2024-09-10T05:23:03.529 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-10T05:23:03.545 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T05:23:03.618 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-09-10_03:21:45-rgw-wip-rgw-meta-handlers-distro-default-smithi/7898714 branch: wip-rgw-meta-handlers description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{ubuntu_latest}} email: null first_in_suite: false job_id: '7898714' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: cbodley-2024-09-10_03:21:45-rgw-wip-rgw-meta-handlers-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-rgw-meta-handlers ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b rgw: ec-data-pool: false frontend: beast thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rgw-meta-handlers sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b owner: scheduled_cbodley@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 seed: 9786 sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b sleep_before_teardown: 0 suite: rgw suite_branch: wip-rgw-meta-handlers suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b targets: smithi002.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPdiEvEC3zyAlQEF3D9ZXtoXsU2Jo0eUvmpV2Ou/EZfhV/S7iiEmZfEjeuGWuqKnxlm08iNoViNXXrkunxw1DRc= smithi062.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFJo4OiAUTUcVu0PHOk8QEko5r45QZsr3KfyM3UbDXuwO4kP219lZtDGJsLkZzHW6Fr4mHyXgkATstC3BButGmQ= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_03:21:45 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-10T05:23:03.619 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa; will attempt to use it 2024-09-10T05:23:03.619 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa/tasks 2024-09-10T05:23:03.620 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-10T05:23:03.621 INFO:teuthology.task.internal:Checking packages... 2024-09-10T05:23:03.643 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'bad475c18c96ec20c5778159aa33ba72b84e9c1b' 2024-09-10T05:23:03.643 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T05:23:03.643 INFO:teuthology.packaging:ref: None 2024-09-10T05:23:03.644 INFO:teuthology.packaging:tag: None 2024-09-10T05:23:03.644 INFO:teuthology.packaging:branch: wip-rgw-meta-handlers 2024-09-10T05:23:03.644 INFO:teuthology.packaging:sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-10T05:23:03.644 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-rgw-meta-handlers 2024-09-10T05:23:03.803 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4762-gbad475c1-1jammy 2024-09-10T05:23:03.804 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-10T05:23:03.811 INFO:teuthology.task.internal:no buildpackages task found 2024-09-10T05:23:03.811 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-10T05:23:03.897 INFO:teuthology.task.internal:Saving configuration 2024-09-10T05:23:03.911 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-10T05:23:04.043 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-10T05:23:04.065 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi002.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-10_03:21:45-rgw-wip-rgw-meta-handlers-distro-default-smithi/7898714', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 05:17:27.307025', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICb3Ybt4Z9wypBAExT/nQurvsh5a1oy+prnO6HIB5HHA'} 2024-09-10T05:23:04.081 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-10_03:21:45-rgw-wip-rgw-meta-handlers-distro-default-smithi/7898714', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 05:17:27.308267', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHerbYnKXbBtYOnIlOz1X2bh9hj6/jilZvR1s/+tGUp/'} 2024-09-10T05:23:04.081 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-10T05:23:04.194 INFO:teuthology.task.internal:roles: ubuntu@smithi002.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2024-09-10T05:23:04.194 INFO:teuthology.task.internal:roles: ubuntu@smithi062.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2024-09-10T05:23:04.194 INFO:teuthology.run_tasks:Running task console_log... 2024-09-10T05:23:04.243 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9cac2afac0>, signals=[15]) 2024-09-10T05:23:04.243 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-10T05:23:04.353 INFO:teuthology.task.internal:Opening connections... 2024-09-10T05:23:04.353 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi002.front.sepia.ceph.com 2024-09-10T05:23:04.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T05:23:04.459 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi062.front.sepia.ceph.com 2024-09-10T05:23:04.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T05:23:04.611 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-10T05:23:05.340 DEBUG:teuthology.orchestra.run.smithi002:> uname -m 2024-09-10T05:23:05.347 INFO:teuthology.orchestra.run.smithi002.stdout:x86_64 2024-09-10T05:23:05.347 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release 2024-09-10T05:23:05.397 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-10T05:23:05.397 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="Ubuntu" 2024-09-10T05:23:05.397 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="22.04" 2024-09-10T05:23:05.398 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-10T05:23:05.398 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_CODENAME=jammy 2024-09-10T05:23:05.398 INFO:teuthology.orchestra.run.smithi002.stdout:ID=ubuntu 2024-09-10T05:23:05.398 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE=debian 2024-09-10T05:23:05.398 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-10T05:23:05.398 INFO:teuthology.orchestra.run.smithi002.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-10T05:23:05.399 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-10T05:23:05.399 INFO:teuthology.orchestra.run.smithi002.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-10T05:23:05.399 INFO:teuthology.orchestra.run.smithi002.stdout:UBUNTU_CODENAME=jammy 2024-09-10T05:23:05.400 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server 2024-09-10T05:23:05.420 DEBUG:teuthology.orchestra.run.smithi062:> uname -m 2024-09-10T05:23:05.426 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64 2024-09-10T05:23:05.426 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2024-09-10T05:23:05.471 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-10T05:23:05.472 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="Ubuntu" 2024-09-10T05:23:05.472 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="22.04" 2024-09-10T05:23:05.472 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-10T05:23:05.472 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_CODENAME=jammy 2024-09-10T05:23:05.472 INFO:teuthology.orchestra.run.smithi062.stdout:ID=ubuntu 2024-09-10T05:23:05.472 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE=debian 2024-09-10T05:23:05.472 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-10T05:23:05.472 INFO:teuthology.orchestra.run.smithi062.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-10T05:23:05.473 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-10T05:23:05.473 INFO:teuthology.orchestra.run.smithi062.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-10T05:23:05.473 INFO:teuthology.orchestra.run.smithi062.stdout:UBUNTU_CODENAME=jammy 2024-09-10T05:23:05.473 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2024-09-10T05:23:05.495 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-10T05:23:05.502 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-10T05:23:05.531 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-10T05:23:05.531 DEBUG:teuthology.orchestra.run.smithi002:> test '!' -e /home/ubuntu/cephtest 2024-09-10T05:23:05.534 DEBUG:teuthology.orchestra.run.smithi062:> test '!' -e /home/ubuntu/cephtest 2024-09-10T05:23:05.539 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-10T05:23:05.569 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-10T05:23:05.569 DEBUG:teuthology.orchestra.run.smithi002:> test -z $(ls -A /var/lib/ceph) 2024-09-10T05:23:05.581 DEBUG:teuthology.orchestra.run.smithi062:> test -z $(ls -A /var/lib/ceph) 2024-09-10T05:23:05.589 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-10T05:23:05.679 INFO:teuthology.run_tasks:Running task kernel... 2024-09-10T05:23:05.697 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-10T05:23:05.697 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-10T05:23:05.697 DEBUG:teuthology.orchestra.run.smithi002:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T05:23:05.698 DEBUG:teuthology.orchestra.run.smithi062:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T05:23:05.702 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T05:23:05.703 DEBUG:teuthology.orchestra.run.smithi002:> uname -r 2024-09-10T05:23:05.703 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T05:23:05.704 DEBUG:teuthology.orchestra.run.smithi062:> uname -r 2024-09-10T05:23:05.752 INFO:teuthology.orchestra.run.smithi062.stdout:5.15.0-56-generic 2024-09-10T05:23:05.752 INFO:teuthology.task.kernel:Running kernel on smithi062: 5.15.0-56-generic 2024-09-10T05:23:05.752 DEBUG:teuthology.orchestra.run.smithi062:> sudo apt-get clean 2024-09-10T05:23:05.753 INFO:teuthology.orchestra.run.smithi002.stdout:5.15.0-56-generic 2024-09-10T05:23:05.753 INFO:teuthology.task.kernel:Running kernel on smithi002: 5.15.0-56-generic 2024-09-10T05:23:05.753 DEBUG:teuthology.orchestra.run.smithi002:> sudo apt-get clean 2024-09-10T05:23:05.872 DEBUG:teuthology.orchestra.run.smithi002:> sudo apt-get update 2024-09-10T05:23:05.943 DEBUG:teuthology.orchestra.run.smithi062:> sudo apt-get update 2024-09-10T05:23:06.012 INFO:teuthology.orchestra.run.smithi002.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-10T05:23:06.012 INFO:teuthology.orchestra.run.smithi002.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-10T05:23:06.012 INFO:teuthology.orchestra.run.smithi002.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-10T05:23:06.091 INFO:teuthology.orchestra.run.smithi002.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-10T05:23:06.213 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-10T05:23:06.214 INFO:teuthology.orchestra.run.smithi062.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-10T05:23:06.249 INFO:teuthology.orchestra.run.smithi002.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-10T05:23:06.280 INFO:teuthology.orchestra.run.smithi062.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-10T05:23:06.345 INFO:teuthology.orchestra.run.smithi002.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-10T05:23:06.364 INFO:teuthology.orchestra.run.smithi002.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-10T05:23:06.368 INFO:teuthology.orchestra.run.smithi002.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-10T05:23:06.371 INFO:teuthology.orchestra.run.smithi002.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-10T05:23:06.371 INFO:teuthology.orchestra.run.smithi002.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-10T05:23:06.372 INFO:teuthology.orchestra.run.smithi002.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-10T05:23:06.393 INFO:teuthology.orchestra.run.smithi002.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-10T05:23:06.396 INFO:teuthology.orchestra.run.smithi002.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-10T05:23:06.396 INFO:teuthology.orchestra.run.smithi002.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-10T05:23:06.407 INFO:teuthology.orchestra.run.smithi002.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-10T05:23:06.413 INFO:teuthology.orchestra.run.smithi002.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-10T05:23:06.415 INFO:teuthology.orchestra.run.smithi002.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-10T05:23:06.415 INFO:teuthology.orchestra.run.smithi002.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-10T05:23:06.416 INFO:teuthology.orchestra.run.smithi002.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-10T05:23:06.416 INFO:teuthology.orchestra.run.smithi002.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-10T05:23:06.447 INFO:teuthology.orchestra.run.smithi002.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-10T05:23:06.447 INFO:teuthology.orchestra.run.smithi002.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-10T05:23:06.453 INFO:teuthology.orchestra.run.smithi002.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-10T05:23:06.457 INFO:teuthology.orchestra.run.smithi002.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-10T05:23:06.457 INFO:teuthology.orchestra.run.smithi002.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-10T05:23:06.457 INFO:teuthology.orchestra.run.smithi002.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-10T05:23:06.480 INFO:teuthology.orchestra.run.smithi002.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-10T05:23:06.483 INFO:teuthology.orchestra.run.smithi002.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-10T05:23:06.483 INFO:teuthology.orchestra.run.smithi002.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-10T05:23:06.495 INFO:teuthology.orchestra.run.smithi002.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-10T05:23:06.501 INFO:teuthology.orchestra.run.smithi002.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-10T05:23:06.503 INFO:teuthology.orchestra.run.smithi002.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-10T05:23:06.504 INFO:teuthology.orchestra.run.smithi002.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-10T05:23:06.504 INFO:teuthology.orchestra.run.smithi002.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-10T05:23:06.516 INFO:teuthology.orchestra.run.smithi002.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-10T05:23:06.516 INFO:teuthology.orchestra.run.smithi002.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-10T05:23:06.517 INFO:teuthology.orchestra.run.smithi002.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-10T05:23:06.517 INFO:teuthology.orchestra.run.smithi002.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-10T05:23:06.531 INFO:teuthology.orchestra.run.smithi002.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-10T05:23:06.532 INFO:teuthology.orchestra.run.smithi002.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-10T05:23:06.532 INFO:teuthology.orchestra.run.smithi002.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-10T05:23:06.532 INFO:teuthology.orchestra.run.smithi002.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-10T05:23:06.548 INFO:teuthology.orchestra.run.smithi002.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-10T05:23:06.549 INFO:teuthology.orchestra.run.smithi002.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-10T05:23:06.637 INFO:teuthology.orchestra.run.smithi062.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-10T05:23:06.663 INFO:teuthology.orchestra.run.smithi062.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-10T05:23:06.777 INFO:teuthology.orchestra.run.smithi062.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-10T05:23:06.958 INFO:teuthology.orchestra.run.smithi062.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-10T05:23:06.972 INFO:teuthology.orchestra.run.smithi062.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-10T05:23:07.131 INFO:teuthology.orchestra.run.smithi062.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-10T05:23:07.131 INFO:teuthology.orchestra.run.smithi062.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-10T05:23:07.144 INFO:teuthology.orchestra.run.smithi062.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-10T05:23:07.145 INFO:teuthology.orchestra.run.smithi062.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-10T05:23:07.145 INFO:teuthology.orchestra.run.smithi062.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-10T05:23:07.147 INFO:teuthology.orchestra.run.smithi062.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-10T05:23:07.147 INFO:teuthology.orchestra.run.smithi062.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-10T05:23:07.167 INFO:teuthology.orchestra.run.smithi062.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-10T05:23:07.215 INFO:teuthology.orchestra.run.smithi062.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-10T05:23:07.230 INFO:teuthology.orchestra.run.smithi062.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-10T05:23:07.239 INFO:teuthology.orchestra.run.smithi062.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-10T05:23:07.239 INFO:teuthology.orchestra.run.smithi062.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-10T05:23:07.253 INFO:teuthology.orchestra.run.smithi062.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-10T05:23:07.253 INFO:teuthology.orchestra.run.smithi062.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-10T05:23:07.260 INFO:teuthology.orchestra.run.smithi062.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-10T05:23:07.280 INFO:teuthology.orchestra.run.smithi062.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-10T05:23:07.289 INFO:teuthology.orchestra.run.smithi062.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-10T05:23:07.295 INFO:teuthology.orchestra.run.smithi062.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-10T05:23:07.296 INFO:teuthology.orchestra.run.smithi062.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-10T05:23:07.297 INFO:teuthology.orchestra.run.smithi062.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-10T05:23:07.298 INFO:teuthology.orchestra.run.smithi062.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-10T05:23:07.298 INFO:teuthology.orchestra.run.smithi062.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-10T05:23:07.307 INFO:teuthology.orchestra.run.smithi062.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-10T05:23:07.308 INFO:teuthology.orchestra.run.smithi062.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-10T05:23:07.309 INFO:teuthology.orchestra.run.smithi062.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-10T05:23:07.310 INFO:teuthology.orchestra.run.smithi062.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-10T05:23:07.377 INFO:teuthology.orchestra.run.smithi062.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-10T05:23:07.378 INFO:teuthology.orchestra.run.smithi062.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-10T05:23:07.378 INFO:teuthology.orchestra.run.smithi062.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-10T05:23:07.380 INFO:teuthology.orchestra.run.smithi062.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-10T05:23:07.381 INFO:teuthology.orchestra.run.smithi062.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-10T05:23:07.459 INFO:teuthology.orchestra.run.smithi062.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-10T05:23:07.459 INFO:teuthology.orchestra.run.smithi062.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-10T05:23:07.460 INFO:teuthology.orchestra.run.smithi062.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-10T05:23:07.461 INFO:teuthology.orchestra.run.smithi062.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-10T05:23:07.462 INFO:teuthology.orchestra.run.smithi062.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-10T05:23:12.991 INFO:teuthology.orchestra.run.smithi002.stdout:Fetched 15.8 MB in 2s (7,147 kB/s) 2024-09-10T05:23:13.756 INFO:teuthology.orchestra.run.smithi062.stdout:Fetched 15.8 MB in 3s (5,648 kB/s) 2024-09-10T05:23:14.478 INFO:teuthology.orchestra.run.smithi002.stdout:Reading package lists... 2024-09-10T05:23:14.496 DEBUG:teuthology.orchestra.run.smithi002:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-10T05:23:14.563 INFO:teuthology.orchestra.run.smithi002.stdout:Reading package lists... 2024-09-10T05:23:14.777 INFO:teuthology.orchestra.run.smithi002.stdout:Building dependency tree... 2024-09-10T05:23:14.778 INFO:teuthology.orchestra.run.smithi002.stdout:Reading state information... 2024-09-10T05:23:14.974 INFO:teuthology.orchestra.run.smithi002.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T05:23:14.974 INFO:teuthology.orchestra.run.smithi002.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T05:23:14.975 INFO:teuthology.orchestra.run.smithi002.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T05:23:14.975 INFO:teuthology.orchestra.run.smithi002.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T05:23:14.975 INFO:teuthology.orchestra.run.smithi002.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-10T05:23:14.975 INFO:teuthology.orchestra.run.smithi002.stdout: python2.7-minimal 2024-09-10T05:23:14.975 INFO:teuthology.orchestra.run.smithi002.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T05:23:14.976 INFO:teuthology.orchestra.run.smithi002.stdout:The following additional packages will be installed: 2024-09-10T05:23:14.977 INFO:teuthology.orchestra.run.smithi002.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-10T05:23:14.977 INFO:teuthology.orchestra.run.smithi002.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-10T05:23:14.977 INFO:teuthology.orchestra.run.smithi002.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-10T05:23:14.978 INFO:teuthology.orchestra.run.smithi002.stdout:Suggested packages: 2024-09-10T05:23:14.978 INFO:teuthology.orchestra.run.smithi002.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-10T05:23:14.979 INFO:teuthology.orchestra.run.smithi002.stdout:Recommended packages: 2024-09-10T05:23:14.979 INFO:teuthology.orchestra.run.smithi002.stdout: thermald 2024-09-10T05:23:15.030 INFO:teuthology.orchestra.run.smithi002.stdout:The following NEW packages will be installed: 2024-09-10T05:23:15.031 INFO:teuthology.orchestra.run.smithi002.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-10T05:23:15.031 INFO:teuthology.orchestra.run.smithi002.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-10T05:23:15.031 INFO:teuthology.orchestra.run.smithi002.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-10T05:23:15.032 INFO:teuthology.orchestra.run.smithi002.stdout:The following packages will be upgraded: 2024-09-10T05:23:15.033 INFO:teuthology.orchestra.run.smithi002.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-10T05:23:15.182 INFO:teuthology.orchestra.run.smithi062.stdout:Reading package lists... 2024-09-10T05:23:15.199 DEBUG:teuthology.orchestra.run.smithi062:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-10T05:23:15.214 INFO:teuthology.orchestra.run.smithi002.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-10T05:23:15.214 INFO:teuthology.orchestra.run.smithi002.stdout:Need to get 113 MB of archives. 2024-09-10T05:23:15.214 INFO:teuthology.orchestra.run.smithi002.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-10T05:23:15.214 INFO:teuthology.orchestra.run.smithi002.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-10T05:23:15.265 INFO:teuthology.orchestra.run.smithi062.stdout:Reading package lists... 2024-09-10T05:23:15.480 INFO:teuthology.orchestra.run.smithi062.stdout:Building dependency tree... 2024-09-10T05:23:15.481 INFO:teuthology.orchestra.run.smithi062.stdout:Reading state information... 2024-09-10T05:23:15.675 INFO:teuthology.orchestra.run.smithi062.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T05:23:15.675 INFO:teuthology.orchestra.run.smithi062.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T05:23:15.675 INFO:teuthology.orchestra.run.smithi062.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T05:23:15.676 INFO:teuthology.orchestra.run.smithi062.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T05:23:15.676 INFO:teuthology.orchestra.run.smithi062.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-10T05:23:15.676 INFO:teuthology.orchestra.run.smithi062.stdout: python2.7-minimal 2024-09-10T05:23:15.676 INFO:teuthology.orchestra.run.smithi062.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T05:23:15.677 INFO:teuthology.orchestra.run.smithi062.stdout:The following additional packages will be installed: 2024-09-10T05:23:15.677 INFO:teuthology.orchestra.run.smithi062.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-10T05:23:15.677 INFO:teuthology.orchestra.run.smithi062.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-10T05:23:15.678 INFO:teuthology.orchestra.run.smithi062.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-10T05:23:15.679 INFO:teuthology.orchestra.run.smithi062.stdout:Suggested packages: 2024-09-10T05:23:15.679 INFO:teuthology.orchestra.run.smithi062.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-10T05:23:15.679 INFO:teuthology.orchestra.run.smithi062.stdout:Recommended packages: 2024-09-10T05:23:15.680 INFO:teuthology.orchestra.run.smithi062.stdout: thermald 2024-09-10T05:23:15.727 INFO:teuthology.orchestra.run.smithi062.stdout:The following NEW packages will be installed: 2024-09-10T05:23:15.728 INFO:teuthology.orchestra.run.smithi062.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-10T05:23:15.728 INFO:teuthology.orchestra.run.smithi062.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-10T05:23:15.728 INFO:teuthology.orchestra.run.smithi062.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-10T05:23:15.729 INFO:teuthology.orchestra.run.smithi062.stdout:The following packages will be upgraded: 2024-09-10T05:23:15.730 INFO:teuthology.orchestra.run.smithi062.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-10T05:23:15.782 INFO:teuthology.orchestra.run.smithi062.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-10T05:23:15.782 INFO:teuthology.orchestra.run.smithi062.stdout:Need to get 113 MB of archives. 2024-09-10T05:23:15.782 INFO:teuthology.orchestra.run.smithi062.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-10T05:23:15.782 INFO:teuthology.orchestra.run.smithi062.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-10T05:23:16.225 INFO:teuthology.orchestra.run.smithi062.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-10T05:23:16.320 INFO:teuthology.orchestra.run.smithi062.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-10T05:23:16.657 INFO:teuthology.orchestra.run.smithi002.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-10T05:23:17.032 INFO:teuthology.orchestra.run.smithi002.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-10T05:23:17.115 INFO:teuthology.orchestra.run.smithi062.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-10T05:23:17.115 INFO:teuthology.orchestra.run.smithi062.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-10T05:23:17.115 INFO:teuthology.orchestra.run.smithi062.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-10T05:23:17.241 INFO:teuthology.orchestra.run.smithi062.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-10T05:23:17.410 INFO:teuthology.orchestra.run.smithi062.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-10T05:23:17.835 INFO:teuthology.orchestra.run.smithi062.stdout:Fetched 113 MB in 2s (67.8 MB/s) 2024-09-10T05:23:18.041 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-10T05:23:19.275 INFO:teuthology.orchestra.run.smithi002.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-10T05:23:19.275 INFO:teuthology.orchestra.run.smithi002.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-10T05:23:19.275 INFO:teuthology.orchestra.run.smithi002.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-10T05:23:19.717 INFO:teuthology.orchestra.run.smithi002.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-10T05:23:19.802 INFO:teuthology.orchestra.run.smithi002.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-10T05:23:19.977 INFO:teuthology.orchestra.run.smithi062.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-10T05:23:19.982 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T05:23:20.088 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T05:23:20.254 INFO:teuthology.orchestra.run.smithi002.stdout:Fetched 113 MB in 5s (23.8 MB/s) 2024-09-10T05:23:20.436 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-10T05:23:22.315 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-10T05:23:22.337 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T05:23:22.393 INFO:teuthology.orchestra.run.smithi002.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-10T05:23:22.398 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T05:23:22.445 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T05:23:22.483 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T05:23:22.927 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-10T05:23:22.948 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T05:23:22.985 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T05:23:24.876 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-10T05:23:24.898 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T05:23:24.991 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T05:23:25.446 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-10T05:23:25.466 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T05:23:25.504 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T05:23:30.057 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-10T05:23:30.190 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-10T05:23:30.482 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-10T05:23:30.626 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-10T05:23:30.938 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-10T05:23:30.960 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-10T05:23:31.029 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-10T05:23:31.713 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-10T05:23:31.839 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-10T05:23:32.173 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-10T05:23:32.302 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-10T05:23:32.588 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-10T05:23:32.610 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-10T05:23:32.646 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-10T05:23:36.595 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-10T05:23:36.633 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T05:23:36.670 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T05:23:38.277 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-10T05:23:38.314 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T05:23:38.351 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T05:23:39.575 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-10T05:23:39.683 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-10T05:23:40.001 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-10T05:23:40.154 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T05:23:40.289 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-10T05:23:40.418 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T05:23:41.073 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-10T05:23:41.172 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-10T05:23:41.489 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-10T05:23:41.957 INFO:teuthology.orchestra.run.smithi062.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-10T05:23:41.957 INFO:teuthology.orchestra.run.smithi062.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-10T05:23:41.957 INFO:teuthology.orchestra.run.smithi062.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-10T05:23:41.957 INFO:teuthology.orchestra.run.smithi062.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-10T05:23:42.436 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T05:23:42.562 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-10T05:23:42.691 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T05:23:43.145 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T05:23:44.077 INFO:teuthology.orchestra.run.smithi002.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-10T05:23:44.077 INFO:teuthology.orchestra.run.smithi002.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-10T05:23:44.077 INFO:teuthology.orchestra.run.smithi002.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-10T05:23:44.077 INFO:teuthology.orchestra.run.smithi002.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-10T05:23:44.242 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T05:23:44.621 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T05:23:45.652 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T05:23:46.031 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-10T05:23:46.157 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-10T05:23:46.300 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T05:23:46.366 INFO:teuthology.orchestra.run.smithi062.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-10T05:23:46.366 INFO:teuthology.orchestra.run.smithi062.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-10T05:23:47.062 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-10T05:23:47.188 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-10T05:23:47.314 INFO:teuthology.orchestra.run.smithi002.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T05:23:47.372 INFO:teuthology.orchestra.run.smithi002.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-10T05:23:47.372 INFO:teuthology.orchestra.run.smithi002.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-10T05:24:00.771 INFO:teuthology.orchestra.run.smithi062.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-10T05:24:00.771 INFO:teuthology.orchestra.run.smithi062.stdout:Sourcing file `/etc/default/grub' 2024-09-10T05:24:00.804 INFO:teuthology.orchestra.run.smithi062.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-10T05:24:00.823 INFO:teuthology.orchestra.run.smithi062.stdout:Generating grub configuration file ... 2024-09-10T05:24:01.073 INFO:teuthology.orchestra.run.smithi062.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-10T05:24:01.085 INFO:teuthology.orchestra.run.smithi062.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-10T05:24:01.428 INFO:teuthology.orchestra.run.smithi062.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-10T05:24:01.434 INFO:teuthology.orchestra.run.smithi062.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-10T05:24:01.461 INFO:teuthology.orchestra.run.smithi002.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-10T05:24:01.461 INFO:teuthology.orchestra.run.smithi002.stdout:Sourcing file `/etc/default/grub' 2024-09-10T05:24:01.478 INFO:teuthology.orchestra.run.smithi002.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-10T05:24:01.497 INFO:teuthology.orchestra.run.smithi002.stdout:Generating grub configuration file ... 2024-09-10T05:24:01.502 INFO:teuthology.orchestra.run.smithi062.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-10T05:24:01.508 INFO:teuthology.orchestra.run.smithi062.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-10T05:24:01.692 INFO:teuthology.orchestra.run.smithi062.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-10T05:24:01.693 INFO:teuthology.orchestra.run.smithi062.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-10T05:24:01.693 INFO:teuthology.orchestra.run.smithi062.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-10T05:24:01.738 INFO:teuthology.orchestra.run.smithi062.stdout:done 2024-09-10T05:24:01.756 INFO:teuthology.orchestra.run.smithi002.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-10T05:24:01.775 INFO:teuthology.orchestra.run.smithi002.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-10T05:24:02.049 INFO:teuthology.orchestra.run.smithi002.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-10T05:24:02.055 INFO:teuthology.orchestra.run.smithi002.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-10T05:24:02.127 INFO:teuthology.orchestra.run.smithi002.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-10T05:24:02.133 INFO:teuthology.orchestra.run.smithi002.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-10T05:24:02.199 DEBUG:teuthology.orchestra.run.smithi062:> dpkg -s linux-image-generic 2024-09-10T05:24:02.226 INFO:teuthology.orchestra.run.smithi062.stdout:Package: linux-image-generic 2024-09-10T05:24:02.226 INFO:teuthology.orchestra.run.smithi062.stdout:Status: install ok installed 2024-09-10T05:24:02.226 INFO:teuthology.orchestra.run.smithi062.stdout:Priority: optional 2024-09-10T05:24:02.226 INFO:teuthology.orchestra.run.smithi062.stdout:Section: kernel 2024-09-10T05:24:02.226 INFO:teuthology.orchestra.run.smithi062.stdout:Installed-Size: 21 2024-09-10T05:24:02.226 INFO:teuthology.orchestra.run.smithi062.stdout:Maintainer: Ubuntu Kernel Team 2024-09-10T05:24:02.226 INFO:teuthology.orchestra.run.smithi062.stdout:Architecture: amd64 2024-09-10T05:24:02.226 INFO:teuthology.orchestra.run.smithi062.stdout:Source: linux-meta 2024-09-10T05:24:02.226 INFO:teuthology.orchestra.run.smithi062.stdout:Version: 5.15.0.119.119 2024-09-10T05:24:02.227 INFO:teuthology.orchestra.run.smithi062.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-10T05:24:02.227 INFO:teuthology.orchestra.run.smithi062.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-10T05:24:02.227 INFO:teuthology.orchestra.run.smithi062.stdout:Recommends: thermald 2024-09-10T05:24:02.227 INFO:teuthology.orchestra.run.smithi062.stdout:Description: Generic Linux kernel image 2024-09-10T05:24:02.227 INFO:teuthology.orchestra.run.smithi062.stdout: This package will always depend on the latest generic kernel image 2024-09-10T05:24:02.227 INFO:teuthology.orchestra.run.smithi062.stdout: available. 2024-09-10T05:24:02.227 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-10T05:24:02.227 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-10T05:24:02.227 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-10T05:24:02.228 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-09-10T05:24:02.228 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi062.front.sepia.ceph.com, path=None, version=distro) 2024-09-10T05:24:02.228 DEBUG:teuthology.orchestra.run.smithi062:> sudo apt-get clean 2024-09-10T05:24:02.286 INFO:teuthology.orchestra.run.smithi002.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-10T05:24:02.286 INFO:teuthology.orchestra.run.smithi002.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-10T05:24:02.286 INFO:teuthology.orchestra.run.smithi002.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-10T05:24:02.321 INFO:teuthology.orchestra.run.smithi002.stdout:done 2024-09-10T05:24:02.414 DEBUG:teuthology.orchestra.run.smithi062:> sudo apt-get update 2024-09-10T05:24:02.547 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-10T05:24:02.668 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-10T05:24:02.750 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-10T05:24:02.808 DEBUG:teuthology.orchestra.run.smithi002:> dpkg -s linux-image-generic 2024-09-10T05:24:02.834 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-10T05:24:02.835 INFO:teuthology.orchestra.run.smithi002.stdout:Package: linux-image-generic 2024-09-10T05:24:02.835 INFO:teuthology.orchestra.run.smithi002.stdout:Status: install ok installed 2024-09-10T05:24:02.835 INFO:teuthology.orchestra.run.smithi002.stdout:Priority: optional 2024-09-10T05:24:02.835 INFO:teuthology.orchestra.run.smithi002.stdout:Section: kernel 2024-09-10T05:24:02.835 INFO:teuthology.orchestra.run.smithi002.stdout:Installed-Size: 21 2024-09-10T05:24:02.835 INFO:teuthology.orchestra.run.smithi002.stdout:Maintainer: Ubuntu Kernel Team 2024-09-10T05:24:02.835 INFO:teuthology.orchestra.run.smithi002.stdout:Architecture: amd64 2024-09-10T05:24:02.835 INFO:teuthology.orchestra.run.smithi002.stdout:Source: linux-meta 2024-09-10T05:24:02.835 INFO:teuthology.orchestra.run.smithi002.stdout:Version: 5.15.0.119.119 2024-09-10T05:24:02.835 INFO:teuthology.orchestra.run.smithi002.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-10T05:24:02.835 INFO:teuthology.orchestra.run.smithi002.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-10T05:24:02.836 INFO:teuthology.orchestra.run.smithi002.stdout:Recommends: thermald 2024-09-10T05:24:02.836 INFO:teuthology.orchestra.run.smithi002.stdout:Description: Generic Linux kernel image 2024-09-10T05:24:02.836 INFO:teuthology.orchestra.run.smithi002.stdout: This package will always depend on the latest generic kernel image 2024-09-10T05:24:02.836 INFO:teuthology.orchestra.run.smithi002.stdout: available. 2024-09-10T05:24:02.836 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-10T05:24:02.836 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-10T05:24:02.836 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-10T05:24:02.836 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-10T05:24:02.836 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi002.front.sepia.ceph.com, path=None, version=distro) 2024-09-10T05:24:02.837 DEBUG:teuthology.orchestra.run.smithi002:> sudo apt-get clean 2024-09-10T05:24:03.013 DEBUG:teuthology.orchestra.run.smithi002:> sudo apt-get update 2024-09-10T05:24:03.270 INFO:teuthology.orchestra.run.smithi002.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-10T05:24:03.270 INFO:teuthology.orchestra.run.smithi002.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-10T05:24:03.341 INFO:teuthology.orchestra.run.smithi002.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-10T05:24:03.424 INFO:teuthology.orchestra.run.smithi002.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-10T05:24:04.048 INFO:teuthology.orchestra.run.smithi062.stdout:Reading package lists... 2024-09-10T05:24:04.066 DEBUG:teuthology.orchestra.run.smithi062:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-10T05:24:04.121 INFO:teuthology.orchestra.run.smithi062.stdout:Reading package lists... 2024-09-10T05:24:04.311 INFO:teuthology.orchestra.run.smithi062.stdout:Building dependency tree... 2024-09-10T05:24:04.312 INFO:teuthology.orchestra.run.smithi062.stdout:Reading state information... 2024-09-10T05:24:04.481 INFO:teuthology.orchestra.run.smithi062.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-10T05:24:04.482 INFO:teuthology.orchestra.run.smithi062.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T05:24:04.482 INFO:teuthology.orchestra.run.smithi062.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T05:24:04.482 INFO:teuthology.orchestra.run.smithi062.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T05:24:04.482 INFO:teuthology.orchestra.run.smithi062.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T05:24:04.482 INFO:teuthology.orchestra.run.smithi062.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-10T05:24:04.483 INFO:teuthology.orchestra.run.smithi062.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-10T05:24:04.483 INFO:teuthology.orchestra.run.smithi062.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T05:24:04.525 INFO:teuthology.orchestra.run.smithi062.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-10T05:24:04.527 DEBUG:teuthology.orchestra.run.smithi062:> dpkg -s linux-image-generic 2024-09-10T05:24:04.585 INFO:teuthology.orchestra.run.smithi062.stdout:Package: linux-image-generic 2024-09-10T05:24:04.585 INFO:teuthology.orchestra.run.smithi062.stdout:Status: install ok installed 2024-09-10T05:24:04.585 INFO:teuthology.orchestra.run.smithi062.stdout:Priority: optional 2024-09-10T05:24:04.585 INFO:teuthology.orchestra.run.smithi062.stdout:Section: kernel 2024-09-10T05:24:04.585 INFO:teuthology.orchestra.run.smithi062.stdout:Installed-Size: 21 2024-09-10T05:24:04.586 INFO:teuthology.orchestra.run.smithi062.stdout:Maintainer: Ubuntu Kernel Team 2024-09-10T05:24:04.586 INFO:teuthology.orchestra.run.smithi062.stdout:Architecture: amd64 2024-09-10T05:24:04.586 INFO:teuthology.orchestra.run.smithi062.stdout:Source: linux-meta 2024-09-10T05:24:04.586 INFO:teuthology.orchestra.run.smithi062.stdout:Version: 5.15.0.119.119 2024-09-10T05:24:04.586 INFO:teuthology.orchestra.run.smithi062.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-10T05:24:04.586 INFO:teuthology.orchestra.run.smithi062.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-10T05:24:04.586 INFO:teuthology.orchestra.run.smithi062.stdout:Recommends: thermald 2024-09-10T05:24:04.586 INFO:teuthology.orchestra.run.smithi062.stdout:Description: Generic Linux kernel image 2024-09-10T05:24:04.586 INFO:teuthology.orchestra.run.smithi062.stdout: This package will always depend on the latest generic kernel image 2024-09-10T05:24:04.586 INFO:teuthology.orchestra.run.smithi062.stdout: available. 2024-09-10T05:24:04.587 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2024-09-10T05:24:04.635 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.5FOe7427N9 2024-09-10T05:24:04.635 DEBUG:teuthology.orchestra.run.smithi062:> sudo cp /boot/grub/grub.cfg /tmp/tmp.5FOe7427N9 2024-09-10T05:24:04.691 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.5FOe7427N9 2024-09-10T05:24:04.697 INFO:teuthology.orchestra.run.smithi002.stdout:Reading package lists... 2024-09-10T05:24:04.715 DEBUG:teuthology.orchestra.run.smithi002:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-10T05:24:04.778 INFO:teuthology.orchestra.run.smithi002.stdout:Reading package lists... 2024-09-10T05:24:04.807 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.5FOe7427N9 is 10KB 2024-09-10T05:24:04.819 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.5FOe7427N9 2024-09-10T05:24:04.827 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-10T05:24:04.883 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-10T05:24:04.883 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-10T05:24:04.883 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-10T05:24:04.950 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-10T05:24:04.950 DEBUG:teuthology.orchestra.run.smithi062:> sudo update-grub 2024-09-10T05:24:04.997 INFO:teuthology.orchestra.run.smithi002.stdout:Building dependency tree... 2024-09-10T05:24:04.998 INFO:teuthology.orchestra.run.smithi002.stdout:Reading state information... 2024-09-10T05:24:05.195 INFO:teuthology.orchestra.run.smithi002.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-10T05:24:05.195 INFO:teuthology.orchestra.run.smithi002.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T05:24:05.195 INFO:teuthology.orchestra.run.smithi002.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T05:24:05.195 INFO:teuthology.orchestra.run.smithi002.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T05:24:05.195 INFO:teuthology.orchestra.run.smithi002.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T05:24:05.195 INFO:teuthology.orchestra.run.smithi002.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-10T05:24:05.196 INFO:teuthology.orchestra.run.smithi002.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-10T05:24:05.196 INFO:teuthology.orchestra.run.smithi002.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T05:24:05.241 INFO:teuthology.orchestra.run.smithi002.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-10T05:24:05.243 DEBUG:teuthology.orchestra.run.smithi002:> dpkg -s linux-image-generic 2024-09-10T05:24:05.257 INFO:teuthology.orchestra.run.smithi002.stdout:Package: linux-image-generic 2024-09-10T05:24:05.257 INFO:teuthology.orchestra.run.smithi002.stdout:Status: install ok installed 2024-09-10T05:24:05.257 INFO:teuthology.orchestra.run.smithi002.stdout:Priority: optional 2024-09-10T05:24:05.257 INFO:teuthology.orchestra.run.smithi002.stdout:Section: kernel 2024-09-10T05:24:05.257 INFO:teuthology.orchestra.run.smithi002.stdout:Installed-Size: 21 2024-09-10T05:24:05.257 INFO:teuthology.orchestra.run.smithi002.stdout:Maintainer: Ubuntu Kernel Team 2024-09-10T05:24:05.257 INFO:teuthology.orchestra.run.smithi002.stdout:Architecture: amd64 2024-09-10T05:24:05.257 INFO:teuthology.orchestra.run.smithi002.stdout:Source: linux-meta 2024-09-10T05:24:05.257 INFO:teuthology.orchestra.run.smithi002.stdout:Version: 5.15.0.119.119 2024-09-10T05:24:05.257 INFO:teuthology.orchestra.run.smithi002.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-10T05:24:05.257 INFO:teuthology.orchestra.run.smithi002.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-10T05:24:05.258 INFO:teuthology.orchestra.run.smithi002.stdout:Recommends: thermald 2024-09-10T05:24:05.258 INFO:teuthology.orchestra.run.smithi002.stdout:Description: Generic Linux kernel image 2024-09-10T05:24:05.258 INFO:teuthology.orchestra.run.smithi002.stdout: This package will always depend on the latest generic kernel image 2024-09-10T05:24:05.258 INFO:teuthology.orchestra.run.smithi002.stdout: available. 2024-09-10T05:24:05.258 DEBUG:teuthology.orchestra.run.smithi002:> mktemp 2024-09-10T05:24:05.303 INFO:teuthology.orchestra.run.smithi002.stdout:/tmp/tmp.XHrCwCLLWm 2024-09-10T05:24:05.303 DEBUG:teuthology.orchestra.run.smithi002:> sudo cp /boot/grub/grub.cfg /tmp/tmp.XHrCwCLLWm 2024-09-10T05:24:05.368 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0666 /tmp/tmp.XHrCwCLLWm 2024-09-10T05:24:05.477 DEBUG:teuthology.orchestra.remote:smithi002:/tmp/tmp.XHrCwCLLWm is 10KB 2024-09-10T05:24:05.490 DEBUG:teuthology.orchestra.run.smithi002:> rm -fr /tmp/tmp.XHrCwCLLWm 2024-09-10T05:24:05.495 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-10T05:24:05.551 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T05:24:05.551 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-10T05:24:05.551 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-10T05:24:05.628 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-10T05:24:05.628 DEBUG:teuthology.orchestra.run.smithi002:> sudo update-grub 2024-09-10T05:24:06.253 INFO:teuthology.orchestra.run.smithi062.stderr:Sourcing file `/etc/default/grub' 2024-09-10T05:24:06.254 INFO:teuthology.orchestra.run.smithi062.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-10T05:24:06.256 INFO:teuthology.orchestra.run.smithi062.stderr:Generating grub configuration file ... 2024-09-10T05:24:06.457 INFO:teuthology.orchestra.run.smithi062.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-10T05:24:06.464 INFO:teuthology.orchestra.run.smithi062.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-10T05:24:06.792 INFO:teuthology.orchestra.run.smithi062.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-10T05:24:06.798 INFO:teuthology.orchestra.run.smithi062.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-10T05:24:06.814 INFO:teuthology.orchestra.run.smithi002.stderr:Sourcing file `/etc/default/grub' 2024-09-10T05:24:06.816 INFO:teuthology.orchestra.run.smithi002.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-10T05:24:06.818 INFO:teuthology.orchestra.run.smithi002.stderr:Generating grub configuration file ... 2024-09-10T05:24:06.842 INFO:teuthology.orchestra.run.smithi062.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-10T05:24:06.847 INFO:teuthology.orchestra.run.smithi062.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-10T05:24:06.994 INFO:teuthology.orchestra.run.smithi062.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-10T05:24:06.994 INFO:teuthology.orchestra.run.smithi062.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-10T05:24:06.994 INFO:teuthology.orchestra.run.smithi062.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-10T05:24:07.004 INFO:teuthology.orchestra.run.smithi002.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-10T05:24:07.007 INFO:teuthology.orchestra.run.smithi062.stderr:done 2024-09-10T05:24:07.012 INFO:teuthology.orchestra.run.smithi002.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-10T05:24:07.021 DEBUG:teuthology.orchestra.run.smithi062:> sudo shutdown -r now 2024-09-10T05:24:07.245 INFO:teuthology.orchestra.run.smithi002.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-10T05:24:07.250 INFO:teuthology.orchestra.run.smithi002.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-10T05:24:07.295 INFO:teuthology.orchestra.run.smithi002.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-10T05:24:07.301 INFO:teuthology.orchestra.run.smithi002.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-10T05:24:07.416 INFO:teuthology.orchestra.run.smithi002.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-10T05:24:07.417 INFO:teuthology.orchestra.run.smithi002.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-10T05:24:07.417 INFO:teuthology.orchestra.run.smithi002.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-10T05:24:07.427 INFO:teuthology.orchestra.run.smithi002.stderr:done 2024-09-10T05:24:07.436 DEBUG:teuthology.orchestra.run.smithi002:> sudo shutdown -r now 2024-09-10T05:24:37.053 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-09-10T05:24:37.054 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-09-10T05:24:37.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T05:24:37.439 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-10T05:24:37.440 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-10T05:24:37.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T05:25:11.617 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.62 2024-09-10T05:25:20.625 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-09-10T05:25:20.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T05:25:37.457 DEBUG:teuthology.orchestra.remote:timed out 2024-09-10T05:25:39.005 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.62 2024-09-10T05:25:46.461 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-10T05:25:46.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T05:25:50.300 DEBUG:teuthology.orchestra.run.smithi002:> true 2024-09-10T05:25:51.006 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-09-10T05:25:51.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T05:25:51.330 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-10T05:25:51.330 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-119-generic"... 2024-09-10T05:25:51.331 DEBUG:teuthology.orchestra.run.smithi002:> uname -r 2024-09-10T05:25:51.379 INFO:teuthology.orchestra.run.smithi002.stdout:5.15.0-119-generic 2024-09-10T05:25:51.379 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-10T05:25:51.379 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T05:25:51.380 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-10T05:25:51.512 DEBUG:teuthology.orchestra.run.smithi062:> true 2024-09-10T05:25:52.380 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-10T05:25:52.380 DEBUG:teuthology.orchestra.run.smithi002:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-10T05:25:52.476 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-09-10T05:25:52.476 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.15.0-119-generic"... 2024-09-10T05:25:52.476 DEBUG:teuthology.orchestra.run.smithi062:> uname -r 2024-09-10T05:25:52.481 INFO:teuthology.orchestra.run.smithi062.stdout:5.15.0-119-generic 2024-09-10T05:25:52.482 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-10T05:25:52.482 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T05:25:52.482 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-10T05:25:52.532 INFO:teuthology.orchestra.run.smithi002.stdout:ttyS1 2024-09-10T05:25:52.561 DEBUG:teuthology.parallel:result is None 2024-09-10T05:25:53.482 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-09-10T05:25:53.482 DEBUG:teuthology.orchestra.run.smithi062:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-10T05:25:53.653 INFO:teuthology.orchestra.run.smithi062.stdout:ttyS1 2024-09-10T05:25:53.685 DEBUG:teuthology.parallel:result is None 2024-09-10T05:25:53.686 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-10T05:25:53.693 INFO:teuthology.task.internal:Creating test directory... 2024-09-10T05:25:53.693 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T05:25:53.696 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T05:25:53.706 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-10T05:25:53.886 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-10T05:25:53.958 INFO:teuthology.task.internal:Creating archive directory... 2024-09-10T05:25:53.959 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T05:25:53.961 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T05:25:54.014 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-10T05:25:54.100 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-10T05:25:54.100 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T05:25:54.103 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T05:25:54.158 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T05:25:54.166 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T05:25:54.196 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T05:25:54.205 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T05:25:54.207 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-10T05:25:54.215 INFO:teuthology.task.internal:Configuring sudo... 2024-09-10T05:25:54.215 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T05:25:54.218 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T05:25:54.240 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-10T05:25:54.451 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-10T05:25:54.451 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T05:25:54.453 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T05:25:54.459 DEBUG:teuthology.orchestra.run.smithi002:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T05:25:54.503 DEBUG:teuthology.orchestra.run.smithi002:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T05:25:54.551 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T05:25:54.551 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T05:25:54.639 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T05:25:54.645 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T05:25:54.696 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-10T05:25:54.696 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T05:25:54.762 DEBUG:teuthology.orchestra.run.smithi002:> sudo service rsyslog restart 2024-09-10T05:25:54.764 DEBUG:teuthology.orchestra.run.smithi062:> sudo service rsyslog restart 2024-09-10T05:25:54.897 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-10T05:25:54.904 INFO:teuthology.task.internal:Starting timer... 2024-09-10T05:25:54.904 INFO:teuthology.run_tasks:Running task pcp... 2024-09-10T05:25:55.042 INFO:teuthology.run_tasks:Running task selinux... 2024-09-10T05:25:55.298 DEBUG:teuthology.task.selinux:Excluding smithi002: OS 'ubuntu' does not support SELinux 2024-09-10T05:25:55.298 DEBUG:teuthology.task.selinux:Excluding smithi062: OS 'ubuntu' does not support SELinux 2024-09-10T05:25:55.299 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-10T05:25:55.299 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-10T05:25:55.299 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-10T05:25:55.299 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-10T05:25:55.367 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-10T05:25:55.380 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-10T05:25:55.381 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi002.front.sepia.ceph.com,smithi062.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-10T05:33:30.401 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi002.front.sepia.ceph.com'), Remote(name='ubuntu@smithi062.front.sepia.ceph.com')] 2024-09-10T05:33:30.403 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-10T05:33:30.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T05:33:30.509 DEBUG:teuthology.orchestra.run.smithi002:> true 2024-09-10T05:33:30.589 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-10T05:33:30.589 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-09-10T05:33:30.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T05:33:30.675 DEBUG:teuthology.orchestra.run.smithi062:> true 2024-09-10T05:33:30.753 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-09-10T05:33:30.753 INFO:teuthology.run_tasks:Running task clock... 2024-09-10T05:33:30.763 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-10T05:33:30.764 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T05:33:30.764 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T05:33:30.767 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T05:33:30.767 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T05:33:30.797 INFO:teuthology.orchestra.run.smithi002.stdout:10 Sep 05:33:30 ntpd[18360]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-10T05:33:30.797 INFO:teuthology.orchestra.run.smithi002.stdout:10 Sep 05:33:30 ntpd[18360]: Command line: ntpd -gq 2024-09-10T05:33:30.797 INFO:teuthology.orchestra.run.smithi002.stdout:10 Sep 05:33:30 ntpd[18360]: ---------------------------------------------------- 2024-09-10T05:33:30.797 INFO:teuthology.orchestra.run.smithi002.stdout:10 Sep 05:33:30 ntpd[18360]: ntp-4 is maintained by Network Time Foundation, 2024-09-10T05:33:30.797 INFO:teuthology.orchestra.run.smithi002.stdout:10 Sep 05:33:30 ntpd[18360]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-10T05:33:30.797 INFO:teuthology.orchestra.run.smithi002.stdout:10 Sep 05:33:30 ntpd[18360]: corporation. Support and training for ntp-4 are 2024-09-10T05:33:30.798 INFO:teuthology.orchestra.run.smithi002.stdout:10 Sep 05:33:30 ntpd[18360]: available at https://www.nwtime.org/support 2024-09-10T05:33:30.798 INFO:teuthology.orchestra.run.smithi002.stdout:10 Sep 05:33:30 ntpd[18360]: ---------------------------------------------------- 2024-09-10T05:33:30.798 INFO:teuthology.orchestra.run.smithi002.stdout:10 Sep 05:33:30 ntpd[18360]: proto: precision = 0.066 usec (-24) 2024-09-10T05:33:30.798 INFO:teuthology.orchestra.run.smithi002.stdout:10 Sep 05:33:30 ntpd[18360]: basedate set to 2022-02-04 2024-09-10T05:33:30.798 INFO:teuthology.orchestra.run.smithi002.stdout:10 Sep 05:33:30 ntpd[18360]: gps base set to 2022-02-06 (week 2196) 2024-09-10T05:33:30.798 INFO:teuthology.orchestra.run.smithi002.stdout:10 Sep 05:33:30 ntpd[18360]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-10T05:33:30.798 INFO:teuthology.orchestra.run.smithi002.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-10T05:33:30.798 INFO:teuthology.orchestra.run.smithi002.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-10T05:33:30.800 INFO:teuthology.orchestra.run.smithi002.stdout:10 Sep 05:33:30 ntpd[18360]: restrict ::: KOD does nothing without LIMITED. 2024-09-10T05:33:30.800 INFO:teuthology.orchestra.run.smithi002.stdout:10 Sep 05:33:30 ntpd[18360]: Listen and drop on 0 v6wildcard [::]:123 2024-09-10T05:33:30.800 INFO:teuthology.orchestra.run.smithi002.stdout:10 Sep 05:33:30 ntpd[18360]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-10T05:33:30.800 INFO:teuthology.orchestra.run.smithi002.stdout:10 Sep 05:33:30 ntpd[18360]: Listen normally on 2 lo 127.0.0.1:123 2024-09-10T05:33:30.800 INFO:teuthology.orchestra.run.smithi002.stdout:10 Sep 05:33:30 ntpd[18360]: Listen normally on 3 ens1f0 172.21.15.2:123 2024-09-10T05:33:30.800 INFO:teuthology.orchestra.run.smithi002.stdout:10 Sep 05:33:30 ntpd[18360]: Listen normally on 4 lo [::1]:123 2024-09-10T05:33:30.800 INFO:teuthology.orchestra.run.smithi002.stdout:10 Sep 05:33:30 ntpd[18360]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1920%4]:123 2024-09-10T05:33:30.800 INFO:teuthology.orchestra.run.smithi002.stdout:10 Sep 05:33:30 ntpd[18360]: Listening on routing socket on fd #22 for interface updates 2024-09-10T05:33:30.828 INFO:teuthology.orchestra.run.smithi062.stdout:10 Sep 05:33:30 ntpd[18478]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-10T05:33:30.829 INFO:teuthology.orchestra.run.smithi062.stdout:10 Sep 05:33:30 ntpd[18478]: Command line: ntpd -gq 2024-09-10T05:33:30.829 INFO:teuthology.orchestra.run.smithi062.stdout:10 Sep 05:33:30 ntpd[18478]: ---------------------------------------------------- 2024-09-10T05:33:30.829 INFO:teuthology.orchestra.run.smithi062.stdout:10 Sep 05:33:30 ntpd[18478]: ntp-4 is maintained by Network Time Foundation, 2024-09-10T05:33:30.829 INFO:teuthology.orchestra.run.smithi062.stdout:10 Sep 05:33:30 ntpd[18478]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-10T05:33:30.829 INFO:teuthology.orchestra.run.smithi062.stdout:10 Sep 05:33:30 ntpd[18478]: corporation. Support and training for ntp-4 are 2024-09-10T05:33:30.829 INFO:teuthology.orchestra.run.smithi062.stdout:10 Sep 05:33:30 ntpd[18478]: available at https://www.nwtime.org/support 2024-09-10T05:33:30.829 INFO:teuthology.orchestra.run.smithi062.stdout:10 Sep 05:33:30 ntpd[18478]: ---------------------------------------------------- 2024-09-10T05:33:30.829 INFO:teuthology.orchestra.run.smithi062.stdout:10 Sep 05:33:30 ntpd[18478]: proto: precision = 0.045 usec (-24) 2024-09-10T05:33:30.829 INFO:teuthology.orchestra.run.smithi062.stdout:10 Sep 05:33:30 ntpd[18478]: basedate set to 2022-02-04 2024-09-10T05:33:30.829 INFO:teuthology.orchestra.run.smithi062.stdout:10 Sep 05:33:30 ntpd[18478]: gps base set to 2022-02-06 (week 2196) 2024-09-10T05:33:30.829 INFO:teuthology.orchestra.run.smithi062.stdout:10 Sep 05:33:30 ntpd[18478]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-10T05:33:30.830 INFO:teuthology.orchestra.run.smithi062.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-10T05:33:30.830 INFO:teuthology.orchestra.run.smithi062.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-10T05:33:30.831 INFO:teuthology.orchestra.run.smithi062.stdout:10 Sep 05:33:30 ntpd[18478]: restrict ::: KOD does nothing without LIMITED. 2024-09-10T05:33:30.831 INFO:teuthology.orchestra.run.smithi062.stdout:10 Sep 05:33:30 ntpd[18478]: Listen and drop on 0 v6wildcard [::]:123 2024-09-10T05:33:30.831 INFO:teuthology.orchestra.run.smithi062.stdout:10 Sep 05:33:30 ntpd[18478]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-10T05:33:30.831 INFO:teuthology.orchestra.run.smithi062.stdout:10 Sep 05:33:30 ntpd[18478]: Listen normally on 2 lo 127.0.0.1:123 2024-09-10T05:33:30.831 INFO:teuthology.orchestra.run.smithi062.stdout:10 Sep 05:33:30 ntpd[18478]: Listen normally on 3 enp3s0f1 172.21.15.62:123 2024-09-10T05:33:30.831 INFO:teuthology.orchestra.run.smithi062.stdout:10 Sep 05:33:30 ntpd[18478]: Listen normally on 4 lo [::1]:123 2024-09-10T05:33:30.831 INFO:teuthology.orchestra.run.smithi062.stdout:10 Sep 05:33:30 ntpd[18478]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:febb:d1c3%5]:123 2024-09-10T05:33:30.831 INFO:teuthology.orchestra.run.smithi062.stdout:10 Sep 05:33:30 ntpd[18478]: Listening on routing socket on fd #22 for interface updates 2024-09-10T05:33:31.798 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:31 ntpd[18360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:33:31.798 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:31 ntpd[18360]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:33:31.798 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:31 ntpd[18360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:33:31.798 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:31 ntpd[18360]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:33:31.798 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:31 ntpd[18360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:33:31.798 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:31 ntpd[18360]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:33:31.798 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:31 ntpd[18360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:33:31.798 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:31 ntpd[18360]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:33:31.798 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:31 ntpd[18360]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T05:33:31.798 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:31 ntpd[18360]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T05:33:31.798 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:31 ntpd[18360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:33:31.799 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:31 ntpd[18360]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:33:31.799 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:31 ntpd[18360]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T05:33:31.799 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:31 ntpd[18360]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T05:33:32.828 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:32 ntpd[18478]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:33:32.828 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:32 ntpd[18478]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:33:33.798 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:33 ntpd[18360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:33:33.798 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:33 ntpd[18360]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:33:33.798 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:33 ntpd[18360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:33:33.798 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:33 ntpd[18360]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:33:33.798 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:33 ntpd[18360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:33:33.798 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:33 ntpd[18360]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:33:33.798 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:33 ntpd[18360]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T05:33:33.798 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:33 ntpd[18360]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T05:33:33.798 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:33 ntpd[18360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:33:33.798 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:33 ntpd[18360]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:33:33.799 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:33 ntpd[18360]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T05:33:33.799 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:33 ntpd[18360]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T05:33:33.829 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:33 ntpd[18478]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:33:33.829 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:33 ntpd[18478]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:33:33.829 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:33 ntpd[18478]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:33:33.829 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:33 ntpd[18478]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:33:33.829 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:33 ntpd[18478]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:33:33.830 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:33 ntpd[18478]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:33:33.830 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:33 ntpd[18478]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T05:33:33.830 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:33 ntpd[18478]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T05:33:33.830 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:33 ntpd[18478]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:33:33.830 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:33 ntpd[18478]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:33:33.830 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:33 ntpd[18478]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T05:33:33.830 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:33 ntpd[18478]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T05:33:34.797 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:34 ntpd[18360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:33:34.797 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:34 ntpd[18360]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:33:34.797 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:34 ntpd[18360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:33:34.797 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:34 ntpd[18360]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:33:34.797 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:34 ntpd[18360]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T05:33:34.797 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:34 ntpd[18360]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T05:33:34.829 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:34 ntpd[18478]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:33:34.829 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:34 ntpd[18478]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:33:34.829 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:34 ntpd[18478]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:33:34.829 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:34 ntpd[18478]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:33:34.829 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:34 ntpd[18478]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T05:33:34.829 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:34 ntpd[18478]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T05:33:35.797 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:35 ntpd[18360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:33:35.798 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:35 ntpd[18360]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:33:35.798 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:35 ntpd[18360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:33:35.798 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:35 ntpd[18360]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:33:35.798 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:35 ntpd[18360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:33:35.798 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:35 ntpd[18360]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:33:35.798 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:35 ntpd[18360]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T05:33:35.798 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:35 ntpd[18360]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T05:33:35.798 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:35 ntpd[18360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:33:35.798 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:35 ntpd[18360]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:33:35.798 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:35 ntpd[18360]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T05:33:35.798 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:35 ntpd[18360]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T05:33:35.829 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:35 ntpd[18478]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:33:35.829 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:35 ntpd[18478]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:33:35.829 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:35 ntpd[18478]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:33:35.829 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:35 ntpd[18478]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:33:35.830 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:35 ntpd[18478]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:33:35.830 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:35 ntpd[18478]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:33:35.830 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:35 ntpd[18478]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T05:33:35.830 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:35 ntpd[18478]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T05:33:35.830 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:35 ntpd[18478]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:33:35.830 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:35 ntpd[18478]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:33:35.830 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:35 ntpd[18478]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T05:33:35.830 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:35 ntpd[18478]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T05:33:36.797 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:36 ntpd[18360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:33:36.797 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:36 ntpd[18360]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:33:36.797 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:36 ntpd[18360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:33:36.797 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:36 ntpd[18360]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:33:36.797 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:36 ntpd[18360]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T05:33:36.797 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:36 ntpd[18360]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T05:33:36.828 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:36 ntpd[18478]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:33:36.828 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:36 ntpd[18478]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:33:36.829 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:36 ntpd[18478]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:33:36.829 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:36 ntpd[18478]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:33:36.829 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:36 ntpd[18478]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T05:33:36.829 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:36 ntpd[18478]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T05:33:37.797 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:37 ntpd[18360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:33:37.797 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:37 ntpd[18360]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:33:37.797 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:37 ntpd[18360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:33:37.797 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:37 ntpd[18360]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:33:37.797 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:37 ntpd[18360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:33:37.798 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:37 ntpd[18360]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:33:37.798 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:37 ntpd[18360]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T05:33:37.798 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:37 ntpd[18360]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T05:33:37.798 INFO:teuthology.orchestra.run.smithi002.stdout:10 Sep 05:33:37 ntpd[18360]: ntpd: time slew -0.000920 s 2024-09-10T05:33:37.798 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd: time slew -0.000920s 2024-09-10T05:33:37.799 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:37 ntpd[18360]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-10T05:33:37.799 INFO:teuthology.orchestra.run.smithi002.stderr:10 Sep 05:33:37 ntpd[18360]: can't open /var/log/ntpstats/loopstats.20240910: Permission denied 2024-09-10T05:33:37.829 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:37 ntpd[18478]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:33:37.829 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:37 ntpd[18478]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:33:37.829 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:37 ntpd[18478]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:33:37.829 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:37 ntpd[18478]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:33:37.829 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:37 ntpd[18478]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:33:37.829 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:37 ntpd[18478]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:33:37.829 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:37 ntpd[18478]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T05:33:37.829 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:37 ntpd[18478]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T05:33:37.830 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:37 ntpd[18478]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:33:37.830 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:37 ntpd[18478]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:33:37.830 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:37 ntpd[18478]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T05:33:37.830 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:37 ntpd[18478]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T05:33:37.854 INFO:teuthology.orchestra.run.smithi002.stdout: remote refid st t when poll reach delay offset jitter 2024-09-10T05:33:37.854 INFO:teuthology.orchestra.run.smithi002.stdout:============================================================================== 2024-09-10T05:33:37.854 INFO:teuthology.orchestra.run.smithi002.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T05:33:37.854 INFO:teuthology.orchestra.run.smithi002.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T05:33:37.854 INFO:teuthology.orchestra.run.smithi002.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T05:33:37.854 INFO:teuthology.orchestra.run.smithi002.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T05:33:38.828 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:38 ntpd[18478]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:33:38.829 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:38 ntpd[18478]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:33:38.829 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:38 ntpd[18478]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:33:38.829 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:38 ntpd[18478]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:33:38.829 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:38 ntpd[18478]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T05:33:38.829 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:38 ntpd[18478]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T05:33:39.829 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:39 ntpd[18478]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:33:39.829 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:39 ntpd[18478]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:33:39.829 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:39 ntpd[18478]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:33:39.829 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:39 ntpd[18478]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:33:39.829 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:39 ntpd[18478]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:33:39.829 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:39 ntpd[18478]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:33:39.829 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:39 ntpd[18478]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T05:33:39.829 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:39 ntpd[18478]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T05:33:39.830 INFO:teuthology.orchestra.run.smithi062.stdout:10 Sep 05:33:39 ntpd[18478]: ntpd: time slew -0.000810 s 2024-09-10T05:33:39.830 INFO:teuthology.orchestra.run.smithi062.stdout:ntpd: time slew -0.000810s 2024-09-10T05:33:39.830 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:39 ntpd[18478]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-10T05:33:39.830 INFO:teuthology.orchestra.run.smithi062.stderr:10 Sep 05:33:39 ntpd[18478]: can't open /var/log/ntpstats/loopstats.20240910: Permission denied 2024-09-10T05:33:39.879 INFO:teuthology.orchestra.run.smithi062.stdout: remote refid st t when poll reach delay offset jitter 2024-09-10T05:33:39.880 INFO:teuthology.orchestra.run.smithi062.stdout:============================================================================== 2024-09-10T05:33:39.880 INFO:teuthology.orchestra.run.smithi062.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T05:33:39.880 INFO:teuthology.orchestra.run.smithi062.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T05:33:39.880 INFO:teuthology.orchestra.run.smithi062.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T05:33:39.880 INFO:teuthology.orchestra.run.smithi062.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T05:33:39.881 INFO:teuthology.run_tasks:Running task install... 2024-09-10T05:33:39.889 DEBUG:teuthology.task.install:project ceph 2024-09-10T05:33:39.889 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}} 2024-09-10T05:33:39.889 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'} 2024-09-10T05:33:39.889 INFO:teuthology.task.install:Using flavor: default 2024-09-10T05:33:39.894 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-10T05:33:39.895 INFO:teuthology.task.install:extra packages: [] 2024-09-10T05:33:39.895 DEBUG:teuthology.orchestra.run.smithi002:> sudo apt-key list | grep Ceph 2024-09-10T05:33:39.896 DEBUG:teuthology.orchestra.run.smithi062:> sudo apt-key list | grep Ceph 2024-09-10T05:33:39.963 INFO:teuthology.orchestra.run.smithi002.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-10T05:33:39.981 INFO:teuthology.orchestra.run.smithi062.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-10T05:33:39.995 INFO:teuthology.orchestra.run.smithi002.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-10T05:33:39.995 INFO:teuthology.orchestra.run.smithi002.stdout:uid [ unknown] Ceph.com (release key) 2024-09-10T05:33:39.996 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-10T05:33:39.996 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-10T05:33:40.009 INFO:teuthology.orchestra.run.smithi062.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-10T05:33:40.009 INFO:teuthology.orchestra.run.smithi062.stdout:uid [ unknown] Ceph.com (release key) 2024-09-10T05:33:40.009 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-10T05:33:40.010 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-10T05:33:40.143 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default/ 2024-09-10T05:33:40.143 INFO:teuthology.task.install.deb:Package version is 19.3.0-4762-gbad475c1-1jammy 2024-09-10T05:33:40.152 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default/ 2024-09-10T05:33:40.152 INFO:teuthology.task.install.deb:Package version is 19.3.0-4762-gbad475c1-1jammy 2024-09-10T05:33:40.257 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T05:33:40.257 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-10T05:33:40.262 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-10T05:33:40.262 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-10T05:33:40.271 DEBUG:teuthology.orchestra.run.smithi002:> sudo apt-get update 2024-09-10T05:33:40.277 DEBUG:teuthology.orchestra.run.smithi062:> sudo apt-get update 2024-09-10T05:33:40.442 INFO:teuthology.orchestra.run.smithi002.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-10T05:33:40.449 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-10T05:33:40.451 INFO:teuthology.orchestra.run.smithi002.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-10T05:33:40.459 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-10T05:33:40.468 INFO:teuthology.orchestra.run.smithi002.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-10T05:33:40.476 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-10T05:33:40.497 INFO:teuthology.orchestra.run.smithi002.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy InRelease 2024-09-10T05:33:40.505 INFO:teuthology.orchestra.run.smithi062.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy InRelease 2024-09-10T05:33:40.518 INFO:teuthology.orchestra.run.smithi002.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy Release [7,005 B] 2024-09-10T05:33:40.529 INFO:teuthology.orchestra.run.smithi062.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy Release [7,005 B] 2024-09-10T05:33:40.540 INFO:teuthology.orchestra.run.smithi002.stdout:Ign:6 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-10T05:33:40.552 INFO:teuthology.orchestra.run.smithi062.stdout:Ign:6 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-10T05:33:40.561 INFO:teuthology.orchestra.run.smithi002.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-10T05:33:40.567 INFO:teuthology.orchestra.run.smithi002.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-10T05:33:40.571 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:7 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-10T05:33:40.572 INFO:teuthology.orchestra.run.smithi062.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-10T05:33:40.589 INFO:teuthology.orchestra.run.smithi002.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,427 B] 2024-09-10T05:33:40.599 INFO:teuthology.orchestra.run.smithi062.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,427 B] 2024-09-10T05:33:40.812 INFO:teuthology.orchestra.run.smithi062.stdout:Fetched 28.6 kB in 0s (82.5 kB/s) 2024-09-10T05:33:40.832 INFO:teuthology.orchestra.run.smithi002.stdout:Fetched 28.6 kB in 0s (76.5 kB/s) 2024-09-10T05:33:41.845 INFO:teuthology.orchestra.run.smithi062.stdout:Reading package lists... 2024-09-10T05:33:41.855 INFO:teuthology.orchestra.run.smithi002.stdout:Reading package lists... 2024-09-10T05:33:41.862 DEBUG:teuthology.orchestra.run.smithi062:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4762-gbad475c1-1jammy cephadm=19.3.0-4762-gbad475c1-1jammy ceph-mds=19.3.0-4762-gbad475c1-1jammy ceph-mgr=19.3.0-4762-gbad475c1-1jammy ceph-common=19.3.0-4762-gbad475c1-1jammy ceph-fuse=19.3.0-4762-gbad475c1-1jammy ceph-test=19.3.0-4762-gbad475c1-1jammy ceph-volume=19.3.0-4762-gbad475c1-1jammy radosgw=19.3.0-4762-gbad475c1-1jammy python3-rados=19.3.0-4762-gbad475c1-1jammy python3-rgw=19.3.0-4762-gbad475c1-1jammy python3-cephfs=19.3.0-4762-gbad475c1-1jammy python3-rbd=19.3.0-4762-gbad475c1-1jammy libcephfs2=19.3.0-4762-gbad475c1-1jammy libcephfs-dev=19.3.0-4762-gbad475c1-1jammy librados2=19.3.0-4762-gbad475c1-1jammy librbd1=19.3.0-4762-gbad475c1-1jammy rbd-fuse=19.3.0-4762-gbad475c1-1jammy 2024-09-10T05:33:41.873 DEBUG:teuthology.orchestra.run.smithi002:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4762-gbad475c1-1jammy cephadm=19.3.0-4762-gbad475c1-1jammy ceph-mds=19.3.0-4762-gbad475c1-1jammy ceph-mgr=19.3.0-4762-gbad475c1-1jammy ceph-common=19.3.0-4762-gbad475c1-1jammy ceph-fuse=19.3.0-4762-gbad475c1-1jammy ceph-test=19.3.0-4762-gbad475c1-1jammy ceph-volume=19.3.0-4762-gbad475c1-1jammy radosgw=19.3.0-4762-gbad475c1-1jammy python3-rados=19.3.0-4762-gbad475c1-1jammy python3-rgw=19.3.0-4762-gbad475c1-1jammy python3-cephfs=19.3.0-4762-gbad475c1-1jammy python3-rbd=19.3.0-4762-gbad475c1-1jammy libcephfs2=19.3.0-4762-gbad475c1-1jammy libcephfs-dev=19.3.0-4762-gbad475c1-1jammy librados2=19.3.0-4762-gbad475c1-1jammy librbd1=19.3.0-4762-gbad475c1-1jammy rbd-fuse=19.3.0-4762-gbad475c1-1jammy 2024-09-10T05:33:41.916 INFO:teuthology.orchestra.run.smithi062.stdout:Reading package lists... 2024-09-10T05:33:41.926 INFO:teuthology.orchestra.run.smithi002.stdout:Reading package lists... 2024-09-10T05:33:42.105 INFO:teuthology.orchestra.run.smithi062.stdout:Building dependency tree... 2024-09-10T05:33:42.106 INFO:teuthology.orchestra.run.smithi062.stdout:Reading state information... 2024-09-10T05:33:42.115 INFO:teuthology.orchestra.run.smithi002.stdout:Building dependency tree... 2024-09-10T05:33:42.116 INFO:teuthology.orchestra.run.smithi002.stdout:Reading state information... 2024-09-10T05:33:42.294 INFO:teuthology.orchestra.run.smithi062.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T05:33:42.295 INFO:teuthology.orchestra.run.smithi062.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T05:33:42.295 INFO:teuthology.orchestra.run.smithi062.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T05:33:42.295 INFO:teuthology.orchestra.run.smithi062.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T05:33:42.295 INFO:teuthology.orchestra.run.smithi062.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-10T05:33:42.296 INFO:teuthology.orchestra.run.smithi062.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-10T05:33:42.296 INFO:teuthology.orchestra.run.smithi062.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T05:33:42.296 INFO:teuthology.orchestra.run.smithi062.stdout:The following additional packages will be installed: 2024-09-10T05:33:42.296 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-10T05:33:42.297 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-10T05:33:42.297 INFO:teuthology.orchestra.run.smithi062.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-10T05:33:42.297 INFO:teuthology.orchestra.run.smithi062.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-10T05:33:42.297 INFO:teuthology.orchestra.run.smithi062.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-10T05:33:42.297 INFO:teuthology.orchestra.run.smithi062.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-10T05:33:42.298 INFO:teuthology.orchestra.run.smithi062.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-10T05:33:42.298 INFO:teuthology.orchestra.run.smithi062.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-10T05:33:42.298 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-10T05:33:42.298 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-10T05:33:42.298 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-10T05:33:42.298 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-10T05:33:42.298 INFO:teuthology.orchestra.run.smithi062.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-10T05:33:42.298 INFO:teuthology.orchestra.run.smithi062.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-10T05:33:42.298 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-10T05:33:42.298 INFO:teuthology.orchestra.run.smithi062.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-10T05:33:42.298 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-10T05:33:42.298 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-10T05:33:42.298 INFO:teuthology.orchestra.run.smithi062.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-10T05:33:42.299 INFO:teuthology.orchestra.run.smithi062.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-10T05:33:42.299 INFO:teuthology.orchestra.run.smithi062.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-10T05:33:42.299 INFO:teuthology.orchestra.run.smithi062.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-10T05:33:42.299 INFO:teuthology.orchestra.run.smithi062.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-10T05:33:42.299 INFO:teuthology.orchestra.run.smithi062.stdout: xmlstarlet zip 2024-09-10T05:33:42.299 INFO:teuthology.orchestra.run.smithi062.stdout:Suggested packages: 2024-09-10T05:33:42.299 INFO:teuthology.orchestra.run.smithi062.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-10T05:33:42.299 INFO:teuthology.orchestra.run.smithi062.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-10T05:33:42.299 INFO:teuthology.orchestra.run.smithi062.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-10T05:33:42.300 INFO:teuthology.orchestra.run.smithi062.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-10T05:33:42.300 INFO:teuthology.orchestra.run.smithi062.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-10T05:33:42.300 INFO:teuthology.orchestra.run.smithi062.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-10T05:33:42.300 INFO:teuthology.orchestra.run.smithi062.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-10T05:33:42.300 INFO:teuthology.orchestra.run.smithi062.stdout:Recommended packages: 2024-09-10T05:33:42.300 INFO:teuthology.orchestra.run.smithi062.stdout: btrfs-tools 2024-09-10T05:33:42.307 INFO:teuthology.orchestra.run.smithi002.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T05:33:42.307 INFO:teuthology.orchestra.run.smithi002.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T05:33:42.307 INFO:teuthology.orchestra.run.smithi002.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T05:33:42.307 INFO:teuthology.orchestra.run.smithi002.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T05:33:42.308 INFO:teuthology.orchestra.run.smithi002.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-10T05:33:42.308 INFO:teuthology.orchestra.run.smithi002.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-10T05:33:42.308 INFO:teuthology.orchestra.run.smithi002.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T05:33:42.310 INFO:teuthology.orchestra.run.smithi002.stdout:The following additional packages will be installed: 2024-09-10T05:33:42.310 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-10T05:33:42.310 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-10T05:33:42.310 INFO:teuthology.orchestra.run.smithi002.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-10T05:33:42.310 INFO:teuthology.orchestra.run.smithi002.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-10T05:33:42.310 INFO:teuthology.orchestra.run.smithi002.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-10T05:33:42.310 INFO:teuthology.orchestra.run.smithi002.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-10T05:33:42.310 INFO:teuthology.orchestra.run.smithi002.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-10T05:33:42.311 INFO:teuthology.orchestra.run.smithi002.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-10T05:33:42.311 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-10T05:33:42.311 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-10T05:33:42.311 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-10T05:33:42.311 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-10T05:33:42.311 INFO:teuthology.orchestra.run.smithi002.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-10T05:33:42.311 INFO:teuthology.orchestra.run.smithi002.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-10T05:33:42.311 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-10T05:33:42.311 INFO:teuthology.orchestra.run.smithi002.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-10T05:33:42.311 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-10T05:33:42.311 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-10T05:33:42.311 INFO:teuthology.orchestra.run.smithi002.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-10T05:33:42.311 INFO:teuthology.orchestra.run.smithi002.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-10T05:33:42.312 INFO:teuthology.orchestra.run.smithi002.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-10T05:33:42.312 INFO:teuthology.orchestra.run.smithi002.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-10T05:33:42.312 INFO:teuthology.orchestra.run.smithi002.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-10T05:33:42.312 INFO:teuthology.orchestra.run.smithi002.stdout: xmlstarlet zip 2024-09-10T05:33:42.312 INFO:teuthology.orchestra.run.smithi002.stdout:Suggested packages: 2024-09-10T05:33:42.312 INFO:teuthology.orchestra.run.smithi002.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-10T05:33:42.312 INFO:teuthology.orchestra.run.smithi002.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-10T05:33:42.313 INFO:teuthology.orchestra.run.smithi002.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-10T05:33:42.313 INFO:teuthology.orchestra.run.smithi002.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-10T05:33:42.313 INFO:teuthology.orchestra.run.smithi002.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-10T05:33:42.313 INFO:teuthology.orchestra.run.smithi002.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-10T05:33:42.313 INFO:teuthology.orchestra.run.smithi002.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-10T05:33:42.313 INFO:teuthology.orchestra.run.smithi002.stdout:Recommended packages: 2024-09-10T05:33:42.313 INFO:teuthology.orchestra.run.smithi002.stdout: btrfs-tools 2024-09-10T05:33:42.408 INFO:teuthology.orchestra.run.smithi062.stdout:The following NEW packages will be installed: 2024-09-10T05:33:42.408 INFO:teuthology.orchestra.run.smithi062.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-10T05:33:42.408 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-10T05:33:42.409 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-10T05:33:42.409 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-10T05:33:42.409 INFO:teuthology.orchestra.run.smithi062.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-10T05:33:42.409 INFO:teuthology.orchestra.run.smithi062.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-10T05:33:42.409 INFO:teuthology.orchestra.run.smithi062.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-10T05:33:42.409 INFO:teuthology.orchestra.run.smithi062.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-10T05:33:42.410 INFO:teuthology.orchestra.run.smithi062.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-10T05:33:42.410 INFO:teuthology.orchestra.run.smithi062.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-10T05:33:42.410 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-10T05:33:42.410 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-10T05:33:42.410 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-10T05:33:42.410 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-10T05:33:42.410 INFO:teuthology.orchestra.run.smithi062.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-10T05:33:42.410 INFO:teuthology.orchestra.run.smithi062.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-10T05:33:42.411 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-10T05:33:42.411 INFO:teuthology.orchestra.run.smithi062.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-10T05:33:42.411 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-10T05:33:42.411 INFO:teuthology.orchestra.run.smithi062.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-10T05:33:42.411 INFO:teuthology.orchestra.run.smithi062.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-10T05:33:42.411 INFO:teuthology.orchestra.run.smithi062.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-10T05:33:42.411 INFO:teuthology.orchestra.run.smithi062.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-10T05:33:42.411 INFO:teuthology.orchestra.run.smithi062.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-10T05:33:42.411 INFO:teuthology.orchestra.run.smithi062.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-10T05:33:42.411 INFO:teuthology.orchestra.run.smithi062.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-10T05:33:42.418 INFO:teuthology.orchestra.run.smithi002.stdout:The following NEW packages will be installed: 2024-09-10T05:33:42.419 INFO:teuthology.orchestra.run.smithi002.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-10T05:33:42.419 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-10T05:33:42.419 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-10T05:33:42.419 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-10T05:33:42.419 INFO:teuthology.orchestra.run.smithi002.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-10T05:33:42.419 INFO:teuthology.orchestra.run.smithi002.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-10T05:33:42.420 INFO:teuthology.orchestra.run.smithi002.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-10T05:33:42.420 INFO:teuthology.orchestra.run.smithi002.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-10T05:33:42.421 INFO:teuthology.orchestra.run.smithi002.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-10T05:33:42.421 INFO:teuthology.orchestra.run.smithi002.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-10T05:33:42.421 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-10T05:33:42.421 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-10T05:33:42.421 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-10T05:33:42.421 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-10T05:33:42.422 INFO:teuthology.orchestra.run.smithi002.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-10T05:33:42.422 INFO:teuthology.orchestra.run.smithi002.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-10T05:33:42.422 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-10T05:33:42.422 INFO:teuthology.orchestra.run.smithi002.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-10T05:33:42.422 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-10T05:33:42.422 INFO:teuthology.orchestra.run.smithi002.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-10T05:33:42.423 INFO:teuthology.orchestra.run.smithi002.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-10T05:33:42.423 INFO:teuthology.orchestra.run.smithi002.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-10T05:33:42.423 INFO:teuthology.orchestra.run.smithi002.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-10T05:33:42.423 INFO:teuthology.orchestra.run.smithi002.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-10T05:33:42.423 INFO:teuthology.orchestra.run.smithi002.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-10T05:33:42.423 INFO:teuthology.orchestra.run.smithi002.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-10T05:33:42.480 INFO:teuthology.orchestra.run.smithi002.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-10T05:33:42.480 INFO:teuthology.orchestra.run.smithi002.stdout:Need to get 243 MB of archives. 2024-09-10T05:33:42.481 INFO:teuthology.orchestra.run.smithi002.stdout:After this operation, 908 MB of additional disk space will be used. 2024-09-10T05:33:42.481 INFO:teuthology.orchestra.run.smithi002.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-10T05:33:42.553 INFO:teuthology.orchestra.run.smithi062.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-10T05:33:42.553 INFO:teuthology.orchestra.run.smithi062.stdout:Need to get 243 MB of archives. 2024-09-10T05:33:42.553 INFO:teuthology.orchestra.run.smithi062.stdout:After this operation, 908 MB of additional disk space will be used. 2024-09-10T05:33:42.553 INFO:teuthology.orchestra.run.smithi062.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4762-gbad475c1-1jammy [3,629 kB] 2024-09-10T05:33:42.563 INFO:teuthology.orchestra.run.smithi002.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4762-gbad475c1-1jammy [3,629 kB] 2024-09-10T05:33:42.568 INFO:teuthology.orchestra.run.smithi002.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-10T05:33:42.571 INFO:teuthology.orchestra.run.smithi002.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-10T05:33:42.587 INFO:teuthology.orchestra.run.smithi002.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-10T05:33:42.597 INFO:teuthology.orchestra.run.smithi062.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-10T05:33:42.646 INFO:teuthology.orchestra.run.smithi002.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-10T05:33:42.651 INFO:teuthology.orchestra.run.smithi002.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-10T05:33:42.664 INFO:teuthology.orchestra.run.smithi002.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-10T05:33:42.668 INFO:teuthology.orchestra.run.smithi002.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-10T05:33:42.669 INFO:teuthology.orchestra.run.smithi002.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-10T05:33:42.670 INFO:teuthology.orchestra.run.smithi002.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-10T05:33:42.679 INFO:teuthology.orchestra.run.smithi002.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-10T05:33:42.681 INFO:teuthology.orchestra.run.smithi002.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-10T05:33:42.683 INFO:teuthology.orchestra.run.smithi002.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-10T05:33:42.685 INFO:teuthology.orchestra.run.smithi002.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-10T05:33:42.685 INFO:teuthology.orchestra.run.smithi002.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-10T05:33:42.688 INFO:teuthology.orchestra.run.smithi002.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-10T05:33:42.703 INFO:teuthology.orchestra.run.smithi002.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-10T05:33:42.705 INFO:teuthology.orchestra.run.smithi002.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-10T05:33:42.705 INFO:teuthology.orchestra.run.smithi002.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-10T05:33:42.705 INFO:teuthology.orchestra.run.smithi002.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-10T05:33:42.707 INFO:teuthology.orchestra.run.smithi002.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-10T05:33:42.707 INFO:teuthology.orchestra.run.smithi002.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-10T05:33:42.720 INFO:teuthology.orchestra.run.smithi002.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-10T05:33:42.720 INFO:teuthology.orchestra.run.smithi002.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-10T05:33:42.721 INFO:teuthology.orchestra.run.smithi002.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-10T05:33:42.721 INFO:teuthology.orchestra.run.smithi002.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-10T05:33:42.737 INFO:teuthology.orchestra.run.smithi002.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-10T05:33:42.740 INFO:teuthology.orchestra.run.smithi002.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-10T05:33:42.740 INFO:teuthology.orchestra.run.smithi002.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-10T05:33:42.741 INFO:teuthology.orchestra.run.smithi002.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-10T05:33:42.741 INFO:teuthology.orchestra.run.smithi002.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-10T05:33:42.743 INFO:teuthology.orchestra.run.smithi002.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-10T05:33:42.752 INFO:teuthology.orchestra.run.smithi062.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4762-gbad475c1-1jammy [3,322 kB] 2024-09-10T05:33:42.755 INFO:teuthology.orchestra.run.smithi002.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-10T05:33:42.755 INFO:teuthology.orchestra.run.smithi002.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-10T05:33:42.756 INFO:teuthology.orchestra.run.smithi002.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-10T05:33:42.757 INFO:teuthology.orchestra.run.smithi002.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-10T05:33:42.766 INFO:teuthology.orchestra.run.smithi002.stdout:Get:38 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4762-gbad475c1-1jammy [3,322 kB] 2024-09-10T05:33:42.772 INFO:teuthology.orchestra.run.smithi002.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-10T05:33:42.778 INFO:teuthology.orchestra.run.smithi002.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-10T05:33:42.778 INFO:teuthology.orchestra.run.smithi002.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-10T05:33:42.779 INFO:teuthology.orchestra.run.smithi002.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-10T05:33:42.780 INFO:teuthology.orchestra.run.smithi002.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-10T05:33:42.781 INFO:teuthology.orchestra.run.smithi002.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-10T05:33:42.789 INFO:teuthology.orchestra.run.smithi002.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-10T05:33:42.790 INFO:teuthology.orchestra.run.smithi002.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-10T05:33:42.792 INFO:teuthology.orchestra.run.smithi002.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-10T05:33:42.792 INFO:teuthology.orchestra.run.smithi002.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-10T05:33:42.807 INFO:teuthology.orchestra.run.smithi002.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-10T05:33:42.807 INFO:teuthology.orchestra.run.smithi002.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-10T05:33:42.808 INFO:teuthology.orchestra.run.smithi002.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-10T05:33:42.811 INFO:teuthology.orchestra.run.smithi002.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-10T05:33:42.848 INFO:teuthology.orchestra.run.smithi062.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4762-gbad475c1-1jammy [721 kB] 2024-09-10T05:33:42.862 INFO:teuthology.orchestra.run.smithi062.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4762-gbad475c1-1jammy [357 kB] 2024-09-10T05:33:42.867 INFO:teuthology.orchestra.run.smithi002.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-10T05:33:42.868 INFO:teuthology.orchestra.run.smithi002.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-10T05:33:42.870 INFO:teuthology.orchestra.run.smithi062.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4762-gbad475c1-1jammy [32.8 kB] 2024-09-10T05:33:42.870 INFO:teuthology.orchestra.run.smithi002.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-10T05:33:42.870 INFO:teuthology.orchestra.run.smithi002.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-10T05:33:42.870 INFO:teuthology.orchestra.run.smithi062.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4762-gbad475c1-1jammy [180 kB] 2024-09-10T05:33:42.871 INFO:teuthology.orchestra.run.smithi002.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-10T05:33:42.873 INFO:teuthology.orchestra.run.smithi002.stdout:Get:58 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4762-gbad475c1-1jammy [721 kB] 2024-09-10T05:33:42.888 INFO:teuthology.orchestra.run.smithi002.stdout:Get:59 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4762-gbad475c1-1jammy [357 kB] 2024-09-10T05:33:42.889 INFO:teuthology.orchestra.run.smithi002.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-10T05:33:42.891 INFO:teuthology.orchestra.run.smithi002.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-10T05:33:42.891 INFO:teuthology.orchestra.run.smithi002.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-10T05:33:42.893 INFO:teuthology.orchestra.run.smithi062.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4762-gbad475c1-1jammy [71.2 kB] 2024-09-10T05:33:42.895 INFO:teuthology.orchestra.run.smithi062.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4762-gbad475c1-1jammy [338 kB] 2024-09-10T05:33:42.896 INFO:teuthology.orchestra.run.smithi002.stdout:Get:63 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4762-gbad475c1-1jammy [32.8 kB] 2024-09-10T05:33:42.897 INFO:teuthology.orchestra.run.smithi002.stdout:Get:64 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4762-gbad475c1-1jammy [180 kB] 2024-09-10T05:33:42.902 INFO:teuthology.orchestra.run.smithi062.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4762-gbad475c1-1jammy [7,972 kB] 2024-09-10T05:33:42.906 INFO:teuthology.orchestra.run.smithi002.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-10T05:33:42.906 INFO:teuthology.orchestra.run.smithi002.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-10T05:33:42.919 INFO:teuthology.orchestra.run.smithi002.stdout:Get:67 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4762-gbad475c1-1jammy [71.2 kB] 2024-09-10T05:33:42.921 INFO:teuthology.orchestra.run.smithi002.stdout:Get:68 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4762-gbad475c1-1jammy [338 kB] 2024-09-10T05:33:42.925 INFO:teuthology.orchestra.run.smithi002.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-10T05:33:42.926 INFO:teuthology.orchestra.run.smithi002.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-10T05:33:42.926 INFO:teuthology.orchestra.run.smithi002.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-10T05:33:42.926 INFO:teuthology.orchestra.run.smithi002.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-10T05:33:42.928 INFO:teuthology.orchestra.run.smithi002.stdout:Get:73 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4762-gbad475c1-1jammy [7,972 kB] 2024-09-10T05:33:42.943 INFO:teuthology.orchestra.run.smithi002.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-10T05:33:42.943 INFO:teuthology.orchestra.run.smithi002.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-10T05:33:42.945 INFO:teuthology.orchestra.run.smithi002.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-10T05:33:42.947 INFO:teuthology.orchestra.run.smithi002.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-10T05:33:42.948 INFO:teuthology.orchestra.run.smithi002.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-10T05:33:42.949 INFO:teuthology.orchestra.run.smithi002.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-10T05:33:42.959 INFO:teuthology.orchestra.run.smithi002.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-10T05:33:42.961 INFO:teuthology.orchestra.run.smithi002.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-10T05:33:42.962 INFO:teuthology.orchestra.run.smithi002.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-10T05:33:42.962 INFO:teuthology.orchestra.run.smithi002.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-10T05:33:42.976 INFO:teuthology.orchestra.run.smithi002.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-10T05:33:42.977 INFO:teuthology.orchestra.run.smithi002.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-10T05:33:42.979 INFO:teuthology.orchestra.run.smithi002.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-10T05:33:42.980 INFO:teuthology.orchestra.run.smithi002.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-10T05:33:42.980 INFO:teuthology.orchestra.run.smithi002.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-10T05:33:42.980 INFO:teuthology.orchestra.run.smithi002.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-10T05:33:42.993 INFO:teuthology.orchestra.run.smithi002.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-10T05:33:42.994 INFO:teuthology.orchestra.run.smithi002.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-10T05:33:43.000 INFO:teuthology.orchestra.run.smithi002.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-10T05:33:43.000 INFO:teuthology.orchestra.run.smithi002.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-10T05:33:43.010 INFO:teuthology.orchestra.run.smithi002.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-10T05:33:43.012 INFO:teuthology.orchestra.run.smithi002.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-10T05:33:43.012 INFO:teuthology.orchestra.run.smithi002.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-10T05:33:43.016 INFO:teuthology.orchestra.run.smithi062.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-10T05:33:43.028 INFO:teuthology.orchestra.run.smithi062.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-10T05:33:43.109 INFO:teuthology.orchestra.run.smithi062.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-10T05:33:43.154 INFO:teuthology.orchestra.run.smithi062.stdout:Get:14 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4762-gbad475c1-1jammy [112 kB] 2024-09-10T05:33:43.157 INFO:teuthology.orchestra.run.smithi062.stdout:Get:15 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4762-gbad475c1-1jammy [473 kB] 2024-09-10T05:33:43.166 INFO:teuthology.orchestra.run.smithi062.stdout:Get:16 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4762-gbad475c1-1jammy [28.2 MB] 2024-09-10T05:33:43.185 INFO:teuthology.orchestra.run.smithi002.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4762-gbad475c1-1jammy [112 kB] 2024-09-10T05:33:43.188 INFO:teuthology.orchestra.run.smithi002.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4762-gbad475c1-1jammy [473 kB] 2024-09-10T05:33:43.196 INFO:teuthology.orchestra.run.smithi002.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4762-gbad475c1-1jammy [28.2 MB] 2024-09-10T05:33:43.339 INFO:teuthology.orchestra.run.smithi062.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-10T05:33:43.349 INFO:teuthology.orchestra.run.smithi062.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-10T05:33:43.379 INFO:teuthology.orchestra.run.smithi062.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-10T05:33:43.388 INFO:teuthology.orchestra.run.smithi062.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-10T05:33:43.388 INFO:teuthology.orchestra.run.smithi062.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-10T05:33:43.390 INFO:teuthology.orchestra.run.smithi062.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-10T05:33:43.408 INFO:teuthology.orchestra.run.smithi062.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-10T05:33:43.412 INFO:teuthology.orchestra.run.smithi062.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-10T05:33:43.417 INFO:teuthology.orchestra.run.smithi062.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-10T05:33:43.424 INFO:teuthology.orchestra.run.smithi062.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-10T05:33:43.502 INFO:teuthology.orchestra.run.smithi062.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-10T05:33:43.510 INFO:teuthology.orchestra.run.smithi062.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-10T05:33:43.515 INFO:teuthology.orchestra.run.smithi062.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-10T05:33:43.521 INFO:teuthology.orchestra.run.smithi062.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-10T05:33:43.523 INFO:teuthology.orchestra.run.smithi062.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-10T05:33:43.524 INFO:teuthology.orchestra.run.smithi062.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-10T05:33:43.528 INFO:teuthology.orchestra.run.smithi062.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-10T05:33:43.530 INFO:teuthology.orchestra.run.smithi062.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-10T05:33:43.533 INFO:teuthology.orchestra.run.smithi062.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-10T05:33:43.585 INFO:teuthology.orchestra.run.smithi062.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-10T05:33:43.619 INFO:teuthology.orchestra.run.smithi062.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-10T05:33:43.620 INFO:teuthology.orchestra.run.smithi062.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-10T05:33:43.620 INFO:teuthology.orchestra.run.smithi062.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-10T05:33:43.626 INFO:teuthology.orchestra.run.smithi062.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-10T05:33:43.627 INFO:teuthology.orchestra.run.smithi062.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-10T05:33:43.667 INFO:teuthology.orchestra.run.smithi062.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-10T05:33:43.668 INFO:teuthology.orchestra.run.smithi062.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-10T05:33:43.670 INFO:teuthology.orchestra.run.smithi062.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-10T05:33:43.670 INFO:teuthology.orchestra.run.smithi062.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-10T05:33:43.748 INFO:teuthology.orchestra.run.smithi062.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-10T05:33:43.751 INFO:teuthology.orchestra.run.smithi062.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-10T05:33:43.752 INFO:teuthology.orchestra.run.smithi062.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-10T05:33:43.753 INFO:teuthology.orchestra.run.smithi062.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-10T05:33:43.764 INFO:teuthology.orchestra.run.smithi062.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-10T05:33:43.829 INFO:teuthology.orchestra.run.smithi062.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-10T05:33:43.830 INFO:teuthology.orchestra.run.smithi062.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-10T05:33:43.832 INFO:teuthology.orchestra.run.smithi062.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-10T05:33:43.836 INFO:teuthology.orchestra.run.smithi062.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-10T05:33:43.838 INFO:teuthology.orchestra.run.smithi062.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-10T05:33:43.911 INFO:teuthology.orchestra.run.smithi062.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-10T05:33:43.913 INFO:teuthology.orchestra.run.smithi062.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-10T05:33:43.915 INFO:teuthology.orchestra.run.smithi062.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-10T05:33:43.920 INFO:teuthology.orchestra.run.smithi062.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-10T05:33:43.921 INFO:teuthology.orchestra.run.smithi062.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-10T05:33:43.992 INFO:teuthology.orchestra.run.smithi062.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-10T05:33:43.997 INFO:teuthology.orchestra.run.smithi062.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-10T05:33:44.210 INFO:teuthology.orchestra.run.smithi062.stdout:Get:63 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4762-gbad475c1-1jammy [5,206 kB] 2024-09-10T05:33:44.247 INFO:teuthology.orchestra.run.smithi062.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-10T05:33:44.249 INFO:teuthology.orchestra.run.smithi062.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-10T05:33:44.252 INFO:teuthology.orchestra.run.smithi062.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-10T05:33:44.253 INFO:teuthology.orchestra.run.smithi062.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-10T05:33:44.256 INFO:teuthology.orchestra.run.smithi062.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-10T05:33:44.284 INFO:teuthology.orchestra.run.smithi002.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4762-gbad475c1-1jammy [5,206 kB] 2024-09-10T05:33:44.293 INFO:teuthology.orchestra.run.smithi062.stdout:Get:69 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4762-gbad475c1-1jammy [251 kB] 2024-09-10T05:33:44.296 INFO:teuthology.orchestra.run.smithi062.stdout:Get:70 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4762-gbad475c1-1jammy [124 kB] 2024-09-10T05:33:44.297 INFO:teuthology.orchestra.run.smithi062.stdout:Get:71 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4762-gbad475c1-1jammy [1,562 kB] 2024-09-10T05:33:44.301 INFO:teuthology.orchestra.run.smithi062.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-10T05:33:44.305 INFO:teuthology.orchestra.run.smithi062.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-10T05:33:44.306 INFO:teuthology.orchestra.run.smithi062.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-10T05:33:44.315 INFO:teuthology.orchestra.run.smithi062.stdout:Get:75 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4762-gbad475c1-1jammy [6,310 kB] 2024-09-10T05:33:44.366 INFO:teuthology.orchestra.run.smithi002.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4762-gbad475c1-1jammy [251 kB] 2024-09-10T05:33:44.369 INFO:teuthology.orchestra.run.smithi002.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4762-gbad475c1-1jammy [124 kB] 2024-09-10T05:33:44.370 INFO:teuthology.orchestra.run.smithi062.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-10T05:33:44.371 INFO:teuthology.orchestra.run.smithi062.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-10T05:33:44.375 INFO:teuthology.orchestra.run.smithi002.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4762-gbad475c1-1jammy [1,562 kB] 2024-09-10T05:33:44.414 INFO:teuthology.orchestra.run.smithi062.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-10T05:33:44.415 INFO:teuthology.orchestra.run.smithi062.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-10T05:33:44.416 INFO:teuthology.orchestra.run.smithi062.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-10T05:33:44.417 INFO:teuthology.orchestra.run.smithi062.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-10T05:33:44.418 INFO:teuthology.orchestra.run.smithi062.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-10T05:33:44.419 INFO:teuthology.orchestra.run.smithi062.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-10T05:33:44.423 INFO:teuthology.orchestra.run.smithi002.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4762-gbad475c1-1jammy [6,310 kB] 2024-09-10T05:33:44.427 INFO:teuthology.orchestra.run.smithi062.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-10T05:33:44.496 INFO:teuthology.orchestra.run.smithi062.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-10T05:33:44.499 INFO:teuthology.orchestra.run.smithi062.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-10T05:33:44.501 INFO:teuthology.orchestra.run.smithi062.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-10T05:33:44.518 INFO:teuthology.orchestra.run.smithi062.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4762-gbad475c1-1jammy [23.1 MB] 2024-09-10T05:33:44.577 INFO:teuthology.orchestra.run.smithi062.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-10T05:33:44.584 INFO:teuthology.orchestra.run.smithi062.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-10T05:33:44.586 INFO:teuthology.orchestra.run.smithi062.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-10T05:33:44.587 INFO:teuthology.orchestra.run.smithi062.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-10T05:33:44.599 INFO:teuthology.orchestra.run.smithi062.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-10T05:33:44.600 INFO:teuthology.orchestra.run.smithi062.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-10T05:33:44.608 INFO:teuthology.orchestra.run.smithi062.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-10T05:33:44.634 INFO:teuthology.orchestra.run.smithi002.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4762-gbad475c1-1jammy [23.1 MB] 2024-09-10T05:33:44.659 INFO:teuthology.orchestra.run.smithi062.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-10T05:33:44.660 INFO:teuthology.orchestra.run.smithi062.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-10T05:33:44.661 INFO:teuthology.orchestra.run.smithi062.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-10T05:33:44.740 INFO:teuthology.orchestra.run.smithi062.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-10T05:33:44.742 INFO:teuthology.orchestra.run.smithi062.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-10T05:33:44.759 INFO:teuthology.orchestra.run.smithi062.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-10T05:33:44.760 INFO:teuthology.orchestra.run.smithi062.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-10T05:33:44.761 INFO:teuthology.orchestra.run.smithi062.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-10T05:33:44.766 INFO:teuthology.orchestra.run.smithi062.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-10T05:33:44.767 INFO:teuthology.orchestra.run.smithi062.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-10T05:33:45.352 INFO:teuthology.orchestra.run.smithi062.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4762-gbad475c1-1jammy [14.1 kB] 2024-09-10T05:33:45.353 INFO:teuthology.orchestra.run.smithi062.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4762-gbad475c1-1jammy [880 kB] 2024-09-10T05:33:45.370 INFO:teuthology.orchestra.run.smithi062.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4762-gbad475c1-1jammy [2,438 kB] 2024-09-10T05:33:45.412 INFO:teuthology.orchestra.run.smithi062.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4762-gbad475c1-1jammy [812 kB] 2024-09-10T05:33:45.423 INFO:teuthology.orchestra.run.smithi062.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4762-gbad475c1-1jammy [160 kB] 2024-09-10T05:33:45.425 INFO:teuthology.orchestra.run.smithi062.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4762-gbad475c1-1jammy [61.4 MB] 2024-09-10T05:33:45.488 INFO:teuthology.orchestra.run.smithi002.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4762-gbad475c1-1jammy [14.1 kB] 2024-09-10T05:33:45.488 INFO:teuthology.orchestra.run.smithi002.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4762-gbad475c1-1jammy [880 kB] 2024-09-10T05:33:45.506 INFO:teuthology.orchestra.run.smithi002.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4762-gbad475c1-1jammy [2,438 kB] 2024-09-10T05:33:45.549 INFO:teuthology.orchestra.run.smithi002.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4762-gbad475c1-1jammy [812 kB] 2024-09-10T05:33:45.559 INFO:teuthology.orchestra.run.smithi002.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4762-gbad475c1-1jammy [160 kB] 2024-09-10T05:33:45.561 INFO:teuthology.orchestra.run.smithi002.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4762-gbad475c1-1jammy [61.4 MB] 2024-09-10T05:33:47.636 INFO:teuthology.orchestra.run.smithi062.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4762-gbad475c1-1jammy [8,625 kB] 2024-09-10T05:33:47.748 INFO:teuthology.orchestra.run.smithi062.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4762-gbad475c1-1jammy [14.2 kB] 2024-09-10T05:33:47.749 INFO:teuthology.orchestra.run.smithi062.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4762-gbad475c1-1jammy [48.5 MB] 2024-09-10T05:33:47.853 INFO:teuthology.orchestra.run.smithi002.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4762-gbad475c1-1jammy [8,625 kB] 2024-09-10T05:33:48.056 INFO:teuthology.orchestra.run.smithi002.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4762-gbad475c1-1jammy [14.2 kB] 2024-09-10T05:33:48.057 INFO:teuthology.orchestra.run.smithi002.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4762-gbad475c1-1jammy [48.5 MB] 2024-09-10T05:33:49.401 INFO:teuthology.orchestra.run.smithi062.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4762-gbad475c1-1jammy [130 kB] 2024-09-10T05:33:49.403 INFO:teuthology.orchestra.run.smithi062.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4762-gbad475c1-1jammy [39.0 kB] 2024-09-10T05:33:49.404 INFO:teuthology.orchestra.run.smithi062.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4762-gbad475c1-1jammy [15.8 MB] 2024-09-10T05:33:49.803 INFO:teuthology.orchestra.run.smithi002.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4762-gbad475c1-1jammy [130 kB] 2024-09-10T05:33:49.805 INFO:teuthology.orchestra.run.smithi002.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4762-gbad475c1-1jammy [39.0 kB] 2024-09-10T05:33:49.807 INFO:teuthology.orchestra.run.smithi002.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4762-gbad475c1-1jammy [15.8 MB] 2024-09-10T05:33:49.853 INFO:teuthology.orchestra.run.smithi062.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4762-gbad475c1-1jammy [91.2 kB] 2024-09-10T05:33:50.081 INFO:teuthology.orchestra.run.smithi002.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4762-gbad475c1-1jammy [91.2 kB] 2024-09-10T05:33:50.451 INFO:teuthology.orchestra.run.smithi062.stdout:Fetched 243 MB in 7s (32.7 MB/s) 2024-09-10T05:33:50.602 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-10T05:33:50.675 INFO:teuthology.orchestra.run.smithi002.stdout:Fetched 243 MB in 8s (31.8 MB/s) 2024-09-10T05:33:50.700 INFO:teuthology.orchestra.run.smithi062.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-10T05:33:50.706 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-10T05:33:50.791 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-10T05:33:50.845 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-10T05:33:50.948 INFO:teuthology.orchestra.run.smithi002.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-10T05:33:50.954 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-10T05:33:51.035 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-10T05:33:51.070 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-10T05:33:51.097 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-10T05:33:51.128 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-10T05:33:51.397 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-10T05:33:51.424 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-10T05:33:51.439 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-10T05:33:51.463 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-10T05:33:51.466 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-10T05:33:51.506 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-10T05:33:51.800 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-10T05:33:51.827 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-10T05:33:51.866 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-10T05:33:51.959 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-10T05:33:51.986 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T05:33:52.034 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T05:33:52.262 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-10T05:33:52.289 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T05:33:52.337 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T05:33:52.438 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-10T05:33:52.464 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T05:33:52.504 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T05:33:52.739 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-10T05:33:52.766 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T05:33:52.806 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T05:33:52.840 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-10T05:33:52.867 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T05:33:52.906 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T05:33:53.218 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-10T05:33:53.245 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-10T05:33:53.276 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-10T05:33:53.326 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-10T05:33:53.353 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T05:33:53.392 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T05:33:53.596 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package librados2. 2024-09-10T05:33:53.622 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../007-librados2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-10T05:33:53.662 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking librados2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:33:53.712 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-10T05:33:53.739 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-10T05:33:53.778 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-10T05:33:54.057 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package librados2. 2024-09-10T05:33:54.083 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../007-librados2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-10T05:33:54.115 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package librbd1. 2024-09-10T05:33:54.123 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking librados2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:33:54.142 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../008-librbd1_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-10T05:33:54.181 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking librbd1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:33:54.576 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package librbd1. 2024-09-10T05:33:54.603 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../008-librbd1_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-10T05:33:54.626 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libcephfs2. 2024-09-10T05:33:54.642 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-10T05:33:54.642 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking librbd1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:33:54.792 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libcephfs2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:33:55.036 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-rados. 2024-09-10T05:33:55.052 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-10T05:33:55.087 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libcephfs2. 2024-09-10T05:33:55.094 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-rados (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:33:55.113 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-10T05:33:55.153 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libcephfs2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:33:55.414 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-10T05:33:55.441 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-10T05:33:55.447 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-rados. 2024-09-10T05:33:55.474 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-10T05:33:55.480 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-ceph-argparse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:33:55.506 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-rados (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:33:55.733 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-cephfs. 2024-09-10T05:33:55.760 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-10T05:33:55.801 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-cephfs (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:33:55.825 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-10T05:33:55.852 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-10T05:33:55.891 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-ceph-argparse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:33:56.069 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-10T05:33:56.085 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-10T05:33:56.119 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:33:56.152 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-cephfs. 2024-09-10T05:33:56.179 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-10T05:33:56.219 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-cephfs (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:33:56.389 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-10T05:33:56.404 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-10T05:33:56.447 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-10T05:33:56.513 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-10T05:33:56.540 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-10T05:33:56.580 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:33:56.775 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-prettytable. 2024-09-10T05:33:56.802 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-10T05:33:56.866 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-10T05:33:56.883 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-10T05:33:56.910 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-10T05:33:56.949 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-10T05:33:57.127 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-rbd. 2024-09-10T05:33:57.145 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-10T05:33:57.185 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-rbd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:33:57.236 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-prettytable. 2024-09-10T05:33:57.263 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-10T05:33:57.302 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-10T05:33:57.497 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-10T05:33:57.523 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-10T05:33:57.556 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-10T05:33:57.557 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-rbd. 2024-09-10T05:33:57.582 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-10T05:33:57.621 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-rbd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:33:57.782 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-10T05:33:57.798 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-10T05:33:57.832 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-10T05:33:57.966 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-10T05:33:57.993 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-10T05:33:58.032 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-10T05:33:58.126 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-10T05:33:58.143 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-10T05:33:58.185 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-10T05:33:58.310 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-10T05:33:58.337 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-10T05:33:58.368 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-10T05:33:58.521 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package lua5.1. 2024-09-10T05:33:58.549 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-10T05:33:58.588 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-10T05:33:58.655 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-10T05:33:58.670 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-10T05:33:58.713 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-10T05:33:59.033 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package lua-any. 2024-09-10T05:33:59.041 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package lua5.1. 2024-09-10T05:33:59.060 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-10T05:33:59.068 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-10T05:33:59.108 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-10T05:33:59.185 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-10T05:33:59.410 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package zip. 2024-09-10T05:33:59.419 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package lua-any. 2024-09-10T05:33:59.426 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-10T05:33:59.446 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-10T05:33:59.460 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking zip (3.0-12build2) ... 2024-09-10T05:33:59.486 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-10T05:33:59.713 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package zip. 2024-09-10T05:33:59.729 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-10T05:33:59.771 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking zip (3.0-12build2) ... 2024-09-10T05:33:59.772 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package unzip. 2024-09-10T05:33:59.800 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-10T05:33:59.838 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-10T05:34:00.066 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package unzip. 2024-09-10T05:34:00.093 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-10T05:34:00.133 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-10T05:34:00.225 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package luarocks. 2024-09-10T05:34:00.252 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-10T05:34:00.291 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-10T05:34:00.528 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package luarocks. 2024-09-10T05:34:00.555 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-10T05:34:00.595 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-10T05:34:00.724 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package librgw2. 2024-09-10T05:34:00.751 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../025-librgw2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-10T05:34:00.790 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking librgw2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:34:00.969 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package librgw2. 2024-09-10T05:34:00.996 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../025-librgw2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-10T05:34:01.036 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking librgw2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:34:01.384 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-rgw. 2024-09-10T05:34:01.400 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-10T05:34:01.434 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-rgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:34:01.621 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-rgw. 2024-09-10T05:34:01.637 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-10T05:34:01.680 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-rgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:34:01.729 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-10T05:34:01.755 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-10T05:34:01.795 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-10T05:34:02.016 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-10T05:34:02.042 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-10T05:34:02.082 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-10T05:34:02.106 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libradosstriper1. 2024-09-10T05:34:02.133 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-10T05:34:02.173 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libradosstriper1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:34:02.402 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libradosstriper1. 2024-09-10T05:34:02.429 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-10T05:34:02.468 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libradosstriper1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:34:02.601 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-common. 2024-09-10T05:34:02.628 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-10T05:34:02.667 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:34:02.813 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package ceph-common. 2024-09-10T05:34:02.840 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-10T05:34:02.871 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:34:04.231 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-base. 2024-09-10T05:34:04.258 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-10T05:34:04.427 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package ceph-base. 2024-09-10T05:34:04.432 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-base (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:34:04.454 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-10T05:34:04.503 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking ceph-base (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:34:05.002 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-10T05:34:05.029 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-10T05:34:05.068 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-10T05:34:05.081 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-10T05:34:05.108 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-10T05:34:05.148 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-10T05:34:05.338 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-cheroot. 2024-09-10T05:34:05.365 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-10T05:34:05.396 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-10T05:34:05.433 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-cheroot. 2024-09-10T05:34:05.460 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-10T05:34:05.500 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-10T05:34:05.707 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-10T05:34:05.735 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-10T05:34:05.774 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-10T05:34:05.787 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-10T05:34:05.813 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-10T05:34:05.845 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-10T05:34:06.060 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-10T05:34:06.087 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-10T05:34:06.126 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-10T05:34:06.148 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-10T05:34:06.175 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-10T05:34:06.214 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-10T05:34:06.404 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-10T05:34:06.431 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-10T05:34:06.470 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-10T05:34:06.517 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-10T05:34:06.544 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-10T05:34:06.583 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-10T05:34:06.715 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-tempora. 2024-09-10T05:34:06.742 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-10T05:34:06.773 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-10T05:34:06.870 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-tempora. 2024-09-10T05:34:06.886 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-10T05:34:06.919 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-10T05:34:07.059 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-portend. 2024-09-10T05:34:07.086 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-10T05:34:07.126 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-10T05:34:07.189 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-portend. 2024-09-10T05:34:07.216 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-10T05:34:07.255 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-10T05:34:07.429 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-10T05:34:07.456 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-10T05:34:07.495 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-10T05:34:07.558 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-10T05:34:07.588 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-10T05:34:07.625 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-10T05:34:07.773 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-10T05:34:07.800 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-10T05:34:07.831 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-10T05:34:07.961 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-10T05:34:07.989 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-10T05:34:08.028 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-10T05:34:08.193 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-natsort. 2024-09-10T05:34:08.220 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-10T05:34:08.259 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-10T05:34:08.373 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-natsort. 2024-09-10T05:34:08.400 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-10T05:34:08.439 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-10T05:34:08.604 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-logutils. 2024-09-10T05:34:08.631 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-10T05:34:08.671 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-10T05:34:08.751 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-logutils. 2024-09-10T05:34:08.778 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-10T05:34:08.817 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-10T05:34:08.957 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-10T05:34:08.973 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-10T05:34:09.007 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-10T05:34:09.120 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-10T05:34:09.147 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-10T05:34:09.187 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-10T05:34:09.251 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-mako. 2024-09-10T05:34:09.278 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-10T05:34:09.309 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-10T05:34:09.621 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-10T05:34:09.648 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-10T05:34:09.656 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-mako. 2024-09-10T05:34:09.683 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-10T05:34:09.687 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-10T05:34:09.722 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-10T05:34:09.990 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-10T05:34:10.017 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-10T05:34:10.051 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-10T05:34:10.057 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-10T05:34:10.067 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-10T05:34:10.109 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-10T05:34:10.360 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-webob. 2024-09-10T05:34:10.387 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-10T05:34:10.412 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-10T05:34:10.426 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-10T05:34:10.439 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-10T05:34:10.478 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-10T05:34:10.739 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-webob. 2024-09-10T05:34:10.756 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-10T05:34:10.771 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-waitress. 2024-09-10T05:34:10.789 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-10T05:34:10.798 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-10T05:34:10.832 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-10T05:34:11.082 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-tempita. 2024-09-10T05:34:11.098 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-10T05:34:11.100 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-waitress. 2024-09-10T05:34:11.128 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-10T05:34:11.140 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-10T05:34:11.162 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-10T05:34:11.443 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-paste. 2024-09-10T05:34:11.470 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-10T05:34:11.470 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-tempita. 2024-09-10T05:34:11.497 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-10T05:34:11.509 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-10T05:34:11.537 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-10T05:34:11.821 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-10T05:34:11.848 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-10T05:34:11.856 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-paste. 2024-09-10T05:34:11.883 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-10T05:34:11.889 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-10T05:34:11.923 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-10T05:34:12.215 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-10T05:34:12.242 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-10T05:34:12.243 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-10T05:34:12.270 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-10T05:34:12.282 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-10T05:34:12.309 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-10T05:34:12.568 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-webtest. 2024-09-10T05:34:12.595 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-10T05:34:12.620 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-10T05:34:12.634 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-10T05:34:12.648 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-10T05:34:12.695 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-10T05:34:12.904 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pecan. 2024-09-10T05:34:12.931 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-10T05:34:12.962 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-10T05:34:12.981 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-webtest. 2024-09-10T05:34:13.009 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-10T05:34:13.048 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-10T05:34:13.283 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-certifi. 2024-09-10T05:34:13.310 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-10T05:34:13.334 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-pecan. 2024-09-10T05:34:13.341 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-10T05:34:13.361 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-10T05:34:13.400 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-10T05:34:13.653 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-idna. 2024-09-10T05:34:13.680 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-10T05:34:13.719 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-10T05:34:14.030 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-urllib3. 2024-09-10T05:34:14.057 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-10T05:34:14.105 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-10T05:34:14.433 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-requests. 2024-09-10T05:34:14.461 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-10T05:34:14.531 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-certifi. 2024-09-10T05:34:14.559 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-10T05:34:14.607 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-10T05:34:14.633 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-10T05:34:14.994 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-10T05:34:15.021 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-10T05:34:15.042 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-idna. 2024-09-10T05:34:15.061 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-10T05:34:15.069 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-10T05:34:15.108 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-10T05:34:15.356 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-10T05:34:15.383 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-10T05:34:15.420 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-urllib3. 2024-09-10T05:34:15.430 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:34:15.447 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-10T05:34:15.486 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-10T05:34:15.814 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-requests. 2024-09-10T05:34:15.841 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-10T05:34:15.902 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-10T05:34:16.027 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-10T05:34:16.055 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-10T05:34:16.217 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-10T05:34:16.239 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-10T05:34:16.275 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-10T05:34:16.410 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:34:16.553 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-10T05:34:16.569 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-10T05:34:16.611 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:34:16.930 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-10T05:34:16.946 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-10T05:34:16.988 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-10T05:34:17.016 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-10T05:34:17.044 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-10T05:34:17.083 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:34:17.291 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-openssl. 2024-09-10T05:34:17.318 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-10T05:34:17.357 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-10T05:34:17.361 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-10T05:34:17.388 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-10T05:34:17.421 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-10T05:34:17.644 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr. 2024-09-10T05:34:17.660 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-10T05:34:17.693 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:34:17.713 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-openssl. 2024-09-10T05:34:17.741 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-10T05:34:17.780 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-10T05:34:18.063 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mon. 2024-09-10T05:34:18.090 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-10T05:34:18.108 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package ceph-mgr. 2024-09-10T05:34:18.129 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mon (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:34:18.135 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-10T05:34:18.174 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking ceph-mgr (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:34:18.569 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package ceph-mon. 2024-09-10T05:34:18.597 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-10T05:34:18.635 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking ceph-mon (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:34:18.858 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-osd. 2024-09-10T05:34:18.886 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-10T05:34:18.925 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-osd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:34:19.222 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package ceph-osd. 2024-09-10T05:34:19.250 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-10T05:34:19.289 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking ceph-osd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:34:20.011 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph. 2024-09-10T05:34:20.032 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../066-ceph_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-10T05:34:20.069 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:34:20.322 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-fuse. 2024-09-10T05:34:20.338 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-10T05:34:20.380 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:34:20.383 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package ceph. 2024-09-10T05:34:20.400 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../066-ceph_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-10T05:34:20.442 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:34:20.750 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mds. 2024-09-10T05:34:20.761 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package ceph-fuse. 2024-09-10T05:34:20.777 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-10T05:34:20.789 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-10T05:34:20.816 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mds (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:34:20.828 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking ceph-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:34:21.190 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package ceph-mds. 2024-09-10T05:34:21.211 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package cephadm. 2024-09-10T05:34:21.217 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-10T05:34:21.239 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../069-cephadm_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-10T05:34:21.256 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking ceph-mds (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:34:21.277 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:34:21.555 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-10T05:34:21.571 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-10T05:34:21.605 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-10T05:34:21.617 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package cephadm. 2024-09-10T05:34:21.633 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../069-cephadm_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-10T05:34:21.667 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:34:21.953 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-10T05:34:21.958 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-10T05:34:21.974 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-10T05:34:21.981 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-10T05:34:22.016 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-10T05:34:22.019 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-10T05:34:22.331 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-10T05:34:22.358 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-10T05:34:22.397 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-10T05:34:22.979 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-babel. 2024-09-10T05:34:23.007 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-10T05:34:23.045 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-10T05:34:23.342 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-jinja2. 2024-09-10T05:34:23.369 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-10T05:34:23.385 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-babel. 2024-09-10T05:34:23.400 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-10T05:34:23.413 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-10T05:34:23.452 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-10T05:34:23.748 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-jinja2. 2024-09-10T05:34:23.770 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-10T05:34:23.776 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-10T05:34:23.797 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-10T05:34:23.815 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-10T05:34:23.836 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:34:24.143 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-10T05:34:24.170 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-10T05:34:24.181 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-10T05:34:24.208 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-10T05:34:24.209 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:34:24.247 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-10T05:34:24.525 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-routes. 2024-09-10T05:34:24.552 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-10T05:34:24.554 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-10T05:34:24.582 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-10T05:34:24.583 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-10T05:34:24.630 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-10T05:34:24.911 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-10T05:34:24.939 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-10T05:34:24.978 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:34:25.132 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-routes. 2024-09-10T05:34:25.160 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-10T05:34:25.199 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-10T05:34:25.502 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-10T05:34:25.529 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-10T05:34:25.568 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:34:27.841 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-10T05:34:27.871 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-10T05:34:27.915 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-10T05:34:28.273 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-10T05:34:28.303 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-10T05:34:28.347 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-10T05:34:28.411 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-joblib. 2024-09-10T05:34:28.439 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-10T05:34:28.477 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-10T05:34:28.814 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-10T05:34:28.826 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-joblib. 2024-09-10T05:34:28.842 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-10T05:34:28.854 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-10T05:34:28.872 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-10T05:34:28.892 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-10T05:34:29.141 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-sklearn. 2024-09-10T05:34:29.169 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-10T05:34:29.207 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-10T05:34:29.246 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-10T05:34:29.274 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-10T05:34:29.312 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-10T05:34:29.615 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-sklearn. 2024-09-10T05:34:29.643 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-10T05:34:29.681 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-10T05:34:29.874 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-10T05:34:29.891 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-10T05:34:30.018 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:34:30.449 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-10T05:34:30.478 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-10T05:34:30.592 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:34:30.955 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-cachetools. 2024-09-10T05:34:30.983 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-10T05:34:31.021 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-10T05:34:31.307 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-10T05:34:31.335 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-10T05:34:31.374 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-10T05:34:31.445 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-cachetools. 2024-09-10T05:34:31.462 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-10T05:34:31.504 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-10T05:34:31.702 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-10T05:34:31.730 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-10T05:34:31.760 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-10T05:34:31.807 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-10T05:34:31.835 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-10T05:34:31.873 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-10T05:34:32.055 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-rsa. 2024-09-10T05:34:32.081 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-10T05:34:32.113 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-10T05:34:32.177 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-10T05:34:32.205 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-10T05:34:32.243 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-10T05:34:32.425 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-google-auth. 2024-09-10T05:34:32.453 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-10T05:34:32.500 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-10T05:34:32.571 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-rsa. 2024-09-10T05:34:32.599 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-10T05:34:32.629 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-10T05:34:32.804 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-10T05:34:32.831 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-10T05:34:32.869 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-10T05:34:32.925 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-google-auth. 2024-09-10T05:34:32.953 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-10T05:34:32.991 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-10T05:34:33.181 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-websocket. 2024-09-10T05:34:33.209 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-10T05:34:33.247 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-10T05:34:33.311 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-10T05:34:33.339 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-10T05:34:33.377 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-10T05:34:33.550 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-10T05:34:33.567 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-10T05:34:33.608 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-10T05:34:33.689 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-websocket. 2024-09-10T05:34:33.717 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-10T05:34:33.755 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-10T05:34:34.066 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-10T05:34:34.095 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-10T05:34:34.133 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-10T05:34:34.239 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-10T05:34:34.253 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-10T05:34:34.297 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:34:34.616 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-10T05:34:34.649 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-10T05:34:34.683 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-10T05:34:34.788 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-10T05:34:34.806 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-10T05:34:34.847 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:34:35.028 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-10T05:34:35.056 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-10T05:34:35.136 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-10T05:34:35.216 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-10T05:34:35.245 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-10T05:34:35.274 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-10T05:34:35.605 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package jq. 2024-09-10T05:34:35.634 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-10T05:34:35.672 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-10T05:34:35.777 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-10T05:34:35.806 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-10T05:34:35.844 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-10T05:34:35.924 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package socat. 2024-09-10T05:34:35.952 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-10T05:34:35.990 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-10T05:34:36.121 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package jq. 2024-09-10T05:34:36.138 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-10T05:34:36.180 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-10T05:34:36.285 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package xmlstarlet. 2024-09-10T05:34:36.302 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-10T05:34:36.343 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-10T05:34:36.449 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package socat. 2024-09-10T05:34:36.478 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-10T05:34:36.516 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-10T05:34:36.722 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-test. 2024-09-10T05:34:36.739 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-10T05:34:36.781 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-test (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:34:36.802 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package xmlstarlet. 2024-09-10T05:34:36.820 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-10T05:34:36.860 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-10T05:34:37.198 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package ceph-test. 2024-09-10T05:34:37.215 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-10T05:34:37.256 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking ceph-test (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:34:39.135 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-volume. 2024-09-10T05:34:39.164 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-10T05:34:39.201 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-volume (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:34:39.502 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package ceph-volume. 2024-09-10T05:34:39.514 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-10T05:34:39.531 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-10T05:34:39.542 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-10T05:34:39.568 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking ceph-volume (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:34:39.580 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libcephfs-dev (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:34:39.882 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-10T05:34:39.891 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-10T05:34:39.898 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-10T05:34:39.920 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-10T05:34:39.939 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libcephfs-dev (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:34:39.957 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-10T05:34:40.250 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-10T05:34:40.279 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-10T05:34:40.296 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-10T05:34:40.317 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-10T05:34:40.324 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-10T05:34:40.362 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-10T05:34:40.674 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package nvme-cli. 2024-09-10T05:34:40.680 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-10T05:34:40.703 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-10T05:34:40.708 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-10T05:34:40.732 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-10T05:34:40.746 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-10T05:34:41.092 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package nvme-cli. 2024-09-10T05:34:41.112 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package pkg-config. 2024-09-10T05:34:41.120 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-10T05:34:41.141 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-10T05:34:41.158 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-10T05:34:41.178 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-10T05:34:41.440 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-10T05:34:41.468 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-10T05:34:41.506 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-10T05:34:41.572 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package pkg-config. 2024-09-10T05:34:41.601 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-10T05:34:41.646 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-10T05:34:41.883 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-10T05:34:41.900 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-10T05:34:41.941 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-10T05:34:41.943 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-10T05:34:41.972 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-10T05:34:42.009 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-10T05:34:42.304 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pastescript. 2024-09-10T05:34:42.327 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-10T05:34:42.332 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-10T05:34:42.356 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-10T05:34:42.370 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-10T05:34:42.393 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-10T05:34:42.696 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-pastescript. 2024-09-10T05:34:42.698 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pluggy. 2024-09-10T05:34:42.725 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-10T05:34:42.727 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-10T05:34:42.762 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-10T05:34:42.764 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-10T05:34:43.083 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-pluggy. 2024-09-10T05:34:43.093 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-psutil. 2024-09-10T05:34:43.112 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-10T05:34:43.121 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-10T05:34:43.149 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-10T05:34:43.151 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-10T05:34:43.461 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-psutil. 2024-09-10T05:34:43.479 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-py. 2024-09-10T05:34:43.489 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-10T05:34:43.507 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-10T05:34:43.527 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-10T05:34:43.545 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-10T05:34:43.857 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pygments. 2024-09-10T05:34:43.864 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-py. 2024-09-10T05:34:43.885 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-10T05:34:43.892 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-10T05:34:43.923 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-10T05:34:43.938 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-10T05:34:44.258 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-pygments. 2024-09-10T05:34:44.287 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-10T05:34:44.324 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-10T05:34:44.419 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-10T05:34:44.447 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-10T05:34:44.485 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-10T05:34:44.763 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-toml. 2024-09-10T05:34:44.778 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-10T05:34:44.779 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-10T05:34:44.808 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-10T05:34:44.821 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-10T05:34:44.836 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-10T05:34:45.090 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pytest. 2024-09-10T05:34:45.119 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-10T05:34:45.148 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-toml. 2024-09-10T05:34:45.156 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-10T05:34:45.177 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-10T05:34:45.214 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-10T05:34:45.477 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-simplejson. 2024-09-10T05:34:45.506 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-10T05:34:45.517 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-pytest. 2024-09-10T05:34:45.543 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-10T05:34:45.546 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-10T05:34:45.584 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-10T05:34:45.813 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-10T05:34:45.841 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-10T05:34:45.870 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-10T05:34:46.145 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-simplejson. 2024-09-10T05:34:46.174 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-10T05:34:46.211 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-10T05:34:46.481 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-10T05:34:46.510 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-10T05:34:46.547 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-10T05:34:46.583 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package radosgw. 2024-09-10T05:34:46.612 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../116-radosgw_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-10T05:34:46.649 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking radosgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:34:47.268 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package radosgw. 2024-09-10T05:34:47.297 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../116-radosgw_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-10T05:34:47.334 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking radosgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:34:47.627 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package rbd-fuse. 2024-09-10T05:34:47.644 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-10T05:34:47.685 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking rbd-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:34:47.975 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-10T05:34:48.254 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package rbd-fuse. 2024-09-10T05:34:48.272 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-10T05:34:48.282 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-10T05:34:48.312 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking rbd-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:34:48.408 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-10T05:34:48.601 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-10T05:34:48.675 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-10T05:34:48.876 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-10T05:34:48.976 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-10T05:34:49.003 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-10T05:34:49.231 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-10T05:34:49.469 INFO:teuthology.orchestra.run.smithi062.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-10T05:34:49.560 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:34:49.584 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-10T05:34:49.992 INFO:teuthology.orchestra.run.smithi002.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-10T05:34:50.053 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:34:50.203 INFO:teuthology.orchestra.run.smithi062.stdout:Adding system user cephadm....done 2024-09-10T05:34:50.469 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-10T05:34:50.545 INFO:teuthology.orchestra.run.smithi002.stdout:Adding system user cephadm....done 2024-09-10T05:34:50.701 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-10T05:34:50.900 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-10T05:34:50.977 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-10T05:34:51.219 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-10T05:34:51.320 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-10T05:34:51.345 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-10T05:34:51.429 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-10T05:34:51.605 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-10T05:34:51.672 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-10T05:34:51.856 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-10T05:34:51.940 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-10T05:34:51.957 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-10T05:34:52.066 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-10T05:34:52.258 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-10T05:34:52.409 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-10T05:34:52.635 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-10T05:34:52.786 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-10T05:34:52.903 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-10T05:34:53.037 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-10T05:34:53.188 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-10T05:34:53.296 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-10T05:34:53.439 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-10T05:34:53.556 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-10T05:34:53.707 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-10T05:34:53.816 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-10T05:34:54.057 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-10T05:34:54.092 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-10T05:34:54.325 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-ceph-argparse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:34:54.384 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-ceph-argparse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:34:54.618 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-10T05:34:54.627 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-10T05:34:54.736 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-10T05:34:54.744 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-10T05:34:54.846 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-10T05:34:54.870 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-10T05:34:54.955 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-10T05:34:54.996 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-10T05:34:55.248 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-10T05:34:55.255 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-10T05:34:55.655 INFO:teuthology.orchestra.run.smithi062.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-10T05:34:55.659 INFO:teuthology.orchestra.run.smithi002.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-10T05:34:55.686 INFO:teuthology.orchestra.run.smithi062.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-10T05:34:55.696 INFO:teuthology.orchestra.run.smithi002.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-10T05:34:55.745 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-10T05:34:55.750 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-10T05:34:55.844 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-10T05:34:55.876 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-10T05:34:56.195 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-10T05:34:56.296 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-10T05:34:56.352 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-10T05:34:56.478 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-10T05:34:56.564 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-10T05:34:56.754 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-10T05:34:56.832 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-10T05:34:57.022 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-10T05:34:57.166 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up zip (3.0-12build2) ... 2024-09-10T05:34:57.292 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-10T05:34:57.314 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up zip (3.0-12build2) ... 2024-09-10T05:34:57.415 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-10T05:34:57.977 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-10T05:34:58.092 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-10T05:34:58.228 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-10T05:34:58.329 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-10T05:34:58.369 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-10T05:34:58.447 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-10T05:34:58.495 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-10T05:34:58.621 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-10T05:34:58.756 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-10T05:34:58.921 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-10T05:34:59.149 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-10T05:34:59.314 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-10T05:34:59.384 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-10T05:34:59.540 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-10T05:34:59.760 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-10T05:34:59.933 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-10T05:35:00.053 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-10T05:35:00.226 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-10T05:35:00.421 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-10T05:35:00.620 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-10T05:35:00.693 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-10T05:35:00.815 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:00.879 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-10T05:35:01.005 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:01.141 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-10T05:35:01.306 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-10T05:35:01.459 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-10T05:35:01.615 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-10T05:35:02.673 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-10T05:35:02.804 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-10T05:35:02.942 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T05:35:03.031 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T05:35:03.076 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-10T05:35:03.140 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-10T05:35:03.343 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-10T05:35:03.383 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-10T05:35:03.461 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-10T05:35:03.509 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-10T05:35:03.587 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-10T05:35:03.643 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-10T05:35:03.897 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-10T05:35:03.944 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-10T05:35:04.156 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-10T05:35:04.212 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-10T05:35:04.407 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T05:35:04.496 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T05:35:04.533 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-10T05:35:04.608 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-10T05:35:04.826 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-10T05:35:04.891 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-10T05:35:05.086 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-10T05:35:05.150 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-10T05:35:05.345 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-10T05:35:05.418 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-10T05:35:05.596 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-10T05:35:05.677 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-10T05:35:05.848 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-10T05:35:05.937 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-10T05:35:06.115 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-10T05:35:06.229 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-10T05:35:06.241 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-10T05:35:06.355 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-10T05:35:06.534 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-10T05:35:06.660 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-10T05:35:06.706 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-10T05:35:06.807 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-10T05:35:06.953 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-10T05:35:07.091 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-10T05:35:07.254 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-10T05:35:07.401 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-10T05:35:07.514 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-10T05:35:07.639 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-10T05:35:07.669 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-10T05:35:07.765 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-10T05:35:07.795 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-10T05:35:07.855 INFO:teuthology.orchestra.run.smithi002.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-10T05:35:07.912 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-10T05:35:07.986 INFO:teuthology.orchestra.run.smithi062.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-10T05:35:08.142 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-10T05:35:08.255 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-10T05:35:08.268 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-10T05:35:08.356 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-10T05:35:08.669 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-10T05:35:08.750 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-10T05:35:08.920 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-10T05:35:09.017 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-10T05:35:09.049 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-10T05:35:09.154 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-10T05:35:09.291 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T05:35:09.392 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-10T05:35:09.421 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T05:35:09.522 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-10T05:35:09.693 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-10T05:35:09.840 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-10T05:35:09.986 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-10T05:35:10.149 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-10T05:35:10.262 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-10T05:35:10.388 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-10T05:35:10.426 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-10T05:35:10.552 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-10T05:35:10.664 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-10T05:35:10.836 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-10T05:35:10.949 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-10T05:35:11.113 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-10T05:35:11.285 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-10T05:35:11.466 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-10T05:35:11.670 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-10T05:35:11.884 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-10T05:35:11.947 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-10T05:35:12.177 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-10T05:35:12.291 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-10T05:35:12.417 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up librados2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:12.530 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-10T05:35:12.543 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:12.631 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up librados2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:12.669 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-10T05:35:12.732 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:12.850 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-10T05:35:12.963 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libcephfs2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:13.089 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libradosstriper1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:13.186 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libcephfs2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:13.216 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-10T05:35:13.312 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libradosstriper1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:13.438 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-10T05:35:13.509 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up librbd1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:13.635 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up ceph-mgr-modules-core (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:13.698 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up librbd1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:13.753 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up ceph-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:13.799 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr-modules-core (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:13.925 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:13.971 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-10T05:35:13.971 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-10T05:35:14.145 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-10T05:35:14.146 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-10T05:35:14.512 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libcephfs-dev (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:14.618 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libcephfs-dev (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:14.638 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-rados (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:14.744 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-rados (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:14.764 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up librgw2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:14.870 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up librgw2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:14.899 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-10T05:35:14.997 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-10T05:35:16.161 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-rbd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:16.267 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-rbd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:16.278 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up rbd-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:16.379 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-rgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:16.393 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up rbd-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:16.505 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-cephfs (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:16.519 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-rgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:16.645 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-cephfs (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:16.755 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:16.964 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:17.289 INFO:teuthology.orchestra.run.smithi062.stdout:Adding group ceph....done 2024-09-10T05:35:17.524 INFO:teuthology.orchestra.run.smithi002.stdout:Adding group ceph....done 2024-09-10T05:35:17.640 INFO:teuthology.orchestra.run.smithi062.stdout:Adding system user ceph....done 2024-09-10T05:35:17.760 INFO:teuthology.orchestra.run.smithi062.stdout:Setting system user ceph properties....done 2024-09-10T05:35:17.774 INFO:teuthology.orchestra.run.smithi062.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-10T05:35:17.834 INFO:teuthology.orchestra.run.smithi002.stdout:Adding system user ceph....done 2024-09-10T05:35:17.919 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-10T05:35:18.002 INFO:teuthology.orchestra.run.smithi002.stdout:Setting system user ceph properties....done 2024-09-10T05:35:18.018 INFO:teuthology.orchestra.run.smithi002.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-10T05:35:18.164 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-10T05:35:18.245 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-10T05:35:18.479 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-10T05:35:18.932 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up ceph-test (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:18.965 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-test (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:19.066 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up radosgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:19.074 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up radosgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:19.583 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-10T05:35:19.583 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-10T05:35:19.607 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-10T05:35:19.607 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-10T05:35:20.035 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-base (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:20.060 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up ceph-base (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:20.403 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-10T05:35:20.429 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-10T05:35:20.862 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mds (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:20.903 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up ceph-mds (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:21.106 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-10T05:35:21.106 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-10T05:35:21.132 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-10T05:35:21.132 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-10T05:35:21.580 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:21.597 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up ceph-mgr (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:21.811 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-10T05:35:21.811 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-10T05:35:21.816 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-10T05:35:21.816 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-10T05:35:22.257 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up ceph-osd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:22.336 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-osd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:22.551 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-10T05:35:22.551 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-10T05:35:22.615 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-10T05:35:22.616 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-10T05:35:23.050 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:23.088 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:23.176 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:23.205 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:23.302 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up ceph-mon (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:23.331 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mon (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:23.504 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-10T05:35:23.504 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-10T05:35:23.535 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-10T05:35:23.535 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-10T05:35:23.978 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up ceph-mgr-cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:24.033 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr-cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:24.129 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:24.184 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:24.255 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up ceph-mgr-dashboard (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:24.309 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr-dashboard (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:24.406 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up ceph-volume (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:24.460 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-volume (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-10T05:35:24.817 INFO:teuthology.orchestra.run.smithi002.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-10T05:35:24.822 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-10T05:35:24.926 INFO:teuthology.orchestra.run.smithi002.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-10T05:35:24.931 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-10T05:35:25.062 INFO:teuthology.orchestra.run.smithi002.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-10T05:35:25.083 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-10T05:35:26.076 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-10T05:35:26.137 INFO:teuthology.orchestra.run.smithi002.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-10T05:35:26.705 INFO:teuthology.orchestra.run.smithi002.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-10T05:35:26.712 DEBUG:teuthology.parallel:result is None 2024-09-10T05:35:26.742 INFO:teuthology.orchestra.run.smithi062.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-10T05:35:26.747 DEBUG:teuthology.parallel:result is None 2024-09-10T05:35:26.748 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-10T05:35:26.892 DEBUG:teuthology.orchestra.run.smithi002:> dpkg-query -W -f '${Version}' ceph 2024-09-10T05:35:26.912 INFO:teuthology.orchestra.run.smithi002.stdout:19.3.0-4762-gbad475c1-1jammy 2024-09-10T05:35:26.913 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4762-gbad475c1-1jammy 2024-09-10T05:35:26.913 INFO:teuthology.task.install:The correct ceph version 19.3.0-4762-gbad475c1-1jammy is installed. 2024-09-10T05:35:26.915 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-10T05:35:27.054 DEBUG:teuthology.orchestra.run.smithi062:> dpkg-query -W -f '${Version}' ceph 2024-09-10T05:35:27.074 INFO:teuthology.orchestra.run.smithi062.stdout:19.3.0-4762-gbad475c1-1jammy 2024-09-10T05:35:27.074 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4762-gbad475c1-1jammy 2024-09-10T05:35:27.074 INFO:teuthology.task.install:The correct ceph version 19.3.0-4762-gbad475c1-1jammy is installed. 2024-09-10T05:35:27.076 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-10T05:35:27.076 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T05:35:27.076 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T05:35:27.091 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-10T05:35:27.091 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T05:35:27.129 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-10T05:35:27.129 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T05:35:27.129 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T05:35:27.146 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T05:35:27.202 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-10T05:35:27.202 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T05:35:27.215 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T05:35:27.268 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-10T05:35:27.269 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T05:35:27.269 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T05:35:27.282 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T05:35:27.338 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-10T05:35:27.339 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T05:35:27.351 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T05:35:27.404 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-10T05:35:27.404 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T05:35:27.404 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T05:35:27.418 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T05:35:27.474 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-10T05:35:27.474 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T05:35:27.488 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T05:35:27.545 INFO:teuthology.run_tasks:Running task ceph... 2024-09-10T05:35:27.629 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-10T05:35:27.629 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 777 /var/log/ceph 2024-09-10T05:35:27.632 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 777 /var/log/ceph 2024-09-10T05:35:27.646 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-10T05:35:27.646 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-10T05:35:27.691 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-10T05:35:27.704 INFO:tasks.ceph:Creating extra log directories... 2024-09-10T05:35:27.705 DEBUG:teuthology.orchestra.run.smithi002:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-10T05:35:27.747 DEBUG:teuthology.orchestra.run.smithi062:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-10T05:35:27.769 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-10T05:35:27.769 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-10T05:35:27.769 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-09-10_03:21:45-rgw-wip-rgw-meta-handlers-distro-default-smithi/7898714', 'branch': 'wip-rgw-meta-handlers', 'description': 'rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{ubuntu_latest}}', 'email': None, 'first_in_suite': False, 'job_id': '7898714', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-09-10_03:21:45-rgw-wip-rgw-meta-handlers-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-rgw-meta-handlers'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}}, 'rgw': {'ec-data-pool': False, 'frontend': 'beast'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rgw-meta-handlers', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 9786, 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-rgw-meta-handlers', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'targets': {'smithi002.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPdiEvEC3zyAlQEF3D9ZXtoXsU2Jo0eUvmpV2Ou/EZfhV/S7iiEmZfEjeuGWuqKnxlm08iNoViNXXrkunxw1DRc=', 'smithi062.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFJo4OiAUTUcVu0PHOk8QEko5r45QZsr3KfyM3UbDXuwO4kP219lZtDGJsLkZzHW6Fr4mHyXgkATstC3BButGmQ='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-10_03:21:45', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-10T05:35:27.769 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-10T05:35:27.804 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-10T05:35:27.809 DEBUG:teuthology.orchestra.run.smithi002:> sudo install -d -m0777 -- /var/run/ceph 2024-09-10T05:35:27.852 DEBUG:teuthology.orchestra.run.smithi062:> sudo install -d -m0777 -- /var/run/ceph 2024-09-10T05:35:27.866 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T05:35:27.866 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T05:35:27.911 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T05:35:27.911 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_1 2024-09-10T05:35:27.959 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T05:35:27.959 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T05:35:27.959 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 883 Links: 1 2024-09-10T05:35:27.959 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T05:35:27.959 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-09-10 05:29:56.599618334 +0000 2024-09-10T05:35:27.959 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-10 05:29:56.595618368 +0000 2024-09-10T05:35:27.959 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-10 05:29:56.595618368 +0000 2024-09-10T05:35:27.959 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: - 2024-09-10T05:35:27.960 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T05:35:28.013 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-09-10T05:35:28.013 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-09-10T05:35:28.013 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000326348 s, 1.6 MB/s 2024-09-10T05:35:28.015 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T05:35:28.064 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_2 2024-09-10T05:35:28.111 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T05:35:28.111 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T05:35:28.111 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 904 Links: 1 2024-09-10T05:35:28.111 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T05:35:28.111 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-09-10 05:29:57.315611938 +0000 2024-09-10T05:35:28.111 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-10 05:29:57.079614045 +0000 2024-09-10T05:35:28.111 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-10 05:29:57.079614045 +0000 2024-09-10T05:35:28.111 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: - 2024-09-10T05:35:28.112 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T05:35:28.165 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-09-10T05:35:28.165 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-09-10T05:35:28.165 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000253495 s, 2.0 MB/s 2024-09-10T05:35:28.166 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T05:35:28.216 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_3 2024-09-10T05:35:28.262 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T05:35:28.263 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T05:35:28.263 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 916 Links: 1 2024-09-10T05:35:28.263 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T05:35:28.263 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-09-10 05:29:57.851607149 +0000 2024-09-10T05:35:28.263 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-10 05:29:57.583609544 +0000 2024-09-10T05:35:28.263 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-10 05:29:57.583609544 +0000 2024-09-10T05:35:28.263 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: - 2024-09-10T05:35:28.263 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T05:35:28.317 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-09-10T05:35:28.317 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-09-10T05:35:28.318 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000303737 s, 1.7 MB/s 2024-09-10T05:35:28.319 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T05:35:28.369 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_4 2024-09-10T05:35:28.419 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T05:35:28.419 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T05:35:28.419 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 938 Links: 1 2024-09-10T05:35:28.419 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T05:35:28.419 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-09-10 05:29:58.087605043 +0000 2024-09-10T05:35:28.419 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-10 05:29:58.083605077 +0000 2024-09-10T05:35:28.419 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-10 05:29:58.083605077 +0000 2024-09-10T05:35:28.419 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: - 2024-09-10T05:35:28.420 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T05:35:28.473 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-09-10T05:35:28.473 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-09-10T05:35:28.473 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000303434 s, 1.7 MB/s 2024-09-10T05:35:28.475 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T05:35:28.524 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-10T05:35:28.525 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-10T05:35:28.525 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T05:35:28.534 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T05:35:28.534 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_1 2024-09-10T05:35:28.582 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T05:35:28.582 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T05:35:28.582 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 889 Links: 1 2024-09-10T05:35:28.582 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T05:35:28.583 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-09-10 05:29:56.285148538 +0000 2024-09-10T05:35:28.583 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-09-10 05:29:56.281148574 +0000 2024-09-10T05:35:28.583 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-09-10 05:29:56.281148574 +0000 2024-09-10T05:35:28.583 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2024-09-10T05:35:28.583 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T05:35:28.637 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-09-10T05:35:28.637 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-09-10T05:35:28.637 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000345678 s, 1.5 MB/s 2024-09-10T05:35:28.639 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T05:35:28.687 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_2 2024-09-10T05:35:28.736 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T05:35:28.736 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T05:35:28.736 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 905 Links: 1 2024-09-10T05:35:28.736 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T05:35:28.736 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-09-10 05:29:56.777144143 +0000 2024-09-10T05:35:28.736 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-09-10 05:29:56.773144179 +0000 2024-09-10T05:35:28.736 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-09-10 05:29:56.773144179 +0000 2024-09-10T05:35:28.737 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2024-09-10T05:35:28.737 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T05:35:28.789 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-09-10T05:35:28.789 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-09-10T05:35:28.789 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000436616 s, 1.2 MB/s 2024-09-10T05:35:28.791 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T05:35:28.839 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_3 2024-09-10T05:35:28.887 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T05:35:28.887 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T05:35:28.887 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 923 Links: 1 2024-09-10T05:35:28.887 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T05:35:28.887 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-09-10 05:29:57.537137355 +0000 2024-09-10T05:35:28.887 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-09-10 05:29:57.285139606 +0000 2024-09-10T05:35:28.887 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-09-10 05:29:57.285139606 +0000 2024-09-10T05:35:28.887 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2024-09-10T05:35:28.888 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T05:35:28.940 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-09-10T05:35:28.941 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-09-10T05:35:28.941 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000424579 s, 1.2 MB/s 2024-09-10T05:35:28.942 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T05:35:28.991 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_4 2024-09-10T05:35:29.038 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T05:35:29.038 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T05:35:29.038 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 938 Links: 1 2024-09-10T05:35:29.038 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T05:35:29.038 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-09-10 05:29:58.029132960 +0000 2024-09-10T05:35:29.038 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-09-10 05:29:57.753135426 +0000 2024-09-10T05:35:29.039 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-09-10 05:29:57.753135426 +0000 2024-09-10T05:35:29.039 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2024-09-10T05:35:29.039 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T05:35:29.092 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-09-10T05:35:29.092 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-09-10T05:35:29.092 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.00031765 s, 1.6 MB/s 2024-09-10T05:35:29.094 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T05:35:29.144 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-10T05:35:29.144 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi002.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi062.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-10T05:35:29.144 INFO:tasks.ceph:Generating config... 2024-09-10T05:35:29.146 INFO:tasks.ceph:[client] debug ms = 1 2024-09-10T05:35:29.146 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2024-09-10T05:35:29.146 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-10T05:35:29.146 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-10T05:35:29.146 INFO:tasks.ceph:[client] setuser = ceph 2024-09-10T05:35:29.146 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-10T05:35:29.146 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-10T05:35:29.146 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-10T05:35:29.146 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-10T05:35:29.146 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-10T05:35:29.146 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-10T05:35:29.147 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-10T05:35:29.147 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-10T05:35:29.147 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-10T05:35:29.147 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-10T05:35:29.147 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-10T05:35:29.147 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-10T05:35:29.147 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-10T05:35:29.147 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-10T05:35:29.147 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-10T05:35:29.147 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-10T05:35:29.147 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-10T05:35:29.147 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-10T05:35:29.147 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-10T05:35:29.147 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-10T05:35:29.148 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-10T05:35:29.148 INFO:tasks.ceph:Setting up mon.a... 2024-09-10T05:35:29.148 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-10T05:35:29.184 INFO:teuthology.orchestra.run.smithi002.stdout:creating /etc/ceph/ceph.keyring 2024-09-10T05:35:29.193 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-10T05:35:29.275 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T05:35:29.331 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.2')] 2024-09-10T05:35:29.331 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.2'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2024-09-10T05:35:29.332 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T05:35:29.332 DEBUG:teuthology.orchestra.run.smithi002:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-10T05:35:29.378 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.2 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-10T05:35:29.458 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:35:29.459 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:35:29.459 INFO:teuthology.orchestra.run.smithi002.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-10T05:35:29.459 INFO:teuthology.orchestra.run.smithi002.stdout:monmaptool: generated fsid 004d9798-7539-4e93-b06c-e32e30a3c3b6 2024-09-10T05:35:29.459 INFO:teuthology.orchestra.run.smithi002.stdout:setting min_mon_release = quincy 2024-09-10T05:35:29.459 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 0 2024-09-10T05:35:29.459 INFO:teuthology.orchestra.run.smithi002.stdout:fsid 004d9798-7539-4e93-b06c-e32e30a3c3b6 2024-09-10T05:35:29.459 INFO:teuthology.orchestra.run.smithi002.stdout:last_changed 2024-09-10T05:35:29.460837+0000 2024-09-10T05:35:29.460 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-09-10T05:35:29.460837+0000 2024-09-10T05:35:29.460 INFO:teuthology.orchestra.run.smithi002.stdout:min_mon_release 17 (quincy) 2024-09-10T05:35:29.460 INFO:teuthology.orchestra.run.smithi002.stdout:election_strategy: 1 2024-09-10T05:35:29.460 INFO:teuthology.orchestra.run.smithi002.stdout:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-10T05:35:29.460 INFO:teuthology.orchestra.run.smithi002.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-10T05:35:29.461 DEBUG:teuthology.orchestra.run.smithi002:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-10T05:35:29.506 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 004d9798-7539-4e93-b06c-e32e30a3c3b6... 2024-09-10T05:35:29.507 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T05:35:29.551 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T05:35:29.580 INFO:teuthology.orchestra.run.smithi002.stdout:[global] 2024-09-10T05:35:29.581 INFO:teuthology.orchestra.run.smithi002.stdout: chdir = "" 2024-09-10T05:35:29.581 INFO:teuthology.orchestra.run.smithi002.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T05:35:29.581 INFO:teuthology.orchestra.run.smithi002.stdout: auth supported = cephx 2024-09-10T05:35:29.581 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T05:35:29.581 INFO:teuthology.orchestra.run.smithi002.stdout: filestore xattr use omap = true 2024-09-10T05:35:29.581 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T05:35:29.581 INFO:teuthology.orchestra.run.smithi002.stdout: mon clock drift allowed = 1.000 2024-09-10T05:35:29.581 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T05:35:29.581 INFO:teuthology.orchestra.run.smithi002.stdout: osd crush chooseleaf type = 0 2024-09-10T05:35:29.581 INFO:teuthology.orchestra.run.smithi002.stdout: auth debug = true 2024-09-10T05:35:29.581 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T05:35:29.581 INFO:teuthology.orchestra.run.smithi002.stdout: ms die on old message = true 2024-09-10T05:35:29.581 INFO:teuthology.orchestra.run.smithi002.stdout: ms die on bug = true 2024-09-10T05:35:29.582 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T05:35:29.582 INFO:teuthology.orchestra.run.smithi002.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T05:35:29.582 INFO:teuthology.orchestra.run.smithi002.stdout: mon pg warn max object skew = 0 2024-09-10T05:35:29.582 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T05:35:29.582 INFO:teuthology.orchestra.run.smithi002.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T05:35:29.582 INFO:teuthology.orchestra.run.smithi002.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T05:35:29.582 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T05:35:29.582 INFO:teuthology.orchestra.run.smithi002.stdout: osd pool default size = 2 2024-09-10T05:35:29.582 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T05:35:29.582 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd allow primary affinity = true 2024-09-10T05:35:29.582 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd allow pg remap = true 2024-09-10T05:35:29.582 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on legacy crush tunables = false 2024-09-10T05:35:29.582 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on crush straw calc version zero = false 2024-09-10T05:35:29.582 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on no sortbitwise = false 2024-09-10T05:35:29.583 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on osd down out interval zero = false 2024-09-10T05:35:29.583 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on too few osds = false 2024-09-10T05:35:29.583 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T05:35:29.583 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T05:35:29.583 INFO:teuthology.orchestra.run.smithi002.stdout: mon_allow_pool_size_one = true 2024-09-10T05:35:29.583 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T05:35:29.583 INFO:teuthology.orchestra.run.smithi002.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T05:35:29.583 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T05:35:29.583 INFO:teuthology.orchestra.run.smithi002.stdout: osd default data pool replay window = 5 2024-09-10T05:35:29.583 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T05:35:29.583 INFO:teuthology.orchestra.run.smithi002.stdout: mon allow pool delete = true 2024-09-10T05:35:29.583 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T05:35:29.583 INFO:teuthology.orchestra.run.smithi002.stdout: mon cluster log file level = debug 2024-09-10T05:35:29.584 INFO:teuthology.orchestra.run.smithi002.stdout: debug asserts on shutdown = true 2024-09-10T05:35:29.584 INFO:teuthology.orchestra.run.smithi002.stdout: mon health detail to clog = false 2024-09-10T05:35:29.584 INFO:teuthology.orchestra.run.smithi002.stdout: mon host = 172.21.15.2 2024-09-10T05:35:29.584 INFO:teuthology.orchestra.run.smithi002.stdout: fsid = 004d9798-7539-4e93-b06c-e32e30a3c3b6 2024-09-10T05:35:29.584 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T05:35:29.584 INFO:teuthology.orchestra.run.smithi002.stdout:[osd] 2024-09-10T05:35:29.584 INFO:teuthology.orchestra.run.smithi002.stdout: osd journal size = 100 2024-09-10T05:35:29.584 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T05:35:29.584 INFO:teuthology.orchestra.run.smithi002.stdout: osd scrub load threshold = 5.0 2024-09-10T05:35:29.584 INFO:teuthology.orchestra.run.smithi002.stdout: osd scrub max interval = 600 2024-09-10T05:35:29.584 INFO:teuthology.orchestra.run.smithi002.stdout: osd mclock profile = high_recovery_ops 2024-09-10T05:35:29.584 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T05:35:29.584 INFO:teuthology.orchestra.run.smithi002.stdout: osd recover clone overlap = true 2024-09-10T05:35:29.585 INFO:teuthology.orchestra.run.smithi002.stdout: osd recovery max chunk = 1048576 2024-09-10T05:35:29.585 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T05:35:29.585 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug shutdown = true 2024-09-10T05:35:29.585 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug op order = true 2024-09-10T05:35:29.585 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug verify stray on activate = true 2024-09-10T05:35:29.585 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug trim objects = true 2024-09-10T05:35:29.585 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T05:35:29.585 INFO:teuthology.orchestra.run.smithi002.stdout: osd open classes on start = true 2024-09-10T05:35:29.585 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug pg log writeout = true 2024-09-10T05:35:29.585 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T05:35:29.585 INFO:teuthology.orchestra.run.smithi002.stdout: osd deep scrub update digest min age = 30 2024-09-10T05:35:29.585 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T05:35:29.585 INFO:teuthology.orchestra.run.smithi002.stdout: osd map max advance = 10 2024-09-10T05:35:29.585 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T05:35:29.585 INFO:teuthology.orchestra.run.smithi002.stdout: journal zero on create = true 2024-09-10T05:35:29.586 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T05:35:29.586 INFO:teuthology.orchestra.run.smithi002.stdout: filestore ondisk finisher threads = 3 2024-09-10T05:35:29.586 INFO:teuthology.orchestra.run.smithi002.stdout: filestore apply finisher threads = 3 2024-09-10T05:35:29.586 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T05:35:29.586 INFO:teuthology.orchestra.run.smithi002.stdout: bdev debug aio = true 2024-09-10T05:35:29.586 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug misdirected ops = true 2024-09-10T05:35:29.586 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2024-09-10T05:35:29.586 INFO:teuthology.orchestra.run.smithi002.stdout: debug objclass = 20 2024-09-10T05:35:29.586 INFO:teuthology.orchestra.run.smithi002.stdout: bdev async discard = True 2024-09-10T05:35:29.586 INFO:teuthology.orchestra.run.smithi002.stdout: bdev enable discard = True 2024-09-10T05:35:29.586 INFO:teuthology.orchestra.run.smithi002.stdout: bluestore allocator = bitmap 2024-09-10T05:35:29.586 INFO:teuthology.orchestra.run.smithi002.stdout: bluestore block size = 96636764160 2024-09-10T05:35:29.586 INFO:teuthology.orchestra.run.smithi002.stdout: bluestore fsck on mount = True 2024-09-10T05:35:29.586 INFO:teuthology.orchestra.run.smithi002.stdout: debug bluefs = 1/20 2024-09-10T05:35:29.586 INFO:teuthology.orchestra.run.smithi002.stdout: debug bluestore = 1/20 2024-09-10T05:35:29.587 INFO:teuthology.orchestra.run.smithi002.stdout: debug osd = 20 2024-09-10T05:35:29.587 INFO:teuthology.orchestra.run.smithi002.stdout: debug rocksdb = 4/10 2024-09-10T05:35:29.587 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T05:35:29.587 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd full ratio = 0.9 2024-09-10T05:35:29.587 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd nearfull ratio = 0.8 2024-09-10T05:35:29.587 INFO:teuthology.orchestra.run.smithi002.stdout: osd failsafe full ratio = 0.95 2024-09-10T05:35:29.587 INFO:teuthology.orchestra.run.smithi002.stdout: osd objectstore = bluestore 2024-09-10T05:35:29.587 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T05:35:29.587 INFO:teuthology.orchestra.run.smithi002.stdout:[mgr] 2024-09-10T05:35:29.587 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2024-09-10T05:35:29.587 INFO:teuthology.orchestra.run.smithi002.stdout: debug mgr = 20 2024-09-10T05:35:29.587 INFO:teuthology.orchestra.run.smithi002.stdout: debug mon = 20 2024-09-10T05:35:29.587 INFO:teuthology.orchestra.run.smithi002.stdout: debug auth = 20 2024-09-10T05:35:29.587 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min pgs per osd = 4 2024-09-10T05:35:29.588 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min bytes per osd = 10 2024-09-10T05:35:29.588 INFO:teuthology.orchestra.run.smithi002.stdout: mgr/telemetry/nag = false 2024-09-10T05:35:29.588 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T05:35:29.588 INFO:teuthology.orchestra.run.smithi002.stdout:[mon] 2024-09-10T05:35:29.588 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2024-09-10T05:35:29.588 INFO:teuthology.orchestra.run.smithi002.stdout: debug mon = 20 2024-09-10T05:35:29.588 INFO:teuthology.orchestra.run.smithi002.stdout: debug paxos = 20 2024-09-10T05:35:29.588 INFO:teuthology.orchestra.run.smithi002.stdout: debug auth = 20 2024-09-10T05:35:29.588 INFO:teuthology.orchestra.run.smithi002.stdout: mon data avail warn = 5 2024-09-10T05:35:29.588 INFO:teuthology.orchestra.run.smithi002.stdout: mon mgr mkfs grace = 240 2024-09-10T05:35:29.588 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min pgs per osd = 4 2024-09-10T05:35:29.588 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd reporter subtree level = osd 2024-09-10T05:35:29.588 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd prime pg temp = true 2024-09-10T05:35:29.588 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min bytes per osd = 10 2024-09-10T05:35:29.589 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T05:35:29.589 INFO:teuthology.orchestra.run.smithi002.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T05:35:29.589 INFO:teuthology.orchestra.run.smithi002.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T05:35:29.589 INFO:teuthology.orchestra.run.smithi002.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T05:35:29.589 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T05:35:29.589 INFO:teuthology.orchestra.run.smithi002.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T05:35:29.589 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T05:35:29.589 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T05:35:29.589 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T05:35:29.589 INFO:teuthology.orchestra.run.smithi002.stdout: # 1m isn't quite enough 2024-09-10T05:35:29.589 INFO:teuthology.orchestra.run.smithi002.stdout: mon_down_mkfs_grace = 2m 2024-09-10T05:35:29.589 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T05:35:29.589 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_filestore_osds = false 2024-09-10T05:35:29.589 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T05:35:29.590 INFO:teuthology.orchestra.run.smithi002.stdout:[client] 2024-09-10T05:35:29.590 INFO:teuthology.orchestra.run.smithi002.stdout: rgw cache enabled = true 2024-09-10T05:35:29.590 INFO:teuthology.orchestra.run.smithi002.stdout: rgw enable ops log = true 2024-09-10T05:35:29.590 INFO:teuthology.orchestra.run.smithi002.stdout: rgw enable usage log = true 2024-09-10T05:35:29.590 INFO:teuthology.orchestra.run.smithi002.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T05:35:29.590 INFO:teuthology.orchestra.run.smithi002.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T05:35:29.590 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2024-09-10T05:35:29.590 INFO:teuthology.orchestra.run.smithi002.stdout: rgw gc obj min wait = 15 2024-09-10T05:35:29.590 INFO:teuthology.orchestra.run.smithi002.stdout: debug rgw = 20 2024-09-10T05:35:29.590 INFO:teuthology.orchestra.run.smithi002.stdout: setgroup = ceph 2024-09-10T05:35:29.590 INFO:teuthology.orchestra.run.smithi002.stdout: setuser = ceph 2024-09-10T05:35:29.590 INFO:teuthology.orchestra.run.smithi002.stdout:[mon.a] 2024-09-10T05:35:29.591 INFO:teuthology.orchestra.run.smithi062.stdout:[global] 2024-09-10T05:35:29.591 INFO:teuthology.orchestra.run.smithi062.stdout: chdir = "" 2024-09-10T05:35:29.591 INFO:teuthology.orchestra.run.smithi062.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T05:35:29.591 INFO:teuthology.orchestra.run.smithi062.stdout: auth supported = cephx 2024-09-10T05:35:29.591 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-10T05:35:29.591 INFO:teuthology.orchestra.run.smithi062.stdout: filestore xattr use omap = true 2024-09-10T05:35:29.591 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-10T05:35:29.591 INFO:teuthology.orchestra.run.smithi062.stdout: mon clock drift allowed = 1.000 2024-09-10T05:35:29.591 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-10T05:35:29.591 INFO:teuthology.orchestra.run.smithi062.stdout: osd crush chooseleaf type = 0 2024-09-10T05:35:29.592 INFO:teuthology.orchestra.run.smithi062.stdout: auth debug = true 2024-09-10T05:35:29.592 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-10T05:35:29.592 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on old message = true 2024-09-10T05:35:29.592 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on bug = true 2024-09-10T05:35:29.592 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-10T05:35:29.592 INFO:teuthology.orchestra.run.smithi062.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T05:35:29.592 INFO:teuthology.orchestra.run.smithi062.stdout: mon pg warn max object skew = 0 2024-09-10T05:35:29.592 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-10T05:35:29.592 INFO:teuthology.orchestra.run.smithi062.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T05:35:29.592 INFO:teuthology.orchestra.run.smithi062.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T05:35:29.592 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-10T05:35:29.592 INFO:teuthology.orchestra.run.smithi062.stdout: osd pool default size = 2 2024-09-10T05:35:29.592 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-10T05:35:29.592 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd allow primary affinity = true 2024-09-10T05:35:29.593 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd allow pg remap = true 2024-09-10T05:35:29.593 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on legacy crush tunables = false 2024-09-10T05:35:29.593 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on crush straw calc version zero = false 2024-09-10T05:35:29.593 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on no sortbitwise = false 2024-09-10T05:35:29.593 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on osd down out interval zero = false 2024-09-10T05:35:29.593 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on too few osds = false 2024-09-10T05:35:29.593 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T05:35:29.593 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T05:35:29.593 INFO:teuthology.orchestra.run.smithi062.stdout: mon_allow_pool_size_one = true 2024-09-10T05:35:29.593 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-10T05:35:29.593 INFO:teuthology.orchestra.run.smithi062.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T05:35:29.593 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-10T05:35:29.593 INFO:teuthology.orchestra.run.smithi062.stdout: osd default data pool replay window = 5 2024-09-10T05:35:29.594 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-10T05:35:29.594 INFO:teuthology.orchestra.run.smithi062.stdout: mon allow pool delete = true 2024-09-10T05:35:29.594 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-10T05:35:29.594 INFO:teuthology.orchestra.run.smithi062.stdout: mon cluster log file level = debug 2024-09-10T05:35:29.594 INFO:teuthology.orchestra.run.smithi062.stdout: debug asserts on shutdown = true 2024-09-10T05:35:29.594 INFO:teuthology.orchestra.run.smithi062.stdout: mon health detail to clog = false 2024-09-10T05:35:29.594 INFO:teuthology.orchestra.run.smithi062.stdout: mon host = 172.21.15.2 2024-09-10T05:35:29.594 INFO:teuthology.orchestra.run.smithi062.stdout: fsid = 004d9798-7539-4e93-b06c-e32e30a3c3b6 2024-09-10T05:35:29.594 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-10T05:35:29.594 INFO:teuthology.orchestra.run.smithi062.stdout:[osd] 2024-09-10T05:35:29.594 INFO:teuthology.orchestra.run.smithi062.stdout: osd journal size = 100 2024-09-10T05:35:29.594 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-10T05:35:29.594 INFO:teuthology.orchestra.run.smithi062.stdout: osd scrub load threshold = 5.0 2024-09-10T05:35:29.594 INFO:teuthology.orchestra.run.smithi062.stdout: osd scrub max interval = 600 2024-09-10T05:35:29.594 INFO:teuthology.orchestra.run.smithi062.stdout: osd mclock profile = high_recovery_ops 2024-09-10T05:35:29.595 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-10T05:35:29.595 INFO:teuthology.orchestra.run.smithi062.stdout: osd recover clone overlap = true 2024-09-10T05:35:29.595 INFO:teuthology.orchestra.run.smithi062.stdout: osd recovery max chunk = 1048576 2024-09-10T05:35:29.595 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-10T05:35:29.595 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug shutdown = true 2024-09-10T05:35:29.595 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug op order = true 2024-09-10T05:35:29.595 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug verify stray on activate = true 2024-09-10T05:35:29.595 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug trim objects = true 2024-09-10T05:35:29.595 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-10T05:35:29.595 INFO:teuthology.orchestra.run.smithi062.stdout: osd open classes on start = true 2024-09-10T05:35:29.595 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug pg log writeout = true 2024-09-10T05:35:29.595 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-10T05:35:29.595 INFO:teuthology.orchestra.run.smithi062.stdout: osd deep scrub update digest min age = 30 2024-09-10T05:35:29.595 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-10T05:35:29.596 INFO:teuthology.orchestra.run.smithi062.stdout: osd map max advance = 10 2024-09-10T05:35:29.596 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-10T05:35:29.596 INFO:teuthology.orchestra.run.smithi062.stdout: journal zero on create = true 2024-09-10T05:35:29.596 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-10T05:35:29.596 INFO:teuthology.orchestra.run.smithi062.stdout: filestore ondisk finisher threads = 3 2024-09-10T05:35:29.596 INFO:teuthology.orchestra.run.smithi062.stdout: filestore apply finisher threads = 3 2024-09-10T05:35:29.596 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-10T05:35:29.596 INFO:teuthology.orchestra.run.smithi062.stdout: bdev debug aio = true 2024-09-10T05:35:29.596 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug misdirected ops = true 2024-09-10T05:35:29.596 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2024-09-10T05:35:29.596 INFO:teuthology.orchestra.run.smithi062.stdout: debug objclass = 20 2024-09-10T05:35:29.596 INFO:teuthology.orchestra.run.smithi062.stdout: bdev async discard = True 2024-09-10T05:35:29.596 INFO:teuthology.orchestra.run.smithi062.stdout: bdev enable discard = True 2024-09-10T05:35:29.596 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore allocator = bitmap 2024-09-10T05:35:29.597 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore block size = 96636764160 2024-09-10T05:35:29.597 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore fsck on mount = True 2024-09-10T05:35:29.597 INFO:teuthology.orchestra.run.smithi062.stdout: debug bluefs = 1/20 2024-09-10T05:35:29.597 INFO:teuthology.orchestra.run.smithi062.stdout: debug bluestore = 1/20 2024-09-10T05:35:29.597 INFO:teuthology.orchestra.run.smithi062.stdout: debug osd = 20 2024-09-10T05:35:29.597 INFO:teuthology.orchestra.run.smithi062.stdout: debug rocksdb = 4/10 2024-09-10T05:35:29.597 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T05:35:29.597 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd full ratio = 0.9 2024-09-10T05:35:29.597 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd nearfull ratio = 0.8 2024-09-10T05:35:29.597 INFO:teuthology.orchestra.run.smithi062.stdout: osd failsafe full ratio = 0.95 2024-09-10T05:35:29.597 INFO:teuthology.orchestra.run.smithi062.stdout: osd objectstore = bluestore 2024-09-10T05:35:29.597 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-10T05:35:29.597 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr] 2024-09-10T05:35:29.597 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2024-09-10T05:35:29.598 INFO:teuthology.orchestra.run.smithi062.stdout: debug mgr = 20 2024-09-10T05:35:29.598 INFO:teuthology.orchestra.run.smithi062.stdout: debug mon = 20 2024-09-10T05:35:29.598 INFO:teuthology.orchestra.run.smithi062.stdout: debug auth = 20 2024-09-10T05:35:29.598 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min pgs per osd = 4 2024-09-10T05:35:29.598 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min bytes per osd = 10 2024-09-10T05:35:29.598 INFO:teuthology.orchestra.run.smithi062.stdout: mgr/telemetry/nag = false 2024-09-10T05:35:29.598 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-10T05:35:29.598 INFO:teuthology.orchestra.run.smithi062.stdout:[mon] 2024-09-10T05:35:29.598 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2024-09-10T05:35:29.598 INFO:teuthology.orchestra.run.smithi062.stdout: debug mon = 20 2024-09-10T05:35:29.598 INFO:teuthology.orchestra.run.smithi062.stdout: debug paxos = 20 2024-09-10T05:35:29.598 INFO:teuthology.orchestra.run.smithi062.stdout: debug auth = 20 2024-09-10T05:35:29.598 INFO:teuthology.orchestra.run.smithi062.stdout: mon data avail warn = 5 2024-09-10T05:35:29.598 INFO:teuthology.orchestra.run.smithi062.stdout: mon mgr mkfs grace = 240 2024-09-10T05:35:29.598 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min pgs per osd = 4 2024-09-10T05:35:29.599 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd reporter subtree level = osd 2024-09-10T05:35:29.599 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd prime pg temp = true 2024-09-10T05:35:29.599 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min bytes per osd = 10 2024-09-10T05:35:29.599 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-10T05:35:29.599 INFO:teuthology.orchestra.run.smithi062.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T05:35:29.599 INFO:teuthology.orchestra.run.smithi062.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T05:35:29.599 INFO:teuthology.orchestra.run.smithi062.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T05:35:29.599 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-10T05:35:29.599 INFO:teuthology.orchestra.run.smithi062.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T05:35:29.599 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T05:35:29.599 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T05:35:29.599 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-10T05:35:29.599 INFO:teuthology.orchestra.run.smithi062.stdout: # 1m isn't quite enough 2024-09-10T05:35:29.599 INFO:teuthology.orchestra.run.smithi062.stdout: mon_down_mkfs_grace = 2m 2024-09-10T05:35:29.600 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-10T05:35:29.600 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_filestore_osds = false 2024-09-10T05:35:29.600 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-10T05:35:29.600 INFO:teuthology.orchestra.run.smithi062.stdout:[client] 2024-09-10T05:35:29.600 INFO:teuthology.orchestra.run.smithi062.stdout: rgw cache enabled = true 2024-09-10T05:35:29.600 INFO:teuthology.orchestra.run.smithi062.stdout: rgw enable ops log = true 2024-09-10T05:35:29.600 INFO:teuthology.orchestra.run.smithi062.stdout: rgw enable usage log = true 2024-09-10T05:35:29.600 INFO:teuthology.orchestra.run.smithi062.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T05:35:29.600 INFO:teuthology.orchestra.run.smithi062.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T05:35:29.600 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2024-09-10T05:35:29.600 INFO:teuthology.orchestra.run.smithi062.stdout: rgw gc obj min wait = 15 2024-09-10T05:35:29.600 INFO:teuthology.orchestra.run.smithi062.stdout: debug rgw = 20 2024-09-10T05:35:29.600 INFO:teuthology.orchestra.run.smithi062.stdout: setgroup = ceph 2024-09-10T05:35:29.600 INFO:teuthology.orchestra.run.smithi062.stdout: setuser = ceph 2024-09-10T05:35:29.601 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.a] 2024-09-10T05:35:29.602 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-10T05:35:29.602 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-10T05:35:29.696 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-10T05:35:29.697 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T05:35:29.697 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-10T05:35:29.702 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T05:35:29.702 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-10T05:35:29.750 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi002.front.sepia.ceph.com 2024-09-10T05:35:29.750 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T05:35:29.750 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-10T05:35:29.750 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T05:35:29.817 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T05:35:29.817 DEBUG:teuthology.orchestra.run.smithi002:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-10T05:35:29.863 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi062.front.sepia.ceph.com 2024-09-10T05:35:29.863 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-10T05:35:29.863 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-10T05:35:29.863 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T05:35:29.887 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-10T05:35:29.887 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-10T05:35:29.933 INFO:tasks.ceph:Setting up mon nodes... 2024-09-10T05:35:29.934 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-10T05:35:29.934 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-10T05:35:30.020 INFO:teuthology.orchestra.run.smithi062.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-10T05:35:30.029 INFO:tasks.ceph:Setting up mds nodes... 2024-09-10T05:35:30.029 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-10T05:35:30.029 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-10T05:35:30.106 INFO:teuthology.orchestra.run.smithi062.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-10T05:35:30.117 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-10T05:35:30.117 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi002.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi062.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-10T05:35:30.117 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-10T05:35:30.131 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-10T05:35:30.131 INFO:tasks.ceph:role: osd.0 2024-09-10T05:35:30.131 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi002.front.sepia.ceph.com 2024-09-10T05:35:30.131 DEBUG:teuthology.orchestra.run.smithi002:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-10T05:35:30.186 INFO:teuthology.orchestra.run.smithi002.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T05:35:30.186 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T05:35:30.186 INFO:teuthology.orchestra.run.smithi002.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T05:35:30.186 INFO:teuthology.orchestra.run.smithi002.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T05:35:30.186 INFO:teuthology.orchestra.run.smithi002.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T05:35:30.186 INFO:teuthology.orchestra.run.smithi002.stdout: = sunit=0 swidth=0 blks 2024-09-10T05:35:30.186 INFO:teuthology.orchestra.run.smithi002.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T05:35:30.187 INFO:teuthology.orchestra.run.smithi002.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T05:35:30.187 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T05:35:30.187 INFO:teuthology.orchestra.run.smithi002.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T05:35:30.210 INFO:teuthology.orchestra.run.smithi002.stdout:Discarding blocks...Done. 2024-09-10T05:35:30.212 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi002.front.sepia.ceph.com -o noatime 2024-09-10T05:35:30.212 DEBUG:teuthology.orchestra.run.smithi002:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-10T05:35:30.271 DEBUG:teuthology.orchestra.run.smithi002:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-10T05:35:30.322 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T05:35:30.323 INFO:teuthology.orchestra.run.smithi002.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T05:35:30.323 DEBUG:teuthology.orchestra.run.smithi002:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T05:35:30.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:30.416+0000 7f9f60f257c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-10T05:35:30.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:30.416+0000 7f9f60f257c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-10T05:35:30.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:30.416+0000 7f9f60f257c0 -1 bdev(0x55ef2e3d7800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-10T05:35:30.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:30.416+0000 7f9f60f257c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-10T05:35:33.577 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-10T05:35:33.592 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-10T05:35:33.606 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-10T05:35:33.606 INFO:tasks.ceph:role: osd.1 2024-09-10T05:35:33.606 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi062.front.sepia.ceph.com 2024-09-10T05:35:33.606 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-10T05:35:33.674 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T05:35:33.674 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T05:35:33.674 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T05:35:33.674 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T05:35:33.674 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T05:35:33.674 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2024-09-10T05:35:33.674 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T05:35:33.674 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T05:35:33.674 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T05:35:33.674 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T05:35:34.128 INFO:teuthology.orchestra.run.smithi062.stdout:Discarding blocks...Done. 2024-09-10T05:35:34.130 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2024-09-10T05:35:34.131 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-09-10T05:35:34.297 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-10T05:35:34.308 INFO:teuthology.orchestra.run.smithi062.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T05:35:34.308 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T05:35:34.309 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-10T05:35:34.366 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-10T05:35:34.366 INFO:tasks.ceph:role: osd.2 2024-09-10T05:35:34.366 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi062.front.sepia.ceph.com 2024-09-10T05:35:34.366 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-10T05:35:34.429 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T05:35:34.430 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T05:35:34.430 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T05:35:34.430 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T05:35:34.430 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T05:35:34.430 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2024-09-10T05:35:34.430 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T05:35:34.430 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T05:35:34.430 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T05:35:34.430 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T05:35:34.871 INFO:teuthology.orchestra.run.smithi062.stdout:Discarding blocks...Done. 2024-09-10T05:35:34.873 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2024-09-10T05:35:34.873 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-09-10T05:35:34.938 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-10T05:35:34.996 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T05:35:34.996 INFO:teuthology.orchestra.run.smithi062.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T05:35:34.996 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-10T05:35:35.049 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-10T05:35:35.049 INFO:tasks.ceph:role: osd.3 2024-09-10T05:35:35.049 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi062.front.sepia.ceph.com 2024-09-10T05:35:35.049 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-10T05:35:35.116 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T05:35:35.117 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T05:35:35.117 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T05:35:35.117 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T05:35:35.117 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T05:35:35.117 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2024-09-10T05:35:35.117 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T05:35:35.117 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T05:35:35.117 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T05:35:35.117 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T05:35:35.573 INFO:teuthology.orchestra.run.smithi062.stdout:Discarding blocks...Done. 2024-09-10T05:35:35.575 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2024-09-10T05:35:35.575 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-09-10T05:35:35.658 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-10T05:35:35.709 INFO:teuthology.orchestra.run.smithi062.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T05:35:35.710 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T05:35:35.711 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T05:35:35.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:35.820+0000 7f0d6990c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-10T05:35:35.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:35.824+0000 7f0d6990c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-10T05:35:35.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:35.824+0000 7f0d6990c7c0 -1 bdev(0x557deccfb800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-10T05:35:35.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:35.824+0000 7f0d6990c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-10T05:35:38.979 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-10T05:35:38.994 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T05:35:39.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:39.080+0000 7f78c271f7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-10T05:35:39.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:39.080+0000 7f78c271f7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-10T05:35:39.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:39.080+0000 7f78c271f7c0 -1 bdev(0x56484f9f7800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-10T05:35:39.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:39.080+0000 7f78c271f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-10T05:35:42.219 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-10T05:35:42.274 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T05:35:42.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:42.356+0000 7f0333f197c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-10T05:35:42.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:42.356+0000 7f0333f197c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-10T05:35:42.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:42.356+0000 7f0333f197c0 -1 bdev(0x55764edc1800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-10T05:35:42.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:42.356+0000 7f0333f197c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-10T05:35:45.478 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-10T05:35:45.534 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-10T05:35:45.534 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T05:35:45.534 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-10T05:35:45.550 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-10T05:35:45.550 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-10T05:35:45.589 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-10T05:35:45.590 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-10T05:35:45.645 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-10T05:35:45.645 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-10T05:35:45.701 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-10T05:35:45.702 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-10T05:35:45.757 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-10T05:35:45.757 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-10T05:35:45.805 INFO:tasks.ceph:Adding keys to all mons... 2024-09-10T05:35:45.806 DEBUG:teuthology.orchestra.run.smithi002:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-10T05:35:45.818 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.0] 2024-09-10T05:35:45.818 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQCi2t9mfeIiGRAA8A0APkX5F5ZS/5Z+6MSxQw== 2024-09-10T05:35:45.818 INFO:teuthology.orchestra.run.smithi002.stdout:[mgr.x] 2024-09-10T05:35:45.818 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQCi2t9m+ANEARAAobcGdd2glWqKmFAXT7c4UA== 2024-09-10T05:35:45.818 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.1] 2024-09-10T05:35:45.819 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQCn2t9mg4IlMRAA3B1anLGK9JEhn4PvhUcOvg== 2024-09-10T05:35:45.819 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.2] 2024-09-10T05:35:45.819 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQCr2t9mMITtBBAAzzK4mUue2K3y3obji4IwFw== 2024-09-10T05:35:45.819 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.3] 2024-09-10T05:35:45.819 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQCu2t9mldRtFRAAu+jx7Ih0Yy3AAXvkcmTXxQ== 2024-09-10T05:35:45.819 INFO:teuthology.orchestra.run.smithi002.stdout:[client.0] 2024-09-10T05:35:45.819 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQCi2t9mZw5pBhAAxDAHVyJZFJ/B3oMu6PvbQw== 2024-09-10T05:35:45.820 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T05:35:45.910 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T05:35:45.955 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T05:35:46.042 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T05:35:46.082 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T05:35:46.165 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T05:35:46.249 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-10T05:35:46.249 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-10T05:35:46.304 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T05:35:46.390 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-10T05:35:46.400 DEBUG:teuthology.orchestra.run.smithi002:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-10T05:35:46.446 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-10T05:35:46.446 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-10T05:35:46.446 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-10T05:35:46.491 INFO:tasks.ceph.mon.a:Started 2024-09-10T05:35:46.491 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-10T05:35:46.491 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-10T05:35:46.492 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-10T05:35:46.494 INFO:tasks.ceph.mgr.x:Started 2024-09-10T05:35:46.494 DEBUG:tasks.ceph:set 0 configs 2024-09-10T05:35:46.494 INFO:tasks.ceph:Setting crush tunables to default 2024-09-10T05:35:46.494 DEBUG:teuthology.orchestra.run.smithi002:> sudo ceph --cluster ceph osd crush tunables default 2024-09-10T05:35:46.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:46.616+0000 7f84d949b640 1 Processor -- start 2024-09-10T05:35:46.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:46.616+0000 7f84d949b640 1 -- start start 2024-09-10T05:35:46.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:46.620+0000 7f84d949b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f84d4073640 0x7f84d41346a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:35:46.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:46.620+0000 7f84d949b640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84d4074040 con 0x7f84d406dbc0 2024-09-10T05:35:46.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:46.620+0000 7f84d949b640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f84d406e6b0 con 0x7f84d4073640 2024-09-10T05:35:46.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:46.620+0000 7f84d27fc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f84d4073640 0x7f84d41346a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:35:46.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:46.620+0000 7f84d27fc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f84d4073640 0x7f84d41346a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35322/0 (socket says 172.21.15.2:35322) 2024-09-10T05:35:46.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:46.620+0000 7f84d27fc640 1 -- 172.21.15.2:0/1148785293 learned_addr learned my addr 172.21.15.2:0/1148785293 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:35:46.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:46.620+0000 7f84d2ffd640 1 --1- 172.21.15.2:0/1148785293 >> v1:172.21.15.2:6789/0 conn(0x7f84d406dbc0 0x7f84d406dfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55626/0 (socket says 172.21.15.2:55626) 2024-09-10T05:35:46.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:46.620+0000 7f84d27fc640 1 -- 172.21.15.2:0/1148785293 >> v1:172.21.15.2:6789/0 conn(0x7f84d406dbc0 legacy=0x7f84d406dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:35:46.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:46.620+0000 7f84d27fc640 1 -- 172.21.15.2:0/1148785293 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84d406e860 con 0x7f84d4073640 2024-09-10T05:35:46.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:46.620+0000 7f84d27fc640 1 --2- 172.21.15.2:0/1148785293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84d4073640 0x7f84d41346a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f84c8009820 tx=0x7f84c801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=796022e347a64502 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:35:46.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:46.620+0000 7f84d1ffb640 1 -- 172.21.15.2:0/1148785293 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84c80ab560 con 0x7f84d4073640 2024-09-10T05:35:46.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:46.620+0000 7f84d1ffb640 1 -- 172.21.15.2:0/1148785293 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84c80b0070 con 0x7f84d4073640 2024-09-10T05:35:46.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:46.620+0000 7f84d1ffb640 1 -- 172.21.15.2:0/1148785293 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84c80ab850 con 0x7f84d4073640 2024-09-10T05:35:46.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:46.620+0000 7f84d949b640 1 -- 172.21.15.2:0/1148785293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84d4073640 msgr2=0x7f84d41346a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:35:46.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:46.620+0000 7f84d949b640 1 --2- 172.21.15.2:0/1148785293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84d4073640 0x7f84d41346a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f84c8009820 tx=0x7f84c801c410 comp rx=0 tx=0).stop 2024-09-10T05:35:46.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:46.620+0000 7f84d949b640 1 -- 172.21.15.2:0/1148785293 shutdown_connections 2024-09-10T05:35:46.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:46.620+0000 7f84d949b640 1 --2- 172.21.15.2:0/1148785293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84d4073640 0x7f84d41346a0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:35:46.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:46.624+0000 7f84d949b640 1 -- 172.21.15.2:0/1148785293 >> 172.21.15.2:0/1148785293 conn(0x7f84d409cde0 msgr2=0x7f84d409d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:35:46.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:46.624+0000 7f84d949b640 1 -- 172.21.15.2:0/1148785293 shutdown_connections 2024-09-10T05:35:46.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:46.624+0000 7f84d949b640 1 -- 172.21.15.2:0/1148785293 wait complete. 2024-09-10T05:35:46.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:46.624+0000 7f84d949b640 1 Processor -- start 2024-09-10T05:35:46.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:46.624+0000 7f84d949b640 1 -- start start 2024-09-10T05:35:46.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:46.624+0000 7f84d949b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84d406dbc0 0x7f84d41c6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:35:46.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:46.624+0000 7f84d949b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f84d4137790 con 0x7f84d406dbc0 2024-09-10T05:35:46.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:46.624+0000 7f84d2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84d406dbc0 0x7f84d41c6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:35:46.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:46.624+0000 7f84d2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84d406dbc0 0x7f84d41c6aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35336/0 (socket says 172.21.15.2:35336) 2024-09-10T05:35:46.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:46.624+0000 7f84d2ffd640 1 -- 172.21.15.2:0/2493106956 learned_addr learned my addr 172.21.15.2:0/2493106956 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:35:46.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:46.624+0000 7f84d2ffd640 1 -- 172.21.15.2:0/2493106956 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84d41280b0 con 0x7f84d406dbc0 2024-09-10T05:35:46.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:46.624+0000 7f84d2ffd640 1 --2- 172.21.15.2:0/2493106956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84d406dbc0 0x7f84d41c6aa0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f84c400c450 tx=0x7f84c400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:35:46.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:46.624+0000 7f84bb7fe640 1 -- 172.21.15.2:0/2493106956 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84c4007410 con 0x7f84d406dbc0 2024-09-10T05:35:46.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:46.624+0000 7f84bb7fe640 1 -- 172.21.15.2:0/2493106956 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84c40075b0 con 0x7f84d406dbc0 2024-09-10T05:35:46.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:46.624+0000 7f84d949b640 1 -- 172.21.15.2:0/2493106956 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84d4099010 con 0x7f84d406dbc0 2024-09-10T05:35:46.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:46.624+0000 7f84bb7fe640 1 -- 172.21.15.2:0/2493106956 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84c4004960 con 0x7f84d406dbc0 2024-09-10T05:35:46.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:46.624+0000 7f84d949b640 1 -- 172.21.15.2:0/2493106956 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84d41286d0 con 0x7f84d406dbc0 2024-09-10T05:35:46.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:46.624+0000 7f84bb7fe640 1 -- 172.21.15.2:0/2493106956 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f84c401a020 con 0x7f84d406dbc0 2024-09-10T05:35:46.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:46.624+0000 7f84bb7fe640 1 -- 172.21.15.2:0/2493106956 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f84c401c5b0 con 0x7f84d406dbc0 2024-09-10T05:35:46.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:46.624+0000 7f84d949b640 1 -- 172.21.15.2:0/2493106956 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84d406dfa0 con 0x7f84d406dbc0 2024-09-10T05:35:46.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:46.636+0000 7f84bb7fe640 1 -- 172.21.15.2:0/2493106956 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f84c4021070 con 0x7f84d406dbc0 2024-09-10T05:35:46.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:46.700+0000 7f84d949b640 1 -- 172.21.15.2:0/2493106956 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f84d4068e50 con 0x7f84d406dbc0 2024-09-10T05:35:46.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:46.704+0000 7f84bb7fe640 1 -- 172.21.15.2:0/2493106956 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f84c401ca40 con 0x7f84d406dbc0 2024-09-10T05:35:46.706 INFO:teuthology.orchestra.run.smithi002.stderr:adjusted tunables profile to default 2024-09-10T05:35:46.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:46.704+0000 7f84d949b640 1 -- 172.21.15.2:0/2493106956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84d406dbc0 msgr2=0x7f84d41c6aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:35:46.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:46.704+0000 7f84d949b640 1 --2- 172.21.15.2:0/2493106956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84d406dbc0 0x7f84d41c6aa0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f84c400c450 tx=0x7f84c400c910 comp rx=0 tx=0).stop 2024-09-10T05:35:46.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:46.704+0000 7f84d949b640 1 -- 172.21.15.2:0/2493106956 shutdown_connections 2024-09-10T05:35:46.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:46.704+0000 7f84d949b640 1 --2- 172.21.15.2:0/2493106956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84d406dbc0 0x7f84d41c6aa0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:35:46.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:46.704+0000 7f84d949b640 1 -- 172.21.15.2:0/2493106956 >> 172.21.15.2:0/2493106956 conn(0x7f84d409cde0 msgr2=0x7f84d4099710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:35:46.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:46.704+0000 7f84d949b640 1 -- 172.21.15.2:0/2493106956 shutdown_connections 2024-09-10T05:35:46.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:46.704+0000 7f84d949b640 1 -- 172.21.15.2:0/2493106956 wait complete. 2024-09-10T05:35:46.724 INFO:tasks.ceph:check_enable_crimson: False 2024-09-10T05:35:46.724 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-10T05:35:46.725 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T05:35:46.725 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-10T05:35:46.737 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-10T05:35:46.738 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-10T05:35:46.750 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-10T05:35:46.750 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-10T05:35:46.806 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-10T05:35:46.806 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-10T05:35:46.860 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new 6b013ec0-c5ae-44ad-8d52-95ef02dc3140 0 2024-09-10T05:35:47.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.028+0000 7f9a2b519640 1 Processor -- start 2024-09-10T05:35:47.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.028+0000 7f9a2b519640 1 -- start start 2024-09-10T05:35:47.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.028+0000 7f9a2b519640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9a24119710 0x7f9a2411bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:35:47.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.028+0000 7f9a2b519640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a2411c0d0 con 0x7f9a241157d0 2024-09-10T05:35:47.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.028+0000 7f9a2b519640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f9a2411d2b0 con 0x7f9a24119710 2024-09-10T05:35:47.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.028+0000 7f9a28ab4640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9a24119710 0x7f9a2411bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:35:47.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.028+0000 7f9a28ab4640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9a24119710 0x7f9a2411bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51520/0 (socket says 172.21.15.62:51520) 2024-09-10T05:35:47.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.028+0000 7f9a28ab4640 1 -- 172.21.15.62:0/2832030874 learned_addr learned my addr 172.21.15.62:0/2832030874 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:35:47.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.028+0000 7f9a28ab4640 1 -- 172.21.15.62:0/2832030874 >> v1:172.21.15.2:6789/0 conn(0x7f9a241157d0 legacy=0x7f9a24115bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:35:47.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.028+0000 7f9a28ab4640 1 -- 172.21.15.62:0/2832030874 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a2411d430 con 0x7f9a24119710 2024-09-10T05:35:47.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.028+0000 7f9a23fff640 1 -- 172.21.15.62:0/2832030874 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1587382327 0 0) 0x7f9a2411c0d0 con 0x7f9a241157d0 2024-09-10T05:35:47.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.032+0000 7f9a28ab4640 1 --2- 172.21.15.62:0/2832030874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a24119710 0x7f9a2411bb00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9a180097f0 tx=0x7f9a1801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1bed6d3e91b06bc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:35:47.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.032+0000 7f9a23fff640 1 -- 172.21.15.62:0/2832030874 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a180ab580 con 0x7f9a24119710 2024-09-10T05:35:47.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.032+0000 7f9a23fff640 1 -- 172.21.15.62:0/2832030874 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a180b0070 con 0x7f9a24119710 2024-09-10T05:35:47.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.032+0000 7f9a23fff640 1 -- 172.21.15.62:0/2832030874 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a180ab870 con 0x7f9a24119710 2024-09-10T05:35:47.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.032+0000 7f9a2b519640 1 -- 172.21.15.62:0/2832030874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a24119710 msgr2=0x7f9a2411bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:35:47.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.032+0000 7f9a2b519640 1 --2- 172.21.15.62:0/2832030874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a24119710 0x7f9a2411bb00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9a180097f0 tx=0x7f9a1801c430 comp rx=0 tx=0).stop 2024-09-10T05:35:47.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.032+0000 7f9a2b519640 1 -- 172.21.15.62:0/2832030874 shutdown_connections 2024-09-10T05:35:47.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.032+0000 7f9a2b519640 1 --2- 172.21.15.62:0/2832030874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a24119710 0x7f9a2411bb00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:35:47.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.032+0000 7f9a2b519640 1 -- 172.21.15.62:0/2832030874 >> 172.21.15.62:0/2832030874 conn(0x7f9a24070f30 msgr2=0x7f9a24073350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:35:47.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.032+0000 7f9a2b519640 1 -- 172.21.15.62:0/2832030874 shutdown_connections 2024-09-10T05:35:47.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.032+0000 7f9a2b519640 1 -- 172.21.15.62:0/2832030874 wait complete. 2024-09-10T05:35:47.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.032+0000 7f9a2b519640 1 Processor -- start 2024-09-10T05:35:47.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.032+0000 7f9a2b519640 1 -- start start 2024-09-10T05:35:47.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.036+0000 7f9a2b519640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a241157d0 0x7f9a2410feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:35:47.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.036+0000 7f9a2b519640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9a2411cf60 con 0x7f9a241157d0 2024-09-10T05:35:47.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.036+0000 7f9a292b5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a241157d0 0x7f9a2410feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:35:47.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.036+0000 7f9a292b5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a241157d0 0x7f9a2410feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51522/0 (socket says 172.21.15.62:51522) 2024-09-10T05:35:47.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.036+0000 7f9a292b5640 1 -- 172.21.15.62:0/985691404 learned_addr learned my addr 172.21.15.62:0/985691404 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:35:47.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.036+0000 7f9a292b5640 1 -- 172.21.15.62:0/985691404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a24111da0 con 0x7f9a241157d0 2024-09-10T05:35:47.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.036+0000 7f9a292b5640 1 --2- 172.21.15.62:0/985691404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a241157d0 0x7f9a2410feb0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c00c3a0 tx=0x7f9a1c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:35:47.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.036+0000 7f9a21ffb640 1 -- 172.21.15.62:0/985691404 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a1c017070 con 0x7f9a241157d0 2024-09-10T05:35:47.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.036+0000 7f9a21ffb640 1 -- 172.21.15.62:0/985691404 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a1c005410 con 0x7f9a241157d0 2024-09-10T05:35:47.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.036+0000 7f9a2b519640 1 -- 172.21.15.62:0/985691404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a24110450 con 0x7f9a241157d0 2024-09-10T05:35:47.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.036+0000 7f9a21ffb640 1 -- 172.21.15.62:0/985691404 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a1c003770 con 0x7f9a241157d0 2024-09-10T05:35:47.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.036+0000 7f9a2b519640 1 -- 172.21.15.62:0/985691404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a241109e0 con 0x7f9a241157d0 2024-09-10T05:35:47.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.036+0000 7f9a21ffb640 1 -- 172.21.15.62:0/985691404 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9a1c01a070 con 0x7f9a241157d0 2024-09-10T05:35:47.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.036+0000 7f9a21ffb640 1 -- 172.21.15.62:0/985691404 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f9a1c012740 con 0x7f9a241157d0 2024-09-10T05:35:47.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.036+0000 7f9a2b519640 1 -- 172.21.15.62:0/985691404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a24110d20 con 0x7f9a241157d0 2024-09-10T05:35:47.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.044+0000 7f9a21ffb640 1 -- 172.21.15.62:0/985691404 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f9a1c021020 con 0x7f9a241157d0 2024-09-10T05:35:47.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.116+0000 7f9a2b519640 1 -- 172.21.15.62:0/985691404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6b013ec0-c5ae-44ad-8d52-95ef02dc3140", "id": 0} v 0) -- 0x7f9a24115c30 con 0x7f9a241157d0 2024-09-10T05:35:47.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.116+0000 7f9a21ffb640 1 -- 172.21.15.62:0/985691404 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6b013ec0-c5ae-44ad-8d52-95ef02dc3140", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f9a1c01c5d0 con 0x7f9a241157d0 2024-09-10T05:35:47.120 INFO:teuthology.orchestra.run.smithi062.stdout:0 2024-09-10T05:35:47.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.120+0000 7f9a2b519640 1 -- 172.21.15.62:0/985691404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a241157d0 msgr2=0x7f9a2410feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:35:47.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.120+0000 7f9a2b519640 1 --2- 172.21.15.62:0/985691404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a241157d0 0x7f9a2410feb0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c00c3a0 tx=0x7f9a1c00c860 comp rx=0 tx=0).stop 2024-09-10T05:35:47.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.120+0000 7f9a2b519640 1 -- 172.21.15.62:0/985691404 shutdown_connections 2024-09-10T05:35:47.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.120+0000 7f9a2b519640 1 --2- 172.21.15.62:0/985691404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a241157d0 0x7f9a2410feb0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:35:47.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.120+0000 7f9a2b519640 1 -- 172.21.15.62:0/985691404 >> 172.21.15.62:0/985691404 conn(0x7f9a24070f30 msgr2=0x7f9a24117ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:35:47.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.120+0000 7f9a2b519640 1 -- 172.21.15.62:0/985691404 shutdown_connections 2024-09-10T05:35:47.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.120+0000 7f9a2b519640 1 -- 172.21.15.62:0/985691404 wait complete. 2024-09-10T05:35:47.138 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new 39b3a256-0e4e-417d-8962-eebb40b35e16 1 2024-09-10T05:35:47.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.252+0000 7fe2f68a8640 1 Processor -- start 2024-09-10T05:35:47.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.252+0000 7fe2f68a8640 1 -- start start 2024-09-10T05:35:47.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.252+0000 7fe2f68a8640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe2f011b8d0 0x7fe2f011dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:35:47.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.252+0000 7fe2f68a8640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2f011e290 con 0x7fe2f0113070 2024-09-10T05:35:47.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.252+0000 7fe2f68a8640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fe2f011f470 con 0x7fe2f011b8d0 2024-09-10T05:35:47.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.252+0000 7fe2ef7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe2f011b8d0 0x7fe2f011dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:35:47.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.252+0000 7fe2ef7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe2f011b8d0 0x7fe2f011dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51528/0 (socket says 172.21.15.62:51528) 2024-09-10T05:35:47.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.252+0000 7fe2ef7fe640 1 -- 172.21.15.62:0/1067101598 learned_addr learned my addr 172.21.15.62:0/1067101598 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:35:47.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.252+0000 7fe2effff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe2f0113070 0x7fe2f0113450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:57328/0 (socket says 172.21.15.62:57328) 2024-09-10T05:35:47.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.256+0000 7fe2ef7fe640 1 -- 172.21.15.62:0/1067101598 >> v1:172.21.15.2:6789/0 conn(0x7fe2f0113070 legacy=0x7fe2f0113450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:35:47.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.256+0000 7fe2ef7fe640 1 -- 172.21.15.62:0/1067101598 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2f011f5f0 con 0x7fe2f011b8d0 2024-09-10T05:35:47.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.256+0000 7fe2ef7fe640 1 --2- 172.21.15.62:0/1067101598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2f011b8d0 0x7fe2f011dcc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe2e40097f0 tx=0x7fe2e401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dacac4fb016cd278 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:35:47.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.256+0000 7fe2eeffd640 1 -- 172.21.15.62:0/1067101598 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2e40ab580 con 0x7fe2f011b8d0 2024-09-10T05:35:47.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.256+0000 7fe2eeffd640 1 -- 172.21.15.62:0/1067101598 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2e40b0070 con 0x7fe2f011b8d0 2024-09-10T05:35:47.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.256+0000 7fe2eeffd640 1 -- 172.21.15.62:0/1067101598 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2e40ab870 con 0x7fe2f011b8d0 2024-09-10T05:35:47.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.260+0000 7fe2f68a8640 1 -- 172.21.15.62:0/1067101598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2f011b8d0 msgr2=0x7fe2f011dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:35:47.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.260+0000 7fe2f68a8640 1 --2- 172.21.15.62:0/1067101598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2f011b8d0 0x7fe2f011dcc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe2e40097f0 tx=0x7fe2e401c430 comp rx=0 tx=0).stop 2024-09-10T05:35:47.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.260+0000 7fe2f68a8640 1 -- 172.21.15.62:0/1067101598 shutdown_connections 2024-09-10T05:35:47.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.260+0000 7fe2f68a8640 1 --2- 172.21.15.62:0/1067101598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2f011b8d0 0x7fe2f011dcc0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:35:47.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.260+0000 7fe2f68a8640 1 -- 172.21.15.62:0/1067101598 >> 172.21.15.62:0/1067101598 conn(0x7fe2f006f3b0 msgr2=0x7fe2f006f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:35:47.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.260+0000 7fe2f68a8640 1 -- 172.21.15.62:0/1067101598 shutdown_connections 2024-09-10T05:35:47.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.260+0000 7fe2f68a8640 1 -- 172.21.15.62:0/1067101598 wait complete. 2024-09-10T05:35:47.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.260+0000 7fe2f68a8640 1 Processor -- start 2024-09-10T05:35:47.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.260+0000 7fe2f68a8640 1 -- start start 2024-09-10T05:35:47.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.260+0000 7fe2f68a8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2f0113070 0x7fe2f01a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:35:47.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.260+0000 7fe2f68a8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f011f120 con 0x7fe2f0113070 2024-09-10T05:35:47.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.260+0000 7fe2effff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2f0113070 0x7fe2f01a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:35:47.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.260+0000 7fe2effff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2f0113070 0x7fe2f01a9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51544/0 (socket says 172.21.15.62:51544) 2024-09-10T05:35:47.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.260+0000 7fe2effff640 1 -- 172.21.15.62:0/2706718846 learned_addr learned my addr 172.21.15.62:0/2706718846 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:35:47.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.260+0000 7fe2effff640 1 -- 172.21.15.62:0/2706718846 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2f01aa480 con 0x7fe2f0113070 2024-09-10T05:35:47.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.260+0000 7fe2effff640 1 --2- 172.21.15.62:0/2706718846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2f0113070 0x7fe2f01a9eb0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe2e000c450 tx=0x7fe2e000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:35:47.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.260+0000 7fe2ecff9640 1 -- 172.21.15.62:0/2706718846 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2e0007410 con 0x7fe2f0113070 2024-09-10T05:35:47.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.260+0000 7fe2ecff9640 1 -- 172.21.15.62:0/2706718846 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2e00075b0 con 0x7fe2f0113070 2024-09-10T05:35:47.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.260+0000 7fe2ecff9640 1 -- 172.21.15.62:0/2706718846 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2e0004960 con 0x7fe2f0113070 2024-09-10T05:35:47.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.260+0000 7fe2f68a8640 1 -- 172.21.15.62:0/2706718846 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2f01aa770 con 0x7fe2f0113070 2024-09-10T05:35:47.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.260+0000 7fe2f68a8640 1 -- 172.21.15.62:0/2706718846 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2f01af940 con 0x7fe2f0113070 2024-09-10T05:35:47.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.260+0000 7fe2ecff9640 1 -- 172.21.15.62:0/2706718846 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe2e001a020 con 0x7fe2f0113070 2024-09-10T05:35:47.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.260+0000 7fe2ecff9640 1 -- 172.21.15.62:0/2706718846 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fe2e001c9a0 con 0x7fe2f0113070 2024-09-10T05:35:47.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.260+0000 7fe2f68a8640 1 -- 172.21.15.62:0/2706718846 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2f01134d0 con 0x7fe2f0113070 2024-09-10T05:35:47.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.268+0000 7fe2ecff9640 1 -- 172.21.15.62:0/2706718846 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fe2e0021070 con 0x7fe2f0113070 2024-09-10T05:35:47.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.340+0000 7fe2f68a8640 1 -- 172.21.15.62:0/2706718846 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd new", "uuid": "39b3a256-0e4e-417d-8962-eebb40b35e16", "id": 1} v 0) -- 0x7fe2f01aaab0 con 0x7fe2f0113070 2024-09-10T05:35:47.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.340+0000 7fe2ecff9640 1 -- 172.21.15.62:0/2706718846 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "39b3a256-0e4e-417d-8962-eebb40b35e16", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fe2e00135e0 con 0x7fe2f0113070 2024-09-10T05:35:47.344 INFO:teuthology.orchestra.run.smithi062.stdout:1 2024-09-10T05:35:47.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.344+0000 7fe2f68a8640 1 -- 172.21.15.62:0/2706718846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2f0113070 msgr2=0x7fe2f01a9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:35:47.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.344+0000 7fe2f68a8640 1 --2- 172.21.15.62:0/2706718846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2f0113070 0x7fe2f01a9eb0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe2e000c450 tx=0x7fe2e000c910 comp rx=0 tx=0).stop 2024-09-10T05:35:47.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.344+0000 7fe2f68a8640 1 -- 172.21.15.62:0/2706718846 shutdown_connections 2024-09-10T05:35:47.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.344+0000 7fe2f68a8640 1 --2- 172.21.15.62:0/2706718846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2f0113070 0x7fe2f01a9eb0 secure :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe2e000c450 tx=0x7fe2e000c910 comp rx=0 tx=0).stop 2024-09-10T05:35:47.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.344+0000 7fe2f68a8640 1 -- 172.21.15.62:0/2706718846 >> 172.21.15.62:0/2706718846 conn(0x7fe2f006f3b0 msgr2=0x7fe2f011a510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:35:47.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.344+0000 7fe2f68a8640 1 -- 172.21.15.62:0/2706718846 shutdown_connections 2024-09-10T05:35:47.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.344+0000 7fe2f68a8640 1 -- 172.21.15.62:0/2706718846 wait complete. 2024-09-10T05:35:47.363 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new d7df24cd-e2f8-48ce-9956-0885d11a5685 2 2024-09-10T05:35:47.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.480+0000 7f2f6286c640 1 Processor -- start 2024-09-10T05:35:47.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.480+0000 7f2f6286c640 1 -- start start 2024-09-10T05:35:47.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.480+0000 7f2f6286c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2f5c110050 0x7f2f5c110430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:35:47.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.480+0000 7f2f6286c640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f5c110b50 con 0x7f2f5c1153e0 2024-09-10T05:35:47.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.480+0000 7f2f6286c640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f2f5c115f80 con 0x7f2f5c110050 2024-09-10T05:35:47.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.480+0000 7f2f5bfff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2f5c110050 0x7f2f5c110430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:35:47.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.480+0000 7f2f5bfff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2f5c110050 0x7f2f5c110430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51552/0 (socket says 172.21.15.62:51552) 2024-09-10T05:35:47.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.480+0000 7f2f5b7fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f2f5c1153e0 0x7f2f5c115870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:57334/0 (socket says 172.21.15.62:57334) 2024-09-10T05:35:47.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.480+0000 7f2f5bfff640 1 -- 172.21.15.62:0/1637511951 learned_addr learned my addr 172.21.15.62:0/1637511951 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:35:47.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.484+0000 7f2f5bfff640 1 -- 172.21.15.62:0/1637511951 >> v1:172.21.15.2:6789/0 conn(0x7f2f5c1153e0 legacy=0x7f2f5c115870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:35:47.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.484+0000 7f2f5bfff640 1 -- 172.21.15.62:0/1637511951 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f5c116130 con 0x7f2f5c110050 2024-09-10T05:35:47.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.484+0000 7f2f5bfff640 1 --2- 172.21.15.62:0/1637511951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f5c110050 0x7f2f5c110430 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c00ba90 tx=0x7f2f4c01eae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3634e6acbd55efe9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:35:47.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.484+0000 7f2f5affd640 1 -- 172.21.15.62:0/1637511951 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f4c0b4070 con 0x7f2f5c110050 2024-09-10T05:35:47.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.484+0000 7f2f5affd640 1 -- 172.21.15.62:0/1637511951 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f4c0a7a00 con 0x7f2f5c110050 2024-09-10T05:35:47.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.484+0000 7f2f5affd640 1 -- 172.21.15.62:0/1637511951 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f4c0a7d00 con 0x7f2f5c110050 2024-09-10T05:35:47.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.484+0000 7f2f6286c640 1 -- 172.21.15.62:0/1637511951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f5c110050 msgr2=0x7f2f5c110430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:35:47.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.484+0000 7f2f6286c640 1 --2- 172.21.15.62:0/1637511951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f5c110050 0x7f2f5c110430 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c00ba90 tx=0x7f2f4c01eae0 comp rx=0 tx=0).stop 2024-09-10T05:35:47.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.488+0000 7f2f6286c640 1 -- 172.21.15.62:0/1637511951 shutdown_connections 2024-09-10T05:35:47.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.488+0000 7f2f6286c640 1 --2- 172.21.15.62:0/1637511951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f5c110050 0x7f2f5c110430 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:35:47.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.488+0000 7f2f6286c640 1 -- 172.21.15.62:0/1637511951 >> 172.21.15.62:0/1637511951 conn(0x7f2f5c070d50 msgr2=0x7f2f5c073170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:35:47.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.488+0000 7f2f6286c640 1 -- 172.21.15.62:0/1637511951 shutdown_connections 2024-09-10T05:35:47.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.488+0000 7f2f6286c640 1 -- 172.21.15.62:0/1637511951 wait complete. 2024-09-10T05:35:47.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.488+0000 7f2f6286c640 1 Processor -- start 2024-09-10T05:35:47.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.488+0000 7f2f6286c640 1 -- start start 2024-09-10T05:35:47.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.488+0000 7f2f6286c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f5c110050 0x7f2f5c1a5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:35:47.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.488+0000 7f2f6286c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c06df30 con 0x7f2f5c110050 2024-09-10T05:35:47.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.488+0000 7f2f5bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f5c110050 0x7f2f5c1a5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:35:47.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.488+0000 7f2f5bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f5c110050 0x7f2f5c1a5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51568/0 (socket says 172.21.15.62:51568) 2024-09-10T05:35:47.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.488+0000 7f2f5bfff640 1 -- 172.21.15.62:0/2146394079 learned_addr learned my addr 172.21.15.62:0/2146394079 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:35:47.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.488+0000 7f2f5bfff640 1 -- 172.21.15.62:0/2146394079 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f5c1a61f0 con 0x7f2f5c110050 2024-09-10T05:35:47.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.488+0000 7f2f5bfff640 1 --2- 172.21.15.62:0/2146394079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f5c110050 0x7f2f5c1a5c20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c01b6f0 tx=0x7f2f4c01b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:35:47.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.488+0000 7f2f58ff9640 1 -- 172.21.15.62:0/2146394079 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f4c0bf020 con 0x7f2f5c110050 2024-09-10T05:35:47.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.488+0000 7f2f58ff9640 1 -- 172.21.15.62:0/2146394079 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f4c0afd60 con 0x7f2f5c110050 2024-09-10T05:35:47.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.488+0000 7f2f6286c640 1 -- 172.21.15.62:0/2146394079 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f5c1a6480 con 0x7f2f5c110050 2024-09-10T05:35:47.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.488+0000 7f2f58ff9640 1 -- 172.21.15.62:0/2146394079 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f4c0b4040 con 0x7f2f5c110050 2024-09-10T05:35:47.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.488+0000 7f2f6286c640 1 -- 172.21.15.62:0/2146394079 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f5c1ab460 con 0x7f2f5c110050 2024-09-10T05:35:47.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.488+0000 7f2f58ff9640 1 -- 172.21.15.62:0/2146394079 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2f4c0c2020 con 0x7f2f5c110050 2024-09-10T05:35:47.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.488+0000 7f2f58ff9640 1 -- 172.21.15.62:0/2146394079 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f2f4c0bbaa0 con 0x7f2f5c110050 2024-09-10T05:35:47.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.488+0000 7f2f6286c640 1 -- 172.21.15.62:0/2146394079 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f5c1104b0 con 0x7f2f5c110050 2024-09-10T05:35:47.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.496+0000 7f2f58ff9640 1 -- 172.21.15.62:0/2146394079 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f2f4c0c9030 con 0x7f2f5c110050 2024-09-10T05:35:47.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.568+0000 7f2f6286c640 1 -- 172.21.15.62:0/2146394079 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d7df24cd-e2f8-48ce-9956-0885d11a5685", "id": 2} v 0) -- 0x7f2f5c1153e0 con 0x7f2f5c110050 2024-09-10T05:35:47.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.568+0000 7f2f58ff9640 1 -- 172.21.15.62:0/2146394079 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d7df24cd-e2f8-48ce-9956-0885d11a5685", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f2f4c018760 con 0x7f2f5c110050 2024-09-10T05:35:47.572 INFO:teuthology.orchestra.run.smithi062.stdout:2 2024-09-10T05:35:47.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.572+0000 7f2f6286c640 1 -- 172.21.15.62:0/2146394079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f5c110050 msgr2=0x7f2f5c1a5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:35:47.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.572+0000 7f2f6286c640 1 --2- 172.21.15.62:0/2146394079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f5c110050 0x7f2f5c1a5c20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c01b6f0 tx=0x7f2f4c01b880 comp rx=0 tx=0).stop 2024-09-10T05:35:47.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.572+0000 7f2f6286c640 1 -- 172.21.15.62:0/2146394079 shutdown_connections 2024-09-10T05:35:47.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.572+0000 7f2f6286c640 1 --2- 172.21.15.62:0/2146394079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f5c110050 0x7f2f5c1a5c20 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:35:47.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.572+0000 7f2f6286c640 1 -- 172.21.15.62:0/2146394079 >> 172.21.15.62:0/2146394079 conn(0x7f2f5c070d50 msgr2=0x7f2f5c071620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:35:47.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.572+0000 7f2f6286c640 1 -- 172.21.15.62:0/2146394079 shutdown_connections 2024-09-10T05:35:47.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.572+0000 7f2f6286c640 1 -- 172.21.15.62:0/2146394079 wait complete. 2024-09-10T05:35:47.590 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new e7bedfd2-ac57-47c9-ad11-0aaf1710946d 3 2024-09-10T05:35:47.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.712+0000 7fd4fbcd6640 1 Processor -- start 2024-09-10T05:35:47.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.712+0000 7fd4fbcd6640 1 -- start start 2024-09-10T05:35:47.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.712+0000 7fd4fbcd6640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd4f4114790 0x7fd4f4114b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:35:47.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.712+0000 7fd4fbcd6640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4f4115260 con 0x7fd4f406d1f0 2024-09-10T05:35:47.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.712+0000 7fd4fbcd6640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fd4f406dd90 con 0x7fd4f4114790 2024-09-10T05:35:47.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.712+0000 7fd4f9a72640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd4f4114790 0x7fd4f4114b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:35:47.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.712+0000 7fd4f9a72640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd4f4114790 0x7fd4f4114b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51570/0 (socket says 172.21.15.62:51570) 2024-09-10T05:35:47.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.712+0000 7fd4f9a72640 1 -- 172.21.15.62:0/3202859595 learned_addr learned my addr 172.21.15.62:0/3202859595 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:35:47.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.712+0000 7fd4f9a72640 1 -- 172.21.15.62:0/3202859595 >> v1:172.21.15.2:6789/0 conn(0x7fd4f406d1f0 legacy=0x7fd4f406d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:35:47.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.712+0000 7fd4f9a72640 1 -- 172.21.15.62:0/3202859595 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4f406df40 con 0x7fd4f4114790 2024-09-10T05:35:47.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.716+0000 7fd4f9a72640 1 --2- 172.21.15.62:0/3202859595 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4f4114790 0x7fd4f4114b70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd4f00097f0 tx=0x7fd4f001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f6d3ce41bbcf9da server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:35:47.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.716+0000 7fd4f8a70640 1 -- 172.21.15.62:0/3202859595 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4f00ab580 con 0x7fd4f4114790 2024-09-10T05:35:47.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.716+0000 7fd4f8a70640 1 -- 172.21.15.62:0/3202859595 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4f00b0070 con 0x7fd4f4114790 2024-09-10T05:35:47.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.716+0000 7fd4f8a70640 1 -- 172.21.15.62:0/3202859595 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4f00ab870 con 0x7fd4f4114790 2024-09-10T05:35:47.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.716+0000 7fd4fbcd6640 1 -- 172.21.15.62:0/3202859595 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4f4114790 msgr2=0x7fd4f4114b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:35:47.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.716+0000 7fd4fbcd6640 1 --2- 172.21.15.62:0/3202859595 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4f4114790 0x7fd4f4114b70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd4f00097f0 tx=0x7fd4f001c430 comp rx=0 tx=0).stop 2024-09-10T05:35:47.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.716+0000 7fd4fbcd6640 1 -- 172.21.15.62:0/3202859595 shutdown_connections 2024-09-10T05:35:47.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.716+0000 7fd4fbcd6640 1 --2- 172.21.15.62:0/3202859595 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4f4114790 0x7fd4f4114b70 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:35:47.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.716+0000 7fd4fbcd6640 1 -- 172.21.15.62:0/3202859595 >> 172.21.15.62:0/3202859595 conn(0x7fd4f4070d50 msgr2=0x7fd4f4073170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:35:47.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.716+0000 7fd4fbcd6640 1 -- 172.21.15.62:0/3202859595 shutdown_connections 2024-09-10T05:35:47.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.716+0000 7fd4fbcd6640 1 -- 172.21.15.62:0/3202859595 wait complete. 2024-09-10T05:35:47.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.716+0000 7fd4fbcd6640 1 Processor -- start 2024-09-10T05:35:47.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.716+0000 7fd4fbcd6640 1 -- start start 2024-09-10T05:35:47.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.716+0000 7fd4fbcd6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4f406d1f0 0x7fd4f410feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:35:47.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.716+0000 7fd4fbcd6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f411f2e0 con 0x7fd4f406d1f0 2024-09-10T05:35:47.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.720+0000 7fd4f9a72640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4f406d1f0 0x7fd4f410feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:35:47.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.720+0000 7fd4f9a72640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4f406d1f0 0x7fd4f410feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51572/0 (socket says 172.21.15.62:51572) 2024-09-10T05:35:47.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.720+0000 7fd4f9a72640 1 -- 172.21.15.62:0/3536807057 learned_addr learned my addr 172.21.15.62:0/3536807057 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:35:47.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.720+0000 7fd4f9a72640 1 -- 172.21.15.62:0/3536807057 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4f4111da0 con 0x7fd4f406d1f0 2024-09-10T05:35:47.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.720+0000 7fd4f9a72640 1 --2- 172.21.15.62:0/3536807057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4f406d1f0 0x7fd4f410feb0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd4f001a060 tx=0x7fd4f001ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:35:47.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.720+0000 7fd4ea7fc640 1 -- 172.21.15.62:0/3536807057 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4f00abe30 con 0x7fd4f406d1f0 2024-09-10T05:35:47.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.720+0000 7fd4ea7fc640 1 -- 172.21.15.62:0/3536807057 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4f00aa8f0 con 0x7fd4f406d1f0 2024-09-10T05:35:47.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.720+0000 7fd4fbcd6640 1 -- 172.21.15.62:0/3536807057 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4f4110450 con 0x7fd4f406d1f0 2024-09-10T05:35:47.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.720+0000 7fd4ea7fc640 1 -- 172.21.15.62:0/3536807057 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4f00aac30 con 0x7fd4f406d1f0 2024-09-10T05:35:47.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.720+0000 7fd4fbcd6640 1 -- 172.21.15.62:0/3536807057 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4f41109e0 con 0x7fd4f406d1f0 2024-09-10T05:35:47.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.720+0000 7fd4ea7fc640 1 -- 172.21.15.62:0/3536807057 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd4f00c77d0 con 0x7fd4f406d1f0 2024-09-10T05:35:47.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.720+0000 7fd4ea7fc640 1 -- 172.21.15.62:0/3536807057 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fd4f00bedd0 con 0x7fd4f406d1f0 2024-09-10T05:35:47.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.720+0000 7fd4fbcd6640 1 -- 172.21.15.62:0/3536807057 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4f4114bf0 con 0x7fd4f406d1f0 2024-09-10T05:35:47.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.728+0000 7fd4ea7fc640 1 -- 172.21.15.62:0/3536807057 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fd4f00160b0 con 0x7fd4f406d1f0 2024-09-10T05:35:47.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.796+0000 7fd4fbcd6640 1 -- 172.21.15.62:0/3536807057 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e7bedfd2-ac57-47c9-ad11-0aaf1710946d", "id": 3} v 0) -- 0x7fd4f4110cc0 con 0x7fd4f406d1f0 2024-09-10T05:35:47.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.800+0000 7fd4ea7fc640 1 -- 172.21.15.62:0/3536807057 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e7bedfd2-ac57-47c9-ad11-0aaf1710946d", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fd4f00aadd0 con 0x7fd4f406d1f0 2024-09-10T05:35:47.802 INFO:teuthology.orchestra.run.smithi062.stdout:3 2024-09-10T05:35:47.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.800+0000 7fd4fbcd6640 1 -- 172.21.15.62:0/3536807057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4f406d1f0 msgr2=0x7fd4f410feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:35:47.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.800+0000 7fd4fbcd6640 1 --2- 172.21.15.62:0/3536807057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4f406d1f0 0x7fd4f410feb0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd4f001a060 tx=0x7fd4f001ac70 comp rx=0 tx=0).stop 2024-09-10T05:35:47.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.800+0000 7fd4fbcd6640 1 -- 172.21.15.62:0/3536807057 shutdown_connections 2024-09-10T05:35:47.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.800+0000 7fd4fbcd6640 1 --2- 172.21.15.62:0/3536807057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4f406d1f0 0x7fd4f410feb0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:35:47.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.800+0000 7fd4fbcd6640 1 -- 172.21.15.62:0/3536807057 >> 172.21.15.62:0/3536807057 conn(0x7fd4f4070d50 msgr2=0x7fd4f4113150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:35:47.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.800+0000 7fd4fbcd6640 1 -- 172.21.15.62:0/3536807057 shutdown_connections 2024-09-10T05:35:47.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:35:47.800+0000 7fd4fbcd6640 1 -- 172.21.15.62:0/3536807057 wait complete. 2024-09-10T05:35:47.819 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-10T05:35:47.819 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-10T05:35:47.822 INFO:tasks.ceph.osd.0:Started 2024-09-10T05:35:47.822 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-10T05:35:47.822 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-10T05:35:47.824 INFO:tasks.ceph.osd.1:Started 2024-09-10T05:35:47.824 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-10T05:35:47.824 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-10T05:35:47.826 INFO:tasks.ceph.osd.2:Started 2024-09-10T05:35:47.826 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-10T05:35:47.826 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-10T05:35:47.829 INFO:tasks.ceph.osd.3:Started 2024-09-10T05:35:47.829 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T05:35:47.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:47.948+0000 7fda1db8a640 1 Processor -- start 2024-09-10T05:35:47.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:47.948+0000 7fda1db8a640 1 -- start start 2024-09-10T05:35:47.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:47.948+0000 7fda1db8a640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fda18132420 0x7fda18134810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:35:47.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:47.948+0000 7fda1db8a640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda1812b9d0 con 0x7fda1812aee0 2024-09-10T05:35:47.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:47.948+0000 7fda1db8a640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fda18071e70 con 0x7fda18132420 2024-09-10T05:35:47.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:47.948+0000 7fda16ffd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fda18132420 0x7fda18134810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:35:47.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:47.948+0000 7fda177fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fda1812aee0 0x7fda1812b2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:43578/0 (socket says 172.21.15.2:43578) 2024-09-10T05:35:47.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:47.948+0000 7fda177fe640 1 -- 172.21.15.2:0/1009653844 learned_addr learned my addr 172.21.15.2:0/1009653844 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T05:35:47.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:47.948+0000 7fda16ffd640 1 -- 172.21.15.2:0/1009653844 >> v1:172.21.15.2:6789/0 conn(0x7fda1812aee0 legacy=0x7fda1812b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:35:47.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:47.948+0000 7fda16ffd640 1 -- 172.21.15.2:0/1009653844 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda180008e0 con 0x7fda18132420 2024-09-10T05:35:47.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:47.952+0000 7fda16ffd640 1 --2- 172.21.15.2:0/1009653844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda18132420 0x7fda18134810 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fda0c009740 tx=0x7fda0c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fda0a69485c67ea server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:35:47.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:47.952+0000 7fda167fc640 1 -- 172.21.15.2:0/1009653844 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda0c0b1070 con 0x7fda18132420 2024-09-10T05:35:47.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:47.952+0000 7fda167fc640 1 -- 172.21.15.2:0/1009653844 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda0c0ac520 con 0x7fda18132420 2024-09-10T05:35:47.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:47.952+0000 7fda167fc640 1 -- 172.21.15.2:0/1009653844 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda0c0ac820 con 0x7fda18132420 2024-09-10T05:35:47.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:47.952+0000 7fda1db8a640 1 -- 172.21.15.2:0/1009653844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda18132420 msgr2=0x7fda18134810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:35:47.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:47.952+0000 7fda1db8a640 1 --2- 172.21.15.2:0/1009653844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda18132420 0x7fda18134810 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fda0c009740 tx=0x7fda0c01c370 comp rx=0 tx=0).stop 2024-09-10T05:35:47.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:47.952+0000 7fda1db8a640 1 -- 172.21.15.2:0/1009653844 shutdown_connections 2024-09-10T05:35:47.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:47.952+0000 7fda1db8a640 1 --2- 172.21.15.2:0/1009653844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda18132420 0x7fda18134810 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:35:47.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:47.952+0000 7fda1db8a640 1 -- 172.21.15.2:0/1009653844 >> 172.21.15.2:0/1009653844 conn(0x7fda180a0a60 msgr2=0x7fda1806e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:35:47.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:47.952+0000 7fda1db8a640 1 -- 172.21.15.2:0/1009653844 shutdown_connections 2024-09-10T05:35:47.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:47.952+0000 7fda1db8a640 1 -- 172.21.15.2:0/1009653844 wait complete. 2024-09-10T05:35:47.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:47.952+0000 7fda1db8a640 1 Processor -- start 2024-09-10T05:35:47.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:47.952+0000 7fda1db8a640 1 -- start start 2024-09-10T05:35:47.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:47.952+0000 7fda1db8a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda1812aee0 0x7fda181298a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:35:47.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:47.952+0000 7fda1db8a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fda18137570 con 0x7fda1812aee0 2024-09-10T05:35:47.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:47.952+0000 7fda177fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda1812aee0 0x7fda181298a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:35:47.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:47.952+0000 7fda177fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda1812aee0 0x7fda181298a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48900/0 (socket says 172.21.15.2:48900) 2024-09-10T05:35:47.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:47.952+0000 7fda177fe640 1 -- 172.21.15.2:0/1266721521 learned_addr learned my addr 172.21.15.2:0/1266721521 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:35:47.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:47.956+0000 7fda177fe640 1 -- 172.21.15.2:0/1266721521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda18073a80 con 0x7fda1812aee0 2024-09-10T05:35:47.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:47.956+0000 7fda177fe640 1 --2- 172.21.15.2:0/1266721521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda1812aee0 0x7fda181298a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fda1000cbd0 tx=0x7fda1000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:35:47.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:47.956+0000 7fd9fffff640 1 -- 172.21.15.2:0/1266721521 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda10017070 con 0x7fda1812aee0 2024-09-10T05:35:47.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:47.956+0000 7fd9fffff640 1 -- 172.21.15.2:0/1266721521 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda1000abc0 con 0x7fda1812aee0 2024-09-10T05:35:47.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:47.956+0000 7fda1db8a640 1 -- 172.21.15.2:0/1266721521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda1811c510 con 0x7fda1812aee0 2024-09-10T05:35:47.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:47.956+0000 7fd9fffff640 1 -- 172.21.15.2:0/1266721521 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda10012400 con 0x7fda1812aee0 2024-09-10T05:35:47.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:47.956+0000 7fda1db8a640 1 -- 172.21.15.2:0/1266721521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda18129fb0 con 0x7fda1812aee0 2024-09-10T05:35:47.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:47.956+0000 7fd9fffff640 1 -- 172.21.15.2:0/1266721521 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fda1001a070 con 0x7fda1812aee0 2024-09-10T05:35:47.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:47.956+0000 7fd9fffff640 1 -- 172.21.15.2:0/1266721521 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fda10007070 con 0x7fda1812aee0 2024-09-10T05:35:47.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:47.956+0000 7fda1db8a640 1 -- 172.21.15.2:0/1266721521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda1811b300 con 0x7fda1812aee0 2024-09-10T05:35:47.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:47.956+0000 7fd9fffff640 1 -- 172.21.15.2:0/1266721521 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fda1001c440 con 0x7fda1812aee0 2024-09-10T05:35:48.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:48.016+0000 7fda1db8a640 1 -- 172.21.15.2:0/1266721521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fda1812b2c0 con 0x7fda1812aee0 2024-09-10T05:35:48.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:48.020+0000 7fd9fffff640 1 -- 172.21.15.2:0/1266721521 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7fda1001ca10 con 0x7fda1812aee0 2024-09-10T05:35:48.022 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T05:35:48.022 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":6,"fsid":"004d9798-7539-4e93-b06c-e32e30a3c3b6","created":"2024-09-10T05:35:46.592342+0000","modified":"2024-09-10T05:35:47.803069+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T05:35:47.803069+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6b013ec0-c5ae-44ad-8d52-95ef02dc3140","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"39b3a256-0e4e-417d-8962-eebb40b35e16","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d7df24cd-e2f8-48ce-9956-0885d11a5685","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e7bedfd2-ac57-47c9-ad11-0aaf1710946d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T05:35:48.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:48.020+0000 7fda1db8a640 1 -- 172.21.15.2:0/1266721521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda1812aee0 msgr2=0x7fda181298a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:35:48.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:48.020+0000 7fda1db8a640 1 --2- 172.21.15.2:0/1266721521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda1812aee0 0x7fda181298a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fda1000cbd0 tx=0x7fda1000a430 comp rx=0 tx=0).stop 2024-09-10T05:35:48.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:48.020+0000 7fda1db8a640 1 -- 172.21.15.2:0/1266721521 shutdown_connections 2024-09-10T05:35:48.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:48.020+0000 7fda1db8a640 1 --2- 172.21.15.2:0/1266721521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda1812aee0 0x7fda181298a0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:35:48.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:48.020+0000 7fda1db8a640 1 -- 172.21.15.2:0/1266721521 >> 172.21.15.2:0/1266721521 conn(0x7fda180a0a60 msgr2=0x7fda180a1230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:35:48.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:48.020+0000 7fda1db8a640 1 -- 172.21.15.2:0/1266721521 shutdown_connections 2024-09-10T05:35:48.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:35:48.020+0000 7fda1db8a640 1 -- 172.21.15.2:0/1266721521 wait complete. 2024-09-10T05:35:48.040 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-10T05:35:48.041 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-10T05:35:48.444 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T05:35:48.569 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:48.564+0000 7efe4562d640 1 Processor -- start 2024-09-10T05:35:48.569 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:48.564+0000 7efe4562d640 1 -- start start 2024-09-10T05:35:48.570 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:48.568+0000 7efe4562d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efe40111db0 0x7efe40131b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:35:48.570 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:48.568+0000 7efe4562d640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe40073730 con 0x7efe4012bc00 2024-09-10T05:35:48.570 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:48.568+0000 7efe4562d640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7efe4006de90 con 0x7efe40111db0 2024-09-10T05:35:48.570 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:48.568+0000 7efe3e7fc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efe40111db0 0x7efe40131b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:35:48.570 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:48.568+0000 7efe3effd640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7efe4012bc00 0x7efe4012bfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:43580/0 (socket says 172.21.15.2:43580) 2024-09-10T05:35:48.570 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:48.568+0000 7efe3effd640 1 -- 172.21.15.2:0/474318110 learned_addr learned my addr 172.21.15.2:0/474318110 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T05:35:48.571 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:48.568+0000 7efe3e7fc640 1 -- 172.21.15.2:0/474318110 >> v1:172.21.15.2:6789/0 conn(0x7efe4012bc00 legacy=0x7efe4012bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:35:48.571 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:48.568+0000 7efe3e7fc640 1 -- 172.21.15.2:0/474318110 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe4012b7b0 con 0x7efe40111db0 2024-09-10T05:35:48.572 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:48.568+0000 7efe3e7fc640 1 --2- 172.21.15.2:0/474318110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe40111db0 0x7efe40131b30 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7efe34009740 tx=0x7efe3401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3c673c2249d1562 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:35:48.572 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:48.568+0000 7efe3dffb640 1 -- 172.21.15.2:0/474318110 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe340b1070 con 0x7efe40111db0 2024-09-10T05:35:48.572 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:48.568+0000 7efe3dffb640 1 -- 172.21.15.2:0/474318110 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe340ac520 con 0x7efe40111db0 2024-09-10T05:35:48.573 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:48.568+0000 7efe3dffb640 1 -- 172.21.15.2:0/474318110 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe340ac820 con 0x7efe40111db0 2024-09-10T05:35:48.573 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:48.568+0000 7efe4562d640 1 -- 172.21.15.2:0/474318110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe40111db0 msgr2=0x7efe40131b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:35:48.573 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:48.568+0000 7efe4562d640 1 --2- 172.21.15.2:0/474318110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe40111db0 0x7efe40131b30 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7efe34009740 tx=0x7efe3401c370 comp rx=0 tx=0).stop 2024-09-10T05:35:48.574 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:48.568+0000 7efe4562d640 1 -- 172.21.15.2:0/474318110 shutdown_connections 2024-09-10T05:35:48.574 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:48.568+0000 7efe4562d640 1 --2- 172.21.15.2:0/474318110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe40111db0 0x7efe40131b30 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:35:48.574 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:48.568+0000 7efe4562d640 1 -- 172.21.15.2:0/474318110 >> 172.21.15.2:0/474318110 conn(0x7efe400709a0 msgr2=0x7efe40072dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:35:48.574 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:48.568+0000 7efe4562d640 1 -- 172.21.15.2:0/474318110 shutdown_connections 2024-09-10T05:35:48.574 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:48.568+0000 7efe4562d640 1 -- 172.21.15.2:0/474318110 wait complete. 2024-09-10T05:35:48.576 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:48.572+0000 7efe4562d640 1 Processor -- start 2024-09-10T05:35:48.576 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:48.572+0000 7efe4562d640 1 -- start start 2024-09-10T05:35:48.576 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:48.572+0000 7efe4562d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe40111db0 0x7efe401c6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:35:48.576 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:48.572+0000 7efe4562d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efe40134a10 con 0x7efe40111db0 2024-09-10T05:35:48.576 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:48.572+0000 7efe3effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe40111db0 0x7efe401c6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:35:48.576 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:48.572+0000 7efe3effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe40111db0 0x7efe401c6cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48904/0 (socket says 172.21.15.2:48904) 2024-09-10T05:35:48.576 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:48.572+0000 7efe3effd640 1 -- 172.21.15.2:0/2262861335 learned_addr learned my addr 172.21.15.2:0/2262861335 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:35:48.576 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:48.572+0000 7efe3effd640 1 -- 172.21.15.2:0/2262861335 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe40131410 con 0x7efe40111db0 2024-09-10T05:35:48.576 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:48.572+0000 7efe3effd640 1 --2- 172.21.15.2:0/2262861335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe40111db0 0x7efe401c6cd0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7efe3000c450 tx=0x7efe3000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:35:48.576 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:48.572+0000 7efe277fe640 1 -- 172.21.15.2:0/2262861335 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe30017070 con 0x7efe40111db0 2024-09-10T05:35:48.576 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:48.572+0000 7efe277fe640 1 -- 172.21.15.2:0/2262861335 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe30005c20 con 0x7efe40111db0 2024-09-10T05:35:48.577 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:48.572+0000 7efe4562d640 1 -- 172.21.15.2:0/2262861335 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe40117ea0 con 0x7efe40111db0 2024-09-10T05:35:48.577 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:48.572+0000 7efe277fe640 1 -- 172.21.15.2:0/2262861335 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe300070d0 con 0x7efe40111db0 2024-09-10T05:35:48.577 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:48.572+0000 7efe4562d640 1 -- 172.21.15.2:0/2262861335 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe40071ee0 con 0x7efe40111db0 2024-09-10T05:35:48.577 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:48.572+0000 7efe277fe640 1 -- 172.21.15.2:0/2262861335 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7efe3001a070 con 0x7efe40111db0 2024-09-10T05:35:48.577 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:48.572+0000 7efe277fe640 1 -- 172.21.15.2:0/2262861335 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7efe3001cc40 con 0x7efe40111db0 2024-09-10T05:35:48.577 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:48.572+0000 7efe4562d640 1 -- 172.21.15.2:0/2262861335 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe40117af0 con 0x7efe40111db0 2024-09-10T05:35:48.578 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:48.576+0000 7efe277fe640 1 -- 172.21.15.2:0/2262861335 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7efe3001c440 con 0x7efe40111db0 2024-09-10T05:35:48.639 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:48.636+0000 7efe4562d640 1 -- 172.21.15.2:0/2262861335 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efe40074f70 con 0x7efe40111db0 2024-09-10T05:35:48.640 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:48.636+0000 7efe277fe640 1 -- 172.21.15.2:0/2262861335 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7efe3001c6c0 con 0x7efe40111db0 2024-09-10T05:35:48.640 INFO:teuthology.misc.health.smithi002.stdout: 2024-09-10T05:35:48.640 INFO:teuthology.misc.health.smithi002.stdout:{"epoch":6,"fsid":"004d9798-7539-4e93-b06c-e32e30a3c3b6","created":"2024-09-10T05:35:46.592342+0000","modified":"2024-09-10T05:35:47.803069+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T05:35:47.803069+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6b013ec0-c5ae-44ad-8d52-95ef02dc3140","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"39b3a256-0e4e-417d-8962-eebb40b35e16","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d7df24cd-e2f8-48ce-9956-0885d11a5685","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e7bedfd2-ac57-47c9-ad11-0aaf1710946d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T05:35:48.641 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:48.636+0000 7efe4562d640 1 -- 172.21.15.2:0/2262861335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe40111db0 msgr2=0x7efe401c6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:35:48.641 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:48.636+0000 7efe4562d640 1 --2- 172.21.15.2:0/2262861335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe40111db0 0x7efe401c6cd0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7efe3000c450 tx=0x7efe3000c910 comp rx=0 tx=0).stop 2024-09-10T05:35:48.641 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:48.636+0000 7efe4562d640 1 -- 172.21.15.2:0/2262861335 shutdown_connections 2024-09-10T05:35:48.641 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:48.636+0000 7efe4562d640 1 --2- 172.21.15.2:0/2262861335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe40111db0 0x7efe401c6cd0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:35:48.642 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:48.636+0000 7efe4562d640 1 -- 172.21.15.2:0/2262861335 >> 172.21.15.2:0/2262861335 conn(0x7efe400709a0 msgr2=0x7efe40126000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:35:48.642 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:48.636+0000 7efe4562d640 1 -- 172.21.15.2:0/2262861335 shutdown_connections 2024-09-10T05:35:48.642 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:48.636+0000 7efe4562d640 1 -- 172.21.15.2:0/2262861335 wait complete. 2024-09-10T05:35:48.657 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-10T05:35:48.871 INFO:tasks.ceph.osd.0.smithi002.stderr:2024-09-10T05:35:48.868+0000 7ff570cbc7c0 -1 Falling back to public interface 2024-09-10T05:35:49.190 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-09-10T05:35:49.188+0000 7fb51e9427c0 -1 Falling back to public interface 2024-09-10T05:35:49.478 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-09-10T05:35:49.476+0000 7fba184277c0 -1 Falling back to public interface 2024-09-10T05:35:49.649 INFO:tasks.ceph.mgr.x.smithi062.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-10T05:35:49.649 INFO:tasks.ceph.mgr.x.smithi062.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-10T05:35:49.649 INFO:tasks.ceph.mgr.x.smithi062.stderr: from numpy import show_config as show_numpy_config 2024-09-10T05:35:49.666 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-09-10T05:35:49.664+0000 7f77933407c0 -1 Falling back to public interface 2024-09-10T05:35:52.589 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-09-10T05:35:52.583+0000 7f3b5f4f0640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-10T05:35:52.714 INFO:tasks.ceph.osd.0.smithi002.stderr:2024-09-10T05:35:52.712+0000 7ff570cbc7c0 -1 osd.0 0 log_to_monitors true 2024-09-10T05:35:53.494 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-09-10T05:35:53.491+0000 7fb51e9427c0 -1 osd.2 0 log_to_monitors true 2024-09-10T05:35:53.575 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-09-10T05:35:53.571+0000 7fba184277c0 -1 osd.1 0 log_to_monitors true 2024-09-10T05:35:54.194 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-09-10T05:35:54.191+0000 7f77933407c0 -1 osd.3 0 log_to_monitors true 2024-09-10T05:35:55.061 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T05:35:55.190 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.184+0000 7fca34e77640 1 Processor -- start 2024-09-10T05:35:55.190 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.184+0000 7fca34e77640 1 -- start start 2024-09-10T05:35:55.190 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.184+0000 7fca34e77640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fca30132520 0x7fca30134910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:35:55.190 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.184+0000 7fca34e77640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca3012bc50 con 0x7fca3012bfe0 2024-09-10T05:35:55.192 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.184+0000 7fca34e77640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fca300691a0 con 0x7fca30132520 2024-09-10T05:35:55.192 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.184+0000 7fca2dd9b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fca30132520 0x7fca30134910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:35:55.192 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.184+0000 7fca2e59c640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fca3012bfe0 0x7fca3012c3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:43590/0 (socket says 172.21.15.2:43590) 2024-09-10T05:35:55.192 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.184+0000 7fca2dd9b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fca30132520 0x7fca30134910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48920/0 (socket says 172.21.15.2:48920) 2024-09-10T05:35:55.192 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.184+0000 7fca2e59c640 1 -- 172.21.15.2:0/4254655664 learned_addr learned my addr 172.21.15.2:0/4254655664 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T05:35:55.193 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.188+0000 7fca2dd9b640 1 -- 172.21.15.2:0/4254655664 >> v1:172.21.15.2:6789/0 conn(0x7fca3012bfe0 legacy=0x7fca3012c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:35:55.193 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.188+0000 7fca2dd9b640 1 -- 172.21.15.2:0/4254655664 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca30073870 con 0x7fca30132520 2024-09-10T05:35:55.194 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.188+0000 7fca2dd9b640 1 --2- 172.21.15.2:0/4254655664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca30132520 0x7fca30134910 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fca24009740 tx=0x7fca2401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4f1cec68abb338 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:35:55.195 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.188+0000 7fca2d59a640 1 -- 172.21.15.2:0/4254655664 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca240b0070 con 0x7fca30132520 2024-09-10T05:35:55.195 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.188+0000 7fca2d59a640 1 -- 172.21.15.2:0/4254655664 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca240ab530 con 0x7fca30132520 2024-09-10T05:35:55.195 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.188+0000 7fca2d59a640 1 -- 172.21.15.2:0/4254655664 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca240ab830 con 0x7fca30132520 2024-09-10T05:35:55.195 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.192+0000 7fca34e77640 1 -- 172.21.15.2:0/4254655664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca30132520 msgr2=0x7fca30134910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:35:55.195 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.192+0000 7fca34e77640 1 --2- 172.21.15.2:0/4254655664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca30132520 0x7fca30134910 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fca24009740 tx=0x7fca2401c400 comp rx=0 tx=0).stop 2024-09-10T05:35:55.195 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.192+0000 7fca34e77640 1 -- 172.21.15.2:0/4254655664 shutdown_connections 2024-09-10T05:35:55.195 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.192+0000 7fca34e77640 1 --2- 172.21.15.2:0/4254655664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca30132520 0x7fca30134910 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:35:55.195 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.192+0000 7fca34e77640 1 -- 172.21.15.2:0/4254655664 >> 172.21.15.2:0/4254655664 conn(0x7fca30070630 msgr2=0x7fca30072a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:35:55.195 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.192+0000 7fca34e77640 1 -- 172.21.15.2:0/4254655664 shutdown_connections 2024-09-10T05:35:55.195 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.192+0000 7fca34e77640 1 -- 172.21.15.2:0/4254655664 wait complete. 2024-09-10T05:35:55.197 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.192+0000 7fca34e77640 1 Processor -- start 2024-09-10T05:35:55.197 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.192+0000 7fca34e77640 1 -- start start 2024-09-10T05:35:55.197 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.192+0000 7fca34e77640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca3012bfe0 0x7fca301302b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:35:55.197 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.192+0000 7fca34e77640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fca301377f0 con 0x7fca3012bfe0 2024-09-10T05:35:55.197 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.192+0000 7fca2e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca3012bfe0 0x7fca301302b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:35:55.198 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.192+0000 7fca2e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca3012bfe0 0x7fca301302b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48932/0 (socket says 172.21.15.2:48932) 2024-09-10T05:35:55.198 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.192+0000 7fca2e59c640 1 -- 172.21.15.2:0/3347555635 learned_addr learned my addr 172.21.15.2:0/3347555635 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:35:55.198 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.192+0000 7fca2e59c640 1 -- 172.21.15.2:0/3347555635 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca301187c0 con 0x7fca3012bfe0 2024-09-10T05:35:55.198 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.192+0000 7fca2e59c640 1 --2- 172.21.15.2:0/3347555635 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca3012bfe0 0x7fca301302b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fca2000c450 tx=0x7fca2000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:35:55.198 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.192+0000 7fca1effd640 1 -- 172.21.15.2:0/3347555635 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca20017070 con 0x7fca3012bfe0 2024-09-10T05:35:55.198 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.192+0000 7fca1effd640 1 -- 172.21.15.2:0/3347555635 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca20005c20 con 0x7fca3012bfe0 2024-09-10T05:35:55.198 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.192+0000 7fca1effd640 1 -- 172.21.15.2:0/3347555635 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca200070d0 con 0x7fca3012bfe0 2024-09-10T05:35:55.198 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.192+0000 7fca34e77640 1 -- 172.21.15.2:0/3347555635 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca301176f0 con 0x7fca3012bfe0 2024-09-10T05:35:55.198 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.192+0000 7fca34e77640 1 -- 172.21.15.2:0/3347555635 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca30117ba0 con 0x7fca3012bfe0 2024-09-10T05:35:55.199 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.196+0000 7fca34e77640 1 -- 172.21.15.2:0/3347555635 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca3012c3c0 con 0x7fca3012bfe0 2024-09-10T05:35:55.199 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.196+0000 7fca1effd640 1 -- 172.21.15.2:0/3347555635 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) ==== 48276+0+0 (secure 0 0 0) 0x7fca2001a070 con 0x7fca3012bfe0 2024-09-10T05:35:55.199 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.196+0000 7fca1effd640 1 --2- 172.21.15.2:0/3347555635 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fca1003b140 0x7fca1003d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:35:55.199 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.196+0000 7fca1effd640 1 -- 172.21.15.2:0/3347555635 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1607+0+0 (secure 0 0 0) 0x7fca2004d730 con 0x7fca3012bfe0 2024-09-10T05:35:55.199 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.196+0000 7fca2dd9b640 1 --2- 172.21.15.2:0/3347555635 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fca1003b140 0x7fca1003d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:35:55.200 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.196+0000 7fca2dd9b640 1 --2- 172.21.15.2:0/3347555635 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fca1003b140 0x7fca1003d600 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fca240ad000 tx=0x7fca240a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:35:55.203 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.200+0000 7fca1effd640 1 -- 172.21.15.2:0/3347555635 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fca20019cd0 con 0x7fca3012bfe0 2024-09-10T05:35:55.478 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.476+0000 7fca34e77640 1 -- 172.21.15.2:0/3347555635 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fca30117e90 con 0x7fca3012bfe0 2024-09-10T05:35:55.479 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.476+0000 7fca1effd640 1 -- 172.21.15.2:0/3347555635 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+4153 (secure 0 0 0) 0x7fca2001b400 con 0x7fca3012bfe0 2024-09-10T05:35:55.479 INFO:teuthology.misc.health.smithi002.stdout: 2024-09-10T05:35:55.479 INFO:teuthology.misc.health.smithi002.stdout:{"epoch":8,"fsid":"004d9798-7539-4e93-b06c-e32e30a3c3b6","created":"2024-09-10T05:35:46.592342+0000","modified":"2024-09-10T05:35:54.637266+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T05:35:47.803069+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6b013ec0-c5ae-44ad-8d52-95ef02dc3140","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"39b3a256-0e4e-417d-8962-eebb40b35e16","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d7df24cd-e2f8-48ce-9956-0885d11a5685","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e7bedfd2-ac57-47c9-ad11-0aaf1710946d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T05:35:55.483 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.480+0000 7fca34e77640 1 -- 172.21.15.2:0/3347555635 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fca1003b140 msgr2=0x7fca1003d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:35:55.483 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.480+0000 7fca34e77640 1 --2- 172.21.15.2:0/3347555635 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fca1003b140 0x7fca1003d600 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fca240ad000 tx=0x7fca240a6000 comp rx=0 tx=0).stop 2024-09-10T05:35:55.483 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.480+0000 7fca34e77640 1 -- 172.21.15.2:0/3347555635 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca3012bfe0 msgr2=0x7fca301302b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:35:55.483 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.480+0000 7fca34e77640 1 --2- 172.21.15.2:0/3347555635 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca3012bfe0 0x7fca301302b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fca2000c450 tx=0x7fca2000c910 comp rx=0 tx=0).stop 2024-09-10T05:35:55.483 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.480+0000 7fca34e77640 1 -- 172.21.15.2:0/3347555635 shutdown_connections 2024-09-10T05:35:55.483 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.480+0000 7fca34e77640 1 --2- 172.21.15.2:0/3347555635 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fca1003b140 0x7fca1003d600 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:35:55.483 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.480+0000 7fca34e77640 1 --2- 172.21.15.2:0/3347555635 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca3012bfe0 0x7fca301302b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:35:55.483 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.480+0000 7fca34e77640 1 -- 172.21.15.2:0/3347555635 >> 172.21.15.2:0/3347555635 conn(0x7fca30070630 msgr2=0x7fca30129ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:35:55.483 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.480+0000 7fca34e77640 1 -- 172.21.15.2:0/3347555635 shutdown_connections 2024-09-10T05:35:55.483 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:35:55.480+0000 7fca34e77640 1 -- 172.21.15.2:0/3347555635 wait complete. 2024-09-10T05:35:55.502 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-10T05:35:55.619 INFO:tasks.ceph.osd.0.smithi002.stderr:2024-09-10T05:35:55.616+0000 7ff56cc65640 -1 osd.0 0 waiting for initial osdmap 2024-09-10T05:35:55.651 INFO:tasks.ceph.osd.0.smithi002.stderr:2024-09-10T05:35:55.648+0000 7ff564a97640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T05:35:56.081 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-09-10T05:35:56.079+0000 7fb51b0fd640 -1 osd.2 0 waiting for initial osdmap 2024-09-10T05:35:56.086 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-09-10T05:35:56.083+0000 7fba143d0640 -1 osd.1 0 waiting for initial osdmap 2024-09-10T05:35:56.106 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-09-10T05:35:56.103+0000 7fb51271d640 -1 osd.2 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T05:35:56.124 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-09-10T05:35:56.119+0000 7fba0c202640 -1 osd.1 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T05:35:56.780 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-09-10T05:35:56.775+0000 7f778f2e9640 -1 osd.3 0 waiting for initial osdmap 2024-09-10T05:35:56.802 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-09-10T05:35:56.799+0000 7f778711b640 -1 osd.3 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T05:36:01.906 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T05:36:02.033 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.028+0000 7f18d3a63640 1 Processor -- start 2024-09-10T05:36:02.033 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.028+0000 7f18d3a63640 1 -- start start 2024-09-10T05:36:02.034 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.032+0000 7f18d3a63640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f18cc132520 0x7f18cc134910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:02.034 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.032+0000 7f18d3a63640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18cc12bc50 con 0x7f18cc12bfe0 2024-09-10T05:36:02.034 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.032+0000 7f18d3a63640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f18cc0691a0 con 0x7f18cc132520 2024-09-10T05:36:02.034 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.032+0000 7f18d0ffe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f18cc132520 0x7f18cc134910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:02.035 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.032+0000 7f18d17ff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f18cc12bfe0 0x7f18cc12c3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58064/0 (socket says 172.21.15.2:58064) 2024-09-10T05:36:02.035 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.032+0000 7f18d17ff640 1 -- 172.21.15.2:0/3937500710 learned_addr learned my addr 172.21.15.2:0/3937500710 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T05:36:02.035 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.032+0000 7f18d0ffe640 1 -- 172.21.15.2:0/3937500710 >> v1:172.21.15.2:6789/0 conn(0x7f18cc12bfe0 legacy=0x7f18cc12c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:02.035 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.032+0000 7f18d0ffe640 1 -- 172.21.15.2:0/3937500710 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18cc073870 con 0x7f18cc132520 2024-09-10T05:36:02.036 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.032+0000 7f18d0ffe640 1 --2- 172.21.15.2:0/3937500710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18cc132520 0x7f18cc134910 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f18c0009740 tx=0x7f18c001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a93eddb097a02150 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:02.036 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.032+0000 7f18cbfff640 1 -- 172.21.15.2:0/3937500710 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18c00b0070 con 0x7f18cc132520 2024-09-10T05:36:02.037 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.032+0000 7f18cbfff640 1 -- 172.21.15.2:0/3937500710 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18c00ab530 con 0x7f18cc132520 2024-09-10T05:36:02.037 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.032+0000 7f18cbfff640 1 -- 172.21.15.2:0/3937500710 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18c00ab830 con 0x7f18cc132520 2024-09-10T05:36:02.037 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.036+0000 7f18d3a63640 1 -- 172.21.15.2:0/3937500710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18cc132520 msgr2=0x7f18cc134910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:02.037 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.036+0000 7f18d3a63640 1 --2- 172.21.15.2:0/3937500710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18cc132520 0x7f18cc134910 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f18c0009740 tx=0x7f18c001c400 comp rx=0 tx=0).stop 2024-09-10T05:36:02.038 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.036+0000 7f18d3a63640 1 -- 172.21.15.2:0/3937500710 shutdown_connections 2024-09-10T05:36:02.038 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.036+0000 7f18d3a63640 1 --2- 172.21.15.2:0/3937500710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18cc132520 0x7f18cc134910 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:02.038 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.036+0000 7f18d3a63640 1 -- 172.21.15.2:0/3937500710 >> 172.21.15.2:0/3937500710 conn(0x7f18cc070630 msgr2=0x7f18cc072a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:02.038 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.036+0000 7f18d3a63640 1 -- 172.21.15.2:0/3937500710 shutdown_connections 2024-09-10T05:36:02.038 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.036+0000 7f18d3a63640 1 -- 172.21.15.2:0/3937500710 wait complete. 2024-09-10T05:36:02.039 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.036+0000 7f18d3a63640 1 Processor -- start 2024-09-10T05:36:02.040 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.036+0000 7f18d3a63640 1 -- start start 2024-09-10T05:36:02.040 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.036+0000 7f18d3a63640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18cc12bfe0 0x7f18cc1302b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:02.040 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.036+0000 7f18d3a63640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f18cc1377f0 con 0x7f18cc12bfe0 2024-09-10T05:36:02.040 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.036+0000 7f18d17ff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18cc12bfe0 0x7f18cc1302b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:02.040 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.036+0000 7f18d17ff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18cc12bfe0 0x7f18cc1302b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36652/0 (socket says 172.21.15.2:36652) 2024-09-10T05:36:02.040 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.036+0000 7f18d17ff640 1 -- 172.21.15.2:0/1144688111 learned_addr learned my addr 172.21.15.2:0/1144688111 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:36:02.040 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.036+0000 7f18d17ff640 1 -- 172.21.15.2:0/1144688111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18cc1187c0 con 0x7f18cc12bfe0 2024-09-10T05:36:02.040 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.036+0000 7f18d17ff640 1 --2- 172.21.15.2:0/1144688111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18cc12bfe0 0x7f18cc1302b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f18bc00cbd0 tx=0x7f18bc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:02.040 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.036+0000 7f18c9ffb640 1 -- 172.21.15.2:0/1144688111 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18bc017070 con 0x7f18cc12bfe0 2024-09-10T05:36:02.040 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.036+0000 7f18c9ffb640 1 -- 172.21.15.2:0/1144688111 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18bc00abc0 con 0x7f18cc12bfe0 2024-09-10T05:36:02.040 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.036+0000 7f18c9ffb640 1 -- 172.21.15.2:0/1144688111 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18bc012400 con 0x7f18cc12bfe0 2024-09-10T05:36:02.040 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.036+0000 7f18d3a63640 1 -- 172.21.15.2:0/1144688111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18cc1176f0 con 0x7f18cc12bfe0 2024-09-10T05:36:02.040 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.036+0000 7f18d3a63640 1 -- 172.21.15.2:0/1144688111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18cc117ba0 con 0x7f18cc12bfe0 2024-09-10T05:36:02.041 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.036+0000 7f18c9ffb640 1 -- 172.21.15.2:0/1144688111 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f18bc01a070 con 0x7f18cc12bfe0 2024-09-10T05:36:02.041 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.036+0000 7f18c9ffb640 1 --2- 172.21.15.2:0/1144688111 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f18b803b1d0 0x7f18b803d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:02.041 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.036+0000 7f18d3a63640 1 -- 172.21.15.2:0/1144688111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18cc12c3c0 con 0x7f18cc12bfe0 2024-09-10T05:36:02.041 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.036+0000 7f18c9ffb640 1 -- 172.21.15.2:0/1144688111 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 3129+0+0 (secure 0 0 0) 0x7f18bc04ea90 con 0x7f18cc12bfe0 2024-09-10T05:36:02.042 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.036+0000 7f18d0ffe640 1 --2- 172.21.15.2:0/1144688111 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f18b803b1d0 0x7f18b803d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:02.042 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.040+0000 7f18d0ffe640 1 --2- 172.21.15.2:0/1144688111 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f18b803b1d0 0x7f18b803d690 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f18c00ad000 tx=0x7f18c00a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:02.046 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.044+0000 7f18c9ffb640 1 -- 172.21.15.2:0/1144688111 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f18bc00fab0 con 0x7f18cc12bfe0 2024-09-10T05:36:02.219 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.216+0000 7f18d3a63640 1 -- 172.21.15.2:0/1144688111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f18cc117e90 con 0x7f18cc12bfe0 2024-09-10T05:36:02.220 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.216+0000 7f18c9ffb640 1 -- 172.21.15.2:0/1144688111 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+7955 (secure 0 0 0) 0x7f18bc00fd90 con 0x7f18cc12bfe0 2024-09-10T05:36:02.221 INFO:teuthology.misc.health.smithi002.stdout: 2024-09-10T05:36:02.221 INFO:teuthology.misc.health.smithi002.stdout:{"epoch":13,"fsid":"004d9798-7539-4e93-b06c-e32e30a3c3b6","created":"2024-09-10T05:35:46.592342+0000","modified":"2024-09-10T05:35:59.673921+0000","last_up_change":"2024-09-10T05:35:57.655557+0000","last_in_change":"2024-09-10T05:35:47.803069+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T05:35:57.624941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6b013ec0-c5ae-44ad-8d52-95ef02dc3140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":945139080},{"type":"v1","addr":"172.21.15.2:6801","nonce":945139080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":945139080},{"type":"v1","addr":"172.21.15.2:6803","nonce":945139080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":945139080},{"type":"v1","addr":"172.21.15.2:6807","nonce":945139080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":945139080},{"type":"v1","addr":"172.21.15.2:6805","nonce":945139080}]},"public_addr":"172.21.15.2:6801/945139080","cluster_addr":"172.21.15.2:6803/945139080","heartbeat_back_addr":"172.21.15.2:6807/945139080","heartbeat_front_addr":"172.21.15.2:6805/945139080","state":["exists","up"]},{"osd":1,"uuid":"39b3a256-0e4e-417d-8962-eebb40b35e16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":3442097179},{"type":"v1","addr":"172.21.15.62:6809","nonce":3442097179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3442097179},{"type":"v1","addr":"172.21.15.62:6811","nonce":3442097179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3442097179},{"type":"v1","addr":"172.21.15.62:6815","nonce":3442097179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3442097179},{"type":"v1","addr":"172.21.15.62:6813","nonce":3442097179}]},"public_addr":"172.21.15.62:6809/3442097179","cluster_addr":"172.21.15.62:6811/3442097179","heartbeat_back_addr":"172.21.15.62:6815/3442097179","heartbeat_front_addr":"172.21.15.62:6813/3442097179","state":["exists","up"]},{"osd":2,"uuid":"d7df24cd-e2f8-48ce-9956-0885d11a5685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2677868286},{"type":"v1","addr":"172.21.15.62:6801","nonce":2677868286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2677868286},{"type":"v1","addr":"172.21.15.62:6803","nonce":2677868286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2677868286},{"type":"v1","addr":"172.21.15.62:6807","nonce":2677868286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2677868286},{"type":"v1","addr":"172.21.15.62:6805","nonce":2677868286}]},"public_addr":"172.21.15.62:6801/2677868286","cluster_addr":"172.21.15.62:6803/2677868286","heartbeat_back_addr":"172.21.15.62:6807/2677868286","heartbeat_front_addr":"172.21.15.62:6805/2677868286","state":["exists","up"]},{"osd":3,"uuid":"e7bedfd2-ac57-47c9-ad11-0aaf1710946d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":2708991149},{"type":"v1","addr":"172.21.15.62:6817","nonce":2708991149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2708991149},{"type":"v1","addr":"172.21.15.62:6819","nonce":2708991149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2708991149},{"type":"v1","addr":"172.21.15.62:6823","nonce":2708991149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":2708991149},{"type":"v1","addr":"172.21.15.62:6821","nonce":2708991149}]},"public_addr":"172.21.15.62:6817/2708991149","cluster_addr":"172.21.15.62:6819/2708991149","heartbeat_back_addr":"172.21.15.62:6823/2708991149","heartbeat_front_addr":"172.21.15.62:6821/2708991149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:35:53.717657+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:35:54.611828+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:35:54.504863+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:35:55.176104+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T05:36:02.223 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.220+0000 7f18d3a63640 1 -- 172.21.15.2:0/1144688111 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f18b803b1d0 msgr2=0x7f18b803d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:02.223 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.220+0000 7f18d3a63640 1 --2- 172.21.15.2:0/1144688111 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f18b803b1d0 0x7f18b803d690 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f18c00ad000 tx=0x7f18c00a6000 comp rx=0 tx=0).stop 2024-09-10T05:36:02.224 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.220+0000 7f18d3a63640 1 -- 172.21.15.2:0/1144688111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18cc12bfe0 msgr2=0x7f18cc1302b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:02.224 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.220+0000 7f18d3a63640 1 --2- 172.21.15.2:0/1144688111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18cc12bfe0 0x7f18cc1302b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f18bc00cbd0 tx=0x7f18bc00a430 comp rx=0 tx=0).stop 2024-09-10T05:36:02.224 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.220+0000 7f18d3a63640 1 -- 172.21.15.2:0/1144688111 shutdown_connections 2024-09-10T05:36:02.224 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.220+0000 7f18d3a63640 1 --2- 172.21.15.2:0/1144688111 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f18b803b1d0 0x7f18b803d690 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:02.224 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.220+0000 7f18d3a63640 1 --2- 172.21.15.2:0/1144688111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18cc12bfe0 0x7f18cc1302b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:02.224 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.220+0000 7f18d3a63640 1 -- 172.21.15.2:0/1144688111 >> 172.21.15.2:0/1144688111 conn(0x7f18cc070630 msgr2=0x7f18cc129ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:02.224 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.220+0000 7f18d3a63640 1 -- 172.21.15.2:0/1144688111 shutdown_connections 2024-09-10T05:36:02.224 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T05:36:02.220+0000 7f18d3a63640 1 -- 172.21.15.2:0/1144688111 wait complete. 2024-09-10T05:36:02.239 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-09-10T05:36:02.239 INFO:tasks.ceph:Creating RBD pool 2024-09-10T05:36:02.239 DEBUG:teuthology.orchestra.run.smithi002:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-10T05:36:02.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.360+0000 7f4a9bc6f640 1 Processor -- start 2024-09-10T05:36:02.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.360+0000 7f4a9bc6f640 1 -- start start 2024-09-10T05:36:02.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.364+0000 7f4a9bc6f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4a9412cf30 0x7f4a9412d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:02.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.364+0000 7f4a9bc6f640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a94096ac0 con 0x7f4a9412d850 2024-09-10T05:36:02.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.364+0000 7f4a9bc6f640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f4a94099b00 con 0x7f4a9412cf30 2024-09-10T05:36:02.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.364+0000 7f4a99a0b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4a9412cf30 0x7f4a9412d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:02.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.364+0000 7f4a9920a640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f4a9412d850 0x7f4a94094050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58068/0 (socket says 172.21.15.2:58068) 2024-09-10T05:36:02.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.364+0000 7f4a99a0b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4a9412cf30 0x7f4a9412d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36658/0 (socket says 172.21.15.2:36658) 2024-09-10T05:36:02.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.364+0000 7f4a9920a640 1 -- 172.21.15.2:0/1903956325 learned_addr learned my addr 172.21.15.2:0/1903956325 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T05:36:02.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.364+0000 7f4a99a0b640 1 -- 172.21.15.2:0/1903956325 >> v1:172.21.15.2:6789/0 conn(0x7f4a9412d850 legacy=0x7f4a94094050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:02.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.364+0000 7f4a98a09640 1 -- 172.21.15.2:0/1903956325 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4108787668 0 0) 0x7f4a94096ac0 con 0x7f4a9412d850 2024-09-10T05:36:02.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.364+0000 7f4a99a0b640 1 -- 172.21.15.2:0/1903956325 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a9409a160 con 0x7f4a9412cf30 2024-09-10T05:36:02.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.364+0000 7f4a99a0b640 1 --2- 172.21.15.2:0/1903956325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a9412cf30 0x7f4a9412d310 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4a88009740 tx=0x7f4a8801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28d47f6c0aa1c666 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:02.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.368+0000 7f4a98a09640 1 -- 172.21.15.2:0/1903956325 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a880b0070 con 0x7f4a9412cf30 2024-09-10T05:36:02.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.368+0000 7f4a98a09640 1 -- 172.21.15.2:0/1903956325 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a880ab530 con 0x7f4a9412cf30 2024-09-10T05:36:02.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.368+0000 7f4a98a09640 1 -- 172.21.15.2:0/1903956325 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a880ab830 con 0x7f4a9412cf30 2024-09-10T05:36:02.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.368+0000 7f4a9bc6f640 1 -- 172.21.15.2:0/1903956325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a9412cf30 msgr2=0x7f4a9412d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:02.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.368+0000 7f4a9bc6f640 1 --2- 172.21.15.2:0/1903956325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a9412cf30 0x7f4a9412d310 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4a88009740 tx=0x7f4a8801c400 comp rx=0 tx=0).stop 2024-09-10T05:36:02.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.368+0000 7f4a9bc6f640 1 -- 172.21.15.2:0/1903956325 shutdown_connections 2024-09-10T05:36:02.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.368+0000 7f4a9bc6f640 1 --2- 172.21.15.2:0/1903956325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a9412cf30 0x7f4a9412d310 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:02.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.368+0000 7f4a9bc6f640 1 -- 172.21.15.2:0/1903956325 >> 172.21.15.2:0/1903956325 conn(0x7f4a9409a930 msgr2=0x7f4a9409ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:02.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.368+0000 7f4a9bc6f640 1 -- 172.21.15.2:0/1903956325 shutdown_connections 2024-09-10T05:36:02.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.368+0000 7f4a9bc6f640 1 -- 172.21.15.2:0/1903956325 wait complete. 2024-09-10T05:36:02.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.368+0000 7f4a9bc6f640 1 Processor -- start 2024-09-10T05:36:02.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.368+0000 7f4a9bc6f640 1 -- start start 2024-09-10T05:36:02.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.368+0000 7f4a9bc6f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a9412cf30 0x7f4a94092fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:02.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.368+0000 7f4a9bc6f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4a94135600 con 0x7f4a9412cf30 2024-09-10T05:36:02.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.368+0000 7f4a99a0b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a9412cf30 0x7f4a94092fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:02.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.368+0000 7f4a99a0b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a9412cf30 0x7f4a94092fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36672/0 (socket says 172.21.15.2:36672) 2024-09-10T05:36:02.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.368+0000 7f4a99a0b640 1 -- 172.21.15.2:0/2635118768 learned_addr learned my addr 172.21.15.2:0/2635118768 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:36:02.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.368+0000 7f4a99a0b640 1 -- 172.21.15.2:0/2635118768 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a94091ea0 con 0x7f4a9412cf30 2024-09-10T05:36:02.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.368+0000 7f4a99a0b640 1 --2- 172.21.15.2:0/2635118768 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a9412cf30 0x7f4a94092fc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4a8801a030 tx=0x7f4a8801ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:02.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.368+0000 7f4a867fc640 1 -- 172.21.15.2:0/2635118768 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a880b0050 con 0x7f4a9412cf30 2024-09-10T05:36:02.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.368+0000 7f4a867fc640 1 -- 172.21.15.2:0/2635118768 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a880b1040 con 0x7f4a9412cf30 2024-09-10T05:36:02.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.368+0000 7f4a9bc6f640 1 -- 172.21.15.2:0/2635118768 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a94092130 con 0x7f4a9412cf30 2024-09-10T05:36:02.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.368+0000 7f4a867fc640 1 -- 172.21.15.2:0/2635118768 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a880b5930 con 0x7f4a9412cf30 2024-09-10T05:36:02.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.368+0000 7f4a9bc6f640 1 -- 172.21.15.2:0/2635118768 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a940936d0 con 0x7f4a9412cf30 2024-09-10T05:36:02.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.372+0000 7f4a867fc640 1 -- 172.21.15.2:0/2635118768 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f4a880be030 con 0x7f4a9412cf30 2024-09-10T05:36:02.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.372+0000 7f4a867fc640 1 --2- 172.21.15.2:0/2635118768 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4a7803b200 0x7f4a7803d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:02.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.372+0000 7f4a9bc6f640 1 -- 172.21.15.2:0/2635118768 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a9412d390 con 0x7f4a9412cf30 2024-09-10T05:36:02.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.372+0000 7f4a867fc640 1 -- 172.21.15.2:0/2635118768 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 3129+0+0 (secure 0 0 0) 0x7f4a880bc070 con 0x7f4a9412cf30 2024-09-10T05:36:02.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.372+0000 7f4a9920a640 1 --2- 172.21.15.2:0/2635118768 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4a7803b200 0x7f4a7803d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:02.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.372+0000 7f4a9920a640 1 --2- 172.21.15.2:0/2635118768 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4a7803b200 0x7f4a7803d6c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4a90000f90 tx=0x7f4a90001680 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:02.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.376+0000 7f4a867fc640 1 -- 172.21.15.2:0/2635118768 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f4a880c5020 con 0x7f4a9412cf30 2024-09-10T05:36:02.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.544+0000 7f4a9bc6f640 1 -- 172.21.15.2:0/2635118768 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f4a940929b0 con 0x7f4a9412cf30 2024-09-10T05:36:02.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.684+0000 7f4a867fc640 1 -- 172.21.15.2:0/2635118768 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v14) ==== 109+0+0 (secure 0 0 0) 0x7f4a88015ff0 con 0x7f4a9412cf30 2024-09-10T05:36:02.689 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'rbd' created 2024-09-10T05:36:02.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.688+0000 7f4a9bc6f640 1 -- 172.21.15.2:0/2635118768 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4a7803b200 msgr2=0x7f4a7803d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:02.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.688+0000 7f4a9bc6f640 1 --2- 172.21.15.2:0/2635118768 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4a7803b200 0x7f4a7803d6c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4a90000f90 tx=0x7f4a90001680 comp rx=0 tx=0).stop 2024-09-10T05:36:02.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.688+0000 7f4a9bc6f640 1 -- 172.21.15.2:0/2635118768 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a9412cf30 msgr2=0x7f4a94092fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:02.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.688+0000 7f4a9bc6f640 1 --2- 172.21.15.2:0/2635118768 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a9412cf30 0x7f4a94092fc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4a8801a030 tx=0x7f4a8801ac40 comp rx=0 tx=0).stop 2024-09-10T05:36:02.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.688+0000 7f4a9bc6f640 1 -- 172.21.15.2:0/2635118768 shutdown_connections 2024-09-10T05:36:02.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.688+0000 7f4a9bc6f640 1 --2- 172.21.15.2:0/2635118768 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4a7803b200 0x7f4a7803d6c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:02.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.688+0000 7f4a9bc6f640 1 --2- 172.21.15.2:0/2635118768 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a9412cf30 0x7f4a94092fc0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:02.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.688+0000 7f4a9bc6f640 1 -- 172.21.15.2:0/2635118768 >> 172.21.15.2:0/2635118768 conn(0x7f4a9409a930 msgr2=0x7f4a94072f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:02.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.688+0000 7f4a9bc6f640 1 -- 172.21.15.2:0/2635118768 shutdown_connections 2024-09-10T05:36:02.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.688+0000 7f4a9bc6f640 1 -- 172.21.15.2:0/2635118768 wait complete. 2024-09-10T05:36:02.715 DEBUG:teuthology.orchestra.run.smithi002:> rbd --cluster ceph pool init rbd 2024-09-10T05:36:02.772 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:02.772 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:02.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.768+0000 7fdae8eca100 1 Processor -- start 2024-09-10T05:36:02.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.768+0000 7fdae8eca100 1 -- start start 2024-09-10T05:36:02.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.772+0000 7fdae8eca100 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55e47f42e480 0x55e47f42e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:02.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.772+0000 7fdae8eca100 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55e47f1edc50 con 0x55e47f42eda0 2024-09-10T05:36:02.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.772+0000 7fdae8eca100 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x55e47f26e600 con 0x55e47f42e480 2024-09-10T05:36:02.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.772+0000 7fdae71d2640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x55e47f42eda0 0x55e47f380fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58074/0 (socket says 172.21.15.2:58074) 2024-09-10T05:36:02.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.772+0000 7fdae71d2640 1 -- 172.21.15.2:0/1622153342 learned_addr learned my addr 172.21.15.2:0/1622153342 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T05:36:02.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.772+0000 7fdae79d3640 1 --2- 172.21.15.2:0/1622153342 >> v2:172.21.15.2:3300/0 conn(0x55e47f42e480 0x55e47f42e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:02.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.772+0000 7fdae69d1640 1 -- 172.21.15.2:0/1622153342 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 801651679 0 0) 0x55e47f1edc50 con 0x55e47f42eda0 2024-09-10T05:36:02.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.772+0000 7fdae69d1640 1 -- 172.21.15.2:0/1622153342 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdad0001e20 con 0x55e47f42eda0 2024-09-10T05:36:02.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.772+0000 7fdae79d3640 1 -- 172.21.15.2:0/1622153342 >> v1:172.21.15.2:6789/0 conn(0x55e47f42eda0 legacy=0x55e47f380fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:02.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.772+0000 7fdae79d3640 1 -- 172.21.15.2:0/1622153342 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e47f398c70 con 0x55e47f42e480 2024-09-10T05:36:02.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.772+0000 7fdae79d3640 1 --2- 172.21.15.2:0/1622153342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e47f42e480 0x55e47f42e860 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdad800a480 tx=0x7fdad801b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f95507849570cbb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:02.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.772+0000 7fdae69d1640 1 -- 172.21.15.2:0/1622153342 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdad80a7580 con 0x55e47f42e480 2024-09-10T05:36:02.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.772+0000 7fdae69d1640 1 -- 172.21.15.2:0/1622153342 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdad80a7720 con 0x55e47f42e480 2024-09-10T05:36:02.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.772+0000 7fdae69d1640 1 -- 172.21.15.2:0/1622153342 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdad80a7a20 con 0x55e47f42e480 2024-09-10T05:36:02.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.776+0000 7fdae8eca100 1 -- 172.21.15.2:0/1622153342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e47f42e480 msgr2=0x55e47f42e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:02.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.776+0000 7fdae8eca100 1 --2- 172.21.15.2:0/1622153342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e47f42e480 0x55e47f42e860 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdad800a480 tx=0x7fdad801b610 comp rx=0 tx=0).stop 2024-09-10T05:36:02.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.776+0000 7fdae8eca100 1 -- 172.21.15.2:0/1622153342 shutdown_connections 2024-09-10T05:36:02.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.776+0000 7fdae8eca100 1 --2- 172.21.15.2:0/1622153342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e47f42e480 0x55e47f42e860 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:02.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.776+0000 7fdae8eca100 1 -- 172.21.15.2:0/1622153342 >> 172.21.15.2:0/1622153342 conn(0x55e47f3a09c0 msgr2=0x55e47f3a0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:02.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.776+0000 7fdae8eca100 1 -- 172.21.15.2:0/1622153342 shutdown_connections 2024-09-10T05:36:02.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.776+0000 7fdae8eca100 1 -- 172.21.15.2:0/1622153342 wait complete. 2024-09-10T05:36:02.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.776+0000 7fdae8eca100 1 Processor -- start 2024-09-10T05:36:02.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.776+0000 7fdae8eca100 1 -- start start 2024-09-10T05:36:02.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.776+0000 7fdae8eca100 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e47f42e480 0x55e47f41c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:02.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.776+0000 7fdae8eca100 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e47f2725b0 con 0x55e47f42e480 2024-09-10T05:36:02.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.776+0000 7fdae79d3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e47f42e480 0x55e47f41c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:02.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.776+0000 7fdae79d3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e47f42e480 0x55e47f41c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36688/0 (socket says 172.21.15.2:36688) 2024-09-10T05:36:02.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.776+0000 7fdae79d3640 1 -- 172.21.15.2:0/2736543163 learned_addr learned my addr 172.21.15.2:0/2736543163 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:36:02.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.776+0000 7fdae79d3640 1 -- 172.21.15.2:0/2736543163 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e47f41e760 con 0x55e47f42e480 2024-09-10T05:36:02.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.776+0000 7fdae79d3640 1 --2- 172.21.15.2:0/2736543163 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e47f42e480 0x55e47f41c360 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdad8000c10 tx=0x7fdad80183b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:02.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.776+0000 7fdad7fff640 1 -- 172.21.15.2:0/2736543163 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdad80af8c0 con 0x55e47f42e480 2024-09-10T05:36:02.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.776+0000 7fdad7fff640 1 -- 172.21.15.2:0/2736543163 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdad80be070 con 0x55e47f42e480 2024-09-10T05:36:02.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.776+0000 7fdad7fff640 1 -- 172.21.15.2:0/2736543163 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdad80afbb0 con 0x55e47f42e480 2024-09-10T05:36:02.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.776+0000 7fdae8eca100 1 -- 172.21.15.2:0/2736543163 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e47f41f740 con 0x55e47f42e480 2024-09-10T05:36:02.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.776+0000 7fdae8eca100 1 -- 172.21.15.2:0/2736543163 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e47f41c8a0 con 0x55e47f42e480 2024-09-10T05:36:02.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.776+0000 7fdad7fff640 1 -- 172.21.15.2:0/2736543163 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fdad80a5040 con 0x55e47f42e480 2024-09-10T05:36:02.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.776+0000 7fdad7fff640 1 --2- 172.21.15.2:0/2736543163 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fdacc039a70 0x7fdacc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:02.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.780+0000 7fdad7fff640 1 -- 172.21.15.2:0/2736543163 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3471+0+0 (secure 0 0 0) 0x7fdad80e94e0 con 0x55e47f42e480 2024-09-10T05:36:02.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.780+0000 7fdae8eca100 1 -- 172.21.15.2:0/2736543163 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x55e47f43f8c0 con 0x55e47f42e480 2024-09-10T05:36:02.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.780+0000 7fdae71d2640 1 --2- 172.21.15.2:0/2736543163 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fdacc039a70 0x7fdacc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:02.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:02.780+0000 7fdae71d2640 1 --2- 172.21.15.2:0/2736543163 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fdacc039a70 0x7fdacc03bf30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fdadc001dc0 tx=0x7fdadc001320 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:03.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:03.692+0000 7fdad7fff640 1 -- 172.21.15.2:0/2736543163 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v15) ==== 141+0+0 (secure 0 0 0) 0x7fdad80b6070 con 0x55e47f42e480 2024-09-10T05:36:03.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:03.692+0000 7fdae8eca100 1 -- 172.21.15.2:0/2736543163 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdad80a7720 con 0x55e47f42e480 2024-09-10T05:36:03.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:03.696+0000 7fdad7fff640 1 -- 172.21.15.2:0/2736543163 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7fdad80afd50 con 0x55e47f42e480 2024-09-10T05:36:03.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:03.696+0000 7fdae61d0640 1 -- 172.21.15.2:0/2736543163 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=15}) -- 0x7fdac4002af0 con 0x55e47f42e480 2024-09-10T05:36:03.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:03.696+0000 7fdad7fff640 1 -- 172.21.15.2:0/2736543163 <== mon.0 v2:172.21.15.2:3300/0 8 ==== osd_map(15..15 src has 1..15) ==== 650+0+0 (secure 0 0 0) 0x7fdad80a6590 con 0x55e47f42e480 2024-09-10T05:36:03.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:03.696+0000 7fdae8eca100 1 --2- 172.21.15.2:0/2736543163 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e47f42eda0 0x55e47f444c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:03.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:03.696+0000 7fdae8eca100 1 -- 172.21.15.2:0/2736543163 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15) -- 0x55e47f445180 con 0x55e47f42eda0 2024-09-10T05:36:03.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:03.696+0000 7fdae8c35640 1 --2- 172.21.15.2:0/2736543163 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e47f42eda0 0x55e47f444c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:03.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:03.696+0000 7fdae8c35640 1 --2- 172.21.15.2:0/2736543163 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e47f42eda0 0x55e47f444c40 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:03.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:03.708+0000 7fdae8c35640 1 -- 172.21.15.2:0/2736543163 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(1 rbd_trash [create] v15'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7fdae000a4d0 con 0x55e47f42eda0 2024-09-10T05:36:03.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:03.712+0000 7fdae8eca100 1 -- 172.21.15.2:0/2736543163 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e15) -- 0x55e47f4972b0 con 0x55e47f42eda0 2024-09-10T05:36:03.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:03.712+0000 7fdae8c35640 1 -- 172.21.15.2:0/2736543163 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdae000a4d0 con 0x55e47f42eda0 2024-09-10T05:36:03.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:03.712+0000 7fdae8eca100 1 -- 172.21.15.2:0/2736543163 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e15) -- 0x55e47f4962c0 con 0x55e47f42eda0 2024-09-10T05:36:03.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:03.712+0000 7fdae8c35640 1 -- 172.21.15.2:0/2736543163 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdae000a4d0 con 0x55e47f42eda0 2024-09-10T05:36:03.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:03.712+0000 7fdae59cf640 1 -- 172.21.15.2:0/2736543163 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7fdac8001f10 con 0x55e47f42e480 2024-09-10T05:36:04.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:04.700+0000 7fdad7fff640 1 -- 172.21.15.2:0/2736543163 <== mon.0 v2:172.21.15.2:3300/0 9 ==== pool_op_reply(tid 4 (0) Success v16) ==== 55+0+0 (secure 0 0 0) 0x7fdad80ab030 con 0x55e47f42e480 2024-09-10T05:36:04.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:04.700+0000 7fdad7fff640 1 -- 172.21.15.2:0/2736543163 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=16}) -- 0x7fdacc03f620 con 0x55e47f42e480 2024-09-10T05:36:04.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:04.700+0000 7fdad7fff640 1 -- 172.21.15.2:0/2736543163 <== mon.0 v2:172.21.15.2:3300/0 10 ==== osd_map(16..16 src has 1..16) ==== 626+0+0 (secure 0 0 0) 0x7fdad80d2030 con 0x55e47f42e480 2024-09-10T05:36:04.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:04.700+0000 7fdae61d0640 1 -- 172.21.15.2:0/2736543163 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16) -- 0x7fdac4005790 con 0x55e47f42eda0 2024-09-10T05:36:04.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:04.708+0000 7fdae8c35640 1 -- 172.21.15.2:0/2736543163 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(5 rbd_info [create,write 0~8] v16'1 uv1 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdae000a4d0 con 0x55e47f42eda0 2024-09-10T05:36:04.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:04.708+0000 7fdae59cf640 1 -- 172.21.15.2:0/2736543163 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v16) -- 0x7fdac8003360 con 0x55e47f42e480 2024-09-10T05:36:05.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.704+0000 7fdad7fff640 1 -- 172.21.15.2:0/2736543163 <== mon.0 v2:172.21.15.2:3300/0 11 ==== pool_op_reply(tid 6 (0) Success v17) ==== 43+0+0 (secure 0 0 0) 0x7fdad8015320 con 0x55e47f42e480 2024-09-10T05:36:05.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.704+0000 7fdad7fff640 1 -- 172.21.15.2:0/2736543163 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=17}) -- 0x7fdacc03f8a0 con 0x55e47f42e480 2024-09-10T05:36:05.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.704+0000 7fdad7fff640 1 -- 172.21.15.2:0/2736543163 <== mon.0 v2:172.21.15.2:3300/0 12 ==== osd_map(17..17 src has 1..17) ==== 654+0+0 (secure 0 0 0) 0x7fdad8006b70 con 0x55e47f42e480 2024-09-10T05:36:05.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.704+0000 7fdae61d0640 1 -- 172.21.15.2:0/2736543163 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17) -- 0x7fdac4005b50 con 0x55e47f42eda0 2024-09-10T05:36:05.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.708+0000 7fdae8c35640 1 -- 172.21.15.2:0/2736543163 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(7 rbd_info [write 0~19] v17'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdae000a4d0 con 0x55e47f42eda0 2024-09-10T05:36:05.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.712+0000 7fdae8eca100 1 -- 172.21.15.2:0/2736543163 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e47f42eda0 msgr2=0x55e47f444c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:05.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.712+0000 7fdae8eca100 1 --2- 172.21.15.2:0/2736543163 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e47f42eda0 0x55e47f444c40 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:05.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.712+0000 7fdae8eca100 1 -- 172.21.15.2:0/2736543163 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fdacc039a70 msgr2=0x7fdacc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:05.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.712+0000 7fdae8eca100 1 --2- 172.21.15.2:0/2736543163 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fdacc039a70 0x7fdacc03bf30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fdadc001dc0 tx=0x7fdadc001320 comp rx=0 tx=0).stop 2024-09-10T05:36:05.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.712+0000 7fdae8eca100 1 -- 172.21.15.2:0/2736543163 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e47f42e480 msgr2=0x55e47f41c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:05.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.712+0000 7fdae8eca100 1 --2- 172.21.15.2:0/2736543163 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e47f42e480 0x55e47f41c360 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdad8000c10 tx=0x7fdad80183b0 comp rx=0 tx=0).stop 2024-09-10T05:36:05.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.712+0000 7fdae8eca100 1 -- 172.21.15.2:0/2736543163 shutdown_connections 2024-09-10T05:36:05.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.712+0000 7fdae8eca100 1 --2- 172.21.15.2:0/2736543163 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e47f42eda0 0x55e47f444c40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:05.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.712+0000 7fdae8eca100 1 --2- 172.21.15.2:0/2736543163 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fdacc039a70 0x7fdacc03bf30 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:05.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.712+0000 7fdae8eca100 1 --2- 172.21.15.2:0/2736543163 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e47f42e480 0x55e47f41c360 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:05.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.712+0000 7fdae8eca100 1 -- 172.21.15.2:0/2736543163 >> 172.21.15.2:0/2736543163 conn(0x55e47f3a09c0 msgr2=0x55e47f432b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:05.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.712+0000 7fdae8eca100 1 -- 172.21.15.2:0/2736543163 shutdown_connections 2024-09-10T05:36:05.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.712+0000 7fdae8eca100 1 -- 172.21.15.2:0/2736543163 wait complete. 2024-09-10T05:36:05.721 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-10T05:36:05.722 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-10T05:36:05.722 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-10T05:36:05.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.852+0000 7fe2685c8640 1 Processor -- start 2024-09-10T05:36:05.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.852+0000 7fe2685c8640 1 -- start start 2024-09-10T05:36:05.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.856+0000 7fe2685c8640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe26012c700 0x7fe2601346a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:05.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.856+0000 7fe2685c8640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe260073830 con 0x7fe26012bc10 2024-09-10T05:36:05.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.856+0000 7fe2685c8640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fe260071eb0 con 0x7fe26012c700 2024-09-10T05:36:05.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.856+0000 7fe265b63640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe26012c700 0x7fe2601346a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:05.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.856+0000 7fe266364640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe26012bc10 0x7fe26012bff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58086/0 (socket says 172.21.15.2:58086) 2024-09-10T05:36:05.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.856+0000 7fe266364640 1 -- 172.21.15.2:0/274586862 learned_addr learned my addr 172.21.15.2:0/274586862 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T05:36:05.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.856+0000 7fe265b63640 1 -- 172.21.15.2:0/274586862 >> v1:172.21.15.2:6789/0 conn(0x7fe26012bc10 legacy=0x7fe26012bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:05.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.856+0000 7fe265b63640 1 -- 172.21.15.2:0/274586862 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2600a30b0 con 0x7fe26012c700 2024-09-10T05:36:05.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.856+0000 7fe265b63640 1 --2- 172.21.15.2:0/274586862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe26012c700 0x7fe2601346a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe250009740 tx=0x7fe25001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2d25e86f731c05a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:05.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.856+0000 7fe265362640 1 -- 172.21.15.2:0/274586862 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2500b0070 con 0x7fe26012c700 2024-09-10T05:36:05.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.856+0000 7fe265362640 1 -- 172.21.15.2:0/274586862 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2500ab530 con 0x7fe26012c700 2024-09-10T05:36:05.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.856+0000 7fe265362640 1 -- 172.21.15.2:0/274586862 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2500ab830 con 0x7fe26012c700 2024-09-10T05:36:05.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.860+0000 7fe2685c8640 1 -- 172.21.15.2:0/274586862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe26012c700 msgr2=0x7fe2601346a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:05.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.860+0000 7fe2685c8640 1 --2- 172.21.15.2:0/274586862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe26012c700 0x7fe2601346a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe250009740 tx=0x7fe25001c370 comp rx=0 tx=0).stop 2024-09-10T05:36:05.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.860+0000 7fe2685c8640 1 -- 172.21.15.2:0/274586862 shutdown_connections 2024-09-10T05:36:05.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.860+0000 7fe2685c8640 1 --2- 172.21.15.2:0/274586862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe26012c700 0x7fe2601346a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:05.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.860+0000 7fe2685c8640 1 -- 172.21.15.2:0/274586862 >> 172.21.15.2:0/274586862 conn(0x7fe2600a0a60 msgr2=0x7fe26006e800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:05.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.860+0000 7fe2685c8640 1 -- 172.21.15.2:0/274586862 shutdown_connections 2024-09-10T05:36:05.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.860+0000 7fe2685c8640 1 -- 172.21.15.2:0/274586862 wait complete. 2024-09-10T05:36:05.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.860+0000 7fe2685c8640 1 Processor -- start 2024-09-10T05:36:05.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.860+0000 7fe2685c8640 1 -- start start 2024-09-10T05:36:05.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.860+0000 7fe2685c8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe26012bc10 0x7fe26012a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:05.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.860+0000 7fe2685c8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe260137790 con 0x7fe26012bc10 2024-09-10T05:36:05.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.860+0000 7fe266364640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe26012bc10 0x7fe26012a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:05.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.860+0000 7fe266364640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe26012bc10 0x7fe26012a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36710/0 (socket says 172.21.15.2:36710) 2024-09-10T05:36:05.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.860+0000 7fe266364640 1 -- 172.21.15.2:0/1666404161 learned_addr learned my addr 172.21.15.2:0/1666404161 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:36:05.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.860+0000 7fe266364640 1 -- 172.21.15.2:0/1666404161 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe260073a50 con 0x7fe26012bc10 2024-09-10T05:36:05.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.860+0000 7fe266364640 1 --2- 172.21.15.2:0/1666404161 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe26012bc10 0x7fe26012a7a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe25c00c480 tx=0x7fe25c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:05.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.860+0000 7fe256ffd640 1 -- 172.21.15.2:0/1666404161 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe25c017070 con 0x7fe26012bc10 2024-09-10T05:36:05.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.860+0000 7fe256ffd640 1 -- 172.21.15.2:0/1666404161 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe25c005c20 con 0x7fe26012bc10 2024-09-10T05:36:05.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.860+0000 7fe256ffd640 1 -- 172.21.15.2:0/1666404161 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe25c0070d0 con 0x7fe26012bc10 2024-09-10T05:36:05.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.860+0000 7fe2685c8640 1 -- 172.21.15.2:0/1666404161 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe26011ceb0 con 0x7fe26012bc10 2024-09-10T05:36:05.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.860+0000 7fe2685c8640 1 -- 172.21.15.2:0/1666404161 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe26011d500 con 0x7fe26012bc10 2024-09-10T05:36:05.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.860+0000 7fe2685c8640 1 -- 172.21.15.2:0/1666404161 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe26012bff0 con 0x7fe26012bc10 2024-09-10T05:36:05.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.864+0000 7fe256ffd640 1 -- 172.21.15.2:0/1666404161 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe25c01a070 con 0x7fe26012bc10 2024-09-10T05:36:05.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.864+0000 7fe256ffd640 1 --2- 172.21.15.2:0/1666404161 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fe24403b200 0x7fe24403d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:05.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.864+0000 7fe256ffd640 1 -- 172.21.15.2:0/1666404161 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fe25c04e480 con 0x7fe26012bc10 2024-09-10T05:36:05.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.864+0000 7fe265b63640 1 --2- 172.21.15.2:0/1666404161 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fe24403b200 0x7fe24403d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:05.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.864+0000 7fe265b63640 1 --2- 172.21.15.2:0/1666404161 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fe24403b200 0x7fe24403d6c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe2500ad000 tx=0x7fe250008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:05.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:05.868+0000 7fe256ffd640 1 -- 172.21.15.2:0/1666404161 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fe25c021020 con 0x7fe26012bc10 2024-09-10T05:36:06.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.040+0000 7fe2685c8640 1 -- 172.21.15.2:0/1666404161 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7fe260068e50 con 0x7fe26012bc10 2024-09-10T05:36:06.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.040+0000 7fe256ffd640 1 -- 172.21.15.2:0/1666404161 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v5) ==== 86+0+159 (secure 0 0 0) 0x7fe25c01ad80 con 0x7fe26012bc10 2024-09-10T05:36:06.042 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T05:36:06.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.040+0000 7fe2685c8640 1 -- 172.21.15.2:0/1666404161 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fe24403b200 msgr2=0x7fe24403d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:06.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.040+0000 7fe2685c8640 1 --2- 172.21.15.2:0/1666404161 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fe24403b200 0x7fe24403d6c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe2500ad000 tx=0x7fe250008040 comp rx=0 tx=0).stop 2024-09-10T05:36:06.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.040+0000 7fe2685c8640 1 -- 172.21.15.2:0/1666404161 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe26012bc10 msgr2=0x7fe26012a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:06.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.040+0000 7fe2685c8640 1 --2- 172.21.15.2:0/1666404161 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe26012bc10 0x7fe26012a7a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe25c00c480 tx=0x7fe25c00c940 comp rx=0 tx=0).stop 2024-09-10T05:36:06.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.040+0000 7fe2685c8640 1 -- 172.21.15.2:0/1666404161 shutdown_connections 2024-09-10T05:36:06.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.040+0000 7fe2685c8640 1 --2- 172.21.15.2:0/1666404161 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fe24403b200 0x7fe24403d6c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:06.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.040+0000 7fe2685c8640 1 --2- 172.21.15.2:0/1666404161 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe26012bc10 0x7fe26012a7a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:06.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.040+0000 7fe2685c8640 1 -- 172.21.15.2:0/1666404161 >> 172.21.15.2:0/1666404161 conn(0x7fe2600a0a60 msgr2=0x7fe2600a0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:06.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.040+0000 7fe2685c8640 1 -- 172.21.15.2:0/1666404161 shutdown_connections 2024-09-10T05:36:06.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.040+0000 7fe2685c8640 1 -- 172.21.15.2:0/1666404161 wait complete. 2024-09-10T05:36:06.061 INFO:teuthology.orchestra.run.smithi002.stdout:[{"version":5,"timestamp":"2024-09-10T05:35:56.782401+0000","name":"","changes":[{"name":"osd.3/osd_mclock_max_capacity_iops_ssd","new_value":"5566.514642"}]}] 2024-09-10T05:36:06.062 INFO:tasks.ceph_manager:config epoch is 5 2024-09-10T05:36:06.062 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-10T05:36:06.062 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-10T05:36:06.062 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-10T05:36:06.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.188+0000 7f090bd89640 1 Processor -- start 2024-09-10T05:36:06.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.188+0000 7f090bd89640 1 -- start start 2024-09-10T05:36:06.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.188+0000 7f090bd89640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f090412f0c0 0x7f090412f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:06.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.188+0000 7f090bd89640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0904071620 con 0x7f090412f9e0 2024-09-10T05:36:06.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.188+0000 7f090bd89640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f09040a3130 con 0x7f090412f0c0 2024-09-10T05:36:06.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.188+0000 7f0909b25640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f090412f0c0 0x7f090412f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:06.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.188+0000 7f0909324640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f090412f9e0 0x7f090412bc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58090/0 (socket says 172.21.15.2:58090) 2024-09-10T05:36:06.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.188+0000 7f0909324640 1 -- 172.21.15.2:0/2376716267 learned_addr learned my addr 172.21.15.2:0/2376716267 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T05:36:06.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.188+0000 7f0909b25640 1 -- 172.21.15.2:0/2376716267 >> v1:172.21.15.2:6789/0 conn(0x7f090412f9e0 legacy=0x7f090412bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:06.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.188+0000 7f0909b25640 1 -- 172.21.15.2:0/2376716267 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09040737d0 con 0x7f090412f0c0 2024-09-10T05:36:06.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.188+0000 7f0909b25640 1 --2- 172.21.15.2:0/2376716267 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f090412f0c0 0x7f090412f4a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0900009740 tx=0x7f090001c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1125dd21551a636d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:06.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.188+0000 7f0908b23640 1 -- 172.21.15.2:0/2376716267 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09000b0070 con 0x7f090412f0c0 2024-09-10T05:36:06.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.188+0000 7f0908b23640 1 -- 172.21.15.2:0/2376716267 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09000ab530 con 0x7f090412f0c0 2024-09-10T05:36:06.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.188+0000 7f0908b23640 1 -- 172.21.15.2:0/2376716267 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09000ab830 con 0x7f090412f0c0 2024-09-10T05:36:06.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.192+0000 7f090bd89640 1 -- 172.21.15.2:0/2376716267 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f090412f0c0 msgr2=0x7f090412f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:06.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.192+0000 7f090bd89640 1 --2- 172.21.15.2:0/2376716267 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f090412f0c0 0x7f090412f4a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0900009740 tx=0x7f090001c310 comp rx=0 tx=0).stop 2024-09-10T05:36:06.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.192+0000 7f090bd89640 1 -- 172.21.15.2:0/2376716267 shutdown_connections 2024-09-10T05:36:06.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.192+0000 7f090bd89640 1 --2- 172.21.15.2:0/2376716267 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f090412f0c0 0x7f090412f4a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:06.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.192+0000 7f090bd89640 1 -- 172.21.15.2:0/2376716267 >> 172.21.15.2:0/2376716267 conn(0x7f09040a0ab0 msgr2=0x7f090406dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:06.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.192+0000 7f090bd89640 1 -- 172.21.15.2:0/2376716267 shutdown_connections 2024-09-10T05:36:06.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.192+0000 7f090bd89640 1 -- 172.21.15.2:0/2376716267 wait complete. 2024-09-10T05:36:06.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.192+0000 7f090bd89640 1 Processor -- start 2024-09-10T05:36:06.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.192+0000 7f090bd89640 1 -- start start 2024-09-10T05:36:06.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.192+0000 7f090bd89640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f090412f0c0 0x7f090411ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:06.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.192+0000 7f090bd89640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f09041376e0 con 0x7f090412f0c0 2024-09-10T05:36:06.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.192+0000 7f0909b25640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f090412f0c0 0x7f090411ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:06.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.192+0000 7f0909b25640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f090412f0c0 0x7f090411ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36732/0 (socket says 172.21.15.2:36732) 2024-09-10T05:36:06.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.192+0000 7f0909b25640 1 -- 172.21.15.2:0/3062087601 learned_addr learned my addr 172.21.15.2:0/3062087601 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:36:06.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.192+0000 7f0909b25640 1 -- 172.21.15.2:0/3062087601 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f090411dd80 con 0x7f090412f0c0 2024-09-10T05:36:06.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.192+0000 7f0909b25640 1 --2- 172.21.15.2:0/3062087601 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f090412f0c0 0x7f090411ac90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f09000ae040 tx=0x7f0900019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:06.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.192+0000 7f08fa7fc640 1 -- 172.21.15.2:0/3062087601 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09000b8020 con 0x7f090412f0c0 2024-09-10T05:36:06.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.192+0000 7f08fa7fc640 1 -- 172.21.15.2:0/3062087601 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09000b4410 con 0x7f090412f0c0 2024-09-10T05:36:06.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.192+0000 7f090bd89640 1 -- 172.21.15.2:0/3062087601 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f090411e0b0 con 0x7f090412f0c0 2024-09-10T05:36:06.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.192+0000 7f08fa7fc640 1 -- 172.21.15.2:0/3062087601 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09000b0040 con 0x7f090412f0c0 2024-09-10T05:36:06.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.192+0000 7f090bd89640 1 -- 172.21.15.2:0/3062087601 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f090411d740 con 0x7f090412f0c0 2024-09-10T05:36:06.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.192+0000 7f090bd89640 1 -- 172.21.15.2:0/3062087601 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f090412f4a0 con 0x7f090412f0c0 2024-09-10T05:36:06.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.192+0000 7f08fa7fc640 1 -- 172.21.15.2:0/3062087601 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f09000bb020 con 0x7f090412f0c0 2024-09-10T05:36:06.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.192+0000 7f08fa7fc640 1 --2- 172.21.15.2:0/3062087601 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f08e803b1d0 0x7f08e803d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:06.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.192+0000 7f08fa7fc640 1 -- 172.21.15.2:0/3062087601 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f09000e8b90 con 0x7f090412f0c0 2024-09-10T05:36:06.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.196+0000 7f0909324640 1 --2- 172.21.15.2:0/3062087601 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f08e803b1d0 0x7f08e803d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:06.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.196+0000 7f0909324640 1 --2- 172.21.15.2:0/3062087601 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f08e803b1d0 0x7f08e803d690 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f08f40015f0 tx=0x7f08f4007ab0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:06.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.200+0000 7f08fa7fc640 1 -- 172.21.15.2:0/3062087601 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f09000c2030 con 0x7f090412f0c0 2024-09-10T05:36:06.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.416+0000 7f090bd89640 1 -- 172.21.15.2:0/3062087601 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f090411c3d0 con 0x7f090412f0c0 2024-09-10T05:36:06.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.420+0000 7f08fa7fc640 1 -- 172.21.15.2:0/3062087601 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+92910 (secure 0 0 0) 0x7f090411dd80 con 0x7f090412f0c0 2024-09-10T05:36:06.426 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T05:36:06.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.424+0000 7f090bd89640 1 -- 172.21.15.2:0/3062087601 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f08e803b1d0 msgr2=0x7f08e803d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:06.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.424+0000 7f090bd89640 1 --2- 172.21.15.2:0/3062087601 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f08e803b1d0 0x7f08e803d690 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f08f40015f0 tx=0x7f08f4007ab0 comp rx=0 tx=0).stop 2024-09-10T05:36:06.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.424+0000 7f090bd89640 1 -- 172.21.15.2:0/3062087601 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f090412f0c0 msgr2=0x7f090411ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:06.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.424+0000 7f090bd89640 1 --2- 172.21.15.2:0/3062087601 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f090412f0c0 0x7f090411ac90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f09000ae040 tx=0x7f0900019110 comp rx=0 tx=0).stop 2024-09-10T05:36:06.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.424+0000 7f090bd89640 1 -- 172.21.15.2:0/3062087601 shutdown_connections 2024-09-10T05:36:06.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.424+0000 7f090bd89640 1 --2- 172.21.15.2:0/3062087601 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f08e803b1d0 0x7f08e803d690 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:06.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.424+0000 7f090bd89640 1 --2- 172.21.15.2:0/3062087601 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f090412f0c0 0x7f090411ac90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:06.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.424+0000 7f090bd89640 1 -- 172.21.15.2:0/3062087601 >> 172.21.15.2:0/3062087601 conn(0x7f09040a0ab0 msgr2=0x7f090412cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:06.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.424+0000 7f090bd89640 1 -- 172.21.15.2:0/3062087601 shutdown_connections 2024-09-10T05:36:06.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.424+0000 7f090bd89640 1 -- 172.21.15.2:0/3062087601 wait complete. 2024-09-10T05:36:06.444 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":5,"flags":0,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3663628807},{"type":"v1","addr":"172.21.15.62:6825","nonce":3663628807}]},"active_addr":"172.21.15.62:6825/3663628807","active_change":"2024-09-10T05:35:51.576078+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.62:0","nonce":2913280794}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.62:0","nonce":2801359269}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.62:0","nonce":1135190065}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.62:0","nonce":4068844539}]}]} 2024-09-10T05:36:06.446 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-10T05:36:06.446 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-10T05:36:06.446 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T05:36:06.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.560+0000 7ffaaa171640 1 Processor -- start 2024-09-10T05:36:06.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.560+0000 7ffaaa171640 1 -- start start 2024-09-10T05:36:06.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.560+0000 7ffaaa171640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ffaa4111890 0x7ffaa4132450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:06.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.560+0000 7ffaaa171640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffaa4073a90 con 0x7ffaa4110da0 2024-09-10T05:36:06.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.560+0000 7ffaaa171640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7ffaa40696e0 con 0x7ffaa4111890 2024-09-10T05:36:06.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.560+0000 7ffaa2ffd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ffaa4111890 0x7ffaa4132450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:06.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.560+0000 7ffaa37fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ffaa4110da0 0x7ffaa4111180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58092/0 (socket says 172.21.15.2:58092) 2024-09-10T05:36:06.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.560+0000 7ffaa37fe640 1 -- 172.21.15.2:0/3833319294 learned_addr learned my addr 172.21.15.2:0/3833319294 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T05:36:06.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.560+0000 7ffaa2ffd640 1 -- 172.21.15.2:0/3833319294 >> v1:172.21.15.2:6789/0 conn(0x7ffaa4110da0 legacy=0x7ffaa4111180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:06.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.560+0000 7ffaa2ffd640 1 -- 172.21.15.2:0/3833319294 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaa406dd50 con 0x7ffaa4111890 2024-09-10T05:36:06.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.564+0000 7ffaa2ffd640 1 --2- 172.21.15.2:0/3833319294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffaa4111890 0x7ffaa4132450 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ffa94009d90 tx=0x7ffa9401c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc63ce1bc7555aa6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:06.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.564+0000 7ffaa27fc640 1 -- 172.21.15.2:0/3833319294 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa940b2070 con 0x7ffaa4111890 2024-09-10T05:36:06.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.564+0000 7ffaa27fc640 1 -- 172.21.15.2:0/3833319294 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa940a5740 con 0x7ffaa4111890 2024-09-10T05:36:06.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.564+0000 7ffaa27fc640 1 -- 172.21.15.2:0/3833319294 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa940a5a40 con 0x7ffaa4111890 2024-09-10T05:36:06.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.564+0000 7ffaaa171640 1 -- 172.21.15.2:0/3833319294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffaa4111890 msgr2=0x7ffaa4132450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:06.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.564+0000 7ffaaa171640 1 --2- 172.21.15.2:0/3833319294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffaa4111890 0x7ffaa4132450 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ffa94009d90 tx=0x7ffa9401c8c0 comp rx=0 tx=0).stop 2024-09-10T05:36:06.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.564+0000 7ffaaa171640 1 -- 172.21.15.2:0/3833319294 shutdown_connections 2024-09-10T05:36:06.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.564+0000 7ffaaa171640 1 --2- 172.21.15.2:0/3833319294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffaa4111890 0x7ffaa4132450 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:06.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.564+0000 7ffaaa171640 1 -- 172.21.15.2:0/3833319294 >> 172.21.15.2:0/3833319294 conn(0x7ffaa4070900 msgr2=0x7ffaa4072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:06.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.564+0000 7ffaaa171640 1 -- 172.21.15.2:0/3833319294 shutdown_connections 2024-09-10T05:36:06.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.564+0000 7ffaaa171640 1 -- 172.21.15.2:0/3833319294 wait complete. 2024-09-10T05:36:06.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.564+0000 7ffaaa171640 1 Processor -- start 2024-09-10T05:36:06.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.564+0000 7ffaaa171640 1 -- start start 2024-09-10T05:36:06.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.568+0000 7ffaaa171640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffaa4110da0 0x7ffaa412e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:06.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.568+0000 7ffaaa171640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa4135330 con 0x7ffaa4110da0 2024-09-10T05:36:06.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.568+0000 7ffaa37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffaa4110da0 0x7ffaa412e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:06.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.568+0000 7ffaa37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffaa4110da0 0x7ffaa412e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36752/0 (socket says 172.21.15.2:36752) 2024-09-10T05:36:06.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.568+0000 7ffaa37fe640 1 -- 172.21.15.2:0/278361439 learned_addr learned my addr 172.21.15.2:0/278361439 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:36:06.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.568+0000 7ffaa37fe640 1 -- 172.21.15.2:0/278361439 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaa412a580 con 0x7ffaa4110da0 2024-09-10T05:36:06.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.568+0000 7ffaa37fe640 1 --2- 172.21.15.2:0/278361439 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffaa4110da0 0x7ffaa412e430 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c00c450 tx=0x7ffa8c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:06.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.568+0000 7ffa9bfff640 1 -- 172.21.15.2:0/278361439 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa8c017070 con 0x7ffaa4110da0 2024-09-10T05:36:06.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.568+0000 7ffa9bfff640 1 -- 172.21.15.2:0/278361439 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa8c005c20 con 0x7ffaa4110da0 2024-09-10T05:36:06.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.568+0000 7ffaaa171640 1 -- 172.21.15.2:0/278361439 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaa4130180 con 0x7ffaa4110da0 2024-09-10T05:36:06.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.568+0000 7ffa9bfff640 1 -- 172.21.15.2:0/278361439 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa8c0070d0 con 0x7ffaa4110da0 2024-09-10T05:36:06.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.568+0000 7ffaaa171640 1 -- 172.21.15.2:0/278361439 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaa4129f60 con 0x7ffaa4110da0 2024-09-10T05:36:06.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.568+0000 7ffaaa171640 1 -- 172.21.15.2:0/278361439 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaa41304d0 con 0x7ffaa4110da0 2024-09-10T05:36:06.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.568+0000 7ffa9bfff640 1 -- 172.21.15.2:0/278361439 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ffa8c01a070 con 0x7ffaa4110da0 2024-09-10T05:36:06.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.568+0000 7ffa9bfff640 1 --2- 172.21.15.2:0/278361439 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ffa8403b1d0 0x7ffa8403d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:06.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.568+0000 7ffa9bfff640 1 -- 172.21.15.2:0/278361439 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7ffa8c04dfd0 con 0x7ffaa4110da0 2024-09-10T05:36:06.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.568+0000 7ffaa2ffd640 1 --2- 172.21.15.2:0/278361439 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ffa8403b1d0 0x7ffa8403d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:06.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.568+0000 7ffaa2ffd640 1 --2- 172.21.15.2:0/278361439 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ffa8403b1d0 0x7ffa8403d690 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ffa940af000 tx=0x7ffa940a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:06.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.572+0000 7ffa9bfff640 1 -- 172.21.15.2:0/278361439 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7ffa8c019cd0 con 0x7ffaa4110da0 2024-09-10T05:36:06.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.748+0000 7ffaaa171640 1 -- 172.21.15.2:0/278361439 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffaa412f730 con 0x7ffaa4110da0 2024-09-10T05:36:06.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.748+0000 7ffa9bfff640 1 -- 172.21.15.2:0/278361439 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+9854 (secure 0 0 0) 0x7ffa8c01b400 con 0x7ffaa4110da0 2024-09-10T05:36:06.752 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T05:36:06.752 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":17,"fsid":"004d9798-7539-4e93-b06c-e32e30a3c3b6","created":"2024-09-10T05:35:46.592342+0000","modified":"2024-09-10T05:36:05.701596+0000","last_up_change":"2024-09-10T05:35:57.655557+0000","last_in_change":"2024-09-10T05:35:47.803069+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T05:35:57.624941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-10T05:36:02.556976+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6b013ec0-c5ae-44ad-8d52-95ef02dc3140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":945139080},{"type":"v1","addr":"172.21.15.2:6801","nonce":945139080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":945139080},{"type":"v1","addr":"172.21.15.2:6803","nonce":945139080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":945139080},{"type":"v1","addr":"172.21.15.2:6807","nonce":945139080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":945139080},{"type":"v1","addr":"172.21.15.2:6805","nonce":945139080}]},"public_addr":"172.21.15.2:6801/945139080","cluster_addr":"172.21.15.2:6803/945139080","heartbeat_back_addr":"172.21.15.2:6807/945139080","heartbeat_front_addr":"172.21.15.2:6805/945139080","state":["exists","up"]},{"osd":1,"uuid":"39b3a256-0e4e-417d-8962-eebb40b35e16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":3442097179},{"type":"v1","addr":"172.21.15.62:6809","nonce":3442097179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3442097179},{"type":"v1","addr":"172.21.15.62:6811","nonce":3442097179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3442097179},{"type":"v1","addr":"172.21.15.62:6815","nonce":3442097179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3442097179},{"type":"v1","addr":"172.21.15.62:6813","nonce":3442097179}]},"public_addr":"172.21.15.62:6809/3442097179","cluster_addr":"172.21.15.62:6811/3442097179","heartbeat_back_addr":"172.21.15.62:6815/3442097179","heartbeat_front_addr":"172.21.15.62:6813/3442097179","state":["exists","up"]},{"osd":2,"uuid":"d7df24cd-e2f8-48ce-9956-0885d11a5685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2677868286},{"type":"v1","addr":"172.21.15.62:6801","nonce":2677868286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2677868286},{"type":"v1","addr":"172.21.15.62:6803","nonce":2677868286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2677868286},{"type":"v1","addr":"172.21.15.62:6807","nonce":2677868286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2677868286},{"type":"v1","addr":"172.21.15.62:6805","nonce":2677868286}]},"public_addr":"172.21.15.62:6801/2677868286","cluster_addr":"172.21.15.62:6803/2677868286","heartbeat_back_addr":"172.21.15.62:6807/2677868286","heartbeat_front_addr":"172.21.15.62:6805/2677868286","state":["exists","up"]},{"osd":3,"uuid":"e7bedfd2-ac57-47c9-ad11-0aaf1710946d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":2708991149},{"type":"v1","addr":"172.21.15.62:6817","nonce":2708991149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2708991149},{"type":"v1","addr":"172.21.15.62:6819","nonce":2708991149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2708991149},{"type":"v1","addr":"172.21.15.62:6823","nonce":2708991149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":2708991149},{"type":"v1","addr":"172.21.15.62:6821","nonce":2708991149}]},"public_addr":"172.21.15.62:6817/2708991149","cluster_addr":"172.21.15.62:6819/2708991149","heartbeat_back_addr":"172.21.15.62:6823/2708991149","heartbeat_front_addr":"172.21.15.62:6821/2708991149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:35:53.717657+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:35:54.611828+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:35:54.504863+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:35:55.176104+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T05:36:06.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.752+0000 7ffaaa171640 1 -- 172.21.15.2:0/278361439 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ffa8403b1d0 msgr2=0x7ffa8403d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:06.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.752+0000 7ffaaa171640 1 --2- 172.21.15.2:0/278361439 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ffa8403b1d0 0x7ffa8403d690 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ffa940af000 tx=0x7ffa940a7070 comp rx=0 tx=0).stop 2024-09-10T05:36:06.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.752+0000 7ffaaa171640 1 -- 172.21.15.2:0/278361439 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffaa4110da0 msgr2=0x7ffaa412e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:06.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.752+0000 7ffaaa171640 1 --2- 172.21.15.2:0/278361439 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffaa4110da0 0x7ffaa412e430 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c00c450 tx=0x7ffa8c00c910 comp rx=0 tx=0).stop 2024-09-10T05:36:06.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.752+0000 7ffaaa171640 1 -- 172.21.15.2:0/278361439 shutdown_connections 2024-09-10T05:36:06.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.752+0000 7ffaaa171640 1 --2- 172.21.15.2:0/278361439 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ffa8403b1d0 0x7ffa8403d690 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:06.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.752+0000 7ffaaa171640 1 --2- 172.21.15.2:0/278361439 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffaa4110da0 0x7ffaa412e430 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:06.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.752+0000 7ffaaa171640 1 -- 172.21.15.2:0/278361439 >> 172.21.15.2:0/278361439 conn(0x7ffaa4070900 msgr2=0x7ffaa4071ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:06.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.752+0000 7ffaaa171640 1 -- 172.21.15.2:0/278361439 shutdown_connections 2024-09-10T05:36:06.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.752+0000 7ffaaa171640 1 -- 172.21.15.2:0/278361439 wait complete. 2024-09-10T05:36:06.771 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-10T05:36:06.772 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T05:36:06.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.876+0000 7f4562e9e640 1 Processor -- start 2024-09-10T05:36:06.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.876+0000 7f4562e9e640 1 -- start start 2024-09-10T05:36:06.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.880+0000 7f4562e9e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f455c111890 0x7f455c132450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:06.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.880+0000 7f4562e9e640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f455c073a90 con 0x7f455c110da0 2024-09-10T05:36:06.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.880+0000 7f4562e9e640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f455c0696e0 con 0x7f455c111890 2024-09-10T05:36:06.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.880+0000 7f455bfff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f455c111890 0x7f455c132450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:06.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.880+0000 7f4560c3a640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f455c110da0 0x7f455c111180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58100/0 (socket says 172.21.15.2:58100) 2024-09-10T05:36:06.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.880+0000 7f4560c3a640 1 -- 172.21.15.2:0/3025774711 learned_addr learned my addr 172.21.15.2:0/3025774711 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T05:36:06.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.880+0000 7f455bfff640 1 -- 172.21.15.2:0/3025774711 >> v1:172.21.15.2:6789/0 conn(0x7f455c110da0 legacy=0x7f455c111180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:06.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.880+0000 7f455b7fe640 1 -- 172.21.15.2:0/3025774711 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4272366281 0 0) 0x7f455c073a90 con 0x7f455c110da0 2024-09-10T05:36:06.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.880+0000 7f455bfff640 1 -- 172.21.15.2:0/3025774711 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f455c06dd50 con 0x7f455c111890 2024-09-10T05:36:06.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.880+0000 7f455bfff640 1 --2- 172.21.15.2:0/3025774711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f455c111890 0x7f455c132450 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4550009740 tx=0x7f455001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e84d7216c7e0dcb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:06.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.880+0000 7f455b7fe640 1 -- 172.21.15.2:0/3025774711 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45500b0070 con 0x7f455c111890 2024-09-10T05:36:06.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.880+0000 7f455b7fe640 1 -- 172.21.15.2:0/3025774711 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45500ab530 con 0x7f455c111890 2024-09-10T05:36:06.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.880+0000 7f455b7fe640 1 -- 172.21.15.2:0/3025774711 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45500ab830 con 0x7f455c111890 2024-09-10T05:36:06.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.884+0000 7f4562e9e640 1 -- 172.21.15.2:0/3025774711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f455c111890 msgr2=0x7f455c132450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:06.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.884+0000 7f4562e9e640 1 --2- 172.21.15.2:0/3025774711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f455c111890 0x7f455c132450 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4550009740 tx=0x7f455001c370 comp rx=0 tx=0).stop 2024-09-10T05:36:06.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.884+0000 7f4562e9e640 1 -- 172.21.15.2:0/3025774711 shutdown_connections 2024-09-10T05:36:06.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.884+0000 7f4562e9e640 1 --2- 172.21.15.2:0/3025774711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f455c111890 0x7f455c132450 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:06.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.884+0000 7f4562e9e640 1 -- 172.21.15.2:0/3025774711 >> 172.21.15.2:0/3025774711 conn(0x7f455c070900 msgr2=0x7f455c072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:06.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.884+0000 7f4562e9e640 1 -- 172.21.15.2:0/3025774711 shutdown_connections 2024-09-10T05:36:06.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.884+0000 7f4562e9e640 1 -- 172.21.15.2:0/3025774711 wait complete. 2024-09-10T05:36:06.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.884+0000 7f4562e9e640 1 Processor -- start 2024-09-10T05:36:06.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.884+0000 7f4562e9e640 1 -- start start 2024-09-10T05:36:06.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.884+0000 7f4562e9e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f455c110da0 0x7f455c121c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:06.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.884+0000 7f4562e9e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f455c135330 con 0x7f455c110da0 2024-09-10T05:36:06.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.884+0000 7f4560c3a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f455c110da0 0x7f455c121c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:06.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.884+0000 7f4560c3a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f455c110da0 0x7f455c121c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36780/0 (socket says 172.21.15.2:36780) 2024-09-10T05:36:06.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.884+0000 7f4560c3a640 1 -- 172.21.15.2:0/226562312 learned_addr learned my addr 172.21.15.2:0/226562312 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:36:06.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.884+0000 7f4560c3a640 1 -- 172.21.15.2:0/226562312 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f455c131c80 con 0x7f455c110da0 2024-09-10T05:36:06.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.884+0000 7f4560c3a640 1 --2- 172.21.15.2:0/226562312 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f455c110da0 0x7f455c121c00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f454c00c3d0 tx=0x7f454c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:06.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.884+0000 7f45597fa640 1 -- 172.21.15.2:0/226562312 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f454c007410 con 0x7f455c110da0 2024-09-10T05:36:06.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.884+0000 7f45597fa640 1 -- 172.21.15.2:0/226562312 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f454c0075d0 con 0x7f455c110da0 2024-09-10T05:36:06.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.884+0000 7f4562e9e640 1 -- 172.21.15.2:0/226562312 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f455c131f10 con 0x7f455c110da0 2024-09-10T05:36:06.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.884+0000 7f45597fa640 1 -- 172.21.15.2:0/226562312 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f454c004960 con 0x7f455c110da0 2024-09-10T05:36:06.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.884+0000 7f4562e9e640 1 -- 172.21.15.2:0/226562312 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f455c122310 con 0x7f455c110da0 2024-09-10T05:36:06.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.884+0000 7f4562e9e640 1 -- 172.21.15.2:0/226562312 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f455c114f60 con 0x7f455c110da0 2024-09-10T05:36:06.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.884+0000 7f45597fa640 1 -- 172.21.15.2:0/226562312 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f454c011070 con 0x7f455c110da0 2024-09-10T05:36:06.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.884+0000 7f45597fa640 1 --2- 172.21.15.2:0/226562312 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f454803b200 0x7f454803d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:06.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.884+0000 7f45597fa640 1 -- 172.21.15.2:0/226562312 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f454c04e860 con 0x7f455c110da0 2024-09-10T05:36:06.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.888+0000 7f455bfff640 1 --2- 172.21.15.2:0/226562312 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f454803b200 0x7f454803d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:06.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.888+0000 7f455bfff640 1 --2- 172.21.15.2:0/226562312 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f454803b200 0x7f454803d6c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f45500ad000 tx=0x7f4550008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:06.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:06.892+0000 7f45597fa640 1 -- 172.21.15.2:0/226562312 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f454c011c60 con 0x7f455c110da0 2024-09-10T05:36:07.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.056+0000 7f4562e9e640 1 -- 172.21.15.2:0/226562312 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f455c111180 con 0x7f455c110da0 2024-09-10T05:36:07.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.056+0000 7f45597fa640 1 -- 172.21.15.2:0/226562312 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+9854 (secure 0 0 0) 0x7f454c010d70 con 0x7f455c110da0 2024-09-10T05:36:07.059 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T05:36:07.060 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":17,"fsid":"004d9798-7539-4e93-b06c-e32e30a3c3b6","created":"2024-09-10T05:35:46.592342+0000","modified":"2024-09-10T05:36:05.701596+0000","last_up_change":"2024-09-10T05:35:57.655557+0000","last_in_change":"2024-09-10T05:35:47.803069+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T05:35:57.624941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-10T05:36:02.556976+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6b013ec0-c5ae-44ad-8d52-95ef02dc3140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":945139080},{"type":"v1","addr":"172.21.15.2:6801","nonce":945139080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":945139080},{"type":"v1","addr":"172.21.15.2:6803","nonce":945139080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":945139080},{"type":"v1","addr":"172.21.15.2:6807","nonce":945139080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":945139080},{"type":"v1","addr":"172.21.15.2:6805","nonce":945139080}]},"public_addr":"172.21.15.2:6801/945139080","cluster_addr":"172.21.15.2:6803/945139080","heartbeat_back_addr":"172.21.15.2:6807/945139080","heartbeat_front_addr":"172.21.15.2:6805/945139080","state":["exists","up"]},{"osd":1,"uuid":"39b3a256-0e4e-417d-8962-eebb40b35e16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":3442097179},{"type":"v1","addr":"172.21.15.62:6809","nonce":3442097179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3442097179},{"type":"v1","addr":"172.21.15.62:6811","nonce":3442097179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3442097179},{"type":"v1","addr":"172.21.15.62:6815","nonce":3442097179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3442097179},{"type":"v1","addr":"172.21.15.62:6813","nonce":3442097179}]},"public_addr":"172.21.15.62:6809/3442097179","cluster_addr":"172.21.15.62:6811/3442097179","heartbeat_back_addr":"172.21.15.62:6815/3442097179","heartbeat_front_addr":"172.21.15.62:6813/3442097179","state":["exists","up"]},{"osd":2,"uuid":"d7df24cd-e2f8-48ce-9956-0885d11a5685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2677868286},{"type":"v1","addr":"172.21.15.62:6801","nonce":2677868286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2677868286},{"type":"v1","addr":"172.21.15.62:6803","nonce":2677868286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2677868286},{"type":"v1","addr":"172.21.15.62:6807","nonce":2677868286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2677868286},{"type":"v1","addr":"172.21.15.62:6805","nonce":2677868286}]},"public_addr":"172.21.15.62:6801/2677868286","cluster_addr":"172.21.15.62:6803/2677868286","heartbeat_back_addr":"172.21.15.62:6807/2677868286","heartbeat_front_addr":"172.21.15.62:6805/2677868286","state":["exists","up"]},{"osd":3,"uuid":"e7bedfd2-ac57-47c9-ad11-0aaf1710946d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":2708991149},{"type":"v1","addr":"172.21.15.62:6817","nonce":2708991149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2708991149},{"type":"v1","addr":"172.21.15.62:6819","nonce":2708991149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2708991149},{"type":"v1","addr":"172.21.15.62:6823","nonce":2708991149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":2708991149},{"type":"v1","addr":"172.21.15.62:6821","nonce":2708991149}]},"public_addr":"172.21.15.62:6817/2708991149","cluster_addr":"172.21.15.62:6819/2708991149","heartbeat_back_addr":"172.21.15.62:6823/2708991149","heartbeat_front_addr":"172.21.15.62:6821/2708991149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:35:53.717657+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:35:54.611828+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:35:54.504863+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:35:55.176104+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T05:36:07.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.060+0000 7f4562e9e640 1 -- 172.21.15.2:0/226562312 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f454803b200 msgr2=0x7f454803d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:07.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.060+0000 7f4562e9e640 1 --2- 172.21.15.2:0/226562312 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f454803b200 0x7f454803d6c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f45500ad000 tx=0x7f4550008040 comp rx=0 tx=0).stop 2024-09-10T05:36:07.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.060+0000 7f4562e9e640 1 -- 172.21.15.2:0/226562312 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f455c110da0 msgr2=0x7f455c121c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:07.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.060+0000 7f4562e9e640 1 --2- 172.21.15.2:0/226562312 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f455c110da0 0x7f455c121c00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f454c00c3d0 tx=0x7f454c00c890 comp rx=0 tx=0).stop 2024-09-10T05:36:07.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.060+0000 7f4562e9e640 1 -- 172.21.15.2:0/226562312 shutdown_connections 2024-09-10T05:36:07.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.060+0000 7f4562e9e640 1 --2- 172.21.15.2:0/226562312 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f454803b200 0x7f454803d6c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:07.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.060+0000 7f4562e9e640 1 --2- 172.21.15.2:0/226562312 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f455c110da0 0x7f455c121c00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:07.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.060+0000 7f4562e9e640 1 -- 172.21.15.2:0/226562312 >> 172.21.15.2:0/226562312 conn(0x7f455c070900 msgr2=0x7f455c129830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:07.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.060+0000 7f4562e9e640 1 -- 172.21.15.2:0/226562312 shutdown_connections 2024-09-10T05:36:07.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.060+0000 7f4562e9e640 1 -- 172.21.15.2:0/226562312 wait complete. 2024-09-10T05:36:07.078 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-10T05:36:07.078 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-10T05:36:07.079 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-10T05:36:07.079 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-10T05:36:07.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.184+0000 7fec7c296640 1 Processor -- start 2024-09-10T05:36:07.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.184+0000 7fec7c296640 1 -- start start 2024-09-10T05:36:07.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.184+0000 7fec7c296640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fec7406e760 0x7fec741347d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:07.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.184+0000 7fec7c296640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec7409d690 con 0x7fec7409c160 2024-09-10T05:36:07.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.184+0000 7fec7c296640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fec74073a20 con 0x7fec7406e760 2024-09-10T05:36:07.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.184+0000 7fec79831640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fec7406e760 0x7fec741347d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:07.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.184+0000 7fec79831640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fec7406e760 0x7fec741347d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58288/0 (socket says 172.21.15.2:58288) 2024-09-10T05:36:07.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.184+0000 7fec79831640 1 -- 172.21.15.2:0/3174069949 learned_addr learned my addr 172.21.15.2:0/3174069949 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:36:07.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.184+0000 7fec79831640 1 -- 172.21.15.2:0/3174069949 >> v1:172.21.15.2:6789/0 conn(0x7fec7409c160 legacy=0x7fec7409c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:07.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.184+0000 7fec79831640 1 -- 172.21.15.2:0/3174069949 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec7406deb0 con 0x7fec7406e760 2024-09-10T05:36:07.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.184+0000 7f1d1c820640 1 Processor -- start 2024-09-10T05:36:07.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.184+0000 7f1d1c820640 1 -- start start 2024-09-10T05:36:07.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.188+0000 7fb2b9e35640 1 Processor -- start 2024-09-10T05:36:07.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.188+0000 7fb2b9e35640 1 -- start start 2024-09-10T05:36:07.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.188+0000 7f1d1c820640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1d18132790 0x7f1d18134b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:07.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.188+0000 7f1d1c820640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d1812cd50 con 0x7f1d1812c260 2024-09-10T05:36:07.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.188+0000 7f1d1659c640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f1d1812c260 0x7f1d1812c640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44130/0 (socket says 172.21.15.2:44130) 2024-09-10T05:36:07.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.188+0000 7f1d1659c640 1 -- 172.21.15.2:0/3741770342 learned_addr learned my addr 172.21.15.2:0/3741770342 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T05:36:07.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.188+0000 7f1d15d9b640 1 --2- 172.21.15.2:0/3741770342 >> v2:172.21.15.2:3300/0 conn(0x7f1d18132790 0x7f1d18134b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:07.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.188+0000 7f1d1c820640 1 -- 172.21.15.2:0/3741770342 --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f1d1812bea0 con 0x7f1d18132790 2024-09-10T05:36:07.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.188+0000 7fb2b9e35640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb2b412be80 0x7fb2b412c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:07.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.188+0000 7f1d1559a640 1 -- 172.21.15.2:0/3741770342 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2629540304 0 0) 0x7f1d1812cd50 con 0x7f1d1812c260 2024-09-10T05:36:07.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.188+0000 7f1d1559a640 1 -- 172.21.15.2:0/3741770342 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d00003530 con 0x7f1d1812c260 2024-09-10T05:36:07.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.188+0000 7f1d15d9b640 1 -- 172.21.15.2:0/3741770342 >> v1:172.21.15.2:6789/0 conn(0x7f1d1812c260 legacy=0x7f1d1812c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:07.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.188+0000 7f1d15d9b640 1 -- 172.21.15.2:0/3741770342 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d18073200 con 0x7f1d18132790 2024-09-10T05:36:07.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.188+0000 7fec79831640 1 --2- 172.21.15.2:0/3174069949 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec7406e760 0x7fec741347d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fec640097f0 tx=0x7fec6401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a47c501529120bb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:07.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.188+0000 7fec79030640 1 -- 172.21.15.2:0/3174069949 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec640b0070 con 0x7fec7406e760 2024-09-10T05:36:07.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.188+0000 7fec79030640 1 -- 172.21.15.2:0/3174069949 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec640ab530 con 0x7fec7406e760 2024-09-10T05:36:07.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.188+0000 7fec79030640 1 -- 172.21.15.2:0/3174069949 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec640ab830 con 0x7fec7406e760 2024-09-10T05:36:07.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.188+0000 7fb2b9e35640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2b406d520 con 0x7fb2b412c7a0 2024-09-10T05:36:07.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.188+0000 7fb2b9e35640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fb2b40735a0 con 0x7fb2b412be80 2024-09-10T05:36:07.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.188+0000 7fb2b37fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb2b412be80 0x7fb2b412c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:07.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.188+0000 7fb2b37fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb2b412be80 0x7fb2b412c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58312/0 (socket says 172.21.15.2:58312) 2024-09-10T05:36:07.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.188+0000 7fb2b37fe640 1 -- 172.21.15.2:0/3135234079 learned_addr learned my addr 172.21.15.2:0/3135234079 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:36:07.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.188+0000 7fb2b2ffd640 1 -- 172.21.15.2:0/3135234079 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2336798680 0 0) 0x7fb2b406d520 con 0x7fb2b412c7a0 2024-09-10T05:36:07.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.188+0000 7fb2b2ffd640 1 -- 172.21.15.2:0/3135234079 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2a0003530 con 0x7fb2b412c7a0 2024-09-10T05:36:07.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.188+0000 7fb2b37fe640 1 -- 172.21.15.2:0/3135234079 >> v1:172.21.15.2:6789/0 conn(0x7fb2b412c7a0 legacy=0x7fb2b4128ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:07.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.188+0000 7fb2b37fe640 1 -- 172.21.15.2:0/3135234079 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2b40716b0 con 0x7fb2b412be80 2024-09-10T05:36:07.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.188+0000 7fec7c296640 1 -- 172.21.15.2:0/3174069949 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec7406e760 msgr2=0x7fec741347d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:07.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.188+0000 7fec7c296640 1 --2- 172.21.15.2:0/3174069949 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec7406e760 0x7fec741347d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fec640097f0 tx=0x7fec6401c430 comp rx=0 tx=0).stop 2024-09-10T05:36:07.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.188+0000 7fec7c296640 1 -- 172.21.15.2:0/3174069949 shutdown_connections 2024-09-10T05:36:07.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.188+0000 7fec7c296640 1 --2- 172.21.15.2:0/3174069949 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec7406e760 0x7fec741347d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:07.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.188+0000 7fec7c296640 1 -- 172.21.15.2:0/3174069949 >> 172.21.15.2:0/3174069949 conn(0x7fec74071630 msgr2=0x7fec7409aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:07.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.188+0000 7fec7c296640 1 -- 172.21.15.2:0/3174069949 shutdown_connections 2024-09-10T05:36:07.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.188+0000 7fec7c296640 1 -- 172.21.15.2:0/3174069949 wait complete. 2024-09-10T05:36:07.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.188+0000 7fec7c296640 1 Processor -- start 2024-09-10T05:36:07.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.188+0000 7fec7c296640 1 -- start start 2024-09-10T05:36:07.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.188+0000 7fec7c296640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec7406e760 0x7fec74119190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:07.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.188+0000 7fec7c296640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fec741378c0 con 0x7fec7406e760 2024-09-10T05:36:07.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.188+0000 7fec7a032640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec7406e760 0x7fec74119190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:07.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.188+0000 7fec7a032640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec7406e760 0x7fec74119190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58316/0 (socket says 172.21.15.2:58316) 2024-09-10T05:36:07.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.188+0000 7fec7a032640 1 -- 172.21.15.2:0/990626478 learned_addr learned my addr 172.21.15.2:0/990626478 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:36:07.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.192+0000 7f1d15d9b640 1 --2- 172.21.15.2:0/3741770342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d18132790 0x7f1d18134b80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c009740 tx=0x7f1d0c01c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d39ef494031dd857 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:07.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.192+0000 7fec7a032640 1 -- 172.21.15.2:0/990626478 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec74133770 con 0x7fec7406e760 2024-09-10T05:36:07.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.192+0000 7fb2b37fe640 1 --2- 172.21.15.2:0/3135234079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2b412be80 0x7fb2b412c260 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb2a40097f0 tx=0x7fb2a401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f85b7e631c230281 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:07.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.192+0000 7fec7a032640 1 --2- 172.21.15.2:0/990626478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec7406e760 0x7fec74119190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fec7000c480 tx=0x7fec7000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:07.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.192+0000 7fb2b2ffd640 1 -- 172.21.15.2:0/3135234079 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2a40b0070 con 0x7fb2b412be80 2024-09-10T05:36:07.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.192+0000 7fb2b2ffd640 1 -- 172.21.15.2:0/3135234079 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2a40ab530 con 0x7fb2b412be80 2024-09-10T05:36:07.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.192+0000 7fb2b2ffd640 1 -- 172.21.15.2:0/3135234079 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2a40ab830 con 0x7fb2b412be80 2024-09-10T05:36:07.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.192+0000 7fec6affd640 1 -- 172.21.15.2:0/990626478 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec70017070 con 0x7fec7406e760 2024-09-10T05:36:07.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.192+0000 7f1d1559a640 1 -- 172.21.15.2:0/3741770342 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d0c0b1070 con 0x7f1d18132790 2024-09-10T05:36:07.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.192+0000 7f1d1559a640 1 -- 172.21.15.2:0/3741770342 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d0c0ac570 con 0x7f1d18132790 2024-09-10T05:36:07.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.192+0000 7f1d1559a640 1 -- 172.21.15.2:0/3741770342 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d0c0ac870 con 0x7f1d18132790 2024-09-10T05:36:07.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.192+0000 7f1d1c820640 1 -- 172.21.15.2:0/3741770342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d18132790 msgr2=0x7f1d18134b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:07.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.192+0000 7f1d1c820640 1 --2- 172.21.15.2:0/3741770342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d18132790 0x7f1d18134b80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c009740 tx=0x7f1d0c01c350 comp rx=0 tx=0).stop 2024-09-10T05:36:07.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.192+0000 7f1d1c820640 1 -- 172.21.15.2:0/3741770342 shutdown_connections 2024-09-10T05:36:07.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.192+0000 7f1d1c820640 1 --2- 172.21.15.2:0/3741770342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d18132790 0x7f1d18134b80 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:07.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.192+0000 7f1d1c820640 1 -- 172.21.15.2:0/3741770342 >> 172.21.15.2:0/3741770342 conn(0x7f1d180704a0 msgr2=0x7f1d18072890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:07.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.192+0000 7f1d1c820640 1 -- 172.21.15.2:0/3741770342 shutdown_connections 2024-09-10T05:36:07.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.192+0000 7fec7c296640 1 -- 172.21.15.2:0/990626478 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec74133cc0 con 0x7fec7406e760 2024-09-10T05:36:07.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.192+0000 7fec7c296640 1 -- 172.21.15.2:0/990626478 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec74134410 con 0x7fec7406e760 2024-09-10T05:36:07.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.192+0000 7fec6affd640 1 -- 172.21.15.2:0/990626478 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec70005200 con 0x7fec7406e760 2024-09-10T05:36:07.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.192+0000 7fec7c296640 1 -- 172.21.15.2:0/990626478 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fec74117770 con 0x7fec7406e760 2024-09-10T05:36:07.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.192+0000 7fec6affd640 1 -- 172.21.15.2:0/990626478 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec70003600 con 0x7fec7406e760 2024-09-10T05:36:07.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.192+0000 7fb2b9e35640 1 -- 172.21.15.2:0/3135234079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2b412be80 msgr2=0x7fb2b412c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:07.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.192+0000 7fb2b9e35640 1 --2- 172.21.15.2:0/3135234079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2b412be80 0x7fb2b412c260 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb2a40097f0 tx=0x7fb2a401c430 comp rx=0 tx=0).stop 2024-09-10T05:36:07.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.192+0000 7fec6affd640 1 -- 172.21.15.2:0/990626478 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fec7001a070 con 0x7fec7406e760 2024-09-10T05:36:07.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.192+0000 7fec6affd640 1 --2- 172.21.15.2:0/990626478 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fec5803b1d0 0x7fec5803d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:07.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.192+0000 7fec6affd640 1 -- 172.21.15.2:0/990626478 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fec7004e680 con 0x7fec7406e760 2024-09-10T05:36:07.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.192+0000 7f1d1c820640 1 -- 172.21.15.2:0/3741770342 wait complete. 2024-09-10T05:36:07.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.192+0000 7f1d1c820640 1 Processor -- start 2024-09-10T05:36:07.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.192+0000 7fb2b9e35640 1 -- 172.21.15.2:0/3135234079 shutdown_connections 2024-09-10T05:36:07.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.192+0000 7fb2b9e35640 1 --2- 172.21.15.2:0/3135234079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2b412be80 0x7fb2b412c260 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:07.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.192+0000 7fb2b9e35640 1 -- 172.21.15.2:0/3135234079 >> 172.21.15.2:0/3135234079 conn(0x7fb2b409b890 msgr2=0x7fb2b406dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:07.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.192+0000 7fec6affd640 1 --2- 172.21.15.2:0/990626478 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x7fec58040950 0x7fec58042dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:07.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.192+0000 7fb2b9e35640 1 -- 172.21.15.2:0/3135234079 shutdown_connections 2024-09-10T05:36:07.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.192+0000 7fec6affd640 1 -- 172.21.15.2:0/990626478 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fec7001dec0 con 0x7fec58040950 2024-09-10T05:36:07.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.192+0000 7fec6affd640 1 -- 172.21.15.2:0/990626478 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fec7004eac0 con 0x7fec7406e760 2024-09-10T05:36:07.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.192+0000 7fb2b9e35640 1 -- 172.21.15.2:0/3135234079 wait complete. 2024-09-10T05:36:07.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.192+0000 7fec79831640 1 --2- 172.21.15.2:0/990626478 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fec5803b1d0 0x7fec5803d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:07.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.192+0000 7fec7a833640 1 --2- 172.21.15.2:0/990626478 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x7fec58040950 0x7fec58042dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:07.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.192+0000 7f1d1c820640 1 -- start start 2024-09-10T05:36:07.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.192+0000 7f1d1c820640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d1812c260 0x7f1d181276c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:07.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.192+0000 7f1d1c820640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1d181168a0 con 0x7f1d1812c260 2024-09-10T05:36:07.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.192+0000 7fb2b9e35640 1 Processor -- start 2024-09-10T05:36:07.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.192+0000 7f1d1659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d1812c260 0x7f1d181276c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:07.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.192+0000 7f1d1659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d1812c260 0x7f1d181276c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58322/0 (socket says 172.21.15.2:58322) 2024-09-10T05:36:07.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.192+0000 7f1d1659c640 1 -- 172.21.15.2:0/2771706571 learned_addr learned my addr 172.21.15.2:0/2771706571 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:36:07.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.192+0000 7fb2b9e35640 1 -- start start 2024-09-10T05:36:07.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.192+0000 7fec79831640 1 --2- 172.21.15.2:0/990626478 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fec5803b1d0 0x7fec5803d690 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fec74074200 tx=0x7fec640a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:07.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.192+0000 7fec7a833640 1 --2- 172.21.15.2:0/990626478 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x7fec58040950 0x7fec58042dd0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:07.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.196+0000 7fb2b9e35640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2b412be80 0x7fb2b41170e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:07.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.196+0000 7fb2b9e35640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b406f790 con 0x7fb2b412be80 2024-09-10T05:36:07.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.196+0000 7f1d1659c640 1 -- 172.21.15.2:0/2771706571 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d1808c730 con 0x7f1d1812c260 2024-09-10T05:36:07.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.196+0000 7fb2b37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2b412be80 0x7fb2b41170e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:07.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.196+0000 7fb2b37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2b412be80 0x7fb2b41170e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58332/0 (socket says 172.21.15.2:58332) 2024-09-10T05:36:07.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.196+0000 7fb2b37fe640 1 -- 172.21.15.2:0/183746067 learned_addr learned my addr 172.21.15.2:0/183746067 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:36:07.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.196+0000 7f1d1659c640 1 --2- 172.21.15.2:0/2771706571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d1812c260 0x7f1d181276c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1d0800c410 tx=0x7f1d0800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:07.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.196+0000 7f1d06ffd640 1 -- 172.21.15.2:0/2771706571 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d080074d0 con 0x7f1d1812c260 2024-09-10T05:36:07.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.196+0000 7f1d06ffd640 1 -- 172.21.15.2:0/2771706571 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d080047f0 con 0x7f1d1812c260 2024-09-10T05:36:07.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.196+0000 7f1d06ffd640 1 -- 172.21.15.2:0/2771706571 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d08004b10 con 0x7f1d1812c260 2024-09-10T05:36:07.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.196+0000 7fb2b37fe640 1 -- 172.21.15.2:0/183746067 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2b4119fe0 con 0x7fb2b412be80 2024-09-10T05:36:07.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.196+0000 7f1d1c820640 1 -- 172.21.15.2:0/2771706571 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d1808d590 con 0x7f1d1812c260 2024-09-10T05:36:07.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.196+0000 7fb2b37fe640 1 --2- 172.21.15.2:0/183746067 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2b412be80 0x7fb2b41170e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4000c10 tx=0x7fb2a40191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:07.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.196+0000 7fb2b0ff9640 1 -- 172.21.15.2:0/183746067 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2a40b9020 con 0x7fb2b412be80 2024-09-10T05:36:07.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.196+0000 7fb2b0ff9640 1 -- 172.21.15.2:0/183746067 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2a40b1040 con 0x7fb2b412be80 2024-09-10T05:36:07.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.196+0000 7fb2b0ff9640 1 -- 172.21.15.2:0/183746067 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2a40b0050 con 0x7fb2b412be80 2024-09-10T05:36:07.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.196+0000 7fb2b9e35640 1 -- 172.21.15.2:0/183746067 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2b4128ad0 con 0x7fb2b412be80 2024-09-10T05:36:07.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.196+0000 7fb2b9e35640 1 -- 172.21.15.2:0/183746067 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2b4119b20 con 0x7fb2b412be80 2024-09-10T05:36:07.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.196+0000 7f1d1c820640 1 -- 172.21.15.2:0/2771706571 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d1808fee0 con 0x7f1d1812c260 2024-09-10T05:36:07.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.196+0000 7f1d1c820640 1 -- 172.21.15.2:0/2771706571 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1d18129b70 con 0x7f1d1812c260 2024-09-10T05:36:07.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.196+0000 7f1d06ffd640 1 -- 172.21.15.2:0/2771706571 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1d08011070 con 0x7f1d1812c260 2024-09-10T05:36:07.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.196+0000 7f1d06ffd640 1 --2- 172.21.15.2:0/2771706571 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1cf803b1d0 0x7f1cf803d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:07.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.196+0000 7f1d06ffd640 1 -- 172.21.15.2:0/2771706571 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f1d0804e900 con 0x7f1d1812c260 2024-09-10T05:36:07.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.196+0000 7f1d06ffd640 1 --2- 172.21.15.2:0/2771706571 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x7f1cf8040950 0x7f1cf8042dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:07.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.196+0000 7f1d06ffd640 1 -- 172.21.15.2:0/2771706571 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1d08010ec0 con 0x7f1cf8040950 2024-09-10T05:36:07.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.196+0000 7f1d06ffd640 1 -- 172.21.15.2:0/2771706571 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f1d080532a0 con 0x7f1d1812c260 2024-09-10T05:36:07.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.196+0000 7fb2b9e35640 1 -- 172.21.15.2:0/183746067 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb2b412c260 con 0x7fb2b412be80 2024-09-10T05:36:07.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.196+0000 7fec6affd640 1 -- 172.21.15.2:0/990626478 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fec7001dec0 con 0x7fec58040950 2024-09-10T05:36:07.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.196+0000 7f1d16d9d640 1 --2- 172.21.15.2:0/2771706571 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x7f1cf8040950 0x7f1cf8042dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:07.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.196+0000 7f1d15d9b640 1 --2- 172.21.15.2:0/2771706571 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1cf803b1d0 0x7f1cf803d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:07.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.196+0000 7f1d16d9d640 1 --2- 172.21.15.2:0/2771706571 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x7f1cf8040950 0x7f1cf8042dd0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:07.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.196+0000 7f1d15d9b640 1 --2- 172.21.15.2:0/2771706571 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1cf803b1d0 0x7f1cf803d690 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c009740 tx=0x7f1d0c0a6070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:07.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.196+0000 7fb2b0ff9640 1 -- 172.21.15.2:0/183746067 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb2a40bc020 con 0x7fb2b412be80 2024-09-10T05:36:07.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.196+0000 7fb2b0ff9640 1 --2- 172.21.15.2:0/183746067 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb29403b1d0 0x7fb29403d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:07.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.196+0000 7fb2b0ff9640 1 -- 172.21.15.2:0/183746067 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fb2a40e8a60 con 0x7fb2b412be80 2024-09-10T05:36:07.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.196+0000 7fb2b0ff9640 1 --2- 172.21.15.2:0/183746067 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x7fb294040950 0x7fb294042dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:07.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.196+0000 7fb2b0ff9640 1 -- 172.21.15.2:0/183746067 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb2a40a9ec0 con 0x7fb294040950 2024-09-10T05:36:07.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.196+0000 7fb2b0ff9640 1 -- 172.21.15.2:0/183746067 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fb2a40ed220 con 0x7fb2b412be80 2024-09-10T05:36:07.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.200+0000 7fb2b3fff640 1 --2- 172.21.15.2:0/183746067 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x7fb294040950 0x7fb294042dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:07.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.200+0000 7f1d06ffd640 1 -- 172.21.15.2:0/2771706571 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1d08010ec0 con 0x7f1cf8040950 2024-09-10T05:36:07.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.200+0000 7fb2abfff640 1 --2- 172.21.15.2:0/183746067 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb29403b1d0 0x7fb29403d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:07.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.200+0000 7fb2b3fff640 1 --2- 172.21.15.2:0/183746067 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x7fb294040950 0x7fb294042dd0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:07.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.200+0000 7fb2abfff640 1 --2- 172.21.15.2:0/183746067 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb29403b1d0 0x7fb29403d690 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb29c001600 tx=0x7fb29c0078f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:07.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.200+0000 7fb2b0ff9640 1 -- 172.21.15.2:0/183746067 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb2a40a9ec0 con 0x7fb294040950 2024-09-10T05:36:07.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.200+0000 7f120e54e640 1 Processor -- start 2024-09-10T05:36:07.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.200+0000 7f120e54e640 1 -- start start 2024-09-10T05:36:07.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.200+0000 7f120e54e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f12080704d0 0x7f12080708b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:07.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.200+0000 7f120e54e640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f120806d520 con 0x7f1208070df0 2024-09-10T05:36:07.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.200+0000 7f120e54e640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f1208072e50 con 0x7f12080704d0 2024-09-10T05:36:07.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.200+0000 7f1207fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f12080704d0 0x7f12080708b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:07.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.200+0000 7f1207fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f12080704d0 0x7f12080708b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58348/0 (socket says 172.21.15.2:58348) 2024-09-10T05:36:07.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.200+0000 7f1207fff640 1 -- 172.21.15.2:0/3789598827 learned_addr learned my addr 172.21.15.2:0/3789598827 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:36:07.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.200+0000 7f12077fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f1208070df0 0x7f1208128ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44138/0 (socket says 172.21.15.2:44138) 2024-09-10T05:36:07.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.200+0000 7f1207fff640 1 -- 172.21.15.2:0/3789598827 >> v1:172.21.15.2:6789/0 conn(0x7f1208070df0 legacy=0x7f1208128ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T05:36:07.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.200+0000 7f1207fff640 1 -- 172.21.15.2:0/3789598827 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f120806d820 con 0x7f12080704d0 2024-09-10T05:36:07.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.204+0000 7f1207fff640 1 --2- 172.21.15.2:0/3789598827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12080704d0 0x7f12080708b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f11f80097f0 tx=0x7f11f801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de78de96a8db1157 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:07.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.204+0000 7f1206ffd640 1 -- 172.21.15.2:0/3789598827 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11f80b0070 con 0x7f12080704d0 2024-09-10T05:36:07.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.204+0000 7f1206ffd640 1 -- 172.21.15.2:0/3789598827 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11f80ab530 con 0x7f12080704d0 2024-09-10T05:36:07.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.204+0000 7f1206ffd640 1 -- 172.21.15.2:0/3789598827 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11f80ab830 con 0x7f12080704d0 2024-09-10T05:36:07.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.208+0000 7f120e54e640 1 -- 172.21.15.2:0/3789598827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12080704d0 msgr2=0x7f12080708b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:07.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.208+0000 7f120e54e640 1 --2- 172.21.15.2:0/3789598827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12080704d0 0x7f12080708b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f11f80097f0 tx=0x7f11f801c430 comp rx=0 tx=0).stop 2024-09-10T05:36:07.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.208+0000 7f120e54e640 1 -- 172.21.15.2:0/3789598827 shutdown_connections 2024-09-10T05:36:07.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.208+0000 7f120e54e640 1 --2- 172.21.15.2:0/3789598827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12080704d0 0x7f12080708b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:07.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.208+0000 7f120e54e640 1 -- 172.21.15.2:0/3789598827 >> 172.21.15.2:0/3789598827 conn(0x7f120809b890 msgr2=0x7f120806dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:07.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.208+0000 7f120e54e640 1 -- 172.21.15.2:0/3789598827 shutdown_connections 2024-09-10T05:36:07.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.208+0000 7f120e54e640 1 -- 172.21.15.2:0/3789598827 wait complete. 2024-09-10T05:36:07.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.208+0000 7f120e54e640 1 Processor -- start 2024-09-10T05:36:07.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.208+0000 7f120e54e640 1 -- start start 2024-09-10T05:36:07.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.208+0000 7f120e54e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12080704d0 0x7f1208116940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:07.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.208+0000 7f120e54e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1208132740 con 0x7f12080704d0 2024-09-10T05:36:07.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.208+0000 7f1207fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12080704d0 0x7f1208116940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:07.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.208+0000 7f1207fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12080704d0 0x7f1208116940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58364/0 (socket says 172.21.15.2:58364) 2024-09-10T05:36:07.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.208+0000 7f1207fff640 1 -- 172.21.15.2:0/2858676868 learned_addr learned my addr 172.21.15.2:0/2858676868 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:36:07.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.208+0000 7f1207fff640 1 -- 172.21.15.2:0/2858676868 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1208073650 con 0x7f12080704d0 2024-09-10T05:36:07.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.208+0000 7f1207fff640 1 --2- 172.21.15.2:0/2858676868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12080704d0 0x7f1208116940 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f11f801aae0 tx=0x7f11f801ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:07.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.208+0000 7f1204ff9640 1 -- 172.21.15.2:0/2858676868 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11f80ba020 con 0x7f12080704d0 2024-09-10T05:36:07.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.208+0000 7f1204ff9640 1 -- 172.21.15.2:0/2858676868 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11f80b6420 con 0x7f12080704d0 2024-09-10T05:36:07.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.208+0000 7f120e54e640 1 -- 172.21.15.2:0/2858676868 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12081181a0 con 0x7f12080704d0 2024-09-10T05:36:07.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.208+0000 7f1204ff9640 1 -- 172.21.15.2:0/2858676868 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11f80b0040 con 0x7f12080704d0 2024-09-10T05:36:07.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.208+0000 7f120e54e640 1 -- 172.21.15.2:0/2858676868 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1208117b80 con 0x7f12080704d0 2024-09-10T05:36:07.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.212+0000 7f120e54e640 1 -- 172.21.15.2:0/2858676868 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f12080708b0 con 0x7f12080704d0 2024-09-10T05:36:07.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.212+0000 7f1204ff9640 1 -- 172.21.15.2:0/2858676868 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f11f80bd020 con 0x7f12080704d0 2024-09-10T05:36:07.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.212+0000 7f1204ff9640 1 --2- 172.21.15.2:0/2858676868 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f11f403b200 0x7f11f403d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:07.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.212+0000 7f1204ff9640 1 -- 172.21.15.2:0/2858676868 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f11f80e9110 con 0x7f12080704d0 2024-09-10T05:36:07.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.212+0000 7f1204ff9640 1 --2- 172.21.15.2:0/2858676868 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f11f4040980 0x7f11f4042e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:07.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.212+0000 7f1204ff9640 1 -- 172.21.15.2:0/2858676868 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f11f80bbec0 con 0x7f11f4040980 2024-09-10T05:36:07.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.212+0000 7f1204ff9640 1 -- 172.21.15.2:0/2858676868 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f11f80f0050 con 0x7f12080704d0 2024-09-10T05:36:07.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.212+0000 7f12077fe640 1 --2- 172.21.15.2:0/2858676868 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f11f403b200 0x7f11f403d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:07.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.212+0000 7f120caeb640 1 --2- 172.21.15.2:0/2858676868 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f11f4040980 0x7f11f4042e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:07.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.212+0000 7f12077fe640 1 --2- 172.21.15.2:0/2858676868 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f11f403b200 0x7f11f403d6c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f11fc004f60 tx=0x7f11fc007a90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:07.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.212+0000 7f120caeb640 1 --2- 172.21.15.2:0/2858676868 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f11f4040980 0x7f11f4042e00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:07.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.212+0000 7fec7c296640 1 -- 172.21.15.2:0/990626478 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fec74117970 con 0x7fec58040950 2024-09-10T05:36:07.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.212+0000 7fec6affd640 1 -- 172.21.15.2:0/990626478 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fec74117970 con 0x7fec58040950 2024-09-10T05:36:07.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.212+0000 7fec7c296640 1 -- 172.21.15.2:0/990626478 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x7fec58040950 msgr2=0x7fec58042dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:07.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.212+0000 7fec7c296640 1 --2- 172.21.15.2:0/990626478 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x7fec58040950 0x7fec58042dd0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:07.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.212+0000 7fec7c296640 1 -- 172.21.15.2:0/990626478 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fec5803b1d0 msgr2=0x7fec5803d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:07.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.212+0000 7fec7c296640 1 --2- 172.21.15.2:0/990626478 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fec5803b1d0 0x7fec5803d690 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fec74074200 tx=0x7fec640a6000 comp rx=0 tx=0).stop 2024-09-10T05:36:07.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.212+0000 7fec7c296640 1 -- 172.21.15.2:0/990626478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec7406e760 msgr2=0x7fec74119190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:07.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.212+0000 7fec7c296640 1 --2- 172.21.15.2:0/990626478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec7406e760 0x7fec74119190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fec7000c480 tx=0x7fec7000c940 comp rx=0 tx=0).stop 2024-09-10T05:36:07.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.212+0000 7fec7c296640 1 -- 172.21.15.2:0/990626478 shutdown_connections 2024-09-10T05:36:07.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.212+0000 7fec7c296640 1 --2- 172.21.15.2:0/990626478 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x7fec58040950 0x7fec58042dd0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:07.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.212+0000 7fec7c296640 1 --2- 172.21.15.2:0/990626478 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fec5803b1d0 0x7fec5803d690 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:07.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.212+0000 7fec7c296640 1 --2- 172.21.15.2:0/990626478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec7406e760 0x7fec74119190 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:07.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.212+0000 7fec7c296640 1 -- 172.21.15.2:0/990626478 >> 172.21.15.2:0/990626478 conn(0x7fec74071630 msgr2=0x7fec7412bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:07.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.212+0000 7fec7c296640 1 -- 172.21.15.2:0/990626478 shutdown_connections 2024-09-10T05:36:07.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.212+0000 7fec7c296640 1 -- 172.21.15.2:0/990626478 wait complete. 2024-09-10T05:36:07.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.216+0000 7f1d1c820640 1 -- 172.21.15.2:0/2771706571 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1d18090220 con 0x7f1cf8040950 2024-09-10T05:36:07.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.216+0000 7f1204ff9640 1 -- 172.21.15.2:0/2858676868 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f11f80bbec0 con 0x7f11f4040980 2024-09-10T05:36:07.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.216+0000 7f1d06ffd640 1 -- 172.21.15.2:0/2771706571 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1d1000adb0 con 0x7f1cf8040950 2024-09-10T05:36:07.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.216+0000 7f1d1c820640 1 -- 172.21.15.2:0/2771706571 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x7f1cf8040950 msgr2=0x7f1cf8042dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:07.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.216+0000 7f1d1c820640 1 --2- 172.21.15.2:0/2771706571 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x7f1cf8040950 0x7f1cf8042dd0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:07.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.216+0000 7f1d1c820640 1 -- 172.21.15.2:0/2771706571 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1cf803b1d0 msgr2=0x7f1cf803d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:07.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.216+0000 7f1d1c820640 1 --2- 172.21.15.2:0/2771706571 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1cf803b1d0 0x7f1cf803d690 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c009740 tx=0x7f1d0c0a6070 comp rx=0 tx=0).stop 2024-09-10T05:36:07.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.216+0000 7f1d1c820640 1 -- 172.21.15.2:0/2771706571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d1812c260 msgr2=0x7f1d181276c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:07.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.216+0000 7f1d1c820640 1 --2- 172.21.15.2:0/2771706571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d1812c260 0x7f1d181276c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1d0800c410 tx=0x7f1d0800c8d0 comp rx=0 tx=0).stop 2024-09-10T05:36:07.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.216+0000 7f1d1c820640 1 -- 172.21.15.2:0/2771706571 shutdown_connections 2024-09-10T05:36:07.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.216+0000 7f1d1c820640 1 --2- 172.21.15.2:0/2771706571 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x7f1cf8040950 0x7f1cf8042dd0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:07.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.216+0000 7f1d1c820640 1 --2- 172.21.15.2:0/2771706571 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1cf803b1d0 0x7f1cf803d690 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:07.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.216+0000 7f1d1c820640 1 --2- 172.21.15.2:0/2771706571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d1812c260 0x7f1d181276c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:07.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.216+0000 7f1d1c820640 1 -- 172.21.15.2:0/2771706571 >> 172.21.15.2:0/2771706571 conn(0x7f1d180704a0 msgr2=0x7f1d1812aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:07.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.216+0000 7f1d1c820640 1 -- 172.21.15.2:0/2771706571 shutdown_connections 2024-09-10T05:36:07.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.216+0000 7f1d1c820640 1 -- 172.21.15.2:0/2771706571 wait complete. 2024-09-10T05:36:07.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.220+0000 7fb2b9e35640 1 -- 172.21.15.2:0/183746067 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb2b412c7a0 con 0x7fb294040950 2024-09-10T05:36:07.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.220+0000 7fb2b0ff9640 1 -- 172.21.15.2:0/183746067 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb2b412c7a0 con 0x7fb294040950 2024-09-10T05:36:07.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.224+0000 7fb2b9e35640 1 -- 172.21.15.2:0/183746067 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x7fb294040950 msgr2=0x7fb294042dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:07.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.224+0000 7fb2b9e35640 1 --2- 172.21.15.2:0/183746067 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x7fb294040950 0x7fb294042dd0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:07.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.224+0000 7fb2b9e35640 1 -- 172.21.15.2:0/183746067 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb29403b1d0 msgr2=0x7fb29403d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:07.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.224+0000 7fb2b9e35640 1 --2- 172.21.15.2:0/183746067 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb29403b1d0 0x7fb29403d690 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb29c001600 tx=0x7fb29c0078f0 comp rx=0 tx=0).stop 2024-09-10T05:36:07.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.224+0000 7fb2b9e35640 1 -- 172.21.15.2:0/183746067 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2b412be80 msgr2=0x7fb2b41170e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:07.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.224+0000 7fb2b9e35640 1 --2- 172.21.15.2:0/183746067 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2b412be80 0x7fb2b41170e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4000c10 tx=0x7fb2a40191d0 comp rx=0 tx=0).stop 2024-09-10T05:36:07.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.224+0000 7fb2b9e35640 1 -- 172.21.15.2:0/183746067 shutdown_connections 2024-09-10T05:36:07.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.224+0000 7fb2b9e35640 1 --2- 172.21.15.2:0/183746067 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x7fb294040950 0x7fb294042dd0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:07.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.224+0000 7fb2b9e35640 1 --2- 172.21.15.2:0/183746067 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb29403b1d0 0x7fb29403d690 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:07.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.224+0000 7fb2b9e35640 1 --2- 172.21.15.2:0/183746067 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2b412be80 0x7fb2b41170e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:07.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.224+0000 7fb2b9e35640 1 -- 172.21.15.2:0/183746067 >> 172.21.15.2:0/183746067 conn(0x7fb2b409b890 msgr2=0x7fb2b409cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:07.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.224+0000 7fb2b9e35640 1 -- 172.21.15.2:0/183746067 shutdown_connections 2024-09-10T05:36:07.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.224+0000 7fb2b9e35640 1 -- 172.21.15.2:0/183746067 wait complete. 2024-09-10T05:36:07.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.232+0000 7f120e54e640 1 -- 172.21.15.2:0/2858676868 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1208070df0 con 0x7f11f4040980 2024-09-10T05:36:07.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.232+0000 7f1204ff9640 1 -- 172.21.15.2:0/2858676868 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1208070df0 con 0x7f11f4040980 2024-09-10T05:36:07.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.232+0000 7f120e54e640 1 -- 172.21.15.2:0/2858676868 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f11f4040980 msgr2=0x7f11f4042e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:07.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.232+0000 7f120e54e640 1 --2- 172.21.15.2:0/2858676868 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f11f4040980 0x7f11f4042e00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:07.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.232+0000 7f120e54e640 1 -- 172.21.15.2:0/2858676868 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f11f403b200 msgr2=0x7f11f403d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:07.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.232+0000 7f120e54e640 1 --2- 172.21.15.2:0/2858676868 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f11f403b200 0x7f11f403d6c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f11fc004f60 tx=0x7f11fc007a90 comp rx=0 tx=0).stop 2024-09-10T05:36:07.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.232+0000 7f120e54e640 1 -- 172.21.15.2:0/2858676868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12080704d0 msgr2=0x7f1208116940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:07.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.232+0000 7f120e54e640 1 --2- 172.21.15.2:0/2858676868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12080704d0 0x7f1208116940 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f11f801aae0 tx=0x7f11f801ac70 comp rx=0 tx=0).stop 2024-09-10T05:36:07.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.232+0000 7f120e54e640 1 -- 172.21.15.2:0/2858676868 shutdown_connections 2024-09-10T05:36:07.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.232+0000 7f120e54e640 1 --2- 172.21.15.2:0/2858676868 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f11f4040980 0x7f11f4042e00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:07.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.232+0000 7f120e54e640 1 --2- 172.21.15.2:0/2858676868 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f11f403b200 0x7f11f403d6c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:07.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.232+0000 7f120e54e640 1 --2- 172.21.15.2:0/2858676868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12080704d0 0x7f1208116940 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:07.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.232+0000 7f120e54e640 1 -- 172.21.15.2:0/2858676868 >> 172.21.15.2:0/2858676868 conn(0x7f120809b890 msgr2=0x7f120812d380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:07.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.232+0000 7f120e54e640 1 -- 172.21.15.2:0/2858676868 shutdown_connections 2024-09-10T05:36:07.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.232+0000 7f120e54e640 1 -- 172.21.15.2:0/2858676868 wait complete. 2024-09-10T05:36:07.237 INFO:teuthology.orchestra.run.smithi002.stdout:42949672965 2024-09-10T05:36:07.238 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-10T05:36:07.239 INFO:teuthology.orchestra.run.smithi002.stdout:42949672966 2024-09-10T05:36:07.239 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-10T05:36:07.248 INFO:teuthology.orchestra.run.smithi002.stdout:47244640260 2024-09-10T05:36:07.249 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-10T05:36:07.253 INFO:teuthology.orchestra.run.smithi002.stdout:42949672965 2024-09-10T05:36:07.253 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-10T05:36:07.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.340+0000 7f20cde64640 1 Processor -- start 2024-09-10T05:36:07.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.340+0000 7f20cde64640 1 -- start start 2024-09-10T05:36:07.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.344+0000 7f20cde64640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f20c809c160 0x7f20c809c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:07.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.344+0000 7f20cde64640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20c809d690 con 0x7f20c806e760 2024-09-10T05:36:07.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.344+0000 7f20cde64640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f20c8073a20 con 0x7f20c809c160 2024-09-10T05:36:07.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.344+0000 7f20c77fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f20c809c160 0x7f20c809c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:07.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.344+0000 7f20c6ffd640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f20c806e760 0x7f20c8128b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44150/0 (socket says 172.21.15.2:44150) 2024-09-10T05:36:07.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.344+0000 7f20c6ffd640 1 -- 172.21.15.2:0/2930483788 learned_addr learned my addr 172.21.15.2:0/2930483788 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T05:36:07.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.344+0000 7f20c77fe640 1 -- 172.21.15.2:0/2930483788 >> v1:172.21.15.2:6789/0 conn(0x7f20c806e760 legacy=0x7f20c8128b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:07.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.344+0000 7f20c77fe640 1 -- 172.21.15.2:0/2930483788 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20c806deb0 con 0x7f20c809c160 2024-09-10T05:36:07.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.344+0000 7f20c77fe640 1 --2- 172.21.15.2:0/2930483788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20c809c160 0x7f20c809c540 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f20b8009740 tx=0x7f20b801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88ee870e24118c0c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:07.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.348+0000 7f20c67fc640 1 -- 172.21.15.2:0/2930483788 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20b80b1070 con 0x7f20c809c160 2024-09-10T05:36:07.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.348+0000 7f20c67fc640 1 -- 172.21.15.2:0/2930483788 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20b80ac520 con 0x7f20c809c160 2024-09-10T05:36:07.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.348+0000 7f20c67fc640 1 -- 172.21.15.2:0/2930483788 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20b80ac820 con 0x7f20c809c160 2024-09-10T05:36:07.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.348+0000 7f20cde64640 1 -- 172.21.15.2:0/2930483788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20c809c160 msgr2=0x7f20c809c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:07.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.348+0000 7f20cde64640 1 --2- 172.21.15.2:0/2930483788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20c809c160 0x7f20c809c540 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f20b8009740 tx=0x7f20b801c370 comp rx=0 tx=0).stop 2024-09-10T05:36:07.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.348+0000 7f20cde64640 1 -- 172.21.15.2:0/2930483788 shutdown_connections 2024-09-10T05:36:07.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.348+0000 7f20cde64640 1 --2- 172.21.15.2:0/2930483788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20c809c160 0x7f20c809c540 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:07.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.348+0000 7f20cde64640 1 -- 172.21.15.2:0/2930483788 >> 172.21.15.2:0/2930483788 conn(0x7f20c8071630 msgr2=0x7f20c809aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:07.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.348+0000 7f20cde64640 1 -- 172.21.15.2:0/2930483788 shutdown_connections 2024-09-10T05:36:07.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.348+0000 7f20cde64640 1 -- 172.21.15.2:0/2930483788 wait complete. 2024-09-10T05:36:07.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.348+0000 7f20cde64640 1 Processor -- start 2024-09-10T05:36:07.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.348+0000 7f20cde64640 1 -- start start 2024-09-10T05:36:07.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.348+0000 7f20cde64640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20c806e760 0x7f20c8127750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:07.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.348+0000 7f20cde64640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f20c8137b80 con 0x7f20c806e760 2024-09-10T05:36:07.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.348+0000 7f20c77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20c806e760 0x7f20c8127750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:07.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.348+0000 7f20c77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20c806e760 0x7f20c8127750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58384/0 (socket says 172.21.15.2:58384) 2024-09-10T05:36:07.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.348+0000 7f20c77fe640 1 -- 172.21.15.2:0/2664140160 learned_addr learned my addr 172.21.15.2:0/2664140160 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:36:07.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.348+0000 7f20c77fe640 1 -- 172.21.15.2:0/2664140160 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20c811a5d0 con 0x7f20c806e760 2024-09-10T05:36:07.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.348+0000 7f20c77fe640 1 --2- 172.21.15.2:0/2664140160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20c806e760 0x7f20c8127750 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f20b80af040 tx=0x7f20b8019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:07.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.352+0000 7f20affff640 1 -- 172.21.15.2:0/2664140160 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20b80b9070 con 0x7f20c806e760 2024-09-10T05:36:07.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.352+0000 7f20affff640 1 -- 172.21.15.2:0/2664140160 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20b80b5410 con 0x7f20c806e760 2024-09-10T05:36:07.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.352+0000 7f20cde64640 1 -- 172.21.15.2:0/2664140160 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20c8134ac0 con 0x7f20c806e760 2024-09-10T05:36:07.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.352+0000 7f20affff640 1 -- 172.21.15.2:0/2664140160 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20b80b1040 con 0x7f20c806e760 2024-09-10T05:36:07.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.352+0000 7f20cde64640 1 -- 172.21.15.2:0/2664140160 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20c811ad40 con 0x7f20c806e760 2024-09-10T05:36:07.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.352+0000 7f20affff640 1 -- 172.21.15.2:0/2664140160 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f20b80bc070 con 0x7f20c806e760 2024-09-10T05:36:07.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.352+0000 7f20affff640 1 --2- 172.21.15.2:0/2664140160 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f20b403b200 0x7f20b403d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:07.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.352+0000 7f20affff640 1 -- 172.21.15.2:0/2664140160 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f20b80e8b10 con 0x7f20c806e760 2024-09-10T05:36:07.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.352+0000 7f20cde64640 1 -- 172.21.15.2:0/2664140160 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20c811b280 con 0x7f20c806e760 2024-09-10T05:36:07.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.352+0000 7f20c6ffd640 1 --2- 172.21.15.2:0/2664140160 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f20b403b200 0x7f20b403d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:07.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.352+0000 7f20c6ffd640 1 --2- 172.21.15.2:0/2664140160 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f20b403b200 0x7f20b403d6c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f20bc005890 tx=0x7f20bc007ab0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:07.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.356+0000 7fc0f8d1a640 1 Processor -- start 2024-09-10T05:36:07.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.356+0000 7fc0f8d1a640 1 -- start start 2024-09-10T05:36:07.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.356+0000 7fc0f8d1a640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc0f41259f0 0x7fc0f4125dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:07.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.356+0000 7fc0f8d1a640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0f4111f60 con 0x7fc0f406dce0 2024-09-10T05:36:07.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.356+0000 7fc0f8d1a640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fc0f4073bd0 con 0x7fc0f41259f0 2024-09-10T05:36:07.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.356+0000 7fc0f259c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc0f41259f0 0x7fc0f4125dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:07.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.356+0000 7fc0f259c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc0f41259f0 0x7fc0f4125dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58398/0 (socket says 172.21.15.2:58398) 2024-09-10T05:36:07.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.356+0000 7fc0f259c640 1 -- 172.21.15.2:0/3283405616 learned_addr learned my addr 172.21.15.2:0/3283405616 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:36:07.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.356+0000 7fc0f1d9b640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc0f406dce0 0x7fc0f406e130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44154/0 (socket says 172.21.15.2:44154) 2024-09-10T05:36:07.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.356+0000 7fc0f259c640 1 -- 172.21.15.2:0/3283405616 >> v1:172.21.15.2:6789/0 conn(0x7fc0f406dce0 legacy=0x7fc0f406e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:07.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.356+0000 7fc0f259c640 1 -- 172.21.15.2:0/3283405616 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0f4126310 con 0x7fc0f41259f0 2024-09-10T05:36:07.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.356+0000 7f20affff640 1 -- 172.21.15.2:0/2664140160 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f20c811a5d0 con 0x7f20c806e760 2024-09-10T05:36:07.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.360+0000 7fc0f259c640 1 --2- 172.21.15.2:0/3283405616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0f41259f0 0x7fc0f4125dd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc0e40097f0 tx=0x7fc0e401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9cfd59a70648989 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:07.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.360+0000 7fc0f159a640 1 -- 172.21.15.2:0/3283405616 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0e40b1070 con 0x7fc0f41259f0 2024-09-10T05:36:07.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.360+0000 7fc0f159a640 1 -- 172.21.15.2:0/3283405616 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0e40ac560 con 0x7fc0f41259f0 2024-09-10T05:36:07.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.360+0000 7fc0f159a640 1 -- 172.21.15.2:0/3283405616 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0e40a8050 con 0x7fc0f41259f0 2024-09-10T05:36:07.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.360+0000 7fc0f8d1a640 1 -- 172.21.15.2:0/3283405616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0f41259f0 msgr2=0x7fc0f4125dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:07.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.360+0000 7fc0f8d1a640 1 --2- 172.21.15.2:0/3283405616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0f41259f0 0x7fc0f4125dd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc0e40097f0 tx=0x7fc0e401c4c0 comp rx=0 tx=0).stop 2024-09-10T05:36:07.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.360+0000 7fc0f8d1a640 1 -- 172.21.15.2:0/3283405616 shutdown_connections 2024-09-10T05:36:07.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.360+0000 7fc0f8d1a640 1 --2- 172.21.15.2:0/3283405616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0f41259f0 0x7fc0f4125dd0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:07.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.360+0000 7fc0f8d1a640 1 -- 172.21.15.2:0/3283405616 >> 172.21.15.2:0/3283405616 conn(0x7fc0f40709b0 msgr2=0x7fc0f4072da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:07.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.364+0000 7fc0f8d1a640 1 -- 172.21.15.2:0/3283405616 shutdown_connections 2024-09-10T05:36:07.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.364+0000 7fc0f8d1a640 1 -- 172.21.15.2:0/3283405616 wait complete. 2024-09-10T05:36:07.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.364+0000 7fc0f8d1a640 1 Processor -- start 2024-09-10T05:36:07.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.364+0000 7fc0f8d1a640 1 -- start start 2024-09-10T05:36:07.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.364+0000 7fc0f8d1a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0f406dce0 0x7fc0f4133d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:07.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.364+0000 7fc0f8d1a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc0f4137d80 con 0x7fc0f406dce0 2024-09-10T05:36:07.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.364+0000 7fc0f259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0f406dce0 0x7fc0f4133d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:07.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.364+0000 7fc0f259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0f406dce0 0x7fc0f4133d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58400/0 (socket says 172.21.15.2:58400) 2024-09-10T05:36:07.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.364+0000 7fc0f259c640 1 -- 172.21.15.2:0/1709798639 learned_addr learned my addr 172.21.15.2:0/1709798639 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:36:07.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.364+0000 7fc0f259c640 1 -- 172.21.15.2:0/1709798639 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0f4129920 con 0x7fc0f406dce0 2024-09-10T05:36:07.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.364+0000 7fc0f259c640 1 --2- 172.21.15.2:0/1709798639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0f406dce0 0x7fc0f4133d00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc0e401a0f0 tx=0x7fc0e4019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:07.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.364+0000 7fc0e2ffd640 1 -- 172.21.15.2:0/1709798639 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0e40bc070 con 0x7fc0f406dce0 2024-09-10T05:36:07.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.364+0000 7fc0e2ffd640 1 -- 172.21.15.2:0/1709798639 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0e40b7430 con 0x7fc0f406dce0 2024-09-10T05:36:07.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.364+0000 7fc0e2ffd640 1 -- 172.21.15.2:0/1709798639 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0e40b1040 con 0x7fc0f406dce0 2024-09-10T05:36:07.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.364+0000 7fc0f8d1a640 1 -- 172.21.15.2:0/1709798639 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0f4131ab0 con 0x7fc0f406dce0 2024-09-10T05:36:07.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.364+0000 7fc0f8d1a640 1 -- 172.21.15.2:0/1709798639 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0f4134240 con 0x7fc0f406dce0 2024-09-10T05:36:07.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.364+0000 7fc0f8d1a640 1 -- 172.21.15.2:0/1709798639 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0f4132b40 con 0x7fc0f406dce0 2024-09-10T05:36:07.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.364+0000 7fc0e2ffd640 1 -- 172.21.15.2:0/1709798639 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc0e40bf070 con 0x7fc0f406dce0 2024-09-10T05:36:07.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.364+0000 7fc0e2ffd640 1 --2- 172.21.15.2:0/1709798639 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc0d403b1d0 0x7fc0d403d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:07.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.364+0000 7fc0e2ffd640 1 -- 172.21.15.2:0/1709798639 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fc0e40e8710 con 0x7fc0f406dce0 2024-09-10T05:36:07.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.368+0000 7fc0f1d9b640 1 --2- 172.21.15.2:0/1709798639 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc0d403b1d0 0x7fc0d403d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:07.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.368+0000 7fc0f1d9b640 1 --2- 172.21.15.2:0/1709798639 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc0d403b1d0 0x7fc0d403d690 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8001640 tx=0x7fc0e8007a30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:07.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.376+0000 7fc0e2ffd640 1 -- 172.21.15.2:0/1709798639 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fc0e40160b0 con 0x7fc0f406dce0 2024-09-10T05:36:07.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.412+0000 7f4aa8290640 1 Processor -- start 2024-09-10T05:36:07.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.412+0000 7f4aa8290640 1 -- start start 2024-09-10T05:36:07.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.412+0000 7f4aa8290640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4aa0126ad0 0x7f4aa0126eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:07.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.412+0000 7f4aa8290640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4aa009e5c0 con 0x7f4aa01273f0 2024-09-10T05:36:07.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.412+0000 7f4aa8290640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f4aa0073c10 con 0x7f4aa0126ad0 2024-09-10T05:36:07.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.412+0000 7f4aa602c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4aa0126ad0 0x7f4aa0126eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:07.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.412+0000 7f4aa582b640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f4aa01273f0 0x7f4aa009ca50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44166/0 (socket says 172.21.15.2:44166) 2024-09-10T05:36:07.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.412+0000 7f4aa582b640 1 -- 172.21.15.2:0/4029967991 learned_addr learned my addr 172.21.15.2:0/4029967991 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T05:36:07.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.412+0000 7f4aa602c640 1 -- 172.21.15.2:0/4029967991 >> v1:172.21.15.2:6789/0 conn(0x7f4aa01273f0 legacy=0x7f4aa009ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:07.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.412+0000 7f4aa602c640 1 -- 172.21.15.2:0/4029967991 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aa009f7e0 con 0x7f4aa0126ad0 2024-09-10T05:36:07.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.416+0000 7ff16be31640 1 Processor -- start 2024-09-10T05:36:07.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.416+0000 7ff16be31640 1 -- start start 2024-09-10T05:36:07.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.416+0000 7ff16be31640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff16406feb0 0x7ff164134660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:07.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.416+0000 7ff16be31640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff164073460 con 0x7ff16406f3c0 2024-09-10T05:36:07.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.416+0000 7ff16be31640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7ff16406d520 con 0x7ff16406feb0 2024-09-10T05:36:07.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.416+0000 7ff169bcd640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff16406f3c0 0x7ff16406f7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44172/0 (socket says 172.21.15.2:44172) 2024-09-10T05:36:07.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.416+0000 7ff169bcd640 1 -- 172.21.15.2:0/1011502374 learned_addr learned my addr 172.21.15.2:0/1011502374 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T05:36:07.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.416+0000 7ff1693cc640 1 --2- 172.21.15.2:0/1011502374 >> v2:172.21.15.2:3300/0 conn(0x7ff16406feb0 0x7ff164134660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:07.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.416+0000 7f4aa602c640 1 --2- 172.21.15.2:0/4029967991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4aa0126ad0 0x7f4aa0126eb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c009740 tx=0x7f4a9c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=376d49a5f247f823 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:07.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.416+0000 7ff168bcb640 1 -- 172.21.15.2:0/1011502374 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2179583559 0 0) 0x7ff164073460 con 0x7ff16406f3c0 2024-09-10T05:36:07.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.416+0000 7ff168bcb640 1 -- 172.21.15.2:0/1011502374 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff150003530 con 0x7ff16406f3c0 2024-09-10T05:36:07.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.416+0000 7ff1693cc640 1 -- 172.21.15.2:0/1011502374 >> v1:172.21.15.2:6789/0 conn(0x7ff16406f3c0 legacy=0x7ff16406f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:07.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.416+0000 7ff1693cc640 1 -- 172.21.15.2:0/1011502374 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff164070af0 con 0x7ff16406feb0 2024-09-10T05:36:07.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.416+0000 7f4aa502a640 1 -- 172.21.15.2:0/4029967991 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a9c0b0070 con 0x7f4aa0126ad0 2024-09-10T05:36:07.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.416+0000 7f4aa502a640 1 -- 172.21.15.2:0/4029967991 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a9c0ab530 con 0x7f4aa0126ad0 2024-09-10T05:36:07.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.416+0000 7f4aa502a640 1 -- 172.21.15.2:0/4029967991 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a9c0b0070 con 0x7f4aa0126ad0 2024-09-10T05:36:07.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.416+0000 7f4aa8290640 1 -- 172.21.15.2:0/4029967991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4aa0126ad0 msgr2=0x7f4aa0126eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:07.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.416+0000 7f4aa8290640 1 --2- 172.21.15.2:0/4029967991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4aa0126ad0 0x7f4aa0126eb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c009740 tx=0x7f4a9c01c370 comp rx=0 tx=0).stop 2024-09-10T05:36:07.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.416+0000 7f4aa8290640 1 -- 172.21.15.2:0/4029967991 shutdown_connections 2024-09-10T05:36:07.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.416+0000 7f4aa8290640 1 --2- 172.21.15.2:0/4029967991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4aa0126ad0 0x7f4aa0126eb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:07.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.416+0000 7f4aa8290640 1 -- 172.21.15.2:0/4029967991 >> 172.21.15.2:0/4029967991 conn(0x7f4aa0071e50 msgr2=0x7f4aa0072230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:07.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.416+0000 7f4aa8290640 1 -- 172.21.15.2:0/4029967991 shutdown_connections 2024-09-10T05:36:07.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.416+0000 7f4aa8290640 1 -- 172.21.15.2:0/4029967991 wait complete. 2024-09-10T05:36:07.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.416+0000 7f4aa8290640 1 Processor -- start 2024-09-10T05:36:07.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.416+0000 7f4aa8290640 1 -- start start 2024-09-10T05:36:07.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.416+0000 7f4aa8290640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4aa0126ad0 0x7f4aa0125740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:07.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.416+0000 7f4aa8290640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4aa0135e30 con 0x7f4aa0126ad0 2024-09-10T05:36:07.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.420+0000 7f4aa602c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4aa0126ad0 0x7f4aa0125740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:07.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.420+0000 7f4aa602c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4aa0126ad0 0x7f4aa0125740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58414/0 (socket says 172.21.15.2:58414) 2024-09-10T05:36:07.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.420+0000 7f4aa602c640 1 -- 172.21.15.2:0/446594777 learned_addr learned my addr 172.21.15.2:0/446594777 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:36:07.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.420+0000 7f4aa602c640 1 -- 172.21.15.2:0/446594777 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aa0070030 con 0x7f4aa0126ad0 2024-09-10T05:36:07.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.420+0000 7f4aa602c640 1 --2- 172.21.15.2:0/446594777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4aa0126ad0 0x7f4aa0125740 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c019fa0 tx=0x7f4a9c01abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:07.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.420+0000 7ff1693cc640 1 --2- 172.21.15.2:0/1011502374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff16406feb0 0x7ff164134660 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff154009740 tx=0x7ff15401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b93af173b49af2b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:07.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.420+0000 7ff168bcb640 1 -- 172.21.15.2:0/1011502374 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1540b0070 con 0x7ff16406feb0 2024-09-10T05:36:07.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.420+0000 7ff168bcb640 1 -- 172.21.15.2:0/1011502374 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1540ab530 con 0x7ff16406feb0 2024-09-10T05:36:07.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.420+0000 7ff168bcb640 1 -- 172.21.15.2:0/1011502374 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1540ab830 con 0x7ff16406feb0 2024-09-10T05:36:07.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.420+0000 7f4a96ffd640 1 -- 172.21.15.2:0/446594777 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a9c0bb020 con 0x7f4aa0126ad0 2024-09-10T05:36:07.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.420+0000 7f4a96ffd640 1 -- 172.21.15.2:0/446594777 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a9c0aa9a0 con 0x7f4aa0126ad0 2024-09-10T05:36:07.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.420+0000 7f4aa8290640 1 -- 172.21.15.2:0/446594777 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4aa0132480 con 0x7f4aa0126ad0 2024-09-10T05:36:07.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.420+0000 7f4a96ffd640 1 -- 172.21.15.2:0/446594777 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a9c0b0070 con 0x7f4aa0126ad0 2024-09-10T05:36:07.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.420+0000 7f4aa8290640 1 -- 172.21.15.2:0/446594777 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4aa011ae40 con 0x7f4aa0126ad0 2024-09-10T05:36:07.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.420+0000 7ff16be31640 1 -- 172.21.15.2:0/1011502374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff16406feb0 msgr2=0x7ff164134660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:07.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.420+0000 7ff16be31640 1 --2- 172.21.15.2:0/1011502374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff16406feb0 0x7ff164134660 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff154009740 tx=0x7ff15401c370 comp rx=0 tx=0).stop 2024-09-10T05:36:07.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.420+0000 7ff16be31640 1 -- 172.21.15.2:0/1011502374 shutdown_connections 2024-09-10T05:36:07.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.420+0000 7ff16be31640 1 --2- 172.21.15.2:0/1011502374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff16406feb0 0x7ff164134660 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:07.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.420+0000 7ff16be31640 1 -- 172.21.15.2:0/1011502374 >> 172.21.15.2:0/1011502374 conn(0x7ff16409b890 msgr2=0x7ff16406dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:07.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.420+0000 7f4aa8290640 1 -- 172.21.15.2:0/446594777 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4aa0126eb0 con 0x7f4aa0126ad0 2024-09-10T05:36:07.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.420+0000 7ff16be31640 1 -- 172.21.15.2:0/1011502374 shutdown_connections 2024-09-10T05:36:07.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.420+0000 7ff16be31640 1 -- 172.21.15.2:0/1011502374 wait complete. 2024-09-10T05:36:07.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.420+0000 7f4a96ffd640 1 -- 172.21.15.2:0/446594777 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f4a9c0be020 con 0x7f4aa0126ad0 2024-09-10T05:36:07.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.420+0000 7f4a96ffd640 1 --2- 172.21.15.2:0/446594777 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4a8403b200 0x7f4a8403d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:07.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.420+0000 7f4a96ffd640 1 -- 172.21.15.2:0/446594777 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f4a9c0e9860 con 0x7f4aa0126ad0 2024-09-10T05:36:07.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.420+0000 7f4aa582b640 1 --2- 172.21.15.2:0/446594777 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4a8403b200 0x7f4a8403d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:07.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.420+0000 7ff16be31640 1 Processor -- start 2024-09-10T05:36:07.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.420+0000 7ff16be31640 1 -- start start 2024-09-10T05:36:07.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.420+0000 7ff16be31640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff16406f3c0 0x7ff16412e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:07.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.420+0000 7ff16be31640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff164137750 con 0x7ff16406f3c0 2024-09-10T05:36:07.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.420+0000 7f4aa582b640 1 --2- 172.21.15.2:0/446594777 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4a8403b200 0x7f4a8403d6c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4a90000f70 tx=0x7f4a90007af0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:07.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.424+0000 7ff169bcd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff16406f3c0 0x7ff16412e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:07.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.424+0000 7ff169bcd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff16406f3c0 0x7ff16412e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58428/0 (socket says 172.21.15.2:58428) 2024-09-10T05:36:07.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.424+0000 7ff169bcd640 1 -- 172.21.15.2:0/1350416079 learned_addr learned my addr 172.21.15.2:0/1350416079 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:36:07.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.424+0000 7ff169bcd640 1 -- 172.21.15.2:0/1350416079 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1641204d0 con 0x7ff16406f3c0 2024-09-10T05:36:07.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.424+0000 7ff169bcd640 1 --2- 172.21.15.2:0/1350416079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff16406f3c0 0x7ff16412e7e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff16000c450 tx=0x7ff16000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:07.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.428+0000 7f4a96ffd640 1 -- 172.21.15.2:0/446594777 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f4a9c0c5030 con 0x7f4aa0126ad0 2024-09-10T05:36:07.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.428+0000 7ff15a7fc640 1 -- 172.21.15.2:0/1350416079 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff160017070 con 0x7ff16406f3c0 2024-09-10T05:36:07.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.428+0000 7ff16be31640 1 -- 172.21.15.2:0/1350416079 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff164121600 con 0x7ff16406f3c0 2024-09-10T05:36:07.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.428+0000 7ff15a7fc640 1 -- 172.21.15.2:0/1350416079 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff160005ce0 con 0x7ff16406f3c0 2024-09-10T05:36:07.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.428+0000 7ff16be31640 1 -- 172.21.15.2:0/1350416079 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff16412eef0 con 0x7ff16406f3c0 2024-09-10T05:36:07.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.432+0000 7ff15a7fc640 1 -- 172.21.15.2:0/1350416079 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff160007200 con 0x7ff16406f3c0 2024-09-10T05:36:07.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.432+0000 7ff16be31640 1 -- 172.21.15.2:0/1350416079 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff16409f640 con 0x7ff16406f3c0 2024-09-10T05:36:07.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.432+0000 7ff15a7fc640 1 -- 172.21.15.2:0/1350416079 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff1600073a0 con 0x7ff16406f3c0 2024-09-10T05:36:07.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.432+0000 7ff15a7fc640 1 --2- 172.21.15.2:0/1350416079 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff14803b180 0x7ff14803d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:07.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.432+0000 7ff15a7fc640 1 -- 172.21.15.2:0/1350416079 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7ff160051440 con 0x7ff16406f3c0 2024-09-10T05:36:07.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.432+0000 7ff1693cc640 1 --2- 172.21.15.2:0/1350416079 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff14803b180 0x7ff14803d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:07.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.432+0000 7ff1693cc640 1 --2- 172.21.15.2:0/1350416079 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff14803b180 0x7ff14803d640 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff1540ad000 tx=0x7ff1540a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:07.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.436+0000 7ff15a7fc640 1 -- 172.21.15.2:0/1350416079 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7ff16004cf60 con 0x7ff16406f3c0 2024-09-10T05:36:07.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.540+0000 7f20cde64640 1 -- 172.21.15.2:0/2664140160 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f20c8068e50 con 0x7f20c806e760 2024-09-10T05:36:07.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.540+0000 7f20affff640 1 -- 172.21.15.2:0/2664140160 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f20b80a9070 con 0x7f20c806e760 2024-09-10T05:36:07.542 INFO:teuthology.orchestra.run.smithi002.stdout:42949672964 2024-09-10T05:36:07.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.540+0000 7f20cde64640 1 -- 172.21.15.2:0/2664140160 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f20b403b200 msgr2=0x7f20b403d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:07.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.540+0000 7f20cde64640 1 --2- 172.21.15.2:0/2664140160 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f20b403b200 0x7f20b403d6c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f20bc005890 tx=0x7f20bc007ab0 comp rx=0 tx=0).stop 2024-09-10T05:36:07.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.540+0000 7f20cde64640 1 -- 172.21.15.2:0/2664140160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20c806e760 msgr2=0x7f20c8127750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:07.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.540+0000 7f20cde64640 1 --2- 172.21.15.2:0/2664140160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20c806e760 0x7f20c8127750 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f20b80af040 tx=0x7f20b8019110 comp rx=0 tx=0).stop 2024-09-10T05:36:07.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.540+0000 7f20cde64640 1 -- 172.21.15.2:0/2664140160 shutdown_connections 2024-09-10T05:36:07.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.540+0000 7f20cde64640 1 --2- 172.21.15.2:0/2664140160 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f20b403b200 0x7f20b403d6c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:07.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.540+0000 7f20cde64640 1 --2- 172.21.15.2:0/2664140160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20c806e760 0x7f20c8127750 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:07.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.540+0000 7f20cde64640 1 -- 172.21.15.2:0/2664140160 >> 172.21.15.2:0/2664140160 conn(0x7f20c8071630 msgr2=0x7f20c809d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:07.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.540+0000 7f20cde64640 1 -- 172.21.15.2:0/2664140160 shutdown_connections 2024-09-10T05:36:07.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.540+0000 7f20cde64640 1 -- 172.21.15.2:0/2664140160 wait complete. 2024-09-10T05:36:07.559 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672964 for osd.0 2024-09-10T05:36:07.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.556+0000 7fc0f8d1a640 1 -- 172.21.15.2:0/1709798639 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fc0f4068e50 con 0x7fc0f406dce0 2024-09-10T05:36:07.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.556+0000 7fc0e2ffd640 1 -- 172.21.15.2:0/1709798639 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc0e40abbd0 con 0x7fc0f406dce0 2024-09-10T05:36:07.561 INFO:teuthology.orchestra.run.smithi002.stdout:42949672965 2024-09-10T05:36:07.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.560+0000 7fc0f8d1a640 1 -- 172.21.15.2:0/1709798639 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc0d403b1d0 msgr2=0x7fc0d403d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:07.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.560+0000 7fc0f8d1a640 1 --2- 172.21.15.2:0/1709798639 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc0d403b1d0 0x7fc0d403d690 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8001640 tx=0x7fc0e8007a30 comp rx=0 tx=0).stop 2024-09-10T05:36:07.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.560+0000 7fc0f8d1a640 1 -- 172.21.15.2:0/1709798639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0f406dce0 msgr2=0x7fc0f4133d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:07.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.560+0000 7fc0f8d1a640 1 --2- 172.21.15.2:0/1709798639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0f406dce0 0x7fc0f4133d00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc0e401a0f0 tx=0x7fc0e4019260 comp rx=0 tx=0).stop 2024-09-10T05:36:07.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.560+0000 7fc0f8d1a640 1 -- 172.21.15.2:0/1709798639 shutdown_connections 2024-09-10T05:36:07.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.560+0000 7fc0f8d1a640 1 --2- 172.21.15.2:0/1709798639 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc0d403b1d0 0x7fc0d403d690 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:07.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.560+0000 7fc0f8d1a640 1 --2- 172.21.15.2:0/1709798639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0f406dce0 0x7fc0f4133d00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:07.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.560+0000 7fc0f8d1a640 1 -- 172.21.15.2:0/1709798639 >> 172.21.15.2:0/1709798639 conn(0x7fc0f40709b0 msgr2=0x7fc0f412bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:07.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.560+0000 7fc0f8d1a640 1 -- 172.21.15.2:0/1709798639 shutdown_connections 2024-09-10T05:36:07.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.560+0000 7fc0f8d1a640 1 -- 172.21.15.2:0/1709798639 wait complete. 2024-09-10T05:36:07.578 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672965 for osd.1 2024-09-10T05:36:07.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.600+0000 7f4aa8290640 1 -- 172.21.15.2:0/446594777 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f4aa0132bb0 con 0x7f4aa0126ad0 2024-09-10T05:36:07.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.600+0000 7f4a96ffd640 1 -- 172.21.15.2:0/446594777 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4a9c015ff0 con 0x7f4aa0126ad0 2024-09-10T05:36:07.604 INFO:teuthology.orchestra.run.smithi002.stdout:42949672964 2024-09-10T05:36:07.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.604+0000 7f4aa8290640 1 -- 172.21.15.2:0/446594777 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4a8403b200 msgr2=0x7f4a8403d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:07.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.604+0000 7f4aa8290640 1 --2- 172.21.15.2:0/446594777 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4a8403b200 0x7f4a8403d6c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4a90000f70 tx=0x7f4a90007af0 comp rx=0 tx=0).stop 2024-09-10T05:36:07.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.604+0000 7f4aa8290640 1 -- 172.21.15.2:0/446594777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4aa0126ad0 msgr2=0x7f4aa0125740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:07.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.604+0000 7f4aa8290640 1 --2- 172.21.15.2:0/446594777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4aa0126ad0 0x7f4aa0125740 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c019fa0 tx=0x7f4a9c01abb0 comp rx=0 tx=0).stop 2024-09-10T05:36:07.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.604+0000 7f4aa8290640 1 -- 172.21.15.2:0/446594777 shutdown_connections 2024-09-10T05:36:07.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.604+0000 7f4aa8290640 1 --2- 172.21.15.2:0/446594777 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4a8403b200 0x7f4a8403d6c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:07.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.604+0000 7f4aa8290640 1 --2- 172.21.15.2:0/446594777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4aa0126ad0 0x7f4aa0125740 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:07.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.604+0000 7f4aa8290640 1 -- 172.21.15.2:0/446594777 >> 172.21.15.2:0/446594777 conn(0x7f4aa0071e50 msgr2=0x7f4aa012ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:07.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.604+0000 7f4aa8290640 1 -- 172.21.15.2:0/446594777 shutdown_connections 2024-09-10T05:36:07.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.604+0000 7f4aa8290640 1 -- 172.21.15.2:0/446594777 wait complete. 2024-09-10T05:36:07.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.608+0000 7ff16be31640 1 -- 172.21.15.2:0/1350416079 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7ff1641220e0 con 0x7ff16406f3c0 2024-09-10T05:36:07.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.608+0000 7ff15a7fc640 1 -- 172.21.15.2:0/1350416079 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff160007690 con 0x7ff16406f3c0 2024-09-10T05:36:07.611 INFO:teuthology.orchestra.run.smithi002.stdout:47244640259 2024-09-10T05:36:07.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.612+0000 7ff16be31640 1 -- 172.21.15.2:0/1350416079 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff14803b180 msgr2=0x7ff14803d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:07.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.612+0000 7ff16be31640 1 --2- 172.21.15.2:0/1350416079 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff14803b180 0x7ff14803d640 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff1540ad000 tx=0x7ff1540a6000 comp rx=0 tx=0).stop 2024-09-10T05:36:07.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.612+0000 7ff16be31640 1 -- 172.21.15.2:0/1350416079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff16406f3c0 msgr2=0x7ff16412e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:07.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.612+0000 7ff16be31640 1 --2- 172.21.15.2:0/1350416079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff16406f3c0 0x7ff16412e7e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff16000c450 tx=0x7ff16000c910 comp rx=0 tx=0).stop 2024-09-10T05:36:07.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.612+0000 7ff16be31640 1 -- 172.21.15.2:0/1350416079 shutdown_connections 2024-09-10T05:36:07.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.612+0000 7ff16be31640 1 --2- 172.21.15.2:0/1350416079 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff14803b180 0x7ff14803d640 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:07.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.612+0000 7ff16be31640 1 --2- 172.21.15.2:0/1350416079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff16406f3c0 0x7ff16412e7e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:07.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.612+0000 7ff16be31640 1 -- 172.21.15.2:0/1350416079 >> 172.21.15.2:0/1350416079 conn(0x7ff16409b890 msgr2=0x7ff16409cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:07.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.612+0000 7ff16be31640 1 -- 172.21.15.2:0/1350416079 shutdown_connections 2024-09-10T05:36:07.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:07.612+0000 7ff16be31640 1 -- 172.21.15.2:0/1350416079 wait complete. 2024-09-10T05:36:07.622 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672964 for osd.2 2024-09-10T05:36:07.629 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640259 for osd.3 2024-09-10T05:36:08.560 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-10T05:36:08.579 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-10T05:36:08.623 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-10T05:36:08.631 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-10T05:36:08.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.688+0000 7ffb703da640 1 Processor -- start 2024-09-10T05:36:08.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.688+0000 7ffb703da640 1 -- start start 2024-09-10T05:36:08.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.688+0000 7ffb703da640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ffb6809ee60 0x7ffb681325c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:08.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.688+0000 7ffb703da640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb6806df40 con 0x7ffb6809e370 2024-09-10T05:36:08.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.688+0000 7ffb703da640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7ffb6809f8a0 con 0x7ffb6809ee60 2024-09-10T05:36:08.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.688+0000 7ffb6d975640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ffb6809ee60 0x7ffb681325c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:08.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.688+0000 7ffb6e176640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ffb6809e370 0x7ffb6809e750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44186/0 (socket says 172.21.15.2:44186) 2024-09-10T05:36:08.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.688+0000 7ffb6e176640 1 -- 172.21.15.2:0/2230140281 learned_addr learned my addr 172.21.15.2:0/2230140281 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T05:36:08.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.688+0000 7ffb6d975640 1 -- 172.21.15.2:0/2230140281 >> v1:172.21.15.2:6789/0 conn(0x7ffb6809e370 legacy=0x7ffb6809e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:08.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.688+0000 7ffb6d975640 1 -- 172.21.15.2:0/2230140281 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb6809fcc0 con 0x7ffb6809ee60 2024-09-10T05:36:08.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.692+0000 7ffb6d975640 1 --2- 172.21.15.2:0/2230140281 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb6809ee60 0x7ffb681325c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ffb58009740 tx=0x7ffb5801c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89c612262e8d09d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:08.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.692+0000 7ffb6d174640 1 -- 172.21.15.2:0/2230140281 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb580b1070 con 0x7ffb6809ee60 2024-09-10T05:36:08.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.692+0000 7ffb6d174640 1 -- 172.21.15.2:0/2230140281 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb580ac520 con 0x7ffb6809ee60 2024-09-10T05:36:08.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.692+0000 7ffb6d174640 1 -- 172.21.15.2:0/2230140281 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb580ac820 con 0x7ffb6809ee60 2024-09-10T05:36:08.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.692+0000 7ffb703da640 1 -- 172.21.15.2:0/2230140281 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb6809ee60 msgr2=0x7ffb681325c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:08.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.692+0000 7ffb703da640 1 --2- 172.21.15.2:0/2230140281 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb6809ee60 0x7ffb681325c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ffb58009740 tx=0x7ffb5801c390 comp rx=0 tx=0).stop 2024-09-10T05:36:08.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.692+0000 7ffb703da640 1 -- 172.21.15.2:0/2230140281 shutdown_connections 2024-09-10T05:36:08.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.692+0000 7ffb703da640 1 --2- 172.21.15.2:0/2230140281 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb6809ee60 0x7ffb681325c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:08.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.692+0000 7ffb703da640 1 -- 172.21.15.2:0/2230140281 >> 172.21.15.2:0/2230140281 conn(0x7ffb68071630 msgr2=0x7ffb6809aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:08.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.692+0000 7ffb703da640 1 -- 172.21.15.2:0/2230140281 shutdown_connections 2024-09-10T05:36:08.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.692+0000 7ffb703da640 1 -- 172.21.15.2:0/2230140281 wait complete. 2024-09-10T05:36:08.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.692+0000 7ffb703da640 1 Processor -- start 2024-09-10T05:36:08.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.692+0000 7ffb703da640 1 -- start start 2024-09-10T05:36:08.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.692+0000 7ffb703da640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb6809e370 0x7ffb68126320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:08.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.692+0000 7ffb703da640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ffb681356b0 con 0x7ffb6809e370 2024-09-10T05:36:08.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.692+0000 7ffb6e176640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb6809e370 0x7ffb68126320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:08.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.692+0000 7ffb6e176640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb6809e370 0x7ffb68126320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58446/0 (socket says 172.21.15.2:58446) 2024-09-10T05:36:08.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.692+0000 7ffb6e176640 1 -- 172.21.15.2:0/544319233 learned_addr learned my addr 172.21.15.2:0/544319233 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:36:08.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.696+0000 7ffb6e176640 1 -- 172.21.15.2:0/544319233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb68117e10 con 0x7ffb6809e370 2024-09-10T05:36:08.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.696+0000 7ffb6e176640 1 --2- 172.21.15.2:0/544319233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb6809e370 0x7ffb68126320 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ffb6400c450 tx=0x7ffb6400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:08.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.696+0000 7ffb5effd640 1 -- 172.21.15.2:0/544319233 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb64017070 con 0x7ffb6809e370 2024-09-10T05:36:08.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.696+0000 7ffb5effd640 1 -- 172.21.15.2:0/544319233 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb64005c20 con 0x7ffb6809e370 2024-09-10T05:36:08.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.696+0000 7ffb703da640 1 -- 172.21.15.2:0/544319233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb68118ac0 con 0x7ffb6809e370 2024-09-10T05:36:08.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.696+0000 7ffb5effd640 1 -- 172.21.15.2:0/544319233 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb640070d0 con 0x7ffb6809e370 2024-09-10T05:36:08.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.696+0000 7ffb703da640 1 -- 172.21.15.2:0/544319233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb68126860 con 0x7ffb6809e370 2024-09-10T05:36:08.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.696+0000 7ffb703da640 1 -- 172.21.15.2:0/544319233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb6809e750 con 0x7ffb6809e370 2024-09-10T05:36:08.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.696+0000 7ffb5effd640 1 -- 172.21.15.2:0/544319233 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ffb6401a070 con 0x7ffb6809e370 2024-09-10T05:36:08.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.696+0000 7ffb5effd640 1 --2- 172.21.15.2:0/544319233 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ffb4c03b1d0 0x7ffb4c03d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:08.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.696+0000 7ffb5effd640 1 -- 172.21.15.2:0/544319233 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7ffb6404dfd0 con 0x7ffb6809e370 2024-09-10T05:36:08.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.696+0000 7ffb6d975640 1 --2- 172.21.15.2:0/544319233 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ffb4c03b1d0 0x7ffb4c03d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:08.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.696+0000 7ffb6d975640 1 --2- 172.21.15.2:0/544319233 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ffb4c03b1d0 0x7ffb4c03d690 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ffb580ae000 tx=0x7ffb580a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:08.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.704+0000 7ffb5effd640 1 -- 172.21.15.2:0/544319233 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7ffb64019cd0 con 0x7ffb6809e370 2024-09-10T05:36:08.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.728+0000 7f5c8af36640 1 Processor -- start 2024-09-10T05:36:08.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.728+0000 7f5c8af36640 1 -- start start 2024-09-10T05:36:08.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.728+0000 7f5c8af36640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5c8406d520 0x7f5c84132530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:08.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.728+0000 7f5c8af36640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c84114cb0 con 0x7f5c8406f5f0 2024-09-10T05:36:08.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.728+0000 7f5c8af36640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f5c84072db0 con 0x7f5c8406d520 2024-09-10T05:36:08.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.728+0000 7f5c83fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5c8406d520 0x7f5c84132530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:08.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.728+0000 7f5c83fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5c8406d520 0x7f5c84132530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58460/0 (socket says 172.21.15.2:58460) 2024-09-10T05:36:08.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.728+0000 7f5c83fff640 1 -- 172.21.15.2:0/3560930918 learned_addr learned my addr 172.21.15.2:0/3560930918 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:36:08.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.728+0000 7f5c88cd2640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f5c8406f5f0 0x7f5c8406f9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44194/0 (socket says 172.21.15.2:44194) 2024-09-10T05:36:08.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.728+0000 7f5c83fff640 1 -- 172.21.15.2:0/3560930918 >> v1:172.21.15.2:6789/0 conn(0x7f5c8406f5f0 legacy=0x7f5c8406f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:08.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.728+0000 7f5c837fe640 1 -- 172.21.15.2:0/3560930918 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4082193747 0 0) 0x7f5c84114cb0 con 0x7f5c8406f5f0 2024-09-10T05:36:08.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.728+0000 7f5c83fff640 1 -- 172.21.15.2:0/3560930918 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c84073af0 con 0x7f5c8406d520 2024-09-10T05:36:08.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.732+0000 7f5c83fff640 1 --2- 172.21.15.2:0/3560930918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c8406d520 0x7f5c84132530 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5c700097f0 tx=0x7f5c7001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb23d4d34e474152 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:08.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.732+0000 7f5c837fe640 1 -- 172.21.15.2:0/3560930918 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c700b0070 con 0x7f5c8406d520 2024-09-10T05:36:08.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.732+0000 7f5c837fe640 1 -- 172.21.15.2:0/3560930918 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c700ab530 con 0x7f5c8406d520 2024-09-10T05:36:08.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.732+0000 7f5c837fe640 1 -- 172.21.15.2:0/3560930918 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c700ab830 con 0x7f5c8406d520 2024-09-10T05:36:08.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.732+0000 7f5c8af36640 1 -- 172.21.15.2:0/3560930918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c8406d520 msgr2=0x7f5c84132530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:08.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.732+0000 7f5c8af36640 1 --2- 172.21.15.2:0/3560930918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c8406d520 0x7f5c84132530 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5c700097f0 tx=0x7f5c7001c4c0 comp rx=0 tx=0).stop 2024-09-10T05:36:08.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.732+0000 7f5c8af36640 1 -- 172.21.15.2:0/3560930918 shutdown_connections 2024-09-10T05:36:08.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.732+0000 7f5c8af36640 1 --2- 172.21.15.2:0/3560930918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c8406d520 0x7f5c84132530 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:08.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.732+0000 7f5c8af36640 1 -- 172.21.15.2:0/3560930918 >> 172.21.15.2:0/3560930918 conn(0x7f5c8409ba60 msgr2=0x7f5c8406dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:08.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.732+0000 7f5c8af36640 1 -- 172.21.15.2:0/3560930918 shutdown_connections 2024-09-10T05:36:08.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.732+0000 7f5c8af36640 1 -- 172.21.15.2:0/3560930918 wait complete. 2024-09-10T05:36:08.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.736+0000 7f5c8af36640 1 Processor -- start 2024-09-10T05:36:08.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.736+0000 7f5c8af36640 1 -- start start 2024-09-10T05:36:08.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.736+0000 7f5c8af36640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c8406d520 0x7f5c84121c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:08.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.736+0000 7f5c8af36640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5c84135620 con 0x7f5c8406d520 2024-09-10T05:36:08.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.736+0000 7f5c88cd2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c8406d520 0x7f5c84121c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:08.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.736+0000 7f5c88cd2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c8406d520 0x7f5c84121c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58462/0 (socket says 172.21.15.2:58462) 2024-09-10T05:36:08.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.736+0000 7f5c88cd2640 1 -- 172.21.15.2:0/736220712 learned_addr learned my addr 172.21.15.2:0/736220712 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:36:08.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.736+0000 7f5c88cd2640 1 -- 172.21.15.2:0/736220712 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c84131ee0 con 0x7f5c8406d520 2024-09-10T05:36:08.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.736+0000 7f5c88cd2640 1 --2- 172.21.15.2:0/736220712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c8406d520 0x7f5c84121c30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5c7800c480 tx=0x7f5c7800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:08.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.736+0000 7f5c817fa640 1 -- 172.21.15.2:0/736220712 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c78017070 con 0x7f5c8406d520 2024-09-10T05:36:08.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.736+0000 7f5c817fa640 1 -- 172.21.15.2:0/736220712 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c78007470 con 0x7f5c8406d520 2024-09-10T05:36:08.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.736+0000 7f5c8af36640 1 -- 172.21.15.2:0/736220712 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c841321d0 con 0x7f5c8406d520 2024-09-10T05:36:08.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.736+0000 7f5c817fa640 1 -- 172.21.15.2:0/736220712 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c78005820 con 0x7f5c8406d520 2024-09-10T05:36:08.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.736+0000 7f5c8af36640 1 -- 172.21.15.2:0/736220712 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c84122340 con 0x7f5c8406d520 2024-09-10T05:36:08.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.736+0000 7f5c8af36640 1 -- 172.21.15.2:0/736220712 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c84114f20 con 0x7f5c8406d520 2024-09-10T05:36:08.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.736+0000 7f5c817fa640 1 -- 172.21.15.2:0/736220712 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f5c7801a070 con 0x7f5c8406d520 2024-09-10T05:36:08.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.736+0000 7f5c817fa640 1 --2- 172.21.15.2:0/736220712 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5c6803b1d0 0x7f5c6803d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:08.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.736+0000 7f5c817fa640 1 -- 172.21.15.2:0/736220712 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f5c7804e070 con 0x7f5c8406d520 2024-09-10T05:36:08.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.740+0000 7f5c83fff640 1 --2- 172.21.15.2:0/736220712 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5c6803b1d0 0x7f5c6803d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:08.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.740+0000 7f5c83fff640 1 --2- 172.21.15.2:0/736220712 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5c6803b1d0 0x7f5c6803d690 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5c700ad000 tx=0x7f5c70008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:08.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.748+0000 7f5c817fa640 1 -- 172.21.15.2:0/736220712 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f5c78010300 con 0x7f5c8406d520 2024-09-10T05:36:08.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.760+0000 7f0d8a970640 1 Processor -- start 2024-09-10T05:36:08.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.760+0000 7f0d8a970640 1 -- start start 2024-09-10T05:36:08.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.760+0000 7f0d8a970640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0d8406dce0 0x7f0d8406e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:08.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.760+0000 7f0d8a970640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d84112c00 con 0x7f0d8406e600 2024-09-10T05:36:08.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.760+0000 7f0d8a970640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f0d841119f0 con 0x7f0d8406dce0 2024-09-10T05:36:08.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.760+0000 7f0d83fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0d8406dce0 0x7f0d8406e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:08.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.760+0000 7f0d837fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f0d8406e600 0x7f0d841254a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44206/0 (socket says 172.21.15.2:44206) 2024-09-10T05:36:08.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.760+0000 7f0d837fe640 1 -- 172.21.15.2:0/1352931378 learned_addr learned my addr 172.21.15.2:0/1352931378 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T05:36:08.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.760+0000 7f0d82ffd640 1 -- 172.21.15.2:0/1352931378 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4125213996 0 0) 0x7f0d78001120 con 0x7f0d8406e600 2024-09-10T05:36:08.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.760+0000 7f0d82ffd640 1 -- 172.21.15.2:0/1352931378 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d6c003530 con 0x7f0d8406e600 2024-09-10T05:36:08.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.760+0000 7f0d83fff640 1 -- 172.21.15.2:0/1352931378 >> v1:172.21.15.2:6789/0 conn(0x7f0d8406e600 legacy=0x7f0d841254a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:08.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.760+0000 7f0d83fff640 1 -- 172.21.15.2:0/1352931378 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d84073b10 con 0x7f0d8406dce0 2024-09-10T05:36:08.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.764+0000 7f0d83fff640 1 --2- 172.21.15.2:0/1352931378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d8406dce0 0x7f0d8406e0c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0d74009740 tx=0x7f0d7401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3507c5a2ce6243d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:08.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.764+0000 7f0d82ffd640 1 -- 172.21.15.2:0/1352931378 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d740b0070 con 0x7f0d8406dce0 2024-09-10T05:36:08.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.764+0000 7f0d82ffd640 1 -- 172.21.15.2:0/1352931378 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d740ab530 con 0x7f0d8406dce0 2024-09-10T05:36:08.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.764+0000 7f0d82ffd640 1 -- 172.21.15.2:0/1352931378 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d740ab830 con 0x7f0d8406dce0 2024-09-10T05:36:08.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.764+0000 7fb6aaeac640 1 Processor -- start 2024-09-10T05:36:08.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.764+0000 7fb6aaeac640 1 -- start start 2024-09-10T05:36:08.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.764+0000 7fb6aaeac640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb6a412daf0 0x7fb6a4132590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:08.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.764+0000 7f0d8a970640 1 -- 172.21.15.2:0/1352931378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d8406dce0 msgr2=0x7f0d8406e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:08.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.764+0000 7f0d8a970640 1 --2- 172.21.15.2:0/1352931378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d8406dce0 0x7f0d8406e0c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0d74009740 tx=0x7f0d7401c400 comp rx=0 tx=0).stop 2024-09-10T05:36:08.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.764+0000 7fb6aaeac640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6a409f7f0 con 0x7fb6a412d000 2024-09-10T05:36:08.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.764+0000 7fb6aaeac640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fb6a409ebb0 con 0x7fb6a412daf0 2024-09-10T05:36:08.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.764+0000 7fb6a8c48640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb6a412d000 0x7fb6a412d3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44208/0 (socket says 172.21.15.2:44208) 2024-09-10T05:36:08.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.764+0000 7fb6a8c48640 1 -- 172.21.15.2:0/1166819499 learned_addr learned my addr 172.21.15.2:0/1166819499 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T05:36:08.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.764+0000 7fb6a3fff640 1 --2- 172.21.15.2:0/1166819499 >> v2:172.21.15.2:3300/0 conn(0x7fb6a412daf0 0x7fb6a4132590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:08.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.764+0000 7f0d8a970640 1 -- 172.21.15.2:0/1352931378 shutdown_connections 2024-09-10T05:36:08.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.764+0000 7f0d8a970640 1 --2- 172.21.15.2:0/1352931378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d8406dce0 0x7f0d8406e0c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:08.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.764+0000 7f0d8a970640 1 -- 172.21.15.2:0/1352931378 >> 172.21.15.2:0/1352931378 conn(0x7f0d840709b0 msgr2=0x7f0d84072da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:08.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.764+0000 7f0d8a970640 1 -- 172.21.15.2:0/1352931378 shutdown_connections 2024-09-10T05:36:08.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.764+0000 7f0d8a970640 1 -- 172.21.15.2:0/1352931378 wait complete. 2024-09-10T05:36:08.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.764+0000 7fb6a37fe640 1 -- 172.21.15.2:0/1166819499 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1585792621 0 0) 0x7fb698001120 con 0x7fb6a412d000 2024-09-10T05:36:08.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.764+0000 7fb6a3fff640 1 -- 172.21.15.2:0/1166819499 >> v1:172.21.15.2:6789/0 conn(0x7fb6a412d000 legacy=0x7fb6a412d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:08.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.764+0000 7fb6a3fff640 1 -- 172.21.15.2:0/1166819499 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6a409f430 con 0x7fb6a412daf0 2024-09-10T05:36:08.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.768+0000 7f0d8a970640 1 Processor -- start 2024-09-10T05:36:08.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.768+0000 7f0d8a970640 1 -- start start 2024-09-10T05:36:08.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.768+0000 7f0d8a970640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d8406dce0 0x7f0d84131930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:08.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.768+0000 7f0d8a970640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0d84137910 con 0x7f0d8406dce0 2024-09-10T05:36:08.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.768+0000 7f0d83fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d8406dce0 0x7f0d84131930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:08.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.768+0000 7f0d83fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d8406dce0 0x7f0d84131930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58506/0 (socket says 172.21.15.2:58506) 2024-09-10T05:36:08.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.768+0000 7f0d83fff640 1 -- 172.21.15.2:0/2631541640 learned_addr learned my addr 172.21.15.2:0/2631541640 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:36:08.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.768+0000 7f0d83fff640 1 -- 172.21.15.2:0/2631541640 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d84117570 con 0x7f0d8406dce0 2024-09-10T05:36:08.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.768+0000 7f0d83fff640 1 --2- 172.21.15.2:0/2631541640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d8406dce0 0x7f0d84131930 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0d740ae040 tx=0x7f0d740191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:08.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.768+0000 7f0d80ff9640 1 -- 172.21.15.2:0/2631541640 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d740b8020 con 0x7f0d8406dce0 2024-09-10T05:36:08.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.768+0000 7f0d8a970640 1 -- 172.21.15.2:0/2631541640 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d841179b0 con 0x7f0d8406dce0 2024-09-10T05:36:08.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.768+0000 7f0d80ff9640 1 -- 172.21.15.2:0/2631541640 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d740abd00 con 0x7f0d8406dce0 2024-09-10T05:36:08.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.768+0000 7f0d80ff9640 1 -- 172.21.15.2:0/2631541640 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d740b0040 con 0x7f0d8406dce0 2024-09-10T05:36:08.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.768+0000 7f0d8a970640 1 -- 172.21.15.2:0/2631541640 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d84132040 con 0x7f0d8406dce0 2024-09-10T05:36:08.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.768+0000 7fb6a3fff640 1 --2- 172.21.15.2:0/1166819499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6a412daf0 0x7fb6a4132590 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb690009740 tx=0x7fb69001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca41a0640c0ee8dc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:08.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.768+0000 7fb6a37fe640 1 -- 172.21.15.2:0/1166819499 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6900b1070 con 0x7fb6a412daf0 2024-09-10T05:36:08.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.768+0000 7fb6a37fe640 1 -- 172.21.15.2:0/1166819499 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6900ac520 con 0x7fb6a412daf0 2024-09-10T05:36:08.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.768+0000 7fb6a37fe640 1 -- 172.21.15.2:0/1166819499 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6900ac820 con 0x7fb6a412daf0 2024-09-10T05:36:08.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.768+0000 7f0d8a970640 1 -- 172.21.15.2:0/2631541640 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d8406e0c0 con 0x7f0d8406dce0 2024-09-10T05:36:08.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.768+0000 7fb6aaeac640 1 -- 172.21.15.2:0/1166819499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6a412daf0 msgr2=0x7fb6a4132590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:08.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.768+0000 7fb6aaeac640 1 --2- 172.21.15.2:0/1166819499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6a412daf0 0x7fb6a4132590 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb690009740 tx=0x7fb69001c370 comp rx=0 tx=0).stop 2024-09-10T05:36:08.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.768+0000 7fb6aaeac640 1 -- 172.21.15.2:0/1166819499 shutdown_connections 2024-09-10T05:36:08.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.768+0000 7fb6aaeac640 1 --2- 172.21.15.2:0/1166819499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6a412daf0 0x7fb6a4132590 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:08.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.768+0000 7fb6aaeac640 1 -- 172.21.15.2:0/1166819499 >> 172.21.15.2:0/1166819499 conn(0x7fb6a4071e50 msgr2=0x7fb6a4072230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:08.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.768+0000 7fb6aaeac640 1 -- 172.21.15.2:0/1166819499 shutdown_connections 2024-09-10T05:36:08.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.768+0000 7fb6aaeac640 1 -- 172.21.15.2:0/1166819499 wait complete. 2024-09-10T05:36:08.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.768+0000 7f0d80ff9640 1 -- 172.21.15.2:0/2631541640 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0d740bb020 con 0x7f0d8406dce0 2024-09-10T05:36:08.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.768+0000 7f0d80ff9640 1 --2- 172.21.15.2:0/2631541640 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0d7003b160 0x7f0d7003d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:08.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.768+0000 7f0d80ff9640 1 -- 172.21.15.2:0/2631541640 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f0d740b2b20 con 0x7f0d8406dce0 2024-09-10T05:36:08.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.772+0000 7f0d837fe640 1 --2- 172.21.15.2:0/2631541640 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0d7003b160 0x7f0d7003d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:08.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.772+0000 7fb6aaeac640 1 Processor -- start 2024-09-10T05:36:08.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.772+0000 7fb6aaeac640 1 -- start start 2024-09-10T05:36:08.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.772+0000 7fb6aaeac640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6a412d000 0x7fb6a409c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:08.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.772+0000 7fb6aaeac640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb6a406ef70 con 0x7fb6a412d000 2024-09-10T05:36:08.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.772+0000 7f0d837fe640 1 --2- 172.21.15.2:0/2631541640 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0d7003b160 0x7f0d7003d620 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0d78001690 tx=0x7f0d78001260 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:08.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.776+0000 7fb6a8c48640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6a412d000 0x7fb6a409c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:08.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.776+0000 7fb6a8c48640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6a412d000 0x7fb6a409c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58516/0 (socket says 172.21.15.2:58516) 2024-09-10T05:36:08.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.776+0000 7fb6a8c48640 1 -- 172.21.15.2:0/1531604620 learned_addr learned my addr 172.21.15.2:0/1531604620 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:36:08.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.776+0000 7fb6a8c48640 1 -- 172.21.15.2:0/1531604620 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6a412f480 con 0x7fb6a412d000 2024-09-10T05:36:08.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.776+0000 7fb6a8c48640 1 --2- 172.21.15.2:0/1531604620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6a412d000 0x7fb6a409c210 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb69800c6b0 tx=0x7fb69800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:08.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.776+0000 7f0d80ff9640 1 -- 172.21.15.2:0/2631541640 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f0d740c2030 con 0x7f0d8406dce0 2024-09-10T05:36:08.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.776+0000 7fb6a17fa640 1 -- 172.21.15.2:0/1531604620 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb698018070 con 0x7fb6a412d000 2024-09-10T05:36:08.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.776+0000 7fb6a17fa640 1 -- 172.21.15.2:0/1531604620 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb698007e30 con 0x7fb6a412d000 2024-09-10T05:36:08.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.776+0000 7fb6a17fa640 1 -- 172.21.15.2:0/1531604620 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb698007200 con 0x7fb6a412d000 2024-09-10T05:36:08.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.776+0000 7fb6aaeac640 1 -- 172.21.15.2:0/1531604620 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6a412fd20 con 0x7fb6a412d000 2024-09-10T05:36:08.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.776+0000 7fb6aaeac640 1 -- 172.21.15.2:0/1531604620 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6a412ebf0 con 0x7fb6a412d000 2024-09-10T05:36:08.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.776+0000 7fb6aaeac640 1 -- 172.21.15.2:0/1531604620 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6a412d3e0 con 0x7fb6a412d000 2024-09-10T05:36:08.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.776+0000 7fb6a17fa640 1 -- 172.21.15.2:0/1531604620 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb69801b070 con 0x7fb6a412d000 2024-09-10T05:36:08.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.776+0000 7fb6a17fa640 1 --2- 172.21.15.2:0/1531604620 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb68803b1d0 0x7fb68803d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:08.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.776+0000 7fb6a17fa640 1 -- 172.21.15.2:0/1531604620 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fb69804e510 con 0x7fb6a412d000 2024-09-10T05:36:08.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.776+0000 7fb6a3fff640 1 --2- 172.21.15.2:0/1531604620 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb68803b1d0 0x7fb68803d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:08.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.780+0000 7fb6a3fff640 1 --2- 172.21.15.2:0/1531604620 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb68803b1d0 0x7fb68803d690 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb6900ae000 tx=0x7fb690008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:08.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.780+0000 7fb6a17fa640 1 -- 172.21.15.2:0/1531604620 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fb698022020 con 0x7fb6a412d000 2024-09-10T05:36:08.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.884+0000 7ffb703da640 1 -- 172.21.15.2:0/544319233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7ffb68127760 con 0x7ffb6809e370 2024-09-10T05:36:08.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.884+0000 7ffb5effd640 1 -- 172.21.15.2:0/544319233 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ffb6401b400 con 0x7ffb6809e370 2024-09-10T05:36:08.886 INFO:teuthology.orchestra.run.smithi002.stdout:42949672965 2024-09-10T05:36:08.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.888+0000 7ffb703da640 1 -- 172.21.15.2:0/544319233 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ffb4c03b1d0 msgr2=0x7ffb4c03d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:08.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.888+0000 7ffb703da640 1 --2- 172.21.15.2:0/544319233 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ffb4c03b1d0 0x7ffb4c03d690 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ffb580ae000 tx=0x7ffb580a7000 comp rx=0 tx=0).stop 2024-09-10T05:36:08.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.888+0000 7ffb703da640 1 -- 172.21.15.2:0/544319233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb6809e370 msgr2=0x7ffb68126320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:08.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.888+0000 7ffb703da640 1 --2- 172.21.15.2:0/544319233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb6809e370 0x7ffb68126320 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ffb6400c450 tx=0x7ffb6400c910 comp rx=0 tx=0).stop 2024-09-10T05:36:08.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.888+0000 7ffb703da640 1 -- 172.21.15.2:0/544319233 shutdown_connections 2024-09-10T05:36:08.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.888+0000 7ffb703da640 1 --2- 172.21.15.2:0/544319233 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ffb4c03b1d0 0x7ffb4c03d690 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:08.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.888+0000 7ffb703da640 1 --2- 172.21.15.2:0/544319233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb6809e370 0x7ffb68126320 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:08.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.888+0000 7ffb703da640 1 -- 172.21.15.2:0/544319233 >> 172.21.15.2:0/544319233 conn(0x7ffb68071630 msgr2=0x7ffb68127a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:08.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.888+0000 7ffb703da640 1 -- 172.21.15.2:0/544319233 shutdown_connections 2024-09-10T05:36:08.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.888+0000 7ffb703da640 1 -- 172.21.15.2:0/544319233 wait complete. 2024-09-10T05:36:08.911 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672965 for osd.0 2024-09-10T05:36:08.911 DEBUG:teuthology.parallel:result is None 2024-09-10T05:36:08.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.928+0000 7f5c8af36640 1 -- 172.21.15.2:0/736220712 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f5c84131b60 con 0x7f5c8406d520 2024-09-10T05:36:08.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.928+0000 7f5c817fa640 1 -- 172.21.15.2:0/736220712 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5c78010e20 con 0x7f5c8406d520 2024-09-10T05:36:08.932 INFO:teuthology.orchestra.run.smithi002.stdout:42949672966 2024-09-10T05:36:08.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.932+0000 7f5c8af36640 1 -- 172.21.15.2:0/736220712 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5c6803b1d0 msgr2=0x7f5c6803d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:08.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.932+0000 7f5c8af36640 1 --2- 172.21.15.2:0/736220712 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5c6803b1d0 0x7f5c6803d690 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5c700ad000 tx=0x7f5c70008040 comp rx=0 tx=0).stop 2024-09-10T05:36:08.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.932+0000 7f5c8af36640 1 -- 172.21.15.2:0/736220712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c8406d520 msgr2=0x7f5c84121c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:08.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.932+0000 7f5c8af36640 1 --2- 172.21.15.2:0/736220712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c8406d520 0x7f5c84121c30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5c7800c480 tx=0x7f5c7800c940 comp rx=0 tx=0).stop 2024-09-10T05:36:08.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.932+0000 7f5c8af36640 1 -- 172.21.15.2:0/736220712 shutdown_connections 2024-09-10T05:36:08.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.932+0000 7f5c8af36640 1 --2- 172.21.15.2:0/736220712 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5c6803b1d0 0x7f5c6803d690 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:08.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.932+0000 7f5c8af36640 1 --2- 172.21.15.2:0/736220712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c8406d520 0x7f5c84121c30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:08.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.932+0000 7f5c8af36640 1 -- 172.21.15.2:0/736220712 >> 172.21.15.2:0/736220712 conn(0x7f5c8409ba60 msgr2=0x7f5c8412ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:08.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.932+0000 7f5c8af36640 1 -- 172.21.15.2:0/736220712 shutdown_connections 2024-09-10T05:36:08.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.932+0000 7f5c8af36640 1 -- 172.21.15.2:0/736220712 wait complete. 2024-09-10T05:36:08.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.944+0000 7f0d8a970640 1 -- 172.21.15.2:0/2631541640 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f0d84068e50 con 0x7f0d8406dce0 2024-09-10T05:36:08.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.944+0000 7f0d80ff9640 1 -- 172.21.15.2:0/2631541640 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0d740c2030 con 0x7f0d8406dce0 2024-09-10T05:36:08.946 INFO:teuthology.orchestra.run.smithi002.stdout:42949672965 2024-09-10T05:36:08.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.944+0000 7f0d8a970640 1 -- 172.21.15.2:0/2631541640 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0d7003b160 msgr2=0x7f0d7003d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:08.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.944+0000 7f0d8a970640 1 --2- 172.21.15.2:0/2631541640 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0d7003b160 0x7f0d7003d620 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0d78001690 tx=0x7f0d78001260 comp rx=0 tx=0).stop 2024-09-10T05:36:08.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.944+0000 7f0d8a970640 1 -- 172.21.15.2:0/2631541640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d8406dce0 msgr2=0x7f0d84131930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:08.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.944+0000 7f0d8a970640 1 --2- 172.21.15.2:0/2631541640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d8406dce0 0x7f0d84131930 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0d740ae040 tx=0x7f0d740191a0 comp rx=0 tx=0).stop 2024-09-10T05:36:08.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.944+0000 7f0d8a970640 1 -- 172.21.15.2:0/2631541640 shutdown_connections 2024-09-10T05:36:08.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.944+0000 7f0d8a970640 1 --2- 172.21.15.2:0/2631541640 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0d7003b160 0x7f0d7003d620 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:08.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.944+0000 7f0d8a970640 1 --2- 172.21.15.2:0/2631541640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d8406dce0 0x7f0d84131930 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:08.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.944+0000 7f0d8a970640 1 -- 172.21.15.2:0/2631541640 >> 172.21.15.2:0/2631541640 conn(0x7f0d840709b0 msgr2=0x7f0d84134990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:08.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.944+0000 7f0d8a970640 1 -- 172.21.15.2:0/2631541640 shutdown_connections 2024-09-10T05:36:08.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.944+0000 7f0d8a970640 1 -- 172.21.15.2:0/2631541640 wait complete. 2024-09-10T05:36:08.951 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672966 for osd.1 2024-09-10T05:36:08.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.948+0000 7fb6aaeac640 1 -- 172.21.15.2:0/1531604620 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fb6a409d950 con 0x7fb6a412d000 2024-09-10T05:36:08.952 DEBUG:teuthology.parallel:result is None 2024-09-10T05:36:08.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.948+0000 7fb6a17fa640 1 -- 172.21.15.2:0/1531604620 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb6a412f480 con 0x7fb6a412d000 2024-09-10T05:36:08.952 INFO:teuthology.orchestra.run.smithi002.stdout:47244640260 2024-09-10T05:36:08.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.952+0000 7fb6aaeac640 1 -- 172.21.15.2:0/1531604620 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb68803b1d0 msgr2=0x7fb68803d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:08.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.952+0000 7fb6aaeac640 1 --2- 172.21.15.2:0/1531604620 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb68803b1d0 0x7fb68803d690 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb6900ae000 tx=0x7fb690008040 comp rx=0 tx=0).stop 2024-09-10T05:36:08.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.952+0000 7fb6aaeac640 1 -- 172.21.15.2:0/1531604620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6a412d000 msgr2=0x7fb6a409c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:08.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.952+0000 7fb6aaeac640 1 --2- 172.21.15.2:0/1531604620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6a412d000 0x7fb6a409c210 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb69800c6b0 tx=0x7fb69800cb70 comp rx=0 tx=0).stop 2024-09-10T05:36:08.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.952+0000 7fb6aaeac640 1 -- 172.21.15.2:0/1531604620 shutdown_connections 2024-09-10T05:36:08.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.952+0000 7fb6aaeac640 1 --2- 172.21.15.2:0/1531604620 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb68803b1d0 0x7fb68803d690 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:08.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.952+0000 7fb6aaeac640 1 --2- 172.21.15.2:0/1531604620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6a412d000 0x7fb6a409c210 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:08.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.952+0000 7fb6aaeac640 1 -- 172.21.15.2:0/1531604620 >> 172.21.15.2:0/1531604620 conn(0x7fb6a4071e50 msgr2=0x7fb6a4126b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:08.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.952+0000 7fb6aaeac640 1 -- 172.21.15.2:0/1531604620 shutdown_connections 2024-09-10T05:36:08.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:08.952+0000 7fb6aaeac640 1 -- 172.21.15.2:0/1531604620 wait complete. 2024-09-10T05:36:08.965 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672965 for osd.2 2024-09-10T05:36:08.966 DEBUG:teuthology.parallel:result is None 2024-09-10T05:36:08.970 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640260 for osd.3 2024-09-10T05:36:08.971 DEBUG:teuthology.parallel:result is None 2024-09-10T05:36:08.971 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T05:36:08.971 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T05:36:09.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.116+0000 7f53ce68f640 1 Processor -- start 2024-09-10T05:36:09.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.116+0000 7f53ce68f640 1 -- start start 2024-09-10T05:36:09.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.120+0000 7f53ce68f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f53c8111890 0x7f53c8132450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:09.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.120+0000 7f53ce68f640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53c8073a90 con 0x7f53c8110da0 2024-09-10T05:36:09.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.120+0000 7f53ce68f640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f53c80696e0 con 0x7f53c8111890 2024-09-10T05:36:09.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.120+0000 7f53c77fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f53c8111890 0x7f53c8132450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:09.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.120+0000 7f53c7fff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f53c8110da0 0x7f53c8111180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44210/0 (socket says 172.21.15.2:44210) 2024-09-10T05:36:09.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.120+0000 7f53c7fff640 1 -- 172.21.15.2:0/362301022 learned_addr learned my addr 172.21.15.2:0/362301022 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T05:36:09.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.120+0000 7f53c77fe640 1 -- 172.21.15.2:0/362301022 >> v1:172.21.15.2:6789/0 conn(0x7f53c8110da0 legacy=0x7f53c8111180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:09.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.120+0000 7f53c77fe640 1 -- 172.21.15.2:0/362301022 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53c806dd50 con 0x7f53c8111890 2024-09-10T05:36:09.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.120+0000 7f53c77fe640 1 --2- 172.21.15.2:0/362301022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53c8111890 0x7f53c8132450 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f53bc009740 tx=0x7f53bc01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=926625c396dc56b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:09.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.120+0000 7f53c6ffd640 1 -- 172.21.15.2:0/362301022 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53bc0b0070 con 0x7f53c8111890 2024-09-10T05:36:09.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.120+0000 7f53c6ffd640 1 -- 172.21.15.2:0/362301022 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53bc0ab530 con 0x7f53c8111890 2024-09-10T05:36:09.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.120+0000 7f53c6ffd640 1 -- 172.21.15.2:0/362301022 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53bc0ab830 con 0x7f53c8111890 2024-09-10T05:36:09.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.120+0000 7f53ce68f640 1 -- 172.21.15.2:0/362301022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53c8111890 msgr2=0x7f53c8132450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:09.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.120+0000 7f53ce68f640 1 --2- 172.21.15.2:0/362301022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53c8111890 0x7f53c8132450 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f53bc009740 tx=0x7f53bc01c370 comp rx=0 tx=0).stop 2024-09-10T05:36:09.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.120+0000 7f53ce68f640 1 -- 172.21.15.2:0/362301022 shutdown_connections 2024-09-10T05:36:09.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.120+0000 7f53ce68f640 1 --2- 172.21.15.2:0/362301022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53c8111890 0x7f53c8132450 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:09.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.120+0000 7f53ce68f640 1 -- 172.21.15.2:0/362301022 >> 172.21.15.2:0/362301022 conn(0x7f53c8070900 msgr2=0x7f53c8072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:09.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.120+0000 7f53ce68f640 1 -- 172.21.15.2:0/362301022 shutdown_connections 2024-09-10T05:36:09.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.120+0000 7f53ce68f640 1 -- 172.21.15.2:0/362301022 wait complete. 2024-09-10T05:36:09.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.124+0000 7f53ce68f640 1 Processor -- start 2024-09-10T05:36:09.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.124+0000 7f53ce68f640 1 -- start start 2024-09-10T05:36:09.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.124+0000 7f53ce68f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53c8110da0 0x7f53c8122a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:09.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.124+0000 7f53ce68f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f53c8135330 con 0x7f53c8110da0 2024-09-10T05:36:09.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.124+0000 7f53c7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53c8110da0 0x7f53c8122a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:09.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.124+0000 7f53c7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53c8110da0 0x7f53c8122a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58528/0 (socket says 172.21.15.2:58528) 2024-09-10T05:36:09.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.124+0000 7f53c7fff640 1 -- 172.21.15.2:0/4088479454 learned_addr learned my addr 172.21.15.2:0/4088479454 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:36:09.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.124+0000 7f53c7fff640 1 -- 172.21.15.2:0/4088479454 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53c8131dd0 con 0x7f53c8110da0 2024-09-10T05:36:09.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.124+0000 7f53c7fff640 1 --2- 172.21.15.2:0/4088479454 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53c8110da0 0x7f53c8122a50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f53b800cbd0 tx=0x7f53b800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:09.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.124+0000 7f53c4ff9640 1 -- 172.21.15.2:0/4088479454 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53b8017070 con 0x7f53c8110da0 2024-09-10T05:36:09.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.124+0000 7f53c4ff9640 1 -- 172.21.15.2:0/4088479454 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53b800abc0 con 0x7f53c8110da0 2024-09-10T05:36:09.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.124+0000 7f53ce68f640 1 -- 172.21.15.2:0/4088479454 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53c812fee0 con 0x7f53c8110da0 2024-09-10T05:36:09.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.124+0000 7f53c4ff9640 1 -- 172.21.15.2:0/4088479454 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53b8012400 con 0x7f53c8110da0 2024-09-10T05:36:09.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.124+0000 7f53ce68f640 1 -- 172.21.15.2:0/4088479454 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53c8130f70 con 0x7f53c8110da0 2024-09-10T05:36:09.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.124+0000 7f53ce68f640 1 -- 172.21.15.2:0/4088479454 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53c8111180 con 0x7f53c8110da0 2024-09-10T05:36:09.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.124+0000 7f53c4ff9640 1 -- 172.21.15.2:0/4088479454 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f53b801a070 con 0x7f53c8110da0 2024-09-10T05:36:09.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.124+0000 7f53c4ff9640 1 --2- 172.21.15.2:0/4088479454 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f53b403b1d0 0x7f53b403d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:09.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.124+0000 7f53c4ff9640 1 -- 172.21.15.2:0/4088479454 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f53b804ea10 con 0x7f53c8110da0 2024-09-10T05:36:09.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.124+0000 7f53c77fe640 1 --2- 172.21.15.2:0/4088479454 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f53b403b1d0 0x7f53b403d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:09.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.124+0000 7f53c77fe640 1 --2- 172.21.15.2:0/4088479454 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f53b403b1d0 0x7f53b403d690 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f53bc0ad000 tx=0x7f53bc0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:09.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.128+0000 7f53c4ff9640 1 -- 172.21.15.2:0/4088479454 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f53b80078c0 con 0x7f53c8110da0 2024-09-10T05:36:09.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.292+0000 7f53ce68f640 1 -- 172.21.15.2:0/4088479454 --> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f53c8122f90 con 0x7f53b403b1d0 2024-09-10T05:36:09.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.296+0000 7f53c4ff9640 1 -- 172.21.15.2:0/4088479454 <== mgr.4101 v2:172.21.15.62:6824/3663628807 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32226 (secure 0 0 0) 0x7f53bc0ab500 con 0x7f53b403b1d0 2024-09-10T05:36:09.298 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T05:36:09.299 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-10T05:36:09.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.296+0000 7f53ce68f640 1 -- 172.21.15.2:0/4088479454 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f53b403b1d0 msgr2=0x7f53b403d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:09.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.296+0000 7f53ce68f640 1 --2- 172.21.15.2:0/4088479454 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f53b403b1d0 0x7f53b403d690 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f53bc0ad000 tx=0x7f53bc0a6000 comp rx=0 tx=0).stop 2024-09-10T05:36:09.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.296+0000 7f53ce68f640 1 -- 172.21.15.2:0/4088479454 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53c8110da0 msgr2=0x7f53c8122a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:09.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.296+0000 7f53ce68f640 1 --2- 172.21.15.2:0/4088479454 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53c8110da0 0x7f53c8122a50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f53b800cbd0 tx=0x7f53b800a430 comp rx=0 tx=0).stop 2024-09-10T05:36:09.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.296+0000 7f53ce68f640 1 -- 172.21.15.2:0/4088479454 shutdown_connections 2024-09-10T05:36:09.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.296+0000 7f53ce68f640 1 --2- 172.21.15.2:0/4088479454 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f53b403b1d0 0x7f53b403d690 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:09.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.296+0000 7f53ce68f640 1 --2- 172.21.15.2:0/4088479454 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53c8110da0 0x7f53c8122a50 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:09.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.296+0000 7f53ce68f640 1 -- 172.21.15.2:0/4088479454 >> 172.21.15.2:0/4088479454 conn(0x7f53c8070900 msgr2=0x7f53c8071ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:09.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.296+0000 7f53ce68f640 1 -- 172.21.15.2:0/4088479454 shutdown_connections 2024-09-10T05:36:09.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.296+0000 7f53ce68f640 1 -- 172.21.15.2:0/4088479454 wait complete. 2024-09-10T05:36:09.316 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-09-10T05:36:07.583560+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":118192,"kb_used_data":1744,"kb_used_omap":6,"kb_used_meta":116345,"kb_avail":377369168,"statfs":{"total":386547056640,"available":386426028032,"internally_reserved":0,"allocated":1785856,"data_stored":1370410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":119138070},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.893131"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T05:36:05.711580+0000","last_change":"2024-09-10T05:36:05.711580+0000","last_active":"2024-09-10T05:36:05.711580+0000","last_peered":"2024-09-10T05:36:05.711580+0000","last_clean":"2024-09-10T05:36:05.711580+0000","last_became_active":"2024-09-10T05:36:03.708884+0000","last_became_peered":"2024-09-10T05:36:03.708884+0000","last_unstale":"2024-09-10T05:36:05.711580+0000","last_undegraded":"2024-09-10T05:36:05.711580+0000","last_fullsized":"2024-09-10T05:36:05.711580+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_clean_scrub_stamp":"2024-09-10T05:36:02.684661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:41:36.044908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018824390000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T05:36:05.716475+0000","last_change":"2024-09-10T05:36:05.716475+0000","last_active":"2024-09-10T05:36:05.716475+0000","last_peered":"2024-09-10T05:36:05.716475+0000","last_clean":"2024-09-10T05:36:05.716475+0000","last_became_active":"2024-09-10T05:36:03.705038+0000","last_became_peered":"2024-09-10T05:36:03.705038+0000","last_unstale":"2024-09-10T05:36:05.716475+0000","last_undegraded":"2024-09-10T05:36:05.716475+0000","last_fullsized":"2024-09-10T05:36:05.716475+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_clean_scrub_stamp":"2024-09-10T05:36:02.684661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:33:56.689163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00126935,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T05:36:05.712138+0000","last_change":"2024-09-10T05:36:05.712138+0000","last_active":"2024-09-10T05:36:05.712138+0000","last_peered":"2024-09-10T05:36:05.712138+0000","last_clean":"2024-09-10T05:36:05.712138+0000","last_became_active":"2024-09-10T05:36:03.709534+0000","last_became_peered":"2024-09-10T05:36:03.709534+0000","last_unstale":"2024-09-10T05:36:05.712138+0000","last_undegraded":"2024-09-10T05:36:05.712138+0000","last_fullsized":"2024-09-10T05:36:05.712138+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_clean_scrub_stamp":"2024-09-10T05:36:02.684661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:58:56.347286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022338829999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T05:36:05.716234+0000","last_change":"2024-09-10T05:36:05.716234+0000","last_active":"2024-09-10T05:36:05.716234+0000","last_peered":"2024-09-10T05:36:05.716234+0000","last_clean":"2024-09-10T05:36:05.716234+0000","last_became_active":"2024-09-10T05:36:03.705338+0000","last_became_peered":"2024-09-10T05:36:03.705338+0000","last_unstale":"2024-09-10T05:36:05.716234+0000","last_undegraded":"2024-09-10T05:36:05.716234+0000","last_fullsized":"2024-09-10T05:36:05.716234+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_clean_scrub_stamp":"2024-09-10T05:36:02.684661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:59.676796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010885789999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"17'2","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T05:36:05.715115+0000","last_change":"2024-09-10T05:36:05.710910+0000","last_active":"2024-09-10T05:36:05.715115+0000","last_peered":"2024-09-10T05:36:05.715115+0000","last_clean":"2024-09-10T05:36:05.715115+0000","last_became_active":"2024-09-10T05:36:03.708495+0000","last_became_peered":"2024-09-10T05:36:03.708495+0000","last_unstale":"2024-09-10T05:36:05.715115+0000","last_undegraded":"2024-09-10T05:36:05.715115+0000","last_fullsized":"2024-09-10T05:36:05.715115+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_clean_scrub_stamp":"2024-09-10T05:36:02.684661+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:51.729077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012525469999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T05:36:06.203202+0000","last_change":"2024-09-10T05:36:06.203202+0000","last_active":"2024-09-10T05:36:06.203202+0000","last_peered":"2024-09-10T05:36:06.203202+0000","last_clean":"2024-09-10T05:36:06.203202+0000","last_became_active":"2024-09-10T05:36:03.707045+0000","last_became_peered":"2024-09-10T05:36:03.707045+0000","last_unstale":"2024-09-10T05:36:06.203202+0000","last_undegraded":"2024-09-10T05:36:06.203202+0000","last_fullsized":"2024-09-10T05:36:06.203202+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_clean_scrub_stamp":"2024-09-10T05:36:02.684661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:47:09.787526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093121299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T05:36:05.710898+0000","last_change":"2024-09-10T05:36:05.710898+0000","last_active":"2024-09-10T05:36:05.710898+0000","last_peered":"2024-09-10T05:36:05.710898+0000","last_clean":"2024-09-10T05:36:05.710898+0000","last_became_active":"2024-09-10T05:36:03.706256+0000","last_became_peered":"2024-09-10T05:36:03.706256+0000","last_unstale":"2024-09-10T05:36:05.710898+0000","last_undegraded":"2024-09-10T05:36:05.710898+0000","last_fullsized":"2024-09-10T05:36:05.710898+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_clean_scrub_stamp":"2024-09-10T05:36:02.684661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:42:18.313806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001383542,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"15'1","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T05:36:05.711729+0000","last_change":"2024-09-10T05:36:05.711729+0000","last_active":"2024-09-10T05:36:05.711729+0000","last_peered":"2024-09-10T05:36:05.711729+0000","last_clean":"2024-09-10T05:36:05.711729+0000","last_became_active":"2024-09-10T05:36:03.710352+0000","last_became_peered":"2024-09-10T05:36:03.710352+0000","last_unstale":"2024-09-10T05:36:05.711729+0000","last_undegraded":"2024-09-10T05:36:05.711729+0000","last_fullsized":"2024-09-10T05:36:05.711729+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_clean_scrub_stamp":"2024-09-10T05:36:02.684661+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:03:30.592449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002047461,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"12'72","reported_seq":111,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T05:36:05.715195+0000","last_change":"2024-09-10T05:35:59.488460+0000","last_active":"2024-09-10T05:36:05.715195+0000","last_peered":"2024-09-10T05:36:05.715195+0000","last_clean":"2024-09-10T05:36:05.715195+0000","last_became_active":"2024-09-10T05:35:59.486077+0000","last_became_peered":"2024-09-10T05:35:59.486077+0000","last_unstale":"2024-09-10T05:36:05.715195+0000","last_undegraded":"2024-09-10T05:36:05.715195+0000","last_fullsized":"2024-09-10T05:36:05.715195+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:35:57.655557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:35:57.655557+0000","last_clean_scrub_stamp":"2024-09-10T05:35:57.655557+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:41:07.276856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31332,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340508,"statfs":{"total":96636764160,"available":96604680192,"internally_reserved":0,"allocated":147456,"data_stored":47409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672965,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":741376,"data_stored":637777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":745472,"data_stored":637796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":10,"seq":42949672965,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31336,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":151552,"data_stored":47428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T05:36:09.317 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T05:36:09.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.432+0000 7fd185a6f640 1 Processor -- start 2024-09-10T05:36:09.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.432+0000 7fd185a6f640 1 -- start start 2024-09-10T05:36:09.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.432+0000 7fd185a6f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd18012aee0 0x7fd18012b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:09.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.432+0000 7fd185a6f640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1800008e0 con 0x7fd18012f110 2024-09-10T05:36:09.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.432+0000 7fd185a6f640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fd180071e70 con 0x7fd18012aee0 2024-09-10T05:36:09.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.436+0000 7fd17effd640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd18012f110 0x7fd18012f550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44214/0 (socket says 172.21.15.2:44214) 2024-09-10T05:36:09.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.436+0000 7fd17effd640 1 -- 172.21.15.2:0/224605676 learned_addr learned my addr 172.21.15.2:0/224605676 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T05:36:09.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.436+0000 7fd17f7fe640 1 --2- 172.21.15.2:0/224605676 >> v2:172.21.15.2:3300/0 conn(0x7fd18012aee0 0x7fd18012b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:09.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.436+0000 7fd17e7fc640 1 -- 172.21.15.2:0/224605676 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2865157314 0 0) 0x7fd1800008e0 con 0x7fd18012f110 2024-09-10T05:36:09.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.436+0000 7fd17e7fc640 1 -- 172.21.15.2:0/224605676 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd168003530 con 0x7fd18012f110 2024-09-10T05:36:09.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.436+0000 7fd17f7fe640 1 -- 172.21.15.2:0/224605676 >> v1:172.21.15.2:6789/0 conn(0x7fd18012f110 legacy=0x7fd18012f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:09.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.436+0000 7fd17f7fe640 1 -- 172.21.15.2:0/224605676 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1800a30b0 con 0x7fd18012aee0 2024-09-10T05:36:09.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.436+0000 7fd17f7fe640 1 --2- 172.21.15.2:0/224605676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd18012aee0 0x7fd18012b2c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd170009740 tx=0x7fd17001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f6593b8edf6bd1c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:09.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.436+0000 7fd17e7fc640 1 -- 172.21.15.2:0/224605676 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1700b1070 con 0x7fd18012aee0 2024-09-10T05:36:09.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.436+0000 7fd17e7fc640 1 -- 172.21.15.2:0/224605676 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1700ac520 con 0x7fd18012aee0 2024-09-10T05:36:09.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.436+0000 7fd17e7fc640 1 -- 172.21.15.2:0/224605676 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1700ac820 con 0x7fd18012aee0 2024-09-10T05:36:09.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.436+0000 7fd185a6f640 1 -- 172.21.15.2:0/224605676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd18012aee0 msgr2=0x7fd18012b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:09.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.436+0000 7fd185a6f640 1 --2- 172.21.15.2:0/224605676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd18012aee0 0x7fd18012b2c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd170009740 tx=0x7fd17001c370 comp rx=0 tx=0).stop 2024-09-10T05:36:09.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.436+0000 7fd185a6f640 1 -- 172.21.15.2:0/224605676 shutdown_connections 2024-09-10T05:36:09.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.436+0000 7fd185a6f640 1 --2- 172.21.15.2:0/224605676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd18012aee0 0x7fd18012b2c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:09.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.436+0000 7fd185a6f640 1 -- 172.21.15.2:0/224605676 >> 172.21.15.2:0/224605676 conn(0x7fd1800a0a60 msgr2=0x7fd18006e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:09.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.436+0000 7fd185a6f640 1 -- 172.21.15.2:0/224605676 shutdown_connections 2024-09-10T05:36:09.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.436+0000 7fd185a6f640 1 -- 172.21.15.2:0/224605676 wait complete. 2024-09-10T05:36:09.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.440+0000 7fd185a6f640 1 Processor -- start 2024-09-10T05:36:09.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.440+0000 7fd185a6f640 1 -- start start 2024-09-10T05:36:09.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.440+0000 7fd185a6f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd18012aee0 0x7fd1801296c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:09.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.440+0000 7fd185a6f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd18012b980 con 0x7fd18012aee0 2024-09-10T05:36:09.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.440+0000 7fd17f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd18012aee0 0x7fd1801296c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:09.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.440+0000 7fd17f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd18012aee0 0x7fd1801296c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58538/0 (socket says 172.21.15.2:58538) 2024-09-10T05:36:09.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.440+0000 7fd17f7fe640 1 -- 172.21.15.2:0/4013979150 learned_addr learned my addr 172.21.15.2:0/4013979150 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:36:09.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.440+0000 7fd17f7fe640 1 -- 172.21.15.2:0/4013979150 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd18011c2e0 con 0x7fd18012aee0 2024-09-10T05:36:09.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.440+0000 7fd17f7fe640 1 --2- 172.21.15.2:0/4013979150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd18012aee0 0x7fd1801296c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd17001aa20 tx=0x7fd17001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:09.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.440+0000 7fd167fff640 1 -- 172.21.15.2:0/4013979150 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1700b1050 con 0x7fd18012aee0 2024-09-10T05:36:09.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.440+0000 7fd167fff640 1 -- 172.21.15.2:0/4013979150 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1700b2040 con 0x7fd18012aee0 2024-09-10T05:36:09.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.440+0000 7fd185a6f640 1 -- 172.21.15.2:0/4013979150 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd18011c510 con 0x7fd18012aee0 2024-09-10T05:36:09.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.440+0000 7fd167fff640 1 -- 172.21.15.2:0/4013979150 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1700b6740 con 0x7fd18012aee0 2024-09-10T05:36:09.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.440+0000 7fd185a6f640 1 -- 172.21.15.2:0/4013979150 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd180129dd0 con 0x7fd18012aee0 2024-09-10T05:36:09.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.440+0000 7fd185a6f640 1 -- 172.21.15.2:0/4013979150 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd18012b2c0 con 0x7fd18012aee0 2024-09-10T05:36:09.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.440+0000 7fd167fff640 1 -- 172.21.15.2:0/4013979150 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd1700bf030 con 0x7fd18012aee0 2024-09-10T05:36:09.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.440+0000 7fd167fff640 1 --2- 172.21.15.2:0/4013979150 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fd16c03b1d0 0x7fd16c03d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:09.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.440+0000 7fd167fff640 1 -- 172.21.15.2:0/4013979150 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fd1700bd070 con 0x7fd18012aee0 2024-09-10T05:36:09.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.440+0000 7fd17effd640 1 --2- 172.21.15.2:0/4013979150 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fd16c03b1d0 0x7fd16c03d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:09.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.444+0000 7fd17effd640 1 --2- 172.21.15.2:0/4013979150 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fd16c03b1d0 0x7fd16c03d690 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd174007fd0 tx=0x7fd174007900 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:09.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.444+0000 7fd167fff640 1 -- 172.21.15.2:0/4013979150 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fd1700c6020 con 0x7fd18012aee0 2024-09-10T05:36:09.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.608+0000 7fd185a6f640 1 -- 172.21.15.2:0/4013979150 --> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd180073a80 con 0x7fd16c03b1d0 2024-09-10T05:36:09.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.608+0000 7fd167fff640 1 -- 172.21.15.2:0/4013979150 <== mgr.4101 v2:172.21.15.62:6824/3663628807 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32166 (secure 0 0 0) 0x7fd1740058c0 con 0x7fd16c03b1d0 2024-09-10T05:36:09.612 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T05:36:09.613 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-10T05:36:09.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.612+0000 7fd185a6f640 1 -- 172.21.15.2:0/4013979150 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fd16c03b1d0 msgr2=0x7fd16c03d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:09.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.612+0000 7fd185a6f640 1 --2- 172.21.15.2:0/4013979150 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fd16c03b1d0 0x7fd16c03d690 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd174007fd0 tx=0x7fd174007900 comp rx=0 tx=0).stop 2024-09-10T05:36:09.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.612+0000 7fd185a6f640 1 -- 172.21.15.2:0/4013979150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd18012aee0 msgr2=0x7fd1801296c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:09.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.612+0000 7fd185a6f640 1 --2- 172.21.15.2:0/4013979150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd18012aee0 0x7fd1801296c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd17001aa20 tx=0x7fd17001abb0 comp rx=0 tx=0).stop 2024-09-10T05:36:09.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.612+0000 7fd185a6f640 1 -- 172.21.15.2:0/4013979150 shutdown_connections 2024-09-10T05:36:09.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.612+0000 7fd185a6f640 1 --2- 172.21.15.2:0/4013979150 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fd16c03b1d0 0x7fd16c03d690 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:09.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.612+0000 7fd185a6f640 1 --2- 172.21.15.2:0/4013979150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd18012aee0 0x7fd1801296c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:09.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.612+0000 7fd185a6f640 1 -- 172.21.15.2:0/4013979150 >> 172.21.15.2:0/4013979150 conn(0x7fd1800a0a60 msgr2=0x7fd1800a0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:09.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.612+0000 7fd185a6f640 1 -- 172.21.15.2:0/4013979150 shutdown_connections 2024-09-10T05:36:09.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.612+0000 7fd185a6f640 1 -- 172.21.15.2:0/4013979150 wait complete. 2024-09-10T05:36:09.630 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-10T05:36:09.584118+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":118192,"kb_used_data":1744,"kb_used_omap":6,"kb_used_meta":116345,"kb_avail":377369168,"statfs":{"total":386547056640,"available":386426028032,"internally_reserved":0,"allocated":1785856,"data_stored":1370410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":119138070},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001642"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T05:36:05.711580+0000","last_change":"2024-09-10T05:36:05.711580+0000","last_active":"2024-09-10T05:36:05.711580+0000","last_peered":"2024-09-10T05:36:05.711580+0000","last_clean":"2024-09-10T05:36:05.711580+0000","last_became_active":"2024-09-10T05:36:03.708884+0000","last_became_peered":"2024-09-10T05:36:03.708884+0000","last_unstale":"2024-09-10T05:36:05.711580+0000","last_undegraded":"2024-09-10T05:36:05.711580+0000","last_fullsized":"2024-09-10T05:36:05.711580+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_clean_scrub_stamp":"2024-09-10T05:36:02.684661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:41:36.044908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018824390000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T05:36:05.716475+0000","last_change":"2024-09-10T05:36:05.716475+0000","last_active":"2024-09-10T05:36:05.716475+0000","last_peered":"2024-09-10T05:36:05.716475+0000","last_clean":"2024-09-10T05:36:05.716475+0000","last_became_active":"2024-09-10T05:36:03.705038+0000","last_became_peered":"2024-09-10T05:36:03.705038+0000","last_unstale":"2024-09-10T05:36:05.716475+0000","last_undegraded":"2024-09-10T05:36:05.716475+0000","last_fullsized":"2024-09-10T05:36:05.716475+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_clean_scrub_stamp":"2024-09-10T05:36:02.684661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:33:56.689163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00126935,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T05:36:05.712138+0000","last_change":"2024-09-10T05:36:05.712138+0000","last_active":"2024-09-10T05:36:05.712138+0000","last_peered":"2024-09-10T05:36:05.712138+0000","last_clean":"2024-09-10T05:36:05.712138+0000","last_became_active":"2024-09-10T05:36:03.709534+0000","last_became_peered":"2024-09-10T05:36:03.709534+0000","last_unstale":"2024-09-10T05:36:05.712138+0000","last_undegraded":"2024-09-10T05:36:05.712138+0000","last_fullsized":"2024-09-10T05:36:05.712138+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_clean_scrub_stamp":"2024-09-10T05:36:02.684661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:58:56.347286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022338829999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T05:36:05.716234+0000","last_change":"2024-09-10T05:36:05.716234+0000","last_active":"2024-09-10T05:36:05.716234+0000","last_peered":"2024-09-10T05:36:05.716234+0000","last_clean":"2024-09-10T05:36:05.716234+0000","last_became_active":"2024-09-10T05:36:03.705338+0000","last_became_peered":"2024-09-10T05:36:03.705338+0000","last_unstale":"2024-09-10T05:36:05.716234+0000","last_undegraded":"2024-09-10T05:36:05.716234+0000","last_fullsized":"2024-09-10T05:36:05.716234+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_clean_scrub_stamp":"2024-09-10T05:36:02.684661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:59.676796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010885789999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"17'2","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T05:36:05.715115+0000","last_change":"2024-09-10T05:36:05.710910+0000","last_active":"2024-09-10T05:36:05.715115+0000","last_peered":"2024-09-10T05:36:05.715115+0000","last_clean":"2024-09-10T05:36:05.715115+0000","last_became_active":"2024-09-10T05:36:03.708495+0000","last_became_peered":"2024-09-10T05:36:03.708495+0000","last_unstale":"2024-09-10T05:36:05.715115+0000","last_undegraded":"2024-09-10T05:36:05.715115+0000","last_fullsized":"2024-09-10T05:36:05.715115+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_clean_scrub_stamp":"2024-09-10T05:36:02.684661+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:51.729077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012525469999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T05:36:06.203202+0000","last_change":"2024-09-10T05:36:06.203202+0000","last_active":"2024-09-10T05:36:06.203202+0000","last_peered":"2024-09-10T05:36:06.203202+0000","last_clean":"2024-09-10T05:36:06.203202+0000","last_became_active":"2024-09-10T05:36:03.707045+0000","last_became_peered":"2024-09-10T05:36:03.707045+0000","last_unstale":"2024-09-10T05:36:06.203202+0000","last_undegraded":"2024-09-10T05:36:06.203202+0000","last_fullsized":"2024-09-10T05:36:06.203202+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_clean_scrub_stamp":"2024-09-10T05:36:02.684661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:47:09.787526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093121299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T05:36:05.710898+0000","last_change":"2024-09-10T05:36:05.710898+0000","last_active":"2024-09-10T05:36:05.710898+0000","last_peered":"2024-09-10T05:36:05.710898+0000","last_clean":"2024-09-10T05:36:05.710898+0000","last_became_active":"2024-09-10T05:36:03.706256+0000","last_became_peered":"2024-09-10T05:36:03.706256+0000","last_unstale":"2024-09-10T05:36:05.710898+0000","last_undegraded":"2024-09-10T05:36:05.710898+0000","last_fullsized":"2024-09-10T05:36:05.710898+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_clean_scrub_stamp":"2024-09-10T05:36:02.684661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:42:18.313806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001383542,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"15'1","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T05:36:05.711729+0000","last_change":"2024-09-10T05:36:05.711729+0000","last_active":"2024-09-10T05:36:05.711729+0000","last_peered":"2024-09-10T05:36:05.711729+0000","last_clean":"2024-09-10T05:36:05.711729+0000","last_became_active":"2024-09-10T05:36:03.710352+0000","last_became_peered":"2024-09-10T05:36:03.710352+0000","last_unstale":"2024-09-10T05:36:05.711729+0000","last_undegraded":"2024-09-10T05:36:05.711729+0000","last_fullsized":"2024-09-10T05:36:05.711729+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_clean_scrub_stamp":"2024-09-10T05:36:02.684661+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:03:30.592449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002047461,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"12'72","reported_seq":111,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T05:36:05.715195+0000","last_change":"2024-09-10T05:35:59.488460+0000","last_active":"2024-09-10T05:36:05.715195+0000","last_peered":"2024-09-10T05:36:05.715195+0000","last_clean":"2024-09-10T05:36:05.715195+0000","last_became_active":"2024-09-10T05:35:59.486077+0000","last_became_peered":"2024-09-10T05:35:59.486077+0000","last_unstale":"2024-09-10T05:36:05.715195+0000","last_undegraded":"2024-09-10T05:36:05.715195+0000","last_fullsized":"2024-09-10T05:36:05.715195+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:35:57.655557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:35:57.655557+0000","last_clean_scrub_stamp":"2024-09-10T05:35:57.655557+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:41:07.276856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640261,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31332,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340508,"statfs":{"total":96636764160,"available":96604680192,"internally_reserved":0,"allocated":147456,"data_stored":47409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672966,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":741376,"data_stored":637777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672967,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":745472,"data_stored":637796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949672966,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31336,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":151552,"data_stored":47428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T05:36:09.631 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T05:36:09.631 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-10T05:36:09.631 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-10T05:36:09.631 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T05:36:09.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.740+0000 7f3bb8f9b640 1 Processor -- start 2024-09-10T05:36:09.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.740+0000 7f3bb8f9b640 1 -- start start 2024-09-10T05:36:09.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.740+0000 7f3bb8f9b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3bb412aee0 0x7f3bb412b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:09.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.740+0000 7f3bb8f9b640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bb40008e0 con 0x7f3bb412f110 2024-09-10T05:36:09.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.740+0000 7f3bb8f9b640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f3bb4071e70 con 0x7f3bb412aee0 2024-09-10T05:36:09.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.740+0000 7f3bb1d9b640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f3bb412f110 0x7f3bb412f550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44226/0 (socket says 172.21.15.2:44226) 2024-09-10T05:36:09.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.740+0000 7f3bb1d9b640 1 -- 172.21.15.2:0/1504568827 learned_addr learned my addr 172.21.15.2:0/1504568827 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T05:36:09.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.740+0000 7f3bb259c640 1 --2- 172.21.15.2:0/1504568827 >> v2:172.21.15.2:3300/0 conn(0x7f3bb412aee0 0x7f3bb412b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:09.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.744+0000 7f3bb159a640 1 -- 172.21.15.2:0/1504568827 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1026026723 0 0) 0x7f3bb40008e0 con 0x7f3bb412f110 2024-09-10T05:36:09.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.744+0000 7f3bb159a640 1 -- 172.21.15.2:0/1504568827 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b9c003530 con 0x7f3bb412f110 2024-09-10T05:36:09.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.744+0000 7f3bb259c640 1 -- 172.21.15.2:0/1504568827 >> v1:172.21.15.2:6789/0 conn(0x7f3bb412f110 legacy=0x7f3bb412f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:09.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.744+0000 7f3bb159a640 1 -- 172.21.15.2:0/1504568827 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1470028378 0 0) 0x7f3b9c003530 con 0x7f3bb412f110 2024-09-10T05:36:09.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.744+0000 7f3bb259c640 1 -- 172.21.15.2:0/1504568827 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bb40a30b0 con 0x7f3bb412aee0 2024-09-10T05:36:09.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.744+0000 7f3bb259c640 1 --2- 172.21.15.2:0/1504568827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bb412aee0 0x7f3bb412b2c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3ba4009d90 tx=0x7f3ba401c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2593f5c5138983ca server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:09.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.748+0000 7f3bb159a640 1 -- 172.21.15.2:0/1504568827 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ba40b2070 con 0x7f3bb412aee0 2024-09-10T05:36:09.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.748+0000 7f3bb159a640 1 -- 172.21.15.2:0/1504568827 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ba40a55c0 con 0x7f3bb412aee0 2024-09-10T05:36:09.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.748+0000 7f3bb159a640 1 -- 172.21.15.2:0/1504568827 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ba8001630 con 0x7f3bb412aee0 2024-09-10T05:36:09.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.748+0000 7f3bb8f9b640 1 -- 172.21.15.2:0/1504568827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bb412aee0 msgr2=0x7f3bb412b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:09.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.748+0000 7f3bb8f9b640 1 --2- 172.21.15.2:0/1504568827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bb412aee0 0x7f3bb412b2c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3ba4009d90 tx=0x7f3ba401c7e0 comp rx=0 tx=0).stop 2024-09-10T05:36:09.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.748+0000 7f3bb8f9b640 1 -- 172.21.15.2:0/1504568827 shutdown_connections 2024-09-10T05:36:09.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.748+0000 7f3bb8f9b640 1 --2- 172.21.15.2:0/1504568827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bb412aee0 0x7f3bb412b2c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:09.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.748+0000 7f3bb8f9b640 1 -- 172.21.15.2:0/1504568827 >> 172.21.15.2:0/1504568827 conn(0x7f3bb40a0a60 msgr2=0x7f3bb406e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:09.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.748+0000 7f3bb8f9b640 1 -- 172.21.15.2:0/1504568827 shutdown_connections 2024-09-10T05:36:09.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.748+0000 7f3bb8f9b640 1 -- 172.21.15.2:0/1504568827 wait complete. 2024-09-10T05:36:09.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.748+0000 7f3bb8f9b640 1 Processor -- start 2024-09-10T05:36:09.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.748+0000 7f3bb8f9b640 1 -- start start 2024-09-10T05:36:09.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.748+0000 7f3bb8f9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bb412aee0 0x7f3bb41296c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:09.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.748+0000 7f3bb8f9b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3bb412b980 con 0x7f3bb412aee0 2024-09-10T05:36:09.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.748+0000 7f3bb259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bb412aee0 0x7f3bb41296c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:09.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.748+0000 7f3bb259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bb412aee0 0x7f3bb41296c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58554/0 (socket says 172.21.15.2:58554) 2024-09-10T05:36:09.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.748+0000 7f3bb259c640 1 -- 172.21.15.2:0/1147471137 learned_addr learned my addr 172.21.15.2:0/1147471137 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:36:09.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.748+0000 7f3bb259c640 1 -- 172.21.15.2:0/1147471137 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bb411bec0 con 0x7f3bb412aee0 2024-09-10T05:36:09.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.748+0000 7f3bb259c640 1 --2- 172.21.15.2:0/1147471137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bb412aee0 0x7f3bb41296c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3ba4009d90 tx=0x7f3ba4019580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:09.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.748+0000 7f3ba2ffd640 1 -- 172.21.15.2:0/1147471137 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ba40bd070 con 0x7f3bb412aee0 2024-09-10T05:36:09.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.748+0000 7f3ba2ffd640 1 -- 172.21.15.2:0/1147471137 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ba40039a0 con 0x7f3bb412aee0 2024-09-10T05:36:09.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.748+0000 7f3ba2ffd640 1 -- 172.21.15.2:0/1147471137 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ba40b2040 con 0x7f3bb412aee0 2024-09-10T05:36:09.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.748+0000 7f3bb8f9b640 1 -- 172.21.15.2:0/1147471137 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bb411c350 con 0x7f3bb412aee0 2024-09-10T05:36:09.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.748+0000 7f3bb8f9b640 1 -- 172.21.15.2:0/1147471137 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bb4129dd0 con 0x7f3bb412aee0 2024-09-10T05:36:09.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.752+0000 7f3bb8f9b640 1 -- 172.21.15.2:0/1147471137 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bb412b2c0 con 0x7f3bb412aee0 2024-09-10T05:36:09.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.752+0000 7f3ba2ffd640 1 -- 172.21.15.2:0/1147471137 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f3ba40b8470 con 0x7f3bb412aee0 2024-09-10T05:36:09.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.752+0000 7f3ba2ffd640 1 --2- 172.21.15.2:0/1147471137 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3b9403b1d0 0x7f3b9403d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:09.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.752+0000 7f3ba2ffd640 1 -- 172.21.15.2:0/1147471137 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f3ba40e9b10 con 0x7f3bb412aee0 2024-09-10T05:36:09.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.752+0000 7f3bb1d9b640 1 --2- 172.21.15.2:0/1147471137 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3b9403b1d0 0x7f3b9403d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:09.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.752+0000 7f3bb1d9b640 1 --2- 172.21.15.2:0/1147471137 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3b9403b1d0 0x7f3b9403d690 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8001ec0 tx=0x7f3ba80019b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:09.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.756+0000 7f3ba2ffd640 1 -- 172.21.15.2:0/1147471137 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f3ba4016460 con 0x7f3bb412aee0 2024-09-10T05:36:09.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.956+0000 7f3bb8f9b640 1 -- 172.21.15.2:0/1147471137 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3bb4073a80 con 0x7f3bb412aee0 2024-09-10T05:36:09.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.960+0000 7f3ba2ffd640 1 -- 172.21.15.2:0/1147471137 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f3ba40b7cd0 con 0x7f3bb412aee0 2024-09-10T05:36:09.962 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T05:36:09.962 INFO:teuthology.orchestra.run.smithi002.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-10T05:36:09.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.960+0000 7f3bb8f9b640 1 -- 172.21.15.2:0/1147471137 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3b9403b1d0 msgr2=0x7f3b9403d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:09.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.960+0000 7f3bb8f9b640 1 --2- 172.21.15.2:0/1147471137 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3b9403b1d0 0x7f3b9403d690 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8001ec0 tx=0x7f3ba80019b0 comp rx=0 tx=0).stop 2024-09-10T05:36:09.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.960+0000 7f3bb8f9b640 1 -- 172.21.15.2:0/1147471137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bb412aee0 msgr2=0x7f3bb41296c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:09.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.960+0000 7f3bb8f9b640 1 --2- 172.21.15.2:0/1147471137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bb412aee0 0x7f3bb41296c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3ba4009d90 tx=0x7f3ba4019580 comp rx=0 tx=0).stop 2024-09-10T05:36:09.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.960+0000 7f3bb8f9b640 1 -- 172.21.15.2:0/1147471137 shutdown_connections 2024-09-10T05:36:09.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.960+0000 7f3bb8f9b640 1 --2- 172.21.15.2:0/1147471137 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3b9403b1d0 0x7f3b9403d690 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:09.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.960+0000 7f3bb8f9b640 1 --2- 172.21.15.2:0/1147471137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bb412aee0 0x7f3bb41296c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:09.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.960+0000 7f3bb8f9b640 1 -- 172.21.15.2:0/1147471137 >> 172.21.15.2:0/1147471137 conn(0x7f3bb40a0a60 msgr2=0x7f3bb40a0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:09.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.960+0000 7f3bb8f9b640 1 -- 172.21.15.2:0/1147471137 shutdown_connections 2024-09-10T05:36:09.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:36:09.960+0000 7f3bb8f9b640 1 -- 172.21.15.2:0/1147471137 wait complete. 2024-09-10T05:36:09.980 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-10T05:36:09.980 INFO:teuthology.run_tasks:Running task rgw... 2024-09-10T05:36:09.995 DEBUG:tasks.rgw:config is {'client.0': None} 2024-09-10T05:36:09.995 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-10T05:36:09.995 INFO:tasks.rgw:Creating data pools 2024-09-10T05:36:09.995 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-10T05:36:09.995 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2024-09-10T05:36:10.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.127+0000 7fadc350f640 1 Processor -- start 2024-09-10T05:36:10.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.127+0000 7fadc350f640 1 -- start start 2024-09-10T05:36:10.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.127+0000 7fadc350f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fadbc0743f0 0x7fadbc0747d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:10.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.127+0000 7fadc350f640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadbc074ec0 con 0x7fadbc112350 2024-09-10T05:36:10.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.127+0000 7fadc350f640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fadbc112ef0 con 0x7fadbc0743f0 2024-09-10T05:36:10.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.127+0000 7fadc0aaa640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fadbc112350 0x7fadbc1127e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:56714/0 (socket says 172.21.15.62:56714) 2024-09-10T05:36:10.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.127+0000 7fadc0aaa640 1 -- 172.21.15.62:0/3337081055 learned_addr learned my addr 172.21.15.62:0/3337081055 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-10T05:36:10.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.127+0000 7fadc12ab640 1 --2- 172.21.15.62:0/3337081055 >> v2:172.21.15.2:3300/0 conn(0x7fadbc0743f0 0x7fadbc0747d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:10.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.127+0000 7fadaffff640 1 -- 172.21.15.62:0/3337081055 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1859369113 0 0) 0x7fadbc074ec0 con 0x7fadbc112350 2024-09-10T05:36:10.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.127+0000 7fadaffff640 1 -- 172.21.15.62:0/3337081055 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fada8003530 con 0x7fadbc112350 2024-09-10T05:36:10.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.127+0000 7fadc12ab640 1 -- 172.21.15.62:0/3337081055 >> v1:172.21.15.2:6789/0 conn(0x7fadbc112350 legacy=0x7fadbc1127e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:10.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.127+0000 7fadc12ab640 1 -- 172.21.15.62:0/3337081055 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadbc1130a0 con 0x7fadbc0743f0 2024-09-10T05:36:10.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.131+0000 7fadc12ab640 1 --2- 172.21.15.62:0/3337081055 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadbc0743f0 0x7fadbc0747d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fadb0009740 tx=0x7fadb001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a33eb3d8462a3913 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:10.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.131+0000 7fadaffff640 1 -- 172.21.15.62:0/3337081055 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadb00b1070 con 0x7fadbc0743f0 2024-09-10T05:36:10.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.131+0000 7fadaffff640 1 -- 172.21.15.62:0/3337081055 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadb00ac520 con 0x7fadbc0743f0 2024-09-10T05:36:10.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.131+0000 7fadaffff640 1 -- 172.21.15.62:0/3337081055 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadb00ac820 con 0x7fadbc0743f0 2024-09-10T05:36:10.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.131+0000 7fadc350f640 1 -- 172.21.15.62:0/3337081055 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadbc0743f0 msgr2=0x7fadbc0747d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:10.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.131+0000 7fadc350f640 1 --2- 172.21.15.62:0/3337081055 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadbc0743f0 0x7fadbc0747d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fadb0009740 tx=0x7fadb001c370 comp rx=0 tx=0).stop 2024-09-10T05:36:10.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.131+0000 7fadc350f640 1 -- 172.21.15.62:0/3337081055 shutdown_connections 2024-09-10T05:36:10.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.131+0000 7fadc350f640 1 --2- 172.21.15.62:0/3337081055 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadbc0743f0 0x7fadbc0747d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:10.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.131+0000 7fadc350f640 1 -- 172.21.15.62:0/3337081055 >> 172.21.15.62:0/3337081055 conn(0x7fadbc06fe70 msgr2=0x7fadbc072290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:10.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.131+0000 7fadc350f640 1 -- 172.21.15.62:0/3337081055 shutdown_connections 2024-09-10T05:36:10.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.131+0000 7fadc350f640 1 -- 172.21.15.62:0/3337081055 wait complete. 2024-09-10T05:36:10.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.131+0000 7fadc350f640 1 Processor -- start 2024-09-10T05:36:10.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.131+0000 7fadc350f640 1 -- start start 2024-09-10T05:36:10.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.131+0000 7fadc350f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadbc0743f0 0x7fadbc1a9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:10.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.131+0000 7fadc350f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fadbc11e250 con 0x7fadbc0743f0 2024-09-10T05:36:10.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.131+0000 7fadc12ab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadbc0743f0 0x7fadbc1a9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:10.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.131+0000 7fadc12ab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadbc0743f0 0x7fadbc1a9d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:53586/0 (socket says 172.21.15.62:53586) 2024-09-10T05:36:10.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.131+0000 7fadc12ab640 1 -- 172.21.15.62:0/3194168113 learned_addr learned my addr 172.21.15.62:0/3194168113 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:10.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.135+0000 7fadc12ab640 1 -- 172.21.15.62:0/3194168113 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadbc1aa300 con 0x7fadbc0743f0 2024-09-10T05:36:10.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.135+0000 7fadc12ab640 1 --2- 172.21.15.62:0/3194168113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadbc0743f0 0x7fadbc1a9d30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fadb001aa20 tx=0x7fadb001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:10.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.135+0000 7fadadffb640 1 -- 172.21.15.62:0/3194168113 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadb00b1050 con 0x7fadbc0743f0 2024-09-10T05:36:10.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.135+0000 7fadc350f640 1 -- 172.21.15.62:0/3194168113 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadbc1aa590 con 0x7fadbc0743f0 2024-09-10T05:36:10.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.135+0000 7fadadffb640 1 -- 172.21.15.62:0/3194168113 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadb00b2040 con 0x7fadbc0743f0 2024-09-10T05:36:10.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.135+0000 7fadadffb640 1 -- 172.21.15.62:0/3194168113 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadb00ab8d0 con 0x7fadbc0743f0 2024-09-10T05:36:10.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.135+0000 7fadc350f640 1 -- 172.21.15.62:0/3194168113 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadbc1af570 con 0x7fadbc0743f0 2024-09-10T05:36:10.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.135+0000 7fadc350f640 1 -- 172.21.15.62:0/3194168113 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadbc0747d0 con 0x7fadbc0743f0 2024-09-10T05:36:10.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.135+0000 7fadadffb640 1 -- 172.21.15.62:0/3194168113 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fadb00bf030 con 0x7fadbc0743f0 2024-09-10T05:36:10.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.135+0000 7fadadffb640 1 --2- 172.21.15.62:0/3194168113 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fada003b1b0 0x7fada003d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:10.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.135+0000 7fadadffb640 1 -- 172.21.15.62:0/3194168113 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fadb00bd070 con 0x7fadbc0743f0 2024-09-10T05:36:10.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.135+0000 7fadc0aaa640 1 --2- 172.21.15.62:0/3194168113 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fada003b1b0 0x7fada003d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:10.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.135+0000 7fadc0aaa640 1 --2- 172.21.15.62:0/3194168113 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fada003b1b0 0x7fada003d670 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fadb8007fd0 tx=0x7fadb8007980 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:10.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.147+0000 7fadadffb640 1 -- 172.21.15.62:0/3194168113 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fadb00c6020 con 0x7fadbc0743f0 2024-09-10T05:36:10.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.323+0000 7fadc350f640 1 -- 172.21.15.62:0/3194168113 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7fadbc112350 con 0x7fadbc0743f0 2024-09-10T05:36:10.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.947+0000 7fadadffb640 1 -- 172.21.15.62:0/3194168113 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.data' created v18) ==== 167+0+0 (secure 0 0 0) 0x7fadb00a9070 con 0x7fadbc0743f0 2024-09-10T05:36:10.948 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'default.rgw.buckets.data' created 2024-09-10T05:36:10.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.947+0000 7fadc350f640 1 -- 172.21.15.62:0/3194168113 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fada003b1b0 msgr2=0x7fada003d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:10.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.947+0000 7fadc350f640 1 --2- 172.21.15.62:0/3194168113 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fada003b1b0 0x7fada003d670 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fadb8007fd0 tx=0x7fadb8007980 comp rx=0 tx=0).stop 2024-09-10T05:36:10.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.947+0000 7fadc350f640 1 -- 172.21.15.62:0/3194168113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadbc0743f0 msgr2=0x7fadbc1a9d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:10.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.947+0000 7fadc350f640 1 --2- 172.21.15.62:0/3194168113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadbc0743f0 0x7fadbc1a9d30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fadb001aa20 tx=0x7fadb001abb0 comp rx=0 tx=0).stop 2024-09-10T05:36:10.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.947+0000 7fadc350f640 1 -- 172.21.15.62:0/3194168113 shutdown_connections 2024-09-10T05:36:10.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.947+0000 7fadc350f640 1 --2- 172.21.15.62:0/3194168113 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fada003b1b0 0x7fada003d670 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:10.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.947+0000 7fadc350f640 1 --2- 172.21.15.62:0/3194168113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadbc0743f0 0x7fadbc1a9d30 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:10.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.947+0000 7fadc350f640 1 -- 172.21.15.62:0/3194168113 >> 172.21.15.62:0/3194168113 conn(0x7fadbc06fe70 msgr2=0x7fadbc10ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:10.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.947+0000 7fadc350f640 1 -- 172.21.15.62:0/3194168113 shutdown_connections 2024-09-10T05:36:10.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:10.951+0000 7fadc350f640 1 -- 172.21.15.62:0/3194168113 wait complete. 2024-09-10T05:36:10.984 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-10T05:36:11.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.111+0000 7fcffdb6d640 1 Processor -- start 2024-09-10T05:36:11.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.111+0000 7fcffdb6d640 1 -- start start 2024-09-10T05:36:11.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.111+0000 7fcffdb6d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcff8116930 0x7fcff8116d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:11.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.111+0000 7fcffdb6d640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcff8074a70 con 0x7fcff8073ed0 2024-09-10T05:36:11.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.111+0000 7fcffdb6d640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fcff8117330 con 0x7fcff8116930 2024-09-10T05:36:11.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.111+0000 7fcff77fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcff8116930 0x7fcff8116d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:11.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.111+0000 7fcff77fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcff8116930 0x7fcff8116d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:53592/0 (socket says 172.21.15.62:53592) 2024-09-10T05:36:11.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.111+0000 7fcff77fe640 1 -- 172.21.15.62:0/3328446121 learned_addr learned my addr 172.21.15.62:0/3328446121 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:11.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.111+0000 7fcff6ffd640 1 --1- 172.21.15.62:0/3328446121 >> v1:172.21.15.2:6789/0 conn(0x7fcff8073ed0 0x7fcff8074360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:56718/0 (socket says 172.21.15.62:56718) 2024-09-10T05:36:11.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.111+0000 7fcff77fe640 1 -- 172.21.15.62:0/3328446121 >> v1:172.21.15.2:6789/0 conn(0x7fcff8073ed0 legacy=0x7fcff8074360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:11.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.111+0000 7fcff77fe640 1 -- 172.21.15.62:0/3328446121 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcff8074c70 con 0x7fcff8116930 2024-09-10T05:36:11.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.115+0000 7fcff77fe640 1 --2- 172.21.15.62:0/3328446121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcff8116930 0x7fcff8116d10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcfe80097f0 tx=0x7fcfe801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8feb00e0db63c335 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:11.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.115+0000 7fcff67fc640 1 -- 172.21.15.62:0/3328446121 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfe80ab580 con 0x7fcff8116930 2024-09-10T05:36:11.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.115+0000 7fcff67fc640 1 -- 172.21.15.62:0/3328446121 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfe80b0070 con 0x7fcff8116930 2024-09-10T05:36:11.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.115+0000 7fcff67fc640 1 -- 172.21.15.62:0/3328446121 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfe80ab870 con 0x7fcff8116930 2024-09-10T05:36:11.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.115+0000 7fcffdb6d640 1 -- 172.21.15.62:0/3328446121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcff8116930 msgr2=0x7fcff8116d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:11.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.115+0000 7fcffdb6d640 1 --2- 172.21.15.62:0/3328446121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcff8116930 0x7fcff8116d10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcfe80097f0 tx=0x7fcfe801c430 comp rx=0 tx=0).stop 2024-09-10T05:36:11.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.115+0000 7fcffdb6d640 1 -- 172.21.15.62:0/3328446121 shutdown_connections 2024-09-10T05:36:11.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.115+0000 7fcffdb6d640 1 --2- 172.21.15.62:0/3328446121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcff8116930 0x7fcff8116d10 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:11.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.115+0000 7fcffdb6d640 1 -- 172.21.15.62:0/3328446121 >> 172.21.15.62:0/3328446121 conn(0x7fcff806fe70 msgr2=0x7fcff8072290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:11.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.115+0000 7fcffdb6d640 1 -- 172.21.15.62:0/3328446121 shutdown_connections 2024-09-10T05:36:11.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.115+0000 7fcffdb6d640 1 -- 172.21.15.62:0/3328446121 wait complete. 2024-09-10T05:36:11.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.115+0000 7fcffdb6d640 1 Processor -- start 2024-09-10T05:36:11.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.115+0000 7fcffdb6d640 1 -- start start 2024-09-10T05:36:11.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.115+0000 7fcffdb6d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcff8073ed0 0x7fcff81ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:11.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.115+0000 7fcffdb6d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcff8123980 con 0x7fcff8073ed0 2024-09-10T05:36:11.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.115+0000 7fcff77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcff8073ed0 0x7fcff81ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:11.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.115+0000 7fcff77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcff8073ed0 0x7fcff81ae2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:53594/0 (socket says 172.21.15.62:53594) 2024-09-10T05:36:11.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.115+0000 7fcff77fe640 1 -- 172.21.15.62:0/2862453372 learned_addr learned my addr 172.21.15.62:0/2862453372 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:11.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.115+0000 7fcff77fe640 1 -- 172.21.15.62:0/2862453372 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcff81ae890 con 0x7fcff8073ed0 2024-09-10T05:36:11.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.119+0000 7fcff77fe640 1 --2- 172.21.15.62:0/2862453372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcff8073ed0 0x7fcff81ae2c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcfe80ad040 tx=0x7fcfe801ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:11.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.119+0000 7fcfdffff640 1 -- 172.21.15.62:0/2862453372 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfe80aa7f0 con 0x7fcff8073ed0 2024-09-10T05:36:11.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.119+0000 7fcffdb6d640 1 -- 172.21.15.62:0/2862453372 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcff81aeb20 con 0x7fcff8073ed0 2024-09-10T05:36:11.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.119+0000 7fcfdffff640 1 -- 172.21.15.62:0/2862453372 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfe80aa990 con 0x7fcff8073ed0 2024-09-10T05:36:11.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.119+0000 7fcffdb6d640 1 -- 172.21.15.62:0/2862453372 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcff81b3b80 con 0x7fcff8073ed0 2024-09-10T05:36:11.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.119+0000 7fcfdffff640 1 -- 172.21.15.62:0/2862453372 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfe80aac70 con 0x7fcff8073ed0 2024-09-10T05:36:11.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.119+0000 7fcffdb6d640 1 -- 172.21.15.62:0/2862453372 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcff8116930 con 0x7fcff8073ed0 2024-09-10T05:36:11.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.119+0000 7fcfdffff640 1 -- 172.21.15.62:0/2862453372 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fcfe80be3f0 con 0x7fcff8073ed0 2024-09-10T05:36:11.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.119+0000 7fcfdffff640 1 --2- 172.21.15.62:0/2862453372 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fcfe403b1b0 0x7fcfe403d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:11.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.119+0000 7fcfdffff640 1 -- 172.21.15.62:0/2862453372 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3873+0+0 (secure 0 0 0) 0x7fcfe80ea4c0 con 0x7fcff8073ed0 2024-09-10T05:36:11.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.119+0000 7fcff6ffd640 1 --2- 172.21.15.62:0/2862453372 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fcfe403b1b0 0x7fcfe403d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:11.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.119+0000 7fcff6ffd640 1 --2- 172.21.15.62:0/2862453372 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fcfe403b1b0 0x7fcfe403d670 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fcfec0015f0 tx=0x7fcfec007a50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:11.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.131+0000 7fcfdffff640 1 -- 172.21.15.62:0/2862453372 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fcfe80cc020 con 0x7fcff8073ed0 2024-09-10T05:36:11.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.315+0000 7fcffdb6d640 1 -- 172.21.15.62:0/2862453372 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) -- 0x7fcff8116b70 con 0x7fcff8073ed0 2024-09-10T05:36:11.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.567+0000 7fcfdffff640 1 -- 172.21.15.62:0/2862453372 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v19) ==== 185+0+0 (secure 0 0 0) 0x7fcfe80160b0 con 0x7fcff8073ed0 2024-09-10T05:36:11.571 INFO:teuthology.orchestra.run.smithi062.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-10T05:36:11.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.571+0000 7fcffdb6d640 1 -- 172.21.15.62:0/2862453372 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fcfe403b1b0 msgr2=0x7fcfe403d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:11.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.571+0000 7fcffdb6d640 1 --2- 172.21.15.62:0/2862453372 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fcfe403b1b0 0x7fcfe403d670 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fcfec0015f0 tx=0x7fcfec007a50 comp rx=0 tx=0).stop 2024-09-10T05:36:11.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.571+0000 7fcffdb6d640 1 -- 172.21.15.62:0/2862453372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcff8073ed0 msgr2=0x7fcff81ae2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:11.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.571+0000 7fcffdb6d640 1 --2- 172.21.15.62:0/2862453372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcff8073ed0 0x7fcff81ae2c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcfe80ad040 tx=0x7fcfe801ac70 comp rx=0 tx=0).stop 2024-09-10T05:36:11.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.575+0000 7fcffdb6d640 1 -- 172.21.15.62:0/2862453372 shutdown_connections 2024-09-10T05:36:11.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.575+0000 7fcffdb6d640 1 --2- 172.21.15.62:0/2862453372 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fcfe403b1b0 0x7fcfe403d670 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:11.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.575+0000 7fcffdb6d640 1 --2- 172.21.15.62:0/2862453372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcff8073ed0 0x7fcff81ae2c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:11.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.575+0000 7fcffdb6d640 1 -- 172.21.15.62:0/2862453372 >> 172.21.15.62:0/2862453372 conn(0x7fcff806fe70 msgr2=0x7fcff8121ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:11.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.575+0000 7fcffdb6d640 1 -- 172.21.15.62:0/2862453372 shutdown_connections 2024-09-10T05:36:11.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.575+0000 7fcffdb6d640 1 -- 172.21.15.62:0/2862453372 wait complete. 2024-09-10T05:36:11.619 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-10T05:36:11.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.735+0000 7fb5af3d9640 1 Processor -- start 2024-09-10T05:36:11.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.735+0000 7fb5af3d9640 1 -- start start 2024-09-10T05:36:11.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.735+0000 7fb5af3d9640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb5a8113070 0x7fb5a8113450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:11.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.735+0000 7fb5af3d9640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5a8113b40 con 0x7fb5a8116660 2024-09-10T05:36:11.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.735+0000 7fb5af3d9640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fb5a8117200 con 0x7fb5a8113070 2024-09-10T05:36:11.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.735+0000 7fb5ad175640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb5a8113070 0x7fb5a8113450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:11.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.735+0000 7fb5ac974640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb5a8116660 0x7fb5a8116af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:56734/0 (socket says 172.21.15.62:56734) 2024-09-10T05:36:11.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.735+0000 7fb5ad175640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb5a8113070 0x7fb5a8113450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:53604/0 (socket says 172.21.15.62:53604) 2024-09-10T05:36:11.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.735+0000 7fb5ac974640 1 -- 172.21.15.62:0/2417321327 learned_addr learned my addr 172.21.15.62:0/2417321327 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-10T05:36:11.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.735+0000 7fb5ad175640 1 -- 172.21.15.62:0/2417321327 >> v1:172.21.15.2:6789/0 conn(0x7fb5a8116660 legacy=0x7fb5a8116af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:11.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.735+0000 7fb5ad175640 1 -- 172.21.15.62:0/2417321327 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5a81173b0 con 0x7fb5a8113070 2024-09-10T05:36:11.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.739+0000 7fb5ad175640 1 --2- 172.21.15.62:0/2417321327 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5a8113070 0x7fb5a8113450 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb5a4009740 tx=0x7fb5a401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=944c871d0745490b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:11.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.739+0000 7fb59bfff640 1 -- 172.21.15.62:0/2417321327 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5a40b1070 con 0x7fb5a8113070 2024-09-10T05:36:11.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.739+0000 7fb59bfff640 1 -- 172.21.15.62:0/2417321327 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5a40ac520 con 0x7fb5a8113070 2024-09-10T05:36:11.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.739+0000 7fb59bfff640 1 -- 172.21.15.62:0/2417321327 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5a40ac820 con 0x7fb5a8113070 2024-09-10T05:36:11.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.739+0000 7fb5af3d9640 1 -- 172.21.15.62:0/2417321327 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5a8113070 msgr2=0x7fb5a8113450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:11.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.739+0000 7fb5af3d9640 1 --2- 172.21.15.62:0/2417321327 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5a8113070 0x7fb5a8113450 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb5a4009740 tx=0x7fb5a401c370 comp rx=0 tx=0).stop 2024-09-10T05:36:11.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.739+0000 7fb5af3d9640 1 -- 172.21.15.62:0/2417321327 shutdown_connections 2024-09-10T05:36:11.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.739+0000 7fb5af3d9640 1 --2- 172.21.15.62:0/2417321327 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5a8113070 0x7fb5a8113450 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:11.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.739+0000 7fb5af3d9640 1 -- 172.21.15.62:0/2417321327 >> 172.21.15.62:0/2417321327 conn(0x7fb5a806f370 msgr2=0x7fb5a806f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:11.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.739+0000 7fb5af3d9640 1 -- 172.21.15.62:0/2417321327 shutdown_connections 2024-09-10T05:36:11.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.739+0000 7fb5af3d9640 1 -- 172.21.15.62:0/2417321327 wait complete. 2024-09-10T05:36:11.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.739+0000 7fb5af3d9640 1 Processor -- start 2024-09-10T05:36:11.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.739+0000 7fb5af3d9640 1 -- start start 2024-09-10T05:36:11.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.743+0000 7fb5af3d9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5a8113070 0x7fb5a81a9f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:11.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.743+0000 7fb5af3d9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a81214d0 con 0x7fb5a8113070 2024-09-10T05:36:11.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.743+0000 7fb5ad175640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5a8113070 0x7fb5a81a9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:11.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.743+0000 7fb5ad175640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5a8113070 0x7fb5a81a9f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:53616/0 (socket says 172.21.15.62:53616) 2024-09-10T05:36:11.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.743+0000 7fb5ad175640 1 -- 172.21.15.62:0/3871226778 learned_addr learned my addr 172.21.15.62:0/3871226778 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:11.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.743+0000 7fb5ad175640 1 -- 172.21.15.62:0/3871226778 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5a81aa540 con 0x7fb5a8113070 2024-09-10T05:36:11.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.743+0000 7fb5ad175640 1 --2- 172.21.15.62:0/3871226778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5a8113070 0x7fb5a81a9f70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb5a401aa20 tx=0x7fb5a401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:11.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.743+0000 7fb599ffb640 1 -- 172.21.15.62:0/3871226778 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5a40b1050 con 0x7fb5a8113070 2024-09-10T05:36:11.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.743+0000 7fb599ffb640 1 -- 172.21.15.62:0/3871226778 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5a40b2040 con 0x7fb5a8113070 2024-09-10T05:36:11.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.743+0000 7fb5af3d9640 1 -- 172.21.15.62:0/3871226778 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5a81aa7d0 con 0x7fb5a8113070 2024-09-10T05:36:11.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.743+0000 7fb599ffb640 1 -- 172.21.15.62:0/3871226778 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5a40abb30 con 0x7fb5a8113070 2024-09-10T05:36:11.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.743+0000 7fb5af3d9640 1 -- 172.21.15.62:0/3871226778 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5a81af7b0 con 0x7fb5a8113070 2024-09-10T05:36:11.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.743+0000 7fb5af3d9640 1 -- 172.21.15.62:0/3871226778 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5a81134d0 con 0x7fb5a8113070 2024-09-10T05:36:11.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.743+0000 7fb599ffb640 1 -- 172.21.15.62:0/3871226778 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb5a40bf030 con 0x7fb5a8113070 2024-09-10T05:36:11.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.743+0000 7fb599ffb640 1 --2- 172.21.15.62:0/3871226778 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb58c03b200 0x7fb58c03d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:11.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.743+0000 7fb599ffb640 1 -- 172.21.15.62:0/3871226778 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3884+0+0 (secure 0 0 0) 0x7fb5a40bd070 con 0x7fb5a8113070 2024-09-10T05:36:11.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.743+0000 7fb5ac974640 1 --2- 172.21.15.62:0/3871226778 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb58c03b200 0x7fb58c03d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:11.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.747+0000 7fb5ac974640 1 --2- 172.21.15.62:0/3871226778 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb58c03b200 0x7fb58c03d6c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb59c0020f0 tx=0x7fb59c0016e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:11.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.759+0000 7fb599ffb640 1 -- 172.21.15.62:0/3871226778 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fb5a40c6020 con 0x7fb5a8113070 2024-09-10T05:36:11.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:11.931+0000 7fb5af3d9640 1 -- 172.21.15.62:0/3871226778 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7fb5a8116660 con 0x7fb5a8113070 2024-09-10T05:36:12.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.571+0000 7fb599ffb640 1 -- 172.21.15.62:0/3871226778 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v20) ==== 169+0+0 (secure 0 0 0) 0x7fb5a40a9070 con 0x7fb5a8113070 2024-09-10T05:36:12.576 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'default.rgw.buckets.index' created 2024-09-10T05:36:12.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.575+0000 7fb5af3d9640 1 -- 172.21.15.62:0/3871226778 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb58c03b200 msgr2=0x7fb58c03d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:12.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.575+0000 7fb5af3d9640 1 --2- 172.21.15.62:0/3871226778 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb58c03b200 0x7fb58c03d6c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb59c0020f0 tx=0x7fb59c0016e0 comp rx=0 tx=0).stop 2024-09-10T05:36:12.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.575+0000 7fb5af3d9640 1 -- 172.21.15.62:0/3871226778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5a8113070 msgr2=0x7fb5a81a9f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:12.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.575+0000 7fb5af3d9640 1 --2- 172.21.15.62:0/3871226778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5a8113070 0x7fb5a81a9f70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb5a401aa20 tx=0x7fb5a401abb0 comp rx=0 tx=0).stop 2024-09-10T05:36:12.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.575+0000 7fb5af3d9640 1 -- 172.21.15.62:0/3871226778 shutdown_connections 2024-09-10T05:36:12.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.575+0000 7fb5af3d9640 1 --2- 172.21.15.62:0/3871226778 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb58c03b200 0x7fb58c03d6c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:12.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.575+0000 7fb5af3d9640 1 --2- 172.21.15.62:0/3871226778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5a8113070 0x7fb5a81a9f70 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:12.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.575+0000 7fb5af3d9640 1 -- 172.21.15.62:0/3871226778 >> 172.21.15.62:0/3871226778 conn(0x7fb5a806f370 msgr2=0x7fb5a8114fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:12.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.579+0000 7fb5af3d9640 1 -- 172.21.15.62:0/3871226778 shutdown_connections 2024-09-10T05:36:12.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.579+0000 7fb5af3d9640 1 -- 172.21.15.62:0/3871226778 wait complete. 2024-09-10T05:36:12.610 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-10T05:36:12.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.735+0000 7fdca1f7f640 1 Processor -- start 2024-09-10T05:36:12.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.735+0000 7fdca1f7f640 1 -- start start 2024-09-10T05:36:12.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.735+0000 7fdca1f7f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdc9c113070 0x7fdc9c113450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:12.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.735+0000 7fdca1f7f640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc9c113b40 con 0x7fdc9c116660 2024-09-10T05:36:12.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.735+0000 7fdca1f7f640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fdc9c117200 con 0x7fdc9c113070 2024-09-10T05:36:12.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.735+0000 7fdc9b7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdc9c113070 0x7fdc9c113450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:12.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.735+0000 7fdc9b7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdc9c113070 0x7fdc9c113450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:53630/0 (socket says 172.21.15.62:53630) 2024-09-10T05:36:12.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.735+0000 7fdc9b7fe640 1 -- 172.21.15.62:0/849209652 learned_addr learned my addr 172.21.15.62:0/849209652 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:12.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.735+0000 7fdc9b7fe640 1 -- 172.21.15.62:0/849209652 >> v1:172.21.15.2:6789/0 conn(0x7fdc9c116660 legacy=0x7fdc9c116af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:12.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.735+0000 7fdc9b7fe640 1 -- 172.21.15.62:0/849209652 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc9c1173b0 con 0x7fdc9c113070 2024-09-10T05:36:12.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.739+0000 7fdc9b7fe640 1 --2- 172.21.15.62:0/849209652 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc9c113070 0x7fdc9c113450 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c0097f0 tx=0x7fdc8c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97fc69d719220497 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:12.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.739+0000 7fdc9a7fc640 1 -- 172.21.15.62:0/849209652 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc8c0ab580 con 0x7fdc9c113070 2024-09-10T05:36:12.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.739+0000 7fdc9a7fc640 1 -- 172.21.15.62:0/849209652 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc8c0b0070 con 0x7fdc9c113070 2024-09-10T05:36:12.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.739+0000 7fdc9a7fc640 1 -- 172.21.15.62:0/849209652 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc8c0ab870 con 0x7fdc9c113070 2024-09-10T05:36:12.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.739+0000 7fdca1f7f640 1 -- 172.21.15.62:0/849209652 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc9c113070 msgr2=0x7fdc9c113450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:12.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.739+0000 7fdca1f7f640 1 --2- 172.21.15.62:0/849209652 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc9c113070 0x7fdc9c113450 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c0097f0 tx=0x7fdc8c01c430 comp rx=0 tx=0).stop 2024-09-10T05:36:12.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.739+0000 7fdca1f7f640 1 -- 172.21.15.62:0/849209652 shutdown_connections 2024-09-10T05:36:12.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.739+0000 7fdca1f7f640 1 --2- 172.21.15.62:0/849209652 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc9c113070 0x7fdc9c113450 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:12.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.739+0000 7fdca1f7f640 1 -- 172.21.15.62:0/849209652 >> 172.21.15.62:0/849209652 conn(0x7fdc9c06f370 msgr2=0x7fdc9c06f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:12.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.739+0000 7fdca1f7f640 1 -- 172.21.15.62:0/849209652 shutdown_connections 2024-09-10T05:36:12.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.739+0000 7fdca1f7f640 1 -- 172.21.15.62:0/849209652 wait complete. 2024-09-10T05:36:12.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.739+0000 7fdca1f7f640 1 Processor -- start 2024-09-10T05:36:12.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.739+0000 7fdca1f7f640 1 -- start start 2024-09-10T05:36:12.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.739+0000 7fdca1f7f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc9c113070 0x7fdc9c1a9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:12.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.743+0000 7fdca1f7f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdc9c1214d0 con 0x7fdc9c113070 2024-09-10T05:36:12.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.743+0000 7fdc9b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc9c113070 0x7fdc9c1a9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:12.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.743+0000 7fdc9b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc9c113070 0x7fdc9c1a9f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:53644/0 (socket says 172.21.15.62:53644) 2024-09-10T05:36:12.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.743+0000 7fdc9b7fe640 1 -- 172.21.15.62:0/1954519678 learned_addr learned my addr 172.21.15.62:0/1954519678 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:12.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.743+0000 7fdc9b7fe640 1 -- 172.21.15.62:0/1954519678 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc9c1aa4e0 con 0x7fdc9c113070 2024-09-10T05:36:12.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.743+0000 7fdc9b7fe640 1 --2- 172.21.15.62:0/1954519678 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc9c113070 0x7fdc9c1a9f10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c019040 tx=0x7fdc8c01ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:12.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.743+0000 7fdc93fff640 1 -- 172.21.15.62:0/1954519678 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc8c0abe10 con 0x7fdc9c113070 2024-09-10T05:36:12.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.743+0000 7fdc93fff640 1 -- 172.21.15.62:0/1954519678 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc8c0aa8f0 con 0x7fdc9c113070 2024-09-10T05:36:12.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.743+0000 7fdca1f7f640 1 -- 172.21.15.62:0/1954519678 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc9c1aa770 con 0x7fdc9c113070 2024-09-10T05:36:12.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.743+0000 7fdc93fff640 1 -- 172.21.15.62:0/1954519678 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc8c0aac10 con 0x7fdc9c113070 2024-09-10T05:36:12.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.743+0000 7fdca1f7f640 1 -- 172.21.15.62:0/1954519678 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc9c1af750 con 0x7fdc9c113070 2024-09-10T05:36:12.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.743+0000 7fdca1f7f640 1 -- 172.21.15.62:0/1954519678 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc9c1134d0 con 0x7fdc9c113070 2024-09-10T05:36:12.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.743+0000 7fdc93fff640 1 -- 172.21.15.62:0/1954519678 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fdc8c0c7440 con 0x7fdc9c113070 2024-09-10T05:36:12.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.743+0000 7fdc93fff640 1 --2- 172.21.15.62:0/1954519678 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fdc7c03b1b0 0x7fdc7c03d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:12.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.743+0000 7fdc93fff640 1 -- 172.21.15.62:0/1954519678 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4220+0+0 (secure 0 0 0) 0x7fdc8c0ea000 con 0x7fdc9c113070 2024-09-10T05:36:12.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.743+0000 7fdc9affd640 1 --2- 172.21.15.62:0/1954519678 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fdc7c03b1b0 0x7fdc7c03d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:12.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.747+0000 7fdc9affd640 1 --2- 172.21.15.62:0/1954519678 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fdc7c03b1b0 0x7fdc7c03d670 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdc84000f70 tx=0x7fdc84007a40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:12.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.759+0000 7fdc93fff640 1 -- 172.21.15.62:0/1954519678 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fdc8c0160b0 con 0x7fdc9c113070 2024-09-10T05:36:12.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:12.931+0000 7fdca1f7f640 1 -- 172.21.15.62:0/1954519678 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) -- 0x7fdc9c116660 con 0x7fdc9c113070 2024-09-10T05:36:13.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:13.575+0000 7fdc93fff640 1 -- 172.21.15.62:0/1954519678 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v21) ==== 187+0+0 (secure 0 0 0) 0x7fdc8c0aae00 con 0x7fdc9c113070 2024-09-10T05:36:13.581 INFO:teuthology.orchestra.run.smithi062.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-10T05:36:13.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:13.575+0000 7fdca1f7f640 1 -- 172.21.15.62:0/1954519678 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fdc7c03b1b0 msgr2=0x7fdc7c03d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:13.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:13.575+0000 7fdca1f7f640 1 --2- 172.21.15.62:0/1954519678 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fdc7c03b1b0 0x7fdc7c03d670 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdc84000f70 tx=0x7fdc84007a40 comp rx=0 tx=0).stop 2024-09-10T05:36:13.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:13.575+0000 7fdca1f7f640 1 -- 172.21.15.62:0/1954519678 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc9c113070 msgr2=0x7fdc9c1a9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:13.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:13.575+0000 7fdca1f7f640 1 --2- 172.21.15.62:0/1954519678 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc9c113070 0x7fdc9c1a9f10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c019040 tx=0x7fdc8c01ac70 comp rx=0 tx=0).stop 2024-09-10T05:36:13.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:13.575+0000 7fdca1f7f640 1 -- 172.21.15.62:0/1954519678 shutdown_connections 2024-09-10T05:36:13.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:13.575+0000 7fdca1f7f640 1 --2- 172.21.15.62:0/1954519678 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fdc7c03b1b0 0x7fdc7c03d670 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:13.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:13.575+0000 7fdca1f7f640 1 --2- 172.21.15.62:0/1954519678 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc9c113070 0x7fdc9c1a9f10 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:13.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:13.575+0000 7fdca1f7f640 1 -- 172.21.15.62:0/1954519678 >> 172.21.15.62:0/1954519678 conn(0x7fdc9c06f370 msgr2=0x7fdc9c114eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:13.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:13.575+0000 7fdca1f7f640 1 -- 172.21.15.62:0/1954519678 shutdown_connections 2024-09-10T05:36:13.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:13.575+0000 7fdca1f7f640 1 -- 172.21.15.62:0/1954519678 wait complete. 2024-09-10T05:36:13.614 DEBUG:tasks.rgw:Pools created 2024-09-10T05:36:13.614 INFO:tasks.rgw:Starting rgw... 2024-09-10T05:36:13.615 INFO:tasks.rgw:rgw client.0 config is {} 2024-09-10T05:36:13.615 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-10T05:36:13.615 DEBUG:teuthology.orchestra.run.smithi062:> sudo echo -n http://smithi062.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-10T05:36:13.634 INFO:teuthology.orchestra.run.smithi062.stdout:http://smithi062.front.sepia.ceph.com:80 2024-09-10T05:36:13.635 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-10T05:36:13.690 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-10T05:36:13.691 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-10T05:36:13.734 INFO:tasks.rgw.client.0:Started 2024-09-10T05:36:13.734 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi062.front.sepia.ceph.com:80/ 2024-09-10T05:36:13.735 DEBUG:teuthology.orchestra.run.smithi062:> curl http://smithi062.front.sepia.ceph.com:80/ 2024-09-10T05:36:13.765 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-10T05:36:13.766 INFO:teuthology.orchestra.run.smithi062.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-10T05:36:13.766 INFO:teuthology.orchestra.run.smithi062.stderr: Dload Upload Total Spent Left Speed 2024-09-10T05:36:13.766 INFO:teuthology.orchestra.run.smithi062.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-10T05:36:13.766 INFO:teuthology.orchestra.run.smithi062.stderr:curl: (7) Failed to connect to smithi062.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-10T05:36:14.767 DEBUG:teuthology.orchestra.run.smithi062:> curl http://smithi062.front.sepia.ceph.com:80/ 2024-09-10T05:36:14.779 INFO:teuthology.orchestra.run.smithi062.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-10T05:36:14.779 INFO:teuthology.orchestra.run.smithi062.stderr: Dload Upload Total Spent Left Speed 2024-09-10T05:36:14.779 INFO:teuthology.orchestra.run.smithi062.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-10T05:36:14.780 INFO:teuthology.orchestra.run.smithi062.stderr:curl: (7) Failed to connect to smithi062.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-10T05:36:14.780 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-10T05:36:16.781 DEBUG:teuthology.orchestra.run.smithi062:> curl http://smithi062.front.sepia.ceph.com:80/ 2024-09-10T05:36:16.793 INFO:teuthology.orchestra.run.smithi062.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-10T05:36:16.793 INFO:teuthology.orchestra.run.smithi062.stderr: Dload Upload Total Spent Left Speed 2024-09-10T05:36:16.793 INFO:teuthology.orchestra.run.smithi062.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-10T05:36:16.794 INFO:teuthology.orchestra.run.smithi062.stderr:curl: (7) Failed to connect to smithi062.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-10T05:36:16.794 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-10T05:36:20.796 DEBUG:teuthology.orchestra.run.smithi062:> curl http://smithi062.front.sepia.ceph.com:80/ 2024-09-10T05:36:20.807 INFO:teuthology.orchestra.run.smithi062.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-10T05:36:20.807 INFO:teuthology.orchestra.run.smithi062.stderr: Dload Upload Total Spent Left Speed 2024-09-10T05:36:20.808 INFO:teuthology.orchestra.run.smithi062.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-10T05:36:20.808 INFO:teuthology.orchestra.run.smithi062.stderr:curl: (7) Failed to connect to smithi062.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-10T05:36:20.808 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-10T05:36:28.810 DEBUG:teuthology.orchestra.run.smithi062:> curl http://smithi062.front.sepia.ceph.com:80/ 2024-09-10T05:36:28.822 INFO:teuthology.orchestra.run.smithi062.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-10T05:36:28.823 INFO:teuthology.orchestra.run.smithi062.stderr: Dload Upload Total Spent Left Speed 2024-09-10T05:36:28.826 INFO:teuthology.orchestra.run.smithi062.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 49562 0 --:--:-- --:--:-- --:--:-- 62333 2024-09-10T05:36:28.827 INFO:teuthology.orchestra.run.smithi062.stdout:anonymous 2024-09-10T05:36:28.827 INFO:teuthology.run_tasks:Running task radosgw-admin... 2024-09-10T05:36:28.906 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2024-09-10T05:36:28.906 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-10T05:36:28.906 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-10T05:36:28.906 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-10T05:36:28.944 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:28.944 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:28.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.943+0000 7f5fb0aca9c0 1 Processor -- start 2024-09-10T05:36:28.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.943+0000 7f5fb0aca9c0 1 -- start start 2024-09-10T05:36:28.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.943+0000 7f5fb0aca9c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5597b50d8320 0x5597b50da710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:28.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.943+0000 7f5fb0aca9c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5597b4f869c0 con 0x5597b50d41d0 2024-09-10T05:36:28.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.943+0000 7f5fb0aca9c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x5597b4fd66d0 con 0x5597b50d8320 2024-09-10T05:36:28.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.943+0000 7f5faddcf640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5597b50d8320 0x5597b50da710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:28.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.943+0000 7f5fae5d0640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x5597b50d41d0 0x5597b50d45b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:38390/0 (socket says 172.21.15.62:38390) 2024-09-10T05:36:28.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.943+0000 7f5fae5d0640 1 -- 172.21.15.62:0/1748157061 learned_addr learned my addr 172.21.15.62:0/1748157061 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-10T05:36:28.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.943+0000 7f5faddcf640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5597b50d8320 0x5597b50da710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:50738/0 (socket says 172.21.15.62:50738) 2024-09-10T05:36:28.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.943+0000 7f5faddcf640 1 -- 172.21.15.62:0/1748157061 >> v1:172.21.15.2:6789/0 conn(0x5597b50d41d0 legacy=0x5597b50d45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:28.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.943+0000 7f5faddcf640 1 -- 172.21.15.62:0/1748157061 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597b4f7aca0 con 0x5597b50d8320 2024-09-10T05:36:28.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.943+0000 7f5fad5ce640 1 -- 172.21.15.62:0/1748157061 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3393595025 0 0) 0x5597b4f869c0 con 0x5597b50d41d0 2024-09-10T05:36:28.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.947+0000 7f5faddcf640 1 --2- 172.21.15.62:0/1748157061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597b50d8320 0x5597b50da710 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5f9800a420 tx=0x7f5f9801b060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1762f3f5e571c0c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:28.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.947+0000 7f5fad5ce640 1 -- 172.21.15.62:0/1748157061 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f980af070 con 0x5597b50d8320 2024-09-10T05:36:28.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.947+0000 7f5fad5ce640 1 -- 172.21.15.62:0/1748157061 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f980aa530 con 0x5597b50d8320 2024-09-10T05:36:28.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.947+0000 7f5fad5ce640 1 -- 172.21.15.62:0/1748157061 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f980aa810 con 0x5597b50d8320 2024-09-10T05:36:28.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.947+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/1748157061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597b50d8320 msgr2=0x5597b50da710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:28.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.947+0000 7f5fb0aca9c0 1 --2- 172.21.15.62:0/1748157061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597b50d8320 0x5597b50da710 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5f9800a420 tx=0x7f5f9801b060 comp rx=0 tx=0).stop 2024-09-10T05:36:28.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.947+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/1748157061 shutdown_connections 2024-09-10T05:36:28.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.947+0000 7f5fb0aca9c0 1 --2- 172.21.15.62:0/1748157061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597b50d8320 0x5597b50da710 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:28.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.947+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/1748157061 >> 172.21.15.62:0/1748157061 conn(0x5597b5047ae0 msgr2=0x5597b5047ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:28.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.947+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/1748157061 shutdown_connections 2024-09-10T05:36:28.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.947+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/1748157061 wait complete. 2024-09-10T05:36:28.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.963+0000 7f5fb0aca9c0 1 Processor -- start 2024-09-10T05:36:28.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.963+0000 7f5fb0aca9c0 1 -- start start 2024-09-10T05:36:28.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.963+0000 7f5fb0aca9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597b50d41d0 0x5597b51bf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:28.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.963+0000 7f5fb0aca9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5597b4fda680 con 0x5597b50d41d0 2024-09-10T05:36:28.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.963+0000 7f5fae5d0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597b50d41d0 0x5597b51bf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:28.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.963+0000 7f5fae5d0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597b50d41d0 0x5597b51bf760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:50742/0 (socket says 172.21.15.62:50742) 2024-09-10T05:36:28.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.963+0000 7f5fae5d0640 1 -- 172.21.15.62:0/1578661016 learned_addr learned my addr 172.21.15.62:0/1578661016 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:28.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.967+0000 7f5fae5d0640 1 -- 172.21.15.62:0/1578661016 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597b4f55da0 con 0x5597b50d41d0 2024-09-10T05:36:28.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.967+0000 7f5fae5d0640 1 --2- 172.21.15.62:0/1578661016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597b50d41d0 0x5597b51bf760 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5fa0001eb0 tx=0x7f5fa000b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75cdb0004e86e2ba server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:28.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.967+0000 7f5e9c608640 1 -- 172.21.15.62:0/1578661016 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fa000d640 con 0x5597b50d41d0 2024-09-10T05:36:28.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.967+0000 7f5e9c608640 1 -- 172.21.15.62:0/1578661016 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fa0008070 con 0x5597b50d41d0 2024-09-10T05:36:28.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.967+0000 7f5e9c608640 1 -- 172.21.15.62:0/1578661016 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fa000d970 con 0x5597b50d41d0 2024-09-10T05:36:28.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.967+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/1578661016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597b50d41d0 msgr2=0x5597b51bf760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:28.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.967+0000 7f5fb0aca9c0 1 --2- 172.21.15.62:0/1578661016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597b50d41d0 0x5597b51bf760 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5fa0001eb0 tx=0x7f5fa000b6b0 comp rx=0 tx=0).stop 2024-09-10T05:36:28.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.967+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/1578661016 shutdown_connections 2024-09-10T05:36:28.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.967+0000 7f5fb0aca9c0 1 --2- 172.21.15.62:0/1578661016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597b50d41d0 0x5597b51bf760 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:28.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.967+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/1578661016 >> 172.21.15.62:0/1578661016 conn(0x5597b5047ae0 msgr2=0x5597b51bb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:28.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.967+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/1578661016 shutdown_connections 2024-09-10T05:36:28.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.967+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/1578661016 wait complete. 2024-09-10T05:36:28.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.967+0000 7f5fb0aca9c0 1 Processor -- start 2024-09-10T05:36:28.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.967+0000 7f5fb0aca9c0 1 -- start start 2024-09-10T05:36:28.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.967+0000 7f5fb0aca9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597b50d41d0 0x5597b51c6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:28.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.967+0000 7f5fb0aca9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5597b4f7ca50 con 0x5597b50d41d0 2024-09-10T05:36:28.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.967+0000 7f5fae5d0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597b50d41d0 0x5597b51c6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:28.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.967+0000 7f5fae5d0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597b50d41d0 0x5597b51c6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:50748/0 (socket says 172.21.15.62:50748) 2024-09-10T05:36:28.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.967+0000 7f5fae5d0640 1 -- 172.21.15.62:0/2786013585 learned_addr learned my addr 172.21.15.62:0/2786013585 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:28.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.967+0000 7f5fae5d0640 1 -- 172.21.15.62:0/2786013585 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597b51c7370 con 0x5597b50d41d0 2024-09-10T05:36:28.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.971+0000 7f5fae5d0640 1 --2- 172.21.15.62:0/2786013585 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597b50d41d0 0x5597b51c6e10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5fa0001300 tx=0x7f5fa0000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:28.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.971+0000 7f5e9ae05640 1 -- 172.21.15.62:0/2786013585 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fa001a7c0 con 0x5597b50d41d0 2024-09-10T05:36:28.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.971+0000 7f5e9ae05640 1 -- 172.21.15.62:0/2786013585 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fa001a960 con 0x5597b50d41d0 2024-09-10T05:36:28.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.971+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/2786013585 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5597b51c7600 con 0x5597b50d41d0 2024-09-10T05:36:28.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.971+0000 7f5e9ae05640 1 -- 172.21.15.62:0/2786013585 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fa001ac40 con 0x5597b50d41d0 2024-09-10T05:36:28.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.971+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/2786013585 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597b51c7fb0 con 0x5597b50d41d0 2024-09-10T05:36:28.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.971+0000 7f5e9ae05640 1 -- 172.21.15.62:0/2786013585 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f5fa0017070 con 0x5597b50d41d0 2024-09-10T05:36:28.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.971+0000 7f5e9ae05640 1 --2- 172.21.15.62:0/2786013585 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5e94039a70 0x7f5e9403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:28.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.971+0000 7f5e9ae05640 1 -- 172.21.15.62:0/2786013585 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f5fa0015020 con 0x5597b50d41d0 2024-09-10T05:36:28.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.971+0000 7f5faddcf640 1 --2- 172.21.15.62:0/2786013585 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5e94039a70 0x7f5e9403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:28.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.971+0000 7f5fb0aca9c0 1 --2- 172.21.15.62:0/2786013585 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5597b50d8320 0x5597b51cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:28.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.971+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/2786013585 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5597b51ce4c0 con 0x5597b50d8320 2024-09-10T05:36:28.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.971+0000 7f5faedd1640 1 --2- 172.21.15.62:0/2786013585 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5597b50d8320 0x5597b51cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:28.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.971+0000 7f5faddcf640 1 --2- 172.21.15.62:0/2786013585 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5e94039a70 0x7f5e9403bf30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5f980ac000 tx=0x7f5f980a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:28.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.971+0000 7f5faedd1640 1 --2- 172.21.15.62:0/2786013585 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5597b50d8320 0x5597b51cdf80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:28.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.971+0000 7f5faedd1640 1 -- 172.21.15.62:0/2786013585 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5fa80083f0 con 0x5597b50d8320 2024-09-10T05:36:28.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.971+0000 7f5fb0aca9c0 1 --2- 172.21.15.62:0/2786013585 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5597b51cf270 0x5597b51d1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:28.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.971+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/2786013585 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5597b51d1c70 con 0x5597b51cf270 2024-09-10T05:36:28.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.971+0000 7f5fae5d0640 1 --2- 172.21.15.62:0/2786013585 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5597b51cf270 0x5597b51d1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:28.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.975+0000 7f5fae5d0640 1 --2- 172.21.15.62:0/2786013585 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5597b51cf270 0x5597b51d1660 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:28.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.975+0000 7f5fae5d0640 1 -- 172.21.15.62:0/2786013585 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5fa002e070 con 0x5597b51cf270 2024-09-10T05:36:28.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.975+0000 7f5fb0aca9c0 1 --2- 172.21.15.62:0/2786013585 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5597b51d3a30 0x5597b51d5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:28.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.975+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/2786013585 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5597b51d64f0 con 0x5597b51d3a30 2024-09-10T05:36:28.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.975+0000 7f5faddcf640 1 --2- 172.21.15.62:0/2786013585 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5597b51d3a30 0x5597b51d5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:28.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.975+0000 7f5faddcf640 1 --2- 172.21.15.62:0/2786013585 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5597b51d3a30 0x5597b51d5e20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:28.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.975+0000 7f5faddcf640 1 -- 172.21.15.62:0/2786013585 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5f980b2070 con 0x5597b51d3a30 2024-09-10T05:36:28.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.975+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/2786013585 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5597b51d2900 con 0x5597b51cf270 2024-09-10T05:36:28.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.975+0000 7f5fae5d0640 1 -- 172.21.15.62:0/2786013585 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5fa002e070 con 0x5597b51cf270 2024-09-10T05:36:28.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.975+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/2786013585 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5597b51d2cc0 con 0x5597b51d3a30 2024-09-10T05:36:28.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.975+0000 7f5faddcf640 1 -- 172.21.15.62:0/2786013585 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5f980b2070 con 0x5597b51d3a30 2024-09-10T05:36:28.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.975+0000 7f5fb0aca9c0 1 Processor -- start 2024-09-10T05:36:28.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.975+0000 7f5fb0aca9c0 1 -- start start 2024-09-10T05:36:28.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.979+0000 7f5fb0aca9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597b51e4ac0 0x5597b51e4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:28.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.979+0000 7f5fb0aca9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5597b4fe7450 con 0x5597b51e4ac0 2024-09-10T05:36:28.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.979+0000 7f5fae5d0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597b51e4ac0 0x5597b51e4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:28.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.979+0000 7f5fae5d0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597b51e4ac0 0x5597b51e4ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:50752/0 (socket says 172.21.15.62:50752) 2024-09-10T05:36:28.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.979+0000 7f5fae5d0640 1 -- 172.21.15.62:0/2720536718 learned_addr learned my addr 172.21.15.62:0/2720536718 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:28.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.979+0000 7f5fae5d0640 1 -- 172.21.15.62:0/2720536718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597b51e5520 con 0x5597b51e4ac0 2024-09-10T05:36:28.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.979+0000 7f5fae5d0640 1 --2- 172.21.15.62:0/2720536718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597b51e4ac0 0x5597b51e4ee0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5fa000eb10 tx=0x7f5fa000ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:28.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.979+0000 7f5e93fff640 1 -- 172.21.15.62:0/2720536718 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fa001c450 con 0x5597b51e4ac0 2024-09-10T05:36:28.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.979+0000 7f5e93fff640 1 -- 172.21.15.62:0/2720536718 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fa001c5f0 con 0x5597b51e4ac0 2024-09-10T05:36:28.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.979+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/2720536718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5597b51e5d80 con 0x5597b51e4ac0 2024-09-10T05:36:28.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.979+0000 7f5e93fff640 1 -- 172.21.15.62:0/2720536718 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fa001c8d0 con 0x5597b51e4ac0 2024-09-10T05:36:28.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.979+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/2720536718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597b51e5d80 con 0x5597b51e4ac0 2024-09-10T05:36:28.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.979+0000 7f5e93fff640 1 -- 172.21.15.62:0/2720536718 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f5fa00480c0 con 0x5597b51e4ac0 2024-09-10T05:36:28.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.979+0000 7f5e93fff640 1 --2- 172.21.15.62:0/2720536718 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5e88039a70 0x7f5e8803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:28.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.979+0000 7f5e93fff640 1 -- 172.21.15.62:0/2720536718 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f5fa0039020 con 0x5597b51e4ac0 2024-09-10T05:36:28.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.979+0000 7f5faddcf640 1 --2- 172.21.15.62:0/2720536718 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5e88039a70 0x7f5e8803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:28.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.979+0000 7f5fb0aca9c0 1 Processor -- start 2024-09-10T05:36:28.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.979+0000 7f5fb0aca9c0 1 -- start start 2024-09-10T05:36:28.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.979+0000 7f5fb0aca9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597b51f10f0 0x5597b51f14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:28.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.979+0000 7f5fb0aca9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5597b51bffb0 con 0x5597b51f10f0 2024-09-10T05:36:28.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.979+0000 7f5faddcf640 1 --2- 172.21.15.62:0/2720536718 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5e88039a70 0x7f5e8803bf30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x5597b51c8260 tx=0x7f5f98005d90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:28.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.983+0000 7f5fae5d0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597b51f10f0 0x5597b51f14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:28.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.983+0000 7f5fae5d0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597b51f10f0 0x5597b51f14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:50758/0 (socket says 172.21.15.62:50758) 2024-09-10T05:36:28.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.983+0000 7f5fae5d0640 1 -- 172.21.15.62:0/29481569 learned_addr learned my addr 172.21.15.62:0/29481569 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:28.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.983+0000 7f5fae5d0640 1 -- 172.21.15.62:0/29481569 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597b51f1aa0 con 0x5597b51f10f0 2024-09-10T05:36:28.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.983+0000 7f5fae5d0640 1 --2- 172.21.15.62:0/29481569 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597b51f10f0 0x5597b51f14d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5fa000fae0 tx=0x7f5fa000f860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7308a838aecc1bb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:28.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.983+0000 7f5e91ffb640 1 -- 172.21.15.62:0/29481569 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fa0043e40 con 0x5597b51f10f0 2024-09-10T05:36:28.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.983+0000 7f5e91ffb640 1 -- 172.21.15.62:0/29481569 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fa0061020 con 0x5597b51f10f0 2024-09-10T05:36:28.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.983+0000 7f5e91ffb640 1 -- 172.21.15.62:0/29481569 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fa00439b0 con 0x5597b51f10f0 2024-09-10T05:36:28.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.983+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/29481569 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597b51f10f0 msgr2=0x5597b51f14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:28.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.983+0000 7f5fb0aca9c0 1 --2- 172.21.15.62:0/29481569 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597b51f10f0 0x5597b51f14d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5fa000fae0 tx=0x7f5fa000f860 comp rx=0 tx=0).stop 2024-09-10T05:36:28.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.983+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/29481569 shutdown_connections 2024-09-10T05:36:28.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.983+0000 7f5fb0aca9c0 1 --2- 172.21.15.62:0/29481569 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597b51f10f0 0x5597b51f14d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:28.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.983+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/29481569 >> 172.21.15.62:0/29481569 conn(0x5597b51ed520 msgr2=0x5597b51eb760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:28.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.983+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/29481569 shutdown_connections 2024-09-10T05:36:28.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.983+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/29481569 wait complete. 2024-09-10T05:36:28.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.983+0000 7f5fb0aca9c0 1 Processor -- start 2024-09-10T05:36:28.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.983+0000 7f5fb0aca9c0 1 -- start start 2024-09-10T05:36:28.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.983+0000 7f5fb0aca9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597b51f10f0 0x5597b51f8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:28.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.983+0000 7f5fb0aca9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5597b51f1f80 con 0x5597b51f10f0 2024-09-10T05:36:28.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.983+0000 7f5fae5d0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597b51f10f0 0x5597b51f8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:28.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.983+0000 7f5fae5d0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597b51f10f0 0x5597b51f8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:50766/0 (socket says 172.21.15.62:50766) 2024-09-10T05:36:28.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.983+0000 7f5fae5d0640 1 -- 172.21.15.62:0/4004167085 learned_addr learned my addr 172.21.15.62:0/4004167085 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:28.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.983+0000 7f5fae5d0640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597b51f8970 con 0x5597b51f10f0 2024-09-10T05:36:28.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.987+0000 7f5fae5d0640 1 --2- 172.21.15.62:0/4004167085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597b51f10f0 0x5597b51f8410 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5fa002bfd0 tx=0x7f5fa0012f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:28.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.987+0000 7f5e7ffff640 1 -- 172.21.15.62:0/4004167085 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fa0060050 con 0x5597b51f10f0 2024-09-10T05:36:28.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.987+0000 7f5e7ffff640 1 -- 172.21.15.62:0/4004167085 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fa00437c0 con 0x5597b51f10f0 2024-09-10T05:36:28.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.987+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5597b51f8970 con 0x5597b51f10f0 2024-09-10T05:36:28.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.987+0000 7f5e7ffff640 1 -- 172.21.15.62:0/4004167085 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fa0042170 con 0x5597b51f10f0 2024-09-10T05:36:28.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.987+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597b51f8f40 con 0x5597b51f10f0 2024-09-10T05:36:28.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.987+0000 7f5fb0aca9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:28.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.987+0000 7f5e7ffff640 1 -- 172.21.15.62:0/4004167085 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f5fa002b8f0 con 0x5597b51f10f0 2024-09-10T05:36:28.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.987+0000 7f5e7ffff640 1 --2- 172.21.15.62:0/4004167085 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5e78039ac0 0x7f5e7803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:28.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.987+0000 7f5e7ffff640 1 -- 172.21.15.62:0/4004167085 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f5fa006e070 con 0x5597b51f10f0 2024-09-10T05:36:28.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.987+0000 7f5faddcf640 1 --2- 172.21.15.62:0/4004167085 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5e78039ac0 0x7f5e7803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:28.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.987+0000 7f5fb0aca9c0 1 --2- 172.21.15.62:0/4004167085 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5597b5203330 0x5597b52057c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:28.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.987+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5597b5205f10 con 0x5597b5203330 2024-09-10T05:36:28.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.987+0000 7f5faedd1640 1 --2- 172.21.15.62:0/4004167085 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5597b5203330 0x5597b52057c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:28.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.987+0000 7f5faddcf640 1 --2- 172.21.15.62:0/4004167085 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5e78039ac0 0x7f5e7803bf80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5f980ad040 tx=0x7f5f980a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:28.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.987+0000 7f5faedd1640 1 --2- 172.21.15.62:0/4004167085 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5597b5203330 0x5597b52057c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:28.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.987+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5fa80083f0 con 0x5597b5203330 2024-09-10T05:36:28.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.987+0000 7f5fb0aca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:28.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.987+0000 7f5fb0aca9c0 20 realm 2024-09-10T05:36:28.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.987+0000 7f5fb0aca9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:28.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.987+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5597b5202720 con 0x5597b5203330 2024-09-10T05:36:28.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.987+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5fa80083f0 con 0x5597b5203330 2024-09-10T05:36:28.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.987+0000 7f5fb0aca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:28.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.987+0000 7f5fb0aca9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:28.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.987+0000 7f5fb0aca9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:28.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.987+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5597b52069d0 con 0x5597b5203330 2024-09-10T05:36:28.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.987+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5fa80083f0 con 0x5597b5203330 2024-09-10T05:36:28.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.991+0000 7f5fb0aca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:28.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.991+0000 7f5fb0aca9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:28.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.991+0000 7f5fb0aca9c0 1 --2- 172.21.15.62:0/4004167085 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5597b52077b0 0x5597b5209ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:28.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.991+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5597b520a230 con 0x5597b52077b0 2024-09-10T05:36:28.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.991+0000 7f5fae5d0640 1 --2- 172.21.15.62:0/4004167085 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5597b52077b0 0x5597b5209ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:28.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.991+0000 7f5fae5d0640 1 --2- 172.21.15.62:0/4004167085 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5597b52077b0 0x5597b5209ba0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:28.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.991+0000 7f5fae5d0640 1 -- 172.21.15.62:0/4004167085 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5fa0078020 con 0x5597b52077b0 2024-09-10T05:36:28.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.991+0000 7f5fb0aca9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:28.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.991+0000 7f5fb0aca9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:28.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.991+0000 7f5fb0aca9c0 1 --2- 172.21.15.62:0/4004167085 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5597b520afe0 0x5597b520d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:28.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.991+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5597b520da30 con 0x5597b520afe0 2024-09-10T05:36:28.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.991+0000 7f5faddcf640 1 --2- 172.21.15.62:0/4004167085 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5597b520afe0 0x5597b520d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:28.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.991+0000 7f5faddcf640 1 --2- 172.21.15.62:0/4004167085 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5597b520afe0 0x5597b520d3d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:28.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.991+0000 7f5faddcf640 1 -- 172.21.15.62:0/4004167085 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5f980b2070 con 0x5597b520afe0 2024-09-10T05:36:28.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.991+0000 7f5fb0aca9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:28.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.991+0000 7f5fb0aca9c0 20 searching for the correct realm 2024-09-10T05:36:28.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.991+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5597b520f300 con 0x5597b520afe0 2024-09-10T05:36:28.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.991+0000 7f5faddcf640 1 -- 172.21.15.62:0/4004167085 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f980b2070 con 0x5597b520afe0 2024-09-10T05:36:28.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.991+0000 7f5faddcf640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5597b520f300 con 0x5597b52077b0 2024-09-10T05:36:28.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.991+0000 7f5fae5d0640 1 -- 172.21.15.62:0/4004167085 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa0078020 con 0x5597b52077b0 2024-09-10T05:36:28.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.991+0000 7f5fae5d0640 1 --2- 172.21.15.62:0/4004167085 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f5fa004f600 0x7f5fa004fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:28.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.991+0000 7f5fae5d0640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5597b520f300 con 0x7f5fa004f600 2024-09-10T05:36:28.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.991+0000 7f5faedd1640 1 --2- 172.21.15.62:0/4004167085 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f5fa004f600 0x7f5fa004fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:28.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.995+0000 7f5faedd1640 1 --2- 172.21.15.62:0/4004167085 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f5fa004f600 0x7f5fa004fa20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:28.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.995+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa80083f0 con 0x7f5fa004f600 2024-09-10T05:36:28.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.995+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5597b520f300 con 0x5597b5203330 2024-09-10T05:36:28.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.995+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa80083f0 con 0x5597b5203330 2024-09-10T05:36:28.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.995+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5597b520f300 con 0x5597b5203330 2024-09-10T05:36:29.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.995+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa80083f0 con 0x5597b5203330 2024-09-10T05:36:29.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.995+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5597b520f300 con 0x5597b520afe0 2024-09-10T05:36:29.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.995+0000 7f5faddcf640 1 -- 172.21.15.62:0/4004167085 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f980b2070 con 0x5597b520afe0 2024-09-10T05:36:29.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.995+0000 7f5faddcf640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5597b520f300 con 0x5597b5203330 2024-09-10T05:36:29.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.995+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa80083f0 con 0x5597b5203330 2024-09-10T05:36:29.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.995+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5597b520f300 con 0x5597b52077b0 2024-09-10T05:36:29.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.995+0000 7f5fae5d0640 1 -- 172.21.15.62:0/4004167085 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa0078020 con 0x5597b52077b0 2024-09-10T05:36:29.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.995+0000 7f5fae5d0640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5597b520f300 con 0x5597b52077b0 2024-09-10T05:36:29.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.995+0000 7f5fae5d0640 1 -- 172.21.15.62:0/4004167085 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa0078020 con 0x5597b52077b0 2024-09-10T05:36:29.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.995+0000 7f5fae5d0640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5597b520f300 con 0x5597b5203330 2024-09-10T05:36:29.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.995+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa80083f0 con 0x5597b5203330 2024-09-10T05:36:29.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.995+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5597b520f300 con 0x7f5fa004f600 2024-09-10T05:36:29.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.995+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa80083f0 con 0x7f5fa004f600 2024-09-10T05:36:29.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.995+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5597b520f300 con 0x5597b5203330 2024-09-10T05:36:29.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.995+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa80083f0 con 0x5597b5203330 2024-09-10T05:36:29.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.995+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5597b520f300 con 0x7f5fa004f600 2024-09-10T05:36:29.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.999+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5fa80083f0 con 0x7f5fa004f600 2024-09-10T05:36:29.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.999+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5597b520f300 con 0x5597b52077b0 2024-09-10T05:36:29.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.999+0000 7f5fae5d0640 1 -- 172.21.15.62:0/4004167085 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa0078020 con 0x5597b52077b0 2024-09-10T05:36:29.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.999+0000 7f5fae5d0640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5597b520f300 con 0x5597b520afe0 2024-09-10T05:36:29.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.999+0000 7f5faddcf640 1 -- 172.21.15.62:0/4004167085 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f980b2070 con 0x5597b520afe0 2024-09-10T05:36:29.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.999+0000 7f5faddcf640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5597b520f300 con 0x5597b5203330 2024-09-10T05:36:29.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.999+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa80083f0 con 0x5597b5203330 2024-09-10T05:36:29.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.999+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5597b520f300 con 0x5597b52077b0 2024-09-10T05:36:29.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.999+0000 7f5fae5d0640 1 -- 172.21.15.62:0/4004167085 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa0078020 con 0x5597b52077b0 2024-09-10T05:36:29.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.999+0000 7f5fae5d0640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5597b520f300 con 0x5597b520afe0 2024-09-10T05:36:29.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.999+0000 7f5faddcf640 1 -- 172.21.15.62:0/4004167085 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 30 out=170b] v23'2 uv2 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f5f980b2070 con 0x5597b520afe0 2024-09-10T05:36:29.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.999+0000 7f5faddcf640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5597b520f300 con 0x5597b5203330 2024-09-10T05:36:29.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.999+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa80083f0 con 0x5597b5203330 2024-09-10T05:36:29.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.999+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5597b520f300 con 0x5597b5203330 2024-09-10T05:36:29.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.999+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5fa80083f0 con 0x5597b5203330 2024-09-10T05:36:29.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.999+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5597b520f300 con 0x5597b5203330 2024-09-10T05:36:29.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.999+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa80083f0 con 0x5597b5203330 2024-09-10T05:36:29.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.999+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5597b520f300 con 0x5597b520afe0 2024-09-10T05:36:29.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:28.999+0000 7f5faddcf640 1 -- 172.21.15.62:0/4004167085 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f980b2070 con 0x5597b520afe0 2024-09-10T05:36:29.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.003+0000 7f5faddcf640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5597b520f300 con 0x7f5fa004f600 2024-09-10T05:36:29.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.003+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa80083f0 con 0x7f5fa004f600 2024-09-10T05:36:29.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.003+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5597b520f300 con 0x5597b5203330 2024-09-10T05:36:29.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.003+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa80083f0 con 0x5597b5203330 2024-09-10T05:36:29.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.003+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5597b520f300 con 0x7f5fa004f600 2024-09-10T05:36:29.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.003+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa80083f0 con 0x7f5fa004f600 2024-09-10T05:36:29.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.003+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5597b520f300 con 0x5597b520afe0 2024-09-10T05:36:29.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.003+0000 7f5faddcf640 1 -- 172.21.15.62:0/4004167085 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f980b2070 con 0x5597b520afe0 2024-09-10T05:36:29.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.003+0000 7f5faddcf640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5597b520f300 con 0x7f5fa004f600 2024-09-10T05:36:29.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.003+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa80083f0 con 0x7f5fa004f600 2024-09-10T05:36:29.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.003+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5597b520f300 con 0x5597b52077b0 2024-09-10T05:36:29.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.003+0000 7f5fae5d0640 1 -- 172.21.15.62:0/4004167085 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa0078020 con 0x5597b52077b0 2024-09-10T05:36:29.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.003+0000 7f5fae5d0640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5597b520f300 con 0x5597b52077b0 2024-09-10T05:36:29.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.003+0000 7f5fae5d0640 1 -- 172.21.15.62:0/4004167085 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa0078020 con 0x5597b52077b0 2024-09-10T05:36:29.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.003+0000 7f5fae5d0640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5597b520f300 con 0x5597b520afe0 2024-09-10T05:36:29.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.003+0000 7f5faddcf640 1 -- 172.21.15.62:0/4004167085 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f980b2070 con 0x5597b520afe0 2024-09-10T05:36:29.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.003+0000 7f5faddcf640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5597b520f300 con 0x5597b52077b0 2024-09-10T05:36:29.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.007+0000 7f5fae5d0640 1 -- 172.21.15.62:0/4004167085 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5fa0078020 con 0x5597b52077b0 2024-09-10T05:36:29.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.007+0000 7f5fae5d0640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5597b520f300 con 0x5597b52077b0 2024-09-10T05:36:29.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.007+0000 7f5fae5d0640 1 -- 172.21.15.62:0/4004167085 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa0078020 con 0x5597b52077b0 2024-09-10T05:36:29.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.007+0000 7f5fb0aca9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:29.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.007+0000 7f5fb0aca9c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:29.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.007+0000 7f5fb0aca9c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:29.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.007+0000 7f5fb0aca9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:29.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.007+0000 7f5fb0aca9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:29.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.007+0000 7f5fb0aca9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:29.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.007+0000 7f5fb0aca9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:29.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.007+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5597b520e3f0 con 0x5597b5203330 2024-09-10T05:36:29.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.007+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5fa80083f0 con 0x5597b5203330 2024-09-10T05:36:29.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.007+0000 7f5fb0aca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:29.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.007+0000 7f5fb0aca9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:29.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.007+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5597b520e870 con 0x5597b52077b0 2024-09-10T05:36:29.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.007+0000 7f5fae5d0640 1 -- 172.21.15.62:0/4004167085 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5fa0078020 con 0x5597b52077b0 2024-09-10T05:36:29.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.007+0000 7f5fb0aca9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:29.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.007+0000 7f5fb0aca9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:29.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.007+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5597b520ec90 con 0x5597b520afe0 2024-09-10T05:36:29.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.007+0000 7f5faddcf640 1 -- 172.21.15.62:0/4004167085 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5f980b2070 con 0x5597b520afe0 2024-09-10T05:36:29.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.007+0000 7f5fb0aca9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:29.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.007+0000 7f5fb0aca9c0 20 zone default found 2024-09-10T05:36:29.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.007+0000 7f5fb0aca9c0 4 Realm: () 2024-09-10T05:36:29.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.007+0000 7f5fb0aca9c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:29.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.007+0000 7f5fb0aca9c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:29.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.007+0000 7f5fb0aca9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:29.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.007+0000 7f5fb0aca9c0 20 zonegroup default 2024-09-10T05:36:29.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.007+0000 7f5fb0aca9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:29.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.007+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5597b520f7d0 con 0x7f5fa004f600 2024-09-10T05:36:29.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.007+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5fa80083f0 con 0x7f5fa004f600 2024-09-10T05:36:29.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.007+0000 7f5fb0aca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:29.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.007+0000 7f5fb0aca9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:29.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.007+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5597b5211a90 con 0x5597b520afe0 2024-09-10T05:36:29.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.007+0000 7f5faddcf640 1 -- 172.21.15.62:0/4004167085 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5f980b2070 con 0x5597b520afe0 2024-09-10T05:36:29.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.007+0000 7f5fb0aca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:29.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.011+0000 7f5fb0aca9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:29.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.011+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5597b5211eb0 con 0x5597b520afe0 2024-09-10T05:36:29.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.011+0000 7f5faddcf640 1 -- 172.21.15.62:0/4004167085 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5f980b2070 con 0x5597b520afe0 2024-09-10T05:36:29.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.011+0000 7f5fb0aca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:29.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.011+0000 7f5fb0aca9c0 20 started sync module instance, tier type = 2024-09-10T05:36:29.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.011+0000 7f5fb0aca9c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:29.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.011+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5597b5210f20 con 0x5597b52077b0 2024-09-10T05:36:29.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.011+0000 7f5fae5d0640 1 -- 172.21.15.62:0/4004167085 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fa0078020 con 0x5597b52077b0 2024-09-10T05:36:29.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.011+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94110067266320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5597b5210b80 con 0x5597b52077b0 2024-09-10T05:36:29.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.011+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5597b5212de0 con 0x5597b5203330 2024-09-10T05:36:29.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.015+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fa80083f0 con 0x5597b5203330 2024-09-10T05:36:29.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.015+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94110067271984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5597b5213680 con 0x5597b5203330 2024-09-10T05:36:29.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.015+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5597b52140c0 con 0x5597b52077b0 2024-09-10T05:36:29.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.015+0000 7f5fae5d0640 1 -- 172.21.15.62:0/4004167085 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94110067266320] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fa0078020 con 0x5597b52077b0 2024-09-10T05:36:29.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.015+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94110067271984] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fa80083f0 con 0x5597b5203330 2024-09-10T05:36:29.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.015+0000 7f5fae5d0640 1 -- 172.21.15.62:0/4004167085 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fa0078020 con 0x5597b52077b0 2024-09-10T05:36:29.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.015+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94110067276688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5597b52131d0 con 0x5597b52077b0 2024-09-10T05:36:29.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.015+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5597b5214960 con 0x7f5fa004f600 2024-09-10T05:36:29.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.019+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fa80083f0 con 0x7f5fa004f600 2024-09-10T05:36:29.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.019+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94110067279024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5597b52131d0 con 0x7f5fa004f600 2024-09-10T05:36:29.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.019+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5597b5215420 con 0x5597b52077b0 2024-09-10T05:36:29.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.019+0000 7f5fae5d0640 1 -- 172.21.15.62:0/4004167085 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94110067276688] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fa0078020 con 0x5597b52077b0 2024-09-10T05:36:29.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.019+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94110067279024] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fa80083f0 con 0x7f5fa004f600 2024-09-10T05:36:29.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.019+0000 7f5fae5d0640 1 -- 172.21.15.62:0/4004167085 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fa0078020 con 0x5597b52077b0 2024-09-10T05:36:29.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.019+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94110067280080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5597b52153e0 con 0x5597b52077b0 2024-09-10T05:36:29.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.019+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5597b5215810 con 0x5597b520afe0 2024-09-10T05:36:29.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.019+0000 7f5faddcf640 1 -- 172.21.15.62:0/4004167085 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f980b2070 con 0x5597b520afe0 2024-09-10T05:36:29.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.019+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94110067270416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5597b5215810 con 0x5597b520afe0 2024-09-10T05:36:29.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.019+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5597b52166d0 con 0x5597b520afe0 2024-09-10T05:36:29.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.023+0000 7f5fae5d0640 1 -- 172.21.15.62:0/4004167085 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94110067280080] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fa0078020 con 0x5597b52077b0 2024-09-10T05:36:29.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.023+0000 7f5faddcf640 1 -- 172.21.15.62:0/4004167085 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(56 notify.6 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f980b2070 con 0x5597b520afe0 2024-09-10T05:36:29.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.023+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94110067281648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5597b52166d0 con 0x5597b520afe0 2024-09-10T05:36:29.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.023+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5597b5217120 con 0x7f5fa004f600 2024-09-10T05:36:29.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.023+0000 7f5faddcf640 1 -- 172.21.15.62:0/4004167085 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94110067270416] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f980b2070 con 0x5597b520afe0 2024-09-10T05:36:29.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.027+0000 7f5faddcf640 1 -- 172.21.15.62:0/4004167085 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94110067281648] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f980b2070 con 0x5597b520afe0 2024-09-10T05:36:29.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.027+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fa80083f0 con 0x7f5fa004f600 2024-09-10T05:36:29.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.027+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94110067284992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5597b5216220 con 0x7f5fa004f600 2024-09-10T05:36:29.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.027+0000 7f5fb0aca9c0 20 add_watcher() i=0 2024-09-10T05:36:29.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.027+0000 7f5fb0aca9c0 20 add_watcher() i=1 2024-09-10T05:36:29.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.027+0000 7f5fb0aca9c0 20 add_watcher() i=2 2024-09-10T05:36:29.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.027+0000 7f5fb0aca9c0 20 add_watcher() i=3 2024-09-10T05:36:29.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.027+0000 7f5fb0aca9c0 20 add_watcher() i=4 2024-09-10T05:36:29.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.027+0000 7f5fb0aca9c0 20 add_watcher() i=5 2024-09-10T05:36:29.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.027+0000 7f5fb0aca9c0 20 add_watcher() i=6 2024-09-10T05:36:29.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.031+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94110067284992] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fa80083f0 con 0x7f5fa004f600 2024-09-10T05:36:29.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.031+0000 7f5fb0aca9c0 20 add_watcher() i=7 2024-09-10T05:36:29.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.031+0000 7f5fb0aca9c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:29.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.031+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5597b5216220 con 0x5597b5203330 2024-09-10T05:36:29.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.031+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5fa80083f0 con 0x5597b5203330 2024-09-10T05:36:29.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.031+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94110067289136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5597b5216220 con 0x5597b5203330 2024-09-10T05:36:29.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.031+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94110067289136] v30'30 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5fa80083f0 con 0x5597b5203330 2024-09-10T05:36:29.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.031+0000 7f5e64fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:29.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.031+0000 7f5fb0aca9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:29.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.031+0000 7f5fb0aca9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:29.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.031+0000 7f5fb0aca9c0 5 note: GC not initialized 2024-09-10T05:36:29.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.031+0000 7f5ddf7fe640 20 reqs_thread_entry: start 2024-09-10T05:36:29.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.031+0000 7f5fb0aca9c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:29.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.031+0000 7f5fb0aca9c0 20 Filter name: none 2024-09-10T05:36:29.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.031+0000 7f5ddd7fa640 20 reqs_thread_entry: start 2024-09-10T05:36:29.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.031+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5597b523cb70 con 0x5597b520afe0 2024-09-10T05:36:29.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.035+0000 7f5faddcf640 1 -- 172.21.15.62:0/4004167085 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f980b2070 con 0x5597b520afe0 2024-09-10T05:36:29.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.035+0000 7f5faddcf640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5597b5211eb0 con 0x5597b52077b0 2024-09-10T05:36:29.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.035+0000 7f5fae5d0640 1 -- 172.21.15.62:0/4004167085 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa0078020 con 0x5597b52077b0 2024-09-10T05:36:29.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.035+0000 7f5fae5d0640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5597b5210f20 con 0x5597b5203330 2024-09-10T05:36:29.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.035+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa80083f0 con 0x5597b5203330 2024-09-10T05:36:29.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.035+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5597b5212de0 con 0x5597b5203330 2024-09-10T05:36:29.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.035+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa80083f0 con 0x5597b5203330 2024-09-10T05:36:29.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.035+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5597b5212de0 con 0x7f5fa004f600 2024-09-10T05:36:29.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.035+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa80083f0 con 0x7f5fa004f600 2024-09-10T05:36:29.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.035+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5597b5212de0 con 0x5597b52077b0 2024-09-10T05:36:29.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.035+0000 7f5fae5d0640 1 -- 172.21.15.62:0/4004167085 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa0078020 con 0x5597b52077b0 2024-09-10T05:36:29.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.035+0000 7f5fae5d0640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5597b5212de0 con 0x5597b5203330 2024-09-10T05:36:29.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.035+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa80083f0 con 0x5597b5203330 2024-09-10T05:36:29.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.035+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5597b5212de0 con 0x5597b520afe0 2024-09-10T05:36:29.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.035+0000 7f5faddcf640 1 -- 172.21.15.62:0/4004167085 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f980b2070 con 0x5597b520afe0 2024-09-10T05:36:29.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.035+0000 7f5faddcf640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5597b5212de0 con 0x7f5fa004f600 2024-09-10T05:36:29.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.035+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa80083f0 con 0x7f5fa004f600 2024-09-10T05:36:29.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.035+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5597b5212de0 con 0x5597b52077b0 2024-09-10T05:36:29.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.039+0000 7f5fae5d0640 1 -- 172.21.15.62:0/4004167085 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa0078020 con 0x5597b52077b0 2024-09-10T05:36:29.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.039+0000 7f5fae5d0640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5597b5212de0 con 0x5597b5203330 2024-09-10T05:36:29.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.039+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa80083f0 con 0x5597b5203330 2024-09-10T05:36:29.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.039+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5597b5212de0 con 0x5597b520afe0 2024-09-10T05:36:29.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.039+0000 7f5faddcf640 1 -- 172.21.15.62:0/4004167085 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f980b2070 con 0x5597b520afe0 2024-09-10T05:36:29.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.039+0000 7f5faddcf640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5597b5212de0 con 0x5597b5203330 2024-09-10T05:36:29.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.039+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 <== osd.1 v2:172.21.15.62:6808/3442097179 23 ==== osd_op_reply(74 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa80083f0 con 0x5597b5203330 2024-09-10T05:36:29.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.039+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5597b5212de0 con 0x5597b520afe0 2024-09-10T05:36:29.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.039+0000 7f5faddcf640 1 -- 172.21.15.62:0/4004167085 <== osd.3 v2:172.21.15.62:6816/2708991149 19 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f980b2070 con 0x5597b520afe0 2024-09-10T05:36:29.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.039+0000 7f5faddcf640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5597b5212de0 con 0x7f5fa004f600 2024-09-10T05:36:29.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.039+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(76 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa80083f0 con 0x7f5fa004f600 2024-09-10T05:36:29.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.039+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5597b5212de0 con 0x5597b520afe0 2024-09-10T05:36:29.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.039+0000 7f5faddcf640 1 -- 172.21.15.62:0/4004167085 <== osd.3 v2:172.21.15.62:6816/2708991149 20 ==== osd_op_reply(77 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f980b2070 con 0x5597b520afe0 2024-09-10T05:36:29.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.039+0000 7f5faddcf640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5597b5212de0 con 0x5597b5203330 2024-09-10T05:36:29.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.039+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 <== osd.1 v2:172.21.15.62:6808/3442097179 24 ==== osd_op_reply(78 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa80083f0 con 0x5597b5203330 2024-09-10T05:36:29.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.039+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5597b5212de0 con 0x5597b52077b0 2024-09-10T05:36:29.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.039+0000 7f5fae5d0640 1 -- 172.21.15.62:0/4004167085 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== osd_op_reply(79 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa0078020 con 0x5597b52077b0 2024-09-10T05:36:29.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.039+0000 7f5fae5d0640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5597b5212de0 con 0x7f5fa004f600 2024-09-10T05:36:29.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.043+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 <== osd.2 v2:172.21.15.62:6800/2677868286 15 ==== osd_op_reply(80 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa80083f0 con 0x7f5fa004f600 2024-09-10T05:36:29.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.043+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5597b5212de0 con 0x5597b52077b0 2024-09-10T05:36:29.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.043+0000 7f5fae5d0640 1 -- 172.21.15.62:0/4004167085 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== osd_op_reply(81 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa0078020 con 0x5597b52077b0 2024-09-10T05:36:29.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.043+0000 7f5fae5d0640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5597b5212de0 con 0x5597b5203330 2024-09-10T05:36:29.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.043+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 <== osd.1 v2:172.21.15.62:6808/3442097179 25 ==== osd_op_reply(82 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa80083f0 con 0x5597b5203330 2024-09-10T05:36:29.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.043+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5fa8042040 con 0x5597b520afe0 2024-09-10T05:36:29.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.043+0000 7f5faddcf640 1 -- 172.21.15.62:0/4004167085 <== osd.3 v2:172.21.15.62:6816/2708991149 21 ==== osd_op_reply(83 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f980b2070 con 0x5597b520afe0 2024-09-10T05:36:29.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.043+0000 7f5faddcf640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5fa8042040 con 0x7f5fa004f600 2024-09-10T05:36:29.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.043+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 <== osd.2 v2:172.21.15.62:6800/2677868286 16 ==== osd_op_reply(84 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa80083f0 con 0x7f5fa004f600 2024-09-10T05:36:29.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.043+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5fa8042040 con 0x5597b5203330 2024-09-10T05:36:29.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.043+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 <== osd.1 v2:172.21.15.62:6808/3442097179 26 ==== osd_op_reply(85 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa80083f0 con 0x5597b5203330 2024-09-10T05:36:29.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.043+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5fa8042040 con 0x5597b5203330 2024-09-10T05:36:29.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.043+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 <== osd.1 v2:172.21.15.62:6808/3442097179 27 ==== osd_op_reply(86 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa80083f0 con 0x5597b5203330 2024-09-10T05:36:29.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.043+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5fa8042040 con 0x5597b520afe0 2024-09-10T05:36:29.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.043+0000 7f5faddcf640 1 -- 172.21.15.62:0/4004167085 <== osd.3 v2:172.21.15.62:6816/2708991149 22 ==== osd_op_reply(87 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f980b2070 con 0x5597b520afe0 2024-09-10T05:36:29.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.043+0000 7f5faddcf640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5fa8042040 con 0x5597b520afe0 2024-09-10T05:36:29.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.043+0000 7f5faddcf640 1 -- 172.21.15.62:0/4004167085 <== osd.3 v2:172.21.15.62:6816/2708991149 23 ==== osd_op_reply(88 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f980b2070 con 0x5597b520afe0 2024-09-10T05:36:29.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.043+0000 7f5faddcf640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5fa8042040 con 0x7f5fa004f600 2024-09-10T05:36:29.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.043+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 <== osd.2 v2:172.21.15.62:6800/2677868286 17 ==== osd_op_reply(89 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa80083f0 con 0x7f5fa004f600 2024-09-10T05:36:29.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.043+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5fa8042040 con 0x5597b5203330 2024-09-10T05:36:29.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.043+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 <== osd.1 v2:172.21.15.62:6808/3442097179 28 ==== osd_op_reply(90 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa80083f0 con 0x5597b5203330 2024-09-10T05:36:29.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.043+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5fa8042040 con 0x5597b52077b0 2024-09-10T05:36:29.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.047+0000 7f5fae5d0640 1 -- 172.21.15.62:0/4004167085 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(91 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa0078020 con 0x5597b52077b0 2024-09-10T05:36:29.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.047+0000 7f5fae5d0640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5fa0094040 con 0x5597b520afe0 2024-09-10T05:36:29.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.047+0000 7f5faddcf640 1 -- 172.21.15.62:0/4004167085 <== osd.3 v2:172.21.15.62:6816/2708991149 24 ==== osd_op_reply(92 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f980b2070 con 0x5597b520afe0 2024-09-10T05:36:29.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.047+0000 7f5faddcf640 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5fa0094040 con 0x7f5fa004f600 2024-09-10T05:36:29.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.047+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 <== osd.2 v2:172.21.15.62:6800/2677868286 18 ==== osd_op_reply(93 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa80083f0 con 0x7f5fa004f600 2024-09-10T05:36:29.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.047+0000 7f5e64fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:29.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.047+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94110067289136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5597b5211eb0 con 0x5597b5203330 2024-09-10T05:36:29.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.051+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 <== osd.1 v2:172.21.15.62:6808/3442097179 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94110067289136] v30'31 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5fa80083f0 con 0x5597b5203330 2024-09-10T05:36:29.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.051+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94110067266320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5597b5212de0 con 0x5597b52077b0 2024-09-10T05:36:29.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.051+0000 7f5fae5d0640 1 -- 172.21.15.62:0/4004167085 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94110067266320] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fa0078020 con 0x5597b52077b0 2024-09-10T05:36:29.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.051+0000 7f5fb0aca9c0 20 remove_watcher() i=0 2024-09-10T05:36:29.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.051+0000 7f5fb0aca9c0 2 removed watcher, disabling cache 2024-09-10T05:36:29.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.051+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94110067271984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5597b5210f20 con 0x5597b5203330 2024-09-10T05:36:29.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.055+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 <== osd.1 v2:172.21.15.62:6808/3442097179 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94110067271984] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fa80083f0 con 0x5597b5203330 2024-09-10T05:36:29.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.055+0000 7f5fb0aca9c0 20 remove_watcher() i=1 2024-09-10T05:36:29.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.055+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94110067276688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5597b5212de0 con 0x5597b52077b0 2024-09-10T05:36:29.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.055+0000 7f5fae5d0640 1 -- 172.21.15.62:0/4004167085 <== osd.0 v2:172.21.15.2:6800/945139080 25 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94110067276688] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fa0078020 con 0x5597b52077b0 2024-09-10T05:36:29.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.055+0000 7f5fb0aca9c0 20 remove_watcher() i=2 2024-09-10T05:36:29.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.055+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94110067279024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5597b5210f20 con 0x7f5fa004f600 2024-09-10T05:36:29.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.055+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 <== osd.2 v2:172.21.15.62:6800/2677868286 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94110067279024] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fa80083f0 con 0x7f5fa004f600 2024-09-10T05:36:29.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.055+0000 7f5fb0aca9c0 20 remove_watcher() i=3 2024-09-10T05:36:29.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.055+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94110067280080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5597b5212de0 con 0x5597b52077b0 2024-09-10T05:36:29.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.059+0000 7f5fae5d0640 1 -- 172.21.15.62:0/4004167085 <== osd.0 v2:172.21.15.2:6800/945139080 26 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94110067280080] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fa0078020 con 0x5597b52077b0 2024-09-10T05:36:29.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.059+0000 7f5fb0aca9c0 20 remove_watcher() i=4 2024-09-10T05:36:29.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.059+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94110067270416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5597b5210f20 con 0x5597b520afe0 2024-09-10T05:36:29.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.059+0000 7f5faddcf640 1 -- 172.21.15.62:0/4004167085 <== osd.3 v2:172.21.15.62:6816/2708991149 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94110067270416] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f980b2070 con 0x5597b520afe0 2024-09-10T05:36:29.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.059+0000 7f5fb0aca9c0 20 remove_watcher() i=5 2024-09-10T05:36:29.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.059+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94110067281648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5597b5212de0 con 0x5597b520afe0 2024-09-10T05:36:29.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.063+0000 7f5faddcf640 1 -- 172.21.15.62:0/4004167085 <== osd.3 v2:172.21.15.62:6816/2708991149 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94110067281648] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f980b2070 con 0x5597b520afe0 2024-09-10T05:36:29.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.063+0000 7f5fb0aca9c0 20 remove_watcher() i=6 2024-09-10T05:36:29.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.063+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/4004167085 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94110067284992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5597b5212de0 con 0x7f5fa004f600 2024-09-10T05:36:29.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.063+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 <== osd.2 v2:172.21.15.62:6800/2677868286 20 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94110067284992] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fa80083f0 con 0x7f5fa004f600 2024-09-10T05:36:29.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.063+0000 7f5fb0aca9c0 20 remove_watcher() i=7 2024-09-10T05:36:29.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.063+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/4004167085 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5597b52077b0 msgr2=0x5597b5209ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.063+0000 7f5fb0aca9c0 1 --2- 172.21.15.62:0/4004167085 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5597b52077b0 0x5597b5209ba0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.063+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/4004167085 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5597b5203330 msgr2=0x5597b52057c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.063+0000 7f5fb0aca9c0 1 --2- 172.21.15.62:0/4004167085 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5597b5203330 0x5597b52057c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.063+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/4004167085 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f5fa004f600 msgr2=0x7f5fa004fa20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.063+0000 7f5fb0aca9c0 1 --2- 172.21.15.62:0/4004167085 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f5fa004f600 0x7f5fa004fa20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.063+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/4004167085 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5597b520afe0 msgr2=0x5597b520d3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.063+0000 7f5fb0aca9c0 1 --2- 172.21.15.62:0/4004167085 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5597b520afe0 0x5597b520d3d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.063+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/4004167085 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5e78039ac0 msgr2=0x7f5e7803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.063+0000 7f5fb0aca9c0 1 --2- 172.21.15.62:0/4004167085 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5e78039ac0 0x7f5e7803bf80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5f980ad040 tx=0x7f5f980a7000 comp rx=0 tx=0).stop 2024-09-10T05:36:29.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.063+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/4004167085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597b51f10f0 msgr2=0x5597b51f8410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.063+0000 7f5fb0aca9c0 1 --2- 172.21.15.62:0/4004167085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597b51f10f0 0x5597b51f8410 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5fa002bfd0 tx=0x7f5fa0012f00 comp rx=0 tx=0).stop 2024-09-10T05:36:29.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.063+0000 7f5faedd1640 1 -- 172.21.15.62:0/4004167085 reap_dead start 2024-09-10T05:36:29.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.067+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/4004167085 shutdown_connections 2024-09-10T05:36:29.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.067+0000 7f5fb0aca9c0 1 --2- 172.21.15.62:0/4004167085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597b51f10f0 0x5597b51f8410 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.067+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/4004167085 >> 172.21.15.62:0/4004167085 conn(0x5597b51ed520 msgr2=0x5597b51eb730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:29.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.067+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/4004167085 shutdown_connections 2024-09-10T05:36:29.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.067+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/4004167085 wait complete. 2024-09-10T05:36:29.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.067+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/2720536718 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5e88039a70 msgr2=0x7f5e8803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.067+0000 7f5fb0aca9c0 1 --2- 172.21.15.62:0/2720536718 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5e88039a70 0x7f5e8803bf30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x5597b51c8260 tx=0x7f5f98005d90 comp rx=0 tx=0).stop 2024-09-10T05:36:29.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.067+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/2720536718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597b51e4ac0 msgr2=0x5597b51e4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.067+0000 7f5fb0aca9c0 1 --2- 172.21.15.62:0/2720536718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597b51e4ac0 0x5597b51e4ee0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5fa000eb10 tx=0x7f5fa000ea80 comp rx=0 tx=0).stop 2024-09-10T05:36:29.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.067+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/2720536718 shutdown_connections 2024-09-10T05:36:29.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.067+0000 7f5fb0aca9c0 1 --2- 172.21.15.62:0/2720536718 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5e88039a70 0x7f5e8803bf30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.067+0000 7f5fb0aca9c0 1 --2- 172.21.15.62:0/2720536718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597b51e4ac0 0x5597b51e4ee0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.067+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/2720536718 >> 172.21.15.62:0/2720536718 conn(0x5597b51da470 msgr2=0x5597b51da850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:29.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.067+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/2720536718 shutdown_connections 2024-09-10T05:36:29.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.067+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/2720536718 wait complete. 2024-09-10T05:36:29.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.067+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/2786013585 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5597b51cf270 msgr2=0x5597b51d1660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.067+0000 7f5fb0aca9c0 1 --2- 172.21.15.62:0/2786013585 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5597b51cf270 0x5597b51d1660 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.067+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/2786013585 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5597b50d8320 msgr2=0x5597b51cdf80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.067+0000 7f5fb0aca9c0 1 --2- 172.21.15.62:0/2786013585 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5597b50d8320 0x5597b51cdf80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.067+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/2786013585 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5597b51d3a30 msgr2=0x5597b51d5e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.067+0000 7f5fb0aca9c0 1 --2- 172.21.15.62:0/2786013585 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5597b51d3a30 0x5597b51d5e20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.067+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/2786013585 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5e94039a70 msgr2=0x7f5e9403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.067+0000 7f5fb0aca9c0 1 --2- 172.21.15.62:0/2786013585 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5e94039a70 0x7f5e9403bf30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5f980ac000 tx=0x7f5f980a5000 comp rx=0 tx=0).stop 2024-09-10T05:36:29.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.067+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/2786013585 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597b50d41d0 msgr2=0x5597b51c6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.067+0000 7f5fb0aca9c0 1 --2- 172.21.15.62:0/2786013585 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597b50d41d0 0x5597b51c6e10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5fa0001300 tx=0x7f5fa0000ee0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.067+0000 7f5faedd1640 1 -- 172.21.15.62:0/2786013585 reap_dead start 2024-09-10T05:36:29.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.067+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/2786013585 shutdown_connections 2024-09-10T05:36:29.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.067+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/2786013585 >> 172.21.15.62:0/2786013585 conn(0x5597b5047ae0 msgr2=0x5597b51b9e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:29.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.067+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/2786013585 shutdown_connections 2024-09-10T05:36:29.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.067+0000 7f5fb0aca9c0 1 -- 172.21.15.62:0/2786013585 wait complete. 2024-09-10T05:36:29.081 INFO:teuthology.orchestra.run.smithi062.stdout:[] 2024-09-10T05:36:29.081 DEBUG:tasks.util.rgw: json result: [] 2024-09-10T05:36:29.081 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2024-09-10T05:36:29.082 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2024-09-10T05:36:29.082 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2024-09-10T05:36:29.157 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:29.157 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:29.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.155+0000 7f14089759c0 1 Processor -- start 2024-09-10T05:36:29.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.155+0000 7f14089759c0 1 -- start start 2024-09-10T05:36:29.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.155+0000 7f14089759c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5559d46ad240 0x5559d473dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:29.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.155+0000 7f14089759c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5559d45ed9c0 con 0x5559d46ad620 2024-09-10T05:36:29.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.155+0000 7f14089759c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x5559d463d6d0 con 0x5559d46ad240 2024-09-10T05:36:29.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.155+0000 7f140647b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5559d46ad240 0x5559d473dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:29.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.155+0000 7f140647b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5559d46ad240 0x5559d473dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:50770/0 (socket says 172.21.15.62:50770) 2024-09-10T05:36:29.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.155+0000 7f1405c7a640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x5559d46ad620 0x5559d4740540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:38406/0 (socket says 172.21.15.62:38406) 2024-09-10T05:36:29.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.155+0000 7f140647b640 1 -- 172.21.15.62:0/3467628810 learned_addr learned my addr 172.21.15.62:0/3467628810 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:29.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.155+0000 7f140647b640 1 -- 172.21.15.62:0/3467628810 >> v1:172.21.15.2:6789/0 conn(0x5559d46ad620 legacy=0x5559d4740540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.155+0000 7f140647b640 1 -- 172.21.15.62:0/3467628810 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559d45e1ca0 con 0x5559d46ad240 2024-09-10T05:36:29.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.159+0000 7f140647b640 1 --2- 172.21.15.62:0/3467628810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d46ad240 0x5559d473dff0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f13f800a5c0 tx=0x7f13f801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76bffc7311af944b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:29.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.159+0000 7f1405479640 1 -- 172.21.15.62:0/3467628810 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13f80a6070 con 0x5559d46ad240 2024-09-10T05:36:29.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.159+0000 7f1405479640 1 -- 172.21.15.62:0/3467628810 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13f80af070 con 0x5559d46ad240 2024-09-10T05:36:29.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.159+0000 7f1405479640 1 -- 172.21.15.62:0/3467628810 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13f80aa5c0 con 0x5559d46ad240 2024-09-10T05:36:29.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.159+0000 7f14089759c0 1 -- 172.21.15.62:0/3467628810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d46ad240 msgr2=0x5559d473dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.159+0000 7f14089759c0 1 --2- 172.21.15.62:0/3467628810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d46ad240 0x5559d473dff0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f13f800a5c0 tx=0x7f13f801b340 comp rx=0 tx=0).stop 2024-09-10T05:36:29.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.159+0000 7f14089759c0 1 -- 172.21.15.62:0/3467628810 shutdown_connections 2024-09-10T05:36:29.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.159+0000 7f14089759c0 1 --2- 172.21.15.62:0/3467628810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d46ad240 0x5559d473dff0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.159+0000 7f14089759c0 1 -- 172.21.15.62:0/3467628810 >> 172.21.15.62:0/3467628810 conn(0x5559d4733920 msgr2=0x5559d4735d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:29.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.159+0000 7f14089759c0 1 -- 172.21.15.62:0/3467628810 shutdown_connections 2024-09-10T05:36:29.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.159+0000 7f14089759c0 1 -- 172.21.15.62:0/3467628810 wait complete. 2024-09-10T05:36:29.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.175+0000 7f14089759c0 1 Processor -- start 2024-09-10T05:36:29.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.175+0000 7f14089759c0 1 -- start start 2024-09-10T05:36:29.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.175+0000 7f14089759c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d46ad240 0x5559d48268c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:29.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.175+0000 7f14089759c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5559d4641680 con 0x5559d46ad240 2024-09-10T05:36:29.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.175+0000 7f140647b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d46ad240 0x5559d48268c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:29.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.175+0000 7f140647b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d46ad240 0x5559d48268c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:50772/0 (socket says 172.21.15.62:50772) 2024-09-10T05:36:29.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.175+0000 7f140647b640 1 -- 172.21.15.62:0/4077534202 learned_addr learned my addr 172.21.15.62:0/4077534202 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:29.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.179+0000 7f140647b640 1 -- 172.21.15.62:0/4077534202 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559d45bcda0 con 0x5559d46ad240 2024-09-10T05:36:29.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.179+0000 7f140647b640 1 --2- 172.21.15.62:0/4077534202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d46ad240 0x5559d48268c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f13f80ac040 tx=0x7f13f8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b115986dbd411ca2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:29.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.179+0000 7f12f4608640 1 -- 172.21.15.62:0/4077534202 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13f80aa9b0 con 0x5559d46ad240 2024-09-10T05:36:29.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.179+0000 7f12f4608640 1 -- 172.21.15.62:0/4077534202 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13f80aab50 con 0x5559d46ad240 2024-09-10T05:36:29.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.179+0000 7f12f4608640 1 -- 172.21.15.62:0/4077534202 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13f80bd3f0 con 0x5559d46ad240 2024-09-10T05:36:29.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.179+0000 7f14089759c0 1 -- 172.21.15.62:0/4077534202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d46ad240 msgr2=0x5559d48268c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.179+0000 7f14089759c0 1 --2- 172.21.15.62:0/4077534202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d46ad240 0x5559d48268c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f13f80ac040 tx=0x7f13f8003030 comp rx=0 tx=0).stop 2024-09-10T05:36:29.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.179+0000 7f14089759c0 1 -- 172.21.15.62:0/4077534202 shutdown_connections 2024-09-10T05:36:29.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.179+0000 7f14089759c0 1 --2- 172.21.15.62:0/4077534202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d46ad240 0x5559d48268c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.179+0000 7f14089759c0 1 -- 172.21.15.62:0/4077534202 >> 172.21.15.62:0/4077534202 conn(0x5559d4733920 msgr2=0x5559d4822500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:29.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.179+0000 7f14089759c0 1 -- 172.21.15.62:0/4077534202 shutdown_connections 2024-09-10T05:36:29.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.179+0000 7f14089759c0 1 -- 172.21.15.62:0/4077534202 wait complete. 2024-09-10T05:36:29.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.179+0000 7f14089759c0 1 Processor -- start 2024-09-10T05:36:29.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.179+0000 7f14089759c0 1 -- start start 2024-09-10T05:36:29.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.179+0000 7f14089759c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d46ad240 0x5559d482dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:29.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.179+0000 7f14089759c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5559d45e3a50 con 0x5559d46ad240 2024-09-10T05:36:29.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.179+0000 7f140647b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d46ad240 0x5559d482dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:29.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.179+0000 7f140647b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d46ad240 0x5559d482dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:50784/0 (socket says 172.21.15.62:50784) 2024-09-10T05:36:29.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.179+0000 7f140647b640 1 -- 172.21.15.62:0/3094645077 learned_addr learned my addr 172.21.15.62:0/3094645077 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:29.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.179+0000 7f140647b640 1 -- 172.21.15.62:0/3094645077 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559d482e420 con 0x5559d46ad240 2024-09-10T05:36:29.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.183+0000 7f140647b640 1 --2- 172.21.15.62:0/3094645077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d46ad240 0x5559d482dec0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f13f8096f40 tx=0x7f13f80180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:29.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.183+0000 7f12f2e05640 1 -- 172.21.15.62:0/3094645077 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13f80abe90 con 0x5559d46ad240 2024-09-10T05:36:29.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.183+0000 7f14089759c0 1 -- 172.21.15.62:0/3094645077 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5559d482e6b0 con 0x5559d46ad240 2024-09-10T05:36:29.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.183+0000 7f12f2e05640 1 -- 172.21.15.62:0/3094645077 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13f80c6650 con 0x5559d46ad240 2024-09-10T05:36:29.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.183+0000 7f12f2e05640 1 -- 172.21.15.62:0/3094645077 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13f80c6930 con 0x5559d46ad240 2024-09-10T05:36:29.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.183+0000 7f14089759c0 1 -- 172.21.15.62:0/3094645077 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559d482f060 con 0x5559d46ad240 2024-09-10T05:36:29.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.183+0000 7f12f2e05640 1 -- 172.21.15.62:0/3094645077 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f13f80c6ad0 con 0x5559d46ad240 2024-09-10T05:36:29.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.183+0000 7f12f2e05640 1 --2- 172.21.15.62:0/3094645077 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f12ec039ac0 0x7f12ec03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:29.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.183+0000 7f12f2e05640 1 -- 172.21.15.62:0/3094645077 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f13f80ebf40 con 0x5559d46ad240 2024-09-10T05:36:29.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.183+0000 7f1405c7a640 1 --2- 172.21.15.62:0/3094645077 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f12ec039ac0 0x7f12ec03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:29.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.183+0000 7f14089759c0 1 --2- 172.21.15.62:0/3094645077 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5559d46ad620 0x5559d4835030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:29.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.183+0000 7f14089759c0 1 -- 172.21.15.62:0/3094645077 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5559d4835570 con 0x5559d46ad620 2024-09-10T05:36:29.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.183+0000 7f1406c7c640 1 --2- 172.21.15.62:0/3094645077 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5559d46ad620 0x5559d4835030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:29.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.183+0000 7f1405c7a640 1 --2- 172.21.15.62:0/3094645077 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f12ec039ac0 0x7f12ec03bf80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f13f0001640 tx=0x7f13f00066a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:29.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.183+0000 7f1406c7c640 1 --2- 172.21.15.62:0/3094645077 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5559d46ad620 0x5559d4835030 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:29.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.183+0000 7f1406c7c640 1 -- 172.21.15.62:0/3094645077 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f14000083f0 con 0x5559d46ad620 2024-09-10T05:36:29.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.183+0000 7f14089759c0 1 --2- 172.21.15.62:0/3094645077 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5559d4836320 0x5559d4838710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:29.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.183+0000 7f14089759c0 1 -- 172.21.15.62:0/3094645077 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5559d4838d40 con 0x5559d4836320 2024-09-10T05:36:29.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.187+0000 7f140647b640 1 --2- 172.21.15.62:0/3094645077 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5559d4836320 0x5559d4838710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:29.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.187+0000 7f140647b640 1 --2- 172.21.15.62:0/3094645077 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5559d4836320 0x5559d4838710 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:29.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.187+0000 7f140647b640 1 -- 172.21.15.62:0/3094645077 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f13f80cd020 con 0x5559d4836320 2024-09-10T05:36:29.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.187+0000 7f14089759c0 1 --2- 172.21.15.62:0/3094645077 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5559d483ab00 0x5559d483cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:29.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.187+0000 7f14089759c0 1 -- 172.21.15.62:0/3094645077 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5559d483d5e0 con 0x5559d483ab00 2024-09-10T05:36:29.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.187+0000 7f1405c7a640 1 --2- 172.21.15.62:0/3094645077 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5559d483ab00 0x5559d483cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:29.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.187+0000 7f1405c7a640 1 --2- 172.21.15.62:0/3094645077 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5559d483ab00 0x5559d483cef0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:29.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.187+0000 7f1405c7a640 1 -- 172.21.15.62:0/3094645077 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f13f000f070 con 0x5559d483ab00 2024-09-10T05:36:29.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.187+0000 7f14089759c0 1 -- 172.21.15.62:0/3094645077 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5559d48399d0 con 0x5559d4836320 2024-09-10T05:36:29.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.187+0000 7f140647b640 1 -- 172.21.15.62:0/3094645077 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f13f80cd020 con 0x5559d4836320 2024-09-10T05:36:29.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.187+0000 7f14089759c0 1 -- 172.21.15.62:0/3094645077 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5559d4839df0 con 0x5559d483ab00 2024-09-10T05:36:29.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.187+0000 7f1405c7a640 1 -- 172.21.15.62:0/3094645077 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f13f000f070 con 0x5559d483ab00 2024-09-10T05:36:29.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.191+0000 7f14089759c0 1 Processor -- start 2024-09-10T05:36:29.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.191+0000 7f14089759c0 1 -- start start 2024-09-10T05:36:29.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.191+0000 7f14089759c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d484bc00 0x5559d484c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:29.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.191+0000 7f14089759c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5559d464e450 con 0x5559d484bc00 2024-09-10T05:36:29.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.191+0000 7f140647b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d484bc00 0x5559d484c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:29.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.191+0000 7f140647b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d484bc00 0x5559d484c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:50796/0 (socket says 172.21.15.62:50796) 2024-09-10T05:36:29.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.191+0000 7f140647b640 1 -- 172.21.15.62:0/470390068 learned_addr learned my addr 172.21.15.62:0/470390068 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:29.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.191+0000 7f140647b640 1 -- 172.21.15.62:0/470390068 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559d484c660 con 0x5559d484bc00 2024-09-10T05:36:29.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.191+0000 7f140647b640 1 --2- 172.21.15.62:0/470390068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d484bc00 0x5559d484c020 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f13f80bcaf0 tx=0x7f13f80bcea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:29.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.191+0000 7f12ebfff640 1 -- 172.21.15.62:0/470390068 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13f80c5560 con 0x5559d484bc00 2024-09-10T05:36:29.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.191+0000 7f14089759c0 1 -- 172.21.15.62:0/470390068 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5559d484cec0 con 0x5559d484bc00 2024-09-10T05:36:29.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.191+0000 7f12ebfff640 1 -- 172.21.15.62:0/470390068 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13f80c5700 con 0x5559d484bc00 2024-09-10T05:36:29.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.191+0000 7f12ebfff640 1 -- 172.21.15.62:0/470390068 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13f80d0400 con 0x5559d484bc00 2024-09-10T05:36:29.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.191+0000 7f14089759c0 1 -- 172.21.15.62:0/470390068 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559d484d430 con 0x5559d484bc00 2024-09-10T05:36:29.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.191+0000 7f12ebfff640 1 -- 172.21.15.62:0/470390068 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f13f80d05a0 con 0x5559d484bc00 2024-09-10T05:36:29.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.191+0000 7f12ebfff640 1 --2- 172.21.15.62:0/470390068 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f12e0039a70 0x7f12e003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:29.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.191+0000 7f12ebfff640 1 -- 172.21.15.62:0/470390068 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f13f80f0af0 con 0x5559d484bc00 2024-09-10T05:36:29.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.195+0000 7f1405c7a640 1 --2- 172.21.15.62:0/470390068 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f12e0039a70 0x7f12e003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:29.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.195+0000 7f14089759c0 1 Processor -- start 2024-09-10T05:36:29.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.195+0000 7f14089759c0 1 -- start start 2024-09-10T05:36:29.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.195+0000 7f14089759c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d4858230 0x5559d4858610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:29.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.195+0000 7f14089759c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5559d4827050 con 0x5559d4858230 2024-09-10T05:36:29.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.195+0000 7f1405c7a640 1 --2- 172.21.15.62:0/470390068 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f12e0039a70 0x7f12e003bf30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f13f00063c0 tx=0x7f13f000f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:29.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.195+0000 7f140647b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d4858230 0x5559d4858610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:29.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.195+0000 7f140647b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d4858230 0x5559d4858610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:50810/0 (socket says 172.21.15.62:50810) 2024-09-10T05:36:29.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.195+0000 7f140647b640 1 -- 172.21.15.62:0/2957671136 learned_addr learned my addr 172.21.15.62:0/2957671136 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:29.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.195+0000 7f140647b640 1 -- 172.21.15.62:0/2957671136 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559d4858be0 con 0x5559d4858230 2024-09-10T05:36:29.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.195+0000 7f140647b640 1 --2- 172.21.15.62:0/2957671136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d4858230 0x5559d4858610 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f13f80db440 tx=0x7f13f80db530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f31958d13dcaac8e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:29.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.195+0000 7f12e9ffb640 1 -- 172.21.15.62:0/2957671136 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13f80f0e10 con 0x5559d4858230 2024-09-10T05:36:29.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.195+0000 7f12e9ffb640 1 -- 172.21.15.62:0/2957671136 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13f8107070 con 0x5559d4858230 2024-09-10T05:36:29.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.195+0000 7f12e9ffb640 1 -- 172.21.15.62:0/2957671136 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13f80d0890 con 0x5559d4858230 2024-09-10T05:36:29.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.195+0000 7f14089759c0 1 -- 172.21.15.62:0/2957671136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d4858230 msgr2=0x5559d4858610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.195+0000 7f14089759c0 1 --2- 172.21.15.62:0/2957671136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d4858230 0x5559d4858610 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f13f80db440 tx=0x7f13f80db530 comp rx=0 tx=0).stop 2024-09-10T05:36:29.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.195+0000 7f14089759c0 1 -- 172.21.15.62:0/2957671136 shutdown_connections 2024-09-10T05:36:29.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.195+0000 7f14089759c0 1 --2- 172.21.15.62:0/2957671136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d4858230 0x5559d4858610 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.195+0000 7f14089759c0 1 -- 172.21.15.62:0/2957671136 >> 172.21.15.62:0/2957671136 conn(0x5559d4854660 msgr2=0x5559d48528a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:29.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.195+0000 7f14089759c0 1 -- 172.21.15.62:0/2957671136 shutdown_connections 2024-09-10T05:36:29.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.195+0000 7f14089759c0 1 -- 172.21.15.62:0/2957671136 wait complete. 2024-09-10T05:36:29.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.195+0000 7f14089759c0 1 Processor -- start 2024-09-10T05:36:29.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.195+0000 7f14089759c0 1 -- start start 2024-09-10T05:36:29.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.195+0000 7f14089759c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d4858230 0x5559d485f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:29.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.195+0000 7f14089759c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5559d4858be0 con 0x5559d4858230 2024-09-10T05:36:29.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.195+0000 7f140647b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d4858230 0x5559d485f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:29.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.195+0000 7f140647b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d4858230 0x5559d485f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:50816/0 (socket says 172.21.15.62:50816) 2024-09-10T05:36:29.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.195+0000 7f140647b640 1 -- 172.21.15.62:0/232307743 learned_addr learned my addr 172.21.15.62:0/232307743 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:29.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.199+0000 7f140647b640 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559d485f950 con 0x5559d4858230 2024-09-10T05:36:29.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.199+0000 7f140647b640 1 --2- 172.21.15.62:0/232307743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d4858230 0x5559d485f3f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f13f80e9360 tx=0x7f13f80d8f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:29.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.199+0000 7f12d7fff640 1 -- 172.21.15.62:0/232307743 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13f80d3150 con 0x5559d4858230 2024-09-10T05:36:29.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.199+0000 7f12d7fff640 1 -- 172.21.15.62:0/232307743 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13f8117070 con 0x5559d4858230 2024-09-10T05:36:29.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.199+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5559d485f950 con 0x5559d4858230 2024-09-10T05:36:29.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.199+0000 7f12d7fff640 1 -- 172.21.15.62:0/232307743 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13f80dda80 con 0x5559d4858230 2024-09-10T05:36:29.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.199+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559d485f950 con 0x5559d4858230 2024-09-10T05:36:29.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.199+0000 7f12d7fff640 1 -- 172.21.15.62:0/232307743 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f13f8101070 con 0x5559d4858230 2024-09-10T05:36:29.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.199+0000 7f12d7fff640 1 --2- 172.21.15.62:0/232307743 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f12d0039a70 0x7f12d003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:29.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.199+0000 7f12d7fff640 1 -- 172.21.15.62:0/232307743 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f13f80fe030 con 0x5559d4858230 2024-09-10T05:36:29.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.199+0000 7f14089759c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:29.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.199+0000 7f1405c7a640 1 --2- 172.21.15.62:0/232307743 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f12d0039a70 0x7f12d003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:29.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.199+0000 7f14089759c0 1 --2- 172.21.15.62:0/232307743 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5559d486a1d0 0x5559d486c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:29.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.199+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5559d486cde0 con 0x5559d486a1d0 2024-09-10T05:36:29.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.199+0000 7f1406c7c640 1 --2- 172.21.15.62:0/232307743 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5559d486a1d0 0x5559d486c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:29.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.199+0000 7f1405c7a640 1 --2- 172.21.15.62:0/232307743 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f12d0039a70 0x7f12d003bf30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x5559d4839d70 tx=0x7f13f0010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:29.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.199+0000 7f1406c7c640 1 --2- 172.21.15.62:0/232307743 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5559d486a1d0 0x5559d486c690 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:29.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.199+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f14000083f0 con 0x5559d486a1d0 2024-09-10T05:36:29.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.199+0000 7f14089759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:29.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.199+0000 7f14089759c0 20 realm 2024-09-10T05:36:29.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.199+0000 7f14089759c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:29.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.199+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5559d4869500 con 0x5559d486a1d0 2024-09-10T05:36:29.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.199+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f14000083f0 con 0x5559d486a1d0 2024-09-10T05:36:29.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.199+0000 7f14089759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:29.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.199+0000 7f14089759c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:29.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.203+0000 7f14089759c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:29.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.203+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5559d486d8a0 con 0x5559d486a1d0 2024-09-10T05:36:29.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.203+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f14000083f0 con 0x5559d486a1d0 2024-09-10T05:36:29.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.203+0000 7f14089759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:29.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.203+0000 7f14089759c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:29.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.203+0000 7f14089759c0 1 --2- 172.21.15.62:0/232307743 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5559d486e680 0x5559d4870a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:29.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.203+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5559d4871140 con 0x5559d486e680 2024-09-10T05:36:29.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.203+0000 7f140647b640 1 --2- 172.21.15.62:0/232307743 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5559d486e680 0x5559d4870a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:29.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.203+0000 7f140647b640 1 --2- 172.21.15.62:0/232307743 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5559d486e680 0x5559d4870a70 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:29.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.203+0000 7f140647b640 1 -- 172.21.15.62:0/232307743 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f13f80f5020 con 0x5559d486e680 2024-09-10T05:36:29.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.203+0000 7f14089759c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:29.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.203+0000 7f14089759c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:29.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.203+0000 7f14089759c0 1 --2- 172.21.15.62:0/232307743 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5559d4871ea0 0x5559d48742b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:29.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.203+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5559d4874a40 con 0x5559d4871ea0 2024-09-10T05:36:29.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.203+0000 7f1405c7a640 1 --2- 172.21.15.62:0/232307743 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5559d4871ea0 0x5559d48742b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:29.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.203+0000 7f1405c7a640 1 --2- 172.21.15.62:0/232307743 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5559d4871ea0 0x5559d48742b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:29.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.203+0000 7f1405c7a640 1 -- 172.21.15.62:0/232307743 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f13f002d040 con 0x5559d4871ea0 2024-09-10T05:36:29.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.203+0000 7f14089759c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:29.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.203+0000 7f14089759c0 20 searching for the correct realm 2024-09-10T05:36:29.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.203+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559d4876310 con 0x5559d4871ea0 2024-09-10T05:36:29.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.203+0000 7f1405c7a640 1 -- 172.21.15.62:0/232307743 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13f002d040 con 0x5559d4871ea0 2024-09-10T05:36:29.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.203+0000 7f1405c7a640 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559d4876310 con 0x5559d486e680 2024-09-10T05:36:29.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.203+0000 7f140647b640 1 -- 172.21.15.62:0/232307743 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13f80f5020 con 0x5559d486e680 2024-09-10T05:36:29.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.203+0000 7f140647b640 1 --2- 172.21.15.62:0/232307743 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f13f8009040 0x7f13f80a9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:29.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.203+0000 7f140647b640 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559d4876310 con 0x7f13f8009040 2024-09-10T05:36:29.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.207+0000 7f1406c7c640 1 --2- 172.21.15.62:0/232307743 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f13f8009040 0x7f13f80a9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:29.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.207+0000 7f1406c7c640 1 --2- 172.21.15.62:0/232307743 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f13f8009040 0x7f13f80a9810 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:29.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.207+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14000083f0 con 0x7f13f8009040 2024-09-10T05:36:29.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.207+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559d4876310 con 0x5559d486a1d0 2024-09-10T05:36:29.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.207+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14000083f0 con 0x5559d486a1d0 2024-09-10T05:36:29.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.207+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559d4876310 con 0x5559d486a1d0 2024-09-10T05:36:29.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.207+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14000083f0 con 0x5559d486a1d0 2024-09-10T05:36:29.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.207+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559d4876310 con 0x5559d4871ea0 2024-09-10T05:36:29.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.207+0000 7f1405c7a640 1 -- 172.21.15.62:0/232307743 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13f002d040 con 0x5559d4871ea0 2024-09-10T05:36:29.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.207+0000 7f1405c7a640 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559d4876310 con 0x5559d486a1d0 2024-09-10T05:36:29.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.207+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14000083f0 con 0x5559d486a1d0 2024-09-10T05:36:29.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.207+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559d4876310 con 0x5559d486e680 2024-09-10T05:36:29.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.207+0000 7f140647b640 1 -- 172.21.15.62:0/232307743 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13f80f5020 con 0x5559d486e680 2024-09-10T05:36:29.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.207+0000 7f140647b640 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559d4876310 con 0x5559d486e680 2024-09-10T05:36:29.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.207+0000 7f140647b640 1 -- 172.21.15.62:0/232307743 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13f80f5020 con 0x5559d486e680 2024-09-10T05:36:29.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.207+0000 7f140647b640 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559d4876310 con 0x5559d486a1d0 2024-09-10T05:36:29.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.207+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14000083f0 con 0x5559d486a1d0 2024-09-10T05:36:29.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.207+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559d4876310 con 0x7f13f8009040 2024-09-10T05:36:29.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.207+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14000083f0 con 0x7f13f8009040 2024-09-10T05:36:29.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.207+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559d4876310 con 0x5559d486a1d0 2024-09-10T05:36:29.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.211+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14000083f0 con 0x5559d486a1d0 2024-09-10T05:36:29.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.211+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559d4876310 con 0x7f13f8009040 2024-09-10T05:36:29.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.211+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f14000083f0 con 0x7f13f8009040 2024-09-10T05:36:29.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.211+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559d4876310 con 0x5559d486e680 2024-09-10T05:36:29.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.211+0000 7f140647b640 1 -- 172.21.15.62:0/232307743 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13f80f5020 con 0x5559d486e680 2024-09-10T05:36:29.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.211+0000 7f140647b640 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559d4876310 con 0x5559d4871ea0 2024-09-10T05:36:29.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.211+0000 7f1405c7a640 1 -- 172.21.15.62:0/232307743 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13f002d040 con 0x5559d4871ea0 2024-09-10T05:36:29.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.211+0000 7f1405c7a640 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559d4876310 con 0x5559d486a1d0 2024-09-10T05:36:29.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.211+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14000083f0 con 0x5559d486a1d0 2024-09-10T05:36:29.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.211+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559d4876310 con 0x5559d486e680 2024-09-10T05:36:29.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.211+0000 7f140647b640 1 -- 172.21.15.62:0/232307743 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13f80f5020 con 0x5559d486e680 2024-09-10T05:36:29.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.211+0000 7f140647b640 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559d4876310 con 0x5559d4871ea0 2024-09-10T05:36:29.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.211+0000 7f1405c7a640 1 -- 172.21.15.62:0/232307743 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 30 out=170b] v23'2 uv2 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f13f002d040 con 0x5559d4871ea0 2024-09-10T05:36:29.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.211+0000 7f1405c7a640 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559d4876310 con 0x5559d486a1d0 2024-09-10T05:36:29.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.211+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14000083f0 con 0x5559d486a1d0 2024-09-10T05:36:29.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.211+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559d4876310 con 0x5559d486a1d0 2024-09-10T05:36:29.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.211+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f14000083f0 con 0x5559d486a1d0 2024-09-10T05:36:29.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.211+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559d4876310 con 0x5559d486a1d0 2024-09-10T05:36:29.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.211+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14000083f0 con 0x5559d486a1d0 2024-09-10T05:36:29.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.211+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559d4876310 con 0x5559d4871ea0 2024-09-10T05:36:29.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.215+0000 7f1405c7a640 1 -- 172.21.15.62:0/232307743 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13f002d040 con 0x5559d4871ea0 2024-09-10T05:36:29.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.215+0000 7f1405c7a640 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559d4876310 con 0x7f13f8009040 2024-09-10T05:36:29.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.215+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14000083f0 con 0x7f13f8009040 2024-09-10T05:36:29.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.215+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559d4876310 con 0x5559d486a1d0 2024-09-10T05:36:29.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.215+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14000083f0 con 0x5559d486a1d0 2024-09-10T05:36:29.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.215+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559d4876310 con 0x7f13f8009040 2024-09-10T05:36:29.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.215+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14000083f0 con 0x7f13f8009040 2024-09-10T05:36:29.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.215+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559d4876310 con 0x5559d4871ea0 2024-09-10T05:36:29.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.215+0000 7f1405c7a640 1 -- 172.21.15.62:0/232307743 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13f002d040 con 0x5559d4871ea0 2024-09-10T05:36:29.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.215+0000 7f1405c7a640 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559d4876310 con 0x7f13f8009040 2024-09-10T05:36:29.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.215+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14000083f0 con 0x7f13f8009040 2024-09-10T05:36:29.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.215+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559d4876310 con 0x5559d486e680 2024-09-10T05:36:29.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.215+0000 7f140647b640 1 -- 172.21.15.62:0/232307743 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13f80f5020 con 0x5559d486e680 2024-09-10T05:36:29.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.215+0000 7f140647b640 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559d4876310 con 0x5559d486e680 2024-09-10T05:36:29.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.215+0000 7f140647b640 1 -- 172.21.15.62:0/232307743 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13f80f5020 con 0x5559d486e680 2024-09-10T05:36:29.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.215+0000 7f140647b640 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559d4876310 con 0x5559d4871ea0 2024-09-10T05:36:29.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.215+0000 7f1405c7a640 1 -- 172.21.15.62:0/232307743 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13f002d040 con 0x5559d4871ea0 2024-09-10T05:36:29.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.215+0000 7f1405c7a640 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559d4876310 con 0x5559d486e680 2024-09-10T05:36:29.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.219+0000 7f140647b640 1 -- 172.21.15.62:0/232307743 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f13f80f5020 con 0x5559d486e680 2024-09-10T05:36:29.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.219+0000 7f140647b640 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559d4876310 con 0x5559d486e680 2024-09-10T05:36:29.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.219+0000 7f140647b640 1 -- 172.21.15.62:0/232307743 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13f80f5020 con 0x5559d486e680 2024-09-10T05:36:29.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.219+0000 7f14089759c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:29.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.219+0000 7f14089759c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:29.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.219+0000 7f14089759c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:29.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.219+0000 7f14089759c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:29.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.219+0000 7f14089759c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:29.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.219+0000 7f14089759c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:29.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.219+0000 7f14089759c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:29.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.219+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5559d4875430 con 0x5559d486a1d0 2024-09-10T05:36:29.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.219+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f14000083f0 con 0x5559d486a1d0 2024-09-10T05:36:29.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.219+0000 7f14089759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:29.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.219+0000 7f14089759c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:29.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.219+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5559d4875cd0 con 0x5559d486e680 2024-09-10T05:36:29.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.219+0000 7f140647b640 1 -- 172.21.15.62:0/232307743 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f13f80f5020 con 0x5559d486e680 2024-09-10T05:36:29.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.219+0000 7f14089759c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:29.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.219+0000 7f14089759c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:29.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.219+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5559d4875070 con 0x5559d4871ea0 2024-09-10T05:36:29.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.219+0000 7f1405c7a640 1 -- 172.21.15.62:0/232307743 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f13f002d040 con 0x5559d4871ea0 2024-09-10T05:36:29.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.219+0000 7f14089759c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:29.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.219+0000 7f14089759c0 20 zone default found 2024-09-10T05:36:29.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.219+0000 7f14089759c0 4 Realm: () 2024-09-10T05:36:29.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.219+0000 7f14089759c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:29.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.219+0000 7f14089759c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:29.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.219+0000 7f14089759c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:29.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.219+0000 7f14089759c0 20 zonegroup default 2024-09-10T05:36:29.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.219+0000 7f14089759c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:29.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.219+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5559d4876bf0 con 0x7f13f8009040 2024-09-10T05:36:29.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.219+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f14000083f0 con 0x7f13f8009040 2024-09-10T05:36:29.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.219+0000 7f14089759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:29.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.219+0000 7f14089759c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:29.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.219+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5559d4878e30 con 0x5559d4871ea0 2024-09-10T05:36:29.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.223+0000 7f1405c7a640 1 -- 172.21.15.62:0/232307743 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f13f002d040 con 0x5559d4871ea0 2024-09-10T05:36:29.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.223+0000 7f14089759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:29.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.223+0000 7f14089759c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:29.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.223+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5559d48791d0 con 0x5559d4871ea0 2024-09-10T05:36:29.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.223+0000 7f1405c7a640 1 -- 172.21.15.62:0/232307743 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f13f002d040 con 0x5559d4871ea0 2024-09-10T05:36:29.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.223+0000 7f14089759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:29.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.223+0000 7f14089759c0 20 started sync module instance, tier type = 2024-09-10T05:36:29.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.223+0000 7f14089759c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:29.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.223+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d48782c0 con 0x5559d486e680 2024-09-10T05:36:29.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.223+0000 7f140647b640 1 -- 172.21.15.62:0/232307743 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13f80f5020 con 0x5559d486e680 2024-09-10T05:36:29.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.223+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93844306101936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d4877f20 con 0x5559d486e680 2024-09-10T05:36:29.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.223+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d4879f20 con 0x5559d486a1d0 2024-09-10T05:36:29.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.227+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14000083f0 con 0x5559d486a1d0 2024-09-10T05:36:29.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.227+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93844306109200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d487abe0 con 0x5559d486a1d0 2024-09-10T05:36:29.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.227+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d487b5a0 con 0x5559d486e680 2024-09-10T05:36:29.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.227+0000 7f140647b640 1 -- 172.21.15.62:0/232307743 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 93844306101936] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13f80f5020 con 0x5559d486e680 2024-09-10T05:36:29.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.227+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93844306109200] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14000083f0 con 0x5559d486a1d0 2024-09-10T05:36:29.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.227+0000 7f140647b640 1 -- 172.21.15.62:0/232307743 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13f80f5020 con 0x5559d486e680 2024-09-10T05:36:29.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.227+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93844306112752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d487abe0 con 0x5559d486e680 2024-09-10T05:36:29.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.227+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d487b510 con 0x7f13f8009040 2024-09-10T05:36:29.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.231+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14000083f0 con 0x7f13f8009040 2024-09-10T05:36:29.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.231+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93844306114960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d487b510 con 0x7f13f8009040 2024-09-10T05:36:29.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.231+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d487c8e0 con 0x5559d486e680 2024-09-10T05:36:29.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.231+0000 7f140647b640 1 -- 172.21.15.62:0/232307743 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93844306112752] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13f80f5020 con 0x5559d486e680 2024-09-10T05:36:29.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.235+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93844306114960] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14000083f0 con 0x7f13f8009040 2024-09-10T05:36:29.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.235+0000 7f140647b640 1 -- 172.21.15.62:0/232307743 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13f80f5020 con 0x5559d486e680 2024-09-10T05:36:29.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.235+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93844306116016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d487c8a0 con 0x5559d486e680 2024-09-10T05:36:29.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.235+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d487ccd0 con 0x5559d4871ea0 2024-09-10T05:36:29.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.235+0000 7f1405c7a640 1 -- 172.21.15.62:0/232307743 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13f002d040 con 0x5559d4871ea0 2024-09-10T05:36:29.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.235+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93844306110256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d487d520 con 0x5559d4871ea0 2024-09-10T05:36:29.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.235+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d487df80 con 0x5559d4871ea0 2024-09-10T05:36:29.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.239+0000 7f140647b640 1 -- 172.21.15.62:0/232307743 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 93844306116016] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13f80f5020 con 0x5559d486e680 2024-09-10T05:36:29.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.239+0000 7f1405c7a640 1 -- 172.21.15.62:0/232307743 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93844306110256] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13f002d040 con 0x5559d4871ea0 2024-09-10T05:36:29.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.239+0000 7f1405c7a640 1 -- 172.21.15.62:0/232307743 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13f002d040 con 0x5559d4871ea0 2024-09-10T05:36:29.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.239+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93844306123312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d487d070 con 0x5559d4871ea0 2024-09-10T05:36:29.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.239+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d487e630 con 0x7f13f8009040 2024-09-10T05:36:29.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.239+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14000083f0 con 0x7f13f8009040 2024-09-10T05:36:29.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.239+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93844306125184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d487ea50 con 0x7f13f8009040 2024-09-10T05:36:29.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.239+0000 7f14089759c0 20 add_watcher() i=0 2024-09-10T05:36:29.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.239+0000 7f14089759c0 20 add_watcher() i=1 2024-09-10T05:36:29.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.239+0000 7f14089759c0 20 add_watcher() i=2 2024-09-10T05:36:29.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.239+0000 7f14089759c0 20 add_watcher() i=3 2024-09-10T05:36:29.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.239+0000 7f14089759c0 20 add_watcher() i=4 2024-09-10T05:36:29.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.239+0000 7f14089759c0 20 add_watcher() i=5 2024-09-10T05:36:29.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.239+0000 7f1405c7a640 1 -- 172.21.15.62:0/232307743 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93844306123312] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13f002d040 con 0x5559d4871ea0 2024-09-10T05:36:29.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.239+0000 7f14089759c0 20 add_watcher() i=6 2024-09-10T05:36:29.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.239+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93844306125184] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14000083f0 con 0x7f13f8009040 2024-09-10T05:36:29.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.243+0000 7f14089759c0 20 add_watcher() i=7 2024-09-10T05:36:29.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.243+0000 7f14089759c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:29.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.243+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5559d4881a80 con 0x5559d486a1d0 2024-09-10T05:36:29.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.243+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f14000083f0 con 0x5559d486a1d0 2024-09-10T05:36:29.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.243+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93844306126240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d487ee70 con 0x5559d486a1d0 2024-09-10T05:36:29.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.243+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93844306126240] v30'32 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f14000083f0 con 0x5559d486a1d0 2024-09-10T05:36:29.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.243+0000 7f12bcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:29.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.243+0000 7f14089759c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:29.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.243+0000 7f14089759c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:29.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.243+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d488a220 con 0x5559d486e680 2024-09-10T05:36:29.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.247+0000 7f140647b640 1 -- 172.21.15.62:0/232307743 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'40 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f13f80f5020 con 0x5559d486e680 2024-09-10T05:36:29.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.247+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d488a2b0 con 0x7f13f8009040 2024-09-10T05:36:29.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.247+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f14000083f0 con 0x7f13f8009040 2024-09-10T05:36:29.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.247+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d488a820 con 0x5559d4871ea0 2024-09-10T05:36:29.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.251+0000 7f1405c7a640 1 -- 172.21.15.62:0/232307743 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f13f002d040 con 0x5559d4871ea0 2024-09-10T05:36:29.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.251+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d488ac40 con 0x5559d486a1d0 2024-09-10T05:36:29.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.251+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'33 uv12 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f14000083f0 con 0x5559d486a1d0 2024-09-10T05:36:29.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.251+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d488b060 con 0x5559d486e680 2024-09-10T05:36:29.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.255+0000 7f140647b640 1 -- 172.21.15.62:0/232307743 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'26 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f13f80f5020 con 0x5559d486e680 2024-09-10T05:36:29.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.255+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d488af90 con 0x5559d4871ea0 2024-09-10T05:36:29.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.255+0000 7f1405c7a640 1 -- 172.21.15.62:0/232307743 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'25 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f13f002d040 con 0x5559d4871ea0 2024-09-10T05:36:29.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.255+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d488b5a0 con 0x5559d486e680 2024-09-10T05:36:29.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.259+0000 7f140647b640 1 -- 172.21.15.62:0/232307743 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f13f80f5020 con 0x5559d486e680 2024-09-10T05:36:29.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.259+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d488b590 con 0x5559d486a1d0 2024-09-10T05:36:29.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.263+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'19 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f14000083f0 con 0x5559d486a1d0 2024-09-10T05:36:29.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.263+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d488bb00 con 0x5559d486e680 2024-09-10T05:36:29.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.263+0000 7f140647b640 1 -- 172.21.15.62:0/232307743 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f13f80f5020 con 0x5559d486e680 2024-09-10T05:36:29.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.263+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d488bb00 con 0x5559d486e680 2024-09-10T05:36:29.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.267+0000 7f140647b640 1 -- 172.21.15.62:0/232307743 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'16 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f13f80f5020 con 0x5559d486e680 2024-09-10T05:36:29.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.267+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d488bb00 con 0x5559d486e680 2024-09-10T05:36:29.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.267+0000 7f140647b640 1 -- 172.21.15.62:0/232307743 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'27 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13f80f5020 con 0x5559d486e680 2024-09-10T05:36:29.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.267+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d488bb00 con 0x5559d4871ea0 2024-09-10T05:36:29.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.271+0000 7f1405c7a640 1 -- 172.21.15.62:0/232307743 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13f002d040 con 0x5559d4871ea0 2024-09-10T05:36:29.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.271+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d488bc30 con 0x5559d486e680 2024-09-10T05:36:29.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.275+0000 7f140647b640 1 -- 172.21.15.62:0/232307743 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13f80f5020 con 0x5559d486e680 2024-09-10T05:36:29.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.275+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d488bc30 con 0x5559d486a1d0 2024-09-10T05:36:29.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.275+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'31 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f14000083f0 con 0x5559d486a1d0 2024-09-10T05:36:29.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.275+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d488c1e0 con 0x5559d486a1d0 2024-09-10T05:36:29.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.275+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'34 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f14000083f0 con 0x5559d486a1d0 2024-09-10T05:36:29.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.275+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d488c1a0 con 0x5559d486e680 2024-09-10T05:36:29.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.279+0000 7f140647b640 1 -- 172.21.15.62:0/232307743 <== osd.0 v2:172.21.15.2:6800/945139080 25 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'21 uv16 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13f80f5020 con 0x5559d486e680 2024-09-10T05:36:29.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.279+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d488c170 con 0x5559d486e680 2024-09-10T05:36:29.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.283+0000 7f140647b640 1 -- 172.21.15.62:0/232307743 <== osd.0 v2:172.21.15.2:6800/945139080 26 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'28 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13f80f5020 con 0x5559d486e680 2024-09-10T05:36:29.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.283+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d488c0e0 con 0x5559d4871ea0 2024-09-10T05:36:29.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.283+0000 7f1405c7a640 1 -- 172.21.15.62:0/232307743 <== osd.3 v2:172.21.15.62:6816/2708991149 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'22 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13f002d040 con 0x5559d4871ea0 2024-09-10T05:36:29.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.283+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d488c0e0 con 0x5559d486e680 2024-09-10T05:36:29.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.287+0000 7f140647b640 1 -- 172.21.15.62:0/232307743 <== osd.0 v2:172.21.15.2:6800/945139080 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13f80f5020 con 0x5559d486e680 2024-09-10T05:36:29.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.287+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d488c0e0 con 0x5559d486a1d0 2024-09-10T05:36:29.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.291+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 <== osd.1 v2:172.21.15.62:6808/3442097179 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'35 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f14000083f0 con 0x5559d486a1d0 2024-09-10T05:36:29.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.291+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d488c0e0 con 0x5559d486e680 2024-09-10T05:36:29.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.291+0000 7f140647b640 1 -- 172.21.15.62:0/232307743 <== osd.0 v2:172.21.15.2:6800/945139080 28 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'22 uv18 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13f80f5020 con 0x5559d486e680 2024-09-10T05:36:29.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.291+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d488c0e0 con 0x5559d486e680 2024-09-10T05:36:29.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.295+0000 7f140647b640 1 -- 172.21.15.62:0/232307743 <== osd.0 v2:172.21.15.2:6800/945139080 29 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'26 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13f80f5020 con 0x5559d486e680 2024-09-10T05:36:29.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.295+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d488c0e0 con 0x5559d4871ea0 2024-09-10T05:36:29.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.299+0000 7f1405c7a640 1 -- 172.21.15.62:0/232307743 <== osd.3 v2:172.21.15.62:6816/2708991149 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13f002d040 con 0x5559d4871ea0 2024-09-10T05:36:29.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.299+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d488c170 con 0x5559d486e680 2024-09-10T05:36:29.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.299+0000 7f140647b640 1 -- 172.21.15.62:0/232307743 <== osd.0 v2:172.21.15.2:6800/945139080 30 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'28 uv18 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13f80f5020 con 0x5559d486e680 2024-09-10T05:36:29.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.299+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d488c170 con 0x5559d4871ea0 2024-09-10T05:36:29.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.303+0000 7f1405c7a640 1 -- 172.21.15.62:0/232307743 <== osd.3 v2:172.21.15.62:6816/2708991149 21 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'12 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13f002d040 con 0x5559d4871ea0 2024-09-10T05:36:29.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.303+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d488c170 con 0x5559d4871ea0 2024-09-10T05:36:29.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.303+0000 7f1405c7a640 1 -- 172.21.15.62:0/232307743 <== osd.3 v2:172.21.15.62:6816/2708991149 22 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'26 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13f002d040 con 0x5559d4871ea0 2024-09-10T05:36:29.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.303+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d488c210 con 0x5559d4871ea0 2024-09-10T05:36:29.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.307+0000 7f1405c7a640 1 -- 172.21.15.62:0/232307743 <== osd.3 v2:172.21.15.62:6816/2708991149 23 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'18 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13f002d040 con 0x5559d4871ea0 2024-09-10T05:36:29.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.307+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d488c210 con 0x5559d486e680 2024-09-10T05:36:29.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.307+0000 7f140647b640 1 -- 172.21.15.62:0/232307743 <== osd.0 v2:172.21.15.2:6800/945139080 31 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'22 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13f80f5020 con 0x5559d486e680 2024-09-10T05:36:29.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.307+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d488c210 con 0x5559d486a1d0 2024-09-10T05:36:29.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.311+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 <== osd.1 v2:172.21.15.62:6808/3442097179 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'20 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f14000083f0 con 0x5559d486a1d0 2024-09-10T05:36:29.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.311+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d488c210 con 0x5559d486e680 2024-09-10T05:36:29.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.311+0000 7f140647b640 1 -- 172.21.15.62:0/232307743 <== osd.0 v2:172.21.15.2:6800/945139080 32 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13f80f5020 con 0x5559d486e680 2024-09-10T05:36:29.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.311+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d488c210 con 0x5559d486a1d0 2024-09-10T05:36:29.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.315+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 <== osd.1 v2:172.21.15.62:6808/3442097179 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'32 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f14000083f0 con 0x5559d486a1d0 2024-09-10T05:36:29.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.315+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d488c210 con 0x7f13f8009040 2024-09-10T05:36:29.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.315+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f14000083f0 con 0x7f13f8009040 2024-09-10T05:36:29.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.315+0000 7f12377fe640 20 reqs_thread_entry: start 2024-09-10T05:36:29.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.315+0000 7f14089759c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:29.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.315+0000 7f14089759c0 20 Filter name: none 2024-09-10T05:36:29.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.315+0000 7f12357fa640 20 reqs_thread_entry: start 2024-09-10T05:36:29.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.315+0000 7f14089759c0 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-10T05:36:29.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.315+0000 7f14089759c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:29.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.315+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5559d4889a80 con 0x7f13f8009040 2024-09-10T05:36:29.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.315+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(94 bud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f14000083f0 con 0x7f13f8009040 2024-09-10T05:36:29.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.315+0000 7f14089759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:29.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.315+0000 7f14089759c0 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2024-09-10T05:36:29.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.315+0000 7f14089759c0 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-10T05:36:29.321 INFO:teuthology.orchestra.run.smithi062.stderr:could not remove user: unable to remove user, user does not exist 2024-09-10T05:36:29.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.319+0000 7f12bcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:29.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.319+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93844306126240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d4889a80 con 0x5559d486a1d0 2024-09-10T05:36:29.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.319+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 <== osd.1 v2:172.21.15.62:6808/3442097179 26 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 93844306126240] v30'36 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f14000083f0 con 0x5559d486a1d0 2024-09-10T05:36:29.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.319+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93844306101936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d4889a80 con 0x5559d486e680 2024-09-10T05:36:29.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.323+0000 7f140647b640 1 -- 172.21.15.62:0/232307743 <== osd.0 v2:172.21.15.2:6800/945139080 33 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 93844306101936] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13f80f5020 con 0x5559d486e680 2024-09-10T05:36:29.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.323+0000 7f14089759c0 20 remove_watcher() i=0 2024-09-10T05:36:29.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.323+0000 7f14089759c0 2 removed watcher, disabling cache 2024-09-10T05:36:29.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.323+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93844306109200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d4889a40 con 0x5559d486a1d0 2024-09-10T05:36:29.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.323+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 <== osd.1 v2:172.21.15.62:6808/3442097179 27 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 93844306109200] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14000083f0 con 0x5559d486a1d0 2024-09-10T05:36:29.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.323+0000 7f14089759c0 20 remove_watcher() i=1 2024-09-10T05:36:29.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.323+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93844306112752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d4889a40 con 0x5559d486e680 2024-09-10T05:36:29.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.327+0000 7f140647b640 1 -- 172.21.15.62:0/232307743 <== osd.0 v2:172.21.15.2:6800/945139080 34 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 93844306112752] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13f80f5020 con 0x5559d486e680 2024-09-10T05:36:29.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.327+0000 7f14089759c0 20 remove_watcher() i=2 2024-09-10T05:36:29.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.327+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93844306114960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d4889a40 con 0x7f13f8009040 2024-09-10T05:36:29.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.327+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 <== osd.2 v2:172.21.15.62:6800/2677868286 15 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 93844306114960] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14000083f0 con 0x7f13f8009040 2024-09-10T05:36:29.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.327+0000 7f14089759c0 20 remove_watcher() i=3 2024-09-10T05:36:29.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.327+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93844306116016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d4889a40 con 0x5559d486e680 2024-09-10T05:36:29.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.331+0000 7f140647b640 1 -- 172.21.15.62:0/232307743 <== osd.0 v2:172.21.15.2:6800/945139080 35 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 93844306116016] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13f80f5020 con 0x5559d486e680 2024-09-10T05:36:29.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.331+0000 7f14089759c0 20 remove_watcher() i=4 2024-09-10T05:36:29.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.331+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93844306110256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d4889a40 con 0x5559d4871ea0 2024-09-10T05:36:29.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.331+0000 7f1405c7a640 1 -- 172.21.15.62:0/232307743 <== osd.3 v2:172.21.15.62:6816/2708991149 24 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 93844306110256] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13f002d040 con 0x5559d4871ea0 2024-09-10T05:36:29.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.331+0000 7f14089759c0 20 remove_watcher() i=5 2024-09-10T05:36:29.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.331+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93844306123312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d4889a40 con 0x5559d4871ea0 2024-09-10T05:36:29.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.335+0000 7f1405c7a640 1 -- 172.21.15.62:0/232307743 <== osd.3 v2:172.21.15.62:6816/2708991149 25 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 93844306123312] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13f002d040 con 0x5559d4871ea0 2024-09-10T05:36:29.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.335+0000 7f14089759c0 20 remove_watcher() i=6 2024-09-10T05:36:29.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.335+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93844306125184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559d4889a40 con 0x7f13f8009040 2024-09-10T05:36:29.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.335+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 <== osd.2 v2:172.21.15.62:6800/2677868286 16 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 93844306125184] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14000083f0 con 0x7f13f8009040 2024-09-10T05:36:29.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.335+0000 7f14089759c0 20 remove_watcher() i=7 2024-09-10T05:36:29.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.335+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5559d486e680 msgr2=0x5559d4870a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.335+0000 7f14089759c0 1 --2- 172.21.15.62:0/232307743 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5559d486e680 0x5559d4870a70 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.335+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5559d486a1d0 msgr2=0x5559d486c690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.335+0000 7f14089759c0 1 --2- 172.21.15.62:0/232307743 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5559d486a1d0 0x5559d486c690 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.335+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f13f8009040 msgr2=0x7f13f80a9810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.335+0000 7f14089759c0 1 --2- 172.21.15.62:0/232307743 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f13f8009040 0x7f13f80a9810 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.335+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5559d4871ea0 msgr2=0x5559d48742b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.335+0000 7f14089759c0 1 --2- 172.21.15.62:0/232307743 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5559d4871ea0 0x5559d48742b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.335+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f12d0039a70 msgr2=0x7f12d003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.335+0000 7f14089759c0 1 --2- 172.21.15.62:0/232307743 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f12d0039a70 0x7f12d003bf30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x5559d4839d70 tx=0x7f13f0010000 comp rx=0 tx=0).stop 2024-09-10T05:36:29.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.335+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d4858230 msgr2=0x5559d485f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.335+0000 7f14089759c0 1 --2- 172.21.15.62:0/232307743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d4858230 0x5559d485f3f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f13f80e9360 tx=0x7f13f80d8f90 comp rx=0 tx=0).stop 2024-09-10T05:36:29.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.335+0000 7f1406c7c640 1 -- 172.21.15.62:0/232307743 reap_dead start 2024-09-10T05:36:29.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.335+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 shutdown_connections 2024-09-10T05:36:29.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.335+0000 7f14089759c0 1 --2- 172.21.15.62:0/232307743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d4858230 0x5559d485f3f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.335+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 >> 172.21.15.62:0/232307743 conn(0x5559d4854660 msgr2=0x5559d4852870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:29.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.335+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 shutdown_connections 2024-09-10T05:36:29.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.335+0000 7f14089759c0 1 -- 172.21.15.62:0/232307743 wait complete. 2024-09-10T05:36:29.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.335+0000 7f14089759c0 1 -- 172.21.15.62:0/470390068 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f12e0039a70 msgr2=0x7f12e003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.335+0000 7f14089759c0 1 --2- 172.21.15.62:0/470390068 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f12e0039a70 0x7f12e003bf30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f13f00063c0 tx=0x7f13f000f000 comp rx=0 tx=0).stop 2024-09-10T05:36:29.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.335+0000 7f14089759c0 1 -- 172.21.15.62:0/470390068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d484bc00 msgr2=0x5559d484c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.335+0000 7f14089759c0 1 --2- 172.21.15.62:0/470390068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d484bc00 0x5559d484c020 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f13f80bcaf0 tx=0x7f13f80bcea0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.335+0000 7f14089759c0 1 -- 172.21.15.62:0/470390068 shutdown_connections 2024-09-10T05:36:29.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.335+0000 7f14089759c0 1 --2- 172.21.15.62:0/470390068 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f12e0039a70 0x7f12e003bf30 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.335+0000 7f14089759c0 1 --2- 172.21.15.62:0/470390068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d484bc00 0x5559d484c020 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.335+0000 7f14089759c0 1 -- 172.21.15.62:0/470390068 >> 172.21.15.62:0/470390068 conn(0x5559d48415b0 msgr2=0x5559d4841990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:29.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.335+0000 7f14089759c0 1 -- 172.21.15.62:0/470390068 shutdown_connections 2024-09-10T05:36:29.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.335+0000 7f14089759c0 1 -- 172.21.15.62:0/470390068 wait complete. 2024-09-10T05:36:29.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.335+0000 7f14089759c0 1 -- 172.21.15.62:0/3094645077 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5559d4836320 msgr2=0x5559d4838710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.335+0000 7f14089759c0 1 --2- 172.21.15.62:0/3094645077 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5559d4836320 0x5559d4838710 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.335+0000 7f14089759c0 1 -- 172.21.15.62:0/3094645077 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5559d46ad620 msgr2=0x5559d4835030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.335+0000 7f14089759c0 1 --2- 172.21.15.62:0/3094645077 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5559d46ad620 0x5559d4835030 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.339+0000 7f14089759c0 1 -- 172.21.15.62:0/3094645077 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5559d483ab00 msgr2=0x5559d483cef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.339+0000 7f14089759c0 1 --2- 172.21.15.62:0/3094645077 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5559d483ab00 0x5559d483cef0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.339+0000 7f14089759c0 1 -- 172.21.15.62:0/3094645077 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f12ec039ac0 msgr2=0x7f12ec03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.339+0000 7f14089759c0 1 --2- 172.21.15.62:0/3094645077 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f12ec039ac0 0x7f12ec03bf80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f13f0001640 tx=0x7f13f00066a0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.339+0000 7f14089759c0 1 -- 172.21.15.62:0/3094645077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d46ad240 msgr2=0x5559d482dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.339+0000 7f14089759c0 1 --2- 172.21.15.62:0/3094645077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559d46ad240 0x5559d482dec0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f13f8096f40 tx=0x7f13f80180e0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.339+0000 7f1406c7c640 1 -- 172.21.15.62:0/3094645077 reap_dead start 2024-09-10T05:36:29.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.339+0000 7f14089759c0 1 -- 172.21.15.62:0/3094645077 shutdown_connections 2024-09-10T05:36:29.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.339+0000 7f14089759c0 1 -- 172.21.15.62:0/3094645077 >> 172.21.15.62:0/3094645077 conn(0x5559d4733920 msgr2=0x5559d4820f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:29.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.339+0000 7f14089759c0 1 -- 172.21.15.62:0/3094645077 shutdown_connections 2024-09-10T05:36:29.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.339+0000 7f14089759c0 1 -- 172.21.15.62:0/3094645077 wait complete. 2024-09-10T05:36:29.353 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-10T05:36:29.353 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2024-09-10T05:36:29.354 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2024-09-10T05:36:29.354 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2024-09-10T05:36:29.437 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:29.437 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:29.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.435+0000 7fa64ecbd9c0 1 Processor -- start 2024-09-10T05:36:29.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.435+0000 7fa64ecbd9c0 1 -- start start 2024-09-10T05:36:29.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.435+0000 7fa64ecbd9c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55c3cc91c7b0 0x55c3cc91b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:29.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.435+0000 7fa64ecbd9c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c3cc85a9c0 con 0x55c3cc91c280 2024-09-10T05:36:29.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.435+0000 7fa64ecbd9c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x55c3cc8aa6d0 con 0x55c3cc91c7b0 2024-09-10T05:36:29.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.435+0000 7fa64bfc2640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55c3cc91c7b0 0x55c3cc91b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:29.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.435+0000 7fa64bfc2640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55c3cc91c7b0 0x55c3cc91b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:50820/0 (socket says 172.21.15.62:50820) 2024-09-10T05:36:29.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.435+0000 7fa64c7c3640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x55c3cc91c280 0x55c3cc91ac70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:38418/0 (socket says 172.21.15.62:38418) 2024-09-10T05:36:29.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.435+0000 7fa64bfc2640 1 -- 172.21.15.62:0/3209575359 learned_addr learned my addr 172.21.15.62:0/3209575359 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:29.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.435+0000 7fa64bfc2640 1 -- 172.21.15.62:0/3209575359 >> v1:172.21.15.2:6789/0 conn(0x55c3cc91c280 legacy=0x55c3cc91ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.435+0000 7fa64bfc2640 1 -- 172.21.15.62:0/3209575359 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3cc84eca0 con 0x55c3cc91c7b0 2024-09-10T05:36:29.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.439+0000 7fa64bfc2640 1 --2- 172.21.15.62:0/3209575359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c3cc91c7b0 0x55c3cc91b380 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa63c00a4e0 tx=0x7fa63c01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a651f4c8040e6fe server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:29.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.439+0000 7fa64b7c1640 1 -- 172.21.15.62:0/3209575359 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa63c0aa540 con 0x55c3cc91c7b0 2024-09-10T05:36:29.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.439+0000 7fa64b7c1640 1 -- 172.21.15.62:0/3209575359 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa63c0aa6e0 con 0x55c3cc91c7b0 2024-09-10T05:36:29.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.439+0000 7fa64b7c1640 1 -- 172.21.15.62:0/3209575359 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa63c0aaa40 con 0x55c3cc91c7b0 2024-09-10T05:36:29.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.439+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/3209575359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c3cc91c7b0 msgr2=0x55c3cc91b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.439+0000 7fa64ecbd9c0 1 --2- 172.21.15.62:0/3209575359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c3cc91c7b0 0x55c3cc91b380 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa63c00a4e0 tx=0x7fa63c01afd0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.439+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/3209575359 shutdown_connections 2024-09-10T05:36:29.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.439+0000 7fa64ecbd9c0 1 --2- 172.21.15.62:0/3209575359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c3cc91c7b0 0x55c3cc91b380 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.439+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/3209575359 >> 172.21.15.62:0/3209575359 conn(0x55c3cc9a1aa0 msgr2=0x55c3cc9a3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:29.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.439+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/3209575359 shutdown_connections 2024-09-10T05:36:29.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.439+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/3209575359 wait complete. 2024-09-10T05:36:29.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.455+0000 7fa64ecbd9c0 1 Processor -- start 2024-09-10T05:36:29.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.455+0000 7fa64ecbd9c0 1 -- start start 2024-09-10T05:36:29.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.455+0000 7fa64ecbd9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c3cc91c280 0x55c3cca93bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:29.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.455+0000 7fa64ecbd9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c3cc8ae680 con 0x55c3cc91c280 2024-09-10T05:36:29.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.455+0000 7fa64c7c3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c3cc91c280 0x55c3cca93bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:29.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.455+0000 7fa64c7c3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c3cc91c280 0x55c3cca93bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:50828/0 (socket says 172.21.15.62:50828) 2024-09-10T05:36:29.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.455+0000 7fa64c7c3640 1 -- 172.21.15.62:0/3581916675 learned_addr learned my addr 172.21.15.62:0/3581916675 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:29.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.455+0000 7fa64c7c3640 1 -- 172.21.15.62:0/3581916675 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3cc829da0 con 0x55c3cc91c280 2024-09-10T05:36:29.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.455+0000 7fa64c7c3640 1 --2- 172.21.15.62:0/3581916675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c3cc91c280 0x55c3cca93bc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa63400b270 tx=0x7fa63400b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a48b8dfdfa02bb65 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:29.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.455+0000 7fa53a60c640 1 -- 172.21.15.62:0/3581916675 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa63400e5d0 con 0x55c3cc91c280 2024-09-10T05:36:29.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.455+0000 7fa53a60c640 1 -- 172.21.15.62:0/3581916675 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa63400e770 con 0x55c3cc91c280 2024-09-10T05:36:29.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.455+0000 7fa53a60c640 1 -- 172.21.15.62:0/3581916675 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa63400ea70 con 0x55c3cc91c280 2024-09-10T05:36:29.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.459+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/3581916675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c3cc91c280 msgr2=0x55c3cca93bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.459+0000 7fa64ecbd9c0 1 --2- 172.21.15.62:0/3581916675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c3cc91c280 0x55c3cca93bc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa63400b270 tx=0x7fa63400b670 comp rx=0 tx=0).stop 2024-09-10T05:36:29.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.459+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/3581916675 shutdown_connections 2024-09-10T05:36:29.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.459+0000 7fa64ecbd9c0 1 --2- 172.21.15.62:0/3581916675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c3cc91c280 0x55c3cca93bc0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.459+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/3581916675 >> 172.21.15.62:0/3581916675 conn(0x55c3cc9a1aa0 msgr2=0x55c3cca8f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:29.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.459+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/3581916675 shutdown_connections 2024-09-10T05:36:29.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.459+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/3581916675 wait complete. 2024-09-10T05:36:29.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.459+0000 7fa64ecbd9c0 1 Processor -- start 2024-09-10T05:36:29.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.459+0000 7fa64ecbd9c0 1 -- start start 2024-09-10T05:36:29.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.459+0000 7fa64ecbd9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c3cc91c7b0 0x55c3cca9b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:29.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.459+0000 7fa64ecbd9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c3cc850a50 con 0x55c3cc91c7b0 2024-09-10T05:36:29.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.459+0000 7fa64c7c3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c3cc91c7b0 0x55c3cca9b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:29.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.459+0000 7fa64c7c3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c3cc91c7b0 0x55c3cca9b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:50836/0 (socket says 172.21.15.62:50836) 2024-09-10T05:36:29.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.459+0000 7fa64c7c3640 1 -- 172.21.15.62:0/4294752267 learned_addr learned my addr 172.21.15.62:0/4294752267 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:29.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.459+0000 7fa64c7c3640 1 -- 172.21.15.62:0/4294752267 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3cca9bae0 con 0x55c3cc91c7b0 2024-09-10T05:36:29.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.459+0000 7fa64c7c3640 1 --2- 172.21.15.62:0/4294752267 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c3cc91c7b0 0x55c3cca9b580 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x55c3cca94b50 tx=0x7fa634000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:29.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.459+0000 7fa538e09640 1 -- 172.21.15.62:0/4294752267 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa63400be70 con 0x55c3cc91c7b0 2024-09-10T05:36:29.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.459+0000 7fa538e09640 1 -- 172.21.15.62:0/4294752267 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa63400ee20 con 0x55c3cc91c7b0 2024-09-10T05:36:29.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.459+0000 7fa538e09640 1 -- 172.21.15.62:0/4294752267 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa63400fb10 con 0x55c3cc91c7b0 2024-09-10T05:36:29.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.459+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4294752267 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c3cca9bd70 con 0x55c3cc91c7b0 2024-09-10T05:36:29.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.459+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4294752267 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3cca9c630 con 0x55c3cc91c7b0 2024-09-10T05:36:29.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.463+0000 7fa538e09640 1 -- 172.21.15.62:0/4294752267 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fa634017070 con 0x55c3cc91c7b0 2024-09-10T05:36:29.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.463+0000 7fa538e09640 1 --2- 172.21.15.62:0/4294752267 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fa534039a70 0x7fa53403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:29.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.463+0000 7fa538e09640 1 -- 172.21.15.62:0/4294752267 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fa634015020 con 0x55c3cc91c7b0 2024-09-10T05:36:29.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.463+0000 7fa64bfc2640 1 --2- 172.21.15.62:0/4294752267 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fa534039a70 0x7fa53403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:29.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.463+0000 7fa64ecbd9c0 1 --2- 172.21.15.62:0/4294752267 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55c3ccaa05f0 0x55c3ccaa29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:29.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.463+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4294752267 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccaa2f20 con 0x55c3ccaa05f0 2024-09-10T05:36:29.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.463+0000 7fa64cfc4640 1 --2- 172.21.15.62:0/4294752267 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55c3ccaa05f0 0x55c3ccaa29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:29.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.463+0000 7fa64bfc2640 1 --2- 172.21.15.62:0/4294752267 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fa534039a70 0x7fa53403bf30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa63c0ab000 tx=0x7fa63c0a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:29.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.463+0000 7fa64cfc4640 1 --2- 172.21.15.62:0/4294752267 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55c3ccaa05f0 0x55c3ccaa29e0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:29.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.463+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4294752267 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa6440083f0 con 0x55c3ccaa05f0 2024-09-10T05:36:29.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.463+0000 7fa64ecbd9c0 1 --2- 172.21.15.62:0/4294752267 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55c3ccaa3a20 0x55c3ccaa5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:29.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.463+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4294752267 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccaa6650 con 0x55c3ccaa3a20 2024-09-10T05:36:29.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.463+0000 7fa64c7c3640 1 --2- 172.21.15.62:0/4294752267 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55c3ccaa3a20 0x55c3ccaa5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:29.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.463+0000 7fa64c7c3640 1 --2- 172.21.15.62:0/4294752267 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55c3ccaa3a20 0x55c3ccaa5ee0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:29.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.463+0000 7fa64c7c3640 1 -- 172.21.15.62:0/4294752267 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa63402e070 con 0x55c3ccaa3a20 2024-09-10T05:36:29.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.463+0000 7fa64ecbd9c0 1 --2- 172.21.15.62:0/4294752267 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55c3ccaa8410 0x55c3ccaaa800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:29.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.463+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4294752267 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccaaaef0 con 0x55c3ccaa8410 2024-09-10T05:36:29.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.463+0000 7fa64bfc2640 1 --2- 172.21.15.62:0/4294752267 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55c3ccaa8410 0x55c3ccaaa800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:29.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.467+0000 7fa64bfc2640 1 --2- 172.21.15.62:0/4294752267 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55c3ccaa8410 0x55c3ccaaa800 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:29.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.467+0000 7fa64bfc2640 1 -- 172.21.15.62:0/4294752267 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa63c0bc040 con 0x55c3ccaa8410 2024-09-10T05:36:29.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.467+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4294752267 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccaa72b0 con 0x55c3ccaa3a20 2024-09-10T05:36:29.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.467+0000 7fa64c7c3640 1 -- 172.21.15.62:0/4294752267 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa63402e070 con 0x55c3ccaa3a20 2024-09-10T05:36:29.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.467+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4294752267 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccaa7710 con 0x55c3ccaa8410 2024-09-10T05:36:29.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.467+0000 7fa64bfc2640 1 -- 172.21.15.62:0/4294752267 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa63c0bc040 con 0x55c3ccaa8410 2024-09-10T05:36:29.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.467+0000 7fa64ecbd9c0 1 Processor -- start 2024-09-10T05:36:29.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.467+0000 7fa64ecbd9c0 1 -- start start 2024-09-10T05:36:29.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.467+0000 7fa64ecbd9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c3ccab9540 0x55c3ccab9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:29.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.467+0000 7fa64ecbd9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c3cc8bb450 con 0x55c3ccab9540 2024-09-10T05:36:29.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.467+0000 7fa64c7c3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c3ccab9540 0x55c3ccab9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:29.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.467+0000 7fa64c7c3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c3ccab9540 0x55c3ccab9960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:50852/0 (socket says 172.21.15.62:50852) 2024-09-10T05:36:29.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.467+0000 7fa64c7c3640 1 -- 172.21.15.62:0/2405835673 learned_addr learned my addr 172.21.15.62:0/2405835673 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:29.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.467+0000 7fa64c7c3640 1 -- 172.21.15.62:0/2405835673 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3ccab9fa0 con 0x55c3ccab9540 2024-09-10T05:36:29.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.467+0000 7fa64c7c3640 1 --2- 172.21.15.62:0/2405835673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c3ccab9540 0x55c3ccab9960 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa63401cfd0 tx=0x7fa6340197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:29.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.467+0000 7fa531ffb640 1 -- 172.21.15.62:0/2405835673 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa634048110 con 0x55c3ccab9540 2024-09-10T05:36:29.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.467+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/2405835673 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c3ccaba800 con 0x55c3ccab9540 2024-09-10T05:36:29.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.467+0000 7fa531ffb640 1 -- 172.21.15.62:0/2405835673 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6340482b0 con 0x55c3ccab9540 2024-09-10T05:36:29.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.467+0000 7fa531ffb640 1 -- 172.21.15.62:0/2405835673 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa634048590 con 0x55c3ccab9540 2024-09-10T05:36:29.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.471+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/2405835673 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3ccaba800 con 0x55c3ccab9540 2024-09-10T05:36:29.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.471+0000 7fa531ffb640 1 -- 172.21.15.62:0/2405835673 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fa634019860 con 0x55c3ccab9540 2024-09-10T05:36:29.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.471+0000 7fa531ffb640 1 --2- 172.21.15.62:0/2405835673 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fa524039ac0 0x7fa52403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:29.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.471+0000 7fa531ffb640 1 -- 172.21.15.62:0/2405835673 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fa634039070 con 0x55c3ccab9540 2024-09-10T05:36:29.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.471+0000 7fa64bfc2640 1 --2- 172.21.15.62:0/2405835673 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fa524039ac0 0x7fa52403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:29.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.471+0000 7fa64ecbd9c0 1 Processor -- start 2024-09-10T05:36:29.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.471+0000 7fa64ecbd9c0 1 -- start start 2024-09-10T05:36:29.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.471+0000 7fa64ecbd9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c3ccac5b30 0x55c3ccac5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:29.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.471+0000 7fa64ecbd9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c3cca94410 con 0x55c3ccac5b30 2024-09-10T05:36:29.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.471+0000 7fa64bfc2640 1 --2- 172.21.15.62:0/2405835673 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fa524039ac0 0x7fa52403bf80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x55c3ccaa7280 tx=0x7fa63c005e50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:29.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.471+0000 7fa64c7c3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c3ccac5b30 0x55c3ccac5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:29.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.471+0000 7fa64c7c3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c3ccac5b30 0x55c3ccac5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:50858/0 (socket says 172.21.15.62:50858) 2024-09-10T05:36:29.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.471+0000 7fa64c7c3640 1 -- 172.21.15.62:0/1231700429 learned_addr learned my addr 172.21.15.62:0/1231700429 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:29.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.471+0000 7fa64c7c3640 1 -- 172.21.15.62:0/1231700429 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3ccac6500 con 0x55c3ccac5b30 2024-09-10T05:36:29.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.471+0000 7fa64c7c3640 1 --2- 172.21.15.62:0/1231700429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c3ccac5b30 0x55c3ccac5f10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa634000c10 tx=0x7fa634050600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba0e489e974ce55a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:29.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.471+0000 7fa52b7fe640 1 -- 172.21.15.62:0/1231700429 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa63401dce0 con 0x55c3ccac5b30 2024-09-10T05:36:29.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.471+0000 7fa52b7fe640 1 -- 172.21.15.62:0/1231700429 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa634062020 con 0x55c3ccac5b30 2024-09-10T05:36:29.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.471+0000 7fa52b7fe640 1 -- 172.21.15.62:0/1231700429 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa634048d90 con 0x55c3ccac5b30 2024-09-10T05:36:29.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.475+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/1231700429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c3ccac5b30 msgr2=0x55c3ccac5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.475+0000 7fa64ecbd9c0 1 --2- 172.21.15.62:0/1231700429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c3ccac5b30 0x55c3ccac5f10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa634000c10 tx=0x7fa634050600 comp rx=0 tx=0).stop 2024-09-10T05:36:29.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.475+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/1231700429 shutdown_connections 2024-09-10T05:36:29.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.475+0000 7fa64ecbd9c0 1 --2- 172.21.15.62:0/1231700429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c3ccac5b30 0x55c3ccac5f10 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.475+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/1231700429 >> 172.21.15.62:0/1231700429 conn(0x55c3ccac1f60 msgr2=0x55c3ccac01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:29.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.475+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/1231700429 shutdown_connections 2024-09-10T05:36:29.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.475+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/1231700429 wait complete. 2024-09-10T05:36:29.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.475+0000 7fa64ecbd9c0 1 Processor -- start 2024-09-10T05:36:29.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.475+0000 7fa64ecbd9c0 1 -- start start 2024-09-10T05:36:29.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.475+0000 7fa64ecbd9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c3ccac5b30 0x55c3ccacce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:29.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.475+0000 7fa64ecbd9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c3ccac69c0 con 0x55c3ccac5b30 2024-09-10T05:36:29.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.475+0000 7fa64c7c3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c3ccac5b30 0x55c3ccacce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:29.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.475+0000 7fa64c7c3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c3ccac5b30 0x55c3ccacce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:50870/0 (socket says 172.21.15.62:50870) 2024-09-10T05:36:29.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.475+0000 7fa64c7c3640 1 -- 172.21.15.62:0/4179545269 learned_addr learned my addr 172.21.15.62:0/4179545269 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:29.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.475+0000 7fa64c7c3640 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3ccacd370 con 0x55c3ccac5b30 2024-09-10T05:36:29.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.475+0000 7fa64c7c3640 1 --2- 172.21.15.62:0/4179545269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c3ccac5b30 0x55c3ccacce10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa63401bab0 tx=0x7fa634006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:29.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.475+0000 7fa529ffb640 1 -- 172.21.15.62:0/4179545269 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa634061050 con 0x55c3ccac5b30 2024-09-10T05:36:29.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.475+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c3ccacd370 con 0x55c3ccac5b30 2024-09-10T05:36:29.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.475+0000 7fa529ffb640 1 -- 172.21.15.62:0/4179545269 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa634031450 con 0x55c3ccac5b30 2024-09-10T05:36:29.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.475+0000 7fa529ffb640 1 -- 172.21.15.62:0/4179545269 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa63401d450 con 0x55c3ccac5b30 2024-09-10T05:36:29.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.475+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3ccacd940 con 0x55c3ccac5b30 2024-09-10T05:36:29.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.479+0000 7fa529ffb640 1 -- 172.21.15.62:0/4179545269 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fa634058070 con 0x55c3ccac5b30 2024-09-10T05:36:29.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.479+0000 7fa529ffb640 1 --2- 172.21.15.62:0/4179545269 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fa51c039a70 0x7fa51c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:29.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.479+0000 7fa529ffb640 1 -- 172.21.15.62:0/4179545269 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fa63406f070 con 0x55c3ccac5b30 2024-09-10T05:36:29.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.479+0000 7fa64ecbd9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:29.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.479+0000 7fa64bfc2640 1 --2- 172.21.15.62:0/4179545269 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fa51c039a70 0x7fa51c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:29.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.479+0000 7fa64ecbd9c0 1 --2- 172.21.15.62:0/4179545269 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55c3ccad7d80 0x55c3ccada240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:29.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.479+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccada990 con 0x55c3ccad7d80 2024-09-10T05:36:29.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.479+0000 7fa64cfc4640 1 --2- 172.21.15.62:0/4179545269 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55c3ccad7d80 0x55c3ccada240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:29.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.479+0000 7fa64bfc2640 1 --2- 172.21.15.62:0/4179545269 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fa51c039a70 0x7fa51c03bf30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa63c0aafd0 tx=0x7fa63c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:29.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.479+0000 7fa64cfc4640 1 --2- 172.21.15.62:0/4179545269 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55c3ccad7d80 0x55c3ccada240 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:29.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.479+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa6440083f0 con 0x55c3ccad7d80 2024-09-10T05:36:29.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.479+0000 7fa64ecbd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:29.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.479+0000 7fa64ecbd9c0 20 realm 2024-09-10T05:36:29.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.479+0000 7fa64ecbd9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:29.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.479+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccad70f0 con 0x55c3ccad7d80 2024-09-10T05:36:29.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.479+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa6440083f0 con 0x55c3ccad7d80 2024-09-10T05:36:29.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.479+0000 7fa64ecbd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:29.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.479+0000 7fa64ecbd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:29.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.479+0000 7fa64ecbd9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:29.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.479+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccadb460 con 0x55c3ccad7d80 2024-09-10T05:36:29.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.479+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa6440083f0 con 0x55c3ccad7d80 2024-09-10T05:36:29.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.479+0000 7fa64ecbd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:29.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.479+0000 7fa64ecbd9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:29.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.479+0000 7fa64ecbd9c0 1 --2- 172.21.15.62:0/4179545269 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55c3ccadc240 0x55c3ccade630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:29.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.479+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccadece0 con 0x55c3ccadc240 2024-09-10T05:36:29.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.479+0000 7fa64c7c3640 1 --2- 172.21.15.62:0/4179545269 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55c3ccadc240 0x55c3ccade630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:29.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.479+0000 7fa64c7c3640 1 --2- 172.21.15.62:0/4179545269 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55c3ccadc240 0x55c3ccade630 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:29.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.483+0000 7fa64c7c3640 1 -- 172.21.15.62:0/4179545269 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa63402e070 con 0x55c3ccadc240 2024-09-10T05:36:29.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.483+0000 7fa64ecbd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:29.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.483+0000 7fa64ecbd9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:29.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.483+0000 7fa64ecbd9c0 1 --2- 172.21.15.62:0/4179545269 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55c3ccadfa40 0x55c3ccae1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:29.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.483+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae25a0 con 0x55c3ccadfa40 2024-09-10T05:36:29.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.483+0000 7fa64bfc2640 1 --2- 172.21.15.62:0/4179545269 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55c3ccadfa40 0x55c3ccae1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:29.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.483+0000 7fa64bfc2640 1 --2- 172.21.15.62:0/4179545269 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55c3ccadfa40 0x55c3ccae1e30 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:29.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.483+0000 7fa64bfc2640 1 -- 172.21.15.62:0/4179545269 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa63c0c3050 con 0x55c3ccadfa40 2024-09-10T05:36:29.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.483+0000 7fa64ecbd9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:29.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.483+0000 7fa64ecbd9c0 20 searching for the correct realm 2024-09-10T05:36:29.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.483+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae3e70 con 0x55c3ccadfa40 2024-09-10T05:36:29.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.483+0000 7fa64bfc2640 1 -- 172.21.15.62:0/4179545269 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa63c0c3050 con 0x55c3ccadfa40 2024-09-10T05:36:29.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.483+0000 7fa64bfc2640 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae3e70 con 0x55c3ccadc240 2024-09-10T05:36:29.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.483+0000 7fa64c7c3640 1 -- 172.21.15.62:0/4179545269 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa63402e070 con 0x55c3ccadc240 2024-09-10T05:36:29.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.483+0000 7fa64c7c3640 1 --2- 172.21.15.62:0/4179545269 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x55c3cc91c280 0x7fa63403e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:29.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.483+0000 7fa64c7c3640 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae3e70 con 0x55c3cc91c280 2024-09-10T05:36:29.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.483+0000 7fa64cfc4640 1 --2- 172.21.15.62:0/4179545269 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x55c3cc91c280 0x7fa63403e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:29.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.483+0000 7fa64cfc4640 1 --2- 172.21.15.62:0/4179545269 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x55c3cc91c280 0x7fa63403e420 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:29.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.483+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6440083f0 con 0x55c3cc91c280 2024-09-10T05:36:29.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.483+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae3e70 con 0x55c3ccad7d80 2024-09-10T05:36:29.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.483+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6440083f0 con 0x55c3ccad7d80 2024-09-10T05:36:29.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.483+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae3e70 con 0x55c3ccad7d80 2024-09-10T05:36:29.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.483+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6440083f0 con 0x55c3ccad7d80 2024-09-10T05:36:29.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.483+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae3e70 con 0x55c3ccadfa40 2024-09-10T05:36:29.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.483+0000 7fa64bfc2640 1 -- 172.21.15.62:0/4179545269 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa63c0c3050 con 0x55c3ccadfa40 2024-09-10T05:36:29.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.487+0000 7fa64bfc2640 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae3e70 con 0x55c3ccad7d80 2024-09-10T05:36:29.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.487+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6440083f0 con 0x55c3ccad7d80 2024-09-10T05:36:29.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.487+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae3e70 con 0x55c3ccadc240 2024-09-10T05:36:29.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.487+0000 7fa64c7c3640 1 -- 172.21.15.62:0/4179545269 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa63402e070 con 0x55c3ccadc240 2024-09-10T05:36:29.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.487+0000 7fa64c7c3640 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae3e70 con 0x55c3ccadc240 2024-09-10T05:36:29.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.487+0000 7fa64c7c3640 1 -- 172.21.15.62:0/4179545269 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa63402e070 con 0x55c3ccadc240 2024-09-10T05:36:29.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.487+0000 7fa64c7c3640 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae3e70 con 0x55c3ccad7d80 2024-09-10T05:36:29.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.487+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6440083f0 con 0x55c3ccad7d80 2024-09-10T05:36:29.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.487+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae3e70 con 0x55c3cc91c280 2024-09-10T05:36:29.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.487+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6440083f0 con 0x55c3cc91c280 2024-09-10T05:36:29.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.487+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae3e70 con 0x55c3ccad7d80 2024-09-10T05:36:29.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.487+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6440083f0 con 0x55c3ccad7d80 2024-09-10T05:36:29.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.487+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae3e70 con 0x55c3cc91c280 2024-09-10T05:36:29.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.487+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa6440083f0 con 0x55c3cc91c280 2024-09-10T05:36:29.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.487+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae3e70 con 0x55c3ccadc240 2024-09-10T05:36:29.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.487+0000 7fa64c7c3640 1 -- 172.21.15.62:0/4179545269 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa63402e070 con 0x55c3ccadc240 2024-09-10T05:36:29.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.487+0000 7fa64c7c3640 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae3e70 con 0x55c3ccadfa40 2024-09-10T05:36:29.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.487+0000 7fa64bfc2640 1 -- 172.21.15.62:0/4179545269 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa63c0c3050 con 0x55c3ccadfa40 2024-09-10T05:36:29.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.487+0000 7fa64bfc2640 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae3e70 con 0x55c3ccad7d80 2024-09-10T05:36:29.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.491+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6440083f0 con 0x55c3ccad7d80 2024-09-10T05:36:29.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.491+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae3e70 con 0x55c3ccadc240 2024-09-10T05:36:29.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.491+0000 7fa64c7c3640 1 -- 172.21.15.62:0/4179545269 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa63402e070 con 0x55c3ccadc240 2024-09-10T05:36:29.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.491+0000 7fa64c7c3640 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae3e70 con 0x55c3ccadfa40 2024-09-10T05:36:29.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.491+0000 7fa64bfc2640 1 -- 172.21.15.62:0/4179545269 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 30 out=170b] v23'2 uv2 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7fa63c0c3050 con 0x55c3ccadfa40 2024-09-10T05:36:29.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.491+0000 7fa64bfc2640 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae3e70 con 0x55c3ccad7d80 2024-09-10T05:36:29.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.491+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6440083f0 con 0x55c3ccad7d80 2024-09-10T05:36:29.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.491+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae3e70 con 0x55c3ccad7d80 2024-09-10T05:36:29.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.491+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa6440083f0 con 0x55c3ccad7d80 2024-09-10T05:36:29.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.491+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae3e70 con 0x55c3ccad7d80 2024-09-10T05:36:29.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.491+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6440083f0 con 0x55c3ccad7d80 2024-09-10T05:36:29.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.491+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae3e70 con 0x55c3ccadfa40 2024-09-10T05:36:29.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.491+0000 7fa64bfc2640 1 -- 172.21.15.62:0/4179545269 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa63c0c3050 con 0x55c3ccadfa40 2024-09-10T05:36:29.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.491+0000 7fa64bfc2640 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae3e70 con 0x55c3cc91c280 2024-09-10T05:36:29.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.491+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6440083f0 con 0x55c3cc91c280 2024-09-10T05:36:29.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.491+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae3e70 con 0x55c3ccad7d80 2024-09-10T05:36:29.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.491+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6440083f0 con 0x55c3ccad7d80 2024-09-10T05:36:29.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.491+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae3e70 con 0x55c3cc91c280 2024-09-10T05:36:29.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.491+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6440083f0 con 0x55c3cc91c280 2024-09-10T05:36:29.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.491+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae3e70 con 0x55c3ccadfa40 2024-09-10T05:36:29.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.491+0000 7fa64bfc2640 1 -- 172.21.15.62:0/4179545269 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa63c0c3050 con 0x55c3ccadfa40 2024-09-10T05:36:29.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.491+0000 7fa64bfc2640 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae3e70 con 0x55c3cc91c280 2024-09-10T05:36:29.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.495+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6440083f0 con 0x55c3cc91c280 2024-09-10T05:36:29.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.495+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae3e70 con 0x55c3ccadc240 2024-09-10T05:36:29.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.495+0000 7fa64c7c3640 1 -- 172.21.15.62:0/4179545269 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa63402e070 con 0x55c3ccadc240 2024-09-10T05:36:29.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.495+0000 7fa64c7c3640 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae3e70 con 0x55c3ccadc240 2024-09-10T05:36:29.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.495+0000 7fa64c7c3640 1 -- 172.21.15.62:0/4179545269 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa63402e070 con 0x55c3ccadc240 2024-09-10T05:36:29.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.495+0000 7fa64c7c3640 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae3e70 con 0x55c3ccadfa40 2024-09-10T05:36:29.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.495+0000 7fa64bfc2640 1 -- 172.21.15.62:0/4179545269 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa63c0c3050 con 0x55c3ccadfa40 2024-09-10T05:36:29.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.495+0000 7fa64bfc2640 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae3e70 con 0x55c3ccadc240 2024-09-10T05:36:29.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.495+0000 7fa64c7c3640 1 -- 172.21.15.62:0/4179545269 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa63402e070 con 0x55c3ccadc240 2024-09-10T05:36:29.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.495+0000 7fa64c7c3640 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae3e70 con 0x55c3ccadc240 2024-09-10T05:36:29.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.495+0000 7fa64c7c3640 1 -- 172.21.15.62:0/4179545269 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa63402e070 con 0x55c3ccadc240 2024-09-10T05:36:29.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.495+0000 7fa64ecbd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:29.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.495+0000 7fa64ecbd9c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:29.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.495+0000 7fa64ecbd9c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:29.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.495+0000 7fa64ecbd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:29.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.495+0000 7fa64ecbd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:29.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.495+0000 7fa64ecbd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:29.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.495+0000 7fa64ecbd9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:29.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.495+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae2f60 con 0x55c3ccad7d80 2024-09-10T05:36:29.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.495+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa6440083f0 con 0x55c3ccad7d80 2024-09-10T05:36:29.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.495+0000 7fa64ecbd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:29.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.495+0000 7fa64ecbd9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:29.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.495+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae2ba0 con 0x55c3ccadc240 2024-09-10T05:36:29.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.499+0000 7fa64c7c3640 1 -- 172.21.15.62:0/4179545269 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa63402e070 con 0x55c3ccadc240 2024-09-10T05:36:29.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.499+0000 7fa64ecbd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:29.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.499+0000 7fa64ecbd9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:29.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.499+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae38c0 con 0x55c3ccadfa40 2024-09-10T05:36:29.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.499+0000 7fa64bfc2640 1 -- 172.21.15.62:0/4179545269 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa63c0c3050 con 0x55c3ccadfa40 2024-09-10T05:36:29.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.499+0000 7fa64ecbd9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:29.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.499+0000 7fa64ecbd9c0 20 zone default found 2024-09-10T05:36:29.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.499+0000 7fa64ecbd9c0 4 Realm: () 2024-09-10T05:36:29.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.499+0000 7fa64ecbd9c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:29.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.499+0000 7fa64ecbd9c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:29.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.499+0000 7fa64ecbd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:29.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.499+0000 7fa64ecbd9c0 20 zonegroup default 2024-09-10T05:36:29.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.499+0000 7fa64ecbd9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:29.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.499+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae4750 con 0x55c3cc91c280 2024-09-10T05:36:29.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.499+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa6440083f0 con 0x55c3cc91c280 2024-09-10T05:36:29.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.499+0000 7fa64ecbd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:29.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.499+0000 7fa64ecbd9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:29.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.499+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae6990 con 0x55c3ccadfa40 2024-09-10T05:36:29.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.499+0000 7fa64bfc2640 1 -- 172.21.15.62:0/4179545269 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa63c0c3050 con 0x55c3ccadfa40 2024-09-10T05:36:29.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.499+0000 7fa64ecbd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:29.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.499+0000 7fa64ecbd9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:29.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.499+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae6d30 con 0x55c3ccadfa40 2024-09-10T05:36:29.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.499+0000 7fa64bfc2640 1 -- 172.21.15.62:0/4179545269 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa63c0c3050 con 0x55c3ccadfa40 2024-09-10T05:36:29.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.499+0000 7fa64ecbd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:29.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.499+0000 7fa64ecbd9c0 20 started sync module instance, tier type = 2024-09-10T05:36:29.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.499+0000 7fa64ecbd9c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:29.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.499+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae5dd0 con 0x55c3ccadc240 2024-09-10T05:36:29.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.503+0000 7fa64c7c3640 1 -- 172.21.15.62:0/4179545269 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa63402e070 con 0x55c3ccadc240 2024-09-10T05:36:29.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.503+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94299440964336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae5dd0 con 0x55c3ccadc240 2024-09-10T05:36:29.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.503+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae76f0 con 0x55c3ccad7d80 2024-09-10T05:36:29.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.503+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6440083f0 con 0x55c3ccad7d80 2024-09-10T05:36:29.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.503+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94299440968256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae7f40 con 0x55c3ccad7d80 2024-09-10T05:36:29.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.503+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae8940 con 0x55c3ccadc240 2024-09-10T05:36:29.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.503+0000 7fa64c7c3640 1 -- 172.21.15.62:0/4179545269 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94299440964336] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa63402e070 con 0x55c3ccadc240 2024-09-10T05:36:29.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.503+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94299440968256] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6440083f0 con 0x55c3ccad7d80 2024-09-10T05:36:29.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.507+0000 7fa64c7c3640 1 -- 172.21.15.62:0/4179545269 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa63402e070 con 0x55c3ccadc240 2024-09-10T05:36:29.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.507+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94299440961824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae7a90 con 0x55c3ccadc240 2024-09-10T05:36:29.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.507+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae91e0 con 0x55c3cc91c280 2024-09-10T05:36:29.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.507+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6440083f0 con 0x55c3cc91c280 2024-09-10T05:36:29.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.507+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94299440975152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae7a90 con 0x55c3cc91c280 2024-09-10T05:36:29.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.507+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae9cd0 con 0x55c3ccadc240 2024-09-10T05:36:29.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.507+0000 7fa64c7c3640 1 -- 172.21.15.62:0/4179545269 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94299440961824] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa63402e070 con 0x55c3ccadc240 2024-09-10T05:36:29.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.507+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94299440975152] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6440083f0 con 0x55c3cc91c280 2024-09-10T05:36:29.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.507+0000 7fa64c7c3640 1 -- 172.21.15.62:0/4179545269 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa63402e070 con 0x55c3ccadc240 2024-09-10T05:36:29.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.507+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94299440976208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae9c90 con 0x55c3ccadc240 2024-09-10T05:36:29.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.507+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccaea0c0 con 0x55c3ccadfa40 2024-09-10T05:36:29.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.511+0000 7fa64bfc2640 1 -- 172.21.15.62:0/4179545269 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa63c0c3050 con 0x55c3ccadfa40 2024-09-10T05:36:29.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.511+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94299440972880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccaea960 con 0x55c3ccadfa40 2024-09-10T05:36:29.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.511+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccaeb380 con 0x55c3ccadfa40 2024-09-10T05:36:29.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.511+0000 7fa64c7c3640 1 -- 172.21.15.62:0/4179545269 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94299440976208] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa63402e070 con 0x55c3ccadc240 2024-09-10T05:36:29.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.511+0000 7fa64bfc2640 1 -- 172.21.15.62:0/4179545269 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94299440972880] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa63c0c3050 con 0x55c3ccadfa40 2024-09-10T05:36:29.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.511+0000 7fa64bfc2640 1 -- 172.21.15.62:0/4179545269 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa63c0c3050 con 0x55c3ccadfa40 2024-09-10T05:36:29.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.511+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94299440983664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccaea4b0 con 0x55c3ccadfa40 2024-09-10T05:36:29.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.511+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccaeb940 con 0x55c3cc91c280 2024-09-10T05:36:29.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.515+0000 7fa64bfc2640 1 -- 172.21.15.62:0/4179545269 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94299440983664] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa63c0c3050 con 0x55c3ccadfa40 2024-09-10T05:36:29.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.515+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6440083f0 con 0x55c3cc91c280 2024-09-10T05:36:29.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.515+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94299440977824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccaeb940 con 0x55c3cc91c280 2024-09-10T05:36:29.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.515+0000 7fa64ecbd9c0 20 add_watcher() i=0 2024-09-10T05:36:29.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.515+0000 7fa64ecbd9c0 20 add_watcher() i=1 2024-09-10T05:36:29.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.515+0000 7fa64ecbd9c0 20 add_watcher() i=2 2024-09-10T05:36:29.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.515+0000 7fa64ecbd9c0 20 add_watcher() i=3 2024-09-10T05:36:29.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.515+0000 7fa64ecbd9c0 20 add_watcher() i=4 2024-09-10T05:36:29.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.515+0000 7fa64ecbd9c0 20 add_watcher() i=5 2024-09-10T05:36:29.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.515+0000 7fa64ecbd9c0 20 add_watcher() i=6 2024-09-10T05:36:29.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.519+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94299440977824] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6440083f0 con 0x55c3cc91c280 2024-09-10T05:36:29.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.519+0000 7fa64ecbd9c0 20 add_watcher() i=7 2024-09-10T05:36:29.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.519+0000 7fa64ecbd9c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:29.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.519+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccaeec00 con 0x55c3ccad7d80 2024-09-10T05:36:29.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.519+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa6440083f0 con 0x55c3ccad7d80 2024-09-10T05:36:29.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.519+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94299440997680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccaeb940 con 0x55c3ccad7d80 2024-09-10T05:36:29.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.523+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94299440997680] v30'37 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa6440083f0 con 0x55c3ccad7d80 2024-09-10T05:36:29.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.523+0000 7fa5027e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:29.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.523+0000 7fa64ecbd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:29.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.523+0000 7fa64ecbd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:29.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.523+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccaf7470 con 0x55c3ccadc240 2024-09-10T05:36:29.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.523+0000 7fa64c7c3640 1 -- 172.21.15.62:0/4179545269 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'41 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa63402e070 con 0x55c3ccadc240 2024-09-10T05:36:29.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.523+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccaf7500 con 0x55c3cc91c280 2024-09-10T05:36:29.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.527+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa6440083f0 con 0x55c3cc91c280 2024-09-10T05:36:29.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.527+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccaf7cd0 con 0x55c3ccadfa40 2024-09-10T05:36:29.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.527+0000 7fa64bfc2640 1 -- 172.21.15.62:0/4179545269 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa63c0c3050 con 0x55c3ccadfa40 2024-09-10T05:36:29.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.527+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccaf8180 con 0x55c3ccad7d80 2024-09-10T05:36:29.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.531+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'38 uv12 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa6440083f0 con 0x55c3ccad7d80 2024-09-10T05:36:29.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.531+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccaf5310 con 0x55c3ccadc240 2024-09-10T05:36:29.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.531+0000 7fa64c7c3640 1 -- 172.21.15.62:0/4179545269 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'29 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa63402e070 con 0x55c3ccadc240 2024-09-10T05:36:29.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.531+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccaf5310 con 0x55c3ccadfa40 2024-09-10T05:36:29.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.535+0000 7fa64bfc2640 1 -- 172.21.15.62:0/4179545269 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'27 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa63c0c3050 con 0x55c3ccadfa40 2024-09-10T05:36:29.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.535+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccaf5310 con 0x55c3ccadc240 2024-09-10T05:36:29.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.535+0000 7fa64c7c3640 1 -- 172.21.15.62:0/4179545269 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa63402e070 con 0x55c3ccadc240 2024-09-10T05:36:29.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.535+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccaf8ce0 con 0x55c3ccad7d80 2024-09-10T05:36:29.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.539+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'21 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa6440083f0 con 0x55c3ccad7d80 2024-09-10T05:36:29.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.539+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccaf9190 con 0x55c3ccadc240 2024-09-10T05:36:29.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.539+0000 7fa64c7c3640 1 -- 172.21.15.62:0/4179545269 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa63402e070 con 0x55c3ccadc240 2024-09-10T05:36:29.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.539+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccaf9190 con 0x55c3ccadc240 2024-09-10T05:36:29.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.543+0000 7fa64c7c3640 1 -- 172.21.15.62:0/4179545269 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'17 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa63402e070 con 0x55c3ccadc240 2024-09-10T05:36:29.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.543+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccaf9190 con 0x55c3ccadc240 2024-09-10T05:36:29.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.543+0000 7fa64c7c3640 1 -- 172.21.15.62:0/4179545269 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'30 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa63402e070 con 0x55c3ccadc240 2024-09-10T05:36:29.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.543+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccaf9190 con 0x55c3ccadfa40 2024-09-10T05:36:29.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.547+0000 7fa64bfc2640 1 -- 172.21.15.62:0/4179545269 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa63c0c3050 con 0x55c3ccadfa40 2024-09-10T05:36:29.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.547+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccaf9190 con 0x55c3ccadc240 2024-09-10T05:36:29.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.547+0000 7fa64c7c3640 1 -- 172.21.15.62:0/4179545269 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa63402e070 con 0x55c3ccadc240 2024-09-10T05:36:29.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.547+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccaf9190 con 0x55c3ccad7d80 2024-09-10T05:36:29.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.551+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'33 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa6440083f0 con 0x55c3ccad7d80 2024-09-10T05:36:29.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.551+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccaf9800 con 0x55c3ccad7d80 2024-09-10T05:36:29.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.551+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'39 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa6440083f0 con 0x55c3ccad7d80 2024-09-10T05:36:29.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.551+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccaf96e0 con 0x55c3ccadc240 2024-09-10T05:36:29.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.555+0000 7fa64c7c3640 1 -- 172.21.15.62:0/4179545269 <== osd.0 v2:172.21.15.2:6800/945139080 25 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'24 uv16 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa63402e070 con 0x55c3ccadc240 2024-09-10T05:36:29.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.555+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccaf9580 con 0x55c3ccadc240 2024-09-10T05:36:29.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.555+0000 7fa64c7c3640 1 -- 172.21.15.62:0/4179545269 <== osd.0 v2:172.21.15.2:6800/945139080 26 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'31 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa63402e070 con 0x55c3ccadc240 2024-09-10T05:36:29.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.555+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccaf95a0 con 0x55c3ccadfa40 2024-09-10T05:36:29.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.559+0000 7fa64bfc2640 1 -- 172.21.15.62:0/4179545269 <== osd.3 v2:172.21.15.62:6816/2708991149 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'23 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa63c0c3050 con 0x55c3ccadfa40 2024-09-10T05:36:29.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.559+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccaf96f0 con 0x55c3ccadc240 2024-09-10T05:36:29.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.559+0000 7fa64c7c3640 1 -- 172.21.15.62:0/4179545269 <== osd.0 v2:172.21.15.2:6800/945139080 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa63402e070 con 0x55c3ccadc240 2024-09-10T05:36:29.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.559+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccaf96f0 con 0x55c3ccad7d80 2024-09-10T05:36:29.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.563+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 <== osd.1 v2:172.21.15.62:6808/3442097179 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'40 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa6440083f0 con 0x55c3ccad7d80 2024-09-10T05:36:29.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.563+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccaf98f0 con 0x55c3ccadc240 2024-09-10T05:36:29.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.563+0000 7fa64c7c3640 1 -- 172.21.15.62:0/4179545269 <== osd.0 v2:172.21.15.2:6800/945139080 28 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'25 uv18 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa63402e070 con 0x55c3ccadc240 2024-09-10T05:36:29.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.563+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccaf98c0 con 0x55c3ccadc240 2024-09-10T05:36:29.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.567+0000 7fa64c7c3640 1 -- 172.21.15.62:0/4179545269 <== osd.0 v2:172.21.15.2:6800/945139080 29 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'27 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa63402e070 con 0x55c3ccadc240 2024-09-10T05:36:29.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.567+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccaf9800 con 0x55c3ccadfa40 2024-09-10T05:36:29.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.567+0000 7fa64bfc2640 1 -- 172.21.15.62:0/4179545269 <== osd.3 v2:172.21.15.62:6816/2708991149 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'19 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa63c0c3050 con 0x55c3ccadfa40 2024-09-10T05:36:29.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.567+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccaf9890 con 0x55c3ccadc240 2024-09-10T05:36:29.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.571+0000 7fa64c7c3640 1 -- 172.21.15.62:0/4179545269 <== osd.0 v2:172.21.15.2:6800/945139080 30 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'29 uv18 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa63402e070 con 0x55c3ccadc240 2024-09-10T05:36:29.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.571+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccaf9890 con 0x55c3ccadfa40 2024-09-10T05:36:29.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.575+0000 7fa64bfc2640 1 -- 172.21.15.62:0/4179545269 <== osd.3 v2:172.21.15.62:6816/2708991149 21 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'13 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa63c0c3050 con 0x55c3ccadfa40 2024-09-10T05:36:29.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.575+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccaf9890 con 0x55c3ccadfa40 2024-09-10T05:36:29.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.575+0000 7fa64bfc2640 1 -- 172.21.15.62:0/4179545269 <== osd.3 v2:172.21.15.62:6816/2708991149 22 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'28 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa63c0c3050 con 0x55c3ccadfa40 2024-09-10T05:36:29.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.575+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccaf8d70 con 0x55c3ccadfa40 2024-09-10T05:36:29.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.579+0000 7fa64bfc2640 1 -- 172.21.15.62:0/4179545269 <== osd.3 v2:172.21.15.62:6816/2708991149 23 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'19 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa63c0c3050 con 0x55c3ccadfa40 2024-09-10T05:36:29.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.579+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccaf8d70 con 0x55c3ccadc240 2024-09-10T05:36:29.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.579+0000 7fa64c7c3640 1 -- 172.21.15.62:0/4179545269 <== osd.0 v2:172.21.15.2:6800/945139080 31 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'23 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa63402e070 con 0x55c3ccadc240 2024-09-10T05:36:29.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.579+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccaf8d70 con 0x55c3ccad7d80 2024-09-10T05:36:29.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.583+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 <== osd.1 v2:172.21.15.62:6808/3442097179 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'22 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa6440083f0 con 0x55c3ccad7d80 2024-09-10T05:36:29.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.583+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccaf8d70 con 0x55c3ccadc240 2024-09-10T05:36:29.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.583+0000 7fa64c7c3640 1 -- 172.21.15.62:0/4179545269 <== osd.0 v2:172.21.15.2:6800/945139080 32 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa63402e070 con 0x55c3ccadc240 2024-09-10T05:36:29.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.583+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccaf8d70 con 0x55c3ccad7d80 2024-09-10T05:36:29.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.587+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 <== osd.1 v2:172.21.15.62:6808/3442097179 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'34 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa6440083f0 con 0x55c3ccad7d80 2024-09-10T05:36:29.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.587+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccaf8d70 con 0x55c3cc91c280 2024-09-10T05:36:29.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.591+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa6440083f0 con 0x55c3cc91c280 2024-09-10T05:36:29.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.591+0000 7fa5017e2640 20 reqs_thread_entry: start 2024-09-10T05:36:29.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.591+0000 7fa64ecbd9c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:29.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.591+0000 7fa64ecbd9c0 20 Filter name: none 2024-09-10T05:36:29.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.591+0000 7fa472ffd640 20 reqs_thread_entry: start 2024-09-10T05:36:29.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.591+0000 7fa64ecbd9c0 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-10T05:36:29.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.591+0000 7fa64ecbd9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:29.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.591+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:94 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccaf4640 con 0x55c3cc91c280 2024-09-10T05:36:29.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.591+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(94 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fa6440083f0 con 0x55c3cc91c280 2024-09-10T05:36:29.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.591+0000 7fa64ecbd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:29.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.591+0000 7fa64ecbd9c0 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-10T05:36:29.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.591+0000 7fa64ecbd9c0 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-10T05:36:29.597 INFO:teuthology.orchestra.run.smithi062.stderr:could not remove user: unable to remove user, user does not exist 2024-09-10T05:36:29.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.591+0000 7fa5027e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:29.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.591+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94299440997680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccaf37b0 con 0x55c3ccad7d80 2024-09-10T05:36:29.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.595+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 <== osd.1 v2:172.21.15.62:6808/3442097179 26 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94299440997680] v30'41 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa6440083f0 con 0x55c3ccad7d80 2024-09-10T05:36:29.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.595+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94299440964336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccaee530 con 0x55c3ccadc240 2024-09-10T05:36:29.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.595+0000 7fa64c7c3640 1 -- 172.21.15.62:0/4179545269 <== osd.0 v2:172.21.15.2:6800/945139080 33 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94299440964336] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa63402e070 con 0x55c3ccadc240 2024-09-10T05:36:29.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.595+0000 7fa64ecbd9c0 20 remove_watcher() i=0 2024-09-10T05:36:29.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.595+0000 7fa64ecbd9c0 2 removed watcher, disabling cache 2024-09-10T05:36:29.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.595+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94299440968256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae62f0 con 0x55c3ccad7d80 2024-09-10T05:36:29.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.599+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 <== osd.1 v2:172.21.15.62:6808/3442097179 27 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94299440968256] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6440083f0 con 0x55c3ccad7d80 2024-09-10T05:36:29.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.599+0000 7fa64ecbd9c0 20 remove_watcher() i=1 2024-09-10T05:36:29.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.599+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94299440961824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae7240 con 0x55c3ccadc240 2024-09-10T05:36:29.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.599+0000 7fa64c7c3640 1 -- 172.21.15.62:0/4179545269 <== osd.0 v2:172.21.15.2:6800/945139080 34 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94299440961824] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa63402e070 con 0x55c3ccadc240 2024-09-10T05:36:29.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.599+0000 7fa64ecbd9c0 20 remove_watcher() i=2 2024-09-10T05:36:29.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.599+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94299440975152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae7240 con 0x55c3cc91c280 2024-09-10T05:36:29.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.603+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 <== osd.2 v2:172.21.15.62:6800/2677868286 15 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94299440975152] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6440083f0 con 0x55c3cc91c280 2024-09-10T05:36:29.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.603+0000 7fa64ecbd9c0 20 remove_watcher() i=3 2024-09-10T05:36:29.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.603+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94299440976208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae7240 con 0x55c3ccadc240 2024-09-10T05:36:29.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.603+0000 7fa64c7c3640 1 -- 172.21.15.62:0/4179545269 <== osd.0 v2:172.21.15.2:6800/945139080 35 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94299440976208] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa63402e070 con 0x55c3ccadc240 2024-09-10T05:36:29.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.603+0000 7fa64ecbd9c0 20 remove_watcher() i=4 2024-09-10T05:36:29.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.603+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94299440972880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae7240 con 0x55c3ccadfa40 2024-09-10T05:36:29.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.607+0000 7fa64bfc2640 1 -- 172.21.15.62:0/4179545269 <== osd.3 v2:172.21.15.62:6816/2708991149 24 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94299440972880] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa63c0c3050 con 0x55c3ccadfa40 2024-09-10T05:36:29.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.607+0000 7fa64ecbd9c0 20 remove_watcher() i=5 2024-09-10T05:36:29.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.607+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94299440983664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae7240 con 0x55c3ccadfa40 2024-09-10T05:36:29.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.607+0000 7fa64bfc2640 1 -- 172.21.15.62:0/4179545269 <== osd.3 v2:172.21.15.62:6816/2708991149 25 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94299440983664] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa63c0c3050 con 0x55c3ccadfa40 2024-09-10T05:36:29.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.607+0000 7fa64ecbd9c0 20 remove_watcher() i=6 2024-09-10T05:36:29.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.607+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94299440977824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ccae7240 con 0x55c3cc91c280 2024-09-10T05:36:29.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.611+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 <== osd.2 v2:172.21.15.62:6800/2677868286 16 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94299440977824] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6440083f0 con 0x55c3cc91c280 2024-09-10T05:36:29.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.611+0000 7fa64ecbd9c0 20 remove_watcher() i=7 2024-09-10T05:36:29.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.611+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55c3ccadc240 msgr2=0x55c3ccade630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.611+0000 7fa64ecbd9c0 1 --2- 172.21.15.62:0/4179545269 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55c3ccadc240 0x55c3ccade630 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.611+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55c3ccad7d80 msgr2=0x55c3ccada240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.611+0000 7fa64ecbd9c0 1 --2- 172.21.15.62:0/4179545269 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55c3ccad7d80 0x55c3ccada240 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.611+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x55c3cc91c280 msgr2=0x7fa63403e420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.611+0000 7fa64ecbd9c0 1 --2- 172.21.15.62:0/4179545269 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x55c3cc91c280 0x7fa63403e420 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.611+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55c3ccadfa40 msgr2=0x55c3ccae1e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.611+0000 7fa64ecbd9c0 1 --2- 172.21.15.62:0/4179545269 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55c3ccadfa40 0x55c3ccae1e30 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.611+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fa51c039a70 msgr2=0x7fa51c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.611+0000 7fa64ecbd9c0 1 --2- 172.21.15.62:0/4179545269 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fa51c039a70 0x7fa51c03bf30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa63c0aafd0 tx=0x7fa63c0a6000 comp rx=0 tx=0).stop 2024-09-10T05:36:29.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.611+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c3ccac5b30 msgr2=0x55c3ccacce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.611+0000 7fa64ecbd9c0 1 --2- 172.21.15.62:0/4179545269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c3ccac5b30 0x55c3ccacce10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa63401bab0 tx=0x7fa634006ee0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.611+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4179545269 reap_dead start 2024-09-10T05:36:29.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.611+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 shutdown_connections 2024-09-10T05:36:29.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.611+0000 7fa64ecbd9c0 1 --2- 172.21.15.62:0/4179545269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c3ccac5b30 0x55c3ccacce10 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.611+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 >> 172.21.15.62:0/4179545269 conn(0x55c3ccac1f60 msgr2=0x55c3ccac0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:29.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.611+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 shutdown_connections 2024-09-10T05:36:29.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.611+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4179545269 wait complete. 2024-09-10T05:36:29.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.611+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/2405835673 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fa524039ac0 msgr2=0x7fa52403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.611+0000 7fa64ecbd9c0 1 --2- 172.21.15.62:0/2405835673 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fa524039ac0 0x7fa52403bf80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x55c3ccaa7280 tx=0x7fa63c005e50 comp rx=0 tx=0).stop 2024-09-10T05:36:29.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.611+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/2405835673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c3ccab9540 msgr2=0x55c3ccab9960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.611+0000 7fa64ecbd9c0 1 --2- 172.21.15.62:0/2405835673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c3ccab9540 0x55c3ccab9960 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa63401cfd0 tx=0x7fa6340197b0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.611+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/2405835673 shutdown_connections 2024-09-10T05:36:29.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.611+0000 7fa64ecbd9c0 1 --2- 172.21.15.62:0/2405835673 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fa524039ac0 0x7fa52403bf80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.611+0000 7fa64ecbd9c0 1 --2- 172.21.15.62:0/2405835673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c3ccab9540 0x55c3ccab9960 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.611+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/2405835673 >> 172.21.15.62:0/2405835673 conn(0x55c3ccaaeef0 msgr2=0x55c3ccaaf2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:29.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.611+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/2405835673 shutdown_connections 2024-09-10T05:36:29.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.611+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/2405835673 wait complete. 2024-09-10T05:36:29.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.611+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4294752267 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55c3ccaa3a20 msgr2=0x55c3ccaa5ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.611+0000 7fa64ecbd9c0 1 --2- 172.21.15.62:0/4294752267 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55c3ccaa3a20 0x55c3ccaa5ee0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.611+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4294752267 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55c3ccaa05f0 msgr2=0x55c3ccaa29e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.611+0000 7fa64ecbd9c0 1 --2- 172.21.15.62:0/4294752267 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55c3ccaa05f0 0x55c3ccaa29e0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.611+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4294752267 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55c3ccaa8410 msgr2=0x55c3ccaaa800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.611+0000 7fa64ecbd9c0 1 --2- 172.21.15.62:0/4294752267 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55c3ccaa8410 0x55c3ccaaa800 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.611+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4294752267 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fa534039a70 msgr2=0x7fa53403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.611+0000 7fa64ecbd9c0 1 --2- 172.21.15.62:0/4294752267 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fa534039a70 0x7fa53403bf30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa63c0ab000 tx=0x7fa63c0a5000 comp rx=0 tx=0).stop 2024-09-10T05:36:29.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.611+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4294752267 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c3cc91c7b0 msgr2=0x55c3cca9b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.611+0000 7fa64ecbd9c0 1 --2- 172.21.15.62:0/4294752267 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c3cc91c7b0 0x55c3cca9b580 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x55c3cca94b50 tx=0x7fa634000ee0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.611+0000 7fa64cfc4640 1 -- 172.21.15.62:0/4294752267 reap_dead start 2024-09-10T05:36:29.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.611+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4294752267 shutdown_connections 2024-09-10T05:36:29.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.611+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4294752267 >> 172.21.15.62:0/4294752267 conn(0x55c3cc9a1aa0 msgr2=0x55c3cca94e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:29.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.611+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4294752267 shutdown_connections 2024-09-10T05:36:29.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.611+0000 7fa64ecbd9c0 1 -- 172.21.15.62:0/4294752267 wait complete. 2024-09-10T05:36:29.629 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-10T05:36:29.630 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-10T05:36:29.630 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-10T05:36:29.630 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-10T05:36:29.705 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:29.705 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:29.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.703+0000 7faad09219c0 1 Processor -- start 2024-09-10T05:36:29.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.703+0000 7faad09219c0 1 -- start start 2024-09-10T05:36:29.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.703+0000 7faad09219c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x564b44176280 0x564b44176660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:29.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.703+0000 7faad09219c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564b440b49c0 con 0x564b44174c70 2024-09-10T05:36:29.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.703+0000 7faad09219c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x564b441046d0 con 0x564b44176280 2024-09-10T05:36:29.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.703+0000 7faace427640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x564b44176280 0x564b44176660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:29.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.703+0000 7faace427640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x564b44176280 0x564b44176660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:50878/0 (socket says 172.21.15.62:50878) 2024-09-10T05:36:29.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.703+0000 7faacdc26640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x564b44174c70 0x564b44175080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:38432/0 (socket says 172.21.15.62:38432) 2024-09-10T05:36:29.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.703+0000 7faace427640 1 -- 172.21.15.62:0/2230341195 learned_addr learned my addr 172.21.15.62:0/2230341195 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:29.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.703+0000 7faace427640 1 -- 172.21.15.62:0/2230341195 >> v1:172.21.15.2:6789/0 conn(0x564b44174c70 legacy=0x564b44175080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.703+0000 7faace427640 1 -- 172.21.15.62:0/2230341195 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b440a8ca0 con 0x564b44176280 2024-09-10T05:36:29.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.707+0000 7faace427640 1 --2- 172.21.15.62:0/2230341195 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b44176280 0x564b44176660 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7faac000a5c0 tx=0x7faac001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=452bc5f9e4f7342b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:29.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.707+0000 7faacd425640 1 -- 172.21.15.62:0/2230341195 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faac00a6070 con 0x564b44176280 2024-09-10T05:36:29.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.707+0000 7faacd425640 1 -- 172.21.15.62:0/2230341195 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faac00af070 con 0x564b44176280 2024-09-10T05:36:29.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.707+0000 7faacd425640 1 -- 172.21.15.62:0/2230341195 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faac00aa5c0 con 0x564b44176280 2024-09-10T05:36:29.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.707+0000 7faad09219c0 1 -- 172.21.15.62:0/2230341195 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b44176280 msgr2=0x564b44176660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.707+0000 7faad09219c0 1 --2- 172.21.15.62:0/2230341195 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b44176280 0x564b44176660 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7faac000a5c0 tx=0x7faac001b340 comp rx=0 tx=0).stop 2024-09-10T05:36:29.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.707+0000 7faad09219c0 1 -- 172.21.15.62:0/2230341195 shutdown_connections 2024-09-10T05:36:29.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.707+0000 7faad09219c0 1 --2- 172.21.15.62:0/2230341195 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b44176280 0x564b44176660 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.707+0000 7faad09219c0 1 -- 172.21.15.62:0/2230341195 >> 172.21.15.62:0/2230341195 conn(0x564b441fbaa0 msgr2=0x564b441fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:29.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.707+0000 7faad09219c0 1 -- 172.21.15.62:0/2230341195 shutdown_connections 2024-09-10T05:36:29.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.707+0000 7faad09219c0 1 -- 172.21.15.62:0/2230341195 wait complete. 2024-09-10T05:36:29.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.723+0000 7faad09219c0 1 Processor -- start 2024-09-10T05:36:29.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.723+0000 7faad09219c0 1 -- start start 2024-09-10T05:36:29.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.723+0000 7faad09219c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b44174c70 0x564b442edb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:29.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.723+0000 7faad09219c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564b44108680 con 0x564b44174c70 2024-09-10T05:36:29.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.723+0000 7faace427640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b44174c70 0x564b442edb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:29.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.723+0000 7faace427640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b44174c70 0x564b442edb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:50894/0 (socket says 172.21.15.62:50894) 2024-09-10T05:36:29.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.723+0000 7faace427640 1 -- 172.21.15.62:0/2117449952 learned_addr learned my addr 172.21.15.62:0/2117449952 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:29.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.723+0000 7faace427640 1 -- 172.21.15.62:0/2117449952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b44083da0 con 0x564b44174c70 2024-09-10T05:36:29.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.723+0000 7faace427640 1 --2- 172.21.15.62:0/2117449952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b44174c70 0x564b442edb90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7faac0018f70 tx=0x7faac0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d51f12be81ba7b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:29.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.723+0000 7fa9bc608640 1 -- 172.21.15.62:0/2117449952 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faac00aa9e0 con 0x564b44174c70 2024-09-10T05:36:29.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.723+0000 7fa9bc608640 1 -- 172.21.15.62:0/2117449952 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faac00aab80 con 0x564b44174c70 2024-09-10T05:36:29.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.723+0000 7fa9bc608640 1 -- 172.21.15.62:0/2117449952 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faac00aae60 con 0x564b44174c70 2024-09-10T05:36:29.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.723+0000 7faad09219c0 1 -- 172.21.15.62:0/2117449952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b44174c70 msgr2=0x564b442edb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.723+0000 7faad09219c0 1 --2- 172.21.15.62:0/2117449952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b44174c70 0x564b442edb90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7faac0018f70 tx=0x7faac0003030 comp rx=0 tx=0).stop 2024-09-10T05:36:29.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.723+0000 7faad09219c0 1 -- 172.21.15.62:0/2117449952 shutdown_connections 2024-09-10T05:36:29.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.723+0000 7faad09219c0 1 --2- 172.21.15.62:0/2117449952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b44174c70 0x564b442edb90 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.723+0000 7faad09219c0 1 -- 172.21.15.62:0/2117449952 >> 172.21.15.62:0/2117449952 conn(0x564b441fbaa0 msgr2=0x564b442e97d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:29.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.723+0000 7faad09219c0 1 -- 172.21.15.62:0/2117449952 shutdown_connections 2024-09-10T05:36:29.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.723+0000 7faad09219c0 1 -- 172.21.15.62:0/2117449952 wait complete. 2024-09-10T05:36:29.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.727+0000 7faad09219c0 1 Processor -- start 2024-09-10T05:36:29.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.727+0000 7faad09219c0 1 -- start start 2024-09-10T05:36:29.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.727+0000 7faad09219c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b44174c70 0x564b442f50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:29.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.727+0000 7faad09219c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564b440aaa50 con 0x564b44174c70 2024-09-10T05:36:29.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.727+0000 7faace427640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b44174c70 0x564b442f50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:29.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.727+0000 7faace427640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b44174c70 0x564b442f50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:50904/0 (socket says 172.21.15.62:50904) 2024-09-10T05:36:29.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.727+0000 7faace427640 1 -- 172.21.15.62:0/3923085399 learned_addr learned my addr 172.21.15.62:0/3923085399 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:29.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.727+0000 7faace427640 1 -- 172.21.15.62:0/3923085399 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b442f5650 con 0x564b44174c70 2024-09-10T05:36:29.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.727+0000 7faace427640 1 --2- 172.21.15.62:0/3923085399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b44174c70 0x564b442f50f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7faac0000c10 tx=0x7faac00180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:29.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.727+0000 7fa9bae05640 1 -- 172.21.15.62:0/3923085399 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faac00abec0 con 0x564b44174c70 2024-09-10T05:36:29.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.727+0000 7faad09219c0 1 -- 172.21.15.62:0/3923085399 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b442f58e0 con 0x564b44174c70 2024-09-10T05:36:29.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.727+0000 7fa9bae05640 1 -- 172.21.15.62:0/3923085399 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faac00c6690 con 0x564b44174c70 2024-09-10T05:36:29.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.727+0000 7fa9bae05640 1 -- 172.21.15.62:0/3923085399 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faac00c6990 con 0x564b44174c70 2024-09-10T05:36:29.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.727+0000 7faad09219c0 1 -- 172.21.15.62:0/3923085399 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b442f6290 con 0x564b44174c70 2024-09-10T05:36:29.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.727+0000 7fa9bae05640 1 -- 172.21.15.62:0/3923085399 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7faac00ce030 con 0x564b44174c70 2024-09-10T05:36:29.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.727+0000 7fa9bae05640 1 --2- 172.21.15.62:0/3923085399 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fa9b4039c10 0x7fa9b403c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:29.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.727+0000 7fa9bae05640 1 -- 172.21.15.62:0/3923085399 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7faac00cc020 con 0x564b44174c70 2024-09-10T05:36:29.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.727+0000 7faacdc26640 1 --2- 172.21.15.62:0/3923085399 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fa9b4039c10 0x7fa9b403c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:29.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.727+0000 7faad09219c0 1 --2- 172.21.15.62:0/3923085399 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x564b44176280 0x564b442fc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:29.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.727+0000 7faad09219c0 1 -- 172.21.15.62:0/3923085399 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b442fc7a0 con 0x564b44176280 2024-09-10T05:36:29.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.731+0000 7faacec28640 1 --2- 172.21.15.62:0/3923085399 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x564b44176280 0x564b442fc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:29.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.731+0000 7faacdc26640 1 --2- 172.21.15.62:0/3923085399 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fa9b4039c10 0x7fa9b403c0d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7faac4001e40 tx=0x7faac40013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:29.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.731+0000 7faacec28640 1 --2- 172.21.15.62:0/3923085399 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x564b44176280 0x564b442fc260 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:29.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.731+0000 7faacec28640 1 -- 172.21.15.62:0/3923085399 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faac800a4d0 con 0x564b44176280 2024-09-10T05:36:29.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.731+0000 7faad09219c0 1 --2- 172.21.15.62:0/3923085399 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x564b442fd550 0x564b442ff940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:29.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.731+0000 7faad09219c0 1 -- 172.21.15.62:0/3923085399 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b442fff50 con 0x564b442fd550 2024-09-10T05:36:29.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.731+0000 7faace427640 1 --2- 172.21.15.62:0/3923085399 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x564b442fd550 0x564b442ff940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:29.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.731+0000 7faace427640 1 --2- 172.21.15.62:0/3923085399 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x564b442fd550 0x564b442ff940 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:29.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.731+0000 7faace427640 1 -- 172.21.15.62:0/3923085399 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faac00d0930 con 0x564b442fd550 2024-09-10T05:36:29.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.731+0000 7faad09219c0 1 --2- 172.21.15.62:0/3923085399 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x564b44301cc0 0x564b443040b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:29.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.731+0000 7faad09219c0 1 -- 172.21.15.62:0/3923085399 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b443047f0 con 0x564b44301cc0 2024-09-10T05:36:29.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.731+0000 7faacdc26640 1 --2- 172.21.15.62:0/3923085399 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x564b44301cc0 0x564b443040b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:29.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.731+0000 7faacdc26640 1 --2- 172.21.15.62:0/3923085399 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x564b44301cc0 0x564b443040b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:29.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.731+0000 7faacdc26640 1 -- 172.21.15.62:0/3923085399 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7faac400bd60 con 0x564b44301cc0 2024-09-10T05:36:29.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.731+0000 7faad09219c0 1 -- 172.21.15.62:0/3923085399 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b44300b60 con 0x564b442fd550 2024-09-10T05:36:29.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.735+0000 7faace427640 1 -- 172.21.15.62:0/3923085399 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faac00d0930 con 0x564b442fd550 2024-09-10T05:36:29.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.735+0000 7faad09219c0 1 -- 172.21.15.62:0/3923085399 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b44300fc0 con 0x564b44301cc0 2024-09-10T05:36:29.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.735+0000 7faacdc26640 1 -- 172.21.15.62:0/3923085399 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7faac400bd60 con 0x564b44301cc0 2024-09-10T05:36:29.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.735+0000 7faad09219c0 1 Processor -- start 2024-09-10T05:36:29.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.735+0000 7faad09219c0 1 -- start start 2024-09-10T05:36:29.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.735+0000 7faad09219c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b44312e40 0x564b44313260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:29.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.735+0000 7faad09219c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564b44115450 con 0x564b44312e40 2024-09-10T05:36:29.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.735+0000 7faace427640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b44312e40 0x564b44313260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:29.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.735+0000 7faace427640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b44312e40 0x564b44313260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:50910/0 (socket says 172.21.15.62:50910) 2024-09-10T05:36:29.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.735+0000 7faace427640 1 -- 172.21.15.62:0/1200327189 learned_addr learned my addr 172.21.15.62:0/1200327189 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:29.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.735+0000 7faace427640 1 -- 172.21.15.62:0/1200327189 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b443138a0 con 0x564b44312e40 2024-09-10T05:36:29.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.735+0000 7faace427640 1 --2- 172.21.15.62:0/1200327189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b44312e40 0x564b44313260 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7faac00cfdc0 tx=0x7faac00cfa10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:29.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.735+0000 7fa9b3fff640 1 -- 172.21.15.62:0/1200327189 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faac00eb390 con 0x564b44312e40 2024-09-10T05:36:29.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.735+0000 7fa9b3fff640 1 -- 172.21.15.62:0/1200327189 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faac00eb890 con 0x564b44312e40 2024-09-10T05:36:29.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.735+0000 7fa9b3fff640 1 -- 172.21.15.62:0/1200327189 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faac00ebb70 con 0x564b44312e40 2024-09-10T05:36:29.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.735+0000 7faad09219c0 1 -- 172.21.15.62:0/1200327189 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b44314100 con 0x564b44312e40 2024-09-10T05:36:29.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.735+0000 7faad09219c0 1 -- 172.21.15.62:0/1200327189 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b44314100 con 0x564b44312e40 2024-09-10T05:36:29.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.739+0000 7fa9b3fff640 1 -- 172.21.15.62:0/1200327189 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7faac00ebd10 con 0x564b44312e40 2024-09-10T05:36:29.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.739+0000 7fa9b3fff640 1 --2- 172.21.15.62:0/1200327189 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fa9a8039ac0 0x7fa9a803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:29.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.739+0000 7fa9b3fff640 1 -- 172.21.15.62:0/1200327189 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7faac00c8aa0 con 0x564b44312e40 2024-09-10T05:36:29.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.739+0000 7faacdc26640 1 --2- 172.21.15.62:0/1200327189 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fa9a8039ac0 0x7fa9a803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:29.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.739+0000 7faad09219c0 1 Processor -- start 2024-09-10T05:36:29.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.739+0000 7faad09219c0 1 -- start start 2024-09-10T05:36:29.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.739+0000 7faacdc26640 1 --2- 172.21.15.62:0/1200327189 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fa9a8039ac0 0x7fa9a803bf80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x564b442f6630 tx=0x7faac400f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:29.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.739+0000 7faad09219c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b4431f410 0x564b4431f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:29.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.739+0000 7faad09219c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564b442ee320 con 0x564b4431f410 2024-09-10T05:36:29.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.739+0000 7faace427640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b4431f410 0x564b4431f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:29.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.739+0000 7faace427640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b4431f410 0x564b4431f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:50914/0 (socket says 172.21.15.62:50914) 2024-09-10T05:36:29.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.739+0000 7faace427640 1 -- 172.21.15.62:0/3448379710 learned_addr learned my addr 172.21.15.62:0/3448379710 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:29.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.739+0000 7faace427640 1 -- 172.21.15.62:0/3448379710 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b4431fdc0 con 0x564b4431f410 2024-09-10T05:36:29.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.739+0000 7faace427640 1 --2- 172.21.15.62:0/3448379710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b4431f410 0x564b4431f7f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7faac001b360 tx=0x7faac00da720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ff24e92ba415882 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:29.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.739+0000 7fa9b1ffb640 1 -- 172.21.15.62:0/3448379710 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faac00da9c0 con 0x564b4431f410 2024-09-10T05:36:29.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.739+0000 7fa9b1ffb640 1 -- 172.21.15.62:0/3448379710 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faac00c5600 con 0x564b4431f410 2024-09-10T05:36:29.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.739+0000 7fa9b1ffb640 1 -- 172.21.15.62:0/3448379710 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faac00bcc00 con 0x564b4431f410 2024-09-10T05:36:29.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.739+0000 7faad09219c0 1 -- 172.21.15.62:0/3448379710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b4431f410 msgr2=0x564b4431f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.739+0000 7faad09219c0 1 --2- 172.21.15.62:0/3448379710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b4431f410 0x564b4431f7f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7faac001b360 tx=0x7faac00da720 comp rx=0 tx=0).stop 2024-09-10T05:36:29.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.739+0000 7faad09219c0 1 -- 172.21.15.62:0/3448379710 shutdown_connections 2024-09-10T05:36:29.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.739+0000 7faad09219c0 1 --2- 172.21.15.62:0/3448379710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b4431f410 0x564b4431f7f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.739+0000 7faad09219c0 1 -- 172.21.15.62:0/3448379710 >> 172.21.15.62:0/3448379710 conn(0x564b4431b840 msgr2=0x564b44319a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:29.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.739+0000 7faad09219c0 1 -- 172.21.15.62:0/3448379710 shutdown_connections 2024-09-10T05:36:29.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.739+0000 7faad09219c0 1 -- 172.21.15.62:0/3448379710 wait complete. 2024-09-10T05:36:29.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.739+0000 7faad09219c0 1 Processor -- start 2024-09-10T05:36:29.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.739+0000 7faad09219c0 1 -- start start 2024-09-10T05:36:29.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.743+0000 7faad09219c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b4431f410 0x564b443266f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:29.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.743+0000 7faad09219c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564b443202a0 con 0x564b4431f410 2024-09-10T05:36:29.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.743+0000 7faace427640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b4431f410 0x564b443266f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:29.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.743+0000 7faace427640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b4431f410 0x564b443266f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:50920/0 (socket says 172.21.15.62:50920) 2024-09-10T05:36:29.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.743+0000 7faace427640 1 -- 172.21.15.62:0/3628084828 learned_addr learned my addr 172.21.15.62:0/3628084828 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:29.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.743+0000 7faace427640 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b44326c50 con 0x564b4431f410 2024-09-10T05:36:29.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.743+0000 7faace427640 1 --2- 172.21.15.62:0/3628084828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b4431f410 0x564b443266f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7faac00a4070 tx=0x7faac00deec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:29.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.743+0000 7fa99ffff640 1 -- 172.21.15.62:0/3628084828 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faac010b070 con 0x564b4431f410 2024-09-10T05:36:29.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.743+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b44326c50 con 0x564b4431f410 2024-09-10T05:36:29.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.743+0000 7fa99ffff640 1 -- 172.21.15.62:0/3628084828 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faac00da7d0 con 0x564b4431f410 2024-09-10T05:36:29.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.743+0000 7fa99ffff640 1 -- 172.21.15.62:0/3628084828 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faac0101040 con 0x564b4431f410 2024-09-10T05:36:29.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.743+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b44326c50 con 0x564b4431f410 2024-09-10T05:36:29.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.743+0000 7fa99ffff640 1 -- 172.21.15.62:0/3628084828 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7faac010e070 con 0x564b4431f410 2024-09-10T05:36:29.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.743+0000 7faad09219c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:29.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.743+0000 7fa99ffff640 1 --2- 172.21.15.62:0/3628084828 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fa998039a70 0x7fa99803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:29.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.743+0000 7fa99ffff640 1 -- 172.21.15.62:0/3628084828 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7faac0111b00 con 0x564b4431f410 2024-09-10T05:36:29.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.743+0000 7faacdc26640 1 --2- 172.21.15.62:0/3628084828 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fa998039a70 0x7fa99803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:29.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.747+0000 7faad09219c0 1 --2- 172.21.15.62:0/3628084828 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x564b44331520 0x564b443339b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:29.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.747+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b44334100 con 0x564b44331520 2024-09-10T05:36:29.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.747+0000 7faacec28640 1 --2- 172.21.15.62:0/3628084828 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x564b44331520 0x564b443339b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:29.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.747+0000 7faacdc26640 1 --2- 172.21.15.62:0/3628084828 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fa998039a70 0x7fa99803bf30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x564b44304bc0 tx=0x7faac4010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:29.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.747+0000 7faacec28640 1 --2- 172.21.15.62:0/3628084828 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x564b44331520 0x564b443339b0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:29.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.747+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faac800a4d0 con 0x564b44331520 2024-09-10T05:36:29.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.747+0000 7faad09219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:29.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.747+0000 7faad09219c0 20 realm 2024-09-10T05:36:29.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.747+0000 7faad09219c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:29.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.747+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b44330910 con 0x564b44331520 2024-09-10T05:36:29.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.747+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faac800a4d0 con 0x564b44331520 2024-09-10T05:36:29.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.747+0000 7faad09219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:29.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.747+0000 7faad09219c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:29.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.747+0000 7faad09219c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:29.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.747+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b44334bc0 con 0x564b44331520 2024-09-10T05:36:29.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.747+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faac800a4d0 con 0x564b44331520 2024-09-10T05:36:29.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.747+0000 7faad09219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:29.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.747+0000 7faad09219c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:29.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.747+0000 7faad09219c0 1 --2- 172.21.15.62:0/3628084828 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x564b443359a0 0x564b44337d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:29.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.747+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b44338460 con 0x564b443359a0 2024-09-10T05:36:29.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.747+0000 7faace427640 1 --2- 172.21.15.62:0/3628084828 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x564b443359a0 0x564b44337d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:29.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.747+0000 7faace427640 1 --2- 172.21.15.62:0/3628084828 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x564b443359a0 0x564b44337d90 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:29.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.747+0000 7faace427640 1 -- 172.21.15.62:0/3628084828 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faac0117070 con 0x564b443359a0 2024-09-10T05:36:29.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.747+0000 7faad09219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:29.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.747+0000 7faad09219c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:29.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.747+0000 7faad09219c0 1 --2- 172.21.15.62:0/3628084828 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x564b443391c0 0x564b4433b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:29.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.747+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b4433bd60 con 0x564b443391c0 2024-09-10T05:36:29.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.747+0000 7faacdc26640 1 --2- 172.21.15.62:0/3628084828 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x564b443391c0 0x564b4433b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:29.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.747+0000 7faacdc26640 1 --2- 172.21.15.62:0/3628084828 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x564b443391c0 0x564b4433b5d0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:29.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.751+0000 7faacdc26640 1 -- 172.21.15.62:0/3628084828 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7faac400bd60 con 0x564b443391c0 2024-09-10T05:36:29.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.751+0000 7faad09219c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:29.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.751+0000 7faad09219c0 20 searching for the correct realm 2024-09-10T05:36:29.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.751+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b4433d630 con 0x564b443391c0 2024-09-10T05:36:29.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.751+0000 7faacdc26640 1 -- 172.21.15.62:0/3628084828 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac400bd60 con 0x564b443391c0 2024-09-10T05:36:29.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.751+0000 7faacdc26640 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b4433d630 con 0x564b443359a0 2024-09-10T05:36:29.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.751+0000 7faace427640 1 -- 172.21.15.62:0/3628084828 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac0117070 con 0x564b443359a0 2024-09-10T05:36:29.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.751+0000 7faace427640 1 --2- 172.21.15.62:0/3628084828 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7faac0110070 0x7faac00c18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:29.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.751+0000 7faace427640 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b4433d630 con 0x7faac0110070 2024-09-10T05:36:29.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.751+0000 7faacec28640 1 --2- 172.21.15.62:0/3628084828 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7faac0110070 0x7faac00c18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:29.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.751+0000 7faacec28640 1 --2- 172.21.15.62:0/3628084828 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7faac0110070 0x7faac00c18f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:29.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.751+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac800a4d0 con 0x7faac0110070 2024-09-10T05:36:29.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.751+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b4433d630 con 0x564b44331520 2024-09-10T05:36:29.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.751+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac800a4d0 con 0x564b44331520 2024-09-10T05:36:29.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.751+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b4433d630 con 0x564b44331520 2024-09-10T05:36:29.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.751+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac800a4d0 con 0x564b44331520 2024-09-10T05:36:29.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.751+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b4433d630 con 0x564b443391c0 2024-09-10T05:36:29.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.751+0000 7faacdc26640 1 -- 172.21.15.62:0/3628084828 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac400bd60 con 0x564b443391c0 2024-09-10T05:36:29.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.751+0000 7faacdc26640 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b4433d630 con 0x564b44331520 2024-09-10T05:36:29.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.751+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac800a4d0 con 0x564b44331520 2024-09-10T05:36:29.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.751+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b4433d630 con 0x564b443359a0 2024-09-10T05:36:29.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.755+0000 7faace427640 1 -- 172.21.15.62:0/3628084828 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac0117070 con 0x564b443359a0 2024-09-10T05:36:29.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.755+0000 7faace427640 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b4433d630 con 0x564b443359a0 2024-09-10T05:36:29.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.755+0000 7faace427640 1 -- 172.21.15.62:0/3628084828 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac0117070 con 0x564b443359a0 2024-09-10T05:36:29.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.755+0000 7faace427640 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b4433d630 con 0x564b44331520 2024-09-10T05:36:29.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.755+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac800a4d0 con 0x564b44331520 2024-09-10T05:36:29.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.755+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b4433d630 con 0x7faac0110070 2024-09-10T05:36:29.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.755+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac800a4d0 con 0x7faac0110070 2024-09-10T05:36:29.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.755+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b4433d630 con 0x564b44331520 2024-09-10T05:36:29.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.755+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac800a4d0 con 0x564b44331520 2024-09-10T05:36:29.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.755+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b4433d630 con 0x7faac0110070 2024-09-10T05:36:29.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.755+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7faac800a4d0 con 0x7faac0110070 2024-09-10T05:36:29.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.755+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b4433d630 con 0x564b443359a0 2024-09-10T05:36:29.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.755+0000 7faace427640 1 -- 172.21.15.62:0/3628084828 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac0117070 con 0x564b443359a0 2024-09-10T05:36:29.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.755+0000 7faace427640 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b4433d630 con 0x564b443391c0 2024-09-10T05:36:29.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.755+0000 7faacdc26640 1 -- 172.21.15.62:0/3628084828 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac400bd60 con 0x564b443391c0 2024-09-10T05:36:29.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.755+0000 7faacdc26640 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b4433d630 con 0x564b44331520 2024-09-10T05:36:29.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.755+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac800a4d0 con 0x564b44331520 2024-09-10T05:36:29.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.755+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b4433d630 con 0x564b443359a0 2024-09-10T05:36:29.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.759+0000 7faace427640 1 -- 172.21.15.62:0/3628084828 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac0117070 con 0x564b443359a0 2024-09-10T05:36:29.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.759+0000 7faace427640 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b4433d630 con 0x564b443391c0 2024-09-10T05:36:29.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.759+0000 7faacdc26640 1 -- 172.21.15.62:0/3628084828 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 30 out=170b] v23'2 uv2 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7faac400bd60 con 0x564b443391c0 2024-09-10T05:36:29.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.759+0000 7faacdc26640 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b4433d630 con 0x564b44331520 2024-09-10T05:36:29.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.759+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac800a4d0 con 0x564b44331520 2024-09-10T05:36:29.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.759+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b4433d630 con 0x564b44331520 2024-09-10T05:36:29.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.759+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7faac800a4d0 con 0x564b44331520 2024-09-10T05:36:29.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.759+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b4433d630 con 0x564b44331520 2024-09-10T05:36:29.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.759+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac800a4d0 con 0x564b44331520 2024-09-10T05:36:29.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.759+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b4433d630 con 0x564b443391c0 2024-09-10T05:36:29.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.759+0000 7faacdc26640 1 -- 172.21.15.62:0/3628084828 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac400bd60 con 0x564b443391c0 2024-09-10T05:36:29.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.759+0000 7faacdc26640 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b4433d630 con 0x7faac0110070 2024-09-10T05:36:29.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.759+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac800a4d0 con 0x7faac0110070 2024-09-10T05:36:29.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.759+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b4433d630 con 0x564b44331520 2024-09-10T05:36:29.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.759+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac800a4d0 con 0x564b44331520 2024-09-10T05:36:29.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.759+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b4433d630 con 0x7faac0110070 2024-09-10T05:36:29.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.759+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac800a4d0 con 0x7faac0110070 2024-09-10T05:36:29.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.759+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b4433d630 con 0x564b443391c0 2024-09-10T05:36:29.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.759+0000 7faacdc26640 1 -- 172.21.15.62:0/3628084828 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac400bd60 con 0x564b443391c0 2024-09-10T05:36:29.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.759+0000 7faacdc26640 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b4433d630 con 0x7faac0110070 2024-09-10T05:36:29.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.759+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac800a4d0 con 0x7faac0110070 2024-09-10T05:36:29.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.759+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b4433d630 con 0x564b443359a0 2024-09-10T05:36:29.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.763+0000 7faace427640 1 -- 172.21.15.62:0/3628084828 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac0117070 con 0x564b443359a0 2024-09-10T05:36:29.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.763+0000 7faace427640 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b4433d630 con 0x564b443359a0 2024-09-10T05:36:29.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.763+0000 7faace427640 1 -- 172.21.15.62:0/3628084828 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac0117070 con 0x564b443359a0 2024-09-10T05:36:29.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.763+0000 7faace427640 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b4433d630 con 0x564b443391c0 2024-09-10T05:36:29.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.763+0000 7faacdc26640 1 -- 172.21.15.62:0/3628084828 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac400bd60 con 0x564b443391c0 2024-09-10T05:36:29.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.763+0000 7faacdc26640 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b4433d630 con 0x564b443359a0 2024-09-10T05:36:29.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.763+0000 7faace427640 1 -- 172.21.15.62:0/3628084828 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7faac0117070 con 0x564b443359a0 2024-09-10T05:36:29.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.763+0000 7faace427640 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b4433d630 con 0x564b443359a0 2024-09-10T05:36:29.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.763+0000 7faace427640 1 -- 172.21.15.62:0/3628084828 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac0117070 con 0x564b443359a0 2024-09-10T05:36:29.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.763+0000 7faad09219c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:29.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.763+0000 7faad09219c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:29.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.763+0000 7faad09219c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:29.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.763+0000 7faad09219c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:29.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.763+0000 7faad09219c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:29.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.763+0000 7faad09219c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:29.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.763+0000 7faad09219c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:29.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.763+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b4433c750 con 0x564b44331520 2024-09-10T05:36:29.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.763+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faac800a4d0 con 0x564b44331520 2024-09-10T05:36:29.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.763+0000 7faad09219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:29.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.763+0000 7faad09219c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:29.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.763+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b4433c390 con 0x564b443359a0 2024-09-10T05:36:29.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.767+0000 7faace427640 1 -- 172.21.15.62:0/3628084828 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faac0117070 con 0x564b443359a0 2024-09-10T05:36:29.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.767+0000 7faad09219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:29.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.767+0000 7faad09219c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:29.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.767+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b4433d0f0 con 0x564b443391c0 2024-09-10T05:36:29.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.767+0000 7faacdc26640 1 -- 172.21.15.62:0/3628084828 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7faac400bd60 con 0x564b443391c0 2024-09-10T05:36:29.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.767+0000 7faad09219c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:29.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.767+0000 7faad09219c0 20 zone default found 2024-09-10T05:36:29.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.767+0000 7faad09219c0 4 Realm: () 2024-09-10T05:36:29.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.767+0000 7faad09219c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:29.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.767+0000 7faad09219c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:29.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.767+0000 7faad09219c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:29.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.767+0000 7faad09219c0 20 zonegroup default 2024-09-10T05:36:29.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.767+0000 7faad09219c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:29.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.767+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b4433df10 con 0x7faac0110070 2024-09-10T05:36:29.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.767+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7faac800a4d0 con 0x7faac0110070 2024-09-10T05:36:29.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.767+0000 7faad09219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:29.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.767+0000 7faad09219c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:29.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.767+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b44340150 con 0x564b443391c0 2024-09-10T05:36:29.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.767+0000 7faacdc26640 1 -- 172.21.15.62:0/3628084828 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faac400bd60 con 0x564b443391c0 2024-09-10T05:36:29.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.767+0000 7faad09219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:29.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.767+0000 7faad09219c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:29.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.767+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b443404f0 con 0x564b443391c0 2024-09-10T05:36:29.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.767+0000 7faacdc26640 1 -- 172.21.15.62:0/3628084828 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faac400bd60 con 0x564b443391c0 2024-09-10T05:36:29.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.767+0000 7faad09219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:29.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.767+0000 7faad09219c0 20 started sync module instance, tier type = 2024-09-10T05:36:29.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.767+0000 7faad09219c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:29.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.767+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b4433f5e0 con 0x564b443359a0 2024-09-10T05:36:29.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.767+0000 7faace427640 1 -- 172.21.15.62:0/3628084828 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faac0117070 con 0x564b443359a0 2024-09-10T05:36:29.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.771+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94881266792912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b44340dd0 con 0x564b443359a0 2024-09-10T05:36:29.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.771+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b44341620 con 0x564b44331520 2024-09-10T05:36:29.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.771+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faac800a4d0 con 0x564b44331520 2024-09-10T05:36:29.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.771+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94881266798032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b44341230 con 0x564b44331520 2024-09-10T05:36:29.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.771+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b44342580 con 0x564b443359a0 2024-09-10T05:36:29.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.771+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94881266798032] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faac800a4d0 con 0x564b44331520 2024-09-10T05:36:29.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.771+0000 7faace427640 1 -- 172.21.15.62:0/3628084828 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94881266792912] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faac0117070 con 0x564b443359a0 2024-09-10T05:36:29.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.775+0000 7faace427640 1 -- 172.21.15.62:0/3628084828 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faac0117070 con 0x564b443359a0 2024-09-10T05:36:29.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.775+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94881266796832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b44342090 con 0x564b443359a0 2024-09-10T05:36:29.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.775+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b44342e50 con 0x7faac0110070 2024-09-10T05:36:29.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.775+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faac800a4d0 con 0x7faac0110070 2024-09-10T05:36:29.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.775+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94881266805152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b44342090 con 0x7faac0110070 2024-09-10T05:36:29.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.775+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b44343920 con 0x564b443359a0 2024-09-10T05:36:29.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.779+0000 7faace427640 1 -- 172.21.15.62:0/3628084828 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94881266796832] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faac0117070 con 0x564b443359a0 2024-09-10T05:36:29.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.779+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94881266805152] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faac800a4d0 con 0x7faac0110070 2024-09-10T05:36:29.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.779+0000 7faace427640 1 -- 172.21.15.62:0/3628084828 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faac0117070 con 0x564b443359a0 2024-09-10T05:36:29.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.779+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94881266806208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b443438e0 con 0x564b443359a0 2024-09-10T05:36:29.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.779+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b44343d10 con 0x564b443391c0 2024-09-10T05:36:29.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.779+0000 7faacdc26640 1 -- 172.21.15.62:0/3628084828 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faac400bd60 con 0x564b443391c0 2024-09-10T05:36:29.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.779+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94881266801088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b44343d10 con 0x564b443391c0 2024-09-10T05:36:29.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.779+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b44344c30 con 0x564b443391c0 2024-09-10T05:36:29.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.783+0000 7faacdc26640 1 -- 172.21.15.62:0/3628084828 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94881266801088] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faac400bd60 con 0x564b443391c0 2024-09-10T05:36:29.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.783+0000 7faace427640 1 -- 172.21.15.62:0/3628084828 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94881266806208] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faac0117070 con 0x564b443359a0 2024-09-10T05:36:29.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.783+0000 7faacdc26640 1 -- 172.21.15.62:0/3628084828 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faac400bd60 con 0x564b443391c0 2024-09-10T05:36:29.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.783+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94881266807824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b44344100 con 0x564b443391c0 2024-09-10T05:36:29.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.783+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b443450a0 con 0x7faac0110070 2024-09-10T05:36:29.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.783+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faac800a4d0 con 0x7faac0110070 2024-09-10T05:36:29.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.783+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94881266813936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b44345010 con 0x7faac0110070 2024-09-10T05:36:29.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.783+0000 7faad09219c0 20 add_watcher() i=0 2024-09-10T05:36:29.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.783+0000 7faad09219c0 20 add_watcher() i=1 2024-09-10T05:36:29.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.783+0000 7faad09219c0 20 add_watcher() i=2 2024-09-10T05:36:29.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.783+0000 7faad09219c0 20 add_watcher() i=3 2024-09-10T05:36:29.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.783+0000 7faad09219c0 20 add_watcher() i=4 2024-09-10T05:36:29.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.783+0000 7faad09219c0 20 add_watcher() i=5 2024-09-10T05:36:29.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.783+0000 7faacdc26640 1 -- 172.21.15.62:0/3628084828 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94881266807824] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faac400bd60 con 0x564b443391c0 2024-09-10T05:36:29.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.783+0000 7faad09219c0 20 add_watcher() i=6 2024-09-10T05:36:29.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.787+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94881266813936] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faac800a4d0 con 0x7faac0110070 2024-09-10T05:36:29.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.787+0000 7faad09219c0 20 add_watcher() i=7 2024-09-10T05:36:29.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.787+0000 7faad09219c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:29.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.787+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b44344720 con 0x564b44331520 2024-09-10T05:36:29.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.787+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7faac800a4d0 con 0x564b44331520 2024-09-10T05:36:29.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.787+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94881266812704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b44345a60 con 0x564b44331520 2024-09-10T05:36:29.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.787+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94881266812704] v30'42 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faac800a4d0 con 0x564b44331520 2024-09-10T05:36:29.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.787+0000 7fa984fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:29.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.787+0000 7faad09219c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:29.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.787+0000 7faad09219c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:29.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.787+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b44350eb0 con 0x564b443359a0 2024-09-10T05:36:29.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.791+0000 7faace427640 1 -- 172.21.15.62:0/3628084828 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'42 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faac0117070 con 0x564b443359a0 2024-09-10T05:36:29.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.791+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b44350eb0 con 0x7faac0110070 2024-09-10T05:36:29.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.791+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faac800a4d0 con 0x7faac0110070 2024-09-10T05:36:29.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.791+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b44350eb0 con 0x564b443391c0 2024-09-10T05:36:29.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.795+0000 7faacdc26640 1 -- 172.21.15.62:0/3628084828 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faac400bd60 con 0x564b443391c0 2024-09-10T05:36:29.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.795+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b443518f0 con 0x564b44331520 2024-09-10T05:36:29.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.795+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'43 uv12 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faac800a4d0 con 0x564b44331520 2024-09-10T05:36:29.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.795+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b44351e60 con 0x564b443359a0 2024-09-10T05:36:29.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.799+0000 7faace427640 1 -- 172.21.15.62:0/3628084828 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'32 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faac0117070 con 0x564b443359a0 2024-09-10T05:36:29.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.799+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b44351e60 con 0x564b443391c0 2024-09-10T05:36:29.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.799+0000 7faacdc26640 1 -- 172.21.15.62:0/3628084828 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'29 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faac400bd60 con 0x564b443391c0 2024-09-10T05:36:29.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.799+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b443523d0 con 0x564b443359a0 2024-09-10T05:36:29.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.803+0000 7faace427640 1 -- 172.21.15.62:0/3628084828 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faac0117070 con 0x564b443359a0 2024-09-10T05:36:29.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.803+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b443523d0 con 0x564b44331520 2024-09-10T05:36:29.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.803+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'23 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faac800a4d0 con 0x564b44331520 2024-09-10T05:36:29.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.803+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b44352940 con 0x564b443359a0 2024-09-10T05:36:29.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.807+0000 7faace427640 1 -- 172.21.15.62:0/3628084828 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faac0117070 con 0x564b443359a0 2024-09-10T05:36:29.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.807+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b44352d80 con 0x564b443359a0 2024-09-10T05:36:29.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.811+0000 7faace427640 1 -- 172.21.15.62:0/3628084828 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'18 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faac0117070 con 0x564b443359a0 2024-09-10T05:36:29.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.811+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b44352a50 con 0x564b443359a0 2024-09-10T05:36:29.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.811+0000 7faace427640 1 -- 172.21.15.62:0/3628084828 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'33 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faac0117070 con 0x564b443359a0 2024-09-10T05:36:29.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.811+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b44352a30 con 0x564b443391c0 2024-09-10T05:36:29.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.815+0000 7faacdc26640 1 -- 172.21.15.62:0/3628084828 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faac400bd60 con 0x564b443391c0 2024-09-10T05:36:29.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.815+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b44352a90 con 0x564b443359a0 2024-09-10T05:36:29.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.815+0000 7faace427640 1 -- 172.21.15.62:0/3628084828 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faac0117070 con 0x564b443359a0 2024-09-10T05:36:29.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.815+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b44352b10 con 0x564b44331520 2024-09-10T05:36:29.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.819+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'35 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faac800a4d0 con 0x564b44331520 2024-09-10T05:36:29.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.819+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b44353180 con 0x564b44331520 2024-09-10T05:36:29.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.819+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'44 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faac800a4d0 con 0x564b44331520 2024-09-10T05:36:29.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.819+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b443530d0 con 0x564b443359a0 2024-09-10T05:36:29.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.823+0000 7faace427640 1 -- 172.21.15.62:0/3628084828 <== osd.0 v2:172.21.15.2:6800/945139080 25 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'27 uv16 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faac0117070 con 0x564b443359a0 2024-09-10T05:36:29.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.823+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b443530d0 con 0x564b443359a0 2024-09-10T05:36:29.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.823+0000 7faace427640 1 -- 172.21.15.62:0/3628084828 <== osd.0 v2:172.21.15.2:6800/945139080 26 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'34 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faac0117070 con 0x564b443359a0 2024-09-10T05:36:29.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.823+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b443530d0 con 0x564b443391c0 2024-09-10T05:36:29.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.827+0000 7faacdc26640 1 -- 172.21.15.62:0/3628084828 <== osd.3 v2:172.21.15.62:6816/2708991149 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'24 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faac400bd60 con 0x564b443391c0 2024-09-10T05:36:29.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.827+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b443530d0 con 0x564b443359a0 2024-09-10T05:36:29.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.827+0000 7faace427640 1 -- 172.21.15.62:0/3628084828 <== osd.0 v2:172.21.15.2:6800/945139080 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faac0117070 con 0x564b443359a0 2024-09-10T05:36:29.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.827+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b443530d0 con 0x564b44331520 2024-09-10T05:36:29.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.831+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 <== osd.1 v2:172.21.15.62:6808/3442097179 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'45 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faac800a4d0 con 0x564b44331520 2024-09-10T05:36:29.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.831+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b44353070 con 0x564b443359a0 2024-09-10T05:36:29.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.831+0000 7faace427640 1 -- 172.21.15.62:0/3628084828 <== osd.0 v2:172.21.15.2:6800/945139080 28 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'28 uv18 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faac0117070 con 0x564b443359a0 2024-09-10T05:36:29.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.831+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b44353070 con 0x564b443359a0 2024-09-10T05:36:29.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.835+0000 7faace427640 1 -- 172.21.15.62:0/3628084828 <== osd.0 v2:172.21.15.2:6800/945139080 29 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'28 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faac0117070 con 0x564b443359a0 2024-09-10T05:36:29.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.835+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b44353070 con 0x564b443391c0 2024-09-10T05:36:29.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.835+0000 7faacdc26640 1 -- 172.21.15.62:0/3628084828 <== osd.3 v2:172.21.15.62:6816/2708991149 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faac400bd60 con 0x564b443391c0 2024-09-10T05:36:29.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.839+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b44353070 con 0x564b443359a0 2024-09-10T05:36:29.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.839+0000 7faace427640 1 -- 172.21.15.62:0/3628084828 <== osd.0 v2:172.21.15.2:6800/945139080 30 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'30 uv18 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faac0117070 con 0x564b443359a0 2024-09-10T05:36:29.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.839+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b44353070 con 0x564b443391c0 2024-09-10T05:36:29.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.843+0000 7faacdc26640 1 -- 172.21.15.62:0/3628084828 <== osd.3 v2:172.21.15.62:6816/2708991149 21 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'14 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faac400bd60 con 0x564b443391c0 2024-09-10T05:36:29.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.843+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b44353130 con 0x564b443391c0 2024-09-10T05:36:29.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.843+0000 7faacdc26640 1 -- 172.21.15.62:0/3628084828 <== osd.3 v2:172.21.15.62:6816/2708991149 22 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'30 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faac400bd60 con 0x564b443391c0 2024-09-10T05:36:29.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.843+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b44353130 con 0x564b443391c0 2024-09-10T05:36:29.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.843+0000 7faacdc26640 1 -- 172.21.15.62:0/3628084828 <== osd.3 v2:172.21.15.62:6816/2708991149 23 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'20 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faac400bd60 con 0x564b443391c0 2024-09-10T05:36:29.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.843+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b44353100 con 0x564b443359a0 2024-09-10T05:36:29.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.847+0000 7faace427640 1 -- 172.21.15.62:0/3628084828 <== osd.0 v2:172.21.15.2:6800/945139080 31 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'24 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faac0117070 con 0x564b443359a0 2024-09-10T05:36:29.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.847+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b44353100 con 0x564b44331520 2024-09-10T05:36:29.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.847+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 <== osd.1 v2:172.21.15.62:6808/3442097179 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'24 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faac800a4d0 con 0x564b44331520 2024-09-10T05:36:29.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.847+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b44353100 con 0x564b443359a0 2024-09-10T05:36:29.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.851+0000 7faace427640 1 -- 172.21.15.62:0/3628084828 <== osd.0 v2:172.21.15.2:6800/945139080 32 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'29 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faac0117070 con 0x564b443359a0 2024-09-10T05:36:29.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.851+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b44353100 con 0x564b44331520 2024-09-10T05:36:29.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.855+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 <== osd.1 v2:172.21.15.62:6808/3442097179 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'36 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faac800a4d0 con 0x564b44331520 2024-09-10T05:36:29.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.855+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b44353100 con 0x7faac0110070 2024-09-10T05:36:29.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.855+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faac800a4d0 con 0x7faac0110070 2024-09-10T05:36:29.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.855+0000 7fa8ff7fe640 20 reqs_thread_entry: start 2024-09-10T05:36:29.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.855+0000 7faad09219c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:29.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.855+0000 7faad09219c0 20 Filter name: none 2024-09-10T05:36:29.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.855+0000 7fa8fd7fa640 20 reqs_thread_entry: start 2024-09-10T05:36:29.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.859+0000 7faad09219c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-10T05:36:29.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.859+0000 7faad09219c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:29.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.859+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b4434f720 con 0x7faac0110070 2024-09-10T05:36:29.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.859+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7faac800a4d0 con 0x7faac0110070 2024-09-10T05:36:29.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.859+0000 7faad09219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:29.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.859+0000 7faad09219c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-10T05:36:29.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.859+0000 7faad09219c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T05:36:29.861 INFO:teuthology.orchestra.run.smithi062.stderr:could not remove user: unable to remove user, user does not exist 2024-09-10T05:36:29.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.859+0000 7fa984fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:29.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.859+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94881266812704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b4434f720 con 0x564b44331520 2024-09-10T05:36:29.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.863+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 <== osd.1 v2:172.21.15.62:6808/3442097179 26 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94881266812704] v30'46 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faac800a4d0 con 0x564b44331520 2024-09-10T05:36:29.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.863+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94881266792912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b4434f720 con 0x564b443359a0 2024-09-10T05:36:29.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.863+0000 7faace427640 1 -- 172.21.15.62:0/3628084828 <== osd.0 v2:172.21.15.2:6800/945139080 33 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94881266792912] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faac0117070 con 0x564b443359a0 2024-09-10T05:36:29.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.863+0000 7faad09219c0 20 remove_watcher() i=0 2024-09-10T05:36:29.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.863+0000 7faad09219c0 2 removed watcher, disabling cache 2024-09-10T05:36:29.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.863+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94881266798032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b4434f720 con 0x564b44331520 2024-09-10T05:36:29.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.863+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 <== osd.1 v2:172.21.15.62:6808/3442097179 27 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94881266798032] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faac800a4d0 con 0x564b44331520 2024-09-10T05:36:29.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.863+0000 7faad09219c0 20 remove_watcher() i=1 2024-09-10T05:36:29.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.863+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94881266796832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b4434f720 con 0x564b443359a0 2024-09-10T05:36:29.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.867+0000 7faace427640 1 -- 172.21.15.62:0/3628084828 <== osd.0 v2:172.21.15.2:6800/945139080 34 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94881266796832] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faac0117070 con 0x564b443359a0 2024-09-10T05:36:29.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.867+0000 7faad09219c0 20 remove_watcher() i=2 2024-09-10T05:36:29.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.867+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94881266805152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b4434f720 con 0x7faac0110070 2024-09-10T05:36:29.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.871+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 <== osd.2 v2:172.21.15.62:6800/2677868286 15 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94881266805152] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faac800a4d0 con 0x7faac0110070 2024-09-10T05:36:29.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.871+0000 7faad09219c0 20 remove_watcher() i=3 2024-09-10T05:36:29.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.871+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94881266806208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b4434f720 con 0x564b443359a0 2024-09-10T05:36:29.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.871+0000 7faace427640 1 -- 172.21.15.62:0/3628084828 <== osd.0 v2:172.21.15.2:6800/945139080 35 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94881266806208] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faac0117070 con 0x564b443359a0 2024-09-10T05:36:29.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.871+0000 7faad09219c0 20 remove_watcher() i=4 2024-09-10T05:36:29.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.875+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94881266801088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b4434f720 con 0x564b443391c0 2024-09-10T05:36:29.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.875+0000 7faacdc26640 1 -- 172.21.15.62:0/3628084828 <== osd.3 v2:172.21.15.62:6816/2708991149 24 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94881266801088] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faac400bd60 con 0x564b443391c0 2024-09-10T05:36:29.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.875+0000 7faad09219c0 20 remove_watcher() i=5 2024-09-10T05:36:29.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.875+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94881266807824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b4434f720 con 0x564b443391c0 2024-09-10T05:36:29.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.875+0000 7faacdc26640 1 -- 172.21.15.62:0/3628084828 <== osd.3 v2:172.21.15.62:6816/2708991149 25 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94881266807824] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faac400bd60 con 0x564b443391c0 2024-09-10T05:36:29.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.875+0000 7faad09219c0 20 remove_watcher() i=6 2024-09-10T05:36:29.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.875+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94881266813936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b4434f720 con 0x7faac0110070 2024-09-10T05:36:29.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.875+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 <== osd.2 v2:172.21.15.62:6800/2677868286 16 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94881266813936] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faac800a4d0 con 0x7faac0110070 2024-09-10T05:36:29.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.875+0000 7faad09219c0 20 remove_watcher() i=7 2024-09-10T05:36:29.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.875+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x564b443359a0 msgr2=0x564b44337d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.875+0000 7faad09219c0 1 --2- 172.21.15.62:0/3628084828 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x564b443359a0 0x564b44337d90 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.875+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x564b44331520 msgr2=0x564b443339b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.875+0000 7faad09219c0 1 --2- 172.21.15.62:0/3628084828 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x564b44331520 0x564b443339b0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.875+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7faac0110070 msgr2=0x7faac00c18f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.875+0000 7faad09219c0 1 --2- 172.21.15.62:0/3628084828 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7faac0110070 0x7faac00c18f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.875+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x564b443391c0 msgr2=0x564b4433b5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.875+0000 7faad09219c0 1 --2- 172.21.15.62:0/3628084828 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x564b443391c0 0x564b4433b5d0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.879+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fa998039a70 msgr2=0x7fa99803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.879+0000 7faad09219c0 1 --2- 172.21.15.62:0/3628084828 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fa998039a70 0x7fa99803bf30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x564b44304bc0 tx=0x7faac4010000 comp rx=0 tx=0).stop 2024-09-10T05:36:29.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.879+0000 7faacec28640 1 -- 172.21.15.62:0/3628084828 reap_dead start 2024-09-10T05:36:29.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.879+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b4431f410 msgr2=0x564b443266f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.879+0000 7faad09219c0 1 --2- 172.21.15.62:0/3628084828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b4431f410 0x564b443266f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7faac00a4070 tx=0x7faac00deec0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.879+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 shutdown_connections 2024-09-10T05:36:29.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.879+0000 7faad09219c0 1 --2- 172.21.15.62:0/3628084828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b4431f410 0x564b443266f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.879+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 >> 172.21.15.62:0/3628084828 conn(0x564b4431b840 msgr2=0x564b44319a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:29.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.879+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 shutdown_connections 2024-09-10T05:36:29.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.879+0000 7faad09219c0 1 -- 172.21.15.62:0/3628084828 wait complete. 2024-09-10T05:36:29.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.879+0000 7faad09219c0 1 -- 172.21.15.62:0/1200327189 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fa9a8039ac0 msgr2=0x7fa9a803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.879+0000 7faad09219c0 1 --2- 172.21.15.62:0/1200327189 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fa9a8039ac0 0x7fa9a803bf80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x564b442f6630 tx=0x7faac400f000 comp rx=0 tx=0).stop 2024-09-10T05:36:29.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.879+0000 7faad09219c0 1 -- 172.21.15.62:0/1200327189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b44312e40 msgr2=0x564b44313260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.879+0000 7faad09219c0 1 --2- 172.21.15.62:0/1200327189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b44312e40 0x564b44313260 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7faac00cfdc0 tx=0x7faac00cfa10 comp rx=0 tx=0).stop 2024-09-10T05:36:29.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.879+0000 7faad09219c0 1 -- 172.21.15.62:0/1200327189 shutdown_connections 2024-09-10T05:36:29.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.879+0000 7faad09219c0 1 --2- 172.21.15.62:0/1200327189 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fa9a8039ac0 0x7fa9a803bf80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.879+0000 7faad09219c0 1 --2- 172.21.15.62:0/1200327189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b44312e40 0x564b44313260 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.879+0000 7faad09219c0 1 -- 172.21.15.62:0/1200327189 >> 172.21.15.62:0/1200327189 conn(0x564b443087f0 msgr2=0x564b44308bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:29.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.879+0000 7faad09219c0 1 -- 172.21.15.62:0/1200327189 shutdown_connections 2024-09-10T05:36:29.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.879+0000 7faad09219c0 1 -- 172.21.15.62:0/1200327189 wait complete. 2024-09-10T05:36:29.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.879+0000 7faad09219c0 1 -- 172.21.15.62:0/3923085399 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x564b442fd550 msgr2=0x564b442ff940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.879+0000 7faad09219c0 1 --2- 172.21.15.62:0/3923085399 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x564b442fd550 0x564b442ff940 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.879+0000 7faad09219c0 1 -- 172.21.15.62:0/3923085399 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x564b44176280 msgr2=0x564b442fc260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.879+0000 7faad09219c0 1 --2- 172.21.15.62:0/3923085399 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x564b44176280 0x564b442fc260 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.879+0000 7faad09219c0 1 -- 172.21.15.62:0/3923085399 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x564b44301cc0 msgr2=0x564b443040b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.879+0000 7faad09219c0 1 --2- 172.21.15.62:0/3923085399 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x564b44301cc0 0x564b443040b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.879+0000 7faad09219c0 1 -- 172.21.15.62:0/3923085399 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fa9b4039c10 msgr2=0x7fa9b403c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.879+0000 7faad09219c0 1 --2- 172.21.15.62:0/3923085399 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fa9b4039c10 0x7fa9b403c0d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7faac4001e40 tx=0x7faac40013a0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.879+0000 7faad09219c0 1 -- 172.21.15.62:0/3923085399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b44174c70 msgr2=0x564b442f50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.879+0000 7faad09219c0 1 --2- 172.21.15.62:0/3923085399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b44174c70 0x564b442f50f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7faac0000c10 tx=0x7faac00180e0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.879+0000 7faacec28640 1 -- 172.21.15.62:0/3923085399 reap_dead start 2024-09-10T05:36:29.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.879+0000 7faad09219c0 1 -- 172.21.15.62:0/3923085399 shutdown_connections 2024-09-10T05:36:29.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.879+0000 7faad09219c0 1 -- 172.21.15.62:0/3923085399 >> 172.21.15.62:0/3923085399 conn(0x564b441fbaa0 msgr2=0x564b442e8260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:29.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.879+0000 7faad09219c0 1 -- 172.21.15.62:0/3923085399 shutdown_connections 2024-09-10T05:36:29.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.879+0000 7faad09219c0 1 -- 172.21.15.62:0/3923085399 wait complete. 2024-09-10T05:36:29.892 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-10T05:36:29.893 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-10T05:36:29.893 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-10T05:36:29.893 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-10T05:36:29.972 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:29.972 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:29.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.971+0000 7f7ece0249c0 1 Processor -- start 2024-09-10T05:36:29.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.971+0000 7f7ece0249c0 1 -- start start 2024-09-10T05:36:29.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.971+0000 7f7ece0249c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5575a7173350 0x5575a7175740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:29.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.971+0000 7f7ece0249c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5575a70219c0 con 0x5575a716f200 2024-09-10T05:36:29.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.971+0000 7f7ece0249c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x5575a70716d0 con 0x5575a7173350 2024-09-10T05:36:29.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.971+0000 7f7ecb329640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5575a7173350 0x5575a7175740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:29.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.971+0000 7f7ecb329640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5575a7173350 0x5575a7175740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:50926/0 (socket says 172.21.15.62:50926) 2024-09-10T05:36:29.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.971+0000 7f7ecb329640 1 -- 172.21.15.62:0/1330772002 learned_addr learned my addr 172.21.15.62:0/1330772002 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:29.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.971+0000 7f7ecbb2a640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x5575a716f200 0x5575a716f5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:38436/0 (socket says 172.21.15.62:38436) 2024-09-10T05:36:29.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.971+0000 7f7ecb329640 1 -- 172.21.15.62:0/1330772002 >> v1:172.21.15.2:6789/0 conn(0x5575a716f200 legacy=0x5575a716f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.971+0000 7f7ecb329640 1 -- 172.21.15.62:0/1330772002 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575a7015ca0 con 0x5575a7173350 2024-09-10T05:36:29.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.975+0000 7f7ecb329640 1 --2- 172.21.15.62:0/1330772002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5575a7173350 0x5575a7175740 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7ec000a5c0 tx=0x7f7ec001b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20a556518af74cd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:29.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.975+0000 7f7ecab28640 1 -- 172.21.15.62:0/1330772002 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ec00a9590 con 0x5575a7173350 2024-09-10T05:36:29.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.975+0000 7f7ecab28640 1 -- 172.21.15.62:0/1330772002 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ec00ae070 con 0x5575a7173350 2024-09-10T05:36:29.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.975+0000 7f7ecab28640 1 -- 172.21.15.62:0/1330772002 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ec00a9880 con 0x5575a7173350 2024-09-10T05:36:29.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.975+0000 7f7ece0249c0 1 -- 172.21.15.62:0/1330772002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5575a7173350 msgr2=0x5575a7175740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:29.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.975+0000 7f7ece0249c0 1 --2- 172.21.15.62:0/1330772002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5575a7173350 0x5575a7175740 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7ec000a5c0 tx=0x7f7ec001b3d0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.975+0000 7f7ece0249c0 1 -- 172.21.15.62:0/1330772002 shutdown_connections 2024-09-10T05:36:29.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.975+0000 7f7ece0249c0 1 --2- 172.21.15.62:0/1330772002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5575a7173350 0x5575a7175740 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:29.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.975+0000 7f7ece0249c0 1 -- 172.21.15.62:0/1330772002 >> 172.21.15.62:0/1330772002 conn(0x5575a70e2b10 msgr2=0x5575a70e2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:29.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.975+0000 7f7ece0249c0 1 -- 172.21.15.62:0/1330772002 shutdown_connections 2024-09-10T05:36:29.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.975+0000 7f7ece0249c0 1 -- 172.21.15.62:0/1330772002 wait complete. 2024-09-10T05:36:29.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.987+0000 7f7ece0249c0 1 Processor -- start 2024-09-10T05:36:29.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.987+0000 7f7ece0249c0 1 -- start start 2024-09-10T05:36:29.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.987+0000 7f7ece0249c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5575a716f200 0x5575a725aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:29.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.987+0000 7f7ece0249c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5575a7075680 con 0x5575a716f200 2024-09-10T05:36:29.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.991+0000 7f7ecbb2a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5575a716f200 0x5575a725aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:29.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.991+0000 7f7ecbb2a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5575a716f200 0x5575a725aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:50938/0 (socket says 172.21.15.62:50938) 2024-09-10T05:36:29.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.991+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/2006605090 learned_addr learned my addr 172.21.15.62:0/2006605090 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:29.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.991+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/2006605090 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575a6ff0da0 con 0x5575a716f200 2024-09-10T05:36:29.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.991+0000 7f7ecbb2a640 1 --2- 172.21.15.62:0/2006605090 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5575a716f200 0x5575a725aa00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc001ec0 tx=0x7f7ebc00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c87707a55b5502cf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:29.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.991+0000 7f7db9e0b640 1 -- 172.21.15.62:0/2006605090 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ebc00e5d0 con 0x5575a716f200 2024-09-10T05:36:29.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.991+0000 7f7db9e0b640 1 -- 172.21.15.62:0/2006605090 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ebc00e770 con 0x5575a716f200 2024-09-10T05:36:29.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.991+0000 7f7db9e0b640 1 -- 172.21.15.62:0/2006605090 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ebc00ea70 con 0x5575a716f200 2024-09-10T05:36:30.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.991+0000 7f7ece0249c0 1 -- 172.21.15.62:0/2006605090 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5575a716f200 msgr2=0x5575a725aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.991+0000 7f7ece0249c0 1 --2- 172.21.15.62:0/2006605090 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5575a716f200 0x5575a725aa00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc001ec0 tx=0x7f7ebc00b6d0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.991+0000 7f7ece0249c0 1 -- 172.21.15.62:0/2006605090 shutdown_connections 2024-09-10T05:36:30.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.991+0000 7f7ece0249c0 1 --2- 172.21.15.62:0/2006605090 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5575a716f200 0x5575a725aa00 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.991+0000 7f7ece0249c0 1 -- 172.21.15.62:0/2006605090 >> 172.21.15.62:0/2006605090 conn(0x5575a70e2b10 msgr2=0x5575a72565a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:30.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.991+0000 7f7ece0249c0 1 -- 172.21.15.62:0/2006605090 shutdown_connections 2024-09-10T05:36:30.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.991+0000 7f7ece0249c0 1 -- 172.21.15.62:0/2006605090 wait complete. 2024-09-10T05:36:30.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.991+0000 7f7ece0249c0 1 Processor -- start 2024-09-10T05:36:30.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.991+0000 7f7ece0249c0 1 -- start start 2024-09-10T05:36:30.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.991+0000 7f7ece0249c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5575a716f200 0x5575a72620a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.991+0000 7f7ece0249c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5575a7017a50 con 0x5575a716f200 2024-09-10T05:36:30.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.991+0000 7f7ecbb2a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5575a716f200 0x5575a72620a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.991+0000 7f7ecbb2a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5575a716f200 0x5575a72620a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:50954/0 (socket says 172.21.15.62:50954) 2024-09-10T05:36:30.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.991+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/1671162060 learned_addr learned my addr 172.21.15.62:0/1671162060 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:30.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.991+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/1671162060 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575a7262600 con 0x5575a716f200 2024-09-10T05:36:30.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.995+0000 7f7ecbb2a640 1 --2- 172.21.15.62:0/1671162060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5575a716f200 0x5575a72620a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x5575a725b990 tx=0x7f7ebc000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.995+0000 7f7db3fff640 1 -- 172.21.15.62:0/1671162060 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ebc00f8e0 con 0x5575a716f200 2024-09-10T05:36:30.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.995+0000 7f7ece0249c0 1 -- 172.21.15.62:0/1671162060 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5575a7262890 con 0x5575a716f200 2024-09-10T05:36:30.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.995+0000 7f7ece0249c0 1 -- 172.21.15.62:0/1671162060 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575a7263240 con 0x5575a716f200 2024-09-10T05:36:30.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.995+0000 7f7db3fff640 1 -- 172.21.15.62:0/1671162060 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ebc00fa80 con 0x5575a716f200 2024-09-10T05:36:30.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.995+0000 7f7db3fff640 1 -- 172.21.15.62:0/1671162060 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ebc02c060 con 0x5575a716f200 2024-09-10T05:36:30.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.995+0000 7f7db3fff640 1 -- 172.21.15.62:0/1671162060 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f7ebc017070 con 0x5575a716f200 2024-09-10T05:36:30.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.995+0000 7f7db3fff640 1 --2- 172.21.15.62:0/1671162060 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7db4039a70 0x7f7db403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.995+0000 7f7db3fff640 1 -- 172.21.15.62:0/1671162060 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f7ebc015020 con 0x5575a716f200 2024-09-10T05:36:30.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.995+0000 7f7ecb329640 1 --2- 172.21.15.62:0/1671162060 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7db4039a70 0x7f7db403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.995+0000 7f7ece0249c0 1 --2- 172.21.15.62:0/1671162060 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5575a7267200 0x5575a72695f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.995+0000 7f7ece0249c0 1 -- 172.21.15.62:0/1671162060 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5575a7269b30 con 0x5575a7267200 2024-09-10T05:36:30.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.995+0000 7f7ecc32b640 1 --2- 172.21.15.62:0/1671162060 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5575a7267200 0x5575a72695f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.995+0000 7f7ecb329640 1 --2- 172.21.15.62:0/1671162060 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7db4039a70 0x7f7db403bf30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7ec00ad000 tx=0x7f7ec00a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.995+0000 7f7ecc32b640 1 --2- 172.21.15.62:0/1671162060 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5575a7267200 0x5575a72695f0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.995+0000 7f7ecc32b640 1 -- 172.21.15.62:0/1671162060 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7ec400a4d0 con 0x5575a7267200 2024-09-10T05:36:30.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.995+0000 7f7ece0249c0 1 --2- 172.21.15.62:0/1671162060 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5575a726a8e0 0x5575a726ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.995+0000 7f7ece0249c0 1 -- 172.21.15.62:0/1671162060 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5575a726d2e0 con 0x5575a726a8e0 2024-09-10T05:36:30.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.995+0000 7f7ecbb2a640 1 --2- 172.21.15.62:0/1671162060 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5575a726a8e0 0x5575a726ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.999+0000 7f7ecbb2a640 1 --2- 172.21.15.62:0/1671162060 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5575a726a8e0 0x5575a726ccd0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.999+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/1671162060 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7ebc02e070 con 0x5575a726a8e0 2024-09-10T05:36:30.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.999+0000 7f7ece0249c0 1 --2- 172.21.15.62:0/1671162060 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5575a726f0a0 0x5575a7271490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.999+0000 7f7ece0249c0 1 -- 172.21.15.62:0/1671162060 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5575a7271b60 con 0x5575a726f0a0 2024-09-10T05:36:30.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.999+0000 7f7ecb329640 1 --2- 172.21.15.62:0/1671162060 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5575a726f0a0 0x5575a7271490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.999+0000 7f7ecb329640 1 --2- 172.21.15.62:0/1671162060 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5575a726f0a0 0x5575a7271490 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.999+0000 7f7ecb329640 1 -- 172.21.15.62:0/1671162060 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7ec00a99a0 con 0x5575a726f0a0 2024-09-10T05:36:30.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.999+0000 7f7ece0249c0 1 -- 172.21.15.62:0/1671162060 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5575a726df70 con 0x5575a726a8e0 2024-09-10T05:36:30.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.999+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/1671162060 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7ebc02e070 con 0x5575a726a8e0 2024-09-10T05:36:30.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.999+0000 7f7ece0249c0 1 -- 172.21.15.62:0/1671162060 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5575a726e390 con 0x5575a726f0a0 2024-09-10T05:36:30.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.999+0000 7f7ecb329640 1 -- 172.21.15.62:0/1671162060 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7ec00a99a0 con 0x5575a726f0a0 2024-09-10T05:36:30.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.999+0000 7f7ece0249c0 1 Processor -- start 2024-09-10T05:36:30.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.999+0000 7f7ece0249c0 1 -- start start 2024-09-10T05:36:30.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.999+0000 7f7ece0249c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5575a7280130 0x5575a7280550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.999+0000 7f7ece0249c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5575a7082450 con 0x5575a7280130 2024-09-10T05:36:30.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.999+0000 7f7ecbb2a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5575a7280130 0x5575a7280550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.999+0000 7f7ecbb2a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5575a7280130 0x5575a7280550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:50960/0 (socket says 172.21.15.62:50960) 2024-09-10T05:36:30.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:29.999+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/542848477 learned_addr learned my addr 172.21.15.62:0/542848477 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:30.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.003+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/542848477 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575a7280b90 con 0x5575a7280130 2024-09-10T05:36:30.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.003+0000 7f7ecbb2a640 1 --2- 172.21.15.62:0/542848477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5575a7280130 0x5575a7280550 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc04f3f0 tx=0x7f7ebc027ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.003+0000 7f7db17fa640 1 -- 172.21.15.62:0/542848477 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ebc035070 con 0x5575a7280130 2024-09-10T05:36:30.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.003+0000 7f7db17fa640 1 -- 172.21.15.62:0/542848477 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ebc01b950 con 0x5575a7280130 2024-09-10T05:36:30.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.003+0000 7f7ece0249c0 1 -- 172.21.15.62:0/542848477 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5575a72813f0 con 0x5575a7280130 2024-09-10T05:36:30.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.003+0000 7f7db17fa640 1 -- 172.21.15.62:0/542848477 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ebc027560 con 0x5575a7280130 2024-09-10T05:36:30.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.003+0000 7f7ece0249c0 1 -- 172.21.15.62:0/542848477 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575a72813f0 con 0x5575a7280130 2024-09-10T05:36:30.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.003+0000 7f7db17fa640 1 -- 172.21.15.62:0/542848477 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f7ebc038070 con 0x5575a7280130 2024-09-10T05:36:30.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.003+0000 7f7db17fa640 1 --2- 172.21.15.62:0/542848477 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7da4039a70 0x7f7da403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.003+0000 7f7db17fa640 1 -- 172.21.15.62:0/542848477 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f7ebc03bb00 con 0x5575a7280130 2024-09-10T05:36:30.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.003+0000 7f7ecb329640 1 --2- 172.21.15.62:0/542848477 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7da4039a70 0x7f7da403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.003+0000 7f7ece0249c0 1 Processor -- start 2024-09-10T05:36:30.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.003+0000 7f7ece0249c0 1 -- start start 2024-09-10T05:36:30.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.003+0000 7f7ece0249c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5575a728c6b0 0x5575a728ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.003+0000 7f7ece0249c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5575a725b250 con 0x5575a728c6b0 2024-09-10T05:36:30.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.003+0000 7f7ecb329640 1 --2- 172.21.15.62:0/542848477 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7da4039a70 0x7f7da403bf30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x5575a726df40 tx=0x7f7ec0005ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.003+0000 7f7ecbb2a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5575a728c6b0 0x5575a728ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.003+0000 7f7ecbb2a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5575a728c6b0 0x5575a728ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:50966/0 (socket says 172.21.15.62:50966) 2024-09-10T05:36:30.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.003+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/3363432245 learned_addr learned my addr 172.21.15.62:0/3363432245 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:30.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.003+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/3363432245 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575a728d060 con 0x5575a728c6b0 2024-09-10T05:36:30.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.007+0000 7f7ecbb2a640 1 --2- 172.21.15.62:0/3363432245 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5575a728c6b0 0x5575a728ca90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc00ef70 tx=0x7f7ebc030ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7c9552b86cba0f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.007+0000 7f7daaffd640 1 -- 172.21.15.62:0/3363432245 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ebc05f070 con 0x5575a728c6b0 2024-09-10T05:36:30.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.007+0000 7f7daaffd640 1 -- 172.21.15.62:0/3363432245 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ebc04fe50 con 0x5575a728c6b0 2024-09-10T05:36:30.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.007+0000 7f7daaffd640 1 -- 172.21.15.62:0/3363432245 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ebc030960 con 0x5575a728c6b0 2024-09-10T05:36:30.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.007+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3363432245 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5575a728c6b0 msgr2=0x5575a728ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.007+0000 7f7ece0249c0 1 --2- 172.21.15.62:0/3363432245 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5575a728c6b0 0x5575a728ca90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc00ef70 tx=0x7f7ebc030ce0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.007+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3363432245 shutdown_connections 2024-09-10T05:36:30.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.007+0000 7f7ece0249c0 1 --2- 172.21.15.62:0/3363432245 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5575a728c6b0 0x5575a728ca90 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.007+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3363432245 >> 172.21.15.62:0/3363432245 conn(0x5575a7288ae0 msgr2=0x5575a7286d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:30.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.007+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3363432245 shutdown_connections 2024-09-10T05:36:30.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.007+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3363432245 wait complete. 2024-09-10T05:36:30.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.007+0000 7f7ece0249c0 1 Processor -- start 2024-09-10T05:36:30.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.007+0000 7f7ece0249c0 1 -- start start 2024-09-10T05:36:30.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.007+0000 7f7ece0249c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5575a728c6b0 0x5575a72939c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.007+0000 7f7ece0249c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5575a728d540 con 0x5575a728c6b0 2024-09-10T05:36:30.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.007+0000 7f7ecbb2a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5575a728c6b0 0x5575a72939c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.007+0000 7f7ecbb2a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5575a728c6b0 0x5575a72939c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:50982/0 (socket says 172.21.15.62:50982) 2024-09-10T05:36:30.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.007+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/3978708228 learned_addr learned my addr 172.21.15.62:0/3978708228 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:30.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.007+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575a7293f20 con 0x5575a728c6b0 2024-09-10T05:36:30.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.007+0000 7f7ecbb2a640 1 --2- 172.21.15.62:0/3978708228 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5575a728c6b0 0x5575a72939c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x5575a7287a70 tx=0x7f7ebc006f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.007+0000 7f7da97fa640 1 -- 172.21.15.62:0/3978708228 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ebc04fe50 con 0x5575a728c6b0 2024-09-10T05:36:30.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.007+0000 7f7da97fa640 1 -- 172.21.15.62:0/3978708228 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ebc073070 con 0x5575a728c6b0 2024-09-10T05:36:30.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.007+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5575a7293f20 con 0x5575a728c6b0 2024-09-10T05:36:30.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.007+0000 7f7da97fa640 1 -- 172.21.15.62:0/3978708228 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ebc042560 con 0x5575a728c6b0 2024-09-10T05:36:30.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.007+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575a72944f0 con 0x5575a728c6b0 2024-09-10T05:36:30.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.011+0000 7f7da97fa640 1 -- 172.21.15.62:0/3978708228 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f7ebc062070 con 0x5575a728c6b0 2024-09-10T05:36:30.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.011+0000 7f7da97fa640 1 --2- 172.21.15.62:0/3978708228 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7d94039bc0 0x7f7d9403c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.011+0000 7f7da97fa640 1 -- 172.21.15.62:0/3978708228 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f7ebc03e170 con 0x5575a728c6b0 2024-09-10T05:36:30.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.011+0000 7f7ece0249c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:30.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.011+0000 7f7ecb329640 1 --2- 172.21.15.62:0/3978708228 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7d94039bc0 0x7f7d9403c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.011+0000 7f7ece0249c0 1 --2- 172.21.15.62:0/3978708228 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5575a729e9d0 0x5575a72a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.011+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5575a72a15b0 con 0x5575a729e9d0 2024-09-10T05:36:30.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.011+0000 7f7ecc32b640 1 --2- 172.21.15.62:0/3978708228 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5575a729e9d0 0x5575a72a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.011+0000 7f7ecb329640 1 --2- 172.21.15.62:0/3978708228 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7d94039bc0 0x7f7d9403c080 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7ec001b410 tx=0x7f7ec00c1040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.011+0000 7f7ecc32b640 1 --2- 172.21.15.62:0/3978708228 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5575a729e9d0 0x5575a72a0e60 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.011+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7ec400a4d0 con 0x5575a729e9d0 2024-09-10T05:36:30.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.011+0000 7f7ece0249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:30.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.011+0000 7f7ece0249c0 20 realm 2024-09-10T05:36:30.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.011+0000 7f7ece0249c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:30.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.011+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5575a729dd60 con 0x5575a729e9d0 2024-09-10T05:36:30.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.011+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7ec400a4d0 con 0x5575a729e9d0 2024-09-10T05:36:30.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.011+0000 7f7ece0249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:30.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.011+0000 7f7ece0249c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:30.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.011+0000 7f7ece0249c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:30.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.011+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5575a72a2070 con 0x5575a729e9d0 2024-09-10T05:36:30.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.011+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7ec400a4d0 con 0x5575a729e9d0 2024-09-10T05:36:30.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.011+0000 7f7ece0249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:30.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.011+0000 7f7ece0249c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:30.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.011+0000 7f7ece0249c0 1 --2- 172.21.15.62:0/3978708228 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5575a72a2e50 0x5575a72a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.011+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5575a72a5910 con 0x5575a72a2e50 2024-09-10T05:36:30.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.011+0000 7f7ecbb2a640 1 --2- 172.21.15.62:0/3978708228 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5575a72a2e50 0x5575a72a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.011+0000 7f7ecbb2a640 1 --2- 172.21.15.62:0/3978708228 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5575a72a2e50 0x5575a72a5240 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.011+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/3978708228 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7ebc061030 con 0x5575a72a2e50 2024-09-10T05:36:30.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.011+0000 7f7ece0249c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:30.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.011+0000 7f7ece0249c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:30.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.011+0000 7f7ece0249c0 1 --2- 172.21.15.62:0/3978708228 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5575a72a6670 0x5575a72a8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.011+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5575a72a91d0 con 0x5575a72a6670 2024-09-10T05:36:30.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.011+0000 7f7ecb329640 1 --2- 172.21.15.62:0/3978708228 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5575a72a6670 0x5575a72a8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.011+0000 7f7ecb329640 1 --2- 172.21.15.62:0/3978708228 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5575a72a6670 0x5575a72a8a60 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.015+0000 7f7ecb329640 1 -- 172.21.15.62:0/3978708228 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7ec00a99a0 con 0x5575a72a6670 2024-09-10T05:36:30.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.015+0000 7f7ece0249c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:30.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.015+0000 7f7ece0249c0 20 searching for the correct realm 2024-09-10T05:36:30.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.015+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5575a72aaaa0 con 0x5575a72a6670 2024-09-10T05:36:30.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.015+0000 7f7ecb329640 1 -- 172.21.15.62:0/3978708228 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ec00a99a0 con 0x5575a72a6670 2024-09-10T05:36:30.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.015+0000 7f7ecb329640 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5575a72aaaa0 con 0x5575a72a2e50 2024-09-10T05:36:30.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.015+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/3978708228 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ebc061030 con 0x5575a72a2e50 2024-09-10T05:36:30.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.015+0000 7f7ecbb2a640 1 --2- 172.21.15.62:0/3978708228 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f7ebc064070 0x7f7ebc03b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.015+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5575a72aaaa0 con 0x7f7ebc064070 2024-09-10T05:36:30.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.015+0000 7f7ecc32b640 1 --2- 172.21.15.62:0/3978708228 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f7ebc064070 0x7f7ebc03b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.015+0000 7f7ecc32b640 1 --2- 172.21.15.62:0/3978708228 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f7ebc064070 0x7f7ebc03b3e0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.015+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ec400a4d0 con 0x7f7ebc064070 2024-09-10T05:36:30.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.015+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5575a72aaaa0 con 0x5575a729e9d0 2024-09-10T05:36:30.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.015+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ec400a4d0 con 0x5575a729e9d0 2024-09-10T05:36:30.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.015+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5575a72aaaa0 con 0x5575a729e9d0 2024-09-10T05:36:30.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.015+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ec400a4d0 con 0x5575a729e9d0 2024-09-10T05:36:30.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.015+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5575a72aaaa0 con 0x5575a72a6670 2024-09-10T05:36:30.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.015+0000 7f7ecb329640 1 -- 172.21.15.62:0/3978708228 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ec00a99a0 con 0x5575a72a6670 2024-09-10T05:36:30.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.015+0000 7f7ecb329640 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5575a72aaaa0 con 0x5575a729e9d0 2024-09-10T05:36:30.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.015+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ec400a4d0 con 0x5575a729e9d0 2024-09-10T05:36:30.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.015+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5575a72aaaa0 con 0x5575a72a2e50 2024-09-10T05:36:30.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.015+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/3978708228 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ebc061030 con 0x5575a72a2e50 2024-09-10T05:36:30.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.015+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5575a72aaaa0 con 0x5575a72a2e50 2024-09-10T05:36:30.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.015+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/3978708228 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ebc061030 con 0x5575a72a2e50 2024-09-10T05:36:30.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.015+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5575a72aaaa0 con 0x5575a729e9d0 2024-09-10T05:36:30.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.019+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ec400a4d0 con 0x5575a729e9d0 2024-09-10T05:36:30.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.019+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5575a72aaaa0 con 0x7f7ebc064070 2024-09-10T05:36:30.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.019+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ec400a4d0 con 0x7f7ebc064070 2024-09-10T05:36:30.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.019+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5575a72aaaa0 con 0x5575a729e9d0 2024-09-10T05:36:30.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.019+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ec400a4d0 con 0x5575a729e9d0 2024-09-10T05:36:30.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.019+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5575a72aaaa0 con 0x7f7ebc064070 2024-09-10T05:36:30.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.019+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7ec400a4d0 con 0x7f7ebc064070 2024-09-10T05:36:30.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.019+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5575a72aaaa0 con 0x5575a72a2e50 2024-09-10T05:36:30.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.019+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/3978708228 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ebc061030 con 0x5575a72a2e50 2024-09-10T05:36:30.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.019+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5575a72aaaa0 con 0x5575a72a6670 2024-09-10T05:36:30.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.019+0000 7f7ecb329640 1 -- 172.21.15.62:0/3978708228 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ec00a99a0 con 0x5575a72a6670 2024-09-10T05:36:30.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.019+0000 7f7ecb329640 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5575a72aaaa0 con 0x5575a729e9d0 2024-09-10T05:36:30.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.019+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ec400a4d0 con 0x5575a729e9d0 2024-09-10T05:36:30.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.019+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5575a72aaaa0 con 0x5575a72a2e50 2024-09-10T05:36:30.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.019+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/3978708228 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ebc061030 con 0x5575a72a2e50 2024-09-10T05:36:30.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.019+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5575a72aaaa0 con 0x5575a72a6670 2024-09-10T05:36:30.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.019+0000 7f7ecb329640 1 -- 172.21.15.62:0/3978708228 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 30 out=170b] v23'2 uv2 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f7ec00a99a0 con 0x5575a72a6670 2024-09-10T05:36:30.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.019+0000 7f7ecb329640 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5575a72aaaa0 con 0x5575a729e9d0 2024-09-10T05:36:30.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.019+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ec400a4d0 con 0x5575a729e9d0 2024-09-10T05:36:30.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.019+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5575a72aaaa0 con 0x5575a729e9d0 2024-09-10T05:36:30.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.019+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7ec400a4d0 con 0x5575a729e9d0 2024-09-10T05:36:30.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.019+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5575a72aaaa0 con 0x5575a729e9d0 2024-09-10T05:36:30.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.019+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ec400a4d0 con 0x5575a729e9d0 2024-09-10T05:36:30.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.019+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5575a72aaaa0 con 0x5575a72a6670 2024-09-10T05:36:30.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.023+0000 7f7ecb329640 1 -- 172.21.15.62:0/3978708228 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ec00a99a0 con 0x5575a72a6670 2024-09-10T05:36:30.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.023+0000 7f7ecb329640 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5575a72aaaa0 con 0x7f7ebc064070 2024-09-10T05:36:30.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.023+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ec400a4d0 con 0x7f7ebc064070 2024-09-10T05:36:30.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.023+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5575a72aaaa0 con 0x5575a729e9d0 2024-09-10T05:36:30.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.023+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ec400a4d0 con 0x5575a729e9d0 2024-09-10T05:36:30.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.023+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5575a72aaaa0 con 0x7f7ebc064070 2024-09-10T05:36:30.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.023+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ec400a4d0 con 0x7f7ebc064070 2024-09-10T05:36:30.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.023+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5575a72aaaa0 con 0x5575a72a6670 2024-09-10T05:36:30.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.023+0000 7f7ecb329640 1 -- 172.21.15.62:0/3978708228 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ec00a99a0 con 0x5575a72a6670 2024-09-10T05:36:30.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.023+0000 7f7ecb329640 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5575a72aaaa0 con 0x7f7ebc064070 2024-09-10T05:36:30.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.023+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ec400a4d0 con 0x7f7ebc064070 2024-09-10T05:36:30.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.023+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5575a72aaaa0 con 0x5575a72a2e50 2024-09-10T05:36:30.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.023+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/3978708228 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ebc061030 con 0x5575a72a2e50 2024-09-10T05:36:30.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.023+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5575a72aaaa0 con 0x5575a72a2e50 2024-09-10T05:36:30.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.023+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/3978708228 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ebc061030 con 0x5575a72a2e50 2024-09-10T05:36:30.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.023+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5575a72aaaa0 con 0x5575a72a6670 2024-09-10T05:36:30.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.023+0000 7f7ecb329640 1 -- 172.21.15.62:0/3978708228 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ec00a99a0 con 0x5575a72a6670 2024-09-10T05:36:30.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.023+0000 7f7ecb329640 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5575a72aaaa0 con 0x5575a72a2e50 2024-09-10T05:36:30.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.023+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/3978708228 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7ebc061030 con 0x5575a72a2e50 2024-09-10T05:36:30.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.023+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5575a72aaaa0 con 0x5575a72a2e50 2024-09-10T05:36:30.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.027+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/3978708228 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ebc061030 con 0x5575a72a2e50 2024-09-10T05:36:30.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.027+0000 7f7ece0249c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:30.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.027+0000 7f7ece0249c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:30.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.027+0000 7f7ece0249c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:30.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.027+0000 7f7ece0249c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:30.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.027+0000 7f7ece0249c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:30.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.027+0000 7f7ece0249c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:30.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.027+0000 7f7ece0249c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:30.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.027+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5575a72a9b90 con 0x5575a729e9d0 2024-09-10T05:36:30.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.027+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7ec400a4d0 con 0x5575a729e9d0 2024-09-10T05:36:30.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.027+0000 7f7ece0249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:30.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.027+0000 7f7ece0249c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:30.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.027+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5575a72a97d0 con 0x5575a72a2e50 2024-09-10T05:36:30.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.027+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/3978708228 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7ebc061030 con 0x5575a72a2e50 2024-09-10T05:36:30.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.027+0000 7f7ece0249c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:30.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.027+0000 7f7ece0249c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:30.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.027+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5575a72aa530 con 0x5575a72a6670 2024-09-10T05:36:30.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.027+0000 7f7ecb329640 1 -- 172.21.15.62:0/3978708228 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7ec00a99a0 con 0x5575a72a6670 2024-09-10T05:36:30.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.027+0000 7f7ece0249c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:30.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.027+0000 7f7ece0249c0 20 zone default found 2024-09-10T05:36:30.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.027+0000 7f7ece0249c0 4 Realm: () 2024-09-10T05:36:30.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.027+0000 7f7ece0249c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:30.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.027+0000 7f7ece0249c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:30.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.027+0000 7f7ece0249c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:30.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.027+0000 7f7ece0249c0 20 zonegroup default 2024-09-10T05:36:30.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.027+0000 7f7ece0249c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:30.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.027+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5575a72ab380 con 0x7f7ebc064070 2024-09-10T05:36:30.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.027+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7ec400a4d0 con 0x7f7ebc064070 2024-09-10T05:36:30.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.027+0000 7f7ece0249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:30.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.027+0000 7f7ece0249c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:30.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.027+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5575a72ad5c0 con 0x5575a72a6670 2024-09-10T05:36:30.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.027+0000 7f7ecb329640 1 -- 172.21.15.62:0/3978708228 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7ec00a99a0 con 0x5575a72a6670 2024-09-10T05:36:30.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.027+0000 7f7ece0249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:30.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.027+0000 7f7ece0249c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:30.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.027+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5575a72ad960 con 0x5575a72a6670 2024-09-10T05:36:30.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.027+0000 7f7ecb329640 1 -- 172.21.15.62:0/3978708228 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7ec00a99a0 con 0x5575a72a6670 2024-09-10T05:36:30.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.027+0000 7f7ece0249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:30.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.027+0000 7f7ece0249c0 20 started sync module instance, tier type = 2024-09-10T05:36:30.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.027+0000 7f7ece0249c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:30.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.027+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72aca00 con 0x5575a72a2e50 2024-09-10T05:36:30.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.031+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/3978708228 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ebc061030 con 0x5575a72a2e50 2024-09-10T05:36:30.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.031+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93963804134816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72ad1c0 con 0x5575a72a2e50 2024-09-10T05:36:30.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.031+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72ae660 con 0x5575a729e9d0 2024-09-10T05:36:30.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.031+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ec400a4d0 con 0x5575a729e9d0 2024-09-10T05:36:30.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.031+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93963804142160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72af320 con 0x5575a729e9d0 2024-09-10T05:36:30.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.031+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72afce0 con 0x5575a72a2e50 2024-09-10T05:36:30.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.031+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/3978708228 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 93963804134816] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ebc061030 con 0x5575a72a2e50 2024-09-10T05:36:30.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.035+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93963804142160] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ec400a4d0 con 0x5575a729e9d0 2024-09-10T05:36:30.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.035+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/3978708228 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ebc061030 con 0x5575a72a2e50 2024-09-10T05:36:30.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.035+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93963804143216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72af290 con 0x5575a72a2e50 2024-09-10T05:36:30.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.035+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72b0190 con 0x7f7ebc064070 2024-09-10T05:36:30.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.039+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ec400a4d0 con 0x7f7ebc064070 2024-09-10T05:36:30.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.039+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93963804146912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72b0100 con 0x7f7ebc064070 2024-09-10T05:36:30.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.039+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72b1080 con 0x5575a72a2e50 2024-09-10T05:36:30.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.039+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/3978708228 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93963804143216] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ebc061030 con 0x5575a72a2e50 2024-09-10T05:36:30.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.039+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93963804146912] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ec400a4d0 con 0x7f7ebc064070 2024-09-10T05:36:30.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.043+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/3978708228 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ebc061030 con 0x5575a72a2e50 2024-09-10T05:36:30.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.043+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93963804149168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72b0bd0 con 0x5575a72a2e50 2024-09-10T05:36:30.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.043+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72b1920 con 0x5575a72a6670 2024-09-10T05:36:30.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.043+0000 7f7ecb329640 1 -- 172.21.15.62:0/3978708228 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ec00a99a0 con 0x5575a72a6670 2024-09-10T05:36:30.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.043+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93963804152944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72b0bd0 con 0x5575a72a6670 2024-09-10T05:36:30.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.043+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72b2360 con 0x5575a72a6670 2024-09-10T05:36:30.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.043+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/3978708228 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 93963804149168] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ebc061030 con 0x5575a72a2e50 2024-09-10T05:36:30.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.043+0000 7f7ecb329640 1 -- 172.21.15.62:0/3978708228 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93963804152944] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ec00a99a0 con 0x5575a72a6670 2024-09-10T05:36:30.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.043+0000 7f7ecb329640 1 -- 172.21.15.62:0/3978708228 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ec00a99a0 con 0x5575a72a6670 2024-09-10T05:36:30.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.043+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93963804154000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72b1eb0 con 0x5575a72a6670 2024-09-10T05:36:30.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.043+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72b2870 con 0x7f7ebc064070 2024-09-10T05:36:30.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.047+0000 7f7ecb329640 1 -- 172.21.15.62:0/3978708228 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93963804154000] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ec00a99a0 con 0x5575a72a6670 2024-09-10T05:36:30.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.047+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ec400a4d0 con 0x7f7ebc064070 2024-09-10T05:36:30.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.047+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93963804145712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72b2870 con 0x7f7ebc064070 2024-09-10T05:36:30.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.047+0000 7f7ece0249c0 20 add_watcher() i=0 2024-09-10T05:36:30.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.047+0000 7f7ece0249c0 20 add_watcher() i=1 2024-09-10T05:36:30.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.047+0000 7f7ece0249c0 20 add_watcher() i=2 2024-09-10T05:36:30.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.047+0000 7f7ece0249c0 20 add_watcher() i=3 2024-09-10T05:36:30.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.047+0000 7f7ece0249c0 20 add_watcher() i=4 2024-09-10T05:36:30.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.047+0000 7f7ece0249c0 20 add_watcher() i=5 2024-09-10T05:36:30.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.047+0000 7f7ece0249c0 20 add_watcher() i=6 2024-09-10T05:36:30.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.047+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93963804145712] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ec400a4d0 con 0x7f7ebc064070 2024-09-10T05:36:30.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.047+0000 7f7ece0249c0 20 add_watcher() i=7 2024-09-10T05:36:30.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.047+0000 7f7ece0249c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:30.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.047+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5575a72b5bf0 con 0x5575a729e9d0 2024-09-10T05:36:30.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.047+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7ec400a4d0 con 0x5575a729e9d0 2024-09-10T05:36:30.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.047+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93963804157232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72b2e00 con 0x5575a729e9d0 2024-09-10T05:36:30.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.047+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93963804157232] v30'47 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7ec400a4d0 con 0x5575a729e9d0 2024-09-10T05:36:30.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.047+0000 7f7d81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:30.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.047+0000 7f7ece0249c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:30.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.047+0000 7f7ece0249c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:30.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.051+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72be4c0 con 0x5575a72a2e50 2024-09-10T05:36:30.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.051+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/3978708228 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'43 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7ebc061030 con 0x5575a72a2e50 2024-09-10T05:36:30.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.051+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72be5e0 con 0x7f7ebc064070 2024-09-10T05:36:30.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.051+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7ec400a4d0 con 0x7f7ebc064070 2024-09-10T05:36:30.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.051+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72becc0 con 0x5575a72a6670 2024-09-10T05:36:30.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.055+0000 7f7ecb329640 1 -- 172.21.15.62:0/3978708228 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7ec00a99a0 con 0x5575a72a6670 2024-09-10T05:36:30.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.055+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72bf170 con 0x5575a729e9d0 2024-09-10T05:36:30.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.055+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'48 uv12 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7ec400a4d0 con 0x5575a729e9d0 2024-09-10T05:36:30.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.055+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72bc410 con 0x5575a72a2e50 2024-09-10T05:36:30.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.059+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/3978708228 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'35 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7ebc061030 con 0x5575a72a2e50 2024-09-10T05:36:30.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.059+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72bc410 con 0x5575a72a6670 2024-09-10T05:36:30.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.059+0000 7f7ecb329640 1 -- 172.21.15.62:0/3978708228 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'31 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7ec00a99a0 con 0x5575a72a6670 2024-09-10T05:36:30.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.059+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72bc410 con 0x5575a72a2e50 2024-09-10T05:36:30.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.063+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/3978708228 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7ebc061030 con 0x5575a72a2e50 2024-09-10T05:36:30.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.063+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72bfcd0 con 0x5575a729e9d0 2024-09-10T05:36:30.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.063+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'25 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7ec400a4d0 con 0x5575a729e9d0 2024-09-10T05:36:30.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.063+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72bfd60 con 0x5575a72a2e50 2024-09-10T05:36:30.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.067+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/3978708228 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7ebc061030 con 0x5575a72a2e50 2024-09-10T05:36:30.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.067+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72bfd60 con 0x5575a72a2e50 2024-09-10T05:36:30.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.067+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/3978708228 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'19 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7ebc061030 con 0x5575a72a2e50 2024-09-10T05:36:30.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.067+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72bff30 con 0x5575a72a2e50 2024-09-10T05:36:30.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.071+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/3978708228 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'36 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ebc061030 con 0x5575a72a2e50 2024-09-10T05:36:30.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.071+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72bff30 con 0x5575a72a6670 2024-09-10T05:36:30.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.071+0000 7f7ecb329640 1 -- 172.21.15.62:0/3978708228 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ec00a99a0 con 0x5575a72a6670 2024-09-10T05:36:30.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.071+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72c03b0 con 0x5575a72a2e50 2024-09-10T05:36:30.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.075+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/3978708228 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ebc061030 con 0x5575a72a2e50 2024-09-10T05:36:30.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.075+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72c0370 con 0x5575a729e9d0 2024-09-10T05:36:30.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.075+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'37 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ec400a4d0 con 0x5575a729e9d0 2024-09-10T05:36:30.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.075+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72c05b0 con 0x5575a729e9d0 2024-09-10T05:36:30.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.079+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'49 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ec400a4d0 con 0x5575a729e9d0 2024-09-10T05:36:30.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.079+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72c05b0 con 0x5575a72a2e50 2024-09-10T05:36:30.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.079+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/3978708228 <== osd.0 v2:172.21.15.2:6800/945139080 25 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'30 uv16 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ebc061030 con 0x5575a72a2e50 2024-09-10T05:36:30.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.079+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72c03e0 con 0x5575a72a2e50 2024-09-10T05:36:30.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.083+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/3978708228 <== osd.0 v2:172.21.15.2:6800/945139080 26 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'37 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ebc061030 con 0x5575a72a2e50 2024-09-10T05:36:30.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.083+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72c03e0 con 0x5575a72a6670 2024-09-10T05:36:30.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.083+0000 7f7ecb329640 1 -- 172.21.15.62:0/3978708228 <== osd.3 v2:172.21.15.62:6816/2708991149 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'25 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ec00a99a0 con 0x5575a72a6670 2024-09-10T05:36:30.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.083+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72c0530 con 0x5575a72a2e50 2024-09-10T05:36:30.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.087+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/3978708228 <== osd.0 v2:172.21.15.2:6800/945139080 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ebc061030 con 0x5575a72a2e50 2024-09-10T05:36:30.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.087+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72c0530 con 0x5575a729e9d0 2024-09-10T05:36:30.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.087+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 <== osd.1 v2:172.21.15.62:6808/3442097179 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'50 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ec400a4d0 con 0x5575a729e9d0 2024-09-10T05:36:30.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.087+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72c09e0 con 0x5575a72a2e50 2024-09-10T05:36:30.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.091+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/3978708228 <== osd.0 v2:172.21.15.2:6800/945139080 28 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'31 uv18 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ebc061030 con 0x5575a72a2e50 2024-09-10T05:36:30.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.091+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72c09e0 con 0x5575a72a2e50 2024-09-10T05:36:30.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.091+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/3978708228 <== osd.0 v2:172.21.15.2:6800/945139080 29 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'29 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ebc061030 con 0x5575a72a2e50 2024-09-10T05:36:30.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.091+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72c09e0 con 0x5575a72a6670 2024-09-10T05:36:30.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.095+0000 7f7ecb329640 1 -- 172.21.15.62:0/3978708228 <== osd.3 v2:172.21.15.62:6816/2708991149 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ec00a99a0 con 0x5575a72a6670 2024-09-10T05:36:30.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.095+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72c09e0 con 0x5575a72a2e50 2024-09-10T05:36:30.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.095+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/3978708228 <== osd.0 v2:172.21.15.2:6800/945139080 30 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'31 uv18 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ebc061030 con 0x5575a72a2e50 2024-09-10T05:36:30.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.095+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72c09e0 con 0x5575a72a6670 2024-09-10T05:36:30.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.099+0000 7f7ecb329640 1 -- 172.21.15.62:0/3978708228 <== osd.3 v2:172.21.15.62:6816/2708991149 21 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'15 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ec00a99a0 con 0x5575a72a6670 2024-09-10T05:36:30.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.099+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72c09e0 con 0x5575a72a6670 2024-09-10T05:36:30.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.099+0000 7f7ecb329640 1 -- 172.21.15.62:0/3978708228 <== osd.3 v2:172.21.15.62:6816/2708991149 22 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'32 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ec00a99a0 con 0x5575a72a6670 2024-09-10T05:36:30.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.099+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72c09e0 con 0x5575a72a6670 2024-09-10T05:36:30.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.099+0000 7f7ecb329640 1 -- 172.21.15.62:0/3978708228 <== osd.3 v2:172.21.15.62:6816/2708991149 23 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'21 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ec00a99a0 con 0x5575a72a6670 2024-09-10T05:36:30.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.099+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72c09e0 con 0x5575a72a2e50 2024-09-10T05:36:30.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.103+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/3978708228 <== osd.0 v2:172.21.15.2:6800/945139080 31 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'25 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ebc061030 con 0x5575a72a2e50 2024-09-10T05:36:30.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.103+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72c09e0 con 0x5575a729e9d0 2024-09-10T05:36:30.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.103+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 <== osd.1 v2:172.21.15.62:6808/3442097179 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'26 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ec400a4d0 con 0x5575a729e9d0 2024-09-10T05:36:30.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.103+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72c09e0 con 0x5575a72a2e50 2024-09-10T05:36:30.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.107+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/3978708228 <== osd.0 v2:172.21.15.2:6800/945139080 32 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'32 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ebc061030 con 0x5575a72a2e50 2024-09-10T05:36:30.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.107+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72c09e0 con 0x5575a729e9d0 2024-09-10T05:36:30.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.111+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 <== osd.1 v2:172.21.15.62:6808/3442097179 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'38 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ec400a4d0 con 0x5575a729e9d0 2024-09-10T05:36:30.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.111+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72c09e0 con 0x7f7ebc064070 2024-09-10T05:36:30.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.111+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ec400a4d0 con 0x7f7ebc064070 2024-09-10T05:36:30.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.111+0000 7f7d80fe1640 20 reqs_thread_entry: start 2024-09-10T05:36:30.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.111+0000 7f7ece0249c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:30.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.111+0000 7f7ece0249c0 20 Filter name: none 2024-09-10T05:36:30.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.111+0000 7f7cfa7fc640 20 reqs_thread_entry: start 2024-09-10T05:36:30.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.111+0000 7f7ece0249c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T05:36:30.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.111+0000 7f7ece0249c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:30.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.111+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5575a72db8f0 con 0x5575a729e9d0 2024-09-10T05:36:30.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.111+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 <== osd.1 v2:172.21.15.62:6808/3442097179 26 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f7ec400a4d0 con 0x5575a729e9d0 2024-09-10T05:36:30.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.111+0000 7f7ece0249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:30.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.111+0000 7f7ece0249c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-10T05:36:30.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.111+0000 7f7ece0249c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:36:30.116 INFO:teuthology.orchestra.run.smithi062.stderr:could not remove user: unable to remove user, user does not exist 2024-09-10T05:36:30.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.115+0000 7f7d81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:30.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.115+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93963804157232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a7298f40 con 0x5575a729e9d0 2024-09-10T05:36:30.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.115+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 <== osd.1 v2:172.21.15.62:6808/3442097179 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 93963804157232] v30'51 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7ec400a4d0 con 0x5575a729e9d0 2024-09-10T05:36:30.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.115+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93963804134816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72b2530 con 0x5575a72a2e50 2024-09-10T05:36:30.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.119+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/3978708228 <== osd.0 v2:172.21.15.2:6800/945139080 33 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 93963804134816] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ebc061030 con 0x5575a72a2e50 2024-09-10T05:36:30.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.119+0000 7f7ece0249c0 20 remove_watcher() i=0 2024-09-10T05:36:30.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.119+0000 7f7ece0249c0 2 removed watcher, disabling cache 2024-09-10T05:36:30.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.119+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93963804142160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72b2530 con 0x5575a729e9d0 2024-09-10T05:36:30.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.119+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 <== osd.1 v2:172.21.15.62:6808/3442097179 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 93963804142160] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ec400a4d0 con 0x5575a729e9d0 2024-09-10T05:36:30.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.119+0000 7f7ece0249c0 20 remove_watcher() i=1 2024-09-10T05:36:30.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.119+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93963804143216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72aea50 con 0x5575a72a2e50 2024-09-10T05:36:30.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.123+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/3978708228 <== osd.0 v2:172.21.15.2:6800/945139080 34 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 93963804143216] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ebc061030 con 0x5575a72a2e50 2024-09-10T05:36:30.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.123+0000 7f7ece0249c0 20 remove_watcher() i=2 2024-09-10T05:36:30.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.123+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93963804146912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72b2530 con 0x7f7ebc064070 2024-09-10T05:36:30.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.123+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 93963804146912] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ec400a4d0 con 0x7f7ebc064070 2024-09-10T05:36:30.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.123+0000 7f7ece0249c0 20 remove_watcher() i=3 2024-09-10T05:36:30.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.123+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93963804149168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72afce0 con 0x5575a72a2e50 2024-09-10T05:36:30.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.123+0000 7f7ecbb2a640 1 -- 172.21.15.62:0/3978708228 <== osd.0 v2:172.21.15.2:6800/945139080 35 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 93963804149168] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ebc061030 con 0x5575a72a2e50 2024-09-10T05:36:30.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.123+0000 7f7ece0249c0 20 remove_watcher() i=4 2024-09-10T05:36:30.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.123+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93963804152944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72b2530 con 0x5575a72a6670 2024-09-10T05:36:30.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.127+0000 7f7ecb329640 1 -- 172.21.15.62:0/3978708228 <== osd.3 v2:172.21.15.62:6816/2708991149 24 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 93963804152944] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ec00a99a0 con 0x5575a72a6670 2024-09-10T05:36:30.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.127+0000 7f7ece0249c0 20 remove_watcher() i=5 2024-09-10T05:36:30.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.127+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93963804154000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72b05b0 con 0x5575a72a6670 2024-09-10T05:36:30.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.127+0000 7f7ecb329640 1 -- 172.21.15.62:0/3978708228 <== osd.3 v2:172.21.15.62:6816/2708991149 25 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 93963804154000] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ec00a99a0 con 0x5575a72a6670 2024-09-10T05:36:30.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.127+0000 7f7ece0249c0 20 remove_watcher() i=6 2024-09-10T05:36:30.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.127+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93963804145712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5575a72afce0 con 0x7f7ebc064070 2024-09-10T05:36:30.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.131+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 <== osd.2 v2:172.21.15.62:6800/2677868286 15 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 93963804145712] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ec400a4d0 con 0x7f7ebc064070 2024-09-10T05:36:30.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.131+0000 7f7ece0249c0 20 remove_watcher() i=7 2024-09-10T05:36:30.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.131+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5575a72a2e50 msgr2=0x5575a72a5240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.131+0000 7f7ece0249c0 1 --2- 172.21.15.62:0/3978708228 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5575a72a2e50 0x5575a72a5240 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.131+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5575a729e9d0 msgr2=0x5575a72a0e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.131+0000 7f7ece0249c0 1 --2- 172.21.15.62:0/3978708228 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5575a729e9d0 0x5575a72a0e60 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.131+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f7ebc064070 msgr2=0x7f7ebc03b3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.131+0000 7f7ece0249c0 1 --2- 172.21.15.62:0/3978708228 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f7ebc064070 0x7f7ebc03b3e0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.131+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5575a72a6670 msgr2=0x5575a72a8a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.131+0000 7f7ece0249c0 1 --2- 172.21.15.62:0/3978708228 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5575a72a6670 0x5575a72a8a60 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.131+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7d94039bc0 msgr2=0x7f7d9403c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.131+0000 7f7ece0249c0 1 --2- 172.21.15.62:0/3978708228 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7d94039bc0 0x7f7d9403c080 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7ec001b410 tx=0x7f7ec00c1040 comp rx=0 tx=0).stop 2024-09-10T05:36:30.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.131+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5575a728c6b0 msgr2=0x5575a72939c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.131+0000 7f7ece0249c0 1 --2- 172.21.15.62:0/3978708228 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5575a728c6b0 0x5575a72939c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x5575a7287a70 tx=0x7f7ebc006f10 comp rx=0 tx=0).stop 2024-09-10T05:36:30.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.131+0000 7f7ecc32b640 1 -- 172.21.15.62:0/3978708228 reap_dead start 2024-09-10T05:36:30.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.131+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 shutdown_connections 2024-09-10T05:36:30.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.131+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 >> 172.21.15.62:0/3978708228 conn(0x5575a7288ae0 msgr2=0x5575a7286cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:30.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.131+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 shutdown_connections 2024-09-10T05:36:30.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.131+0000 7f7ece0249c0 1 -- 172.21.15.62:0/3978708228 wait complete. 2024-09-10T05:36:30.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.131+0000 7f7ece0249c0 1 -- 172.21.15.62:0/542848477 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7da4039a70 msgr2=0x7f7da403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.131+0000 7f7ece0249c0 1 --2- 172.21.15.62:0/542848477 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7da4039a70 0x7f7da403bf30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x5575a726df40 tx=0x7f7ec0005ad0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.131+0000 7f7ece0249c0 1 -- 172.21.15.62:0/542848477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5575a7280130 msgr2=0x5575a7280550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.131+0000 7f7ece0249c0 1 --2- 172.21.15.62:0/542848477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5575a7280130 0x5575a7280550 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc04f3f0 tx=0x7f7ebc027ee0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.131+0000 7f7ece0249c0 1 -- 172.21.15.62:0/542848477 shutdown_connections 2024-09-10T05:36:30.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.131+0000 7f7ece0249c0 1 --2- 172.21.15.62:0/542848477 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7da4039a70 0x7f7da403bf30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.131+0000 7f7ece0249c0 1 --2- 172.21.15.62:0/542848477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5575a7280130 0x5575a7280550 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.131+0000 7f7ece0249c0 1 -- 172.21.15.62:0/542848477 >> 172.21.15.62:0/542848477 conn(0x5575a7275ae0 msgr2=0x5575a7275ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:30.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.131+0000 7f7ece0249c0 1 -- 172.21.15.62:0/542848477 shutdown_connections 2024-09-10T05:36:30.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.135+0000 7f7ece0249c0 1 -- 172.21.15.62:0/542848477 wait complete. 2024-09-10T05:36:30.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.135+0000 7f7ece0249c0 1 -- 172.21.15.62:0/1671162060 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5575a726a8e0 msgr2=0x5575a726ccd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.135+0000 7f7ece0249c0 1 --2- 172.21.15.62:0/1671162060 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5575a726a8e0 0x5575a726ccd0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.135+0000 7f7ece0249c0 1 -- 172.21.15.62:0/1671162060 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5575a7267200 msgr2=0x5575a72695f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.135+0000 7f7ece0249c0 1 --2- 172.21.15.62:0/1671162060 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5575a7267200 0x5575a72695f0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.135+0000 7f7ece0249c0 1 -- 172.21.15.62:0/1671162060 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5575a726f0a0 msgr2=0x5575a7271490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.135+0000 7f7ece0249c0 1 --2- 172.21.15.62:0/1671162060 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5575a726f0a0 0x5575a7271490 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.135+0000 7f7ece0249c0 1 -- 172.21.15.62:0/1671162060 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7db4039a70 msgr2=0x7f7db403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.135+0000 7f7ece0249c0 1 --2- 172.21.15.62:0/1671162060 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7db4039a70 0x7f7db403bf30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7ec00ad000 tx=0x7f7ec00a6000 comp rx=0 tx=0).stop 2024-09-10T05:36:30.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.135+0000 7f7ece0249c0 1 -- 172.21.15.62:0/1671162060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5575a716f200 msgr2=0x5575a72620a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.135+0000 7f7ece0249c0 1 --2- 172.21.15.62:0/1671162060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5575a716f200 0x5575a72620a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x5575a725b990 tx=0x7f7ebc000bd0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.135+0000 7f7ecc32b640 1 -- 172.21.15.62:0/1671162060 reap_dead start 2024-09-10T05:36:30.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.135+0000 7f7ece0249c0 1 -- 172.21.15.62:0/1671162060 shutdown_connections 2024-09-10T05:36:30.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.135+0000 7f7ece0249c0 1 -- 172.21.15.62:0/1671162060 >> 172.21.15.62:0/1671162060 conn(0x5575a70e2b10 msgr2=0x5575a7255030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:30.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.135+0000 7f7ece0249c0 1 -- 172.21.15.62:0/1671162060 shutdown_connections 2024-09-10T05:36:30.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.135+0000 7f7ece0249c0 1 -- 172.21.15.62:0/1671162060 wait complete. 2024-09-10T05:36:30.147 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-10T05:36:30.147 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-10T05:36:30.147 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-10T05:36:30.147 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-10T05:36:30.227 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:30.227 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:30.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.223+0000 7f26072a59c0 1 Processor -- start 2024-09-10T05:36:30.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.223+0000 7f26072a59c0 1 -- start start 2024-09-10T05:36:30.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.223+0000 7f26072a59c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x563ebe0f42d0 0x563ebe185090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.223+0000 7f26072a59c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563ebe0349c0 con 0x563ebe0f46b0 2024-09-10T05:36:30.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.223+0000 7f26072a59c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x563ebe0846d0 con 0x563ebe0f42d0 2024-09-10T05:36:30.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.227+0000 7f2604dab640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x563ebe0f42d0 0x563ebe185090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.227+0000 7f2604dab640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x563ebe0f42d0 0x563ebe185090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:50998/0 (socket says 172.21.15.62:50998) 2024-09-10T05:36:30.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.227+0000 7f2604dab640 1 -- 172.21.15.62:0/1571832471 learned_addr learned my addr 172.21.15.62:0/1571832471 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:30.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.227+0000 7f2604dab640 1 -- 172.21.15.62:0/1571832471 >> v1:172.21.15.2:6789/0 conn(0x563ebe0f46b0 legacy=0x563ebe1875e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.227+0000 7f2604dab640 1 -- 172.21.15.62:0/1571832471 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ebe028ca0 con 0x563ebe0f42d0 2024-09-10T05:36:30.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.227+0000 7f2604dab640 1 --2- 172.21.15.62:0/1571832471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ebe0f42d0 0x563ebe185090 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f25fc00a4e0 tx=0x7f25fc01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81f44a9292c8d6b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.227+0000 7f2603da9640 1 -- 172.21.15.62:0/1571832471 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25fc0aa540 con 0x563ebe0f42d0 2024-09-10T05:36:30.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.227+0000 7f2603da9640 1 -- 172.21.15.62:0/1571832471 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25fc0aa6e0 con 0x563ebe0f42d0 2024-09-10T05:36:30.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.227+0000 7f2603da9640 1 -- 172.21.15.62:0/1571832471 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25fc0aaa40 con 0x563ebe0f42d0 2024-09-10T05:36:30.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.231+0000 7f26072a59c0 1 -- 172.21.15.62:0/1571832471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ebe0f42d0 msgr2=0x563ebe185090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.231+0000 7f26072a59c0 1 --2- 172.21.15.62:0/1571832471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ebe0f42d0 0x563ebe185090 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f25fc00a4e0 tx=0x7f25fc01b090 comp rx=0 tx=0).stop 2024-09-10T05:36:30.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.231+0000 7f26072a59c0 1 -- 172.21.15.62:0/1571832471 shutdown_connections 2024-09-10T05:36:30.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.231+0000 7f26072a59c0 1 --2- 172.21.15.62:0/1571832471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ebe0f42d0 0x563ebe185090 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.231+0000 7f26072a59c0 1 -- 172.21.15.62:0/1571832471 >> 172.21.15.62:0/1571832471 conn(0x563ebe17a980 msgr2=0x563ebe17cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:30.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.231+0000 7f26072a59c0 1 -- 172.21.15.62:0/1571832471 shutdown_connections 2024-09-10T05:36:30.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.231+0000 7f26072a59c0 1 -- 172.21.15.62:0/1571832471 wait complete. 2024-09-10T05:36:30.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.243+0000 7f26072a59c0 1 Processor -- start 2024-09-10T05:36:30.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.243+0000 7f26072a59c0 1 -- start start 2024-09-10T05:36:30.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.243+0000 7f26072a59c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ebe0f42d0 0x563ebe26d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.243+0000 7f26072a59c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563ebe088680 con 0x563ebe0f42d0 2024-09-10T05:36:30.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.243+0000 7f2604dab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ebe0f42d0 0x563ebe26d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.243+0000 7f2604dab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ebe0f42d0 0x563ebe26d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51012/0 (socket says 172.21.15.62:51012) 2024-09-10T05:36:30.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.243+0000 7f2604dab640 1 -- 172.21.15.62:0/4002267505 learned_addr learned my addr 172.21.15.62:0/4002267505 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:30.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.243+0000 7f2604dab640 1 -- 172.21.15.62:0/4002267505 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ebe003da0 con 0x563ebe0f42d0 2024-09-10T05:36:30.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.243+0000 7f2604dab640 1 --2- 172.21.15.62:0/4002267505 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ebe0f42d0 0x563ebe26d970 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f25fc0ac040 tx=0x7f25fc0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a33469ce7f4df5ca server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.247+0000 7f24f2e0d640 1 -- 172.21.15.62:0/4002267505 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25fc0b9030 con 0x563ebe0f42d0 2024-09-10T05:36:30.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.247+0000 7f24f2e0d640 1 -- 172.21.15.62:0/4002267505 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25fc0aaa40 con 0x563ebe0f42d0 2024-09-10T05:36:30.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.247+0000 7f24f2e0d640 1 -- 172.21.15.62:0/4002267505 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25fc0aad20 con 0x563ebe0f42d0 2024-09-10T05:36:30.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.247+0000 7f26072a59c0 1 -- 172.21.15.62:0/4002267505 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ebe0f42d0 msgr2=0x563ebe26d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.247+0000 7f26072a59c0 1 --2- 172.21.15.62:0/4002267505 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ebe0f42d0 0x563ebe26d970 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f25fc0ac040 tx=0x7f25fc0033b0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.247+0000 7f26072a59c0 1 -- 172.21.15.62:0/4002267505 shutdown_connections 2024-09-10T05:36:30.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.247+0000 7f26072a59c0 1 --2- 172.21.15.62:0/4002267505 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ebe0f42d0 0x563ebe26d970 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.247+0000 7f26072a59c0 1 -- 172.21.15.62:0/4002267505 >> 172.21.15.62:0/4002267505 conn(0x563ebe17a980 msgr2=0x563ebe269610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:30.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.247+0000 7f26072a59c0 1 -- 172.21.15.62:0/4002267505 shutdown_connections 2024-09-10T05:36:30.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.247+0000 7f26072a59c0 1 -- 172.21.15.62:0/4002267505 wait complete. 2024-09-10T05:36:30.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.247+0000 7f26072a59c0 1 Processor -- start 2024-09-10T05:36:30.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.247+0000 7f26072a59c0 1 -- start start 2024-09-10T05:36:30.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.247+0000 7f26072a59c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ebe0f46b0 0x563ebe2750f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.247+0000 7f26072a59c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563ebe02aa50 con 0x563ebe0f46b0 2024-09-10T05:36:30.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.247+0000 7f2604dab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ebe0f46b0 0x563ebe2750f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.247+0000 7f2604dab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ebe0f46b0 0x563ebe2750f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51024/0 (socket says 172.21.15.62:51024) 2024-09-10T05:36:30.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.247+0000 7f2604dab640 1 -- 172.21.15.62:0/102568646 learned_addr learned my addr 172.21.15.62:0/102568646 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:30.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.247+0000 7f2604dab640 1 -- 172.21.15.62:0/102568646 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ebe275650 con 0x563ebe0f46b0 2024-09-10T05:36:30.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.247+0000 7f2604dab640 1 --2- 172.21.15.62:0/102568646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ebe0f46b0 0x563ebe2750f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f25fc01b0d0 tx=0x7f25fc017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.247+0000 7f24f160a640 1 -- 172.21.15.62:0/102568646 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25fc0b9030 con 0x563ebe0f46b0 2024-09-10T05:36:30.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.247+0000 7f26072a59c0 1 -- 172.21.15.62:0/102568646 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563ebe2758e0 con 0x563ebe0f46b0 2024-09-10T05:36:30.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.247+0000 7f24f160a640 1 -- 172.21.15.62:0/102568646 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25fc0c2070 con 0x563ebe0f46b0 2024-09-10T05:36:30.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.247+0000 7f24f160a640 1 -- 172.21.15.62:0/102568646 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25fc0b5ab0 con 0x563ebe0f46b0 2024-09-10T05:36:30.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.247+0000 7f26072a59c0 1 -- 172.21.15.62:0/102568646 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ebe276290 con 0x563ebe0f46b0 2024-09-10T05:36:30.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.247+0000 7f26072a59c0 1 Processor -- start 2024-09-10T05:36:30.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.251+0000 7f26072a59c0 1 -- start start 2024-09-10T05:36:30.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.251+0000 7f26072a59c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ebe282520 0x563ebe282920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.251+0000 7f26072a59c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563ebe095450 con 0x563ebe282520 2024-09-10T05:36:30.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.251+0000 7f26055ac640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ebe282520 0x563ebe282920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.251+0000 7f24f160a640 1 -- 172.21.15.62:0/102568646 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f25fc0c4070 con 0x563ebe0f46b0 2024-09-10T05:36:30.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.251+0000 7f26055ac640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ebe282520 0x563ebe282920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51030/0 (socket says 172.21.15.62:51030) 2024-09-10T05:36:30.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.251+0000 7f26055ac640 1 -- 172.21.15.62:0/2784701459 learned_addr learned my addr 172.21.15.62:0/2784701459 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:30.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.251+0000 7f24f160a640 1 --2- 172.21.15.62:0/102568646 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f24ec039a70 0x7f24ec03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.251+0000 7f24f160a640 1 -- 172.21.15.62:0/102568646 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f25fc0ba070 con 0x563ebe0f46b0 2024-09-10T05:36:30.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.251+0000 7f2604dab640 1 --2- 172.21.15.62:0/102568646 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f24ec039a70 0x7f24ec03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.251+0000 7f26055ac640 1 -- 172.21.15.62:0/2784701459 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ebe282ef0 con 0x563ebe282520 2024-09-10T05:36:30.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.251+0000 7f26055ac640 1 --2- 172.21.15.62:0/2784701459 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ebe282520 0x563ebe282920 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f25f400a440 tx=0x7f25f400a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=288900eed314fd51 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.251+0000 7f2604dab640 1 --2- 172.21.15.62:0/102568646 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f24ec039a70 0x7f24ec03bf30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f25fc0a3cb0 tx=0x7f25fc0033d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.251+0000 7f24eaffd640 1 -- 172.21.15.62:0/2784701459 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25f4008850 con 0x563ebe282520 2024-09-10T05:36:30.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.251+0000 7f24eaffd640 1 -- 172.21.15.62:0/2784701459 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25f4008a10 con 0x563ebe282520 2024-09-10T05:36:30.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.251+0000 7f24eaffd640 1 -- 172.21.15.62:0/2784701459 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25f4008d30 con 0x563ebe282520 2024-09-10T05:36:30.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.251+0000 7f26072a59c0 1 -- 172.21.15.62:0/2784701459 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ebe282520 msgr2=0x563ebe282920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.251+0000 7f26072a59c0 1 --2- 172.21.15.62:0/2784701459 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ebe282520 0x563ebe282920 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f25f400a440 tx=0x7f25f400a900 comp rx=0 tx=0).stop 2024-09-10T05:36:30.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.251+0000 7f26072a59c0 1 -- 172.21.15.62:0/2784701459 shutdown_connections 2024-09-10T05:36:30.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.251+0000 7f26072a59c0 1 --2- 172.21.15.62:0/2784701459 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ebe282520 0x563ebe282920 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.251+0000 7f26072a59c0 1 -- 172.21.15.62:0/2784701459 >> 172.21.15.62:0/2784701459 conn(0x563ebe27d6f0 msgr2=0x563ebe27e2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:30.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.251+0000 7f26072a59c0 1 -- 172.21.15.62:0/2784701459 shutdown_connections 2024-09-10T05:36:30.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.251+0000 7f26072a59c0 1 -- 172.21.15.62:0/2784701459 wait complete. 2024-09-10T05:36:30.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.251+0000 7f26072a59c0 1 Processor -- start 2024-09-10T05:36:30.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.251+0000 7f26072a59c0 1 -- start start 2024-09-10T05:36:30.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.251+0000 7f26072a59c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ebe282520 0x563ebe2894b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.251+0000 7f26072a59c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563ebe2832a0 con 0x563ebe282520 2024-09-10T05:36:30.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.251+0000 7f26055ac640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ebe282520 0x563ebe2894b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.251+0000 7f26055ac640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ebe282520 0x563ebe2894b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51044/0 (socket says 172.21.15.62:51044) 2024-09-10T05:36:30.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.251+0000 7f26055ac640 1 -- 172.21.15.62:0/3936370969 learned_addr learned my addr 172.21.15.62:0/3936370969 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:30.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.251+0000 7f26055ac640 1 -- 172.21.15.62:0/3936370969 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ebe289a10 con 0x563ebe282520 2024-09-10T05:36:30.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.251+0000 7f26055ac640 1 --2- 172.21.15.62:0/3936370969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ebe282520 0x563ebe2894b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x563ebe27ef20 tx=0x7f25f4003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.251+0000 7f24e97fa640 1 -- 172.21.15.62:0/3936370969 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25f4013a70 con 0x563ebe282520 2024-09-10T05:36:30.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.251+0000 7f26072a59c0 1 -- 172.21.15.62:0/3936370969 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563ebe289ca0 con 0x563ebe282520 2024-09-10T05:36:30.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.251+0000 7f24e97fa640 1 -- 172.21.15.62:0/3936370969 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25f4023070 con 0x563ebe282520 2024-09-10T05:36:30.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.251+0000 7f24e97fa640 1 -- 172.21.15.62:0/3936370969 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25f4013d80 con 0x563ebe282520 2024-09-10T05:36:30.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.255+0000 7f26072a59c0 1 -- 172.21.15.62:0/3936370969 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ebe28a650 con 0x563ebe282520 2024-09-10T05:36:30.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.255+0000 7f26072a59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:30.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.255+0000 7f26072a59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:30.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.255+0000 7f24e97fa640 1 -- 172.21.15.62:0/3936370969 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f25f4028460 con 0x563ebe282520 2024-09-10T05:36:30.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.255+0000 7f26072a59c0 1 Processor -- start 2024-09-10T05:36:30.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.255+0000 7f24e97fa640 1 --2- 172.21.15.62:0/3936370969 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f24dc039a70 0x7f24dc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.255+0000 7f24e97fa640 1 -- 172.21.15.62:0/3936370969 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f25f4050500 con 0x563ebe282520 2024-09-10T05:36:30.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.255+0000 7f26072a59c0 1 -- start start 2024-09-10T05:36:30.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.255+0000 7f26055ac640 1 --2- 172.21.15.62:0/3936370969 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f24dc039a70 0x7f24dc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.255+0000 7f26072a59c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ebe2a2bc0 0x563ebe2a2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.255+0000 7f26072a59c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563ebe26e100 con 0x563ebe2a2bc0 2024-09-10T05:36:30.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.255+0000 7f26055ac640 1 --2- 172.21.15.62:0/3936370969 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f24dc039a70 0x7f24dc03bf30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f25f401df90 tx=0x7f25f401dea0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.255+0000 7f2604dab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ebe2a2bc0 0x563ebe2a2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.255+0000 7f2604dab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ebe2a2bc0 0x563ebe2a2fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51048/0 (socket says 172.21.15.62:51048) 2024-09-10T05:36:30.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.255+0000 7f2604dab640 1 -- 172.21.15.62:0/474024805 learned_addr learned my addr 172.21.15.62:0/474024805 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:30.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.255+0000 7f2604dab640 1 -- 172.21.15.62:0/474024805 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ebe2a3620 con 0x563ebe2a2bc0 2024-09-10T05:36:30.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.255+0000 7f2604dab640 1 --2- 172.21.15.62:0/474024805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ebe2a2bc0 0x563ebe2a2fe0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f25fc0bdfd0 tx=0x7f25fc0e8cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.255+0000 7f24c97e2640 1 -- 172.21.15.62:0/474024805 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25fc0ea500 con 0x563ebe2a2bc0 2024-09-10T05:36:30.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.255+0000 7f26072a59c0 1 -- 172.21.15.62:0/474024805 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563ebe2a3dc0 con 0x563ebe2a2bc0 2024-09-10T05:36:30.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.255+0000 7f24c97e2640 1 -- 172.21.15.62:0/474024805 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25fc0bc7d0 con 0x563ebe2a2bc0 2024-09-10T05:36:30.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.255+0000 7f24c97e2640 1 -- 172.21.15.62:0/474024805 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25fc0c5810 con 0x563ebe2a2bc0 2024-09-10T05:36:30.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.255+0000 7f26072a59c0 1 -- 172.21.15.62:0/474024805 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ebe2a4330 con 0x563ebe2a2bc0 2024-09-10T05:36:30.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.259+0000 7f24c97e2640 1 -- 172.21.15.62:0/474024805 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f25fc0b3040 con 0x563ebe2a2bc0 2024-09-10T05:36:30.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.259+0000 7f24c97e2640 1 --2- 172.21.15.62:0/474024805 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2440039a70 0x7f244003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.259+0000 7f24c97e2640 1 -- 172.21.15.62:0/474024805 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f25fc0eb060 con 0x563ebe2a2bc0 2024-09-10T05:36:30.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.259+0000 7f26045aa640 1 --2- 172.21.15.62:0/474024805 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2440039a70 0x7f244003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.259+0000 7f244affd640 20 reqs_thread_entry: start 2024-09-10T05:36:30.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.259+0000 7f26072a59c0 1 --2- 172.21.15.62:0/102568646 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x563ebe2a85e0 0x563ebe2aaa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.259+0000 7f26072a59c0 1 -- 172.21.15.62:0/102568646 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563ebe2ab0f0 con 0x563ebe2a85e0 2024-09-10T05:36:30.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.259+0000 7f26045aa640 1 --2- 172.21.15.62:0/474024805 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2440039a70 0x7f244003bf30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f25f8001e40 tx=0x7f25f80013c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.259+0000 7f26055ac640 1 --2- 172.21.15.62:0/102568646 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x563ebe2a85e0 0x563ebe2aaa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.259+0000 7f26055ac640 1 --2- 172.21.15.62:0/102568646 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x563ebe2a85e0 0x563ebe2aaa50 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.259+0000 7f26055ac640 1 -- 172.21.15.62:0/102568646 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f25f401e7a0 con 0x563ebe2a85e0 2024-09-10T05:36:30.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.259+0000 7f26072a59c0 1 --2- 172.21.15.62:0/102568646 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x563ebe2acec0 0x563ebe2af2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.259+0000 7f26072a59c0 1 -- 172.21.15.62:0/102568646 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:2 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563ebe2af9b0 con 0x563ebe2acec0 2024-09-10T05:36:30.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.259+0000 7f2604dab640 1 --2- 172.21.15.62:0/102568646 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x563ebe2acec0 0x563ebe2af2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.259+0000 7f2604dab640 1 --2- 172.21.15.62:0/102568646 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x563ebe2acec0 0x563ebe2af2b0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.263+0000 7f2604dab640 1 -- 172.21.15.62:0/102568646 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(2 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f25fc0eac40 con 0x563ebe2acec0 2024-09-10T05:36:30.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.263+0000 7f26072a59c0 1 -- 172.21.15.62:0/102568646 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563ebe2b4750 con 0x563ebe2acec0 2024-09-10T05:36:30.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.263+0000 7f2604dab640 1 -- 172.21.15.62:0/102568646 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [stat,call,call,writefull 0~993] v30'3 uv3 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f25fc0eac40 con 0x563ebe2acec0 2024-09-10T05:36:30.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.263+0000 7f26072a59c0 1 -- 172.21.15.62:0/3936370969 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f24dc039a70 msgr2=0x7f24dc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.263+0000 7f26072a59c0 1 --2- 172.21.15.62:0/3936370969 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f24dc039a70 0x7f24dc03bf30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f25f401df90 tx=0x7f25f401dea0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.263+0000 7f26072a59c0 1 -- 172.21.15.62:0/3936370969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ebe282520 msgr2=0x563ebe2894b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.263+0000 7f26072a59c0 1 --2- 172.21.15.62:0/3936370969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ebe282520 0x563ebe2894b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x563ebe27ef20 tx=0x7f25f4003000 comp rx=0 tx=0).stop 2024-09-10T05:36:30.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.263+0000 7f26072a59c0 1 -- 172.21.15.62:0/3936370969 shutdown_connections 2024-09-10T05:36:30.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.263+0000 7f26072a59c0 1 --2- 172.21.15.62:0/3936370969 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f24dc039a70 0x7f24dc03bf30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.263+0000 7f26072a59c0 1 --2- 172.21.15.62:0/3936370969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ebe282520 0x563ebe2894b0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.263+0000 7f26072a59c0 1 -- 172.21.15.62:0/3936370969 >> 172.21.15.62:0/3936370969 conn(0x563ebe27d6f0 msgr2=0x563ebe27e2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:30.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.263+0000 7f26072a59c0 1 -- 172.21.15.62:0/3936370969 shutdown_connections 2024-09-10T05:36:30.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.263+0000 7f26072a59c0 1 -- 172.21.15.62:0/3936370969 wait complete. 2024-09-10T05:36:30.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.263+0000 7f26072a59c0 1 -- 172.21.15.62:0/474024805 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2440039a70 msgr2=0x7f244003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.263+0000 7f26072a59c0 1 --2- 172.21.15.62:0/474024805 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2440039a70 0x7f244003bf30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f25f8001e40 tx=0x7f25f80013c0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.263+0000 7f26072a59c0 1 -- 172.21.15.62:0/474024805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ebe2a2bc0 msgr2=0x563ebe2a2fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.263+0000 7f26072a59c0 1 --2- 172.21.15.62:0/474024805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ebe2a2bc0 0x563ebe2a2fe0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f25fc0bdfd0 tx=0x7f25fc0e8cf0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.263+0000 7f26072a59c0 1 -- 172.21.15.62:0/474024805 shutdown_connections 2024-09-10T05:36:30.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.263+0000 7f26072a59c0 1 --2- 172.21.15.62:0/474024805 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2440039a70 0x7f244003bf30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.263+0000 7f26072a59c0 1 --2- 172.21.15.62:0/474024805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ebe2a2bc0 0x563ebe2a2fe0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.263+0000 7f26072a59c0 1 -- 172.21.15.62:0/474024805 >> 172.21.15.62:0/474024805 conn(0x563ebe2981c0 msgr2=0x563ebe2985a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:30.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.263+0000 7f26072a59c0 1 -- 172.21.15.62:0/474024805 shutdown_connections 2024-09-10T05:36:30.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.263+0000 7f26072a59c0 1 -- 172.21.15.62:0/474024805 wait complete. 2024-09-10T05:36:30.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.267+0000 7f26072a59c0 1 -- 172.21.15.62:0/102568646 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x563ebe2a85e0 msgr2=0x563ebe2aaa50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.267+0000 7f26072a59c0 1 --2- 172.21.15.62:0/102568646 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x563ebe2a85e0 0x563ebe2aaa50 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.267+0000 7f26072a59c0 1 -- 172.21.15.62:0/102568646 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x563ebe2acec0 msgr2=0x563ebe2af2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.267+0000 7f26072a59c0 1 --2- 172.21.15.62:0/102568646 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x563ebe2acec0 0x563ebe2af2b0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.267+0000 7f26072a59c0 1 -- 172.21.15.62:0/102568646 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f24ec039a70 msgr2=0x7f24ec03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.267+0000 7f26072a59c0 1 --2- 172.21.15.62:0/102568646 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f24ec039a70 0x7f24ec03bf30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f25fc0a3cb0 tx=0x7f25fc0033d0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.267+0000 7f26072a59c0 1 -- 172.21.15.62:0/102568646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ebe0f46b0 msgr2=0x563ebe2750f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.267+0000 7f26072a59c0 1 --2- 172.21.15.62:0/102568646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ebe0f46b0 0x563ebe2750f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f25fc01b0d0 tx=0x7f25fc017e30 comp rx=0 tx=0).stop 2024-09-10T05:36:30.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.267+0000 7f26072a59c0 1 -- 172.21.15.62:0/102568646 shutdown_connections 2024-09-10T05:36:30.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.267+0000 7f26072a59c0 1 --2- 172.21.15.62:0/102568646 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x563ebe2acec0 0x563ebe2af2b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.267+0000 7f26072a59c0 1 --2- 172.21.15.62:0/102568646 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x563ebe2a85e0 0x563ebe2aaa50 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.267+0000 7f26072a59c0 1 --2- 172.21.15.62:0/102568646 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f24ec039a70 0x7f24ec03bf30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.267+0000 7f26072a59c0 1 --2- 172.21.15.62:0/102568646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ebe0f46b0 0x563ebe2750f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.267+0000 7f26072a59c0 1 -- 172.21.15.62:0/102568646 >> 172.21.15.62:0/102568646 conn(0x563ebe17a980 msgr2=0x563ebe2680a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:30.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.267+0000 7f26072a59c0 1 -- 172.21.15.62:0/102568646 shutdown_connections 2024-09-10T05:36:30.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.267+0000 7f26072a59c0 1 -- 172.21.15.62:0/102568646 wait complete. 2024-09-10T05:36:30.281 INFO:teuthology.orchestra.run.smithi062.stdout:{"id":"475ecc13-ad4b-423e-b7f2-f7f260e17071","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-10T05:36:30.281 DEBUG:tasks.util.rgw: json result: {'id': '475ecc13-ad4b-423e-b7f2-f7f260e17071', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-10T05:36:30.282 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-10T05:36:30.282 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-10T05:36:30.282 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-10T05:36:30.361 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:30.361 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:30.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.359+0000 7f7905f929c0 1 Processor -- start 2024-09-10T05:36:30.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.359+0000 7f7905f929c0 1 -- start start 2024-09-10T05:36:30.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.359+0000 7f7905f929c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5605f8e75320 0x5605f8e77710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.359+0000 7f7905f929c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5605f8d239c0 con 0x5605f8e711d0 2024-09-10T05:36:30.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.359+0000 7f7905f929c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x5605f8d736d0 con 0x5605f8e75320 2024-09-10T05:36:30.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.359+0000 7f7903297640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5605f8e75320 0x5605f8e77710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.359+0000 7f7903a98640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x5605f8e711d0 0x5605f8e715b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:38448/0 (socket says 172.21.15.62:38448) 2024-09-10T05:36:30.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.359+0000 7f7903a98640 1 -- 172.21.15.62:0/280701232 learned_addr learned my addr 172.21.15.62:0/280701232 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-10T05:36:30.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.359+0000 7f7902a96640 1 -- 172.21.15.62:0/280701232 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2494885752 0 0) 0x5605f8d239c0 con 0x5605f8e711d0 2024-09-10T05:36:30.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.359+0000 7f7902a96640 1 -- 172.21.15.62:0/280701232 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78ec001e20 con 0x5605f8e711d0 2024-09-10T05:36:30.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.359+0000 7f7903297640 1 -- 172.21.15.62:0/280701232 >> v1:172.21.15.2:6789/0 conn(0x5605f8e711d0 legacy=0x5605f8e715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.359+0000 7f7903297640 1 -- 172.21.15.62:0/280701232 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605f8d17ca0 con 0x5605f8e75320 2024-09-10T05:36:30.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.363+0000 7f7903297640 1 --2- 172.21.15.62:0/280701232 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605f8e75320 0x5605f8e77710 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f78f800a480 tx=0x7f78f801b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af9cfd4018fdc31 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.363+0000 7f7902a96640 1 -- 172.21.15.62:0/280701232 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78f80aa570 con 0x5605f8e75320 2024-09-10T05:36:30.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.363+0000 7f7902a96640 1 -- 172.21.15.62:0/280701232 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78f80af070 con 0x5605f8e75320 2024-09-10T05:36:30.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.363+0000 7f7902a96640 1 -- 172.21.15.62:0/280701232 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78f80aa860 con 0x5605f8e75320 2024-09-10T05:36:30.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.363+0000 7f7905f929c0 1 -- 172.21.15.62:0/280701232 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605f8e75320 msgr2=0x5605f8e77710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.363+0000 7f7905f929c0 1 --2- 172.21.15.62:0/280701232 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605f8e75320 0x5605f8e77710 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f78f800a480 tx=0x7f78f801b310 comp rx=0 tx=0).stop 2024-09-10T05:36:30.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.363+0000 7f7905f929c0 1 -- 172.21.15.62:0/280701232 shutdown_connections 2024-09-10T05:36:30.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.363+0000 7f7905f929c0 1 --2- 172.21.15.62:0/280701232 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605f8e75320 0x5605f8e77710 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.363+0000 7f7905f929c0 1 -- 172.21.15.62:0/280701232 >> 172.21.15.62:0/280701232 conn(0x5605f8de4ae0 msgr2=0x5605f8de4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:30.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.363+0000 7f7905f929c0 1 -- 172.21.15.62:0/280701232 shutdown_connections 2024-09-10T05:36:30.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.363+0000 7f7905f929c0 1 -- 172.21.15.62:0/280701232 wait complete. 2024-09-10T05:36:30.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.379+0000 7f7905f929c0 1 Processor -- start 2024-09-10T05:36:30.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.379+0000 7f7905f929c0 1 -- start start 2024-09-10T05:36:30.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.379+0000 7f7905f929c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605f8e711d0 0x5605f8f5c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.379+0000 7f7905f929c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5605f8d77680 con 0x5605f8e711d0 2024-09-10T05:36:30.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.379+0000 7f7903a98640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605f8e711d0 0x5605f8f5c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.379+0000 7f7903a98640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605f8e711d0 0x5605f8f5c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51080/0 (socket says 172.21.15.62:51080) 2024-09-10T05:36:30.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.379+0000 7f7903a98640 1 -- 172.21.15.62:0/2341395944 learned_addr learned my addr 172.21.15.62:0/2341395944 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:30.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.379+0000 7f7903a98640 1 -- 172.21.15.62:0/2341395944 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605f8cf2da0 con 0x5605f8e711d0 2024-09-10T05:36:30.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.383+0000 7f7903a98640 1 --2- 172.21.15.62:0/2341395944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605f8e711d0 0x5605f8f5c800 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f78f4001e40 tx=0x7f78f400b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3aee67d70839e47 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.383+0000 7f77f1e0b640 1 -- 172.21.15.62:0/2341395944 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78f4012020 con 0x5605f8e711d0 2024-09-10T05:36:30.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.383+0000 7f77f1e0b640 1 -- 172.21.15.62:0/2341395944 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78f400e690 con 0x5605f8e711d0 2024-09-10T05:36:30.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.383+0000 7f77f1e0b640 1 -- 172.21.15.62:0/2341395944 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78f400e9b0 con 0x5605f8e711d0 2024-09-10T05:36:30.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.383+0000 7f7905f929c0 1 -- 172.21.15.62:0/2341395944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605f8e711d0 msgr2=0x5605f8f5c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.383+0000 7f7905f929c0 1 --2- 172.21.15.62:0/2341395944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605f8e711d0 0x5605f8f5c800 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f78f4001e40 tx=0x7f78f400b790 comp rx=0 tx=0).stop 2024-09-10T05:36:30.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.383+0000 7f7905f929c0 1 -- 172.21.15.62:0/2341395944 shutdown_connections 2024-09-10T05:36:30.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.383+0000 7f7905f929c0 1 --2- 172.21.15.62:0/2341395944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605f8e711d0 0x5605f8f5c800 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.383+0000 7f7905f929c0 1 -- 172.21.15.62:0/2341395944 >> 172.21.15.62:0/2341395944 conn(0x5605f8de4ae0 msgr2=0x5605f8f583a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:30.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.383+0000 7f7905f929c0 1 -- 172.21.15.62:0/2341395944 shutdown_connections 2024-09-10T05:36:30.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.383+0000 7f7905f929c0 1 -- 172.21.15.62:0/2341395944 wait complete. 2024-09-10T05:36:30.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.383+0000 7f7905f929c0 1 Processor -- start 2024-09-10T05:36:30.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.383+0000 7f7905f929c0 1 -- start start 2024-09-10T05:36:30.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.383+0000 7f7905f929c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605f8e711d0 0x5605f8f63ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.383+0000 7f7905f929c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5605f8d19a50 con 0x5605f8e711d0 2024-09-10T05:36:30.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.383+0000 7f7903a98640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605f8e711d0 0x5605f8f63ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.383+0000 7f7903a98640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605f8e711d0 0x5605f8f63ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51092/0 (socket says 172.21.15.62:51092) 2024-09-10T05:36:30.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.383+0000 7f7903a98640 1 -- 172.21.15.62:0/2450393378 learned_addr learned my addr 172.21.15.62:0/2450393378 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:30.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.383+0000 7f7903a98640 1 -- 172.21.15.62:0/2450393378 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605f8f64430 con 0x5605f8e711d0 2024-09-10T05:36:30.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.383+0000 7f7903a98640 1 --2- 172.21.15.62:0/2450393378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605f8e711d0 0x5605f8f63ed0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x5605f8f5d790 tx=0x7f78f40040f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.383+0000 7f77ebfff640 1 -- 172.21.15.62:0/2450393378 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78f4012030 con 0x5605f8e711d0 2024-09-10T05:36:30.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.383+0000 7f7905f929c0 1 -- 172.21.15.62:0/2450393378 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5605f8f646c0 con 0x5605f8e711d0 2024-09-10T05:36:30.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.383+0000 7f77ebfff640 1 -- 172.21.15.62:0/2450393378 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78f401a720 con 0x5605f8e711d0 2024-09-10T05:36:30.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.383+0000 7f7905f929c0 1 -- 172.21.15.62:0/2450393378 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605f8f65070 con 0x5605f8e711d0 2024-09-10T05:36:30.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.383+0000 7f77ebfff640 1 -- 172.21.15.62:0/2450393378 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78f401aa00 con 0x5605f8e711d0 2024-09-10T05:36:30.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.387+0000 7f77ebfff640 1 -- 172.21.15.62:0/2450393378 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f78f4015020 con 0x5605f8e711d0 2024-09-10T05:36:30.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.387+0000 7f77ebfff640 1 --2- 172.21.15.62:0/2450393378 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f77ec039a70 0x7f77ec03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.387+0000 7f77ebfff640 1 -- 172.21.15.62:0/2450393378 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f78f4020070 con 0x5605f8e711d0 2024-09-10T05:36:30.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.387+0000 7f7903297640 1 --2- 172.21.15.62:0/2450393378 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f77ec039a70 0x7f77ec03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.387+0000 7f7905f929c0 1 --2- 172.21.15.62:0/2450393378 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5605f8f69030 0x5605f8f6b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.387+0000 7f7905f929c0 1 -- 172.21.15.62:0/2450393378 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5605f8f6b960 con 0x5605f8f69030 2024-09-10T05:36:30.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.387+0000 7f7904299640 1 --2- 172.21.15.62:0/2450393378 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5605f8f69030 0x5605f8f6b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.387+0000 7f7903297640 1 --2- 172.21.15.62:0/2450393378 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f77ec039a70 0x7f77ec03bf30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f78f80ae000 tx=0x7f78f80a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.387+0000 7f7904299640 1 --2- 172.21.15.62:0/2450393378 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5605f8f69030 0x5605f8f6b420 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.387+0000 7f7904299640 1 -- 172.21.15.62:0/2450393378 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f78fc00a4d0 con 0x5605f8f69030 2024-09-10T05:36:30.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.387+0000 7f7905f929c0 1 --2- 172.21.15.62:0/2450393378 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5605f8f6c6c0 0x5605f8f6eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.387+0000 7f7905f929c0 1 -- 172.21.15.62:0/2450393378 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5605f8f6f0a0 con 0x5605f8f6c6c0 2024-09-10T05:36:30.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.387+0000 7f7903a98640 1 --2- 172.21.15.62:0/2450393378 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5605f8f6c6c0 0x5605f8f6eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.387+0000 7f7903a98640 1 --2- 172.21.15.62:0/2450393378 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5605f8f6c6c0 0x5605f8f6eab0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.391+0000 7f7903a98640 1 -- 172.21.15.62:0/2450393378 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f78f4008030 con 0x5605f8f6c6c0 2024-09-10T05:36:30.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.391+0000 7f7905f929c0 1 --2- 172.21.15.62:0/2450393378 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5605f8f70e60 0x5605f8f73250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.391+0000 7f7905f929c0 1 -- 172.21.15.62:0/2450393378 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5605f8f73940 con 0x5605f8f70e60 2024-09-10T05:36:30.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.391+0000 7f7903297640 1 --2- 172.21.15.62:0/2450393378 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5605f8f70e60 0x5605f8f73250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.391+0000 7f7903297640 1 --2- 172.21.15.62:0/2450393378 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5605f8f70e60 0x5605f8f73250 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.391+0000 7f7903297640 1 -- 172.21.15.62:0/2450393378 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f78f80a8070 con 0x5605f8f70e60 2024-09-10T05:36:30.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.391+0000 7f7905f929c0 1 -- 172.21.15.62:0/2450393378 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5605f8f6fcd0 con 0x5605f8f6c6c0 2024-09-10T05:36:30.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.391+0000 7f7903a98640 1 -- 172.21.15.62:0/2450393378 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f78f4008030 con 0x5605f8f6c6c0 2024-09-10T05:36:30.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.391+0000 7f7905f929c0 1 -- 172.21.15.62:0/2450393378 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5605f8f70170 con 0x5605f8f70e60 2024-09-10T05:36:30.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.391+0000 7f7903297640 1 -- 172.21.15.62:0/2450393378 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f78f80a8070 con 0x5605f8f70e60 2024-09-10T05:36:30.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.391+0000 7f7905f929c0 1 Processor -- start 2024-09-10T05:36:30.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.391+0000 7f7905f929c0 1 -- start start 2024-09-10T05:36:30.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.391+0000 7f7905f929c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605f8f81f90 0x5605f8f823b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.391+0000 7f7905f929c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5605f8d84450 con 0x5605f8f81f90 2024-09-10T05:36:30.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.391+0000 7f7903a98640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605f8f81f90 0x5605f8f823b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.391+0000 7f7903a98640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605f8f81f90 0x5605f8f823b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51106/0 (socket says 172.21.15.62:51106) 2024-09-10T05:36:30.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.391+0000 7f7903a98640 1 -- 172.21.15.62:0/713421184 learned_addr learned my addr 172.21.15.62:0/713421184 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:30.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.391+0000 7f7903a98640 1 -- 172.21.15.62:0/713421184 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605f8f829f0 con 0x5605f8f81f90 2024-09-10T05:36:30.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.391+0000 7f7903a98640 1 --2- 172.21.15.62:0/713421184 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605f8f81f90 0x5605f8f823b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f78f4018fd0 tx=0x7f78f4024750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.395+0000 7f77e97fa640 1 -- 172.21.15.62:0/713421184 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78f403c070 con 0x5605f8f81f90 2024-09-10T05:36:30.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.395+0000 7f7905f929c0 1 -- 172.21.15.62:0/713421184 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5605f8f83250 con 0x5605f8f81f90 2024-09-10T05:36:30.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.395+0000 7f77e97fa640 1 -- 172.21.15.62:0/713421184 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78f4046070 con 0x5605f8f81f90 2024-09-10T05:36:30.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.395+0000 7f77e97fa640 1 -- 172.21.15.62:0/713421184 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78f400de20 con 0x5605f8f81f90 2024-09-10T05:36:30.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.395+0000 7f7905f929c0 1 -- 172.21.15.62:0/713421184 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605f8f83250 con 0x5605f8f81f90 2024-09-10T05:36:30.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.395+0000 7f77e97fa640 1 -- 172.21.15.62:0/713421184 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f78f403f070 con 0x5605f8f81f90 2024-09-10T05:36:30.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.395+0000 7f77e97fa640 1 --2- 172.21.15.62:0/713421184 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f77dc039a70 0x7f77dc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.395+0000 7f77e97fa640 1 -- 172.21.15.62:0/713421184 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f78f4005050 con 0x5605f8f81f90 2024-09-10T05:36:30.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.395+0000 7f7903297640 1 --2- 172.21.15.62:0/713421184 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f77dc039a70 0x7f77dc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.395+0000 7f7905f929c0 1 Processor -- start 2024-09-10T05:36:30.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.395+0000 7f7905f929c0 1 -- start start 2024-09-10T05:36:30.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.395+0000 7f7903297640 1 --2- 172.21.15.62:0/713421184 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f77dc039a70 0x7f77dc03bf30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x5605f8f65320 tx=0x7f78f8005a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.395+0000 7f7905f929c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605f8de9a40 0x5605f8f952a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.395+0000 7f7905f929c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5605f8f5d050 con 0x5605f8de9a40 2024-09-10T05:36:30.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.395+0000 7f7903a98640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605f8de9a40 0x5605f8f952a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.395+0000 7f7903a98640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605f8de9a40 0x5605f8f952a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51116/0 (socket says 172.21.15.62:51116) 2024-09-10T05:36:30.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.395+0000 7f7903a98640 1 -- 172.21.15.62:0/2235592467 learned_addr learned my addr 172.21.15.62:0/2235592467 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:30.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.395+0000 7f7903a98640 1 -- 172.21.15.62:0/2235592467 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605f8de9ef0 con 0x5605f8de9a40 2024-09-10T05:36:30.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.395+0000 7f7903a98640 1 --2- 172.21.15.62:0/2235592467 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605f8de9a40 0x5605f8f952a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f78f402d7c0 tx=0x7f78f4017940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e2777f6c9ce6fc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.395+0000 7f77e2ffd640 1 -- 172.21.15.62:0/2235592467 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78f4040760 con 0x5605f8de9a40 2024-09-10T05:36:30.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.395+0000 7f77e2ffd640 1 -- 172.21.15.62:0/2235592467 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78f40403b0 con 0x5605f8de9a40 2024-09-10T05:36:30.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.395+0000 7f77e2ffd640 1 -- 172.21.15.62:0/2235592467 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78f404d3a0 con 0x5605f8de9a40 2024-09-10T05:36:30.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.399+0000 7f7905f929c0 1 -- 172.21.15.62:0/2235592467 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605f8de9a40 msgr2=0x5605f8f952a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.399+0000 7f7905f929c0 1 --2- 172.21.15.62:0/2235592467 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605f8de9a40 0x5605f8f952a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f78f402d7c0 tx=0x7f78f4017940 comp rx=0 tx=0).stop 2024-09-10T05:36:30.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.399+0000 7f7905f929c0 1 -- 172.21.15.62:0/2235592467 shutdown_connections 2024-09-10T05:36:30.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.399+0000 7f7905f929c0 1 --2- 172.21.15.62:0/2235592467 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605f8de9a40 0x5605f8f952a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.399+0000 7f7905f929c0 1 -- 172.21.15.62:0/2235592467 >> 172.21.15.62:0/2235592467 conn(0x5605f8de7bf0 msgr2=0x5605f8de5e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:30.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.399+0000 7f7905f929c0 1 -- 172.21.15.62:0/2235592467 shutdown_connections 2024-09-10T05:36:30.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.399+0000 7f7905f929c0 1 -- 172.21.15.62:0/2235592467 wait complete. 2024-09-10T05:36:30.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.399+0000 7f7905f929c0 1 Processor -- start 2024-09-10T05:36:30.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.399+0000 7f7905f929c0 1 -- start start 2024-09-10T05:36:30.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.399+0000 7f7905f929c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605f8de9a40 0x5605f8f99ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.399+0000 7f7905f929c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5605f8f95a20 con 0x5605f8de9a40 2024-09-10T05:36:30.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.399+0000 7f7903a98640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605f8de9a40 0x5605f8f99ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.399+0000 7f7903a98640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605f8de9a40 0x5605f8f99ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51132/0 (socket says 172.21.15.62:51132) 2024-09-10T05:36:30.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.399+0000 7f7903a98640 1 -- 172.21.15.62:0/1649849341 learned_addr learned my addr 172.21.15.62:0/1649849341 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:30.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.399+0000 7f7903a98640 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605f8f9a200 con 0x5605f8de9a40 2024-09-10T05:36:30.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.399+0000 7f7903a98640 1 --2- 172.21.15.62:0/1649849341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605f8de9a40 0x5605f8f99ca0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f78f404d720 tx=0x7f78f4005f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.399+0000 7f77e17fa640 1 -- 172.21.15.62:0/1649849341 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78f4075070 con 0x5605f8de9a40 2024-09-10T05:36:30.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.399+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5605f8f9a200 con 0x5605f8de9a40 2024-09-10T05:36:30.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.399+0000 7f77e17fa640 1 -- 172.21.15.62:0/1649849341 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78f401f1d0 con 0x5605f8de9a40 2024-09-10T05:36:30.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.399+0000 7f77e17fa640 1 -- 172.21.15.62:0/1649849341 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78f4017430 con 0x5605f8de9a40 2024-09-10T05:36:30.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.399+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605f8f9a200 con 0x5605f8de9a40 2024-09-10T05:36:30.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.399+0000 7f77e17fa640 1 -- 172.21.15.62:0/1649849341 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f78f4078070 con 0x5605f8de9a40 2024-09-10T05:36:30.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.399+0000 7f7905f929c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:30.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.403+0000 7f77e17fa640 1 --2- 172.21.15.62:0/1649849341 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f77cc039a70 0x7f77cc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.403+0000 7f77e17fa640 1 -- 172.21.15.62:0/1649849341 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f78f406b030 con 0x5605f8de9a40 2024-09-10T05:36:30.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.403+0000 7f7903297640 1 --2- 172.21.15.62:0/1649849341 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f77cc039a70 0x7f77cc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.403+0000 7f7905f929c0 1 --2- 172.21.15.62:0/1649849341 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5605f8fa4c40 0x5605f8fa70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.403+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fa7820 con 0x5605f8fa4c40 2024-09-10T05:36:30.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.403+0000 7f7904299640 1 --2- 172.21.15.62:0/1649849341 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5605f8fa4c40 0x5605f8fa70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.403+0000 7f7903297640 1 --2- 172.21.15.62:0/1649849341 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f77cc039a70 0x7f77cc03bf30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f78f80ac040 tx=0x7f78f80a8000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.403+0000 7f7904299640 1 --2- 172.21.15.62:0/1649849341 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5605f8fa4c40 0x5605f8fa70d0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.403+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f78fc00a4d0 con 0x5605f8fa4c40 2024-09-10T05:36:30.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.403+0000 7f7905f929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:30.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.403+0000 7f7905f929c0 20 realm 2024-09-10T05:36:30.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.403+0000 7f7905f929c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:30.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.403+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fa3fd0 con 0x5605f8fa4c40 2024-09-10T05:36:30.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.403+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f78fc00a4d0 con 0x5605f8fa4c40 2024-09-10T05:36:30.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.403+0000 7f7905f929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:30.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.403+0000 7f7905f929c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:30.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.403+0000 7f7905f929c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:30.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.403+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fa82e0 con 0x5605f8fa4c40 2024-09-10T05:36:30.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.403+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f78fc00a4d0 con 0x5605f8fa4c40 2024-09-10T05:36:30.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.403+0000 7f7905f929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:30.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.403+0000 7f7905f929c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:30.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.403+0000 7f7905f929c0 1 --2- 172.21.15.62:0/1649849341 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5605f8fa90c0 0x5605f8fab4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.403+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fabb40 con 0x5605f8fa90c0 2024-09-10T05:36:30.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.403+0000 7f7903a98640 1 --2- 172.21.15.62:0/1649849341 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5605f8fa90c0 0x5605f8fab4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.403+0000 7f7903a98640 1 --2- 172.21.15.62:0/1649849341 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5605f8fa90c0 0x5605f8fab4b0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.403+0000 7f7903a98640 1 -- 172.21.15.62:0/1649849341 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f78f4077030 con 0x5605f8fa90c0 2024-09-10T05:36:30.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.403+0000 7f7905f929c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:30.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.403+0000 7f7905f929c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:30.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.403+0000 7f7905f929c0 1 --2- 172.21.15.62:0/1649849341 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5605f8fac8f0 0x5605f8faece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.403+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5605f8faf380 con 0x5605f8fac8f0 2024-09-10T05:36:30.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.403+0000 7f7903297640 1 --2- 172.21.15.62:0/1649849341 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5605f8fac8f0 0x5605f8faece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.403+0000 7f7903297640 1 --2- 172.21.15.62:0/1649849341 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5605f8fac8f0 0x5605f8faece0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.407+0000 7f7903297640 1 -- 172.21.15.62:0/1649849341 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f78f80a8070 con 0x5605f8fac8f0 2024-09-10T05:36:30.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.407+0000 7f7905f929c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:30.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.407+0000 7f7905f929c0 20 searching for the correct realm 2024-09-10T05:36:30.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.407+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fb0c50 con 0x5605f8fac8f0 2024-09-10T05:36:30.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.407+0000 7f7903297640 1 -- 172.21.15.62:0/1649849341 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78f80a8070 con 0x5605f8fac8f0 2024-09-10T05:36:30.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.407+0000 7f7903297640 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fb0c50 con 0x5605f8fa90c0 2024-09-10T05:36:30.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.407+0000 7f7903a98640 1 -- 172.21.15.62:0/1649849341 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78f4077030 con 0x5605f8fa90c0 2024-09-10T05:36:30.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.407+0000 7f7903a98640 1 --2- 172.21.15.62:0/1649849341 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f78f407a060 0x7f78f40100d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.407+0000 7f7903a98640 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fb0c50 con 0x7f78f407a060 2024-09-10T05:36:30.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.407+0000 7f7904299640 1 --2- 172.21.15.62:0/1649849341 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f78f407a060 0x7f78f40100d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.407+0000 7f7904299640 1 --2- 172.21.15.62:0/1649849341 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f78f407a060 0x7f78f40100d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.407+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78fc00a4d0 con 0x7f78f407a060 2024-09-10T05:36:30.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.407+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fb0c50 con 0x5605f8fa4c40 2024-09-10T05:36:30.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.407+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78fc00a4d0 con 0x5605f8fa4c40 2024-09-10T05:36:30.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.407+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fb0c50 con 0x5605f8fa4c40 2024-09-10T05:36:30.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.407+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78fc00a4d0 con 0x5605f8fa4c40 2024-09-10T05:36:30.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.407+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fb0c50 con 0x5605f8fac8f0 2024-09-10T05:36:30.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.407+0000 7f7903297640 1 -- 172.21.15.62:0/1649849341 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78f80a8070 con 0x5605f8fac8f0 2024-09-10T05:36:30.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.407+0000 7f7903297640 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fb0c50 con 0x5605f8fa4c40 2024-09-10T05:36:30.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.407+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78fc00a4d0 con 0x5605f8fa4c40 2024-09-10T05:36:30.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.407+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fb0c50 con 0x5605f8fa90c0 2024-09-10T05:36:30.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.407+0000 7f7903a98640 1 -- 172.21.15.62:0/1649849341 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78f4077030 con 0x5605f8fa90c0 2024-09-10T05:36:30.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.407+0000 7f7903a98640 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fb0c50 con 0x5605f8fa90c0 2024-09-10T05:36:30.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.411+0000 7f7903a98640 1 -- 172.21.15.62:0/1649849341 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78f4077030 con 0x5605f8fa90c0 2024-09-10T05:36:30.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.411+0000 7f7903a98640 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fb0c50 con 0x5605f8fa4c40 2024-09-10T05:36:30.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.411+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78fc00a4d0 con 0x5605f8fa4c40 2024-09-10T05:36:30.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.411+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fb0c50 con 0x7f78f407a060 2024-09-10T05:36:30.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.411+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78fc00a4d0 con 0x7f78f407a060 2024-09-10T05:36:30.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.411+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fb0c50 con 0x5605f8fa4c40 2024-09-10T05:36:30.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.411+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78fc00a4d0 con 0x5605f8fa4c40 2024-09-10T05:36:30.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.411+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fb0c50 con 0x7f78f407a060 2024-09-10T05:36:30.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.411+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f78fc00a4d0 con 0x7f78f407a060 2024-09-10T05:36:30.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.411+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fb0c50 con 0x5605f8fa90c0 2024-09-10T05:36:30.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.411+0000 7f7903a98640 1 -- 172.21.15.62:0/1649849341 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78f4077030 con 0x5605f8fa90c0 2024-09-10T05:36:30.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.411+0000 7f7903a98640 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fb0c50 con 0x5605f8fac8f0 2024-09-10T05:36:30.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.411+0000 7f7903297640 1 -- 172.21.15.62:0/1649849341 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78f80a8070 con 0x5605f8fac8f0 2024-09-10T05:36:30.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.411+0000 7f7903297640 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fb0c50 con 0x5605f8fa4c40 2024-09-10T05:36:30.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.411+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78fc00a4d0 con 0x5605f8fa4c40 2024-09-10T05:36:30.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.411+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fb0c50 con 0x5605f8fa90c0 2024-09-10T05:36:30.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.411+0000 7f7903a98640 1 -- 172.21.15.62:0/1649849341 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78f4077030 con 0x5605f8fa90c0 2024-09-10T05:36:30.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.411+0000 7f7903a98640 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fb0c50 con 0x5605f8fac8f0 2024-09-10T05:36:30.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.415+0000 7f7903297640 1 -- 172.21.15.62:0/1649849341 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 30 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f78f80a8070 con 0x5605f8fac8f0 2024-09-10T05:36:30.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.415+0000 7f7903297640 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fb0c50 con 0x5605f8fa4c40 2024-09-10T05:36:30.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.415+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78fc00a4d0 con 0x5605f8fa4c40 2024-09-10T05:36:30.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.415+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fb0c50 con 0x5605f8fa4c40 2024-09-10T05:36:30.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.415+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f78fc00a4d0 con 0x5605f8fa4c40 2024-09-10T05:36:30.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.415+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fb0c50 con 0x5605f8fa4c40 2024-09-10T05:36:30.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.415+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78fc00a4d0 con 0x5605f8fa4c40 2024-09-10T05:36:30.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.415+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fb0c50 con 0x5605f8fac8f0 2024-09-10T05:36:30.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.415+0000 7f7903297640 1 -- 172.21.15.62:0/1649849341 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78f80a8070 con 0x5605f8fac8f0 2024-09-10T05:36:30.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.415+0000 7f7903297640 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fb0c50 con 0x7f78f407a060 2024-09-10T05:36:30.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.415+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78fc00a4d0 con 0x7f78f407a060 2024-09-10T05:36:30.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.415+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fb0c50 con 0x5605f8fa4c40 2024-09-10T05:36:30.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.415+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78fc00a4d0 con 0x5605f8fa4c40 2024-09-10T05:36:30.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.415+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fb0c50 con 0x7f78f407a060 2024-09-10T05:36:30.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.415+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78fc00a4d0 con 0x7f78f407a060 2024-09-10T05:36:30.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.415+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fb0c50 con 0x5605f8fac8f0 2024-09-10T05:36:30.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.415+0000 7f7903297640 1 -- 172.21.15.62:0/1649849341 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78f80a8070 con 0x5605f8fac8f0 2024-09-10T05:36:30.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.415+0000 7f7903297640 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fb0c50 con 0x7f78f407a060 2024-09-10T05:36:30.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.415+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78fc00a4d0 con 0x7f78f407a060 2024-09-10T05:36:30.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.415+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fb0c50 con 0x5605f8fa90c0 2024-09-10T05:36:30.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.415+0000 7f7903a98640 1 -- 172.21.15.62:0/1649849341 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78f4077030 con 0x5605f8fa90c0 2024-09-10T05:36:30.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.415+0000 7f7903a98640 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fb0c50 con 0x5605f8fa90c0 2024-09-10T05:36:30.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.419+0000 7f7903a98640 1 -- 172.21.15.62:0/1649849341 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78f4077030 con 0x5605f8fa90c0 2024-09-10T05:36:30.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.419+0000 7f7903a98640 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fb0c50 con 0x5605f8fac8f0 2024-09-10T05:36:30.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.419+0000 7f7903297640 1 -- 172.21.15.62:0/1649849341 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78f80a8070 con 0x5605f8fac8f0 2024-09-10T05:36:30.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.419+0000 7f7903297640 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fb0c50 con 0x5605f8fa90c0 2024-09-10T05:36:30.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.419+0000 7f7903a98640 1 -- 172.21.15.62:0/1649849341 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f78f4077030 con 0x5605f8fa90c0 2024-09-10T05:36:30.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.419+0000 7f7903a98640 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fb0c50 con 0x5605f8fa90c0 2024-09-10T05:36:30.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.419+0000 7f7903a98640 1 -- 172.21.15.62:0/1649849341 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78f4077030 con 0x5605f8fa90c0 2024-09-10T05:36:30.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.419+0000 7f7905f929c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:30.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.419+0000 7f7905f929c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:30.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.419+0000 7f7905f929c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:30.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.419+0000 7f7905f929c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:30.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.419+0000 7f7905f929c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:30.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.419+0000 7f7905f929c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:30.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.419+0000 7f7905f929c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:30.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.419+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fafd70 con 0x5605f8fa4c40 2024-09-10T05:36:30.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.419+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f78fc00a4d0 con 0x5605f8fa4c40 2024-09-10T05:36:30.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.419+0000 7f7905f929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:30.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.419+0000 7f7905f929c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:30.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.419+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fb01f0 con 0x5605f8fa90c0 2024-09-10T05:36:30.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.419+0000 7f7903a98640 1 -- 172.21.15.62:0/1649849341 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f78f4077030 con 0x5605f8fa90c0 2024-09-10T05:36:30.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.419+0000 7f7905f929c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:30.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.419+0000 7f7905f929c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:30.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.419+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fb0610 con 0x5605f8fac8f0 2024-09-10T05:36:30.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.419+0000 7f7903297640 1 -- 172.21.15.62:0/1649849341 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f78f80a8070 con 0x5605f8fac8f0 2024-09-10T05:36:30.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.419+0000 7f7905f929c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:30.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.419+0000 7f7905f929c0 20 zone default found 2024-09-10T05:36:30.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.419+0000 7f7905f929c0 4 Realm: () 2024-09-10T05:36:30.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.419+0000 7f7905f929c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:30.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.419+0000 7f7905f929c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:30.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.419+0000 7f7905f929c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:30.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.419+0000 7f7905f929c0 20 zonegroup default 2024-09-10T05:36:30.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.419+0000 7f7905f929c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:30.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.419+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5605f8faf950 con 0x7f78f407a060 2024-09-10T05:36:30.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.419+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f78fc00a4d0 con 0x7f78f407a060 2024-09-10T05:36:30.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.419+0000 7f7905f929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:30.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.419+0000 7f7905f929c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:30.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.419+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fb34a0 con 0x5605f8fac8f0 2024-09-10T05:36:30.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.419+0000 7f7903297640 1 -- 172.21.15.62:0/1649849341 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f78f80a8070 con 0x5605f8fac8f0 2024-09-10T05:36:30.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.419+0000 7f7905f929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:30.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.419+0000 7f7905f929c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:30.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.419+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fb3840 con 0x5605f8fac8f0 2024-09-10T05:36:30.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.423+0000 7f7903297640 1 -- 172.21.15.62:0/1649849341 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f78f80a8070 con 0x5605f8fac8f0 2024-09-10T05:36:30.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.423+0000 7f7905f929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:30.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.423+0000 7f7905f929c0 20 started sync module instance, tier type = 2024-09-10T05:36:30.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.423+0000 7f7905f929c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:30.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.423+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fb2930 con 0x5605f8fa90c0 2024-09-10T05:36:30.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.423+0000 7f7903a98640 1 -- 172.21.15.62:0/1649849341 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78f4077030 con 0x5605f8fa90c0 2024-09-10T05:36:30.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.423+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94583652036144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fb2930 con 0x5605f8fa90c0 2024-09-10T05:36:30.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.423+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fb4290 con 0x5605f8fa4c40 2024-09-10T05:36:30.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.427+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78fc00a4d0 con 0x5605f8fa4c40 2024-09-10T05:36:30.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.427+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94583652040096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fb4b30 con 0x5605f8fa4c40 2024-09-10T05:36:30.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.427+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fb5530 con 0x5605f8fa90c0 2024-09-10T05:36:30.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.427+0000 7f7903a98640 1 -- 172.21.15.62:0/1649849341 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94583652036144] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78f4077030 con 0x5605f8fa90c0 2024-09-10T05:36:30.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.427+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94583652040096] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78fc00a4d0 con 0x5605f8fa4c40 2024-09-10T05:36:30.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.427+0000 7f7903a98640 1 -- 172.21.15.62:0/1649849341 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78f4077030 con 0x5605f8fa90c0 2024-09-10T05:36:30.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.427+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94583652042368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fb5040 con 0x5605f8fa90c0 2024-09-10T05:36:30.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.427+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fb5a00 con 0x7f78f407a060 2024-09-10T05:36:30.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.431+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78fc00a4d0 con 0x7f78f407a060 2024-09-10T05:36:30.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.431+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94583652046160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fb5e20 con 0x7f78f407a060 2024-09-10T05:36:30.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.431+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fb68d0 con 0x5605f8fa90c0 2024-09-10T05:36:30.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.431+0000 7f7903a98640 1 -- 172.21.15.62:0/1649849341 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94583652042368] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78f4077030 con 0x5605f8fa90c0 2024-09-10T05:36:30.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.431+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94583652046160] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78fc00a4d0 con 0x7f78f407a060 2024-09-10T05:36:30.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.431+0000 7f7903a98640 1 -- 172.21.15.62:0/1649849341 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78f4077030 con 0x5605f8fa90c0 2024-09-10T05:36:30.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.431+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94583652033664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fb5970 con 0x5605f8fa90c0 2024-09-10T05:36:30.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.431+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fb7170 con 0x5605f8fac8f0 2024-09-10T05:36:30.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.435+0000 7f7903297640 1 -- 172.21.15.62:0/1649849341 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78f80a8070 con 0x5605f8fac8f0 2024-09-10T05:36:30.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.435+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94583652052160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fb5970 con 0x5605f8fac8f0 2024-09-10T05:36:30.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.435+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fb7bb0 con 0x5605f8fac8f0 2024-09-10T05:36:30.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.435+0000 7f7903a98640 1 -- 172.21.15.62:0/1649849341 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94583652033664] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78f4077030 con 0x5605f8fa90c0 2024-09-10T05:36:30.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.439+0000 7f7903297640 1 -- 172.21.15.62:0/1649849341 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94583652052160] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78f80a8070 con 0x5605f8fac8f0 2024-09-10T05:36:30.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.439+0000 7f7903297640 1 -- 172.21.15.62:0/1649849341 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78f80a8070 con 0x5605f8fac8f0 2024-09-10T05:36:30.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.439+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94583652053216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fb7700 con 0x5605f8fac8f0 2024-09-10T05:36:30.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.439+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fb8480 con 0x7f78f407a060 2024-09-10T05:36:30.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.439+0000 7f7903297640 1 -- 172.21.15.62:0/1649849341 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94583652053216] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78f80a8070 con 0x5605f8fac8f0 2024-09-10T05:36:30.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.443+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78fc00a4d0 con 0x7f78f407a060 2024-09-10T05:36:30.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.443+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94583652049840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fb7700 con 0x7f78f407a060 2024-09-10T05:36:30.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.443+0000 7f7905f929c0 20 add_watcher() i=0 2024-09-10T05:36:30.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.443+0000 7f7905f929c0 20 add_watcher() i=1 2024-09-10T05:36:30.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.443+0000 7f7905f929c0 20 add_watcher() i=2 2024-09-10T05:36:30.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.443+0000 7f7905f929c0 20 add_watcher() i=3 2024-09-10T05:36:30.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.443+0000 7f7905f929c0 20 add_watcher() i=4 2024-09-10T05:36:30.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.443+0000 7f7905f929c0 20 add_watcher() i=5 2024-09-10T05:36:30.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.443+0000 7f7905f929c0 20 add_watcher() i=6 2024-09-10T05:36:30.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.443+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94583652049840] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78fc00a4d0 con 0x7f78f407a060 2024-09-10T05:36:30.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.443+0000 7f7905f929c0 20 add_watcher() i=7 2024-09-10T05:36:30.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.443+0000 7f7905f929c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:30.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.443+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fbb510 con 0x5605f8fa4c40 2024-09-10T05:36:30.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.443+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f78fc00a4d0 con 0x5605f8fa4c40 2024-09-10T05:36:30.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.443+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94583652057040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fb8aa0 con 0x5605f8fa4c40 2024-09-10T05:36:30.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.447+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94583652057040] v30'52 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f78fc00a4d0 con 0x5605f8fa4c40 2024-09-10T05:36:30.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.447+0000 7f77b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:30.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.447+0000 7f7905f929c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:30.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.447+0000 7f7905f929c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:30.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.447+0000 7f7905f929c0 5 note: GC not initialized 2024-09-10T05:36:30.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.447+0000 7f77b8fe1640 20 reqs_thread_entry: start 2024-09-10T05:36:30.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.447+0000 7f7905f929c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:30.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.447+0000 7f7905f929c0 20 Filter name: none 2024-09-10T05:36:30.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.447+0000 7f77327fc640 20 reqs_thread_entry: start 2024-09-10T05:36:30.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.447+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fdee50 con 0x5605f8fa90c0 2024-09-10T05:36:30.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.447+0000 7f7903a98640 1 -- 172.21.15.62:0/1649849341 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f78f4077030 con 0x5605f8fa90c0 2024-09-10T05:36:30.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.447+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fdee50 con 0x5605f8fa90c0 2024-09-10T05:36:30.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.447+0000 7f7903a98640 1 -- 172.21.15.62:0/1649849341 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f78f4077030 con 0x5605f8fa90c0 2024-09-10T05:36:30.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.451+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fdee10 con 0x5605f8fa90c0 2024-09-10T05:36:30.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.451+0000 7f7903a98640 1 -- 172.21.15.62:0/1649849341 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f78f4077030 con 0x5605f8fa90c0 2024-09-10T05:36:30.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.451+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fdee10 con 0x5605f8fac8f0 2024-09-10T05:36:30.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.451+0000 7f7903297640 1 -- 172.21.15.62:0/1649849341 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f78f80a8070 con 0x5605f8fac8f0 2024-09-10T05:36:30.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.451+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fdee10 con 0x5605f8fa90c0 2024-09-10T05:36:30.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.451+0000 7f7903a98640 1 -- 172.21.15.62:0/1649849341 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f78f4077030 con 0x5605f8fa90c0 2024-09-10T05:36:30.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.451+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fdee10 con 0x5605f8fac8f0 2024-09-10T05:36:30.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.451+0000 7f7903297640 1 -- 172.21.15.62:0/1649849341 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f78f80a8070 con 0x5605f8fac8f0 2024-09-10T05:36:30.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.451+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fdee10 con 0x5605f8fa4c40 2024-09-10T05:36:30.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.451+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f78fc00a4d0 con 0x5605f8fa4c40 2024-09-10T05:36:30.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.451+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fdee10 con 0x5605f8fa4c40 2024-09-10T05:36:30.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.451+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f78fc00a4d0 con 0x5605f8fa4c40 2024-09-10T05:36:30.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.451+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fdee10 con 0x5605f8fac8f0 2024-09-10T05:36:30.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.451+0000 7f7903297640 1 -- 172.21.15.62:0/1649849341 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f78f80a8070 con 0x5605f8fac8f0 2024-09-10T05:36:30.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.451+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fdee10 con 0x5605f8fac8f0 2024-09-10T05:36:30.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.451+0000 7f7903297640 1 -- 172.21.15.62:0/1649849341 <== osd.3 v2:172.21.15.62:6816/2708991149 19 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f78f80a8070 con 0x5605f8fac8f0 2024-09-10T05:36:30.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.451+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fdee10 con 0x5605f8fac8f0 2024-09-10T05:36:30.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.451+0000 7f7903297640 1 -- 172.21.15.62:0/1649849341 <== osd.3 v2:172.21.15.62:6816/2708991149 20 ==== osd_op_reply(72 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f78f80a8070 con 0x5605f8fac8f0 2024-09-10T05:36:30.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.451+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fdee10 con 0x5605f8fa4c40 2024-09-10T05:36:30.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.451+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f78fc00a4d0 con 0x5605f8fa4c40 2024-09-10T05:36:30.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.451+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fdee10 con 0x7f78f407a060 2024-09-10T05:36:30.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.455+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f78fc00a4d0 con 0x7f78f407a060 2024-09-10T05:36:30.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.455+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fdee10 con 0x5605f8fac8f0 2024-09-10T05:36:30.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.455+0000 7f7903297640 1 -- 172.21.15.62:0/1649849341 <== osd.3 v2:172.21.15.62:6816/2708991149 21 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f78f80a8070 con 0x5605f8fac8f0 2024-09-10T05:36:30.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.455+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fdee10 con 0x7f78f407a060 2024-09-10T05:36:30.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.455+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f78fc00a4d0 con 0x7f78f407a060 2024-09-10T05:36:30.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.455+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fdee10 con 0x5605f8fa4c40 2024-09-10T05:36:30.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.455+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f78fc00a4d0 con 0x5605f8fa4c40 2024-09-10T05:36:30.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.455+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fdee10 con 0x5605f8fac8f0 2024-09-10T05:36:30.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.455+0000 7f7903297640 1 -- 172.21.15.62:0/1649849341 <== osd.3 v2:172.21.15.62:6816/2708991149 22 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f78f80a8070 con 0x5605f8fac8f0 2024-09-10T05:36:30.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.455+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fdee10 con 0x5605f8fa4c40 2024-09-10T05:36:30.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.455+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 <== osd.1 v2:172.21.15.62:6808/3442097179 23 ==== osd_op_reply(79 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f78fc00a4d0 con 0x5605f8fa4c40 2024-09-10T05:36:30.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.455+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fdee10 con 0x5605f8fa90c0 2024-09-10T05:36:30.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.455+0000 7f7903a98640 1 -- 172.21.15.62:0/1649849341 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f78f4077030 con 0x5605f8fa90c0 2024-09-10T05:36:30.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.455+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fdee10 con 0x5605f8fa90c0 2024-09-10T05:36:30.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.455+0000 7f7903a98640 1 -- 172.21.15.62:0/1649849341 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f78f4077030 con 0x5605f8fa90c0 2024-09-10T05:36:30.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.455+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fdee10 con 0x5605f8fac8f0 2024-09-10T05:36:30.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.455+0000 7f7903297640 1 -- 172.21.15.62:0/1649849341 <== osd.3 v2:172.21.15.62:6816/2708991149 23 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f78f80a8070 con 0x5605f8fac8f0 2024-09-10T05:36:30.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.455+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fdee10 con 0x5605f8fa90c0 2024-09-10T05:36:30.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.459+0000 7f7903a98640 1 -- 172.21.15.62:0/1649849341 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f78f4077030 con 0x5605f8fa90c0 2024-09-10T05:36:30.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.459+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fdee10 con 0x5605f8fac8f0 2024-09-10T05:36:30.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.459+0000 7f7903297640 1 -- 172.21.15.62:0/1649849341 <== osd.3 v2:172.21.15.62:6816/2708991149 24 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f78f80a8070 con 0x5605f8fac8f0 2024-09-10T05:36:30.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.459+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fdee10 con 0x5605f8fa4c40 2024-09-10T05:36:30.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.459+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 <== osd.1 v2:172.21.15.62:6808/3442097179 24 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f78fc00a4d0 con 0x5605f8fa4c40 2024-09-10T05:36:30.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.459+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fdee10 con 0x5605f8fa90c0 2024-09-10T05:36:30.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.459+0000 7f7903a98640 1 -- 172.21.15.62:0/1649849341 <== osd.0 v2:172.21.15.2:6800/945139080 25 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f78f4077030 con 0x5605f8fa90c0 2024-09-10T05:36:30.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.459+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fdee10 con 0x5605f8fa90c0 2024-09-10T05:36:30.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.459+0000 7f7903a98640 1 -- 172.21.15.62:0/1649849341 <== osd.0 v2:172.21.15.2:6800/945139080 26 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f78f4077030 con 0x5605f8fa90c0 2024-09-10T05:36:30.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.459+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fdee10 con 0x5605f8fa90c0 2024-09-10T05:36:30.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.459+0000 7f7903a98640 1 -- 172.21.15.62:0/1649849341 <== osd.0 v2:172.21.15.2:6800/945139080 27 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f78f4077030 con 0x5605f8fa90c0 2024-09-10T05:36:30.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.459+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fdee10 con 0x5605f8fa4c40 2024-09-10T05:36:30.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.459+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 <== osd.1 v2:172.21.15.62:6808/3442097179 25 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f78fc00a4d0 con 0x5605f8fa4c40 2024-09-10T05:36:30.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.459+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fdee10 con 0x5605f8fac8f0 2024-09-10T05:36:30.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.459+0000 7f7903297640 1 -- 172.21.15.62:0/1649849341 <== osd.3 v2:172.21.15.62:6816/2708991149 25 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f78f80a8070 con 0x5605f8fac8f0 2024-09-10T05:36:30.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.459+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fdee10 con 0x5605f8fac8f0 2024-09-10T05:36:30.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.463+0000 7f7903297640 1 -- 172.21.15.62:0/1649849341 <== osd.3 v2:172.21.15.62:6816/2708991149 26 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f78f80a8070 con 0x5605f8fac8f0 2024-09-10T05:36:30.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.463+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fdee10 con 0x5605f8fa90c0 2024-09-10T05:36:30.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.463+0000 7f7903a98640 1 -- 172.21.15.62:0/1649849341 <== osd.0 v2:172.21.15.2:6800/945139080 28 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f78f4077030 con 0x5605f8fa90c0 2024-09-10T05:36:30.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.463+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fdee10 con 0x5605f8fa4c40 2024-09-10T05:36:30.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.463+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 <== osd.1 v2:172.21.15.62:6808/3442097179 26 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f78fc00a4d0 con 0x5605f8fa4c40 2024-09-10T05:36:30.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.463+0000 7f77b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:30.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.463+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94583652057040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fdee10 con 0x5605f8fa4c40 2024-09-10T05:36:30.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.467+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 <== osd.1 v2:172.21.15.62:6808/3442097179 27 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94583652057040] v30'53 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f78fc00a4d0 con 0x5605f8fa4c40 2024-09-10T05:36:30.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.467+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94583652036144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fdee10 con 0x5605f8fa90c0 2024-09-10T05:36:30.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.467+0000 7f7903a98640 1 -- 172.21.15.62:0/1649849341 <== osd.0 v2:172.21.15.2:6800/945139080 29 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94583652036144] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78f4077030 con 0x5605f8fa90c0 2024-09-10T05:36:30.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.467+0000 7f7905f929c0 20 remove_watcher() i=0 2024-09-10T05:36:30.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.467+0000 7f7905f929c0 2 removed watcher, disabling cache 2024-09-10T05:36:30.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.467+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94583652040096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fdee10 con 0x5605f8fa4c40 2024-09-10T05:36:30.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.467+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 <== osd.1 v2:172.21.15.62:6808/3442097179 28 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94583652040096] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78fc00a4d0 con 0x5605f8fa4c40 2024-09-10T05:36:30.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.467+0000 7f7905f929c0 20 remove_watcher() i=1 2024-09-10T05:36:30.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.467+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94583652042368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fdee10 con 0x5605f8fa90c0 2024-09-10T05:36:30.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.471+0000 7f7903a98640 1 -- 172.21.15.62:0/1649849341 <== osd.0 v2:172.21.15.2:6800/945139080 30 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94583652042368] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78f4077030 con 0x5605f8fa90c0 2024-09-10T05:36:30.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.471+0000 7f7905f929c0 20 remove_watcher() i=2 2024-09-10T05:36:30.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.471+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94583652046160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fdee10 con 0x7f78f407a060 2024-09-10T05:36:30.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.471+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94583652046160] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78fc00a4d0 con 0x7f78f407a060 2024-09-10T05:36:30.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.471+0000 7f7905f929c0 20 remove_watcher() i=3 2024-09-10T05:36:30.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.471+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94583652033664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fdee10 con 0x5605f8fa90c0 2024-09-10T05:36:30.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.475+0000 7f7903a98640 1 -- 172.21.15.62:0/1649849341 <== osd.0 v2:172.21.15.2:6800/945139080 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94583652033664] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78f4077030 con 0x5605f8fa90c0 2024-09-10T05:36:30.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.475+0000 7f7905f929c0 20 remove_watcher() i=4 2024-09-10T05:36:30.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.475+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94583652052160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fdee10 con 0x5605f8fac8f0 2024-09-10T05:36:30.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.475+0000 7f7903297640 1 -- 172.21.15.62:0/1649849341 <== osd.3 v2:172.21.15.62:6816/2708991149 27 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94583652052160] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78f80a8070 con 0x5605f8fac8f0 2024-09-10T05:36:30.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.475+0000 7f7905f929c0 20 remove_watcher() i=5 2024-09-10T05:36:30.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.475+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94583652053216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fdee10 con 0x5605f8fac8f0 2024-09-10T05:36:30.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.479+0000 7f7903297640 1 -- 172.21.15.62:0/1649849341 <== osd.3 v2:172.21.15.62:6816/2708991149 28 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94583652053216] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78f80a8070 con 0x5605f8fac8f0 2024-09-10T05:36:30.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.479+0000 7f7905f929c0 20 remove_watcher() i=6 2024-09-10T05:36:30.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.479+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94583652049840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5605f8fdee10 con 0x7f78f407a060 2024-09-10T05:36:30.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.483+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 <== osd.2 v2:172.21.15.62:6800/2677868286 15 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94583652049840] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78fc00a4d0 con 0x7f78f407a060 2024-09-10T05:36:30.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.483+0000 7f7905f929c0 20 remove_watcher() i=7 2024-09-10T05:36:30.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.483+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5605f8fa90c0 msgr2=0x5605f8fab4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.483+0000 7f7905f929c0 1 --2- 172.21.15.62:0/1649849341 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5605f8fa90c0 0x5605f8fab4b0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.483+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5605f8fa4c40 msgr2=0x5605f8fa70d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.483+0000 7f7905f929c0 1 --2- 172.21.15.62:0/1649849341 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5605f8fa4c40 0x5605f8fa70d0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.483+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f78f407a060 msgr2=0x7f78f40100d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.483+0000 7f7905f929c0 1 --2- 172.21.15.62:0/1649849341 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f78f407a060 0x7f78f40100d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.483+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5605f8fac8f0 msgr2=0x5605f8faece0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.483+0000 7f7905f929c0 1 --2- 172.21.15.62:0/1649849341 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5605f8fac8f0 0x5605f8faece0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.483+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f77cc039a70 msgr2=0x7f77cc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.483+0000 7f7905f929c0 1 --2- 172.21.15.62:0/1649849341 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f77cc039a70 0x7f77cc03bf30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f78f80ac040 tx=0x7f78f80a8000 comp rx=0 tx=0).stop 2024-09-10T05:36:30.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.483+0000 7f7904299640 1 -- 172.21.15.62:0/1649849341 reap_dead start 2024-09-10T05:36:30.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.483+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605f8de9a40 msgr2=0x5605f8f99ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.483+0000 7f7905f929c0 1 --2- 172.21.15.62:0/1649849341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605f8de9a40 0x5605f8f99ca0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f78f404d720 tx=0x7f78f4005f40 comp rx=0 tx=0).stop 2024-09-10T05:36:30.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.483+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 shutdown_connections 2024-09-10T05:36:30.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.483+0000 7f7905f929c0 1 --2- 172.21.15.62:0/1649849341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605f8de9a40 0x5605f8f99ca0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.483+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 >> 172.21.15.62:0/1649849341 conn(0x5605f8de7bf0 msgr2=0x5605f8de5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:30.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.483+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 shutdown_connections 2024-09-10T05:36:30.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.483+0000 7f7905f929c0 1 -- 172.21.15.62:0/1649849341 wait complete. 2024-09-10T05:36:30.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.483+0000 7f7905f929c0 1 -- 172.21.15.62:0/713421184 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f77dc039a70 msgr2=0x7f77dc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.483+0000 7f7905f929c0 1 --2- 172.21.15.62:0/713421184 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f77dc039a70 0x7f77dc03bf30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x5605f8f65320 tx=0x7f78f8005a10 comp rx=0 tx=0).stop 2024-09-10T05:36:30.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.483+0000 7f7905f929c0 1 -- 172.21.15.62:0/713421184 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605f8f81f90 msgr2=0x5605f8f823b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.483+0000 7f7905f929c0 1 --2- 172.21.15.62:0/713421184 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605f8f81f90 0x5605f8f823b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f78f4018fd0 tx=0x7f78f4024750 comp rx=0 tx=0).stop 2024-09-10T05:36:30.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.483+0000 7f7905f929c0 1 -- 172.21.15.62:0/713421184 shutdown_connections 2024-09-10T05:36:30.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.483+0000 7f7905f929c0 1 --2- 172.21.15.62:0/713421184 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f77dc039a70 0x7f77dc03bf30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.483+0000 7f7905f929c0 1 --2- 172.21.15.62:0/713421184 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605f8f81f90 0x5605f8f823b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.483+0000 7f7905f929c0 1 -- 172.21.15.62:0/713421184 >> 172.21.15.62:0/713421184 conn(0x5605f8f77940 msgr2=0x5605f8f77d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:30.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.483+0000 7f7905f929c0 1 -- 172.21.15.62:0/713421184 shutdown_connections 2024-09-10T05:36:30.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.483+0000 7f7905f929c0 1 -- 172.21.15.62:0/713421184 wait complete. 2024-09-10T05:36:30.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.483+0000 7f7905f929c0 1 -- 172.21.15.62:0/2450393378 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5605f8f6c6c0 msgr2=0x5605f8f6eab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.483+0000 7f7905f929c0 1 --2- 172.21.15.62:0/2450393378 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5605f8f6c6c0 0x5605f8f6eab0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.483+0000 7f7905f929c0 1 -- 172.21.15.62:0/2450393378 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5605f8f69030 msgr2=0x5605f8f6b420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.483+0000 7f7905f929c0 1 --2- 172.21.15.62:0/2450393378 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5605f8f69030 0x5605f8f6b420 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.483+0000 7f7905f929c0 1 -- 172.21.15.62:0/2450393378 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5605f8f70e60 msgr2=0x5605f8f73250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.483+0000 7f7905f929c0 1 --2- 172.21.15.62:0/2450393378 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5605f8f70e60 0x5605f8f73250 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.483+0000 7f7905f929c0 1 -- 172.21.15.62:0/2450393378 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f77ec039a70 msgr2=0x7f77ec03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.483+0000 7f7905f929c0 1 --2- 172.21.15.62:0/2450393378 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f77ec039a70 0x7f77ec03bf30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f78f80ae000 tx=0x7f78f80a6000 comp rx=0 tx=0).stop 2024-09-10T05:36:30.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.483+0000 7f7905f929c0 1 -- 172.21.15.62:0/2450393378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605f8e711d0 msgr2=0x5605f8f63ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.483+0000 7f7905f929c0 1 --2- 172.21.15.62:0/2450393378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605f8e711d0 0x5605f8f63ed0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x5605f8f5d790 tx=0x7f78f40040f0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.483+0000 7f7904299640 1 -- 172.21.15.62:0/2450393378 reap_dead start 2024-09-10T05:36:30.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.483+0000 7f7905f929c0 1 -- 172.21.15.62:0/2450393378 shutdown_connections 2024-09-10T05:36:30.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.483+0000 7f7905f929c0 1 -- 172.21.15.62:0/2450393378 >> 172.21.15.62:0/2450393378 conn(0x5605f8de4ae0 msgr2=0x5605f8f56e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:30.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.483+0000 7f7905f929c0 1 -- 172.21.15.62:0/2450393378 shutdown_connections 2024-09-10T05:36:30.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.483+0000 7f7905f929c0 1 -- 172.21.15.62:0/2450393378 wait complete. 2024-09-10T05:36:30.498 INFO:teuthology.orchestra.run.smithi062.stdout:{"entries":[],"summary":[]} 2024-09-10T05:36:30.499 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-10T05:36:30.499 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-10T05:36:30.499 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-10T05:36:30.499 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-10T05:36:30.572 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:30.573 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:30.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.571+0000 7f1a2467d9c0 1 Processor -- start 2024-09-10T05:36:30.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.571+0000 7f1a2467d9c0 1 -- start start 2024-09-10T05:36:30.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.571+0000 7f1a2467d9c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55dcd431f350 0x55dcd4321740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.571+0000 7f1a2467d9c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55dcd41cd9c0 con 0x55dcd431b200 2024-09-10T05:36:30.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.571+0000 7f1a2467d9c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x55dcd421d6d0 con 0x55dcd431f350 2024-09-10T05:36:30.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.571+0000 7f1a21982640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55dcd431f350 0x55dcd4321740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.571+0000 7f1a22183640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x55dcd431b200 0x55dcd431b5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:38456/0 (socket says 172.21.15.62:38456) 2024-09-10T05:36:30.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.571+0000 7f1a22183640 1 -- 172.21.15.62:0/1327052302 learned_addr learned my addr 172.21.15.62:0/1327052302 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-10T05:36:30.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.571+0000 7f1a21181640 1 -- 172.21.15.62:0/1327052302 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4142887540 0 0) 0x55dcd41cd9c0 con 0x55dcd431b200 2024-09-10T05:36:30.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.571+0000 7f1a21181640 1 -- 172.21.15.62:0/1327052302 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a0c001e20 con 0x55dcd431b200 2024-09-10T05:36:30.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.571+0000 7f1a21982640 1 -- 172.21.15.62:0/1327052302 >> v1:172.21.15.2:6789/0 conn(0x55dcd431b200 legacy=0x55dcd431b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.571+0000 7f1a21982640 1 -- 172.21.15.62:0/1327052302 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dcd41c1ca0 con 0x55dcd431f350 2024-09-10T05:36:30.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.575+0000 7f1a21982640 1 --2- 172.21.15.62:0/1327052302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dcd431f350 0x55dcd4321740 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1a1800a480 tx=0x7f1a1801b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b9847ff46dda0d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.575+0000 7f1a21181640 1 -- 172.21.15.62:0/1327052302 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a180aa570 con 0x55dcd431f350 2024-09-10T05:36:30.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.575+0000 7f1a21181640 1 -- 172.21.15.62:0/1327052302 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a180af070 con 0x55dcd431f350 2024-09-10T05:36:30.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.575+0000 7f1a21181640 1 -- 172.21.15.62:0/1327052302 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a180aa840 con 0x55dcd431f350 2024-09-10T05:36:30.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.575+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/1327052302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dcd431f350 msgr2=0x55dcd4321740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.575+0000 7f1a2467d9c0 1 --2- 172.21.15.62:0/1327052302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dcd431f350 0x55dcd4321740 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1a1800a480 tx=0x7f1a1801b310 comp rx=0 tx=0).stop 2024-09-10T05:36:30.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.575+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/1327052302 shutdown_connections 2024-09-10T05:36:30.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.575+0000 7f1a2467d9c0 1 --2- 172.21.15.62:0/1327052302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dcd431f350 0x55dcd4321740 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.575+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/1327052302 >> 172.21.15.62:0/1327052302 conn(0x55dcd428eb10 msgr2=0x55dcd428ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:30.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.575+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/1327052302 shutdown_connections 2024-09-10T05:36:30.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.575+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/1327052302 wait complete. 2024-09-10T05:36:30.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.591+0000 7f1a2467d9c0 1 Processor -- start 2024-09-10T05:36:30.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.591+0000 7f1a2467d9c0 1 -- start start 2024-09-10T05:36:30.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.591+0000 7f1a2467d9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dcd431b200 0x55dcd44066d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.591+0000 7f1a2467d9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55dcd4221680 con 0x55dcd431b200 2024-09-10T05:36:30.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.591+0000 7f1a22183640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dcd431b200 0x55dcd44066d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.591+0000 7f1a22183640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dcd431b200 0x55dcd44066d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51142/0 (socket says 172.21.15.62:51142) 2024-09-10T05:36:30.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.591+0000 7f1a22183640 1 -- 172.21.15.62:0/3626538552 learned_addr learned my addr 172.21.15.62:0/3626538552 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:30.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.591+0000 7f1a22183640 1 -- 172.21.15.62:0/3626538552 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dcd419cda0 con 0x55dcd431b200 2024-09-10T05:36:30.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.591+0000 7f1a22183640 1 --2- 172.21.15.62:0/3626538552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dcd431b200 0x55dcd44066d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c0016a0 tx=0x7f1a1c001b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac026d7976bb8f40 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.591+0000 7f1910608640 1 -- 172.21.15.62:0/3626538552 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a1c004530 con 0x55dcd431b200 2024-09-10T05:36:30.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.591+0000 7f1910608640 1 -- 172.21.15.62:0/3626538552 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a1c0046d0 con 0x55dcd431b200 2024-09-10T05:36:30.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.591+0000 7f1910608640 1 -- 172.21.15.62:0/3626538552 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a1c0049f0 con 0x55dcd431b200 2024-09-10T05:36:30.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.595+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/3626538552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dcd431b200 msgr2=0x55dcd44066d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.595+0000 7f1a2467d9c0 1 --2- 172.21.15.62:0/3626538552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dcd431b200 0x55dcd44066d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c0016a0 tx=0x7f1a1c001b60 comp rx=0 tx=0).stop 2024-09-10T05:36:30.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.595+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/3626538552 shutdown_connections 2024-09-10T05:36:30.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.595+0000 7f1a2467d9c0 1 --2- 172.21.15.62:0/3626538552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dcd431b200 0x55dcd44066d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.595+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/3626538552 >> 172.21.15.62:0/3626538552 conn(0x55dcd428eb10 msgr2=0x55dcd4402310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:30.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.595+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/3626538552 shutdown_connections 2024-09-10T05:36:30.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.595+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/3626538552 wait complete. 2024-09-10T05:36:30.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.595+0000 7f1a2467d9c0 1 Processor -- start 2024-09-10T05:36:30.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.595+0000 7f1a2467d9c0 1 -- start start 2024-09-10T05:36:30.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.595+0000 7f1a2467d9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dcd431b200 0x55dcd440dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.595+0000 7f1a2467d9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55dcd41c3a50 con 0x55dcd431b200 2024-09-10T05:36:30.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.595+0000 7f1a22183640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dcd431b200 0x55dcd440dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.595+0000 7f1a22183640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dcd431b200 0x55dcd440dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51152/0 (socket says 172.21.15.62:51152) 2024-09-10T05:36:30.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.595+0000 7f1a22183640 1 -- 172.21.15.62:0/2563005830 learned_addr learned my addr 172.21.15.62:0/2563005830 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:30.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.595+0000 7f1a22183640 1 -- 172.21.15.62:0/2563005830 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dcd440e2a0 con 0x55dcd431b200 2024-09-10T05:36:30.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.595+0000 7f1a22183640 1 --2- 172.21.15.62:0/2563005830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dcd431b200 0x55dcd440dd40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c001ba0 tx=0x7f1a1c004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.595+0000 7f190ee05640 1 -- 172.21.15.62:0/2563005830 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a1c013760 con 0x55dcd431b200 2024-09-10T05:36:30.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.595+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/2563005830 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dcd440e530 con 0x55dcd431b200 2024-09-10T05:36:30.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.595+0000 7f190ee05640 1 -- 172.21.15.62:0/2563005830 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a1c013900 con 0x55dcd431b200 2024-09-10T05:36:30.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.595+0000 7f190ee05640 1 -- 172.21.15.62:0/2563005830 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a1c013c00 con 0x55dcd431b200 2024-09-10T05:36:30.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.595+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/2563005830 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dcd440eee0 con 0x55dcd431b200 2024-09-10T05:36:30.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.599+0000 7f190ee05640 1 -- 172.21.15.62:0/2563005830 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1a1c010070 con 0x55dcd431b200 2024-09-10T05:36:30.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.599+0000 7f190ee05640 1 --2- 172.21.15.62:0/2563005830 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1908039a70 0x7f190803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.599+0000 7f190ee05640 1 -- 172.21.15.62:0/2563005830 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f1a1c018070 con 0x55dcd431b200 2024-09-10T05:36:30.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.599+0000 7f1a21982640 1 --2- 172.21.15.62:0/2563005830 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1908039a70 0x7f190803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.599+0000 7f1a2467d9c0 1 --2- 172.21.15.62:0/2563005830 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55dcd431f350 0x55dcd4414eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.599+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/2563005830 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dcd44153f0 con 0x55dcd431f350 2024-09-10T05:36:30.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.599+0000 7f1a22984640 1 --2- 172.21.15.62:0/2563005830 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55dcd431f350 0x55dcd4414eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.599+0000 7f1a21982640 1 --2- 172.21.15.62:0/2563005830 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1908039a70 0x7f190803bf30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1a180ae000 tx=0x7f1a180a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.599+0000 7f1a22984640 1 --2- 172.21.15.62:0/2563005830 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55dcd431f350 0x55dcd4414eb0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.599+0000 7f1a22984640 1 -- 172.21.15.62:0/2563005830 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1a140083f0 con 0x55dcd431f350 2024-09-10T05:36:30.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.599+0000 7f1a2467d9c0 1 --2- 172.21.15.62:0/2563005830 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55dcd44161a0 0x55dcd4418590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.599+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/2563005830 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dcd4418bc0 con 0x55dcd44161a0 2024-09-10T05:36:30.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.599+0000 7f1a22183640 1 --2- 172.21.15.62:0/2563005830 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55dcd44161a0 0x55dcd4418590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.599+0000 7f1a22183640 1 --2- 172.21.15.62:0/2563005830 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55dcd44161a0 0x55dcd4418590 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.599+0000 7f1a22183640 1 -- 172.21.15.62:0/2563005830 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1a1c01b030 con 0x55dcd44161a0 2024-09-10T05:36:30.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.599+0000 7f1a2467d9c0 1 --2- 172.21.15.62:0/2563005830 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55dcd441a980 0x55dcd441cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.599+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/2563005830 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dcd441d460 con 0x55dcd441a980 2024-09-10T05:36:30.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.599+0000 7f1a21982640 1 --2- 172.21.15.62:0/2563005830 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55dcd441a980 0x55dcd441cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.603+0000 7f1a21982640 1 --2- 172.21.15.62:0/2563005830 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55dcd441a980 0x55dcd441cd70 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.603+0000 7f1a21982640 1 -- 172.21.15.62:0/2563005830 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1a180a8070 con 0x55dcd441a980 2024-09-10T05:36:30.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.603+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/2563005830 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dcd4419820 con 0x55dcd44161a0 2024-09-10T05:36:30.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.603+0000 7f1a22183640 1 -- 172.21.15.62:0/2563005830 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1a1c01b030 con 0x55dcd44161a0 2024-09-10T05:36:30.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.603+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/2563005830 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dcd4419c80 con 0x55dcd441a980 2024-09-10T05:36:30.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.603+0000 7f1a21982640 1 -- 172.21.15.62:0/2563005830 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1a180a8070 con 0x55dcd441a980 2024-09-10T05:36:30.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.603+0000 7f1a2467d9c0 1 Processor -- start 2024-09-10T05:36:30.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.603+0000 7f1a2467d9c0 1 -- start start 2024-09-10T05:36:30.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.603+0000 7f1a2467d9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dcd442ba80 0x55dcd442bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.603+0000 7f1a2467d9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55dcd422e450 con 0x55dcd442ba80 2024-09-10T05:36:30.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.603+0000 7f1a22183640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dcd442ba80 0x55dcd442bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.603+0000 7f1a22183640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dcd442ba80 0x55dcd442bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51164/0 (socket says 172.21.15.62:51164) 2024-09-10T05:36:30.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.603+0000 7f1a22183640 1 -- 172.21.15.62:0/974287386 learned_addr learned my addr 172.21.15.62:0/974287386 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:30.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.603+0000 7f1a22183640 1 -- 172.21.15.62:0/974287386 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dcd442c4e0 con 0x55dcd442ba80 2024-09-10T05:36:30.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.603+0000 7f1a22183640 1 --2- 172.21.15.62:0/974287386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dcd442ba80 0x55dcd442bea0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c010a90 tx=0x7f1a1c042ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.603+0000 7f1907fff640 1 -- 172.21.15.62:0/974287386 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a1c037070 con 0x55dcd442ba80 2024-09-10T05:36:30.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.603+0000 7f1907fff640 1 -- 172.21.15.62:0/974287386 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a1c028ca0 con 0x55dcd442ba80 2024-09-10T05:36:30.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.603+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/974287386 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dcd442cd40 con 0x55dcd442ba80 2024-09-10T05:36:30.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.603+0000 7f1907fff640 1 -- 172.21.15.62:0/974287386 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a1c028e50 con 0x55dcd442ba80 2024-09-10T05:36:30.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.603+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/974287386 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dcd442d2b0 con 0x55dcd442ba80 2024-09-10T05:36:30.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.607+0000 7f1907fff640 1 -- 172.21.15.62:0/974287386 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1a1c03a070 con 0x55dcd442ba80 2024-09-10T05:36:30.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.607+0000 7f1907fff640 1 --2- 172.21.15.62:0/974287386 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f18fc039bc0 0x7f18fc03c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.607+0000 7f1907fff640 1 -- 172.21.15.62:0/974287386 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f1a1c051d00 con 0x55dcd442ba80 2024-09-10T05:36:30.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.607+0000 7f1a21982640 1 --2- 172.21.15.62:0/974287386 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f18fc039bc0 0x7f18fc03c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.607+0000 7f1a2467d9c0 1 Processor -- start 2024-09-10T05:36:30.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.607+0000 7f1a2467d9c0 1 -- start start 2024-09-10T05:36:30.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.607+0000 7f1a21982640 1 --2- 172.21.15.62:0/974287386 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f18fc039bc0 0x7f18fc03c080 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x55dcd440f280 tx=0x7f1a18005a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.607+0000 7f1a2467d9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dcd44381c0 0x55dcd44385a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.607+0000 7f1a2467d9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55dcd4406f20 con 0x55dcd44381c0 2024-09-10T05:36:30.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.607+0000 7f1a22183640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dcd44381c0 0x55dcd44385a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.607+0000 7f1a22183640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dcd44381c0 0x55dcd44385a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51176/0 (socket says 172.21.15.62:51176) 2024-09-10T05:36:30.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.607+0000 7f1a22183640 1 -- 172.21.15.62:0/1402378741 learned_addr learned my addr 172.21.15.62:0/1402378741 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:30.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.607+0000 7f1a22183640 1 -- 172.21.15.62:0/1402378741 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dcd4438b70 con 0x55dcd44381c0 2024-09-10T05:36:30.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.607+0000 7f1a22183640 1 --2- 172.21.15.62:0/1402378741 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dcd44381c0 0x55dcd44385a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c010bd0 tx=0x7f1a1c0479b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ab3623e8320be9b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.607+0000 7f1905ffb640 1 -- 172.21.15.62:0/1402378741 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a1c063070 con 0x55dcd44381c0 2024-09-10T05:36:30.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.607+0000 7f1905ffb640 1 -- 172.21.15.62:0/1402378741 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a1c01d350 con 0x55dcd44381c0 2024-09-10T05:36:30.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.607+0000 7f1905ffb640 1 -- 172.21.15.62:0/1402378741 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a1c0117a0 con 0x55dcd44381c0 2024-09-10T05:36:30.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.607+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/1402378741 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dcd44381c0 msgr2=0x55dcd44385a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.607+0000 7f1a2467d9c0 1 --2- 172.21.15.62:0/1402378741 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dcd44381c0 0x55dcd44385a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c010bd0 tx=0x7f1a1c0479b0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.607+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/1402378741 shutdown_connections 2024-09-10T05:36:30.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.607+0000 7f1a2467d9c0 1 --2- 172.21.15.62:0/1402378741 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dcd44381c0 0x55dcd44385a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.607+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/1402378741 >> 172.21.15.62:0/1402378741 conn(0x55dcd44345f0 msgr2=0x55dcd4432830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:30.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.611+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/1402378741 shutdown_connections 2024-09-10T05:36:30.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.611+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/1402378741 wait complete. 2024-09-10T05:36:30.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.611+0000 7f1a2467d9c0 1 Processor -- start 2024-09-10T05:36:30.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.611+0000 7f1a2467d9c0 1 -- start start 2024-09-10T05:36:30.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.611+0000 7f1a2467d9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dcd44381c0 0x55dcd443f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.611+0000 7f1a2467d9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55dcd4439050 con 0x55dcd44381c0 2024-09-10T05:36:30.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.611+0000 7f1a22183640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dcd44381c0 0x55dcd443f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.611+0000 7f1a22183640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dcd44381c0 0x55dcd443f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51190/0 (socket says 172.21.15.62:51190) 2024-09-10T05:36:30.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.611+0000 7f1a22183640 1 -- 172.21.15.62:0/211935648 learned_addr learned my addr 172.21.15.62:0/211935648 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:30.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.611+0000 7f1a22183640 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dcd443fa00 con 0x55dcd44381c0 2024-09-10T05:36:30.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.611+0000 7f1a22183640 1 --2- 172.21.15.62:0/211935648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dcd44381c0 0x55dcd443f4a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c04f400 tx=0x7f1a1c037ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.611+0000 7f18f3fff640 1 -- 172.21.15.62:0/211935648 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a1c06e020 con 0x55dcd44381c0 2024-09-10T05:36:30.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.611+0000 7f18f3fff640 1 -- 172.21.15.62:0/211935648 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a1c064040 con 0x55dcd44381c0 2024-09-10T05:36:30.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.611+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dcd443fa00 con 0x55dcd44381c0 2024-09-10T05:36:30.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.611+0000 7f18f3fff640 1 -- 172.21.15.62:0/211935648 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a1c063070 con 0x55dcd44381c0 2024-09-10T05:36:30.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.611+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dcd443fa00 con 0x55dcd44381c0 2024-09-10T05:36:30.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.611+0000 7f1a2467d9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:30.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.611+0000 7f18f3fff640 1 -- 172.21.15.62:0/211935648 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1a1c071020 con 0x55dcd44381c0 2024-09-10T05:36:30.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.615+0000 7f18f3fff640 1 --2- 172.21.15.62:0/211935648 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f18ec039a70 0x7f18ec03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.615+0000 7f18f3fff640 1 -- 172.21.15.62:0/211935648 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f1a1c05b070 con 0x55dcd44381c0 2024-09-10T05:36:30.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.615+0000 7f1a2467d9c0 1 --2- 172.21.15.62:0/211935648 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55dcd444a410 0x55dcd444c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.615+0000 7f1a21982640 1 --2- 172.21.15.62:0/211935648 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f18ec039a70 0x7f18ec03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.615+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dcd444cff0 con 0x55dcd444a410 2024-09-10T05:36:30.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.615+0000 7f1a22984640 1 --2- 172.21.15.62:0/211935648 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55dcd444a410 0x55dcd444c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.615+0000 7f1a22984640 1 --2- 172.21.15.62:0/211935648 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55dcd444a410 0x55dcd444c8a0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.615+0000 7f1a21982640 1 --2- 172.21.15.62:0/211935648 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f18ec039a70 0x7f18ec03bf30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1a1801b350 tx=0x7f1a180a8000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.615+0000 7f1a22984640 1 -- 172.21.15.62:0/211935648 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1a140083f0 con 0x55dcd444a410 2024-09-10T05:36:30.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.615+0000 7f1a2467d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:30.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.615+0000 7f1a2467d9c0 20 realm 2024-09-10T05:36:30.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.615+0000 7f1a2467d9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:30.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.615+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dcd44497e0 con 0x55dcd444a410 2024-09-10T05:36:30.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.615+0000 7f1a22984640 1 -- 172.21.15.62:0/211935648 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1a140083f0 con 0x55dcd444a410 2024-09-10T05:36:30.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.615+0000 7f1a2467d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:30.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.615+0000 7f1a2467d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:30.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.615+0000 7f1a2467d9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:30.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.615+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dcd444dab0 con 0x55dcd444a410 2024-09-10T05:36:30.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.615+0000 7f1a22984640 1 -- 172.21.15.62:0/211935648 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1a140083f0 con 0x55dcd444a410 2024-09-10T05:36:30.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.615+0000 7f1a2467d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:30.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.615+0000 7f1a2467d9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:30.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.615+0000 7f1a2467d9c0 1 --2- 172.21.15.62:0/211935648 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55dcd444e890 0x55dcd4450c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.615+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dcd4451310 con 0x55dcd444e890 2024-09-10T05:36:30.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.615+0000 7f1a22183640 1 --2- 172.21.15.62:0/211935648 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55dcd444e890 0x55dcd4450c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.615+0000 7f1a22183640 1 --2- 172.21.15.62:0/211935648 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55dcd444e890 0x55dcd4450c80 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.615+0000 7f1a22183640 1 -- 172.21.15.62:0/211935648 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1a1c039030 con 0x55dcd444e890 2024-09-10T05:36:30.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.615+0000 7f1a2467d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:30.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.615+0000 7f1a2467d9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:30.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.615+0000 7f1a2467d9c0 1 --2- 172.21.15.62:0/211935648 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55dcd44520c0 0x55dcd44544b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.615+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dcd4454b50 con 0x55dcd44520c0 2024-09-10T05:36:30.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.615+0000 7f1a21982640 1 --2- 172.21.15.62:0/211935648 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55dcd44520c0 0x55dcd44544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.619+0000 7f1a21982640 1 --2- 172.21.15.62:0/211935648 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55dcd44520c0 0x55dcd44544b0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.619+0000 7f1a21982640 1 -- 172.21.15.62:0/211935648 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1a180a8070 con 0x55dcd44520c0 2024-09-10T05:36:30.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.619+0000 7f1a2467d9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:30.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.619+0000 7f1a2467d9c0 20 searching for the correct realm 2024-09-10T05:36:30.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.619+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dcd4456420 con 0x55dcd44520c0 2024-09-10T05:36:30.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.619+0000 7f1a21982640 1 -- 172.21.15.62:0/211935648 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a180a8070 con 0x55dcd44520c0 2024-09-10T05:36:30.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.619+0000 7f1a21982640 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dcd4456420 con 0x55dcd444e890 2024-09-10T05:36:30.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.619+0000 7f1a22183640 1 -- 172.21.15.62:0/211935648 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a1c039030 con 0x55dcd444e890 2024-09-10T05:36:30.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.619+0000 7f1a22183640 1 --2- 172.21.15.62:0/211935648 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f1a1c073020 0x7f1a1c041280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.619+0000 7f1a22183640 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dcd4456420 con 0x7f1a1c073020 2024-09-10T05:36:30.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.619+0000 7f1a22984640 1 --2- 172.21.15.62:0/211935648 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f1a1c073020 0x7f1a1c041280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.619+0000 7f1a22984640 1 --2- 172.21.15.62:0/211935648 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f1a1c073020 0x7f1a1c041280 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.619+0000 7f1a22984640 1 -- 172.21.15.62:0/211935648 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a140083f0 con 0x7f1a1c073020 2024-09-10T05:36:30.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.619+0000 7f1a22984640 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dcd4456420 con 0x55dcd444a410 2024-09-10T05:36:30.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.619+0000 7f1a22984640 1 -- 172.21.15.62:0/211935648 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a140083f0 con 0x55dcd444a410 2024-09-10T05:36:30.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.619+0000 7f1a22984640 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dcd4456420 con 0x55dcd444a410 2024-09-10T05:36:30.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.619+0000 7f1a22984640 1 -- 172.21.15.62:0/211935648 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a140083f0 con 0x55dcd444a410 2024-09-10T05:36:30.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.619+0000 7f1a22984640 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dcd4456420 con 0x55dcd44520c0 2024-09-10T05:36:30.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.619+0000 7f1a21982640 1 -- 172.21.15.62:0/211935648 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a180a8070 con 0x55dcd44520c0 2024-09-10T05:36:30.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.619+0000 7f1a21982640 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dcd4456420 con 0x55dcd444a410 2024-09-10T05:36:30.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.619+0000 7f1a22984640 1 -- 172.21.15.62:0/211935648 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a140083f0 con 0x55dcd444a410 2024-09-10T05:36:30.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.619+0000 7f1a22984640 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dcd4456420 con 0x55dcd444e890 2024-09-10T05:36:30.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.623+0000 7f1a22183640 1 -- 172.21.15.62:0/211935648 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a1c039030 con 0x55dcd444e890 2024-09-10T05:36:30.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.623+0000 7f1a22183640 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dcd4456420 con 0x55dcd444e890 2024-09-10T05:36:30.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.623+0000 7f1a22183640 1 -- 172.21.15.62:0/211935648 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a1c039030 con 0x55dcd444e890 2024-09-10T05:36:30.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.623+0000 7f1a22183640 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dcd4456420 con 0x55dcd444a410 2024-09-10T05:36:30.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.623+0000 7f1a22984640 1 -- 172.21.15.62:0/211935648 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a140083f0 con 0x55dcd444a410 2024-09-10T05:36:30.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.623+0000 7f1a22984640 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dcd4456420 con 0x7f1a1c073020 2024-09-10T05:36:30.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.623+0000 7f1a22984640 1 -- 172.21.15.62:0/211935648 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a140083f0 con 0x7f1a1c073020 2024-09-10T05:36:30.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.623+0000 7f1a22984640 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dcd4456420 con 0x55dcd444a410 2024-09-10T05:36:30.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.623+0000 7f1a22984640 1 -- 172.21.15.62:0/211935648 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a140083f0 con 0x55dcd444a410 2024-09-10T05:36:30.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.623+0000 7f1a22984640 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dcd4456420 con 0x7f1a1c073020 2024-09-10T05:36:30.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.623+0000 7f1a22984640 1 -- 172.21.15.62:0/211935648 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1a140083f0 con 0x7f1a1c073020 2024-09-10T05:36:30.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.623+0000 7f1a22984640 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dcd4456420 con 0x55dcd444e890 2024-09-10T05:36:30.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.623+0000 7f1a22183640 1 -- 172.21.15.62:0/211935648 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a1c039030 con 0x55dcd444e890 2024-09-10T05:36:30.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.623+0000 7f1a22183640 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dcd4456420 con 0x55dcd44520c0 2024-09-10T05:36:30.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.623+0000 7f1a21982640 1 -- 172.21.15.62:0/211935648 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a180a8070 con 0x55dcd44520c0 2024-09-10T05:36:30.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.623+0000 7f1a21982640 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dcd4456420 con 0x55dcd444a410 2024-09-10T05:36:30.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.623+0000 7f1a22984640 1 -- 172.21.15.62:0/211935648 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a140083f0 con 0x55dcd444a410 2024-09-10T05:36:30.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.623+0000 7f1a22984640 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dcd4456420 con 0x55dcd444e890 2024-09-10T05:36:30.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.623+0000 7f1a22183640 1 -- 172.21.15.62:0/211935648 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a1c039030 con 0x55dcd444e890 2024-09-10T05:36:30.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.623+0000 7f1a22183640 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dcd4456420 con 0x55dcd44520c0 2024-09-10T05:36:30.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.627+0000 7f1a21982640 1 -- 172.21.15.62:0/211935648 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 30 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f1a180a8070 con 0x55dcd44520c0 2024-09-10T05:36:30.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.627+0000 7f1a21982640 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dcd4456420 con 0x55dcd444a410 2024-09-10T05:36:30.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.627+0000 7f1a22984640 1 -- 172.21.15.62:0/211935648 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a140083f0 con 0x55dcd444a410 2024-09-10T05:36:30.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.627+0000 7f1a22984640 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dcd4456420 con 0x55dcd444a410 2024-09-10T05:36:30.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.627+0000 7f1a22984640 1 -- 172.21.15.62:0/211935648 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1a140083f0 con 0x55dcd444a410 2024-09-10T05:36:30.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.627+0000 7f1a22984640 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dcd4456420 con 0x55dcd444a410 2024-09-10T05:36:30.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.627+0000 7f1a22984640 1 -- 172.21.15.62:0/211935648 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a140083f0 con 0x55dcd444a410 2024-09-10T05:36:30.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.627+0000 7f1a22984640 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dcd4456420 con 0x55dcd44520c0 2024-09-10T05:36:30.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.627+0000 7f1a21982640 1 -- 172.21.15.62:0/211935648 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a180a8070 con 0x55dcd44520c0 2024-09-10T05:36:30.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.627+0000 7f1a21982640 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dcd4456420 con 0x7f1a1c073020 2024-09-10T05:36:30.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.627+0000 7f1a22984640 1 -- 172.21.15.62:0/211935648 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a140083f0 con 0x7f1a1c073020 2024-09-10T05:36:30.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.627+0000 7f1a22984640 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dcd4456420 con 0x55dcd444a410 2024-09-10T05:36:30.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.627+0000 7f1a22984640 1 -- 172.21.15.62:0/211935648 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a140083f0 con 0x55dcd444a410 2024-09-10T05:36:30.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.627+0000 7f1a22984640 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dcd4456420 con 0x7f1a1c073020 2024-09-10T05:36:30.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.627+0000 7f1a22984640 1 -- 172.21.15.62:0/211935648 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a140083f0 con 0x7f1a1c073020 2024-09-10T05:36:30.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.627+0000 7f1a22984640 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dcd4456420 con 0x55dcd44520c0 2024-09-10T05:36:30.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.627+0000 7f1a21982640 1 -- 172.21.15.62:0/211935648 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a180a8070 con 0x55dcd44520c0 2024-09-10T05:36:30.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.627+0000 7f1a21982640 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dcd4456420 con 0x7f1a1c073020 2024-09-10T05:36:30.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.627+0000 7f1a22984640 1 -- 172.21.15.62:0/211935648 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a140083f0 con 0x7f1a1c073020 2024-09-10T05:36:30.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.627+0000 7f1a22984640 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dcd4456420 con 0x55dcd444e890 2024-09-10T05:36:30.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.627+0000 7f1a22183640 1 -- 172.21.15.62:0/211935648 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a1c039030 con 0x55dcd444e890 2024-09-10T05:36:30.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.627+0000 7f1a22183640 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dcd4456420 con 0x55dcd444e890 2024-09-10T05:36:30.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.631+0000 7f1a22183640 1 -- 172.21.15.62:0/211935648 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a1c039030 con 0x55dcd444e890 2024-09-10T05:36:30.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.631+0000 7f1a22183640 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dcd4456420 con 0x55dcd44520c0 2024-09-10T05:36:30.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.631+0000 7f1a21982640 1 -- 172.21.15.62:0/211935648 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a180a8070 con 0x55dcd44520c0 2024-09-10T05:36:30.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.631+0000 7f1a21982640 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dcd4456420 con 0x55dcd444e890 2024-09-10T05:36:30.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.631+0000 7f1a22183640 1 -- 172.21.15.62:0/211935648 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1a1c039030 con 0x55dcd444e890 2024-09-10T05:36:30.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.631+0000 7f1a22183640 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dcd4456420 con 0x55dcd444e890 2024-09-10T05:36:30.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.631+0000 7f1a22183640 1 -- 172.21.15.62:0/211935648 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a1c039030 con 0x55dcd444e890 2024-09-10T05:36:30.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.631+0000 7f1a2467d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:30.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.631+0000 7f1a2467d9c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:30.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.631+0000 7f1a2467d9c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:30.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.631+0000 7f1a2467d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:30.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.631+0000 7f1a2467d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:30.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.631+0000 7f1a2467d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:30.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.631+0000 7f1a2467d9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:30.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.631+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dcd4455510 con 0x55dcd444a410 2024-09-10T05:36:30.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.631+0000 7f1a22984640 1 -- 172.21.15.62:0/211935648 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1a140083f0 con 0x55dcd444a410 2024-09-10T05:36:30.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.631+0000 7f1a2467d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:30.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.631+0000 7f1a2467d9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:30.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.631+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dcd4455930 con 0x55dcd444e890 2024-09-10T05:36:30.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.631+0000 7f1a22183640 1 -- 172.21.15.62:0/211935648 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1a1c039030 con 0x55dcd444e890 2024-09-10T05:36:30.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.631+0000 7f1a2467d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:30.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.631+0000 7f1a2467d9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:30.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.631+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dcd4455900 con 0x55dcd44520c0 2024-09-10T05:36:30.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.631+0000 7f1a21982640 1 -- 172.21.15.62:0/211935648 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1a180a8070 con 0x55dcd44520c0 2024-09-10T05:36:30.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.631+0000 7f1a2467d9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:30.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.631+0000 7f1a2467d9c0 20 zone default found 2024-09-10T05:36:30.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.631+0000 7f1a2467d9c0 4 Realm: () 2024-09-10T05:36:30.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.631+0000 7f1a2467d9c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:30.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.631+0000 7f1a2467d9c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:30.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.631+0000 7f1a2467d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:30.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.631+0000 7f1a2467d9c0 20 zonegroup default 2024-09-10T05:36:30.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.631+0000 7f1a2467d9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:30.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.631+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dcd44568d0 con 0x7f1a1c073020 2024-09-10T05:36:30.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.635+0000 7f1a22984640 1 -- 172.21.15.62:0/211935648 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1a140083f0 con 0x7f1a1c073020 2024-09-10T05:36:30.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.635+0000 7f1a2467d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:30.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.635+0000 7f1a2467d9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:30.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.635+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dcd4458760 con 0x55dcd44520c0 2024-09-10T05:36:30.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.635+0000 7f1a21982640 1 -- 172.21.15.62:0/211935648 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1a180a8070 con 0x55dcd44520c0 2024-09-10T05:36:30.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.635+0000 7f1a2467d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:30.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.635+0000 7f1a2467d9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:30.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.635+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dcd4458b90 con 0x55dcd44520c0 2024-09-10T05:36:30.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.635+0000 7f1a21982640 1 -- 172.21.15.62:0/211935648 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1a180a8070 con 0x55dcd44520c0 2024-09-10T05:36:30.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.635+0000 7f1a2467d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:30.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.635+0000 7f1a2467d9c0 20 started sync module instance, tier type = 2024-09-10T05:36:30.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.635+0000 7f1a2467d9c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:30.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.635+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dcd4457b00 con 0x55dcd444e890 2024-09-10T05:36:30.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.635+0000 7f1a22183640 1 -- 172.21.15.62:0/211935648 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a1c039030 con 0x55dcd444e890 2024-09-10T05:36:30.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.635+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94406942490624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dcd4457b00 con 0x55dcd444e890 2024-09-10T05:36:30.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.635+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dcd4459650 con 0x55dcd444a410 2024-09-10T05:36:30.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.639+0000 7f1a22984640 1 -- 172.21.15.62:0/211935648 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a140083f0 con 0x55dcd444a410 2024-09-10T05:36:30.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.639+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94406942495040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dcd4459ea0 con 0x55dcd444a410 2024-09-10T05:36:30.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.639+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dcd445a990 con 0x55dcd444e890 2024-09-10T05:36:30.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.639+0000 7f1a22183640 1 -- 172.21.15.62:0/211935648 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94406942490624] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a1c039030 con 0x55dcd444e890 2024-09-10T05:36:30.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.639+0000 7f1a22984640 1 -- 172.21.15.62:0/211935648 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94406942495040] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a140083f0 con 0x55dcd444a410 2024-09-10T05:36:30.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.639+0000 7f1a22183640 1 -- 172.21.15.62:0/211935648 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a1c039030 con 0x55dcd444e890 2024-09-10T05:36:30.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.639+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94406942499936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dcd44599f0 con 0x55dcd444e890 2024-09-10T05:36:30.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.639+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dcd445b230 con 0x7f1a1c073020 2024-09-10T05:36:30.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.643+0000 7f1a22984640 1 -- 172.21.15.62:0/211935648 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a140083f0 con 0x7f1a1c073020 2024-09-10T05:36:30.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.643+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94406942502272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dcd44599f0 con 0x7f1a1c073020 2024-09-10T05:36:30.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.643+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dcd445bcd0 con 0x55dcd444e890 2024-09-10T05:36:30.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.643+0000 7f1a22183640 1 -- 172.21.15.62:0/211935648 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94406942499936] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a1c039030 con 0x55dcd444e890 2024-09-10T05:36:30.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.647+0000 7f1a22984640 1 -- 172.21.15.62:0/211935648 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94406942502272] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a140083f0 con 0x7f1a1c073020 2024-09-10T05:36:30.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.647+0000 7f1a22183640 1 -- 172.21.15.62:0/211935648 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a1c039030 con 0x55dcd444e890 2024-09-10T05:36:30.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.647+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94406942503328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dcd445bc90 con 0x55dcd444e890 2024-09-10T05:36:30.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.647+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dcd445c0c0 con 0x55dcd44520c0 2024-09-10T05:36:30.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.647+0000 7f1a21982640 1 -- 172.21.15.62:0/211935648 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a180a8070 con 0x55dcd44520c0 2024-09-10T05:36:30.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.647+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94406942488144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dcd445c0c0 con 0x55dcd44520c0 2024-09-10T05:36:30.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.647+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dcd445cf80 con 0x55dcd44520c0 2024-09-10T05:36:30.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.651+0000 7f1a22183640 1 -- 172.21.15.62:0/211935648 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94406942503328] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a1c039030 con 0x55dcd444e890 2024-09-10T05:36:30.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.651+0000 7f1a21982640 1 -- 172.21.15.62:0/211935648 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94406942488144] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a180a8070 con 0x55dcd44520c0 2024-09-10T05:36:30.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.655+0000 7f1a21982640 1 -- 172.21.15.62:0/211935648 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a180a8070 con 0x55dcd44520c0 2024-09-10T05:36:30.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.655+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94406942508208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dcd445cad0 con 0x55dcd44520c0 2024-09-10T05:36:30.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.655+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dcd445d820 con 0x7f1a1c073020 2024-09-10T05:36:30.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.659+0000 7f1a21982640 1 -- 172.21.15.62:0/211935648 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94406942508208] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a180a8070 con 0x55dcd44520c0 2024-09-10T05:36:30.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.659+0000 7f1a22984640 1 -- 172.21.15.62:0/211935648 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a140083f0 con 0x7f1a1c073020 2024-09-10T05:36:30.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.659+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94406942504896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dcd445cad0 con 0x7f1a1c073020 2024-09-10T05:36:30.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.659+0000 7f1a2467d9c0 20 add_watcher() i=0 2024-09-10T05:36:30.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.659+0000 7f1a2467d9c0 20 add_watcher() i=1 2024-09-10T05:36:30.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.659+0000 7f1a2467d9c0 20 add_watcher() i=2 2024-09-10T05:36:30.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.659+0000 7f1a2467d9c0 20 add_watcher() i=3 2024-09-10T05:36:30.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.659+0000 7f1a2467d9c0 20 add_watcher() i=4 2024-09-10T05:36:30.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.659+0000 7f1a2467d9c0 20 add_watcher() i=5 2024-09-10T05:36:30.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.659+0000 7f1a2467d9c0 20 add_watcher() i=6 2024-09-10T05:36:30.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.663+0000 7f1a22984640 1 -- 172.21.15.62:0/211935648 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94406942504896] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a140083f0 con 0x7f1a1c073020 2024-09-10T05:36:30.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.663+0000 7f1a2467d9c0 20 add_watcher() i=7 2024-09-10T05:36:30.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.663+0000 7f1a2467d9c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:30.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.663+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dcd44608e0 con 0x55dcd444a410 2024-09-10T05:36:30.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.663+0000 7f1a22984640 1 -- 172.21.15.62:0/211935648 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1a140083f0 con 0x55dcd444a410 2024-09-10T05:36:30.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.663+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94406942511984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dcd445de00 con 0x55dcd444a410 2024-09-10T05:36:30.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.663+0000 7f1a22984640 1 -- 172.21.15.62:0/211935648 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94406942511984] v30'54 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1a140083f0 con 0x55dcd444a410 2024-09-10T05:36:30.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.667+0000 7f18d8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:30.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.667+0000 7f1a2467d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:30.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.667+0000 7f1a2467d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:30.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.667+0000 7f1a2467d9c0 5 note: GC not initialized 2024-09-10T05:36:30.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.667+0000 7f18537fe640 20 reqs_thread_entry: start 2024-09-10T05:36:30.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.667+0000 7f1a2467d9c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:30.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.667+0000 7f1a2467d9c0 20 Filter name: none 2024-09-10T05:36:30.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.667+0000 7f18517fa640 20 reqs_thread_entry: start 2024-09-10T05:36:30.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.667+0000 7f1a2467d9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:30.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.667+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dcd4483710 con 0x55dcd444a410 2024-09-10T05:36:30.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.667+0000 7f1a22984640 1 -- 172.21.15.62:0/211935648 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f1a140083f0 con 0x55dcd444a410 2024-09-10T05:36:30.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.667+0000 7f1a2467d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:30.671 INFO:teuthology.orchestra.run.smithi062.stderr:could not fetch user info: no user info saved 2024-09-10T05:36:30.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.667+0000 7f18d8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:30.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.667+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94406942511984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dcd44836d0 con 0x55dcd444a410 2024-09-10T05:36:30.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.671+0000 7f1a22984640 1 -- 172.21.15.62:0/211935648 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94406942511984] v30'55 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1a140083f0 con 0x55dcd444a410 2024-09-10T05:36:30.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.671+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94406942490624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dcd44836d0 con 0x55dcd444e890 2024-09-10T05:36:30.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.671+0000 7f1a22183640 1 -- 172.21.15.62:0/211935648 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94406942490624] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a1c039030 con 0x55dcd444e890 2024-09-10T05:36:30.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.671+0000 7f1a2467d9c0 20 remove_watcher() i=0 2024-09-10T05:36:30.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.671+0000 7f1a2467d9c0 2 removed watcher, disabling cache 2024-09-10T05:36:30.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.671+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94406942495040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dcd44836d0 con 0x55dcd444a410 2024-09-10T05:36:30.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.671+0000 7f1a22984640 1 -- 172.21.15.62:0/211935648 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94406942495040] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a140083f0 con 0x55dcd444a410 2024-09-10T05:36:30.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.671+0000 7f1a2467d9c0 20 remove_watcher() i=1 2024-09-10T05:36:30.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.671+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94406942499936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dcd44836d0 con 0x55dcd444e890 2024-09-10T05:36:30.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.675+0000 7f1a22183640 1 -- 172.21.15.62:0/211935648 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94406942499936] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a1c039030 con 0x55dcd444e890 2024-09-10T05:36:30.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.675+0000 7f1a2467d9c0 20 remove_watcher() i=2 2024-09-10T05:36:30.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.675+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94406942502272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dcd44836d0 con 0x7f1a1c073020 2024-09-10T05:36:30.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.675+0000 7f1a22984640 1 -- 172.21.15.62:0/211935648 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94406942502272] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a140083f0 con 0x7f1a1c073020 2024-09-10T05:36:30.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.675+0000 7f1a2467d9c0 20 remove_watcher() i=3 2024-09-10T05:36:30.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.675+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94406942503328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dcd44836d0 con 0x55dcd444e890 2024-09-10T05:36:30.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.679+0000 7f1a22183640 1 -- 172.21.15.62:0/211935648 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94406942503328] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a1c039030 con 0x55dcd444e890 2024-09-10T05:36:30.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.679+0000 7f1a2467d9c0 20 remove_watcher() i=4 2024-09-10T05:36:30.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.679+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94406942488144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dcd44836d0 con 0x55dcd44520c0 2024-09-10T05:36:30.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.679+0000 7f1a21982640 1 -- 172.21.15.62:0/211935648 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94406942488144] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a180a8070 con 0x55dcd44520c0 2024-09-10T05:36:30.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.679+0000 7f1a2467d9c0 20 remove_watcher() i=5 2024-09-10T05:36:30.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.679+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94406942508208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dcd44836d0 con 0x55dcd44520c0 2024-09-10T05:36:30.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.683+0000 7f1a21982640 1 -- 172.21.15.62:0/211935648 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94406942508208] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a180a8070 con 0x55dcd44520c0 2024-09-10T05:36:30.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.683+0000 7f1a2467d9c0 20 remove_watcher() i=6 2024-09-10T05:36:30.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.683+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/211935648 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94406942504896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dcd44836d0 con 0x7f1a1c073020 2024-09-10T05:36:30.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.683+0000 7f1a22984640 1 -- 172.21.15.62:0/211935648 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94406942504896] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a140083f0 con 0x7f1a1c073020 2024-09-10T05:36:30.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.683+0000 7f1a2467d9c0 20 remove_watcher() i=7 2024-09-10T05:36:30.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.683+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/211935648 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55dcd444e890 msgr2=0x55dcd4450c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.683+0000 7f1a2467d9c0 1 --2- 172.21.15.62:0/211935648 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55dcd444e890 0x55dcd4450c80 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.683+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/211935648 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55dcd444a410 msgr2=0x55dcd444c8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.683+0000 7f1a2467d9c0 1 --2- 172.21.15.62:0/211935648 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55dcd444a410 0x55dcd444c8a0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.683+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/211935648 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f1a1c073020 msgr2=0x7f1a1c041280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.683+0000 7f1a2467d9c0 1 --2- 172.21.15.62:0/211935648 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f1a1c073020 0x7f1a1c041280 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.683+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/211935648 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55dcd44520c0 msgr2=0x55dcd44544b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.683+0000 7f1a2467d9c0 1 --2- 172.21.15.62:0/211935648 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55dcd44520c0 0x55dcd44544b0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.683+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/211935648 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f18ec039a70 msgr2=0x7f18ec03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.683+0000 7f1a2467d9c0 1 --2- 172.21.15.62:0/211935648 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f18ec039a70 0x7f18ec03bf30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1a1801b350 tx=0x7f1a180a8000 comp rx=0 tx=0).stop 2024-09-10T05:36:30.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.683+0000 7f1a22984640 1 -- 172.21.15.62:0/211935648 reap_dead start 2024-09-10T05:36:30.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.683+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/211935648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dcd44381c0 msgr2=0x55dcd443f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.683+0000 7f1a2467d9c0 1 --2- 172.21.15.62:0/211935648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dcd44381c0 0x55dcd443f4a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c04f400 tx=0x7f1a1c037ea0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.683+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/211935648 shutdown_connections 2024-09-10T05:36:30.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.683+0000 7f1a2467d9c0 1 --2- 172.21.15.62:0/211935648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dcd44381c0 0x55dcd443f4a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.683+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/211935648 >> 172.21.15.62:0/211935648 conn(0x55dcd44345f0 msgr2=0x55dcd4432800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:30.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.687+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/211935648 shutdown_connections 2024-09-10T05:36:30.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.687+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/211935648 wait complete. 2024-09-10T05:36:30.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.687+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/974287386 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f18fc039bc0 msgr2=0x7f18fc03c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.687+0000 7f1a2467d9c0 1 --2- 172.21.15.62:0/974287386 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f18fc039bc0 0x7f18fc03c080 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x55dcd440f280 tx=0x7f1a18005a10 comp rx=0 tx=0).stop 2024-09-10T05:36:30.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.687+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/974287386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dcd442ba80 msgr2=0x55dcd442bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.687+0000 7f1a2467d9c0 1 --2- 172.21.15.62:0/974287386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dcd442ba80 0x55dcd442bea0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c010a90 tx=0x7f1a1c042ef0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.687+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/974287386 shutdown_connections 2024-09-10T05:36:30.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.687+0000 7f1a2467d9c0 1 --2- 172.21.15.62:0/974287386 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f18fc039bc0 0x7f18fc03c080 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.687+0000 7f1a2467d9c0 1 --2- 172.21.15.62:0/974287386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dcd442ba80 0x55dcd442bea0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.687+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/974287386 >> 172.21.15.62:0/974287386 conn(0x55dcd4421430 msgr2=0x55dcd4421810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:30.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.687+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/974287386 shutdown_connections 2024-09-10T05:36:30.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.687+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/974287386 wait complete. 2024-09-10T05:36:30.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.687+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/2563005830 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55dcd44161a0 msgr2=0x55dcd4418590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.687+0000 7f1a2467d9c0 1 --2- 172.21.15.62:0/2563005830 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55dcd44161a0 0x55dcd4418590 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.687+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/2563005830 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55dcd431f350 msgr2=0x55dcd4414eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.687+0000 7f1a2467d9c0 1 --2- 172.21.15.62:0/2563005830 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55dcd431f350 0x55dcd4414eb0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.687+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/2563005830 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55dcd441a980 msgr2=0x55dcd441cd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.687+0000 7f1a2467d9c0 1 --2- 172.21.15.62:0/2563005830 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55dcd441a980 0x55dcd441cd70 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.687+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/2563005830 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1908039a70 msgr2=0x7f190803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.687+0000 7f1a2467d9c0 1 --2- 172.21.15.62:0/2563005830 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1908039a70 0x7f190803bf30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1a180ae000 tx=0x7f1a180a6000 comp rx=0 tx=0).stop 2024-09-10T05:36:30.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.687+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/2563005830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dcd431b200 msgr2=0x55dcd440dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.687+0000 7f1a2467d9c0 1 --2- 172.21.15.62:0/2563005830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dcd431b200 0x55dcd440dd40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c001ba0 tx=0x7f1a1c004470 comp rx=0 tx=0).stop 2024-09-10T05:36:30.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.687+0000 7f1a22984640 1 -- 172.21.15.62:0/2563005830 reap_dead start 2024-09-10T05:36:30.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.687+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/2563005830 shutdown_connections 2024-09-10T05:36:30.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.687+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/2563005830 >> 172.21.15.62:0/2563005830 conn(0x55dcd428eb10 msgr2=0x55dcd4400da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:30.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.687+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/2563005830 shutdown_connections 2024-09-10T05:36:30.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.687+0000 7f1a2467d9c0 1 -- 172.21.15.62:0/2563005830 wait complete. 2024-09-10T05:36:30.701 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-10T05:36:30.701 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-10T05:36:30.701 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-10T05:36:30.702 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2024-09-10T05:36:30.794 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:30.794 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:30.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.791+0000 7f099a47b9c0 1 Processor -- start 2024-09-10T05:36:30.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.791+0000 7f099a47b9c0 1 -- start start 2024-09-10T05:36:30.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.791+0000 7f099a47b9c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x561cf09891c0 0x561cf0a17b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.791+0000 7f099a47b9c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561cf08c99c0 con 0x561cf0a180b0 2024-09-10T05:36:30.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.791+0000 7f099a47b9c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x561cf09196d0 con 0x561cf09891c0 2024-09-10T05:36:30.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.791+0000 7f0997f81640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x561cf09891c0 0x561cf0a17b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.791+0000 7f0997780640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x561cf0a180b0 0x561cf0a1a4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:38460/0 (socket says 172.21.15.62:38460) 2024-09-10T05:36:30.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.791+0000 7f0997780640 1 -- 172.21.15.62:0/551777920 learned_addr learned my addr 172.21.15.62:0/551777920 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-10T05:36:30.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.795+0000 7f0997f81640 1 -- 172.21.15.62:0/551777920 >> v1:172.21.15.2:6789/0 conn(0x561cf0a180b0 legacy=0x561cf0a1a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.795+0000 7f0997f81640 1 -- 172.21.15.62:0/551777920 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cf08bdca0 con 0x561cf09891c0 2024-09-10T05:36:30.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.795+0000 7f0997f81640 1 --2- 172.21.15.62:0/551777920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cf09891c0 0x561cf0a17b70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f099000a420 tx=0x7f099001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ea0956106dc73c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.795+0000 7f0996f7f640 1 -- 172.21.15.62:0/551777920 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09900b0070 con 0x561cf09891c0 2024-09-10T05:36:30.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.795+0000 7f0996f7f640 1 -- 172.21.15.62:0/551777920 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09900a3dc0 con 0x561cf09891c0 2024-09-10T05:36:30.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.795+0000 7f0996f7f640 1 -- 172.21.15.62:0/551777920 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09900ab570 con 0x561cf09891c0 2024-09-10T05:36:30.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.795+0000 7f099a47b9c0 1 -- 172.21.15.62:0/551777920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cf09891c0 msgr2=0x561cf0a17b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.795+0000 7f099a47b9c0 1 --2- 172.21.15.62:0/551777920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cf09891c0 0x561cf0a17b70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f099000a420 tx=0x7f099001afd0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.795+0000 7f099a47b9c0 1 -- 172.21.15.62:0/551777920 shutdown_connections 2024-09-10T05:36:30.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.795+0000 7f099a47b9c0 1 --2- 172.21.15.62:0/551777920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cf09891c0 0x561cf0a17b70 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.795+0000 7f099a47b9c0 1 -- 172.21.15.62:0/551777920 >> 172.21.15.62:0/551777920 conn(0x561cf0a0f8a0 msgr2=0x561cf0a11cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:30.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.795+0000 7f099a47b9c0 1 -- 172.21.15.62:0/551777920 shutdown_connections 2024-09-10T05:36:30.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.795+0000 7f099a47b9c0 1 -- 172.21.15.62:0/551777920 wait complete. 2024-09-10T05:36:30.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.811+0000 7f099a47b9c0 1 Processor -- start 2024-09-10T05:36:30.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.811+0000 7f099a47b9c0 1 -- start start 2024-09-10T05:36:30.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.811+0000 7f099a47b9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cf09891c0 0x561cf0a150f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.811+0000 7f099a47b9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561cf091d680 con 0x561cf09891c0 2024-09-10T05:36:30.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.811+0000 7f0997f81640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cf09891c0 0x561cf0a150f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.811+0000 7f0997f81640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cf09891c0 0x561cf0a150f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51208/0 (socket says 172.21.15.62:51208) 2024-09-10T05:36:30.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.811+0000 7f0997f81640 1 -- 172.21.15.62:0/2574480888 learned_addr learned my addr 172.21.15.62:0/2574480888 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:30.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.815+0000 7f0997f81640 1 -- 172.21.15.62:0/2574480888 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cf0898da0 con 0x561cf09891c0 2024-09-10T05:36:30.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.815+0000 7f0997f81640 1 --2- 172.21.15.62:0/2574480888 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cf09891c0 0x561cf0a150f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f09900a3d90 tx=0x7f09900033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa095b43f06ae943 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.815+0000 7f0885e0b640 1 -- 172.21.15.62:0/2574480888 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09900b0040 con 0x561cf09891c0 2024-09-10T05:36:30.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.815+0000 7f0885e0b640 1 -- 172.21.15.62:0/2574480888 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09900ab6b0 con 0x561cf09891c0 2024-09-10T05:36:30.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.815+0000 7f0885e0b640 1 -- 172.21.15.62:0/2574480888 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09900ab990 con 0x561cf09891c0 2024-09-10T05:36:30.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.815+0000 7f099a47b9c0 1 -- 172.21.15.62:0/2574480888 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cf09891c0 msgr2=0x561cf0a150f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.815+0000 7f099a47b9c0 1 --2- 172.21.15.62:0/2574480888 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cf09891c0 0x561cf0a150f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f09900a3d90 tx=0x7f09900033b0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.815+0000 7f099a47b9c0 1 -- 172.21.15.62:0/2574480888 shutdown_connections 2024-09-10T05:36:30.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.815+0000 7f099a47b9c0 1 --2- 172.21.15.62:0/2574480888 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cf09891c0 0x561cf0a150f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.815+0000 7f099a47b9c0 1 -- 172.21.15.62:0/2574480888 >> 172.21.15.62:0/2574480888 conn(0x561cf0a0f8a0 msgr2=0x561cf0afc480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:30.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.815+0000 7f099a47b9c0 1 -- 172.21.15.62:0/2574480888 shutdown_connections 2024-09-10T05:36:30.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.815+0000 7f099a47b9c0 1 -- 172.21.15.62:0/2574480888 wait complete. 2024-09-10T05:36:30.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.815+0000 7f099a47b9c0 1 Processor -- start 2024-09-10T05:36:30.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.815+0000 7f099a47b9c0 1 -- start start 2024-09-10T05:36:30.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.815+0000 7f099a47b9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cf0a180b0 0x561cf0b0a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.815+0000 7f099a47b9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561cf08bfa50 con 0x561cf0a180b0 2024-09-10T05:36:30.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.815+0000 7f0997f81640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cf0a180b0 0x561cf0b0a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.815+0000 7f0997f81640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cf0a180b0 0x561cf0b0a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51212/0 (socket says 172.21.15.62:51212) 2024-09-10T05:36:30.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.815+0000 7f0997f81640 1 -- 172.21.15.62:0/1182268591 learned_addr learned my addr 172.21.15.62:0/1182268591 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:30.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.815+0000 7f0997f81640 1 -- 172.21.15.62:0/1182268591 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cf0b0a7d0 con 0x561cf0a180b0 2024-09-10T05:36:30.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.815+0000 7f0997f81640 1 --2- 172.21.15.62:0/1182268591 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cf0a180b0 0x561cf0b0a270 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0990008030 tx=0x7f0990017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.819+0000 7f087ffff640 1 -- 172.21.15.62:0/1182268591 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09900b0040 con 0x561cf0a180b0 2024-09-10T05:36:30.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.819+0000 7f099a47b9c0 1 -- 172.21.15.62:0/1182268591 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561cf0b0aa60 con 0x561cf0a180b0 2024-09-10T05:36:30.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.819+0000 7f087ffff640 1 -- 172.21.15.62:0/1182268591 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09900b4770 con 0x561cf0a180b0 2024-09-10T05:36:30.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.819+0000 7f087ffff640 1 -- 172.21.15.62:0/1182268591 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09900b4a50 con 0x561cf0a180b0 2024-09-10T05:36:30.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.819+0000 7f099a47b9c0 1 -- 172.21.15.62:0/1182268591 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cf0b0b3a0 con 0x561cf0a180b0 2024-09-10T05:36:30.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.819+0000 7f087ffff640 1 -- 172.21.15.62:0/1182268591 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f09900b4bf0 con 0x561cf0a180b0 2024-09-10T05:36:30.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.819+0000 7f087ffff640 1 --2- 172.21.15.62:0/1182268591 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0880039a70 0x7f088003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.819+0000 7f087ffff640 1 -- 172.21.15.62:0/1182268591 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f09900ea230 con 0x561cf0a180b0 2024-09-10T05:36:30.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.819+0000 7f0997780640 1 --2- 172.21.15.62:0/1182268591 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0880039a70 0x7f088003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.819+0000 7f099a47b9c0 1 --2- 172.21.15.62:0/1182268591 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x561cf0b0f2e0 0x561cf0b116d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.819+0000 7f099a47b9c0 1 -- 172.21.15.62:0/1182268591 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b11c10 con 0x561cf0b0f2e0 2024-09-10T05:36:30.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.819+0000 7f0998782640 1 --2- 172.21.15.62:0/1182268591 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x561cf0b0f2e0 0x561cf0b116d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.819+0000 7f0997780640 1 --2- 172.21.15.62:0/1182268591 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0880039a70 0x7f088003bf30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f098c001d80 tx=0x7f098c0012e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.819+0000 7f0998782640 1 --2- 172.21.15.62:0/1182268591 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x561cf0b0f2e0 0x561cf0b116d0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.819+0000 7f0998782640 1 -- 172.21.15.62:0/1182268591 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f09880083f0 con 0x561cf0b0f2e0 2024-09-10T05:36:30.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.819+0000 7f099a47b9c0 1 --2- 172.21.15.62:0/1182268591 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561cf0b12730 0x561cf0b14bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.819+0000 7f099a47b9c0 1 -- 172.21.15.62:0/1182268591 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b15360 con 0x561cf0b12730 2024-09-10T05:36:30.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.819+0000 7f0997f81640 1 --2- 172.21.15.62:0/1182268591 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561cf0b12730 0x561cf0b14bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.823+0000 7f0997f81640 1 --2- 172.21.15.62:0/1182268591 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561cf0b12730 0x561cf0b14bf0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.823+0000 7f0997f81640 1 -- 172.21.15.62:0/1182268591 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f09900bbd40 con 0x561cf0b12730 2024-09-10T05:36:30.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.823+0000 7f099a47b9c0 1 --2- 172.21.15.62:0/1182268591 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x561cf0b17120 0x561cf0b19510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.823+0000 7f099a47b9c0 1 -- 172.21.15.62:0/1182268591 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b19be0 con 0x561cf0b17120 2024-09-10T05:36:30.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.823+0000 7f0997780640 1 --2- 172.21.15.62:0/1182268591 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x561cf0b17120 0x561cf0b19510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.823+0000 7f0997780640 1 --2- 172.21.15.62:0/1182268591 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x561cf0b17120 0x561cf0b19510 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.823+0000 7f0997780640 1 -- 172.21.15.62:0/1182268591 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f098c00e620 con 0x561cf0b17120 2024-09-10T05:36:30.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.823+0000 7f099a47b9c0 1 -- 172.21.15.62:0/1182268591 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b15fc0 con 0x561cf0b12730 2024-09-10T05:36:30.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.823+0000 7f0997f81640 1 -- 172.21.15.62:0/1182268591 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f09900bbd40 con 0x561cf0b12730 2024-09-10T05:36:30.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.823+0000 7f099a47b9c0 1 -- 172.21.15.62:0/1182268591 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b163e0 con 0x561cf0b17120 2024-09-10T05:36:30.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.823+0000 7f0997780640 1 -- 172.21.15.62:0/1182268591 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f098c00e620 con 0x561cf0b17120 2024-09-10T05:36:30.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.823+0000 7f099a47b9c0 1 Processor -- start 2024-09-10T05:36:30.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.823+0000 7f099a47b9c0 1 -- start start 2024-09-10T05:36:30.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.823+0000 7f099a47b9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cf0b282b0 0x561cf0b286d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.823+0000 7f099a47b9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561cf092a450 con 0x561cf0b282b0 2024-09-10T05:36:30.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.827+0000 7f0997f81640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cf0b282b0 0x561cf0b286d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.827+0000 7f0997f81640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cf0b282b0 0x561cf0b286d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51218/0 (socket says 172.21.15.62:51218) 2024-09-10T05:36:30.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.827+0000 7f0997f81640 1 -- 172.21.15.62:0/2244439216 learned_addr learned my addr 172.21.15.62:0/2244439216 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:30.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.827+0000 7f0997f81640 1 -- 172.21.15.62:0/2244439216 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cf0b28d10 con 0x561cf0b282b0 2024-09-10T05:36:30.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.827+0000 7f0997f81640 1 --2- 172.21.15.62:0/2244439216 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cf0b282b0 0x561cf0b286d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f09900bc570 tx=0x7f09900ab000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.827+0000 7f087d7fa640 1 -- 172.21.15.62:0/2244439216 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09900e3030 con 0x561cf0b282b0 2024-09-10T05:36:30.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.827+0000 7f087d7fa640 1 -- 172.21.15.62:0/2244439216 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09900e8410 con 0x561cf0b282b0 2024-09-10T05:36:30.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.827+0000 7f099a47b9c0 1 -- 172.21.15.62:0/2244439216 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561cf0b29570 con 0x561cf0b282b0 2024-09-10T05:36:30.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.827+0000 7f087d7fa640 1 -- 172.21.15.62:0/2244439216 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09900c6570 con 0x561cf0b282b0 2024-09-10T05:36:30.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.827+0000 7f099a47b9c0 1 -- 172.21.15.62:0/2244439216 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cf0b29ae0 con 0x561cf0b282b0 2024-09-10T05:36:30.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.827+0000 7f087d7fa640 1 -- 172.21.15.62:0/2244439216 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f09900e6030 con 0x561cf0b282b0 2024-09-10T05:36:30.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.827+0000 7f087d7fa640 1 --2- 172.21.15.62:0/2244439216 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0870039a70 0x7f087003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.827+0000 7f087d7fa640 1 -- 172.21.15.62:0/2244439216 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f09900e4070 con 0x561cf0b282b0 2024-09-10T05:36:30.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.827+0000 7f0997780640 1 --2- 172.21.15.62:0/2244439216 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0870039a70 0x7f087003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.827+0000 7f099a47b9c0 1 Processor -- start 2024-09-10T05:36:30.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.827+0000 7f099a47b9c0 1 -- start start 2024-09-10T05:36:30.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.827+0000 7f099a47b9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cf0b34a50 0x561cf0b34e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.827+0000 7f099a47b9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561cf0a15880 con 0x561cf0b34a50 2024-09-10T05:36:30.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.827+0000 7f0997780640 1 --2- 172.21.15.62:0/2244439216 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0870039a70 0x7f087003bf30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f098c00bf50 tx=0x7f098c00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.827+0000 7f0997f81640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cf0b34a50 0x561cf0b34e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.827+0000 7f0997f81640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cf0b34a50 0x561cf0b34e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51232/0 (socket says 172.21.15.62:51232) 2024-09-10T05:36:30.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.827+0000 7f0997f81640 1 -- 172.21.15.62:0/34298219 learned_addr learned my addr 172.21.15.62:0/34298219 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:30.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.831+0000 7f0997f81640 1 -- 172.21.15.62:0/34298219 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cf0b35400 con 0x561cf0b34a50 2024-09-10T05:36:30.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.831+0000 7f0997f81640 1 --2- 172.21.15.62:0/34298219 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cf0b34a50 0x561cf0b34e30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f09900a3d90 tx=0x7f09900bc890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c59a1460f6fae238 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.831+0000 7f0876ffd640 1 -- 172.21.15.62:0/34298219 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09900d1dc0 con 0x561cf0b34a50 2024-09-10T05:36:30.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.831+0000 7f0876ffd640 1 -- 172.21.15.62:0/34298219 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09900c6710 con 0x561cf0b34a50 2024-09-10T05:36:30.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.831+0000 7f0876ffd640 1 -- 172.21.15.62:0/34298219 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09900d1790 con 0x561cf0b34a50 2024-09-10T05:36:30.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.831+0000 7f099a47b9c0 1 -- 172.21.15.62:0/34298219 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cf0b34a50 msgr2=0x561cf0b34e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.831+0000 7f099a47b9c0 1 --2- 172.21.15.62:0/34298219 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cf0b34a50 0x561cf0b34e30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f09900a3d90 tx=0x7f09900bc890 comp rx=0 tx=0).stop 2024-09-10T05:36:30.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.831+0000 7f099a47b9c0 1 -- 172.21.15.62:0/34298219 shutdown_connections 2024-09-10T05:36:30.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.831+0000 7f099a47b9c0 1 --2- 172.21.15.62:0/34298219 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cf0b34a50 0x561cf0b34e30 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.831+0000 7f099a47b9c0 1 -- 172.21.15.62:0/34298219 >> 172.21.15.62:0/34298219 conn(0x561cf0b30e80 msgr2=0x561cf0b2f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:30.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.831+0000 7f099a47b9c0 1 -- 172.21.15.62:0/34298219 shutdown_connections 2024-09-10T05:36:30.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.831+0000 7f099a47b9c0 1 -- 172.21.15.62:0/34298219 wait complete. 2024-09-10T05:36:30.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.831+0000 7f099a47b9c0 1 Processor -- start 2024-09-10T05:36:30.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.831+0000 7f099a47b9c0 1 -- start start 2024-09-10T05:36:30.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.831+0000 7f099a47b9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cf0b34a50 0x561cf0b3bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.831+0000 7f099a47b9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561cf0b358e0 con 0x561cf0b34a50 2024-09-10T05:36:30.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.831+0000 7f0997f81640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cf0b34a50 0x561cf0b3bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.831+0000 7f0997f81640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cf0b34a50 0x561cf0b3bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51242/0 (socket says 172.21.15.62:51242) 2024-09-10T05:36:30.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.831+0000 7f0997f81640 1 -- 172.21.15.62:0/611128491 learned_addr learned my addr 172.21.15.62:0/611128491 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:30.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.831+0000 7f0997f81640 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cf0b3c2f0 con 0x561cf0b34a50 2024-09-10T05:36:30.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.831+0000 7f0997f81640 1 --2- 172.21.15.62:0/611128491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cf0b34a50 0x561cf0b3bd90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f09900bcad0 tx=0x7f09900bafa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.831+0000 7f08757fa640 1 -- 172.21.15.62:0/611128491 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f099010c020 con 0x561cf0b34a50 2024-09-10T05:36:30.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.831+0000 7f08757fa640 1 -- 172.21.15.62:0/611128491 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09900ebe80 con 0x561cf0b34a50 2024-09-10T05:36:30.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.831+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561cf0b3c2f0 con 0x561cf0b34a50 2024-09-10T05:36:30.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.831+0000 7f08757fa640 1 -- 172.21.15.62:0/611128491 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09900d18c0 con 0x561cf0b34a50 2024-09-10T05:36:30.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.831+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cf0b3c8c0 con 0x561cf0b34a50 2024-09-10T05:36:30.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.835+0000 7f08757fa640 1 -- 172.21.15.62:0/611128491 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f099010f020 con 0x561cf0b34a50 2024-09-10T05:36:30.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.835+0000 7f08757fa640 1 --2- 172.21.15.62:0/611128491 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0860039a20 0x7f086003bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.835+0000 7f08757fa640 1 -- 172.21.15.62:0/611128491 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f0990103050 con 0x561cf0b34a50 2024-09-10T05:36:30.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.835+0000 7f099a47b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:30.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.835+0000 7f0997780640 1 --2- 172.21.15.62:0/611128491 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0860039a20 0x7f086003bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.835+0000 7f099a47b9c0 1 --2- 172.21.15.62:0/611128491 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x561cf0b46d90 0x561cf0b49220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.835+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b49970 con 0x561cf0b46d90 2024-09-10T05:36:30.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.835+0000 7f0998782640 1 --2- 172.21.15.62:0/611128491 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x561cf0b46d90 0x561cf0b49220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.835+0000 7f0997780640 1 --2- 172.21.15.62:0/611128491 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0860039a20 0x7f086003bee0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f098c01d040 tx=0x7f098c010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.835+0000 7f0998782640 1 --2- 172.21.15.62:0/611128491 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x561cf0b46d90 0x561cf0b49220 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.835+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f09880083f0 con 0x561cf0b46d90 2024-09-10T05:36:30.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.835+0000 7f099a47b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:30.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.835+0000 7f099a47b9c0 20 realm 2024-09-10T05:36:30.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.835+0000 7f099a47b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:30.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.835+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b46120 con 0x561cf0b46d90 2024-09-10T05:36:30.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.835+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f09880083f0 con 0x561cf0b46d90 2024-09-10T05:36:30.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.835+0000 7f099a47b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:30.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.835+0000 7f099a47b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:30.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.835+0000 7f099a47b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:30.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.835+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b4a440 con 0x561cf0b46d90 2024-09-10T05:36:30.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.835+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f09880083f0 con 0x561cf0b46d90 2024-09-10T05:36:30.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.835+0000 7f099a47b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:30.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.835+0000 7f099a47b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:30.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.835+0000 7f099a47b9c0 1 --2- 172.21.15.62:0/611128491 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561cf0b4b220 0x561cf0b4d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.835+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b4dca0 con 0x561cf0b4b220 2024-09-10T05:36:30.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.835+0000 7f0997f81640 1 --2- 172.21.15.62:0/611128491 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561cf0b4b220 0x561cf0b4d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.835+0000 7f0997f81640 1 --2- 172.21.15.62:0/611128491 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561cf0b4b220 0x561cf0b4d610 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.839+0000 7f0997f81640 1 -- 172.21.15.62:0/611128491 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f09900f1070 con 0x561cf0b4b220 2024-09-10T05:36:30.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.839+0000 7f099a47b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:30.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.839+0000 7f099a47b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:30.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.839+0000 7f099a47b9c0 1 --2- 172.21.15.62:0/611128491 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x561cf0b4ea00 0x561cf0b50df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.839+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b51560 con 0x561cf0b4ea00 2024-09-10T05:36:30.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.839+0000 7f0997780640 1 --2- 172.21.15.62:0/611128491 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x561cf0b4ea00 0x561cf0b50df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.839+0000 7f0997780640 1 --2- 172.21.15.62:0/611128491 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x561cf0b4ea00 0x561cf0b50df0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.839+0000 7f0997780640 1 -- 172.21.15.62:0/611128491 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f098c026070 con 0x561cf0b4ea00 2024-09-10T05:36:30.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.839+0000 7f099a47b9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:30.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.839+0000 7f099a47b9c0 20 searching for the correct realm 2024-09-10T05:36:30.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.839+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b52e30 con 0x561cf0b4ea00 2024-09-10T05:36:30.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.839+0000 7f0997780640 1 -- 172.21.15.62:0/611128491 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f098c026070 con 0x561cf0b4ea00 2024-09-10T05:36:30.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.839+0000 7f0997780640 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b52e30 con 0x561cf0b4b220 2024-09-10T05:36:30.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.839+0000 7f0997f81640 1 -- 172.21.15.62:0/611128491 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09900f1070 con 0x561cf0b4b220 2024-09-10T05:36:30.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.839+0000 7f0997f81640 1 --2- 172.21.15.62:0/611128491 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f0990111020 0x7f0990108460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.839+0000 7f0997f81640 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b52e30 con 0x7f0990111020 2024-09-10T05:36:30.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.839+0000 7f0998782640 1 --2- 172.21.15.62:0/611128491 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f0990111020 0x7f0990108460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.839+0000 7f0998782640 1 --2- 172.21.15.62:0/611128491 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f0990111020 0x7f0990108460 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.839+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09880083f0 con 0x7f0990111020 2024-09-10T05:36:30.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.839+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b52e30 con 0x561cf0b46d90 2024-09-10T05:36:30.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.839+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09880083f0 con 0x561cf0b46d90 2024-09-10T05:36:30.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.839+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b52e30 con 0x561cf0b46d90 2024-09-10T05:36:30.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.843+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09880083f0 con 0x561cf0b46d90 2024-09-10T05:36:30.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.843+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b52e30 con 0x561cf0b4ea00 2024-09-10T05:36:30.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.843+0000 7f0997780640 1 -- 172.21.15.62:0/611128491 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f098c026070 con 0x561cf0b4ea00 2024-09-10T05:36:30.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.843+0000 7f0997780640 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b52e30 con 0x561cf0b46d90 2024-09-10T05:36:30.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.843+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09880083f0 con 0x561cf0b46d90 2024-09-10T05:36:30.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.843+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b52e30 con 0x561cf0b4b220 2024-09-10T05:36:30.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.843+0000 7f0997f81640 1 -- 172.21.15.62:0/611128491 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09900f1070 con 0x561cf0b4b220 2024-09-10T05:36:30.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.843+0000 7f0997f81640 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b52e30 con 0x561cf0b4b220 2024-09-10T05:36:30.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.843+0000 7f0997f81640 1 -- 172.21.15.62:0/611128491 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09900f1070 con 0x561cf0b4b220 2024-09-10T05:36:30.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.843+0000 7f0997f81640 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b52e30 con 0x561cf0b46d90 2024-09-10T05:36:30.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.843+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09880083f0 con 0x561cf0b46d90 2024-09-10T05:36:30.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.843+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b52e30 con 0x7f0990111020 2024-09-10T05:36:30.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.843+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09880083f0 con 0x7f0990111020 2024-09-10T05:36:30.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.843+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b52e30 con 0x561cf0b46d90 2024-09-10T05:36:30.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.843+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09880083f0 con 0x561cf0b46d90 2024-09-10T05:36:30.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.843+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b52e30 con 0x7f0990111020 2024-09-10T05:36:30.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.843+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f09880083f0 con 0x7f0990111020 2024-09-10T05:36:30.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.843+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b52e30 con 0x561cf0b4b220 2024-09-10T05:36:30.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.847+0000 7f0997f81640 1 -- 172.21.15.62:0/611128491 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09900f1070 con 0x561cf0b4b220 2024-09-10T05:36:30.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.847+0000 7f0997f81640 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b52e30 con 0x561cf0b4ea00 2024-09-10T05:36:30.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.847+0000 7f0997780640 1 -- 172.21.15.62:0/611128491 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f098c026070 con 0x561cf0b4ea00 2024-09-10T05:36:30.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.847+0000 7f0997780640 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b52e30 con 0x561cf0b46d90 2024-09-10T05:36:30.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.847+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09880083f0 con 0x561cf0b46d90 2024-09-10T05:36:30.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.847+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b52e30 con 0x561cf0b4b220 2024-09-10T05:36:30.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.847+0000 7f0997f81640 1 -- 172.21.15.62:0/611128491 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09900f1070 con 0x561cf0b4b220 2024-09-10T05:36:30.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.847+0000 7f0997f81640 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b52e30 con 0x561cf0b4ea00 2024-09-10T05:36:30.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.847+0000 7f0997780640 1 -- 172.21.15.62:0/611128491 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 30 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f098c026070 con 0x561cf0b4ea00 2024-09-10T05:36:30.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.847+0000 7f0997780640 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b52e30 con 0x561cf0b46d90 2024-09-10T05:36:30.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.847+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09880083f0 con 0x561cf0b46d90 2024-09-10T05:36:30.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.847+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b52e30 con 0x561cf0b46d90 2024-09-10T05:36:30.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.847+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f09880083f0 con 0x561cf0b46d90 2024-09-10T05:36:30.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.847+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b52e30 con 0x561cf0b46d90 2024-09-10T05:36:30.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.847+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09880083f0 con 0x561cf0b46d90 2024-09-10T05:36:30.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.847+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b52e30 con 0x561cf0b4ea00 2024-09-10T05:36:30.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.847+0000 7f0997780640 1 -- 172.21.15.62:0/611128491 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f098c026070 con 0x561cf0b4ea00 2024-09-10T05:36:30.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.847+0000 7f0997780640 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b52e30 con 0x7f0990111020 2024-09-10T05:36:30.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.847+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09880083f0 con 0x7f0990111020 2024-09-10T05:36:30.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.847+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b52e30 con 0x561cf0b46d90 2024-09-10T05:36:30.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.847+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09880083f0 con 0x561cf0b46d90 2024-09-10T05:36:30.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.847+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b52e30 con 0x7f0990111020 2024-09-10T05:36:30.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.847+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09880083f0 con 0x7f0990111020 2024-09-10T05:36:30.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.847+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b52e30 con 0x561cf0b4ea00 2024-09-10T05:36:30.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.851+0000 7f0997780640 1 -- 172.21.15.62:0/611128491 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f098c026070 con 0x561cf0b4ea00 2024-09-10T05:36:30.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.851+0000 7f0997780640 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b52e30 con 0x7f0990111020 2024-09-10T05:36:30.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.851+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09880083f0 con 0x7f0990111020 2024-09-10T05:36:30.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.851+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b52e30 con 0x561cf0b4b220 2024-09-10T05:36:30.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.851+0000 7f0997f81640 1 -- 172.21.15.62:0/611128491 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09900f1070 con 0x561cf0b4b220 2024-09-10T05:36:30.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.851+0000 7f0997f81640 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b52e30 con 0x561cf0b4b220 2024-09-10T05:36:30.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.851+0000 7f0997f81640 1 -- 172.21.15.62:0/611128491 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09900f1070 con 0x561cf0b4b220 2024-09-10T05:36:30.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.851+0000 7f0997f81640 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b52e30 con 0x561cf0b4ea00 2024-09-10T05:36:30.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.851+0000 7f0997780640 1 -- 172.21.15.62:0/611128491 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f098c026070 con 0x561cf0b4ea00 2024-09-10T05:36:30.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.851+0000 7f0997780640 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b52e30 con 0x561cf0b4b220 2024-09-10T05:36:30.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.851+0000 7f0997f81640 1 -- 172.21.15.62:0/611128491 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f09900f1070 con 0x561cf0b4b220 2024-09-10T05:36:30.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.851+0000 7f0997f81640 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b52e30 con 0x561cf0b4b220 2024-09-10T05:36:30.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.851+0000 7f0997f81640 1 -- 172.21.15.62:0/611128491 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09900f1070 con 0x561cf0b4b220 2024-09-10T05:36:30.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.851+0000 7f099a47b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:30.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.851+0000 7f099a47b9c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:30.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.851+0000 7f099a47b9c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:30.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.851+0000 7f099a47b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:30.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.851+0000 7f099a47b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:30.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.851+0000 7f099a47b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:30.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.851+0000 7f099a47b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:30.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.855+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b51f50 con 0x561cf0b46d90 2024-09-10T05:36:30.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.855+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f09880083f0 con 0x561cf0b46d90 2024-09-10T05:36:30.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.855+0000 7f099a47b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:30.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.855+0000 7f099a47b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:30.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.855+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b527f0 con 0x561cf0b4b220 2024-09-10T05:36:30.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.855+0000 7f0997f81640 1 -- 172.21.15.62:0/611128491 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f09900f1070 con 0x561cf0b4b220 2024-09-10T05:36:30.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.855+0000 7f099a47b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:30.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.855+0000 7f099a47b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:30.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.855+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b51b90 con 0x561cf0b4ea00 2024-09-10T05:36:30.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.855+0000 7f0997780640 1 -- 172.21.15.62:0/611128491 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f098c026070 con 0x561cf0b4ea00 2024-09-10T05:36:30.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.855+0000 7f099a47b9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:30.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.855+0000 7f099a47b9c0 20 zone default found 2024-09-10T05:36:30.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.855+0000 7f099a47b9c0 4 Realm: () 2024-09-10T05:36:30.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.855+0000 7f099a47b9c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:30.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.855+0000 7f099a47b9c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:30.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.855+0000 7f099a47b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:30.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.855+0000 7f099a47b9c0 20 zonegroup default 2024-09-10T05:36:30.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.855+0000 7f099a47b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:30.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.855+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b53710 con 0x7f0990111020 2024-09-10T05:36:30.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.855+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f09880083f0 con 0x7f0990111020 2024-09-10T05:36:30.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.855+0000 7f099a47b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:30.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.855+0000 7f099a47b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:30.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.855+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b55950 con 0x561cf0b4ea00 2024-09-10T05:36:30.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.855+0000 7f0997780640 1 -- 172.21.15.62:0/611128491 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f098c026070 con 0x561cf0b4ea00 2024-09-10T05:36:30.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.855+0000 7f099a47b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:30.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.855+0000 7f099a47b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:30.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.855+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b55cf0 con 0x561cf0b4ea00 2024-09-10T05:36:30.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.855+0000 7f0997780640 1 -- 172.21.15.62:0/611128491 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f098c026070 con 0x561cf0b4ea00 2024-09-10T05:36:30.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.855+0000 7f099a47b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:30.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.855+0000 7f099a47b9c0 20 started sync module instance, tier type = 2024-09-10T05:36:30.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.855+0000 7f099a47b9c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:30.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.855+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b54e30 con 0x561cf0b4b220 2024-09-10T05:36:30.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.859+0000 7f0997f81640 1 -- 172.21.15.62:0/611128491 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09900f1070 con 0x561cf0b4b220 2024-09-10T05:36:30.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.859+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94682297488176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b54e30 con 0x561cf0b4b220 2024-09-10T05:36:30.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.859+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b56780 con 0x561cf0b46d90 2024-09-10T05:36:30.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.863+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09880083f0 con 0x561cf0b46d90 2024-09-10T05:36:30.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.863+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94682297492112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b57020 con 0x561cf0b46d90 2024-09-10T05:36:30.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.863+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b57a60 con 0x561cf0b4b220 2024-09-10T05:36:30.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.863+0000 7f0997f81640 1 -- 172.21.15.62:0/611128491 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94682297488176] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09900f1070 con 0x561cf0b4b220 2024-09-10T05:36:30.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.863+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94682297492112] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09880083f0 con 0x561cf0b46d90 2024-09-10T05:36:30.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.863+0000 7f0997f81640 1 -- 172.21.15.62:0/611128491 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09900f1070 con 0x561cf0b4b220 2024-09-10T05:36:30.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.863+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94682297496880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b56b70 con 0x561cf0b4b220 2024-09-10T05:36:30.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.863+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b58300 con 0x7f0990111020 2024-09-10T05:36:30.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.867+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09880083f0 con 0x7f0990111020 2024-09-10T05:36:30.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.867+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94682297499216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b56b70 con 0x7f0990111020 2024-09-10T05:36:30.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.867+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b58d80 con 0x561cf0b4b220 2024-09-10T05:36:30.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.867+0000 7f0997f81640 1 -- 172.21.15.62:0/611128491 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94682297496880] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09900f1070 con 0x561cf0b4b220 2024-09-10T05:36:30.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.867+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94682297499216] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09880083f0 con 0x7f0990111020 2024-09-10T05:36:30.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.871+0000 7f0997f81640 1 -- 172.21.15.62:0/611128491 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09900f1070 con 0x561cf0b4b220 2024-09-10T05:36:30.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.871+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94682297500272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b58890 con 0x561cf0b4b220 2024-09-10T05:36:30.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.871+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b59620 con 0x561cf0b4ea00 2024-09-10T05:36:30.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.871+0000 7f0997780640 1 -- 172.21.15.62:0/611128491 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f098c026070 con 0x561cf0b4ea00 2024-09-10T05:36:30.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.871+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94682297504112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b58890 con 0x561cf0b4ea00 2024-09-10T05:36:30.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.871+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b5a060 con 0x561cf0b4ea00 2024-09-10T05:36:30.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.875+0000 7f0997f81640 1 -- 172.21.15.62:0/611128491 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94682297500272] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09900f1070 con 0x561cf0b4b220 2024-09-10T05:36:30.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.875+0000 7f0997780640 1 -- 172.21.15.62:0/611128491 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94682297504112] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f098c026070 con 0x561cf0b4ea00 2024-09-10T05:36:30.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.875+0000 7f0997780640 1 -- 172.21.15.62:0/611128491 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f098c026070 con 0x561cf0b4ea00 2024-09-10T05:36:30.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.875+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94682297505168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b59bb0 con 0x561cf0b4ea00 2024-09-10T05:36:30.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.875+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b5a570 con 0x7f0990111020 2024-09-10T05:36:30.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.883+0000 7f0997780640 1 -- 172.21.15.62:0/611128491 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94682297505168] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f098c026070 con 0x561cf0b4ea00 2024-09-10T05:36:30.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.883+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09880083f0 con 0x7f0990111020 2024-09-10T05:36:30.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.883+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94682297485696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b5a570 con 0x7f0990111020 2024-09-10T05:36:30.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.883+0000 7f099a47b9c0 20 add_watcher() i=0 2024-09-10T05:36:30.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.883+0000 7f099a47b9c0 20 add_watcher() i=1 2024-09-10T05:36:30.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.883+0000 7f099a47b9c0 20 add_watcher() i=2 2024-09-10T05:36:30.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.883+0000 7f099a47b9c0 20 add_watcher() i=3 2024-09-10T05:36:30.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.883+0000 7f099a47b9c0 20 add_watcher() i=4 2024-09-10T05:36:30.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.883+0000 7f099a47b9c0 20 add_watcher() i=5 2024-09-10T05:36:30.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.883+0000 7f099a47b9c0 20 add_watcher() i=6 2024-09-10T05:36:30.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.883+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94682297485696] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09880083f0 con 0x7f0990111020 2024-09-10T05:36:30.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.883+0000 7f099a47b9c0 20 add_watcher() i=7 2024-09-10T05:36:30.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.883+0000 7f099a47b9c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:30.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.883+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b5d910 con 0x561cf0b46d90 2024-09-10T05:36:30.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.883+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f09880083f0 con 0x561cf0b46d90 2024-09-10T05:36:30.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.883+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94682297520848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b5a6e0 con 0x561cf0b46d90 2024-09-10T05:36:30.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.887+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94682297520848] v30'56 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f09880083f0 con 0x561cf0b46d90 2024-09-10T05:36:30.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.887+0000 7f084e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:30.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.887+0000 7f099a47b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:30.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.887+0000 7f099a47b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:30.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.887+0000 7f099a47b9c0 5 note: GC not initialized 2024-09-10T05:36:30.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.887+0000 7f084d7e2640 20 reqs_thread_entry: start 2024-09-10T05:36:30.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.887+0000 7f099a47b9c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:30.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.887+0000 7f099a47b9c0 20 Filter name: none 2024-09-10T05:36:30.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.887+0000 7f08467fc640 20 reqs_thread_entry: start 2024-09-10T05:36:30.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.887+0000 7f099a47b9c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T05:36:30.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.887+0000 7f099a47b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:30.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.887+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b80cd0 con 0x561cf0b46d90 2024-09-10T05:36:30.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.887+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f09880083f0 con 0x561cf0b46d90 2024-09-10T05:36:30.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.887+0000 7f099a47b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:30.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.887+0000 7f099a47b9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-10T05:36:30.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.887+0000 7f099a47b9c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:36:30.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.887+0000 7f099a47b9c0 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-10T05:36:30.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.887+0000 7f099a47b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:30.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.887+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b7f370 con 0x561cf0b46d90 2024-09-10T05:36:30.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.887+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(63 foo@foo.com [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f09880083f0 con 0x561cf0b46d90 2024-09-10T05:36:30.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.887+0000 7f099a47b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:30.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.887+0000 7f099a47b9c0 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2024-09-10T05:36:30.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.887+0000 7f099a47b9c0 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-10T05:36:30.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.887+0000 7f099a47b9c0 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2024-09-10T05:36:30.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.887+0000 7f099a47b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:30.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.887+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:64 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b7f760 con 0x561cf0b46d90 2024-09-10T05:36:30.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.887+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(64 9te6NH5mcdcq0Tc5i8i1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f09880083f0 con 0x561cf0b46d90 2024-09-10T05:36:30.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.887+0000 7f099a47b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:30.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.891+0000 7f099a47b9c0 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2024-09-10T05:36:30.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.891+0000 7f099a47b9c0 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-10T05:36:30.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.891+0000 7f099a47b9c0 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-10T05:36:30.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.891+0000 7f099a47b9c0 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-10T05:36:30.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.891+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:65 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b7fca0 con 0x561cf0b46d90 2024-09-10T05:36:30.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.891+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(65 foo [delete,create,call,writefull 0~391] v30'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f09880083f0 con 0x561cf0b46d90 2024-09-10T05:36:30.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.891+0000 7f099a47b9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:36:30.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.891+0000 7f099a47b9c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:36:30.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.891+0000 7f099a47b9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T05:36:30.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.891+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify cookie 94682297665056 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b84720 con 0x561cf0b4b220 2024-09-10T05:36:30.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.891+0000 7f0997f81640 1 -- 172.21.15.62:0/611128491 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== watch-notify(notify (1) cookie 94682297500272 notify 128849018880 ret 0) ==== 609+0+0 (crc 0 0 0) 0x561cf0b29570 con 0x561cf0b4b220 2024-09-10T05:36:30.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.891+0000 7f0876ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018880 cookie 94682297500272 notifier 4290 bl.length()=567 2024-09-10T05:36:30.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.891+0000 7f0876ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:36:30.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.891+0000 7f0997f81640 1 -- 172.21.15.62:0/611128491 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(66 notify.4 [notify cookie 94682297665056 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f09900f1070 con 0x561cf0b4b220 2024-09-10T05:36:30.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.891+0000 7f0876ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:36:30.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.891+0000 7f0876ffd640 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f085c003eb0 con 0x561cf0b4b220 2024-09-10T05:36:30.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.891+0000 7f0997f81640 1 -- 172.21.15.62:0/611128491 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(67 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09900f1070 con 0x561cf0b4b220 2024-09-10T05:36:30.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.891+0000 7f0997f81640 1 -- 172.21.15.62:0/611128491 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== watch-notify(notify_complete (2) cookie 94682297665056 notify 128849018880 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561cf0b28d10 con 0x561cf0b4b220 2024-09-10T05:36:30.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.891+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:68 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b80620 con 0x561cf0b46d90 2024-09-10T05:36:30.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.895+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 <== osd.1 v2:172.21.15.62:6808/3442097179 23 ==== osd_op_reply(68 foo@foo.com [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f09880083f0 con 0x561cf0b46d90 2024-09-10T05:36:30.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.895+0000 7f099a47b9c0 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-10T05:36:30.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.895+0000 7f099a47b9c0 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-10T05:36:30.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.895+0000 7f099a47b9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-10T05:36:30.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.895+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 94682297665056 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b84b10 con 0x7f0990111020 2024-09-10T05:36:30.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.895+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== watch-notify(notify (1) cookie 94682297499216 notify 128849018880 ret 0) ==== 211+0+0 (crc 0 0 0) 0x561cf0b80040 con 0x7f0990111020 2024-09-10T05:36:30.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.895+0000 7f0876ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018880 cookie 94682297499216 notifier 4290 bl.length()=169 2024-09-10T05:36:30.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.895+0000 7f0876ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-10T05:36:30.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.895+0000 7f0876ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-10T05:36:30.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.895+0000 7f0876ffd640 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f085c003eb0 con 0x7f0990111020 2024-09-10T05:36:30.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.895+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(69 notify.3 [notify cookie 94682297665056 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f09880083f0 con 0x7f0990111020 2024-09-10T05:36:30.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.895+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09880083f0 con 0x7f0990111020 2024-09-10T05:36:30.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.895+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 <== osd.2 v2:172.21.15.62:6800/2677868286 15 ==== watch-notify(notify_complete (2) cookie 94682297665056 notify 128849018880 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561cf0b7f8c0 con 0x7f0990111020 2024-09-10T05:36:30.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.895+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:71 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b80620 con 0x561cf0b46d90 2024-09-10T05:36:30.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.899+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 <== osd.1 v2:172.21.15.62:6808/3442097179 24 ==== osd_op_reply(71 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f09880083f0 con 0x561cf0b46d90 2024-09-10T05:36:30.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.899+0000 7f099a47b9c0 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-10T05:36:30.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.899+0000 7f099a47b9c0 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-10T05:36:30.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.899+0000 7f099a47b9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-10T05:36:30.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.899+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify cookie 94682297665056 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b84b10 con 0x7f0990111020 2024-09-10T05:36:30.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.899+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 <== osd.2 v2:172.21.15.62:6800/2677868286 16 ==== watch-notify(notify (1) cookie 94682297499216 notify 128849018881 ret 0) ==== 219+0+0 (crc 0 0 0) 0x561cf0b7f8c0 con 0x7f0990111020 2024-09-10T05:36:30.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.899+0000 7f08767fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018881 cookie 94682297499216 notifier 4290 bl.length()=177 2024-09-10T05:36:30.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.899+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 <== osd.2 v2:172.21.15.62:6800/2677868286 17 ==== osd_op_reply(72 notify.3 [notify cookie 94682297665056 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f09880083f0 con 0x7f0990111020 2024-09-10T05:36:30.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.899+0000 7f08767fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-10T05:36:30.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.899+0000 7f08767fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-10T05:36:30.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.899+0000 7f08767fc640 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f07c0003410 con 0x7f0990111020 2024-09-10T05:36:30.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.899+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 <== osd.2 v2:172.21.15.62:6800/2677868286 18 ==== watch-notify(notify_complete (2) cookie 94682297665056 notify 128849018881 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f098800a510 con 0x7f0990111020 2024-09-10T05:36:30.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.899+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 <== osd.2 v2:172.21.15.62:6800/2677868286 19 ==== osd_op_reply(73 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09880083f0 con 0x7f0990111020 2024-09-10T05:36:30.904 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T05:36:30.893777Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:36:30.893760Z","tags":[],"group_ids":[]} 2024-09-10T05:36:30.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.899+0000 7f084e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:30.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.899+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:74 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94682297520848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b7ea70 con 0x561cf0b46d90 2024-09-10T05:36:30.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.903+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 <== osd.1 v2:172.21.15.62:6808/3442097179 25 ==== osd_op_reply(74 data_loggenerations_metadata [watch unwatch cookie 94682297520848] v30'57 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f09880083f0 con 0x561cf0b46d90 2024-09-10T05:36:30.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.903+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:75 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94682297488176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b7ea70 con 0x561cf0b4b220 2024-09-10T05:36:30.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.903+0000 7f0997f81640 1 -- 172.21.15.62:0/611128491 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== osd_op_reply(75 notify.0 [watch unwatch cookie 94682297488176] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09900f1070 con 0x561cf0b4b220 2024-09-10T05:36:30.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.903+0000 7f099a47b9c0 20 remove_watcher() i=0 2024-09-10T05:36:30.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.903+0000 7f099a47b9c0 2 removed watcher, disabling cache 2024-09-10T05:36:30.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.903+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94682297492112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b7ea70 con 0x561cf0b46d90 2024-09-10T05:36:30.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.907+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 <== osd.1 v2:172.21.15.62:6808/3442097179 26 ==== osd_op_reply(76 notify.1 [watch unwatch cookie 94682297492112] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09880083f0 con 0x561cf0b46d90 2024-09-10T05:36:30.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.907+0000 7f099a47b9c0 20 remove_watcher() i=1 2024-09-10T05:36:30.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.907+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94682297496880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b7ea70 con 0x561cf0b4b220 2024-09-10T05:36:30.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.907+0000 7f0997f81640 1 -- 172.21.15.62:0/611128491 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(77 notify.2 [watch unwatch cookie 94682297496880] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09900f1070 con 0x561cf0b4b220 2024-09-10T05:36:30.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.907+0000 7f099a47b9c0 20 remove_watcher() i=2 2024-09-10T05:36:30.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.907+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94682297499216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b7ea70 con 0x7f0990111020 2024-09-10T05:36:30.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.911+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 <== osd.2 v2:172.21.15.62:6800/2677868286 20 ==== osd_op_reply(78 notify.3 [watch unwatch cookie 94682297499216] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09880083f0 con 0x7f0990111020 2024-09-10T05:36:30.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.911+0000 7f099a47b9c0 20 remove_watcher() i=3 2024-09-10T05:36:30.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.911+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:79 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94682297500272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b7ea70 con 0x561cf0b4b220 2024-09-10T05:36:30.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.911+0000 7f0997f81640 1 -- 172.21.15.62:0/611128491 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(79 notify.4 [watch unwatch cookie 94682297500272] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09900f1070 con 0x561cf0b4b220 2024-09-10T05:36:30.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.911+0000 7f099a47b9c0 20 remove_watcher() i=4 2024-09-10T05:36:30.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.911+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:80 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94682297504112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b7ea70 con 0x561cf0b4ea00 2024-09-10T05:36:30.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.911+0000 7f0997780640 1 -- 172.21.15.62:0/611128491 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(80 notify.5 [watch unwatch cookie 94682297504112] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f098c026070 con 0x561cf0b4ea00 2024-09-10T05:36:30.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.911+0000 7f099a47b9c0 20 remove_watcher() i=5 2024-09-10T05:36:30.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.911+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:81 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94682297505168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b7ea70 con 0x561cf0b4ea00 2024-09-10T05:36:30.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.915+0000 7f0997780640 1 -- 172.21.15.62:0/611128491 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(81 notify.6 [watch unwatch cookie 94682297505168] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f098c026070 con 0x561cf0b4ea00 2024-09-10T05:36:30.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.915+0000 7f099a47b9c0 20 remove_watcher() i=6 2024-09-10T05:36:30.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.915+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:82 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94682297485696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cf0b7ea70 con 0x7f0990111020 2024-09-10T05:36:30.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.915+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 <== osd.2 v2:172.21.15.62:6800/2677868286 21 ==== osd_op_reply(82 notify.7 [watch unwatch cookie 94682297485696] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09880083f0 con 0x7f0990111020 2024-09-10T05:36:30.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.915+0000 7f099a47b9c0 20 remove_watcher() i=7 2024-09-10T05:36:30.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.915+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561cf0b4b220 msgr2=0x561cf0b4d610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.915+0000 7f099a47b9c0 1 --2- 172.21.15.62:0/611128491 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561cf0b4b220 0x561cf0b4d610 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.915+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x561cf0b46d90 msgr2=0x561cf0b49220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.915+0000 7f099a47b9c0 1 --2- 172.21.15.62:0/611128491 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x561cf0b46d90 0x561cf0b49220 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.915+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f0990111020 msgr2=0x7f0990108460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.915+0000 7f099a47b9c0 1 --2- 172.21.15.62:0/611128491 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f0990111020 0x7f0990108460 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.915+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x561cf0b4ea00 msgr2=0x561cf0b50df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.915+0000 7f099a47b9c0 1 --2- 172.21.15.62:0/611128491 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x561cf0b4ea00 0x561cf0b50df0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.915+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0860039a20 msgr2=0x7f086003bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.915+0000 7f099a47b9c0 1 --2- 172.21.15.62:0/611128491 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0860039a20 0x7f086003bee0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f098c01d040 tx=0x7f098c010000 comp rx=0 tx=0).stop 2024-09-10T05:36:30.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.915+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cf0b34a50 msgr2=0x561cf0b3bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.915+0000 7f0998782640 1 -- 172.21.15.62:0/611128491 reap_dead start 2024-09-10T05:36:30.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.915+0000 7f099a47b9c0 1 --2- 172.21.15.62:0/611128491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cf0b34a50 0x561cf0b3bd90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f09900bcad0 tx=0x7f09900bafa0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.915+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 shutdown_connections 2024-09-10T05:36:30.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.915+0000 7f099a47b9c0 1 --2- 172.21.15.62:0/611128491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cf0b34a50 0x561cf0b3bd90 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.915+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 >> 172.21.15.62:0/611128491 conn(0x561cf0b30e80 msgr2=0x561cf0b2f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:30.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.915+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 shutdown_connections 2024-09-10T05:36:30.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.915+0000 7f099a47b9c0 1 -- 172.21.15.62:0/611128491 wait complete. 2024-09-10T05:36:30.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.915+0000 7f099a47b9c0 1 -- 172.21.15.62:0/2244439216 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0870039a70 msgr2=0x7f087003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.915+0000 7f099a47b9c0 1 --2- 172.21.15.62:0/2244439216 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0870039a70 0x7f087003bf30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f098c00bf50 tx=0x7f098c00f000 comp rx=0 tx=0).stop 2024-09-10T05:36:30.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.915+0000 7f099a47b9c0 1 -- 172.21.15.62:0/2244439216 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cf0b282b0 msgr2=0x561cf0b286d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.915+0000 7f099a47b9c0 1 --2- 172.21.15.62:0/2244439216 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cf0b282b0 0x561cf0b286d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f09900bc570 tx=0x7f09900ab000 comp rx=0 tx=0).stop 2024-09-10T05:36:30.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.915+0000 7f099a47b9c0 1 -- 172.21.15.62:0/2244439216 shutdown_connections 2024-09-10T05:36:30.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.915+0000 7f099a47b9c0 1 --2- 172.21.15.62:0/2244439216 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0870039a70 0x7f087003bf30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.915+0000 7f099a47b9c0 1 --2- 172.21.15.62:0/2244439216 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cf0b282b0 0x561cf0b286d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.915+0000 7f099a47b9c0 1 -- 172.21.15.62:0/2244439216 >> 172.21.15.62:0/2244439216 conn(0x561cf0b1dc60 msgr2=0x561cf0b1e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:30.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.915+0000 7f099a47b9c0 1 -- 172.21.15.62:0/2244439216 shutdown_connections 2024-09-10T05:36:30.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.915+0000 7f099a47b9c0 1 -- 172.21.15.62:0/2244439216 wait complete. 2024-09-10T05:36:30.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.919+0000 7f099a47b9c0 1 -- 172.21.15.62:0/1182268591 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561cf0b12730 msgr2=0x561cf0b14bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.919+0000 7f099a47b9c0 1 --2- 172.21.15.62:0/1182268591 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561cf0b12730 0x561cf0b14bf0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.919+0000 7f099a47b9c0 1 -- 172.21.15.62:0/1182268591 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x561cf0b0f2e0 msgr2=0x561cf0b116d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.919+0000 7f099a47b9c0 1 --2- 172.21.15.62:0/1182268591 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x561cf0b0f2e0 0x561cf0b116d0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.919+0000 7f099a47b9c0 1 -- 172.21.15.62:0/1182268591 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x561cf0b17120 msgr2=0x561cf0b19510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.919+0000 7f099a47b9c0 1 --2- 172.21.15.62:0/1182268591 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x561cf0b17120 0x561cf0b19510 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.919+0000 7f099a47b9c0 1 -- 172.21.15.62:0/1182268591 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0880039a70 msgr2=0x7f088003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.919+0000 7f099a47b9c0 1 --2- 172.21.15.62:0/1182268591 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0880039a70 0x7f088003bf30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f098c001d80 tx=0x7f098c0012e0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.919+0000 7f099a47b9c0 1 -- 172.21.15.62:0/1182268591 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cf0a180b0 msgr2=0x561cf0b0a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.919+0000 7f099a47b9c0 1 --2- 172.21.15.62:0/1182268591 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cf0a180b0 0x561cf0b0a270 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0990008030 tx=0x7f0990017d70 comp rx=0 tx=0).stop 2024-09-10T05:36:30.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.919+0000 7f0998782640 1 -- 172.21.15.62:0/1182268591 reap_dead start 2024-09-10T05:36:30.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.919+0000 7f099a47b9c0 1 -- 172.21.15.62:0/1182268591 shutdown_connections 2024-09-10T05:36:30.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.919+0000 7f099a47b9c0 1 -- 172.21.15.62:0/1182268591 >> 172.21.15.62:0/1182268591 conn(0x561cf0a0f8a0 msgr2=0x561cf0a13dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:30.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.919+0000 7f099a47b9c0 1 -- 172.21.15.62:0/1182268591 shutdown_connections 2024-09-10T05:36:30.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.919+0000 7f099a47b9c0 1 -- 172.21.15.62:0/1182268591 wait complete. 2024-09-10T05:36:30.932 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T05:36:30.893777Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:36:30.893760Z', 'tags': [], 'group_ids': []} 2024-09-10T05:36:30.932 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-10T05:36:30.932 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-10T05:36:30.932 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2024-09-10T05:36:30.967 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:30.967 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:30.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.963+0000 7f20ad6779c0 1 Processor -- start 2024-09-10T05:36:30.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.963+0000 7f20ad6779c0 1 -- start start 2024-09-10T05:36:30.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.967+0000 7f20ad6779c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55ef5fe91730 0x55ef5fe90300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.967+0000 7f20ad6779c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ef5fdcf9c0 con 0x55ef5fe91200 2024-09-10T05:36:30.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.967+0000 7f20ad6779c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x55ef5fe1f6d0 con 0x55ef5fe91730 2024-09-10T05:36:30.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.967+0000 7f20a3fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55ef5fe91730 0x55ef5fe90300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.967+0000 7f20ab17d640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x55ef5fe91200 0x55ef5fe8fbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:38472/0 (socket says 172.21.15.62:38472) 2024-09-10T05:36:30.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.967+0000 7f20ab17d640 1 -- 172.21.15.62:0/2582256685 learned_addr learned my addr 172.21.15.62:0/2582256685 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-10T05:36:30.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.967+0000 7f20a3fff640 1 -- 172.21.15.62:0/2582256685 >> v1:172.21.15.2:6789/0 conn(0x55ef5fe91200 legacy=0x55ef5fe8fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.967+0000 7f20a3fff640 1 -- 172.21.15.62:0/2582256685 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef5fdc3ca0 con 0x55ef5fe91730 2024-09-10T05:36:30.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.967+0000 7f20a3fff640 1 --2- 172.21.15.62:0/2582256685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ef5fe91730 0x55ef5fe90300 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f209400a480 tx=0x7f209401b1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4abc2fcfe7190d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.967+0000 7f20aa97c640 1 -- 172.21.15.62:0/2582256685 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20940af070 con 0x55ef5fe91730 2024-09-10T05:36:30.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.967+0000 7f20aa97c640 1 -- 172.21.15.62:0/2582256685 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20940aa530 con 0x55ef5fe91730 2024-09-10T05:36:30.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.967+0000 7f20aa97c640 1 -- 172.21.15.62:0/2582256685 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20940aa830 con 0x55ef5fe91730 2024-09-10T05:36:30.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.971+0000 7f20ad6779c0 1 -- 172.21.15.62:0/2582256685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ef5fe91730 msgr2=0x55ef5fe90300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.971+0000 7f20ad6779c0 1 --2- 172.21.15.62:0/2582256685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ef5fe91730 0x55ef5fe90300 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f209400a480 tx=0x7f209401b1c0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.971+0000 7f20ad6779c0 1 -- 172.21.15.62:0/2582256685 shutdown_connections 2024-09-10T05:36:30.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.971+0000 7f20ad6779c0 1 --2- 172.21.15.62:0/2582256685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ef5fe91730 0x55ef5fe90300 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.971+0000 7f20ad6779c0 1 -- 172.21.15.62:0/2582256685 >> 172.21.15.62:0/2582256685 conn(0x55ef5ff16a20 msgr2=0x55ef5ff18e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:30.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.971+0000 7f20ad6779c0 1 -- 172.21.15.62:0/2582256685 shutdown_connections 2024-09-10T05:36:30.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.971+0000 7f20ad6779c0 1 -- 172.21.15.62:0/2582256685 wait complete. 2024-09-10T05:36:30.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.983+0000 7f20ad6779c0 1 Processor -- start 2024-09-10T05:36:30.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.983+0000 7f20ad6779c0 1 -- start start 2024-09-10T05:36:30.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.983+0000 7f20ad6779c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ef5fe91200 0x55ef60008c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.983+0000 7f20ad6779c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ef5fe23680 con 0x55ef5fe91200 2024-09-10T05:36:30.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.983+0000 7f20ab17d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ef5fe91200 0x55ef60008c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.983+0000 7f20ab17d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ef5fe91200 0x55ef60008c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51264/0 (socket says 172.21.15.62:51264) 2024-09-10T05:36:30.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.983+0000 7f20ab17d640 1 -- 172.21.15.62:0/4039908340 learned_addr learned my addr 172.21.15.62:0/4039908340 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:30.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.987+0000 7f20ab17d640 1 -- 172.21.15.62:0/4039908340 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef5fd9eda0 con 0x55ef5fe91200 2024-09-10T05:36:30.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.987+0000 7f20ab17d640 1 --2- 172.21.15.62:0/4039908340 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ef5fe91200 0x55ef60008c10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f209c001e50 tx=0x7f209c001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d9b619b31dd39e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.987+0000 7f1f9960a640 1 -- 172.21.15.62:0/4039908340 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f209c012020 con 0x55ef5fe91200 2024-09-10T05:36:30.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.987+0000 7f1f9960a640 1 -- 172.21.15.62:0/4039908340 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f209c00e7c0 con 0x55ef5fe91200 2024-09-10T05:36:30.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.987+0000 7f1f9960a640 1 -- 172.21.15.62:0/4039908340 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f209c00eaa0 con 0x55ef5fe91200 2024-09-10T05:36:30.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.987+0000 7f20ad6779c0 1 -- 172.21.15.62:0/4039908340 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ef5fe91200 msgr2=0x55ef60008c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:30.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.987+0000 7f20ad6779c0 1 --2- 172.21.15.62:0/4039908340 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ef5fe91200 0x55ef60008c10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f209c001e50 tx=0x7f209c001e80 comp rx=0 tx=0).stop 2024-09-10T05:36:30.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.987+0000 7f20ad6779c0 1 -- 172.21.15.62:0/4039908340 shutdown_connections 2024-09-10T05:36:30.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.987+0000 7f20ad6779c0 1 --2- 172.21.15.62:0/4039908340 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ef5fe91200 0x55ef60008c10 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:30.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.987+0000 7f20ad6779c0 1 -- 172.21.15.62:0/4039908340 >> 172.21.15.62:0/4039908340 conn(0x55ef5ff16a20 msgr2=0x55ef60004850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:30.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.987+0000 7f20ad6779c0 1 -- 172.21.15.62:0/4039908340 shutdown_connections 2024-09-10T05:36:30.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.987+0000 7f20ad6779c0 1 -- 172.21.15.62:0/4039908340 wait complete. 2024-09-10T05:36:30.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.987+0000 7f20ad6779c0 1 Processor -- start 2024-09-10T05:36:30.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.987+0000 7f20ad6779c0 1 -- start start 2024-09-10T05:36:30.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.987+0000 7f20ad6779c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ef5fe91200 0x55ef600102c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.987+0000 7f20ad6779c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ef5fdc5a50 con 0x55ef5fe91200 2024-09-10T05:36:30.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.987+0000 7f20ab17d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ef5fe91200 0x55ef600102c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.987+0000 7f20ab17d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ef5fe91200 0x55ef600102c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51266/0 (socket says 172.21.15.62:51266) 2024-09-10T05:36:30.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.987+0000 7f20ab17d640 1 -- 172.21.15.62:0/3950817679 learned_addr learned my addr 172.21.15.62:0/3950817679 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:30.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.987+0000 7f20ab17d640 1 -- 172.21.15.62:0/3950817679 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef60010820 con 0x55ef5fe91200 2024-09-10T05:36:30.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.987+0000 7f20ab17d640 1 --2- 172.21.15.62:0/3950817679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ef5fe91200 0x55ef600102c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x55ef60009ba0 tx=0x7f209c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.987+0000 7f1f97e07640 1 -- 172.21.15.62:0/3950817679 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f209c012030 con 0x55ef5fe91200 2024-09-10T05:36:30.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.987+0000 7f20ad6779c0 1 -- 172.21.15.62:0/3950817679 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ef60010ab0 con 0x55ef5fe91200 2024-09-10T05:36:30.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.987+0000 7f1f97e07640 1 -- 172.21.15.62:0/3950817679 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f209c01a680 con 0x55ef5fe91200 2024-09-10T05:36:30.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.987+0000 7f1f97e07640 1 -- 172.21.15.62:0/3950817679 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f209c01a980 con 0x55ef5fe91200 2024-09-10T05:36:30.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.987+0000 7f20ad6779c0 1 -- 172.21.15.62:0/3950817679 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef60011460 con 0x55ef5fe91200 2024-09-10T05:36:30.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.991+0000 7f1f97e07640 1 -- 172.21.15.62:0/3950817679 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f209c015020 con 0x55ef5fe91200 2024-09-10T05:36:30.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.991+0000 7f1f97e07640 1 --2- 172.21.15.62:0/3950817679 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1f90039ac0 0x7f1f9003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.991+0000 7f1f97e07640 1 -- 172.21.15.62:0/3950817679 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f209c020070 con 0x55ef5fe91200 2024-09-10T05:36:30.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.991+0000 7f20a3fff640 1 --2- 172.21.15.62:0/3950817679 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1f90039ac0 0x7f1f9003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.991+0000 7f20ad6779c0 1 --2- 172.21.15.62:0/3950817679 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55ef5fe91730 0x55ef60017430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.991+0000 7f20ad6779c0 1 -- 172.21.15.62:0/3950817679 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ef60017970 con 0x55ef5fe91730 2024-09-10T05:36:30.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.991+0000 7f20ab97e640 1 --2- 172.21.15.62:0/3950817679 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55ef5fe91730 0x55ef60017430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.991+0000 7f20a3fff640 1 --2- 172.21.15.62:0/3950817679 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1f90039ac0 0x7f1f9003bf80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f20940ac000 tx=0x7f20940a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.991+0000 7f20ab97e640 1 --2- 172.21.15.62:0/3950817679 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55ef5fe91730 0x55ef60017430 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.991+0000 7f20ab97e640 1 -- 172.21.15.62:0/3950817679 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20a400a4d0 con 0x55ef5fe91730 2024-09-10T05:36:30.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.991+0000 7f20ad6779c0 1 --2- 172.21.15.62:0/3950817679 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55ef600186d0 0x55ef6001aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.991+0000 7f20ad6779c0 1 -- 172.21.15.62:0/3950817679 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ef6001b0b0 con 0x55ef600186d0 2024-09-10T05:36:30.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.991+0000 7f20ab17d640 1 --2- 172.21.15.62:0/3950817679 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55ef600186d0 0x55ef6001aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.991+0000 7f20ab17d640 1 --2- 172.21.15.62:0/3950817679 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55ef600186d0 0x55ef6001aac0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.995+0000 7f20ab17d640 1 -- 172.21.15.62:0/3950817679 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f209c008030 con 0x55ef600186d0 2024-09-10T05:36:30.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.995+0000 7f20ad6779c0 1 --2- 172.21.15.62:0/3950817679 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55ef6001ce70 0x55ef6001f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:30.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.995+0000 7f20ad6779c0 1 -- 172.21.15.62:0/3950817679 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ef6001f950 con 0x55ef6001ce70 2024-09-10T05:36:30.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.995+0000 7f20a3fff640 1 --2- 172.21.15.62:0/3950817679 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55ef6001ce70 0x55ef6001f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:30.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.995+0000 7f20a3fff640 1 --2- 172.21.15.62:0/3950817679 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55ef6001ce70 0x55ef6001f260 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:30.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.995+0000 7f20a3fff640 1 -- 172.21.15.62:0/3950817679 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f20940b2040 con 0x55ef6001ce70 2024-09-10T05:36:31.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.995+0000 7f20ad6779c0 1 -- 172.21.15.62:0/3950817679 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ef6001bd10 con 0x55ef600186d0 2024-09-10T05:36:31.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.995+0000 7f20ab17d640 1 -- 172.21.15.62:0/3950817679 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f209c008030 con 0x55ef600186d0 2024-09-10T05:36:31.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.995+0000 7f20ad6779c0 1 -- 172.21.15.62:0/3950817679 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ef6001c170 con 0x55ef6001ce70 2024-09-10T05:36:31.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.995+0000 7f20a3fff640 1 -- 172.21.15.62:0/3950817679 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f20940b2040 con 0x55ef6001ce70 2024-09-10T05:36:31.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.995+0000 7f20ad6779c0 1 Processor -- start 2024-09-10T05:36:31.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.995+0000 7f20ad6779c0 1 -- start start 2024-09-10T05:36:31.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.995+0000 7f20ad6779c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ef6002dee0 0x55ef6002e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.995+0000 7f20ad6779c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ef5fe30450 con 0x55ef6002dee0 2024-09-10T05:36:31.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.995+0000 7f20ab17d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ef6002dee0 0x55ef6002e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.995+0000 7f20ab17d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ef6002dee0 0x55ef6002e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51274/0 (socket says 172.21.15.62:51274) 2024-09-10T05:36:31.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.995+0000 7f20ab17d640 1 -- 172.21.15.62:0/2019812595 learned_addr learned my addr 172.21.15.62:0/2019812595 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:31.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.995+0000 7f20ab17d640 1 -- 172.21.15.62:0/2019812595 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef6002e940 con 0x55ef6002dee0 2024-09-10T05:36:31.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.999+0000 7f20ab17d640 1 --2- 172.21.15.62:0/2019812595 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ef6002dee0 0x55ef6002e300 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f209c04ecc0 tx=0x7f209c01adf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.999+0000 7f1f95602640 1 -- 172.21.15.62:0/2019812595 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f209c02ce50 con 0x55ef6002dee0 2024-09-10T05:36:31.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.999+0000 7f1f95602640 1 -- 172.21.15.62:0/2019812595 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f209c016b00 con 0x55ef6002dee0 2024-09-10T05:36:31.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.999+0000 7f1f95602640 1 -- 172.21.15.62:0/2019812595 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f209c016cd0 con 0x55ef6002dee0 2024-09-10T05:36:31.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.999+0000 7f20ad6779c0 1 -- 172.21.15.62:0/2019812595 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ef6002f1a0 con 0x55ef6002dee0 2024-09-10T05:36:31.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.999+0000 7f20ad6779c0 1 -- 172.21.15.62:0/2019812595 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef6002f1a0 con 0x55ef6002dee0 2024-09-10T05:36:31.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.999+0000 7f1f95602640 1 -- 172.21.15.62:0/2019812595 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f209c049040 con 0x55ef6002dee0 2024-09-10T05:36:31.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.999+0000 7f1f95602640 1 --2- 172.21.15.62:0/2019812595 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1f84039a70 0x7f1f8403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.999+0000 7f1f95602640 1 -- 172.21.15.62:0/2019812595 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f209c047050 con 0x55ef6002dee0 2024-09-10T05:36:31.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.999+0000 7f20a3fff640 1 --2- 172.21.15.62:0/2019812595 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1f84039a70 0x7f1f8403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.999+0000 7f20ad6779c0 1 Processor -- start 2024-09-10T05:36:31.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.999+0000 7f20ad6779c0 1 -- start start 2024-09-10T05:36:31.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.999+0000 7f20ad6779c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ef6003b460 0x55ef6003b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.999+0000 7f20ad6779c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ef60009460 con 0x55ef6003b460 2024-09-10T05:36:31.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.999+0000 7f20a3fff640 1 --2- 172.21.15.62:0/2019812595 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1f84039a70 0x7f1f8403bf30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f20940ad040 tx=0x7f2094005a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.999+0000 7f20ab17d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ef6003b460 0x55ef6003b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.999+0000 7f20ab17d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ef6003b460 0x55ef6003b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51290/0 (socket says 172.21.15.62:51290) 2024-09-10T05:36:31.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.999+0000 7f20ab17d640 1 -- 172.21.15.62:0/4015178685 learned_addr learned my addr 172.21.15.62:0/4015178685 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:31.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.999+0000 7f20ab17d640 1 -- 172.21.15.62:0/4015178685 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef6003be50 con 0x55ef6003b460 2024-09-10T05:36:31.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:30.999+0000 7f20ab17d640 1 --2- 172.21.15.62:0/4015178685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ef6003b460 0x55ef6003b860 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f209c001660 tx=0x7f209c023f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6b85b1f07eef2c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.003+0000 7f1f8effd640 1 -- 172.21.15.62:0/4015178685 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f209c03c610 con 0x55ef6003b460 2024-09-10T05:36:31.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.003+0000 7f1f8effd640 1 -- 172.21.15.62:0/4015178685 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f209c040150 con 0x55ef6003b460 2024-09-10T05:36:31.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.003+0000 7f1f8effd640 1 -- 172.21.15.62:0/4015178685 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f209c047c90 con 0x55ef6003b460 2024-09-10T05:36:31.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.003+0000 7f20ad6779c0 1 -- 172.21.15.62:0/4015178685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ef6003b460 msgr2=0x55ef6003b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.003+0000 7f20ad6779c0 1 --2- 172.21.15.62:0/4015178685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ef6003b460 0x55ef6003b860 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f209c001660 tx=0x7f209c023f80 comp rx=0 tx=0).stop 2024-09-10T05:36:31.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.003+0000 7f20ad6779c0 1 -- 172.21.15.62:0/4015178685 shutdown_connections 2024-09-10T05:36:31.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.003+0000 7f20ad6779c0 1 --2- 172.21.15.62:0/4015178685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ef6003b460 0x55ef6003b860 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.003+0000 7f20ad6779c0 1 -- 172.21.15.62:0/4015178685 >> 172.21.15.62:0/4015178685 conn(0x55ef60036880 msgr2=0x55ef60034ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:31.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.003+0000 7f20ad6779c0 1 -- 172.21.15.62:0/4015178685 shutdown_connections 2024-09-10T05:36:31.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.003+0000 7f20ad6779c0 1 -- 172.21.15.62:0/4015178685 wait complete. 2024-09-10T05:36:31.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.003+0000 7f20ad6779c0 1 Processor -- start 2024-09-10T05:36:31.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.003+0000 7f20ad6779c0 1 -- start start 2024-09-10T05:36:31.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.003+0000 7f20ad6779c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ef6003b460 0x55ef60041710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.003+0000 7f20ad6779c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ef6003a230 con 0x55ef6003b460 2024-09-10T05:36:31.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.003+0000 7f20ab17d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ef6003b460 0x55ef60041710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.003+0000 7f20ab17d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ef6003b460 0x55ef60041710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51296/0 (socket says 172.21.15.62:51296) 2024-09-10T05:36:31.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.003+0000 7f20ab17d640 1 -- 172.21.15.62:0/1992077859 learned_addr learned my addr 172.21.15.62:0/1992077859 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:31.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.003+0000 7f20ab17d640 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef60041c70 con 0x55ef6003b460 2024-09-10T05:36:31.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.003+0000 7f20ab17d640 1 --2- 172.21.15.62:0/1992077859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ef6003b460 0x55ef60041710 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f209c04db10 tx=0x7f209c043f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.003+0000 7f1f8d7fa640 1 -- 172.21.15.62:0/1992077859 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f209c069070 con 0x55ef6003b460 2024-09-10T05:36:31.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.003+0000 7f1f8d7fa640 1 -- 172.21.15.62:0/1992077859 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f209c03c610 con 0x55ef6003b460 2024-09-10T05:36:31.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.003+0000 7f1f8d7fa640 1 -- 172.21.15.62:0/1992077859 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f209c04d1f0 con 0x55ef6003b460 2024-09-10T05:36:31.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.003+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ef60041c70 con 0x55ef6003b460 2024-09-10T05:36:31.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.003+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef60041c70 con 0x55ef6003b460 2024-09-10T05:36:31.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.007+0000 7f20ad6779c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.007+0000 7f1f8d7fa640 1 -- 172.21.15.62:0/1992077859 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f209c061070 con 0x55ef6003b460 2024-09-10T05:36:31.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.007+0000 7f1f8d7fa640 1 --2- 172.21.15.62:0/1992077859 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1f74039a70 0x7f1f7403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.007+0000 7f1f8d7fa640 1 -- 172.21.15.62:0/1992077859 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f209c05f020 con 0x55ef6003b460 2024-09-10T05:36:31.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.007+0000 7f20a3fff640 1 --2- 172.21.15.62:0/1992077859 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1f74039a70 0x7f1f7403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.007+0000 7f20ad6779c0 1 --2- 172.21.15.62:0/1992077859 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55ef6004c6c0 0x55ef6004eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.007+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ef6004f260 con 0x55ef6004c6c0 2024-09-10T05:36:31.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.007+0000 7f20ab97e640 1 --2- 172.21.15.62:0/1992077859 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55ef6004c6c0 0x55ef6004eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.007+0000 7f20a3fff640 1 --2- 172.21.15.62:0/1992077859 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1f74039a70 0x7f1f7403bf30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2094000c10 tx=0x7f20940a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.007+0000 7f20ab97e640 1 --2- 172.21.15.62:0/1992077859 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55ef6004c6c0 0x55ef6004eb10 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.007+0000 7f20ab97e640 1 -- 172.21.15.62:0/1992077859 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20a400a4d0 con 0x55ef6004c6c0 2024-09-10T05:36:31.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.007+0000 7f20ad6779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:31.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.007+0000 7f20ad6779c0 20 realm 2024-09-10T05:36:31.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.007+0000 7f20ad6779c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.007+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ef6004bb00 con 0x55ef6004c6c0 2024-09-10T05:36:31.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.007+0000 7f20ab97e640 1 -- 172.21.15.62:0/1992077859 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20a400a4d0 con 0x55ef6004c6c0 2024-09-10T05:36:31.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.007+0000 7f20ad6779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:31.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.007+0000 7f20ad6779c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:31.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.007+0000 7f20ad6779c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.007+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ef6004fd20 con 0x55ef6004c6c0 2024-09-10T05:36:31.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.007+0000 7f20ab97e640 1 -- 172.21.15.62:0/1992077859 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20a400a4d0 con 0x55ef6004c6c0 2024-09-10T05:36:31.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.007+0000 7f20ad6779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:31.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.007+0000 7f20ad6779c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.007+0000 7f20ad6779c0 1 --2- 172.21.15.62:0/1992077859 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55ef60050b00 0x55ef60052ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.007+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ef600535c0 con 0x55ef60050b00 2024-09-10T05:36:31.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.007+0000 7f20ab17d640 1 --2- 172.21.15.62:0/1992077859 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55ef60050b00 0x55ef60052ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.007+0000 7f20ab17d640 1 --2- 172.21.15.62:0/1992077859 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55ef60050b00 0x55ef60052ef0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.011+0000 7f20ab17d640 1 -- 172.21.15.62:0/1992077859 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f209c008030 con 0x55ef60050b00 2024-09-10T05:36:31.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.011+0000 7f20ad6779c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:31.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.011+0000 7f20ad6779c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.011+0000 7f20ad6779c0 1 --2- 172.21.15.62:0/1992077859 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55ef60054320 0x55ef60056710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.011+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ef60056ea0 con 0x55ef60054320 2024-09-10T05:36:31.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.011+0000 7f20a3fff640 1 --2- 172.21.15.62:0/1992077859 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55ef60054320 0x55ef60056710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.011+0000 7f20a3fff640 1 --2- 172.21.15.62:0/1992077859 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55ef60054320 0x55ef60056710 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.011+0000 7f20a3fff640 1 -- 172.21.15.62:0/1992077859 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f20940b2040 con 0x55ef60054320 2024-09-10T05:36:31.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.011+0000 7f20ad6779c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:31.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.011+0000 7f20ad6779c0 20 searching for the correct realm 2024-09-10T05:36:31.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.011+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef60058770 con 0x55ef60054320 2024-09-10T05:36:31.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.011+0000 7f20a3fff640 1 -- 172.21.15.62:0/1992077859 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20940b2040 con 0x55ef60054320 2024-09-10T05:36:31.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.011+0000 7f20a3fff640 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef60058770 con 0x55ef60050b00 2024-09-10T05:36:31.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.011+0000 7f20ab17d640 1 -- 172.21.15.62:0/1992077859 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f209c008030 con 0x55ef60050b00 2024-09-10T05:36:31.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.011+0000 7f20ab17d640 1 --2- 172.21.15.62:0/1992077859 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f209c04c070 0x7f209c021810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.011+0000 7f20ab17d640 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef60058770 con 0x7f209c04c070 2024-09-10T05:36:31.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.011+0000 7f20ab97e640 1 --2- 172.21.15.62:0/1992077859 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f209c04c070 0x7f209c021810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.011+0000 7f20ab97e640 1 --2- 172.21.15.62:0/1992077859 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f209c04c070 0x7f209c021810 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.011+0000 7f20ab97e640 1 -- 172.21.15.62:0/1992077859 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20a400a4d0 con 0x7f209c04c070 2024-09-10T05:36:31.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.011+0000 7f20ab97e640 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef60058770 con 0x55ef6004c6c0 2024-09-10T05:36:31.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.011+0000 7f20ab97e640 1 -- 172.21.15.62:0/1992077859 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20a400a4d0 con 0x55ef6004c6c0 2024-09-10T05:36:31.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.011+0000 7f20ab97e640 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef60058770 con 0x55ef6004c6c0 2024-09-10T05:36:31.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.011+0000 7f20ab97e640 1 -- 172.21.15.62:0/1992077859 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20a400a4d0 con 0x55ef6004c6c0 2024-09-10T05:36:31.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.011+0000 7f20ab97e640 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef60058770 con 0x55ef60054320 2024-09-10T05:36:31.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.015+0000 7f20a3fff640 1 -- 172.21.15.62:0/1992077859 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20940b2040 con 0x55ef60054320 2024-09-10T05:36:31.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.015+0000 7f20a3fff640 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef60058770 con 0x55ef6004c6c0 2024-09-10T05:36:31.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.015+0000 7f20ab97e640 1 -- 172.21.15.62:0/1992077859 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20a400a4d0 con 0x55ef6004c6c0 2024-09-10T05:36:31.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.015+0000 7f20ab97e640 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef60058770 con 0x55ef60050b00 2024-09-10T05:36:31.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.015+0000 7f20ab17d640 1 -- 172.21.15.62:0/1992077859 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f209c008030 con 0x55ef60050b00 2024-09-10T05:36:31.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.015+0000 7f20ab17d640 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef60058770 con 0x55ef60050b00 2024-09-10T05:36:31.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.015+0000 7f20ab17d640 1 -- 172.21.15.62:0/1992077859 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f209c008030 con 0x55ef60050b00 2024-09-10T05:36:31.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.015+0000 7f20ab17d640 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef60058770 con 0x55ef6004c6c0 2024-09-10T05:36:31.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.015+0000 7f20ab97e640 1 -- 172.21.15.62:0/1992077859 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20a400a4d0 con 0x55ef6004c6c0 2024-09-10T05:36:31.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.015+0000 7f20ab97e640 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef60058770 con 0x7f209c04c070 2024-09-10T05:36:31.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.015+0000 7f20ab97e640 1 -- 172.21.15.62:0/1992077859 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20a400a4d0 con 0x7f209c04c070 2024-09-10T05:36:31.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.015+0000 7f20ab97e640 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef60058770 con 0x55ef6004c6c0 2024-09-10T05:36:31.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.015+0000 7f20ab97e640 1 -- 172.21.15.62:0/1992077859 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20a400a4d0 con 0x55ef6004c6c0 2024-09-10T05:36:31.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.015+0000 7f20ab97e640 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef60058770 con 0x7f209c04c070 2024-09-10T05:36:31.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.015+0000 7f20ab97e640 1 -- 172.21.15.62:0/1992077859 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f20a400a4d0 con 0x7f209c04c070 2024-09-10T05:36:31.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.015+0000 7f20ab97e640 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef60058770 con 0x55ef60050b00 2024-09-10T05:36:31.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.015+0000 7f20ab17d640 1 -- 172.21.15.62:0/1992077859 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f209c008030 con 0x55ef60050b00 2024-09-10T05:36:31.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.015+0000 7f20ab17d640 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef60058770 con 0x55ef60054320 2024-09-10T05:36:31.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.019+0000 7f20a3fff640 1 -- 172.21.15.62:0/1992077859 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20940b2040 con 0x55ef60054320 2024-09-10T05:36:31.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.019+0000 7f20a3fff640 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef60058770 con 0x55ef6004c6c0 2024-09-10T05:36:31.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.019+0000 7f20ab97e640 1 -- 172.21.15.62:0/1992077859 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20a400a4d0 con 0x55ef6004c6c0 2024-09-10T05:36:31.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.019+0000 7f20ab97e640 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef60058770 con 0x55ef60050b00 2024-09-10T05:36:31.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.019+0000 7f20ab17d640 1 -- 172.21.15.62:0/1992077859 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f209c008030 con 0x55ef60050b00 2024-09-10T05:36:31.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.019+0000 7f20ab17d640 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef60058770 con 0x55ef60054320 2024-09-10T05:36:31.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.019+0000 7f20a3fff640 1 -- 172.21.15.62:0/1992077859 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 30 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f20940b2040 con 0x55ef60054320 2024-09-10T05:36:31.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.019+0000 7f20a3fff640 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef60058770 con 0x55ef6004c6c0 2024-09-10T05:36:31.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.019+0000 7f20ab97e640 1 -- 172.21.15.62:0/1992077859 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20a400a4d0 con 0x55ef6004c6c0 2024-09-10T05:36:31.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.019+0000 7f20ab97e640 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef60058770 con 0x55ef6004c6c0 2024-09-10T05:36:31.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.019+0000 7f20ab97e640 1 -- 172.21.15.62:0/1992077859 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f20a400a4d0 con 0x55ef6004c6c0 2024-09-10T05:36:31.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.019+0000 7f20ab97e640 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef60058770 con 0x55ef6004c6c0 2024-09-10T05:36:31.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.019+0000 7f20ab97e640 1 -- 172.21.15.62:0/1992077859 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20a400a4d0 con 0x55ef6004c6c0 2024-09-10T05:36:31.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.019+0000 7f20ab97e640 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef60058770 con 0x55ef60054320 2024-09-10T05:36:31.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.019+0000 7f20a3fff640 1 -- 172.21.15.62:0/1992077859 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20940b2040 con 0x55ef60054320 2024-09-10T05:36:31.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.019+0000 7f20a3fff640 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef60058770 con 0x7f209c04c070 2024-09-10T05:36:31.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.019+0000 7f20ab97e640 1 -- 172.21.15.62:0/1992077859 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20a400a4d0 con 0x7f209c04c070 2024-09-10T05:36:31.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.019+0000 7f20ab97e640 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef60058770 con 0x55ef6004c6c0 2024-09-10T05:36:31.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.019+0000 7f20ab97e640 1 -- 172.21.15.62:0/1992077859 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20a400a4d0 con 0x55ef6004c6c0 2024-09-10T05:36:31.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.019+0000 7f20ab97e640 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef60058770 con 0x7f209c04c070 2024-09-10T05:36:31.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.019+0000 7f20ab97e640 1 -- 172.21.15.62:0/1992077859 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20a400a4d0 con 0x7f209c04c070 2024-09-10T05:36:31.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.019+0000 7f20ab97e640 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef60058770 con 0x55ef60054320 2024-09-10T05:36:31.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.019+0000 7f20a3fff640 1 -- 172.21.15.62:0/1992077859 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20940b2040 con 0x55ef60054320 2024-09-10T05:36:31.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.019+0000 7f20a3fff640 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef60058770 con 0x7f209c04c070 2024-09-10T05:36:31.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.023+0000 7f20ab97e640 1 -- 172.21.15.62:0/1992077859 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20a400a4d0 con 0x7f209c04c070 2024-09-10T05:36:31.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.023+0000 7f20ab97e640 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef60058770 con 0x55ef60050b00 2024-09-10T05:36:31.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.023+0000 7f20ab17d640 1 -- 172.21.15.62:0/1992077859 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f209c008030 con 0x55ef60050b00 2024-09-10T05:36:31.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.023+0000 7f20ab17d640 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef60058770 con 0x55ef60050b00 2024-09-10T05:36:31.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.023+0000 7f20ab17d640 1 -- 172.21.15.62:0/1992077859 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f209c008030 con 0x55ef60050b00 2024-09-10T05:36:31.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.023+0000 7f20ab17d640 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef60058770 con 0x55ef60054320 2024-09-10T05:36:31.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.023+0000 7f20a3fff640 1 -- 172.21.15.62:0/1992077859 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20940b2040 con 0x55ef60054320 2024-09-10T05:36:31.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.023+0000 7f20a3fff640 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef60058770 con 0x55ef60050b00 2024-09-10T05:36:31.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.023+0000 7f20ab17d640 1 -- 172.21.15.62:0/1992077859 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f209c008030 con 0x55ef60050b00 2024-09-10T05:36:31.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.023+0000 7f20ab17d640 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef60058770 con 0x55ef60050b00 2024-09-10T05:36:31.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.023+0000 7f20ab17d640 1 -- 172.21.15.62:0/1992077859 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f209c008030 con 0x55ef60050b00 2024-09-10T05:36:31.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.023+0000 7f20ad6779c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:31.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.023+0000 7f20ad6779c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:31.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.023+0000 7f20ad6779c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:31.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.023+0000 7f20ad6779c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:31.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.023+0000 7f20ad6779c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:31.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.023+0000 7f20ad6779c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:31.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.023+0000 7f20ad6779c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.023+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ef60057860 con 0x55ef6004c6c0 2024-09-10T05:36:31.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.023+0000 7f20ab97e640 1 -- 172.21.15.62:0/1992077859 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20a400a4d0 con 0x55ef6004c6c0 2024-09-10T05:36:31.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.023+0000 7f20ad6779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:31.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.023+0000 7f20ad6779c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.023+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ef600574a0 con 0x55ef60050b00 2024-09-10T05:36:31.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.027+0000 7f20ab17d640 1 -- 172.21.15.62:0/1992077859 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f209c008030 con 0x55ef60050b00 2024-09-10T05:36:31.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.027+0000 7f20ad6779c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:31.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.027+0000 7f20ad6779c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.027+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ef60058200 con 0x55ef60054320 2024-09-10T05:36:31.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.027+0000 7f20a3fff640 1 -- 172.21.15.62:0/1992077859 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f20940b2040 con 0x55ef60054320 2024-09-10T05:36:31.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.027+0000 7f20ad6779c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:31.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.027+0000 7f20ad6779c0 20 zone default found 2024-09-10T05:36:31.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.027+0000 7f20ad6779c0 4 Realm: () 2024-09-10T05:36:31.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.027+0000 7f20ad6779c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:31.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.027+0000 7f20ad6779c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:31.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.027+0000 7f20ad6779c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:31.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.027+0000 7f20ad6779c0 20 zonegroup default 2024-09-10T05:36:31.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.027+0000 7f20ad6779c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.027+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ef60059050 con 0x7f209c04c070 2024-09-10T05:36:31.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.027+0000 7f20ab97e640 1 -- 172.21.15.62:0/1992077859 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f20a400a4d0 con 0x7f209c04c070 2024-09-10T05:36:31.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.027+0000 7f20ad6779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:31.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.027+0000 7f20ad6779c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.027+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ef6005b290 con 0x55ef60054320 2024-09-10T05:36:31.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.027+0000 7f20a3fff640 1 -- 172.21.15.62:0/1992077859 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f20940b2040 con 0x55ef60054320 2024-09-10T05:36:31.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.027+0000 7f20ad6779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:31.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.027+0000 7f20ad6779c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.027+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ef6005b630 con 0x55ef60054320 2024-09-10T05:36:31.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.027+0000 7f20a3fff640 1 -- 172.21.15.62:0/1992077859 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f20940b2040 con 0x55ef60054320 2024-09-10T05:36:31.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.027+0000 7f20ad6779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:31.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.027+0000 7f20ad6779c0 20 started sync module instance, tier type = 2024-09-10T05:36:31.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.027+0000 7f20ad6779c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:31.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.027+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef6005a6d0 con 0x55ef60050b00 2024-09-10T05:36:31.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.031+0000 7f20ab17d640 1 -- 172.21.15.62:0/1992077859 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f209c008030 con 0x55ef60050b00 2024-09-10T05:36:31.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.031+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94486596528880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef6005a6d0 con 0x55ef60050b00 2024-09-10T05:36:31.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.031+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef6005bed0 con 0x55ef6004c6c0 2024-09-10T05:36:31.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.031+0000 7f20ab97e640 1 -- 172.21.15.62:0/1992077859 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20a400a4d0 con 0x55ef6004c6c0 2024-09-10T05:36:31.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.031+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94486596532768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef6005c720 con 0x55ef6004c6c0 2024-09-10T05:36:31.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.031+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef6005cf70 con 0x55ef60050b00 2024-09-10T05:36:31.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.031+0000 7f20ab17d640 1 -- 172.21.15.62:0/1992077859 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94486596528880] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f209c008030 con 0x55ef60050b00 2024-09-10T05:36:31.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.031+0000 7f20ab97e640 1 -- 172.21.15.62:0/1992077859 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94486596532768] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20a400a4d0 con 0x55ef6004c6c0 2024-09-10T05:36:31.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.031+0000 7f20ab17d640 1 -- 172.21.15.62:0/1992077859 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f209c008030 con 0x55ef60050b00 2024-09-10T05:36:31.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.031+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94486596534896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef6005cb40 con 0x55ef60050b00 2024-09-10T05:36:31.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.035+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef6005d390 con 0x7f209c04c070 2024-09-10T05:36:31.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.035+0000 7f20ab97e640 1 -- 172.21.15.62:0/1992077859 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20a400a4d0 con 0x7f209c04c070 2024-09-10T05:36:31.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.035+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94486596537424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef6005d6a0 con 0x7f209c04c070 2024-09-10T05:36:31.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.035+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef6005e1a0 con 0x55ef60050b00 2024-09-10T05:36:31.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.035+0000 7f20ab17d640 1 -- 172.21.15.62:0/1992077859 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94486596534896] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f209c008030 con 0x55ef60050b00 2024-09-10T05:36:31.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.035+0000 7f20ab97e640 1 -- 172.21.15.62:0/1992077859 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94486596537424] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20a400a4d0 con 0x7f209c04c070 2024-09-10T05:36:31.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.035+0000 7f20ab17d640 1 -- 172.21.15.62:0/1992077859 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f209c008030 con 0x55ef60050b00 2024-09-10T05:36:31.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.035+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94486596541584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef6005e160 con 0x55ef60050b00 2024-09-10T05:36:31.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.035+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef6005ea70 con 0x55ef60054320 2024-09-10T05:36:31.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.039+0000 7f20a3fff640 1 -- 172.21.15.62:0/1992077859 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20940b2040 con 0x55ef60054320 2024-09-10T05:36:31.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.039+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94486596543936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef6005e160 con 0x55ef60054320 2024-09-10T05:36:31.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.039+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef6005f4b0 con 0x55ef60054320 2024-09-10T05:36:31.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.039+0000 7f20ab17d640 1 -- 172.21.15.62:0/1992077859 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94486596541584] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f209c008030 con 0x55ef60050b00 2024-09-10T05:36:31.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.039+0000 7f20a3fff640 1 -- 172.21.15.62:0/1992077859 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94486596543936] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20940b2040 con 0x55ef60054320 2024-09-10T05:36:31.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.039+0000 7f20a3fff640 1 -- 172.21.15.62:0/1992077859 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20940b2040 con 0x55ef60054320 2024-09-10T05:36:31.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.039+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94486596544992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef6005f000 con 0x55ef60054320 2024-09-10T05:36:31.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.039+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef6005fd50 con 0x7f209c04c070 2024-09-10T05:36:31.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.039+0000 7f20a3fff640 1 -- 172.21.15.62:0/1992077859 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94486596544992] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20940b2040 con 0x55ef60054320 2024-09-10T05:36:31.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.039+0000 7f20ab97e640 1 -- 172.21.15.62:0/1992077859 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20a400a4d0 con 0x7f209c04c070 2024-09-10T05:36:31.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.039+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94486596535952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef6005f000 con 0x7f209c04c070 2024-09-10T05:36:31.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.039+0000 7f20ad6779c0 20 add_watcher() i=0 2024-09-10T05:36:31.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.039+0000 7f20ad6779c0 20 add_watcher() i=1 2024-09-10T05:36:31.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.039+0000 7f20ad6779c0 20 add_watcher() i=2 2024-09-10T05:36:31.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.039+0000 7f20ad6779c0 20 add_watcher() i=3 2024-09-10T05:36:31.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.039+0000 7f20ad6779c0 20 add_watcher() i=4 2024-09-10T05:36:31.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.039+0000 7f20ad6779c0 20 add_watcher() i=5 2024-09-10T05:36:31.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.039+0000 7f20ad6779c0 20 add_watcher() i=6 2024-09-10T05:36:31.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.043+0000 7f20ab97e640 1 -- 172.21.15.62:0/1992077859 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94486596535952] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20a400a4d0 con 0x7f209c04c070 2024-09-10T05:36:31.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.043+0000 7f20ad6779c0 20 add_watcher() i=7 2024-09-10T05:36:31.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.043+0000 7f20ad6779c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:31.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.043+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ef60062de0 con 0x55ef6004c6c0 2024-09-10T05:36:31.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.043+0000 7f20ab97e640 1 -- 172.21.15.62:0/1992077859 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f20a400a4d0 con 0x55ef6004c6c0 2024-09-10T05:36:31.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.043+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94486596548768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef60060370 con 0x55ef6004c6c0 2024-09-10T05:36:31.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.043+0000 7f20ab97e640 1 -- 172.21.15.62:0/1992077859 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94486596548768] v30'58 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f20a400a4d0 con 0x55ef6004c6c0 2024-09-10T05:36:31.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.043+0000 7f1f61fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:31.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.043+0000 7f20ad6779c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:31.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.043+0000 7f20ad6779c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:31.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.043+0000 7f20ad6779c0 5 note: GC not initialized 2024-09-10T05:36:31.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.043+0000 7f1f60fe1640 20 reqs_thread_entry: start 2024-09-10T05:36:31.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.043+0000 7f20ad6779c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:31.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.047+0000 7f20ad6779c0 20 Filter name: none 2024-09-10T05:36:31.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.047+0000 7f1eda7fc640 20 reqs_thread_entry: start 2024-09-10T05:36:31.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.047+0000 7f20ad6779c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-10T05:36:31.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.047+0000 7f20ad6779c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.047+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ef60086080 con 0x7f209c04c070 2024-09-10T05:36:31.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.047+0000 7f20ab97e640 1 -- 172.21.15.62:0/1992077859 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f20a400a4d0 con 0x7f209c04c070 2024-09-10T05:36:31.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.047+0000 7f20ad6779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:31.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.047+0000 7f20ad6779c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-10T05:36:31.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.047+0000 7f20ad6779c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T05:36:31.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.047+0000 7f20ad6779c0 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-10T05:36:31.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.047+0000 7f20ad6779c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.047+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ef60084720 con 0x55ef6004c6c0 2024-09-10T05:36:31.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.047+0000 7f20ab97e640 1 -- 172.21.15.62:0/1992077859 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(63 foo@foo.com [stat out=16b,read 0~7 out=7b] v0'0 uv1 ondisk = 0) ==== 197+0+23 (crc 0 0 0) 0x7f20a400a4d0 con 0x55ef6004c6c0 2024-09-10T05:36:31.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.047+0000 7f20ad6779c0 20 rados_obj.operate() r=0 bl.length=7 2024-09-10T05:36:31.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.047+0000 7f20ad6779c0 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x5 2024-09-10T05:36:31.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.047+0000 7f20ad6779c0 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-10T05:36:31.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.047+0000 7f20ad6779c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T05:36:31.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.047+0000 7f20ad6779c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.047+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ef60084b10 con 0x55ef6004c6c0 2024-09-10T05:36:31.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.047+0000 7f20ab97e640 1 -- 172.21.15.62:0/1992077859 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(64 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f20a400a4d0 con 0x55ef6004c6c0 2024-09-10T05:36:31.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.047+0000 7f20ad6779c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:36:31.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.047+0000 7f20ad6779c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T05:36:31.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.047+0000 7f20ad6779c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:36:31.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.047+0000 7f20ad6779c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:36:31.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.047+0000 7f20ad6779c0 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2024-09-10T05:36:31.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.047+0000 7f20ad6779c0 20 get_user_info_from_index found 0 xattrs 2024-09-10T05:36:31.053 INFO:teuthology.orchestra.run.smithi062.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2024-09-10T05:36:31.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.047+0000 7f1f61fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:31.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.047+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94486596548768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef60046ce0 con 0x55ef6004c6c0 2024-09-10T05:36:31.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.051+0000 7f20ab97e640 1 -- 172.21.15.62:0/1992077859 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94486596548768] v30'59 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f20a400a4d0 con 0x55ef6004c6c0 2024-09-10T05:36:31.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.051+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94486596528880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef6005f8a0 con 0x55ef60050b00 2024-09-10T05:36:31.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.051+0000 7f20ab17d640 1 -- 172.21.15.62:0/1992077859 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94486596528880] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f209c008030 con 0x55ef60050b00 2024-09-10T05:36:31.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.051+0000 7f20ad6779c0 20 remove_watcher() i=0 2024-09-10T05:36:31.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.051+0000 7f20ad6779c0 2 removed watcher, disabling cache 2024-09-10T05:36:31.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.051+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94486596532768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef6005f8a0 con 0x55ef6004c6c0 2024-09-10T05:36:31.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.051+0000 7f20ab97e640 1 -- 172.21.15.62:0/1992077859 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94486596532768] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20a400a4d0 con 0x55ef6004c6c0 2024-09-10T05:36:31.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.051+0000 7f20ad6779c0 20 remove_watcher() i=1 2024-09-10T05:36:31.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.051+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94486596534896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef6005f8a0 con 0x55ef60050b00 2024-09-10T05:36:31.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.055+0000 7f20ab17d640 1 -- 172.21.15.62:0/1992077859 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94486596534896] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f209c008030 con 0x55ef60050b00 2024-09-10T05:36:31.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.055+0000 7f20ad6779c0 20 remove_watcher() i=2 2024-09-10T05:36:31.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.055+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94486596537424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef6005c270 con 0x7f209c04c070 2024-09-10T05:36:31.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.055+0000 7f20ab97e640 1 -- 172.21.15.62:0/1992077859 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94486596537424] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20a400a4d0 con 0x7f209c04c070 2024-09-10T05:36:31.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.055+0000 7f20ad6779c0 20 remove_watcher() i=3 2024-09-10T05:36:31.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.055+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94486596541584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef6005f8a0 con 0x55ef60050b00 2024-09-10T05:36:31.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.059+0000 7f20ab17d640 1 -- 172.21.15.62:0/1992077859 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94486596541584] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f209c008030 con 0x55ef60050b00 2024-09-10T05:36:31.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.059+0000 7f20ad6779c0 20 remove_watcher() i=4 2024-09-10T05:36:31.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.059+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94486596543936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef6005cc50 con 0x55ef60054320 2024-09-10T05:36:31.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.059+0000 7f20a3fff640 1 -- 172.21.15.62:0/1992077859 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94486596543936] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20940b2040 con 0x55ef60054320 2024-09-10T05:36:31.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.059+0000 7f20ad6779c0 20 remove_watcher() i=5 2024-09-10T05:36:31.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.059+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94486596544992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef6005c270 con 0x55ef60054320 2024-09-10T05:36:31.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.063+0000 7f20a3fff640 1 -- 172.21.15.62:0/1992077859 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94486596544992] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20940b2040 con 0x55ef60054320 2024-09-10T05:36:31.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.063+0000 7f20ad6779c0 20 remove_watcher() i=6 2024-09-10T05:36:31.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.063+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94486596535952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef6005cc50 con 0x7f209c04c070 2024-09-10T05:36:31.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.063+0000 7f20ab97e640 1 -- 172.21.15.62:0/1992077859 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94486596535952] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20a400a4d0 con 0x7f209c04c070 2024-09-10T05:36:31.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.063+0000 7f20ad6779c0 20 remove_watcher() i=7 2024-09-10T05:36:31.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.063+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55ef60050b00 msgr2=0x55ef60052ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.063+0000 7f20ad6779c0 1 --2- 172.21.15.62:0/1992077859 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55ef60050b00 0x55ef60052ef0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.063+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55ef6004c6c0 msgr2=0x55ef6004eb10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.063+0000 7f20ad6779c0 1 --2- 172.21.15.62:0/1992077859 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55ef6004c6c0 0x55ef6004eb10 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.063+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f209c04c070 msgr2=0x7f209c021810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.063+0000 7f20ad6779c0 1 --2- 172.21.15.62:0/1992077859 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f209c04c070 0x7f209c021810 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.063+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55ef60054320 msgr2=0x55ef60056710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.063+0000 7f20ad6779c0 1 --2- 172.21.15.62:0/1992077859 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55ef60054320 0x55ef60056710 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.063+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1f74039a70 msgr2=0x7f1f7403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.063+0000 7f20ad6779c0 1 --2- 172.21.15.62:0/1992077859 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1f74039a70 0x7f1f7403bf30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2094000c10 tx=0x7f20940a7000 comp rx=0 tx=0).stop 2024-09-10T05:36:31.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.063+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ef6003b460 msgr2=0x55ef60041710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.063+0000 7f20ab97e640 1 -- 172.21.15.62:0/1992077859 reap_dead start 2024-09-10T05:36:31.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.063+0000 7f20ad6779c0 1 --2- 172.21.15.62:0/1992077859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ef6003b460 0x55ef60041710 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f209c04db10 tx=0x7f209c043f70 comp rx=0 tx=0).stop 2024-09-10T05:36:31.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.063+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 shutdown_connections 2024-09-10T05:36:31.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.063+0000 7f20ad6779c0 1 --2- 172.21.15.62:0/1992077859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ef6003b460 0x55ef60041710 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.063+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 >> 172.21.15.62:0/1992077859 conn(0x55ef60036880 msgr2=0x55ef60034a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:31.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.063+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 shutdown_connections 2024-09-10T05:36:31.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.063+0000 7f20ad6779c0 1 -- 172.21.15.62:0/1992077859 wait complete. 2024-09-10T05:36:31.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.063+0000 7f20ad6779c0 1 -- 172.21.15.62:0/2019812595 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1f84039a70 msgr2=0x7f1f8403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.063+0000 7f20ad6779c0 1 --2- 172.21.15.62:0/2019812595 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1f84039a70 0x7f1f8403bf30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f20940ad040 tx=0x7f2094005a10 comp rx=0 tx=0).stop 2024-09-10T05:36:31.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.063+0000 7f20ad6779c0 1 -- 172.21.15.62:0/2019812595 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ef6002dee0 msgr2=0x55ef6002e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.063+0000 7f20ad6779c0 1 --2- 172.21.15.62:0/2019812595 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ef6002dee0 0x55ef6002e300 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f209c04ecc0 tx=0x7f209c01adf0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.063+0000 7f20ad6779c0 1 -- 172.21.15.62:0/2019812595 shutdown_connections 2024-09-10T05:36:31.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.063+0000 7f20ad6779c0 1 --2- 172.21.15.62:0/2019812595 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1f84039a70 0x7f1f8403bf30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.063+0000 7f20ad6779c0 1 --2- 172.21.15.62:0/2019812595 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ef6002dee0 0x55ef6002e300 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.063+0000 7f20ad6779c0 1 -- 172.21.15.62:0/2019812595 >> 172.21.15.62:0/2019812595 conn(0x55ef60023890 msgr2=0x55ef60023c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:31.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.063+0000 7f20ad6779c0 1 -- 172.21.15.62:0/2019812595 shutdown_connections 2024-09-10T05:36:31.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.063+0000 7f20ad6779c0 1 -- 172.21.15.62:0/2019812595 wait complete. 2024-09-10T05:36:31.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.063+0000 7f20ad6779c0 1 -- 172.21.15.62:0/3950817679 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55ef600186d0 msgr2=0x55ef6001aac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.063+0000 7f20ad6779c0 1 --2- 172.21.15.62:0/3950817679 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55ef600186d0 0x55ef6001aac0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.063+0000 7f20ad6779c0 1 -- 172.21.15.62:0/3950817679 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55ef5fe91730 msgr2=0x55ef60017430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.063+0000 7f20ad6779c0 1 --2- 172.21.15.62:0/3950817679 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55ef5fe91730 0x55ef60017430 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.063+0000 7f20ad6779c0 1 -- 172.21.15.62:0/3950817679 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55ef6001ce70 msgr2=0x55ef6001f260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.063+0000 7f20ad6779c0 1 --2- 172.21.15.62:0/3950817679 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55ef6001ce70 0x55ef6001f260 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.063+0000 7f20ad6779c0 1 -- 172.21.15.62:0/3950817679 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1f90039ac0 msgr2=0x7f1f9003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.063+0000 7f20ad6779c0 1 --2- 172.21.15.62:0/3950817679 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1f90039ac0 0x7f1f9003bf80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f20940ac000 tx=0x7f20940a5000 comp rx=0 tx=0).stop 2024-09-10T05:36:31.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.063+0000 7f20ad6779c0 1 -- 172.21.15.62:0/3950817679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ef5fe91200 msgr2=0x55ef600102c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.063+0000 7f20ad6779c0 1 --2- 172.21.15.62:0/3950817679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ef5fe91200 0x55ef600102c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x55ef60009ba0 tx=0x7f209c000ee0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.063+0000 7f20ab97e640 1 -- 172.21.15.62:0/3950817679 reap_dead start 2024-09-10T05:36:31.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.063+0000 7f20ad6779c0 1 -- 172.21.15.62:0/3950817679 shutdown_connections 2024-09-10T05:36:31.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.063+0000 7f20ad6779c0 1 -- 172.21.15.62:0/3950817679 >> 172.21.15.62:0/3950817679 conn(0x55ef5ff16a20 msgr2=0x55ef600032e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:31.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.063+0000 7f20ad6779c0 1 -- 172.21.15.62:0/3950817679 shutdown_connections 2024-09-10T05:36:31.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.063+0000 7f20ad6779c0 1 -- 172.21.15.62:0/3950817679 wait complete. 2024-09-10T05:36:31.078 DEBUG:teuthology.orchestra.run:got remote process result: 240 2024-09-10T05:36:31.078 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-10T05:36:31.079 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-10T05:36:31.079 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-10T05:36:31.157 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:31.157 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:31.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.155+0000 7f1cca11d9c0 1 Processor -- start 2024-09-10T05:36:31.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.155+0000 7f1cca11d9c0 1 -- start start 2024-09-10T05:36:31.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.155+0000 7f1cca11d9c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5567ddf34200 0x5567ddfc5030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.155+0000 7f1cca11d9c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5567dde749c0 con 0x5567ddf345e0 2024-09-10T05:36:31.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.155+0000 7f1cca11d9c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x5567ddec46d0 con 0x5567ddf34200 2024-09-10T05:36:31.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.155+0000 7f1cc7c23640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5567ddf34200 0x5567ddfc5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.155+0000 7f1cc7c23640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5567ddf34200 0x5567ddfc5030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51304/0 (socket says 172.21.15.62:51304) 2024-09-10T05:36:31.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.155+0000 7f1cc7422640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x5567ddf345e0 0x5567ddfc7580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:38474/0 (socket says 172.21.15.62:38474) 2024-09-10T05:36:31.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.155+0000 7f1cc7c23640 1 -- 172.21.15.62:0/3867628917 learned_addr learned my addr 172.21.15.62:0/3867628917 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:31.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.155+0000 7f1cc7c23640 1 -- 172.21.15.62:0/3867628917 >> v1:172.21.15.2:6789/0 conn(0x5567ddf345e0 legacy=0x5567ddfc7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.155+0000 7f1cc7c23640 1 -- 172.21.15.62:0/3867628917 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567dde68ca0 con 0x5567ddf34200 2024-09-10T05:36:31.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.159+0000 7f1cc7c23640 1 --2- 172.21.15.62:0/3867628917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567ddf34200 0x5567ddfc5030 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1cb800a5c0 tx=0x7f1cb801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=832fa8bd4f21cfbd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.159+0000 7f1cc6c21640 1 -- 172.21.15.62:0/3867628917 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cb80a6070 con 0x5567ddf34200 2024-09-10T05:36:31.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.159+0000 7f1cc6c21640 1 -- 172.21.15.62:0/3867628917 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cb80af070 con 0x5567ddf34200 2024-09-10T05:36:31.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.159+0000 7f1cc6c21640 1 -- 172.21.15.62:0/3867628917 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cb80aa5c0 con 0x5567ddf34200 2024-09-10T05:36:31.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.159+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/3867628917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567ddf34200 msgr2=0x5567ddfc5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.159+0000 7f1cca11d9c0 1 --2- 172.21.15.62:0/3867628917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567ddf34200 0x5567ddfc5030 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1cb800a5c0 tx=0x7f1cb801b340 comp rx=0 tx=0).stop 2024-09-10T05:36:31.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.159+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/3867628917 shutdown_connections 2024-09-10T05:36:31.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.159+0000 7f1cca11d9c0 1 --2- 172.21.15.62:0/3867628917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567ddf34200 0x5567ddfc5030 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.159+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/3867628917 >> 172.21.15.62:0/3867628917 conn(0x5567ddfba920 msgr2=0x5567ddfbcd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:31.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.159+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/3867628917 shutdown_connections 2024-09-10T05:36:31.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.159+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/3867628917 wait complete. 2024-09-10T05:36:31.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.175+0000 7f1cca11d9c0 1 Processor -- start 2024-09-10T05:36:31.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.175+0000 7f1cca11d9c0 1 -- start start 2024-09-10T05:36:31.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.175+0000 7f1cca11d9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567ddf34200 0x5567de0ad8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.175+0000 7f1cca11d9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5567ddec8680 con 0x5567ddf34200 2024-09-10T05:36:31.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.175+0000 7f1cc7c23640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567ddf34200 0x5567de0ad8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.175+0000 7f1cc7c23640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567ddf34200 0x5567de0ad8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51310/0 (socket says 172.21.15.62:51310) 2024-09-10T05:36:31.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.175+0000 7f1cc7c23640 1 -- 172.21.15.62:0/3637400196 learned_addr learned my addr 172.21.15.62:0/3637400196 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:31.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.175+0000 7f1cc7c23640 1 -- 172.21.15.62:0/3637400196 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567dde43da0 con 0x5567ddf34200 2024-09-10T05:36:31.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.175+0000 7f1cc7c23640 1 --2- 172.21.15.62:0/3637400196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567ddf34200 0x5567de0ad8d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1cb80ac040 tx=0x7f1cb8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5692c42e20d19ec server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.175+0000 7f1bb5e0b640 1 -- 172.21.15.62:0/3637400196 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cb80aa970 con 0x5567ddf34200 2024-09-10T05:36:31.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.175+0000 7f1bb5e0b640 1 -- 172.21.15.62:0/3637400196 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cb80aab10 con 0x5567ddf34200 2024-09-10T05:36:31.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.175+0000 7f1bb5e0b640 1 -- 172.21.15.62:0/3637400196 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cb80aae30 con 0x5567ddf34200 2024-09-10T05:36:31.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.179+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/3637400196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567ddf34200 msgr2=0x5567de0ad8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.179+0000 7f1cca11d9c0 1 --2- 172.21.15.62:0/3637400196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567ddf34200 0x5567de0ad8d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1cb80ac040 tx=0x7f1cb8003030 comp rx=0 tx=0).stop 2024-09-10T05:36:31.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.179+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/3637400196 shutdown_connections 2024-09-10T05:36:31.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.179+0000 7f1cca11d9c0 1 --2- 172.21.15.62:0/3637400196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567ddf34200 0x5567de0ad8d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.179+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/3637400196 >> 172.21.15.62:0/3637400196 conn(0x5567ddfba920 msgr2=0x5567de0a9510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:31.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.179+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/3637400196 shutdown_connections 2024-09-10T05:36:31.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.179+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/3637400196 wait complete. 2024-09-10T05:36:31.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.179+0000 7f1cca11d9c0 1 Processor -- start 2024-09-10T05:36:31.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.179+0000 7f1cca11d9c0 1 -- start start 2024-09-10T05:36:31.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.179+0000 7f1cca11d9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567ddf34200 0x5567de0b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.179+0000 7f1cca11d9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5567dde6aa50 con 0x5567ddf34200 2024-09-10T05:36:31.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.179+0000 7f1cc7c23640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567ddf34200 0x5567de0b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.179+0000 7f1cc7c23640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567ddf34200 0x5567de0b4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51316/0 (socket says 172.21.15.62:51316) 2024-09-10T05:36:31.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.179+0000 7f1cc7c23640 1 -- 172.21.15.62:0/3552655022 learned_addr learned my addr 172.21.15.62:0/3552655022 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:31.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.179+0000 7f1cc7c23640 1 -- 172.21.15.62:0/3552655022 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567de0b5390 con 0x5567ddf34200 2024-09-10T05:36:31.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.179+0000 7f1cc7c23640 1 --2- 172.21.15.62:0/3552655022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567ddf34200 0x5567de0b4e30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1cb801b170 tx=0x7f1cb80180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.179+0000 7f1baffff640 1 -- 172.21.15.62:0/3552655022 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cb80c6690 con 0x5567ddf34200 2024-09-10T05:36:31.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.179+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/3552655022 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5567de0b5620 con 0x5567ddf34200 2024-09-10T05:36:31.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.179+0000 7f1baffff640 1 -- 172.21.15.62:0/3552655022 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cb80cc070 con 0x5567ddf34200 2024-09-10T05:36:31.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.179+0000 7f1baffff640 1 -- 172.21.15.62:0/3552655022 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cb80c69a0 con 0x5567ddf34200 2024-09-10T05:36:31.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.179+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/3552655022 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567de0b5fd0 con 0x5567ddf34200 2024-09-10T05:36:31.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.183+0000 7f1baffff640 1 -- 172.21.15.62:0/3552655022 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1cb80c6c10 con 0x5567ddf34200 2024-09-10T05:36:31.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.183+0000 7f1baffff640 1 --2- 172.21.15.62:0/3552655022 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1bb0039a70 0x7f1bb003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.183+0000 7f1baffff640 1 -- 172.21.15.62:0/3552655022 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f1cb80ebb30 con 0x5567ddf34200 2024-09-10T05:36:31.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.183+0000 7f1cc7422640 1 --2- 172.21.15.62:0/3552655022 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1bb0039a70 0x7f1bb003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.183+0000 7f1cca11d9c0 1 --2- 172.21.15.62:0/3552655022 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5567ddf345e0 0x5567de0bbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.183+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/3552655022 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5567de0bc4e0 con 0x5567ddf345e0 2024-09-10T05:36:31.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.183+0000 7f1cc8424640 1 --2- 172.21.15.62:0/3552655022 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5567ddf345e0 0x5567de0bbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.183+0000 7f1cc7422640 1 --2- 172.21.15.62:0/3552655022 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1bb0039a70 0x7f1bb003bf30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1cb0001e40 tx=0x7f1cb00013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.183+0000 7f1cc8424640 1 --2- 172.21.15.62:0/3552655022 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5567ddf345e0 0x5567de0bbfa0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.183+0000 7f1cc8424640 1 -- 172.21.15.62:0/3552655022 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1cc000a4d0 con 0x5567ddf345e0 2024-09-10T05:36:31.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.183+0000 7f1cca11d9c0 1 --2- 172.21.15.62:0/3552655022 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5567de0bd000 0x5567de0bf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.183+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/3552655022 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5567de0bfc30 con 0x5567de0bd000 2024-09-10T05:36:31.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.183+0000 7f1cc7c23640 1 --2- 172.21.15.62:0/3552655022 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5567de0bd000 0x5567de0bf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.183+0000 7f1cc7c23640 1 --2- 172.21.15.62:0/3552655022 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5567de0bd000 0x5567de0bf4c0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.183+0000 7f1cc7c23640 1 -- 172.21.15.62:0/3552655022 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1cb80bd3f0 con 0x5567de0bd000 2024-09-10T05:36:31.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.183+0000 7f1cca11d9c0 1 --2- 172.21.15.62:0/3552655022 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5567de0c19f0 0x5567de0c3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.183+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/3552655022 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5567de0c44b0 con 0x5567de0c19f0 2024-09-10T05:36:31.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.183+0000 7f1cc7422640 1 --2- 172.21.15.62:0/3552655022 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5567de0c19f0 0x5567de0c3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.187+0000 7f1cc7422640 1 --2- 172.21.15.62:0/3552655022 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5567de0c19f0 0x5567de0c3de0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.187+0000 7f1cc7422640 1 -- 172.21.15.62:0/3552655022 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1cb000bd60 con 0x5567de0c19f0 2024-09-10T05:36:31.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.187+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/3552655022 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5567de0c0890 con 0x5567de0bd000 2024-09-10T05:36:31.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.187+0000 7f1cc7c23640 1 -- 172.21.15.62:0/3552655022 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1cb80bd3f0 con 0x5567de0bd000 2024-09-10T05:36:31.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.187+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/3552655022 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5567de0c0cf0 con 0x5567de0c19f0 2024-09-10T05:36:31.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.187+0000 7f1cc7422640 1 -- 172.21.15.62:0/3552655022 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1cb000bd60 con 0x5567de0c19f0 2024-09-10T05:36:31.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.187+0000 7f1cca11d9c0 1 Processor -- start 2024-09-10T05:36:31.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.187+0000 7f1cca11d9c0 1 -- start start 2024-09-10T05:36:31.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.187+0000 7f1cca11d9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567de0d2b80 0x5567de0d2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.187+0000 7f1cca11d9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5567dded5450 con 0x5567de0d2b80 2024-09-10T05:36:31.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.187+0000 7f1cc7c23640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567de0d2b80 0x5567de0d2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.187+0000 7f1cc7c23640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567de0d2b80 0x5567de0d2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51328/0 (socket says 172.21.15.62:51328) 2024-09-10T05:36:31.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.187+0000 7f1cc7c23640 1 -- 172.21.15.62:0/335442140 learned_addr learned my addr 172.21.15.62:0/335442140 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:31.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.187+0000 7f1cc7c23640 1 -- 172.21.15.62:0/335442140 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567de0d35e0 con 0x5567de0d2b80 2024-09-10T05:36:31.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.187+0000 7f1cc7c23640 1 --2- 172.21.15.62:0/335442140 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567de0d2b80 0x5567de0d2fa0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1cb80ea100 tx=0x7f1cb80c7ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.187+0000 7f1bad7fa640 1 -- 172.21.15.62:0/335442140 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cb80b3cf0 con 0x5567de0d2b80 2024-09-10T05:36:31.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.187+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/335442140 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5567de0d3e40 con 0x5567de0d2b80 2024-09-10T05:36:31.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.187+0000 7f1bad7fa640 1 -- 172.21.15.62:0/335442140 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cb80ebe50 con 0x5567de0d2b80 2024-09-10T05:36:31.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.187+0000 7f1bad7fa640 1 -- 172.21.15.62:0/335442140 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cb80d0970 con 0x5567de0d2b80 2024-09-10T05:36:31.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.187+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/335442140 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567de0d43b0 con 0x5567de0d2b80 2024-09-10T05:36:31.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.191+0000 7f1bad7fa640 1 -- 172.21.15.62:0/335442140 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1cb80eb280 con 0x5567de0d2b80 2024-09-10T05:36:31.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.191+0000 7f1bad7fa640 1 --2- 172.21.15.62:0/335442140 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1ba0039ac0 0x7f1ba003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.191+0000 7f1bad7fa640 1 -- 172.21.15.62:0/335442140 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f1cb80f9850 con 0x5567de0d2b80 2024-09-10T05:36:31.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.191+0000 7f1cc7422640 1 --2- 172.21.15.62:0/335442140 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1ba0039ac0 0x7f1ba003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.191+0000 7f1cca11d9c0 1 Processor -- start 2024-09-10T05:36:31.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.191+0000 7f1cca11d9c0 1 -- start start 2024-09-10T05:36:31.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.191+0000 7f1cca11d9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567de0df310 0x5567de0df6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.191+0000 7f1cca11d9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5567de0ae060 con 0x5567de0df310 2024-09-10T05:36:31.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.191+0000 7f1cc7422640 1 --2- 172.21.15.62:0/335442140 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1ba0039ac0 0x7f1ba003bf80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x5567de0c0c30 tx=0x7f1cb000f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.191+0000 7f1cc7c23640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567de0df310 0x5567de0df6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.191+0000 7f1cc7c23640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567de0df310 0x5567de0df6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51342/0 (socket says 172.21.15.62:51342) 2024-09-10T05:36:31.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.191+0000 7f1cc7c23640 1 -- 172.21.15.62:0/3209338794 learned_addr learned my addr 172.21.15.62:0/3209338794 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:31.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.191+0000 7f1cc7c23640 1 -- 172.21.15.62:0/3209338794 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567de0dfce0 con 0x5567de0df310 2024-09-10T05:36:31.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.191+0000 7f1cc7c23640 1 --2- 172.21.15.62:0/3209338794 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567de0df310 0x5567de0df6f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1cb80dafd0 tx=0x7f1cb80f4c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f82a47895ed7daf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.191+0000 7f1ba6ffd640 1 -- 172.21.15.62:0/3209338794 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cb8107020 con 0x5567de0df310 2024-09-10T05:36:31.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.191+0000 7f1ba6ffd640 1 -- 172.21.15.62:0/3209338794 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cb80d0b10 con 0x5567de0df310 2024-09-10T05:36:31.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.191+0000 7f1ba6ffd640 1 -- 172.21.15.62:0/3209338794 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cb80b33f0 con 0x5567de0df310 2024-09-10T05:36:31.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.191+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/3209338794 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567de0df310 msgr2=0x5567de0df6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.191+0000 7f1cca11d9c0 1 --2- 172.21.15.62:0/3209338794 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567de0df310 0x5567de0df6f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1cb80dafd0 tx=0x7f1cb80f4c70 comp rx=0 tx=0).stop 2024-09-10T05:36:31.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.191+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/3209338794 shutdown_connections 2024-09-10T05:36:31.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.191+0000 7f1cca11d9c0 1 --2- 172.21.15.62:0/3209338794 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567de0df310 0x5567de0df6f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.191+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/3209338794 >> 172.21.15.62:0/3209338794 conn(0x5567de0db740 msgr2=0x5567de0d9980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:31.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.191+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/3209338794 shutdown_connections 2024-09-10T05:36:31.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.191+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/3209338794 wait complete. 2024-09-10T05:36:31.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.191+0000 7f1cca11d9c0 1 Processor -- start 2024-09-10T05:36:31.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.195+0000 7f1cca11d9c0 1 -- start start 2024-09-10T05:36:31.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.195+0000 7f1cca11d9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567de0df310 0x5567de0e6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.195+0000 7f1cca11d9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5567de0e01a0 con 0x5567de0df310 2024-09-10T05:36:31.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.195+0000 7f1cc7c23640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567de0df310 0x5567de0e6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.195+0000 7f1cc7c23640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567de0df310 0x5567de0e6620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51354/0 (socket says 172.21.15.62:51354) 2024-09-10T05:36:31.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.195+0000 7f1cc7c23640 1 -- 172.21.15.62:0/4165597391 learned_addr learned my addr 172.21.15.62:0/4165597391 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:31.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.195+0000 7f1cc7c23640 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567de0e6b80 con 0x5567de0df310 2024-09-10T05:36:31.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.195+0000 7f1cc7c23640 1 --2- 172.21.15.62:0/4165597391 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567de0df310 0x5567de0e6620 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1cb80e8f50 tx=0x7f1cb80e2ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.195+0000 7f1ba57fa640 1 -- 172.21.15.62:0/4165597391 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cb80d0b10 con 0x5567de0df310 2024-09-10T05:36:31.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.195+0000 7f1ba57fa640 1 -- 172.21.15.62:0/4165597391 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cb80dbcf0 con 0x5567de0df310 2024-09-10T05:36:31.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.195+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5567de0e6b80 con 0x5567de0df310 2024-09-10T05:36:31.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.195+0000 7f1ba57fa640 1 -- 172.21.15.62:0/4165597391 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cb80e7780 con 0x5567de0df310 2024-09-10T05:36:31.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.195+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567de0e6b80 con 0x5567de0df310 2024-09-10T05:36:31.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.195+0000 7f1cca11d9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.195+0000 7f1ba57fa640 1 -- 172.21.15.62:0/4165597391 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1cb810a020 con 0x5567de0df310 2024-09-10T05:36:31.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.195+0000 7f1ba57fa640 1 --2- 172.21.15.62:0/4165597391 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1b90039a70 0x7f1b9003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.195+0000 7f1ba57fa640 1 -- 172.21.15.62:0/4165597391 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f1cb8113070 con 0x5567de0df310 2024-09-10T05:36:31.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.195+0000 7f1cc7422640 1 --2- 172.21.15.62:0/4165597391 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1b90039a70 0x7f1b9003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.195+0000 7f1cca11d9c0 1 --2- 172.21.15.62:0/4165597391 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5567de0f13d0 0x5567de0f3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.195+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5567de0f3fb0 con 0x5567de0f13d0 2024-09-10T05:36:31.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.195+0000 7f1cc8424640 1 --2- 172.21.15.62:0/4165597391 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5567de0f13d0 0x5567de0f3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.199+0000 7f1cc7422640 1 --2- 172.21.15.62:0/4165597391 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1b90039a70 0x7f1b9003bf30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x5567de0c0860 tx=0x7f1cb0010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.199+0000 7f1cc8424640 1 --2- 172.21.15.62:0/4165597391 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5567de0f13d0 0x5567de0f3860 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.199+0000 7f1cc8424640 1 -- 172.21.15.62:0/4165597391 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1cc000a4d0 con 0x5567de0f13d0 2024-09-10T05:36:31.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.199+0000 7f1cca11d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:31.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.199+0000 7f1cca11d9c0 20 realm 2024-09-10T05:36:31.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.199+0000 7f1cca11d9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.199+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5567de0f07c0 con 0x5567de0f13d0 2024-09-10T05:36:31.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.199+0000 7f1cc8424640 1 -- 172.21.15.62:0/4165597391 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1cc000a4d0 con 0x5567de0f13d0 2024-09-10T05:36:31.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.199+0000 7f1cca11d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:31.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.199+0000 7f1cca11d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:31.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.199+0000 7f1cca11d9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.199+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5567de0f4a70 con 0x5567de0f13d0 2024-09-10T05:36:31.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.199+0000 7f1cc8424640 1 -- 172.21.15.62:0/4165597391 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1cc000a4d0 con 0x5567de0f13d0 2024-09-10T05:36:31.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.199+0000 7f1cca11d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:31.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.199+0000 7f1cca11d9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.199+0000 7f1cca11d9c0 1 --2- 172.21.15.62:0/4165597391 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5567de0f5850 0x5567de0f7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.199+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5567de0f82d0 con 0x5567de0f5850 2024-09-10T05:36:31.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.199+0000 7f1cc7c23640 1 --2- 172.21.15.62:0/4165597391 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5567de0f5850 0x5567de0f7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.199+0000 7f1cc7c23640 1 --2- 172.21.15.62:0/4165597391 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5567de0f5850 0x5567de0f7c40 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.199+0000 7f1cc7c23640 1 -- 172.21.15.62:0/4165597391 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1cb811d020 con 0x5567de0f5850 2024-09-10T05:36:31.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.199+0000 7f1cca11d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:31.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.199+0000 7f1cca11d9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.199+0000 7f1cca11d9c0 1 --2- 172.21.15.62:0/4165597391 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5567de0f9080 0x5567de0fb470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.199+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5567de0fbad0 con 0x5567de0f9080 2024-09-10T05:36:31.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.199+0000 7f1cc7422640 1 --2- 172.21.15.62:0/4165597391 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5567de0f9080 0x5567de0fb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.199+0000 7f1cc7422640 1 --2- 172.21.15.62:0/4165597391 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5567de0f9080 0x5567de0fb470 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.199+0000 7f1cc7422640 1 -- 172.21.15.62:0/4165597391 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1cb000bd60 con 0x5567de0f9080 2024-09-10T05:36:31.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.199+0000 7f1cca11d9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:31.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.199+0000 7f1cca11d9c0 20 searching for the correct realm 2024-09-10T05:36:31.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.199+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5567de0fd3d0 con 0x5567de0f9080 2024-09-10T05:36:31.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.203+0000 7f1cc7422640 1 -- 172.21.15.62:0/4165597391 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cb000bd60 con 0x5567de0f9080 2024-09-10T05:36:31.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.203+0000 7f1cc7422640 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5567de0fd3d0 con 0x5567de0f5850 2024-09-10T05:36:31.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.203+0000 7f1cc7c23640 1 -- 172.21.15.62:0/4165597391 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cb811d020 con 0x5567de0f5850 2024-09-10T05:36:31.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.203+0000 7f1cc7c23640 1 --2- 172.21.15.62:0/4165597391 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f1cb810c040 0x7f1cb80efa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.203+0000 7f1cc7c23640 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5567de0fd3d0 con 0x7f1cb810c040 2024-09-10T05:36:31.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.203+0000 7f1cc8424640 1 --2- 172.21.15.62:0/4165597391 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f1cb810c040 0x7f1cb80efa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.203+0000 7f1cc8424640 1 --2- 172.21.15.62:0/4165597391 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f1cb810c040 0x7f1cb80efa20 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.203+0000 7f1cc8424640 1 -- 172.21.15.62:0/4165597391 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cc000a4d0 con 0x7f1cb810c040 2024-09-10T05:36:31.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.203+0000 7f1cc8424640 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5567de0fd3d0 con 0x5567de0f13d0 2024-09-10T05:36:31.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.203+0000 7f1cc8424640 1 -- 172.21.15.62:0/4165597391 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cc000a4d0 con 0x5567de0f13d0 2024-09-10T05:36:31.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.203+0000 7f1cc8424640 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5567de0fd3d0 con 0x5567de0f13d0 2024-09-10T05:36:31.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.203+0000 7f1cc8424640 1 -- 172.21.15.62:0/4165597391 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cc000a4d0 con 0x5567de0f13d0 2024-09-10T05:36:31.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.203+0000 7f1cc8424640 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5567de0fd3d0 con 0x5567de0f9080 2024-09-10T05:36:31.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.203+0000 7f1cc7422640 1 -- 172.21.15.62:0/4165597391 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cb000bd60 con 0x5567de0f9080 2024-09-10T05:36:31.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.203+0000 7f1cc7422640 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5567de0fd3d0 con 0x5567de0f13d0 2024-09-10T05:36:31.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.203+0000 7f1cc8424640 1 -- 172.21.15.62:0/4165597391 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cc000a4d0 con 0x5567de0f13d0 2024-09-10T05:36:31.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.203+0000 7f1cc8424640 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5567de0fd3d0 con 0x5567de0f5850 2024-09-10T05:36:31.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.203+0000 7f1cc7c23640 1 -- 172.21.15.62:0/4165597391 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cb811d020 con 0x5567de0f5850 2024-09-10T05:36:31.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.203+0000 7f1cc7c23640 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5567de0fd3d0 con 0x5567de0f5850 2024-09-10T05:36:31.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.207+0000 7f1cc7c23640 1 -- 172.21.15.62:0/4165597391 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cb811d020 con 0x5567de0f5850 2024-09-10T05:36:31.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.207+0000 7f1cc7c23640 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5567de0fd3d0 con 0x5567de0f13d0 2024-09-10T05:36:31.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.207+0000 7f1cc8424640 1 -- 172.21.15.62:0/4165597391 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cc000a4d0 con 0x5567de0f13d0 2024-09-10T05:36:31.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.207+0000 7f1cc8424640 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5567de0fd3d0 con 0x7f1cb810c040 2024-09-10T05:36:31.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.207+0000 7f1cc8424640 1 -- 172.21.15.62:0/4165597391 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cc000a4d0 con 0x7f1cb810c040 2024-09-10T05:36:31.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.207+0000 7f1cc8424640 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5567de0fd3d0 con 0x5567de0f13d0 2024-09-10T05:36:31.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.207+0000 7f1cc8424640 1 -- 172.21.15.62:0/4165597391 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cc000a4d0 con 0x5567de0f13d0 2024-09-10T05:36:31.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.207+0000 7f1cc8424640 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5567de0fd3d0 con 0x7f1cb810c040 2024-09-10T05:36:31.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.207+0000 7f1cc8424640 1 -- 172.21.15.62:0/4165597391 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1cc000a4d0 con 0x7f1cb810c040 2024-09-10T05:36:31.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.207+0000 7f1cc8424640 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5567de0fd3d0 con 0x5567de0f5850 2024-09-10T05:36:31.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.207+0000 7f1cc7c23640 1 -- 172.21.15.62:0/4165597391 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cb811d020 con 0x5567de0f5850 2024-09-10T05:36:31.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.207+0000 7f1cc7c23640 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5567de0fd3d0 con 0x5567de0f9080 2024-09-10T05:36:31.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.207+0000 7f1cc7422640 1 -- 172.21.15.62:0/4165597391 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cb000bd60 con 0x5567de0f9080 2024-09-10T05:36:31.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.207+0000 7f1cc7422640 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5567de0fd3d0 con 0x5567de0f13d0 2024-09-10T05:36:31.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.207+0000 7f1cc8424640 1 -- 172.21.15.62:0/4165597391 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cc000a4d0 con 0x5567de0f13d0 2024-09-10T05:36:31.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.207+0000 7f1cc8424640 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5567de0fd3d0 con 0x5567de0f5850 2024-09-10T05:36:31.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.207+0000 7f1cc7c23640 1 -- 172.21.15.62:0/4165597391 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cb811d020 con 0x5567de0f5850 2024-09-10T05:36:31.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.207+0000 7f1cc7c23640 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5567de0fd3d0 con 0x5567de0f9080 2024-09-10T05:36:31.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.211+0000 7f1cc7422640 1 -- 172.21.15.62:0/4165597391 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 30 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f1cb000bd60 con 0x5567de0f9080 2024-09-10T05:36:31.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.211+0000 7f1cc7422640 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5567de0fd3d0 con 0x5567de0f13d0 2024-09-10T05:36:31.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.211+0000 7f1cc8424640 1 -- 172.21.15.62:0/4165597391 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cc000a4d0 con 0x5567de0f13d0 2024-09-10T05:36:31.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.211+0000 7f1cc8424640 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5567de0fd3d0 con 0x5567de0f13d0 2024-09-10T05:36:31.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.211+0000 7f1cc8424640 1 -- 172.21.15.62:0/4165597391 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1cc000a4d0 con 0x5567de0f13d0 2024-09-10T05:36:31.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.211+0000 7f1cc8424640 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5567de0fd3d0 con 0x5567de0f13d0 2024-09-10T05:36:31.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.211+0000 7f1cc8424640 1 -- 172.21.15.62:0/4165597391 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cc000a4d0 con 0x5567de0f13d0 2024-09-10T05:36:31.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.211+0000 7f1cc8424640 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5567de0fd3d0 con 0x5567de0f9080 2024-09-10T05:36:31.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.211+0000 7f1cc7422640 1 -- 172.21.15.62:0/4165597391 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cb000bd60 con 0x5567de0f9080 2024-09-10T05:36:31.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.211+0000 7f1cc7422640 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5567de0fd3d0 con 0x7f1cb810c040 2024-09-10T05:36:31.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.211+0000 7f1cc8424640 1 -- 172.21.15.62:0/4165597391 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cc000a4d0 con 0x7f1cb810c040 2024-09-10T05:36:31.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.211+0000 7f1cc8424640 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5567de0fd3d0 con 0x5567de0f13d0 2024-09-10T05:36:31.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.211+0000 7f1cc8424640 1 -- 172.21.15.62:0/4165597391 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cc000a4d0 con 0x5567de0f13d0 2024-09-10T05:36:31.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.211+0000 7f1cc8424640 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5567de0fd3d0 con 0x7f1cb810c040 2024-09-10T05:36:31.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.211+0000 7f1cc8424640 1 -- 172.21.15.62:0/4165597391 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cc000a4d0 con 0x7f1cb810c040 2024-09-10T05:36:31.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.211+0000 7f1cc8424640 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5567de0fd3d0 con 0x5567de0f9080 2024-09-10T05:36:31.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.211+0000 7f1cc7422640 1 -- 172.21.15.62:0/4165597391 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cb000bd60 con 0x5567de0f9080 2024-09-10T05:36:31.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.211+0000 7f1cc7422640 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5567de0fd3d0 con 0x7f1cb810c040 2024-09-10T05:36:31.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.211+0000 7f1cc8424640 1 -- 172.21.15.62:0/4165597391 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cc000a4d0 con 0x7f1cb810c040 2024-09-10T05:36:31.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.211+0000 7f1cc8424640 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5567de0fd3d0 con 0x5567de0f5850 2024-09-10T05:36:31.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.211+0000 7f1cc7c23640 1 -- 172.21.15.62:0/4165597391 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cb811d020 con 0x5567de0f5850 2024-09-10T05:36:31.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.211+0000 7f1cc7c23640 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5567de0fd3d0 con 0x5567de0f5850 2024-09-10T05:36:31.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.215+0000 7f1cc7c23640 1 -- 172.21.15.62:0/4165597391 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cb811d020 con 0x5567de0f5850 2024-09-10T05:36:31.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.215+0000 7f1cc7c23640 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5567de0fd3d0 con 0x5567de0f9080 2024-09-10T05:36:31.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.215+0000 7f1cc7422640 1 -- 172.21.15.62:0/4165597391 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cb000bd60 con 0x5567de0f9080 2024-09-10T05:36:31.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.215+0000 7f1cc7422640 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5567de0fd3d0 con 0x5567de0f5850 2024-09-10T05:36:31.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.215+0000 7f1cc7c23640 1 -- 172.21.15.62:0/4165597391 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1cb811d020 con 0x5567de0f5850 2024-09-10T05:36:31.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.215+0000 7f1cc7c23640 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5567de0fd3d0 con 0x5567de0f5850 2024-09-10T05:36:31.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.215+0000 7f1cc7c23640 1 -- 172.21.15.62:0/4165597391 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cb811d020 con 0x5567de0f5850 2024-09-10T05:36:31.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.215+0000 7f1cca11d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:31.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.215+0000 7f1cca11d9c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:31.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.215+0000 7f1cca11d9c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:31.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.215+0000 7f1cca11d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:31.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.215+0000 7f1cca11d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:31.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.215+0000 7f1cca11d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:31.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.215+0000 7f1cca11d9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.215+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5567de0fc4f0 con 0x5567de0f13d0 2024-09-10T05:36:31.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.215+0000 7f1cc8424640 1 -- 172.21.15.62:0/4165597391 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1cc000a4d0 con 0x5567de0f13d0 2024-09-10T05:36:31.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.215+0000 7f1cca11d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:31.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.215+0000 7f1cca11d9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.215+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5567de0fc970 con 0x5567de0f5850 2024-09-10T05:36:31.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.215+0000 7f1cc7c23640 1 -- 172.21.15.62:0/4165597391 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1cb811d020 con 0x5567de0f5850 2024-09-10T05:36:31.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.215+0000 7f1cca11d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:31.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.215+0000 7f1cca11d9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.215+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5567de0fcd90 con 0x5567de0f9080 2024-09-10T05:36:31.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.215+0000 7f1cc7422640 1 -- 172.21.15.62:0/4165597391 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1cb000bd60 con 0x5567de0f9080 2024-09-10T05:36:31.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.215+0000 7f1cca11d9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:31.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.215+0000 7f1cca11d9c0 20 zone default found 2024-09-10T05:36:31.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.215+0000 7f1cca11d9c0 4 Realm: () 2024-09-10T05:36:31.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.215+0000 7f1cca11d9c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:31.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.215+0000 7f1cca11d9c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:31.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.215+0000 7f1cca11d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:31.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.215+0000 7f1cca11d9c0 20 zonegroup default 2024-09-10T05:36:31.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.215+0000 7f1cca11d9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.215+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5567de0fc070 con 0x7f1cb810c040 2024-09-10T05:36:31.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.215+0000 7f1cc8424640 1 -- 172.21.15.62:0/4165597391 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1cc000a4d0 con 0x7f1cb810c040 2024-09-10T05:36:31.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.215+0000 7f1cca11d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:31.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.215+0000 7f1cca11d9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.215+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5567de0ffae0 con 0x5567de0f9080 2024-09-10T05:36:31.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.215+0000 7f1cc7422640 1 -- 172.21.15.62:0/4165597391 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1cb000bd60 con 0x5567de0f9080 2024-09-10T05:36:31.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.215+0000 7f1cca11d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:31.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.215+0000 7f1cca11d9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.215+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5567de0ffff0 con 0x5567de0f9080 2024-09-10T05:36:31.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.219+0000 7f1cc7422640 1 -- 172.21.15.62:0/4165597391 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1cb000bd60 con 0x5567de0f9080 2024-09-10T05:36:31.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.219+0000 7f1cca11d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:31.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.219+0000 7f1cca11d9c0 20 started sync module instance, tier type = 2024-09-10T05:36:31.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.219+0000 7f1cca11d9c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:31.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.219+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5567de0fe8e0 con 0x5567de0f5850 2024-09-10T05:36:31.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.219+0000 7f1cc7c23640 1 -- 172.21.15.62:0/4165597391 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cb811d020 con 0x5567de0f5850 2024-09-10T05:36:31.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.219+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93904595576128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5567de0fefd0 con 0x5567de0f5850 2024-09-10T05:36:31.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.219+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5567de100b00 con 0x5567de0f13d0 2024-09-10T05:36:31.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.219+0000 7f1cc8424640 1 -- 172.21.15.62:0/4165597391 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cc000a4d0 con 0x5567de0f13d0 2024-09-10T05:36:31.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.219+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93904595584496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5567de1013a0 con 0x5567de0f13d0 2024-09-10T05:36:31.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.219+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5567de101dc0 con 0x5567de0f5850 2024-09-10T05:36:31.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.223+0000 7f1cc7c23640 1 -- 172.21.15.62:0/4165597391 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 93904595576128] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cb811d020 con 0x5567de0f5850 2024-09-10T05:36:31.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.223+0000 7f1cc8424640 1 -- 172.21.15.62:0/4165597391 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93904595584496] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cc000a4d0 con 0x5567de0f13d0 2024-09-10T05:36:31.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.223+0000 7f1cc7c23640 1 -- 172.21.15.62:0/4165597391 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cb811d020 con 0x5567de0f5850 2024-09-10T05:36:31.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.223+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93904595589296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5567de100ef0 con 0x5567de0f5850 2024-09-10T05:36:31.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.223+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5567de102660 con 0x7f1cb810c040 2024-09-10T05:36:31.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.223+0000 7f1cc8424640 1 -- 172.21.15.62:0/4165597391 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cc000a4d0 con 0x7f1cb810c040 2024-09-10T05:36:31.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.223+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93904595591600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5567de100ef0 con 0x7f1cb810c040 2024-09-10T05:36:31.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.223+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5567de103120 con 0x5567de0f5850 2024-09-10T05:36:31.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.227+0000 7f1cc7c23640 1 -- 172.21.15.62:0/4165597391 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93904595589296] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cb811d020 con 0x5567de0f5850 2024-09-10T05:36:31.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.227+0000 7f1cc8424640 1 -- 172.21.15.62:0/4165597391 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93904595591600] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cc000a4d0 con 0x7f1cb810c040 2024-09-10T05:36:31.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.227+0000 7f1cc7c23640 1 -- 172.21.15.62:0/4165597391 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cb811d020 con 0x5567de0f5850 2024-09-10T05:36:31.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.227+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93904595592656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5567de1030e0 con 0x5567de0f5850 2024-09-10T05:36:31.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.227+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5567de103510 con 0x5567de0f9080 2024-09-10T05:36:31.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.227+0000 7f1cc7422640 1 -- 172.21.15.62:0/4165597391 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cb000bd60 con 0x5567de0f9080 2024-09-10T05:36:31.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.227+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93904595577376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5567de103510 con 0x5567de0f9080 2024-09-10T05:36:31.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.227+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5567de104450 con 0x5567de0f9080 2024-09-10T05:36:31.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.227+0000 7f1cc7c23640 1 -- 172.21.15.62:0/4165597391 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 93904595592656] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cb811d020 con 0x5567de0f5850 2024-09-10T05:36:31.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.231+0000 7f1cc7422640 1 -- 172.21.15.62:0/4165597391 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(56 notify.6 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cb000bd60 con 0x5567de0f9080 2024-09-10T05:36:31.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.231+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93904595599136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5567de104410 con 0x5567de0f9080 2024-09-10T05:36:31.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.231+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5567de104e10 con 0x7f1cb810c040 2024-09-10T05:36:31.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.231+0000 7f1cc7422640 1 -- 172.21.15.62:0/4165597391 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93904595577376] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cb000bd60 con 0x5567de0f9080 2024-09-10T05:36:31.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.231+0000 7f1cc8424640 1 -- 172.21.15.62:0/4165597391 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cc000a4d0 con 0x7f1cb810c040 2024-09-10T05:36:31.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.231+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93904595597568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5567de104dd0 con 0x7f1cb810c040 2024-09-10T05:36:31.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.231+0000 7f1cca11d9c0 20 add_watcher() i=0 2024-09-10T05:36:31.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.231+0000 7f1cca11d9c0 20 add_watcher() i=1 2024-09-10T05:36:31.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.231+0000 7f1cca11d9c0 20 add_watcher() i=2 2024-09-10T05:36:31.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.231+0000 7f1cca11d9c0 20 add_watcher() i=3 2024-09-10T05:36:31.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.231+0000 7f1cca11d9c0 20 add_watcher() i=4 2024-09-10T05:36:31.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.231+0000 7f1cca11d9c0 20 add_watcher() i=5 2024-09-10T05:36:31.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.231+0000 7f1cc7422640 1 -- 172.21.15.62:0/4165597391 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93904595599136] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cb000bd60 con 0x5567de0f9080 2024-09-10T05:36:31.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.231+0000 7f1cca11d9c0 20 add_watcher() i=6 2024-09-10T05:36:31.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.235+0000 7f1cc8424640 1 -- 172.21.15.62:0/4165597391 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93904595597568] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cc000a4d0 con 0x7f1cb810c040 2024-09-10T05:36:31.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.235+0000 7f1cca11d9c0 20 add_watcher() i=7 2024-09-10T05:36:31.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.235+0000 7f1cca11d9c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:31.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.235+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5567de102bf0 con 0x5567de0f13d0 2024-09-10T05:36:31.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.235+0000 7f1cc8424640 1 -- 172.21.15.62:0/4165597391 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1cc000a4d0 con 0x5567de0f13d0 2024-09-10T05:36:31.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.235+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93904595594224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5567de1052d0 con 0x5567de0f13d0 2024-09-10T05:36:31.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.235+0000 7f1cc8424640 1 -- 172.21.15.62:0/4165597391 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93904595594224] v30'60 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1cc000a4d0 con 0x5567de0f13d0 2024-09-10T05:36:31.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.235+0000 7f1b7dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:31.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.235+0000 7f1cca11d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:31.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.235+0000 7f1cca11d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:31.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.235+0000 7f1cca11d9c0 5 note: GC not initialized 2024-09-10T05:36:31.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.235+0000 7f1b7cfe1640 20 reqs_thread_entry: start 2024-09-10T05:36:31.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.235+0000 7f1cca11d9c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:31.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.235+0000 7f1cca11d9c0 20 Filter name: none 2024-09-10T05:36:31.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.235+0000 7f1af67fc640 20 reqs_thread_entry: start 2024-09-10T05:36:31.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.235+0000 7f1cca11d9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.235+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5567de12abc0 con 0x5567de0f13d0 2024-09-10T05:36:31.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.239+0000 7f1cc8424640 1 -- 172.21.15.62:0/4165597391 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f1cc000a4d0 con 0x5567de0f13d0 2024-09-10T05:36:31.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.239+0000 7f1cca11d9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:36:31.241 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T05:36:30.893777Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:36:30.893760Z","tags":[],"group_ids":[]} 2024-09-10T05:36:31.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.239+0000 7f1b7dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:31.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.239+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93904595594224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5567de129a10 con 0x5567de0f13d0 2024-09-10T05:36:31.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.239+0000 7f1cc8424640 1 -- 172.21.15.62:0/4165597391 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93904595594224] v30'61 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1cc000a4d0 con 0x5567de0f13d0 2024-09-10T05:36:31.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.239+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93904595576128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5567de128a30 con 0x5567de0f5850 2024-09-10T05:36:31.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.243+0000 7f1cc7c23640 1 -- 172.21.15.62:0/4165597391 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93904595576128] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cb811d020 con 0x5567de0f5850 2024-09-10T05:36:31.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.243+0000 7f1cca11d9c0 20 remove_watcher() i=0 2024-09-10T05:36:31.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.243+0000 7f1cca11d9c0 2 removed watcher, disabling cache 2024-09-10T05:36:31.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.243+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93904595584496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5567de128a30 con 0x5567de0f13d0 2024-09-10T05:36:31.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.243+0000 7f1cc8424640 1 -- 172.21.15.62:0/4165597391 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93904595584496] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cc000a4d0 con 0x5567de0f13d0 2024-09-10T05:36:31.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.243+0000 7f1cca11d9c0 20 remove_watcher() i=1 2024-09-10T05:36:31.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.243+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93904595589296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5567de128a30 con 0x5567de0f5850 2024-09-10T05:36:31.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.247+0000 7f1cc7c23640 1 -- 172.21.15.62:0/4165597391 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93904595589296] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cb811d020 con 0x5567de0f5850 2024-09-10T05:36:31.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.247+0000 7f1cca11d9c0 20 remove_watcher() i=2 2024-09-10T05:36:31.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.247+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93904595591600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5567de128a30 con 0x7f1cb810c040 2024-09-10T05:36:31.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.247+0000 7f1cc8424640 1 -- 172.21.15.62:0/4165597391 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93904595591600] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cc000a4d0 con 0x7f1cb810c040 2024-09-10T05:36:31.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.247+0000 7f1cca11d9c0 20 remove_watcher() i=3 2024-09-10T05:36:31.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.247+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93904595592656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5567de128a30 con 0x5567de0f5850 2024-09-10T05:36:31.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.251+0000 7f1cc7c23640 1 -- 172.21.15.62:0/4165597391 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93904595592656] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cb811d020 con 0x5567de0f5850 2024-09-10T05:36:31.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.251+0000 7f1cca11d9c0 20 remove_watcher() i=4 2024-09-10T05:36:31.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.251+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93904595577376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5567de128a30 con 0x5567de0f9080 2024-09-10T05:36:31.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.251+0000 7f1cc7422640 1 -- 172.21.15.62:0/4165597391 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93904595577376] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cb000bd60 con 0x5567de0f9080 2024-09-10T05:36:31.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.251+0000 7f1cca11d9c0 20 remove_watcher() i=5 2024-09-10T05:36:31.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.251+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93904595599136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5567de102630 con 0x5567de0f9080 2024-09-10T05:36:31.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.251+0000 7f1cc7422640 1 -- 172.21.15.62:0/4165597391 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93904595599136] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cb000bd60 con 0x5567de0f9080 2024-09-10T05:36:31.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.251+0000 7f1cca11d9c0 20 remove_watcher() i=6 2024-09-10T05:36:31.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.251+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/4165597391 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93904595597568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5567de128a30 con 0x7f1cb810c040 2024-09-10T05:36:31.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.255+0000 7f1cc8424640 1 -- 172.21.15.62:0/4165597391 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93904595597568] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cc000a4d0 con 0x7f1cb810c040 2024-09-10T05:36:31.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.255+0000 7f1cca11d9c0 20 remove_watcher() i=7 2024-09-10T05:36:31.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.255+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/4165597391 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5567de0f5850 msgr2=0x5567de0f7c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.255+0000 7f1cca11d9c0 1 --2- 172.21.15.62:0/4165597391 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5567de0f5850 0x5567de0f7c40 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.255+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/4165597391 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5567de0f13d0 msgr2=0x5567de0f3860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.255+0000 7f1cca11d9c0 1 --2- 172.21.15.62:0/4165597391 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5567de0f13d0 0x5567de0f3860 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.255+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/4165597391 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f1cb810c040 msgr2=0x7f1cb80efa20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.255+0000 7f1cca11d9c0 1 --2- 172.21.15.62:0/4165597391 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f1cb810c040 0x7f1cb80efa20 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.255+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/4165597391 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5567de0f9080 msgr2=0x5567de0fb470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.255+0000 7f1cca11d9c0 1 --2- 172.21.15.62:0/4165597391 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5567de0f9080 0x5567de0fb470 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.255+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/4165597391 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1b90039a70 msgr2=0x7f1b9003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.255+0000 7f1cca11d9c0 1 --2- 172.21.15.62:0/4165597391 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1b90039a70 0x7f1b9003bf30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x5567de0c0860 tx=0x7f1cb0010000 comp rx=0 tx=0).stop 2024-09-10T05:36:31.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.255+0000 7f1cc8424640 1 -- 172.21.15.62:0/4165597391 reap_dead start 2024-09-10T05:36:31.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.255+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/4165597391 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567de0df310 msgr2=0x5567de0e6620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.255+0000 7f1cca11d9c0 1 --2- 172.21.15.62:0/4165597391 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567de0df310 0x5567de0e6620 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1cb80e8f50 tx=0x7f1cb80e2ec0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.255+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/4165597391 shutdown_connections 2024-09-10T05:36:31.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.255+0000 7f1cca11d9c0 1 --2- 172.21.15.62:0/4165597391 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567de0df310 0x5567de0e6620 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.255+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/4165597391 >> 172.21.15.62:0/4165597391 conn(0x5567de0db740 msgr2=0x5567de0d9950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:31.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.255+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/4165597391 shutdown_connections 2024-09-10T05:36:31.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.255+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/4165597391 wait complete. 2024-09-10T05:36:31.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.255+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/335442140 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1ba0039ac0 msgr2=0x7f1ba003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.255+0000 7f1cca11d9c0 1 --2- 172.21.15.62:0/335442140 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1ba0039ac0 0x7f1ba003bf80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x5567de0c0c30 tx=0x7f1cb000f000 comp rx=0 tx=0).stop 2024-09-10T05:36:31.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.255+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/335442140 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567de0d2b80 msgr2=0x5567de0d2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.255+0000 7f1cca11d9c0 1 --2- 172.21.15.62:0/335442140 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567de0d2b80 0x5567de0d2fa0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1cb80ea100 tx=0x7f1cb80c7ed0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.255+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/335442140 shutdown_connections 2024-09-10T05:36:31.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.255+0000 7f1cca11d9c0 1 --2- 172.21.15.62:0/335442140 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1ba0039ac0 0x7f1ba003bf80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.255+0000 7f1cca11d9c0 1 --2- 172.21.15.62:0/335442140 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567de0d2b80 0x5567de0d2fa0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.255+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/335442140 >> 172.21.15.62:0/335442140 conn(0x5567de0c8530 msgr2=0x5567de0c8910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:31.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.259+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/335442140 shutdown_connections 2024-09-10T05:36:31.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.259+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/335442140 wait complete. 2024-09-10T05:36:31.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.259+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/3552655022 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5567de0bd000 msgr2=0x5567de0bf4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.259+0000 7f1cca11d9c0 1 --2- 172.21.15.62:0/3552655022 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5567de0bd000 0x5567de0bf4c0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.259+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/3552655022 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5567ddf345e0 msgr2=0x5567de0bbfa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.259+0000 7f1cca11d9c0 1 --2- 172.21.15.62:0/3552655022 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5567ddf345e0 0x5567de0bbfa0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.259+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/3552655022 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5567de0c19f0 msgr2=0x5567de0c3de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.259+0000 7f1cca11d9c0 1 --2- 172.21.15.62:0/3552655022 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5567de0c19f0 0x5567de0c3de0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.259+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/3552655022 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1bb0039a70 msgr2=0x7f1bb003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.259+0000 7f1cca11d9c0 1 --2- 172.21.15.62:0/3552655022 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1bb0039a70 0x7f1bb003bf30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1cb0001e40 tx=0x7f1cb00013a0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.259+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/3552655022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567ddf34200 msgr2=0x5567de0b4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.259+0000 7f1cca11d9c0 1 --2- 172.21.15.62:0/3552655022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567ddf34200 0x5567de0b4e30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1cb801b170 tx=0x7f1cb80180e0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.259+0000 7f1cc8424640 1 -- 172.21.15.62:0/3552655022 reap_dead start 2024-09-10T05:36:31.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.259+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/3552655022 shutdown_connections 2024-09-10T05:36:31.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.259+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/3552655022 >> 172.21.15.62:0/3552655022 conn(0x5567ddfba920 msgr2=0x5567de0a7fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:31.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.259+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/3552655022 shutdown_connections 2024-09-10T05:36:31.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.259+0000 7f1cca11d9c0 1 -- 172.21.15.62:0/3552655022 wait complete. 2024-09-10T05:36:31.272 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T05:36:30.893777Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:36:30.893760Z', 'tags': [], 'group_ids': []} 2024-09-10T05:36:31.272 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-10T05:36:31.272 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-10T05:36:31.273 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-10T05:36:31.349 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:31.349 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:31.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.347+0000 7f07f7e269c0 1 Processor -- start 2024-09-10T05:36:31.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.347+0000 7f07f7e269c0 1 -- start start 2024-09-10T05:36:31.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.347+0000 7f07f7e269c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5555fe879200 0x5555fe8795e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.347+0000 7f07f7e269c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5555fe72b9c0 con 0x5555fe87c340 2024-09-10T05:36:31.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.347+0000 7f07f7e269c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x5555fe77b6d0 con 0x5555fe879200 2024-09-10T05:36:31.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.347+0000 7f07f592c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5555fe879200 0x5555fe8795e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.347+0000 7f07f592c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5555fe879200 0x5555fe8795e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51364/0 (socket says 172.21.15.62:51364) 2024-09-10T05:36:31.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.347+0000 7f07f592c640 1 -- 172.21.15.62:0/2037689742 learned_addr learned my addr 172.21.15.62:0/2037689742 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:31.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.347+0000 7f07f592c640 1 -- 172.21.15.62:0/2037689742 >> v1:172.21.15.2:6789/0 conn(0x5555fe87c340 legacy=0x5555fe87e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.347+0000 7f07f592c640 1 -- 172.21.15.62:0/2037689742 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555fe71fca0 con 0x5555fe879200 2024-09-10T05:36:31.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.351+0000 7f07f592c640 1 --2- 172.21.15.62:0/2037689742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555fe879200 0x5555fe8795e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f07f000a4e0 tx=0x7f07f001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fd9f4335cf7a5c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.351+0000 7f07f492a640 1 -- 172.21.15.62:0/2037689742 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07f00aa540 con 0x5555fe879200 2024-09-10T05:36:31.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.351+0000 7f07f492a640 1 -- 172.21.15.62:0/2037689742 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07f00aa6e0 con 0x5555fe879200 2024-09-10T05:36:31.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.351+0000 7f07f492a640 1 -- 172.21.15.62:0/2037689742 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07f00aaa40 con 0x5555fe879200 2024-09-10T05:36:31.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.351+0000 7f07f7e269c0 1 -- 172.21.15.62:0/2037689742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555fe879200 msgr2=0x5555fe8795e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.351+0000 7f07f7e269c0 1 --2- 172.21.15.62:0/2037689742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555fe879200 0x5555fe8795e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f07f000a4e0 tx=0x7f07f001b090 comp rx=0 tx=0).stop 2024-09-10T05:36:31.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.351+0000 7f07f7e269c0 1 -- 172.21.15.62:0/2037689742 shutdown_connections 2024-09-10T05:36:31.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.351+0000 7f07f7e269c0 1 --2- 172.21.15.62:0/2037689742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555fe879200 0x5555fe8795e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.351+0000 7f07f7e269c0 1 -- 172.21.15.62:0/2037689742 >> 172.21.15.62:0/2037689742 conn(0x5555fe7ecb10 msgr2=0x5555fe7ecf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:31.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.351+0000 7f07f7e269c0 1 -- 172.21.15.62:0/2037689742 shutdown_connections 2024-09-10T05:36:31.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.351+0000 7f07f7e269c0 1 -- 172.21.15.62:0/2037689742 wait complete. 2024-09-10T05:36:31.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.367+0000 7f07f7e269c0 1 Processor -- start 2024-09-10T05:36:31.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.367+0000 7f07f7e269c0 1 -- start start 2024-09-10T05:36:31.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.367+0000 7f07f7e269c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555fe879200 0x5555fe964870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.367+0000 7f07f7e269c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5555fe77f680 con 0x5555fe879200 2024-09-10T05:36:31.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.367+0000 7f07f592c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555fe879200 0x5555fe964870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.367+0000 7f07f592c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555fe879200 0x5555fe964870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51370/0 (socket says 172.21.15.62:51370) 2024-09-10T05:36:31.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.367+0000 7f07f592c640 1 -- 172.21.15.62:0/367039333 learned_addr learned my addr 172.21.15.62:0/367039333 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:31.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.367+0000 7f07f592c640 1 -- 172.21.15.62:0/367039333 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555fe6fada0 con 0x5555fe879200 2024-09-10T05:36:31.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.367+0000 7f07f592c640 1 --2- 172.21.15.62:0/367039333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555fe879200 0x5555fe964870 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f07f0019740 tx=0x7f07f00033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdf0bb6b1780ff99 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.371+0000 7f06e3e07640 1 -- 172.21.15.62:0/367039333 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07f00b9070 con 0x5555fe879200 2024-09-10T05:36:31.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.371+0000 7f06e3e07640 1 -- 172.21.15.62:0/367039333 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07f00aaa90 con 0x5555fe879200 2024-09-10T05:36:31.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.371+0000 7f06e3e07640 1 -- 172.21.15.62:0/367039333 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07f00aad70 con 0x5555fe879200 2024-09-10T05:36:31.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.371+0000 7f07f7e269c0 1 -- 172.21.15.62:0/367039333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555fe879200 msgr2=0x5555fe964870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.371+0000 7f07f7e269c0 1 --2- 172.21.15.62:0/367039333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555fe879200 0x5555fe964870 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f07f0019740 tx=0x7f07f00033b0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.371+0000 7f07f7e269c0 1 -- 172.21.15.62:0/367039333 shutdown_connections 2024-09-10T05:36:31.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.371+0000 7f07f7e269c0 1 --2- 172.21.15.62:0/367039333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555fe879200 0x5555fe964870 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.371+0000 7f07f7e269c0 1 -- 172.21.15.62:0/367039333 >> 172.21.15.62:0/367039333 conn(0x5555fe7ecb10 msgr2=0x5555fe960510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:31.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.371+0000 7f07f7e269c0 1 -- 172.21.15.62:0/367039333 shutdown_connections 2024-09-10T05:36:31.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.371+0000 7f07f7e269c0 1 -- 172.21.15.62:0/367039333 wait complete. 2024-09-10T05:36:31.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.371+0000 7f07f7e269c0 1 Processor -- start 2024-09-10T05:36:31.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.371+0000 7f07f7e269c0 1 -- start start 2024-09-10T05:36:31.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.371+0000 7f07f7e269c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555fe879200 0x5555fe96bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.371+0000 7f07f7e269c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5555fe721a50 con 0x5555fe879200 2024-09-10T05:36:31.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.371+0000 7f07f592c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555fe879200 0x5555fe96bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.371+0000 7f07f592c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555fe879200 0x5555fe96bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51374/0 (socket says 172.21.15.62:51374) 2024-09-10T05:36:31.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.371+0000 7f07f592c640 1 -- 172.21.15.62:0/4205856280 learned_addr learned my addr 172.21.15.62:0/4205856280 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:31.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.371+0000 7f07f592c640 1 -- 172.21.15.62:0/4205856280 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555fe96c2c0 con 0x5555fe879200 2024-09-10T05:36:31.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.371+0000 7f07f592c640 1 --2- 172.21.15.62:0/4205856280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555fe879200 0x5555fe96bd60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f07f0018cc0 tx=0x7f07f0017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.371+0000 7f06e2604640 1 -- 172.21.15.62:0/4205856280 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07f00b9070 con 0x5555fe879200 2024-09-10T05:36:31.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.371+0000 7f06e2604640 1 -- 172.21.15.62:0/4205856280 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07f00b5b10 con 0x5555fe879200 2024-09-10T05:36:31.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.371+0000 7f07f7e269c0 1 -- 172.21.15.62:0/4205856280 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5555fe96c550 con 0x5555fe879200 2024-09-10T05:36:31.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.371+0000 7f06e2604640 1 -- 172.21.15.62:0/4205856280 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07f00b5df0 con 0x5555fe879200 2024-09-10T05:36:31.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.371+0000 7f07f7e269c0 1 -- 172.21.15.62:0/4205856280 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555fe96cf00 con 0x5555fe879200 2024-09-10T05:36:31.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.375+0000 7f06e2604640 1 -- 172.21.15.62:0/4205856280 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f07f00b3040 con 0x5555fe879200 2024-09-10T05:36:31.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.375+0000 7f06e2604640 1 --2- 172.21.15.62:0/4205856280 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f06dc039a70 0x7f06dc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.375+0000 7f06e2604640 1 -- 172.21.15.62:0/4205856280 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f07f00c4070 con 0x5555fe879200 2024-09-10T05:36:31.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.375+0000 7f07f512b640 1 --2- 172.21.15.62:0/4205856280 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f06dc039a70 0x7f06dc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.375+0000 7f07f7e269c0 1 --2- 172.21.15.62:0/4205856280 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5555fe87c340 0x5555fe972ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.375+0000 7f07f7e269c0 1 -- 172.21.15.62:0/4205856280 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555fe973410 con 0x5555fe87c340 2024-09-10T05:36:31.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.375+0000 7f07f612d640 1 --2- 172.21.15.62:0/4205856280 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5555fe87c340 0x5555fe972ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.375+0000 7f07f512b640 1 --2- 172.21.15.62:0/4205856280 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f06dc039a70 0x7f06dc03bf30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f07ec001e60 tx=0x7f07ec0013e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.375+0000 7f07f612d640 1 --2- 172.21.15.62:0/4205856280 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5555fe87c340 0x5555fe972ed0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.375+0000 7f07f612d640 1 -- 172.21.15.62:0/4205856280 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07e80083f0 con 0x5555fe87c340 2024-09-10T05:36:31.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.375+0000 7f07f7e269c0 1 --2- 172.21.15.62:0/4205856280 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5555fe974170 0x5555fe976560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.375+0000 7f07f7e269c0 1 -- 172.21.15.62:0/4205856280 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555fe976b70 con 0x5555fe974170 2024-09-10T05:36:31.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.375+0000 7f07f592c640 1 --2- 172.21.15.62:0/4205856280 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5555fe974170 0x5555fe976560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.375+0000 7f07f592c640 1 --2- 172.21.15.62:0/4205856280 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5555fe974170 0x5555fe976560 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.375+0000 7f07f592c640 1 -- 172.21.15.62:0/4205856280 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f07f00c6d80 con 0x5555fe974170 2024-09-10T05:36:31.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.375+0000 7f07f7e269c0 1 --2- 172.21.15.62:0/4205856280 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5555fe978930 0x5555fe97ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.375+0000 7f07f7e269c0 1 -- 172.21.15.62:0/4205856280 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555fe97b410 con 0x5555fe978930 2024-09-10T05:36:31.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.375+0000 7f07f512b640 1 --2- 172.21.15.62:0/4205856280 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5555fe978930 0x5555fe97ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.379+0000 7f07f512b640 1 --2- 172.21.15.62:0/4205856280 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5555fe978930 0x5555fe97ad20 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.379+0000 7f07f512b640 1 -- 172.21.15.62:0/4205856280 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f07ec00d040 con 0x5555fe978930 2024-09-10T05:36:31.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.379+0000 7f07f7e269c0 1 -- 172.21.15.62:0/4205856280 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555fe977800 con 0x5555fe974170 2024-09-10T05:36:31.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.379+0000 7f07f592c640 1 -- 172.21.15.62:0/4205856280 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f07f00c6d80 con 0x5555fe974170 2024-09-10T05:36:31.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.379+0000 7f07f7e269c0 1 -- 172.21.15.62:0/4205856280 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555fe977c20 con 0x5555fe978930 2024-09-10T05:36:31.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.379+0000 7f07f512b640 1 -- 172.21.15.62:0/4205856280 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f07ec00d040 con 0x5555fe978930 2024-09-10T05:36:31.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.379+0000 7f07f7e269c0 1 Processor -- start 2024-09-10T05:36:31.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.379+0000 7f07f7e269c0 1 -- start start 2024-09-10T05:36:31.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.379+0000 7f07f7e269c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555fe989a30 0x5555fe989e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.379+0000 7f07f7e269c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5555fe78c450 con 0x5555fe989a30 2024-09-10T05:36:31.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.379+0000 7f07f592c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555fe989a30 0x5555fe989e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.379+0000 7f07f592c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555fe989a30 0x5555fe989e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51382/0 (socket says 172.21.15.62:51382) 2024-09-10T05:36:31.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.379+0000 7f07f592c640 1 -- 172.21.15.62:0/571588496 learned_addr learned my addr 172.21.15.62:0/571588496 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:31.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.379+0000 7f07f592c640 1 -- 172.21.15.62:0/571588496 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555fe98a490 con 0x5555fe989a30 2024-09-10T05:36:31.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.379+0000 7f07f592c640 1 --2- 172.21.15.62:0/571588496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555fe989a30 0x5555fe989e50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f07f00e95c0 tx=0x7f07f00c76c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.383+0000 7f06db7fe640 1 -- 172.21.15.62:0/571588496 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07f00e1070 con 0x5555fe989a30 2024-09-10T05:36:31.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.383+0000 7f06db7fe640 1 -- 172.21.15.62:0/571588496 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07f00b3540 con 0x5555fe989a30 2024-09-10T05:36:31.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.383+0000 7f07f7e269c0 1 -- 172.21.15.62:0/571588496 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5555fe98acf0 con 0x5555fe989a30 2024-09-10T05:36:31.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.383+0000 7f06db7fe640 1 -- 172.21.15.62:0/571588496 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07f00e9a70 con 0x5555fe989a30 2024-09-10T05:36:31.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.383+0000 7f07f7e269c0 1 -- 172.21.15.62:0/571588496 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555fe98acf0 con 0x5555fe989a30 2024-09-10T05:36:31.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.383+0000 7f06db7fe640 1 -- 172.21.15.62:0/571588496 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f07f00e9c10 con 0x5555fe989a30 2024-09-10T05:36:31.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.383+0000 7f06db7fe640 1 --2- 172.21.15.62:0/571588496 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f06d0039ac0 0x7f06d003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.383+0000 7f06db7fe640 1 -- 172.21.15.62:0/571588496 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f07f00efaa0 con 0x5555fe989a30 2024-09-10T05:36:31.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.383+0000 7f07f512b640 1 --2- 172.21.15.62:0/571588496 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f06d0039ac0 0x7f06d003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.383+0000 7f07f7e269c0 1 Processor -- start 2024-09-10T05:36:31.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.383+0000 7f07f7e269c0 1 -- start start 2024-09-10T05:36:31.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.383+0000 7f07f512b640 1 --2- 172.21.15.62:0/571588496 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f06d0039ac0 0x7f06d003bf80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x5555fe96d1b0 tx=0x7f07ec006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.383+0000 7f07f7e269c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555fe995fe0 0x5555fe9963c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.383+0000 7f07f7e269c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5555fe965000 con 0x5555fe995fe0 2024-09-10T05:36:31.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.383+0000 7f07f592c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555fe995fe0 0x5555fe9963c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.383+0000 7f07f592c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555fe995fe0 0x5555fe9963c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51398/0 (socket says 172.21.15.62:51398) 2024-09-10T05:36:31.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.383+0000 7f07f592c640 1 -- 172.21.15.62:0/3696390798 learned_addr learned my addr 172.21.15.62:0/3696390798 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:31.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.383+0000 7f07f592c640 1 -- 172.21.15.62:0/3696390798 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555fe996990 con 0x5555fe995fe0 2024-09-10T05:36:31.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.383+0000 7f07f592c640 1 --2- 172.21.15.62:0/3696390798 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555fe995fe0 0x5555fe9963c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f07f00e8440 tx=0x7f07f00ddd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e886d961383b39b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.387+0000 7f06d97fa640 1 -- 172.21.15.62:0/3696390798 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07f00f3070 con 0x5555fe995fe0 2024-09-10T05:36:31.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.387+0000 7f06d97fa640 1 -- 172.21.15.62:0/3696390798 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07f00b3d30 con 0x5555fe995fe0 2024-09-10T05:36:31.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.387+0000 7f06d97fa640 1 -- 172.21.15.62:0/3696390798 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07f00b39a0 con 0x5555fe995fe0 2024-09-10T05:36:31.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.387+0000 7f07f7e269c0 1 -- 172.21.15.62:0/3696390798 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555fe995fe0 msgr2=0x5555fe9963c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.387+0000 7f07f7e269c0 1 --2- 172.21.15.62:0/3696390798 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555fe995fe0 0x5555fe9963c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f07f00e8440 tx=0x7f07f00ddd70 comp rx=0 tx=0).stop 2024-09-10T05:36:31.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.387+0000 7f07f7e269c0 1 -- 172.21.15.62:0/3696390798 shutdown_connections 2024-09-10T05:36:31.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.387+0000 7f07f7e269c0 1 --2- 172.21.15.62:0/3696390798 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555fe995fe0 0x5555fe9963c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.387+0000 7f07f7e269c0 1 -- 172.21.15.62:0/3696390798 >> 172.21.15.62:0/3696390798 conn(0x5555fe992410 msgr2=0x5555fe990650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:31.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.387+0000 7f07f7e269c0 1 -- 172.21.15.62:0/3696390798 shutdown_connections 2024-09-10T05:36:31.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.387+0000 7f07f7e269c0 1 -- 172.21.15.62:0/3696390798 wait complete. 2024-09-10T05:36:31.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.387+0000 7f07f7e269c0 1 Processor -- start 2024-09-10T05:36:31.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.387+0000 7f07f7e269c0 1 -- start start 2024-09-10T05:36:31.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.387+0000 7f07f7e269c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555fe995fe0 0x5555fe99d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.387+0000 7f07f7e269c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5555fe996e70 con 0x5555fe995fe0 2024-09-10T05:36:31.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.387+0000 7f07f592c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555fe995fe0 0x5555fe99d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.387+0000 7f07f592c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555fe995fe0 0x5555fe99d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51402/0 (socket says 172.21.15.62:51402) 2024-09-10T05:36:31.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.387+0000 7f07f592c640 1 -- 172.21.15.62:0/250939873 learned_addr learned my addr 172.21.15.62:0/250939873 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:31.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.387+0000 7f07f592c640 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555fe99d820 con 0x5555fe995fe0 2024-09-10T05:36:31.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.387+0000 7f07f592c640 1 --2- 172.21.15.62:0/250939873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555fe995fe0 0x5555fe99d2c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f07f00ac010 tx=0x7f07f00edea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.387+0000 7f06c77fe640 1 -- 172.21.15.62:0/250939873 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07f0113070 con 0x5555fe995fe0 2024-09-10T05:36:31.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.387+0000 7f06c77fe640 1 -- 172.21.15.62:0/250939873 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07f00b3ad0 con 0x5555fe995fe0 2024-09-10T05:36:31.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.387+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5555fe99d820 con 0x5555fe995fe0 2024-09-10T05:36:31.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.387+0000 7f06c77fe640 1 -- 172.21.15.62:0/250939873 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07f00b8d70 con 0x5555fe995fe0 2024-09-10T05:36:31.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.387+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555fe99d820 con 0x5555fe995fe0 2024-09-10T05:36:31.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.391+0000 7f06c77fe640 1 -- 172.21.15.62:0/250939873 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f07f0116070 con 0x5555fe995fe0 2024-09-10T05:36:31.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.391+0000 7f06c77fe640 1 --2- 172.21.15.62:0/250939873 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f06c0039ac0 0x7f06c003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.391+0000 7f06c77fe640 1 -- 172.21.15.62:0/250939873 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f07f010b070 con 0x5555fe995fe0 2024-09-10T05:36:31.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.391+0000 7f07f512b640 1 --2- 172.21.15.62:0/250939873 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f06c0039ac0 0x7f06c003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.391+0000 7f07f7e269c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.391+0000 7f07f7e269c0 1 --2- 172.21.15.62:0/250939873 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5555fe9a8100 0x5555fe9aa5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.391+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9aad10 con 0x5555fe9a8100 2024-09-10T05:36:31.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.391+0000 7f07f612d640 1 --2- 172.21.15.62:0/250939873 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5555fe9a8100 0x5555fe9aa5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.391+0000 7f07f512b640 1 --2- 172.21.15.62:0/250939873 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f06c0039ac0 0x7f06c003bf80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x5555fe97b7e0 tx=0x7f07ec011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.391+0000 7f07f612d640 1 --2- 172.21.15.62:0/250939873 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5555fe9a8100 0x5555fe9aa5c0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.391+0000 7f07f612d640 1 -- 172.21.15.62:0/250939873 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07e80083f0 con 0x5555fe9a8100 2024-09-10T05:36:31.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.391+0000 7f07f7e269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:31.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.391+0000 7f07f7e269c0 20 realm 2024-09-10T05:36:31.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.391+0000 7f07f7e269c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.391+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9a7430 con 0x5555fe9a8100 2024-09-10T05:36:31.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.391+0000 7f07f612d640 1 -- 172.21.15.62:0/250939873 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07e80083f0 con 0x5555fe9a8100 2024-09-10T05:36:31.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.391+0000 7f07f7e269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:31.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.391+0000 7f07f7e269c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:31.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.391+0000 7f07f7e269c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.391+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9ab7d0 con 0x5555fe9a8100 2024-09-10T05:36:31.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.391+0000 7f07f612d640 1 -- 172.21.15.62:0/250939873 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07e80083f0 con 0x5555fe9a8100 2024-09-10T05:36:31.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.391+0000 7f07f7e269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:31.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.391+0000 7f07f7e269c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.391+0000 7f07f7e269c0 1 --2- 172.21.15.62:0/250939873 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5555fe9ac5b0 0x5555fe9ae9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.391+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9af070 con 0x5555fe9ac5b0 2024-09-10T05:36:31.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.391+0000 7f07f592c640 1 --2- 172.21.15.62:0/250939873 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5555fe9ac5b0 0x5555fe9ae9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.391+0000 7f07f592c640 1 --2- 172.21.15.62:0/250939873 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5555fe9ac5b0 0x5555fe9ae9a0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.395+0000 7f07f592c640 1 -- 172.21.15.62:0/250939873 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f07f0115030 con 0x5555fe9ac5b0 2024-09-10T05:36:31.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.395+0000 7f07f7e269c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:31.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.395+0000 7f07f7e269c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.395+0000 7f07f7e269c0 1 --2- 172.21.15.62:0/250939873 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5555fe9afdd0 0x5555fe9b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.395+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b2970 con 0x5555fe9afdd0 2024-09-10T05:36:31.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.395+0000 7f07f512b640 1 --2- 172.21.15.62:0/250939873 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5555fe9afdd0 0x5555fe9b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.395+0000 7f07f512b640 1 --2- 172.21.15.62:0/250939873 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5555fe9afdd0 0x5555fe9b21e0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.395+0000 7f07f512b640 1 -- 172.21.15.62:0/250939873 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f07ec00d040 con 0x5555fe9afdd0 2024-09-10T05:36:31.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.395+0000 7f07f7e269c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:31.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.395+0000 7f07f7e269c0 20 searching for the correct realm 2024-09-10T05:36:31.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.395+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b4240 con 0x5555fe9afdd0 2024-09-10T05:36:31.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.395+0000 7f07f512b640 1 -- 172.21.15.62:0/250939873 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07ec00d040 con 0x5555fe9afdd0 2024-09-10T05:36:31.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.395+0000 7f07f512b640 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b4240 con 0x5555fe9ac5b0 2024-09-10T05:36:31.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.395+0000 7f07f592c640 1 -- 172.21.15.62:0/250939873 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07f0115030 con 0x5555fe9ac5b0 2024-09-10T05:36:31.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.395+0000 7f07f592c640 1 --2- 172.21.15.62:0/250939873 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f07f0118060 0x7f07f00e26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.395+0000 7f07f592c640 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b4240 con 0x7f07f0118060 2024-09-10T05:36:31.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.395+0000 7f07f612d640 1 --2- 172.21.15.62:0/250939873 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f07f0118060 0x7f07f00e26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.395+0000 7f07f612d640 1 --2- 172.21.15.62:0/250939873 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f07f0118060 0x7f07f00e26b0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.395+0000 7f07f612d640 1 -- 172.21.15.62:0/250939873 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07e80083f0 con 0x7f07f0118060 2024-09-10T05:36:31.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.395+0000 7f07f612d640 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b4240 con 0x5555fe9a8100 2024-09-10T05:36:31.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.395+0000 7f07f612d640 1 -- 172.21.15.62:0/250939873 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07e80083f0 con 0x5555fe9a8100 2024-09-10T05:36:31.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.395+0000 7f07f612d640 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b4240 con 0x5555fe9a8100 2024-09-10T05:36:31.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.395+0000 7f07f612d640 1 -- 172.21.15.62:0/250939873 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07e80083f0 con 0x5555fe9a8100 2024-09-10T05:36:31.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.395+0000 7f07f612d640 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b4240 con 0x5555fe9afdd0 2024-09-10T05:36:31.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.399+0000 7f07f512b640 1 -- 172.21.15.62:0/250939873 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07ec00d040 con 0x5555fe9afdd0 2024-09-10T05:36:31.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.399+0000 7f07f512b640 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b4240 con 0x5555fe9a8100 2024-09-10T05:36:31.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.399+0000 7f07f612d640 1 -- 172.21.15.62:0/250939873 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07e80083f0 con 0x5555fe9a8100 2024-09-10T05:36:31.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.399+0000 7f07f612d640 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b4240 con 0x5555fe9ac5b0 2024-09-10T05:36:31.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.399+0000 7f07f592c640 1 -- 172.21.15.62:0/250939873 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07f0115030 con 0x5555fe9ac5b0 2024-09-10T05:36:31.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.399+0000 7f07f592c640 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b4240 con 0x5555fe9ac5b0 2024-09-10T05:36:31.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.399+0000 7f07f592c640 1 -- 172.21.15.62:0/250939873 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07f0115030 con 0x5555fe9ac5b0 2024-09-10T05:36:31.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.399+0000 7f07f592c640 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b4240 con 0x5555fe9a8100 2024-09-10T05:36:31.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.399+0000 7f07f612d640 1 -- 172.21.15.62:0/250939873 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07e80083f0 con 0x5555fe9a8100 2024-09-10T05:36:31.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.399+0000 7f07f612d640 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b4240 con 0x7f07f0118060 2024-09-10T05:36:31.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.399+0000 7f07f612d640 1 -- 172.21.15.62:0/250939873 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07e80083f0 con 0x7f07f0118060 2024-09-10T05:36:31.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.399+0000 7f07f612d640 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b4240 con 0x5555fe9a8100 2024-09-10T05:36:31.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.399+0000 7f07f612d640 1 -- 172.21.15.62:0/250939873 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07e80083f0 con 0x5555fe9a8100 2024-09-10T05:36:31.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.399+0000 7f07f612d640 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b4240 con 0x7f07f0118060 2024-09-10T05:36:31.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.399+0000 7f07f612d640 1 -- 172.21.15.62:0/250939873 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f07e80083f0 con 0x7f07f0118060 2024-09-10T05:36:31.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.399+0000 7f07f612d640 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b4240 con 0x5555fe9ac5b0 2024-09-10T05:36:31.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.399+0000 7f07f592c640 1 -- 172.21.15.62:0/250939873 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07f0115030 con 0x5555fe9ac5b0 2024-09-10T05:36:31.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.399+0000 7f07f592c640 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b4240 con 0x5555fe9afdd0 2024-09-10T05:36:31.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.403+0000 7f07f512b640 1 -- 172.21.15.62:0/250939873 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07ec00d040 con 0x5555fe9afdd0 2024-09-10T05:36:31.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.403+0000 7f07f512b640 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b4240 con 0x5555fe9a8100 2024-09-10T05:36:31.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.403+0000 7f07f612d640 1 -- 172.21.15.62:0/250939873 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07e80083f0 con 0x5555fe9a8100 2024-09-10T05:36:31.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.403+0000 7f07f612d640 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b4240 con 0x5555fe9ac5b0 2024-09-10T05:36:31.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.403+0000 7f07f592c640 1 -- 172.21.15.62:0/250939873 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07f0115030 con 0x5555fe9ac5b0 2024-09-10T05:36:31.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.403+0000 7f07f592c640 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b4240 con 0x5555fe9afdd0 2024-09-10T05:36:31.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.403+0000 7f07f512b640 1 -- 172.21.15.62:0/250939873 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 30 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f07ec00d040 con 0x5555fe9afdd0 2024-09-10T05:36:31.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.403+0000 7f07f512b640 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b4240 con 0x5555fe9a8100 2024-09-10T05:36:31.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.403+0000 7f07f612d640 1 -- 172.21.15.62:0/250939873 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07e80083f0 con 0x5555fe9a8100 2024-09-10T05:36:31.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.403+0000 7f07f612d640 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b4240 con 0x5555fe9a8100 2024-09-10T05:36:31.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.403+0000 7f07f612d640 1 -- 172.21.15.62:0/250939873 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f07e80083f0 con 0x5555fe9a8100 2024-09-10T05:36:31.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.403+0000 7f07f612d640 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b4240 con 0x5555fe9a8100 2024-09-10T05:36:31.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.403+0000 7f07f612d640 1 -- 172.21.15.62:0/250939873 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07e80083f0 con 0x5555fe9a8100 2024-09-10T05:36:31.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.403+0000 7f07f612d640 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b4240 con 0x5555fe9afdd0 2024-09-10T05:36:31.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.403+0000 7f07f512b640 1 -- 172.21.15.62:0/250939873 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07ec00d040 con 0x5555fe9afdd0 2024-09-10T05:36:31.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.403+0000 7f07f512b640 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b4240 con 0x7f07f0118060 2024-09-10T05:36:31.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.403+0000 7f07f612d640 1 -- 172.21.15.62:0/250939873 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07e80083f0 con 0x7f07f0118060 2024-09-10T05:36:31.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.403+0000 7f07f612d640 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b4240 con 0x5555fe9a8100 2024-09-10T05:36:31.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.403+0000 7f07f612d640 1 -- 172.21.15.62:0/250939873 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07e80083f0 con 0x5555fe9a8100 2024-09-10T05:36:31.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.403+0000 7f07f612d640 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b4240 con 0x7f07f0118060 2024-09-10T05:36:31.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.403+0000 7f07f612d640 1 -- 172.21.15.62:0/250939873 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07e80083f0 con 0x7f07f0118060 2024-09-10T05:36:31.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.403+0000 7f07f612d640 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b4240 con 0x5555fe9afdd0 2024-09-10T05:36:31.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.403+0000 7f07f512b640 1 -- 172.21.15.62:0/250939873 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07ec00d040 con 0x5555fe9afdd0 2024-09-10T05:36:31.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.403+0000 7f07f512b640 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b4240 con 0x7f07f0118060 2024-09-10T05:36:31.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.407+0000 7f07f612d640 1 -- 172.21.15.62:0/250939873 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07e80083f0 con 0x7f07f0118060 2024-09-10T05:36:31.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.407+0000 7f07f612d640 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b4240 con 0x5555fe9ac5b0 2024-09-10T05:36:31.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.407+0000 7f07f592c640 1 -- 172.21.15.62:0/250939873 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07f0115030 con 0x5555fe9ac5b0 2024-09-10T05:36:31.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.407+0000 7f07f592c640 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b4240 con 0x5555fe9ac5b0 2024-09-10T05:36:31.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.407+0000 7f07f592c640 1 -- 172.21.15.62:0/250939873 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07f0115030 con 0x5555fe9ac5b0 2024-09-10T05:36:31.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.407+0000 7f07f592c640 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b4240 con 0x5555fe9afdd0 2024-09-10T05:36:31.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.407+0000 7f07f512b640 1 -- 172.21.15.62:0/250939873 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07ec00d040 con 0x5555fe9afdd0 2024-09-10T05:36:31.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.407+0000 7f07f512b640 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b4240 con 0x5555fe9ac5b0 2024-09-10T05:36:31.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.407+0000 7f07f592c640 1 -- 172.21.15.62:0/250939873 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f07f0115030 con 0x5555fe9ac5b0 2024-09-10T05:36:31.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.407+0000 7f07f592c640 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b4240 con 0x5555fe9ac5b0 2024-09-10T05:36:31.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.407+0000 7f07f592c640 1 -- 172.21.15.62:0/250939873 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07f0115030 con 0x5555fe9ac5b0 2024-09-10T05:36:31.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.407+0000 7f07f7e269c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:31.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.407+0000 7f07f7e269c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:31.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.407+0000 7f07f7e269c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:31.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.407+0000 7f07f7e269c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:31.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.407+0000 7f07f7e269c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:31.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.407+0000 7f07f7e269c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:31.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.407+0000 7f07f7e269c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.407+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b3330 con 0x5555fe9a8100 2024-09-10T05:36:31.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.407+0000 7f07f612d640 1 -- 172.21.15.62:0/250939873 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07e80083f0 con 0x5555fe9a8100 2024-09-10T05:36:31.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.407+0000 7f07f7e269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:31.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.407+0000 7f07f7e269c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.407+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b3bd0 con 0x5555fe9ac5b0 2024-09-10T05:36:31.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.411+0000 7f07f592c640 1 -- 172.21.15.62:0/250939873 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f07f0115030 con 0x5555fe9ac5b0 2024-09-10T05:36:31.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.411+0000 7f07f7e269c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:31.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.411+0000 7f07f7e269c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.411+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b2f70 con 0x5555fe9afdd0 2024-09-10T05:36:31.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.411+0000 7f07f512b640 1 -- 172.21.15.62:0/250939873 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f07ec00d040 con 0x5555fe9afdd0 2024-09-10T05:36:31.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.411+0000 7f07f7e269c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:31.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.411+0000 7f07f7e269c0 20 zone default found 2024-09-10T05:36:31.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.411+0000 7f07f7e269c0 4 Realm: () 2024-09-10T05:36:31.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.411+0000 7f07f7e269c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:31.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.411+0000 7f07f7e269c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:31.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.411+0000 7f07f7e269c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:31.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.411+0000 7f07f7e269c0 20 zonegroup default 2024-09-10T05:36:31.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.411+0000 7f07f7e269c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.411+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b4b20 con 0x7f07f0118060 2024-09-10T05:36:31.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.411+0000 7f07f612d640 1 -- 172.21.15.62:0/250939873 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f07e80083f0 con 0x7f07f0118060 2024-09-10T05:36:31.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.411+0000 7f07f7e269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:31.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.411+0000 7f07f7e269c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.411+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b6d60 con 0x5555fe9afdd0 2024-09-10T05:36:31.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.411+0000 7f07f512b640 1 -- 172.21.15.62:0/250939873 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f07ec00d040 con 0x5555fe9afdd0 2024-09-10T05:36:31.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.411+0000 7f07f7e269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:31.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.411+0000 7f07f7e269c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.411+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b7100 con 0x5555fe9afdd0 2024-09-10T05:36:31.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.411+0000 7f07f512b640 1 -- 172.21.15.62:0/250939873 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f07ec00d040 con 0x5555fe9afdd0 2024-09-10T05:36:31.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.411+0000 7f07f7e269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:31.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.411+0000 7f07f7e269c0 20 started sync module instance, tier type = 2024-09-10T05:36:31.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.411+0000 7f07f7e269c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:31.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.411+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b61a0 con 0x5555fe9ac5b0 2024-09-10T05:36:31.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.415+0000 7f07f592c640 1 -- 172.21.15.62:0/250939873 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07f0115030 con 0x5555fe9ac5b0 2024-09-10T05:36:31.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.415+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93827832178112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b61a0 con 0x5555fe9ac5b0 2024-09-10T05:36:31.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.415+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b79c0 con 0x5555fe9a8100 2024-09-10T05:36:31.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.415+0000 7f07f612d640 1 -- 172.21.15.62:0/250939873 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07e80083f0 con 0x5555fe9a8100 2024-09-10T05:36:31.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.415+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93827832182032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b8210 con 0x5555fe9a8100 2024-09-10T05:36:31.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.415+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b8a60 con 0x5555fe9ac5b0 2024-09-10T05:36:31.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.415+0000 7f07f592c640 1 -- 172.21.15.62:0/250939873 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 93827832178112] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07f0115030 con 0x5555fe9ac5b0 2024-09-10T05:36:31.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.419+0000 7f07f612d640 1 -- 172.21.15.62:0/250939873 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93827832182032] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07e80083f0 con 0x5555fe9a8100 2024-09-10T05:36:31.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.419+0000 7f07f592c640 1 -- 172.21.15.62:0/250939873 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07f0115030 con 0x5555fe9ac5b0 2024-09-10T05:36:31.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.419+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93827832184160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b8630 con 0x5555fe9ac5b0 2024-09-10T05:36:31.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.419+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b9300 con 0x7f07f0118060 2024-09-10T05:36:31.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.419+0000 7f07f612d640 1 -- 172.21.15.62:0/250939873 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07e80083f0 con 0x7f07f0118060 2024-09-10T05:36:31.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.419+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93827832188496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b8630 con 0x7f07f0118060 2024-09-10T05:36:31.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.419+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b9dd0 con 0x5555fe9ac5b0 2024-09-10T05:36:31.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.419+0000 7f07f592c640 1 -- 172.21.15.62:0/250939873 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93827832184160] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07f0115030 con 0x5555fe9ac5b0 2024-09-10T05:36:31.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.423+0000 7f07f612d640 1 -- 172.21.15.62:0/250939873 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93827832188496] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07e80083f0 con 0x7f07f0118060 2024-09-10T05:36:31.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.423+0000 7f07f592c640 1 -- 172.21.15.62:0/250939873 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07f0115030 con 0x5555fe9ac5b0 2024-09-10T05:36:31.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.423+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93827832191168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b8180 con 0x5555fe9ac5b0 2024-09-10T05:36:31.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.423+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9ba670 con 0x5555fe9afdd0 2024-09-10T05:36:31.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.423+0000 7f07f512b640 1 -- 172.21.15.62:0/250939873 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07ec00d040 con 0x5555fe9afdd0 2024-09-10T05:36:31.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.423+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93827832193472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b8180 con 0x5555fe9afdd0 2024-09-10T05:36:31.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.423+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9bb0b0 con 0x5555fe9afdd0 2024-09-10T05:36:31.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.423+0000 7f07f592c640 1 -- 172.21.15.62:0/250939873 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 93827832191168] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07f0115030 con 0x5555fe9ac5b0 2024-09-10T05:36:31.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.427+0000 7f07f512b640 1 -- 172.21.15.62:0/250939873 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93827832193472] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07ec00d040 con 0x5555fe9afdd0 2024-09-10T05:36:31.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.427+0000 7f07f512b640 1 -- 172.21.15.62:0/250939873 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07ec00d040 con 0x5555fe9afdd0 2024-09-10T05:36:31.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.427+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93827832194528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9bac00 con 0x5555fe9afdd0 2024-09-10T05:36:31.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.427+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9bb950 con 0x7f07f0118060 2024-09-10T05:36:31.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.431+0000 7f07f512b640 1 -- 172.21.15.62:0/250939873 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93827832194528] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07ec00d040 con 0x5555fe9afdd0 2024-09-10T05:36:31.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.431+0000 7f07f612d640 1 -- 172.21.15.62:0/250939873 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07e80083f0 con 0x7f07f0118060 2024-09-10T05:36:31.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.431+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93827832189552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9bac00 con 0x7f07f0118060 2024-09-10T05:36:31.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.431+0000 7f07f7e269c0 20 add_watcher() i=0 2024-09-10T05:36:31.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.431+0000 7f07f7e269c0 20 add_watcher() i=1 2024-09-10T05:36:31.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.431+0000 7f07f7e269c0 20 add_watcher() i=2 2024-09-10T05:36:31.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.431+0000 7f07f7e269c0 20 add_watcher() i=3 2024-09-10T05:36:31.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.431+0000 7f07f7e269c0 20 add_watcher() i=4 2024-09-10T05:36:31.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.431+0000 7f07f7e269c0 20 add_watcher() i=5 2024-09-10T05:36:31.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.431+0000 7f07f7e269c0 20 add_watcher() i=6 2024-09-10T05:36:31.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.435+0000 7f07f612d640 1 -- 172.21.15.62:0/250939873 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93827832189552] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07e80083f0 con 0x7f07f0118060 2024-09-10T05:36:31.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.435+0000 7f07f7e269c0 20 add_watcher() i=7 2024-09-10T05:36:31.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.435+0000 7f07f7e269c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:31.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.435+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9be9b0 con 0x5555fe9a8100 2024-09-10T05:36:31.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.435+0000 7f07f612d640 1 -- 172.21.15.62:0/250939873 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f07e80083f0 con 0x5555fe9a8100 2024-09-10T05:36:31.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.435+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93827832198304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9bbf00 con 0x5555fe9a8100 2024-09-10T05:36:31.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.435+0000 7f07f612d640 1 -- 172.21.15.62:0/250939873 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93827832198304] v30'62 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f07e80083f0 con 0x5555fe9a8100 2024-09-10T05:36:31.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.439+0000 7f06a77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:31.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.439+0000 7f07f7e269c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:31.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.439+0000 7f07f7e269c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:31.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.439+0000 7f07f7e269c0 5 note: GC not initialized 2024-09-10T05:36:31.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.439+0000 7f06a67fc640 20 reqs_thread_entry: start 2024-09-10T05:36:31.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.439+0000 7f07f7e269c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:31.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.439+0000 7f07f7e269c0 20 Filter name: none 2024-09-10T05:36:31.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.439+0000 7f061bfff640 20 reqs_thread_entry: start 2024-09-10T05:36:31.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.439+0000 7f07f7e269c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T05:36:31.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.439+0000 7f07f7e269c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.439+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9e1c60 con 0x5555fe9a8100 2024-09-10T05:36:31.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.439+0000 7f07f612d640 1 -- 172.21.15.62:0/250939873 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f07e80083f0 con 0x5555fe9a8100 2024-09-10T05:36:31.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.439+0000 7f07f7e269c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:36:31.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.439+0000 7f07f7e269c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T05:36:31.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.439+0000 7f07f7e269c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:36:31.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.439+0000 7f07f7e269c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:36:31.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.439+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9e46f0 con 0x7f07f0118060 2024-09-10T05:36:31.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.439+0000 7f07f612d640 1 -- 172.21.15.62:0/250939873 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f07e80083f0 con 0x7f07f0118060 2024-09-10T05:36:31.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.439+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9e7d30 con 0x5555fe9a8100 2024-09-10T05:36:31.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.439+0000 7f07f612d640 1 -- 172.21.15.62:0/250939873 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v30'2 uv2 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f07e80083f0 con 0x5555fe9a8100 2024-09-10T05:36:31.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.439+0000 7f07f7e269c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:36:31.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.439+0000 7f07f7e269c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:36:31.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.439+0000 7f07f7e269c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T05:36:31.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.439+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 93827832379328 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9e36e0 con 0x5555fe9ac5b0 2024-09-10T05:36:31.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.443+0000 7f07f592c640 1 -- 172.21.15.62:0/250939873 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== watch-notify(notify (1) cookie 93827832191168 notify 128849018881 ret 0) ==== 609+0+0 (crc 0 0 0) 0x5555fe98a490 con 0x5555fe9ac5b0 2024-09-10T05:36:31.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.443+0000 7f06d97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018881 cookie 93827832191168 notifier 4311 bl.length()=567 2024-09-10T05:36:31.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.443+0000 7f06d97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:36:31.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.443+0000 7f06d97fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:36:31.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.443+0000 7f06d97fa640 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f06b8003eb0 con 0x5555fe9ac5b0 2024-09-10T05:36:31.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.443+0000 7f07f592c640 1 -- 172.21.15.62:0/250939873 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(65 notify.4 [notify cookie 93827832379328 out=8b] v0'0 uv33 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f07f0115030 con 0x5555fe9ac5b0 2024-09-10T05:36:31.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.443+0000 7f07f592c640 1 -- 172.21.15.62:0/250939873 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07f0115030 con 0x5555fe9ac5b0 2024-09-10T05:36:31.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.443+0000 7f07f592c640 1 -- 172.21.15.62:0/250939873 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== watch-notify(notify_complete (2) cookie 93827832379328 notify 128849018881 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f07f00e8040 con 0x5555fe9ac5b0 2024-09-10T05:36:31.446 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T05:36:30.893777Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:36:30.893760Z","tags":[],"group_ids":[]} 2024-09-10T05:36:31.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.443+0000 7f06a77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:31.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.443+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93827832198304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9e0a70 con 0x5555fe9a8100 2024-09-10T05:36:31.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.447+0000 7f07f612d640 1 -- 172.21.15.62:0/250939873 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 93827832198304] v30'63 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f07e80083f0 con 0x5555fe9a8100 2024-09-10T05:36:31.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.447+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93827832178112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9bb4a0 con 0x5555fe9ac5b0 2024-09-10T05:36:31.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.447+0000 7f07f592c640 1 -- 172.21.15.62:0/250939873 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 93827832178112] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07f0115030 con 0x5555fe9ac5b0 2024-09-10T05:36:31.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.447+0000 7f07f7e269c0 20 remove_watcher() i=0 2024-09-10T05:36:31.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.447+0000 7f07f7e269c0 2 removed watcher, disabling cache 2024-09-10T05:36:31.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.447+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93827832182032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b65c0 con 0x5555fe9a8100 2024-09-10T05:36:31.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.447+0000 7f07f612d640 1 -- 172.21.15.62:0/250939873 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 93827832182032] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07e80083f0 con 0x5555fe9a8100 2024-09-10T05:36:31.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.447+0000 7f07f7e269c0 20 remove_watcher() i=1 2024-09-10T05:36:31.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.447+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93827832184160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b65c0 con 0x5555fe9ac5b0 2024-09-10T05:36:31.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.451+0000 7f07f592c640 1 -- 172.21.15.62:0/250939873 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 93827832184160] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07f0115030 con 0x5555fe9ac5b0 2024-09-10T05:36:31.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.451+0000 7f07f7e269c0 20 remove_watcher() i=2 2024-09-10T05:36:31.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.451+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93827832188496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b65c0 con 0x7f07f0118060 2024-09-10T05:36:31.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.455+0000 7f07f612d640 1 -- 172.21.15.62:0/250939873 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 93827832188496] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07e80083f0 con 0x7f07f0118060 2024-09-10T05:36:31.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.455+0000 7f07f7e269c0 20 remove_watcher() i=3 2024-09-10T05:36:31.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.455+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93827832191168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b8e50 con 0x5555fe9ac5b0 2024-09-10T05:36:31.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.455+0000 7f07f592c640 1 -- 172.21.15.62:0/250939873 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 93827832191168] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07f0115030 con 0x5555fe9ac5b0 2024-09-10T05:36:31.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.455+0000 7f07f7e269c0 20 remove_watcher() i=4 2024-09-10T05:36:31.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.455+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93827832193472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b65c0 con 0x5555fe9afdd0 2024-09-10T05:36:31.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.459+0000 7f07f512b640 1 -- 172.21.15.62:0/250939873 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 93827832193472] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07ec00d040 con 0x5555fe9afdd0 2024-09-10T05:36:31.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.459+0000 7f07f7e269c0 20 remove_watcher() i=5 2024-09-10T05:36:31.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.459+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93827832194528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b98c0 con 0x5555fe9afdd0 2024-09-10T05:36:31.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.459+0000 7f07f512b640 1 -- 172.21.15.62:0/250939873 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 93827832194528] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07ec00d040 con 0x5555fe9afdd0 2024-09-10T05:36:31.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.459+0000 7f07f7e269c0 20 remove_watcher() i=6 2024-09-10T05:36:31.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.459+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93827832189552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555fe9b8e50 con 0x7f07f0118060 2024-09-10T05:36:31.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.459+0000 7f07f612d640 1 -- 172.21.15.62:0/250939873 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 93827832189552] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07e80083f0 con 0x7f07f0118060 2024-09-10T05:36:31.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.459+0000 7f07f7e269c0 20 remove_watcher() i=7 2024-09-10T05:36:31.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.459+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5555fe9ac5b0 msgr2=0x5555fe9ae9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.459+0000 7f07f7e269c0 1 --2- 172.21.15.62:0/250939873 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5555fe9ac5b0 0x5555fe9ae9a0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.459+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5555fe9a8100 msgr2=0x5555fe9aa5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.459+0000 7f07f7e269c0 1 --2- 172.21.15.62:0/250939873 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5555fe9a8100 0x5555fe9aa5c0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.459+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f07f0118060 msgr2=0x7f07f00e26b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.459+0000 7f07f7e269c0 1 --2- 172.21.15.62:0/250939873 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f07f0118060 0x7f07f00e26b0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.459+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5555fe9afdd0 msgr2=0x5555fe9b21e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.459+0000 7f07f7e269c0 1 --2- 172.21.15.62:0/250939873 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5555fe9afdd0 0x5555fe9b21e0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.463+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f06c0039ac0 msgr2=0x7f06c003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.463+0000 7f07f7e269c0 1 --2- 172.21.15.62:0/250939873 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f06c0039ac0 0x7f06c003bf80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x5555fe97b7e0 tx=0x7f07ec011000 comp rx=0 tx=0).stop 2024-09-10T05:36:31.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.463+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555fe995fe0 msgr2=0x5555fe99d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.463+0000 7f07f7e269c0 1 --2- 172.21.15.62:0/250939873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555fe995fe0 0x5555fe99d2c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f07f00ac010 tx=0x7f07f00edea0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.463+0000 7f07f612d640 1 -- 172.21.15.62:0/250939873 reap_dead start 2024-09-10T05:36:31.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.463+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 shutdown_connections 2024-09-10T05:36:31.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.463+0000 7f07f7e269c0 1 --2- 172.21.15.62:0/250939873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555fe995fe0 0x5555fe99d2c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.463+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 >> 172.21.15.62:0/250939873 conn(0x5555fe992410 msgr2=0x5555fe990620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:31.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.463+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 shutdown_connections 2024-09-10T05:36:31.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.463+0000 7f07f7e269c0 1 -- 172.21.15.62:0/250939873 wait complete. 2024-09-10T05:36:31.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.463+0000 7f07f7e269c0 1 -- 172.21.15.62:0/571588496 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f06d0039ac0 msgr2=0x7f06d003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.463+0000 7f07f7e269c0 1 --2- 172.21.15.62:0/571588496 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f06d0039ac0 0x7f06d003bf80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x5555fe96d1b0 tx=0x7f07ec006000 comp rx=0 tx=0).stop 2024-09-10T05:36:31.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.463+0000 7f07f7e269c0 1 -- 172.21.15.62:0/571588496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555fe989a30 msgr2=0x5555fe989e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.463+0000 7f07f7e269c0 1 --2- 172.21.15.62:0/571588496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555fe989a30 0x5555fe989e50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f07f00e95c0 tx=0x7f07f00c76c0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.463+0000 7f07f7e269c0 1 -- 172.21.15.62:0/571588496 shutdown_connections 2024-09-10T05:36:31.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.463+0000 7f07f7e269c0 1 --2- 172.21.15.62:0/571588496 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f06d0039ac0 0x7f06d003bf80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.463+0000 7f07f7e269c0 1 --2- 172.21.15.62:0/571588496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555fe989a30 0x5555fe989e50 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.463+0000 7f07f7e269c0 1 -- 172.21.15.62:0/571588496 >> 172.21.15.62:0/571588496 conn(0x5555fe97f3e0 msgr2=0x5555fe97f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:31.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.463+0000 7f07f7e269c0 1 -- 172.21.15.62:0/571588496 shutdown_connections 2024-09-10T05:36:31.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.463+0000 7f07f7e269c0 1 -- 172.21.15.62:0/571588496 wait complete. 2024-09-10T05:36:31.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.463+0000 7f07f7e269c0 1 -- 172.21.15.62:0/4205856280 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5555fe974170 msgr2=0x5555fe976560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.463+0000 7f07f7e269c0 1 --2- 172.21.15.62:0/4205856280 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5555fe974170 0x5555fe976560 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.463+0000 7f07f7e269c0 1 -- 172.21.15.62:0/4205856280 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5555fe87c340 msgr2=0x5555fe972ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.463+0000 7f07f7e269c0 1 --2- 172.21.15.62:0/4205856280 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5555fe87c340 0x5555fe972ed0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.463+0000 7f07f7e269c0 1 -- 172.21.15.62:0/4205856280 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5555fe978930 msgr2=0x5555fe97ad20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.463+0000 7f07f7e269c0 1 --2- 172.21.15.62:0/4205856280 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5555fe978930 0x5555fe97ad20 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.463+0000 7f07f7e269c0 1 -- 172.21.15.62:0/4205856280 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f06dc039a70 msgr2=0x7f06dc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.463+0000 7f07f7e269c0 1 --2- 172.21.15.62:0/4205856280 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f06dc039a70 0x7f06dc03bf30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f07ec001e60 tx=0x7f07ec0013e0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.463+0000 7f07f7e269c0 1 -- 172.21.15.62:0/4205856280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555fe879200 msgr2=0x5555fe96bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.463+0000 7f07f7e269c0 1 --2- 172.21.15.62:0/4205856280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5555fe879200 0x5555fe96bd60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f07f0018cc0 tx=0x7f07f0017e30 comp rx=0 tx=0).stop 2024-09-10T05:36:31.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.463+0000 7f07f612d640 1 -- 172.21.15.62:0/4205856280 reap_dead start 2024-09-10T05:36:31.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.463+0000 7f07f7e269c0 1 -- 172.21.15.62:0/4205856280 shutdown_connections 2024-09-10T05:36:31.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.463+0000 7f07f7e269c0 1 -- 172.21.15.62:0/4205856280 >> 172.21.15.62:0/4205856280 conn(0x5555fe7ecb10 msgr2=0x5555fe95efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:31.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.463+0000 7f07f7e269c0 1 -- 172.21.15.62:0/4205856280 shutdown_connections 2024-09-10T05:36:31.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.463+0000 7f07f7e269c0 1 -- 172.21.15.62:0/4205856280 wait complete. 2024-09-10T05:36:31.477 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T05:36:30.893777Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:36:30.893760Z', 'tags': [], 'group_ids': []} 2024-09-10T05:36:31.477 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-10T05:36:31.478 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-10T05:36:31.478 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-10T05:36:31.563 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:31.563 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:31.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.559+0000 7ffb3a07b9c0 1 Processor -- start 2024-09-10T05:36:31.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.559+0000 7ffb3a07b9c0 1 -- start start 2024-09-10T05:36:31.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.563+0000 7ffb3a07b9c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x562b34b5de00 0x562b34b5e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.563+0000 7ffb3a07b9c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562b34a139c0 con 0x562b34b60fe0 2024-09-10T05:36:31.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.563+0000 7ffb3a07b9c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x562b34a636d0 con 0x562b34b5de00 2024-09-10T05:36:31.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.563+0000 7ffb37b81640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x562b34b5de00 0x562b34b5e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.563+0000 7ffb37b81640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x562b34b5de00 0x562b34b5e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51404/0 (socket says 172.21.15.62:51404) 2024-09-10T05:36:31.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.563+0000 7ffb37380640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x562b34b60fe0 0x562b34b633d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:38504/0 (socket says 172.21.15.62:38504) 2024-09-10T05:36:31.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.563+0000 7ffb37b81640 1 -- 172.21.15.62:0/1776851338 learned_addr learned my addr 172.21.15.62:0/1776851338 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:31.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.563+0000 7ffb37b81640 1 -- 172.21.15.62:0/1776851338 >> v1:172.21.15.2:6789/0 conn(0x562b34b60fe0 legacy=0x562b34b633d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.563+0000 7ffb37b81640 1 -- 172.21.15.62:0/1776851338 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b34a07ca0 con 0x562b34b5de00 2024-09-10T05:36:31.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.563+0000 7ffb37b81640 1 --2- 172.21.15.62:0/1776851338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b34b5de00 0x562b34b5e1e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ffb3000a4e0 tx=0x7ffb3001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94421938ae07a4b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.563+0000 7ffb36b7f640 1 -- 172.21.15.62:0/1776851338 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb300aa540 con 0x562b34b5de00 2024-09-10T05:36:31.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.563+0000 7ffb36b7f640 1 -- 172.21.15.62:0/1776851338 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb300aa6e0 con 0x562b34b5de00 2024-09-10T05:36:31.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.563+0000 7ffb36b7f640 1 -- 172.21.15.62:0/1776851338 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb300aaa40 con 0x562b34b5de00 2024-09-10T05:36:31.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.567+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/1776851338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b34b5de00 msgr2=0x562b34b5e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.567+0000 7ffb3a07b9c0 1 --2- 172.21.15.62:0/1776851338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b34b5de00 0x562b34b5e1e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ffb3000a4e0 tx=0x7ffb3001b090 comp rx=0 tx=0).stop 2024-09-10T05:36:31.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.567+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/1776851338 shutdown_connections 2024-09-10T05:36:31.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.567+0000 7ffb3a07b9c0 1 --2- 172.21.15.62:0/1776851338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b34b5de00 0x562b34b5e1e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.567+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/1776851338 >> 172.21.15.62:0/1776851338 conn(0x562b34b59920 msgr2=0x562b34b5bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:31.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.567+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/1776851338 shutdown_connections 2024-09-10T05:36:31.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.567+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/1776851338 wait complete. 2024-09-10T05:36:31.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.583+0000 7ffb3a07b9c0 1 Processor -- start 2024-09-10T05:36:31.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.583+0000 7ffb3a07b9c0 1 -- start start 2024-09-10T05:36:31.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.583+0000 7ffb3a07b9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b34b5de00 0x562b34c4a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.583+0000 7ffb3a07b9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562b34a67680 con 0x562b34b5de00 2024-09-10T05:36:31.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.583+0000 7ffb37b81640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b34b5de00 0x562b34c4a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.583+0000 7ffb37b81640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b34b5de00 0x562b34c4a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51420/0 (socket says 172.21.15.62:51420) 2024-09-10T05:36:31.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.583+0000 7ffb37b81640 1 -- 172.21.15.62:0/4217956978 learned_addr learned my addr 172.21.15.62:0/4217956978 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:31.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.583+0000 7ffb37b81640 1 -- 172.21.15.62:0/4217956978 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b349e2da0 con 0x562b34b5de00 2024-09-10T05:36:31.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.583+0000 7ffb37b81640 1 --2- 172.21.15.62:0/4217956978 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b34b5de00 0x562b34c4a860 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ffb30019740 tx=0x7ffb300033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=317da055175c8da2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.583+0000 7ffa25e0b640 1 -- 172.21.15.62:0/4217956978 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb300b9070 con 0x562b34b5de00 2024-09-10T05:36:31.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.583+0000 7ffa25e0b640 1 -- 172.21.15.62:0/4217956978 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb300aaa90 con 0x562b34b5de00 2024-09-10T05:36:31.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.583+0000 7ffa25e0b640 1 -- 172.21.15.62:0/4217956978 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb300aad70 con 0x562b34b5de00 2024-09-10T05:36:31.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.583+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/4217956978 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b34b5de00 msgr2=0x562b34c4a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.583+0000 7ffb3a07b9c0 1 --2- 172.21.15.62:0/4217956978 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b34b5de00 0x562b34c4a860 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ffb30019740 tx=0x7ffb300033b0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.583+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/4217956978 shutdown_connections 2024-09-10T05:36:31.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.583+0000 7ffb3a07b9c0 1 --2- 172.21.15.62:0/4217956978 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b34b5de00 0x562b34c4a860 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.583+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/4217956978 >> 172.21.15.62:0/4217956978 conn(0x562b34b59920 msgr2=0x562b34c45170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:31.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.583+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/4217956978 shutdown_connections 2024-09-10T05:36:31.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.583+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/4217956978 wait complete. 2024-09-10T05:36:31.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.583+0000 7ffb3a07b9c0 1 Processor -- start 2024-09-10T05:36:31.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.583+0000 7ffb3a07b9c0 1 -- start start 2024-09-10T05:36:31.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.583+0000 7ffb3a07b9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b34b5de00 0x562b34c53d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.583+0000 7ffb3a07b9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562b34a09a50 con 0x562b34b5de00 2024-09-10T05:36:31.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.583+0000 7ffb37b81640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b34b5de00 0x562b34c53d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.583+0000 7ffb37b81640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b34b5de00 0x562b34c53d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51422/0 (socket says 172.21.15.62:51422) 2024-09-10T05:36:31.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.583+0000 7ffb37b81640 1 -- 172.21.15.62:0/2361507695 learned_addr learned my addr 172.21.15.62:0/2361507695 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:31.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.587+0000 7ffb37b81640 1 -- 172.21.15.62:0/2361507695 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b34c542a0 con 0x562b34b5de00 2024-09-10T05:36:31.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.587+0000 7ffb37b81640 1 --2- 172.21.15.62:0/2361507695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b34b5de00 0x562b34c53d40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ffb30018cc0 tx=0x7ffb30017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.587+0000 7ffa1ffff640 1 -- 172.21.15.62:0/2361507695 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb300b9070 con 0x562b34b5de00 2024-09-10T05:36:31.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.587+0000 7ffa1ffff640 1 -- 172.21.15.62:0/2361507695 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb300b5b10 con 0x562b34b5de00 2024-09-10T05:36:31.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.587+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2361507695 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562b34c54530 con 0x562b34b5de00 2024-09-10T05:36:31.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.587+0000 7ffa1ffff640 1 -- 172.21.15.62:0/2361507695 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb300b5df0 con 0x562b34b5de00 2024-09-10T05:36:31.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.587+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2361507695 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b34c54ee0 con 0x562b34b5de00 2024-09-10T05:36:31.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.587+0000 7ffa1ffff640 1 -- 172.21.15.62:0/2361507695 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ffb300b3040 con 0x562b34b5de00 2024-09-10T05:36:31.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.587+0000 7ffa1ffff640 1 --2- 172.21.15.62:0/2361507695 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ffa20039b10 0x7ffa2003bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.587+0000 7ffa1ffff640 1 -- 172.21.15.62:0/2361507695 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7ffb300c4070 con 0x562b34b5de00 2024-09-10T05:36:31.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.587+0000 7ffb37380640 1 --2- 172.21.15.62:0/2361507695 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ffa20039b10 0x7ffa2003bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.587+0000 7ffb3a07b9c0 1 --2- 172.21.15.62:0/2361507695 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x562b34b60fe0 0x562b34c5aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.587+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2361507695 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562b34c5b3f0 con 0x562b34b60fe0 2024-09-10T05:36:31.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.587+0000 7ffb38382640 1 --2- 172.21.15.62:0/2361507695 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x562b34b60fe0 0x562b34c5aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.587+0000 7ffb37380640 1 --2- 172.21.15.62:0/2361507695 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ffa20039b10 0x7ffa2003bfd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c001e90 tx=0x7ffb2c0013f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.587+0000 7ffb38382640 1 --2- 172.21.15.62:0/2361507695 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x562b34b60fe0 0x562b34c5aeb0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.591+0000 7ffb38382640 1 -- 172.21.15.62:0/2361507695 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb280083f0 con 0x562b34b60fe0 2024-09-10T05:36:31.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.591+0000 7ffb3a07b9c0 1 --2- 172.21.15.62:0/2361507695 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x562b34c5bec0 0x562b34c5e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.591+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2361507695 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562b34c5eaf0 con 0x562b34c5bec0 2024-09-10T05:36:31.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.591+0000 7ffb37b81640 1 --2- 172.21.15.62:0/2361507695 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x562b34c5bec0 0x562b34c5e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.591+0000 7ffb37b81640 1 --2- 172.21.15.62:0/2361507695 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x562b34c5bec0 0x562b34c5e380 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.591+0000 7ffb37b81640 1 -- 172.21.15.62:0/2361507695 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffb300c6d80 con 0x562b34c5bec0 2024-09-10T05:36:31.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.591+0000 7ffb3a07b9c0 1 --2- 172.21.15.62:0/2361507695 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x562b34c608b0 0x562b34c62ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.591+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2361507695 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562b34c63370 con 0x562b34c608b0 2024-09-10T05:36:31.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.591+0000 7ffb37380640 1 --2- 172.21.15.62:0/2361507695 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x562b34c608b0 0x562b34c62ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.591+0000 7ffb37380640 1 --2- 172.21.15.62:0/2361507695 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x562b34c608b0 0x562b34c62ca0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.591+0000 7ffb37380640 1 -- 172.21.15.62:0/2361507695 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ffb2c00f6e0 con 0x562b34c608b0 2024-09-10T05:36:31.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.591+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2361507695 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562b34c5f750 con 0x562b34c5bec0 2024-09-10T05:36:31.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.591+0000 7ffb37b81640 1 -- 172.21.15.62:0/2361507695 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffb300c6d80 con 0x562b34c5bec0 2024-09-10T05:36:31.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.591+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2361507695 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562b34c5fbb0 con 0x562b34c608b0 2024-09-10T05:36:31.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.591+0000 7ffb37380640 1 -- 172.21.15.62:0/2361507695 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ffb2c00f6e0 con 0x562b34c608b0 2024-09-10T05:36:31.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.595+0000 7ffb3a07b9c0 1 Processor -- start 2024-09-10T05:36:31.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.595+0000 7ffb3a07b9c0 1 -- start start 2024-09-10T05:36:31.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.595+0000 7ffb3a07b9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b34c71a00 0x562b34c71e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.595+0000 7ffb3a07b9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562b34a74450 con 0x562b34c71a00 2024-09-10T05:36:31.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.595+0000 7ffb37b81640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b34c71a00 0x562b34c71e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.595+0000 7ffb37b81640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b34c71a00 0x562b34c71e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51426/0 (socket says 172.21.15.62:51426) 2024-09-10T05:36:31.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.595+0000 7ffb37b81640 1 -- 172.21.15.62:0/1280171008 learned_addr learned my addr 172.21.15.62:0/1280171008 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:31.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.595+0000 7ffb37b81640 1 -- 172.21.15.62:0/1280171008 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b34c72460 con 0x562b34c71a00 2024-09-10T05:36:31.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.595+0000 7ffb37b81640 1 --2- 172.21.15.62:0/1280171008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b34c71a00 0x562b34c71e20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ffb300ac010 tx=0x7ffb300c7960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.595+0000 7ffa1d7fa640 1 -- 172.21.15.62:0/1280171008 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb300bd7f0 con 0x562b34c71a00 2024-09-10T05:36:31.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.595+0000 7ffa1d7fa640 1 -- 172.21.15.62:0/1280171008 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb300bd990 con 0x562b34c71a00 2024-09-10T05:36:31.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.595+0000 7ffa1d7fa640 1 -- 172.21.15.62:0/1280171008 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb300b3480 con 0x562b34c71a00 2024-09-10T05:36:31.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.595+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/1280171008 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562b34c72cc0 con 0x562b34c71a00 2024-09-10T05:36:31.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.595+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/1280171008 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b34c73230 con 0x562b34c71a00 2024-09-10T05:36:31.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.595+0000 7ffa1d7fa640 1 -- 172.21.15.62:0/1280171008 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ffb300b3620 con 0x562b34c71a00 2024-09-10T05:36:31.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.595+0000 7ffa1d7fa640 1 --2- 172.21.15.62:0/1280171008 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ffa10039a70 0x7ffa1003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.595+0000 7ffa1d7fa640 1 -- 172.21.15.62:0/1280171008 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7ffb300e1070 con 0x562b34c71a00 2024-09-10T05:36:31.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.595+0000 7ffb37380640 1 --2- 172.21.15.62:0/1280171008 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ffa10039a70 0x7ffa1003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.595+0000 7ffb3a07b9c0 1 Processor -- start 2024-09-10T05:36:31.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.595+0000 7ffb3a07b9c0 1 -- start start 2024-09-10T05:36:31.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.599+0000 7ffb3a07b9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b34c7e190 0x562b34c7e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.599+0000 7ffb3a07b9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562b34c4aff0 con 0x562b34c7e190 2024-09-10T05:36:31.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.599+0000 7ffb37380640 1 --2- 172.21.15.62:0/1280171008 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ffa10039a70 0x7ffa1003bf30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x562b34c55ec0 tx=0x7ffb2c00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.599+0000 7ffb37b81640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b34c7e190 0x562b34c7e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.599+0000 7ffb37b81640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b34c7e190 0x562b34c7e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51438/0 (socket says 172.21.15.62:51438) 2024-09-10T05:36:31.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.599+0000 7ffb37b81640 1 -- 172.21.15.62:0/1327018896 learned_addr learned my addr 172.21.15.62:0/1327018896 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:31.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.599+0000 7ffb37b81640 1 -- 172.21.15.62:0/1327018896 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b34c7eb40 con 0x562b34c7e190 2024-09-10T05:36:31.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.599+0000 7ffb37b81640 1 --2- 172.21.15.62:0/1327018896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b34c7e190 0x562b34c7e570 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ffb300c6a90 tx=0x7ffb300e3c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=785f0c55eecb5693 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.599+0000 7ffa16ffd640 1 -- 172.21.15.62:0/1327018896 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb300fc070 con 0x562b34c7e190 2024-09-10T05:36:31.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.599+0000 7ffa16ffd640 1 -- 172.21.15.62:0/1327018896 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb300b44d0 con 0x562b34c7e190 2024-09-10T05:36:31.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.599+0000 7ffa16ffd640 1 -- 172.21.15.62:0/1327018896 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb300e82e0 con 0x562b34c7e190 2024-09-10T05:36:31.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.599+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/1327018896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b34c7e190 msgr2=0x562b34c7e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.599+0000 7ffb3a07b9c0 1 --2- 172.21.15.62:0/1327018896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b34c7e190 0x562b34c7e570 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ffb300c6a90 tx=0x7ffb300e3c40 comp rx=0 tx=0).stop 2024-09-10T05:36:31.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.599+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/1327018896 shutdown_connections 2024-09-10T05:36:31.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.599+0000 7ffb3a07b9c0 1 --2- 172.21.15.62:0/1327018896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b34c7e190 0x562b34c7e570 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.599+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/1327018896 >> 172.21.15.62:0/1327018896 conn(0x562b34c7a5c0 msgr2=0x562b34c78800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:31.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.599+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/1327018896 shutdown_connections 2024-09-10T05:36:31.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.599+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/1327018896 wait complete. 2024-09-10T05:36:31.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.599+0000 7ffb3a07b9c0 1 Processor -- start 2024-09-10T05:36:31.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.599+0000 7ffb3a07b9c0 1 -- start start 2024-09-10T05:36:31.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.599+0000 7ffb3a07b9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b34c7e190 0x562b34c854d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.599+0000 7ffb3a07b9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562b34c7f020 con 0x562b34c7e190 2024-09-10T05:36:31.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.599+0000 7ffb37b81640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b34c7e190 0x562b34c854d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.599+0000 7ffb37b81640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b34c7e190 0x562b34c854d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51444/0 (socket says 172.21.15.62:51444) 2024-09-10T05:36:31.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.599+0000 7ffb37b81640 1 -- 172.21.15.62:0/2628859590 learned_addr learned my addr 172.21.15.62:0/2628859590 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:31.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.599+0000 7ffb37b81640 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b34c85a30 con 0x562b34c7e190 2024-09-10T05:36:31.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.599+0000 7ffb37b81640 1 --2- 172.21.15.62:0/2628859590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b34c7e190 0x562b34c854d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ffb300b49f0 tx=0x7ffb300b4980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.603+0000 7ffa157fa640 1 -- 172.21.15.62:0/2628859590 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb30107020 con 0x562b34c7e190 2024-09-10T05:36:31.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.603+0000 7ffa157fa640 1 -- 172.21.15.62:0/2628859590 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb300fd040 con 0x562b34c7e190 2024-09-10T05:36:31.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.603+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562b34c85a30 con 0x562b34c7e190 2024-09-10T05:36:31.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.603+0000 7ffa157fa640 1 -- 172.21.15.62:0/2628859590 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb300fc070 con 0x562b34c7e190 2024-09-10T05:36:31.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.603+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b34c85ea0 con 0x562b34c7e190 2024-09-10T05:36:31.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.603+0000 7ffb3a07b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.603+0000 7ffa157fa640 1 -- 172.21.15.62:0/2628859590 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ffb3010a020 con 0x562b34c7e190 2024-09-10T05:36:31.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.603+0000 7ffa157fa640 1 --2- 172.21.15.62:0/2628859590 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ffa000399d0 0x7ffa0003be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.603+0000 7ffa157fa640 1 -- 172.21.15.62:0/2628859590 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7ffb3010dab0 con 0x562b34c7e190 2024-09-10T05:36:31.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.603+0000 7ffb37380640 1 --2- 172.21.15.62:0/2628859590 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ffa000399d0 0x7ffa0003be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.603+0000 7ffb3a07b9c0 1 --2- 172.21.15.62:0/2628859590 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x562b34c902e0 0x562b34c92770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.603+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562b34c92ec0 con 0x562b34c902e0 2024-09-10T05:36:31.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.603+0000 7ffb38382640 1 --2- 172.21.15.62:0/2628859590 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x562b34c902e0 0x562b34c92770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.603+0000 7ffb38382640 1 --2- 172.21.15.62:0/2628859590 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x562b34c902e0 0x562b34c92770 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.603+0000 7ffb37380640 1 --2- 172.21.15.62:0/2628859590 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ffa000399d0 0x7ffa0003be90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x562b34c5f720 tx=0x7ffb2c010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.603+0000 7ffb38382640 1 -- 172.21.15.62:0/2628859590 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb280083f0 con 0x562b34c902e0 2024-09-10T05:36:31.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.603+0000 7ffb3a07b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:31.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.603+0000 7ffb3a07b9c0 20 realm 2024-09-10T05:36:31.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.603+0000 7ffb3a07b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.603+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562b34c8f670 con 0x562b34c902e0 2024-09-10T05:36:31.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.603+0000 7ffb38382640 1 -- 172.21.15.62:0/2628859590 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb280083f0 con 0x562b34c902e0 2024-09-10T05:36:31.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.603+0000 7ffb3a07b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:31.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.603+0000 7ffb3a07b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:31.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.603+0000 7ffb3a07b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.603+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562b34c93980 con 0x562b34c902e0 2024-09-10T05:36:31.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.603+0000 7ffb38382640 1 -- 172.21.15.62:0/2628859590 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb280083f0 con 0x562b34c902e0 2024-09-10T05:36:31.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.603+0000 7ffb3a07b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:31.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.603+0000 7ffb3a07b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.607+0000 7ffb3a07b9c0 1 --2- 172.21.15.62:0/2628859590 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x562b34c94760 0x562b34c96b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.607+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562b34c971e0 con 0x562b34c94760 2024-09-10T05:36:31.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.607+0000 7ffb37b81640 1 --2- 172.21.15.62:0/2628859590 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x562b34c94760 0x562b34c96b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.607+0000 7ffb37b81640 1 --2- 172.21.15.62:0/2628859590 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x562b34c94760 0x562b34c96b50 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.607+0000 7ffb37b81640 1 -- 172.21.15.62:0/2628859590 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffb300f5070 con 0x562b34c94760 2024-09-10T05:36:31.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.607+0000 7ffb3a07b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:31.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.607+0000 7ffb3a07b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.607+0000 7ffb3a07b9c0 1 --2- 172.21.15.62:0/2628859590 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x562b34c97f90 0x562b34c9a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.607+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562b34c9a9d0 con 0x562b34c97f90 2024-09-10T05:36:31.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.607+0000 7ffb37380640 1 --2- 172.21.15.62:0/2628859590 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x562b34c97f90 0x562b34c9a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.607+0000 7ffb37380640 1 --2- 172.21.15.62:0/2628859590 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x562b34c97f90 0x562b34c9a380 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.607+0000 7ffb37380640 1 -- 172.21.15.62:0/2628859590 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ffb2c00f6e0 con 0x562b34c97f90 2024-09-10T05:36:31.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.607+0000 7ffb3a07b9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:31.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.607+0000 7ffb3a07b9c0 20 searching for the correct realm 2024-09-10T05:36:31.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.607+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b34c9c2d0 con 0x562b34c97f90 2024-09-10T05:36:31.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.607+0000 7ffb37380640 1 -- 172.21.15.62:0/2628859590 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb2c00f6e0 con 0x562b34c97f90 2024-09-10T05:36:31.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.607+0000 7ffb37380640 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b34c9c2d0 con 0x562b34c94760 2024-09-10T05:36:31.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.607+0000 7ffb37b81640 1 -- 172.21.15.62:0/2628859590 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb300f5070 con 0x562b34c94760 2024-09-10T05:36:31.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.607+0000 7ffb37b81640 1 --2- 172.21.15.62:0/2628859590 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7ffb3010c020 0x7ffb30107590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.607+0000 7ffb37b81640 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b34c9c2d0 con 0x7ffb3010c020 2024-09-10T05:36:31.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.611+0000 7ffb38382640 1 --2- 172.21.15.62:0/2628859590 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7ffb3010c020 0x7ffb30107590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.611+0000 7ffb38382640 1 --2- 172.21.15.62:0/2628859590 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7ffb3010c020 0x7ffb30107590 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.611+0000 7ffb38382640 1 -- 172.21.15.62:0/2628859590 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb280083f0 con 0x7ffb3010c020 2024-09-10T05:36:31.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.611+0000 7ffb38382640 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b34c9c2d0 con 0x562b34c902e0 2024-09-10T05:36:31.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.611+0000 7ffb38382640 1 -- 172.21.15.62:0/2628859590 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb280083f0 con 0x562b34c902e0 2024-09-10T05:36:31.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.611+0000 7ffb38382640 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b34c9c2d0 con 0x562b34c902e0 2024-09-10T05:36:31.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.611+0000 7ffb38382640 1 -- 172.21.15.62:0/2628859590 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb280083f0 con 0x562b34c902e0 2024-09-10T05:36:31.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.611+0000 7ffb38382640 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b34c9c2d0 con 0x562b34c97f90 2024-09-10T05:36:31.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.611+0000 7ffb37380640 1 -- 172.21.15.62:0/2628859590 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb2c00f6e0 con 0x562b34c97f90 2024-09-10T05:36:31.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.611+0000 7ffb37380640 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b34c9c2d0 con 0x562b34c902e0 2024-09-10T05:36:31.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.611+0000 7ffb38382640 1 -- 172.21.15.62:0/2628859590 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb280083f0 con 0x562b34c902e0 2024-09-10T05:36:31.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.611+0000 7ffb38382640 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b34c9c2d0 con 0x562b34c94760 2024-09-10T05:36:31.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.611+0000 7ffb37b81640 1 -- 172.21.15.62:0/2628859590 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb300f5070 con 0x562b34c94760 2024-09-10T05:36:31.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.611+0000 7ffb37b81640 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b34c9c2d0 con 0x562b34c94760 2024-09-10T05:36:31.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.611+0000 7ffb37b81640 1 -- 172.21.15.62:0/2628859590 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb300f5070 con 0x562b34c94760 2024-09-10T05:36:31.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.611+0000 7ffb37b81640 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b34c9c2d0 con 0x562b34c902e0 2024-09-10T05:36:31.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.611+0000 7ffb38382640 1 -- 172.21.15.62:0/2628859590 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb280083f0 con 0x562b34c902e0 2024-09-10T05:36:31.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.611+0000 7ffb38382640 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b34c9c2d0 con 0x7ffb3010c020 2024-09-10T05:36:31.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.611+0000 7ffb38382640 1 -- 172.21.15.62:0/2628859590 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb280083f0 con 0x7ffb3010c020 2024-09-10T05:36:31.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.611+0000 7ffb38382640 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b34c9c2d0 con 0x562b34c902e0 2024-09-10T05:36:31.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.615+0000 7ffb38382640 1 -- 172.21.15.62:0/2628859590 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb280083f0 con 0x562b34c902e0 2024-09-10T05:36:31.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.615+0000 7ffb38382640 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b34c9c2d0 con 0x7ffb3010c020 2024-09-10T05:36:31.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.615+0000 7ffb38382640 1 -- 172.21.15.62:0/2628859590 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ffb280083f0 con 0x7ffb3010c020 2024-09-10T05:36:31.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.615+0000 7ffb38382640 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b34c9c2d0 con 0x562b34c94760 2024-09-10T05:36:31.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.615+0000 7ffb37b81640 1 -- 172.21.15.62:0/2628859590 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb300f5070 con 0x562b34c94760 2024-09-10T05:36:31.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.615+0000 7ffb37b81640 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b34c9c2d0 con 0x562b34c97f90 2024-09-10T05:36:31.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.615+0000 7ffb37380640 1 -- 172.21.15.62:0/2628859590 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb2c00f6e0 con 0x562b34c97f90 2024-09-10T05:36:31.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.615+0000 7ffb37380640 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b34c9c2d0 con 0x562b34c902e0 2024-09-10T05:36:31.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.615+0000 7ffb38382640 1 -- 172.21.15.62:0/2628859590 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb280083f0 con 0x562b34c902e0 2024-09-10T05:36:31.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.615+0000 7ffb38382640 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b34c9c2d0 con 0x562b34c94760 2024-09-10T05:36:31.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.615+0000 7ffb37b81640 1 -- 172.21.15.62:0/2628859590 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb300f5070 con 0x562b34c94760 2024-09-10T05:36:31.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.615+0000 7ffb37b81640 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b34c9c2d0 con 0x562b34c97f90 2024-09-10T05:36:31.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.615+0000 7ffb37380640 1 -- 172.21.15.62:0/2628859590 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 30 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7ffb2c00f6e0 con 0x562b34c97f90 2024-09-10T05:36:31.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.615+0000 7ffb37380640 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b34c9c2d0 con 0x562b34c902e0 2024-09-10T05:36:31.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.615+0000 7ffb38382640 1 -- 172.21.15.62:0/2628859590 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb280083f0 con 0x562b34c902e0 2024-09-10T05:36:31.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.615+0000 7ffb38382640 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b34c9c2d0 con 0x562b34c902e0 2024-09-10T05:36:31.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.615+0000 7ffb38382640 1 -- 172.21.15.62:0/2628859590 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ffb280083f0 con 0x562b34c902e0 2024-09-10T05:36:31.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.615+0000 7ffb38382640 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b34c9c2d0 con 0x562b34c902e0 2024-09-10T05:36:31.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.619+0000 7ffb38382640 1 -- 172.21.15.62:0/2628859590 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb280083f0 con 0x562b34c902e0 2024-09-10T05:36:31.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.619+0000 7ffb38382640 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b34c9c2d0 con 0x562b34c97f90 2024-09-10T05:36:31.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.619+0000 7ffb37380640 1 -- 172.21.15.62:0/2628859590 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb2c00f6e0 con 0x562b34c97f90 2024-09-10T05:36:31.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.619+0000 7ffb37380640 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b34c9c2d0 con 0x7ffb3010c020 2024-09-10T05:36:31.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.619+0000 7ffb38382640 1 -- 172.21.15.62:0/2628859590 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb280083f0 con 0x7ffb3010c020 2024-09-10T05:36:31.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.619+0000 7ffb38382640 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b34c9c2d0 con 0x562b34c902e0 2024-09-10T05:36:31.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.619+0000 7ffb38382640 1 -- 172.21.15.62:0/2628859590 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb280083f0 con 0x562b34c902e0 2024-09-10T05:36:31.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.619+0000 7ffb38382640 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b34c9c2d0 con 0x7ffb3010c020 2024-09-10T05:36:31.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.619+0000 7ffb38382640 1 -- 172.21.15.62:0/2628859590 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb280083f0 con 0x7ffb3010c020 2024-09-10T05:36:31.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.619+0000 7ffb38382640 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b34c9c2d0 con 0x562b34c97f90 2024-09-10T05:36:31.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.619+0000 7ffb37380640 1 -- 172.21.15.62:0/2628859590 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb2c00f6e0 con 0x562b34c97f90 2024-09-10T05:36:31.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.619+0000 7ffb37380640 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b34c9c2d0 con 0x7ffb3010c020 2024-09-10T05:36:31.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.619+0000 7ffb38382640 1 -- 172.21.15.62:0/2628859590 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb280083f0 con 0x7ffb3010c020 2024-09-10T05:36:31.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.619+0000 7ffb38382640 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b34c9c2d0 con 0x562b34c94760 2024-09-10T05:36:31.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.619+0000 7ffb37b81640 1 -- 172.21.15.62:0/2628859590 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb300f5070 con 0x562b34c94760 2024-09-10T05:36:31.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.619+0000 7ffb37b81640 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b34c9c2d0 con 0x562b34c94760 2024-09-10T05:36:31.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.619+0000 7ffb37b81640 1 -- 172.21.15.62:0/2628859590 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb300f5070 con 0x562b34c94760 2024-09-10T05:36:31.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.619+0000 7ffb37b81640 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b34c9c2d0 con 0x562b34c97f90 2024-09-10T05:36:31.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.623+0000 7ffb37380640 1 -- 172.21.15.62:0/2628859590 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb2c00f6e0 con 0x562b34c97f90 2024-09-10T05:36:31.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.623+0000 7ffb37380640 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b34c9c2d0 con 0x562b34c94760 2024-09-10T05:36:31.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.623+0000 7ffb37b81640 1 -- 172.21.15.62:0/2628859590 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ffb300f5070 con 0x562b34c94760 2024-09-10T05:36:31.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.623+0000 7ffb37b81640 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b34c9c2d0 con 0x562b34c94760 2024-09-10T05:36:31.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.623+0000 7ffb37b81640 1 -- 172.21.15.62:0/2628859590 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb300f5070 con 0x562b34c94760 2024-09-10T05:36:31.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.623+0000 7ffb3a07b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:31.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.623+0000 7ffb3a07b9c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:31.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.623+0000 7ffb3a07b9c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:31.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.623+0000 7ffb3a07b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:31.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.623+0000 7ffb3a07b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:31.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.623+0000 7ffb3a07b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:31.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.623+0000 7ffb3a07b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.623+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562b34c9b3f0 con 0x562b34c902e0 2024-09-10T05:36:31.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.623+0000 7ffb38382640 1 -- 172.21.15.62:0/2628859590 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb280083f0 con 0x562b34c902e0 2024-09-10T05:36:31.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.623+0000 7ffb3a07b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:31.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.623+0000 7ffb3a07b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.623+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562b34c9b870 con 0x562b34c94760 2024-09-10T05:36:31.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.623+0000 7ffb37b81640 1 -- 172.21.15.62:0/2628859590 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffb300f5070 con 0x562b34c94760 2024-09-10T05:36:31.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.623+0000 7ffb3a07b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:31.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.623+0000 7ffb3a07b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.623+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562b34c9bc90 con 0x562b34c97f90 2024-09-10T05:36:31.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.623+0000 7ffb37380640 1 -- 172.21.15.62:0/2628859590 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ffb2c00f6e0 con 0x562b34c97f90 2024-09-10T05:36:31.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.623+0000 7ffb3a07b9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:31.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.623+0000 7ffb3a07b9c0 20 zone default found 2024-09-10T05:36:31.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.623+0000 7ffb3a07b9c0 4 Realm: () 2024-09-10T05:36:31.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.623+0000 7ffb3a07b9c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:31.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.623+0000 7ffb3a07b9c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:31.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.623+0000 7ffb3a07b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:31.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.623+0000 7ffb3a07b9c0 20 zonegroup default 2024-09-10T05:36:31.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.623+0000 7ffb3a07b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.623+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562b34c9c7a0 con 0x7ffb3010c020 2024-09-10T05:36:31.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.623+0000 7ffb38382640 1 -- 172.21.15.62:0/2628859590 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ffb280083f0 con 0x7ffb3010c020 2024-09-10T05:36:31.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.623+0000 7ffb3a07b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:31.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.623+0000 7ffb3a07b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.623+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562b34c9ea80 con 0x562b34c97f90 2024-09-10T05:36:31.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.623+0000 7ffb37380640 1 -- 172.21.15.62:0/2628859590 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffb2c00f6e0 con 0x562b34c97f90 2024-09-10T05:36:31.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.623+0000 7ffb3a07b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:31.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.623+0000 7ffb3a07b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.623+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562b34c9ee20 con 0x562b34c97f90 2024-09-10T05:36:31.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.623+0000 7ffb37380640 1 -- 172.21.15.62:0/2628859590 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffb2c00f6e0 con 0x562b34c97f90 2024-09-10T05:36:31.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.623+0000 7ffb3a07b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:31.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.623+0000 7ffb3a07b9c0 20 started sync module instance, tier type = 2024-09-10T05:36:31.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.623+0000 7ffb3a07b9c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:31.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.623+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b34c9df10 con 0x562b34c94760 2024-09-10T05:36:31.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.627+0000 7ffb37b81640 1 -- 172.21.15.62:0/2628859590 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb300f5070 con 0x562b34c94760 2024-09-10T05:36:31.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.627+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94743569228544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b34c9f730 con 0x562b34c94760 2024-09-10T05:36:31.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.627+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b34c9ff80 con 0x562b34c902e0 2024-09-10T05:36:31.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.627+0000 7ffb38382640 1 -- 172.21.15.62:0/2628859590 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb280083f0 con 0x562b34c902e0 2024-09-10T05:36:31.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.627+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94743569233712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b34ca07d0 con 0x562b34c902e0 2024-09-10T05:36:31.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.627+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b34ca1020 con 0x562b34c94760 2024-09-10T05:36:31.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.631+0000 7ffb37b81640 1 -- 172.21.15.62:0/2628859590 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94743569228544] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb300f5070 con 0x562b34c94760 2024-09-10T05:36:31.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.631+0000 7ffb38382640 1 -- 172.21.15.62:0/2628859590 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94743569233712] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb280083f0 con 0x562b34c902e0 2024-09-10T05:36:31.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.631+0000 7ffb37b81640 1 -- 172.21.15.62:0/2628859590 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb300f5070 con 0x562b34c94760 2024-09-10T05:36:31.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.631+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94743569236768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b34ca0bf0 con 0x562b34c94760 2024-09-10T05:36:31.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.631+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b34ca1440 con 0x7ffb3010c020 2024-09-10T05:36:31.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.635+0000 7ffb38382640 1 -- 172.21.15.62:0/2628859590 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb280083f0 con 0x7ffb3010c020 2024-09-10T05:36:31.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.635+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94743569239296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b34ca1830 con 0x7ffb3010c020 2024-09-10T05:36:31.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.635+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b34ca2300 con 0x562b34c94760 2024-09-10T05:36:31.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.639+0000 7ffb37b81640 1 -- 172.21.15.62:0/2628859590 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94743569236768] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb300f5070 con 0x562b34c94760 2024-09-10T05:36:31.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.639+0000 7ffb38382640 1 -- 172.21.15.62:0/2628859590 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94743569239296] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb280083f0 con 0x7ffb3010c020 2024-09-10T05:36:31.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.639+0000 7ffb37b81640 1 -- 172.21.15.62:0/2628859590 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb300f5070 con 0x562b34c94760 2024-09-10T05:36:31.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.639+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94743569243632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b34ca22c0 con 0x562b34c94760 2024-09-10T05:36:31.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.639+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b34ca2ba0 con 0x562b34c97f90 2024-09-10T05:36:31.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.643+0000 7ffb37380640 1 -- 172.21.15.62:0/2628859590 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb2c00f6e0 con 0x562b34c97f90 2024-09-10T05:36:31.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.643+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94743569245936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b34ca22c0 con 0x562b34c97f90 2024-09-10T05:36:31.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.643+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b34ca35e0 con 0x562b34c97f90 2024-09-10T05:36:31.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.643+0000 7ffb37b81640 1 -- 172.21.15.62:0/2628859590 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94743569243632] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb300f5070 con 0x562b34c94760 2024-09-10T05:36:31.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.643+0000 7ffb37380640 1 -- 172.21.15.62:0/2628859590 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94743569245936] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb2c00f6e0 con 0x562b34c97f90 2024-09-10T05:36:31.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.643+0000 7ffb37380640 1 -- 172.21.15.62:0/2628859590 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb2c00f6e0 con 0x562b34c97f90 2024-09-10T05:36:31.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.647+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94743569246992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b34ca3130 con 0x562b34c97f90 2024-09-10T05:36:31.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.647+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b34ca3eb0 con 0x7ffb3010c020 2024-09-10T05:36:31.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.647+0000 7ffb37380640 1 -- 172.21.15.62:0/2628859590 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94743569246992] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb2c00f6e0 con 0x562b34c97f90 2024-09-10T05:36:31.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.647+0000 7ffb38382640 1 -- 172.21.15.62:0/2628859590 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb280083f0 con 0x7ffb3010c020 2024-09-10T05:36:31.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.647+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94743569237824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b34ca3130 con 0x7ffb3010c020 2024-09-10T05:36:31.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.647+0000 7ffb3a07b9c0 20 add_watcher() i=0 2024-09-10T05:36:31.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.647+0000 7ffb3a07b9c0 20 add_watcher() i=1 2024-09-10T05:36:31.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.651+0000 7ffb3a07b9c0 20 add_watcher() i=2 2024-09-10T05:36:31.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.651+0000 7ffb3a07b9c0 20 add_watcher() i=3 2024-09-10T05:36:31.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.651+0000 7ffb3a07b9c0 20 add_watcher() i=4 2024-09-10T05:36:31.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.651+0000 7ffb3a07b9c0 20 add_watcher() i=5 2024-09-10T05:36:31.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.651+0000 7ffb3a07b9c0 20 add_watcher() i=6 2024-09-10T05:36:31.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.651+0000 7ffb38382640 1 -- 172.21.15.62:0/2628859590 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94743569237824] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb280083f0 con 0x7ffb3010c020 2024-09-10T05:36:31.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.651+0000 7ffb3a07b9c0 20 add_watcher() i=7 2024-09-10T05:36:31.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.651+0000 7ffb3a07b9c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:31.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.651+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562b34ca6f10 con 0x562b34c902e0 2024-09-10T05:36:31.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.651+0000 7ffb38382640 1 -- 172.21.15.62:0/2628859590 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ffb280083f0 con 0x562b34c902e0 2024-09-10T05:36:31.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.651+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94743569250816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b34ca44a0 con 0x562b34c902e0 2024-09-10T05:36:31.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.655+0000 7ffb38382640 1 -- 172.21.15.62:0/2628859590 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94743569250816] v30'64 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffb280083f0 con 0x562b34c902e0 2024-09-10T05:36:31.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.655+0000 7ff9edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:31.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.655+0000 7ffb3a07b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:31.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.655+0000 7ffb3a07b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:31.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.655+0000 7ffb3a07b9c0 5 note: GC not initialized 2024-09-10T05:36:31.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.655+0000 7ff9ecfe1640 20 reqs_thread_entry: start 2024-09-10T05:36:31.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.655+0000 7ffb3a07b9c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:31.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.655+0000 7ffb3a07b9c0 20 Filter name: none 2024-09-10T05:36:31.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.655+0000 7ff9667fc640 20 reqs_thread_entry: start 2024-09-10T05:36:31.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.655+0000 7ffb3a07b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.655+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562b34cc9d40 con 0x562b34c902e0 2024-09-10T05:36:31.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.655+0000 7ffb38382640 1 -- 172.21.15.62:0/2628859590 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ffb280083f0 con 0x562b34c902e0 2024-09-10T05:36:31.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.655+0000 7ffb3a07b9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:36:31.660 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T05:36:30.893777Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:36:30.893760Z","tags":[],"group_ids":[]} 2024-09-10T05:36:31.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.655+0000 7ff9edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:31.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.655+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94743569250816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b34cc8b90 con 0x562b34c902e0 2024-09-10T05:36:31.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.659+0000 7ffb38382640 1 -- 172.21.15.62:0/2628859590 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94743569250816] v30'65 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffb280083f0 con 0x562b34c902e0 2024-09-10T05:36:31.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.659+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94743569228544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b34ca3a00 con 0x562b34c94760 2024-09-10T05:36:31.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.659+0000 7ffb37b81640 1 -- 172.21.15.62:0/2628859590 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94743569228544] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb300f5070 con 0x562b34c94760 2024-09-10T05:36:31.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.659+0000 7ffb3a07b9c0 20 remove_watcher() i=0 2024-09-10T05:36:31.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.659+0000 7ffb3a07b9c0 2 removed watcher, disabling cache 2024-09-10T05:36:31.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.659+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94743569233712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b34ca3a00 con 0x562b34c902e0 2024-09-10T05:36:31.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.663+0000 7ffb38382640 1 -- 172.21.15.62:0/2628859590 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94743569233712] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb280083f0 con 0x562b34c902e0 2024-09-10T05:36:31.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.663+0000 7ffb3a07b9c0 20 remove_watcher() i=1 2024-09-10T05:36:31.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.663+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94743569236768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b34ca3a00 con 0x562b34c94760 2024-09-10T05:36:31.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.663+0000 7ffb37b81640 1 -- 172.21.15.62:0/2628859590 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94743569236768] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb300f5070 con 0x562b34c94760 2024-09-10T05:36:31.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.663+0000 7ffb3a07b9c0 20 remove_watcher() i=2 2024-09-10T05:36:31.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.663+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94743569239296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b34ca0320 con 0x7ffb3010c020 2024-09-10T05:36:31.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.667+0000 7ffb38382640 1 -- 172.21.15.62:0/2628859590 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94743569239296] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb280083f0 con 0x7ffb3010c020 2024-09-10T05:36:31.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.667+0000 7ffb3a07b9c0 20 remove_watcher() i=3 2024-09-10T05:36:31.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.667+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94743569243632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b34ca3a00 con 0x562b34c94760 2024-09-10T05:36:31.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.667+0000 7ffb37b81640 1 -- 172.21.15.62:0/2628859590 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94743569243632] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb300f5070 con 0x562b34c94760 2024-09-10T05:36:31.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.667+0000 7ffb3a07b9c0 20 remove_watcher() i=4 2024-09-10T05:36:31.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.667+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94743569245936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b34ca0d00 con 0x562b34c97f90 2024-09-10T05:36:31.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.667+0000 7ffb37380640 1 -- 172.21.15.62:0/2628859590 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94743569245936] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb2c00f6e0 con 0x562b34c97f90 2024-09-10T05:36:31.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.671+0000 7ffb3a07b9c0 20 remove_watcher() i=5 2024-09-10T05:36:31.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.671+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94743569246992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b34ca0320 con 0x562b34c97f90 2024-09-10T05:36:31.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.671+0000 7ffb37380640 1 -- 172.21.15.62:0/2628859590 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94743569246992] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb2c00f6e0 con 0x562b34c97f90 2024-09-10T05:36:31.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.671+0000 7ffb3a07b9c0 20 remove_watcher() i=6 2024-09-10T05:36:31.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.671+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2628859590 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94743569237824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b34ca1df0 con 0x7ffb3010c020 2024-09-10T05:36:31.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.671+0000 7ffb38382640 1 -- 172.21.15.62:0/2628859590 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94743569237824] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb280083f0 con 0x7ffb3010c020 2024-09-10T05:36:31.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.671+0000 7ffb3a07b9c0 20 remove_watcher() i=7 2024-09-10T05:36:31.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.671+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2628859590 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x562b34c94760 msgr2=0x562b34c96b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.671+0000 7ffb3a07b9c0 1 --2- 172.21.15.62:0/2628859590 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x562b34c94760 0x562b34c96b50 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.671+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2628859590 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x562b34c902e0 msgr2=0x562b34c92770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.671+0000 7ffb3a07b9c0 1 --2- 172.21.15.62:0/2628859590 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x562b34c902e0 0x562b34c92770 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.671+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2628859590 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7ffb3010c020 msgr2=0x7ffb30107590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.671+0000 7ffb3a07b9c0 1 --2- 172.21.15.62:0/2628859590 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7ffb3010c020 0x7ffb30107590 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.671+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2628859590 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x562b34c97f90 msgr2=0x562b34c9a380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.671+0000 7ffb3a07b9c0 1 --2- 172.21.15.62:0/2628859590 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x562b34c97f90 0x562b34c9a380 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.671+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2628859590 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ffa000399d0 msgr2=0x7ffa0003be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.671+0000 7ffb3a07b9c0 1 --2- 172.21.15.62:0/2628859590 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ffa000399d0 0x7ffa0003be90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x562b34c5f720 tx=0x7ffb2c010000 comp rx=0 tx=0).stop 2024-09-10T05:36:31.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.671+0000 7ffb38382640 1 -- 172.21.15.62:0/2628859590 reap_dead start 2024-09-10T05:36:31.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.671+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2628859590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b34c7e190 msgr2=0x562b34c854d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.671+0000 7ffb3a07b9c0 1 --2- 172.21.15.62:0/2628859590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b34c7e190 0x562b34c854d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ffb300b49f0 tx=0x7ffb300b4980 comp rx=0 tx=0).stop 2024-09-10T05:36:31.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.671+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2628859590 shutdown_connections 2024-09-10T05:36:31.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.671+0000 7ffb3a07b9c0 1 --2- 172.21.15.62:0/2628859590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b34c7e190 0x562b34c854d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.671+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2628859590 >> 172.21.15.62:0/2628859590 conn(0x562b34c7a5c0 msgr2=0x562b34c787d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:31.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.671+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2628859590 shutdown_connections 2024-09-10T05:36:31.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.671+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2628859590 wait complete. 2024-09-10T05:36:31.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.671+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/1280171008 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ffa10039a70 msgr2=0x7ffa1003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.671+0000 7ffb3a07b9c0 1 --2- 172.21.15.62:0/1280171008 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ffa10039a70 0x7ffa1003bf30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x562b34c55ec0 tx=0x7ffb2c00f000 comp rx=0 tx=0).stop 2024-09-10T05:36:31.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.671+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/1280171008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b34c71a00 msgr2=0x562b34c71e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.671+0000 7ffb3a07b9c0 1 --2- 172.21.15.62:0/1280171008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b34c71a00 0x562b34c71e20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ffb300ac010 tx=0x7ffb300c7960 comp rx=0 tx=0).stop 2024-09-10T05:36:31.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.671+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/1280171008 shutdown_connections 2024-09-10T05:36:31.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.671+0000 7ffb3a07b9c0 1 --2- 172.21.15.62:0/1280171008 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ffa10039a70 0x7ffa1003bf30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.671+0000 7ffb3a07b9c0 1 --2- 172.21.15.62:0/1280171008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b34c71a00 0x562b34c71e20 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.671+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/1280171008 >> 172.21.15.62:0/1280171008 conn(0x562b34c673b0 msgr2=0x562b34c67790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:31.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.671+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/1280171008 shutdown_connections 2024-09-10T05:36:31.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.671+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/1280171008 wait complete. 2024-09-10T05:36:31.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.671+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2361507695 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x562b34c5bec0 msgr2=0x562b34c5e380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.671+0000 7ffb3a07b9c0 1 --2- 172.21.15.62:0/2361507695 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x562b34c5bec0 0x562b34c5e380 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.671+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2361507695 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x562b34b60fe0 msgr2=0x562b34c5aeb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.671+0000 7ffb3a07b9c0 1 --2- 172.21.15.62:0/2361507695 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x562b34b60fe0 0x562b34c5aeb0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.671+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2361507695 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x562b34c608b0 msgr2=0x562b34c62ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.671+0000 7ffb3a07b9c0 1 --2- 172.21.15.62:0/2361507695 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x562b34c608b0 0x562b34c62ca0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.675+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2361507695 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ffa20039b10 msgr2=0x7ffa2003bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.675+0000 7ffb3a07b9c0 1 --2- 172.21.15.62:0/2361507695 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ffa20039b10 0x7ffa2003bfd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c001e90 tx=0x7ffb2c0013f0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.675+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2361507695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b34b5de00 msgr2=0x562b34c53d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.675+0000 7ffb3a07b9c0 1 --2- 172.21.15.62:0/2361507695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b34b5de00 0x562b34c53d40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ffb30018cc0 tx=0x7ffb30017e30 comp rx=0 tx=0).stop 2024-09-10T05:36:31.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.675+0000 7ffb38382640 1 -- 172.21.15.62:0/2361507695 reap_dead start 2024-09-10T05:36:31.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.675+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2361507695 shutdown_connections 2024-09-10T05:36:31.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.675+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2361507695 >> 172.21.15.62:0/2361507695 conn(0x562b34b59920 msgr2=0x562b34c49750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:31.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.675+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2361507695 shutdown_connections 2024-09-10T05:36:31.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.675+0000 7ffb3a07b9c0 1 -- 172.21.15.62:0/2361507695 wait complete. 2024-09-10T05:36:31.688 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T05:36:30.893777Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:36:30.893760Z', 'tags': [], 'group_ids': []} 2024-09-10T05:36:31.688 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-10T05:36:31.688 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-10T05:36:31.688 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-10T05:36:31.767 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:31.767 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:31.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.763+0000 7f975b3519c0 1 Processor -- start 2024-09-10T05:36:31.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.763+0000 7f975b3519c0 1 -- start start 2024-09-10T05:36:31.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.767+0000 7f975b3519c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x56419d8ff200 0x56419d98dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.767+0000 7f975b3519c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56419d83f9c0 con 0x56419d98e170 2024-09-10T05:36:31.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.767+0000 7f975b3519c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x56419d88f6d0 con 0x56419d8ff200 2024-09-10T05:36:31.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.767+0000 7f9758e57640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x56419d8ff200 0x56419d98dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.767+0000 7f9758e57640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x56419d8ff200 0x56419d98dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51452/0 (socket says 172.21.15.62:51452) 2024-09-10T05:36:31.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.767+0000 7f9758656640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x56419d98e170 0x56419d990560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:38518/0 (socket says 172.21.15.62:38518) 2024-09-10T05:36:31.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.767+0000 7f9758e57640 1 -- 172.21.15.62:0/2536694627 learned_addr learned my addr 172.21.15.62:0/2536694627 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:31.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.767+0000 7f9758e57640 1 -- 172.21.15.62:0/2536694627 >> v1:172.21.15.2:6789/0 conn(0x56419d98e170 legacy=0x56419d990560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.767+0000 7f9758e57640 1 -- 172.21.15.62:0/2536694627 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56419d833ca0 con 0x56419d8ff200 2024-09-10T05:36:31.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.767+0000 7f9758e57640 1 --2- 172.21.15.62:0/2536694627 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419d8ff200 0x56419d98dc30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f974800a5c0 tx=0x7f974801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32f606e120a3d79c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.767+0000 7f9757e55640 1 -- 172.21.15.62:0/2536694627 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97480b1070 con 0x56419d8ff200 2024-09-10T05:36:31.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.767+0000 7f9757e55640 1 -- 172.21.15.62:0/2536694627 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97480a8070 con 0x56419d8ff200 2024-09-10T05:36:31.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.767+0000 7f9757e55640 1 -- 172.21.15.62:0/2536694627 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97480ac5b0 con 0x56419d8ff200 2024-09-10T05:36:31.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.771+0000 7f975b3519c0 1 -- 172.21.15.62:0/2536694627 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419d8ff200 msgr2=0x56419d98dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.771+0000 7f975b3519c0 1 --2- 172.21.15.62:0/2536694627 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419d8ff200 0x56419d98dc30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f974800a5c0 tx=0x7f974801b340 comp rx=0 tx=0).stop 2024-09-10T05:36:31.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.771+0000 7f975b3519c0 1 -- 172.21.15.62:0/2536694627 shutdown_connections 2024-09-10T05:36:31.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.771+0000 7f975b3519c0 1 --2- 172.21.15.62:0/2536694627 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419d8ff200 0x56419d98dc30 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.771+0000 7f975b3519c0 1 -- 172.21.15.62:0/2536694627 >> 172.21.15.62:0/2536694627 conn(0x56419d985920 msgr2=0x56419d987d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:31.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.771+0000 7f975b3519c0 1 -- 172.21.15.62:0/2536694627 shutdown_connections 2024-09-10T05:36:31.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.771+0000 7f975b3519c0 1 -- 172.21.15.62:0/2536694627 wait complete. 2024-09-10T05:36:31.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.783+0000 7f975b3519c0 1 Processor -- start 2024-09-10T05:36:31.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.783+0000 7f975b3519c0 1 -- start start 2024-09-10T05:36:31.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.783+0000 7f975b3519c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419d8ff200 0x56419da767b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.783+0000 7f975b3519c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56419d893680 con 0x56419d8ff200 2024-09-10T05:36:31.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.787+0000 7f9758e57640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419d8ff200 0x56419da767b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.787+0000 7f9758e57640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419d8ff200 0x56419da767b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51468/0 (socket says 172.21.15.62:51468) 2024-09-10T05:36:31.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.787+0000 7f9758e57640 1 -- 172.21.15.62:0/4031859257 learned_addr learned my addr 172.21.15.62:0/4031859257 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:31.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.787+0000 7f9758e57640 1 -- 172.21.15.62:0/4031859257 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56419d80eda0 con 0x56419d8ff200 2024-09-10T05:36:31.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.787+0000 7f9758e57640 1 --2- 172.21.15.62:0/4031859257 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419d8ff200 0x56419da767b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f97480af040 tx=0x7f9748003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed1b42f77d29c764 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.787+0000 7f9646e0d640 1 -- 172.21.15.62:0/4031859257 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97480b1040 con 0x56419d8ff200 2024-09-10T05:36:31.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.787+0000 7f9646e0d640 1 -- 172.21.15.62:0/4031859257 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97480ac820 con 0x56419d8ff200 2024-09-10T05:36:31.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.787+0000 7f9646e0d640 1 -- 172.21.15.62:0/4031859257 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97480acb00 con 0x56419d8ff200 2024-09-10T05:36:31.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.787+0000 7f975b3519c0 1 -- 172.21.15.62:0/4031859257 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419d8ff200 msgr2=0x56419da767b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.787+0000 7f975b3519c0 1 --2- 172.21.15.62:0/4031859257 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419d8ff200 0x56419da767b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f97480af040 tx=0x7f9748003030 comp rx=0 tx=0).stop 2024-09-10T05:36:31.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.787+0000 7f975b3519c0 1 -- 172.21.15.62:0/4031859257 shutdown_connections 2024-09-10T05:36:31.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.787+0000 7f975b3519c0 1 --2- 172.21.15.62:0/4031859257 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419d8ff200 0x56419da767b0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.787+0000 7f975b3519c0 1 -- 172.21.15.62:0/4031859257 >> 172.21.15.62:0/4031859257 conn(0x56419d985920 msgr2=0x56419da723f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:31.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.787+0000 7f975b3519c0 1 -- 172.21.15.62:0/4031859257 shutdown_connections 2024-09-10T05:36:31.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.787+0000 7f975b3519c0 1 -- 172.21.15.62:0/4031859257 wait complete. 2024-09-10T05:36:31.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.787+0000 7f975b3519c0 1 Processor -- start 2024-09-10T05:36:31.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.787+0000 7f975b3519c0 1 -- start start 2024-09-10T05:36:31.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.787+0000 7f975b3519c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419d8ff200 0x56419da7dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.787+0000 7f975b3519c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56419d835a50 con 0x56419d8ff200 2024-09-10T05:36:31.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.787+0000 7f9758e57640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419d8ff200 0x56419da7dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.787+0000 7f9758e57640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419d8ff200 0x56419da7dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51476/0 (socket says 172.21.15.62:51476) 2024-09-10T05:36:31.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.787+0000 7f9758e57640 1 -- 172.21.15.62:0/1853811853 learned_addr learned my addr 172.21.15.62:0/1853811853 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:31.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.787+0000 7f9758e57640 1 -- 172.21.15.62:0/1853811853 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56419da7e2c0 con 0x56419d8ff200 2024-09-10T05:36:31.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.787+0000 7f9758e57640 1 --2- 172.21.15.62:0/1853811853 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419d8ff200 0x56419da7dd60 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9748018f70 tx=0x7f9748019b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.791+0000 7f964560a640 1 -- 172.21.15.62:0/1853811853 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97480cd070 con 0x56419d8ff200 2024-09-10T05:36:31.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.791+0000 7f964560a640 1 -- 172.21.15.62:0/1853811853 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97480b7a20 con 0x56419d8ff200 2024-09-10T05:36:31.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.791+0000 7f975b3519c0 1 -- 172.21.15.62:0/1853811853 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56419da7e550 con 0x56419d8ff200 2024-09-10T05:36:31.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.791+0000 7f964560a640 1 -- 172.21.15.62:0/1853811853 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97480b1070 con 0x56419d8ff200 2024-09-10T05:36:31.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.791+0000 7f975b3519c0 1 -- 172.21.15.62:0/1853811853 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56419da7ef00 con 0x56419d8ff200 2024-09-10T05:36:31.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.791+0000 7f964560a640 1 -- 172.21.15.62:0/1853811853 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f97480d0070 con 0x56419d8ff200 2024-09-10T05:36:31.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.791+0000 7f964560a640 1 --2- 172.21.15.62:0/1853811853 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f9640039a70 0x7f964003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.791+0000 7f964560a640 1 -- 172.21.15.62:0/1853811853 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f97480eaf30 con 0x56419d8ff200 2024-09-10T05:36:31.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.791+0000 7f9758656640 1 --2- 172.21.15.62:0/1853811853 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f9640039a70 0x7f964003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.791+0000 7f975b3519c0 1 --2- 172.21.15.62:0/1853811853 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56419d98e170 0x56419da84ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.791+0000 7f975b3519c0 1 -- 172.21.15.62:0/1853811853 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56419da85410 con 0x56419d98e170 2024-09-10T05:36:31.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.791+0000 7f9759658640 1 --2- 172.21.15.62:0/1853811853 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56419d98e170 0x56419da84ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.791+0000 7f9758656640 1 --2- 172.21.15.62:0/1853811853 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f9640039a70 0x7f964003bf30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f974c001e40 tx=0x7f974c0013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.791+0000 7f9759658640 1 --2- 172.21.15.62:0/1853811853 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56419d98e170 0x56419da84ed0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.791+0000 7f9759658640 1 -- 172.21.15.62:0/1853811853 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f975000a4d0 con 0x56419d98e170 2024-09-10T05:36:31.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.791+0000 7f975b3519c0 1 --2- 172.21.15.62:0/1853811853 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x56419da85f30 0x56419da883f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.791+0000 7f975b3519c0 1 -- 172.21.15.62:0/1853811853 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56419da88b60 con 0x56419da85f30 2024-09-10T05:36:31.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.791+0000 7f9758e57640 1 --2- 172.21.15.62:0/1853811853 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x56419da85f30 0x56419da883f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.791+0000 7f9758e57640 1 --2- 172.21.15.62:0/1853811853 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x56419da85f30 0x56419da883f0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.795+0000 7f9758e57640 1 -- 172.21.15.62:0/1853811853 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f97480cf030 con 0x56419da85f30 2024-09-10T05:36:31.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.795+0000 7f975b3519c0 1 --2- 172.21.15.62:0/1853811853 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56419da8a920 0x56419da8cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.795+0000 7f975b3519c0 1 -- 172.21.15.62:0/1853811853 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56419da8d3b0 con 0x56419da8a920 2024-09-10T05:36:31.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.795+0000 7f9758656640 1 --2- 172.21.15.62:0/1853811853 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56419da8a920 0x56419da8cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.795+0000 7f9758656640 1 --2- 172.21.15.62:0/1853811853 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56419da8a920 0x56419da8cd10 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.795+0000 7f9758656640 1 -- 172.21.15.62:0/1853811853 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f974c00bd60 con 0x56419da8a920 2024-09-10T05:36:31.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.795+0000 7f975b3519c0 1 -- 172.21.15.62:0/1853811853 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56419da897c0 con 0x56419da85f30 2024-09-10T05:36:31.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.795+0000 7f9758e57640 1 -- 172.21.15.62:0/1853811853 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f97480cf030 con 0x56419da85f30 2024-09-10T05:36:31.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.795+0000 7f975b3519c0 1 -- 172.21.15.62:0/1853811853 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56419da89c20 con 0x56419da8a920 2024-09-10T05:36:31.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.795+0000 7f9758656640 1 -- 172.21.15.62:0/1853811853 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f974c00bd60 con 0x56419da8a920 2024-09-10T05:36:31.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.795+0000 7f975b3519c0 1 Processor -- start 2024-09-10T05:36:31.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.795+0000 7f975b3519c0 1 -- start start 2024-09-10T05:36:31.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.795+0000 7f975b3519c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419d98b390 0x56419d989c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.795+0000 7f975b3519c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56419d8a0450 con 0x56419d98b390 2024-09-10T05:36:31.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.795+0000 7f9758e57640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419d98b390 0x56419d989c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.795+0000 7f9758e57640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419d98b390 0x56419d989c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51488/0 (socket says 172.21.15.62:51488) 2024-09-10T05:36:31.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.795+0000 7f9758e57640 1 -- 172.21.15.62:0/3596151806 learned_addr learned my addr 172.21.15.62:0/3596151806 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:31.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.799+0000 7f9758e57640 1 -- 172.21.15.62:0/3596151806 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56419d98b8b0 con 0x56419d98b390 2024-09-10T05:36:31.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.799+0000 7f9758e57640 1 --2- 172.21.15.62:0/3596151806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419d98b390 0x56419d989c30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f97480abb80 tx=0x7f9748006760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.799+0000 7f963e7fc640 1 -- 172.21.15.62:0/3596151806 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97480d09d0 con 0x56419d98b390 2024-09-10T05:36:31.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.799+0000 7f963e7fc640 1 -- 172.21.15.62:0/3596151806 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97480e4030 con 0x56419d98b390 2024-09-10T05:36:31.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.799+0000 7f963e7fc640 1 -- 172.21.15.62:0/3596151806 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97480d0cc0 con 0x56419d98b390 2024-09-10T05:36:31.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.799+0000 7f975b3519c0 1 -- 172.21.15.62:0/3596151806 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56419d98a170 con 0x56419d98b390 2024-09-10T05:36:31.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.799+0000 7f975b3519c0 1 -- 172.21.15.62:0/3596151806 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56419d98a6e0 con 0x56419d98b390 2024-09-10T05:36:31.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.799+0000 7f963e7fc640 1 -- 172.21.15.62:0/3596151806 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f97480aa070 con 0x56419d98b390 2024-09-10T05:36:31.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.799+0000 7f963e7fc640 1 --2- 172.21.15.62:0/3596151806 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f9630039b10 0x7f963003bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.799+0000 7f963e7fc640 1 -- 172.21.15.62:0/3596151806 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f97480eeab0 con 0x56419d98b390 2024-09-10T05:36:31.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.799+0000 7f9758656640 1 --2- 172.21.15.62:0/3596151806 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f9630039b10 0x7f963003bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.799+0000 7f975b3519c0 1 Processor -- start 2024-09-10T05:36:31.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.803+0000 7f975b3519c0 1 -- start start 2024-09-10T05:36:31.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.803+0000 7f9758656640 1 --2- 172.21.15.62:0/3596151806 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f9630039b10 0x7f963003bfd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x56419da8d780 tx=0x7f974c00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.803+0000 7f975b3519c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419daaa3c0 0x56419daaa7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.803+0000 7f975b3519c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56419da76fa0 con 0x56419daaa3c0 2024-09-10T05:36:31.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.803+0000 7f9758e57640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419daaa3c0 0x56419daaa7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.803+0000 7f9758e57640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419daaa3c0 0x56419daaa7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51494/0 (socket says 172.21.15.62:51494) 2024-09-10T05:36:31.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.803+0000 7f9758e57640 1 -- 172.21.15.62:0/3444985242 learned_addr learned my addr 172.21.15.62:0/3444985242 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:31.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.803+0000 7f9758e57640 1 -- 172.21.15.62:0/3444985242 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56419daaad90 con 0x56419daaa3c0 2024-09-10T05:36:31.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.803+0000 7f9758e57640 1 --2- 172.21.15.62:0/3444985242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419daaa3c0 0x56419daaa7a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9748006f40 tx=0x7f97480c7dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=574bab74f49e525 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.803+0000 7f962ffff640 1 -- 172.21.15.62:0/3444985242 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97480f2040 con 0x56419daaa3c0 2024-09-10T05:36:31.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.803+0000 7f962ffff640 1 -- 172.21.15.62:0/3444985242 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97480c8df0 con 0x56419daaa3c0 2024-09-10T05:36:31.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.803+0000 7f962ffff640 1 -- 172.21.15.62:0/3444985242 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97480dfd50 con 0x56419daaa3c0 2024-09-10T05:36:31.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.803+0000 7f975b3519c0 1 -- 172.21.15.62:0/3444985242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419daaa3c0 msgr2=0x56419daaa7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.803+0000 7f975b3519c0 1 --2- 172.21.15.62:0/3444985242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419daaa3c0 0x56419daaa7a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9748006f40 tx=0x7f97480c7dd0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.803+0000 7f975b3519c0 1 -- 172.21.15.62:0/3444985242 shutdown_connections 2024-09-10T05:36:31.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.803+0000 7f975b3519c0 1 --2- 172.21.15.62:0/3444985242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419daaa3c0 0x56419daaa7a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.803+0000 7f975b3519c0 1 -- 172.21.15.62:0/3444985242 >> 172.21.15.62:0/3444985242 conn(0x56419daa67f0 msgr2=0x56419daa4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:31.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.803+0000 7f975b3519c0 1 -- 172.21.15.62:0/3444985242 shutdown_connections 2024-09-10T05:36:31.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.803+0000 7f975b3519c0 1 -- 172.21.15.62:0/3444985242 wait complete. 2024-09-10T05:36:31.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.803+0000 7f975b3519c0 1 Processor -- start 2024-09-10T05:36:31.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.803+0000 7f975b3519c0 1 -- start start 2024-09-10T05:36:31.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.803+0000 7f975b3519c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419daaa3c0 0x56419dab1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.803+0000 7f975b3519c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56419daab250 con 0x56419daaa3c0 2024-09-10T05:36:31.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.803+0000 7f9758e57640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419daaa3c0 0x56419dab1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.803+0000 7f9758e57640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419daaa3c0 0x56419dab1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51504/0 (socket says 172.21.15.62:51504) 2024-09-10T05:36:31.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.803+0000 7f9758e57640 1 -- 172.21.15.62:0/964879990 learned_addr learned my addr 172.21.15.62:0/964879990 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:31.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.803+0000 7f9758e57640 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56419dab1ca0 con 0x56419daaa3c0 2024-09-10T05:36:31.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.807+0000 7f9758e57640 1 --2- 172.21.15.62:0/964879990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419daaa3c0 0x56419dab1740 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f97480c7e10 tx=0x7f97480cbeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.807+0000 7f962e7fc640 1 -- 172.21.15.62:0/964879990 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97480f2040 con 0x56419daaa3c0 2024-09-10T05:36:31.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.807+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56419dab1ca0 con 0x56419daaa3c0 2024-09-10T05:36:31.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.807+0000 7f962e7fc640 1 -- 172.21.15.62:0/964879990 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97480e9c60 con 0x56419daaa3c0 2024-09-10T05:36:31.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.807+0000 7f962e7fc640 1 -- 172.21.15.62:0/964879990 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97480c88f0 con 0x56419daaa3c0 2024-09-10T05:36:31.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.807+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56419dab2270 con 0x56419daaa3c0 2024-09-10T05:36:31.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.807+0000 7f962e7fc640 1 -- 172.21.15.62:0/964879990 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f9748112020 con 0x56419daaa3c0 2024-09-10T05:36:31.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.807+0000 7f962e7fc640 1 --2- 172.21.15.62:0/964879990 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f9624039a70 0x7f962403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.807+0000 7f962e7fc640 1 -- 172.21.15.62:0/964879990 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f9748110020 con 0x56419daaa3c0 2024-09-10T05:36:31.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.807+0000 7f975b3519c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.807+0000 7f9758656640 1 --2- 172.21.15.62:0/964879990 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f9624039a70 0x7f962403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.807+0000 7f975b3519c0 1 --2- 172.21.15.62:0/964879990 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56419dabc5a0 0x56419dabea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.807+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56419dabf180 con 0x56419dabc5a0 2024-09-10T05:36:31.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.807+0000 7f9759658640 1 --2- 172.21.15.62:0/964879990 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56419dabc5a0 0x56419dabea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.807+0000 7f9758656640 1 --2- 172.21.15.62:0/964879990 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f9624039a70 0x7f962403bf30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x56419da89790 tx=0x7f974c010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.807+0000 7f9759658640 1 --2- 172.21.15.62:0/964879990 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56419dabc5a0 0x56419dabea30 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.807+0000 7f9759658640 1 -- 172.21.15.62:0/964879990 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f975000a4d0 con 0x56419dabc5a0 2024-09-10T05:36:31.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.807+0000 7f975b3519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:31.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.807+0000 7f975b3519c0 20 realm 2024-09-10T05:36:31.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.807+0000 7f975b3519c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.807+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56419dabb930 con 0x56419dabc5a0 2024-09-10T05:36:31.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.807+0000 7f9759658640 1 -- 172.21.15.62:0/964879990 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f975000a4d0 con 0x56419dabc5a0 2024-09-10T05:36:31.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.807+0000 7f975b3519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:31.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.807+0000 7f975b3519c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:31.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.807+0000 7f975b3519c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.807+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56419dabfc40 con 0x56419dabc5a0 2024-09-10T05:36:31.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.807+0000 7f9759658640 1 -- 172.21.15.62:0/964879990 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f975000a4d0 con 0x56419dabc5a0 2024-09-10T05:36:31.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.807+0000 7f975b3519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:31.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.807+0000 7f975b3519c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.807+0000 7f975b3519c0 1 --2- 172.21.15.62:0/964879990 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x56419dac0a20 0x56419dac2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.807+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56419dac34e0 con 0x56419dac0a20 2024-09-10T05:36:31.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.811+0000 7f9758e57640 1 --2- 172.21.15.62:0/964879990 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x56419dac0a20 0x56419dac2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.811+0000 7f9758e57640 1 --2- 172.21.15.62:0/964879990 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x56419dac0a20 0x56419dac2e10 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.811+0000 7f9758e57640 1 -- 172.21.15.62:0/964879990 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f97480f4070 con 0x56419dac0a20 2024-09-10T05:36:31.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.811+0000 7f975b3519c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:31.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.811+0000 7f975b3519c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.811+0000 7f975b3519c0 1 --2- 172.21.15.62:0/964879990 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56419dac4240 0x56419dac6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.811+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56419dac6de0 con 0x56419dac4240 2024-09-10T05:36:31.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.811+0000 7f9758656640 1 --2- 172.21.15.62:0/964879990 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56419dac4240 0x56419dac6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.811+0000 7f9758656640 1 --2- 172.21.15.62:0/964879990 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56419dac4240 0x56419dac6650 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.811+0000 7f9758656640 1 -- 172.21.15.62:0/964879990 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f974c00bd60 con 0x56419dac4240 2024-09-10T05:36:31.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.811+0000 7f975b3519c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:31.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.811+0000 7f975b3519c0 20 searching for the correct realm 2024-09-10T05:36:31.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.811+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56419dac86b0 con 0x56419dac4240 2024-09-10T05:36:31.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.811+0000 7f9758656640 1 -- 172.21.15.62:0/964879990 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f974c00bd60 con 0x56419dac4240 2024-09-10T05:36:31.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.811+0000 7f9758656640 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56419dac86b0 con 0x56419dac0a20 2024-09-10T05:36:31.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.811+0000 7f9758e57640 1 -- 172.21.15.62:0/964879990 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97480f4070 con 0x56419dac0a20 2024-09-10T05:36:31.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.811+0000 7f9758e57640 1 --2- 172.21.15.62:0/964879990 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f97480ed020 0x7f97480bb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.811+0000 7f9758e57640 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56419dac86b0 con 0x7f97480ed020 2024-09-10T05:36:31.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.811+0000 7f9759658640 1 --2- 172.21.15.62:0/964879990 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f97480ed020 0x7f97480bb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.811+0000 7f9759658640 1 --2- 172.21.15.62:0/964879990 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f97480ed020 0x7f97480bb1b0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.815+0000 7f9759658640 1 -- 172.21.15.62:0/964879990 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f975000a4d0 con 0x7f97480ed020 2024-09-10T05:36:31.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.815+0000 7f9759658640 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56419dac86b0 con 0x56419dabc5a0 2024-09-10T05:36:31.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.815+0000 7f9759658640 1 -- 172.21.15.62:0/964879990 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f975000a4d0 con 0x56419dabc5a0 2024-09-10T05:36:31.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.815+0000 7f9759658640 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56419dac86b0 con 0x56419dabc5a0 2024-09-10T05:36:31.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.815+0000 7f9759658640 1 -- 172.21.15.62:0/964879990 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f975000a4d0 con 0x56419dabc5a0 2024-09-10T05:36:31.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.815+0000 7f9759658640 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56419dac86b0 con 0x56419dac4240 2024-09-10T05:36:31.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.815+0000 7f9758656640 1 -- 172.21.15.62:0/964879990 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f974c00bd60 con 0x56419dac4240 2024-09-10T05:36:31.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.815+0000 7f9758656640 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56419dac86b0 con 0x56419dabc5a0 2024-09-10T05:36:31.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.815+0000 7f9759658640 1 -- 172.21.15.62:0/964879990 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f975000a4d0 con 0x56419dabc5a0 2024-09-10T05:36:31.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.815+0000 7f9759658640 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56419dac86b0 con 0x56419dac0a20 2024-09-10T05:36:31.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.815+0000 7f9758e57640 1 -- 172.21.15.62:0/964879990 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97480f4070 con 0x56419dac0a20 2024-09-10T05:36:31.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.815+0000 7f9758e57640 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56419dac86b0 con 0x56419dac0a20 2024-09-10T05:36:31.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.815+0000 7f9758e57640 1 -- 172.21.15.62:0/964879990 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97480f4070 con 0x56419dac0a20 2024-09-10T05:36:31.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.815+0000 7f9758e57640 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56419dac86b0 con 0x56419dabc5a0 2024-09-10T05:36:31.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.815+0000 7f9759658640 1 -- 172.21.15.62:0/964879990 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f975000a4d0 con 0x56419dabc5a0 2024-09-10T05:36:31.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.815+0000 7f9759658640 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56419dac86b0 con 0x7f97480ed020 2024-09-10T05:36:31.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.815+0000 7f9759658640 1 -- 172.21.15.62:0/964879990 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f975000a4d0 con 0x7f97480ed020 2024-09-10T05:36:31.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.815+0000 7f9759658640 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56419dac86b0 con 0x56419dabc5a0 2024-09-10T05:36:31.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.815+0000 7f9759658640 1 -- 172.21.15.62:0/964879990 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f975000a4d0 con 0x56419dabc5a0 2024-09-10T05:36:31.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.815+0000 7f9759658640 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56419dac86b0 con 0x7f97480ed020 2024-09-10T05:36:31.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.815+0000 7f9759658640 1 -- 172.21.15.62:0/964879990 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f975000a4d0 con 0x7f97480ed020 2024-09-10T05:36:31.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.815+0000 7f9759658640 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56419dac86b0 con 0x56419dac0a20 2024-09-10T05:36:31.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.819+0000 7f9758e57640 1 -- 172.21.15.62:0/964879990 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97480f4070 con 0x56419dac0a20 2024-09-10T05:36:31.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.819+0000 7f9758e57640 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56419dac86b0 con 0x56419dac4240 2024-09-10T05:36:31.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.819+0000 7f9758656640 1 -- 172.21.15.62:0/964879990 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f974c00bd60 con 0x56419dac4240 2024-09-10T05:36:31.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.819+0000 7f9758656640 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56419dac86b0 con 0x56419dabc5a0 2024-09-10T05:36:31.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.819+0000 7f9759658640 1 -- 172.21.15.62:0/964879990 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f975000a4d0 con 0x56419dabc5a0 2024-09-10T05:36:31.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.819+0000 7f9759658640 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56419dac86b0 con 0x56419dac0a20 2024-09-10T05:36:31.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.819+0000 7f9758e57640 1 -- 172.21.15.62:0/964879990 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97480f4070 con 0x56419dac0a20 2024-09-10T05:36:31.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.819+0000 7f9758e57640 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56419dac86b0 con 0x56419dac4240 2024-09-10T05:36:31.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.819+0000 7f9758656640 1 -- 172.21.15.62:0/964879990 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 30 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f974c00bd60 con 0x56419dac4240 2024-09-10T05:36:31.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.819+0000 7f9758656640 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56419dac86b0 con 0x56419dabc5a0 2024-09-10T05:36:31.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.819+0000 7f9759658640 1 -- 172.21.15.62:0/964879990 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f975000a4d0 con 0x56419dabc5a0 2024-09-10T05:36:31.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.819+0000 7f9759658640 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56419dac86b0 con 0x56419dabc5a0 2024-09-10T05:36:31.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.819+0000 7f9759658640 1 -- 172.21.15.62:0/964879990 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f975000a4d0 con 0x56419dabc5a0 2024-09-10T05:36:31.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.819+0000 7f9759658640 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56419dac86b0 con 0x56419dabc5a0 2024-09-10T05:36:31.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.819+0000 7f9759658640 1 -- 172.21.15.62:0/964879990 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f975000a4d0 con 0x56419dabc5a0 2024-09-10T05:36:31.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.819+0000 7f9759658640 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56419dac86b0 con 0x56419dac4240 2024-09-10T05:36:31.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.819+0000 7f9758656640 1 -- 172.21.15.62:0/964879990 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f974c00bd60 con 0x56419dac4240 2024-09-10T05:36:31.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.819+0000 7f9758656640 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56419dac86b0 con 0x7f97480ed020 2024-09-10T05:36:31.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.819+0000 7f9759658640 1 -- 172.21.15.62:0/964879990 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f975000a4d0 con 0x7f97480ed020 2024-09-10T05:36:31.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.819+0000 7f9759658640 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56419dac86b0 con 0x56419dabc5a0 2024-09-10T05:36:31.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.823+0000 7f9759658640 1 -- 172.21.15.62:0/964879990 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f975000a4d0 con 0x56419dabc5a0 2024-09-10T05:36:31.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.823+0000 7f9759658640 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56419dac86b0 con 0x7f97480ed020 2024-09-10T05:36:31.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.823+0000 7f9759658640 1 -- 172.21.15.62:0/964879990 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f975000a4d0 con 0x7f97480ed020 2024-09-10T05:36:31.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.823+0000 7f9759658640 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56419dac86b0 con 0x56419dac4240 2024-09-10T05:36:31.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.823+0000 7f9758656640 1 -- 172.21.15.62:0/964879990 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f974c00bd60 con 0x56419dac4240 2024-09-10T05:36:31.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.823+0000 7f9758656640 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56419dac86b0 con 0x7f97480ed020 2024-09-10T05:36:31.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.823+0000 7f9759658640 1 -- 172.21.15.62:0/964879990 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f975000a4d0 con 0x7f97480ed020 2024-09-10T05:36:31.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.823+0000 7f9759658640 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56419dac86b0 con 0x56419dac0a20 2024-09-10T05:36:31.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.823+0000 7f9758e57640 1 -- 172.21.15.62:0/964879990 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97480f4070 con 0x56419dac0a20 2024-09-10T05:36:31.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.823+0000 7f9758e57640 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56419dac86b0 con 0x56419dac0a20 2024-09-10T05:36:31.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.823+0000 7f9758e57640 1 -- 172.21.15.62:0/964879990 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97480f4070 con 0x56419dac0a20 2024-09-10T05:36:31.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.823+0000 7f9758e57640 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56419dac86b0 con 0x56419dac4240 2024-09-10T05:36:31.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.823+0000 7f9758656640 1 -- 172.21.15.62:0/964879990 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f974c00bd60 con 0x56419dac4240 2024-09-10T05:36:31.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.823+0000 7f9758656640 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56419dac86b0 con 0x56419dac0a20 2024-09-10T05:36:31.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.823+0000 7f9758e57640 1 -- 172.21.15.62:0/964879990 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f97480f4070 con 0x56419dac0a20 2024-09-10T05:36:31.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.823+0000 7f9758e57640 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56419dac86b0 con 0x56419dac0a20 2024-09-10T05:36:31.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.827+0000 7f9758e57640 1 -- 172.21.15.62:0/964879990 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97480f4070 con 0x56419dac0a20 2024-09-10T05:36:31.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.827+0000 7f975b3519c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:31.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.827+0000 7f975b3519c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:31.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.827+0000 7f975b3519c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:31.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.827+0000 7f975b3519c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:31.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.827+0000 7f975b3519c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:31.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.827+0000 7f975b3519c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:31.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.827+0000 7f975b3519c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.827+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56419dac77a0 con 0x56419dabc5a0 2024-09-10T05:36:31.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.827+0000 7f9759658640 1 -- 172.21.15.62:0/964879990 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f975000a4d0 con 0x56419dabc5a0 2024-09-10T05:36:31.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.827+0000 7f975b3519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:31.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.827+0000 7f975b3519c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.827+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56419dac8040 con 0x56419dac0a20 2024-09-10T05:36:31.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.827+0000 7f9758e57640 1 -- 172.21.15.62:0/964879990 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f97480f4070 con 0x56419dac0a20 2024-09-10T05:36:31.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.827+0000 7f975b3519c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:31.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.827+0000 7f975b3519c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.827+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56419dac73e0 con 0x56419dac4240 2024-09-10T05:36:31.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.827+0000 7f9758656640 1 -- 172.21.15.62:0/964879990 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f974c00bd60 con 0x56419dac4240 2024-09-10T05:36:31.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.827+0000 7f975b3519c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:31.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.827+0000 7f975b3519c0 20 zone default found 2024-09-10T05:36:31.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.827+0000 7f975b3519c0 4 Realm: () 2024-09-10T05:36:31.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.827+0000 7f975b3519c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:31.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.827+0000 7f975b3519c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:31.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.827+0000 7f975b3519c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:31.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.827+0000 7f975b3519c0 20 zonegroup default 2024-09-10T05:36:31.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.827+0000 7f975b3519c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.827+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56419dac8f90 con 0x7f97480ed020 2024-09-10T05:36:31.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.827+0000 7f9759658640 1 -- 172.21.15.62:0/964879990 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f975000a4d0 con 0x7f97480ed020 2024-09-10T05:36:31.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.827+0000 7f975b3519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:31.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.827+0000 7f975b3519c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.827+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56419dacb1d0 con 0x56419dac4240 2024-09-10T05:36:31.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.827+0000 7f9758656640 1 -- 172.21.15.62:0/964879990 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f974c00bd60 con 0x56419dac4240 2024-09-10T05:36:31.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.827+0000 7f975b3519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:31.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.827+0000 7f975b3519c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.827+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56419dacb570 con 0x56419dac4240 2024-09-10T05:36:31.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.827+0000 7f9758656640 1 -- 172.21.15.62:0/964879990 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f974c00bd60 con 0x56419dac4240 2024-09-10T05:36:31.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.827+0000 7f975b3519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:31.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.827+0000 7f975b3519c0 20 started sync module instance, tier type = 2024-09-10T05:36:31.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.827+0000 7f975b3519c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:31.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.827+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56419daca660 con 0x56419dac0a20 2024-09-10T05:36:31.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.831+0000 7f9758e57640 1 -- 172.21.15.62:0/964879990 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97480f4070 con 0x56419dac0a20 2024-09-10T05:36:31.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.831+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94839818201952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56419daca660 con 0x56419dac0a20 2024-09-10T05:36:31.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.831+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56419dacbfa0 con 0x56419dabc5a0 2024-09-10T05:36:31.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.831+0000 7f9759658640 1 -- 172.21.15.62:0/964879990 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f975000a4d0 con 0x56419dabc5a0 2024-09-10T05:36:31.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.831+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94839818205936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56419dacc840 con 0x56419dabc5a0 2024-09-10T05:36:31.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.831+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56419dacd240 con 0x56419dac0a20 2024-09-10T05:36:31.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.831+0000 7f9758e57640 1 -- 172.21.15.62:0/964879990 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94839818201952] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97480f4070 con 0x56419dac0a20 2024-09-10T05:36:31.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.835+0000 7f9759658640 1 -- 172.21.15.62:0/964879990 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94839818205936] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f975000a4d0 con 0x56419dabc5a0 2024-09-10T05:36:31.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.835+0000 7f9758e57640 1 -- 172.21.15.62:0/964879990 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97480f4070 con 0x56419dac0a20 2024-09-10T05:36:31.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.835+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94839818199472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56419dacc390 con 0x56419dac0a20 2024-09-10T05:36:31.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.835+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56419dacdae0 con 0x7f97480ed020 2024-09-10T05:36:31.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.835+0000 7f9759658640 1 -- 172.21.15.62:0/964879990 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f975000a4d0 con 0x7f97480ed020 2024-09-10T05:36:31.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.835+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94839818212912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56419dacc390 con 0x7f97480ed020 2024-09-10T05:36:31.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.835+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56419dace580 con 0x56419dac0a20 2024-09-10T05:36:31.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.835+0000 7f9758e57640 1 -- 172.21.15.62:0/964879990 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94839818199472] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97480f4070 con 0x56419dac0a20 2024-09-10T05:36:31.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.835+0000 7f9759658640 1 -- 172.21.15.62:0/964879990 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94839818212912] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f975000a4d0 con 0x7f97480ed020 2024-09-10T05:36:31.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.839+0000 7f9758e57640 1 -- 172.21.15.62:0/964879990 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97480f4070 con 0x56419dac0a20 2024-09-10T05:36:31.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.839+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94839818213968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56419dace540 con 0x56419dac0a20 2024-09-10T05:36:31.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.839+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56419dace9a0 con 0x56419dac4240 2024-09-10T05:36:31.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.839+0000 7f9758656640 1 -- 172.21.15.62:0/964879990 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f974c00bd60 con 0x56419dac4240 2024-09-10T05:36:31.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.839+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94839818210640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56419dace9a0 con 0x56419dac4240 2024-09-10T05:36:31.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.839+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56419dacf8a0 con 0x56419dac4240 2024-09-10T05:36:31.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.839+0000 7f9758e57640 1 -- 172.21.15.62:0/964879990 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94839818213968] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97480f4070 con 0x56419dac0a20 2024-09-10T05:36:31.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.843+0000 7f9758656640 1 -- 172.21.15.62:0/964879990 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94839818210640] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f974c00bd60 con 0x56419dac4240 2024-09-10T05:36:31.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.843+0000 7f9758656640 1 -- 172.21.15.62:0/964879990 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f974c00bd60 con 0x56419dac4240 2024-09-10T05:36:31.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.843+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94839818218896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56419dacf3b0 con 0x56419dac4240 2024-09-10T05:36:31.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.843+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56419dacfd70 con 0x7f97480ed020 2024-09-10T05:36:31.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.847+0000 7f9758656640 1 -- 172.21.15.62:0/964879990 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94839818218896] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f974c00bd60 con 0x56419dac4240 2024-09-10T05:36:31.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.847+0000 7f9759658640 1 -- 172.21.15.62:0/964879990 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f975000a4d0 con 0x7f97480ed020 2024-09-10T05:36:31.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.847+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94839818215536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56419dacfd70 con 0x7f97480ed020 2024-09-10T05:36:31.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.847+0000 7f975b3519c0 20 add_watcher() i=0 2024-09-10T05:36:31.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.847+0000 7f975b3519c0 20 add_watcher() i=1 2024-09-10T05:36:31.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.847+0000 7f975b3519c0 20 add_watcher() i=2 2024-09-10T05:36:31.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.847+0000 7f975b3519c0 20 add_watcher() i=3 2024-09-10T05:36:31.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.847+0000 7f975b3519c0 20 add_watcher() i=4 2024-09-10T05:36:31.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.847+0000 7f975b3519c0 20 add_watcher() i=5 2024-09-10T05:36:31.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.847+0000 7f975b3519c0 20 add_watcher() i=6 2024-09-10T05:36:31.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.847+0000 7f9759658640 1 -- 172.21.15.62:0/964879990 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94839818215536] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f975000a4d0 con 0x7f97480ed020 2024-09-10T05:36:31.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.847+0000 7f975b3519c0 20 add_watcher() i=7 2024-09-10T05:36:31.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.847+0000 7f975b3519c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:31.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.847+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56419dad31a0 con 0x56419dabc5a0 2024-09-10T05:36:31.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.851+0000 7f9759658640 1 -- 172.21.15.62:0/964879990 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f975000a4d0 con 0x56419dabc5a0 2024-09-10T05:36:31.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.851+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94839818222224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56419dad06c0 con 0x56419dabc5a0 2024-09-10T05:36:31.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.851+0000 7f9759658640 1 -- 172.21.15.62:0/964879990 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94839818222224] v30'66 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f975000a4d0 con 0x56419dabc5a0 2024-09-10T05:36:31.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.851+0000 7f960efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:31.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.851+0000 7f975b3519c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:31.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.851+0000 7f975b3519c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:31.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.851+0000 7f975b3519c0 5 note: GC not initialized 2024-09-10T05:36:31.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.851+0000 7f960dfe3640 20 reqs_thread_entry: start 2024-09-10T05:36:31.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.851+0000 7f975b3519c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:31.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.851+0000 7f975b3519c0 20 Filter name: none 2024-09-10T05:36:31.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.851+0000 7f957f7fe640 20 reqs_thread_entry: start 2024-09-10T05:36:31.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.851+0000 7f975b3519c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T05:36:31.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.851+0000 7f975b3519c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:31.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.851+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56419daf6440 con 0x56419dabc5a0 2024-09-10T05:36:31.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.851+0000 7f9759658640 1 -- 172.21.15.62:0/964879990 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f975000a4d0 con 0x56419dabc5a0 2024-09-10T05:36:31.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.855+0000 7f975b3519c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:36:31.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.855+0000 7f975b3519c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T05:36:31.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.855+0000 7f975b3519c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:36:31.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.855+0000 7f975b3519c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:36:31.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.855+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56419daf8ed0 con 0x7f97480ed020 2024-09-10T05:36:31.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.855+0000 7f9759658640 1 -- 172.21.15.62:0/964879990 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f975000a4d0 con 0x7f97480ed020 2024-09-10T05:36:31.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.855+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56419dafc510 con 0x56419dabc5a0 2024-09-10T05:36:31.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.855+0000 7f9759658640 1 -- 172.21.15.62:0/964879990 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v30'3 uv3 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f975000a4d0 con 0x56419dabc5a0 2024-09-10T05:36:31.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.855+0000 7f975b3519c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:36:31.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.855+0000 7f975b3519c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:36:31.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.855+0000 7f975b3519c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T05:36:31.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.855+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94839818403744 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56419daf7ec0 con 0x56419dac0a20 2024-09-10T05:36:31.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.855+0000 7f9758e57640 1 -- 172.21.15.62:0/964879990 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== watch-notify(notify (1) cookie 94839818213968 notify 128849018882 ret 0) ==== 609+0+0 (crc 0 0 0) 0x56419d98a170 con 0x56419dac0a20 2024-09-10T05:36:31.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.855+0000 7f962ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018882 cookie 94839818213968 notifier 4325 bl.length()=567 2024-09-10T05:36:31.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.855+0000 7f962ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:36:31.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.855+0000 7f962ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:36:31.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.855+0000 7f9758e57640 1 -- 172.21.15.62:0/964879990 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(65 notify.4 [notify cookie 94839818403744 out=8b] v0'0 uv39 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f97480f4070 con 0x56419dac0a20 2024-09-10T05:36:31.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.855+0000 7f962ffff640 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f961c003eb0 con 0x56419dac0a20 2024-09-10T05:36:31.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.859+0000 7f9758e57640 1 -- 172.21.15.62:0/964879990 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== watch-notify(notify_complete (2) cookie 94839818403744 notify 128849018882 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56419d98b8b0 con 0x56419dac0a20 2024-09-10T05:36:31.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.859+0000 7f9758e57640 1 -- 172.21.15.62:0/964879990 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97480f4070 con 0x56419dac0a20 2024-09-10T05:36:31.861 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T05:36:30.893777Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:36:30.893760Z","tags":[],"group_ids":[]} 2024-09-10T05:36:31.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.859+0000 7f960efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:31.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.859+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94839818222224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56419daf5250 con 0x56419dabc5a0 2024-09-10T05:36:31.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.859+0000 7f9759658640 1 -- 172.21.15.62:0/964879990 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94839818222224] v30'67 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f975000a4d0 con 0x56419dabc5a0 2024-09-10T05:36:31.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.859+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94839818201952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56419daf4da0 con 0x56419dac0a20 2024-09-10T05:36:31.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.863+0000 7f9758e57640 1 -- 172.21.15.62:0/964879990 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94839818201952] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97480f4070 con 0x56419dac0a20 2024-09-10T05:36:31.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.863+0000 7f975b3519c0 20 remove_watcher() i=0 2024-09-10T05:36:31.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.863+0000 7f975b3519c0 2 removed watcher, disabling cache 2024-09-10T05:36:31.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.863+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94839818205936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56419dacab60 con 0x56419dabc5a0 2024-09-10T05:36:31.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.863+0000 7f9759658640 1 -- 172.21.15.62:0/964879990 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94839818205936] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f975000a4d0 con 0x56419dabc5a0 2024-09-10T05:36:31.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.863+0000 7f975b3519c0 20 remove_watcher() i=1 2024-09-10T05:36:31.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.863+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94839818199472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56419dacab60 con 0x56419dac0a20 2024-09-10T05:36:31.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.867+0000 7f9758e57640 1 -- 172.21.15.62:0/964879990 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94839818199472] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97480f4070 con 0x56419dac0a20 2024-09-10T05:36:31.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.867+0000 7f975b3519c0 20 remove_watcher() i=2 2024-09-10T05:36:31.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.867+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94839818212912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56419daca1b0 con 0x7f97480ed020 2024-09-10T05:36:31.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.867+0000 7f9759658640 1 -- 172.21.15.62:0/964879990 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94839818212912] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f975000a4d0 con 0x7f97480ed020 2024-09-10T05:36:31.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.867+0000 7f975b3519c0 20 remove_watcher() i=3 2024-09-10T05:36:31.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.867+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94839818213968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56419dacab60 con 0x56419dac0a20 2024-09-10T05:36:31.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.871+0000 7f9758e57640 1 -- 172.21.15.62:0/964879990 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94839818213968] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97480f4070 con 0x56419dac0a20 2024-09-10T05:36:31.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.871+0000 7f975b3519c0 20 remove_watcher() i=4 2024-09-10T05:36:31.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.871+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94839818210640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56419daca1b0 con 0x56419dac4240 2024-09-10T05:36:31.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.871+0000 7f9758656640 1 -- 172.21.15.62:0/964879990 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94839818210640] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f974c00bd60 con 0x56419dac4240 2024-09-10T05:36:31.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.871+0000 7f975b3519c0 20 remove_watcher() i=5 2024-09-10T05:36:31.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.871+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94839818218896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56419dacab60 con 0x56419dac4240 2024-09-10T05:36:31.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.871+0000 7f9758656640 1 -- 172.21.15.62:0/964879990 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94839818218896] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f974c00bd60 con 0x56419dac4240 2024-09-10T05:36:31.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.871+0000 7f975b3519c0 20 remove_watcher() i=6 2024-09-10T05:36:31.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.871+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94839818215536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56419daca1b0 con 0x7f97480ed020 2024-09-10T05:36:31.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.875+0000 7f9759658640 1 -- 172.21.15.62:0/964879990 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94839818215536] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f975000a4d0 con 0x7f97480ed020 2024-09-10T05:36:31.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.875+0000 7f975b3519c0 20 remove_watcher() i=7 2024-09-10T05:36:31.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.875+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x56419dac0a20 msgr2=0x56419dac2e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.875+0000 7f975b3519c0 1 --2- 172.21.15.62:0/964879990 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x56419dac0a20 0x56419dac2e10 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.875+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56419dabc5a0 msgr2=0x56419dabea30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.875+0000 7f975b3519c0 1 --2- 172.21.15.62:0/964879990 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56419dabc5a0 0x56419dabea30 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.875+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f97480ed020 msgr2=0x7f97480bb1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.875+0000 7f975b3519c0 1 --2- 172.21.15.62:0/964879990 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f97480ed020 0x7f97480bb1b0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.875+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56419dac4240 msgr2=0x56419dac6650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.875+0000 7f975b3519c0 1 --2- 172.21.15.62:0/964879990 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56419dac4240 0x56419dac6650 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.875+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f9624039a70 msgr2=0x7f962403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.875+0000 7f975b3519c0 1 --2- 172.21.15.62:0/964879990 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f9624039a70 0x7f962403bf30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x56419da89790 tx=0x7f974c010000 comp rx=0 tx=0).stop 2024-09-10T05:36:31.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.875+0000 7f9759658640 1 -- 172.21.15.62:0/964879990 reap_dead start 2024-09-10T05:36:31.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.875+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419daaa3c0 msgr2=0x56419dab1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.875+0000 7f975b3519c0 1 --2- 172.21.15.62:0/964879990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419daaa3c0 0x56419dab1740 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f97480c7e10 tx=0x7f97480cbeb0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.875+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 shutdown_connections 2024-09-10T05:36:31.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.875+0000 7f975b3519c0 1 --2- 172.21.15.62:0/964879990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419daaa3c0 0x56419dab1740 secure :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f97480c7e10 tx=0x7f97480cbeb0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.875+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 >> 172.21.15.62:0/964879990 conn(0x56419daa67f0 msgr2=0x56419daa4a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:31.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.875+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 shutdown_connections 2024-09-10T05:36:31.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.875+0000 7f975b3519c0 1 -- 172.21.15.62:0/964879990 wait complete. 2024-09-10T05:36:31.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.875+0000 7f975b3519c0 1 -- 172.21.15.62:0/3596151806 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f9630039b10 msgr2=0x7f963003bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.875+0000 7f975b3519c0 1 --2- 172.21.15.62:0/3596151806 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f9630039b10 0x7f963003bfd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x56419da8d780 tx=0x7f974c00f000 comp rx=0 tx=0).stop 2024-09-10T05:36:31.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.875+0000 7f975b3519c0 1 -- 172.21.15.62:0/3596151806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419d98b390 msgr2=0x56419d989c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.875+0000 7f975b3519c0 1 --2- 172.21.15.62:0/3596151806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419d98b390 0x56419d989c30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f97480abb80 tx=0x7f9748006760 comp rx=0 tx=0).stop 2024-09-10T05:36:31.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.875+0000 7f975b3519c0 1 -- 172.21.15.62:0/3596151806 shutdown_connections 2024-09-10T05:36:31.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.875+0000 7f975b3519c0 1 --2- 172.21.15.62:0/3596151806 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f9630039b10 0x7f963003bfd0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.875+0000 7f975b3519c0 1 --2- 172.21.15.62:0/3596151806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419d98b390 0x56419d989c30 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.875+0000 7f975b3519c0 1 -- 172.21.15.62:0/3596151806 >> 172.21.15.62:0/3596151806 conn(0x56419da91490 msgr2=0x56419da91870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:31.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.875+0000 7f975b3519c0 1 -- 172.21.15.62:0/3596151806 shutdown_connections 2024-09-10T05:36:31.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.875+0000 7f975b3519c0 1 -- 172.21.15.62:0/3596151806 wait complete. 2024-09-10T05:36:31.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.875+0000 7f975b3519c0 1 -- 172.21.15.62:0/1853811853 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x56419da85f30 msgr2=0x56419da883f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.875+0000 7f975b3519c0 1 --2- 172.21.15.62:0/1853811853 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x56419da85f30 0x56419da883f0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.875+0000 7f975b3519c0 1 -- 172.21.15.62:0/1853811853 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56419d98e170 msgr2=0x56419da84ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.875+0000 7f975b3519c0 1 --2- 172.21.15.62:0/1853811853 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56419d98e170 0x56419da84ed0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.875+0000 7f975b3519c0 1 -- 172.21.15.62:0/1853811853 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56419da8a920 msgr2=0x56419da8cd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.875+0000 7f975b3519c0 1 --2- 172.21.15.62:0/1853811853 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56419da8a920 0x56419da8cd10 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.875+0000 7f975b3519c0 1 -- 172.21.15.62:0/1853811853 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f9640039a70 msgr2=0x7f964003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.875+0000 7f975b3519c0 1 --2- 172.21.15.62:0/1853811853 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f9640039a70 0x7f964003bf30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f974c001e40 tx=0x7f974c0013a0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.875+0000 7f975b3519c0 1 -- 172.21.15.62:0/1853811853 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419d8ff200 msgr2=0x56419da7dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.875+0000 7f975b3519c0 1 --2- 172.21.15.62:0/1853811853 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56419d8ff200 0x56419da7dd60 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9748018f70 tx=0x7f9748019b80 comp rx=0 tx=0).stop 2024-09-10T05:36:31.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.875+0000 7f9759658640 1 -- 172.21.15.62:0/1853811853 reap_dead start 2024-09-10T05:36:31.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.875+0000 7f975b3519c0 1 -- 172.21.15.62:0/1853811853 shutdown_connections 2024-09-10T05:36:31.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.875+0000 7f975b3519c0 1 -- 172.21.15.62:0/1853811853 >> 172.21.15.62:0/1853811853 conn(0x56419d985920 msgr2=0x56419da70e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:31.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.875+0000 7f975b3519c0 1 -- 172.21.15.62:0/1853811853 shutdown_connections 2024-09-10T05:36:31.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.875+0000 7f975b3519c0 1 -- 172.21.15.62:0/1853811853 wait complete. 2024-09-10T05:36:31.891 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T05:36:30.893777Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:36:30.893760Z', 'tags': [], 'group_ids': []} 2024-09-10T05:36:31.891 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-10T05:36:31.891 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-10T05:36:31.891 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-10T05:36:31.971 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:31.971 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:31.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.967+0000 7fb0caec69c0 1 Processor -- start 2024-09-10T05:36:31.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.967+0000 7fb0caec69c0 1 -- start start 2024-09-10T05:36:31.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.967+0000 7fb0caec69c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x562e63066200 0x562e630665e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.967+0000 7fb0caec69c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562e62f189c0 con 0x562e63069340 2024-09-10T05:36:31.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.967+0000 7fb0caec69c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x562e62f686d0 con 0x562e63066200 2024-09-10T05:36:31.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.971+0000 7fb0c89cc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x562e63066200 0x562e630665e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.971+0000 7fb0c89cc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x562e63066200 0x562e630665e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51524/0 (socket says 172.21.15.62:51524) 2024-09-10T05:36:31.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.971+0000 7fb0c89cc640 1 -- 172.21.15.62:0/1573401027 learned_addr learned my addr 172.21.15.62:0/1573401027 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:31.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.971+0000 7fb0c81cb640 1 --1- 172.21.15.62:0/1573401027 >> v1:172.21.15.2:6789/0 conn(0x562e63069340 0x562e6306b730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:38534/0 (socket says 172.21.15.62:38534) 2024-09-10T05:36:31.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.971+0000 7fb0c89cc640 1 -- 172.21.15.62:0/1573401027 >> v1:172.21.15.2:6789/0 conn(0x562e63069340 legacy=0x562e6306b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.971+0000 7fb0c89cc640 1 -- 172.21.15.62:0/1573401027 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e62f0cca0 con 0x562e63066200 2024-09-10T05:36:31.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.971+0000 7fb0c89cc640 1 --2- 172.21.15.62:0/1573401027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e63066200 0x562e630665e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb0b800a5c0 tx=0x7fb0b801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cd5ee374ebfaef6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.971+0000 7fb0c79ca640 1 -- 172.21.15.62:0/1573401027 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0b80a6070 con 0x562e63066200 2024-09-10T05:36:31.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.971+0000 7fb0c79ca640 1 -- 172.21.15.62:0/1573401027 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0b80af070 con 0x562e63066200 2024-09-10T05:36:31.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.971+0000 7fb0c79ca640 1 -- 172.21.15.62:0/1573401027 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0b80aa5c0 con 0x562e63066200 2024-09-10T05:36:31.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.971+0000 7fb0caec69c0 1 -- 172.21.15.62:0/1573401027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e63066200 msgr2=0x562e630665e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.971+0000 7fb0caec69c0 1 --2- 172.21.15.62:0/1573401027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e63066200 0x562e630665e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb0b800a5c0 tx=0x7fb0b801b340 comp rx=0 tx=0).stop 2024-09-10T05:36:31.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.975+0000 7fb0caec69c0 1 -- 172.21.15.62:0/1573401027 shutdown_connections 2024-09-10T05:36:31.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.975+0000 7fb0caec69c0 1 --2- 172.21.15.62:0/1573401027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e63066200 0x562e630665e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.975+0000 7fb0caec69c0 1 -- 172.21.15.62:0/1573401027 >> 172.21.15.62:0/1573401027 conn(0x562e62fd9b10 msgr2=0x562e62fd9f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:31.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.975+0000 7fb0caec69c0 1 -- 172.21.15.62:0/1573401027 shutdown_connections 2024-09-10T05:36:31.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.975+0000 7fb0caec69c0 1 -- 172.21.15.62:0/1573401027 wait complete. 2024-09-10T05:36:31.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.987+0000 7fb0caec69c0 1 Processor -- start 2024-09-10T05:36:31.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.987+0000 7fb0caec69c0 1 -- start start 2024-09-10T05:36:31.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.987+0000 7fb0caec69c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e63066200 0x562e63151870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.987+0000 7fb0caec69c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562e62f6c680 con 0x562e63066200 2024-09-10T05:36:31.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.991+0000 7fb0c89cc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e63066200 0x562e63151870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.991+0000 7fb0c89cc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e63066200 0x562e63151870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51526/0 (socket says 172.21.15.62:51526) 2024-09-10T05:36:31.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.991+0000 7fb0c89cc640 1 -- 172.21.15.62:0/1415393414 learned_addr learned my addr 172.21.15.62:0/1415393414 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:31.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.991+0000 7fb0c89cc640 1 -- 172.21.15.62:0/1415393414 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e62ee7da0 con 0x562e63066200 2024-09-10T05:36:31.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.991+0000 7fb0c89cc640 1 --2- 172.21.15.62:0/1415393414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e63066200 0x562e63151870 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb0b80ac040 tx=0x7fb0b8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfb98e469f74eb80 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:31.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.991+0000 7fafb6e0d640 1 -- 172.21.15.62:0/1415393414 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0b80aa970 con 0x562e63066200 2024-09-10T05:36:31.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.991+0000 7fafb6e0d640 1 -- 172.21.15.62:0/1415393414 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0b80aab10 con 0x562e63066200 2024-09-10T05:36:31.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.991+0000 7fafb6e0d640 1 -- 172.21.15.62:0/1415393414 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0b80aae30 con 0x562e63066200 2024-09-10T05:36:31.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.991+0000 7fb0caec69c0 1 -- 172.21.15.62:0/1415393414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e63066200 msgr2=0x562e63151870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:31.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.991+0000 7fb0caec69c0 1 --2- 172.21.15.62:0/1415393414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e63066200 0x562e63151870 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb0b80ac040 tx=0x7fb0b8003030 comp rx=0 tx=0).stop 2024-09-10T05:36:31.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.991+0000 7fb0caec69c0 1 -- 172.21.15.62:0/1415393414 shutdown_connections 2024-09-10T05:36:31.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.991+0000 7fb0caec69c0 1 --2- 172.21.15.62:0/1415393414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e63066200 0x562e63151870 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:31.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.991+0000 7fb0caec69c0 1 -- 172.21.15.62:0/1415393414 >> 172.21.15.62:0/1415393414 conn(0x562e62fd9b10 msgr2=0x562e6314d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:31.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.991+0000 7fb0caec69c0 1 -- 172.21.15.62:0/1415393414 shutdown_connections 2024-09-10T05:36:31.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.991+0000 7fb0caec69c0 1 -- 172.21.15.62:0/1415393414 wait complete. 2024-09-10T05:36:31.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.991+0000 7fb0caec69c0 1 Processor -- start 2024-09-10T05:36:31.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.991+0000 7fb0caec69c0 1 -- start start 2024-09-10T05:36:31.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.991+0000 7fb0caec69c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e63066200 0x562e63158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:31.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.991+0000 7fb0caec69c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562e62f0ea50 con 0x562e63066200 2024-09-10T05:36:31.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.991+0000 7fb0c89cc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e63066200 0x562e63158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:31.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.991+0000 7fb0c89cc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e63066200 0x562e63158dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51536/0 (socket says 172.21.15.62:51536) 2024-09-10T05:36:31.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.991+0000 7fb0c89cc640 1 -- 172.21.15.62:0/4214703471 learned_addr learned my addr 172.21.15.62:0/4214703471 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:31.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.991+0000 7fb0c89cc640 1 -- 172.21.15.62:0/4214703471 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e63159330 con 0x562e63066200 2024-09-10T05:36:32.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.991+0000 7fb0c89cc640 1 --2- 172.21.15.62:0/4214703471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e63066200 0x562e63158dd0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb0b801b170 tx=0x7fb0b80180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.995+0000 7fafb560a640 1 -- 172.21.15.62:0/4214703471 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0b80c6690 con 0x562e63066200 2024-09-10T05:36:32.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.995+0000 7fafb560a640 1 -- 172.21.15.62:0/4214703471 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0b80cc070 con 0x562e63066200 2024-09-10T05:36:32.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.995+0000 7fafb560a640 1 -- 172.21.15.62:0/4214703471 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0b80c6960 con 0x562e63066200 2024-09-10T05:36:32.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.995+0000 7fb0caec69c0 1 -- 172.21.15.62:0/4214703471 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e631595c0 con 0x562e63066200 2024-09-10T05:36:32.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.995+0000 7fb0caec69c0 1 -- 172.21.15.62:0/4214703471 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e63159f20 con 0x562e63066200 2024-09-10T05:36:32.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.995+0000 7fafb560a640 1 -- 172.21.15.62:0/4214703471 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb0b80c6c10 con 0x562e63066200 2024-09-10T05:36:32.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.995+0000 7fafb560a640 1 --2- 172.21.15.62:0/4214703471 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fafb0039a70 0x7fafb003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.995+0000 7fafb560a640 1 -- 172.21.15.62:0/4214703471 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fb0b80ebc90 con 0x562e63066200 2024-09-10T05:36:32.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.995+0000 7fb0c81cb640 1 --2- 172.21.15.62:0/4214703471 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fafb0039a70 0x7fafb003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.995+0000 7fb0caec69c0 1 --2- 172.21.15.62:0/4214703471 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x562e63069340 0x562e6315fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.995+0000 7fb0caec69c0 1 -- 172.21.15.62:0/4214703471 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e63160430 con 0x562e63069340 2024-09-10T05:36:32.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.995+0000 7fb0c91cd640 1 --2- 172.21.15.62:0/4214703471 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x562e63069340 0x562e6315fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.995+0000 7fb0c81cb640 1 --2- 172.21.15.62:0/4214703471 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fafb0039a70 0x7fafb003bf30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc001e90 tx=0x7fb0bc0013f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.995+0000 7fb0c91cd640 1 --2- 172.21.15.62:0/4214703471 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x562e63069340 0x562e6315fef0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.995+0000 7fb0c91cd640 1 -- 172.21.15.62:0/4214703471 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb0c000a4d0 con 0x562e63069340 2024-09-10T05:36:32.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.995+0000 7fb0caec69c0 1 --2- 172.21.15.62:0/4214703471 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x562e63160f30 0x562e631633f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.995+0000 7fb0caec69c0 1 -- 172.21.15.62:0/4214703471 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e63163b60 con 0x562e63160f30 2024-09-10T05:36:32.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.995+0000 7fb0c89cc640 1 --2- 172.21.15.62:0/4214703471 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x562e63160f30 0x562e631633f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.999+0000 7fb0c89cc640 1 --2- 172.21.15.62:0/4214703471 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x562e63160f30 0x562e631633f0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.999+0000 7fb0c89cc640 1 -- 172.21.15.62:0/4214703471 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb0b80b3cd0 con 0x562e63160f30 2024-09-10T05:36:32.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.999+0000 7fb0caec69c0 1 --2- 172.21.15.62:0/4214703471 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x562e63165920 0x562e63167d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.999+0000 7fb0caec69c0 1 -- 172.21.15.62:0/4214703471 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e63168400 con 0x562e63165920 2024-09-10T05:36:32.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.999+0000 7fb0c81cb640 1 --2- 172.21.15.62:0/4214703471 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x562e63165920 0x562e63167d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.999+0000 7fb0c81cb640 1 --2- 172.21.15.62:0/4214703471 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x562e63165920 0x562e63167d10 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.999+0000 7fb0c81cb640 1 -- 172.21.15.62:0/4214703471 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb0bc00f6e0 con 0x562e63165920 2024-09-10T05:36:32.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.999+0000 7fb0caec69c0 1 -- 172.21.15.62:0/4214703471 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e631647c0 con 0x562e63160f30 2024-09-10T05:36:32.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.999+0000 7fb0c89cc640 1 -- 172.21.15.62:0/4214703471 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb0b80b3cd0 con 0x562e63160f30 2024-09-10T05:36:32.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.999+0000 7fb0caec69c0 1 -- 172.21.15.62:0/4214703471 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e63164c20 con 0x562e63165920 2024-09-10T05:36:32.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.999+0000 7fb0c81cb640 1 -- 172.21.15.62:0/4214703471 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb0bc00f6e0 con 0x562e63165920 2024-09-10T05:36:32.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.999+0000 7fb0caec69c0 1 Processor -- start 2024-09-10T05:36:32.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.999+0000 7fb0caec69c0 1 -- start start 2024-09-10T05:36:32.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.999+0000 7fb0caec69c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e63176a50 0x562e63176e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.999+0000 7fb0caec69c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562e62f79450 con 0x562e63176a50 2024-09-10T05:36:32.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.999+0000 7fb0c89cc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e63176a50 0x562e63176e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.999+0000 7fb0c89cc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e63176a50 0x562e63176e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51546/0 (socket says 172.21.15.62:51546) 2024-09-10T05:36:32.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:31.999+0000 7fb0c89cc640 1 -- 172.21.15.62:0/1921276136 learned_addr learned my addr 172.21.15.62:0/1921276136 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:32.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.003+0000 7fb0c89cc640 1 -- 172.21.15.62:0/1921276136 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e631774b0 con 0x562e63176a50 2024-09-10T05:36:32.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.003+0000 7fb0c89cc640 1 --2- 172.21.15.62:0/1921276136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e63176a50 0x562e63176e70 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb0b80ea1d0 tx=0x7fb0b80c5dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.003+0000 7fafae7fc640 1 -- 172.21.15.62:0/1921276136 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0b80c55f0 con 0x562e63176a50 2024-09-10T05:36:32.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.003+0000 7fafae7fc640 1 -- 172.21.15.62:0/1921276136 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0b80c5790 con 0x562e63176a50 2024-09-10T05:36:32.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.003+0000 7fb0caec69c0 1 -- 172.21.15.62:0/1921276136 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e63177d10 con 0x562e63176a50 2024-09-10T05:36:32.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.003+0000 7fafae7fc640 1 -- 172.21.15.62:0/1921276136 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0b80d05f0 con 0x562e63176a50 2024-09-10T05:36:32.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.003+0000 7fb0caec69c0 1 -- 172.21.15.62:0/1921276136 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e63178280 con 0x562e63176a50 2024-09-10T05:36:32.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.003+0000 7fafae7fc640 1 -- 172.21.15.62:0/1921276136 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb0b80d0790 con 0x562e63176a50 2024-09-10T05:36:32.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.003+0000 7fafae7fc640 1 --2- 172.21.15.62:0/1921276136 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fafa0039a70 0x7fafa003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.003+0000 7fafae7fc640 1 -- 172.21.15.62:0/1921276136 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fb0b80ee120 con 0x562e63176a50 2024-09-10T05:36:32.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.003+0000 7fb0c81cb640 1 --2- 172.21.15.62:0/1921276136 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fafa0039a70 0x7fafa003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.003+0000 7fb0caec69c0 1 Processor -- start 2024-09-10T05:36:32.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.003+0000 7fb0caec69c0 1 -- start start 2024-09-10T05:36:32.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.003+0000 7fb0c81cb640 1 --2- 172.21.15.62:0/1921276136 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fafa0039a70 0x7fafa003bf30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x562e631607d0 tx=0x7fb0bc00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.003+0000 7fb0caec69c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e631840f0 0x562e631844d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.003+0000 7fb0caec69c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562e63152000 con 0x562e631840f0 2024-09-10T05:36:32.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.003+0000 7fb0c89cc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e631840f0 0x562e631844d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.003+0000 7fb0c89cc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e631840f0 0x562e631844d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51554/0 (socket says 172.21.15.62:51554) 2024-09-10T05:36:32.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.003+0000 7fb0c89cc640 1 -- 172.21.15.62:0/2077605779 learned_addr learned my addr 172.21.15.62:0/2077605779 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:32.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.007+0000 7fb0c89cc640 1 -- 172.21.15.62:0/2077605779 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e63184ac0 con 0x562e631840f0 2024-09-10T05:36:32.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.007+0000 7fb0c89cc640 1 --2- 172.21.15.62:0/2077605779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e631840f0 0x562e631844d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb0b80c6be0 tx=0x7fb0b80e88f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28bf215b9552240b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.007+0000 7faf9ffff640 1 -- 172.21.15.62:0/2077605779 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0b80e83c0 con 0x562e631840f0 2024-09-10T05:36:32.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.007+0000 7faf9ffff640 1 -- 172.21.15.62:0/2077605779 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0b80e8560 con 0x562e631840f0 2024-09-10T05:36:32.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.007+0000 7faf9ffff640 1 -- 172.21.15.62:0/2077605779 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0b80dc7d0 con 0x562e631840f0 2024-09-10T05:36:32.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.007+0000 7fb0caec69c0 1 -- 172.21.15.62:0/2077605779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e631840f0 msgr2=0x562e631844d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.007+0000 7fb0caec69c0 1 --2- 172.21.15.62:0/2077605779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e631840f0 0x562e631844d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb0b80c6be0 tx=0x7fb0b80e88f0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.007+0000 7fb0caec69c0 1 -- 172.21.15.62:0/2077605779 shutdown_connections 2024-09-10T05:36:32.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.007+0000 7fb0caec69c0 1 --2- 172.21.15.62:0/2077605779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e631840f0 0x562e631844d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.007+0000 7fb0caec69c0 1 -- 172.21.15.62:0/2077605779 >> 172.21.15.62:0/2077605779 conn(0x562e6317f4b0 msgr2=0x562e6317d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:32.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.007+0000 7fb0caec69c0 1 -- 172.21.15.62:0/2077605779 shutdown_connections 2024-09-10T05:36:32.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.007+0000 7fb0caec69c0 1 -- 172.21.15.62:0/2077605779 wait complete. 2024-09-10T05:36:32.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.007+0000 7fb0caec69c0 1 Processor -- start 2024-09-10T05:36:32.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.007+0000 7fb0caec69c0 1 -- start start 2024-09-10T05:36:32.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.007+0000 7fb0caec69c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e631840f0 0x562e6318a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.007+0000 7fb0caec69c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562e63182e60 con 0x562e631840f0 2024-09-10T05:36:32.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.007+0000 7fb0c89cc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e631840f0 0x562e6318a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.007+0000 7fb0c89cc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e631840f0 0x562e6318a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51562/0 (socket says 172.21.15.62:51562) 2024-09-10T05:36:32.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.007+0000 7fb0c89cc640 1 -- 172.21.15.62:0/3177212323 learned_addr learned my addr 172.21.15.62:0/3177212323 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:32.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.007+0000 7fb0c89cc640 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e6318a980 con 0x562e631840f0 2024-09-10T05:36:32.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.007+0000 7fb0c89cc640 1 --2- 172.21.15.62:0/3177212323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e631840f0 0x562e6318a420 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb0b80c6be0 tx=0x7fb0b80bfec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.007+0000 7faf9e7fc640 1 -- 172.21.15.62:0/3177212323 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0b8118070 con 0x562e631840f0 2024-09-10T05:36:32.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.007+0000 7faf9e7fc640 1 -- 172.21.15.62:0/3177212323 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0b80e89f0 con 0x562e631840f0 2024-09-10T05:36:32.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.007+0000 7fb0caec69c0 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e6318a980 con 0x562e631840f0 2024-09-10T05:36:32.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.007+0000 7faf9e7fc640 1 -- 172.21.15.62:0/3177212323 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0b80e8d30 con 0x562e631840f0 2024-09-10T05:36:32.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.007+0000 7fb0caec69c0 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e6318a980 con 0x562e631840f0 2024-09-10T05:36:32.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.011+0000 7fb0caec69c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.011+0000 7faf9e7fc640 1 -- 172.21.15.62:0/3177212323 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb0b811b070 con 0x562e631840f0 2024-09-10T05:36:32.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.011+0000 7faf9e7fc640 1 --2- 172.21.15.62:0/3177212323 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7faf94039a70 0x7faf9403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.011+0000 7faf9e7fc640 1 -- 172.21.15.62:0/3177212323 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fb0b8114ae0 con 0x562e631840f0 2024-09-10T05:36:32.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.011+0000 7fb0c81cb640 1 --2- 172.21.15.62:0/3177212323 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7faf94039a70 0x7faf9403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.011+0000 7fb0caec69c0 1 --2- 172.21.15.62:0/3177212323 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x562e63195270 0x562e63197700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.011+0000 7fb0caec69c0 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e63197e50 con 0x562e63195270 2024-09-10T05:36:32.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.011+0000 7fb0c91cd640 1 --2- 172.21.15.62:0/3177212323 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x562e63195270 0x562e63197700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.011+0000 7fb0c81cb640 1 --2- 172.21.15.62:0/3177212323 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7faf94039a70 0x7faf9403bf30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc00ffd0 tx=0x7fb0bc010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.011+0000 7fb0c91cd640 1 --2- 172.21.15.62:0/3177212323 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x562e63195270 0x562e63197700 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.011+0000 7fb0c91cd640 1 -- 172.21.15.62:0/3177212323 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb0c000a4d0 con 0x562e63195270 2024-09-10T05:36:32.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.011+0000 7fb0caec69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:32.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.011+0000 7fb0caec69c0 20 realm 2024-09-10T05:36:32.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.011+0000 7fb0caec69c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.011+0000 7fb0caec69c0 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e63194600 con 0x562e63195270 2024-09-10T05:36:32.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.011+0000 7fb0c91cd640 1 -- 172.21.15.62:0/3177212323 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb0c000a4d0 con 0x562e63195270 2024-09-10T05:36:32.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.011+0000 7fb0caec69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:32.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.011+0000 7fb0caec69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:32.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.011+0000 7fb0caec69c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.011+0000 7fb0caec69c0 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e63198910 con 0x562e63195270 2024-09-10T05:36:32.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.011+0000 7fb0c91cd640 1 -- 172.21.15.62:0/3177212323 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb0c000a4d0 con 0x562e63195270 2024-09-10T05:36:32.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.011+0000 7fb0caec69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:32.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.011+0000 7fb0caec69c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.011+0000 7fb0caec69c0 1 --2- 172.21.15.62:0/3177212323 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x562e631996f0 0x562e6319bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.011+0000 7fb0caec69c0 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e6319c190 con 0x562e631996f0 2024-09-10T05:36:32.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.011+0000 7fb0c89cc640 1 --2- 172.21.15.62:0/3177212323 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x562e631996f0 0x562e6319bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.011+0000 7fb0c89cc640 1 --2- 172.21.15.62:0/3177212323 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x562e631996f0 0x562e6319bae0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.015+0000 7fb0c89cc640 1 -- 172.21.15.62:0/3177212323 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb0b811a030 con 0x562e631996f0 2024-09-10T05:36:32.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.015+0000 7fb0caec69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:32.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.015+0000 7fb0caec69c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.015+0000 7fb0caec69c0 1 --2- 172.21.15.62:0/3177212323 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x562e6319cf40 0x562e6319f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.015+0000 7fb0caec69c0 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e6319f980 con 0x562e6319cf40 2024-09-10T05:36:32.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.015+0000 7fb0c81cb640 1 --2- 172.21.15.62:0/3177212323 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x562e6319cf40 0x562e6319f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.015+0000 7fb0c81cb640 1 --2- 172.21.15.62:0/3177212323 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x562e6319cf40 0x562e6319f330 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.015+0000 7fb0c81cb640 1 -- 172.21.15.62:0/3177212323 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb0bc00f6e0 con 0x562e6319cf40 2024-09-10T05:36:32.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.015+0000 7fb0caec69c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:32.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.015+0000 7fb0caec69c0 20 searching for the correct realm 2024-09-10T05:36:32.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.015+0000 7fb0caec69c0 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e631a1280 con 0x562e6319cf40 2024-09-10T05:36:32.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.015+0000 7fb0c81cb640 1 -- 172.21.15.62:0/3177212323 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0bc00f6e0 con 0x562e6319cf40 2024-09-10T05:36:32.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.015+0000 7fb0c81cb640 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e631a1280 con 0x562e631996f0 2024-09-10T05:36:32.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.015+0000 7fb0c89cc640 1 -- 172.21.15.62:0/3177212323 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b811a030 con 0x562e631996f0 2024-09-10T05:36:32.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.015+0000 7fb0c89cc640 1 --2- 172.21.15.62:0/3177212323 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fb0b811d060 0x7fb0b8100670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.015+0000 7fb0c89cc640 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e631a1280 con 0x7fb0b811d060 2024-09-10T05:36:32.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.015+0000 7fb0c91cd640 1 --2- 172.21.15.62:0/3177212323 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fb0b811d060 0x7fb0b8100670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.015+0000 7fb0c91cd640 1 --2- 172.21.15.62:0/3177212323 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fb0b811d060 0x7fb0b8100670 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.015+0000 7fb0c91cd640 1 -- 172.21.15.62:0/3177212323 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0c000a4d0 con 0x7fb0b811d060 2024-09-10T05:36:32.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.015+0000 7fb0c91cd640 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e631a1280 con 0x562e63195270 2024-09-10T05:36:32.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.015+0000 7fb0c91cd640 1 -- 172.21.15.62:0/3177212323 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0c000a4d0 con 0x562e63195270 2024-09-10T05:36:32.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.015+0000 7fb0c91cd640 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e631a1280 con 0x562e63195270 2024-09-10T05:36:32.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.019+0000 7fb0c91cd640 1 -- 172.21.15.62:0/3177212323 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0c000a4d0 con 0x562e63195270 2024-09-10T05:36:32.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.019+0000 7fb0c91cd640 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e631a1280 con 0x562e6319cf40 2024-09-10T05:36:32.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.019+0000 7fb0c81cb640 1 -- 172.21.15.62:0/3177212323 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0bc00f6e0 con 0x562e6319cf40 2024-09-10T05:36:32.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.019+0000 7fb0c81cb640 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e631a1280 con 0x562e63195270 2024-09-10T05:36:32.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.019+0000 7fb0c91cd640 1 -- 172.21.15.62:0/3177212323 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0c000a4d0 con 0x562e63195270 2024-09-10T05:36:32.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.019+0000 7fb0c91cd640 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e631a1280 con 0x562e631996f0 2024-09-10T05:36:32.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.019+0000 7fb0c89cc640 1 -- 172.21.15.62:0/3177212323 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b811a030 con 0x562e631996f0 2024-09-10T05:36:32.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.019+0000 7fb0c89cc640 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e631a1280 con 0x562e631996f0 2024-09-10T05:36:32.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.019+0000 7fb0c89cc640 1 -- 172.21.15.62:0/3177212323 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b811a030 con 0x562e631996f0 2024-09-10T05:36:32.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.019+0000 7fb0c89cc640 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e631a1280 con 0x562e63195270 2024-09-10T05:36:32.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.019+0000 7fb0c91cd640 1 -- 172.21.15.62:0/3177212323 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0c000a4d0 con 0x562e63195270 2024-09-10T05:36:32.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.019+0000 7fb0c91cd640 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e631a1280 con 0x7fb0b811d060 2024-09-10T05:36:32.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.019+0000 7fb0c91cd640 1 -- 172.21.15.62:0/3177212323 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0c000a4d0 con 0x7fb0b811d060 2024-09-10T05:36:32.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.019+0000 7fb0c91cd640 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e631a1280 con 0x562e63195270 2024-09-10T05:36:32.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.019+0000 7fb0c91cd640 1 -- 172.21.15.62:0/3177212323 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0c000a4d0 con 0x562e63195270 2024-09-10T05:36:32.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.019+0000 7fb0c91cd640 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e631a1280 con 0x7fb0b811d060 2024-09-10T05:36:32.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.019+0000 7fb0c91cd640 1 -- 172.21.15.62:0/3177212323 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb0c000a4d0 con 0x7fb0b811d060 2024-09-10T05:36:32.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.019+0000 7fb0c91cd640 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e631a1280 con 0x562e631996f0 2024-09-10T05:36:32.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.023+0000 7fb0c89cc640 1 -- 172.21.15.62:0/3177212323 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b811a030 con 0x562e631996f0 2024-09-10T05:36:32.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.023+0000 7fb0c89cc640 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e631a1280 con 0x562e6319cf40 2024-09-10T05:36:32.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.023+0000 7fb0c81cb640 1 -- 172.21.15.62:0/3177212323 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0bc00f6e0 con 0x562e6319cf40 2024-09-10T05:36:32.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.023+0000 7fb0c81cb640 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e631a1280 con 0x562e63195270 2024-09-10T05:36:32.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.023+0000 7fb0c91cd640 1 -- 172.21.15.62:0/3177212323 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0c000a4d0 con 0x562e63195270 2024-09-10T05:36:32.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.023+0000 7fb0c91cd640 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e631a1280 con 0x562e631996f0 2024-09-10T05:36:32.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.023+0000 7fb0c89cc640 1 -- 172.21.15.62:0/3177212323 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b811a030 con 0x562e631996f0 2024-09-10T05:36:32.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.023+0000 7fb0c89cc640 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e631a1280 con 0x562e6319cf40 2024-09-10T05:36:32.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.023+0000 7fb0c81cb640 1 -- 172.21.15.62:0/3177212323 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 30 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7fb0bc00f6e0 con 0x562e6319cf40 2024-09-10T05:36:32.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.023+0000 7fb0c81cb640 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e631a1280 con 0x562e63195270 2024-09-10T05:36:32.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.023+0000 7fb0c91cd640 1 -- 172.21.15.62:0/3177212323 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0c000a4d0 con 0x562e63195270 2024-09-10T05:36:32.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.023+0000 7fb0c91cd640 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e631a1280 con 0x562e63195270 2024-09-10T05:36:32.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.023+0000 7fb0c91cd640 1 -- 172.21.15.62:0/3177212323 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb0c000a4d0 con 0x562e63195270 2024-09-10T05:36:32.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.023+0000 7fb0c91cd640 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e631a1280 con 0x562e63195270 2024-09-10T05:36:32.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.023+0000 7fb0c91cd640 1 -- 172.21.15.62:0/3177212323 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0c000a4d0 con 0x562e63195270 2024-09-10T05:36:32.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.023+0000 7fb0c91cd640 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e631a1280 con 0x562e6319cf40 2024-09-10T05:36:32.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.023+0000 7fb0c81cb640 1 -- 172.21.15.62:0/3177212323 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0bc00f6e0 con 0x562e6319cf40 2024-09-10T05:36:32.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.023+0000 7fb0c81cb640 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e631a1280 con 0x7fb0b811d060 2024-09-10T05:36:32.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.023+0000 7fb0c91cd640 1 -- 172.21.15.62:0/3177212323 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0c000a4d0 con 0x7fb0b811d060 2024-09-10T05:36:32.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.023+0000 7fb0c91cd640 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e631a1280 con 0x562e63195270 2024-09-10T05:36:32.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.023+0000 7fb0c91cd640 1 -- 172.21.15.62:0/3177212323 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0c000a4d0 con 0x562e63195270 2024-09-10T05:36:32.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.023+0000 7fb0c91cd640 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e631a1280 con 0x7fb0b811d060 2024-09-10T05:36:32.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.023+0000 7fb0c91cd640 1 -- 172.21.15.62:0/3177212323 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0c000a4d0 con 0x7fb0b811d060 2024-09-10T05:36:32.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.023+0000 7fb0c91cd640 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e631a1280 con 0x562e6319cf40 2024-09-10T05:36:32.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.027+0000 7fb0c81cb640 1 -- 172.21.15.62:0/3177212323 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0bc00f6e0 con 0x562e6319cf40 2024-09-10T05:36:32.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.027+0000 7fb0c81cb640 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e631a1280 con 0x7fb0b811d060 2024-09-10T05:36:32.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.027+0000 7fb0c91cd640 1 -- 172.21.15.62:0/3177212323 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0c000a4d0 con 0x7fb0b811d060 2024-09-10T05:36:32.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.027+0000 7fb0c91cd640 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e631a1280 con 0x562e631996f0 2024-09-10T05:36:32.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.027+0000 7fb0c89cc640 1 -- 172.21.15.62:0/3177212323 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b811a030 con 0x562e631996f0 2024-09-10T05:36:32.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.027+0000 7fb0c89cc640 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e631a1280 con 0x562e631996f0 2024-09-10T05:36:32.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.027+0000 7fb0c89cc640 1 -- 172.21.15.62:0/3177212323 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b811a030 con 0x562e631996f0 2024-09-10T05:36:32.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.027+0000 7fb0c89cc640 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e631a1280 con 0x562e6319cf40 2024-09-10T05:36:32.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.027+0000 7fb0c81cb640 1 -- 172.21.15.62:0/3177212323 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0bc00f6e0 con 0x562e6319cf40 2024-09-10T05:36:32.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.027+0000 7fb0c81cb640 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e631a1280 con 0x562e631996f0 2024-09-10T05:36:32.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.027+0000 7fb0c89cc640 1 -- 172.21.15.62:0/3177212323 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb0b811a030 con 0x562e631996f0 2024-09-10T05:36:32.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.027+0000 7fb0c89cc640 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e631a1280 con 0x562e631996f0 2024-09-10T05:36:32.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.027+0000 7fb0c89cc640 1 -- 172.21.15.62:0/3177212323 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b811a030 con 0x562e631996f0 2024-09-10T05:36:32.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.027+0000 7fb0caec69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:32.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.027+0000 7fb0caec69c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:32.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.027+0000 7fb0caec69c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:32.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.027+0000 7fb0caec69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:32.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.027+0000 7fb0caec69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:32.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.027+0000 7fb0caec69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:32.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.027+0000 7fb0caec69c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.027+0000 7fb0caec69c0 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e631a03a0 con 0x562e63195270 2024-09-10T05:36:32.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.031+0000 7fb0c91cd640 1 -- 172.21.15.62:0/3177212323 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb0c000a4d0 con 0x562e63195270 2024-09-10T05:36:32.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.031+0000 7fb0caec69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:32.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.031+0000 7fb0caec69c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.031+0000 7fb0caec69c0 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e631a0820 con 0x562e631996f0 2024-09-10T05:36:32.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.031+0000 7fb0c89cc640 1 -- 172.21.15.62:0/3177212323 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb0b811a030 con 0x562e631996f0 2024-09-10T05:36:32.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.031+0000 7fb0caec69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:32.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.031+0000 7fb0caec69c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.031+0000 7fb0caec69c0 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e631a0820 con 0x562e6319cf40 2024-09-10T05:36:32.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.031+0000 7fb0c81cb640 1 -- 172.21.15.62:0/3177212323 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb0bc00f6e0 con 0x562e6319cf40 2024-09-10T05:36:32.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.031+0000 7fb0caec69c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:32.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.031+0000 7fb0caec69c0 20 zone default found 2024-09-10T05:36:32.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.031+0000 7fb0caec69c0 4 Realm: () 2024-09-10T05:36:32.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.031+0000 7fb0caec69c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:32.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.031+0000 7fb0caec69c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:32.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.031+0000 7fb0caec69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:32.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.031+0000 7fb0caec69c0 20 zonegroup default 2024-09-10T05:36:32.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.031+0000 7fb0caec69c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.031+0000 7fb0caec69c0 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e631a1750 con 0x7fb0b811d060 2024-09-10T05:36:32.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.031+0000 7fb0c91cd640 1 -- 172.21.15.62:0/3177212323 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb0c000a4d0 con 0x7fb0b811d060 2024-09-10T05:36:32.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.031+0000 7fb0caec69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:32.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.031+0000 7fb0caec69c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.031+0000 7fb0caec69c0 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e631a35e0 con 0x562e6319cf40 2024-09-10T05:36:32.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.031+0000 7fb0c81cb640 1 -- 172.21.15.62:0/3177212323 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb0bc00f6e0 con 0x562e6319cf40 2024-09-10T05:36:32.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.031+0000 7fb0caec69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:32.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.031+0000 7fb0caec69c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.031+0000 7fb0caec69c0 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e631a3aa0 con 0x562e6319cf40 2024-09-10T05:36:32.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.031+0000 7fb0c81cb640 1 -- 172.21.15.62:0/3177212323 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb0bc00f6e0 con 0x562e6319cf40 2024-09-10T05:36:32.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.031+0000 7fb0caec69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:32.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.031+0000 7fb0caec69c0 20 started sync module instance, tier type = 2024-09-10T05:36:32.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.031+0000 7fb0caec69c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:32.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.031+0000 7fb0caec69c0 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e631a0d70 con 0x562e631996f0 2024-09-10T05:36:32.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.035+0000 7fb0c89cc640 1 -- 172.21.15.62:0/3177212323 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b811a030 con 0x562e631996f0 2024-09-10T05:36:32.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.035+0000 7fb0caec69c0 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94757231143200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e631a3f00 con 0x562e631996f0 2024-09-10T05:36:32.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.035+0000 7fb0caec69c0 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e631a4750 con 0x562e63195270 2024-09-10T05:36:32.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.035+0000 7fb0c91cd640 1 -- 172.21.15.62:0/3177212323 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0c000a4d0 con 0x562e63195270 2024-09-10T05:36:32.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.035+0000 7fb0caec69c0 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94757231148800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e631a4fa0 con 0x562e63195270 2024-09-10T05:36:32.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.035+0000 7fb0caec69c0 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e631a5870 con 0x562e631996f0 2024-09-10T05:36:32.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.035+0000 7fb0c89cc640 1 -- 172.21.15.62:0/3177212323 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94757231143200] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b811a030 con 0x562e631996f0 2024-09-10T05:36:32.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.039+0000 7fb0c91cd640 1 -- 172.21.15.62:0/3177212323 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94757231148800] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0c000a4d0 con 0x562e63195270 2024-09-10T05:36:32.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.039+0000 7fb0c89cc640 1 -- 172.21.15.62:0/3177212323 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b811a030 con 0x562e631996f0 2024-09-10T05:36:32.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.039+0000 7fb0caec69c0 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94757231144256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e631a4fa0 con 0x562e631996f0 2024-09-10T05:36:32.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.039+0000 7fb0caec69c0 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e631a6110 con 0x7fb0b811d060 2024-09-10T05:36:32.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.039+0000 7fb0c91cd640 1 -- 172.21.15.62:0/3177212323 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0c000a4d0 con 0x7fb0b811d060 2024-09-10T05:36:32.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.039+0000 7fb0caec69c0 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94757231156320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e631a4fa0 con 0x7fb0b811d060 2024-09-10T05:36:32.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.039+0000 7fb0caec69c0 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e631a6b90 con 0x562e631996f0 2024-09-10T05:36:32.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.039+0000 7fb0c89cc640 1 -- 172.21.15.62:0/3177212323 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94757231144256] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b811a030 con 0x562e631996f0 2024-09-10T05:36:32.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.043+0000 7fb0c91cd640 1 -- 172.21.15.62:0/3177212323 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94757231156320] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0c000a4d0 con 0x7fb0b811d060 2024-09-10T05:36:32.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.043+0000 7fb0c89cc640 1 -- 172.21.15.62:0/3177212323 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b811a030 con 0x562e631996f0 2024-09-10T05:36:32.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.043+0000 7fb0caec69c0 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94757231157376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e631a66a0 con 0x562e631996f0 2024-09-10T05:36:32.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.043+0000 7fb0caec69c0 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e631a6f90 con 0x562e6319cf40 2024-09-10T05:36:32.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.043+0000 7fb0c81cb640 1 -- 172.21.15.62:0/3177212323 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0bc00f6e0 con 0x562e6319cf40 2024-09-10T05:36:32.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.043+0000 7fb0caec69c0 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94757231158944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e631a6ac0 con 0x562e6319cf40 2024-09-10T05:36:32.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.043+0000 7fb0caec69c0 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e631a7ed0 con 0x562e6319cf40 2024-09-10T05:36:32.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.043+0000 7fb0c89cc640 1 -- 172.21.15.62:0/3177212323 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94757231157376] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b811a030 con 0x562e631996f0 2024-09-10T05:36:32.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.047+0000 7fb0c81cb640 1 -- 172.21.15.62:0/3177212323 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94757231158944] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0bc00f6e0 con 0x562e6319cf40 2024-09-10T05:36:32.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.051+0000 7fb0c81cb640 1 -- 172.21.15.62:0/3177212323 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0bc00f6e0 con 0x562e6319cf40 2024-09-10T05:36:32.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.051+0000 7fb0caec69c0 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94757231162240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e631a7e90 con 0x562e6319cf40 2024-09-10T05:36:32.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.051+0000 7fb0caec69c0 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e631a8770 con 0x7fb0b811d060 2024-09-10T05:36:32.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.051+0000 7fb0c91cd640 1 -- 172.21.15.62:0/3177212323 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0c000a4d0 con 0x7fb0b811d060 2024-09-10T05:36:32.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.051+0000 7fb0caec69c0 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94757231166144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e631a8b90 con 0x7fb0b811d060 2024-09-10T05:36:32.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.051+0000 7fb0caec69c0 20 add_watcher() i=0 2024-09-10T05:36:32.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.051+0000 7fb0caec69c0 20 add_watcher() i=1 2024-09-10T05:36:32.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.051+0000 7fb0caec69c0 20 add_watcher() i=2 2024-09-10T05:36:32.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.051+0000 7fb0caec69c0 20 add_watcher() i=3 2024-09-10T05:36:32.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.051+0000 7fb0caec69c0 20 add_watcher() i=4 2024-09-10T05:36:32.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.051+0000 7fb0caec69c0 20 add_watcher() i=5 2024-09-10T05:36:32.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.051+0000 7fb0c81cb640 1 -- 172.21.15.62:0/3177212323 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94757231162240] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0bc00f6e0 con 0x562e6319cf40 2024-09-10T05:36:32.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.051+0000 7fb0caec69c0 20 add_watcher() i=6 2024-09-10T05:36:32.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.055+0000 7fb0c91cd640 1 -- 172.21.15.62:0/3177212323 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94757231166144] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0c000a4d0 con 0x7fb0b811d060 2024-09-10T05:36:32.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.055+0000 7fb0caec69c0 20 add_watcher() i=7 2024-09-10T05:36:32.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.055+0000 7fb0caec69c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:32.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.055+0000 7fb0caec69c0 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e631ab820 con 0x562e63195270 2024-09-10T05:36:32.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.055+0000 7fb0c91cd640 1 -- 172.21.15.62:0/3177212323 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb0c000a4d0 con 0x562e63195270 2024-09-10T05:36:32.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.055+0000 7fb0caec69c0 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94757231163808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e631a8b90 con 0x562e63195270 2024-09-10T05:36:32.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.059+0000 7fb0c91cd640 1 -- 172.21.15.62:0/3177212323 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94757231163808] v30'68 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb0c000a4d0 con 0x562e63195270 2024-09-10T05:36:32.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.059+0000 7faf7efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:32.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.059+0000 7fb0caec69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:32.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.059+0000 7fb0caec69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:32.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.059+0000 7fb0caec69c0 5 note: GC not initialized 2024-09-10T05:36:32.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.059+0000 7faf7dfe3640 20 reqs_thread_entry: start 2024-09-10T05:36:32.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.059+0000 7fb0caec69c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:32.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.059+0000 7fb0caec69c0 20 Filter name: none 2024-09-10T05:36:32.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.059+0000 7faeef7fe640 20 reqs_thread_entry: start 2024-09-10T05:36:32.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.059+0000 7fb0caec69c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.059+0000 7fb0caec69c0 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e631ce680 con 0x562e63195270 2024-09-10T05:36:32.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.059+0000 7fb0c91cd640 1 -- 172.21.15.62:0/3177212323 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb0c000a4d0 con 0x562e63195270 2024-09-10T05:36:32.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.059+0000 7fb0caec69c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:36:32.064 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T05:36:30.893777Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:36:30.893760Z","tags":[],"group_ids":[]} 2024-09-10T05:36:32.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.059+0000 7faf7efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:32.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.059+0000 7fb0caec69c0 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94757231163808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e631cd4d0 con 0x562e63195270 2024-09-10T05:36:32.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.063+0000 7fb0c91cd640 1 -- 172.21.15.62:0/3177212323 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94757231163808] v30'69 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb0c000a4d0 con 0x562e63195270 2024-09-10T05:36:32.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.063+0000 7fb0caec69c0 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94757231143200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e631a79a0 con 0x562e631996f0 2024-09-10T05:36:32.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.063+0000 7fb0c89cc640 1 -- 172.21.15.62:0/3177212323 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94757231143200] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b811a030 con 0x562e631996f0 2024-09-10T05:36:32.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.063+0000 7fb0caec69c0 20 remove_watcher() i=0 2024-09-10T05:36:32.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.063+0000 7fb0caec69c0 2 removed watcher, disabling cache 2024-09-10T05:36:32.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.063+0000 7fb0caec69c0 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94757231148800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e631a79a0 con 0x562e63195270 2024-09-10T05:36:32.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.067+0000 7fb0c91cd640 1 -- 172.21.15.62:0/3177212323 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94757231148800] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0c000a4d0 con 0x562e63195270 2024-09-10T05:36:32.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.067+0000 7fb0caec69c0 20 remove_watcher() i=1 2024-09-10T05:36:32.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.067+0000 7fb0caec69c0 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94757231144256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e631a79a0 con 0x562e631996f0 2024-09-10T05:36:32.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.067+0000 7fb0c89cc640 1 -- 172.21.15.62:0/3177212323 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94757231144256] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b811a030 con 0x562e631996f0 2024-09-10T05:36:32.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.067+0000 7fb0caec69c0 20 remove_watcher() i=2 2024-09-10T05:36:32.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.067+0000 7fb0caec69c0 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94757231156320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e631a79a0 con 0x7fb0b811d060 2024-09-10T05:36:32.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.071+0000 7fb0c91cd640 1 -- 172.21.15.62:0/3177212323 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94757231156320] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0c000a4d0 con 0x7fb0b811d060 2024-09-10T05:36:32.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.071+0000 7fb0caec69c0 20 remove_watcher() i=3 2024-09-10T05:36:32.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.071+0000 7fb0caec69c0 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94757231157376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e631a79a0 con 0x562e631996f0 2024-09-10T05:36:32.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.071+0000 7fb0c89cc640 1 -- 172.21.15.62:0/3177212323 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94757231157376] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b811a030 con 0x562e631996f0 2024-09-10T05:36:32.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.071+0000 7fb0caec69c0 20 remove_watcher() i=4 2024-09-10T05:36:32.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.071+0000 7fb0caec69c0 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94757231158944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e631a79a0 con 0x562e6319cf40 2024-09-10T05:36:32.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.071+0000 7fb0c81cb640 1 -- 172.21.15.62:0/3177212323 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94757231158944] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0bc00f6e0 con 0x562e6319cf40 2024-09-10T05:36:32.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.071+0000 7fb0caec69c0 20 remove_watcher() i=5 2024-09-10T05:36:32.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.071+0000 7fb0caec69c0 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94757231162240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e631a79a0 con 0x562e6319cf40 2024-09-10T05:36:32.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.075+0000 7fb0c81cb640 1 -- 172.21.15.62:0/3177212323 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94757231162240] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0bc00f6e0 con 0x562e6319cf40 2024-09-10T05:36:32.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.075+0000 7fb0caec69c0 20 remove_watcher() i=6 2024-09-10T05:36:32.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.075+0000 7fb0caec69c0 1 -- 172.21.15.62:0/3177212323 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94757231166144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e631a7380 con 0x7fb0b811d060 2024-09-10T05:36:32.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.075+0000 7fb0c91cd640 1 -- 172.21.15.62:0/3177212323 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94757231166144] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0c000a4d0 con 0x7fb0b811d060 2024-09-10T05:36:32.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.075+0000 7fb0caec69c0 20 remove_watcher() i=7 2024-09-10T05:36:32.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.075+0000 7fb0caec69c0 1 -- 172.21.15.62:0/3177212323 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x562e631996f0 msgr2=0x562e6319bae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.075+0000 7fb0caec69c0 1 --2- 172.21.15.62:0/3177212323 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x562e631996f0 0x562e6319bae0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.075+0000 7fb0caec69c0 1 -- 172.21.15.62:0/3177212323 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x562e63195270 msgr2=0x562e63197700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.075+0000 7fb0caec69c0 1 --2- 172.21.15.62:0/3177212323 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x562e63195270 0x562e63197700 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.075+0000 7fb0caec69c0 1 -- 172.21.15.62:0/3177212323 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fb0b811d060 msgr2=0x7fb0b8100670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.075+0000 7fb0caec69c0 1 --2- 172.21.15.62:0/3177212323 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fb0b811d060 0x7fb0b8100670 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.075+0000 7fb0caec69c0 1 -- 172.21.15.62:0/3177212323 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x562e6319cf40 msgr2=0x562e6319f330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.075+0000 7fb0caec69c0 1 --2- 172.21.15.62:0/3177212323 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x562e6319cf40 0x562e6319f330 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.075+0000 7fb0caec69c0 1 -- 172.21.15.62:0/3177212323 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7faf94039a70 msgr2=0x7faf9403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.075+0000 7fb0caec69c0 1 --2- 172.21.15.62:0/3177212323 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7faf94039a70 0x7faf9403bf30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc00ffd0 tx=0x7fb0bc010000 comp rx=0 tx=0).stop 2024-09-10T05:36:32.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.075+0000 7fb0caec69c0 1 -- 172.21.15.62:0/3177212323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e631840f0 msgr2=0x562e6318a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.075+0000 7fb0c91cd640 1 -- 172.21.15.62:0/3177212323 reap_dead start 2024-09-10T05:36:32.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.075+0000 7fb0caec69c0 1 --2- 172.21.15.62:0/3177212323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e631840f0 0x562e6318a420 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb0b80c6be0 tx=0x7fb0b80bfec0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.075+0000 7fb0caec69c0 1 -- 172.21.15.62:0/3177212323 shutdown_connections 2024-09-10T05:36:32.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.075+0000 7fb0caec69c0 1 --2- 172.21.15.62:0/3177212323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e631840f0 0x562e6318a420 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.075+0000 7fb0caec69c0 1 -- 172.21.15.62:0/3177212323 >> 172.21.15.62:0/3177212323 conn(0x562e6317f4b0 msgr2=0x562e6317d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:32.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.075+0000 7fb0caec69c0 1 -- 172.21.15.62:0/3177212323 shutdown_connections 2024-09-10T05:36:32.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.075+0000 7fb0caec69c0 1 -- 172.21.15.62:0/3177212323 wait complete. 2024-09-10T05:36:32.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.075+0000 7fb0caec69c0 1 -- 172.21.15.62:0/1921276136 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fafa0039a70 msgr2=0x7fafa003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.075+0000 7fb0caec69c0 1 --2- 172.21.15.62:0/1921276136 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fafa0039a70 0x7fafa003bf30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x562e631607d0 tx=0x7fb0bc00f000 comp rx=0 tx=0).stop 2024-09-10T05:36:32.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.075+0000 7fb0caec69c0 1 -- 172.21.15.62:0/1921276136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e63176a50 msgr2=0x562e63176e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.075+0000 7fb0caec69c0 1 --2- 172.21.15.62:0/1921276136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e63176a50 0x562e63176e70 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb0b80ea1d0 tx=0x7fb0b80c5dc0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.075+0000 7fb0caec69c0 1 -- 172.21.15.62:0/1921276136 shutdown_connections 2024-09-10T05:36:32.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.075+0000 7fb0caec69c0 1 --2- 172.21.15.62:0/1921276136 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fafa0039a70 0x7fafa003bf30 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.075+0000 7fb0caec69c0 1 --2- 172.21.15.62:0/1921276136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e63176a50 0x562e63176e70 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.075+0000 7fb0caec69c0 1 -- 172.21.15.62:0/1921276136 >> 172.21.15.62:0/1921276136 conn(0x562e6316c400 msgr2=0x562e6316c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:32.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.075+0000 7fb0caec69c0 1 -- 172.21.15.62:0/1921276136 shutdown_connections 2024-09-10T05:36:32.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.075+0000 7fb0caec69c0 1 -- 172.21.15.62:0/1921276136 wait complete. 2024-09-10T05:36:32.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.075+0000 7fb0caec69c0 1 -- 172.21.15.62:0/4214703471 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x562e63160f30 msgr2=0x562e631633f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.075+0000 7fb0caec69c0 1 --2- 172.21.15.62:0/4214703471 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x562e63160f30 0x562e631633f0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.075+0000 7fb0caec69c0 1 -- 172.21.15.62:0/4214703471 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x562e63069340 msgr2=0x562e6315fef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.075+0000 7fb0caec69c0 1 --2- 172.21.15.62:0/4214703471 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x562e63069340 0x562e6315fef0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.075+0000 7fb0caec69c0 1 -- 172.21.15.62:0/4214703471 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x562e63165920 msgr2=0x562e63167d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.075+0000 7fb0caec69c0 1 --2- 172.21.15.62:0/4214703471 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x562e63165920 0x562e63167d10 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.075+0000 7fb0caec69c0 1 -- 172.21.15.62:0/4214703471 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fafb0039a70 msgr2=0x7fafb003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.075+0000 7fb0caec69c0 1 --2- 172.21.15.62:0/4214703471 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fafb0039a70 0x7fafb003bf30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc001e90 tx=0x7fb0bc0013f0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.075+0000 7fb0caec69c0 1 -- 172.21.15.62:0/4214703471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e63066200 msgr2=0x562e63158dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.075+0000 7fb0caec69c0 1 --2- 172.21.15.62:0/4214703471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e63066200 0x562e63158dd0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb0b801b170 tx=0x7fb0b80180e0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.075+0000 7fb0c91cd640 1 -- 172.21.15.62:0/4214703471 reap_dead start 2024-09-10T05:36:32.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.075+0000 7fb0caec69c0 1 -- 172.21.15.62:0/4214703471 shutdown_connections 2024-09-10T05:36:32.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.075+0000 7fb0caec69c0 1 -- 172.21.15.62:0/4214703471 >> 172.21.15.62:0/4214703471 conn(0x562e62fd9b10 msgr2=0x562e6314bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:32.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.075+0000 7fb0caec69c0 1 -- 172.21.15.62:0/4214703471 shutdown_connections 2024-09-10T05:36:32.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.075+0000 7fb0caec69c0 1 -- 172.21.15.62:0/4214703471 wait complete. 2024-09-10T05:36:32.091 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T05:36:30.893777Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:36:30.893760Z', 'tags': [], 'group_ids': []} 2024-09-10T05:36:32.092 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-10T05:36:32.092 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-10T05:36:32.092 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2024-09-10T05:36:32.174 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:32.174 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:32.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.171+0000 7fbec7eb49c0 1 Processor -- start 2024-09-10T05:36:32.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.171+0000 7fbec7eb49c0 1 -- start start 2024-09-10T05:36:32.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.171+0000 7fbec7eb49c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55878e1210d0 0x55878e1234c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.171+0000 7fbec7eb49c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55878dfd19c0 con 0x55878e11cf30 2024-09-10T05:36:32.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.171+0000 7fbec7eb49c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x55878e0216d0 con 0x55878e1210d0 2024-09-10T05:36:32.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.171+0000 7fbec51b9640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55878e1210d0 0x55878e1234c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.171+0000 7fbec59ba640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x55878e11cf30 0x55878e11d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:38546/0 (socket says 172.21.15.62:38546) 2024-09-10T05:36:32.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.171+0000 7fbec59ba640 1 -- 172.21.15.62:0/49814141 learned_addr learned my addr 172.21.15.62:0/49814141 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-10T05:36:32.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.175+0000 7fbec51b9640 1 -- 172.21.15.62:0/49814141 >> v1:172.21.15.2:6789/0 conn(0x55878e11cf30 legacy=0x55878e11d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.175+0000 7fbec51b9640 1 -- 172.21.15.62:0/49814141 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55878dfc5ca0 con 0x55878e1210d0 2024-09-10T05:36:32.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.175+0000 7fbec51b9640 1 --2- 172.21.15.62:0/49814141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878e1210d0 0x55878e1234c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbebc00a480 tx=0x7fbebc01b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a767214529d8a5d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.175+0000 7fbec49b8640 1 -- 172.21.15.62:0/49814141 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbebc0aa570 con 0x55878e1210d0 2024-09-10T05:36:32.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.175+0000 7fbec49b8640 1 -- 172.21.15.62:0/49814141 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbebc0af070 con 0x55878e1210d0 2024-09-10T05:36:32.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.175+0000 7fbec49b8640 1 -- 172.21.15.62:0/49814141 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbebc0aa860 con 0x55878e1210d0 2024-09-10T05:36:32.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.175+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/49814141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878e1210d0 msgr2=0x55878e1234c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.175+0000 7fbec7eb49c0 1 --2- 172.21.15.62:0/49814141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878e1210d0 0x55878e1234c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbebc00a480 tx=0x7fbebc01b310 comp rx=0 tx=0).stop 2024-09-10T05:36:32.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.175+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/49814141 shutdown_connections 2024-09-10T05:36:32.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.175+0000 7fbec7eb49c0 1 --2- 172.21.15.62:0/49814141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878e1210d0 0x55878e1234c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.175+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/49814141 >> 172.21.15.62:0/49814141 conn(0x55878e118a50 msgr2=0x55878e11ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:32.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.175+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/49814141 shutdown_connections 2024-09-10T05:36:32.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.175+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/49814141 wait complete. 2024-09-10T05:36:32.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.191+0000 7fbec7eb49c0 1 Processor -- start 2024-09-10T05:36:32.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.191+0000 7fbec7eb49c0 1 -- start start 2024-09-10T05:36:32.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.191+0000 7fbec7eb49c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878e11cf30 0x55878e2087b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.191+0000 7fbec7eb49c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55878e025680 con 0x55878e11cf30 2024-09-10T05:36:32.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.191+0000 7fbec59ba640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878e11cf30 0x55878e2087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.191+0000 7fbec59ba640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878e11cf30 0x55878e2087b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51574/0 (socket says 172.21.15.62:51574) 2024-09-10T05:36:32.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.191+0000 7fbec59ba640 1 -- 172.21.15.62:0/2801539516 learned_addr learned my addr 172.21.15.62:0/2801539516 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:32.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.195+0000 7fbec59ba640 1 -- 172.21.15.62:0/2801539516 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55878dfa0da0 con 0x55878e11cf30 2024-09-10T05:36:32.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.195+0000 7fbec59ba640 1 --2- 172.21.15.62:0/2801539516 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878e11cf30 0x55878e2087b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbec0001810 tx=0x7fbec0001cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f248565f8d1fa0c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.195+0000 7fbdb3e07640 1 -- 172.21.15.62:0/2801539516 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbec0004530 con 0x55878e11cf30 2024-09-10T05:36:32.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.195+0000 7fbdb3e07640 1 -- 172.21.15.62:0/2801539516 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbec00046d0 con 0x55878e11cf30 2024-09-10T05:36:32.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.195+0000 7fbdb3e07640 1 -- 172.21.15.62:0/2801539516 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbec00049f0 con 0x55878e11cf30 2024-09-10T05:36:32.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.195+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/2801539516 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878e11cf30 msgr2=0x55878e2087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.195+0000 7fbec7eb49c0 1 --2- 172.21.15.62:0/2801539516 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878e11cf30 0x55878e2087b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbec0001810 tx=0x7fbec0001cd0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.195+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/2801539516 shutdown_connections 2024-09-10T05:36:32.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.195+0000 7fbec7eb49c0 1 --2- 172.21.15.62:0/2801539516 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878e11cf30 0x55878e2087b0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.195+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/2801539516 >> 172.21.15.62:0/2801539516 conn(0x55878e118a50 msgr2=0x55878e204450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:32.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.195+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/2801539516 shutdown_connections 2024-09-10T05:36:32.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.195+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/2801539516 wait complete. 2024-09-10T05:36:32.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.195+0000 7fbec7eb49c0 1 Processor -- start 2024-09-10T05:36:32.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.195+0000 7fbec7eb49c0 1 -- start start 2024-09-10T05:36:32.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.195+0000 7fbec7eb49c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878e11cf30 0x55878e20fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.195+0000 7fbec7eb49c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55878dfc7a50 con 0x55878e11cf30 2024-09-10T05:36:32.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.195+0000 7fbec59ba640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878e11cf30 0x55878e20fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.195+0000 7fbec59ba640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878e11cf30 0x55878e20fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51588/0 (socket says 172.21.15.62:51588) 2024-09-10T05:36:32.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.195+0000 7fbec59ba640 1 -- 172.21.15.62:0/1206957929 learned_addr learned my addr 172.21.15.62:0/1206957929 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:32.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.195+0000 7fbec59ba640 1 -- 172.21.15.62:0/1206957929 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55878e210380 con 0x55878e11cf30 2024-09-10T05:36:32.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.195+0000 7fbec59ba640 1 --2- 172.21.15.62:0/1206957929 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878e11cf30 0x55878e20fe20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x55878e2097a0 tx=0x7fbec0001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.195+0000 7fbdb2604640 1 -- 172.21.15.62:0/1206957929 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbec0013760 con 0x55878e11cf30 2024-09-10T05:36:32.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.195+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/1206957929 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55878e210610 con 0x55878e11cf30 2024-09-10T05:36:32.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.195+0000 7fbdb2604640 1 -- 172.21.15.62:0/1206957929 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbec0013920 con 0x55878e11cf30 2024-09-10T05:36:32.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.195+0000 7fbdb2604640 1 -- 172.21.15.62:0/1206957929 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbec0013c40 con 0x55878e11cf30 2024-09-10T05:36:32.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.195+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/1206957929 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55878e210fc0 con 0x55878e11cf30 2024-09-10T05:36:32.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.199+0000 7fbdb2604640 1 -- 172.21.15.62:0/1206957929 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fbec0010070 con 0x55878e11cf30 2024-09-10T05:36:32.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.199+0000 7fbdb2604640 1 --2- 172.21.15.62:0/1206957929 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fbdac039a70 0x7fbdac03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.199+0000 7fbdb2604640 1 -- 172.21.15.62:0/1206957929 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fbec0018070 con 0x55878e11cf30 2024-09-10T05:36:32.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.199+0000 7fbec51b9640 1 --2- 172.21.15.62:0/1206957929 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fbdac039a70 0x7fbdac03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.199+0000 7fbec7eb49c0 1 --2- 172.21.15.62:0/1206957929 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55878e1210d0 0x55878e216f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.199+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/1206957929 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55878e2174d0 con 0x55878e1210d0 2024-09-10T05:36:32.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.199+0000 7fbec61bb640 1 --2- 172.21.15.62:0/1206957929 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55878e1210d0 0x55878e216f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.199+0000 7fbec51b9640 1 --2- 172.21.15.62:0/1206957929 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fbdac039a70 0x7fbdac03bf30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbebc0ae000 tx=0x7fbebc0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.199+0000 7fbec61bb640 1 --2- 172.21.15.62:0/1206957929 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55878e1210d0 0x55878e216f90 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.199+0000 7fbec61bb640 1 -- 172.21.15.62:0/1206957929 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbeb80083f0 con 0x55878e1210d0 2024-09-10T05:36:32.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.199+0000 7fbec7eb49c0 1 --2- 172.21.15.62:0/1206957929 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55878e218230 0x55878e21a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.199+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/1206957929 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55878e21abf0 con 0x55878e218230 2024-09-10T05:36:32.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.199+0000 7fbec59ba640 1 --2- 172.21.15.62:0/1206957929 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55878e218230 0x55878e21a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.199+0000 7fbec59ba640 1 --2- 172.21.15.62:0/1206957929 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55878e218230 0x55878e21a620 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.203+0000 7fbec59ba640 1 -- 172.21.15.62:0/1206957929 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbec001b030 con 0x55878e218230 2024-09-10T05:36:32.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.203+0000 7fbec7eb49c0 1 --2- 172.21.15.62:0/1206957929 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55878e21c9b0 0x55878e21eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.203+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/1206957929 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55878e21f490 con 0x55878e21c9b0 2024-09-10T05:36:32.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.203+0000 7fbec51b9640 1 --2- 172.21.15.62:0/1206957929 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55878e21c9b0 0x55878e21eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.203+0000 7fbec51b9640 1 --2- 172.21.15.62:0/1206957929 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55878e21c9b0 0x55878e21eda0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.203+0000 7fbec51b9640 1 -- 172.21.15.62:0/1206957929 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbebc0a8070 con 0x55878e21c9b0 2024-09-10T05:36:32.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.203+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/1206957929 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55878e21b850 con 0x55878e218230 2024-09-10T05:36:32.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.203+0000 7fbec59ba640 1 -- 172.21.15.62:0/1206957929 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbec001b030 con 0x55878e218230 2024-09-10T05:36:32.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.203+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/1206957929 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55878e21bcf0 con 0x55878e21c9b0 2024-09-10T05:36:32.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.203+0000 7fbec51b9640 1 -- 172.21.15.62:0/1206957929 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbebc0a8070 con 0x55878e21c9b0 2024-09-10T05:36:32.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.203+0000 7fbec7eb49c0 1 Processor -- start 2024-09-10T05:36:32.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.203+0000 7fbec7eb49c0 1 -- start start 2024-09-10T05:36:32.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.203+0000 7fbec7eb49c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878e22dac0 0x55878e22dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.203+0000 7fbec7eb49c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55878e032450 con 0x55878e22dac0 2024-09-10T05:36:32.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.203+0000 7fbec59ba640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878e22dac0 0x55878e22dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.203+0000 7fbec59ba640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878e22dac0 0x55878e22dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51592/0 (socket says 172.21.15.62:51592) 2024-09-10T05:36:32.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.203+0000 7fbec59ba640 1 -- 172.21.15.62:0/2709784680 learned_addr learned my addr 172.21.15.62:0/2709784680 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:32.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.203+0000 7fbec59ba640 1 -- 172.21.15.62:0/2709784680 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55878e22e520 con 0x55878e22dac0 2024-09-10T05:36:32.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.207+0000 7fbec59ba640 1 --2- 172.21.15.62:0/2709784680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878e22dac0 0x55878e22dee0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbec004e8d0 tx=0x7fbec0012af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.207+0000 7fbdab7fe640 1 -- 172.21.15.62:0/2709784680 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbec004a070 con 0x55878e22dac0 2024-09-10T05:36:32.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.207+0000 7fbdab7fe640 1 -- 172.21.15.62:0/2709784680 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbec001da10 con 0x55878e22dac0 2024-09-10T05:36:32.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.207+0000 7fbdab7fe640 1 -- 172.21.15.62:0/2709784680 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbec003e040 con 0x55878e22dac0 2024-09-10T05:36:32.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.207+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/2709784680 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55878e22ed80 con 0x55878e22dac0 2024-09-10T05:36:32.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.207+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/2709784680 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55878e22f2f0 con 0x55878e22dac0 2024-09-10T05:36:32.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.207+0000 7fbdab7fe640 1 -- 172.21.15.62:0/2709784680 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fbec0029d10 con 0x55878e22dac0 2024-09-10T05:36:32.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.207+0000 7fbdab7fe640 1 --2- 172.21.15.62:0/2709784680 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fbda0039b10 0x7fbda003bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.207+0000 7fbdab7fe640 1 -- 172.21.15.62:0/2709784680 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fbec0045b20 con 0x55878e22dac0 2024-09-10T05:36:32.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.207+0000 7fbec51b9640 1 --2- 172.21.15.62:0/2709784680 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fbda0039b10 0x7fbda003bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.207+0000 7fbec7eb49c0 1 Processor -- start 2024-09-10T05:36:32.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.207+0000 7fbec7eb49c0 1 -- start start 2024-09-10T05:36:32.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.207+0000 7fbec51b9640 1 --2- 172.21.15.62:0/2709784680 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fbda0039b10 0x7fbda003bfd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x55878e21b820 tx=0x7fbebc005a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.207+0000 7fbec7eb49c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878e23b250 0x55878e23b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.207+0000 7fbec7eb49c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55878e208fe0 con 0x55878e23b250 2024-09-10T05:36:32.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.207+0000 7fbec59ba640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878e23b250 0x55878e23b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.207+0000 7fbec59ba640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878e23b250 0x55878e23b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51596/0 (socket says 172.21.15.62:51596) 2024-09-10T05:36:32.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.207+0000 7fbec59ba640 1 -- 172.21.15.62:0/4029721249 learned_addr learned my addr 172.21.15.62:0/4029721249 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:32.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.207+0000 7fbec59ba640 1 -- 172.21.15.62:0/4029721249 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55878e23bc40 con 0x55878e23b250 2024-09-10T05:36:32.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.207+0000 7fbec59ba640 1 --2- 172.21.15.62:0/4029721249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878e23b250 0x55878e23b650 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fbec001d930 tx=0x7fbec0045ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c708d0560b2b9782 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.211+0000 7fbda97fa640 1 -- 172.21.15.62:0/4029721249 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbec001d350 con 0x55878e23b250 2024-09-10T05:36:32.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.211+0000 7fbda97fa640 1 -- 172.21.15.62:0/4029721249 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbec004e3f0 con 0x55878e23b250 2024-09-10T05:36:32.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.211+0000 7fbda97fa640 1 -- 172.21.15.62:0/4029721249 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbec001d4f0 con 0x55878e23b250 2024-09-10T05:36:32.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.211+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4029721249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878e23b250 msgr2=0x55878e23b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.211+0000 7fbec7eb49c0 1 --2- 172.21.15.62:0/4029721249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878e23b250 0x55878e23b650 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fbec001d930 tx=0x7fbec0045ef0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.211+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4029721249 shutdown_connections 2024-09-10T05:36:32.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.211+0000 7fbec7eb49c0 1 --2- 172.21.15.62:0/4029721249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878e23b250 0x55878e23b650 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.211+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4029721249 >> 172.21.15.62:0/4029721249 conn(0x55878e236610 msgr2=0x55878e234850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:32.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.211+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4029721249 shutdown_connections 2024-09-10T05:36:32.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.211+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4029721249 wait complete. 2024-09-10T05:36:32.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.211+0000 7fbec7eb49c0 1 Processor -- start 2024-09-10T05:36:32.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.211+0000 7fbec7eb49c0 1 -- start start 2024-09-10T05:36:32.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.211+0000 7fbec7eb49c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878e23b250 0x55878e2415a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.211+0000 7fbec7eb49c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55878e239fc0 con 0x55878e23b250 2024-09-10T05:36:32.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.211+0000 7fbec59ba640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878e23b250 0x55878e2415a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.211+0000 7fbec59ba640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878e23b250 0x55878e2415a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51598/0 (socket says 172.21.15.62:51598) 2024-09-10T05:36:32.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.211+0000 7fbec59ba640 1 -- 172.21.15.62:0/4174708414 learned_addr learned my addr 172.21.15.62:0/4174708414 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:32.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.211+0000 7fbec59ba640 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55878e241b00 con 0x55878e23b250 2024-09-10T05:36:32.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.211+0000 7fbec59ba640 1 --2- 172.21.15.62:0/4174708414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878e23b250 0x55878e2415a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbec0004fa0 tx=0x7fbec000ffd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.211+0000 7fbd977fe640 1 -- 172.21.15.62:0/4174708414 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbec001a470 con 0x55878e23b250 2024-09-10T05:36:32.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.211+0000 7fbd977fe640 1 -- 172.21.15.62:0/4174708414 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbec0029470 con 0x55878e23b250 2024-09-10T05:36:32.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.211+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55878e241b00 con 0x55878e23b250 2024-09-10T05:36:32.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.211+0000 7fbd977fe640 1 -- 172.21.15.62:0/4174708414 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbec0029660 con 0x55878e23b250 2024-09-10T05:36:32.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.211+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55878e241b00 con 0x55878e23b250 2024-09-10T05:36:32.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.215+0000 7fbd977fe640 1 -- 172.21.15.62:0/4174708414 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fbec0063040 con 0x55878e23b250 2024-09-10T05:36:32.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.215+0000 7fbd977fe640 1 --2- 172.21.15.62:0/4174708414 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fbd90039a70 0x7fbd9003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.215+0000 7fbd977fe640 1 -- 172.21.15.62:0/4174708414 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fbec0072ad0 con 0x55878e23b250 2024-09-10T05:36:32.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.215+0000 7fbec51b9640 1 --2- 172.21.15.62:0/4174708414 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fbd90039a70 0x7fbd9003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.215+0000 7fbec7eb49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.215+0000 7fbec7eb49c0 1 --2- 172.21.15.62:0/4174708414 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55878e24c4d0 0x55878e24e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.215+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55878e24f0e0 con 0x55878e24c4d0 2024-09-10T05:36:32.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.215+0000 7fbec61bb640 1 --2- 172.21.15.62:0/4174708414 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55878e24c4d0 0x55878e24e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.215+0000 7fbec51b9640 1 --2- 172.21.15.62:0/4174708414 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fbd90039a70 0x7fbd9003bf30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbebc01b350 tx=0x7fbebc0a8000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.215+0000 7fbec61bb640 1 --2- 172.21.15.62:0/4174708414 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55878e24c4d0 0x55878e24e990 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.215+0000 7fbec61bb640 1 -- 172.21.15.62:0/4174708414 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbeb80083f0 con 0x55878e24c4d0 2024-09-10T05:36:32.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.215+0000 7fbec7eb49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:32.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.215+0000 7fbec7eb49c0 20 realm 2024-09-10T05:36:32.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.215+0000 7fbec7eb49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.215+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55878e24b800 con 0x55878e24c4d0 2024-09-10T05:36:32.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.215+0000 7fbec61bb640 1 -- 172.21.15.62:0/4174708414 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbeb80083f0 con 0x55878e24c4d0 2024-09-10T05:36:32.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.215+0000 7fbec7eb49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:32.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.215+0000 7fbec7eb49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:32.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.215+0000 7fbec7eb49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.215+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55878e24fba0 con 0x55878e24c4d0 2024-09-10T05:36:32.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.215+0000 7fbec61bb640 1 -- 172.21.15.62:0/4174708414 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbeb80083f0 con 0x55878e24c4d0 2024-09-10T05:36:32.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.215+0000 7fbec7eb49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:32.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.215+0000 7fbec7eb49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.215+0000 7fbec7eb49c0 1 --2- 172.21.15.62:0/4174708414 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55878e250980 0x55878e252d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.215+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55878e253440 con 0x55878e250980 2024-09-10T05:36:32.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.215+0000 7fbec59ba640 1 --2- 172.21.15.62:0/4174708414 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55878e250980 0x55878e252d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.215+0000 7fbec59ba640 1 --2- 172.21.15.62:0/4174708414 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55878e250980 0x55878e252d70 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.215+0000 7fbec59ba640 1 -- 172.21.15.62:0/4174708414 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbec0041040 con 0x55878e250980 2024-09-10T05:36:32.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.215+0000 7fbec7eb49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:32.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.215+0000 7fbec7eb49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.215+0000 7fbec7eb49c0 1 --2- 172.21.15.62:0/4174708414 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55878e2541a0 0x55878e2565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.219+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55878e256d40 con 0x55878e2541a0 2024-09-10T05:36:32.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.219+0000 7fbec51b9640 1 --2- 172.21.15.62:0/4174708414 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55878e2541a0 0x55878e2565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.219+0000 7fbec51b9640 1 --2- 172.21.15.62:0/4174708414 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55878e2541a0 0x55878e2565b0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.219+0000 7fbec51b9640 1 -- 172.21.15.62:0/4174708414 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbebc0a8070 con 0x55878e2541a0 2024-09-10T05:36:32.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.219+0000 7fbec7eb49c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:32.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.219+0000 7fbec7eb49c0 20 searching for the correct realm 2024-09-10T05:36:32.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.219+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55878e258610 con 0x55878e2541a0 2024-09-10T05:36:32.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.219+0000 7fbec51b9640 1 -- 172.21.15.62:0/4174708414 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbebc0a8070 con 0x55878e2541a0 2024-09-10T05:36:32.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.219+0000 7fbec51b9640 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55878e258610 con 0x55878e250980 2024-09-10T05:36:32.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.219+0000 7fbec59ba640 1 -- 172.21.15.62:0/4174708414 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbec0041040 con 0x55878e250980 2024-09-10T05:36:32.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.219+0000 7fbec59ba640 1 --2- 172.21.15.62:0/4174708414 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fbec0022130 0x7fbec00225b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.219+0000 7fbec59ba640 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55878e258610 con 0x7fbec0022130 2024-09-10T05:36:32.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.219+0000 7fbec61bb640 1 --2- 172.21.15.62:0/4174708414 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fbec0022130 0x7fbec00225b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.219+0000 7fbec61bb640 1 --2- 172.21.15.62:0/4174708414 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fbec0022130 0x7fbec00225b0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.219+0000 7fbec61bb640 1 -- 172.21.15.62:0/4174708414 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbeb80083f0 con 0x7fbec0022130 2024-09-10T05:36:32.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.219+0000 7fbec61bb640 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55878e258610 con 0x55878e24c4d0 2024-09-10T05:36:32.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.219+0000 7fbec61bb640 1 -- 172.21.15.62:0/4174708414 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbeb80083f0 con 0x55878e24c4d0 2024-09-10T05:36:32.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.219+0000 7fbec61bb640 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55878e258610 con 0x55878e24c4d0 2024-09-10T05:36:32.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.219+0000 7fbec61bb640 1 -- 172.21.15.62:0/4174708414 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbeb80083f0 con 0x55878e24c4d0 2024-09-10T05:36:32.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.219+0000 7fbec61bb640 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55878e258610 con 0x55878e2541a0 2024-09-10T05:36:32.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.219+0000 7fbec51b9640 1 -- 172.21.15.62:0/4174708414 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbebc0a8070 con 0x55878e2541a0 2024-09-10T05:36:32.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.219+0000 7fbec51b9640 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55878e258610 con 0x55878e24c4d0 2024-09-10T05:36:32.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.223+0000 7fbec61bb640 1 -- 172.21.15.62:0/4174708414 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbeb80083f0 con 0x55878e24c4d0 2024-09-10T05:36:32.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.223+0000 7fbec61bb640 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55878e258610 con 0x55878e250980 2024-09-10T05:36:32.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.223+0000 7fbec59ba640 1 -- 172.21.15.62:0/4174708414 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbec0041040 con 0x55878e250980 2024-09-10T05:36:32.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.223+0000 7fbec59ba640 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55878e258610 con 0x55878e250980 2024-09-10T05:36:32.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.223+0000 7fbec59ba640 1 -- 172.21.15.62:0/4174708414 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbec0041040 con 0x55878e250980 2024-09-10T05:36:32.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.223+0000 7fbec59ba640 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55878e258610 con 0x55878e24c4d0 2024-09-10T05:36:32.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.223+0000 7fbec61bb640 1 -- 172.21.15.62:0/4174708414 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbeb80083f0 con 0x55878e24c4d0 2024-09-10T05:36:32.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.223+0000 7fbec61bb640 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55878e258610 con 0x7fbec0022130 2024-09-10T05:36:32.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.223+0000 7fbec61bb640 1 -- 172.21.15.62:0/4174708414 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbeb80083f0 con 0x7fbec0022130 2024-09-10T05:36:32.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.223+0000 7fbec61bb640 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55878e258610 con 0x55878e24c4d0 2024-09-10T05:36:32.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.223+0000 7fbec61bb640 1 -- 172.21.15.62:0/4174708414 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbeb80083f0 con 0x55878e24c4d0 2024-09-10T05:36:32.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.223+0000 7fbec61bb640 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55878e258610 con 0x7fbec0022130 2024-09-10T05:36:32.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.223+0000 7fbec61bb640 1 -- 172.21.15.62:0/4174708414 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbeb80083f0 con 0x7fbec0022130 2024-09-10T05:36:32.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.223+0000 7fbec61bb640 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55878e258610 con 0x55878e250980 2024-09-10T05:36:32.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.223+0000 7fbec59ba640 1 -- 172.21.15.62:0/4174708414 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbec0041040 con 0x55878e250980 2024-09-10T05:36:32.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.223+0000 7fbec59ba640 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55878e258610 con 0x55878e2541a0 2024-09-10T05:36:32.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.223+0000 7fbec51b9640 1 -- 172.21.15.62:0/4174708414 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbebc0a8070 con 0x55878e2541a0 2024-09-10T05:36:32.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.223+0000 7fbec51b9640 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55878e258610 con 0x55878e24c4d0 2024-09-10T05:36:32.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.223+0000 7fbec61bb640 1 -- 172.21.15.62:0/4174708414 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbeb80083f0 con 0x55878e24c4d0 2024-09-10T05:36:32.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.227+0000 7fbec61bb640 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55878e258610 con 0x55878e250980 2024-09-10T05:36:32.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.227+0000 7fbec59ba640 1 -- 172.21.15.62:0/4174708414 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbec0041040 con 0x55878e250980 2024-09-10T05:36:32.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.227+0000 7fbec59ba640 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55878e258610 con 0x55878e2541a0 2024-09-10T05:36:32.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.227+0000 7fbec51b9640 1 -- 172.21.15.62:0/4174708414 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 30 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7fbebc0a8070 con 0x55878e2541a0 2024-09-10T05:36:32.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.227+0000 7fbec51b9640 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55878e258610 con 0x55878e24c4d0 2024-09-10T05:36:32.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.227+0000 7fbec61bb640 1 -- 172.21.15.62:0/4174708414 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbeb80083f0 con 0x55878e24c4d0 2024-09-10T05:36:32.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.227+0000 7fbec61bb640 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55878e258610 con 0x55878e24c4d0 2024-09-10T05:36:32.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.227+0000 7fbec61bb640 1 -- 172.21.15.62:0/4174708414 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbeb80083f0 con 0x55878e24c4d0 2024-09-10T05:36:32.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.227+0000 7fbec61bb640 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55878e258610 con 0x55878e24c4d0 2024-09-10T05:36:32.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.227+0000 7fbec61bb640 1 -- 172.21.15.62:0/4174708414 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbeb80083f0 con 0x55878e24c4d0 2024-09-10T05:36:32.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.227+0000 7fbec61bb640 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55878e258610 con 0x55878e2541a0 2024-09-10T05:36:32.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.227+0000 7fbec51b9640 1 -- 172.21.15.62:0/4174708414 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbebc0a8070 con 0x55878e2541a0 2024-09-10T05:36:32.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.227+0000 7fbec51b9640 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55878e258610 con 0x7fbec0022130 2024-09-10T05:36:32.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.227+0000 7fbec61bb640 1 -- 172.21.15.62:0/4174708414 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbeb80083f0 con 0x7fbec0022130 2024-09-10T05:36:32.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.227+0000 7fbec61bb640 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55878e258610 con 0x55878e24c4d0 2024-09-10T05:36:32.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.227+0000 7fbec61bb640 1 -- 172.21.15.62:0/4174708414 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbeb80083f0 con 0x55878e24c4d0 2024-09-10T05:36:32.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.227+0000 7fbec61bb640 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55878e258610 con 0x7fbec0022130 2024-09-10T05:36:32.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.227+0000 7fbec61bb640 1 -- 172.21.15.62:0/4174708414 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbeb80083f0 con 0x7fbec0022130 2024-09-10T05:36:32.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.227+0000 7fbec61bb640 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55878e258610 con 0x55878e2541a0 2024-09-10T05:36:32.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.227+0000 7fbec51b9640 1 -- 172.21.15.62:0/4174708414 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbebc0a8070 con 0x55878e2541a0 2024-09-10T05:36:32.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.227+0000 7fbec51b9640 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55878e258610 con 0x7fbec0022130 2024-09-10T05:36:32.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.227+0000 7fbec61bb640 1 -- 172.21.15.62:0/4174708414 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbeb80083f0 con 0x7fbec0022130 2024-09-10T05:36:32.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.227+0000 7fbec61bb640 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55878e258610 con 0x55878e250980 2024-09-10T05:36:32.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.231+0000 7fbec59ba640 1 -- 172.21.15.62:0/4174708414 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbec0041040 con 0x55878e250980 2024-09-10T05:36:32.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.231+0000 7fbec59ba640 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55878e258610 con 0x55878e250980 2024-09-10T05:36:32.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.231+0000 7fbec59ba640 1 -- 172.21.15.62:0/4174708414 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbec0041040 con 0x55878e250980 2024-09-10T05:36:32.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.231+0000 7fbec59ba640 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55878e258610 con 0x55878e2541a0 2024-09-10T05:36:32.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.231+0000 7fbec51b9640 1 -- 172.21.15.62:0/4174708414 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbebc0a8070 con 0x55878e2541a0 2024-09-10T05:36:32.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.231+0000 7fbec51b9640 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55878e258610 con 0x55878e250980 2024-09-10T05:36:32.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.231+0000 7fbec59ba640 1 -- 172.21.15.62:0/4174708414 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbec0041040 con 0x55878e250980 2024-09-10T05:36:32.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.231+0000 7fbec59ba640 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55878e258610 con 0x55878e250980 2024-09-10T05:36:32.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.231+0000 7fbec59ba640 1 -- 172.21.15.62:0/4174708414 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbec0041040 con 0x55878e250980 2024-09-10T05:36:32.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.231+0000 7fbec7eb49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:32.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.231+0000 7fbec7eb49c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:32.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.231+0000 7fbec7eb49c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:32.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.231+0000 7fbec7eb49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:32.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.231+0000 7fbec7eb49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:32.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.231+0000 7fbec7eb49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:32.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.231+0000 7fbec7eb49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.231+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55878e257700 con 0x55878e24c4d0 2024-09-10T05:36:32.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.231+0000 7fbec61bb640 1 -- 172.21.15.62:0/4174708414 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbeb80083f0 con 0x55878e24c4d0 2024-09-10T05:36:32.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.231+0000 7fbec7eb49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:32.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.231+0000 7fbec7eb49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.231+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55878e257340 con 0x55878e250980 2024-09-10T05:36:32.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.235+0000 7fbec59ba640 1 -- 172.21.15.62:0/4174708414 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbec0041040 con 0x55878e250980 2024-09-10T05:36:32.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.235+0000 7fbec7eb49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:32.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.235+0000 7fbec7eb49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.235+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55878e258020 con 0x55878e2541a0 2024-09-10T05:36:32.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.235+0000 7fbec51b9640 1 -- 172.21.15.62:0/4174708414 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbebc0a8070 con 0x55878e2541a0 2024-09-10T05:36:32.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.235+0000 7fbec7eb49c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:32.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.235+0000 7fbec7eb49c0 20 zone default found 2024-09-10T05:36:32.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.235+0000 7fbec7eb49c0 4 Realm: () 2024-09-10T05:36:32.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.235+0000 7fbec7eb49c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:32.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.235+0000 7fbec7eb49c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:32.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.235+0000 7fbec7eb49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:32.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.235+0000 7fbec7eb49c0 20 zonegroup default 2024-09-10T05:36:32.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.235+0000 7fbec7eb49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.235+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55878e258a40 con 0x7fbec0022130 2024-09-10T05:36:32.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.235+0000 7fbec61bb640 1 -- 172.21.15.62:0/4174708414 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbeb80083f0 con 0x7fbec0022130 2024-09-10T05:36:32.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.235+0000 7fbec7eb49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:32.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.235+0000 7fbec7eb49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.235+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55878e25ad00 con 0x55878e2541a0 2024-09-10T05:36:32.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.235+0000 7fbec51b9640 1 -- 172.21.15.62:0/4174708414 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbebc0a8070 con 0x55878e2541a0 2024-09-10T05:36:32.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.235+0000 7fbec7eb49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:32.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.235+0000 7fbec7eb49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.235+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55878e25b0a0 con 0x55878e2541a0 2024-09-10T05:36:32.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.235+0000 7fbec51b9640 1 -- 172.21.15.62:0/4174708414 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbebc0a8070 con 0x55878e2541a0 2024-09-10T05:36:32.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.235+0000 7fbec7eb49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:32.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.235+0000 7fbec7eb49c0 20 started sync module instance, tier type = 2024-09-10T05:36:32.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.235+0000 7fbec7eb49c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:32.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.235+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55878e25a190 con 0x55878e250980 2024-09-10T05:36:32.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.235+0000 7fbec59ba640 1 -- 172.21.15.62:0/4174708414 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbec0041040 con 0x55878e250980 2024-09-10T05:36:32.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.235+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94040693778064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55878e25a190 con 0x55878e250980 2024-09-10T05:36:32.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.235+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55878e25bab0 con 0x55878e24c4d0 2024-09-10T05:36:32.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.239+0000 7fbec61bb640 1 -- 172.21.15.62:0/4174708414 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbeb80083f0 con 0x55878e24c4d0 2024-09-10T05:36:32.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.239+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94040693782016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55878e25c300 con 0x55878e24c4d0 2024-09-10T05:36:32.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.239+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55878e25cd20 con 0x55878e250980 2024-09-10T05:36:32.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.239+0000 7fbec59ba640 1 -- 172.21.15.62:0/4174708414 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94040693778064] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbec0041040 con 0x55878e250980 2024-09-10T05:36:32.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.239+0000 7fbec61bb640 1 -- 172.21.15.62:0/4174708414 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94040693782016] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbeb80083f0 con 0x55878e24c4d0 2024-09-10T05:36:32.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.239+0000 7fbec59ba640 1 -- 172.21.15.62:0/4174708414 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbec0041040 con 0x55878e250980 2024-09-10T05:36:32.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.239+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94040693786640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55878e25be50 con 0x55878e250980 2024-09-10T05:36:32.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.239+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55878e25d5c0 con 0x7fbec0022130 2024-09-10T05:36:32.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.243+0000 7fbec61bb640 1 -- 172.21.15.62:0/4174708414 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbeb80083f0 con 0x7fbec0022130 2024-09-10T05:36:32.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.243+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94040693788944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55878e25be50 con 0x7fbec0022130 2024-09-10T05:36:32.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.243+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55878e25e060 con 0x55878e250980 2024-09-10T05:36:32.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.243+0000 7fbec61bb640 1 -- 172.21.15.62:0/4174708414 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94040693788944] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbeb80083f0 con 0x7fbec0022130 2024-09-10T05:36:32.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.243+0000 7fbec59ba640 1 -- 172.21.15.62:0/4174708414 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94040693786640] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbec0041040 con 0x55878e250980 2024-09-10T05:36:32.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.243+0000 7fbec59ba640 1 -- 172.21.15.62:0/4174708414 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbec0041040 con 0x55878e250980 2024-09-10T05:36:32.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.243+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94040693775584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55878e25e020 con 0x55878e250980 2024-09-10T05:36:32.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.243+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55878e25e450 con 0x55878e2541a0 2024-09-10T05:36:32.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.243+0000 7fbec51b9640 1 -- 172.21.15.62:0/4174708414 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbebc0a8070 con 0x55878e2541a0 2024-09-10T05:36:32.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.243+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94040693790000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55878e25e450 con 0x55878e2541a0 2024-09-10T05:36:32.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.243+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55878e25f350 con 0x55878e2541a0 2024-09-10T05:36:32.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.247+0000 7fbec51b9640 1 -- 172.21.15.62:0/4174708414 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94040693790000] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbebc0a8070 con 0x55878e2541a0 2024-09-10T05:36:32.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.247+0000 7fbec59ba640 1 -- 172.21.15.62:0/4174708414 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94040693775584] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbec0041040 con 0x55878e250980 2024-09-10T05:36:32.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.247+0000 7fbec51b9640 1 -- 172.21.15.62:0/4174708414 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbebc0a8070 con 0x55878e2541a0 2024-09-10T05:36:32.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.247+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94040693791568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55878e25ee60 con 0x55878e2541a0 2024-09-10T05:36:32.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.247+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55878e25f860 con 0x7fbec0022130 2024-09-10T05:36:32.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.247+0000 7fbec51b9640 1 -- 172.21.15.62:0/4174708414 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94040693791568] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbebc0a8070 con 0x55878e2541a0 2024-09-10T05:36:32.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.247+0000 7fbec61bb640 1 -- 172.21.15.62:0/4174708414 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbeb80083f0 con 0x7fbec0022130 2024-09-10T05:36:32.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.247+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94040693794880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55878e25f820 con 0x7fbec0022130 2024-09-10T05:36:32.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.247+0000 7fbec7eb49c0 20 add_watcher() i=0 2024-09-10T05:36:32.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.247+0000 7fbec7eb49c0 20 add_watcher() i=1 2024-09-10T05:36:32.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.247+0000 7fbec7eb49c0 20 add_watcher() i=2 2024-09-10T05:36:32.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.247+0000 7fbec7eb49c0 20 add_watcher() i=3 2024-09-10T05:36:32.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.247+0000 7fbec7eb49c0 20 add_watcher() i=4 2024-09-10T05:36:32.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.247+0000 7fbec7eb49c0 20 add_watcher() i=5 2024-09-10T05:36:32.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.247+0000 7fbec7eb49c0 20 add_watcher() i=6 2024-09-10T05:36:32.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.247+0000 7fbec61bb640 1 -- 172.21.15.62:0/4174708414 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94040693794880] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbeb80083f0 con 0x7fbec0022130 2024-09-10T05:36:32.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.247+0000 7fbec7eb49c0 20 add_watcher() i=7 2024-09-10T05:36:32.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.247+0000 7fbec7eb49c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:32.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.247+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55878e262cb0 con 0x55878e24c4d0 2024-09-10T05:36:32.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.251+0000 7fbec61bb640 1 -- 172.21.15.62:0/4174708414 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbeb80083f0 con 0x55878e24c4d0 2024-09-10T05:36:32.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.251+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94040693798288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55878e2601d0 con 0x55878e24c4d0 2024-09-10T05:36:32.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.251+0000 7fbec61bb640 1 -- 172.21.15.62:0/4174708414 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94040693798288] v30'70 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbeb80083f0 con 0x55878e24c4d0 2024-09-10T05:36:32.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.251+0000 7fbd777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:32.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.251+0000 7fbec7eb49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:32.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.251+0000 7fbec7eb49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:32.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.251+0000 7fbec7eb49c0 5 note: GC not initialized 2024-09-10T05:36:32.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.251+0000 7fbd767fc640 20 reqs_thread_entry: start 2024-09-10T05:36:32.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.251+0000 7fbec7eb49c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:32.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.251+0000 7fbec7eb49c0 20 Filter name: none 2024-09-10T05:36:32.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.251+0000 7fbce7fff640 20 reqs_thread_entry: start 2024-09-10T05:36:32.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.251+0000 7fbec7eb49c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T05:36:32.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.251+0000 7fbec7eb49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.251+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55878e2881e0 con 0x55878e24c4d0 2024-09-10T05:36:32.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.251+0000 7fbec61bb640 1 -- 172.21.15.62:0/4174708414 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fbeb80083f0 con 0x55878e24c4d0 2024-09-10T05:36:32.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.251+0000 7fbec7eb49c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:36:32.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.251+0000 7fbec7eb49c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T05:36:32.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.251+0000 7fbec7eb49c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:36:32.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.251+0000 7fbec7eb49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:36:32.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.251+0000 7fbec7eb49c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-10T05:36:32.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.251+0000 7fbec7eb49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.251+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55878e288c50 con 0x55878e2541a0 2024-09-10T05:36:32.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.251+0000 7fbec51b9640 1 -- 172.21.15.62:0/4174708414 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fbebc0a8070 con 0x55878e2541a0 2024-09-10T05:36:32.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.251+0000 7fbec7eb49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:32.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.251+0000 7fbec7eb49c0 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-10T05:36:32.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.251+0000 7fbec7eb49c0 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T05:36:32.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.251+0000 7fbec7eb49c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-10T05:36:32.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.251+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~502 in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55878e28e530 con 0x55878e24c4d0 2024-09-10T05:36:32.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.255+0000 7fbec61bb640 1 -- 172.21.15.62:0/4174708414 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~502] v30'4 uv4 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fbeb80083f0 con 0x55878e24c4d0 2024-09-10T05:36:32.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.255+0000 7fbec7eb49c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:36:32.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.255+0000 7fbec7eb49c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:36:32.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.255+0000 7fbec7eb49c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T05:36:32.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.255+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94040693989344 in=690b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55878e289ca0 con 0x55878e250980 2024-09-10T05:36:32.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.255+0000 7fbec59ba640 1 -- 172.21.15.62:0/4174708414 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== watch-notify(notify (1) cookie 94040693775584 notify 128849018883 ret 0) ==== 720+0+0 (crc 0 0 0) 0x55878e22ed80 con 0x55878e250980 2024-09-10T05:36:32.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.255+0000 7fbda97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018883 cookie 94040693775584 notifier 4339 bl.length()=678 2024-09-10T05:36:32.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.255+0000 7fbda97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:36:32.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.255+0000 7fbda97fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:36:32.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.255+0000 7fbda97fa640 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fbd88003eb0 con 0x55878e250980 2024-09-10T05:36:32.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.255+0000 7fbec59ba640 1 -- 172.21.15.62:0/4174708414 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(65 notify.4 [notify cookie 94040693989344 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbec0041040 con 0x55878e250980 2024-09-10T05:36:32.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.255+0000 7fbec59ba640 1 -- 172.21.15.62:0/4174708414 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbec0041040 con 0x55878e250980 2024-09-10T05:36:32.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.255+0000 7fbec59ba640 1 -- 172.21.15.62:0/4174708414 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== watch-notify(notify_complete (2) cookie 94040693989344 notify 128849018883 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55878e22e520 con 0x55878e250980 2024-09-10T05:36:32.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.255+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55878e28dfe0 con 0x55878e2541a0 2024-09-10T05:36:32.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.259+0000 7fbec51b9640 1 -- 172.21.15.62:0/4174708414 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fbebc0a8070 con 0x55878e2541a0 2024-09-10T05:36:32.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.259+0000 7fbec7eb49c0 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-10T05:36:32.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.259+0000 7fbec7eb49c0 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T05:36:32.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.259+0000 7fbec7eb49c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-10T05:36:32.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.259+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94040693989344 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55878e28a960 con 0x55878e250980 2024-09-10T05:36:32.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.259+0000 7fbec59ba640 1 -- 172.21.15.62:0/4174708414 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== watch-notify(notify (1) cookie 94040693786640 notify 128849018884 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55878e22e520 con 0x55878e250980 2024-09-10T05:36:32.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.259+0000 7fbda8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018884 cookie 94040693786640 notifier 4339 bl.length()=177 2024-09-10T05:36:32.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.259+0000 7fbda8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-10T05:36:32.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.259+0000 7fbda8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T05:36:32.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.259+0000 7fbda8ff9640 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fbcf0003410 con 0x55878e250980 2024-09-10T05:36:32.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.259+0000 7fbec59ba640 1 -- 172.21.15.62:0/4174708414 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(68 notify.2 [notify cookie 94040693989344 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbec0041040 con 0x55878e250980 2024-09-10T05:36:32.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.259+0000 7fbec59ba640 1 -- 172.21.15.62:0/4174708414 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbec0041040 con 0x55878e250980 2024-09-10T05:36:32.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.259+0000 7fbec59ba640 1 -- 172.21.15.62:0/4174708414 <== osd.0 v2:172.21.15.2:6800/945139080 25 ==== watch-notify(notify_complete (2) cookie 94040693989344 notify 128849018884 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55878e210fc0 con 0x55878e250980 2024-09-10T05:36:32.264 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T05:36:30.893777Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-10T05:36:32.257505Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:36:30.893760Z","tags":[],"group_ids":[]} 2024-09-10T05:36:32.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.259+0000 7fbd777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:32.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.263+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94040693798288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55878e28a0d0 con 0x55878e24c4d0 2024-09-10T05:36:32.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.263+0000 7fbec61bb640 1 -- 172.21.15.62:0/4174708414 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94040693798288] v30'71 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbeb80083f0 con 0x55878e24c4d0 2024-09-10T05:36:32.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.263+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94040693778064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55878e25f590 con 0x55878e250980 2024-09-10T05:36:32.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.267+0000 7fbec59ba640 1 -- 172.21.15.62:0/4174708414 <== osd.0 v2:172.21.15.2:6800/945139080 26 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94040693778064] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbec0041040 con 0x55878e250980 2024-09-10T05:36:32.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.267+0000 7fbec7eb49c0 20 remove_watcher() i=0 2024-09-10T05:36:32.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.267+0000 7fbec7eb49c0 2 removed watcher, disabling cache 2024-09-10T05:36:32.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.267+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94040693782016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55878e25a690 con 0x55878e24c4d0 2024-09-10T05:36:32.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.267+0000 7fbec61bb640 1 -- 172.21.15.62:0/4174708414 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94040693782016] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbeb80083f0 con 0x55878e24c4d0 2024-09-10T05:36:32.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.267+0000 7fbec7eb49c0 20 remove_watcher() i=1 2024-09-10T05:36:32.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.267+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94040693786640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55878e25a690 con 0x55878e250980 2024-09-10T05:36:32.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.267+0000 7fbec59ba640 1 -- 172.21.15.62:0/4174708414 <== osd.0 v2:172.21.15.2:6800/945139080 27 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94040693786640] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbec0041040 con 0x55878e250980 2024-09-10T05:36:32.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.271+0000 7fbec7eb49c0 20 remove_watcher() i=2 2024-09-10T05:36:32.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.271+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94040693788944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55878e25a690 con 0x7fbec0022130 2024-09-10T05:36:32.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.271+0000 7fbec61bb640 1 -- 172.21.15.62:0/4174708414 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94040693788944] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbeb80083f0 con 0x7fbec0022130 2024-09-10T05:36:32.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.271+0000 7fbec7eb49c0 20 remove_watcher() i=3 2024-09-10T05:36:32.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.271+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94040693775584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55878e25d110 con 0x55878e250980 2024-09-10T05:36:32.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.271+0000 7fbec59ba640 1 -- 172.21.15.62:0/4174708414 <== osd.0 v2:172.21.15.2:6800/945139080 28 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94040693775584] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbec0041040 con 0x55878e250980 2024-09-10T05:36:32.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.271+0000 7fbec7eb49c0 20 remove_watcher() i=4 2024-09-10T05:36:32.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.271+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94040693790000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55878e25a690 con 0x55878e2541a0 2024-09-10T05:36:32.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.275+0000 7fbec51b9640 1 -- 172.21.15.62:0/4174708414 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94040693790000] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbebc0a8070 con 0x55878e2541a0 2024-09-10T05:36:32.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.275+0000 7fbec7eb49c0 20 remove_watcher() i=5 2024-09-10T05:36:32.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.275+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94040693791568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55878e25a690 con 0x55878e2541a0 2024-09-10T05:36:32.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.275+0000 7fbec51b9640 1 -- 172.21.15.62:0/4174708414 <== osd.3 v2:172.21.15.62:6816/2708991149 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94040693791568] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbebc0a8070 con 0x55878e2541a0 2024-09-10T05:36:32.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.275+0000 7fbec7eb49c0 20 remove_watcher() i=6 2024-09-10T05:36:32.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.275+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94040693794880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55878e25a690 con 0x7fbec0022130 2024-09-10T05:36:32.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.275+0000 7fbec61bb640 1 -- 172.21.15.62:0/4174708414 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94040693794880] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbeb80083f0 con 0x7fbec0022130 2024-09-10T05:36:32.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.275+0000 7fbec7eb49c0 20 remove_watcher() i=7 2024-09-10T05:36:32.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.275+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55878e250980 msgr2=0x55878e252d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.275+0000 7fbec7eb49c0 1 --2- 172.21.15.62:0/4174708414 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55878e250980 0x55878e252d70 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.275+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55878e24c4d0 msgr2=0x55878e24e990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.275+0000 7fbec7eb49c0 1 --2- 172.21.15.62:0/4174708414 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55878e24c4d0 0x55878e24e990 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.275+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fbec0022130 msgr2=0x7fbec00225b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.275+0000 7fbec7eb49c0 1 --2- 172.21.15.62:0/4174708414 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fbec0022130 0x7fbec00225b0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.275+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55878e2541a0 msgr2=0x55878e2565b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.275+0000 7fbec7eb49c0 1 --2- 172.21.15.62:0/4174708414 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55878e2541a0 0x55878e2565b0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.275+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fbd90039a70 msgr2=0x7fbd9003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.275+0000 7fbec7eb49c0 1 --2- 172.21.15.62:0/4174708414 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fbd90039a70 0x7fbd9003bf30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbebc01b350 tx=0x7fbebc0a8000 comp rx=0 tx=0).stop 2024-09-10T05:36:32.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.275+0000 7fbec61bb640 1 -- 172.21.15.62:0/4174708414 reap_dead start 2024-09-10T05:36:32.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.275+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878e23b250 msgr2=0x55878e2415a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.275+0000 7fbec7eb49c0 1 --2- 172.21.15.62:0/4174708414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878e23b250 0x55878e2415a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbec0004fa0 tx=0x7fbec000ffd0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.275+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 shutdown_connections 2024-09-10T05:36:32.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.275+0000 7fbec7eb49c0 1 --2- 172.21.15.62:0/4174708414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878e23b250 0x55878e2415a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.275+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 >> 172.21.15.62:0/4174708414 conn(0x55878e236610 msgr2=0x55878e234820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:32.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.275+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 shutdown_connections 2024-09-10T05:36:32.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.275+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/4174708414 wait complete. 2024-09-10T05:36:32.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.279+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/2709784680 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fbda0039b10 msgr2=0x7fbda003bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.279+0000 7fbec7eb49c0 1 --2- 172.21.15.62:0/2709784680 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fbda0039b10 0x7fbda003bfd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x55878e21b820 tx=0x7fbebc005a10 comp rx=0 tx=0).stop 2024-09-10T05:36:32.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.279+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/2709784680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878e22dac0 msgr2=0x55878e22dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.279+0000 7fbec7eb49c0 1 --2- 172.21.15.62:0/2709784680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878e22dac0 0x55878e22dee0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbec004e8d0 tx=0x7fbec0012af0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.279+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/2709784680 shutdown_connections 2024-09-10T05:36:32.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.279+0000 7fbec7eb49c0 1 --2- 172.21.15.62:0/2709784680 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fbda0039b10 0x7fbda003bfd0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.279+0000 7fbec7eb49c0 1 --2- 172.21.15.62:0/2709784680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878e22dac0 0x55878e22dee0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.279+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/2709784680 >> 172.21.15.62:0/2709784680 conn(0x55878e223470 msgr2=0x55878e223850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:32.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.279+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/2709784680 shutdown_connections 2024-09-10T05:36:32.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.279+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/2709784680 wait complete. 2024-09-10T05:36:32.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.279+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/1206957929 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55878e218230 msgr2=0x55878e21a620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.279+0000 7fbec7eb49c0 1 --2- 172.21.15.62:0/1206957929 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55878e218230 0x55878e21a620 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.279+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/1206957929 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55878e1210d0 msgr2=0x55878e216f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.279+0000 7fbec7eb49c0 1 --2- 172.21.15.62:0/1206957929 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55878e1210d0 0x55878e216f90 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.279+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/1206957929 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55878e21c9b0 msgr2=0x55878e21eda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.279+0000 7fbec7eb49c0 1 --2- 172.21.15.62:0/1206957929 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55878e21c9b0 0x55878e21eda0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.279+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/1206957929 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fbdac039a70 msgr2=0x7fbdac03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.279+0000 7fbec7eb49c0 1 --2- 172.21.15.62:0/1206957929 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fbdac039a70 0x7fbdac03bf30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbebc0ae000 tx=0x7fbebc0a6000 comp rx=0 tx=0).stop 2024-09-10T05:36:32.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.279+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/1206957929 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878e11cf30 msgr2=0x55878e20fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.279+0000 7fbec7eb49c0 1 --2- 172.21.15.62:0/1206957929 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55878e11cf30 0x55878e20fe20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x55878e2097a0 tx=0x7fbec0001260 comp rx=0 tx=0).stop 2024-09-10T05:36:32.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.279+0000 7fbec61bb640 1 -- 172.21.15.62:0/1206957929 reap_dead start 2024-09-10T05:36:32.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.279+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/1206957929 shutdown_connections 2024-09-10T05:36:32.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.279+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/1206957929 >> 172.21.15.62:0/1206957929 conn(0x55878e118a50 msgr2=0x55878e202ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:32.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.279+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/1206957929 shutdown_connections 2024-09-10T05:36:32.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.279+0000 7fbec7eb49c0 1 -- 172.21.15.62:0/1206957929 wait complete. 2024-09-10T05:36:32.292 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T05:36:30.893777Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-10T05:36:32.257505Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:36:30.893760Z', 'tags': [], 'group_ids': []} 2024-09-10T05:36:32.293 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-10T05:36:32.293 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-10T05:36:32.293 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-10T05:36:32.372 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:32.372 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:32.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.371+0000 7f3e37d999c0 1 Processor -- start 2024-09-10T05:36:32.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.371+0000 7f3e37d999c0 1 -- start start 2024-09-10T05:36:32.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.371+0000 7f3e37d999c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5651e7c685b0 0x5651e7c68990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.371+0000 7f3e37d999c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5651e7b1e9c0 con 0x5651e7c6b790 2024-09-10T05:36:32.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.371+0000 7f3e37d999c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x5651e7b6e6d0 con 0x5651e7c685b0 2024-09-10T05:36:32.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.371+0000 7f3e3589f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5651e7c685b0 0x5651e7c68990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.371+0000 7f3e3589f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5651e7c685b0 0x5651e7c68990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51612/0 (socket says 172.21.15.62:51612) 2024-09-10T05:36:32.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.371+0000 7f3e3589f640 1 -- 172.21.15.62:0/3124337443 learned_addr learned my addr 172.21.15.62:0/3124337443 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:32.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.371+0000 7f3e3509e640 1 --1- 172.21.15.62:0/3124337443 >> v1:172.21.15.2:6789/0 conn(0x5651e7c6b790 0x5651e7c6db80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:38558/0 (socket says 172.21.15.62:38558) 2024-09-10T05:36:32.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.371+0000 7f3e3589f640 1 -- 172.21.15.62:0/3124337443 >> v1:172.21.15.2:6789/0 conn(0x5651e7c6b790 legacy=0x5651e7c6db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.371+0000 7f3e3589f640 1 -- 172.21.15.62:0/3124337443 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651e7b12ca0 con 0x5651e7c685b0 2024-09-10T05:36:32.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.375+0000 7f3e3589f640 1 --2- 172.21.15.62:0/3124337443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651e7c685b0 0x5651e7c68990 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3e3000a4e0 tx=0x7f3e3001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d5f03099c076bdc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.375+0000 7f3e3489d640 1 -- 172.21.15.62:0/3124337443 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e300aa540 con 0x5651e7c685b0 2024-09-10T05:36:32.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.375+0000 7f3e3489d640 1 -- 172.21.15.62:0/3124337443 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e300aa6e0 con 0x5651e7c685b0 2024-09-10T05:36:32.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.375+0000 7f3e3489d640 1 -- 172.21.15.62:0/3124337443 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e300aaa40 con 0x5651e7c685b0 2024-09-10T05:36:32.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.375+0000 7f3e37d999c0 1 -- 172.21.15.62:0/3124337443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651e7c685b0 msgr2=0x5651e7c68990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.375+0000 7f3e37d999c0 1 --2- 172.21.15.62:0/3124337443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651e7c685b0 0x5651e7c68990 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3e3000a4e0 tx=0x7f3e3001b090 comp rx=0 tx=0).stop 2024-09-10T05:36:32.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.375+0000 7f3e37d999c0 1 -- 172.21.15.62:0/3124337443 shutdown_connections 2024-09-10T05:36:32.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.375+0000 7f3e37d999c0 1 --2- 172.21.15.62:0/3124337443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651e7c685b0 0x5651e7c68990 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.375+0000 7f3e37d999c0 1 -- 172.21.15.62:0/3124337443 >> 172.21.15.62:0/3124337443 conn(0x5651e7c640d0 msgr2=0x5651e7c664f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:32.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.375+0000 7f3e37d999c0 1 -- 172.21.15.62:0/3124337443 shutdown_connections 2024-09-10T05:36:32.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.375+0000 7f3e37d999c0 1 -- 172.21.15.62:0/3124337443 wait complete. 2024-09-10T05:36:32.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.391+0000 7f3e37d999c0 1 Processor -- start 2024-09-10T05:36:32.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.391+0000 7f3e37d999c0 1 -- start start 2024-09-10T05:36:32.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.391+0000 7f3e37d999c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651e7c685b0 0x5651e7d53490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.391+0000 7f3e37d999c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5651e7b72680 con 0x5651e7c685b0 2024-09-10T05:36:32.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.391+0000 7f3e3589f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651e7c685b0 0x5651e7d53490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.391+0000 7f3e3589f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651e7c685b0 0x5651e7d53490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51630/0 (socket says 172.21.15.62:51630) 2024-09-10T05:36:32.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.391+0000 7f3e3589f640 1 -- 172.21.15.62:0/1841046057 learned_addr learned my addr 172.21.15.62:0/1841046057 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:32.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.391+0000 7f3e3589f640 1 -- 172.21.15.62:0/1841046057 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651e7aedda0 con 0x5651e7c685b0 2024-09-10T05:36:32.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.391+0000 7f3e3589f640 1 --2- 172.21.15.62:0/1841046057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651e7c685b0 0x5651e7d53490 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3e30017ca0 tx=0x7f3e300033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=499a17a4a0a55525 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.391+0000 7f3d23e07640 1 -- 172.21.15.62:0/1841046057 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e300b9030 con 0x5651e7c685b0 2024-09-10T05:36:32.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.391+0000 7f3d23e07640 1 -- 172.21.15.62:0/1841046057 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e300aaa80 con 0x5651e7c685b0 2024-09-10T05:36:32.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.391+0000 7f3d23e07640 1 -- 172.21.15.62:0/1841046057 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e300aada0 con 0x5651e7c685b0 2024-09-10T05:36:32.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.391+0000 7f3e37d999c0 1 -- 172.21.15.62:0/1841046057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651e7c685b0 msgr2=0x5651e7d53490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.391+0000 7f3e37d999c0 1 --2- 172.21.15.62:0/1841046057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651e7c685b0 0x5651e7d53490 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3e30017ca0 tx=0x7f3e300033b0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.391+0000 7f3e37d999c0 1 -- 172.21.15.62:0/1841046057 shutdown_connections 2024-09-10T05:36:32.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.391+0000 7f3e37d999c0 1 --2- 172.21.15.62:0/1841046057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651e7c685b0 0x5651e7d53490 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.391+0000 7f3e37d999c0 1 -- 172.21.15.62:0/1841046057 >> 172.21.15.62:0/1841046057 conn(0x5651e7c640d0 msgr2=0x5651e7d4f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:32.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.391+0000 7f3e37d999c0 1 -- 172.21.15.62:0/1841046057 shutdown_connections 2024-09-10T05:36:32.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.391+0000 7f3e37d999c0 1 -- 172.21.15.62:0/1841046057 wait complete. 2024-09-10T05:36:32.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.391+0000 7f3e37d999c0 1 Processor -- start 2024-09-10T05:36:32.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.391+0000 7f3e37d999c0 1 -- start start 2024-09-10T05:36:32.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.391+0000 7f3e37d999c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651e7c685b0 0x5651e7d5a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.391+0000 7f3e37d999c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5651e7b14a50 con 0x5651e7c685b0 2024-09-10T05:36:32.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.395+0000 7f3e3589f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651e7c685b0 0x5651e7d5a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.395+0000 7f3e3589f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651e7c685b0 0x5651e7d5a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51640/0 (socket says 172.21.15.62:51640) 2024-09-10T05:36:32.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.395+0000 7f3e3589f640 1 -- 172.21.15.62:0/1067097513 learned_addr learned my addr 172.21.15.62:0/1067097513 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:32.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.395+0000 7f3e3589f640 1 -- 172.21.15.62:0/1067097513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651e7d5af30 con 0x5651e7c685b0 2024-09-10T05:36:32.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.395+0000 7f3e3589f640 1 --2- 172.21.15.62:0/1067097513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651e7c685b0 0x5651e7d5a9d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3e3001b930 tx=0x7f3e30017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.395+0000 7f3d22604640 1 -- 172.21.15.62:0/1067097513 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e300b9070 con 0x5651e7c685b0 2024-09-10T05:36:32.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.395+0000 7f3d22604640 1 -- 172.21.15.62:0/1067097513 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e300c3030 con 0x5651e7c685b0 2024-09-10T05:36:32.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.395+0000 7f3e37d999c0 1 -- 172.21.15.62:0/1067097513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5651e7d5b1c0 con 0x5651e7c685b0 2024-09-10T05:36:32.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.395+0000 7f3d22604640 1 -- 172.21.15.62:0/1067097513 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e300b5c40 con 0x5651e7c685b0 2024-09-10T05:36:32.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.395+0000 7f3e37d999c0 1 -- 172.21.15.62:0/1067097513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651e7d5bb70 con 0x5651e7c685b0 2024-09-10T05:36:32.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.395+0000 7f3d22604640 1 -- 172.21.15.62:0/1067097513 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f3e300b3040 con 0x5651e7c685b0 2024-09-10T05:36:32.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.395+0000 7f3d22604640 1 --2- 172.21.15.62:0/1067097513 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3d1c039a70 0x7f3d1c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.395+0000 7f3d22604640 1 -- 172.21.15.62:0/1067097513 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f3e300ba070 con 0x5651e7c685b0 2024-09-10T05:36:32.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.395+0000 7f3e3509e640 1 --2- 172.21.15.62:0/1067097513 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3d1c039a70 0x7f3d1c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.395+0000 7f3e37d999c0 1 --2- 172.21.15.62:0/1067097513 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5651e7c6b790 0x5651e7d61b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.395+0000 7f3e37d999c0 1 -- 172.21.15.62:0/1067097513 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5651e7d62080 con 0x5651e7c6b790 2024-09-10T05:36:32.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.395+0000 7f3e360a0640 1 --2- 172.21.15.62:0/1067097513 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5651e7c6b790 0x5651e7d61b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.395+0000 7f3e3509e640 1 --2- 172.21.15.62:0/1067097513 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3d1c039a70 0x7f3d1c03bf30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c001e40 tx=0x7f3e2c0013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.395+0000 7f3e360a0640 1 --2- 172.21.15.62:0/1067097513 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5651e7c6b790 0x5651e7d61b40 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.395+0000 7f3e360a0640 1 -- 172.21.15.62:0/1067097513 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3e280083f0 con 0x5651e7c6b790 2024-09-10T05:36:32.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.395+0000 7f3e37d999c0 1 --2- 172.21.15.62:0/1067097513 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5651e7d62b30 0x5651e7d64ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.395+0000 7f3e37d999c0 1 -- 172.21.15.62:0/1067097513 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5651e7d65760 con 0x5651e7d62b30 2024-09-10T05:36:32.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.399+0000 7f3e3589f640 1 --2- 172.21.15.62:0/1067097513 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5651e7d62b30 0x5651e7d64ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.399+0000 7f3e3589f640 1 --2- 172.21.15.62:0/1067097513 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5651e7d62b30 0x5651e7d64ff0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.399+0000 7f3e3589f640 1 -- 172.21.15.62:0/1067097513 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3e300e7040 con 0x5651e7d62b30 2024-09-10T05:36:32.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.399+0000 7f3e37d999c0 1 --2- 172.21.15.62:0/1067097513 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5651e7d67520 0x5651e7d69910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.399+0000 7f3e37d999c0 1 -- 172.21.15.62:0/1067097513 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5651e7d6a000 con 0x5651e7d67520 2024-09-10T05:36:32.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.399+0000 7f3e3509e640 1 --2- 172.21.15.62:0/1067097513 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5651e7d67520 0x5651e7d69910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.399+0000 7f3e3509e640 1 --2- 172.21.15.62:0/1067097513 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5651e7d67520 0x5651e7d69910 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.399+0000 7f3e3509e640 1 -- 172.21.15.62:0/1067097513 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3e2c00bd60 con 0x5651e7d67520 2024-09-10T05:36:32.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.399+0000 7f3e37d999c0 1 -- 172.21.15.62:0/1067097513 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5651e7d663c0 con 0x5651e7d62b30 2024-09-10T05:36:32.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.399+0000 7f3e3589f640 1 -- 172.21.15.62:0/1067097513 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3e300e7040 con 0x5651e7d62b30 2024-09-10T05:36:32.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.399+0000 7f3e37d999c0 1 -- 172.21.15.62:0/1067097513 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5651e7d667e0 con 0x5651e7d67520 2024-09-10T05:36:32.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.399+0000 7f3e3509e640 1 -- 172.21.15.62:0/1067097513 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3e2c00bd60 con 0x5651e7d67520 2024-09-10T05:36:32.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.399+0000 7f3e37d999c0 1 Processor -- start 2024-09-10T05:36:32.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.399+0000 7f3e37d999c0 1 -- start start 2024-09-10T05:36:32.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.403+0000 7f3e37d999c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651e7d786b0 0x5651e7d78ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.403+0000 7f3e37d999c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5651e7b7f450 con 0x5651e7d786b0 2024-09-10T05:36:32.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.403+0000 7f3e3589f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651e7d786b0 0x5651e7d78ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.403+0000 7f3e3589f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651e7d786b0 0x5651e7d78ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51654/0 (socket says 172.21.15.62:51654) 2024-09-10T05:36:32.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.403+0000 7f3e3589f640 1 -- 172.21.15.62:0/1219406577 learned_addr learned my addr 172.21.15.62:0/1219406577 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:32.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.403+0000 7f3e3589f640 1 -- 172.21.15.62:0/1219406577 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651e7d79110 con 0x5651e7d786b0 2024-09-10T05:36:32.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.403+0000 7f3e3589f640 1 --2- 172.21.15.62:0/1219406577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651e7d786b0 0x5651e7d78ad0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3e300aa650 tx=0x7f3e300bc720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.403+0000 7f3d1b7fe640 1 -- 172.21.15.62:0/1219406577 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e300e1020 con 0x5651e7d786b0 2024-09-10T05:36:32.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.403+0000 7f3d1b7fe640 1 -- 172.21.15.62:0/1219406577 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e300eb180 con 0x5651e7d786b0 2024-09-10T05:36:32.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.403+0000 7f3d1b7fe640 1 -- 172.21.15.62:0/1219406577 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e300e4040 con 0x5651e7d786b0 2024-09-10T05:36:32.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.403+0000 7f3e37d999c0 1 -- 172.21.15.62:0/1219406577 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5651e7d79970 con 0x5651e7d786b0 2024-09-10T05:36:32.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.403+0000 7f3e37d999c0 1 -- 172.21.15.62:0/1219406577 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651e7d79ee0 con 0x5651e7d786b0 2024-09-10T05:36:32.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.403+0000 7f3d1b7fe640 1 -- 172.21.15.62:0/1219406577 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f3e300b4560 con 0x5651e7d786b0 2024-09-10T05:36:32.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.403+0000 7f3d1b7fe640 1 --2- 172.21.15.62:0/1219406577 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3d10039ac0 0x7f3d1003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.403+0000 7f3d1b7fe640 1 -- 172.21.15.62:0/1219406577 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f3e300ece30 con 0x5651e7d786b0 2024-09-10T05:36:32.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.403+0000 7f3e3509e640 1 --2- 172.21.15.62:0/1219406577 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3d10039ac0 0x7f3d1003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.403+0000 7f3e37d999c0 1 Processor -- start 2024-09-10T05:36:32.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.403+0000 7f3e37d999c0 1 -- start start 2024-09-10T05:36:32.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.403+0000 7f3e37d999c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651e7d89270 0x5651e7d89650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.403+0000 7f3e37d999c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5651e7d53c20 con 0x5651e7d89270 2024-09-10T05:36:32.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.403+0000 7f3e3509e640 1 --2- 172.21.15.62:0/1219406577 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3d10039ac0 0x7f3d1003bf80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c00c010 tx=0x7f3e2c00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.407+0000 7f3e3589f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651e7d89270 0x5651e7d89650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.407+0000 7f3e3589f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651e7d89270 0x5651e7d89650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51668/0 (socket says 172.21.15.62:51668) 2024-09-10T05:36:32.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.407+0000 7f3e3589f640 1 -- 172.21.15.62:0/2125186231 learned_addr learned my addr 172.21.15.62:0/2125186231 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:32.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.407+0000 7f3e3589f640 1 -- 172.21.15.62:0/2125186231 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651e7d89c40 con 0x5651e7d89270 2024-09-10T05:36:32.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.407+0000 7f3e3589f640 1 --2- 172.21.15.62:0/2125186231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651e7d89270 0x5651e7d89650 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3e300bf580 tx=0x7f3e300d0d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a30db9a8a7fb98a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.407+0000 7f3d197fa640 1 -- 172.21.15.62:0/2125186231 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e300be410 con 0x5651e7d89270 2024-09-10T05:36:32.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.407+0000 7f3d197fa640 1 -- 172.21.15.62:0/2125186231 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e300d0350 con 0x5651e7d89270 2024-09-10T05:36:32.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.407+0000 7f3d197fa640 1 -- 172.21.15.62:0/2125186231 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e300be5b0 con 0x5651e7d89270 2024-09-10T05:36:32.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.407+0000 7f3e37d999c0 1 -- 172.21.15.62:0/2125186231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651e7d89270 msgr2=0x5651e7d89650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.407+0000 7f3e37d999c0 1 --2- 172.21.15.62:0/2125186231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651e7d89270 0x5651e7d89650 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3e300bf580 tx=0x7f3e300d0d20 comp rx=0 tx=0).stop 2024-09-10T05:36:32.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.407+0000 7f3e37d999c0 1 -- 172.21.15.62:0/2125186231 shutdown_connections 2024-09-10T05:36:32.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.407+0000 7f3e37d999c0 1 --2- 172.21.15.62:0/2125186231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651e7d89270 0x5651e7d89650 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.407+0000 7f3e37d999c0 1 -- 172.21.15.62:0/2125186231 >> 172.21.15.62:0/2125186231 conn(0x5651e7d81270 msgr2=0x5651e7d7f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:32.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.407+0000 7f3e37d999c0 1 -- 172.21.15.62:0/2125186231 shutdown_connections 2024-09-10T05:36:32.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.407+0000 7f3e37d999c0 1 -- 172.21.15.62:0/2125186231 wait complete. 2024-09-10T05:36:32.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.407+0000 7f3e37d999c0 1 Processor -- start 2024-09-10T05:36:32.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.407+0000 7f3e37d999c0 1 -- start start 2024-09-10T05:36:32.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.407+0000 7f3e37d999c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651e7d89270 0x5651e7d905f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.407+0000 7f3e37d999c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5651e7d8a0e0 con 0x5651e7d89270 2024-09-10T05:36:32.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.407+0000 7f3e3589f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651e7d89270 0x5651e7d905f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.407+0000 7f3e3589f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651e7d89270 0x5651e7d905f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51684/0 (socket says 172.21.15.62:51684) 2024-09-10T05:36:32.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.407+0000 7f3e3589f640 1 -- 172.21.15.62:0/998845069 learned_addr learned my addr 172.21.15.62:0/998845069 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:32.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.407+0000 7f3e3589f640 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651e7d90b50 con 0x5651e7d89270 2024-09-10T05:36:32.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.407+0000 7f3e3589f640 1 --2- 172.21.15.62:0/998845069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651e7d89270 0x5651e7d905f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3e300bf580 tx=0x7f3e300e3090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.407+0000 7f3d077fe640 1 -- 172.21.15.62:0/998845069 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e3010d020 con 0x5651e7d89270 2024-09-10T05:36:32.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.407+0000 7f3e37d999c0 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5651e7d90b50 con 0x5651e7d89270 2024-09-10T05:36:32.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.407+0000 7f3d077fe640 1 -- 172.21.15.62:0/998845069 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e300b7ad0 con 0x5651e7d89270 2024-09-10T05:36:32.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.407+0000 7f3d077fe640 1 -- 172.21.15.62:0/998845069 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e300d04f0 con 0x5651e7d89270 2024-09-10T05:36:32.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.411+0000 7f3e37d999c0 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651e7d90fc0 con 0x5651e7d89270 2024-09-10T05:36:32.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.411+0000 7f3e37d999c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.411+0000 7f3d077fe640 1 -- 172.21.15.62:0/998845069 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f3e300a99f0 con 0x5651e7d89270 2024-09-10T05:36:32.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.411+0000 7f3d077fe640 1 --2- 172.21.15.62:0/998845069 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3d00039a70 0x7f3d0003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.411+0000 7f3d077fe640 1 -- 172.21.15.62:0/998845069 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f3e300fb030 con 0x5651e7d89270 2024-09-10T05:36:32.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.411+0000 7f3e3509e640 1 --2- 172.21.15.62:0/998845069 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3d00039a70 0x7f3d0003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.411+0000 7f3e37d999c0 1 --2- 172.21.15.62:0/998845069 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5651e7d9b3e0 0x5651e7d9d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.411+0000 7f3e37d999c0 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5651e7d9dfc0 con 0x5651e7d9b3e0 2024-09-10T05:36:32.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.411+0000 7f3e360a0640 1 --2- 172.21.15.62:0/998845069 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5651e7d9b3e0 0x5651e7d9d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.411+0000 7f3e3509e640 1 --2- 172.21.15.62:0/998845069 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3d00039a70 0x7f3d0003bf30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x5651e7d66760 tx=0x7f3e2c010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.411+0000 7f3e360a0640 1 --2- 172.21.15.62:0/998845069 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5651e7d9b3e0 0x5651e7d9d870 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.411+0000 7f3e360a0640 1 -- 172.21.15.62:0/998845069 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3e280083f0 con 0x5651e7d9b3e0 2024-09-10T05:36:32.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.411+0000 7f3e37d999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:32.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.411+0000 7f3e37d999c0 20 realm 2024-09-10T05:36:32.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.411+0000 7f3e37d999c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.411+0000 7f3e37d999c0 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5651e7d9a770 con 0x5651e7d9b3e0 2024-09-10T05:36:32.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.411+0000 7f3e360a0640 1 -- 172.21.15.62:0/998845069 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3e280083f0 con 0x5651e7d9b3e0 2024-09-10T05:36:32.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.411+0000 7f3e37d999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:32.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.411+0000 7f3e37d999c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:32.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.411+0000 7f3e37d999c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.411+0000 7f3e37d999c0 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5651e7d9ea80 con 0x5651e7d9b3e0 2024-09-10T05:36:32.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.411+0000 7f3e360a0640 1 -- 172.21.15.62:0/998845069 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3e280083f0 con 0x5651e7d9b3e0 2024-09-10T05:36:32.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.411+0000 7f3e37d999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:32.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.411+0000 7f3e37d999c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.411+0000 7f3e37d999c0 1 --2- 172.21.15.62:0/998845069 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5651e7d9f860 0x5651e7da1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.411+0000 7f3e37d999c0 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5651e7da2300 con 0x5651e7d9f860 2024-09-10T05:36:32.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.411+0000 7f3e3589f640 1 --2- 172.21.15.62:0/998845069 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5651e7d9f860 0x5651e7da1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.415+0000 7f3e3589f640 1 --2- 172.21.15.62:0/998845069 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5651e7d9f860 0x5651e7da1c50 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.415+0000 7f3e3589f640 1 -- 172.21.15.62:0/998845069 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3e3010f020 con 0x5651e7d9f860 2024-09-10T05:36:32.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.415+0000 7f3e37d999c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:32.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.415+0000 7f3e37d999c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.415+0000 7f3e37d999c0 1 --2- 172.21.15.62:0/998845069 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5651e7da30b0 0x5651e7da54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.415+0000 7f3e37d999c0 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5651e7da5b40 con 0x5651e7da30b0 2024-09-10T05:36:32.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.415+0000 7f3e3509e640 1 --2- 172.21.15.62:0/998845069 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5651e7da30b0 0x5651e7da54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.415+0000 7f3e3509e640 1 --2- 172.21.15.62:0/998845069 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5651e7da30b0 0x5651e7da54a0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.415+0000 7f3e3509e640 1 -- 172.21.15.62:0/998845069 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3e2c00bd60 con 0x5651e7da30b0 2024-09-10T05:36:32.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.415+0000 7f3e37d999c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:32.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.415+0000 7f3e37d999c0 20 searching for the correct realm 2024-09-10T05:36:32.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.415+0000 7f3e37d999c0 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651e7da7430 con 0x5651e7da30b0 2024-09-10T05:36:32.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.415+0000 7f3e3509e640 1 -- 172.21.15.62:0/998845069 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e2c00bd60 con 0x5651e7da30b0 2024-09-10T05:36:32.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.415+0000 7f3e3509e640 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651e7da7430 con 0x5651e7d9f860 2024-09-10T05:36:32.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.415+0000 7f3e3589f640 1 -- 172.21.15.62:0/998845069 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e3010f020 con 0x5651e7d9f860 2024-09-10T05:36:32.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.415+0000 7f3e3589f640 1 --2- 172.21.15.62:0/998845069 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f3e30112020 0x7f3e3010d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.415+0000 7f3e3589f640 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651e7da7430 con 0x7f3e30112020 2024-09-10T05:36:32.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.415+0000 7f3e360a0640 1 --2- 172.21.15.62:0/998845069 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f3e30112020 0x7f3e3010d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.415+0000 7f3e360a0640 1 --2- 172.21.15.62:0/998845069 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f3e30112020 0x7f3e3010d830 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.419+0000 7f3e360a0640 1 -- 172.21.15.62:0/998845069 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e280083f0 con 0x7f3e30112020 2024-09-10T05:36:32.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.419+0000 7f3e360a0640 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651e7da7430 con 0x5651e7d9b3e0 2024-09-10T05:36:32.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.419+0000 7f3e360a0640 1 -- 172.21.15.62:0/998845069 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e280083f0 con 0x5651e7d9b3e0 2024-09-10T05:36:32.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.419+0000 7f3e360a0640 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651e7da7430 con 0x5651e7d9b3e0 2024-09-10T05:36:32.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.419+0000 7f3e360a0640 1 -- 172.21.15.62:0/998845069 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e280083f0 con 0x5651e7d9b3e0 2024-09-10T05:36:32.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.419+0000 7f3e360a0640 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651e7da7430 con 0x5651e7da30b0 2024-09-10T05:36:32.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.419+0000 7f3e3509e640 1 -- 172.21.15.62:0/998845069 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e2c00bd60 con 0x5651e7da30b0 2024-09-10T05:36:32.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.419+0000 7f3e3509e640 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651e7da7430 con 0x5651e7d9b3e0 2024-09-10T05:36:32.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.419+0000 7f3e360a0640 1 -- 172.21.15.62:0/998845069 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e280083f0 con 0x5651e7d9b3e0 2024-09-10T05:36:32.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.419+0000 7f3e360a0640 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651e7da7430 con 0x5651e7d9f860 2024-09-10T05:36:32.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.419+0000 7f3e3589f640 1 -- 172.21.15.62:0/998845069 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e3010f020 con 0x5651e7d9f860 2024-09-10T05:36:32.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.419+0000 7f3e3589f640 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651e7da7430 con 0x5651e7d9f860 2024-09-10T05:36:32.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.419+0000 7f3e3589f640 1 -- 172.21.15.62:0/998845069 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e3010f020 con 0x5651e7d9f860 2024-09-10T05:36:32.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.419+0000 7f3e3589f640 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651e7da7430 con 0x5651e7d9b3e0 2024-09-10T05:36:32.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.419+0000 7f3e360a0640 1 -- 172.21.15.62:0/998845069 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e280083f0 con 0x5651e7d9b3e0 2024-09-10T05:36:32.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.419+0000 7f3e360a0640 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651e7da7430 con 0x7f3e30112020 2024-09-10T05:36:32.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.419+0000 7f3e360a0640 1 -- 172.21.15.62:0/998845069 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e280083f0 con 0x7f3e30112020 2024-09-10T05:36:32.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.419+0000 7f3e360a0640 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651e7da7430 con 0x5651e7d9b3e0 2024-09-10T05:36:32.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.419+0000 7f3e360a0640 1 -- 172.21.15.62:0/998845069 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e280083f0 con 0x5651e7d9b3e0 2024-09-10T05:36:32.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.419+0000 7f3e360a0640 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651e7da7430 con 0x7f3e30112020 2024-09-10T05:36:32.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.419+0000 7f3e360a0640 1 -- 172.21.15.62:0/998845069 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3e280083f0 con 0x7f3e30112020 2024-09-10T05:36:32.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.419+0000 7f3e360a0640 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651e7da7430 con 0x5651e7d9f860 2024-09-10T05:36:32.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.423+0000 7f3e3589f640 1 -- 172.21.15.62:0/998845069 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e3010f020 con 0x5651e7d9f860 2024-09-10T05:36:32.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.423+0000 7f3e3589f640 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651e7da7430 con 0x5651e7da30b0 2024-09-10T05:36:32.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.423+0000 7f3e3509e640 1 -- 172.21.15.62:0/998845069 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e2c00bd60 con 0x5651e7da30b0 2024-09-10T05:36:32.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.423+0000 7f3e3509e640 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651e7da7430 con 0x5651e7d9b3e0 2024-09-10T05:36:32.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.423+0000 7f3e360a0640 1 -- 172.21.15.62:0/998845069 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e280083f0 con 0x5651e7d9b3e0 2024-09-10T05:36:32.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.423+0000 7f3e360a0640 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651e7da7430 con 0x5651e7d9f860 2024-09-10T05:36:32.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.423+0000 7f3e3589f640 1 -- 172.21.15.62:0/998845069 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e3010f020 con 0x5651e7d9f860 2024-09-10T05:36:32.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.423+0000 7f3e3589f640 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651e7da7430 con 0x5651e7da30b0 2024-09-10T05:36:32.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.423+0000 7f3e3509e640 1 -- 172.21.15.62:0/998845069 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 30 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f3e2c00bd60 con 0x5651e7da30b0 2024-09-10T05:36:32.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.423+0000 7f3e3509e640 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651e7da7430 con 0x5651e7d9b3e0 2024-09-10T05:36:32.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.423+0000 7f3e360a0640 1 -- 172.21.15.62:0/998845069 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e280083f0 con 0x5651e7d9b3e0 2024-09-10T05:36:32.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.423+0000 7f3e360a0640 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651e7da7430 con 0x5651e7d9b3e0 2024-09-10T05:36:32.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.423+0000 7f3e360a0640 1 -- 172.21.15.62:0/998845069 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3e280083f0 con 0x5651e7d9b3e0 2024-09-10T05:36:32.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.423+0000 7f3e360a0640 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651e7da7430 con 0x5651e7d9b3e0 2024-09-10T05:36:32.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.423+0000 7f3e360a0640 1 -- 172.21.15.62:0/998845069 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e280083f0 con 0x5651e7d9b3e0 2024-09-10T05:36:32.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.423+0000 7f3e360a0640 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651e7da7430 con 0x5651e7da30b0 2024-09-10T05:36:32.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.423+0000 7f3e3509e640 1 -- 172.21.15.62:0/998845069 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e2c00bd60 con 0x5651e7da30b0 2024-09-10T05:36:32.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.423+0000 7f3e3509e640 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651e7da7430 con 0x7f3e30112020 2024-09-10T05:36:32.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.423+0000 7f3e360a0640 1 -- 172.21.15.62:0/998845069 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e280083f0 con 0x7f3e30112020 2024-09-10T05:36:32.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.423+0000 7f3e360a0640 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651e7da7430 con 0x5651e7d9b3e0 2024-09-10T05:36:32.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.427+0000 7f3e360a0640 1 -- 172.21.15.62:0/998845069 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e280083f0 con 0x5651e7d9b3e0 2024-09-10T05:36:32.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.427+0000 7f3e360a0640 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651e7da7430 con 0x7f3e30112020 2024-09-10T05:36:32.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.427+0000 7f3e360a0640 1 -- 172.21.15.62:0/998845069 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e280083f0 con 0x7f3e30112020 2024-09-10T05:36:32.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.427+0000 7f3e360a0640 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651e7da7430 con 0x5651e7da30b0 2024-09-10T05:36:32.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.427+0000 7f3e3509e640 1 -- 172.21.15.62:0/998845069 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e2c00bd60 con 0x5651e7da30b0 2024-09-10T05:36:32.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.427+0000 7f3e3509e640 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651e7da7430 con 0x7f3e30112020 2024-09-10T05:36:32.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.427+0000 7f3e360a0640 1 -- 172.21.15.62:0/998845069 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e280083f0 con 0x7f3e30112020 2024-09-10T05:36:32.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.427+0000 7f3e360a0640 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651e7da7430 con 0x5651e7d9f860 2024-09-10T05:36:32.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.427+0000 7f3e3589f640 1 -- 172.21.15.62:0/998845069 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e3010f020 con 0x5651e7d9f860 2024-09-10T05:36:32.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.427+0000 7f3e3589f640 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651e7da7430 con 0x5651e7d9f860 2024-09-10T05:36:32.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.427+0000 7f3e3589f640 1 -- 172.21.15.62:0/998845069 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e3010f020 con 0x5651e7d9f860 2024-09-10T05:36:32.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.427+0000 7f3e3589f640 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651e7da7430 con 0x5651e7da30b0 2024-09-10T05:36:32.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.427+0000 7f3e3509e640 1 -- 172.21.15.62:0/998845069 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e2c00bd60 con 0x5651e7da30b0 2024-09-10T05:36:32.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.427+0000 7f3e3509e640 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651e7da7430 con 0x5651e7d9f860 2024-09-10T05:36:32.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.427+0000 7f3e3589f640 1 -- 172.21.15.62:0/998845069 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3e3010f020 con 0x5651e7d9f860 2024-09-10T05:36:32.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.427+0000 7f3e3589f640 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651e7da7430 con 0x5651e7d9f860 2024-09-10T05:36:32.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.431+0000 7f3e3589f640 1 -- 172.21.15.62:0/998845069 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e3010f020 con 0x5651e7d9f860 2024-09-10T05:36:32.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.431+0000 7f3e37d999c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:32.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.431+0000 7f3e37d999c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:32.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.431+0000 7f3e37d999c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:32.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.431+0000 7f3e37d999c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:32.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.431+0000 7f3e37d999c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:32.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.431+0000 7f3e37d999c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:32.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.431+0000 7f3e37d999c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.431+0000 7f3e37d999c0 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5651e7da6530 con 0x5651e7d9b3e0 2024-09-10T05:36:32.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.431+0000 7f3e360a0640 1 -- 172.21.15.62:0/998845069 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3e280083f0 con 0x5651e7d9b3e0 2024-09-10T05:36:32.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.431+0000 7f3e37d999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:32.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.431+0000 7f3e37d999c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.431+0000 7f3e37d999c0 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5651e7da6950 con 0x5651e7d9f860 2024-09-10T05:36:32.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.431+0000 7f3e3589f640 1 -- 172.21.15.62:0/998845069 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3e3010f020 con 0x5651e7d9f860 2024-09-10T05:36:32.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.431+0000 7f3e37d999c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:32.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.431+0000 7f3e37d999c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.431+0000 7f3e37d999c0 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5651e7da6d70 con 0x5651e7da30b0 2024-09-10T05:36:32.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.431+0000 7f3e3509e640 1 -- 172.21.15.62:0/998845069 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3e2c00bd60 con 0x5651e7da30b0 2024-09-10T05:36:32.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.431+0000 7f3e37d999c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:32.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.431+0000 7f3e37d999c0 20 zone default found 2024-09-10T05:36:32.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.431+0000 7f3e37d999c0 4 Realm: () 2024-09-10T05:36:32.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.431+0000 7f3e37d999c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:32.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.431+0000 7f3e37d999c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:32.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.431+0000 7f3e37d999c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:32.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.431+0000 7f3e37d999c0 20 zonegroup default 2024-09-10T05:36:32.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.431+0000 7f3e37d999c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.431+0000 7f3e37d999c0 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5651e7da60a0 con 0x7f3e30112020 2024-09-10T05:36:32.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.431+0000 7f3e360a0640 1 -- 172.21.15.62:0/998845069 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3e280083f0 con 0x7f3e30112020 2024-09-10T05:36:32.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.431+0000 7f3e37d999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:32.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.431+0000 7f3e37d999c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.431+0000 7f3e37d999c0 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5651e7da9b40 con 0x5651e7da30b0 2024-09-10T05:36:32.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.431+0000 7f3e3509e640 1 -- 172.21.15.62:0/998845069 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3e2c00bd60 con 0x5651e7da30b0 2024-09-10T05:36:32.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.431+0000 7f3e37d999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:32.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.431+0000 7f3e37d999c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.431+0000 7f3e37d999c0 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5651e7da9fa0 con 0x5651e7da30b0 2024-09-10T05:36:32.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.431+0000 7f3e3509e640 1 -- 172.21.15.62:0/998845069 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3e2c00bd60 con 0x5651e7da30b0 2024-09-10T05:36:32.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.431+0000 7f3e37d999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:32.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.431+0000 7f3e37d999c0 20 started sync module instance, tier type = 2024-09-10T05:36:32.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.431+0000 7f3e37d999c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:32.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.431+0000 7f3e37d999c0 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651e7da8940 con 0x5651e7d9f860 2024-09-10T05:36:32.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.435+0000 7f3e3589f640 1 -- 172.21.15.62:0/998845069 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e3010f020 con 0x5651e7d9f860 2024-09-10T05:36:32.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.435+0000 7f3e37d999c0 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94909782199872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651e7da8940 con 0x5651e7d9f860 2024-09-10T05:36:32.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.435+0000 7f3e37d999c0 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651e7daaad0 con 0x5651e7d9b3e0 2024-09-10T05:36:32.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.435+0000 7f3e360a0640 1 -- 172.21.15.62:0/998845069 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e280083f0 con 0x5651e7d9b3e0 2024-09-10T05:36:32.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.435+0000 7f3e37d999c0 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94909782205888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651e7dab3a0 con 0x5651e7d9b3e0 2024-09-10T05:36:32.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.435+0000 7f3e37d999c0 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651e7dabdc0 con 0x5651e7d9f860 2024-09-10T05:36:32.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.435+0000 7f3e3589f640 1 -- 172.21.15.62:0/998845069 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94909782199872] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e3010f020 con 0x5651e7d9f860 2024-09-10T05:36:32.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.435+0000 7f3e360a0640 1 -- 172.21.15.62:0/998845069 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94909782205888] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e280083f0 con 0x5651e7d9b3e0 2024-09-10T05:36:32.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.439+0000 7f3e3589f640 1 -- 172.21.15.62:0/998845069 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e3010f020 con 0x5651e7d9f860 2024-09-10T05:36:32.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.439+0000 7f3e37d999c0 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94909782210736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651e7daaef0 con 0x5651e7d9f860 2024-09-10T05:36:32.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.439+0000 7f3e37d999c0 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651e7dac660 con 0x7f3e30112020 2024-09-10T05:36:32.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.439+0000 7f3e360a0640 1 -- 172.21.15.62:0/998845069 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e280083f0 con 0x7f3e30112020 2024-09-10T05:36:32.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.439+0000 7f3e37d999c0 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94909782213040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651e7daaef0 con 0x7f3e30112020 2024-09-10T05:36:32.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.439+0000 7f3e37d999c0 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651e7dad100 con 0x5651e7d9f860 2024-09-10T05:36:32.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.439+0000 7f3e3589f640 1 -- 172.21.15.62:0/998845069 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94909782210736] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e3010f020 con 0x5651e7d9f860 2024-09-10T05:36:32.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.439+0000 7f3e360a0640 1 -- 172.21.15.62:0/998845069 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94909782213040] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e280083f0 con 0x7f3e30112020 2024-09-10T05:36:32.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.443+0000 7f3e3589f640 1 -- 172.21.15.62:0/998845069 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e3010f020 con 0x5651e7d9f860 2024-09-10T05:36:32.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.443+0000 7f3e37d999c0 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94909782214096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651e7dad0c0 con 0x5651e7d9f860 2024-09-10T05:36:32.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.443+0000 7f3e37d999c0 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651e7dad4f0 con 0x5651e7da30b0 2024-09-10T05:36:32.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.443+0000 7f3e3509e640 1 -- 172.21.15.62:0/998845069 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e2c00bd60 con 0x5651e7da30b0 2024-09-10T05:36:32.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.443+0000 7f3e37d999c0 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94909782197392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651e7dad4f0 con 0x5651e7da30b0 2024-09-10T05:36:32.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.443+0000 7f3e37d999c0 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651e7dae3e0 con 0x5651e7da30b0 2024-09-10T05:36:32.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.443+0000 7f3e3589f640 1 -- 172.21.15.62:0/998845069 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94909782214096] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e3010f020 con 0x5651e7d9f860 2024-09-10T05:36:32.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.443+0000 7f3e3509e640 1 -- 172.21.15.62:0/998845069 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94909782197392] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e2c00bd60 con 0x5651e7da30b0 2024-09-10T05:36:32.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.443+0000 7f3e3509e640 1 -- 172.21.15.62:0/998845069 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e2c00bd60 con 0x5651e7da30b0 2024-09-10T05:36:32.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.443+0000 7f3e37d999c0 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94909782219024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651e7dadf30 con 0x5651e7da30b0 2024-09-10T05:36:32.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.443+0000 7f3e37d999c0 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651e7dae8f0 con 0x7f3e30112020 2024-09-10T05:36:32.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.447+0000 7f3e3509e640 1 -- 172.21.15.62:0/998845069 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94909782219024] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e2c00bd60 con 0x5651e7da30b0 2024-09-10T05:36:32.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.447+0000 7f3e360a0640 1 -- 172.21.15.62:0/998845069 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e280083f0 con 0x7f3e30112020 2024-09-10T05:36:32.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.447+0000 7f3e37d999c0 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94909782215664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651e7dae8f0 con 0x7f3e30112020 2024-09-10T05:36:32.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.447+0000 7f3e37d999c0 20 add_watcher() i=0 2024-09-10T05:36:32.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.447+0000 7f3e37d999c0 20 add_watcher() i=1 2024-09-10T05:36:32.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.447+0000 7f3e37d999c0 20 add_watcher() i=2 2024-09-10T05:36:32.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.447+0000 7f3e37d999c0 20 add_watcher() i=3 2024-09-10T05:36:32.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.447+0000 7f3e37d999c0 20 add_watcher() i=4 2024-09-10T05:36:32.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.447+0000 7f3e37d999c0 20 add_watcher() i=5 2024-09-10T05:36:32.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.447+0000 7f3e37d999c0 20 add_watcher() i=6 2024-09-10T05:36:32.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.447+0000 7f3e360a0640 1 -- 172.21.15.62:0/998845069 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94909782215664] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e280083f0 con 0x7f3e30112020 2024-09-10T05:36:32.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.447+0000 7f3e37d999c0 20 add_watcher() i=7 2024-09-10T05:36:32.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.447+0000 7f3e37d999c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:32.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.447+0000 7f3e37d999c0 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5651e7db1cf0 con 0x5651e7d9b3e0 2024-09-10T05:36:32.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.447+0000 7f3e360a0640 1 -- 172.21.15.62:0/998845069 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3e280083f0 con 0x5651e7d9b3e0 2024-09-10T05:36:32.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.447+0000 7f3e37d999c0 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94909782222432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651e7daf210 con 0x5651e7d9b3e0 2024-09-10T05:36:32.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.451+0000 7f3e360a0640 1 -- 172.21.15.62:0/998845069 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94909782222432] v30'72 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3e280083f0 con 0x5651e7d9b3e0 2024-09-10T05:36:32.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.451+0000 7f3ce77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:32.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.451+0000 7f3e37d999c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:32.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.451+0000 7f3e37d999c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:32.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.451+0000 7f3e37d999c0 5 note: GC not initialized 2024-09-10T05:36:32.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.451+0000 7f3ce67fc640 20 reqs_thread_entry: start 2024-09-10T05:36:32.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.451+0000 7f3e37d999c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:32.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.451+0000 7f3e37d999c0 20 Filter name: none 2024-09-10T05:36:32.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.451+0000 7f3c57fff640 20 reqs_thread_entry: start 2024-09-10T05:36:32.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.451+0000 7f3e37d999c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.451+0000 7f3e37d999c0 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5651e7dd4b80 con 0x5651e7d9b3e0 2024-09-10T05:36:32.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.451+0000 7f3e360a0640 1 -- 172.21.15.62:0/998845069 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f3e280083f0 con 0x5651e7d9b3e0 2024-09-10T05:36:32.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.451+0000 7f3e37d999c0 20 rados_obj.operate() r=0 bl.length=502 2024-09-10T05:36:32.457 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T05:36:30.893777Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-10T05:36:32.257505Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:36:30.893760Z","tags":[],"group_ids":[]} 2024-09-10T05:36:32.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.451+0000 7f3ce77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:32.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.451+0000 7f3e37d999c0 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94909782222432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651e7dd3630 con 0x5651e7d9b3e0 2024-09-10T05:36:32.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.455+0000 7f3e360a0640 1 -- 172.21.15.62:0/998845069 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94909782222432] v30'73 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3e280083f0 con 0x5651e7d9b3e0 2024-09-10T05:36:32.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.455+0000 7f3e37d999c0 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94909782199872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651e7dd3630 con 0x5651e7d9f860 2024-09-10T05:36:32.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.455+0000 7f3e3589f640 1 -- 172.21.15.62:0/998845069 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94909782199872] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e3010f020 con 0x5651e7d9f860 2024-09-10T05:36:32.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.455+0000 7f3e37d999c0 20 remove_watcher() i=0 2024-09-10T05:36:32.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.455+0000 7f3e37d999c0 2 removed watcher, disabling cache 2024-09-10T05:36:32.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.455+0000 7f3e37d999c0 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94909782205888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651e7da8e40 con 0x5651e7d9b3e0 2024-09-10T05:36:32.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.459+0000 7f3e360a0640 1 -- 172.21.15.62:0/998845069 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94909782205888] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e280083f0 con 0x5651e7d9b3e0 2024-09-10T05:36:32.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.459+0000 7f3e37d999c0 20 remove_watcher() i=1 2024-09-10T05:36:32.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.459+0000 7f3e37d999c0 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94909782210736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651e7daa5c0 con 0x5651e7d9f860 2024-09-10T05:36:32.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.459+0000 7f3e3589f640 1 -- 172.21.15.62:0/998845069 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94909782210736] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e3010f020 con 0x5651e7d9f860 2024-09-10T05:36:32.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.459+0000 7f3e37d999c0 20 remove_watcher() i=2 2024-09-10T05:36:32.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.459+0000 7f3e37d999c0 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94909782213040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651e7dab8b0 con 0x7f3e30112020 2024-09-10T05:36:32.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.459+0000 7f3e360a0640 1 -- 172.21.15.62:0/998845069 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94909782213040] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e280083f0 con 0x7f3e30112020 2024-09-10T05:36:32.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.459+0000 7f3e37d999c0 20 remove_watcher() i=3 2024-09-10T05:36:32.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.459+0000 7f3e37d999c0 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94909782214096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651e7dab8b0 con 0x5651e7d9f860 2024-09-10T05:36:32.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.463+0000 7f3e3589f640 1 -- 172.21.15.62:0/998845069 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94909782214096] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e3010f020 con 0x5651e7d9f860 2024-09-10T05:36:32.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.463+0000 7f3e37d999c0 20 remove_watcher() i=4 2024-09-10T05:36:32.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.463+0000 7f3e37d999c0 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94909782197392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651e7dab8b0 con 0x5651e7da30b0 2024-09-10T05:36:32.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.463+0000 7f3e3509e640 1 -- 172.21.15.62:0/998845069 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94909782197392] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e2c00bd60 con 0x5651e7da30b0 2024-09-10T05:36:32.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.463+0000 7f3e37d999c0 20 remove_watcher() i=5 2024-09-10T05:36:32.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.463+0000 7f3e37d999c0 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94909782219024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651e7dab8b0 con 0x5651e7da30b0 2024-09-10T05:36:32.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.467+0000 7f3e3509e640 1 -- 172.21.15.62:0/998845069 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94909782219024] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e2c00bd60 con 0x5651e7da30b0 2024-09-10T05:36:32.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.467+0000 7f3e37d999c0 20 remove_watcher() i=6 2024-09-10T05:36:32.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.467+0000 7f3e37d999c0 1 -- 172.21.15.62:0/998845069 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94909782215664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651e7dad910 con 0x7f3e30112020 2024-09-10T05:36:32.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.467+0000 7f3e360a0640 1 -- 172.21.15.62:0/998845069 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94909782215664] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e280083f0 con 0x7f3e30112020 2024-09-10T05:36:32.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.467+0000 7f3e37d999c0 20 remove_watcher() i=7 2024-09-10T05:36:32.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.467+0000 7f3e37d999c0 1 -- 172.21.15.62:0/998845069 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5651e7d9f860 msgr2=0x5651e7da1c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.467+0000 7f3e37d999c0 1 --2- 172.21.15.62:0/998845069 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5651e7d9f860 0x5651e7da1c50 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.467+0000 7f3e37d999c0 1 -- 172.21.15.62:0/998845069 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5651e7d9b3e0 msgr2=0x5651e7d9d870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.467+0000 7f3e37d999c0 1 --2- 172.21.15.62:0/998845069 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5651e7d9b3e0 0x5651e7d9d870 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.467+0000 7f3e37d999c0 1 -- 172.21.15.62:0/998845069 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f3e30112020 msgr2=0x7f3e3010d830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.467+0000 7f3e37d999c0 1 --2- 172.21.15.62:0/998845069 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f3e30112020 0x7f3e3010d830 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.467+0000 7f3e37d999c0 1 -- 172.21.15.62:0/998845069 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5651e7da30b0 msgr2=0x5651e7da54a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.467+0000 7f3e37d999c0 1 --2- 172.21.15.62:0/998845069 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5651e7da30b0 0x5651e7da54a0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.467+0000 7f3e37d999c0 1 -- 172.21.15.62:0/998845069 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3d00039a70 msgr2=0x7f3d0003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.467+0000 7f3e37d999c0 1 --2- 172.21.15.62:0/998845069 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3d00039a70 0x7f3d0003bf30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x5651e7d66760 tx=0x7f3e2c010000 comp rx=0 tx=0).stop 2024-09-10T05:36:32.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.467+0000 7f3e37d999c0 1 -- 172.21.15.62:0/998845069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651e7d89270 msgr2=0x5651e7d905f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.467+0000 7f3e360a0640 1 -- 172.21.15.62:0/998845069 reap_dead start 2024-09-10T05:36:32.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.467+0000 7f3e37d999c0 1 --2- 172.21.15.62:0/998845069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651e7d89270 0x5651e7d905f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3e300bf580 tx=0x7f3e300e3090 comp rx=0 tx=0).stop 2024-09-10T05:36:32.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.467+0000 7f3e37d999c0 1 -- 172.21.15.62:0/998845069 shutdown_connections 2024-09-10T05:36:32.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.467+0000 7f3e37d999c0 1 --2- 172.21.15.62:0/998845069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651e7d89270 0x5651e7d905f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.467+0000 7f3e37d999c0 1 -- 172.21.15.62:0/998845069 >> 172.21.15.62:0/998845069 conn(0x5651e7d81270 msgr2=0x5651e7d7f480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:32.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.467+0000 7f3e37d999c0 1 -- 172.21.15.62:0/998845069 shutdown_connections 2024-09-10T05:36:32.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.467+0000 7f3e37d999c0 1 -- 172.21.15.62:0/998845069 wait complete. 2024-09-10T05:36:32.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.467+0000 7f3e37d999c0 1 -- 172.21.15.62:0/1219406577 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3d10039ac0 msgr2=0x7f3d1003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.467+0000 7f3e37d999c0 1 --2- 172.21.15.62:0/1219406577 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3d10039ac0 0x7f3d1003bf80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c00c010 tx=0x7f3e2c00f000 comp rx=0 tx=0).stop 2024-09-10T05:36:32.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.467+0000 7f3e37d999c0 1 -- 172.21.15.62:0/1219406577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651e7d786b0 msgr2=0x5651e7d78ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.467+0000 7f3e37d999c0 1 --2- 172.21.15.62:0/1219406577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651e7d786b0 0x5651e7d78ad0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3e300aa650 tx=0x7f3e300bc720 comp rx=0 tx=0).stop 2024-09-10T05:36:32.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.467+0000 7f3e37d999c0 1 -- 172.21.15.62:0/1219406577 shutdown_connections 2024-09-10T05:36:32.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.467+0000 7f3e37d999c0 1 --2- 172.21.15.62:0/1219406577 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3d10039ac0 0x7f3d1003bf80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.467+0000 7f3e37d999c0 1 --2- 172.21.15.62:0/1219406577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651e7d786b0 0x5651e7d78ad0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.467+0000 7f3e37d999c0 1 -- 172.21.15.62:0/1219406577 >> 172.21.15.62:0/1219406577 conn(0x5651e7d6e060 msgr2=0x5651e7d6e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:32.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.467+0000 7f3e37d999c0 1 -- 172.21.15.62:0/1219406577 shutdown_connections 2024-09-10T05:36:32.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.467+0000 7f3e37d999c0 1 -- 172.21.15.62:0/1219406577 wait complete. 2024-09-10T05:36:32.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.467+0000 7f3e37d999c0 1 -- 172.21.15.62:0/1067097513 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5651e7d62b30 msgr2=0x5651e7d64ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.467+0000 7f3e37d999c0 1 --2- 172.21.15.62:0/1067097513 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5651e7d62b30 0x5651e7d64ff0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.467+0000 7f3e37d999c0 1 -- 172.21.15.62:0/1067097513 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5651e7c6b790 msgr2=0x5651e7d61b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.467+0000 7f3e37d999c0 1 --2- 172.21.15.62:0/1067097513 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5651e7c6b790 0x5651e7d61b40 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.467+0000 7f3e37d999c0 1 -- 172.21.15.62:0/1067097513 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5651e7d67520 msgr2=0x5651e7d69910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.467+0000 7f3e37d999c0 1 --2- 172.21.15.62:0/1067097513 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5651e7d67520 0x5651e7d69910 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.467+0000 7f3e37d999c0 1 -- 172.21.15.62:0/1067097513 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3d1c039a70 msgr2=0x7f3d1c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.467+0000 7f3e37d999c0 1 --2- 172.21.15.62:0/1067097513 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3d1c039a70 0x7f3d1c03bf30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c001e40 tx=0x7f3e2c0013a0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.467+0000 7f3e37d999c0 1 -- 172.21.15.62:0/1067097513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651e7c685b0 msgr2=0x5651e7d5a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.467+0000 7f3e37d999c0 1 --2- 172.21.15.62:0/1067097513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651e7c685b0 0x5651e7d5a9d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3e3001b930 tx=0x7f3e30017e30 comp rx=0 tx=0).stop 2024-09-10T05:36:32.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.467+0000 7f3e360a0640 1 -- 172.21.15.62:0/1067097513 reap_dead start 2024-09-10T05:36:32.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.467+0000 7f3e37d999c0 1 -- 172.21.15.62:0/1067097513 shutdown_connections 2024-09-10T05:36:32.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.471+0000 7f3e37d999c0 1 -- 172.21.15.62:0/1067097513 >> 172.21.15.62:0/1067097513 conn(0x5651e7c640d0 msgr2=0x5651e7d4db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:32.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.471+0000 7f3e37d999c0 1 -- 172.21.15.62:0/1067097513 shutdown_connections 2024-09-10T05:36:32.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.471+0000 7f3e37d999c0 1 -- 172.21.15.62:0/1067097513 wait complete. 2024-09-10T05:36:32.483 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T05:36:30.893777Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-10T05:36:32.257505Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:36:30.893760Z', 'tags': [], 'group_ids': []} 2024-09-10T05:36:32.484 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-10T05:36:32.484 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-10T05:36:32.484 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2024-09-10T05:36:32.557 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:32.557 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:32.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.555+0000 7ff72b5419c0 1 Processor -- start 2024-09-10T05:36:32.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.555+0000 7ff72b5419c0 1 -- start start 2024-09-10T05:36:32.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.555+0000 7ff72b5419c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55763cb796f0 0x55763cb7bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.555+0000 7ff72b5419c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55763ca239c0 con 0x55763cae5f90 2024-09-10T05:36:32.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.555+0000 7ff72b5419c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x55763ca736d0 con 0x55763cb796f0 2024-09-10T05:36:32.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.555+0000 7ff728846640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55763cb796f0 0x55763cb7bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.555+0000 7ff729047640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x55763cae5f90 0x55763cae6370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:38574/0 (socket says 172.21.15.62:38574) 2024-09-10T05:36:32.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.555+0000 7ff729047640 1 -- 172.21.15.62:0/4033572454 learned_addr learned my addr 172.21.15.62:0/4033572454 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-10T05:36:32.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.555+0000 7ff728846640 1 -- 172.21.15.62:0/4033572454 >> v1:172.21.15.2:6789/0 conn(0x55763cae5f90 legacy=0x55763cae6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.555+0000 7ff71bfff640 1 -- 172.21.15.62:0/4033572454 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 940935882 0 0) 0x55763ca239c0 con 0x55763cae5f90 2024-09-10T05:36:32.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.555+0000 7ff728846640 1 -- 172.21.15.62:0/4033572454 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55763ca17ca0 con 0x55763cb796f0 2024-09-10T05:36:32.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.559+0000 7ff728846640 1 --2- 172.21.15.62:0/4033572454 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55763cb796f0 0x55763cb7bae0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff72000a480 tx=0x7ff72001b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55003888aeffd064 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.559+0000 7ff71bfff640 1 -- 172.21.15.62:0/4033572454 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7200aa570 con 0x55763cb796f0 2024-09-10T05:36:32.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.559+0000 7ff71bfff640 1 -- 172.21.15.62:0/4033572454 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7200af070 con 0x55763cb796f0 2024-09-10T05:36:32.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.559+0000 7ff71bfff640 1 -- 172.21.15.62:0/4033572454 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7200aa860 con 0x55763cb796f0 2024-09-10T05:36:32.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.559+0000 7ff72b5419c0 1 -- 172.21.15.62:0/4033572454 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55763cb796f0 msgr2=0x55763cb7bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.559+0000 7ff72b5419c0 1 --2- 172.21.15.62:0/4033572454 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55763cb796f0 0x55763cb7bae0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff72000a480 tx=0x7ff72001b310 comp rx=0 tx=0).stop 2024-09-10T05:36:32.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.559+0000 7ff72b5419c0 1 -- 172.21.15.62:0/4033572454 shutdown_connections 2024-09-10T05:36:32.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.559+0000 7ff72b5419c0 1 --2- 172.21.15.62:0/4033572454 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55763cb796f0 0x55763cb7bae0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.559+0000 7ff72b5419c0 1 -- 172.21.15.62:0/4033572454 >> 172.21.15.62:0/4033572454 conn(0x55763cae4b00 msgr2=0x55763cae4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:32.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.559+0000 7ff72b5419c0 1 -- 172.21.15.62:0/4033572454 shutdown_connections 2024-09-10T05:36:32.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.559+0000 7ff72b5419c0 1 -- 172.21.15.62:0/4033572454 wait complete. 2024-09-10T05:36:32.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.575+0000 7ff72b5419c0 1 Processor -- start 2024-09-10T05:36:32.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.575+0000 7ff72b5419c0 1 -- start start 2024-09-10T05:36:32.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.575+0000 7ff72b5419c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55763cae5f90 0x55763cc60b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.575+0000 7ff72b5419c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55763ca77680 con 0x55763cae5f90 2024-09-10T05:36:32.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.575+0000 7ff729047640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55763cae5f90 0x55763cc60b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.575+0000 7ff729047640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55763cae5f90 0x55763cc60b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51706/0 (socket says 172.21.15.62:51706) 2024-09-10T05:36:32.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.575+0000 7ff729047640 1 -- 172.21.15.62:0/2985050162 learned_addr learned my addr 172.21.15.62:0/2985050162 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:32.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.575+0000 7ff729047640 1 -- 172.21.15.62:0/2985050162 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55763c9f2da0 con 0x55763cae5f90 2024-09-10T05:36:32.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.575+0000 7ff729047640 1 --2- 172.21.15.62:0/2985050162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55763cae5f90 0x55763cc60b40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff724001eb0 tx=0x7ff72400b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e0deb89cf8f1af7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.575+0000 7ff617606640 1 -- 172.21.15.62:0/2985050162 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff72400d640 con 0x55763cae5f90 2024-09-10T05:36:32.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.575+0000 7ff617606640 1 -- 172.21.15.62:0/2985050162 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff724008070 con 0x55763cae5f90 2024-09-10T05:36:32.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.575+0000 7ff617606640 1 -- 172.21.15.62:0/2985050162 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff72400d970 con 0x55763cae5f90 2024-09-10T05:36:32.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.579+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2985050162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55763cae5f90 msgr2=0x55763cc60b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.579+0000 7ff72b5419c0 1 --2- 172.21.15.62:0/2985050162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55763cae5f90 0x55763cc60b40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff724001eb0 tx=0x7ff72400b6b0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.579+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2985050162 shutdown_connections 2024-09-10T05:36:32.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.579+0000 7ff72b5419c0 1 --2- 172.21.15.62:0/2985050162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55763cae5f90 0x55763cc60b40 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.579+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2985050162 >> 172.21.15.62:0/2985050162 conn(0x55763cae4b00 msgr2=0x55763cc5c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:32.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.579+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2985050162 shutdown_connections 2024-09-10T05:36:32.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.579+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2985050162 wait complete. 2024-09-10T05:36:32.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.579+0000 7ff72b5419c0 1 Processor -- start 2024-09-10T05:36:32.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.579+0000 7ff72b5419c0 1 -- start start 2024-09-10T05:36:32.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.579+0000 7ff72b5419c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55763cb796f0 0x55763cc68530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.579+0000 7ff72b5419c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55763ca19a50 con 0x55763cb796f0 2024-09-10T05:36:32.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.579+0000 7ff729047640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55763cb796f0 0x55763cc68530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.579+0000 7ff729047640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55763cb796f0 0x55763cc68530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51720/0 (socket says 172.21.15.62:51720) 2024-09-10T05:36:32.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.579+0000 7ff729047640 1 -- 172.21.15.62:0/246289723 learned_addr learned my addr 172.21.15.62:0/246289723 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:32.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.579+0000 7ff729047640 1 -- 172.21.15.62:0/246289723 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55763cc68a90 con 0x55763cb796f0 2024-09-10T05:36:32.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.579+0000 7ff729047640 1 --2- 172.21.15.62:0/246289723 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55763cb796f0 0x55763cc68530 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff724000f70 tx=0x7ff724000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.579+0000 7ff615e03640 1 -- 172.21.15.62:0/246289723 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff72401a690 con 0x55763cb796f0 2024-09-10T05:36:32.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.579+0000 7ff72b5419c0 1 -- 172.21.15.62:0/246289723 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55763cc68d20 con 0x55763cb796f0 2024-09-10T05:36:32.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.579+0000 7ff615e03640 1 -- 172.21.15.62:0/246289723 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff72401a830 con 0x55763cb796f0 2024-09-10T05:36:32.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.579+0000 7ff615e03640 1 -- 172.21.15.62:0/246289723 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff72401ab50 con 0x55763cb796f0 2024-09-10T05:36:32.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.579+0000 7ff72b5419c0 1 -- 172.21.15.62:0/246289723 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55763cc69630 con 0x55763cb796f0 2024-09-10T05:36:32.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.583+0000 7ff615e03640 1 -- 172.21.15.62:0/246289723 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff724017070 con 0x55763cb796f0 2024-09-10T05:36:32.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.583+0000 7ff615e03640 1 --2- 172.21.15.62:0/246289723 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff610039a70 0x7ff61003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.583+0000 7ff615e03640 1 -- 172.21.15.62:0/246289723 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7ff724015020 con 0x55763cb796f0 2024-09-10T05:36:32.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.583+0000 7ff728846640 1 --2- 172.21.15.62:0/246289723 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff610039a70 0x7ff61003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.583+0000 7ff72b5419c0 1 --2- 172.21.15.62:0/246289723 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55763cc6d5f0 0x55763cc6f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.583+0000 7ff72b5419c0 1 -- 172.21.15.62:0/246289723 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55763cc6ff20 con 0x55763cc6d5f0 2024-09-10T05:36:32.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.583+0000 7ff729848640 1 --2- 172.21.15.62:0/246289723 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55763cc6d5f0 0x55763cc6f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.583+0000 7ff728846640 1 --2- 172.21.15.62:0/246289723 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff610039a70 0x7ff61003bf30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff7200ae000 tx=0x7ff7200a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.583+0000 7ff729848640 1 --2- 172.21.15.62:0/246289723 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55763cc6d5f0 0x55763cc6f9e0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.583+0000 7ff729848640 1 -- 172.21.15.62:0/246289723 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff71c00a4d0 con 0x55763cc6d5f0 2024-09-10T05:36:32.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.583+0000 7ff72b5419c0 1 --2- 172.21.15.62:0/246289723 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55763cc70a20 0x55763cc72ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.583+0000 7ff72b5419c0 1 -- 172.21.15.62:0/246289723 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55763cc73650 con 0x55763cc70a20 2024-09-10T05:36:32.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.583+0000 7ff729047640 1 --2- 172.21.15.62:0/246289723 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55763cc70a20 0x55763cc72ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.583+0000 7ff729047640 1 --2- 172.21.15.62:0/246289723 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55763cc70a20 0x55763cc72ee0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.583+0000 7ff729047640 1 -- 172.21.15.62:0/246289723 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff72402e070 con 0x55763cc70a20 2024-09-10T05:36:32.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.583+0000 7ff72b5419c0 1 --2- 172.21.15.62:0/246289723 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55763cc75410 0x55763cc77800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.583+0000 7ff72b5419c0 1 -- 172.21.15.62:0/246289723 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55763cc77ed0 con 0x55763cc75410 2024-09-10T05:36:32.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.583+0000 7ff728846640 1 --2- 172.21.15.62:0/246289723 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55763cc75410 0x55763cc77800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.583+0000 7ff728846640 1 --2- 172.21.15.62:0/246289723 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55763cc75410 0x55763cc77800 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.587+0000 7ff728846640 1 -- 172.21.15.62:0/246289723 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff7200a8070 con 0x55763cc75410 2024-09-10T05:36:32.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.587+0000 7ff72b5419c0 1 -- 172.21.15.62:0/246289723 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55763cc742b0 con 0x55763cc70a20 2024-09-10T05:36:32.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.587+0000 7ff729047640 1 -- 172.21.15.62:0/246289723 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff72402e070 con 0x55763cc70a20 2024-09-10T05:36:32.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.587+0000 7ff72b5419c0 1 -- 172.21.15.62:0/246289723 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55763cc74710 con 0x55763cc75410 2024-09-10T05:36:32.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.587+0000 7ff728846640 1 -- 172.21.15.62:0/246289723 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff7200a8070 con 0x55763cc75410 2024-09-10T05:36:32.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.587+0000 7ff72b5419c0 1 Processor -- start 2024-09-10T05:36:32.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.587+0000 7ff72b5419c0 1 -- start start 2024-09-10T05:36:32.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.587+0000 7ff72b5419c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55763cc864e0 0x55763cc86900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.587+0000 7ff72b5419c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55763ca84450 con 0x55763cc864e0 2024-09-10T05:36:32.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.587+0000 7ff729047640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55763cc864e0 0x55763cc86900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.587+0000 7ff729047640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55763cc864e0 0x55763cc86900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51726/0 (socket says 172.21.15.62:51726) 2024-09-10T05:36:32.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.587+0000 7ff729047640 1 -- 172.21.15.62:0/2601683386 learned_addr learned my addr 172.21.15.62:0/2601683386 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:32.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.587+0000 7ff729047640 1 -- 172.21.15.62:0/2601683386 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55763cc86f40 con 0x55763cc864e0 2024-09-10T05:36:32.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.587+0000 7ff729047640 1 --2- 172.21.15.62:0/2601683386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55763cc864e0 0x55763cc86900 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff72400e560 tx=0x7ff72401b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.587+0000 7ff60effd640 1 -- 172.21.15.62:0/2601683386 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff724035030 con 0x55763cc864e0 2024-09-10T05:36:32.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.587+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2601683386 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55763cc877a0 con 0x55763cc864e0 2024-09-10T05:36:32.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.587+0000 7ff60effd640 1 -- 172.21.15.62:0/2601683386 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff724050040 con 0x55763cc864e0 2024-09-10T05:36:32.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.587+0000 7ff60effd640 1 -- 172.21.15.62:0/2601683386 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff72401c580 con 0x55763cc864e0 2024-09-10T05:36:32.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.587+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2601683386 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55763cc87d10 con 0x55763cc864e0 2024-09-10T05:36:32.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.591+0000 7ff60effd640 1 -- 172.21.15.62:0/2601683386 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff724045070 con 0x55763cc864e0 2024-09-10T05:36:32.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.591+0000 7ff60effd640 1 --2- 172.21.15.62:0/2601683386 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff600039ac0 0x7ff60003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.591+0000 7ff60effd640 1 -- 172.21.15.62:0/2601683386 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7ff724039070 con 0x55763cc864e0 2024-09-10T05:36:32.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.591+0000 7ff728846640 1 --2- 172.21.15.62:0/2601683386 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff600039ac0 0x7ff60003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.591+0000 7ff72b5419c0 1 Processor -- start 2024-09-10T05:36:32.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.591+0000 7ff72b5419c0 1 -- start start 2024-09-10T05:36:32.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.591+0000 7ff72b5419c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55763cc93c70 0x55763cc94070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.591+0000 7ff72b5419c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55763cc61390 con 0x55763cc93c70 2024-09-10T05:36:32.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.591+0000 7ff728846640 1 --2- 172.21.15.62:0/2601683386 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff600039ac0 0x7ff60003bf80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff720018f40 tx=0x7ff720005a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.591+0000 7ff729047640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55763cc93c70 0x55763cc94070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.591+0000 7ff729047640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55763cc93c70 0x55763cc94070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51730/0 (socket says 172.21.15.62:51730) 2024-09-10T05:36:32.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.591+0000 7ff729047640 1 -- 172.21.15.62:0/2834503799 learned_addr learned my addr 172.21.15.62:0/2834503799 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:32.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.591+0000 7ff729047640 1 -- 172.21.15.62:0/2834503799 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55763cc94660 con 0x55763cc93c70 2024-09-10T05:36:32.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.591+0000 7ff729047640 1 --2- 172.21.15.62:0/2834503799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55763cc93c70 0x55763cc94070 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff72400e790 tx=0x7ff724047cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e7e7cc08a6733b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.591+0000 7ff60cff9640 1 -- 172.21.15.62:0/2834503799 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff724032030 con 0x55763cc93c70 2024-09-10T05:36:32.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.591+0000 7ff60cff9640 1 -- 172.21.15.62:0/2834503799 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff724062020 con 0x55763cc93c70 2024-09-10T05:36:32.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.591+0000 7ff60cff9640 1 -- 172.21.15.62:0/2834503799 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7240473b0 con 0x55763cc93c70 2024-09-10T05:36:32.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.591+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2834503799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55763cc93c70 msgr2=0x55763cc94070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.591+0000 7ff72b5419c0 1 --2- 172.21.15.62:0/2834503799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55763cc93c70 0x55763cc94070 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff72400e790 tx=0x7ff724047cd0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.595+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2834503799 shutdown_connections 2024-09-10T05:36:32.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.595+0000 7ff72b5419c0 1 --2- 172.21.15.62:0/2834503799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55763cc93c70 0x55763cc94070 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.595+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2834503799 >> 172.21.15.62:0/2834503799 conn(0x55763cc8f090 msgr2=0x55763cc8d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:32.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.595+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2834503799 shutdown_connections 2024-09-10T05:36:32.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.595+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2834503799 wait complete. 2024-09-10T05:36:32.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.595+0000 7ff72b5419c0 1 Processor -- start 2024-09-10T05:36:32.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.595+0000 7ff72b5419c0 1 -- start start 2024-09-10T05:36:32.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.595+0000 7ff72b5419c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55763cc93c70 0x55763cc9a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.595+0000 7ff72b5419c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55763cc92a40 con 0x55763cc93c70 2024-09-10T05:36:32.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.595+0000 7ff729047640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55763cc93c70 0x55763cc9a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.595+0000 7ff729047640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55763cc93c70 0x55763cc9a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51740/0 (socket says 172.21.15.62:51740) 2024-09-10T05:36:32.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.595+0000 7ff729047640 1 -- 172.21.15.62:0/2361923237 learned_addr learned my addr 172.21.15.62:0/2361923237 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:32.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.595+0000 7ff729047640 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55763cc9a580 con 0x55763cc93c70 2024-09-10T05:36:32.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.595+0000 7ff729047640 1 --2- 172.21.15.62:0/2361923237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55763cc93c70 0x55763cc9a020 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff724050a10 tx=0x7ff724009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.595+0000 7ff5feffd640 1 -- 172.21.15.62:0/2361923237 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff724061050 con 0x55763cc93c70 2024-09-10T05:36:32.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.595+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55763cc9a580 con 0x55763cc93c70 2024-09-10T05:36:32.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.595+0000 7ff5feffd640 1 -- 172.21.15.62:0/2361923237 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff72400ebd0 con 0x55763cc93c70 2024-09-10T05:36:32.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.595+0000 7ff5feffd640 1 -- 172.21.15.62:0/2361923237 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff724019600 con 0x55763cc93c70 2024-09-10T05:36:32.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.595+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55763cc9a580 con 0x55763cc93c70 2024-09-10T05:36:32.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.595+0000 7ff5feffd640 1 -- 172.21.15.62:0/2361923237 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff724058070 con 0x55763cc93c70 2024-09-10T05:36:32.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.595+0000 7ff72b5419c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.599+0000 7ff5feffd640 1 --2- 172.21.15.62:0/2361923237 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff5f4039a70 0x7ff5f403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.599+0000 7ff5feffd640 1 -- 172.21.15.62:0/2361923237 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7ff72406f030 con 0x55763cc93c70 2024-09-10T05:36:32.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.599+0000 7ff728846640 1 --2- 172.21.15.62:0/2361923237 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff5f4039a70 0x7ff5f403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.599+0000 7ff72b5419c0 1 --2- 172.21.15.62:0/2361923237 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55763cca4f10 0x55763cca73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.599+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55763cca7af0 con 0x55763cca4f10 2024-09-10T05:36:32.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.599+0000 7ff729848640 1 --2- 172.21.15.62:0/2361923237 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55763cca4f10 0x55763cca73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.599+0000 7ff729848640 1 --2- 172.21.15.62:0/2361923237 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55763cca4f10 0x55763cca73a0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.599+0000 7ff728846640 1 --2- 172.21.15.62:0/2361923237 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff5f4039a70 0x7ff5f403bf30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff7200199c0 tx=0x7ff7200a8000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.599+0000 7ff729848640 1 -- 172.21.15.62:0/2361923237 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff71c00a4d0 con 0x55763cca4f10 2024-09-10T05:36:32.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.599+0000 7ff72b5419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:32.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.599+0000 7ff72b5419c0 20 realm 2024-09-10T05:36:32.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.599+0000 7ff72b5419c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.599+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55763cca4300 con 0x55763cca4f10 2024-09-10T05:36:32.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.599+0000 7ff729848640 1 -- 172.21.15.62:0/2361923237 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff71c00a4d0 con 0x55763cca4f10 2024-09-10T05:36:32.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.599+0000 7ff72b5419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:32.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.599+0000 7ff72b5419c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:32.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.599+0000 7ff72b5419c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.599+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55763cca85c0 con 0x55763cca4f10 2024-09-10T05:36:32.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.599+0000 7ff729848640 1 -- 172.21.15.62:0/2361923237 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff71c00a4d0 con 0x55763cca4f10 2024-09-10T05:36:32.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.599+0000 7ff72b5419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:32.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.599+0000 7ff72b5419c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.599+0000 7ff72b5419c0 1 --2- 172.21.15.62:0/2361923237 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55763cca93a0 0x55763ccab790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.599+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55763ccabe20 con 0x55763cca93a0 2024-09-10T05:36:32.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.599+0000 7ff729047640 1 --2- 172.21.15.62:0/2361923237 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55763cca93a0 0x55763ccab790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.599+0000 7ff729047640 1 --2- 172.21.15.62:0/2361923237 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55763cca93a0 0x55763ccab790 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.599+0000 7ff729047640 1 -- 172.21.15.62:0/2361923237 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff72402e070 con 0x55763cca93a0 2024-09-10T05:36:32.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.599+0000 7ff72b5419c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:32.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.599+0000 7ff72b5419c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.599+0000 7ff72b5419c0 1 --2- 172.21.15.62:0/2361923237 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55763ccacb80 0x55763ccaef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.599+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55763ccaf720 con 0x55763ccacb80 2024-09-10T05:36:32.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.599+0000 7ff728846640 1 --2- 172.21.15.62:0/2361923237 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55763ccacb80 0x55763ccaef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.599+0000 7ff728846640 1 --2- 172.21.15.62:0/2361923237 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55763ccacb80 0x55763ccaef90 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.603+0000 7ff728846640 1 -- 172.21.15.62:0/2361923237 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff7200a8070 con 0x55763ccacb80 2024-09-10T05:36:32.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.603+0000 7ff72b5419c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:32.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.603+0000 7ff72b5419c0 20 searching for the correct realm 2024-09-10T05:36:32.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.603+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb0ff0 con 0x55763ccacb80 2024-09-10T05:36:32.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.603+0000 7ff728846640 1 -- 172.21.15.62:0/2361923237 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7200a8070 con 0x55763ccacb80 2024-09-10T05:36:32.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.603+0000 7ff728846640 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb0ff0 con 0x55763cca93a0 2024-09-10T05:36:32.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.603+0000 7ff729047640 1 -- 172.21.15.62:0/2361923237 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff72402e070 con 0x55763cca93a0 2024-09-10T05:36:32.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.603+0000 7ff729047640 1 --2- 172.21.15.62:0/2361923237 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7ff72400f400 0x7ff72405dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.603+0000 7ff729047640 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb0ff0 con 0x7ff72400f400 2024-09-10T05:36:32.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.603+0000 7ff729848640 1 --2- 172.21.15.62:0/2361923237 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7ff72400f400 0x7ff72405dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.603+0000 7ff729848640 1 --2- 172.21.15.62:0/2361923237 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7ff72400f400 0x7ff72405dac0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.603+0000 7ff729848640 1 -- 172.21.15.62:0/2361923237 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff71c00a4d0 con 0x7ff72400f400 2024-09-10T05:36:32.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.603+0000 7ff729848640 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb0ff0 con 0x55763cca4f10 2024-09-10T05:36:32.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.603+0000 7ff729848640 1 -- 172.21.15.62:0/2361923237 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff71c00a4d0 con 0x55763cca4f10 2024-09-10T05:36:32.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.603+0000 7ff729848640 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb0ff0 con 0x55763cca4f10 2024-09-10T05:36:32.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.603+0000 7ff729848640 1 -- 172.21.15.62:0/2361923237 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff71c00a4d0 con 0x55763cca4f10 2024-09-10T05:36:32.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.603+0000 7ff729848640 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb0ff0 con 0x55763ccacb80 2024-09-10T05:36:32.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.603+0000 7ff728846640 1 -- 172.21.15.62:0/2361923237 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7200a8070 con 0x55763ccacb80 2024-09-10T05:36:32.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.603+0000 7ff728846640 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb0ff0 con 0x55763cca4f10 2024-09-10T05:36:32.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.603+0000 7ff729848640 1 -- 172.21.15.62:0/2361923237 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff71c00a4d0 con 0x55763cca4f10 2024-09-10T05:36:32.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.603+0000 7ff729848640 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb0ff0 con 0x55763cca93a0 2024-09-10T05:36:32.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.603+0000 7ff729047640 1 -- 172.21.15.62:0/2361923237 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff72402e070 con 0x55763cca93a0 2024-09-10T05:36:32.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.603+0000 7ff729047640 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb0ff0 con 0x55763cca93a0 2024-09-10T05:36:32.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.607+0000 7ff729047640 1 -- 172.21.15.62:0/2361923237 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff72402e070 con 0x55763cca93a0 2024-09-10T05:36:32.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.607+0000 7ff729047640 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb0ff0 con 0x55763cca4f10 2024-09-10T05:36:32.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.607+0000 7ff729848640 1 -- 172.21.15.62:0/2361923237 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff71c00a4d0 con 0x55763cca4f10 2024-09-10T05:36:32.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.607+0000 7ff729848640 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb0ff0 con 0x7ff72400f400 2024-09-10T05:36:32.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.607+0000 7ff729848640 1 -- 172.21.15.62:0/2361923237 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff71c00a4d0 con 0x7ff72400f400 2024-09-10T05:36:32.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.607+0000 7ff729848640 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb0ff0 con 0x55763cca4f10 2024-09-10T05:36:32.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.607+0000 7ff729848640 1 -- 172.21.15.62:0/2361923237 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff71c00a4d0 con 0x55763cca4f10 2024-09-10T05:36:32.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.607+0000 7ff729848640 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb0ff0 con 0x7ff72400f400 2024-09-10T05:36:32.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.607+0000 7ff729848640 1 -- 172.21.15.62:0/2361923237 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff71c00a4d0 con 0x7ff72400f400 2024-09-10T05:36:32.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.607+0000 7ff729848640 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb0ff0 con 0x55763cca93a0 2024-09-10T05:36:32.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.607+0000 7ff729047640 1 -- 172.21.15.62:0/2361923237 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff72402e070 con 0x55763cca93a0 2024-09-10T05:36:32.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.607+0000 7ff729047640 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb0ff0 con 0x55763ccacb80 2024-09-10T05:36:32.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.607+0000 7ff728846640 1 -- 172.21.15.62:0/2361923237 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7200a8070 con 0x55763ccacb80 2024-09-10T05:36:32.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.607+0000 7ff728846640 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb0ff0 con 0x55763cca4f10 2024-09-10T05:36:32.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.607+0000 7ff729848640 1 -- 172.21.15.62:0/2361923237 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff71c00a4d0 con 0x55763cca4f10 2024-09-10T05:36:32.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.607+0000 7ff729848640 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb0ff0 con 0x55763cca93a0 2024-09-10T05:36:32.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.607+0000 7ff729047640 1 -- 172.21.15.62:0/2361923237 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff72402e070 con 0x55763cca93a0 2024-09-10T05:36:32.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.607+0000 7ff729047640 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb0ff0 con 0x55763ccacb80 2024-09-10T05:36:32.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.607+0000 7ff728846640 1 -- 172.21.15.62:0/2361923237 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 30 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7ff7200a8070 con 0x55763ccacb80 2024-09-10T05:36:32.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.607+0000 7ff728846640 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb0ff0 con 0x55763cca4f10 2024-09-10T05:36:32.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.611+0000 7ff729848640 1 -- 172.21.15.62:0/2361923237 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff71c00a4d0 con 0x55763cca4f10 2024-09-10T05:36:32.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.611+0000 7ff729848640 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb0ff0 con 0x55763cca4f10 2024-09-10T05:36:32.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.611+0000 7ff729848640 1 -- 172.21.15.62:0/2361923237 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff71c00a4d0 con 0x55763cca4f10 2024-09-10T05:36:32.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.611+0000 7ff729848640 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb0ff0 con 0x55763cca4f10 2024-09-10T05:36:32.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.611+0000 7ff729848640 1 -- 172.21.15.62:0/2361923237 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff71c00a4d0 con 0x55763cca4f10 2024-09-10T05:36:32.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.611+0000 7ff729848640 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb0ff0 con 0x55763ccacb80 2024-09-10T05:36:32.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.611+0000 7ff728846640 1 -- 172.21.15.62:0/2361923237 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7200a8070 con 0x55763ccacb80 2024-09-10T05:36:32.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.611+0000 7ff728846640 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb0ff0 con 0x7ff72400f400 2024-09-10T05:36:32.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.611+0000 7ff729848640 1 -- 172.21.15.62:0/2361923237 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff71c00a4d0 con 0x7ff72400f400 2024-09-10T05:36:32.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.611+0000 7ff729848640 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb0ff0 con 0x55763cca4f10 2024-09-10T05:36:32.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.611+0000 7ff729848640 1 -- 172.21.15.62:0/2361923237 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff71c00a4d0 con 0x55763cca4f10 2024-09-10T05:36:32.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.611+0000 7ff729848640 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb0ff0 con 0x7ff72400f400 2024-09-10T05:36:32.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.611+0000 7ff729848640 1 -- 172.21.15.62:0/2361923237 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff71c00a4d0 con 0x7ff72400f400 2024-09-10T05:36:32.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.611+0000 7ff729848640 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb0ff0 con 0x55763ccacb80 2024-09-10T05:36:32.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.611+0000 7ff728846640 1 -- 172.21.15.62:0/2361923237 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7200a8070 con 0x55763ccacb80 2024-09-10T05:36:32.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.611+0000 7ff728846640 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb0ff0 con 0x7ff72400f400 2024-09-10T05:36:32.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.611+0000 7ff729848640 1 -- 172.21.15.62:0/2361923237 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff71c00a4d0 con 0x7ff72400f400 2024-09-10T05:36:32.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.611+0000 7ff729848640 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb0ff0 con 0x55763cca93a0 2024-09-10T05:36:32.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.611+0000 7ff729047640 1 -- 172.21.15.62:0/2361923237 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff72402e070 con 0x55763cca93a0 2024-09-10T05:36:32.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.611+0000 7ff729047640 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb0ff0 con 0x55763cca93a0 2024-09-10T05:36:32.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.611+0000 7ff729047640 1 -- 172.21.15.62:0/2361923237 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff72402e070 con 0x55763cca93a0 2024-09-10T05:36:32.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.611+0000 7ff729047640 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb0ff0 con 0x55763ccacb80 2024-09-10T05:36:32.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.611+0000 7ff728846640 1 -- 172.21.15.62:0/2361923237 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7200a8070 con 0x55763ccacb80 2024-09-10T05:36:32.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.615+0000 7ff728846640 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb0ff0 con 0x55763cca93a0 2024-09-10T05:36:32.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.615+0000 7ff729047640 1 -- 172.21.15.62:0/2361923237 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff72402e070 con 0x55763cca93a0 2024-09-10T05:36:32.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.615+0000 7ff729047640 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb0ff0 con 0x55763cca93a0 2024-09-10T05:36:32.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.615+0000 7ff729047640 1 -- 172.21.15.62:0/2361923237 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff72402e070 con 0x55763cca93a0 2024-09-10T05:36:32.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.615+0000 7ff72b5419c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:32.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.615+0000 7ff72b5419c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:32.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.615+0000 7ff72b5419c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:32.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.615+0000 7ff72b5419c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:32.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.615+0000 7ff72b5419c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:32.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.615+0000 7ff72b5419c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:32.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.615+0000 7ff72b5419c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.615+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb00e0 con 0x55763cca4f10 2024-09-10T05:36:32.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.615+0000 7ff729848640 1 -- 172.21.15.62:0/2361923237 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff71c00a4d0 con 0x55763cca4f10 2024-09-10T05:36:32.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.615+0000 7ff72b5419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:32.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.615+0000 7ff72b5419c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.615+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55763ccafd20 con 0x55763cca93a0 2024-09-10T05:36:32.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.615+0000 7ff729047640 1 -- 172.21.15.62:0/2361923237 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff72402e070 con 0x55763cca93a0 2024-09-10T05:36:32.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.615+0000 7ff72b5419c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:32.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.615+0000 7ff72b5419c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.615+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb0a80 con 0x55763ccacb80 2024-09-10T05:36:32.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.615+0000 7ff728846640 1 -- 172.21.15.62:0/2361923237 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff7200a8070 con 0x55763ccacb80 2024-09-10T05:36:32.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.615+0000 7ff72b5419c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:32.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.615+0000 7ff72b5419c0 20 zone default found 2024-09-10T05:36:32.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.615+0000 7ff72b5419c0 4 Realm: () 2024-09-10T05:36:32.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.615+0000 7ff72b5419c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:32.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.615+0000 7ff72b5419c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:32.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.615+0000 7ff72b5419c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:32.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.615+0000 7ff72b5419c0 20 zonegroup default 2024-09-10T05:36:32.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.615+0000 7ff72b5419c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.615+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb18d0 con 0x7ff72400f400 2024-09-10T05:36:32.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.615+0000 7ff729848640 1 -- 172.21.15.62:0/2361923237 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff71c00a4d0 con 0x7ff72400f400 2024-09-10T05:36:32.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.615+0000 7ff72b5419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:32.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.615+0000 7ff72b5419c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.615+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb3b10 con 0x55763ccacb80 2024-09-10T05:36:32.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.615+0000 7ff728846640 1 -- 172.21.15.62:0/2361923237 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff7200a8070 con 0x55763ccacb80 2024-09-10T05:36:32.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.615+0000 7ff72b5419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:32.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.615+0000 7ff72b5419c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.615+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb3eb0 con 0x55763ccacb80 2024-09-10T05:36:32.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.615+0000 7ff728846640 1 -- 172.21.15.62:0/2361923237 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff7200a8070 con 0x55763ccacb80 2024-09-10T05:36:32.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.615+0000 7ff72b5419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:32.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.615+0000 7ff72b5419c0 20 started sync module instance, tier type = 2024-09-10T05:36:32.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.615+0000 7ff72b5419c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:32.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.615+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb2f50 con 0x55763cca93a0 2024-09-10T05:36:32.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.619+0000 7ff729047640 1 -- 172.21.15.62:0/2361923237 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff72402e070 con 0x55763cca93a0 2024-09-10T05:36:32.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.619+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93966314451776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb3760 con 0x55763cca93a0 2024-09-10T05:36:32.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.619+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb4bb0 con 0x55763cca4f10 2024-09-10T05:36:32.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.619+0000 7ff729848640 1 -- 172.21.15.62:0/2361923237 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff71c00a4d0 con 0x55763cca4f10 2024-09-10T05:36:32.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.619+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93966314458960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb5820 con 0x55763cca4f10 2024-09-10T05:36:32.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.619+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb61e0 con 0x55763cca93a0 2024-09-10T05:36:32.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.619+0000 7ff729047640 1 -- 172.21.15.62:0/2361923237 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 93966314451776] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff72402e070 con 0x55763cca93a0 2024-09-10T05:36:32.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.623+0000 7ff729848640 1 -- 172.21.15.62:0/2361923237 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93966314458960] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff71c00a4d0 con 0x55763cca4f10 2024-09-10T05:36:32.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.623+0000 7ff729047640 1 -- 172.21.15.62:0/2361923237 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff72402e070 con 0x55763cca93a0 2024-09-10T05:36:32.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.623+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93966314455632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb5820 con 0x55763cca93a0 2024-09-10T05:36:32.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.623+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb6a80 con 0x7ff72400f400 2024-09-10T05:36:32.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.623+0000 7ff729848640 1 -- 172.21.15.62:0/2361923237 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff71c00a4d0 con 0x7ff72400f400 2024-09-10T05:36:32.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.623+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93966314464720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb6ea0 con 0x7ff72400f400 2024-09-10T05:36:32.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.623+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb78e0 con 0x55763cca93a0 2024-09-10T05:36:32.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.623+0000 7ff729848640 1 -- 172.21.15.62:0/2361923237 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93966314464720] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff71c00a4d0 con 0x7ff72400f400 2024-09-10T05:36:32.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.623+0000 7ff729047640 1 -- 172.21.15.62:0/2361923237 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93966314455632] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff72402e070 con 0x55763cca93a0 2024-09-10T05:36:32.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.627+0000 7ff729047640 1 -- 172.21.15.62:0/2361923237 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff72402e070 con 0x55763cca93a0 2024-09-10T05:36:32.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.627+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93966314468272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb69f0 con 0x55763cca93a0 2024-09-10T05:36:32.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.627+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb8180 con 0x55763ccacb80 2024-09-10T05:36:32.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.627+0000 7ff728846640 1 -- 172.21.15.62:0/2361923237 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7200a8070 con 0x55763ccacb80 2024-09-10T05:36:32.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.627+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93966314470608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb69f0 con 0x55763ccacb80 2024-09-10T05:36:32.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.627+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb8c00 con 0x55763ccacb80 2024-09-10T05:36:32.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.627+0000 7ff729047640 1 -- 172.21.15.62:0/2361923237 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 93966314468272] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff72402e070 con 0x55763cca93a0 2024-09-10T05:36:32.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.627+0000 7ff728846640 1 -- 172.21.15.62:0/2361923237 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(56 notify.6 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7200a8070 con 0x55763ccacb80 2024-09-10T05:36:32.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.627+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93966314460016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb8bc0 con 0x55763ccacb80 2024-09-10T05:36:32.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.627+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb9610 con 0x7ff72400f400 2024-09-10T05:36:32.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.627+0000 7ff728846640 1 -- 172.21.15.62:0/2361923237 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93966314470608] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7200a8070 con 0x55763ccacb80 2024-09-10T05:36:32.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.631+0000 7ff729848640 1 -- 172.21.15.62:0/2361923237 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff71c00a4d0 con 0x7ff72400f400 2024-09-10T05:36:32.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.631+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93966314471664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb9610 con 0x7ff72400f400 2024-09-10T05:36:32.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.631+0000 7ff72b5419c0 20 add_watcher() i=0 2024-09-10T05:36:32.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.631+0000 7ff72b5419c0 20 add_watcher() i=1 2024-09-10T05:36:32.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.631+0000 7ff72b5419c0 20 add_watcher() i=2 2024-09-10T05:36:32.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.631+0000 7ff72b5419c0 20 add_watcher() i=3 2024-09-10T05:36:32.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.631+0000 7ff72b5419c0 20 add_watcher() i=4 2024-09-10T05:36:32.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.631+0000 7ff72b5419c0 20 add_watcher() i=5 2024-09-10T05:36:32.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.631+0000 7ff728846640 1 -- 172.21.15.62:0/2361923237 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93966314460016] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7200a8070 con 0x55763ccacb80 2024-09-10T05:36:32.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.631+0000 7ff72b5419c0 20 add_watcher() i=6 2024-09-10T05:36:32.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.631+0000 7ff729848640 1 -- 172.21.15.62:0/2361923237 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93966314471664] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff71c00a4d0 con 0x7ff72400f400 2024-09-10T05:36:32.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.631+0000 7ff72b5419c0 20 add_watcher() i=7 2024-09-10T05:36:32.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.631+0000 7ff72b5419c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:32.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.631+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb9610 con 0x55763cca4f10 2024-09-10T05:36:32.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.631+0000 7ff729848640 1 -- 172.21.15.62:0/2361923237 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff71c00a4d0 con 0x55763cca4f10 2024-09-10T05:36:32.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.631+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93966314475872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb9580 con 0x55763cca4f10 2024-09-10T05:36:32.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.631+0000 7ff729848640 1 -- 172.21.15.62:0/2361923237 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93966314475872] v30'74 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff71c00a4d0 con 0x55763cca4f10 2024-09-10T05:36:32.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.631+0000 7ff5df7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:32.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.631+0000 7ff72b5419c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:32.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.631+0000 7ff72b5419c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:32.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.631+0000 7ff72b5419c0 5 note: GC not initialized 2024-09-10T05:36:32.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.631+0000 7ff5de7e4640 20 reqs_thread_entry: start 2024-09-10T05:36:32.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.631+0000 7ff72b5419c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:32.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.635+0000 7ff72b5419c0 20 Filter name: none 2024-09-10T05:36:32.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.635+0000 7ff54ffff640 20 reqs_thread_entry: start 2024-09-10T05:36:32.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.635+0000 7ff72b5419c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T05:36:32.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.635+0000 7ff72b5419c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.635+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55763ccdf860 con 0x55763cca4f10 2024-09-10T05:36:32.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.635+0000 7ff729848640 1 -- 172.21.15.62:0/2361923237 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7ff71c00a4d0 con 0x55763cca4f10 2024-09-10T05:36:32.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.635+0000 7ff72b5419c0 20 rados_obj.operate() r=0 bl.length=502 2024-09-10T05:36:32.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.635+0000 7ff72b5419c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T05:36:32.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.635+0000 7ff72b5419c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:36:32.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.635+0000 7ff72b5419c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:36:32.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.635+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55763cce5d90 con 0x55763cca4f10 2024-09-10T05:36:32.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.635+0000 7ff729848640 1 -- 172.21.15.62:0/2361923237 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v30'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7ff71c00a4d0 con 0x55763cca4f10 2024-09-10T05:36:32.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.635+0000 7ff72b5419c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:36:32.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.635+0000 7ff72b5419c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:36:32.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.635+0000 7ff72b5419c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T05:36:32.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.635+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93966314657920 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55763cce1520 con 0x55763cca93a0 2024-09-10T05:36:32.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.635+0000 7ff729047640 1 -- 172.21.15.62:0/2361923237 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== watch-notify(notify (1) cookie 93966314468272 notify 128849018885 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55763cc877a0 con 0x55763cca93a0 2024-09-10T05:36:32.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.635+0000 7ff60cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018885 cookie 93966314468272 notifier 4353 bl.length()=567 2024-09-10T05:36:32.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.635+0000 7ff60cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:36:32.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.635+0000 7ff60cff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:36:32.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.635+0000 7ff60cff9640 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7ff5ec003eb0 con 0x55763cca93a0 2024-09-10T05:36:32.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.635+0000 7ff729047640 1 -- 172.21.15.62:0/2361923237 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(64 notify.4 [notify cookie 93966314657920 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff72402e070 con 0x55763cca93a0 2024-09-10T05:36:32.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.635+0000 7ff729047640 1 -- 172.21.15.62:0/2361923237 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff72402e070 con 0x55763cca93a0 2024-09-10T05:36:32.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.639+0000 7ff729047640 1 -- 172.21.15.62:0/2361923237 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== watch-notify(notify_complete (2) cookie 93966314657920 notify 128849018885 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7ff724090040 con 0x55763cca93a0 2024-09-10T05:36:32.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.639+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:66 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55763cce5880 con 0x55763ccacb80 2024-09-10T05:36:32.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.639+0000 7ff728846640 1 -- 172.21.15.62:0/2361923237 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(66 p5YnriCv1nAtykxBrupQ [delete] v30'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7ff7200a8070 con 0x55763ccacb80 2024-09-10T05:36:32.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.639+0000 7ff72b5419c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-10T05:36:32.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.639+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 93966314657920 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55763cce1070 con 0x55763cca93a0 2024-09-10T05:36:32.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.639+0000 7ff729047640 1 -- 172.21.15.62:0/2361923237 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== watch-notify(notify (1) cookie 93966314455632 notify 128849018886 ret 0) ==== 212+0+0 (crc 0 0 0) 0x7ff724090040 con 0x55763cca93a0 2024-09-10T05:36:32.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.639+0000 7ff5fffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018886 cookie 93966314455632 notifier 4353 bl.length()=170 2024-09-10T05:36:32.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.639+0000 7ff5fffff640 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7ff55c0032d0 con 0x55763cca93a0 2024-09-10T05:36:32.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.639+0000 7ff729047640 1 -- 172.21.15.62:0/2361923237 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(67 notify.2 [notify cookie 93966314657920 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff72402e070 con 0x55763cca93a0 2024-09-10T05:36:32.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.639+0000 7ff729047640 1 -- 172.21.15.62:0/2361923237 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff72402e070 con 0x55763cca93a0 2024-09-10T05:36:32.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.639+0000 7ff729047640 1 -- 172.21.15.62:0/2361923237 <== osd.0 v2:172.21.15.2:6800/945139080 25 ==== watch-notify(notify_complete (2) cookie 93966314657920 notify 128849018886 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55763cc86f40 con 0x55763cca93a0 2024-09-10T05:36:32.646 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T05:36:30.893777Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:36:30.893760Z","tags":[],"group_ids":[]} 2024-09-10T05:36:32.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.643+0000 7ff5df7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:32.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.643+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93966314475872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55763ccdd5f0 con 0x55763cca4f10 2024-09-10T05:36:32.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.643+0000 7ff729848640 1 -- 172.21.15.62:0/2361923237 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 93966314475872] v30'75 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff71c00a4d0 con 0x55763cca4f10 2024-09-10T05:36:32.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.643+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93966314451776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55763ccdd5f0 con 0x55763cca93a0 2024-09-10T05:36:32.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.647+0000 7ff729047640 1 -- 172.21.15.62:0/2361923237 <== osd.0 v2:172.21.15.2:6800/945139080 26 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 93966314451776] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff72402e070 con 0x55763cca93a0 2024-09-10T05:36:32.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.647+0000 7ff72b5419c0 20 remove_watcher() i=0 2024-09-10T05:36:32.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.647+0000 7ff72b5419c0 2 removed watcher, disabling cache 2024-09-10T05:36:32.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.647+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93966314458960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb3340 con 0x55763cca4f10 2024-09-10T05:36:32.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.647+0000 7ff729848640 1 -- 172.21.15.62:0/2361923237 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 93966314458960] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff71c00a4d0 con 0x55763cca4f10 2024-09-10T05:36:32.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.647+0000 7ff72b5419c0 20 remove_watcher() i=1 2024-09-10T05:36:32.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.647+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93966314455632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55763ccdd5f0 con 0x55763cca93a0 2024-09-10T05:36:32.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.647+0000 7ff729047640 1 -- 172.21.15.62:0/2361923237 <== osd.0 v2:172.21.15.2:6800/945139080 27 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 93966314455632] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff72402e070 con 0x55763cca93a0 2024-09-10T05:36:32.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.647+0000 7ff72b5419c0 20 remove_watcher() i=2 2024-09-10T05:36:32.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.647+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93966314464720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb4f50 con 0x7ff72400f400 2024-09-10T05:36:32.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.651+0000 7ff729848640 1 -- 172.21.15.62:0/2361923237 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 93966314464720] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff71c00a4d0 con 0x7ff72400f400 2024-09-10T05:36:32.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.651+0000 7ff72b5419c0 20 remove_watcher() i=3 2024-09-10T05:36:32.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.651+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93966314468272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb3340 con 0x55763cca93a0 2024-09-10T05:36:32.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.651+0000 7ff729047640 1 -- 172.21.15.62:0/2361923237 <== osd.0 v2:172.21.15.2:6800/945139080 28 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 93966314468272] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff72402e070 con 0x55763cca93a0 2024-09-10T05:36:32.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.651+0000 7ff72b5419c0 20 remove_watcher() i=4 2024-09-10T05:36:32.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.651+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93966314470608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb4250 con 0x55763ccacb80 2024-09-10T05:36:32.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.651+0000 7ff728846640 1 -- 172.21.15.62:0/2361923237 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 93966314470608] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7200a8070 con 0x55763ccacb80 2024-09-10T05:36:32.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.651+0000 7ff72b5419c0 20 remove_watcher() i=5 2024-09-10T05:36:32.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.651+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93966314460016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55763ccdd5f0 con 0x55763ccacb80 2024-09-10T05:36:32.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.655+0000 7ff728846640 1 -- 172.21.15.62:0/2361923237 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 93966314460016] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7200a8070 con 0x55763ccacb80 2024-09-10T05:36:32.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.655+0000 7ff72b5419c0 20 remove_watcher() i=6 2024-09-10T05:36:32.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.655+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93966314471664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55763ccb73b0 con 0x7ff72400f400 2024-09-10T05:36:32.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.655+0000 7ff729848640 1 -- 172.21.15.62:0/2361923237 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 93966314471664] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff71c00a4d0 con 0x7ff72400f400 2024-09-10T05:36:32.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.655+0000 7ff72b5419c0 20 remove_watcher() i=7 2024-09-10T05:36:32.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.655+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55763cca93a0 msgr2=0x55763ccab790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.655+0000 7ff72b5419c0 1 --2- 172.21.15.62:0/2361923237 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55763cca93a0 0x55763ccab790 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.655+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55763cca4f10 msgr2=0x55763cca73a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.655+0000 7ff72b5419c0 1 --2- 172.21.15.62:0/2361923237 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55763cca4f10 0x55763cca73a0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.655+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7ff72400f400 msgr2=0x7ff72405dac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.655+0000 7ff72b5419c0 1 --2- 172.21.15.62:0/2361923237 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7ff72400f400 0x7ff72405dac0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.655+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55763ccacb80 msgr2=0x55763ccaef90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.655+0000 7ff72b5419c0 1 --2- 172.21.15.62:0/2361923237 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55763ccacb80 0x55763ccaef90 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.655+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff5f4039a70 msgr2=0x7ff5f403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.655+0000 7ff72b5419c0 1 --2- 172.21.15.62:0/2361923237 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff5f4039a70 0x7ff5f403bf30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff7200199c0 tx=0x7ff7200a8000 comp rx=0 tx=0).stop 2024-09-10T05:36:32.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.655+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55763cc93c70 msgr2=0x55763cc9a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.655+0000 7ff729848640 1 -- 172.21.15.62:0/2361923237 reap_dead start 2024-09-10T05:36:32.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.655+0000 7ff72b5419c0 1 --2- 172.21.15.62:0/2361923237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55763cc93c70 0x55763cc9a020 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff724050a10 tx=0x7ff724009f90 comp rx=0 tx=0).stop 2024-09-10T05:36:32.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.655+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 shutdown_connections 2024-09-10T05:36:32.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.655+0000 7ff72b5419c0 1 --2- 172.21.15.62:0/2361923237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55763cc93c70 0x55763cc9a020 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.655+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 >> 172.21.15.62:0/2361923237 conn(0x55763cc8f090 msgr2=0x55763cc8d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:32.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.655+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 shutdown_connections 2024-09-10T05:36:32.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.655+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2361923237 wait complete. 2024-09-10T05:36:32.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.655+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2601683386 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff600039ac0 msgr2=0x7ff60003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.655+0000 7ff72b5419c0 1 --2- 172.21.15.62:0/2601683386 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff600039ac0 0x7ff60003bf80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff720018f40 tx=0x7ff720005a10 comp rx=0 tx=0).stop 2024-09-10T05:36:32.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.655+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2601683386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55763cc864e0 msgr2=0x55763cc86900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.655+0000 7ff72b5419c0 1 --2- 172.21.15.62:0/2601683386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55763cc864e0 0x55763cc86900 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff72400e560 tx=0x7ff72401b3d0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.655+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2601683386 shutdown_connections 2024-09-10T05:36:32.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.655+0000 7ff72b5419c0 1 --2- 172.21.15.62:0/2601683386 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff600039ac0 0x7ff60003bf80 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.655+0000 7ff72b5419c0 1 --2- 172.21.15.62:0/2601683386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55763cc864e0 0x55763cc86900 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.655+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2601683386 >> 172.21.15.62:0/2601683386 conn(0x55763cc7be90 msgr2=0x55763cc7c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:32.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.655+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2601683386 shutdown_connections 2024-09-10T05:36:32.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.655+0000 7ff72b5419c0 1 -- 172.21.15.62:0/2601683386 wait complete. 2024-09-10T05:36:32.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.655+0000 7ff72b5419c0 1 -- 172.21.15.62:0/246289723 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55763cc70a20 msgr2=0x55763cc72ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.655+0000 7ff72b5419c0 1 --2- 172.21.15.62:0/246289723 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55763cc70a20 0x55763cc72ee0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.655+0000 7ff72b5419c0 1 -- 172.21.15.62:0/246289723 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55763cc6d5f0 msgr2=0x55763cc6f9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.655+0000 7ff72b5419c0 1 --2- 172.21.15.62:0/246289723 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55763cc6d5f0 0x55763cc6f9e0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.655+0000 7ff72b5419c0 1 -- 172.21.15.62:0/246289723 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55763cc75410 msgr2=0x55763cc77800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.655+0000 7ff72b5419c0 1 --2- 172.21.15.62:0/246289723 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55763cc75410 0x55763cc77800 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.655+0000 7ff72b5419c0 1 -- 172.21.15.62:0/246289723 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff610039a70 msgr2=0x7ff61003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.655+0000 7ff72b5419c0 1 --2- 172.21.15.62:0/246289723 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff610039a70 0x7ff61003bf30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff7200ae000 tx=0x7ff7200a6000 comp rx=0 tx=0).stop 2024-09-10T05:36:32.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.655+0000 7ff72b5419c0 1 -- 172.21.15.62:0/246289723 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55763cb796f0 msgr2=0x55763cc68530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.655+0000 7ff72b5419c0 1 --2- 172.21.15.62:0/246289723 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55763cb796f0 0x55763cc68530 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff724000f70 tx=0x7ff724000ee0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.655+0000 7ff729848640 1 -- 172.21.15.62:0/246289723 reap_dead start 2024-09-10T05:36:32.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.655+0000 7ff72b5419c0 1 -- 172.21.15.62:0/246289723 shutdown_connections 2024-09-10T05:36:32.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.655+0000 7ff72b5419c0 1 -- 172.21.15.62:0/246289723 >> 172.21.15.62:0/246289723 conn(0x55763cae4b00 msgr2=0x55763cc61e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:32.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.655+0000 7ff72b5419c0 1 -- 172.21.15.62:0/246289723 shutdown_connections 2024-09-10T05:36:32.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.655+0000 7ff72b5419c0 1 -- 172.21.15.62:0/246289723 wait complete. 2024-09-10T05:36:32.670 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T05:36:30.893777Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:36:30.893760Z', 'tags': [], 'group_ids': []} 2024-09-10T05:36:32.670 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-10T05:36:32.670 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-10T05:36:32.670 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2024-09-10T05:36:32.750 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:32.751 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:32.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.747+0000 7f388499a9c0 1 Processor -- start 2024-09-10T05:36:32.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.747+0000 7f388499a9c0 1 -- start start 2024-09-10T05:36:32.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.747+0000 7f388499a9c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55e42d371fa0 0x55e42d372380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.747+0000 7f388499a9c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e42d2269c0 con 0x55e42d375130 2024-09-10T05:36:32.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.747+0000 7f388499a9c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x55e42d2766d0 con 0x55e42d371fa0 2024-09-10T05:36:32.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.747+0000 7f38824a0640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55e42d371fa0 0x55e42d372380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.751+0000 7f38824a0640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55e42d371fa0 0x55e42d372380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51748/0 (socket says 172.21.15.62:51748) 2024-09-10T05:36:32.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.751+0000 7f38824a0640 1 -- 172.21.15.62:0/2928193226 learned_addr learned my addr 172.21.15.62:0/2928193226 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:32.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.751+0000 7f3881c9f640 1 --1- 172.21.15.62:0/2928193226 >> v1:172.21.15.2:6789/0 conn(0x55e42d375130 0x55e42d377520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:38578/0 (socket says 172.21.15.62:38578) 2024-09-10T05:36:32.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.751+0000 7f38824a0640 1 -- 172.21.15.62:0/2928193226 >> v1:172.21.15.2:6789/0 conn(0x55e42d375130 legacy=0x55e42d377520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.751+0000 7f38824a0640 1 -- 172.21.15.62:0/2928193226 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e42d21aca0 con 0x55e42d371fa0 2024-09-10T05:36:32.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.755+0000 7f38824a0640 1 --2- 172.21.15.62:0/2928193226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e42d371fa0 0x55e42d372380 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f387c00a5c0 tx=0x7f387c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf5e31d124bbbe9c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.755+0000 7f388149e640 1 -- 172.21.15.62:0/2928193226 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f387c0a6070 con 0x55e42d371fa0 2024-09-10T05:36:32.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.755+0000 7f388149e640 1 -- 172.21.15.62:0/2928193226 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f387c0af070 con 0x55e42d371fa0 2024-09-10T05:36:32.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.755+0000 7f388149e640 1 -- 172.21.15.62:0/2928193226 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f387c0aa5c0 con 0x55e42d371fa0 2024-09-10T05:36:32.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.755+0000 7f388499a9c0 1 -- 172.21.15.62:0/2928193226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e42d371fa0 msgr2=0x55e42d372380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.755+0000 7f388499a9c0 1 --2- 172.21.15.62:0/2928193226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e42d371fa0 0x55e42d372380 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f387c00a5c0 tx=0x7f387c01b340 comp rx=0 tx=0).stop 2024-09-10T05:36:32.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.755+0000 7f388499a9c0 1 -- 172.21.15.62:0/2928193226 shutdown_connections 2024-09-10T05:36:32.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.755+0000 7f388499a9c0 1 --2- 172.21.15.62:0/2928193226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e42d371fa0 0x55e42d372380 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.755+0000 7f388499a9c0 1 -- 172.21.15.62:0/2928193226 >> 172.21.15.62:0/2928193226 conn(0x55e42d36dac0 msgr2=0x55e42d36fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:32.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.755+0000 7f388499a9c0 1 -- 172.21.15.62:0/2928193226 shutdown_connections 2024-09-10T05:36:32.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.755+0000 7f388499a9c0 1 -- 172.21.15.62:0/2928193226 wait complete. 2024-09-10T05:36:32.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.767+0000 7f388499a9c0 1 Processor -- start 2024-09-10T05:36:32.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.771+0000 7f388499a9c0 1 -- start start 2024-09-10T05:36:32.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.771+0000 7f388499a9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e42d371fa0 0x55e42d45d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.771+0000 7f388499a9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e42d27a680 con 0x55e42d371fa0 2024-09-10T05:36:32.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.771+0000 7f38824a0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e42d371fa0 0x55e42d45d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.771+0000 7f38824a0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e42d371fa0 0x55e42d45d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51752/0 (socket says 172.21.15.62:51752) 2024-09-10T05:36:32.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.771+0000 7f38824a0640 1 -- 172.21.15.62:0/3156442566 learned_addr learned my addr 172.21.15.62:0/3156442566 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:32.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.771+0000 7f38824a0640 1 -- 172.21.15.62:0/3156442566 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e42d1f5da0 con 0x55e42d371fa0 2024-09-10T05:36:32.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.771+0000 7f38824a0640 1 --2- 172.21.15.62:0/3156442566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e42d371fa0 0x55e42d45d680 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f387c0ac040 tx=0x7f387c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41079f59b2c025ac server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.771+0000 7f3770608640 1 -- 172.21.15.62:0/3156442566 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f387c0aa9d0 con 0x55e42d371fa0 2024-09-10T05:36:32.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.771+0000 7f3770608640 1 -- 172.21.15.62:0/3156442566 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f387c0aab70 con 0x55e42d371fa0 2024-09-10T05:36:32.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.771+0000 7f3770608640 1 -- 172.21.15.62:0/3156442566 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f387c0bd3f0 con 0x55e42d371fa0 2024-09-10T05:36:32.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.771+0000 7f388499a9c0 1 -- 172.21.15.62:0/3156442566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e42d371fa0 msgr2=0x55e42d45d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.771+0000 7f388499a9c0 1 --2- 172.21.15.62:0/3156442566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e42d371fa0 0x55e42d45d680 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f387c0ac040 tx=0x7f387c003030 comp rx=0 tx=0).stop 2024-09-10T05:36:32.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.771+0000 7f388499a9c0 1 -- 172.21.15.62:0/3156442566 shutdown_connections 2024-09-10T05:36:32.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.771+0000 7f388499a9c0 1 --2- 172.21.15.62:0/3156442566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e42d371fa0 0x55e42d45d680 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.771+0000 7f388499a9c0 1 -- 172.21.15.62:0/3156442566 >> 172.21.15.62:0/3156442566 conn(0x55e42d36dac0 msgr2=0x55e42d459320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:32.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.771+0000 7f388499a9c0 1 -- 172.21.15.62:0/3156442566 shutdown_connections 2024-09-10T05:36:32.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.771+0000 7f388499a9c0 1 -- 172.21.15.62:0/3156442566 wait complete. 2024-09-10T05:36:32.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.771+0000 7f388499a9c0 1 Processor -- start 2024-09-10T05:36:32.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.771+0000 7f388499a9c0 1 -- start start 2024-09-10T05:36:32.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.771+0000 7f388499a9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e42d371fa0 0x55e42d464bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.771+0000 7f388499a9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e42d21ca50 con 0x55e42d371fa0 2024-09-10T05:36:32.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.771+0000 7f38824a0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e42d371fa0 0x55e42d464bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.771+0000 7f38824a0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e42d371fa0 0x55e42d464bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51760/0 (socket says 172.21.15.62:51760) 2024-09-10T05:36:32.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.771+0000 7f38824a0640 1 -- 172.21.15.62:0/3733330744 learned_addr learned my addr 172.21.15.62:0/3733330744 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:32.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.775+0000 7f38824a0640 1 -- 172.21.15.62:0/3733330744 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e42d465120 con 0x55e42d371fa0 2024-09-10T05:36:32.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.775+0000 7f38824a0640 1 --2- 172.21.15.62:0/3733330744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e42d371fa0 0x55e42d464bc0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f387c01bbe0 tx=0x7f387c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.775+0000 7f376ee05640 1 -- 172.21.15.62:0/3733330744 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f387c0cb020 con 0x55e42d371fa0 2024-09-10T05:36:32.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.775+0000 7f388499a9c0 1 -- 172.21.15.62:0/3733330744 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e42d4653b0 con 0x55e42d371fa0 2024-09-10T05:36:32.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.775+0000 7f376ee05640 1 -- 172.21.15.62:0/3733330744 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f387c0c6650 con 0x55e42d371fa0 2024-09-10T05:36:32.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.775+0000 7f376ee05640 1 -- 172.21.15.62:0/3733330744 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f387c0c6970 con 0x55e42d371fa0 2024-09-10T05:36:32.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.775+0000 7f388499a9c0 1 -- 172.21.15.62:0/3733330744 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e42d465d60 con 0x55e42d371fa0 2024-09-10T05:36:32.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.775+0000 7f376ee05640 1 -- 172.21.15.62:0/3733330744 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f387c0ce020 con 0x55e42d371fa0 2024-09-10T05:36:32.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.775+0000 7f376ee05640 1 --2- 172.21.15.62:0/3733330744 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3768039a70 0x7f376803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.775+0000 7f376ee05640 1 -- 172.21.15.62:0/3733330744 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f387c0eb9d0 con 0x55e42d371fa0 2024-09-10T05:36:32.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.775+0000 7f3881c9f640 1 --2- 172.21.15.62:0/3733330744 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3768039a70 0x7f376803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.775+0000 7f388499a9c0 1 --2- 172.21.15.62:0/3733330744 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55e42d375130 0x55e42d46bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.775+0000 7f388499a9c0 1 -- 172.21.15.62:0/3733330744 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e42d46c270 con 0x55e42d375130 2024-09-10T05:36:32.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.775+0000 7f3882ca1640 1 --2- 172.21.15.62:0/3733330744 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55e42d375130 0x55e42d46bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.775+0000 7f3881c9f640 1 --2- 172.21.15.62:0/3733330744 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3768039a70 0x7f376803bf30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3878001e90 tx=0x7f38780013f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.775+0000 7f3882ca1640 1 --2- 172.21.15.62:0/3733330744 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55e42d375130 0x55e42d46bd30 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.775+0000 7f3882ca1640 1 -- 172.21.15.62:0/3733330744 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f387400a4d0 con 0x55e42d375130 2024-09-10T05:36:32.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.775+0000 7f388499a9c0 1 --2- 172.21.15.62:0/3733330744 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e42d46cd60 0x55e42d46f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.775+0000 7f388499a9c0 1 -- 172.21.15.62:0/3733330744 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e42d46f990 con 0x55e42d46cd60 2024-09-10T05:36:32.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.775+0000 7f38824a0640 1 --2- 172.21.15.62:0/3733330744 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e42d46cd60 0x55e42d46f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.779+0000 7f38824a0640 1 --2- 172.21.15.62:0/3733330744 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e42d46cd60 0x55e42d46f220 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.779+0000 7f38824a0640 1 -- 172.21.15.62:0/3733330744 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f387c0bd910 con 0x55e42d46cd60 2024-09-10T05:36:32.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.779+0000 7f388499a9c0 1 --2- 172.21.15.62:0/3733330744 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55e42d471750 0x55e42d473b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.779+0000 7f388499a9c0 1 -- 172.21.15.62:0/3733330744 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e42d474210 con 0x55e42d471750 2024-09-10T05:36:32.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.779+0000 7f3881c9f640 1 --2- 172.21.15.62:0/3733330744 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55e42d471750 0x55e42d473b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.779+0000 7f3881c9f640 1 --2- 172.21.15.62:0/3733330744 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55e42d471750 0x55e42d473b40 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.779+0000 7f3881c9f640 1 -- 172.21.15.62:0/3733330744 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f387800f6e0 con 0x55e42d471750 2024-09-10T05:36:32.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.779+0000 7f388499a9c0 1 -- 172.21.15.62:0/3733330744 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4705f0 con 0x55e42d46cd60 2024-09-10T05:36:32.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.779+0000 7f38824a0640 1 -- 172.21.15.62:0/3733330744 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f387c0bd910 con 0x55e42d46cd60 2024-09-10T05:36:32.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.779+0000 7f388499a9c0 1 -- 172.21.15.62:0/3733330744 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e42d470a50 con 0x55e42d471750 2024-09-10T05:36:32.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.779+0000 7f3881c9f640 1 -- 172.21.15.62:0/3733330744 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f387800f6e0 con 0x55e42d471750 2024-09-10T05:36:32.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.779+0000 7f388499a9c0 1 Processor -- start 2024-09-10T05:36:32.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.779+0000 7f388499a9c0 1 -- start start 2024-09-10T05:36:32.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.779+0000 7f388499a9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e42d4828a0 0x55e42d482cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.779+0000 7f388499a9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e42d287450 con 0x55e42d4828a0 2024-09-10T05:36:32.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.779+0000 7f38824a0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e42d4828a0 0x55e42d482cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.779+0000 7f38824a0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e42d4828a0 0x55e42d482cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51770/0 (socket says 172.21.15.62:51770) 2024-09-10T05:36:32.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.779+0000 7f38824a0640 1 -- 172.21.15.62:0/3561218997 learned_addr learned my addr 172.21.15.62:0/3561218997 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:32.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.783+0000 7f38824a0640 1 -- 172.21.15.62:0/3561218997 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e42d483300 con 0x55e42d4828a0 2024-09-10T05:36:32.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.783+0000 7f38824a0640 1 --2- 172.21.15.62:0/3561218997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e42d4828a0 0x55e42d482cc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f387c0e9fe0 tx=0x7f387c0cfa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.783+0000 7f3767fff640 1 -- 172.21.15.62:0/3561218997 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f387c0eb560 con 0x55e42d4828a0 2024-09-10T05:36:32.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.783+0000 7f3767fff640 1 -- 172.21.15.62:0/3561218997 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f387c0eb700 con 0x55e42d4828a0 2024-09-10T05:36:32.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.783+0000 7f388499a9c0 1 -- 172.21.15.62:0/3561218997 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e42d483b60 con 0x55e42d4828a0 2024-09-10T05:36:32.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.783+0000 7f3767fff640 1 -- 172.21.15.62:0/3561218997 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f387c0bc900 con 0x55e42d4828a0 2024-09-10T05:36:32.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.783+0000 7f388499a9c0 1 -- 172.21.15.62:0/3561218997 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e42d4840d0 con 0x55e42d4828a0 2024-09-10T05:36:32.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.783+0000 7f3767fff640 1 -- 172.21.15.62:0/3561218997 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f387c0bcaa0 con 0x55e42d4828a0 2024-09-10T05:36:32.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.783+0000 7f3767fff640 1 --2- 172.21.15.62:0/3561218997 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f375c039a70 0x7f375c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.783+0000 7f3767fff640 1 -- 172.21.15.62:0/3561218997 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f387c0b50b0 con 0x55e42d4828a0 2024-09-10T05:36:32.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.783+0000 7f3881c9f640 1 --2- 172.21.15.62:0/3561218997 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f375c039a70 0x7f375c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.783+0000 7f388499a9c0 1 Processor -- start 2024-09-10T05:36:32.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.783+0000 7f388499a9c0 1 -- start start 2024-09-10T05:36:32.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.783+0000 7f3881c9f640 1 --2- 172.21.15.62:0/3561218997 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f375c039a70 0x7f375c03bf30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x55e42d466d00 tx=0x7f387800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.783+0000 7f388499a9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e42d4900f0 0x55e42d4904f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.783+0000 7f388499a9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e42d45ddf0 con 0x55e42d4900f0 2024-09-10T05:36:32.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.783+0000 7f38824a0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e42d4900f0 0x55e42d4904f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.783+0000 7f38824a0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e42d4900f0 0x55e42d4904f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51774/0 (socket says 172.21.15.62:51774) 2024-09-10T05:36:32.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.783+0000 7f38824a0640 1 -- 172.21.15.62:0/266389815 learned_addr learned my addr 172.21.15.62:0/266389815 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:32.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.787+0000 7f38824a0640 1 -- 172.21.15.62:0/266389815 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e42d490ae0 con 0x55e42d4900f0 2024-09-10T05:36:32.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.787+0000 7f38824a0640 1 --2- 172.21.15.62:0/266389815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e42d4900f0 0x55e42d4904f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f387c0c6b70 tx=0x7f387c0b3810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9fa678f8563bda6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.787+0000 7f3765ffb640 1 -- 172.21.15.62:0/266389815 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f387c0b35b0 con 0x55e42d4900f0 2024-09-10T05:36:32.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.787+0000 7f3765ffb640 1 -- 172.21.15.62:0/266389815 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f387c0f4d00 con 0x55e42d4900f0 2024-09-10T05:36:32.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.787+0000 7f3765ffb640 1 -- 172.21.15.62:0/266389815 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f387c0a93d0 con 0x55e42d4900f0 2024-09-10T05:36:32.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.787+0000 7f388499a9c0 1 -- 172.21.15.62:0/266389815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e42d4900f0 msgr2=0x55e42d4904f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.787+0000 7f388499a9c0 1 --2- 172.21.15.62:0/266389815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e42d4900f0 0x55e42d4904f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f387c0c6b70 tx=0x7f387c0b3810 comp rx=0 tx=0).stop 2024-09-10T05:36:32.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.787+0000 7f388499a9c0 1 -- 172.21.15.62:0/266389815 shutdown_connections 2024-09-10T05:36:32.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.787+0000 7f388499a9c0 1 --2- 172.21.15.62:0/266389815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e42d4900f0 0x55e42d4904f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.787+0000 7f388499a9c0 1 -- 172.21.15.62:0/266389815 >> 172.21.15.62:0/266389815 conn(0x55e42d48b4b0 msgr2=0x55e42d4896f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:32.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.787+0000 7f388499a9c0 1 -- 172.21.15.62:0/266389815 shutdown_connections 2024-09-10T05:36:32.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.787+0000 7f388499a9c0 1 -- 172.21.15.62:0/266389815 wait complete. 2024-09-10T05:36:32.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.787+0000 7f388499a9c0 1 Processor -- start 2024-09-10T05:36:32.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.787+0000 7f388499a9c0 1 -- start start 2024-09-10T05:36:32.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.787+0000 7f388499a9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e42d4900f0 0x55e42d496400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.787+0000 7f388499a9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e42d48ee60 con 0x55e42d4900f0 2024-09-10T05:36:32.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.787+0000 7f38824a0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e42d4900f0 0x55e42d496400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.787+0000 7f38824a0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e42d4900f0 0x55e42d496400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51786/0 (socket says 172.21.15.62:51786) 2024-09-10T05:36:32.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.787+0000 7f38824a0640 1 -- 172.21.15.62:0/1033669032 learned_addr learned my addr 172.21.15.62:0/1033669032 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:32.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.787+0000 7f38824a0640 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e42d496960 con 0x55e42d4900f0 2024-09-10T05:36:32.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.787+0000 7f38824a0640 1 --2- 172.21.15.62:0/1033669032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e42d4900f0 0x55e42d496400 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f387c0c6b70 tx=0x7f387c102040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.787+0000 7f3753fff640 1 -- 172.21.15.62:0/1033669032 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f387c0b35b0 con 0x55e42d4900f0 2024-09-10T05:36:32.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.787+0000 7f3753fff640 1 -- 172.21.15.62:0/1033669032 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f387c0ee120 con 0x55e42d4900f0 2024-09-10T05:36:32.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.787+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e42d496960 con 0x55e42d4900f0 2024-09-10T05:36:32.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.787+0000 7f3753fff640 1 -- 172.21.15.62:0/1033669032 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f387c0ee2d0 con 0x55e42d4900f0 2024-09-10T05:36:32.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.787+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e42d496960 con 0x55e42d4900f0 2024-09-10T05:36:32.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.791+0000 7f3753fff640 1 -- 172.21.15.62:0/1033669032 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f387c0b3a40 con 0x55e42d4900f0 2024-09-10T05:36:32.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.791+0000 7f388499a9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.791+0000 7f3753fff640 1 --2- 172.21.15.62:0/1033669032 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f374c039ac0 0x7f374c03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.791+0000 7f3753fff640 1 -- 172.21.15.62:0/1033669032 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f387c119aa0 con 0x55e42d4900f0 2024-09-10T05:36:32.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.791+0000 7f3881c9f640 1 --2- 172.21.15.62:0/1033669032 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f374c039ac0 0x7f374c03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.791+0000 7f388499a9c0 1 --2- 172.21.15.62:0/1033669032 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55e42d4a1200 0x55e42d4a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.791+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4a3de0 con 0x55e42d4a1200 2024-09-10T05:36:32.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.791+0000 7f3882ca1640 1 --2- 172.21.15.62:0/1033669032 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55e42d4a1200 0x55e42d4a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.791+0000 7f3881c9f640 1 --2- 172.21.15.62:0/1033669032 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f374c039ac0 0x7f374c03bf80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x55e42d4705c0 tx=0x7f3878010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.791+0000 7f3882ca1640 1 --2- 172.21.15.62:0/1033669032 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55e42d4a1200 0x55e42d4a3690 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.791+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f387400a4d0 con 0x55e42d4a1200 2024-09-10T05:36:32.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.791+0000 7f388499a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:32.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.791+0000 7f388499a9c0 20 realm 2024-09-10T05:36:32.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.791+0000 7f388499a9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.791+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4a0590 con 0x55e42d4a1200 2024-09-10T05:36:32.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.791+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f387400a4d0 con 0x55e42d4a1200 2024-09-10T05:36:32.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.791+0000 7f388499a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:32.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.791+0000 7f388499a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:32.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.791+0000 7f388499a9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.791+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4a48a0 con 0x55e42d4a1200 2024-09-10T05:36:32.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.791+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f387400a4d0 con 0x55e42d4a1200 2024-09-10T05:36:32.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.791+0000 7f388499a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:32.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.791+0000 7f388499a9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.791+0000 7f388499a9c0 1 --2- 172.21.15.62:0/1033669032 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e42d4a5680 0x55e42d4a7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.791+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4a8140 con 0x55e42d4a5680 2024-09-10T05:36:32.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.791+0000 7f38824a0640 1 --2- 172.21.15.62:0/1033669032 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e42d4a5680 0x55e42d4a7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.791+0000 7f38824a0640 1 --2- 172.21.15.62:0/1033669032 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e42d4a5680 0x55e42d4a7a70 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.791+0000 7f38824a0640 1 -- 172.21.15.62:0/1033669032 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f387c0bd910 con 0x55e42d4a5680 2024-09-10T05:36:32.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.791+0000 7f388499a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:32.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.791+0000 7f388499a9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.791+0000 7f388499a9c0 1 --2- 172.21.15.62:0/1033669032 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55e42d4a8ea0 0x55e42d4ab290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.791+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4aba20 con 0x55e42d4a8ea0 2024-09-10T05:36:32.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.791+0000 7f3881c9f640 1 --2- 172.21.15.62:0/1033669032 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55e42d4a8ea0 0x55e42d4ab290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.795+0000 7f3881c9f640 1 --2- 172.21.15.62:0/1033669032 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55e42d4a8ea0 0x55e42d4ab290 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.795+0000 7f3881c9f640 1 -- 172.21.15.62:0/1033669032 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f387800f6e0 con 0x55e42d4a8ea0 2024-09-10T05:36:32.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.795+0000 7f388499a9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:32.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.795+0000 7f388499a9c0 20 searching for the correct realm 2024-09-10T05:36:32.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.795+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4ad2f0 con 0x55e42d4a8ea0 2024-09-10T05:36:32.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.795+0000 7f3881c9f640 1 -- 172.21.15.62:0/1033669032 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f387800f6e0 con 0x55e42d4a8ea0 2024-09-10T05:36:32.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.795+0000 7f3881c9f640 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4ad2f0 con 0x55e42d4a5680 2024-09-10T05:36:32.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.795+0000 7f38824a0640 1 -- 172.21.15.62:0/1033669032 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f387c0bd910 con 0x55e42d4a5680 2024-09-10T05:36:32.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.795+0000 7f38824a0640 1 --2- 172.21.15.62:0/1033669032 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f387c123040 0x7f387c0db5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.795+0000 7f38824a0640 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4ad2f0 con 0x7f387c123040 2024-09-10T05:36:32.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.795+0000 7f3882ca1640 1 --2- 172.21.15.62:0/1033669032 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f387c123040 0x7f387c0db5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.795+0000 7f3882ca1640 1 --2- 172.21.15.62:0/1033669032 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f387c123040 0x7f387c0db5f0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.795+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f387400a4d0 con 0x7f387c123040 2024-09-10T05:36:32.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.795+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4ad2f0 con 0x55e42d4a1200 2024-09-10T05:36:32.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.795+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f387400a4d0 con 0x55e42d4a1200 2024-09-10T05:36:32.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.795+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4ad2f0 con 0x55e42d4a1200 2024-09-10T05:36:32.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.795+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f387400a4d0 con 0x55e42d4a1200 2024-09-10T05:36:32.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.795+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4ad2f0 con 0x55e42d4a8ea0 2024-09-10T05:36:32.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.795+0000 7f3881c9f640 1 -- 172.21.15.62:0/1033669032 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f387800f6e0 con 0x55e42d4a8ea0 2024-09-10T05:36:32.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.795+0000 7f3881c9f640 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4ad2f0 con 0x55e42d4a1200 2024-09-10T05:36:32.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.795+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f387400a4d0 con 0x55e42d4a1200 2024-09-10T05:36:32.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.795+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4ad2f0 con 0x55e42d4a5680 2024-09-10T05:36:32.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.799+0000 7f38824a0640 1 -- 172.21.15.62:0/1033669032 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f387c0bd910 con 0x55e42d4a5680 2024-09-10T05:36:32.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.799+0000 7f38824a0640 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4ad2f0 con 0x55e42d4a5680 2024-09-10T05:36:32.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.799+0000 7f38824a0640 1 -- 172.21.15.62:0/1033669032 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f387c0bd910 con 0x55e42d4a5680 2024-09-10T05:36:32.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.799+0000 7f38824a0640 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4ad2f0 con 0x55e42d4a1200 2024-09-10T05:36:32.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.799+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f387400a4d0 con 0x55e42d4a1200 2024-09-10T05:36:32.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.799+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4ad2f0 con 0x7f387c123040 2024-09-10T05:36:32.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.799+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f387400a4d0 con 0x7f387c123040 2024-09-10T05:36:32.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.799+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4ad2f0 con 0x55e42d4a1200 2024-09-10T05:36:32.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.799+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f387400a4d0 con 0x55e42d4a1200 2024-09-10T05:36:32.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.799+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4ad2f0 con 0x7f387c123040 2024-09-10T05:36:32.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.799+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f387400a4d0 con 0x7f387c123040 2024-09-10T05:36:32.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.799+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4ad2f0 con 0x55e42d4a5680 2024-09-10T05:36:32.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.799+0000 7f38824a0640 1 -- 172.21.15.62:0/1033669032 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f387c0bd910 con 0x55e42d4a5680 2024-09-10T05:36:32.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.799+0000 7f38824a0640 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4ad2f0 con 0x55e42d4a8ea0 2024-09-10T05:36:32.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.799+0000 7f3881c9f640 1 -- 172.21.15.62:0/1033669032 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f387800f6e0 con 0x55e42d4a8ea0 2024-09-10T05:36:32.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.799+0000 7f3881c9f640 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4ad2f0 con 0x55e42d4a1200 2024-09-10T05:36:32.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.799+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f387400a4d0 con 0x55e42d4a1200 2024-09-10T05:36:32.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.799+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4ad2f0 con 0x55e42d4a5680 2024-09-10T05:36:32.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.799+0000 7f38824a0640 1 -- 172.21.15.62:0/1033669032 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f387c0bd910 con 0x55e42d4a5680 2024-09-10T05:36:32.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.799+0000 7f38824a0640 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4ad2f0 con 0x55e42d4a8ea0 2024-09-10T05:36:32.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.803+0000 7f3881c9f640 1 -- 172.21.15.62:0/1033669032 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 30 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f387800f6e0 con 0x55e42d4a8ea0 2024-09-10T05:36:32.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.803+0000 7f3881c9f640 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4ad2f0 con 0x55e42d4a1200 2024-09-10T05:36:32.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.803+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f387400a4d0 con 0x55e42d4a1200 2024-09-10T05:36:32.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.803+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4ad2f0 con 0x55e42d4a1200 2024-09-10T05:36:32.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.803+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f387400a4d0 con 0x55e42d4a1200 2024-09-10T05:36:32.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.803+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4ad2f0 con 0x55e42d4a1200 2024-09-10T05:36:32.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.803+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f387400a4d0 con 0x55e42d4a1200 2024-09-10T05:36:32.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.803+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4ad2f0 con 0x55e42d4a8ea0 2024-09-10T05:36:32.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.803+0000 7f3881c9f640 1 -- 172.21.15.62:0/1033669032 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f387800f6e0 con 0x55e42d4a8ea0 2024-09-10T05:36:32.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.803+0000 7f3881c9f640 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4ad2f0 con 0x7f387c123040 2024-09-10T05:36:32.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.803+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f387400a4d0 con 0x7f387c123040 2024-09-10T05:36:32.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.803+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4ad2f0 con 0x55e42d4a1200 2024-09-10T05:36:32.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.803+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f387400a4d0 con 0x55e42d4a1200 2024-09-10T05:36:32.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.803+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4ad2f0 con 0x7f387c123040 2024-09-10T05:36:32.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.803+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f387400a4d0 con 0x7f387c123040 2024-09-10T05:36:32.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.803+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4ad2f0 con 0x55e42d4a8ea0 2024-09-10T05:36:32.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.803+0000 7f3881c9f640 1 -- 172.21.15.62:0/1033669032 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f387800f6e0 con 0x55e42d4a8ea0 2024-09-10T05:36:32.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.803+0000 7f3881c9f640 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4ad2f0 con 0x7f387c123040 2024-09-10T05:36:32.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.803+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f387400a4d0 con 0x7f387c123040 2024-09-10T05:36:32.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.803+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4ad2f0 con 0x55e42d4a5680 2024-09-10T05:36:32.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.803+0000 7f38824a0640 1 -- 172.21.15.62:0/1033669032 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f387c0bd910 con 0x55e42d4a5680 2024-09-10T05:36:32.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.803+0000 7f38824a0640 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4ad2f0 con 0x55e42d4a5680 2024-09-10T05:36:32.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.803+0000 7f38824a0640 1 -- 172.21.15.62:0/1033669032 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f387c0bd910 con 0x55e42d4a5680 2024-09-10T05:36:32.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.803+0000 7f38824a0640 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4ad2f0 con 0x55e42d4a8ea0 2024-09-10T05:36:32.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.807+0000 7f3881c9f640 1 -- 172.21.15.62:0/1033669032 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f387800f6e0 con 0x55e42d4a8ea0 2024-09-10T05:36:32.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.807+0000 7f3881c9f640 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4ad2f0 con 0x55e42d4a5680 2024-09-10T05:36:32.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.807+0000 7f38824a0640 1 -- 172.21.15.62:0/1033669032 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f387c0bd910 con 0x55e42d4a5680 2024-09-10T05:36:32.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.807+0000 7f38824a0640 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4ad2f0 con 0x55e42d4a5680 2024-09-10T05:36:32.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.807+0000 7f38824a0640 1 -- 172.21.15.62:0/1033669032 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f387c0bd910 con 0x55e42d4a5680 2024-09-10T05:36:32.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.807+0000 7f388499a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:32.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.807+0000 7f388499a9c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:32.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.807+0000 7f388499a9c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:32.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.807+0000 7f388499a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:32.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.807+0000 7f388499a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:32.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.807+0000 7f388499a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:32.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.807+0000 7f388499a9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.807+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4ac410 con 0x55e42d4a1200 2024-09-10T05:36:32.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.807+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f387400a4d0 con 0x55e42d4a1200 2024-09-10T05:36:32.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.807+0000 7f388499a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:32.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.807+0000 7f388499a9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.807+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4accb0 con 0x55e42d4a5680 2024-09-10T05:36:32.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.807+0000 7f38824a0640 1 -- 172.21.15.62:0/1033669032 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f387c0bd910 con 0x55e42d4a5680 2024-09-10T05:36:32.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.807+0000 7f388499a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:32.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.807+0000 7f388499a9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.807+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4ac050 con 0x55e42d4a8ea0 2024-09-10T05:36:32.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.807+0000 7f3881c9f640 1 -- 172.21.15.62:0/1033669032 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f387800f6e0 con 0x55e42d4a8ea0 2024-09-10T05:36:32.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.807+0000 7f388499a9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:32.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.807+0000 7f388499a9c0 20 zone default found 2024-09-10T05:36:32.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.807+0000 7f388499a9c0 4 Realm: () 2024-09-10T05:36:32.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.807+0000 7f388499a9c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:32.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.807+0000 7f388499a9c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:32.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.807+0000 7f388499a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:32.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.807+0000 7f388499a9c0 20 zonegroup default 2024-09-10T05:36:32.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.807+0000 7f388499a9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.807+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4adbd0 con 0x7f387c123040 2024-09-10T05:36:32.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.807+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f387400a4d0 con 0x7f387c123040 2024-09-10T05:36:32.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.807+0000 7f388499a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:32.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.807+0000 7f388499a9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.807+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4afe10 con 0x55e42d4a8ea0 2024-09-10T05:36:32.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.807+0000 7f3881c9f640 1 -- 172.21.15.62:0/1033669032 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f387800f6e0 con 0x55e42d4a8ea0 2024-09-10T05:36:32.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.807+0000 7f388499a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:32.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.807+0000 7f388499a9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.811+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4b01b0 con 0x55e42d4a8ea0 2024-09-10T05:36:32.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.811+0000 7f3881c9f640 1 -- 172.21.15.62:0/1033669032 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f387800f6e0 con 0x55e42d4a8ea0 2024-09-10T05:36:32.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.811+0000 7f388499a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:32.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.811+0000 7f388499a9c0 20 started sync module instance, tier type = 2024-09-10T05:36:32.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.811+0000 7f388499a9c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:32.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.811+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4af2a0 con 0x55e42d4a5680 2024-09-10T05:36:32.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.811+0000 7f38824a0640 1 -- 172.21.15.62:0/1033669032 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f387c0bd910 con 0x55e42d4a5680 2024-09-10T05:36:32.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.811+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94438500791952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4b0a50 con 0x55e42d4a5680 2024-09-10T05:36:32.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.811+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4b12a0 con 0x55e42d4a1200 2024-09-10T05:36:32.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.811+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f387400a4d0 con 0x55e42d4a1200 2024-09-10T05:36:32.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.811+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94438500797008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4b0ed0 con 0x55e42d4a1200 2024-09-10T05:36:32.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.811+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4b2230 con 0x55e42d4a5680 2024-09-10T05:36:32.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.815+0000 7f38824a0640 1 -- 172.21.15.62:0/1033669032 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94438500791952] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f387c0bd910 con 0x55e42d4a5680 2024-09-10T05:36:32.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.815+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94438500797008] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f387400a4d0 con 0x55e42d4a1200 2024-09-10T05:36:32.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.815+0000 7f38824a0640 1 -- 172.21.15.62:0/1033669032 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f387c0bd910 con 0x55e42d4a5680 2024-09-10T05:36:32.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.815+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94438500800064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4b21f0 con 0x55e42d4a5680 2024-09-10T05:36:32.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.815+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4b2ad0 con 0x7f387c123040 2024-09-10T05:36:32.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.815+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f387400a4d0 con 0x7f387c123040 2024-09-10T05:36:32.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.815+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94438500804128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4b21f0 con 0x7f387c123040 2024-09-10T05:36:32.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.815+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4b3540 con 0x55e42d4a5680 2024-09-10T05:36:32.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.815+0000 7f38824a0640 1 -- 172.21.15.62:0/1033669032 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94438500800064] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f387c0bd910 con 0x55e42d4a5680 2024-09-10T05:36:32.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.815+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94438500804128] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f387400a4d0 con 0x7f387c123040 2024-09-10T05:36:32.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.819+0000 7f38824a0640 1 -- 172.21.15.62:0/1033669032 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f387c0bd910 con 0x55e42d4a5680 2024-09-10T05:36:32.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.819+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94438500805184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4b3090 con 0x55e42d4a5680 2024-09-10T05:36:32.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.819+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4b3e10 con 0x55e42d4a8ea0 2024-09-10T05:36:32.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.819+0000 7f3881c9f640 1 -- 172.21.15.62:0/1033669032 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f387800f6e0 con 0x55e42d4a8ea0 2024-09-10T05:36:32.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.819+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94438500809056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4b3090 con 0x55e42d4a8ea0 2024-09-10T05:36:32.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.819+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4b4850 con 0x55e42d4a8ea0 2024-09-10T05:36:32.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.819+0000 7f38824a0640 1 -- 172.21.15.62:0/1033669032 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94438500805184] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f387c0bd910 con 0x55e42d4a5680 2024-09-10T05:36:32.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.819+0000 7f3881c9f640 1 -- 172.21.15.62:0/1033669032 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94438500809056] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f387800f6e0 con 0x55e42d4a8ea0 2024-09-10T05:36:32.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.819+0000 7f3881c9f640 1 -- 172.21.15.62:0/1033669032 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f387800f6e0 con 0x55e42d4a8ea0 2024-09-10T05:36:32.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.819+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94438500810112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4b43a0 con 0x55e42d4a8ea0 2024-09-10T05:36:32.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.819+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4b50f0 con 0x7f387c123040 2024-09-10T05:36:32.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.823+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f387400a4d0 con 0x7f387c123040 2024-09-10T05:36:32.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.823+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94438500813888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4b5510 con 0x7f387c123040 2024-09-10T05:36:32.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.823+0000 7f388499a9c0 20 add_watcher() i=0 2024-09-10T05:36:32.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.823+0000 7f388499a9c0 20 add_watcher() i=1 2024-09-10T05:36:32.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.823+0000 7f388499a9c0 20 add_watcher() i=2 2024-09-10T05:36:32.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.823+0000 7f388499a9c0 20 add_watcher() i=3 2024-09-10T05:36:32.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.823+0000 7f388499a9c0 20 add_watcher() i=4 2024-09-10T05:36:32.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.823+0000 7f388499a9c0 20 add_watcher() i=5 2024-09-10T05:36:32.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.823+0000 7f3881c9f640 1 -- 172.21.15.62:0/1033669032 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94438500810112] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f387800f6e0 con 0x55e42d4a8ea0 2024-09-10T05:36:32.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.823+0000 7f388499a9c0 20 add_watcher() i=6 2024-09-10T05:36:32.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.823+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94438500813888] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f387400a4d0 con 0x7f387c123040 2024-09-10T05:36:32.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.823+0000 7f388499a9c0 20 add_watcher() i=7 2024-09-10T05:36:32.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.823+0000 7f388499a9c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:32.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.823+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4b8190 con 0x55e42d4a1200 2024-09-10T05:36:32.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.823+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f387400a4d0 con 0x55e42d4a1200 2024-09-10T05:36:32.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.823+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94438500801760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4b5510 con 0x55e42d4a1200 2024-09-10T05:36:32.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.823+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94438500801760] v30'76 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f387400a4d0 con 0x55e42d4a1200 2024-09-10T05:36:32.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.827+0000 7f3738fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:32.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.827+0000 7f388499a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:32.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.827+0000 7f388499a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:32.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.827+0000 7f388499a9c0 5 note: GC not initialized 2024-09-10T05:36:32.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.827+0000 7f36b37fe640 20 reqs_thread_entry: start 2024-09-10T05:36:32.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.827+0000 7f388499a9c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:32.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.827+0000 7f388499a9c0 20 Filter name: none 2024-09-10T05:36:32.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.827+0000 7f36b17fa640 20 reqs_thread_entry: start 2024-09-10T05:36:32.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.827+0000 7f388499a9c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T05:36:32.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.827+0000 7f388499a9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.827+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4db4b0 con 0x55e42d4a1200 2024-09-10T05:36:32.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.827+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f387400a4d0 con 0x55e42d4a1200 2024-09-10T05:36:32.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.827+0000 7f388499a9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:36:32.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.827+0000 7f388499a9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T05:36:32.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.827+0000 7f388499a9c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:36:32.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.827+0000 7f388499a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:36:32.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.827+0000 7f388499a9c0 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2024-09-10T05:36:32.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.827+0000 7f388499a9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.827+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:63 8.8 8:17d68d04:users.swift::foo%3afoo1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4dbf20 con 0x55e42d4a1200 2024-09-10T05:36:32.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.827+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(63 foo:foo1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f387400a4d0 con 0x55e42d4a1200 2024-09-10T05:36:32.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.827+0000 7f388499a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:32.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.827+0000 7f388499a9c0 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2024-09-10T05:36:32.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.827+0000 7f388499a9c0 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-10T05:36:32.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.827+0000 7f388499a9c0 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2024-09-10T05:36:32.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.827+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4e1790 con 0x55e42d4a1200 2024-09-10T05:36:32.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.827+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~556] v30'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f387400a4d0 con 0x55e42d4a1200 2024-09-10T05:36:32.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.827+0000 7f388499a9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:36:32.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.827+0000 7f388499a9c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:36:32.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.827+0000 7f388499a9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T05:36:32.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.827+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94438500995712 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4dcf30 con 0x55e42d4a5680 2024-09-10T05:36:32.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.827+0000 7f38824a0640 1 -- 172.21.15.62:0/1033669032 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== watch-notify(notify (1) cookie 94438500805184 notify 128849018887 ret 0) ==== 774+0+0 (crc 0 0 0) 0x55e42d483b60 con 0x55e42d4a5680 2024-09-10T05:36:32.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.827+0000 7f37657fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018887 cookie 94438500805184 notifier 4360 bl.length()=732 2024-09-10T05:36:32.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.827+0000 7f37657fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:36:32.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.827+0000 7f37657fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:36:32.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.827+0000 7f37657fa640 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f36b8003440 con 0x55e42d4a5680 2024-09-10T05:36:32.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.827+0000 7f38824a0640 1 -- 172.21.15.62:0/1033669032 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(65 notify.4 [notify cookie 94438500995712 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f387c0bd910 con 0x55e42d4a5680 2024-09-10T05:36:32.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.827+0000 7f38824a0640 1 -- 172.21.15.62:0/1033669032 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f387c0bd910 con 0x55e42d4a5680 2024-09-10T05:36:32.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.831+0000 7f38824a0640 1 -- 172.21.15.62:0/1033669032 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== watch-notify(notify_complete (2) cookie 94438500995712 notify 128849018887 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e42d483300 con 0x55e42d4a5680 2024-09-10T05:36:32.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.831+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:67 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4e1280 con 0x55e42d4a1200 2024-09-10T05:36:32.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.831+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(67 foo:foo1 [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f387400a4d0 con 0x55e42d4a1200 2024-09-10T05:36:32.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.831+0000 7f388499a9c0 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-10T05:36:32.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.831+0000 7f388499a9c0 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-10T05:36:32.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.831+0000 7f388499a9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-10T05:36:32.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.831+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94438500995712 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4dca80 con 0x55e42d4a5680 2024-09-10T05:36:32.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.831+0000 7f38824a0640 1 -- 172.21.15.62:0/1033669032 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== watch-notify(notify (1) cookie 94438500791952 notify 128849018888 ret 0) ==== 208+0+0 (crc 0 0 0) 0x55e42d483300 con 0x55e42d4a5680 2024-09-10T05:36:32.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.831+0000 7f3765ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018888 cookie 94438500791952 notifier 4360 bl.length()=166 2024-09-10T05:36:32.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.831+0000 7f3765ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-10T05:36:32.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.831+0000 7f3765ffb640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-10T05:36:32.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.831+0000 7f3765ffb640 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f3748003eb0 con 0x55e42d4a5680 2024-09-10T05:36:32.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.831+0000 7f38824a0640 1 -- 172.21.15.62:0/1033669032 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(68 notify.0 [notify cookie 94438500995712 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f387c0bd910 con 0x55e42d4a5680 2024-09-10T05:36:32.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.831+0000 7f38824a0640 1 -- 172.21.15.62:0/1033669032 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f387c0bd910 con 0x55e42d4a5680 2024-09-10T05:36:32.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.831+0000 7f38824a0640 1 -- 172.21.15.62:0/1033669032 <== osd.0 v2:172.21.15.2:6800/945139080 25 ==== watch-notify(notify_complete (2) cookie 94438500995712 notify 128849018888 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e42d465d60 con 0x55e42d4a5680 2024-09-10T05:36:32.837 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T05:36:30.893777Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"M1I9xqh3DM0nin6SDSZzLICHL0sAGATlySk9iudt","active":true,"create_date":"2024-09-10T05:36:32.831155Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:36:30.893760Z","tags":[],"group_ids":[]} 2024-09-10T05:36:32.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.831+0000 7f3738fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:32.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.835+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94438500801760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4d92f0 con 0x55e42d4a1200 2024-09-10T05:36:32.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.835+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 <== osd.1 v2:172.21.15.62:6808/3442097179 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94438500801760] v30'77 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f387400a4d0 con 0x55e42d4a1200 2024-09-10T05:36:32.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.835+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94438500791952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4d92f0 con 0x55e42d4a5680 2024-09-10T05:36:32.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.839+0000 7f38824a0640 1 -- 172.21.15.62:0/1033669032 <== osd.0 v2:172.21.15.2:6800/945139080 26 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94438500791952] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f387c0bd910 con 0x55e42d4a5680 2024-09-10T05:36:32.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.839+0000 7f388499a9c0 20 remove_watcher() i=0 2024-09-10T05:36:32.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.839+0000 7f388499a9c0 2 removed watcher, disabling cache 2024-09-10T05:36:32.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.839+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94438500797008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4d92f0 con 0x55e42d4a1200 2024-09-10T05:36:32.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.839+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 <== osd.1 v2:172.21.15.62:6808/3442097179 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94438500797008] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f387400a4d0 con 0x55e42d4a1200 2024-09-10T05:36:32.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.839+0000 7f388499a9c0 20 remove_watcher() i=1 2024-09-10T05:36:32.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.839+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94438500800064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4d92f0 con 0x55e42d4a5680 2024-09-10T05:36:32.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.839+0000 7f38824a0640 1 -- 172.21.15.62:0/1033669032 <== osd.0 v2:172.21.15.2:6800/945139080 27 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94438500800064] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f387c0bd910 con 0x55e42d4a5680 2024-09-10T05:36:32.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.839+0000 7f388499a9c0 20 remove_watcher() i=2 2024-09-10T05:36:32.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.839+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94438500804128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4d92f0 con 0x7f387c123040 2024-09-10T05:36:32.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.843+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94438500804128] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f387400a4d0 con 0x7f387c123040 2024-09-10T05:36:32.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.843+0000 7f388499a9c0 20 remove_watcher() i=3 2024-09-10T05:36:32.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.843+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94438500805184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4d92f0 con 0x55e42d4a5680 2024-09-10T05:36:32.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.843+0000 7f38824a0640 1 -- 172.21.15.62:0/1033669032 <== osd.0 v2:172.21.15.2:6800/945139080 28 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94438500805184] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f387c0bd910 con 0x55e42d4a5680 2024-09-10T05:36:32.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.843+0000 7f388499a9c0 20 remove_watcher() i=4 2024-09-10T05:36:32.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.843+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94438500809056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4d92f0 con 0x55e42d4a8ea0 2024-09-10T05:36:32.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.843+0000 7f3881c9f640 1 -- 172.21.15.62:0/1033669032 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94438500809056] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f387800f6e0 con 0x55e42d4a8ea0 2024-09-10T05:36:32.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.843+0000 7f388499a9c0 20 remove_watcher() i=5 2024-09-10T05:36:32.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.843+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94438500810112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4d92f0 con 0x55e42d4a8ea0 2024-09-10T05:36:32.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.847+0000 7f3881c9f640 1 -- 172.21.15.62:0/1033669032 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94438500810112] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f387800f6e0 con 0x55e42d4a8ea0 2024-09-10T05:36:32.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.847+0000 7f388499a9c0 20 remove_watcher() i=6 2024-09-10T05:36:32.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.847+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94438500813888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e42d4d92f0 con 0x7f387c123040 2024-09-10T05:36:32.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.847+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94438500813888] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f387400a4d0 con 0x7f387c123040 2024-09-10T05:36:32.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.847+0000 7f388499a9c0 20 remove_watcher() i=7 2024-09-10T05:36:32.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.847+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e42d4a5680 msgr2=0x55e42d4a7a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.847+0000 7f388499a9c0 1 --2- 172.21.15.62:0/1033669032 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e42d4a5680 0x55e42d4a7a70 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.847+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55e42d4a1200 msgr2=0x55e42d4a3690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.847+0000 7f388499a9c0 1 --2- 172.21.15.62:0/1033669032 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55e42d4a1200 0x55e42d4a3690 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.847+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f387c123040 msgr2=0x7f387c0db5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.847+0000 7f388499a9c0 1 --2- 172.21.15.62:0/1033669032 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f387c123040 0x7f387c0db5f0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.847+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55e42d4a8ea0 msgr2=0x55e42d4ab290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.847+0000 7f388499a9c0 1 --2- 172.21.15.62:0/1033669032 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55e42d4a8ea0 0x55e42d4ab290 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.847+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f374c039ac0 msgr2=0x7f374c03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.847+0000 7f388499a9c0 1 --2- 172.21.15.62:0/1033669032 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f374c039ac0 0x7f374c03bf80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x55e42d4705c0 tx=0x7f3878010000 comp rx=0 tx=0).stop 2024-09-10T05:36:32.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.847+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e42d4900f0 msgr2=0x55e42d496400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.847+0000 7f388499a9c0 1 --2- 172.21.15.62:0/1033669032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e42d4900f0 0x55e42d496400 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f387c0c6b70 tx=0x7f387c102040 comp rx=0 tx=0).stop 2024-09-10T05:36:32.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.847+0000 7f3882ca1640 1 -- 172.21.15.62:0/1033669032 reap_dead start 2024-09-10T05:36:32.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.847+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 shutdown_connections 2024-09-10T05:36:32.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.847+0000 7f388499a9c0 1 --2- 172.21.15.62:0/1033669032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e42d4900f0 0x55e42d496400 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.847+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 >> 172.21.15.62:0/1033669032 conn(0x55e42d48b4b0 msgr2=0x55e42d4896c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:32.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.847+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 shutdown_connections 2024-09-10T05:36:32.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.847+0000 7f388499a9c0 1 -- 172.21.15.62:0/1033669032 wait complete. 2024-09-10T05:36:32.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.847+0000 7f388499a9c0 1 -- 172.21.15.62:0/3561218997 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f375c039a70 msgr2=0x7f375c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.847+0000 7f388499a9c0 1 --2- 172.21.15.62:0/3561218997 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f375c039a70 0x7f375c03bf30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x55e42d466d00 tx=0x7f387800f000 comp rx=0 tx=0).stop 2024-09-10T05:36:32.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.847+0000 7f388499a9c0 1 -- 172.21.15.62:0/3561218997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e42d4828a0 msgr2=0x55e42d482cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.847+0000 7f388499a9c0 1 --2- 172.21.15.62:0/3561218997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e42d4828a0 0x55e42d482cc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f387c0e9fe0 tx=0x7f387c0cfa00 comp rx=0 tx=0).stop 2024-09-10T05:36:32.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.847+0000 7f388499a9c0 1 -- 172.21.15.62:0/3561218997 shutdown_connections 2024-09-10T05:36:32.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.847+0000 7f388499a9c0 1 --2- 172.21.15.62:0/3561218997 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f375c039a70 0x7f375c03bf30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.847+0000 7f388499a9c0 1 --2- 172.21.15.62:0/3561218997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e42d4828a0 0x55e42d482cc0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.847+0000 7f388499a9c0 1 -- 172.21.15.62:0/3561218997 >> 172.21.15.62:0/3561218997 conn(0x55e42d478250 msgr2=0x55e42d478630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:32.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.847+0000 7f388499a9c0 1 -- 172.21.15.62:0/3561218997 shutdown_connections 2024-09-10T05:36:32.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.847+0000 7f388499a9c0 1 -- 172.21.15.62:0/3561218997 wait complete. 2024-09-10T05:36:32.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.847+0000 7f388499a9c0 1 -- 172.21.15.62:0/3733330744 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e42d46cd60 msgr2=0x55e42d46f220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.847+0000 7f388499a9c0 1 --2- 172.21.15.62:0/3733330744 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e42d46cd60 0x55e42d46f220 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.847+0000 7f388499a9c0 1 -- 172.21.15.62:0/3733330744 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55e42d375130 msgr2=0x55e42d46bd30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.847+0000 7f388499a9c0 1 --2- 172.21.15.62:0/3733330744 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55e42d375130 0x55e42d46bd30 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.847+0000 7f388499a9c0 1 -- 172.21.15.62:0/3733330744 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55e42d471750 msgr2=0x55e42d473b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.847+0000 7f388499a9c0 1 --2- 172.21.15.62:0/3733330744 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55e42d471750 0x55e42d473b40 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.847+0000 7f388499a9c0 1 -- 172.21.15.62:0/3733330744 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3768039a70 msgr2=0x7f376803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.847+0000 7f388499a9c0 1 --2- 172.21.15.62:0/3733330744 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3768039a70 0x7f376803bf30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3878001e90 tx=0x7f38780013f0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.847+0000 7f388499a9c0 1 -- 172.21.15.62:0/3733330744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e42d371fa0 msgr2=0x55e42d464bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.847+0000 7f388499a9c0 1 --2- 172.21.15.62:0/3733330744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e42d371fa0 0x55e42d464bc0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f387c01bbe0 tx=0x7f387c0180e0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.847+0000 7f3882ca1640 1 -- 172.21.15.62:0/3733330744 reap_dead start 2024-09-10T05:36:32.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.847+0000 7f388499a9c0 1 -- 172.21.15.62:0/3733330744 shutdown_connections 2024-09-10T05:36:32.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.847+0000 7f388499a9c0 1 -- 172.21.15.62:0/3733330744 >> 172.21.15.62:0/3733330744 conn(0x55e42d36dac0 msgr2=0x55e42d457db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:32.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.847+0000 7f388499a9c0 1 -- 172.21.15.62:0/3733330744 shutdown_connections 2024-09-10T05:36:32.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.847+0000 7f388499a9c0 1 -- 172.21.15.62:0/3733330744 wait complete. 2024-09-10T05:36:32.861 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T05:36:30.893777Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'M1I9xqh3DM0nin6SDSZzLICHL0sAGATlySk9iudt', 'active': True, 'create_date': '2024-09-10T05:36:32.831155Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:36:30.893760Z', 'tags': [], 'group_ids': []} 2024-09-10T05:36:32.861 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-10T05:36:32.862 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-10T05:36:32.862 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2024-09-10T05:36:32.944 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:32.944 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:32.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.943+0000 7f6d3d4cc9c0 1 Processor -- start 2024-09-10T05:36:32.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.943+0000 7f6d3d4cc9c0 1 -- start start 2024-09-10T05:36:32.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.943+0000 7f6d3d4cc9c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55e0cc4242d0 0x55e0cc4266c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.943+0000 7f6d3d4cc9c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e0cc2d29c0 con 0x55e0cc420180 2024-09-10T05:36:32.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.943+0000 7f6d3d4cc9c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x55e0cc3226d0 con 0x55e0cc4242d0 2024-09-10T05:36:32.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.943+0000 7f6d3a7d1640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55e0cc4242d0 0x55e0cc4266c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.943+0000 7f6d3afd2640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x55e0cc420180 0x55e0cc420560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:38588/0 (socket says 172.21.15.62:38588) 2024-09-10T05:36:32.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.943+0000 7f6d3afd2640 1 -- 172.21.15.62:0/154894978 learned_addr learned my addr 172.21.15.62:0/154894978 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-10T05:36:32.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.943+0000 7f6d3a7d1640 1 -- 172.21.15.62:0/154894978 >> v1:172.21.15.2:6789/0 conn(0x55e0cc420180 legacy=0x55e0cc420560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.943+0000 7f6d3a7d1640 1 -- 172.21.15.62:0/154894978 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0cc2c6ca0 con 0x55e0cc4242d0 2024-09-10T05:36:32.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.947+0000 7f6d3a7d1640 1 --2- 172.21.15.62:0/154894978 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0cc4242d0 0x55e0cc4266c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6d3000a480 tx=0x7f6d3001b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f839aae743784f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.947+0000 7f6d39fd0640 1 -- 172.21.15.62:0/154894978 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d300aa570 con 0x55e0cc4242d0 2024-09-10T05:36:32.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.947+0000 7f6d39fd0640 1 -- 172.21.15.62:0/154894978 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d300af070 con 0x55e0cc4242d0 2024-09-10T05:36:32.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.947+0000 7f6d39fd0640 1 -- 172.21.15.62:0/154894978 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d300aa860 con 0x55e0cc4242d0 2024-09-10T05:36:32.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.947+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/154894978 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0cc4242d0 msgr2=0x55e0cc4266c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.947+0000 7f6d3d4cc9c0 1 --2- 172.21.15.62:0/154894978 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0cc4242d0 0x55e0cc4266c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6d3000a480 tx=0x7f6d3001b310 comp rx=0 tx=0).stop 2024-09-10T05:36:32.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.947+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/154894978 shutdown_connections 2024-09-10T05:36:32.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.947+0000 7f6d3d4cc9c0 1 --2- 172.21.15.62:0/154894978 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0cc4242d0 0x55e0cc4266c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.947+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/154894978 >> 172.21.15.62:0/154894978 conn(0x55e0cc393a90 msgr2=0x55e0cc393ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:32.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.947+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/154894978 shutdown_connections 2024-09-10T05:36:32.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.947+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/154894978 wait complete. 2024-09-10T05:36:32.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.959+0000 7f6d3d4cc9c0 1 Processor -- start 2024-09-10T05:36:32.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.959+0000 7f6d3d4cc9c0 1 -- start start 2024-09-10T05:36:32.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.959+0000 7f6d3d4cc9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0cc420180 0x55e0cc50b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.959+0000 7f6d3d4cc9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e0cc326680 con 0x55e0cc420180 2024-09-10T05:36:32.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.959+0000 7f6d3afd2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0cc420180 0x55e0cc50b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.959+0000 7f6d3afd2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0cc420180 0x55e0cc50b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51812/0 (socket says 172.21.15.62:51812) 2024-09-10T05:36:32.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.959+0000 7f6d3afd2640 1 -- 172.21.15.62:0/4203988477 learned_addr learned my addr 172.21.15.62:0/4203988477 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:32.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.959+0000 7f6d3afd2640 1 -- 172.21.15.62:0/4203988477 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0cc2a1da0 con 0x55e0cc420180 2024-09-10T05:36:32.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.959+0000 7f6d3afd2640 1 --2- 172.21.15.62:0/4203988477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0cc420180 0x55e0cc50b940 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c001e00 tx=0x7f6d2c00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7319dccb017771fd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.959+0000 7f6c28e09640 1 -- 172.21.15.62:0/4203988477 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d2c012020 con 0x55e0cc420180 2024-09-10T05:36:32.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.959+0000 7f6c28e09640 1 -- 172.21.15.62:0/4203988477 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d2c00e690 con 0x55e0cc420180 2024-09-10T05:36:32.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.959+0000 7f6c28e09640 1 -- 172.21.15.62:0/4203988477 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d2c00ea10 con 0x55e0cc420180 2024-09-10T05:36:32.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.963+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/4203988477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0cc420180 msgr2=0x55e0cc50b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.963+0000 7f6d3d4cc9c0 1 --2- 172.21.15.62:0/4203988477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0cc420180 0x55e0cc50b940 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c001e00 tx=0x7f6d2c00b6d0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.963+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/4203988477 shutdown_connections 2024-09-10T05:36:32.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.963+0000 7f6d3d4cc9c0 1 --2- 172.21.15.62:0/4203988477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0cc420180 0x55e0cc50b940 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.963+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/4203988477 >> 172.21.15.62:0/4203988477 conn(0x55e0cc393a90 msgr2=0x55e0cc507580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:32.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.963+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/4203988477 shutdown_connections 2024-09-10T05:36:32.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.963+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/4203988477 wait complete. 2024-09-10T05:36:32.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.963+0000 7f6d3d4cc9c0 1 Processor -- start 2024-09-10T05:36:32.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.963+0000 7f6d3d4cc9c0 1 -- start start 2024-09-10T05:36:32.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.963+0000 7f6d3d4cc9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0cc420180 0x55e0cc512ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.963+0000 7f6d3d4cc9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e0cc2c8a50 con 0x55e0cc420180 2024-09-10T05:36:32.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.963+0000 7f6d3afd2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0cc420180 0x55e0cc512ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.963+0000 7f6d3afd2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0cc420180 0x55e0cc512ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51824/0 (socket says 172.21.15.62:51824) 2024-09-10T05:36:32.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.963+0000 7f6d3afd2640 1 -- 172.21.15.62:0/812940201 learned_addr learned my addr 172.21.15.62:0/812940201 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:32.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.963+0000 7f6d3afd2640 1 -- 172.21.15.62:0/812940201 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0cc513550 con 0x55e0cc420180 2024-09-10T05:36:32.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.963+0000 7f6d3afd2640 1 --2- 172.21.15.62:0/812940201 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0cc420180 0x55e0cc512ff0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x55e0cc50c8d0 tx=0x7f6d2c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.963+0000 7f6c27606640 1 -- 172.21.15.62:0/812940201 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d2c012030 con 0x55e0cc420180 2024-09-10T05:36:32.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.963+0000 7f6c27606640 1 -- 172.21.15.62:0/812940201 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d2c01a750 con 0x55e0cc420180 2024-09-10T05:36:32.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.963+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/812940201 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e0cc5137e0 con 0x55e0cc420180 2024-09-10T05:36:32.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.963+0000 7f6c27606640 1 -- 172.21.15.62:0/812940201 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d2c01aa50 con 0x55e0cc420180 2024-09-10T05:36:32.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.963+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/812940201 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0cc514190 con 0x55e0cc420180 2024-09-10T05:36:32.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.967+0000 7f6c27606640 1 -- 172.21.15.62:0/812940201 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6d2c015020 con 0x55e0cc420180 2024-09-10T05:36:32.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.967+0000 7f6c27606640 1 --2- 172.21.15.62:0/812940201 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6c20039a70 0x7f6c2003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.967+0000 7f6c27606640 1 -- 172.21.15.62:0/812940201 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f6d2c020030 con 0x55e0cc420180 2024-09-10T05:36:32.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.967+0000 7f6d3a7d1640 1 --2- 172.21.15.62:0/812940201 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6c20039a70 0x7f6c2003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.967+0000 7f6d3d4cc9c0 1 --2- 172.21.15.62:0/812940201 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55e0cc4242d0 0x55e0cc51a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.967+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/812940201 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc51a6a0 con 0x55e0cc4242d0 2024-09-10T05:36:32.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.967+0000 7f6d3b7d3640 1 --2- 172.21.15.62:0/812940201 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55e0cc4242d0 0x55e0cc51a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.967+0000 7f6d3a7d1640 1 --2- 172.21.15.62:0/812940201 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6c20039a70 0x7f6c2003bf30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6d300ae000 tx=0x7f6d300a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.967+0000 7f6d3b7d3640 1 --2- 172.21.15.62:0/812940201 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55e0cc4242d0 0x55e0cc51a160 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.967+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/812940201 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d3400a4d0 con 0x55e0cc4242d0 2024-09-10T05:36:32.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.967+0000 7f6d3d4cc9c0 1 --2- 172.21.15.62:0/812940201 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e0cc51b1a0 0x55e0cc51d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.967+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/812940201 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc51ddd0 con 0x55e0cc51b1a0 2024-09-10T05:36:32.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.967+0000 7f6d3afd2640 1 --2- 172.21.15.62:0/812940201 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e0cc51b1a0 0x55e0cc51d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.967+0000 7f6d3afd2640 1 --2- 172.21.15.62:0/812940201 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e0cc51b1a0 0x55e0cc51d660 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.967+0000 7f6d3afd2640 1 -- 172.21.15.62:0/812940201 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6d2c008030 con 0x55e0cc51b1a0 2024-09-10T05:36:32.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.967+0000 7f6d3d4cc9c0 1 --2- 172.21.15.62:0/812940201 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55e0cc51fb90 0x55e0cc521f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.967+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/812940201 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc522670 con 0x55e0cc51fb90 2024-09-10T05:36:32.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.967+0000 7f6d3a7d1640 1 --2- 172.21.15.62:0/812940201 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55e0cc51fb90 0x55e0cc521f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.967+0000 7f6d3a7d1640 1 --2- 172.21.15.62:0/812940201 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55e0cc51fb90 0x55e0cc521f80 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.971+0000 7f6d3a7d1640 1 -- 172.21.15.62:0/812940201 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6d300a8070 con 0x55e0cc51fb90 2024-09-10T05:36:32.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.971+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/812940201 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc51ea30 con 0x55e0cc51b1a0 2024-09-10T05:36:32.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.971+0000 7f6d3afd2640 1 -- 172.21.15.62:0/812940201 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6d2c008030 con 0x55e0cc51b1a0 2024-09-10T05:36:32.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.971+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/812940201 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc51eed0 con 0x55e0cc51fb90 2024-09-10T05:36:32.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.971+0000 7f6d3a7d1640 1 -- 172.21.15.62:0/812940201 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6d300a8070 con 0x55e0cc51fb90 2024-09-10T05:36:32.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.971+0000 7f6d3d4cc9c0 1 Processor -- start 2024-09-10T05:36:32.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.971+0000 7f6d3d4cc9c0 1 -- start start 2024-09-10T05:36:32.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.971+0000 7f6d3d4cc9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0cc530c80 0x55e0cc5310a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.971+0000 7f6d3d4cc9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e0cc333450 con 0x55e0cc530c80 2024-09-10T05:36:32.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.971+0000 7f6d3afd2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0cc530c80 0x55e0cc5310a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.971+0000 7f6d3afd2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0cc530c80 0x55e0cc5310a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51838/0 (socket says 172.21.15.62:51838) 2024-09-10T05:36:32.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.971+0000 7f6d3afd2640 1 -- 172.21.15.62:0/3701990085 learned_addr learned my addr 172.21.15.62:0/3701990085 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:32.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.971+0000 7f6d3afd2640 1 -- 172.21.15.62:0/3701990085 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0cc5316e0 con 0x55e0cc530c80 2024-09-10T05:36:32.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.971+0000 7f6d3afd2640 1 --2- 172.21.15.62:0/3701990085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0cc530c80 0x55e0cc5310a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c03e010 tx=0x7f6d2c01aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.971+0000 7f6c24e01640 1 -- 172.21.15.62:0/3701990085 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d2c02cb80 con 0x55e0cc530c80 2024-09-10T05:36:32.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.971+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/3701990085 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e0cc531f40 con 0x55e0cc530c80 2024-09-10T05:36:32.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.971+0000 7f6c24e01640 1 -- 172.21.15.62:0/3701990085 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d2c031070 con 0x55e0cc530c80 2024-09-10T05:36:32.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.971+0000 7f6c24e01640 1 -- 172.21.15.62:0/3701990085 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d2c02ce50 con 0x55e0cc530c80 2024-09-10T05:36:32.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.971+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/3701990085 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0cc5324b0 con 0x55e0cc530c80 2024-09-10T05:36:32.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.975+0000 7f6c24e01640 1 -- 172.21.15.62:0/3701990085 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6d2c033030 con 0x55e0cc530c80 2024-09-10T05:36:32.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.975+0000 7f6c24e01640 1 --2- 172.21.15.62:0/3701990085 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6c14039ac0 0x7f6c1403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.975+0000 7f6c24e01640 1 -- 172.21.15.62:0/3701990085 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f6d2c005050 con 0x55e0cc530c80 2024-09-10T05:36:32.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.975+0000 7f6d3a7d1640 1 --2- 172.21.15.62:0/3701990085 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6c14039ac0 0x7f6c1403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.975+0000 7f6d3d4cc9c0 1 Processor -- start 2024-09-10T05:36:32.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.975+0000 7f6d3d4cc9c0 1 -- start start 2024-09-10T05:36:32.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.975+0000 7f6d3a7d1640 1 --2- 172.21.15.62:0/3701990085 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6c14039ac0 0x7f6c1403bf80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6d30000c10 tx=0x7f6d30005a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.975+0000 7f6d3d4cc9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0cc53e410 0x55e0cc53e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.975+0000 7f6d3d4cc9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e0cc50c190 con 0x55e0cc53e410 2024-09-10T05:36:32.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.975+0000 7f6d3afd2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0cc53e410 0x55e0cc53e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.975+0000 7f6d3afd2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0cc53e410 0x55e0cc53e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51840/0 (socket says 172.21.15.62:51840) 2024-09-10T05:36:32.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.975+0000 7f6d3afd2640 1 -- 172.21.15.62:0/3971896186 learned_addr learned my addr 172.21.15.62:0/3971896186 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:32.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.975+0000 7f6d3afd2640 1 -- 172.21.15.62:0/3971896186 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0cc53ee00 con 0x55e0cc53e410 2024-09-10T05:36:32.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.975+0000 7f6d3afd2640 1 --2- 172.21.15.62:0/3971896186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0cc53e410 0x55e0cc53e810 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c040870 tx=0x7f6d2c04d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd656c5665c50817 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.975+0000 7f6c1e7fc640 1 -- 172.21.15.62:0/3971896186 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d2c05f070 con 0x55e0cc53e410 2024-09-10T05:36:32.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.975+0000 7f6c1e7fc640 1 -- 172.21.15.62:0/3971896186 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d2c0408e0 con 0x55e0cc53e410 2024-09-10T05:36:32.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.975+0000 7f6c1e7fc640 1 -- 172.21.15.62:0/3971896186 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d2c03c300 con 0x55e0cc53e410 2024-09-10T05:36:32.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.975+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/3971896186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0cc53e410 msgr2=0x55e0cc53e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:32.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.975+0000 7f6d3d4cc9c0 1 --2- 172.21.15.62:0/3971896186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0cc53e410 0x55e0cc53e810 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c040870 tx=0x7f6d2c04d4a0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.975+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/3971896186 shutdown_connections 2024-09-10T05:36:32.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.975+0000 7f6d3d4cc9c0 1 --2- 172.21.15.62:0/3971896186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0cc53e410 0x55e0cc53e810 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:32.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.975+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/3971896186 >> 172.21.15.62:0/3971896186 conn(0x55e0cc539830 msgr2=0x55e0cc537a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:32.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.975+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/3971896186 shutdown_connections 2024-09-10T05:36:32.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.975+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/3971896186 wait complete. 2024-09-10T05:36:32.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.975+0000 7f6d3d4cc9c0 1 Processor -- start 2024-09-10T05:36:32.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.975+0000 7f6d3d4cc9c0 1 -- start start 2024-09-10T05:36:32.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.975+0000 7f6d3d4cc9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0cc53e410 0x55e0cc5447c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.975+0000 7f6d3d4cc9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e0cc53d1e0 con 0x55e0cc53e410 2024-09-10T05:36:32.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.979+0000 7f6d3afd2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0cc53e410 0x55e0cc5447c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.979+0000 7f6d3afd2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0cc53e410 0x55e0cc5447c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51852/0 (socket says 172.21.15.62:51852) 2024-09-10T05:36:32.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.979+0000 7f6d3afd2640 1 -- 172.21.15.62:0/2797980179 learned_addr learned my addr 172.21.15.62:0/2797980179 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:32.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.979+0000 7f6d3afd2640 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0cc544d20 con 0x55e0cc53e410 2024-09-10T05:36:32.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.979+0000 7f6d3afd2640 1 --2- 172.21.15.62:0/2797980179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0cc53e410 0x55e0cc5447c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c01ffd0 tx=0x7f6d2c01fe80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.979+0000 7f6c1cff9640 1 -- 172.21.15.62:0/2797980179 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d2c06a020 con 0x55e0cc53e410 2024-09-10T05:36:32.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.979+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e0cc544d20 con 0x55e0cc53e410 2024-09-10T05:36:32.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.979+0000 7f6c1cff9640 1 -- 172.21.15.62:0/2797980179 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d2c060040 con 0x55e0cc53e410 2024-09-10T05:36:32.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.979+0000 7f6c1cff9640 1 -- 172.21.15.62:0/2797980179 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d2c05f070 con 0x55e0cc53e410 2024-09-10T05:36:32.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.979+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0cc5452f0 con 0x55e0cc53e410 2024-09-10T05:36:32.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.979+0000 7f6d3d4cc9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.979+0000 7f6c1cff9640 1 -- 172.21.15.62:0/2797980179 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6d2c06d020 con 0x55e0cc53e410 2024-09-10T05:36:32.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.979+0000 7f6c1cff9640 1 --2- 172.21.15.62:0/2797980179 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6c04039a70 0x7f6c0403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.979+0000 7f6c1cff9640 1 -- 172.21.15.62:0/2797980179 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f6d2c070ab0 con 0x55e0cc53e410 2024-09-10T05:36:32.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.979+0000 7f6d3a7d1640 1 --2- 172.21.15.62:0/2797980179 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6c04039a70 0x7f6c0403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.979+0000 7f6d3d4cc9c0 1 --2- 172.21.15.62:0/2797980179 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55e0cc54f710 0x55e0cc551ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.979+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc5522f0 con 0x55e0cc54f710 2024-09-10T05:36:32.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.979+0000 7f6d3b7d3640 1 --2- 172.21.15.62:0/2797980179 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55e0cc54f710 0x55e0cc551ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.979+0000 7f6d3a7d1640 1 --2- 172.21.15.62:0/2797980179 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6c04039a70 0x7f6c0403bf30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6d300aa650 tx=0x7f6d300a8000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.979+0000 7f6d3b7d3640 1 --2- 172.21.15.62:0/2797980179 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55e0cc54f710 0x55e0cc551ba0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.983+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/2797980179 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d3400a4d0 con 0x55e0cc54f710 2024-09-10T05:36:32.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.983+0000 7f6d3d4cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:32.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.983+0000 7f6d3d4cc9c0 20 realm 2024-09-10T05:36:32.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.983+0000 7f6d3d4cc9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.983+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc54eaa0 con 0x55e0cc54f710 2024-09-10T05:36:32.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.983+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/2797980179 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d3400a4d0 con 0x55e0cc54f710 2024-09-10T05:36:32.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.983+0000 7f6d3d4cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:32.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.983+0000 7f6d3d4cc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:32.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.983+0000 7f6d3d4cc9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.983+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc552db0 con 0x55e0cc54f710 2024-09-10T05:36:32.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.983+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/2797980179 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d3400a4d0 con 0x55e0cc54f710 2024-09-10T05:36:32.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.983+0000 7f6d3d4cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:32.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.983+0000 7f6d3d4cc9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.983+0000 7f6d3d4cc9c0 1 --2- 172.21.15.62:0/2797980179 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e0cc553b90 0x55e0cc555f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.983+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc556650 con 0x55e0cc553b90 2024-09-10T05:36:32.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.983+0000 7f6d3afd2640 1 --2- 172.21.15.62:0/2797980179 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e0cc553b90 0x55e0cc555f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.983+0000 7f6d3afd2640 1 --2- 172.21.15.62:0/2797980179 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e0cc553b90 0x55e0cc555f80 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.983+0000 7f6d3afd2640 1 -- 172.21.15.62:0/2797980179 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6d2c03c070 con 0x55e0cc553b90 2024-09-10T05:36:32.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.983+0000 7f6d3d4cc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:32.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.983+0000 7f6d3d4cc9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:32.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.983+0000 7f6d3d4cc9c0 1 --2- 172.21.15.62:0/2797980179 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55e0cc5573b0 0x55e0cc5597c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.983+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc559f50 con 0x55e0cc5573b0 2024-09-10T05:36:32.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.983+0000 7f6d3a7d1640 1 --2- 172.21.15.62:0/2797980179 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55e0cc5573b0 0x55e0cc5597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.983+0000 7f6d3a7d1640 1 --2- 172.21.15.62:0/2797980179 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55e0cc5573b0 0x55e0cc5597c0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.983+0000 7f6d3a7d1640 1 -- 172.21.15.62:0/2797980179 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6d300a8070 con 0x55e0cc5573b0 2024-09-10T05:36:32.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.983+0000 7f6d3d4cc9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:32.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.983+0000 7f6d3d4cc9c0 20 searching for the correct realm 2024-09-10T05:36:32.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.983+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc55b820 con 0x55e0cc5573b0 2024-09-10T05:36:32.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.983+0000 7f6d3a7d1640 1 -- 172.21.15.62:0/2797980179 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d300a8070 con 0x55e0cc5573b0 2024-09-10T05:36:32.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.983+0000 7f6d3a7d1640 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc55b820 con 0x55e0cc553b90 2024-09-10T05:36:32.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.983+0000 7f6d3afd2640 1 -- 172.21.15.62:0/2797980179 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d2c03c070 con 0x55e0cc553b90 2024-09-10T05:36:32.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.983+0000 7f6d3afd2640 1 --2- 172.21.15.62:0/2797980179 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f6d2c06f020 0x7f6d2c038340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:32.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.983+0000 7f6d3afd2640 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc55b820 con 0x7f6d2c06f020 2024-09-10T05:36:32.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.987+0000 7f6d3b7d3640 1 --2- 172.21.15.62:0/2797980179 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f6d2c06f020 0x7f6d2c038340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:32.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.987+0000 7f6d3b7d3640 1 --2- 172.21.15.62:0/2797980179 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f6d2c06f020 0x7f6d2c038340 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:32.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.987+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/2797980179 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3400a4d0 con 0x7f6d2c06f020 2024-09-10T05:36:32.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.987+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc55b820 con 0x55e0cc54f710 2024-09-10T05:36:32.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.987+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/2797980179 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3400a4d0 con 0x55e0cc54f710 2024-09-10T05:36:32.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.987+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc55b820 con 0x55e0cc54f710 2024-09-10T05:36:32.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.987+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/2797980179 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3400a4d0 con 0x55e0cc54f710 2024-09-10T05:36:32.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.987+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc55b820 con 0x55e0cc5573b0 2024-09-10T05:36:32.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.987+0000 7f6d3a7d1640 1 -- 172.21.15.62:0/2797980179 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d300a8070 con 0x55e0cc5573b0 2024-09-10T05:36:32.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.987+0000 7f6d3a7d1640 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc55b820 con 0x55e0cc54f710 2024-09-10T05:36:32.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.987+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/2797980179 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3400a4d0 con 0x55e0cc54f710 2024-09-10T05:36:32.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.987+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc55b820 con 0x55e0cc553b90 2024-09-10T05:36:32.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.987+0000 7f6d3afd2640 1 -- 172.21.15.62:0/2797980179 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d2c03c070 con 0x55e0cc553b90 2024-09-10T05:36:32.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.987+0000 7f6d3afd2640 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc55b820 con 0x55e0cc553b90 2024-09-10T05:36:32.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.987+0000 7f6d3afd2640 1 -- 172.21.15.62:0/2797980179 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d2c03c070 con 0x55e0cc553b90 2024-09-10T05:36:32.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.987+0000 7f6d3afd2640 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc55b820 con 0x55e0cc54f710 2024-09-10T05:36:32.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.987+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/2797980179 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3400a4d0 con 0x55e0cc54f710 2024-09-10T05:36:32.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.987+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc55b820 con 0x7f6d2c06f020 2024-09-10T05:36:32.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.987+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/2797980179 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3400a4d0 con 0x7f6d2c06f020 2024-09-10T05:36:32.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.987+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc55b820 con 0x55e0cc54f710 2024-09-10T05:36:32.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.987+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/2797980179 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3400a4d0 con 0x55e0cc54f710 2024-09-10T05:36:32.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.987+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc55b820 con 0x7f6d2c06f020 2024-09-10T05:36:32.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.991+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/2797980179 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6d3400a4d0 con 0x7f6d2c06f020 2024-09-10T05:36:32.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.991+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc55b820 con 0x55e0cc553b90 2024-09-10T05:36:32.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.991+0000 7f6d3afd2640 1 -- 172.21.15.62:0/2797980179 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d2c03c070 con 0x55e0cc553b90 2024-09-10T05:36:32.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.991+0000 7f6d3afd2640 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc55b820 con 0x55e0cc5573b0 2024-09-10T05:36:32.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.991+0000 7f6d3a7d1640 1 -- 172.21.15.62:0/2797980179 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d300a8070 con 0x55e0cc5573b0 2024-09-10T05:36:32.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.991+0000 7f6d3a7d1640 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc55b820 con 0x55e0cc54f710 2024-09-10T05:36:32.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.991+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/2797980179 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3400a4d0 con 0x55e0cc54f710 2024-09-10T05:36:33.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.991+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc55b820 con 0x55e0cc553b90 2024-09-10T05:36:33.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.991+0000 7f6d3afd2640 1 -- 172.21.15.62:0/2797980179 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d2c03c070 con 0x55e0cc553b90 2024-09-10T05:36:33.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.991+0000 7f6d3afd2640 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc55b820 con 0x55e0cc5573b0 2024-09-10T05:36:33.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.991+0000 7f6d3a7d1640 1 -- 172.21.15.62:0/2797980179 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 30 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f6d300a8070 con 0x55e0cc5573b0 2024-09-10T05:36:33.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.991+0000 7f6d3a7d1640 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc55b820 con 0x55e0cc54f710 2024-09-10T05:36:33.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.991+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/2797980179 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3400a4d0 con 0x55e0cc54f710 2024-09-10T05:36:33.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.991+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc55b820 con 0x55e0cc54f710 2024-09-10T05:36:33.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.991+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/2797980179 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6d3400a4d0 con 0x55e0cc54f710 2024-09-10T05:36:33.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.991+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc55b820 con 0x55e0cc54f710 2024-09-10T05:36:33.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.991+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/2797980179 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3400a4d0 con 0x55e0cc54f710 2024-09-10T05:36:33.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.991+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc55b820 con 0x55e0cc5573b0 2024-09-10T05:36:33.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.991+0000 7f6d3a7d1640 1 -- 172.21.15.62:0/2797980179 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d300a8070 con 0x55e0cc5573b0 2024-09-10T05:36:33.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.991+0000 7f6d3a7d1640 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc55b820 con 0x7f6d2c06f020 2024-09-10T05:36:33.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.991+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/2797980179 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3400a4d0 con 0x7f6d2c06f020 2024-09-10T05:36:33.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.991+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc55b820 con 0x55e0cc54f710 2024-09-10T05:36:33.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.991+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/2797980179 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3400a4d0 con 0x55e0cc54f710 2024-09-10T05:36:33.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.991+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc55b820 con 0x7f6d2c06f020 2024-09-10T05:36:33.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.995+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/2797980179 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3400a4d0 con 0x7f6d2c06f020 2024-09-10T05:36:33.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.995+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc55b820 con 0x55e0cc5573b0 2024-09-10T05:36:33.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.995+0000 7f6d3a7d1640 1 -- 172.21.15.62:0/2797980179 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d300a8070 con 0x55e0cc5573b0 2024-09-10T05:36:33.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.995+0000 7f6d3a7d1640 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc55b820 con 0x7f6d2c06f020 2024-09-10T05:36:33.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.995+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/2797980179 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3400a4d0 con 0x7f6d2c06f020 2024-09-10T05:36:33.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.995+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc55b820 con 0x55e0cc553b90 2024-09-10T05:36:33.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.995+0000 7f6d3afd2640 1 -- 172.21.15.62:0/2797980179 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d2c03c070 con 0x55e0cc553b90 2024-09-10T05:36:33.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.995+0000 7f6d3afd2640 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc55b820 con 0x55e0cc553b90 2024-09-10T05:36:33.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.995+0000 7f6d3afd2640 1 -- 172.21.15.62:0/2797980179 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d2c03c070 con 0x55e0cc553b90 2024-09-10T05:36:33.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.995+0000 7f6d3afd2640 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc55b820 con 0x55e0cc5573b0 2024-09-10T05:36:33.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.995+0000 7f6d3a7d1640 1 -- 172.21.15.62:0/2797980179 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d300a8070 con 0x55e0cc5573b0 2024-09-10T05:36:33.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.995+0000 7f6d3a7d1640 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc55b820 con 0x55e0cc553b90 2024-09-10T05:36:33.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.995+0000 7f6d3afd2640 1 -- 172.21.15.62:0/2797980179 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6d2c03c070 con 0x55e0cc553b90 2024-09-10T05:36:33.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.995+0000 7f6d3afd2640 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc55b820 con 0x55e0cc553b90 2024-09-10T05:36:33.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.995+0000 7f6d3afd2640 1 -- 172.21.15.62:0/2797980179 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d2c03c070 con 0x55e0cc553b90 2024-09-10T05:36:33.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.995+0000 7f6d3d4cc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:33.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.995+0000 7f6d3d4cc9c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:33.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.995+0000 7f6d3d4cc9c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:33.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.995+0000 7f6d3d4cc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:33.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.995+0000 7f6d3d4cc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:33.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.995+0000 7f6d3d4cc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:33.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.995+0000 7f6d3d4cc9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.995+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc55a910 con 0x55e0cc54f710 2024-09-10T05:36:33.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.995+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/2797980179 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d3400a4d0 con 0x55e0cc54f710 2024-09-10T05:36:33.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.995+0000 7f6d3d4cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:33.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.995+0000 7f6d3d4cc9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.995+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc55ad90 con 0x55e0cc553b90 2024-09-10T05:36:33.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.999+0000 7f6d3afd2640 1 -- 172.21.15.62:0/2797980179 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6d2c03c070 con 0x55e0cc553b90 2024-09-10T05:36:33.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.999+0000 7f6d3d4cc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:33.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.999+0000 7f6d3d4cc9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.999+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc55a4b0 con 0x55e0cc5573b0 2024-09-10T05:36:33.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.999+0000 7f6d3a7d1640 1 -- 172.21.15.62:0/2797980179 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6d300a8070 con 0x55e0cc5573b0 2024-09-10T05:36:33.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.999+0000 7f6d3d4cc9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:33.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.999+0000 7f6d3d4cc9c0 20 zone default found 2024-09-10T05:36:33.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.999+0000 7f6d3d4cc9c0 4 Realm: () 2024-09-10T05:36:33.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.999+0000 7f6d3d4cc9c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:33.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.999+0000 7f6d3d4cc9c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:33.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.999+0000 7f6d3d4cc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:33.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.999+0000 7f6d3d4cc9c0 20 zonegroup default 2024-09-10T05:36:33.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.999+0000 7f6d3d4cc9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.999+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc55c100 con 0x7f6d2c06f020 2024-09-10T05:36:33.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.999+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/2797980179 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6d3400a4d0 con 0x7f6d2c06f020 2024-09-10T05:36:33.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.999+0000 7f6d3d4cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:33.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.999+0000 7f6d3d4cc9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.999+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc55e340 con 0x55e0cc5573b0 2024-09-10T05:36:33.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.999+0000 7f6d3a7d1640 1 -- 172.21.15.62:0/2797980179 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6d300a8070 con 0x55e0cc5573b0 2024-09-10T05:36:33.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.999+0000 7f6d3d4cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:33.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.999+0000 7f6d3d4cc9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.999+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc55e6e0 con 0x55e0cc5573b0 2024-09-10T05:36:33.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.999+0000 7f6d3a7d1640 1 -- 172.21.15.62:0/2797980179 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6d300a8070 con 0x55e0cc5573b0 2024-09-10T05:36:33.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.999+0000 7f6d3d4cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:33.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.999+0000 7f6d3d4cc9c0 20 started sync module instance, tier type = 2024-09-10T05:36:33.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.999+0000 7f6d3d4cc9c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:33.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:32.999+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc55d780 con 0x55e0cc553b90 2024-09-10T05:36:33.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.003+0000 7f6d3afd2640 1 -- 172.21.15.62:0/2797980179 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d2c03c070 con 0x55e0cc553b90 2024-09-10T05:36:33.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.003+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94423989214064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc55df90 con 0x55e0cc553b90 2024-09-10T05:36:33.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.003+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc55f3e0 con 0x55e0cc54f710 2024-09-10T05:36:33.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.003+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/2797980179 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3400a4d0 con 0x55e0cc54f710 2024-09-10T05:36:33.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.003+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94423989221328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc5600a0 con 0x55e0cc54f710 2024-09-10T05:36:33.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.003+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc560a60 con 0x55e0cc553b90 2024-09-10T05:36:33.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.003+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/2797980179 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94423989221328] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3400a4d0 con 0x55e0cc54f710 2024-09-10T05:36:33.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.003+0000 7f6d3afd2640 1 -- 172.21.15.62:0/2797980179 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94423989214064] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d2c03c070 con 0x55e0cc553b90 2024-09-10T05:36:33.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.003+0000 7f6d3afd2640 1 -- 172.21.15.62:0/2797980179 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d2c03c070 con 0x55e0cc553b90 2024-09-10T05:36:33.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.003+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94423989224880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc5600a0 con 0x55e0cc553b90 2024-09-10T05:36:33.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.003+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc5609d0 con 0x7f6d2c06f020 2024-09-10T05:36:33.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.007+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/2797980179 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3400a4d0 con 0x7f6d2c06f020 2024-09-10T05:36:33.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.007+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94423989227088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc5609d0 con 0x7f6d2c06f020 2024-09-10T05:36:33.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.007+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc561da0 con 0x55e0cc553b90 2024-09-10T05:36:33.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.007+0000 7f6d3afd2640 1 -- 172.21.15.62:0/2797980179 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94423989224880] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d2c03c070 con 0x55e0cc553b90 2024-09-10T05:36:33.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.007+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/2797980179 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94423989227088] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3400a4d0 con 0x7f6d2c06f020 2024-09-10T05:36:33.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.007+0000 7f6d3afd2640 1 -- 172.21.15.62:0/2797980179 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d2c03c070 con 0x55e0cc553b90 2024-09-10T05:36:33.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.007+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94423989228144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc561d60 con 0x55e0cc553b90 2024-09-10T05:36:33.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.007+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc562190 con 0x55e0cc5573b0 2024-09-10T05:36:33.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.007+0000 7f6d3a7d1640 1 -- 172.21.15.62:0/2797980179 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d300a8070 con 0x55e0cc5573b0 2024-09-10T05:36:33.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.007+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94423989222384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc562190 con 0x55e0cc5573b0 2024-09-10T05:36:33.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.007+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc563090 con 0x55e0cc5573b0 2024-09-10T05:36:33.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.011+0000 7f6d3afd2640 1 -- 172.21.15.62:0/2797980179 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94423989228144] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d2c03c070 con 0x55e0cc553b90 2024-09-10T05:36:33.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.011+0000 7f6d3a7d1640 1 -- 172.21.15.62:0/2797980179 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(56 notify.6 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d300a8070 con 0x55e0cc5573b0 2024-09-10T05:36:33.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.011+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94423989229712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc563050 con 0x55e0cc5573b0 2024-09-10T05:36:33.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.011+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc563a90 con 0x7f6d2c06f020 2024-09-10T05:36:33.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.011+0000 7f6d3a7d1640 1 -- 172.21.15.62:0/2797980179 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94423989222384] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d300a8070 con 0x55e0cc5573b0 2024-09-10T05:36:33.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.011+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/2797980179 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3400a4d0 con 0x7f6d2c06f020 2024-09-10T05:36:33.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.011+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94423989237088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc563a50 con 0x7f6d2c06f020 2024-09-10T05:36:33.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.011+0000 7f6d3d4cc9c0 20 add_watcher() i=0 2024-09-10T05:36:33.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.011+0000 7f6d3d4cc9c0 20 add_watcher() i=1 2024-09-10T05:36:33.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.011+0000 7f6d3d4cc9c0 20 add_watcher() i=2 2024-09-10T05:36:33.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.011+0000 7f6d3d4cc9c0 20 add_watcher() i=3 2024-09-10T05:36:33.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.011+0000 7f6d3d4cc9c0 20 add_watcher() i=4 2024-09-10T05:36:33.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.011+0000 7f6d3d4cc9c0 20 add_watcher() i=5 2024-09-10T05:36:33.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.011+0000 7f6d3a7d1640 1 -- 172.21.15.62:0/2797980179 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94423989229712] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d300a8070 con 0x55e0cc5573b0 2024-09-10T05:36:33.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.011+0000 7f6d3d4cc9c0 20 add_watcher() i=6 2024-09-10T05:36:33.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.011+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/2797980179 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94423989237088] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3400a4d0 con 0x7f6d2c06f020 2024-09-10T05:36:33.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.011+0000 7f6d3d4cc9c0 20 add_watcher() i=7 2024-09-10T05:36:33.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.011+0000 7f6d3d4cc9c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:33.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.011+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc562ba0 con 0x55e0cc54f710 2024-09-10T05:36:33.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.011+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/2797980179 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6d3400a4d0 con 0x55e0cc54f710 2024-09-10T05:36:33.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.011+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94423989234592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc563f50 con 0x55e0cc54f710 2024-09-10T05:36:33.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.015+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/2797980179 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94423989234592] v30'78 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6d3400a4d0 con 0x55e0cc54f710 2024-09-10T05:36:33.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.015+0000 7f6bf17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:33.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.015+0000 7f6d3d4cc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:33.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.015+0000 7f6d3d4cc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:33.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.015+0000 7f6d3d4cc9c0 5 note: GC not initialized 2024-09-10T05:36:33.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.015+0000 7f6b6bfff640 20 reqs_thread_entry: start 2024-09-10T05:36:33.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.015+0000 7f6d3d4cc9c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:33.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.015+0000 7f6d3d4cc9c0 20 Filter name: none 2024-09-10T05:36:33.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.015+0000 7f6b69ffb640 20 reqs_thread_entry: start 2024-09-10T05:36:33.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.015+0000 7f6d3d4cc9c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T05:36:33.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.015+0000 7f6d3d4cc9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.015+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc589ca0 con 0x55e0cc54f710 2024-09-10T05:36:33.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.015+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/2797980179 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f6d3400a4d0 con 0x55e0cc54f710 2024-09-10T05:36:33.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.015+0000 7f6d3d4cc9c0 20 rados_obj.operate() r=0 bl.length=556 2024-09-10T05:36:33.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.015+0000 7f6d3d4cc9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T05:36:33.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.015+0000 7f6d3d4cc9c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:36:33.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.015+0000 7f6d3d4cc9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:36:33.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.015+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc590350 con 0x55e0cc54f710 2024-09-10T05:36:33.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.019+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/2797980179 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v30'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f6d3400a4d0 con 0x55e0cc54f710 2024-09-10T05:36:33.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.019+0000 7f6d3d4cc9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:36:33.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.019+0000 7f6d3d4cc9c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:36:33.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.019+0000 7f6d3d4cc9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T05:36:33.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.019+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94423989419520 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc58bac0 con 0x55e0cc553b90 2024-09-10T05:36:33.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.019+0000 7f6d3afd2640 1 -- 172.21.15.62:0/2797980179 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== watch-notify(notify (1) cookie 94423989228144 notify 128849018889 ret 0) ==== 774+0+0 (crc 0 0 0) 0x55e0cc531f40 con 0x55e0cc553b90 2024-09-10T05:36:33.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.019+0000 7f6c1e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018889 cookie 94423989228144 notifier 4367 bl.length()=732 2024-09-10T05:36:33.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.019+0000 7f6d3afd2640 1 -- 172.21.15.62:0/2797980179 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(64 notify.4 [notify cookie 94423989419520 out=8b] v0'0 uv57 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6d2c03c070 con 0x55e0cc553b90 2024-09-10T05:36:33.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.019+0000 7f6c1e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:36:33.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.019+0000 7f6c1e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:36:33.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.019+0000 7f6c1e7fc640 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f6c00003eb0 con 0x55e0cc553b90 2024-09-10T05:36:33.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.019+0000 7f6d3afd2640 1 -- 172.21.15.62:0/2797980179 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d2c03c070 con 0x55e0cc553b90 2024-09-10T05:36:33.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.019+0000 7f6d3afd2640 1 -- 172.21.15.62:0/2797980179 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== watch-notify(notify_complete (2) cookie 94423989419520 notify 128849018889 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e0cc5316e0 con 0x55e0cc553b90 2024-09-10T05:36:33.023 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T05:36:30.893777Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:36:30.893760Z","tags":[],"group_ids":[]} 2024-09-10T05:36:33.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.019+0000 7f6bf17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:33.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.019+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94423989234592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc58b610 con 0x55e0cc54f710 2024-09-10T05:36:33.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.023+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/2797980179 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94423989234592] v30'79 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6d3400a4d0 con 0x55e0cc54f710 2024-09-10T05:36:33.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.023+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94423989214064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc58bac0 con 0x55e0cc553b90 2024-09-10T05:36:33.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.023+0000 7f6d3afd2640 1 -- 172.21.15.62:0/2797980179 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94423989214064] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d2c03c070 con 0x55e0cc553b90 2024-09-10T05:36:33.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.023+0000 7f6d3d4cc9c0 20 remove_watcher() i=0 2024-09-10T05:36:33.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.023+0000 7f6d3d4cc9c0 2 removed watcher, disabling cache 2024-09-10T05:36:33.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.023+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94423989221328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc58bac0 con 0x55e0cc54f710 2024-09-10T05:36:33.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.027+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/2797980179 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94423989221328] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3400a4d0 con 0x55e0cc54f710 2024-09-10T05:36:33.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.027+0000 7f6d3d4cc9c0 20 remove_watcher() i=1 2024-09-10T05:36:33.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.027+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94423989224880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc58bac0 con 0x55e0cc553b90 2024-09-10T05:36:33.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.027+0000 7f6d3afd2640 1 -- 172.21.15.62:0/2797980179 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94423989224880] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d2c03c070 con 0x55e0cc553b90 2024-09-10T05:36:33.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.027+0000 7f6d3d4cc9c0 20 remove_watcher() i=2 2024-09-10T05:36:33.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.027+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94423989227088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc58bac0 con 0x7f6d2c06f020 2024-09-10T05:36:33.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.027+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/2797980179 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94423989227088] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3400a4d0 con 0x7f6d2c06f020 2024-09-10T05:36:33.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.027+0000 7f6d3d4cc9c0 20 remove_watcher() i=3 2024-09-10T05:36:33.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.027+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94423989228144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc58bac0 con 0x55e0cc553b90 2024-09-10T05:36:33.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.031+0000 7f6d3afd2640 1 -- 172.21.15.62:0/2797980179 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94423989228144] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d2c03c070 con 0x55e0cc553b90 2024-09-10T05:36:33.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.031+0000 7f6d3d4cc9c0 20 remove_watcher() i=4 2024-09-10T05:36:33.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.031+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94423989222384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc55db70 con 0x55e0cc5573b0 2024-09-10T05:36:33.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.031+0000 7f6d3a7d1640 1 -- 172.21.15.62:0/2797980179 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94423989222384] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d300a8070 con 0x55e0cc5573b0 2024-09-10T05:36:33.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.031+0000 7f6d3d4cc9c0 20 remove_watcher() i=5 2024-09-10T05:36:33.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.031+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94423989229712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc5612d0 con 0x55e0cc5573b0 2024-09-10T05:36:33.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.031+0000 7f6d3a7d1640 1 -- 172.21.15.62:0/2797980179 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94423989229712] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d300a8070 con 0x55e0cc5573b0 2024-09-10T05:36:33.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.031+0000 7f6d3d4cc9c0 20 remove_watcher() i=6 2024-09-10T05:36:33.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.031+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94423989237088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e0cc55fc80 con 0x7f6d2c06f020 2024-09-10T05:36:33.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.035+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/2797980179 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94423989237088] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3400a4d0 con 0x7f6d2c06f020 2024-09-10T05:36:33.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.035+0000 7f6d3d4cc9c0 20 remove_watcher() i=7 2024-09-10T05:36:33.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.035+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e0cc553b90 msgr2=0x55e0cc555f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.035+0000 7f6d3d4cc9c0 1 --2- 172.21.15.62:0/2797980179 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e0cc553b90 0x55e0cc555f80 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.035+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55e0cc54f710 msgr2=0x55e0cc551ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.035+0000 7f6d3d4cc9c0 1 --2- 172.21.15.62:0/2797980179 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55e0cc54f710 0x55e0cc551ba0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.035+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f6d2c06f020 msgr2=0x7f6d2c038340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.035+0000 7f6d3d4cc9c0 1 --2- 172.21.15.62:0/2797980179 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f6d2c06f020 0x7f6d2c038340 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.035+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55e0cc5573b0 msgr2=0x55e0cc5597c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.035+0000 7f6d3d4cc9c0 1 --2- 172.21.15.62:0/2797980179 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55e0cc5573b0 0x55e0cc5597c0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.035+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6c04039a70 msgr2=0x7f6c0403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.035+0000 7f6d3d4cc9c0 1 --2- 172.21.15.62:0/2797980179 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6c04039a70 0x7f6c0403bf30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6d300aa650 tx=0x7f6d300a8000 comp rx=0 tx=0).stop 2024-09-10T05:36:33.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.035+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0cc53e410 msgr2=0x55e0cc5447c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.035+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/2797980179 reap_dead start 2024-09-10T05:36:33.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.035+0000 7f6d3d4cc9c0 1 --2- 172.21.15.62:0/2797980179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0cc53e410 0x55e0cc5447c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c01ffd0 tx=0x7f6d2c01fe80 comp rx=0 tx=0).stop 2024-09-10T05:36:33.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.035+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 shutdown_connections 2024-09-10T05:36:33.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.035+0000 7f6d3d4cc9c0 1 --2- 172.21.15.62:0/2797980179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0cc53e410 0x55e0cc5447c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.035+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 >> 172.21.15.62:0/2797980179 conn(0x55e0cc539830 msgr2=0x55e0cc537a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:33.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.035+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 shutdown_connections 2024-09-10T05:36:33.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.035+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/2797980179 wait complete. 2024-09-10T05:36:33.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.035+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/3701990085 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6c14039ac0 msgr2=0x7f6c1403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.035+0000 7f6d3d4cc9c0 1 --2- 172.21.15.62:0/3701990085 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6c14039ac0 0x7f6c1403bf80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6d30000c10 tx=0x7f6d30005a10 comp rx=0 tx=0).stop 2024-09-10T05:36:33.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.035+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/3701990085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0cc530c80 msgr2=0x55e0cc5310a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.035+0000 7f6d3d4cc9c0 1 --2- 172.21.15.62:0/3701990085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0cc530c80 0x55e0cc5310a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c03e010 tx=0x7f6d2c01aec0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.035+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/3701990085 shutdown_connections 2024-09-10T05:36:33.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.035+0000 7f6d3d4cc9c0 1 --2- 172.21.15.62:0/3701990085 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6c14039ac0 0x7f6c1403bf80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.035+0000 7f6d3d4cc9c0 1 --2- 172.21.15.62:0/3701990085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0cc530c80 0x55e0cc5310a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.035+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/3701990085 >> 172.21.15.62:0/3701990085 conn(0x55e0cc526630 msgr2=0x55e0cc526a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:33.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.035+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/3701990085 shutdown_connections 2024-09-10T05:36:33.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.035+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/3701990085 wait complete. 2024-09-10T05:36:33.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.035+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/812940201 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e0cc51b1a0 msgr2=0x55e0cc51d660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.035+0000 7f6d3d4cc9c0 1 --2- 172.21.15.62:0/812940201 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e0cc51b1a0 0x55e0cc51d660 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.035+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/812940201 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55e0cc4242d0 msgr2=0x55e0cc51a160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.035+0000 7f6d3d4cc9c0 1 --2- 172.21.15.62:0/812940201 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55e0cc4242d0 0x55e0cc51a160 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.035+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/812940201 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55e0cc51fb90 msgr2=0x55e0cc521f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.035+0000 7f6d3d4cc9c0 1 --2- 172.21.15.62:0/812940201 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55e0cc51fb90 0x55e0cc521f80 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.035+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/812940201 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6c20039a70 msgr2=0x7f6c2003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.035+0000 7f6d3d4cc9c0 1 --2- 172.21.15.62:0/812940201 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6c20039a70 0x7f6c2003bf30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6d300ae000 tx=0x7f6d300a6000 comp rx=0 tx=0).stop 2024-09-10T05:36:33.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.035+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/812940201 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0cc420180 msgr2=0x55e0cc512ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.035+0000 7f6d3d4cc9c0 1 --2- 172.21.15.62:0/812940201 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0cc420180 0x55e0cc512ff0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x55e0cc50c8d0 tx=0x7f6d2c000bd0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.035+0000 7f6d3b7d3640 1 -- 172.21.15.62:0/812940201 reap_dead start 2024-09-10T05:36:33.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.035+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/812940201 shutdown_connections 2024-09-10T05:36:33.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.035+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/812940201 >> 172.21.15.62:0/812940201 conn(0x55e0cc393a90 msgr2=0x55e0cc506010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:33.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.035+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/812940201 shutdown_connections 2024-09-10T05:36:33.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.035+0000 7f6d3d4cc9c0 1 -- 172.21.15.62:0/812940201 wait complete. 2024-09-10T05:36:33.047 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T05:36:30.893777Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:36:30.893760Z', 'tags': [], 'group_ids': []} 2024-09-10T05:36:33.047 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-10T05:36:33.047 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-10T05:36:33.047 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-10T05:36:33.121 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:33.122 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:33.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.119+0000 7fab3f7ef9c0 1 Processor -- start 2024-09-10T05:36:33.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.119+0000 7fab3f7ef9c0 1 -- start start 2024-09-10T05:36:33.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.119+0000 7fab3f7ef9c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x56482cb34310 0x56482cb36700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.119+0000 7fab3f7ef9c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56482c9e49c0 con 0x56482caa4240 2024-09-10T05:36:33.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.119+0000 7fab3f7ef9c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x56482ca346d0 con 0x56482cb34310 2024-09-10T05:36:33.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.119+0000 7fab3caf4640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x56482cb34310 0x56482cb36700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.119+0000 7fab3d2f5640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x56482caa4240 0x56482cb32bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:38596/0 (socket says 172.21.15.62:38596) 2024-09-10T05:36:33.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.119+0000 7fab3d2f5640 1 -- 172.21.15.62:0/1841487176 learned_addr learned my addr 172.21.15.62:0/1841487176 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-10T05:36:33.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.119+0000 7fab3caf4640 1 -- 172.21.15.62:0/1841487176 >> v1:172.21.15.2:6789/0 conn(0x56482caa4240 legacy=0x56482cb32bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.119+0000 7fab3caf4640 1 -- 172.21.15.62:0/1841487176 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56482c9d8ca0 con 0x56482cb34310 2024-09-10T05:36:33.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.123+0000 7fab3caf4640 1 --2- 172.21.15.62:0/1841487176 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56482cb34310 0x56482cb36700 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fab3400a480 tx=0x7fab3401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bde2b946e85bb37d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.123+0000 7fab2ffff640 1 -- 172.21.15.62:0/1841487176 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab340af070 con 0x56482cb34310 2024-09-10T05:36:33.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.123+0000 7fab2ffff640 1 -- 172.21.15.62:0/1841487176 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab340aa530 con 0x56482cb34310 2024-09-10T05:36:33.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.123+0000 7fab2ffff640 1 -- 172.21.15.62:0/1841487176 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab340aa830 con 0x56482cb34310 2024-09-10T05:36:33.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.123+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/1841487176 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56482cb34310 msgr2=0x56482cb36700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.123+0000 7fab3f7ef9c0 1 --2- 172.21.15.62:0/1841487176 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56482cb34310 0x56482cb36700 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fab3400a480 tx=0x7fab3401b280 comp rx=0 tx=0).stop 2024-09-10T05:36:33.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.123+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/1841487176 shutdown_connections 2024-09-10T05:36:33.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.123+0000 7fab3f7ef9c0 1 --2- 172.21.15.62:0/1841487176 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56482cb34310 0x56482cb36700 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.123+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/1841487176 >> 172.21.15.62:0/1841487176 conn(0x56482cb2a920 msgr2=0x56482cb2cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:33.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.123+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/1841487176 shutdown_connections 2024-09-10T05:36:33.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.123+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/1841487176 wait complete. 2024-09-10T05:36:33.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.135+0000 7fab3f7ef9c0 1 Processor -- start 2024-09-10T05:36:33.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.135+0000 7fab3f7ef9c0 1 -- start start 2024-09-10T05:36:33.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.135+0000 7fab3f7ef9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56482caa4240 0x56482cb30150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.135+0000 7fab3f7ef9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56482ca38680 con 0x56482caa4240 2024-09-10T05:36:33.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.135+0000 7fab3d2f5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56482caa4240 0x56482cb30150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.135+0000 7fab3d2f5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56482caa4240 0x56482cb30150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51866/0 (socket says 172.21.15.62:51866) 2024-09-10T05:36:33.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.135+0000 7fab3d2f5640 1 -- 172.21.15.62:0/2970933335 learned_addr learned my addr 172.21.15.62:0/2970933335 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:33.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.139+0000 7fab3d2f5640 1 -- 172.21.15.62:0/2970933335 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56482c9b3da0 con 0x56482caa4240 2024-09-10T05:36:33.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.139+0000 7fab3d2f5640 1 --2- 172.21.15.62:0/2970933335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56482caa4240 0x56482cb30150 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fab38001810 tx=0x7fab38001cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d1eeba0fd844188 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.139+0000 7faa2b606640 1 -- 172.21.15.62:0/2970933335 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab38004530 con 0x56482caa4240 2024-09-10T05:36:33.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.139+0000 7faa2b606640 1 -- 172.21.15.62:0/2970933335 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab380046d0 con 0x56482caa4240 2024-09-10T05:36:33.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.139+0000 7faa2b606640 1 -- 172.21.15.62:0/2970933335 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab380049f0 con 0x56482caa4240 2024-09-10T05:36:33.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.139+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2970933335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56482caa4240 msgr2=0x56482cb30150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.139+0000 7fab3f7ef9c0 1 --2- 172.21.15.62:0/2970933335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56482caa4240 0x56482cb30150 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fab38001810 tx=0x7fab38001cd0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.139+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2970933335 shutdown_connections 2024-09-10T05:36:33.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.139+0000 7fab3f7ef9c0 1 --2- 172.21.15.62:0/2970933335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56482caa4240 0x56482cb30150 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.139+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2970933335 >> 172.21.15.62:0/2970933335 conn(0x56482cb2a920 msgr2=0x56482cc17440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:33.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.139+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2970933335 shutdown_connections 2024-09-10T05:36:33.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.139+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2970933335 wait complete. 2024-09-10T05:36:33.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.139+0000 7fab3f7ef9c0 1 Processor -- start 2024-09-10T05:36:33.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.139+0000 7fab3f7ef9c0 1 -- start start 2024-09-10T05:36:33.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.139+0000 7fab3f7ef9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56482caa4240 0x56482cc250b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.139+0000 7fab3f7ef9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56482c9daa50 con 0x56482caa4240 2024-09-10T05:36:33.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.139+0000 7fab3d2f5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56482caa4240 0x56482cc250b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.139+0000 7fab3d2f5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56482caa4240 0x56482cc250b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51878/0 (socket says 172.21.15.62:51878) 2024-09-10T05:36:33.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.139+0000 7fab3d2f5640 1 -- 172.21.15.62:0/1209533798 learned_addr learned my addr 172.21.15.62:0/1209533798 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:33.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.139+0000 7fab3d2f5640 1 -- 172.21.15.62:0/1209533798 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56482cc25610 con 0x56482caa4240 2024-09-10T05:36:33.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.139+0000 7fab3d2f5640 1 --2- 172.21.15.62:0/1209533798 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56482caa4240 0x56482cc250b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fab38000f90 tx=0x7fab38001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.139+0000 7faa29e03640 1 -- 172.21.15.62:0/1209533798 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab38013820 con 0x56482caa4240 2024-09-10T05:36:33.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.139+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/1209533798 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56482cc258a0 con 0x56482caa4240 2024-09-10T05:36:33.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.139+0000 7faa29e03640 1 -- 172.21.15.62:0/1209533798 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab380139c0 con 0x56482caa4240 2024-09-10T05:36:33.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.139+0000 7faa29e03640 1 -- 172.21.15.62:0/1209533798 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab38013ce0 con 0x56482caa4240 2024-09-10T05:36:33.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.139+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/1209533798 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56482cc26250 con 0x56482caa4240 2024-09-10T05:36:33.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.143+0000 7faa29e03640 1 -- 172.21.15.62:0/1209533798 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fab38010070 con 0x56482caa4240 2024-09-10T05:36:33.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.143+0000 7faa29e03640 1 --2- 172.21.15.62:0/1209533798 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7faa24039a70 0x7faa2403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.143+0000 7faa29e03640 1 -- 172.21.15.62:0/1209533798 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fab38018070 con 0x56482caa4240 2024-09-10T05:36:33.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.143+0000 7fab3caf4640 1 --2- 172.21.15.62:0/1209533798 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7faa24039a70 0x7faa2403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.143+0000 7fab3f7ef9c0 1 --2- 172.21.15.62:0/1209533798 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56482cb34310 0x56482cc2c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.143+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/1209533798 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56482cc2c760 con 0x56482cb34310 2024-09-10T05:36:33.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.143+0000 7fab3daf6640 1 --2- 172.21.15.62:0/1209533798 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56482cb34310 0x56482cc2c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.143+0000 7fab3caf4640 1 --2- 172.21.15.62:0/1209533798 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7faa24039a70 0x7faa2403bf30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fab340ac000 tx=0x7fab340a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.143+0000 7fab3daf6640 1 --2- 172.21.15.62:0/1209533798 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56482cb34310 0x56482cc2c220 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.143+0000 7fab3daf6640 1 -- 172.21.15.62:0/1209533798 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab300083f0 con 0x56482cb34310 2024-09-10T05:36:33.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.143+0000 7fab3f7ef9c0 1 --2- 172.21.15.62:0/1209533798 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x56482cc2d4c0 0x56482cc2f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.143+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/1209533798 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56482cc2fee0 con 0x56482cc2d4c0 2024-09-10T05:36:33.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.143+0000 7fab3d2f5640 1 --2- 172.21.15.62:0/1209533798 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x56482cc2d4c0 0x56482cc2f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.143+0000 7fab3d2f5640 1 --2- 172.21.15.62:0/1209533798 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x56482cc2d4c0 0x56482cc2f8b0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.143+0000 7fab3d2f5640 1 -- 172.21.15.62:0/1209533798 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fab3801b030 con 0x56482cc2d4c0 2024-09-10T05:36:33.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.143+0000 7fab3f7ef9c0 1 --2- 172.21.15.62:0/1209533798 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56482cc31ca0 0x56482cc34090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.143+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/1209533798 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56482cc34780 con 0x56482cc31ca0 2024-09-10T05:36:33.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.143+0000 7fab3caf4640 1 --2- 172.21.15.62:0/1209533798 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56482cc31ca0 0x56482cc34090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.143+0000 7fab3caf4640 1 --2- 172.21.15.62:0/1209533798 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56482cc31ca0 0x56482cc34090 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.147+0000 7fab3caf4640 1 -- 172.21.15.62:0/1209533798 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fab340a8070 con 0x56482cc31ca0 2024-09-10T05:36:33.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.147+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/1209533798 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56482cc30b40 con 0x56482cc2d4c0 2024-09-10T05:36:33.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.147+0000 7fab3d2f5640 1 -- 172.21.15.62:0/1209533798 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fab3801b030 con 0x56482cc2d4c0 2024-09-10T05:36:33.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.147+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/1209533798 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56482cc30fa0 con 0x56482cc31ca0 2024-09-10T05:36:33.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.147+0000 7fab3caf4640 1 -- 172.21.15.62:0/1209533798 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fab340a8070 con 0x56482cc31ca0 2024-09-10T05:36:33.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.147+0000 7fab3f7ef9c0 1 Processor -- start 2024-09-10T05:36:33.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.147+0000 7fab3f7ef9c0 1 -- start start 2024-09-10T05:36:33.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.147+0000 7fab3f7ef9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56482cc42d60 0x56482cc43180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.147+0000 7fab3f7ef9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56482ca45450 con 0x56482cc42d60 2024-09-10T05:36:33.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.147+0000 7fab3d2f5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56482cc42d60 0x56482cc43180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.147+0000 7fab3d2f5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56482cc42d60 0x56482cc43180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51892/0 (socket says 172.21.15.62:51892) 2024-09-10T05:36:33.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.147+0000 7fab3d2f5640 1 -- 172.21.15.62:0/1786521064 learned_addr learned my addr 172.21.15.62:0/1786521064 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:33.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.147+0000 7fab3d2f5640 1 -- 172.21.15.62:0/1786521064 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56482cc437c0 con 0x56482cc42d60 2024-09-10T05:36:33.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.147+0000 7fab3d2f5640 1 --2- 172.21.15.62:0/1786521064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56482cc42d60 0x56482cc43180 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fab38004be0 tx=0x7fab3804ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.147+0000 7faa22ffd640 1 -- 172.21.15.62:0/1786521064 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab38046020 con 0x56482cc42d60 2024-09-10T05:36:33.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.147+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/1786521064 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56482cc44020 con 0x56482cc42d60 2024-09-10T05:36:33.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.147+0000 7faa22ffd640 1 -- 172.21.15.62:0/1786521064 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab38012ad0 con 0x56482cc42d60 2024-09-10T05:36:33.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.147+0000 7faa22ffd640 1 -- 172.21.15.62:0/1786521064 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab38012db0 con 0x56482cc42d60 2024-09-10T05:36:33.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.147+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/1786521064 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56482cc44020 con 0x56482cc42d60 2024-09-10T05:36:33.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.151+0000 7faa22ffd640 1 -- 172.21.15.62:0/1786521064 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fab38049020 con 0x56482cc42d60 2024-09-10T05:36:33.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.151+0000 7faa22ffd640 1 --2- 172.21.15.62:0/1786521064 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7faa14039a70 0x7faa1403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.151+0000 7faa22ffd640 1 -- 172.21.15.62:0/1786521064 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fab38051cf0 con 0x56482cc42d60 2024-09-10T05:36:33.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.151+0000 7fab3caf4640 1 --2- 172.21.15.62:0/1786521064 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7faa14039a70 0x7faa1403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.151+0000 7fab3f7ef9c0 1 Processor -- start 2024-09-10T05:36:33.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.151+0000 7fab3f7ef9c0 1 -- start start 2024-09-10T05:36:33.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.151+0000 7fab3caf4640 1 --2- 172.21.15.62:0/1786521064 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7faa14039a70 0x7faa1403bf30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x56482cc265f0 tx=0x7fab34005a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.151+0000 7fab3f7ef9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56482cc4f2c0 0x56482cc4f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.151+0000 7fab3f7ef9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56482cb309a0 con 0x56482cc4f2c0 2024-09-10T05:36:33.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.151+0000 7fab3d2f5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56482cc4f2c0 0x56482cc4f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.151+0000 7fab3d2f5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56482cc4f2c0 0x56482cc4f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51908/0 (socket says 172.21.15.62:51908) 2024-09-10T05:36:33.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.151+0000 7fab3d2f5640 1 -- 172.21.15.62:0/1799277215 learned_addr learned my addr 172.21.15.62:0/1799277215 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:33.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.151+0000 7fab3d2f5640 1 -- 172.21.15.62:0/1799277215 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56482cc4fc70 con 0x56482cc4f2c0 2024-09-10T05:36:33.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.151+0000 7fab3d2f5640 1 --2- 172.21.15.62:0/1799277215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56482cc4f2c0 0x56482cc4f6a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fab3801dfd0 tx=0x7fab380268d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4d552efef1fdef server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.151+0000 7faa20ff9640 1 -- 172.21.15.62:0/1799277215 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab38060020 con 0x56482cc4f2c0 2024-09-10T05:36:33.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.151+0000 7faa20ff9640 1 -- 172.21.15.62:0/1799277215 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab380288a0 con 0x56482cc4f2c0 2024-09-10T05:36:33.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.151+0000 7faa20ff9640 1 -- 172.21.15.62:0/1799277215 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab38026bf0 con 0x56482cc4f2c0 2024-09-10T05:36:33.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.151+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/1799277215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56482cc4f2c0 msgr2=0x56482cc4f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.151+0000 7fab3f7ef9c0 1 --2- 172.21.15.62:0/1799277215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56482cc4f2c0 0x56482cc4f6a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fab3801dfd0 tx=0x7fab380268d0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.151+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/1799277215 shutdown_connections 2024-09-10T05:36:33.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.151+0000 7fab3f7ef9c0 1 --2- 172.21.15.62:0/1799277215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56482cc4f2c0 0x56482cc4f6a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.151+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/1799277215 >> 172.21.15.62:0/1799277215 conn(0x56482cc4b6f0 msgr2=0x56482cc49930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:33.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.151+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/1799277215 shutdown_connections 2024-09-10T05:36:33.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.151+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/1799277215 wait complete. 2024-09-10T05:36:33.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.151+0000 7fab3f7ef9c0 1 Processor -- start 2024-09-10T05:36:33.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.151+0000 7fab3f7ef9c0 1 -- start start 2024-09-10T05:36:33.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.151+0000 7fab3f7ef9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56482cc4f2c0 0x56482cc56640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.151+0000 7fab3f7ef9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56482cc50150 con 0x56482cc4f2c0 2024-09-10T05:36:33.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.155+0000 7fab3d2f5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56482cc4f2c0 0x56482cc56640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.155+0000 7fab3d2f5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56482cc4f2c0 0x56482cc56640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51914/0 (socket says 172.21.15.62:51914) 2024-09-10T05:36:33.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.155+0000 7fab3d2f5640 1 -- 172.21.15.62:0/2038080552 learned_addr learned my addr 172.21.15.62:0/2038080552 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:33.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.155+0000 7fab3d2f5640 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56482cc56ba0 con 0x56482cc4f2c0 2024-09-10T05:36:33.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.155+0000 7fab3d2f5640 1 --2- 172.21.15.62:0/2038080552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56482cc4f2c0 0x56482cc56640 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fab3801e700 tx=0x7fab3803ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.155+0000 7faa12ffd640 1 -- 172.21.15.62:0/2038080552 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab38028a90 con 0x56482cc4f2c0 2024-09-10T05:36:33.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.155+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56482cc56ba0 con 0x56482cc4f2c0 2024-09-10T05:36:33.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.155+0000 7faa12ffd640 1 -- 172.21.15.62:0/2038080552 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab380288a0 con 0x56482cc4f2c0 2024-09-10T05:36:33.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.155+0000 7faa12ffd640 1 -- 172.21.15.62:0/2038080552 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab38026320 con 0x56482cc4f2c0 2024-09-10T05:36:33.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.155+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56482cc57170 con 0x56482cc4f2c0 2024-09-10T05:36:33.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.155+0000 7fab3f7ef9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.155+0000 7faa12ffd640 1 -- 172.21.15.62:0/2038080552 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fab38063020 con 0x56482cc4f2c0 2024-09-10T05:36:33.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.155+0000 7faa12ffd640 1 --2- 172.21.15.62:0/2038080552 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7faa08039a70 0x7faa0803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.155+0000 7faa12ffd640 1 -- 172.21.15.62:0/2038080552 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fab38072af0 con 0x56482cc4f2c0 2024-09-10T05:36:33.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.155+0000 7fab3caf4640 1 --2- 172.21.15.62:0/2038080552 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7faa08039a70 0x7faa0803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.155+0000 7fab3f7ef9c0 1 --2- 172.21.15.62:0/2038080552 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56482cc61560 0x56482cc639f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.155+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56482cc64140 con 0x56482cc61560 2024-09-10T05:36:33.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.155+0000 7fab3daf6640 1 --2- 172.21.15.62:0/2038080552 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56482cc61560 0x56482cc639f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.155+0000 7fab3caf4640 1 --2- 172.21.15.62:0/2038080552 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7faa08039a70 0x7faa0803bf30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x56482cc265c0 tx=0x7fab340a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.155+0000 7fab3daf6640 1 --2- 172.21.15.62:0/2038080552 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56482cc61560 0x56482cc639f0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.155+0000 7fab3daf6640 1 -- 172.21.15.62:0/2038080552 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab300083f0 con 0x56482cc61560 2024-09-10T05:36:33.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.155+0000 7fab3f7ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:33.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.155+0000 7fab3f7ef9c0 20 realm 2024-09-10T05:36:33.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.155+0000 7fab3f7ef9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.155+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56482cc60950 con 0x56482cc61560 2024-09-10T05:36:33.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.155+0000 7fab3daf6640 1 -- 172.21.15.62:0/2038080552 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab300083f0 con 0x56482cc61560 2024-09-10T05:36:33.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.155+0000 7fab3f7ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:33.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.155+0000 7fab3f7ef9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:33.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.155+0000 7fab3f7ef9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.155+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56482cc64c00 con 0x56482cc61560 2024-09-10T05:36:33.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.159+0000 7fab3daf6640 1 -- 172.21.15.62:0/2038080552 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab300083f0 con 0x56482cc61560 2024-09-10T05:36:33.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.159+0000 7fab3f7ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:33.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.159+0000 7fab3f7ef9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.159+0000 7fab3f7ef9c0 1 --2- 172.21.15.62:0/2038080552 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x56482cc659e0 0x56482cc67dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.159+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56482cc68460 con 0x56482cc659e0 2024-09-10T05:36:33.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.159+0000 7fab3d2f5640 1 --2- 172.21.15.62:0/2038080552 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x56482cc659e0 0x56482cc67dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.159+0000 7fab3d2f5640 1 --2- 172.21.15.62:0/2038080552 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x56482cc659e0 0x56482cc67dd0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.159+0000 7fab3d2f5640 1 -- 172.21.15.62:0/2038080552 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fab38077020 con 0x56482cc659e0 2024-09-10T05:36:33.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.159+0000 7fab3f7ef9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:33.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.159+0000 7fab3f7ef9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.159+0000 7fab3f7ef9c0 1 --2- 172.21.15.62:0/2038080552 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56482cc69210 0x56482cc6b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.159+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56482cc6bc60 con 0x56482cc69210 2024-09-10T05:36:33.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.159+0000 7fab3caf4640 1 --2- 172.21.15.62:0/2038080552 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56482cc69210 0x56482cc6b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.159+0000 7fab3caf4640 1 --2- 172.21.15.62:0/2038080552 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56482cc69210 0x56482cc6b600 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.159+0000 7fab3caf4640 1 -- 172.21.15.62:0/2038080552 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fab340a8070 con 0x56482cc69210 2024-09-10T05:36:33.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.159+0000 7fab3f7ef9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:33.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.159+0000 7fab3f7ef9c0 20 searching for the correct realm 2024-09-10T05:36:33.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.159+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56482cc6d560 con 0x56482cc69210 2024-09-10T05:36:33.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.159+0000 7fab3caf4640 1 -- 172.21.15.62:0/2038080552 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab340a8070 con 0x56482cc69210 2024-09-10T05:36:33.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.159+0000 7fab3caf4640 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56482cc6d560 con 0x56482cc659e0 2024-09-10T05:36:33.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.159+0000 7fab3d2f5640 1 -- 172.21.15.62:0/2038080552 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab38077020 con 0x56482cc659e0 2024-09-10T05:36:33.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.159+0000 7fab3d2f5640 1 --2- 172.21.15.62:0/2038080552 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fab38065030 0x7fab38053160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.159+0000 7fab3d2f5640 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56482cc6d560 con 0x7fab38065030 2024-09-10T05:36:33.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.159+0000 7fab3daf6640 1 --2- 172.21.15.62:0/2038080552 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fab38065030 0x7fab38053160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.159+0000 7fab3daf6640 1 --2- 172.21.15.62:0/2038080552 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fab38065030 0x7fab38053160 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.163+0000 7fab3daf6640 1 -- 172.21.15.62:0/2038080552 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab300083f0 con 0x7fab38065030 2024-09-10T05:36:33.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.163+0000 7fab3daf6640 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56482cc6d560 con 0x56482cc61560 2024-09-10T05:36:33.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.163+0000 7fab3daf6640 1 -- 172.21.15.62:0/2038080552 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab300083f0 con 0x56482cc61560 2024-09-10T05:36:33.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.163+0000 7fab3daf6640 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56482cc6d560 con 0x56482cc61560 2024-09-10T05:36:33.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.163+0000 7fab3daf6640 1 -- 172.21.15.62:0/2038080552 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab300083f0 con 0x56482cc61560 2024-09-10T05:36:33.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.163+0000 7fab3daf6640 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56482cc6d560 con 0x56482cc69210 2024-09-10T05:36:33.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.163+0000 7fab3caf4640 1 -- 172.21.15.62:0/2038080552 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab340a8070 con 0x56482cc69210 2024-09-10T05:36:33.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.163+0000 7fab3caf4640 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56482cc6d560 con 0x56482cc61560 2024-09-10T05:36:33.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.163+0000 7fab3daf6640 1 -- 172.21.15.62:0/2038080552 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab300083f0 con 0x56482cc61560 2024-09-10T05:36:33.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.163+0000 7fab3daf6640 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56482cc6d560 con 0x56482cc659e0 2024-09-10T05:36:33.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.163+0000 7fab3d2f5640 1 -- 172.21.15.62:0/2038080552 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab38077020 con 0x56482cc659e0 2024-09-10T05:36:33.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.163+0000 7fab3d2f5640 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56482cc6d560 con 0x56482cc659e0 2024-09-10T05:36:33.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.163+0000 7fab3d2f5640 1 -- 172.21.15.62:0/2038080552 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab38077020 con 0x56482cc659e0 2024-09-10T05:36:33.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.163+0000 7fab3d2f5640 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56482cc6d560 con 0x56482cc61560 2024-09-10T05:36:33.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.163+0000 7fab3daf6640 1 -- 172.21.15.62:0/2038080552 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab300083f0 con 0x56482cc61560 2024-09-10T05:36:33.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.163+0000 7fab3daf6640 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56482cc6d560 con 0x7fab38065030 2024-09-10T05:36:33.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.163+0000 7fab3daf6640 1 -- 172.21.15.62:0/2038080552 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab300083f0 con 0x7fab38065030 2024-09-10T05:36:33.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.163+0000 7fab3daf6640 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56482cc6d560 con 0x56482cc61560 2024-09-10T05:36:33.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.163+0000 7fab3daf6640 1 -- 172.21.15.62:0/2038080552 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab300083f0 con 0x56482cc61560 2024-09-10T05:36:33.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.163+0000 7fab3daf6640 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56482cc6d560 con 0x7fab38065030 2024-09-10T05:36:33.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.163+0000 7fab3daf6640 1 -- 172.21.15.62:0/2038080552 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fab300083f0 con 0x7fab38065030 2024-09-10T05:36:33.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.163+0000 7fab3daf6640 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56482cc6d560 con 0x56482cc659e0 2024-09-10T05:36:33.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.167+0000 7fab3d2f5640 1 -- 172.21.15.62:0/2038080552 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab38077020 con 0x56482cc659e0 2024-09-10T05:36:33.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.167+0000 7fab3d2f5640 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56482cc6d560 con 0x56482cc69210 2024-09-10T05:36:33.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.167+0000 7fab3caf4640 1 -- 172.21.15.62:0/2038080552 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab340a8070 con 0x56482cc69210 2024-09-10T05:36:33.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.167+0000 7fab3caf4640 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56482cc6d560 con 0x56482cc61560 2024-09-10T05:36:33.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.167+0000 7fab3daf6640 1 -- 172.21.15.62:0/2038080552 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab300083f0 con 0x56482cc61560 2024-09-10T05:36:33.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.167+0000 7fab3daf6640 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56482cc6d560 con 0x56482cc659e0 2024-09-10T05:36:33.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.167+0000 7fab3d2f5640 1 -- 172.21.15.62:0/2038080552 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab38077020 con 0x56482cc659e0 2024-09-10T05:36:33.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.167+0000 7fab3d2f5640 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56482cc6d560 con 0x56482cc69210 2024-09-10T05:36:33.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.167+0000 7fab3caf4640 1 -- 172.21.15.62:0/2038080552 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 30 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7fab340a8070 con 0x56482cc69210 2024-09-10T05:36:33.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.167+0000 7fab3caf4640 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56482cc6d560 con 0x56482cc61560 2024-09-10T05:36:33.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.167+0000 7fab3daf6640 1 -- 172.21.15.62:0/2038080552 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab300083f0 con 0x56482cc61560 2024-09-10T05:36:33.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.167+0000 7fab3daf6640 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56482cc6d560 con 0x56482cc61560 2024-09-10T05:36:33.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.167+0000 7fab3daf6640 1 -- 172.21.15.62:0/2038080552 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fab300083f0 con 0x56482cc61560 2024-09-10T05:36:33.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.167+0000 7fab3daf6640 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56482cc6d560 con 0x56482cc61560 2024-09-10T05:36:33.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.167+0000 7fab3daf6640 1 -- 172.21.15.62:0/2038080552 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab300083f0 con 0x56482cc61560 2024-09-10T05:36:33.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.167+0000 7fab3daf6640 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56482cc6d560 con 0x56482cc69210 2024-09-10T05:36:33.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.167+0000 7fab3caf4640 1 -- 172.21.15.62:0/2038080552 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab340a8070 con 0x56482cc69210 2024-09-10T05:36:33.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.167+0000 7fab3caf4640 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56482cc6d560 con 0x7fab38065030 2024-09-10T05:36:33.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.167+0000 7fab3daf6640 1 -- 172.21.15.62:0/2038080552 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab300083f0 con 0x7fab38065030 2024-09-10T05:36:33.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.167+0000 7fab3daf6640 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56482cc6d560 con 0x56482cc61560 2024-09-10T05:36:33.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.167+0000 7fab3daf6640 1 -- 172.21.15.62:0/2038080552 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab300083f0 con 0x56482cc61560 2024-09-10T05:36:33.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.167+0000 7fab3daf6640 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56482cc6d560 con 0x7fab38065030 2024-09-10T05:36:33.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.167+0000 7fab3daf6640 1 -- 172.21.15.62:0/2038080552 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab300083f0 con 0x7fab38065030 2024-09-10T05:36:33.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.167+0000 7fab3daf6640 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56482cc6d560 con 0x56482cc69210 2024-09-10T05:36:33.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.167+0000 7fab3caf4640 1 -- 172.21.15.62:0/2038080552 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab340a8070 con 0x56482cc69210 2024-09-10T05:36:33.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.167+0000 7fab3caf4640 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56482cc6d560 con 0x7fab38065030 2024-09-10T05:36:33.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.171+0000 7fab3daf6640 1 -- 172.21.15.62:0/2038080552 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab300083f0 con 0x7fab38065030 2024-09-10T05:36:33.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.171+0000 7fab3daf6640 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56482cc6d560 con 0x56482cc659e0 2024-09-10T05:36:33.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.171+0000 7fab3d2f5640 1 -- 172.21.15.62:0/2038080552 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab38077020 con 0x56482cc659e0 2024-09-10T05:36:33.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.171+0000 7fab3d2f5640 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56482cc6d560 con 0x56482cc659e0 2024-09-10T05:36:33.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.171+0000 7fab3d2f5640 1 -- 172.21.15.62:0/2038080552 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab38077020 con 0x56482cc659e0 2024-09-10T05:36:33.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.171+0000 7fab3d2f5640 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56482cc6d560 con 0x56482cc69210 2024-09-10T05:36:33.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.171+0000 7fab3caf4640 1 -- 172.21.15.62:0/2038080552 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab340a8070 con 0x56482cc69210 2024-09-10T05:36:33.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.171+0000 7fab3caf4640 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56482cc6d560 con 0x56482cc659e0 2024-09-10T05:36:33.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.171+0000 7fab3d2f5640 1 -- 172.21.15.62:0/2038080552 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fab38077020 con 0x56482cc659e0 2024-09-10T05:36:33.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.171+0000 7fab3d2f5640 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56482cc6d560 con 0x56482cc659e0 2024-09-10T05:36:33.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.171+0000 7fab3d2f5640 1 -- 172.21.15.62:0/2038080552 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab38077020 con 0x56482cc659e0 2024-09-10T05:36:33.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.171+0000 7fab3f7ef9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:33.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.171+0000 7fab3f7ef9c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:33.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.171+0000 7fab3f7ef9c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:33.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.171+0000 7fab3f7ef9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:33.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.171+0000 7fab3f7ef9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:33.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.171+0000 7fab3f7ef9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:33.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.171+0000 7fab3f7ef9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.171+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56482cc6c650 con 0x56482cc61560 2024-09-10T05:36:33.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.171+0000 7fab3daf6640 1 -- 172.21.15.62:0/2038080552 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab300083f0 con 0x56482cc61560 2024-09-10T05:36:33.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.171+0000 7fab3f7ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:33.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.171+0000 7fab3f7ef9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.171+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56482cc6caa0 con 0x56482cc659e0 2024-09-10T05:36:33.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.175+0000 7fab3d2f5640 1 -- 172.21.15.62:0/2038080552 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fab38077020 con 0x56482cc659e0 2024-09-10T05:36:33.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.175+0000 7fab3f7ef9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:33.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.175+0000 7fab3f7ef9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.175+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56482cc6cec0 con 0x56482cc69210 2024-09-10T05:36:33.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.175+0000 7fab3caf4640 1 -- 172.21.15.62:0/2038080552 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fab340a8070 con 0x56482cc69210 2024-09-10T05:36:33.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.175+0000 7fab3f7ef9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:33.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.175+0000 7fab3f7ef9c0 20 zone default found 2024-09-10T05:36:33.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.175+0000 7fab3f7ef9c0 4 Realm: () 2024-09-10T05:36:33.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.175+0000 7fab3f7ef9c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:33.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.175+0000 7fab3f7ef9c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:33.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.175+0000 7fab3f7ef9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:33.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.175+0000 7fab3f7ef9c0 20 zonegroup default 2024-09-10T05:36:33.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.175+0000 7fab3f7ef9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.175+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56482cc6da30 con 0x7fab38065030 2024-09-10T05:36:33.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.175+0000 7fab3daf6640 1 -- 172.21.15.62:0/2038080552 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fab300083f0 con 0x7fab38065030 2024-09-10T05:36:33.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.175+0000 7fab3f7ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:33.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.175+0000 7fab3f7ef9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.175+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56482cc6fcf0 con 0x56482cc69210 2024-09-10T05:36:33.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.175+0000 7fab3caf4640 1 -- 172.21.15.62:0/2038080552 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fab340a8070 con 0x56482cc69210 2024-09-10T05:36:33.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.175+0000 7fab3f7ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:33.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.175+0000 7fab3f7ef9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.175+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56482cc700c0 con 0x56482cc69210 2024-09-10T05:36:33.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.175+0000 7fab3caf4640 1 -- 172.21.15.62:0/2038080552 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fab340a8070 con 0x56482cc69210 2024-09-10T05:36:33.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.175+0000 7fab3f7ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:33.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.175+0000 7fab3f7ef9c0 20 started sync module instance, tier type = 2024-09-10T05:36:33.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.175+0000 7fab3f7ef9c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:33.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.175+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56482cc6f180 con 0x56482cc659e0 2024-09-10T05:36:33.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.175+0000 7fab3d2f5640 1 -- 172.21.15.62:0/2038080552 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab38077020 con 0x56482cc659e0 2024-09-10T05:36:33.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.175+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94867988870784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56482cc6f180 con 0x56482cc659e0 2024-09-10T05:36:33.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.175+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56482cc70bb0 con 0x56482cc61560 2024-09-10T05:36:33.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.179+0000 7fab3daf6640 1 -- 172.21.15.62:0/2038080552 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab300083f0 con 0x56482cc61560 2024-09-10T05:36:33.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.179+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94867988874944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56482cc71480 con 0x56482cc61560 2024-09-10T05:36:33.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.179+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56482cc71ec0 con 0x56482cc659e0 2024-09-10T05:36:33.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.179+0000 7fab3d2f5640 1 -- 172.21.15.62:0/2038080552 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94867988870784] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab38077020 con 0x56482cc659e0 2024-09-10T05:36:33.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.179+0000 7fab3daf6640 1 -- 172.21.15.62:0/2038080552 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94867988874944] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab300083f0 con 0x56482cc61560 2024-09-10T05:36:33.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.179+0000 7fab3d2f5640 1 -- 172.21.15.62:0/2038080552 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab38077020 con 0x56482cc659e0 2024-09-10T05:36:33.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.179+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94867988877264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56482cc6ecd0 con 0x56482cc659e0 2024-09-10T05:36:33.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.179+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56482cc72370 con 0x7fab38065030 2024-09-10T05:36:33.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.183+0000 7fab3daf6640 1 -- 172.21.15.62:0/2038080552 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab300083f0 con 0x7fab38065030 2024-09-10T05:36:33.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.183+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94867988881024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56482cc722a0 con 0x7fab38065030 2024-09-10T05:36:33.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.183+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56482cc73230 con 0x56482cc659e0 2024-09-10T05:36:33.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.183+0000 7fab3daf6640 1 -- 172.21.15.62:0/2038080552 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94867988881024] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab300083f0 con 0x7fab38065030 2024-09-10T05:36:33.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.183+0000 7fab3d2f5640 1 -- 172.21.15.62:0/2038080552 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94867988877264] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab38077020 con 0x56482cc659e0 2024-09-10T05:36:33.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.183+0000 7fab3d2f5640 1 -- 172.21.15.62:0/2038080552 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab38077020 con 0x56482cc659e0 2024-09-10T05:36:33.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.183+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94867988879760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56482cc72d80 con 0x56482cc659e0 2024-09-10T05:36:33.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.183+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56482cc73ad0 con 0x56482cc69210 2024-09-10T05:36:33.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.183+0000 7fab3caf4640 1 -- 172.21.15.62:0/2038080552 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab340a8070 con 0x56482cc69210 2024-09-10T05:36:33.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.183+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94867988887072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56482cc72d80 con 0x56482cc69210 2024-09-10T05:36:33.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.183+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56482cc74510 con 0x56482cc69210 2024-09-10T05:36:33.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.187+0000 7fab3d2f5640 1 -- 172.21.15.62:0/2038080552 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94867988879760] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab38077020 con 0x56482cc659e0 2024-09-10T05:36:33.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.187+0000 7fab3caf4640 1 -- 172.21.15.62:0/2038080552 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94867988887072] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab340a8070 con 0x56482cc69210 2024-09-10T05:36:33.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.187+0000 7fab3caf4640 1 -- 172.21.15.62:0/2038080552 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab340a8070 con 0x56482cc69210 2024-09-10T05:36:33.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.187+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94867988888128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56482cc74060 con 0x56482cc69210 2024-09-10T05:36:33.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.187+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56482cc74db0 con 0x7fab38065030 2024-09-10T05:36:33.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.187+0000 7fab3caf4640 1 -- 172.21.15.62:0/2038080552 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94867988888128] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab340a8070 con 0x56482cc69210 2024-09-10T05:36:33.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.187+0000 7fab3daf6640 1 -- 172.21.15.62:0/2038080552 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab300083f0 con 0x7fab38065030 2024-09-10T05:36:33.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.187+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94867988883296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56482cc74060 con 0x7fab38065030 2024-09-10T05:36:33.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.187+0000 7fab3f7ef9c0 20 add_watcher() i=0 2024-09-10T05:36:33.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.187+0000 7fab3f7ef9c0 20 add_watcher() i=1 2024-09-10T05:36:33.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.187+0000 7fab3f7ef9c0 20 add_watcher() i=2 2024-09-10T05:36:33.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.187+0000 7fab3f7ef9c0 20 add_watcher() i=3 2024-09-10T05:36:33.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.187+0000 7fab3f7ef9c0 20 add_watcher() i=4 2024-09-10T05:36:33.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.187+0000 7fab3f7ef9c0 20 add_watcher() i=5 2024-09-10T05:36:33.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.187+0000 7fab3f7ef9c0 20 add_watcher() i=6 2024-09-10T05:36:33.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.187+0000 7fab3daf6640 1 -- 172.21.15.62:0/2038080552 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94867988883296] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab300083f0 con 0x7fab38065030 2024-09-10T05:36:33.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.187+0000 7fab3f7ef9c0 20 add_watcher() i=7 2024-09-10T05:36:33.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.187+0000 7fab3f7ef9c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:33.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.187+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56482cc77ea0 con 0x56482cc61560 2024-09-10T05:36:33.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.187+0000 7fab3daf6640 1 -- 172.21.15.62:0/2038080552 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fab300083f0 con 0x56482cc61560 2024-09-10T05:36:33.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.187+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94867988891904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56482cc75430 con 0x56482cc61560 2024-09-10T05:36:33.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.191+0000 7fab3daf6640 1 -- 172.21.15.62:0/2038080552 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94867988891904] v30'80 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fab300083f0 con 0x56482cc61560 2024-09-10T05:36:33.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.191+0000 7fa9f3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:33.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.191+0000 7fab3f7ef9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:33.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.191+0000 7fab3f7ef9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:33.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.191+0000 7fab3f7ef9c0 5 note: GC not initialized 2024-09-10T05:36:33.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.191+0000 7fa9f2fe5640 20 reqs_thread_entry: start 2024-09-10T05:36:33.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.191+0000 7fab3f7ef9c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:33.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.191+0000 7fab3f7ef9c0 20 Filter name: none 2024-09-10T05:36:33.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.191+0000 7fa9f0fe1640 20 reqs_thread_entry: start 2024-09-10T05:36:33.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.191+0000 7fab3f7ef9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.191+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56482cc9acd0 con 0x56482cc61560 2024-09-10T05:36:33.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.191+0000 7fab3daf6640 1 -- 172.21.15.62:0/2038080552 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fab300083f0 con 0x56482cc61560 2024-09-10T05:36:33.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.191+0000 7fab3f7ef9c0 20 rados_obj.operate() r=0 bl.length=556 2024-09-10T05:36:33.196 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T05:36:30.893777Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:36:30.893760Z","tags":[],"group_ids":[]} 2024-09-10T05:36:33.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.191+0000 7fa9f3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:33.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.191+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94867988891904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56482cc997c0 con 0x56482cc61560 2024-09-10T05:36:33.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.195+0000 7fab3daf6640 1 -- 172.21.15.62:0/2038080552 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94867988891904] v30'81 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fab300083f0 con 0x56482cc61560 2024-09-10T05:36:33.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.195+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94867988870784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56482cc74900 con 0x56482cc659e0 2024-09-10T05:36:33.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.195+0000 7fab3d2f5640 1 -- 172.21.15.62:0/2038080552 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94867988870784] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab38077020 con 0x56482cc659e0 2024-09-10T05:36:33.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.195+0000 7fab3f7ef9c0 20 remove_watcher() i=0 2024-09-10T05:36:33.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.195+0000 7fab3f7ef9c0 2 removed watcher, disabling cache 2024-09-10T05:36:33.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.195+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94867988874944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56482cc74900 con 0x56482cc61560 2024-09-10T05:36:33.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.199+0000 7fab3daf6640 1 -- 172.21.15.62:0/2038080552 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94867988874944] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab300083f0 con 0x56482cc61560 2024-09-10T05:36:33.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.199+0000 7fab3f7ef9c0 20 remove_watcher() i=1 2024-09-10T05:36:33.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.199+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94867988877264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56482cc74900 con 0x56482cc659e0 2024-09-10T05:36:33.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.199+0000 7fab3d2f5640 1 -- 172.21.15.62:0/2038080552 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94867988877264] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab38077020 con 0x56482cc659e0 2024-09-10T05:36:33.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.199+0000 7fab3f7ef9c0 20 remove_watcher() i=2 2024-09-10T05:36:33.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.199+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94867988881024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56482cc70fd0 con 0x7fab38065030 2024-09-10T05:36:33.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.199+0000 7fab3daf6640 1 -- 172.21.15.62:0/2038080552 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94867988881024] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab300083f0 con 0x7fab38065030 2024-09-10T05:36:33.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.199+0000 7fab3f7ef9c0 20 remove_watcher() i=3 2024-09-10T05:36:33.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.199+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94867988879760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56482cc74900 con 0x56482cc659e0 2024-09-10T05:36:33.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.203+0000 7fab3d2f5640 1 -- 172.21.15.62:0/2038080552 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94867988879760] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab38077020 con 0x56482cc659e0 2024-09-10T05:36:33.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.203+0000 7fab3f7ef9c0 20 remove_watcher() i=4 2024-09-10T05:36:33.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.203+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94867988887072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56482cc71e80 con 0x56482cc69210 2024-09-10T05:36:33.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.203+0000 7fab3caf4640 1 -- 172.21.15.62:0/2038080552 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94867988887072] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab340a8070 con 0x56482cc69210 2024-09-10T05:36:33.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.203+0000 7fab3f7ef9c0 20 remove_watcher() i=5 2024-09-10T05:36:33.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.203+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94867988888128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56482cc71990 con 0x56482cc69210 2024-09-10T05:36:33.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.207+0000 7fab3caf4640 1 -- 172.21.15.62:0/2038080552 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94867988888128] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab340a8070 con 0x56482cc69210 2024-09-10T05:36:33.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.207+0000 7fab3f7ef9c0 20 remove_watcher() i=6 2024-09-10T05:36:33.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.207+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2038080552 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94867988883296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56482cc71e80 con 0x7fab38065030 2024-09-10T05:36:33.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.207+0000 7fab3daf6640 1 -- 172.21.15.62:0/2038080552 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94867988883296] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab300083f0 con 0x7fab38065030 2024-09-10T05:36:33.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.207+0000 7fab3f7ef9c0 20 remove_watcher() i=7 2024-09-10T05:36:33.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.207+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2038080552 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x56482cc659e0 msgr2=0x56482cc67dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.207+0000 7fab3f7ef9c0 1 --2- 172.21.15.62:0/2038080552 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x56482cc659e0 0x56482cc67dd0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.207+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2038080552 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56482cc61560 msgr2=0x56482cc639f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.207+0000 7fab3f7ef9c0 1 --2- 172.21.15.62:0/2038080552 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56482cc61560 0x56482cc639f0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.207+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2038080552 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fab38065030 msgr2=0x7fab38053160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.207+0000 7fab3f7ef9c0 1 --2- 172.21.15.62:0/2038080552 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fab38065030 0x7fab38053160 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.207+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2038080552 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56482cc69210 msgr2=0x56482cc6b600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.207+0000 7fab3f7ef9c0 1 --2- 172.21.15.62:0/2038080552 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56482cc69210 0x56482cc6b600 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.207+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2038080552 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7faa08039a70 msgr2=0x7faa0803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.207+0000 7fab3f7ef9c0 1 --2- 172.21.15.62:0/2038080552 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7faa08039a70 0x7faa0803bf30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x56482cc265c0 tx=0x7fab340a7000 comp rx=0 tx=0).stop 2024-09-10T05:36:33.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.207+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2038080552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56482cc4f2c0 msgr2=0x56482cc56640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.207+0000 7fab3daf6640 1 -- 172.21.15.62:0/2038080552 reap_dead start 2024-09-10T05:36:33.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.207+0000 7fab3f7ef9c0 1 --2- 172.21.15.62:0/2038080552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56482cc4f2c0 0x56482cc56640 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fab3801e700 tx=0x7fab3803ded0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.207+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2038080552 shutdown_connections 2024-09-10T05:36:33.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.207+0000 7fab3f7ef9c0 1 --2- 172.21.15.62:0/2038080552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56482cc4f2c0 0x56482cc56640 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.207+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2038080552 >> 172.21.15.62:0/2038080552 conn(0x56482cc4b6f0 msgr2=0x56482cc49900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:33.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.207+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2038080552 shutdown_connections 2024-09-10T05:36:33.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.207+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/2038080552 wait complete. 2024-09-10T05:36:33.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.207+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/1786521064 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7faa14039a70 msgr2=0x7faa1403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.207+0000 7fab3f7ef9c0 1 --2- 172.21.15.62:0/1786521064 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7faa14039a70 0x7faa1403bf30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x56482cc265f0 tx=0x7fab34005a10 comp rx=0 tx=0).stop 2024-09-10T05:36:33.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.207+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/1786521064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56482cc42d60 msgr2=0x56482cc43180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.207+0000 7fab3f7ef9c0 1 --2- 172.21.15.62:0/1786521064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56482cc42d60 0x56482cc43180 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fab38004be0 tx=0x7fab3804ef50 comp rx=0 tx=0).stop 2024-09-10T05:36:33.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.207+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/1786521064 shutdown_connections 2024-09-10T05:36:33.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.207+0000 7fab3f7ef9c0 1 --2- 172.21.15.62:0/1786521064 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7faa14039a70 0x7faa1403bf30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.207+0000 7fab3f7ef9c0 1 --2- 172.21.15.62:0/1786521064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56482cc42d60 0x56482cc43180 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.207+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/1786521064 >> 172.21.15.62:0/1786521064 conn(0x56482cc38710 msgr2=0x56482cc38af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:33.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.207+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/1786521064 shutdown_connections 2024-09-10T05:36:33.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.207+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/1786521064 wait complete. 2024-09-10T05:36:33.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.207+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/1209533798 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x56482cc2d4c0 msgr2=0x56482cc2f8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.207+0000 7fab3f7ef9c0 1 --2- 172.21.15.62:0/1209533798 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x56482cc2d4c0 0x56482cc2f8b0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.207+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/1209533798 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56482cb34310 msgr2=0x56482cc2c220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.207+0000 7fab3f7ef9c0 1 --2- 172.21.15.62:0/1209533798 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56482cb34310 0x56482cc2c220 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.207+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/1209533798 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56482cc31ca0 msgr2=0x56482cc34090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.207+0000 7fab3f7ef9c0 1 --2- 172.21.15.62:0/1209533798 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56482cc31ca0 0x56482cc34090 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.207+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/1209533798 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7faa24039a70 msgr2=0x7faa2403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.207+0000 7fab3f7ef9c0 1 --2- 172.21.15.62:0/1209533798 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7faa24039a70 0x7faa2403bf30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fab340ac000 tx=0x7fab340a5000 comp rx=0 tx=0).stop 2024-09-10T05:36:33.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.207+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/1209533798 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56482caa4240 msgr2=0x56482cc250b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.207+0000 7fab3f7ef9c0 1 --2- 172.21.15.62:0/1209533798 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56482caa4240 0x56482cc250b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fab38000f90 tx=0x7fab38001260 comp rx=0 tx=0).stop 2024-09-10T05:36:33.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.207+0000 7fab3daf6640 1 -- 172.21.15.62:0/1209533798 reap_dead start 2024-09-10T05:36:33.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.207+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/1209533798 shutdown_connections 2024-09-10T05:36:33.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.207+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/1209533798 >> 172.21.15.62:0/1209533798 conn(0x56482cb2a920 msgr2=0x56482cb2eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:33.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.207+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/1209533798 shutdown_connections 2024-09-10T05:36:33.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.207+0000 7fab3f7ef9c0 1 -- 172.21.15.62:0/1209533798 wait complete. 2024-09-10T05:36:33.220 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T05:36:30.893777Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:36:30.893760Z', 'tags': [], 'group_ids': []} 2024-09-10T05:36:33.220 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-10T05:36:33.221 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-10T05:36:33.221 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-10T05:36:33.292 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:33.292 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:33.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.291+0000 7f5533d349c0 1 Processor -- start 2024-09-10T05:36:33.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.291+0000 7f5533d349c0 1 -- start start 2024-09-10T05:36:33.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.291+0000 7f5533d349c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x561882a31fb0 0x561882a32390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.291+0000 7f5533d349c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5618828e69c0 con 0x561882a35140 2024-09-10T05:36:33.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.291+0000 7f5533d349c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x5618829366d0 con 0x561882a31fb0 2024-09-10T05:36:33.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.291+0000 7f553183a640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x561882a31fb0 0x561882a32390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.291+0000 7f5531039640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x561882a35140 0x561882a37530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:38612/0 (socket says 172.21.15.62:38612) 2024-09-10T05:36:33.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.291+0000 7f5531039640 1 -- 172.21.15.62:0/4116292997 learned_addr learned my addr 172.21.15.62:0/4116292997 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-10T05:36:33.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.291+0000 7f553183a640 1 -- 172.21.15.62:0/4116292997 >> v1:172.21.15.2:6789/0 conn(0x561882a35140 legacy=0x561882a37530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.291+0000 7f553183a640 1 -- 172.21.15.62:0/4116292997 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618828daca0 con 0x561882a31fb0 2024-09-10T05:36:33.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.295+0000 7f553183a640 1 --2- 172.21.15.62:0/4116292997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561882a31fb0 0x561882a32390 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f552c00a420 tx=0x7f552c01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5ab722e9f008aa9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.295+0000 7f5530838640 1 -- 172.21.15.62:0/4116292997 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f552c0af070 con 0x561882a31fb0 2024-09-10T05:36:33.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.295+0000 7f5530838640 1 -- 172.21.15.62:0/4116292997 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f552c0aa530 con 0x561882a31fb0 2024-09-10T05:36:33.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.295+0000 7f5530838640 1 -- 172.21.15.62:0/4116292997 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f552c0aa850 con 0x561882a31fb0 2024-09-10T05:36:33.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.295+0000 7f5533d349c0 1 -- 172.21.15.62:0/4116292997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561882a31fb0 msgr2=0x561882a32390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.295+0000 7f5533d349c0 1 --2- 172.21.15.62:0/4116292997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561882a31fb0 0x561882a32390 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f552c00a420 tx=0x7f552c01afd0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.295+0000 7f5533d349c0 1 -- 172.21.15.62:0/4116292997 shutdown_connections 2024-09-10T05:36:33.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.295+0000 7f5533d349c0 1 --2- 172.21.15.62:0/4116292997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561882a31fb0 0x561882a32390 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.295+0000 7f5533d349c0 1 -- 172.21.15.62:0/4116292997 >> 172.21.15.62:0/4116292997 conn(0x561882a2dad0 msgr2=0x561882a2fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:33.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.295+0000 7f5533d349c0 1 -- 172.21.15.62:0/4116292997 shutdown_connections 2024-09-10T05:36:33.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.295+0000 7f5533d349c0 1 -- 172.21.15.62:0/4116292997 wait complete. 2024-09-10T05:36:33.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.307+0000 7f5533d349c0 1 Processor -- start 2024-09-10T05:36:33.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.307+0000 7f5533d349c0 1 -- start start 2024-09-10T05:36:33.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.307+0000 7f5533d349c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561882a31fb0 0x561882b1d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.307+0000 7f5533d349c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56188293a680 con 0x561882a31fb0 2024-09-10T05:36:33.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.307+0000 7f553183a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561882a31fb0 0x561882b1d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.307+0000 7f553183a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561882a31fb0 0x561882b1d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51946/0 (socket says 172.21.15.62:51946) 2024-09-10T05:36:33.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.307+0000 7f553183a640 1 -- 172.21.15.62:0/4108703393 learned_addr learned my addr 172.21.15.62:0/4108703393 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:33.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.307+0000 7f553183a640 1 -- 172.21.15.62:0/4108703393 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618828b5da0 con 0x561882a31fb0 2024-09-10T05:36:33.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.307+0000 7f553183a640 1 --2- 172.21.15.62:0/4108703393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561882a31fb0 0x561882b1d630 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f552c018c00 tx=0x7f552c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cb34e304cd933ad server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.307+0000 7f541fe07640 1 -- 172.21.15.62:0/4108703393 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f552c0af040 con 0x561882a31fb0 2024-09-10T05:36:33.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.307+0000 7f541fe07640 1 -- 172.21.15.62:0/4108703393 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f552c0aaa00 con 0x561882a31fb0 2024-09-10T05:36:33.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.307+0000 7f541fe07640 1 -- 172.21.15.62:0/4108703393 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f552c0aace0 con 0x561882a31fb0 2024-09-10T05:36:33.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.311+0000 7f5533d349c0 1 -- 172.21.15.62:0/4108703393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561882a31fb0 msgr2=0x561882b1d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.311+0000 7f5533d349c0 1 --2- 172.21.15.62:0/4108703393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561882a31fb0 0x561882b1d630 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f552c018c00 tx=0x7f552c0033b0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.311+0000 7f5533d349c0 1 -- 172.21.15.62:0/4108703393 shutdown_connections 2024-09-10T05:36:33.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.311+0000 7f5533d349c0 1 --2- 172.21.15.62:0/4108703393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561882a31fb0 0x561882b1d630 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.311+0000 7f5533d349c0 1 -- 172.21.15.62:0/4108703393 >> 172.21.15.62:0/4108703393 conn(0x561882a2dad0 msgr2=0x561882b192d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:33.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.311+0000 7f5533d349c0 1 -- 172.21.15.62:0/4108703393 shutdown_connections 2024-09-10T05:36:33.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.311+0000 7f5533d349c0 1 -- 172.21.15.62:0/4108703393 wait complete. 2024-09-10T05:36:33.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.311+0000 7f5533d349c0 1 Processor -- start 2024-09-10T05:36:33.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.311+0000 7f5533d349c0 1 -- start start 2024-09-10T05:36:33.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.311+0000 7f5533d349c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561882a31fb0 0x561882b24b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.311+0000 7f5533d349c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5618828dca50 con 0x561882a31fb0 2024-09-10T05:36:33.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.311+0000 7f553183a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561882a31fb0 0x561882b24b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.311+0000 7f553183a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561882a31fb0 0x561882b24b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51962/0 (socket says 172.21.15.62:51962) 2024-09-10T05:36:33.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.311+0000 7f553183a640 1 -- 172.21.15.62:0/57442292 learned_addr learned my addr 172.21.15.62:0/57442292 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:33.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.311+0000 7f553183a640 1 -- 172.21.15.62:0/57442292 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561882b250b0 con 0x561882a31fb0 2024-09-10T05:36:33.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.311+0000 7f553183a640 1 --2- 172.21.15.62:0/57442292 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561882a31fb0 0x561882b24b50 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f552c000f90 tx=0x7f552c017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.311+0000 7f541e604640 1 -- 172.21.15.62:0/57442292 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f552c0c5030 con 0x561882a31fb0 2024-09-10T05:36:33.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.311+0000 7f5533d349c0 1 -- 172.21.15.62:0/57442292 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561882b25340 con 0x561882a31fb0 2024-09-10T05:36:33.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.311+0000 7f541e604640 1 -- 172.21.15.62:0/57442292 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f552c0c1690 con 0x561882a31fb0 2024-09-10T05:36:33.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.311+0000 7f541e604640 1 -- 172.21.15.62:0/57442292 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f552c0c1990 con 0x561882a31fb0 2024-09-10T05:36:33.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.311+0000 7f5533d349c0 1 -- 172.21.15.62:0/57442292 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561882b25d70 con 0x561882a31fb0 2024-09-10T05:36:33.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.311+0000 7f541e604640 1 -- 172.21.15.62:0/57442292 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f552c0c8070 con 0x561882a31fb0 2024-09-10T05:36:33.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.315+0000 7f541e604640 1 --2- 172.21.15.62:0/57442292 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5418039a70 0x7f541803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.315+0000 7f541e604640 1 -- 172.21.15.62:0/57442292 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f552c0c6070 con 0x561882a31fb0 2024-09-10T05:36:33.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.315+0000 7f5531039640 1 --2- 172.21.15.62:0/57442292 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5418039a70 0x7f541803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.315+0000 7f5533d349c0 1 --2- 172.21.15.62:0/57442292 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x561882a35140 0x561882b2bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.315+0000 7f5533d349c0 1 -- 172.21.15.62:0/57442292 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561882b2c200 con 0x561882a35140 2024-09-10T05:36:33.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.315+0000 7f553203b640 1 --2- 172.21.15.62:0/57442292 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x561882a35140 0x561882b2bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.315+0000 7f5531039640 1 --2- 172.21.15.62:0/57442292 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5418039a70 0x7f541803bf30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5528004180 tx=0x7f5528001340 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.315+0000 7f553203b640 1 --2- 172.21.15.62:0/57442292 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x561882a35140 0x561882b2bcc0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.315+0000 7f553203b640 1 -- 172.21.15.62:0/57442292 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55240083f0 con 0x561882a35140 2024-09-10T05:36:33.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.315+0000 7f5533d349c0 1 --2- 172.21.15.62:0/57442292 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561882b2cf60 0x561882b2f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.315+0000 7f5533d349c0 1 -- 172.21.15.62:0/57442292 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561882b2f940 con 0x561882b2cf60 2024-09-10T05:36:33.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.315+0000 7f553183a640 1 --2- 172.21.15.62:0/57442292 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561882b2cf60 0x561882b2f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.315+0000 7f553183a640 1 --2- 172.21.15.62:0/57442292 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561882b2cf60 0x561882b2f350 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.315+0000 7f553183a640 1 -- 172.21.15.62:0/57442292 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f552c0b2040 con 0x561882b2cf60 2024-09-10T05:36:33.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.315+0000 7f5533d349c0 1 --2- 172.21.15.62:0/57442292 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x561882b31700 0x561882b33af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.315+0000 7f5533d349c0 1 -- 172.21.15.62:0/57442292 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561882b341e0 con 0x561882b31700 2024-09-10T05:36:33.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.315+0000 7f5531039640 1 --2- 172.21.15.62:0/57442292 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x561882b31700 0x561882b33af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.315+0000 7f5531039640 1 --2- 172.21.15.62:0/57442292 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x561882b31700 0x561882b33af0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.315+0000 7f5531039640 1 -- 172.21.15.62:0/57442292 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f552800e6c0 con 0x561882b31700 2024-09-10T05:36:33.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.315+0000 7f5533d349c0 1 -- 172.21.15.62:0/57442292 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561882b305a0 con 0x561882b2cf60 2024-09-10T05:36:33.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.319+0000 7f553183a640 1 -- 172.21.15.62:0/57442292 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f552c0b2040 con 0x561882b2cf60 2024-09-10T05:36:33.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.319+0000 7f5533d349c0 1 -- 172.21.15.62:0/57442292 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561882b30a00 con 0x561882b31700 2024-09-10T05:36:33.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.319+0000 7f5531039640 1 -- 172.21.15.62:0/57442292 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f552800e6c0 con 0x561882b31700 2024-09-10T05:36:33.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.319+0000 7f5533d349c0 1 Processor -- start 2024-09-10T05:36:33.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.319+0000 7f5533d349c0 1 -- start start 2024-09-10T05:36:33.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.319+0000 7f5533d349c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561882b42830 0x561882b42c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.319+0000 7f5533d349c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561882947450 con 0x561882b42830 2024-09-10T05:36:33.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.319+0000 7f553183a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561882b42830 0x561882b42c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.319+0000 7f553183a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561882b42830 0x561882b42c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51976/0 (socket says 172.21.15.62:51976) 2024-09-10T05:36:33.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.319+0000 7f553183a640 1 -- 172.21.15.62:0/92493280 learned_addr learned my addr 172.21.15.62:0/92493280 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:33.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.319+0000 7f553183a640 1 -- 172.21.15.62:0/92493280 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561882b43290 con 0x561882b42830 2024-09-10T05:36:33.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.319+0000 7f553183a640 1 --2- 172.21.15.62:0/92493280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561882b42830 0x561882b42c50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f552c0033f0 tx=0x7f552c0c0c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.319+0000 7f54177fe640 1 -- 172.21.15.62:0/92493280 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f552c0c1e60 con 0x561882b42830 2024-09-10T05:36:33.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.319+0000 7f5533d349c0 1 -- 172.21.15.62:0/92493280 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561882b43af0 con 0x561882b42830 2024-09-10T05:36:33.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.319+0000 7f54177fe640 1 -- 172.21.15.62:0/92493280 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f552c0e22f0 con 0x561882b42830 2024-09-10T05:36:33.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.319+0000 7f54177fe640 1 -- 172.21.15.62:0/92493280 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f552c0a94d0 con 0x561882b42830 2024-09-10T05:36:33.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.319+0000 7f5533d349c0 1 -- 172.21.15.62:0/92493280 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561882b44060 con 0x561882b42830 2024-09-10T05:36:33.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.319+0000 7f54177fe640 1 -- 172.21.15.62:0/92493280 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f552c0dc030 con 0x561882b42830 2024-09-10T05:36:33.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.323+0000 7f54177fe640 1 --2- 172.21.15.62:0/92493280 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f540c039a70 0x7f540c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.323+0000 7f54177fe640 1 -- 172.21.15.62:0/92493280 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f552c0bb070 con 0x561882b42830 2024-09-10T05:36:33.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.323+0000 7f5531039640 1 --2- 172.21.15.62:0/92493280 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f540c039a70 0x7f540c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.323+0000 7f5533d349c0 1 Processor -- start 2024-09-10T05:36:33.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.323+0000 7f5533d349c0 1 -- start start 2024-09-10T05:36:33.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.323+0000 7f5531039640 1 --2- 172.21.15.62:0/92493280 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f540c039a70 0x7f540c03bf30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f552800c010 tx=0x7f552800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.323+0000 7f5533d349c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561882b4ffc0 0x561882b503a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.323+0000 7f5533d349c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561882b1dda0 con 0x561882b4ffc0 2024-09-10T05:36:33.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.323+0000 7f553183a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561882b4ffc0 0x561882b503a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.323+0000 7f553183a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561882b4ffc0 0x561882b503a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51992/0 (socket says 172.21.15.62:51992) 2024-09-10T05:36:33.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.323+0000 7f553183a640 1 -- 172.21.15.62:0/170128387 learned_addr learned my addr 172.21.15.62:0/170128387 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:33.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.323+0000 7f553183a640 1 -- 172.21.15.62:0/170128387 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561882b50990 con 0x561882b4ffc0 2024-09-10T05:36:33.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.323+0000 7f553183a640 1 --2- 172.21.15.62:0/170128387 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561882b4ffc0 0x561882b503a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f552c0e2540 tx=0x7f552c0bfaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f55667b5220f671c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.323+0000 7f54157fa640 1 -- 172.21.15.62:0/170128387 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f552c0f2070 con 0x561882b4ffc0 2024-09-10T05:36:33.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.323+0000 7f54157fa640 1 -- 172.21.15.62:0/170128387 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f552c0c9e50 con 0x561882b4ffc0 2024-09-10T05:36:33.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.323+0000 7f54157fa640 1 -- 172.21.15.62:0/170128387 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f552c0b80d0 con 0x561882b4ffc0 2024-09-10T05:36:33.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.323+0000 7f5533d349c0 1 -- 172.21.15.62:0/170128387 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561882b4ffc0 msgr2=0x561882b503a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.323+0000 7f5533d349c0 1 --2- 172.21.15.62:0/170128387 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561882b4ffc0 0x561882b503a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f552c0e2540 tx=0x7f552c0bfaa0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.323+0000 7f5533d349c0 1 -- 172.21.15.62:0/170128387 shutdown_connections 2024-09-10T05:36:33.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.323+0000 7f5533d349c0 1 --2- 172.21.15.62:0/170128387 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561882b4ffc0 0x561882b503a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.323+0000 7f5533d349c0 1 -- 172.21.15.62:0/170128387 >> 172.21.15.62:0/170128387 conn(0x561882b4b380 msgr2=0x561882b495c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:33.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.323+0000 7f5533d349c0 1 -- 172.21.15.62:0/170128387 shutdown_connections 2024-09-10T05:36:33.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.323+0000 7f5533d349c0 1 -- 172.21.15.62:0/170128387 wait complete. 2024-09-10T05:36:33.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.323+0000 7f5533d349c0 1 Processor -- start 2024-09-10T05:36:33.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.323+0000 7f5533d349c0 1 -- start start 2024-09-10T05:36:33.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.323+0000 7f5533d349c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561882b4ffc0 0x5618829a8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.323+0000 7f5533d349c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561882b4ed30 con 0x561882b4ffc0 2024-09-10T05:36:33.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.323+0000 7f553183a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561882b4ffc0 0x5618829a8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.323+0000 7f553183a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561882b4ffc0 0x5618829a8bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:51994/0 (socket says 172.21.15.62:51994) 2024-09-10T05:36:33.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.323+0000 7f553183a640 1 -- 172.21.15.62:0/300700049 learned_addr learned my addr 172.21.15.62:0/300700049 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:33.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.327+0000 7f553183a640 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618829a9150 con 0x561882b4ffc0 2024-09-10T05:36:33.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.327+0000 7f553183a640 1 --2- 172.21.15.62:0/300700049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561882b4ffc0 0x5618829a8bf0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f552c0c0c70 tx=0x7f552c0b8fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.327+0000 7f54037fe640 1 -- 172.21.15.62:0/300700049 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f552c0b3a20 con 0x561882b4ffc0 2024-09-10T05:36:33.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.327+0000 7f54037fe640 1 -- 172.21.15.62:0/300700049 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f552c0e25b0 con 0x561882b4ffc0 2024-09-10T05:36:33.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.327+0000 7f54037fe640 1 -- 172.21.15.62:0/300700049 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f552c0cbd80 con 0x561882b4ffc0 2024-09-10T05:36:33.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.327+0000 7f5533d349c0 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5618829a9150 con 0x561882b4ffc0 2024-09-10T05:36:33.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.327+0000 7f5533d349c0 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618829a9150 con 0x561882b4ffc0 2024-09-10T05:36:33.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.327+0000 7f5533d349c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.327+0000 7f54037fe640 1 -- 172.21.15.62:0/300700049 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f552c0ada20 con 0x561882b4ffc0 2024-09-10T05:36:33.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.327+0000 7f54037fe640 1 --2- 172.21.15.62:0/300700049 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f53fc039ac0 0x7f53fc03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.327+0000 7f54037fe640 1 -- 172.21.15.62:0/300700049 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f552c0ce1b0 con 0x561882b4ffc0 2024-09-10T05:36:33.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.327+0000 7f5531039640 1 --2- 172.21.15.62:0/300700049 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f53fc039ac0 0x7f53fc03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.327+0000 7f5533d349c0 1 --2- 172.21.15.62:0/300700049 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x561882b631f0 0x561882b65680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.327+0000 7f5533d349c0 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561882b65dd0 con 0x561882b631f0 2024-09-10T05:36:33.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.327+0000 7f553203b640 1 --2- 172.21.15.62:0/300700049 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x561882b631f0 0x561882b65680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.327+0000 7f5531039640 1 --2- 172.21.15.62:0/300700049 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f53fc039ac0 0x7f53fc03bf80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f552800efd0 tx=0x7f5528010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.327+0000 7f553203b640 1 --2- 172.21.15.62:0/300700049 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x561882b631f0 0x561882b65680 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.327+0000 7f553203b640 1 -- 172.21.15.62:0/300700049 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55240083f0 con 0x561882b631f0 2024-09-10T05:36:33.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.327+0000 7f5533d349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:33.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.327+0000 7f5533d349c0 20 realm 2024-09-10T05:36:33.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.327+0000 7f5533d349c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.327+0000 7f5533d349c0 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561882b62630 con 0x561882b631f0 2024-09-10T05:36:33.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.327+0000 7f553203b640 1 -- 172.21.15.62:0/300700049 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55240083f0 con 0x561882b631f0 2024-09-10T05:36:33.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.327+0000 7f5533d349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:33.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.327+0000 7f5533d349c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:33.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.327+0000 7f5533d349c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.327+0000 7f5533d349c0 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561882b668e0 con 0x561882b631f0 2024-09-10T05:36:33.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.327+0000 7f553203b640 1 -- 172.21.15.62:0/300700049 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55240083f0 con 0x561882b631f0 2024-09-10T05:36:33.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.327+0000 7f5533d349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:33.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.327+0000 7f5533d349c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.331+0000 7f5533d349c0 1 --2- 172.21.15.62:0/300700049 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561882b676c0 0x561882b69ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.331+0000 7f5533d349c0 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561882b6a140 con 0x561882b676c0 2024-09-10T05:36:33.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.331+0000 7f553183a640 1 --2- 172.21.15.62:0/300700049 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561882b676c0 0x561882b69ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.331+0000 7f553183a640 1 --2- 172.21.15.62:0/300700049 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561882b676c0 0x561882b69ab0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.331+0000 7f553183a640 1 -- 172.21.15.62:0/300700049 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f552c0f4070 con 0x561882b676c0 2024-09-10T05:36:33.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.331+0000 7f5533d349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:33.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.331+0000 7f5533d349c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.331+0000 7f5533d349c0 1 --2- 172.21.15.62:0/300700049 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x561882b6aef0 0x561882b6d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.331+0000 7f5533d349c0 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561882b6d980 con 0x561882b6aef0 2024-09-10T05:36:33.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.331+0000 7f5531039640 1 --2- 172.21.15.62:0/300700049 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x561882b6aef0 0x561882b6d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.331+0000 7f5531039640 1 --2- 172.21.15.62:0/300700049 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x561882b6aef0 0x561882b6d2e0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.331+0000 7f5531039640 1 -- 172.21.15.62:0/300700049 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5528026070 con 0x561882b6aef0 2024-09-10T05:36:33.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.331+0000 7f5533d349c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:33.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.331+0000 7f5533d349c0 20 searching for the correct realm 2024-09-10T05:36:33.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.331+0000 7f5533d349c0 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561882b6f270 con 0x561882b6aef0 2024-09-10T05:36:33.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.331+0000 7f5531039640 1 -- 172.21.15.62:0/300700049 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5528026070 con 0x561882b6aef0 2024-09-10T05:36:33.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.331+0000 7f5531039640 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561882b6f270 con 0x561882b676c0 2024-09-10T05:36:33.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.331+0000 7f553183a640 1 -- 172.21.15.62:0/300700049 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f552c0f4070 con 0x561882b676c0 2024-09-10T05:36:33.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.331+0000 7f553183a640 1 --2- 172.21.15.62:0/300700049 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f552c0ca030 0x7f552c0d3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.331+0000 7f553183a640 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561882b6f270 con 0x7f552c0ca030 2024-09-10T05:36:33.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.331+0000 7f553203b640 1 --2- 172.21.15.62:0/300700049 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f552c0ca030 0x7f552c0d3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.331+0000 7f553203b640 1 --2- 172.21.15.62:0/300700049 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f552c0ca030 0x7f552c0d3890 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.331+0000 7f553203b640 1 -- 172.21.15.62:0/300700049 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55240083f0 con 0x7f552c0ca030 2024-09-10T05:36:33.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.331+0000 7f553203b640 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561882b6f270 con 0x561882b631f0 2024-09-10T05:36:33.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.335+0000 7f553203b640 1 -- 172.21.15.62:0/300700049 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55240083f0 con 0x561882b631f0 2024-09-10T05:36:33.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.335+0000 7f553203b640 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561882b6f270 con 0x561882b631f0 2024-09-10T05:36:33.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.335+0000 7f553203b640 1 -- 172.21.15.62:0/300700049 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55240083f0 con 0x561882b631f0 2024-09-10T05:36:33.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.335+0000 7f553203b640 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561882b6f270 con 0x561882b6aef0 2024-09-10T05:36:33.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.335+0000 7f5531039640 1 -- 172.21.15.62:0/300700049 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5528026070 con 0x561882b6aef0 2024-09-10T05:36:33.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.335+0000 7f5531039640 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561882b6f270 con 0x561882b631f0 2024-09-10T05:36:33.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.335+0000 7f553203b640 1 -- 172.21.15.62:0/300700049 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55240083f0 con 0x561882b631f0 2024-09-10T05:36:33.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.335+0000 7f553203b640 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561882b6f270 con 0x561882b676c0 2024-09-10T05:36:33.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.335+0000 7f553183a640 1 -- 172.21.15.62:0/300700049 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f552c0f4070 con 0x561882b676c0 2024-09-10T05:36:33.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.335+0000 7f553183a640 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561882b6f270 con 0x561882b676c0 2024-09-10T05:36:33.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.335+0000 7f553183a640 1 -- 172.21.15.62:0/300700049 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f552c0f4070 con 0x561882b676c0 2024-09-10T05:36:33.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.335+0000 7f553183a640 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561882b6f270 con 0x561882b631f0 2024-09-10T05:36:33.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.335+0000 7f553203b640 1 -- 172.21.15.62:0/300700049 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55240083f0 con 0x561882b631f0 2024-09-10T05:36:33.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.335+0000 7f553203b640 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561882b6f270 con 0x7f552c0ca030 2024-09-10T05:36:33.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.335+0000 7f553203b640 1 -- 172.21.15.62:0/300700049 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55240083f0 con 0x7f552c0ca030 2024-09-10T05:36:33.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.335+0000 7f553203b640 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561882b6f270 con 0x561882b631f0 2024-09-10T05:36:33.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.335+0000 7f553203b640 1 -- 172.21.15.62:0/300700049 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55240083f0 con 0x561882b631f0 2024-09-10T05:36:33.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.335+0000 7f553203b640 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561882b6f270 con 0x7f552c0ca030 2024-09-10T05:36:33.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.335+0000 7f553203b640 1 -- 172.21.15.62:0/300700049 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f55240083f0 con 0x7f552c0ca030 2024-09-10T05:36:33.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.335+0000 7f553203b640 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561882b6f270 con 0x561882b676c0 2024-09-10T05:36:33.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.339+0000 7f553183a640 1 -- 172.21.15.62:0/300700049 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f552c0f4070 con 0x561882b676c0 2024-09-10T05:36:33.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.339+0000 7f553183a640 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561882b6f270 con 0x561882b6aef0 2024-09-10T05:36:33.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.339+0000 7f5531039640 1 -- 172.21.15.62:0/300700049 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5528026070 con 0x561882b6aef0 2024-09-10T05:36:33.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.339+0000 7f5531039640 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561882b6f270 con 0x561882b631f0 2024-09-10T05:36:33.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.339+0000 7f553203b640 1 -- 172.21.15.62:0/300700049 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55240083f0 con 0x561882b631f0 2024-09-10T05:36:33.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.339+0000 7f553203b640 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561882b6f270 con 0x561882b676c0 2024-09-10T05:36:33.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.339+0000 7f553183a640 1 -- 172.21.15.62:0/300700049 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f552c0f4070 con 0x561882b676c0 2024-09-10T05:36:33.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.339+0000 7f553183a640 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561882b6f270 con 0x561882b6aef0 2024-09-10T05:36:33.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.339+0000 7f5531039640 1 -- 172.21.15.62:0/300700049 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 30 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f5528026070 con 0x561882b6aef0 2024-09-10T05:36:33.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.339+0000 7f5531039640 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561882b6f270 con 0x561882b631f0 2024-09-10T05:36:33.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.339+0000 7f553203b640 1 -- 172.21.15.62:0/300700049 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55240083f0 con 0x561882b631f0 2024-09-10T05:36:33.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.339+0000 7f553203b640 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561882b6f270 con 0x561882b631f0 2024-09-10T05:36:33.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.339+0000 7f553203b640 1 -- 172.21.15.62:0/300700049 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f55240083f0 con 0x561882b631f0 2024-09-10T05:36:33.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.339+0000 7f553203b640 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561882b6f270 con 0x561882b631f0 2024-09-10T05:36:33.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.339+0000 7f553203b640 1 -- 172.21.15.62:0/300700049 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55240083f0 con 0x561882b631f0 2024-09-10T05:36:33.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.339+0000 7f553203b640 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561882b6f270 con 0x561882b6aef0 2024-09-10T05:36:33.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.339+0000 7f5531039640 1 -- 172.21.15.62:0/300700049 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5528026070 con 0x561882b6aef0 2024-09-10T05:36:33.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.339+0000 7f5531039640 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561882b6f270 con 0x7f552c0ca030 2024-09-10T05:36:33.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.339+0000 7f553203b640 1 -- 172.21.15.62:0/300700049 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55240083f0 con 0x7f552c0ca030 2024-09-10T05:36:33.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.339+0000 7f553203b640 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561882b6f270 con 0x561882b631f0 2024-09-10T05:36:33.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.339+0000 7f553203b640 1 -- 172.21.15.62:0/300700049 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55240083f0 con 0x561882b631f0 2024-09-10T05:36:33.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.339+0000 7f553203b640 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561882b6f270 con 0x7f552c0ca030 2024-09-10T05:36:33.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.339+0000 7f553203b640 1 -- 172.21.15.62:0/300700049 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55240083f0 con 0x7f552c0ca030 2024-09-10T05:36:33.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.339+0000 7f553203b640 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561882b6f270 con 0x561882b6aef0 2024-09-10T05:36:33.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.339+0000 7f5531039640 1 -- 172.21.15.62:0/300700049 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5528026070 con 0x561882b6aef0 2024-09-10T05:36:33.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.339+0000 7f5531039640 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561882b6f270 con 0x7f552c0ca030 2024-09-10T05:36:33.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.339+0000 7f553203b640 1 -- 172.21.15.62:0/300700049 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55240083f0 con 0x7f552c0ca030 2024-09-10T05:36:33.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.339+0000 7f553203b640 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561882b6f270 con 0x561882b676c0 2024-09-10T05:36:33.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.343+0000 7f553183a640 1 -- 172.21.15.62:0/300700049 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f552c0f4070 con 0x561882b676c0 2024-09-10T05:36:33.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.343+0000 7f553183a640 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561882b6f270 con 0x561882b676c0 2024-09-10T05:36:33.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.343+0000 7f553183a640 1 -- 172.21.15.62:0/300700049 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f552c0f4070 con 0x561882b676c0 2024-09-10T05:36:33.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.343+0000 7f553183a640 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561882b6f270 con 0x561882b6aef0 2024-09-10T05:36:33.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.343+0000 7f5531039640 1 -- 172.21.15.62:0/300700049 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5528026070 con 0x561882b6aef0 2024-09-10T05:36:33.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.343+0000 7f5531039640 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561882b6f270 con 0x561882b676c0 2024-09-10T05:36:33.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.343+0000 7f553183a640 1 -- 172.21.15.62:0/300700049 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f552c0f4070 con 0x561882b676c0 2024-09-10T05:36:33.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.343+0000 7f553183a640 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561882b6f270 con 0x561882b676c0 2024-09-10T05:36:33.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.343+0000 7f553183a640 1 -- 172.21.15.62:0/300700049 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f552c0f4070 con 0x561882b676c0 2024-09-10T05:36:33.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.343+0000 7f5533d349c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:33.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.343+0000 7f5533d349c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:33.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.343+0000 7f5533d349c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:33.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.343+0000 7f5533d349c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:33.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.343+0000 7f5533d349c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:33.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.343+0000 7f5533d349c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:33.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.343+0000 7f5533d349c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.343+0000 7f5533d349c0 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561882b6e340 con 0x561882b631f0 2024-09-10T05:36:33.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.343+0000 7f553203b640 1 -- 172.21.15.62:0/300700049 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55240083f0 con 0x561882b631f0 2024-09-10T05:36:33.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.343+0000 7f5533d349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:33.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.343+0000 7f5533d349c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.343+0000 7f5533d349c0 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561882b6e730 con 0x561882b676c0 2024-09-10T05:36:33.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.343+0000 7f553183a640 1 -- 172.21.15.62:0/300700049 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f552c0f4070 con 0x561882b676c0 2024-09-10T05:36:33.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.343+0000 7f5533d349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:33.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.343+0000 7f5533d349c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.343+0000 7f5533d349c0 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561882b6e730 con 0x561882b6aef0 2024-09-10T05:36:33.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.347+0000 7f5531039640 1 -- 172.21.15.62:0/300700049 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5528026070 con 0x561882b6aef0 2024-09-10T05:36:33.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.347+0000 7f5533d349c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:33.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.347+0000 7f5533d349c0 20 zone default found 2024-09-10T05:36:33.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.347+0000 7f5533d349c0 4 Realm: () 2024-09-10T05:36:33.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.347+0000 7f5533d349c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:33.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.347+0000 7f5533d349c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:33.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.347+0000 7f5533d349c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:33.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.347+0000 7f5533d349c0 20 zonegroup default 2024-09-10T05:36:33.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.347+0000 7f5533d349c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.347+0000 7f5533d349c0 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561882b6f740 con 0x7f552c0ca030 2024-09-10T05:36:33.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.347+0000 7f553203b640 1 -- 172.21.15.62:0/300700049 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f55240083f0 con 0x7f552c0ca030 2024-09-10T05:36:33.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.347+0000 7f5533d349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:33.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.347+0000 7f5533d349c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.347+0000 7f5533d349c0 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561882b715d0 con 0x561882b6aef0 2024-09-10T05:36:33.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.347+0000 7f5531039640 1 -- 172.21.15.62:0/300700049 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5528026070 con 0x561882b6aef0 2024-09-10T05:36:33.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.347+0000 7f5533d349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:33.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.347+0000 7f5533d349c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.347+0000 7f5533d349c0 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561882b71a10 con 0x561882b6aef0 2024-09-10T05:36:33.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.347+0000 7f5531039640 1 -- 172.21.15.62:0/300700049 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5528026070 con 0x561882b6aef0 2024-09-10T05:36:33.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.347+0000 7f5533d349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:33.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.347+0000 7f5533d349c0 20 started sync module instance, tier type = 2024-09-10T05:36:33.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.347+0000 7f5533d349c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:33.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.347+0000 7f5533d349c0 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561882b70970 con 0x561882b676c0 2024-09-10T05:36:33.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.347+0000 7f553183a640 1 -- 172.21.15.62:0/300700049 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f552c0f4070 con 0x561882b676c0 2024-09-10T05:36:33.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.347+0000 7f5533d349c0 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94663272238736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561882b70970 con 0x561882b676c0 2024-09-10T05:36:33.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.347+0000 7f5533d349c0 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561882b724f0 con 0x561882b631f0 2024-09-10T05:36:33.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.347+0000 7f553203b640 1 -- 172.21.15.62:0/300700049 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55240083f0 con 0x561882b631f0 2024-09-10T05:36:33.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.351+0000 7f5533d349c0 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94663272243184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561882b72d40 con 0x561882b631f0 2024-09-10T05:36:33.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.351+0000 7f5533d349c0 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561882b737b0 con 0x561882b676c0 2024-09-10T05:36:33.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.351+0000 7f553203b640 1 -- 172.21.15.62:0/300700049 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94663272243184] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55240083f0 con 0x561882b631f0 2024-09-10T05:36:33.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.351+0000 7f553183a640 1 -- 172.21.15.62:0/300700049 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94663272238736] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f552c0f4070 con 0x561882b676c0 2024-09-10T05:36:33.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.351+0000 7f553183a640 1 -- 172.21.15.62:0/300700049 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f552c0f4070 con 0x561882b676c0 2024-09-10T05:36:33.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.351+0000 7f5533d349c0 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94663272247936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561882b72890 con 0x561882b676c0 2024-09-10T05:36:33.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.351+0000 7f5533d349c0 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561882b74050 con 0x7f552c0ca030 2024-09-10T05:36:33.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.351+0000 7f553203b640 1 -- 172.21.15.62:0/300700049 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55240083f0 con 0x7f552c0ca030 2024-09-10T05:36:33.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.351+0000 7f5533d349c0 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94663272250272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561882b72890 con 0x7f552c0ca030 2024-09-10T05:36:33.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.351+0000 7f5533d349c0 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561882b74b10 con 0x561882b676c0 2024-09-10T05:36:33.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.351+0000 7f553203b640 1 -- 172.21.15.62:0/300700049 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94663272250272] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55240083f0 con 0x7f552c0ca030 2024-09-10T05:36:33.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.355+0000 7f553183a640 1 -- 172.21.15.62:0/300700049 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94663272247936] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f552c0f4070 con 0x561882b676c0 2024-09-10T05:36:33.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.355+0000 7f553183a640 1 -- 172.21.15.62:0/300700049 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f552c0f4070 con 0x561882b676c0 2024-09-10T05:36:33.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.355+0000 7f5533d349c0 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94663272236224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561882b74ad0 con 0x561882b676c0 2024-09-10T05:36:33.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.355+0000 7f5533d349c0 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561882b74f00 con 0x561882b6aef0 2024-09-10T05:36:33.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.355+0000 7f5531039640 1 -- 172.21.15.62:0/300700049 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5528026070 con 0x561882b6aef0 2024-09-10T05:36:33.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.355+0000 7f5533d349c0 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94663272251328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561882b753b0 con 0x561882b6aef0 2024-09-10T05:36:33.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.355+0000 7f5533d349c0 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561882b75e20 con 0x561882b6aef0 2024-09-10T05:36:33.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.355+0000 7f553183a640 1 -- 172.21.15.62:0/300700049 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94663272236224] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f552c0f4070 con 0x561882b676c0 2024-09-10T05:36:33.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.355+0000 7f5531039640 1 -- 172.21.15.62:0/300700049 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94663272251328] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5528026070 con 0x561882b6aef0 2024-09-10T05:36:33.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.355+0000 7f5531039640 1 -- 172.21.15.62:0/300700049 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5528026070 con 0x561882b6aef0 2024-09-10T05:36:33.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.355+0000 7f5533d349c0 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94663272257776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561882b74f00 con 0x561882b6aef0 2024-09-10T05:36:33.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.355+0000 7f5533d349c0 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561882b764b0 con 0x7f552c0ca030 2024-09-10T05:36:33.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.359+0000 7f5531039640 1 -- 172.21.15.62:0/300700049 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94663272257776] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5528026070 con 0x561882b6aef0 2024-09-10T05:36:33.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.359+0000 7f553203b640 1 -- 172.21.15.62:0/300700049 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55240083f0 con 0x7f552c0ca030 2024-09-10T05:36:33.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.359+0000 7f5533d349c0 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94663272252896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561882b764b0 con 0x7f552c0ca030 2024-09-10T05:36:33.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.359+0000 7f5533d349c0 20 add_watcher() i=0 2024-09-10T05:36:33.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.359+0000 7f5533d349c0 20 add_watcher() i=1 2024-09-10T05:36:33.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.359+0000 7f5533d349c0 20 add_watcher() i=2 2024-09-10T05:36:33.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.359+0000 7f5533d349c0 20 add_watcher() i=3 2024-09-10T05:36:33.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.359+0000 7f5533d349c0 20 add_watcher() i=4 2024-09-10T05:36:33.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.359+0000 7f5533d349c0 20 add_watcher() i=5 2024-09-10T05:36:33.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.359+0000 7f5533d349c0 20 add_watcher() i=6 2024-09-10T05:36:33.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.359+0000 7f553203b640 1 -- 172.21.15.62:0/300700049 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94663272252896] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55240083f0 con 0x7f552c0ca030 2024-09-10T05:36:33.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.359+0000 7f5533d349c0 20 add_watcher() i=7 2024-09-10T05:36:33.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.359+0000 7f5533d349c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:33.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.359+0000 7f5533d349c0 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561882b79690 con 0x561882b631f0 2024-09-10T05:36:33.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.359+0000 7f553203b640 1 -- 172.21.15.62:0/300700049 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f55240083f0 con 0x561882b631f0 2024-09-10T05:36:33.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.359+0000 7f5533d349c0 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94663272259584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561882b768d0 con 0x561882b631f0 2024-09-10T05:36:33.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.359+0000 7f553203b640 1 -- 172.21.15.62:0/300700049 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94663272259584] v30'82 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f55240083f0 con 0x561882b631f0 2024-09-10T05:36:33.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.359+0000 7f53e37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:33.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.359+0000 7f5533d349c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:33.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.359+0000 7f5533d349c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:33.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.359+0000 7f5533d349c0 5 note: GC not initialized 2024-09-10T05:36:33.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.363+0000 7f53e27fc640 20 reqs_thread_entry: start 2024-09-10T05:36:33.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.363+0000 7f5533d349c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:33.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.363+0000 7f5533d349c0 20 Filter name: none 2024-09-10T05:36:33.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.363+0000 7f5353fff640 20 reqs_thread_entry: start 2024-09-10T05:36:33.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.363+0000 7f5533d349c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.363+0000 7f5533d349c0 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561882b9c4e0 con 0x561882b631f0 2024-09-10T05:36:33.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.363+0000 7f553203b640 1 -- 172.21.15.62:0/300700049 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f55240083f0 con 0x561882b631f0 2024-09-10T05:36:33.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.363+0000 7f5533d349c0 20 rados_obj.operate() r=0 bl.length=556 2024-09-10T05:36:33.366 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T05:36:30.893777Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:36:30.893760Z","tags":[],"group_ids":[]} 2024-09-10T05:36:33.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.363+0000 7f53e37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:33.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.363+0000 7f5533d349c0 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94663272259584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561882b9af90 con 0x561882b631f0 2024-09-10T05:36:33.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.363+0000 7f553203b640 1 -- 172.21.15.62:0/300700049 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94663272259584] v30'83 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f55240083f0 con 0x561882b631f0 2024-09-10T05:36:33.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.363+0000 7f5533d349c0 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94663272238736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561882b76000 con 0x561882b676c0 2024-09-10T05:36:33.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.367+0000 7f553183a640 1 -- 172.21.15.62:0/300700049 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94663272238736] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f552c0f4070 con 0x561882b676c0 2024-09-10T05:36:33.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.367+0000 7f5533d349c0 20 remove_watcher() i=0 2024-09-10T05:36:33.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.367+0000 7f5533d349c0 2 removed watcher, disabling cache 2024-09-10T05:36:33.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.367+0000 7f5533d349c0 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94663272243184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561882b76000 con 0x561882b631f0 2024-09-10T05:36:33.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.367+0000 7f553203b640 1 -- 172.21.15.62:0/300700049 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94663272243184] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55240083f0 con 0x561882b631f0 2024-09-10T05:36:33.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.367+0000 7f5533d349c0 20 remove_watcher() i=1 2024-09-10T05:36:33.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.367+0000 7f5533d349c0 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94663272247936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561882b76000 con 0x561882b676c0 2024-09-10T05:36:33.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.371+0000 7f553183a640 1 -- 172.21.15.62:0/300700049 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94663272247936] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f552c0f4070 con 0x561882b676c0 2024-09-10T05:36:33.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.371+0000 7f5533d349c0 20 remove_watcher() i=2 2024-09-10T05:36:33.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.371+0000 7f5533d349c0 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94663272250272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561882b76000 con 0x7f552c0ca030 2024-09-10T05:36:33.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.371+0000 7f553203b640 1 -- 172.21.15.62:0/300700049 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94663272250272] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55240083f0 con 0x7f552c0ca030 2024-09-10T05:36:33.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.371+0000 7f5533d349c0 20 remove_watcher() i=3 2024-09-10T05:36:33.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.371+0000 7f5533d349c0 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94663272236224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561882b73ba0 con 0x561882b676c0 2024-09-10T05:36:33.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.375+0000 7f553183a640 1 -- 172.21.15.62:0/300700049 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94663272236224] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f552c0f4070 con 0x561882b676c0 2024-09-10T05:36:33.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.375+0000 7f5533d349c0 20 remove_watcher() i=4 2024-09-10T05:36:33.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.375+0000 7f5533d349c0 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94663272251328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561882b76000 con 0x561882b6aef0 2024-09-10T05:36:33.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.375+0000 7f5531039640 1 -- 172.21.15.62:0/300700049 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94663272251328] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5528026070 con 0x561882b6aef0 2024-09-10T05:36:33.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.375+0000 7f5533d349c0 20 remove_watcher() i=5 2024-09-10T05:36:33.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.375+0000 7f5533d349c0 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94663272257776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561882b74050 con 0x561882b6aef0 2024-09-10T05:36:33.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.375+0000 7f5531039640 1 -- 172.21.15.62:0/300700049 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94663272257776] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5528026070 con 0x561882b6aef0 2024-09-10T05:36:33.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.375+0000 7f5533d349c0 20 remove_watcher() i=6 2024-09-10T05:36:33.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.375+0000 7f5533d349c0 1 -- 172.21.15.62:0/300700049 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94663272252896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561882b74050 con 0x7f552c0ca030 2024-09-10T05:36:33.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.379+0000 7f553203b640 1 -- 172.21.15.62:0/300700049 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94663272252896] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55240083f0 con 0x7f552c0ca030 2024-09-10T05:36:33.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.379+0000 7f5533d349c0 20 remove_watcher() i=7 2024-09-10T05:36:33.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.379+0000 7f5533d349c0 1 -- 172.21.15.62:0/300700049 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561882b676c0 msgr2=0x561882b69ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.379+0000 7f5533d349c0 1 --2- 172.21.15.62:0/300700049 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561882b676c0 0x561882b69ab0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.379+0000 7f5533d349c0 1 -- 172.21.15.62:0/300700049 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x561882b631f0 msgr2=0x561882b65680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.379+0000 7f5533d349c0 1 --2- 172.21.15.62:0/300700049 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x561882b631f0 0x561882b65680 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.379+0000 7f5533d349c0 1 -- 172.21.15.62:0/300700049 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f552c0ca030 msgr2=0x7f552c0d3890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.379+0000 7f5533d349c0 1 --2- 172.21.15.62:0/300700049 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f552c0ca030 0x7f552c0d3890 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.379+0000 7f5533d349c0 1 -- 172.21.15.62:0/300700049 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x561882b6aef0 msgr2=0x561882b6d2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.379+0000 7f5533d349c0 1 --2- 172.21.15.62:0/300700049 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x561882b6aef0 0x561882b6d2e0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.379+0000 7f5533d349c0 1 -- 172.21.15.62:0/300700049 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f53fc039ac0 msgr2=0x7f53fc03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.379+0000 7f5533d349c0 1 --2- 172.21.15.62:0/300700049 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f53fc039ac0 0x7f53fc03bf80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f552800efd0 tx=0x7f5528010000 comp rx=0 tx=0).stop 2024-09-10T05:36:33.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.379+0000 7f5533d349c0 1 -- 172.21.15.62:0/300700049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561882b4ffc0 msgr2=0x5618829a8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.379+0000 7f5533d349c0 1 --2- 172.21.15.62:0/300700049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561882b4ffc0 0x5618829a8bf0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f552c0c0c70 tx=0x7f552c0b8fa0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.379+0000 7f553203b640 1 -- 172.21.15.62:0/300700049 reap_dead start 2024-09-10T05:36:33.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.379+0000 7f5533d349c0 1 -- 172.21.15.62:0/300700049 shutdown_connections 2024-09-10T05:36:33.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.379+0000 7f5533d349c0 1 --2- 172.21.15.62:0/300700049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561882b4ffc0 0x5618829a8bf0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.379+0000 7f5533d349c0 1 -- 172.21.15.62:0/300700049 >> 172.21.15.62:0/300700049 conn(0x561882b4b380 msgr2=0x561882b49590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:33.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.379+0000 7f5533d349c0 1 -- 172.21.15.62:0/300700049 shutdown_connections 2024-09-10T05:36:33.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.379+0000 7f5533d349c0 1 -- 172.21.15.62:0/300700049 wait complete. 2024-09-10T05:36:33.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.379+0000 7f5533d349c0 1 -- 172.21.15.62:0/92493280 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f540c039a70 msgr2=0x7f540c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.379+0000 7f5533d349c0 1 --2- 172.21.15.62:0/92493280 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f540c039a70 0x7f540c03bf30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f552800c010 tx=0x7f552800f000 comp rx=0 tx=0).stop 2024-09-10T05:36:33.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.379+0000 7f5533d349c0 1 -- 172.21.15.62:0/92493280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561882b42830 msgr2=0x561882b42c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.379+0000 7f5533d349c0 1 --2- 172.21.15.62:0/92493280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561882b42830 0x561882b42c50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f552c0033f0 tx=0x7f552c0c0c00 comp rx=0 tx=0).stop 2024-09-10T05:36:33.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.379+0000 7f5533d349c0 1 -- 172.21.15.62:0/92493280 shutdown_connections 2024-09-10T05:36:33.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.379+0000 7f5533d349c0 1 --2- 172.21.15.62:0/92493280 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f540c039a70 0x7f540c03bf30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.379+0000 7f5533d349c0 1 --2- 172.21.15.62:0/92493280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561882b42830 0x561882b42c50 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.379+0000 7f5533d349c0 1 -- 172.21.15.62:0/92493280 >> 172.21.15.62:0/92493280 conn(0x561882b381e0 msgr2=0x561882b385c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:33.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.379+0000 7f5533d349c0 1 -- 172.21.15.62:0/92493280 shutdown_connections 2024-09-10T05:36:33.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.379+0000 7f5533d349c0 1 -- 172.21.15.62:0/92493280 wait complete. 2024-09-10T05:36:33.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.379+0000 7f5533d349c0 1 -- 172.21.15.62:0/57442292 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561882b2cf60 msgr2=0x561882b2f350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.379+0000 7f5533d349c0 1 --2- 172.21.15.62:0/57442292 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561882b2cf60 0x561882b2f350 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.379+0000 7f5533d349c0 1 -- 172.21.15.62:0/57442292 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x561882a35140 msgr2=0x561882b2bcc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.379+0000 7f5533d349c0 1 --2- 172.21.15.62:0/57442292 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x561882a35140 0x561882b2bcc0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.379+0000 7f5533d349c0 1 -- 172.21.15.62:0/57442292 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x561882b31700 msgr2=0x561882b33af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.379+0000 7f5533d349c0 1 --2- 172.21.15.62:0/57442292 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x561882b31700 0x561882b33af0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.379+0000 7f5533d349c0 1 -- 172.21.15.62:0/57442292 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5418039a70 msgr2=0x7f541803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.379+0000 7f5533d349c0 1 --2- 172.21.15.62:0/57442292 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5418039a70 0x7f541803bf30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5528004180 tx=0x7f5528001340 comp rx=0 tx=0).stop 2024-09-10T05:36:33.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.379+0000 7f5533d349c0 1 -- 172.21.15.62:0/57442292 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561882a31fb0 msgr2=0x561882b24b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.379+0000 7f5533d349c0 1 --2- 172.21.15.62:0/57442292 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561882a31fb0 0x561882b24b50 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f552c000f90 tx=0x7f552c017d70 comp rx=0 tx=0).stop 2024-09-10T05:36:33.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.379+0000 7f553203b640 1 -- 172.21.15.62:0/57442292 reap_dead start 2024-09-10T05:36:33.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.379+0000 7f5533d349c0 1 -- 172.21.15.62:0/57442292 shutdown_connections 2024-09-10T05:36:33.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.379+0000 7f5533d349c0 1 -- 172.21.15.62:0/57442292 >> 172.21.15.62:0/57442292 conn(0x561882a2dad0 msgr2=0x561882b17d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:33.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.379+0000 7f5533d349c0 1 -- 172.21.15.62:0/57442292 shutdown_connections 2024-09-10T05:36:33.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.379+0000 7f5533d349c0 1 -- 172.21.15.62:0/57442292 wait complete. 2024-09-10T05:36:33.391 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T05:36:30.893777Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:36:30.893760Z', 'tags': [], 'group_ids': []} 2024-09-10T05:36:33.392 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-10T05:36:33.392 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-10T05:36:33.392 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2024-09-10T05:36:33.468 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:33.468 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:33.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.467+0000 7f004be549c0 1 Processor -- start 2024-09-10T05:36:33.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.467+0000 7f004be549c0 1 -- start start 2024-09-10T05:36:33.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.467+0000 7f004be549c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x560ec7ea4f30 0x560ec7ea5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.467+0000 7f004be549c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560ec7d599c0 con 0x560ec7ea80c0 2024-09-10T05:36:33.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.467+0000 7f004be549c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x560ec7da96d0 con 0x560ec7ea4f30 2024-09-10T05:36:33.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.467+0000 7f004995a640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x560ec7ea4f30 0x560ec7ea5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.467+0000 7f0049159640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x560ec7ea80c0 0x560ec7eaa4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:38624/0 (socket says 172.21.15.62:38624) 2024-09-10T05:36:33.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.467+0000 7f0049159640 1 -- 172.21.15.62:0/1951003159 learned_addr learned my addr 172.21.15.62:0/1951003159 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-10T05:36:33.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.467+0000 7f004995a640 1 -- 172.21.15.62:0/1951003159 >> v1:172.21.15.2:6789/0 conn(0x560ec7ea80c0 legacy=0x560ec7eaa4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.467+0000 7f004995a640 1 -- 172.21.15.62:0/1951003159 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ec7d4dca0 con 0x560ec7ea4f30 2024-09-10T05:36:33.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.467+0000 7f004995a640 1 --2- 172.21.15.62:0/1951003159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ec7ea4f30 0x560ec7ea5310 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f003c00a480 tx=0x7f003c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e278822b218062c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.471+0000 7f0048958640 1 -- 172.21.15.62:0/1951003159 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f003c0b0070 con 0x560ec7ea4f30 2024-09-10T05:36:33.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.471+0000 7f0048958640 1 -- 172.21.15.62:0/1951003159 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f003c0ab540 con 0x560ec7ea4f30 2024-09-10T05:36:33.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.471+0000 7f0048958640 1 -- 172.21.15.62:0/1951003159 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f003c0ab840 con 0x560ec7ea4f30 2024-09-10T05:36:33.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.471+0000 7f004be549c0 1 -- 172.21.15.62:0/1951003159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ec7ea4f30 msgr2=0x560ec7ea5310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.471+0000 7f004be549c0 1 --2- 172.21.15.62:0/1951003159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ec7ea4f30 0x560ec7ea5310 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f003c00a480 tx=0x7f003c01b280 comp rx=0 tx=0).stop 2024-09-10T05:36:33.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.471+0000 7f004be549c0 1 -- 172.21.15.62:0/1951003159 shutdown_connections 2024-09-10T05:36:33.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.471+0000 7f004be549c0 1 --2- 172.21.15.62:0/1951003159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ec7ea4f30 0x560ec7ea5310 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.471+0000 7f004be549c0 1 -- 172.21.15.62:0/1951003159 >> 172.21.15.62:0/1951003159 conn(0x560ec7ea0a50 msgr2=0x560ec7ea2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:33.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.471+0000 7f004be549c0 1 -- 172.21.15.62:0/1951003159 shutdown_connections 2024-09-10T05:36:33.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.471+0000 7f004be549c0 1 -- 172.21.15.62:0/1951003159 wait complete. 2024-09-10T05:36:33.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.483+0000 7f004be549c0 1 Processor -- start 2024-09-10T05:36:33.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.483+0000 7f004be549c0 1 -- start start 2024-09-10T05:36:33.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.483+0000 7f004be549c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ec7ea4f30 0x560ec7f90730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.483+0000 7f004be549c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560ec7dad680 con 0x560ec7ea4f30 2024-09-10T05:36:33.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.483+0000 7f004995a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ec7ea4f30 0x560ec7f90730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.483+0000 7f004995a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ec7ea4f30 0x560ec7f90730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:52022/0 (socket says 172.21.15.62:52022) 2024-09-10T05:36:33.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.483+0000 7f004995a640 1 -- 172.21.15.62:0/2203513029 learned_addr learned my addr 172.21.15.62:0/2203513029 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:33.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.483+0000 7f004995a640 1 -- 172.21.15.62:0/2203513029 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ec7d28da0 con 0x560ec7ea4f30 2024-09-10T05:36:33.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.483+0000 7f004995a640 1 --2- 172.21.15.62:0/2203513029 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ec7ea4f30 0x560ec7f90730 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f003c0ae040 tx=0x7f003c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6744fdfba7eacf5f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.483+0000 7eff37e07640 1 -- 172.21.15.62:0/2203513029 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f003c0b0070 con 0x560ec7ea4f30 2024-09-10T05:36:33.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.483+0000 7eff37e07640 1 -- 172.21.15.62:0/2203513029 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f003c0b1040 con 0x560ec7ea4f30 2024-09-10T05:36:33.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.483+0000 7eff37e07640 1 -- 172.21.15.62:0/2203513029 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f003c0ab6f0 con 0x560ec7ea4f30 2024-09-10T05:36:33.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.483+0000 7f004be549c0 1 -- 172.21.15.62:0/2203513029 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ec7ea4f30 msgr2=0x560ec7f90730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.483+0000 7f004be549c0 1 --2- 172.21.15.62:0/2203513029 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ec7ea4f30 0x560ec7f90730 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f003c0ae040 tx=0x7f003c003030 comp rx=0 tx=0).stop 2024-09-10T05:36:33.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.483+0000 7f004be549c0 1 -- 172.21.15.62:0/2203513029 shutdown_connections 2024-09-10T05:36:33.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.483+0000 7f004be549c0 1 --2- 172.21.15.62:0/2203513029 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ec7ea4f30 0x560ec7f90730 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.483+0000 7f004be549c0 1 -- 172.21.15.62:0/2203513029 >> 172.21.15.62:0/2203513029 conn(0x560ec7ea0a50 msgr2=0x560ec7f8c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:33.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.483+0000 7f004be549c0 1 -- 172.21.15.62:0/2203513029 shutdown_connections 2024-09-10T05:36:33.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.483+0000 7f004be549c0 1 -- 172.21.15.62:0/2203513029 wait complete. 2024-09-10T05:36:33.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.483+0000 7f004be549c0 1 Processor -- start 2024-09-10T05:36:33.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.483+0000 7f004be549c0 1 -- start start 2024-09-10T05:36:33.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.487+0000 7f004be549c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ec7ea4f30 0x560ec7e1bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.487+0000 7f004be549c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560ec7d4fa50 con 0x560ec7ea4f30 2024-09-10T05:36:33.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.487+0000 7f004995a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ec7ea4f30 0x560ec7e1bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.487+0000 7f004995a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ec7ea4f30 0x560ec7e1bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:52026/0 (socket says 172.21.15.62:52026) 2024-09-10T05:36:33.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.487+0000 7f004995a640 1 -- 172.21.15.62:0/4089708164 learned_addr learned my addr 172.21.15.62:0/4089708164 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:33.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.487+0000 7f004995a640 1 -- 172.21.15.62:0/4089708164 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ec7e1c0f0 con 0x560ec7ea4f30 2024-09-10T05:36:33.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.487+0000 7f004995a640 1 --2- 172.21.15.62:0/4089708164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ec7ea4f30 0x560ec7e1bb90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f003c0ae040 tx=0x7f003c018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.487+0000 7eff36604640 1 -- 172.21.15.62:0/4089708164 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f003c0b7480 con 0x560ec7ea4f30 2024-09-10T05:36:33.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.487+0000 7f004be549c0 1 -- 172.21.15.62:0/4089708164 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560ec7e1a4d0 con 0x560ec7ea4f30 2024-09-10T05:36:33.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.487+0000 7eff36604640 1 -- 172.21.15.62:0/4089708164 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f003c0b7620 con 0x560ec7ea4f30 2024-09-10T05:36:33.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.487+0000 7eff36604640 1 -- 172.21.15.62:0/4089708164 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f003c0b7920 con 0x560ec7ea4f30 2024-09-10T05:36:33.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.487+0000 7f004be549c0 1 -- 172.21.15.62:0/4089708164 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ec7e1aa60 con 0x560ec7ea4f30 2024-09-10T05:36:33.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.487+0000 7eff36604640 1 -- 172.21.15.62:0/4089708164 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f003c0b7ac0 con 0x560ec7ea4f30 2024-09-10T05:36:33.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.487+0000 7eff36604640 1 --2- 172.21.15.62:0/4089708164 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7eff30039a70 0x7eff3003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.487+0000 7eff36604640 1 -- 172.21.15.62:0/4089708164 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f003c0bc070 con 0x560ec7ea4f30 2024-09-10T05:36:33.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.487+0000 7f0049159640 1 --2- 172.21.15.62:0/4089708164 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7eff30039a70 0x7eff3003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.487+0000 7f004be549c0 1 --2- 172.21.15.62:0/4089708164 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560ec7ea80c0 0x560ec7fa1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.487+0000 7f004be549c0 1 -- 172.21.15.62:0/4089708164 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fa1580 con 0x560ec7ea80c0 2024-09-10T05:36:33.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.487+0000 7f004a15b640 1 --2- 172.21.15.62:0/4089708164 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560ec7ea80c0 0x560ec7fa1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.487+0000 7f0049159640 1 --2- 172.21.15.62:0/4089708164 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7eff30039a70 0x7eff3003bf30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0040001d80 tx=0x7f00400012e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.487+0000 7f004a15b640 1 --2- 172.21.15.62:0/4089708164 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560ec7ea80c0 0x560ec7fa1040 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.491+0000 7f004a15b640 1 -- 172.21.15.62:0/4089708164 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f004400a4d0 con 0x560ec7ea80c0 2024-09-10T05:36:33.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.491+0000 7f004be549c0 1 --2- 172.21.15.62:0/4089708164 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x560ec7fa1ff0 0x560ec7fa4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.491+0000 7f004be549c0 1 -- 172.21.15.62:0/4089708164 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fa4bf0 con 0x560ec7fa1ff0 2024-09-10T05:36:33.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.491+0000 7f004995a640 1 --2- 172.21.15.62:0/4089708164 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x560ec7fa1ff0 0x560ec7fa4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.491+0000 7f004995a640 1 --2- 172.21.15.62:0/4089708164 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x560ec7fa1ff0 0x560ec7fa4480 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.491+0000 7f004995a640 1 -- 172.21.15.62:0/4089708164 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f003c0d0070 con 0x560ec7fa1ff0 2024-09-10T05:36:33.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.491+0000 7f004be549c0 1 --2- 172.21.15.62:0/4089708164 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x560ec7fa69b0 0x560ec7fa8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.491+0000 7f004be549c0 1 -- 172.21.15.62:0/4089708164 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fa9490 con 0x560ec7fa69b0 2024-09-10T05:36:33.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.491+0000 7f0049159640 1 --2- 172.21.15.62:0/4089708164 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x560ec7fa69b0 0x560ec7fa8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.491+0000 7f0049159640 1 --2- 172.21.15.62:0/4089708164 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x560ec7fa69b0 0x560ec7fa8da0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.491+0000 7f0049159640 1 -- 172.21.15.62:0/4089708164 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f004000e620 con 0x560ec7fa69b0 2024-09-10T05:36:33.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.491+0000 7f004be549c0 1 -- 172.21.15.62:0/4089708164 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fa5850 con 0x560ec7fa1ff0 2024-09-10T05:36:33.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.491+0000 7f004995a640 1 -- 172.21.15.62:0/4089708164 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f003c0d0070 con 0x560ec7fa1ff0 2024-09-10T05:36:33.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.491+0000 7f004be549c0 1 -- 172.21.15.62:0/4089708164 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fa5c70 con 0x560ec7fa69b0 2024-09-10T05:36:33.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.491+0000 7f0049159640 1 -- 172.21.15.62:0/4089708164 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f004000e620 con 0x560ec7fa69b0 2024-09-10T05:36:33.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.495+0000 7f004be549c0 1 Processor -- start 2024-09-10T05:36:33.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.495+0000 7f004be549c0 1 -- start start 2024-09-10T05:36:33.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.495+0000 7f004be549c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ec7fb7b30 0x560ec7fb7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.495+0000 7f004be549c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560ec7dba450 con 0x560ec7fb7b30 2024-09-10T05:36:33.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.495+0000 7f004995a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ec7fb7b30 0x560ec7fb7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.495+0000 7f004995a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ec7fb7b30 0x560ec7fb7f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:52036/0 (socket says 172.21.15.62:52036) 2024-09-10T05:36:33.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.495+0000 7f004995a640 1 -- 172.21.15.62:0/3454867310 learned_addr learned my addr 172.21.15.62:0/3454867310 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:33.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.495+0000 7f004995a640 1 -- 172.21.15.62:0/3454867310 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ec7fb8590 con 0x560ec7fb7b30 2024-09-10T05:36:33.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.495+0000 7f004995a640 1 --2- 172.21.15.62:0/3454867310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ec7fb7b30 0x560ec7fb7f50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f003c0b7f70 tx=0x7f003c0b6f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.495+0000 7eff2f7fe640 1 -- 172.21.15.62:0/3454867310 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f003c0b5a40 con 0x560ec7fb7b30 2024-09-10T05:36:33.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.495+0000 7eff2f7fe640 1 -- 172.21.15.62:0/3454867310 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f003c0e8300 con 0x560ec7fb7b30 2024-09-10T05:36:33.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.495+0000 7f004be549c0 1 -- 172.21.15.62:0/3454867310 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560ec7fb8df0 con 0x560ec7fb7b30 2024-09-10T05:36:33.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.495+0000 7eff2f7fe640 1 -- 172.21.15.62:0/3454867310 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f003c0073f0 con 0x560ec7fb7b30 2024-09-10T05:36:33.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.495+0000 7f004be549c0 1 -- 172.21.15.62:0/3454867310 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ec7fb8df0 con 0x560ec7fb7b30 2024-09-10T05:36:33.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.495+0000 7eff2f7fe640 1 -- 172.21.15.62:0/3454867310 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f003c007590 con 0x560ec7fb7b30 2024-09-10T05:36:33.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.495+0000 7eff2f7fe640 1 --2- 172.21.15.62:0/3454867310 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7eff24039a70 0x7eff2403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.495+0000 7eff2f7fe640 1 -- 172.21.15.62:0/3454867310 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f003c0a8070 con 0x560ec7fb7b30 2024-09-10T05:36:33.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.495+0000 7f0049159640 1 --2- 172.21.15.62:0/3454867310 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7eff24039a70 0x7eff2403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.495+0000 7f004be549c0 1 Processor -- start 2024-09-10T05:36:33.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.495+0000 7f004be549c0 1 -- start start 2024-09-10T05:36:33.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.495+0000 7f0049159640 1 --2- 172.21.15.62:0/3454867310 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7eff24039a70 0x7eff2403bf30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f004000bf50 tx=0x7f004000f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.499+0000 7f004be549c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ec7fc5110 0x560ec7fc5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.499+0000 7f004be549c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560ec7f90ea0 con 0x560ec7fc5110 2024-09-10T05:36:33.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.499+0000 7f004995a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ec7fc5110 0x560ec7fc5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.499+0000 7f004995a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ec7fc5110 0x560ec7fc5510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:52048/0 (socket says 172.21.15.62:52048) 2024-09-10T05:36:33.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.499+0000 7f004995a640 1 -- 172.21.15.62:0/2881089313 learned_addr learned my addr 172.21.15.62:0/2881089313 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:33.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.499+0000 7f004995a640 1 -- 172.21.15.62:0/2881089313 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ec7fc5b00 con 0x560ec7fc5110 2024-09-10T05:36:33.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.499+0000 7f004995a640 1 --2- 172.21.15.62:0/2881089313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ec7fc5110 0x560ec7fc5510 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f003c0b7e80 tx=0x7f003c0c9910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae1babcafceb4976 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.499+0000 7eff2d7fa640 1 -- 172.21.15.62:0/2881089313 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f003c0f0040 con 0x560ec7fc5110 2024-09-10T05:36:33.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.499+0000 7eff2d7fa640 1 -- 172.21.15.62:0/2881089313 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f003c0d4d60 con 0x560ec7fc5110 2024-09-10T05:36:33.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.499+0000 7eff2d7fa640 1 -- 172.21.15.62:0/2881089313 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f003c0aa4e0 con 0x560ec7fc5110 2024-09-10T05:36:33.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.499+0000 7f004be549c0 1 -- 172.21.15.62:0/2881089313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ec7fc5110 msgr2=0x560ec7fc5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.499+0000 7f004be549c0 1 --2- 172.21.15.62:0/2881089313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ec7fc5110 0x560ec7fc5510 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f003c0b7e80 tx=0x7f003c0c9910 comp rx=0 tx=0).stop 2024-09-10T05:36:33.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.499+0000 7f004be549c0 1 -- 172.21.15.62:0/2881089313 shutdown_connections 2024-09-10T05:36:33.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.499+0000 7f004be549c0 1 --2- 172.21.15.62:0/2881089313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ec7fc5110 0x560ec7fc5510 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.499+0000 7f004be549c0 1 -- 172.21.15.62:0/2881089313 >> 172.21.15.62:0/2881089313 conn(0x560ec7fc0530 msgr2=0x560ec7fbe770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:33.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.499+0000 7f004be549c0 1 -- 172.21.15.62:0/2881089313 shutdown_connections 2024-09-10T05:36:33.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.499+0000 7f004be549c0 1 -- 172.21.15.62:0/2881089313 wait complete. 2024-09-10T05:36:33.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.499+0000 7f004be549c0 1 Processor -- start 2024-09-10T05:36:33.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.499+0000 7f004be549c0 1 -- start start 2024-09-10T05:36:33.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.499+0000 7f004be549c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ec7fc5110 0x560ec7fcb420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.499+0000 7f004be549c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560ec7fc3ee0 con 0x560ec7fc5110 2024-09-10T05:36:33.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.499+0000 7f004995a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ec7fc5110 0x560ec7fcb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.499+0000 7f004995a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ec7fc5110 0x560ec7fcb420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:52056/0 (socket says 172.21.15.62:52056) 2024-09-10T05:36:33.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.499+0000 7f004995a640 1 -- 172.21.15.62:0/1143206001 learned_addr learned my addr 172.21.15.62:0/1143206001 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:33.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.499+0000 7f004995a640 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ec7fcb980 con 0x560ec7fc5110 2024-09-10T05:36:33.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.499+0000 7f004995a640 1 --2- 172.21.15.62:0/1143206001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ec7fc5110 0x560ec7fcb420 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f003c0c1fd0 tx=0x7f003c0ddf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.499+0000 7eff1b7fe640 1 -- 172.21.15.62:0/1143206001 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f003c10c030 con 0x560ec7fc5110 2024-09-10T05:36:33.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.499+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560ec7fcb980 con 0x560ec7fc5110 2024-09-10T05:36:33.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.499+0000 7eff1b7fe640 1 -- 172.21.15.62:0/1143206001 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f003c0aa3b0 con 0x560ec7fc5110 2024-09-10T05:36:33.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.499+0000 7eff1b7fe640 1 -- 172.21.15.62:0/1143206001 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f003c0f0070 con 0x560ec7fc5110 2024-09-10T05:36:33.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.499+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ec7fcbef0 con 0x560ec7fc5110 2024-09-10T05:36:33.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.503+0000 7eff1b7fe640 1 -- 172.21.15.62:0/1143206001 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f003c10f030 con 0x560ec7fc5110 2024-09-10T05:36:33.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.503+0000 7f004be549c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.503+0000 7eff1b7fe640 1 --2- 172.21.15.62:0/1143206001 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7eff14039a70 0x7eff1403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.503+0000 7eff1b7fe640 1 -- 172.21.15.62:0/1143206001 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f003c10d070 con 0x560ec7fc5110 2024-09-10T05:36:33.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.503+0000 7f0049159640 1 --2- 172.21.15.62:0/1143206001 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7eff14039a70 0x7eff1403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.503+0000 7f004be549c0 1 --2- 172.21.15.62:0/1143206001 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560ec7fd63e0 0x560ec7fd8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.503+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fd8fc0 con 0x560ec7fd63e0 2024-09-10T05:36:33.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.503+0000 7f004a15b640 1 --2- 172.21.15.62:0/1143206001 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560ec7fd63e0 0x560ec7fd8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.503+0000 7f0049159640 1 --2- 172.21.15.62:0/1143206001 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7eff14039a70 0x7eff1403bf30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x560ec7fa5bf0 tx=0x7f0040010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.503+0000 7f004a15b640 1 --2- 172.21.15.62:0/1143206001 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560ec7fd63e0 0x560ec7fd8870 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.503+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f004400a4d0 con 0x560ec7fd63e0 2024-09-10T05:36:33.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.503+0000 7f004be549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:33.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.503+0000 7f004be549c0 20 realm 2024-09-10T05:36:33.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.503+0000 7f004be549c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.503+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fd5770 con 0x560ec7fd63e0 2024-09-10T05:36:33.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.503+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f004400a4d0 con 0x560ec7fd63e0 2024-09-10T05:36:33.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.503+0000 7f004be549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:33.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.503+0000 7f004be549c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:33.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.503+0000 7f004be549c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.503+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fd9a90 con 0x560ec7fd63e0 2024-09-10T05:36:33.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.503+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f004400a4d0 con 0x560ec7fd63e0 2024-09-10T05:36:33.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.503+0000 7f004be549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:33.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.503+0000 7f004be549c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.503+0000 7f004be549c0 1 --2- 172.21.15.62:0/1143206001 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x560ec7fda870 0x560ec7fdcc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.503+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fdd2f0 con 0x560ec7fda870 2024-09-10T05:36:33.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.503+0000 7f004995a640 1 --2- 172.21.15.62:0/1143206001 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x560ec7fda870 0x560ec7fdcc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.507+0000 7f004995a640 1 --2- 172.21.15.62:0/1143206001 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x560ec7fda870 0x560ec7fdcc60 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.507+0000 7f004995a640 1 -- 172.21.15.62:0/1143206001 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f003c118070 con 0x560ec7fda870 2024-09-10T05:36:33.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.507+0000 7f004be549c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:33.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.507+0000 7f004be549c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.507+0000 7f004be549c0 1 --2- 172.21.15.62:0/1143206001 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x560ec7fde050 0x560ec7fe0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.507+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe0bf0 con 0x560ec7fde050 2024-09-10T05:36:33.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.507+0000 7f0049159640 1 --2- 172.21.15.62:0/1143206001 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x560ec7fde050 0x560ec7fe0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.507+0000 7f0049159640 1 --2- 172.21.15.62:0/1143206001 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x560ec7fde050 0x560ec7fe0460 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.507+0000 7f0049159640 1 -- 172.21.15.62:0/1143206001 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0040026070 con 0x560ec7fde050 2024-09-10T05:36:33.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.507+0000 7f004be549c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:33.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.507+0000 7f004be549c0 20 searching for the correct realm 2024-09-10T05:36:33.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.507+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe24c0 con 0x560ec7fde050 2024-09-10T05:36:33.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.507+0000 7f0049159640 1 -- 172.21.15.62:0/1143206001 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0040026070 con 0x560ec7fde050 2024-09-10T05:36:33.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.507+0000 7f0049159640 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe24c0 con 0x560ec7fda870 2024-09-10T05:36:33.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.507+0000 7f004995a640 1 -- 172.21.15.62:0/1143206001 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f003c118070 con 0x560ec7fda870 2024-09-10T05:36:33.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.507+0000 7f004995a640 1 --2- 172.21.15.62:0/1143206001 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f003c0ab030 0x7f003c0b0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.507+0000 7f004995a640 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe24c0 con 0x7f003c0ab030 2024-09-10T05:36:33.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.507+0000 7f004a15b640 1 --2- 172.21.15.62:0/1143206001 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f003c0ab030 0x7f003c0b0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.507+0000 7f004a15b640 1 --2- 172.21.15.62:0/1143206001 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f003c0ab030 0x7f003c0b0a50 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.507+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f004400a4d0 con 0x7f003c0ab030 2024-09-10T05:36:33.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.507+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe24c0 con 0x560ec7fd63e0 2024-09-10T05:36:33.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.507+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f004400a4d0 con 0x560ec7fd63e0 2024-09-10T05:36:33.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.507+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe24c0 con 0x560ec7fd63e0 2024-09-10T05:36:33.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.507+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f004400a4d0 con 0x560ec7fd63e0 2024-09-10T05:36:33.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.507+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe24c0 con 0x560ec7fde050 2024-09-10T05:36:33.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.507+0000 7f0049159640 1 -- 172.21.15.62:0/1143206001 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0040026070 con 0x560ec7fde050 2024-09-10T05:36:33.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.507+0000 7f0049159640 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe24c0 con 0x560ec7fd63e0 2024-09-10T05:36:33.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.511+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f004400a4d0 con 0x560ec7fd63e0 2024-09-10T05:36:33.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.511+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe24c0 con 0x560ec7fda870 2024-09-10T05:36:33.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.511+0000 7f004995a640 1 -- 172.21.15.62:0/1143206001 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f003c118070 con 0x560ec7fda870 2024-09-10T05:36:33.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.511+0000 7f004995a640 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe24c0 con 0x560ec7fda870 2024-09-10T05:36:33.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.511+0000 7f004995a640 1 -- 172.21.15.62:0/1143206001 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f003c118070 con 0x560ec7fda870 2024-09-10T05:36:33.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.511+0000 7f004995a640 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe24c0 con 0x560ec7fd63e0 2024-09-10T05:36:33.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.511+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f004400a4d0 con 0x560ec7fd63e0 2024-09-10T05:36:33.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.511+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe24c0 con 0x7f003c0ab030 2024-09-10T05:36:33.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.511+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f004400a4d0 con 0x7f003c0ab030 2024-09-10T05:36:33.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.511+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe24c0 con 0x560ec7fd63e0 2024-09-10T05:36:33.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.511+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f004400a4d0 con 0x560ec7fd63e0 2024-09-10T05:36:33.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.511+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe24c0 con 0x7f003c0ab030 2024-09-10T05:36:33.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.511+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f004400a4d0 con 0x7f003c0ab030 2024-09-10T05:36:33.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.511+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe24c0 con 0x560ec7fda870 2024-09-10T05:36:33.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.511+0000 7f004995a640 1 -- 172.21.15.62:0/1143206001 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f003c118070 con 0x560ec7fda870 2024-09-10T05:36:33.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.511+0000 7f004995a640 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe24c0 con 0x560ec7fde050 2024-09-10T05:36:33.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.511+0000 7f0049159640 1 -- 172.21.15.62:0/1143206001 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0040026070 con 0x560ec7fde050 2024-09-10T05:36:33.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.511+0000 7f0049159640 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe24c0 con 0x560ec7fd63e0 2024-09-10T05:36:33.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.511+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f004400a4d0 con 0x560ec7fd63e0 2024-09-10T05:36:33.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.511+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe24c0 con 0x560ec7fda870 2024-09-10T05:36:33.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.515+0000 7f004995a640 1 -- 172.21.15.62:0/1143206001 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f003c118070 con 0x560ec7fda870 2024-09-10T05:36:33.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.515+0000 7f004995a640 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe24c0 con 0x560ec7fde050 2024-09-10T05:36:33.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.515+0000 7f0049159640 1 -- 172.21.15.62:0/1143206001 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 30 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f0040026070 con 0x560ec7fde050 2024-09-10T05:36:33.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.515+0000 7f0049159640 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe24c0 con 0x560ec7fd63e0 2024-09-10T05:36:33.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.515+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f004400a4d0 con 0x560ec7fd63e0 2024-09-10T05:36:33.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.515+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe24c0 con 0x560ec7fd63e0 2024-09-10T05:36:33.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.515+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f004400a4d0 con 0x560ec7fd63e0 2024-09-10T05:36:33.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.515+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe24c0 con 0x560ec7fd63e0 2024-09-10T05:36:33.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.515+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f004400a4d0 con 0x560ec7fd63e0 2024-09-10T05:36:33.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.515+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe24c0 con 0x560ec7fde050 2024-09-10T05:36:33.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.515+0000 7f0049159640 1 -- 172.21.15.62:0/1143206001 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0040026070 con 0x560ec7fde050 2024-09-10T05:36:33.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.515+0000 7f0049159640 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe24c0 con 0x7f003c0ab030 2024-09-10T05:36:33.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.515+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f004400a4d0 con 0x7f003c0ab030 2024-09-10T05:36:33.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.515+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe24c0 con 0x560ec7fd63e0 2024-09-10T05:36:33.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.515+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f004400a4d0 con 0x560ec7fd63e0 2024-09-10T05:36:33.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.515+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe24c0 con 0x7f003c0ab030 2024-09-10T05:36:33.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.515+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f004400a4d0 con 0x7f003c0ab030 2024-09-10T05:36:33.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.515+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe24c0 con 0x560ec7fde050 2024-09-10T05:36:33.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.515+0000 7f0049159640 1 -- 172.21.15.62:0/1143206001 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0040026070 con 0x560ec7fde050 2024-09-10T05:36:33.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.515+0000 7f0049159640 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe24c0 con 0x7f003c0ab030 2024-09-10T05:36:33.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.515+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f004400a4d0 con 0x7f003c0ab030 2024-09-10T05:36:33.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.515+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe24c0 con 0x560ec7fda870 2024-09-10T05:36:33.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.515+0000 7f004995a640 1 -- 172.21.15.62:0/1143206001 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f003c118070 con 0x560ec7fda870 2024-09-10T05:36:33.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.515+0000 7f004995a640 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe24c0 con 0x560ec7fda870 2024-09-10T05:36:33.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.515+0000 7f004995a640 1 -- 172.21.15.62:0/1143206001 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f003c118070 con 0x560ec7fda870 2024-09-10T05:36:33.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.515+0000 7f004995a640 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe24c0 con 0x560ec7fde050 2024-09-10T05:36:33.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.515+0000 7f0049159640 1 -- 172.21.15.62:0/1143206001 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0040026070 con 0x560ec7fde050 2024-09-10T05:36:33.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.515+0000 7f0049159640 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe24c0 con 0x560ec7fda870 2024-09-10T05:36:33.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.519+0000 7f004995a640 1 -- 172.21.15.62:0/1143206001 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f003c118070 con 0x560ec7fda870 2024-09-10T05:36:33.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.519+0000 7f004995a640 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe24c0 con 0x560ec7fda870 2024-09-10T05:36:33.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.519+0000 7f004995a640 1 -- 172.21.15.62:0/1143206001 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f003c118070 con 0x560ec7fda870 2024-09-10T05:36:33.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.519+0000 7f004be549c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:33.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.519+0000 7f004be549c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:33.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.519+0000 7f004be549c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:33.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.519+0000 7f004be549c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:33.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.519+0000 7f004be549c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:33.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.519+0000 7f004be549c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:33.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.519+0000 7f004be549c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.519+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe15e0 con 0x560ec7fd63e0 2024-09-10T05:36:33.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.519+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f004400a4d0 con 0x560ec7fd63e0 2024-09-10T05:36:33.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.519+0000 7f004be549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:33.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.519+0000 7f004be549c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.519+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe1e80 con 0x560ec7fda870 2024-09-10T05:36:33.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.519+0000 7f004995a640 1 -- 172.21.15.62:0/1143206001 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f003c118070 con 0x560ec7fda870 2024-09-10T05:36:33.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.519+0000 7f004be549c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:33.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.519+0000 7f004be549c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.519+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe28f0 con 0x560ec7fde050 2024-09-10T05:36:33.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.519+0000 7f0049159640 1 -- 172.21.15.62:0/1143206001 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0040026070 con 0x560ec7fde050 2024-09-10T05:36:33.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.519+0000 7f004be549c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:33.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.519+0000 7f004be549c0 20 zone default found 2024-09-10T05:36:33.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.519+0000 7f004be549c0 4 Realm: () 2024-09-10T05:36:33.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.519+0000 7f004be549c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:33.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.519+0000 7f004be549c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:33.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.519+0000 7f004be549c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:33.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.519+0000 7f004be549c0 20 zonegroup default 2024-09-10T05:36:33.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.519+0000 7f004be549c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.519+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe2ce0 con 0x7f003c0ab030 2024-09-10T05:36:33.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.519+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f004400a4d0 con 0x7f003c0ab030 2024-09-10T05:36:33.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.519+0000 7f004be549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:33.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.519+0000 7f004be549c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.519+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe4fc0 con 0x560ec7fde050 2024-09-10T05:36:33.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.519+0000 7f0049159640 1 -- 172.21.15.62:0/1143206001 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0040026070 con 0x560ec7fde050 2024-09-10T05:36:33.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.519+0000 7f004be549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:33.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.519+0000 7f004be549c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.519+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe5360 con 0x560ec7fde050 2024-09-10T05:36:33.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.519+0000 7f0049159640 1 -- 172.21.15.62:0/1143206001 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0040026070 con 0x560ec7fde050 2024-09-10T05:36:33.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.519+0000 7f004be549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:33.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.519+0000 7f004be549c0 20 started sync module instance, tier type = 2024-09-10T05:36:33.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.519+0000 7f004be549c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:33.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.519+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe4450 con 0x560ec7fda870 2024-09-10T05:36:33.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.523+0000 7f004995a640 1 -- 172.21.15.62:0/1143206001 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f003c118070 con 0x560ec7fda870 2024-09-10T05:36:33.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.523+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94621484861552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe5c00 con 0x560ec7fda870 2024-09-10T05:36:33.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.523+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe6450 con 0x560ec7fd63e0 2024-09-10T05:36:33.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.523+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f004400a4d0 con 0x560ec7fd63e0 2024-09-10T05:36:33.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.523+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94621484867488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe6ca0 con 0x560ec7fd63e0 2024-09-10T05:36:33.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.523+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe77c0 con 0x560ec7fda870 2024-09-10T05:36:33.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.523+0000 7f004995a640 1 -- 172.21.15.62:0/1143206001 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94621484861552] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f003c118070 con 0x560ec7fda870 2024-09-10T05:36:33.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.523+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94621484867488] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f004400a4d0 con 0x560ec7fd63e0 2024-09-10T05:36:33.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.527+0000 7f004995a640 1 -- 172.21.15.62:0/1143206001 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f003c118070 con 0x560ec7fda870 2024-09-10T05:36:33.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.527+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94621484872336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe67f0 con 0x560ec7fda870 2024-09-10T05:36:33.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.527+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe8060 con 0x7f003c0ab030 2024-09-10T05:36:33.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.527+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f004400a4d0 con 0x7f003c0ab030 2024-09-10T05:36:33.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.527+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94621484874672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe67f0 con 0x7f003c0ab030 2024-09-10T05:36:33.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.527+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe8bd0 con 0x560ec7fda870 2024-09-10T05:36:33.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.527+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94621484874672] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f004400a4d0 con 0x7f003c0ab030 2024-09-10T05:36:33.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.527+0000 7f004995a640 1 -- 172.21.15.62:0/1143206001 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94621484872336] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f003c118070 con 0x560ec7fda870 2024-09-10T05:36:33.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.527+0000 7f004995a640 1 -- 172.21.15.62:0/1143206001 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f003c118070 con 0x560ec7fda870 2024-09-10T05:36:33.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.527+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94621484865360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe8b90 con 0x560ec7fda870 2024-09-10T05:36:33.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.527+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe8fc0 con 0x560ec7fde050 2024-09-10T05:36:33.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.531+0000 7f0049159640 1 -- 172.21.15.62:0/1143206001 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0040026070 con 0x560ec7fde050 2024-09-10T05:36:33.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.531+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94621484875728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe9470 con 0x560ec7fde050 2024-09-10T05:36:33.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.531+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe9e70 con 0x560ec7fde050 2024-09-10T05:36:33.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.531+0000 7f004995a640 1 -- 172.21.15.62:0/1143206001 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94621484865360] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f003c118070 con 0x560ec7fda870 2024-09-10T05:36:33.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.531+0000 7f0049159640 1 -- 172.21.15.62:0/1143206001 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94621484875728] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0040026070 con 0x560ec7fde050 2024-09-10T05:36:33.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.531+0000 7f0049159640 1 -- 172.21.15.62:0/1143206001 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0040026070 con 0x560ec7fde050 2024-09-10T05:36:33.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.531+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94621484877472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe8fc0 con 0x560ec7fde050 2024-09-10T05:36:33.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.531+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fea710 con 0x7f003c0ab030 2024-09-10T05:36:33.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.531+0000 7f0049159640 1 -- 172.21.15.62:0/1143206001 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94621484877472] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0040026070 con 0x560ec7fde050 2024-09-10T05:36:33.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.531+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f004400a4d0 con 0x7f003c0ab030 2024-09-10T05:36:33.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.531+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94621484882304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fe8fc0 con 0x7f003c0ab030 2024-09-10T05:36:33.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.531+0000 7f004be549c0 20 add_watcher() i=0 2024-09-10T05:36:33.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.531+0000 7f004be549c0 20 add_watcher() i=1 2024-09-10T05:36:33.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.531+0000 7f004be549c0 20 add_watcher() i=2 2024-09-10T05:36:33.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.531+0000 7f004be549c0 20 add_watcher() i=3 2024-09-10T05:36:33.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.531+0000 7f004be549c0 20 add_watcher() i=4 2024-09-10T05:36:33.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.531+0000 7f004be549c0 20 add_watcher() i=5 2024-09-10T05:36:33.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.531+0000 7f004be549c0 20 add_watcher() i=6 2024-09-10T05:36:33.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.531+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94621484882304] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f004400a4d0 con 0x7f003c0ab030 2024-09-10T05:36:33.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.531+0000 7f004be549c0 20 add_watcher() i=7 2024-09-10T05:36:33.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.531+0000 7f004be549c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:33.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.531+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fed7a0 con 0x560ec7fd63e0 2024-09-10T05:36:33.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.535+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f004400a4d0 con 0x560ec7fd63e0 2024-09-10T05:36:33.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.535+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94621484884576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560ec7fead30 con 0x560ec7fd63e0 2024-09-10T05:36:33.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.535+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94621484884576] v30'84 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f004400a4d0 con 0x560ec7fd63e0 2024-09-10T05:36:33.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.535+0000 7efefbfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:33.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.535+0000 7f004be549c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:33.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.535+0000 7f004be549c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:33.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.535+0000 7f004be549c0 5 note: GC not initialized 2024-09-10T05:36:33.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.535+0000 7efefaffd640 20 reqs_thread_entry: start 2024-09-10T05:36:33.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.535+0000 7f004be549c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:33.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.535+0000 7f004be549c0 20 Filter name: none 2024-09-10T05:36:33.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.535+0000 7efef8ff9640 20 reqs_thread_entry: start 2024-09-10T05:36:33.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.535+0000 7f004be549c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T05:36:33.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.535+0000 7f004be549c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.535+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560ec8010a10 con 0x560ec7fd63e0 2024-09-10T05:36:33.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.535+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f004400a4d0 con 0x560ec7fd63e0 2024-09-10T05:36:33.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.535+0000 7f004be549c0 20 rados_obj.operate() r=0 bl.length=556 2024-09-10T05:36:33.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.535+0000 7f004be549c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T05:36:33.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.535+0000 7f004be549c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:36:33.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.535+0000 7f004be549c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:36:33.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.535+0000 7f004be549c0 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2024-09-10T05:36:33.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.535+0000 7f004be549c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.535+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:63 8.2 8:45671577:users.swift::foo%3afoo2:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560ec80117b0 con 0x7f003c0ab030 2024-09-10T05:36:33.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.535+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(63 foo:foo2 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f004400a4d0 con 0x7f003c0ab030 2024-09-10T05:36:33.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.535+0000 7f004be549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:33.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.535+0000 7f004be549c0 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2024-09-10T05:36:33.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.535+0000 7f004be549c0 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-10T05:36:33.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.535+0000 7f004be549c0 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2024-09-10T05:36:33.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.535+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~673 in=673b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560ec80173c0 con 0x560ec7fd63e0 2024-09-10T05:36:33.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.539+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~673] v30'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f004400a4d0 con 0x560ec7fd63e0 2024-09-10T05:36:33.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.539+0000 7f004be549c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:36:33.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.539+0000 7f004be549c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:36:33.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.539+0000 7f004be549c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T05:36:33.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.539+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94621485067984 in=861b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560ec80140a0 con 0x560ec7fda870 2024-09-10T05:36:33.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.539+0000 7f004995a640 1 -- 172.21.15.62:0/1143206001 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== watch-notify(notify (1) cookie 94621484865360 notify 128849018890 ret 0) ==== 891+0+0 (crc 0 0 0) 0x560ec7fb8590 con 0x560ec7fda870 2024-09-10T05:36:33.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.539+0000 7eff2d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018890 cookie 94621484865360 notifier 4388 bl.length()=849 2024-09-10T05:36:33.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.539+0000 7f004995a640 1 -- 172.21.15.62:0/1143206001 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(65 notify.4 [notify cookie 94621485067984 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f003c118070 con 0x560ec7fda870 2024-09-10T05:36:33.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.539+0000 7eff2d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:36:33.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.539+0000 7eff2d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:36:33.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.539+0000 7eff2d7fa640 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7eff0c003eb0 con 0x560ec7fda870 2024-09-10T05:36:33.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.539+0000 7f004995a640 1 -- 172.21.15.62:0/1143206001 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f003c118070 con 0x560ec7fda870 2024-09-10T05:36:33.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.539+0000 7f004995a640 1 -- 172.21.15.62:0/1143206001 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== watch-notify(notify_complete (2) cookie 94621485067984 notify 128849018890 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f003c0db040 con 0x560ec7fda870 2024-09-10T05:36:33.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.539+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:67 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560ec8016ed0 con 0x7f003c0ab030 2024-09-10T05:36:33.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.539+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(67 foo:foo2 [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f004400a4d0 con 0x7f003c0ab030 2024-09-10T05:36:33.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.539+0000 7f004be549c0 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-10T05:36:33.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.539+0000 7f004be549c0 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-10T05:36:33.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.539+0000 7f004be549c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-10T05:36:33.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.539+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94621485067984 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560ec8011b50 con 0x560ec7fda870 2024-09-10T05:36:33.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.539+0000 7f004995a640 1 -- 172.21.15.62:0/1143206001 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== watch-notify(notify (1) cookie 94621484861552 notify 128849018891 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7f003c0db040 con 0x560ec7fda870 2024-09-10T05:36:33.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.539+0000 7eff2cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018891 cookie 94621484861552 notifier 4388 bl.length()=166 2024-09-10T05:36:33.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.539+0000 7f004995a640 1 -- 172.21.15.62:0/1143206001 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(68 notify.0 [notify cookie 94621485067984 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f003c118070 con 0x560ec7fda870 2024-09-10T05:36:33.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.539+0000 7eff2cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-10T05:36:33.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.539+0000 7eff2cff9640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-10T05:36:33.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.539+0000 7eff2cff9640 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7efe70003410 con 0x560ec7fda870 2024-09-10T05:36:33.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.543+0000 7f004995a640 1 -- 172.21.15.62:0/1143206001 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== watch-notify(notify_complete (2) cookie 94621485067984 notify 128849018891 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560ec7e1aa60 con 0x560ec7fda870 2024-09-10T05:36:33.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.543+0000 7f004995a640 1 -- 172.21.15.62:0/1143206001 <== osd.0 v2:172.21.15.2:6800/945139080 25 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f003c118070 con 0x560ec7fda870 2024-09-10T05:36:33.548 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T05:36:30.893777Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-10T05:36:33.541095Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:36:30.893760Z","tags":[],"group_ids":[]} 2024-09-10T05:36:33.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.543+0000 7efefbfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:33.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.543+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94621484884576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560ec800e7e0 con 0x560ec7fd63e0 2024-09-10T05:36:33.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.543+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94621484884576] v30'85 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f004400a4d0 con 0x560ec7fd63e0 2024-09-10T05:36:33.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.543+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94621484861552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560ec800e7e0 con 0x560ec7fda870 2024-09-10T05:36:33.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.547+0000 7f004995a640 1 -- 172.21.15.62:0/1143206001 <== osd.0 v2:172.21.15.2:6800/945139080 26 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94621484861552] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f003c118070 con 0x560ec7fda870 2024-09-10T05:36:33.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.547+0000 7f004be549c0 20 remove_watcher() i=0 2024-09-10T05:36:33.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.547+0000 7f004be549c0 2 removed watcher, disabling cache 2024-09-10T05:36:33.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.547+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94621484867488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560ec800e7e0 con 0x560ec7fd63e0 2024-09-10T05:36:33.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.547+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94621484867488] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f004400a4d0 con 0x560ec7fd63e0 2024-09-10T05:36:33.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.547+0000 7f004be549c0 20 remove_watcher() i=1 2024-09-10T05:36:33.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.547+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94621484872336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560ec800e7e0 con 0x560ec7fda870 2024-09-10T05:36:33.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.551+0000 7f004995a640 1 -- 172.21.15.62:0/1143206001 <== osd.0 v2:172.21.15.2:6800/945139080 27 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94621484872336] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f003c118070 con 0x560ec7fda870 2024-09-10T05:36:33.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.551+0000 7f004be549c0 20 remove_watcher() i=2 2024-09-10T05:36:33.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.551+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94621484874672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560ec800e7e0 con 0x7f003c0ab030 2024-09-10T05:36:33.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.551+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94621484874672] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f004400a4d0 con 0x7f003c0ab030 2024-09-10T05:36:33.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.551+0000 7f004be549c0 20 remove_watcher() i=3 2024-09-10T05:36:33.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.551+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94621484865360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560ec800e7e0 con 0x560ec7fda870 2024-09-10T05:36:33.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.551+0000 7f004995a640 1 -- 172.21.15.62:0/1143206001 <== osd.0 v2:172.21.15.2:6800/945139080 28 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94621484865360] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f003c118070 con 0x560ec7fda870 2024-09-10T05:36:33.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.551+0000 7f004be549c0 20 remove_watcher() i=4 2024-09-10T05:36:33.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.551+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94621484875728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560ec800e7e0 con 0x560ec7fde050 2024-09-10T05:36:33.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.551+0000 7f0049159640 1 -- 172.21.15.62:0/1143206001 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94621484875728] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0040026070 con 0x560ec7fde050 2024-09-10T05:36:33.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.555+0000 7f004be549c0 20 remove_watcher() i=5 2024-09-10T05:36:33.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.555+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94621484877472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560ec800e7e0 con 0x560ec7fde050 2024-09-10T05:36:33.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.555+0000 7f0049159640 1 -- 172.21.15.62:0/1143206001 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94621484877472] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0040026070 con 0x560ec7fde050 2024-09-10T05:36:33.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.555+0000 7f004be549c0 20 remove_watcher() i=6 2024-09-10T05:36:33.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.555+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94621484882304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560ec800e7e0 con 0x7f003c0ab030 2024-09-10T05:36:33.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.555+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 <== osd.2 v2:172.21.15.62:6800/2677868286 15 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94621484882304] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f004400a4d0 con 0x7f003c0ab030 2024-09-10T05:36:33.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.555+0000 7f004be549c0 20 remove_watcher() i=7 2024-09-10T05:36:33.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.555+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x560ec7fda870 msgr2=0x560ec7fdcc60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.555+0000 7f004be549c0 1 --2- 172.21.15.62:0/1143206001 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x560ec7fda870 0x560ec7fdcc60 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.555+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560ec7fd63e0 msgr2=0x560ec7fd8870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.555+0000 7f004be549c0 1 --2- 172.21.15.62:0/1143206001 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560ec7fd63e0 0x560ec7fd8870 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.555+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f003c0ab030 msgr2=0x7f003c0b0a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.555+0000 7f004be549c0 1 --2- 172.21.15.62:0/1143206001 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f003c0ab030 0x7f003c0b0a50 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.555+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x560ec7fde050 msgr2=0x560ec7fe0460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.555+0000 7f004be549c0 1 --2- 172.21.15.62:0/1143206001 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x560ec7fde050 0x560ec7fe0460 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.555+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7eff14039a70 msgr2=0x7eff1403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.555+0000 7f004be549c0 1 --2- 172.21.15.62:0/1143206001 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7eff14039a70 0x7eff1403bf30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x560ec7fa5bf0 tx=0x7f0040010000 comp rx=0 tx=0).stop 2024-09-10T05:36:33.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.555+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ec7fc5110 msgr2=0x560ec7fcb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.555+0000 7f004a15b640 1 -- 172.21.15.62:0/1143206001 reap_dead start 2024-09-10T05:36:33.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.555+0000 7f004be549c0 1 --2- 172.21.15.62:0/1143206001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ec7fc5110 0x560ec7fcb420 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f003c0c1fd0 tx=0x7f003c0ddf90 comp rx=0 tx=0).stop 2024-09-10T05:36:33.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.555+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 shutdown_connections 2024-09-10T05:36:33.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.555+0000 7f004be549c0 1 --2- 172.21.15.62:0/1143206001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ec7fc5110 0x560ec7fcb420 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.555+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 >> 172.21.15.62:0/1143206001 conn(0x560ec7fc0530 msgr2=0x560ec7fbe740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:33.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.555+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 shutdown_connections 2024-09-10T05:36:33.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.555+0000 7f004be549c0 1 -- 172.21.15.62:0/1143206001 wait complete. 2024-09-10T05:36:33.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.555+0000 7f004be549c0 1 -- 172.21.15.62:0/3454867310 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7eff24039a70 msgr2=0x7eff2403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.555+0000 7f004be549c0 1 --2- 172.21.15.62:0/3454867310 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7eff24039a70 0x7eff2403bf30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f004000bf50 tx=0x7f004000f000 comp rx=0 tx=0).stop 2024-09-10T05:36:33.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.555+0000 7f004be549c0 1 -- 172.21.15.62:0/3454867310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ec7fb7b30 msgr2=0x560ec7fb7f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.555+0000 7f004be549c0 1 --2- 172.21.15.62:0/3454867310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ec7fb7b30 0x560ec7fb7f50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f003c0b7f70 tx=0x7f003c0b6f00 comp rx=0 tx=0).stop 2024-09-10T05:36:33.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.555+0000 7f004be549c0 1 -- 172.21.15.62:0/3454867310 shutdown_connections 2024-09-10T05:36:33.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.555+0000 7f004be549c0 1 --2- 172.21.15.62:0/3454867310 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7eff24039a70 0x7eff2403bf30 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.555+0000 7f004be549c0 1 --2- 172.21.15.62:0/3454867310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ec7fb7b30 0x560ec7fb7f50 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.555+0000 7f004be549c0 1 -- 172.21.15.62:0/3454867310 >> 172.21.15.62:0/3454867310 conn(0x560ec7fad4e0 msgr2=0x560ec7fad8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:33.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.555+0000 7f004be549c0 1 -- 172.21.15.62:0/3454867310 shutdown_connections 2024-09-10T05:36:33.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.555+0000 7f004be549c0 1 -- 172.21.15.62:0/3454867310 wait complete. 2024-09-10T05:36:33.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.555+0000 7f004be549c0 1 -- 172.21.15.62:0/4089708164 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x560ec7fa1ff0 msgr2=0x560ec7fa4480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.555+0000 7f004be549c0 1 --2- 172.21.15.62:0/4089708164 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x560ec7fa1ff0 0x560ec7fa4480 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.555+0000 7f004be549c0 1 -- 172.21.15.62:0/4089708164 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560ec7ea80c0 msgr2=0x560ec7fa1040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.555+0000 7f004be549c0 1 --2- 172.21.15.62:0/4089708164 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560ec7ea80c0 0x560ec7fa1040 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.555+0000 7f004be549c0 1 -- 172.21.15.62:0/4089708164 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x560ec7fa69b0 msgr2=0x560ec7fa8da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.555+0000 7f004be549c0 1 --2- 172.21.15.62:0/4089708164 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x560ec7fa69b0 0x560ec7fa8da0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.555+0000 7f004be549c0 1 -- 172.21.15.62:0/4089708164 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7eff30039a70 msgr2=0x7eff3003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.555+0000 7f004be549c0 1 --2- 172.21.15.62:0/4089708164 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7eff30039a70 0x7eff3003bf30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0040001d80 tx=0x7f00400012e0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.555+0000 7f004be549c0 1 -- 172.21.15.62:0/4089708164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ec7ea4f30 msgr2=0x560ec7e1bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.555+0000 7f004be549c0 1 --2- 172.21.15.62:0/4089708164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ec7ea4f30 0x560ec7e1bb90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f003c0ae040 tx=0x7f003c018020 comp rx=0 tx=0).stop 2024-09-10T05:36:33.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.555+0000 7f004a15b640 1 -- 172.21.15.62:0/4089708164 reap_dead start 2024-09-10T05:36:33.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.555+0000 7f004be549c0 1 -- 172.21.15.62:0/4089708164 shutdown_connections 2024-09-10T05:36:33.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.555+0000 7f004be549c0 1 -- 172.21.15.62:0/4089708164 >> 172.21.15.62:0/4089708164 conn(0x560ec7ea0a50 msgr2=0x560ec7f8ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:33.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.555+0000 7f004be549c0 1 -- 172.21.15.62:0/4089708164 shutdown_connections 2024-09-10T05:36:33.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.555+0000 7f004be549c0 1 -- 172.21.15.62:0/4089708164 wait complete. 2024-09-10T05:36:33.569 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T05:36:30.893777Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-10T05:36:33.541095Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:36:30.893760Z', 'tags': [], 'group_ids': []} 2024-09-10T05:36:33.569 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-10T05:36:33.569 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-10T05:36:33.570 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-10T05:36:33.647 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:33.647 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:33.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.643+0000 7f3a233b79c0 1 Processor -- start 2024-09-10T05:36:33.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.643+0000 7f3a233b79c0 1 -- start start 2024-09-10T05:36:33.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.643+0000 7f3a233b79c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5639d1743350 0x5639d1745740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.643+0000 7f3a233b79c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5639d15f19c0 con 0x5639d173f200 2024-09-10T05:36:33.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.643+0000 7f3a233b79c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x5639d16416d0 con 0x5639d1743350 2024-09-10T05:36:33.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.647+0000 7f3a1bfff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5639d1743350 0x5639d1745740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.647+0000 7f3a20ebd640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x5639d173f200 0x5639d173f5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:38636/0 (socket says 172.21.15.62:38636) 2024-09-10T05:36:33.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.647+0000 7f3a1bfff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5639d1743350 0x5639d1745740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:52070/0 (socket says 172.21.15.62:52070) 2024-09-10T05:36:33.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.647+0000 7f3a20ebd640 1 -- 172.21.15.62:0/3175903034 learned_addr learned my addr 172.21.15.62:0/3175903034 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-10T05:36:33.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.647+0000 7f3a1bfff640 1 -- 172.21.15.62:0/3175903034 >> v1:172.21.15.2:6789/0 conn(0x5639d173f200 legacy=0x5639d173f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.647+0000 7f3a1bfff640 1 -- 172.21.15.62:0/3175903034 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639d15e5ca0 con 0x5639d1743350 2024-09-10T05:36:33.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.647+0000 7f3a1bfff640 1 --2- 172.21.15.62:0/3175903034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639d1743350 0x5639d1745740 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c00a480 tx=0x7f3a0c01b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed4fa6e7db72bc9f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.651+0000 7f3a1b7fe640 1 -- 172.21.15.62:0/3175903034 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a0c0aa570 con 0x5639d1743350 2024-09-10T05:36:33.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.651+0000 7f3a1b7fe640 1 -- 172.21.15.62:0/3175903034 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a0c0af070 con 0x5639d1743350 2024-09-10T05:36:33.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.651+0000 7f3a1b7fe640 1 -- 172.21.15.62:0/3175903034 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a0c0aa860 con 0x5639d1743350 2024-09-10T05:36:33.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.651+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3175903034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639d1743350 msgr2=0x5639d1745740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.651+0000 7f3a233b79c0 1 --2- 172.21.15.62:0/3175903034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639d1743350 0x5639d1745740 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c00a480 tx=0x7f3a0c01b310 comp rx=0 tx=0).stop 2024-09-10T05:36:33.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.651+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3175903034 shutdown_connections 2024-09-10T05:36:33.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.651+0000 7f3a233b79c0 1 --2- 172.21.15.62:0/3175903034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639d1743350 0x5639d1745740 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.651+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3175903034 >> 172.21.15.62:0/3175903034 conn(0x5639d16b2b10 msgr2=0x5639d16b2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:33.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.651+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3175903034 shutdown_connections 2024-09-10T05:36:33.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.651+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3175903034 wait complete. 2024-09-10T05:36:33.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.663+0000 7f3a233b79c0 1 Processor -- start 2024-09-10T05:36:33.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.667+0000 7f3a233b79c0 1 -- start start 2024-09-10T05:36:33.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.667+0000 7f3a233b79c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639d173f200 0x5639d182a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.667+0000 7f3a233b79c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5639d1645680 con 0x5639d173f200 2024-09-10T05:36:33.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.667+0000 7f3a20ebd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639d173f200 0x5639d182a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.667+0000 7f3a20ebd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639d173f200 0x5639d182a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:52080/0 (socket says 172.21.15.62:52080) 2024-09-10T05:36:33.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.667+0000 7f3a20ebd640 1 -- 172.21.15.62:0/2048903463 learned_addr learned my addr 172.21.15.62:0/2048903463 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:33.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.667+0000 7f3a20ebd640 1 -- 172.21.15.62:0/2048903463 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639d15c0da0 con 0x5639d173f200 2024-09-10T05:36:33.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.667+0000 7f3a20ebd640 1 --2- 172.21.15.62:0/2048903463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639d173f200 0x5639d182a8a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3a14001e00 tx=0x7f3a1400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fbb9237e80bb0dc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.667+0000 7f390ee05640 1 -- 172.21.15.62:0/2048903463 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a14012020 con 0x5639d173f200 2024-09-10T05:36:33.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.667+0000 7f390ee05640 1 -- 172.21.15.62:0/2048903463 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a1400e690 con 0x5639d173f200 2024-09-10T05:36:33.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.667+0000 7f390ee05640 1 -- 172.21.15.62:0/2048903463 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a1400ea10 con 0x5639d173f200 2024-09-10T05:36:33.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.667+0000 7f3a233b79c0 1 -- 172.21.15.62:0/2048903463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639d173f200 msgr2=0x5639d182a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.667+0000 7f3a233b79c0 1 --2- 172.21.15.62:0/2048903463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639d173f200 0x5639d182a8a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3a14001e00 tx=0x7f3a1400b6d0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.667+0000 7f3a233b79c0 1 -- 172.21.15.62:0/2048903463 shutdown_connections 2024-09-10T05:36:33.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.667+0000 7f3a233b79c0 1 --2- 172.21.15.62:0/2048903463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639d173f200 0x5639d182a8a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.667+0000 7f3a233b79c0 1 -- 172.21.15.62:0/2048903463 >> 172.21.15.62:0/2048903463 conn(0x5639d16b2b10 msgr2=0x5639d18264e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:33.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.667+0000 7f3a233b79c0 1 -- 172.21.15.62:0/2048903463 shutdown_connections 2024-09-10T05:36:33.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.667+0000 7f3a233b79c0 1 -- 172.21.15.62:0/2048903463 wait complete. 2024-09-10T05:36:33.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.667+0000 7f3a233b79c0 1 Processor -- start 2024-09-10T05:36:33.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.667+0000 7f3a233b79c0 1 -- start start 2024-09-10T05:36:33.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.667+0000 7f3a233b79c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639d173f200 0x5639d1831f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.667+0000 7f3a233b79c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5639d15e7a50 con 0x5639d173f200 2024-09-10T05:36:33.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.667+0000 7f3a20ebd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639d173f200 0x5639d1831f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.667+0000 7f3a20ebd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639d173f200 0x5639d1831f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:52092/0 (socket says 172.21.15.62:52092) 2024-09-10T05:36:33.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.667+0000 7f3a20ebd640 1 -- 172.21.15.62:0/1660010032 learned_addr learned my addr 172.21.15.62:0/1660010032 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:33.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.671+0000 7f3a20ebd640 1 -- 172.21.15.62:0/1660010032 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639d18324a0 con 0x5639d173f200 2024-09-10T05:36:33.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.671+0000 7f3a20ebd640 1 --2- 172.21.15.62:0/1660010032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639d173f200 0x5639d1831f40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x5639d182b830 tx=0x7f3a14000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.671+0000 7f390d602640 1 -- 172.21.15.62:0/1660010032 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a14012030 con 0x5639d173f200 2024-09-10T05:36:33.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.671+0000 7f3a233b79c0 1 -- 172.21.15.62:0/1660010032 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5639d1832730 con 0x5639d173f200 2024-09-10T05:36:33.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.671+0000 7f390d602640 1 -- 172.21.15.62:0/1660010032 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a1401a750 con 0x5639d173f200 2024-09-10T05:36:33.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.671+0000 7f3a233b79c0 1 -- 172.21.15.62:0/1660010032 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639d18330e0 con 0x5639d173f200 2024-09-10T05:36:33.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.671+0000 7f390d602640 1 -- 172.21.15.62:0/1660010032 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a1401aa30 con 0x5639d173f200 2024-09-10T05:36:33.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.671+0000 7f390d602640 1 -- 172.21.15.62:0/1660010032 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f3a14015020 con 0x5639d173f200 2024-09-10T05:36:33.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.671+0000 7f390d602640 1 --2- 172.21.15.62:0/1660010032 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3908039ac0 0x7f390803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.671+0000 7f390d602640 1 -- 172.21.15.62:0/1660010032 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f3a14020030 con 0x5639d173f200 2024-09-10T05:36:33.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.671+0000 7f3a1bfff640 1 --2- 172.21.15.62:0/1660010032 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3908039ac0 0x7f390803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.671+0000 7f3a233b79c0 1 --2- 172.21.15.62:0/1660010032 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5639d1743350 0x5639d18390b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.671+0000 7f3a233b79c0 1 -- 172.21.15.62:0/1660010032 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5639d18395f0 con 0x5639d1743350 2024-09-10T05:36:33.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.671+0000 7f3a216be640 1 --2- 172.21.15.62:0/1660010032 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5639d1743350 0x5639d18390b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.671+0000 7f3a1bfff640 1 --2- 172.21.15.62:0/1660010032 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3908039ac0 0x7f390803bf80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c0ae000 tx=0x7f3a0c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.671+0000 7f3a216be640 1 --2- 172.21.15.62:0/1660010032 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5639d1743350 0x5639d18390b0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.671+0000 7f3a216be640 1 -- 172.21.15.62:0/1660010032 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3a1c00a4d0 con 0x5639d1743350 2024-09-10T05:36:33.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.671+0000 7f3a233b79c0 1 --2- 172.21.15.62:0/1660010032 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5639d183a060 0x5639d183c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.671+0000 7f3a233b79c0 1 -- 172.21.15.62:0/1660010032 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5639d183cc90 con 0x5639d183a060 2024-09-10T05:36:33.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.671+0000 7f3a20ebd640 1 --2- 172.21.15.62:0/1660010032 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5639d183a060 0x5639d183c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.675+0000 7f3a20ebd640 1 --2- 172.21.15.62:0/1660010032 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5639d183a060 0x5639d183c520 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.675+0000 7f3a20ebd640 1 -- 172.21.15.62:0/1660010032 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3a14008030 con 0x5639d183a060 2024-09-10T05:36:33.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.675+0000 7f3a233b79c0 1 --2- 172.21.15.62:0/1660010032 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5639d183ea50 0x5639d1840e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.675+0000 7f3a233b79c0 1 -- 172.21.15.62:0/1660010032 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5639d1841530 con 0x5639d183ea50 2024-09-10T05:36:33.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.675+0000 7f3a1bfff640 1 --2- 172.21.15.62:0/1660010032 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5639d183ea50 0x5639d1840e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.675+0000 7f3a1bfff640 1 --2- 172.21.15.62:0/1660010032 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5639d183ea50 0x5639d1840e40 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.675+0000 7f3a1bfff640 1 -- 172.21.15.62:0/1660010032 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3a0c0a8070 con 0x5639d183ea50 2024-09-10T05:36:33.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.675+0000 7f3a233b79c0 1 -- 172.21.15.62:0/1660010032 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5639d183d8f0 con 0x5639d183a060 2024-09-10T05:36:33.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.675+0000 7f3a20ebd640 1 -- 172.21.15.62:0/1660010032 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3a14008030 con 0x5639d183a060 2024-09-10T05:36:33.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.675+0000 7f3a233b79c0 1 -- 172.21.15.62:0/1660010032 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5639d183dd50 con 0x5639d183ea50 2024-09-10T05:36:33.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.675+0000 7f3a1bfff640 1 -- 172.21.15.62:0/1660010032 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3a0c0a8070 con 0x5639d183ea50 2024-09-10T05:36:33.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.675+0000 7f3a233b79c0 1 Processor -- start 2024-09-10T05:36:33.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.675+0000 7f3a233b79c0 1 -- start start 2024-09-10T05:36:33.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.675+0000 7f3a233b79c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639d184fb40 0x5639d184ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.675+0000 7f3a233b79c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5639d1652450 con 0x5639d184fb40 2024-09-10T05:36:33.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.675+0000 7f3a20ebd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639d184fb40 0x5639d184ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.675+0000 7f3a20ebd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639d184fb40 0x5639d184ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:52106/0 (socket says 172.21.15.62:52106) 2024-09-10T05:36:33.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.675+0000 7f3a20ebd640 1 -- 172.21.15.62:0/3885939204 learned_addr learned my addr 172.21.15.62:0/3885939204 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:33.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.679+0000 7f3a20ebd640 1 -- 172.21.15.62:0/3885939204 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639d18505a0 con 0x5639d184fb40 2024-09-10T05:36:33.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.679+0000 7f3a20ebd640 1 --2- 172.21.15.62:0/3885939204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639d184fb40 0x5639d184ff60 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3a1402cac0 tx=0x7f3a14018720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.679+0000 7f39067fc640 1 -- 172.21.15.62:0/3885939204 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a14016570 con 0x5639d184fb40 2024-09-10T05:36:33.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.679+0000 7f39067fc640 1 -- 172.21.15.62:0/3885939204 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a14016710 con 0x5639d184fb40 2024-09-10T05:36:33.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.679+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3885939204 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5639d1850e00 con 0x5639d184fb40 2024-09-10T05:36:33.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.679+0000 7f39067fc640 1 -- 172.21.15.62:0/3885939204 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a1404d3e0 con 0x5639d184fb40 2024-09-10T05:36:33.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.679+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3885939204 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639d1850e00 con 0x5639d184fb40 2024-09-10T05:36:33.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.683+0000 7f39067fc640 1 -- 172.21.15.62:0/3885939204 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f3a14009070 con 0x5639d184fb40 2024-09-10T05:36:33.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.683+0000 7f39067fc640 1 --2- 172.21.15.62:0/3885939204 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f38f8039ac0 0x7f38f803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.683+0000 7f39067fc640 1 -- 172.21.15.62:0/3885939204 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f3a14047050 con 0x5639d184fb40 2024-09-10T05:36:33.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.683+0000 7f3a1bfff640 1 --2- 172.21.15.62:0/3885939204 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f38f8039ac0 0x7f38f803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.683+0000 7f3a233b79c0 1 Processor -- start 2024-09-10T05:36:33.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.683+0000 7f3a233b79c0 1 -- start start 2024-09-10T05:36:33.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.683+0000 7f3a233b79c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639d185d0e0 0x5639d185d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.683+0000 7f3a233b79c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5639d182b0f0 con 0x5639d185d0e0 2024-09-10T05:36:33.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.683+0000 7f3a1bfff640 1 --2- 172.21.15.62:0/3885939204 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f38f8039ac0 0x7f38f803bf80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c000c10 tx=0x7f3a0c005a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.683+0000 7f3a20ebd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639d185d0e0 0x5639d185d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.683+0000 7f3a20ebd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639d185d0e0 0x5639d185d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:52118/0 (socket says 172.21.15.62:52118) 2024-09-10T05:36:33.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.683+0000 7f3a20ebd640 1 -- 172.21.15.62:0/2676429630 learned_addr learned my addr 172.21.15.62:0/2676429630 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:33.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.683+0000 7f3a20ebd640 1 -- 172.21.15.62:0/2676429630 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639d185dad0 con 0x5639d185d0e0 2024-09-10T05:36:33.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.683+0000 7f3a20ebd640 1 --2- 172.21.15.62:0/2676429630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639d185d0e0 0x5639d185d4e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3a14016a90 tx=0x7f3a14047980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dd729463a516224 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.687+0000 7f38f7fff640 1 -- 172.21.15.62:0/2676429630 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a1405f070 con 0x5639d185d0e0 2024-09-10T05:36:33.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.687+0000 7f38f7fff640 1 -- 172.21.15.62:0/2676429630 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a14047b60 con 0x5639d185d0e0 2024-09-10T05:36:33.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.687+0000 7f38f7fff640 1 -- 172.21.15.62:0/2676429630 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a1400d510 con 0x5639d185d0e0 2024-09-10T05:36:33.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.687+0000 7f3a233b79c0 1 -- 172.21.15.62:0/2676429630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639d185d0e0 msgr2=0x5639d185d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.687+0000 7f3a233b79c0 1 --2- 172.21.15.62:0/2676429630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639d185d0e0 0x5639d185d4e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3a14016a90 tx=0x7f3a14047980 comp rx=0 tx=0).stop 2024-09-10T05:36:33.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.687+0000 7f3a233b79c0 1 -- 172.21.15.62:0/2676429630 shutdown_connections 2024-09-10T05:36:33.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.687+0000 7f3a233b79c0 1 --2- 172.21.15.62:0/2676429630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639d185d0e0 0x5639d185d4e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.687+0000 7f3a233b79c0 1 -- 172.21.15.62:0/2676429630 >> 172.21.15.62:0/2676429630 conn(0x5639d1858500 msgr2=0x5639d1856740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:33.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.687+0000 7f3a233b79c0 1 -- 172.21.15.62:0/2676429630 shutdown_connections 2024-09-10T05:36:33.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.687+0000 7f3a233b79c0 1 -- 172.21.15.62:0/2676429630 wait complete. 2024-09-10T05:36:33.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.687+0000 7f3a233b79c0 1 Processor -- start 2024-09-10T05:36:33.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.687+0000 7f3a233b79c0 1 -- start start 2024-09-10T05:36:33.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.687+0000 7f3a233b79c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639d185d0e0 0x5639d18633f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.687+0000 7f3a233b79c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5639d185beb0 con 0x5639d185d0e0 2024-09-10T05:36:33.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.687+0000 7f3a20ebd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639d185d0e0 0x5639d18633f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.687+0000 7f3a20ebd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639d185d0e0 0x5639d18633f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:52132/0 (socket says 172.21.15.62:52132) 2024-09-10T05:36:33.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.687+0000 7f3a20ebd640 1 -- 172.21.15.62:0/3812861200 learned_addr learned my addr 172.21.15.62:0/3812861200 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:33.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.687+0000 7f3a20ebd640 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639d1863950 con 0x5639d185d0e0 2024-09-10T05:36:33.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.687+0000 7f3a20ebd640 1 --2- 172.21.15.62:0/3812861200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639d185d0e0 0x5639d18633f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3a14018790 tx=0x7f3a14014ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.687+0000 7f38f67fc640 1 -- 172.21.15.62:0/3812861200 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a14069070 con 0x5639d185d0e0 2024-09-10T05:36:33.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.687+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5639d1863950 con 0x5639d185d0e0 2024-09-10T05:36:33.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.687+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639d1863950 con 0x5639d185d0e0 2024-09-10T05:36:33.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.687+0000 7f38f67fc640 1 -- 172.21.15.62:0/3812861200 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a1404d580 con 0x5639d185d0e0 2024-09-10T05:36:33.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.687+0000 7f38f67fc640 1 -- 172.21.15.62:0/3812861200 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a14072060 con 0x5639d185d0e0 2024-09-10T05:36:33.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.687+0000 7f3a233b79c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.687+0000 7f38f67fc640 1 -- 172.21.15.62:0/3812861200 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f3a14059070 con 0x5639d185d0e0 2024-09-10T05:36:33.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.691+0000 7f38f67fc640 1 --2- 172.21.15.62:0/3812861200 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f38ec039a20 0x7f38ec03bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.691+0000 7f38f67fc640 1 -- 172.21.15.62:0/3812861200 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f3a14005050 con 0x5639d185d0e0 2024-09-10T05:36:33.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.691+0000 7f3a1bfff640 1 --2- 172.21.15.62:0/3812861200 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f38ec039a20 0x7f38ec03bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.691+0000 7f3a233b79c0 1 --2- 172.21.15.62:0/3812861200 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5639d186e340 0x5639d1870790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.691+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5639d1870ee0 con 0x5639d186e340 2024-09-10T05:36:33.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.691+0000 7f3a216be640 1 --2- 172.21.15.62:0/3812861200 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5639d186e340 0x5639d1870790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.691+0000 7f3a1bfff640 1 --2- 172.21.15.62:0/3812861200 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f38ec039a20 0x7f38ec03bee0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c0aa650 tx=0x7f3a0c0a8000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.691+0000 7f3a216be640 1 --2- 172.21.15.62:0/3812861200 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5639d186e340 0x5639d1870790 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.691+0000 7f3a216be640 1 -- 172.21.15.62:0/3812861200 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3a1c00a4d0 con 0x5639d186e340 2024-09-10T05:36:33.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.691+0000 7f3a233b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:33.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.691+0000 7f3a233b79c0 20 realm 2024-09-10T05:36:33.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.691+0000 7f3a233b79c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.691+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5639d186d730 con 0x5639d186e340 2024-09-10T05:36:33.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.691+0000 7f3a216be640 1 -- 172.21.15.62:0/3812861200 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3a1c00a4d0 con 0x5639d186e340 2024-09-10T05:36:33.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.691+0000 7f3a233b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:33.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.691+0000 7f3a233b79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:33.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.691+0000 7f3a233b79c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.691+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5639d18719a0 con 0x5639d186e340 2024-09-10T05:36:33.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.691+0000 7f3a216be640 1 -- 172.21.15.62:0/3812861200 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3a1c00a4d0 con 0x5639d186e340 2024-09-10T05:36:33.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.691+0000 7f3a233b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:33.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.691+0000 7f3a233b79c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.691+0000 7f3a233b79c0 1 --2- 172.21.15.62:0/3812861200 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5639d1872780 0x5639d1874b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.691+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5639d1875200 con 0x5639d1872780 2024-09-10T05:36:33.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.691+0000 7f3a20ebd640 1 --2- 172.21.15.62:0/3812861200 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5639d1872780 0x5639d1874b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.691+0000 7f3a20ebd640 1 --2- 172.21.15.62:0/3812861200 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5639d1872780 0x5639d1874b70 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.691+0000 7f3a20ebd640 1 -- 172.21.15.62:0/3812861200 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3a14062050 con 0x5639d1872780 2024-09-10T05:36:33.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.691+0000 7f3a233b79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:33.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.691+0000 7f3a233b79c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.691+0000 7f3a233b79c0 1 --2- 172.21.15.62:0/3812861200 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5639d1875fb0 0x5639d18783a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.691+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5639d1878a40 con 0x5639d1875fb0 2024-09-10T05:36:33.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.691+0000 7f3a1bfff640 1 --2- 172.21.15.62:0/3812861200 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5639d1875fb0 0x5639d18783a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.691+0000 7f3a1bfff640 1 --2- 172.21.15.62:0/3812861200 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5639d1875fb0 0x5639d18783a0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.695+0000 7f3a1bfff640 1 -- 172.21.15.62:0/3812861200 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3a0c0a8070 con 0x5639d1875fb0 2024-09-10T05:36:33.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.695+0000 7f3a233b79c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:33.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.695+0000 7f3a233b79c0 20 searching for the correct realm 2024-09-10T05:36:33.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.695+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639d187a310 con 0x5639d1875fb0 2024-09-10T05:36:33.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.695+0000 7f3a1bfff640 1 -- 172.21.15.62:0/3812861200 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a0c0a8070 con 0x5639d1875fb0 2024-09-10T05:36:33.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.695+0000 7f3a1bfff640 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639d187a310 con 0x5639d1872780 2024-09-10T05:36:33.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.695+0000 7f3a20ebd640 1 -- 172.21.15.62:0/3812861200 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a14062050 con 0x5639d1872780 2024-09-10T05:36:33.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.695+0000 7f3a20ebd640 1 --2- 172.21.15.62:0/3812861200 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f3a1401ec20 0x7f3a140246b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.695+0000 7f3a20ebd640 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639d187a310 con 0x7f3a1401ec20 2024-09-10T05:36:33.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.695+0000 7f3a216be640 1 --2- 172.21.15.62:0/3812861200 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f3a1401ec20 0x7f3a140246b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.695+0000 7f3a216be640 1 --2- 172.21.15.62:0/3812861200 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f3a1401ec20 0x7f3a140246b0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.695+0000 7f3a216be640 1 -- 172.21.15.62:0/3812861200 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a1c00a4d0 con 0x7f3a1401ec20 2024-09-10T05:36:33.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.695+0000 7f3a216be640 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639d187a310 con 0x5639d186e340 2024-09-10T05:36:33.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.695+0000 7f3a216be640 1 -- 172.21.15.62:0/3812861200 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a1c00a4d0 con 0x5639d186e340 2024-09-10T05:36:33.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.695+0000 7f3a216be640 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639d187a310 con 0x5639d186e340 2024-09-10T05:36:33.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.695+0000 7f3a216be640 1 -- 172.21.15.62:0/3812861200 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a1c00a4d0 con 0x5639d186e340 2024-09-10T05:36:33.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.695+0000 7f3a216be640 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639d187a310 con 0x5639d1875fb0 2024-09-10T05:36:33.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.695+0000 7f3a1bfff640 1 -- 172.21.15.62:0/3812861200 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a0c0a8070 con 0x5639d1875fb0 2024-09-10T05:36:33.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.695+0000 7f3a1bfff640 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639d187a310 con 0x5639d186e340 2024-09-10T05:36:33.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.695+0000 7f3a216be640 1 -- 172.21.15.62:0/3812861200 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a1c00a4d0 con 0x5639d186e340 2024-09-10T05:36:33.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.695+0000 7f3a216be640 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639d187a310 con 0x5639d1872780 2024-09-10T05:36:33.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.695+0000 7f3a20ebd640 1 -- 172.21.15.62:0/3812861200 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a14062050 con 0x5639d1872780 2024-09-10T05:36:33.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.695+0000 7f3a20ebd640 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639d187a310 con 0x5639d1872780 2024-09-10T05:36:33.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.695+0000 7f3a20ebd640 1 -- 172.21.15.62:0/3812861200 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a14062050 con 0x5639d1872780 2024-09-10T05:36:33.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.695+0000 7f3a20ebd640 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639d187a310 con 0x5639d186e340 2024-09-10T05:36:33.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.699+0000 7f3a216be640 1 -- 172.21.15.62:0/3812861200 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a1c00a4d0 con 0x5639d186e340 2024-09-10T05:36:33.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.699+0000 7f3a216be640 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639d187a310 con 0x7f3a1401ec20 2024-09-10T05:36:33.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.699+0000 7f3a216be640 1 -- 172.21.15.62:0/3812861200 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a1c00a4d0 con 0x7f3a1401ec20 2024-09-10T05:36:33.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.699+0000 7f3a216be640 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639d187a310 con 0x5639d186e340 2024-09-10T05:36:33.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.699+0000 7f3a216be640 1 -- 172.21.15.62:0/3812861200 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a1c00a4d0 con 0x5639d186e340 2024-09-10T05:36:33.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.699+0000 7f3a216be640 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639d187a310 con 0x7f3a1401ec20 2024-09-10T05:36:33.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.699+0000 7f3a216be640 1 -- 172.21.15.62:0/3812861200 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3a1c00a4d0 con 0x7f3a1401ec20 2024-09-10T05:36:33.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.699+0000 7f3a216be640 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639d187a310 con 0x5639d1872780 2024-09-10T05:36:33.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.699+0000 7f3a20ebd640 1 -- 172.21.15.62:0/3812861200 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a14062050 con 0x5639d1872780 2024-09-10T05:36:33.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.699+0000 7f3a20ebd640 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639d187a310 con 0x5639d1875fb0 2024-09-10T05:36:33.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.699+0000 7f3a1bfff640 1 -- 172.21.15.62:0/3812861200 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a0c0a8070 con 0x5639d1875fb0 2024-09-10T05:36:33.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.699+0000 7f3a1bfff640 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639d187a310 con 0x5639d186e340 2024-09-10T05:36:33.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.699+0000 7f3a216be640 1 -- 172.21.15.62:0/3812861200 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a1c00a4d0 con 0x5639d186e340 2024-09-10T05:36:33.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.699+0000 7f3a216be640 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639d187a310 con 0x5639d1872780 2024-09-10T05:36:33.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.699+0000 7f3a20ebd640 1 -- 172.21.15.62:0/3812861200 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a14062050 con 0x5639d1872780 2024-09-10T05:36:33.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.699+0000 7f3a20ebd640 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639d187a310 con 0x5639d1875fb0 2024-09-10T05:36:33.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.699+0000 7f3a1bfff640 1 -- 172.21.15.62:0/3812861200 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 30 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f3a0c0a8070 con 0x5639d1875fb0 2024-09-10T05:36:33.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.699+0000 7f3a1bfff640 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639d187a310 con 0x5639d186e340 2024-09-10T05:36:33.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.699+0000 7f3a216be640 1 -- 172.21.15.62:0/3812861200 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a1c00a4d0 con 0x5639d186e340 2024-09-10T05:36:33.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.699+0000 7f3a216be640 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639d187a310 con 0x5639d186e340 2024-09-10T05:36:33.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.699+0000 7f3a216be640 1 -- 172.21.15.62:0/3812861200 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3a1c00a4d0 con 0x5639d186e340 2024-09-10T05:36:33.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.699+0000 7f3a216be640 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639d187a310 con 0x5639d186e340 2024-09-10T05:36:33.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.699+0000 7f3a216be640 1 -- 172.21.15.62:0/3812861200 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a1c00a4d0 con 0x5639d186e340 2024-09-10T05:36:33.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.699+0000 7f3a216be640 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639d187a310 con 0x5639d1875fb0 2024-09-10T05:36:33.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.699+0000 7f3a1bfff640 1 -- 172.21.15.62:0/3812861200 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a0c0a8070 con 0x5639d1875fb0 2024-09-10T05:36:33.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.699+0000 7f3a1bfff640 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639d187a310 con 0x7f3a1401ec20 2024-09-10T05:36:33.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.703+0000 7f3a216be640 1 -- 172.21.15.62:0/3812861200 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a1c00a4d0 con 0x7f3a1401ec20 2024-09-10T05:36:33.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.703+0000 7f3a216be640 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639d187a310 con 0x5639d186e340 2024-09-10T05:36:33.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.703+0000 7f3a216be640 1 -- 172.21.15.62:0/3812861200 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a1c00a4d0 con 0x5639d186e340 2024-09-10T05:36:33.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.703+0000 7f3a216be640 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639d187a310 con 0x7f3a1401ec20 2024-09-10T05:36:33.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.703+0000 7f3a216be640 1 -- 172.21.15.62:0/3812861200 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a1c00a4d0 con 0x7f3a1401ec20 2024-09-10T05:36:33.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.703+0000 7f3a216be640 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639d187a310 con 0x5639d1875fb0 2024-09-10T05:36:33.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.703+0000 7f3a1bfff640 1 -- 172.21.15.62:0/3812861200 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a0c0a8070 con 0x5639d1875fb0 2024-09-10T05:36:33.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.703+0000 7f3a1bfff640 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639d187a310 con 0x7f3a1401ec20 2024-09-10T05:36:33.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.703+0000 7f3a216be640 1 -- 172.21.15.62:0/3812861200 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a1c00a4d0 con 0x7f3a1401ec20 2024-09-10T05:36:33.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.703+0000 7f3a216be640 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639d187a310 con 0x5639d1872780 2024-09-10T05:36:33.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.703+0000 7f3a20ebd640 1 -- 172.21.15.62:0/3812861200 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a14062050 con 0x5639d1872780 2024-09-10T05:36:33.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.703+0000 7f3a20ebd640 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639d187a310 con 0x5639d1872780 2024-09-10T05:36:33.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.703+0000 7f3a20ebd640 1 -- 172.21.15.62:0/3812861200 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a14062050 con 0x5639d1872780 2024-09-10T05:36:33.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.703+0000 7f3a20ebd640 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639d187a310 con 0x5639d1875fb0 2024-09-10T05:36:33.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.703+0000 7f3a1bfff640 1 -- 172.21.15.62:0/3812861200 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a0c0a8070 con 0x5639d1875fb0 2024-09-10T05:36:33.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.703+0000 7f3a1bfff640 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639d187a310 con 0x5639d1872780 2024-09-10T05:36:33.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.703+0000 7f3a20ebd640 1 -- 172.21.15.62:0/3812861200 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3a14062050 con 0x5639d1872780 2024-09-10T05:36:33.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.703+0000 7f3a20ebd640 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639d187a310 con 0x5639d1872780 2024-09-10T05:36:33.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.703+0000 7f3a20ebd640 1 -- 172.21.15.62:0/3812861200 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a14062050 con 0x5639d1872780 2024-09-10T05:36:33.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.703+0000 7f3a233b79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:33.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.703+0000 7f3a233b79c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:33.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.703+0000 7f3a233b79c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:33.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.703+0000 7f3a233b79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:33.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.703+0000 7f3a233b79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:33.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.703+0000 7f3a233b79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:33.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.703+0000 7f3a233b79c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.703+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5639d1879400 con 0x5639d186e340 2024-09-10T05:36:33.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.707+0000 7f3a216be640 1 -- 172.21.15.62:0/3812861200 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3a1c00a4d0 con 0x5639d186e340 2024-09-10T05:36:33.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.707+0000 7f3a233b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:33.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.707+0000 7f3a233b79c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.707+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5639d1879850 con 0x5639d1872780 2024-09-10T05:36:33.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.707+0000 7f3a20ebd640 1 -- 172.21.15.62:0/3812861200 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3a14062050 con 0x5639d1872780 2024-09-10T05:36:33.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.707+0000 7f3a233b79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:33.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.707+0000 7f3a233b79c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.707+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5639d1879c70 con 0x5639d1875fb0 2024-09-10T05:36:33.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.707+0000 7f3a1bfff640 1 -- 172.21.15.62:0/3812861200 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3a0c0a8070 con 0x5639d1875fb0 2024-09-10T05:36:33.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.707+0000 7f3a233b79c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:33.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.707+0000 7f3a233b79c0 20 zone default found 2024-09-10T05:36:33.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.707+0000 7f3a233b79c0 4 Realm: () 2024-09-10T05:36:33.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.707+0000 7f3a233b79c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:33.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.707+0000 7f3a233b79c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:33.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.707+0000 7f3a233b79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:33.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.707+0000 7f3a233b79c0 20 zonegroup default 2024-09-10T05:36:33.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.707+0000 7f3a233b79c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.707+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5639d187a7c0 con 0x7f3a1401ec20 2024-09-10T05:36:33.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.707+0000 7f3a216be640 1 -- 172.21.15.62:0/3812861200 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3a1c00a4d0 con 0x7f3a1401ec20 2024-09-10T05:36:33.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.707+0000 7f3a233b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:33.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.707+0000 7f3a233b79c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.707+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5639d187ca80 con 0x5639d1875fb0 2024-09-10T05:36:33.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.707+0000 7f3a1bfff640 1 -- 172.21.15.62:0/3812861200 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3a0c0a8070 con 0x5639d1875fb0 2024-09-10T05:36:33.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.707+0000 7f3a233b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:33.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.707+0000 7f3a233b79c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.707+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5639d187ce50 con 0x5639d1875fb0 2024-09-10T05:36:33.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.707+0000 7f3a1bfff640 1 -- 172.21.15.62:0/3812861200 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3a0c0a8070 con 0x5639d1875fb0 2024-09-10T05:36:33.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.707+0000 7f3a233b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:33.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.707+0000 7f3a233b79c0 20 started sync module instance, tier type = 2024-09-10T05:36:33.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.707+0000 7f3a233b79c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:33.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.707+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5639d187bf10 con 0x5639d1872780 2024-09-10T05:36:33.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.711+0000 7f3a20ebd640 1 -- 172.21.15.62:0/3812861200 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a14062050 con 0x5639d1872780 2024-09-10T05:36:33.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.711+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94806328460304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5639d187bf10 con 0x5639d1872780 2024-09-10T05:36:33.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.711+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5639d187d930 con 0x5639d186e340 2024-09-10T05:36:33.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.711+0000 7f3a216be640 1 -- 172.21.15.62:0/3812861200 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a1c00a4d0 con 0x5639d186e340 2024-09-10T05:36:33.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.711+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94806328464416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5639d187e1d0 con 0x5639d186e340 2024-09-10T05:36:33.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.711+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5639d187ebf0 con 0x5639d1872780 2024-09-10T05:36:33.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.711+0000 7f3a20ebd640 1 -- 172.21.15.62:0/3812861200 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94806328460304] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a14062050 con 0x5639d1872780 2024-09-10T05:36:33.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.711+0000 7f3a216be640 1 -- 172.21.15.62:0/3812861200 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94806328464416] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a1c00a4d0 con 0x5639d186e340 2024-09-10T05:36:33.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.711+0000 7f3a20ebd640 1 -- 172.21.15.62:0/3812861200 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a14062050 con 0x5639d1872780 2024-09-10T05:36:33.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.711+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94806328469216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5639d187dd20 con 0x5639d1872780 2024-09-10T05:36:33.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.711+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5639d187f490 con 0x7f3a1401ec20 2024-09-10T05:36:33.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.715+0000 7f3a216be640 1 -- 172.21.15.62:0/3812861200 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a1c00a4d0 con 0x7f3a1401ec20 2024-09-10T05:36:33.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.715+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94806328471520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5639d187dd20 con 0x7f3a1401ec20 2024-09-10T05:36:33.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.715+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5639d187ff30 con 0x5639d1872780 2024-09-10T05:36:33.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.715+0000 7f3a216be640 1 -- 172.21.15.62:0/3812861200 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94806328471520] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a1c00a4d0 con 0x7f3a1401ec20 2024-09-10T05:36:33.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.715+0000 7f3a20ebd640 1 -- 172.21.15.62:0/3812861200 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94806328469216] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a14062050 con 0x5639d1872780 2024-09-10T05:36:33.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.715+0000 7f3a20ebd640 1 -- 172.21.15.62:0/3812861200 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a14062050 con 0x5639d1872780 2024-09-10T05:36:33.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.715+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94806328457824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5639d187fef0 con 0x5639d1872780 2024-09-10T05:36:33.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.715+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5639d1880320 con 0x5639d1875fb0 2024-09-10T05:36:33.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.715+0000 7f3a1bfff640 1 -- 172.21.15.62:0/3812861200 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a0c0a8070 con 0x5639d1875fb0 2024-09-10T05:36:33.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.715+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94806328472576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5639d1880320 con 0x5639d1875fb0 2024-09-10T05:36:33.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.715+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5639d1881220 con 0x5639d1875fb0 2024-09-10T05:36:33.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.715+0000 7f3a20ebd640 1 -- 172.21.15.62:0/3812861200 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94806328457824] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a14062050 con 0x5639d1872780 2024-09-10T05:36:33.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.719+0000 7f3a1bfff640 1 -- 172.21.15.62:0/3812861200 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94806328472576] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a0c0a8070 con 0x5639d1875fb0 2024-09-10T05:36:33.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.719+0000 7f3a1bfff640 1 -- 172.21.15.62:0/3812861200 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a0c0a8070 con 0x5639d1875fb0 2024-09-10T05:36:33.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.719+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94806328477456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5639d1880d30 con 0x5639d1875fb0 2024-09-10T05:36:33.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.719+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5639d1881ac0 con 0x7f3a1401ec20 2024-09-10T05:36:33.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.719+0000 7f3a1bfff640 1 -- 172.21.15.62:0/3812861200 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94806328477456] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a0c0a8070 con 0x5639d1875fb0 2024-09-10T05:36:33.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.719+0000 7f3a216be640 1 -- 172.21.15.62:0/3812861200 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a1c00a4d0 con 0x7f3a1401ec20 2024-09-10T05:36:33.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.719+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94806328474144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5639d1880d30 con 0x7f3a1401ec20 2024-09-10T05:36:33.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.719+0000 7f3a233b79c0 20 add_watcher() i=0 2024-09-10T05:36:33.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.719+0000 7f3a233b79c0 20 add_watcher() i=1 2024-09-10T05:36:33.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.719+0000 7f3a233b79c0 20 add_watcher() i=2 2024-09-10T05:36:33.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.719+0000 7f3a233b79c0 20 add_watcher() i=3 2024-09-10T05:36:33.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.719+0000 7f3a233b79c0 20 add_watcher() i=4 2024-09-10T05:36:33.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.719+0000 7f3a233b79c0 20 add_watcher() i=5 2024-09-10T05:36:33.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.719+0000 7f3a233b79c0 20 add_watcher() i=6 2024-09-10T05:36:33.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.719+0000 7f3a216be640 1 -- 172.21.15.62:0/3812861200 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94806328474144] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a1c00a4d0 con 0x7f3a1401ec20 2024-09-10T05:36:33.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.719+0000 7f3a233b79c0 20 add_watcher() i=7 2024-09-10T05:36:33.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.719+0000 7f3a233b79c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:33.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.719+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5639d1884bb0 con 0x5639d186e340 2024-09-10T05:36:33.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.719+0000 7f3a216be640 1 -- 172.21.15.62:0/3812861200 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3a1c00a4d0 con 0x5639d186e340 2024-09-10T05:36:33.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.719+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94806328481296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5639d1882140 con 0x5639d186e340 2024-09-10T05:36:33.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.723+0000 7f3a216be640 1 -- 172.21.15.62:0/3812861200 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94806328481296] v30'86 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3a1c00a4d0 con 0x5639d186e340 2024-09-10T05:36:33.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.723+0000 7f38d77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:33.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.723+0000 7f3a233b79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:33.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.723+0000 7f3a233b79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:33.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.723+0000 7f3a233b79c0 5 note: GC not initialized 2024-09-10T05:36:33.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.723+0000 7f38d67e4640 20 reqs_thread_entry: start 2024-09-10T05:36:33.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.723+0000 7f3a233b79c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:33.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.723+0000 7f3a233b79c0 20 Filter name: none 2024-09-10T05:36:33.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.723+0000 7f38cf7fe640 20 reqs_thread_entry: start 2024-09-10T05:36:33.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.723+0000 7f3a233b79c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.723+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5639d18a79e0 con 0x5639d186e340 2024-09-10T05:36:33.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.723+0000 7f3a216be640 1 -- 172.21.15.62:0/3812861200 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f3a1c00a4d0 con 0x5639d186e340 2024-09-10T05:36:33.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.723+0000 7f3a233b79c0 20 rados_obj.operate() r=0 bl.length=673 2024-09-10T05:36:33.730 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T05:36:30.893777Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-10T05:36:33.541095Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:36:30.893760Z","tags":[],"group_ids":[]} 2024-09-10T05:36:33.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.723+0000 7f38d77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:33.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.723+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94806328481296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5639d1868490 con 0x5639d186e340 2024-09-10T05:36:33.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.727+0000 7f3a216be640 1 -- 172.21.15.62:0/3812861200 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94806328481296] v30'87 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3a1c00a4d0 con 0x5639d186e340 2024-09-10T05:36:33.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.727+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94806328460304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5639d1881610 con 0x5639d1872780 2024-09-10T05:36:33.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.727+0000 7f3a20ebd640 1 -- 172.21.15.62:0/3812861200 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94806328460304] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a14062050 con 0x5639d1872780 2024-09-10T05:36:33.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.727+0000 7f3a233b79c0 20 remove_watcher() i=0 2024-09-10T05:36:33.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.727+0000 7f3a233b79c0 2 removed watcher, disabling cache 2024-09-10T05:36:33.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.727+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94806328464416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5639d1881610 con 0x5639d186e340 2024-09-10T05:36:33.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.731+0000 7f3a216be640 1 -- 172.21.15.62:0/3812861200 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94806328464416] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a1c00a4d0 con 0x5639d186e340 2024-09-10T05:36:33.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.731+0000 7f3a233b79c0 20 remove_watcher() i=1 2024-09-10T05:36:33.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.731+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94806328469216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5639d1881610 con 0x5639d1872780 2024-09-10T05:36:33.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.731+0000 7f3a20ebd640 1 -- 172.21.15.62:0/3812861200 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94806328469216] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a14062050 con 0x5639d1872780 2024-09-10T05:36:33.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.731+0000 7f3a233b79c0 20 remove_watcher() i=2 2024-09-10T05:36:33.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.731+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94806328471520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5639d1881610 con 0x7f3a1401ec20 2024-09-10T05:36:33.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.731+0000 7f3a216be640 1 -- 172.21.15.62:0/3812861200 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94806328471520] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a1c00a4d0 con 0x7f3a1401ec20 2024-09-10T05:36:33.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.731+0000 7f3a233b79c0 20 remove_watcher() i=3 2024-09-10T05:36:33.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.731+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94806328457824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5639d187efe0 con 0x5639d1872780 2024-09-10T05:36:33.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.735+0000 7f3a20ebd640 1 -- 172.21.15.62:0/3812861200 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94806328457824] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a14062050 con 0x5639d1872780 2024-09-10T05:36:33.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.735+0000 7f3a233b79c0 20 remove_watcher() i=4 2024-09-10T05:36:33.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.735+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94806328472576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5639d1881610 con 0x5639d1875fb0 2024-09-10T05:36:33.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.735+0000 7f3a1bfff640 1 -- 172.21.15.62:0/3812861200 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94806328472576] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a0c0a8070 con 0x5639d1875fb0 2024-09-10T05:36:33.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.735+0000 7f3a233b79c0 20 remove_watcher() i=5 2024-09-10T05:36:33.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.735+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94806328477456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5639d187ba60 con 0x5639d1875fb0 2024-09-10T05:36:33.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.735+0000 7f3a1bfff640 1 -- 172.21.15.62:0/3812861200 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94806328477456] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a0c0a8070 con 0x5639d1875fb0 2024-09-10T05:36:33.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.735+0000 7f3a233b79c0 20 remove_watcher() i=6 2024-09-10T05:36:33.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.735+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3812861200 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94806328474144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5639d187ba60 con 0x7f3a1401ec20 2024-09-10T05:36:33.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.735+0000 7f3a216be640 1 -- 172.21.15.62:0/3812861200 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94806328474144] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a1c00a4d0 con 0x7f3a1401ec20 2024-09-10T05:36:33.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.735+0000 7f3a233b79c0 20 remove_watcher() i=7 2024-09-10T05:36:33.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.739+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3812861200 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5639d1872780 msgr2=0x5639d1874b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.739+0000 7f3a233b79c0 1 --2- 172.21.15.62:0/3812861200 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5639d1872780 0x5639d1874b70 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.739+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3812861200 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5639d186e340 msgr2=0x5639d1870790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.739+0000 7f3a233b79c0 1 --2- 172.21.15.62:0/3812861200 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5639d186e340 0x5639d1870790 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.739+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3812861200 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f3a1401ec20 msgr2=0x7f3a140246b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.739+0000 7f3a233b79c0 1 --2- 172.21.15.62:0/3812861200 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f3a1401ec20 0x7f3a140246b0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.739+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3812861200 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5639d1875fb0 msgr2=0x5639d18783a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.739+0000 7f3a233b79c0 1 --2- 172.21.15.62:0/3812861200 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5639d1875fb0 0x5639d18783a0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.739+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3812861200 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f38ec039a20 msgr2=0x7f38ec03bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.739+0000 7f3a233b79c0 1 --2- 172.21.15.62:0/3812861200 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f38ec039a20 0x7f38ec03bee0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c0aa650 tx=0x7f3a0c0a8000 comp rx=0 tx=0).stop 2024-09-10T05:36:33.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.739+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3812861200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639d185d0e0 msgr2=0x5639d18633f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.739+0000 7f3a216be640 1 -- 172.21.15.62:0/3812861200 reap_dead start 2024-09-10T05:36:33.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.739+0000 7f3a233b79c0 1 --2- 172.21.15.62:0/3812861200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639d185d0e0 0x5639d18633f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3a14018790 tx=0x7f3a14014ee0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.739+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3812861200 shutdown_connections 2024-09-10T05:36:33.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.739+0000 7f3a233b79c0 1 --2- 172.21.15.62:0/3812861200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639d185d0e0 0x5639d18633f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.739+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3812861200 >> 172.21.15.62:0/3812861200 conn(0x5639d1858500 msgr2=0x5639d1856710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:33.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.739+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3812861200 shutdown_connections 2024-09-10T05:36:33.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.739+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3812861200 wait complete. 2024-09-10T05:36:33.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.739+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3885939204 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f38f8039ac0 msgr2=0x7f38f803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.739+0000 7f3a233b79c0 1 --2- 172.21.15.62:0/3885939204 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f38f8039ac0 0x7f38f803bf80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c000c10 tx=0x7f3a0c005a10 comp rx=0 tx=0).stop 2024-09-10T05:36:33.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.739+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3885939204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639d184fb40 msgr2=0x5639d184ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.739+0000 7f3a233b79c0 1 --2- 172.21.15.62:0/3885939204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639d184fb40 0x5639d184ff60 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3a1402cac0 tx=0x7f3a14018720 comp rx=0 tx=0).stop 2024-09-10T05:36:33.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.739+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3885939204 shutdown_connections 2024-09-10T05:36:33.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.739+0000 7f3a233b79c0 1 --2- 172.21.15.62:0/3885939204 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f38f8039ac0 0x7f38f803bf80 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.739+0000 7f3a233b79c0 1 --2- 172.21.15.62:0/3885939204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639d184fb40 0x5639d184ff60 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.739+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3885939204 >> 172.21.15.62:0/3885939204 conn(0x5639d18454f0 msgr2=0x5639d18458d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:33.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.739+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3885939204 shutdown_connections 2024-09-10T05:36:33.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.739+0000 7f3a233b79c0 1 -- 172.21.15.62:0/3885939204 wait complete. 2024-09-10T05:36:33.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.739+0000 7f3a233b79c0 1 -- 172.21.15.62:0/1660010032 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5639d183a060 msgr2=0x5639d183c520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.739+0000 7f3a233b79c0 1 --2- 172.21.15.62:0/1660010032 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5639d183a060 0x5639d183c520 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.739+0000 7f3a233b79c0 1 -- 172.21.15.62:0/1660010032 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5639d1743350 msgr2=0x5639d18390b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.739+0000 7f3a233b79c0 1 --2- 172.21.15.62:0/1660010032 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5639d1743350 0x5639d18390b0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.739+0000 7f3a233b79c0 1 -- 172.21.15.62:0/1660010032 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5639d183ea50 msgr2=0x5639d1840e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.739+0000 7f3a233b79c0 1 --2- 172.21.15.62:0/1660010032 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5639d183ea50 0x5639d1840e40 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.739+0000 7f3a233b79c0 1 -- 172.21.15.62:0/1660010032 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3908039ac0 msgr2=0x7f390803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.739+0000 7f3a233b79c0 1 --2- 172.21.15.62:0/1660010032 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3908039ac0 0x7f390803bf80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c0ae000 tx=0x7f3a0c0a6000 comp rx=0 tx=0).stop 2024-09-10T05:36:33.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.739+0000 7f3a233b79c0 1 -- 172.21.15.62:0/1660010032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639d173f200 msgr2=0x5639d1831f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.739+0000 7f3a233b79c0 1 --2- 172.21.15.62:0/1660010032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639d173f200 0x5639d1831f40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x5639d182b830 tx=0x7f3a14000bd0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.739+0000 7f3a216be640 1 -- 172.21.15.62:0/1660010032 reap_dead start 2024-09-10T05:36:33.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.739+0000 7f3a233b79c0 1 -- 172.21.15.62:0/1660010032 shutdown_connections 2024-09-10T05:36:33.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.739+0000 7f3a233b79c0 1 -- 172.21.15.62:0/1660010032 >> 172.21.15.62:0/1660010032 conn(0x5639d16b2b10 msgr2=0x5639d1824f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:33.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.739+0000 7f3a233b79c0 1 -- 172.21.15.62:0/1660010032 shutdown_connections 2024-09-10T05:36:33.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.739+0000 7f3a233b79c0 1 -- 172.21.15.62:0/1660010032 wait complete. 2024-09-10T05:36:33.751 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T05:36:30.893777Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-10T05:36:33.541095Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:36:30.893760Z', 'tags': [], 'group_ids': []} 2024-09-10T05:36:33.751 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-10T05:36:33.752 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-10T05:36:33.752 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2024-09-10T05:36:33.823 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:33.823 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:33.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.819+0000 7faee99539c0 1 Processor -- start 2024-09-10T05:36:33.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.819+0000 7faee99539c0 1 -- start start 2024-09-10T05:36:33.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.819+0000 7faee99539c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55f880e8c1f0 0x55f880e8c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.823+0000 7faee99539c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f880d3e9c0 con 0x55f880e8f330 2024-09-10T05:36:33.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.823+0000 7faee99539c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x55f880d8e6d0 con 0x55f880e8c1f0 2024-09-10T05:36:33.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.823+0000 7faee7459640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55f880e8c1f0 0x55f880e8c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.823+0000 7faee6c58640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x55f880e8f330 0x55f880e91720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:38640/0 (socket says 172.21.15.62:38640) 2024-09-10T05:36:33.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.823+0000 7faee7459640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55f880e8c1f0 0x55f880e8c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:52138/0 (socket says 172.21.15.62:52138) 2024-09-10T05:36:33.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.823+0000 7faee6c58640 1 -- 172.21.15.62:0/4021071927 learned_addr learned my addr 172.21.15.62:0/4021071927 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-10T05:36:33.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.823+0000 7faee7459640 1 -- 172.21.15.62:0/4021071927 >> v1:172.21.15.2:6789/0 conn(0x55f880e8f330 legacy=0x55f880e91720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.823+0000 7faee7459640 1 -- 172.21.15.62:0/4021071927 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f880d32ca0 con 0x55f880e8c1f0 2024-09-10T05:36:33.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.823+0000 7faee7459640 1 --2- 172.21.15.62:0/4021071927 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f880e8c1f0 0x55f880e8c5d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7faee000a420 tx=0x7faee001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=118efb15bdd12a06 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.823+0000 7faee6457640 1 -- 172.21.15.62:0/4021071927 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faee00af070 con 0x55f880e8c1f0 2024-09-10T05:36:33.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.823+0000 7faee6457640 1 -- 172.21.15.62:0/4021071927 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faee00aa530 con 0x55f880e8c1f0 2024-09-10T05:36:33.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.823+0000 7faee6457640 1 -- 172.21.15.62:0/4021071927 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faee00aa850 con 0x55f880e8c1f0 2024-09-10T05:36:33.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.827+0000 7faee99539c0 1 -- 172.21.15.62:0/4021071927 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f880e8c1f0 msgr2=0x55f880e8c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.827+0000 7faee99539c0 1 --2- 172.21.15.62:0/4021071927 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f880e8c1f0 0x55f880e8c5d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7faee000a420 tx=0x7faee001afd0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.827+0000 7faee99539c0 1 -- 172.21.15.62:0/4021071927 shutdown_connections 2024-09-10T05:36:33.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.827+0000 7faee99539c0 1 --2- 172.21.15.62:0/4021071927 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f880e8c1f0 0x55f880e8c5d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.827+0000 7faee99539c0 1 -- 172.21.15.62:0/4021071927 >> 172.21.15.62:0/4021071927 conn(0x55f880dffb00 msgr2=0x55f880dfff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:33.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.827+0000 7faee99539c0 1 -- 172.21.15.62:0/4021071927 shutdown_connections 2024-09-10T05:36:33.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.827+0000 7faee99539c0 1 -- 172.21.15.62:0/4021071927 wait complete. 2024-09-10T05:36:33.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.839+0000 7faee99539c0 1 Processor -- start 2024-09-10T05:36:33.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.839+0000 7faee99539c0 1 -- start start 2024-09-10T05:36:33.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.839+0000 7faee99539c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f880e8c1f0 0x55f880f77820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.839+0000 7faee99539c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f880d92680 con 0x55f880e8c1f0 2024-09-10T05:36:33.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.839+0000 7faee7459640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f880e8c1f0 0x55f880f77820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.839+0000 7faee7459640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f880e8c1f0 0x55f880f77820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:52152/0 (socket says 172.21.15.62:52152) 2024-09-10T05:36:33.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.839+0000 7faee7459640 1 -- 172.21.15.62:0/3561772537 learned_addr learned my addr 172.21.15.62:0/3561772537 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:33.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.839+0000 7faee7459640 1 -- 172.21.15.62:0/3561772537 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f880d0dda0 con 0x55f880e8c1f0 2024-09-10T05:36:33.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.839+0000 7faee7459640 1 --2- 172.21.15.62:0/3561772537 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f880e8c1f0 0x55f880f77820 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7faee0018c00 tx=0x7faee00033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24414cfb65455a0a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.839+0000 7fadd560a640 1 -- 172.21.15.62:0/3561772537 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faee00af040 con 0x55f880e8c1f0 2024-09-10T05:36:33.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.839+0000 7fadd560a640 1 -- 172.21.15.62:0/3561772537 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faee00aaa00 con 0x55f880e8c1f0 2024-09-10T05:36:33.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.839+0000 7fadd560a640 1 -- 172.21.15.62:0/3561772537 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faee00aace0 con 0x55f880e8c1f0 2024-09-10T05:36:33.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.843+0000 7faee99539c0 1 -- 172.21.15.62:0/3561772537 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f880e8c1f0 msgr2=0x55f880f77820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.843+0000 7faee99539c0 1 --2- 172.21.15.62:0/3561772537 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f880e8c1f0 0x55f880f77820 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7faee0018c00 tx=0x7faee00033b0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.843+0000 7faee99539c0 1 -- 172.21.15.62:0/3561772537 shutdown_connections 2024-09-10T05:36:33.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.843+0000 7faee99539c0 1 --2- 172.21.15.62:0/3561772537 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f880e8c1f0 0x55f880f77820 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.843+0000 7faee99539c0 1 -- 172.21.15.62:0/3561772537 >> 172.21.15.62:0/3561772537 conn(0x55f880dffb00 msgr2=0x55f880f734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:33.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.843+0000 7faee99539c0 1 -- 172.21.15.62:0/3561772537 shutdown_connections 2024-09-10T05:36:33.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.843+0000 7faee99539c0 1 -- 172.21.15.62:0/3561772537 wait complete. 2024-09-10T05:36:33.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.843+0000 7faee99539c0 1 Processor -- start 2024-09-10T05:36:33.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.843+0000 7faee99539c0 1 -- start start 2024-09-10T05:36:33.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.843+0000 7faee99539c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f880e8c1f0 0x55f880f7ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.843+0000 7faee99539c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f880d34a50 con 0x55f880e8c1f0 2024-09-10T05:36:33.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.843+0000 7faee7459640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f880e8c1f0 0x55f880f7ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.843+0000 7faee7459640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f880e8c1f0 0x55f880f7ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:52156/0 (socket says 172.21.15.62:52156) 2024-09-10T05:36:33.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.843+0000 7faee7459640 1 -- 172.21.15.62:0/4067538613 learned_addr learned my addr 172.21.15.62:0/4067538613 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:33.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.843+0000 7faee7459640 1 -- 172.21.15.62:0/4067538613 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f880f7f2e0 con 0x55f880e8c1f0 2024-09-10T05:36:33.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.843+0000 7faee7459640 1 --2- 172.21.15.62:0/4067538613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f880e8c1f0 0x55f880f7ed80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7faee0018c00 tx=0x7faee0017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.843+0000 7fadd3e07640 1 -- 172.21.15.62:0/4067538613 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faee00c5070 con 0x55f880e8c1f0 2024-09-10T05:36:33.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.843+0000 7faee99539c0 1 -- 172.21.15.62:0/4067538613 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f880f7f570 con 0x55f880e8c1f0 2024-09-10T05:36:33.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.843+0000 7faee99539c0 1 -- 172.21.15.62:0/4067538613 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f880f7ffa0 con 0x55f880e8c1f0 2024-09-10T05:36:33.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.843+0000 7fadd3e07640 1 -- 172.21.15.62:0/4067538613 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faee00c1690 con 0x55f880e8c1f0 2024-09-10T05:36:33.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.843+0000 7fadd3e07640 1 -- 172.21.15.62:0/4067538613 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faee00c1970 con 0x55f880e8c1f0 2024-09-10T05:36:33.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.843+0000 7fadd3e07640 1 -- 172.21.15.62:0/4067538613 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7faee00c1b10 con 0x55f880e8c1f0 2024-09-10T05:36:33.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.847+0000 7fadd3e07640 1 --2- 172.21.15.62:0/4067538613 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fadcc039ac0 0x7fadcc03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.847+0000 7fadd3e07640 1 -- 172.21.15.62:0/4067538613 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7faee00bb070 con 0x55f880e8c1f0 2024-09-10T05:36:33.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.847+0000 7faee6c58640 1 --2- 172.21.15.62:0/4067538613 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fadcc039ac0 0x7fadcc03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.847+0000 7faee99539c0 1 --2- 172.21.15.62:0/4067538613 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55f880e8f330 0x55f880f85ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.847+0000 7faee99539c0 1 -- 172.21.15.62:0/4067538613 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f880f86430 con 0x55f880e8f330 2024-09-10T05:36:33.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.847+0000 7faee7c5a640 1 --2- 172.21.15.62:0/4067538613 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55f880e8f330 0x55f880f85ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.847+0000 7faee6c58640 1 --2- 172.21.15.62:0/4067538613 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fadcc039ac0 0x7fadcc03bf80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7faedc004180 tx=0x7faedc001340 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.847+0000 7faee7c5a640 1 --2- 172.21.15.62:0/4067538613 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55f880e8f330 0x55f880f85ef0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.847+0000 7faee7c5a640 1 -- 172.21.15.62:0/4067538613 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faed80083f0 con 0x55f880e8f330 2024-09-10T05:36:33.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.847+0000 7faee99539c0 1 --2- 172.21.15.62:0/4067538613 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55f880f86ea0 0x55f880f89340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.847+0000 7faee99539c0 1 -- 172.21.15.62:0/4067538613 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f880f89ab0 con 0x55f880f86ea0 2024-09-10T05:36:33.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.847+0000 7faee7459640 1 --2- 172.21.15.62:0/4067538613 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55f880f86ea0 0x55f880f89340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.847+0000 7faee7459640 1 --2- 172.21.15.62:0/4067538613 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55f880f86ea0 0x55f880f89340 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.847+0000 7faee7459640 1 -- 172.21.15.62:0/4067538613 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faee00c7070 con 0x55f880f86ea0 2024-09-10T05:36:33.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.847+0000 7faee99539c0 1 --2- 172.21.15.62:0/4067538613 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55f880f8b870 0x55f880f8dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.847+0000 7faee99539c0 1 -- 172.21.15.62:0/4067538613 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f880f8e350 con 0x55f880f8b870 2024-09-10T05:36:33.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.847+0000 7faee6c58640 1 --2- 172.21.15.62:0/4067538613 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55f880f8b870 0x55f880f8dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.847+0000 7faee6c58640 1 --2- 172.21.15.62:0/4067538613 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55f880f8b870 0x55f880f8dc60 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.847+0000 7faee6c58640 1 -- 172.21.15.62:0/4067538613 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7faedc00e6c0 con 0x55f880f8b870 2024-09-10T05:36:33.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.847+0000 7faee99539c0 1 -- 172.21.15.62:0/4067538613 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f880f8a710 con 0x55f880f86ea0 2024-09-10T05:36:33.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.851+0000 7faee7459640 1 -- 172.21.15.62:0/4067538613 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faee00c7070 con 0x55f880f86ea0 2024-09-10T05:36:33.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.851+0000 7faee99539c0 1 -- 172.21.15.62:0/4067538613 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f880f8ab70 con 0x55f880f8b870 2024-09-10T05:36:33.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.851+0000 7faee6c58640 1 -- 172.21.15.62:0/4067538613 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7faedc00e6c0 con 0x55f880f8b870 2024-09-10T05:36:33.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.851+0000 7faee99539c0 1 Processor -- start 2024-09-10T05:36:33.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.851+0000 7faee99539c0 1 -- start start 2024-09-10T05:36:33.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.851+0000 7faee99539c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f880f9c9e0 0x55f880f9ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.851+0000 7faee99539c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f880d9f450 con 0x55f880f9c9e0 2024-09-10T05:36:33.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.851+0000 7faee7459640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f880f9c9e0 0x55f880f9ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.851+0000 7faee7459640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f880f9c9e0 0x55f880f9ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:52160/0 (socket says 172.21.15.62:52160) 2024-09-10T05:36:33.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.851+0000 7faee7459640 1 -- 172.21.15.62:0/320704578 learned_addr learned my addr 172.21.15.62:0/320704578 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:33.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.851+0000 7faee7459640 1 -- 172.21.15.62:0/320704578 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f880f9d440 con 0x55f880f9c9e0 2024-09-10T05:36:33.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.851+0000 7faee7459640 1 --2- 172.21.15.62:0/320704578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f880f9c9e0 0x55f880f9ce00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7faee00bf860 tx=0x7faee00bf430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.851+0000 7fadd1602640 1 -- 172.21.15.62:0/320704578 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faee00b3a30 con 0x55f880f9c9e0 2024-09-10T05:36:33.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.851+0000 7faee99539c0 1 -- 172.21.15.62:0/320704578 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f880f9dca0 con 0x55f880f9c9e0 2024-09-10T05:36:33.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.851+0000 7fadd1602640 1 -- 172.21.15.62:0/320704578 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faee00b3bd0 con 0x55f880f9c9e0 2024-09-10T05:36:33.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.851+0000 7fadd1602640 1 -- 172.21.15.62:0/320704578 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faee00b3dc0 con 0x55f880f9c9e0 2024-09-10T05:36:33.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.851+0000 7faee99539c0 1 -- 172.21.15.62:0/320704578 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f880f9e210 con 0x55f880f9c9e0 2024-09-10T05:36:33.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.855+0000 7fadd1602640 1 -- 172.21.15.62:0/320704578 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7faee00b3370 con 0x55f880f9c9e0 2024-09-10T05:36:33.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.855+0000 7fadd1602640 1 --2- 172.21.15.62:0/320704578 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fadc0039a70 0x7fadc003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.855+0000 7fadd1602640 1 -- 172.21.15.62:0/320704578 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7faee00ca020 con 0x55f880f9c9e0 2024-09-10T05:36:33.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.855+0000 7faee6c58640 1 --2- 172.21.15.62:0/320704578 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fadc0039a70 0x7fadc003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.855+0000 7faee99539c0 1 Processor -- start 2024-09-10T05:36:33.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.855+0000 7faee99539c0 1 -- start start 2024-09-10T05:36:33.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.855+0000 7faee6c58640 1 --2- 172.21.15.62:0/320704578 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fadc0039a70 0x7fadc003bf30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7faedc00c010 tx=0x7faedc00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.855+0000 7faee99539c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f880faa170 0x55f880faa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.855+0000 7faee99539c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f880f77fb0 con 0x55f880faa170 2024-09-10T05:36:33.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.855+0000 7faee7459640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f880faa170 0x55f880faa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.855+0000 7faee7459640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f880faa170 0x55f880faa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:52162/0 (socket says 172.21.15.62:52162) 2024-09-10T05:36:33.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.855+0000 7faee7459640 1 -- 172.21.15.62:0/2834232965 learned_addr learned my addr 172.21.15.62:0/2834232965 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:33.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.855+0000 7faee7459640 1 -- 172.21.15.62:0/2834232965 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f880faab60 con 0x55f880faa170 2024-09-10T05:36:33.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.855+0000 7faee7459640 1 --2- 172.21.15.62:0/2834232965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f880faa170 0x55f880faa570 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7faee00b4ab0 tx=0x7faee00ed1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a126a3e55b1c27f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.855+0000 7fadcaffd640 1 -- 172.21.15.62:0/2834232965 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faee00c03e0 con 0x55f880faa170 2024-09-10T05:36:33.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.855+0000 7fadcaffd640 1 -- 172.21.15.62:0/2834232965 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faee00b4750 con 0x55f880faa170 2024-09-10T05:36:33.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.855+0000 7fadcaffd640 1 -- 172.21.15.62:0/2834232965 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faee00c0580 con 0x55f880faa170 2024-09-10T05:36:33.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.855+0000 7faee99539c0 1 -- 172.21.15.62:0/2834232965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f880faa170 msgr2=0x55f880faa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.855+0000 7faee99539c0 1 --2- 172.21.15.62:0/2834232965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f880faa170 0x55f880faa570 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7faee00b4ab0 tx=0x7faee00ed1c0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.855+0000 7faee99539c0 1 -- 172.21.15.62:0/2834232965 shutdown_connections 2024-09-10T05:36:33.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.855+0000 7faee99539c0 1 --2- 172.21.15.62:0/2834232965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f880faa170 0x55f880faa570 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.855+0000 7faee99539c0 1 -- 172.21.15.62:0/2834232965 >> 172.21.15.62:0/2834232965 conn(0x55f880fa5590 msgr2=0x55f880fa37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:33.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.855+0000 7faee99539c0 1 -- 172.21.15.62:0/2834232965 shutdown_connections 2024-09-10T05:36:33.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.855+0000 7faee99539c0 1 -- 172.21.15.62:0/2834232965 wait complete. 2024-09-10T05:36:33.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.855+0000 7faee99539c0 1 Processor -- start 2024-09-10T05:36:33.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.855+0000 7faee99539c0 1 -- start start 2024-09-10T05:36:33.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.855+0000 7faee99539c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f880faa170 0x55f880fb0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.855+0000 7faee99539c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f880fa8f40 con 0x55f880faa170 2024-09-10T05:36:33.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.855+0000 7faee7459640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f880faa170 0x55f880fb0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.855+0000 7faee7459640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f880faa170 0x55f880fb0540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:52168/0 (socket says 172.21.15.62:52168) 2024-09-10T05:36:33.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.855+0000 7faee7459640 1 -- 172.21.15.62:0/870529907 learned_addr learned my addr 172.21.15.62:0/870529907 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:33.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.859+0000 7faee7459640 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f880fb0aa0 con 0x55f880faa170 2024-09-10T05:36:33.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.859+0000 7faee7459640 1 --2- 172.21.15.62:0/870529907 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f880faa170 0x55f880fb0540 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7faee00c1f50 tx=0x7faee00b1ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.859+0000 7fadc97fa640 1 -- 172.21.15.62:0/870529907 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faee0110070 con 0x55f880faa170 2024-09-10T05:36:33.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.859+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f880fb0aa0 con 0x55f880faa170 2024-09-10T05:36:33.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.859+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f880fb0aa0 con 0x55f880faa170 2024-09-10T05:36:33.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.859+0000 7fadc97fa640 1 -- 172.21.15.62:0/870529907 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faee00e97a0 con 0x55f880faa170 2024-09-10T05:36:33.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.859+0000 7fadc97fa640 1 -- 172.21.15.62:0/870529907 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faee00e9a80 con 0x55f880faa170 2024-09-10T05:36:33.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.859+0000 7fadc97fa640 1 -- 172.21.15.62:0/870529907 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7faee0113070 con 0x55f880faa170 2024-09-10T05:36:33.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.859+0000 7faee99539c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.859+0000 7fadc97fa640 1 --2- 172.21.15.62:0/870529907 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fadb0039a70 0x7fadb003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.859+0000 7fadc97fa640 1 -- 172.21.15.62:0/870529907 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7faee0118120 con 0x55f880faa170 2024-09-10T05:36:33.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.859+0000 7faee6c58640 1 --2- 172.21.15.62:0/870529907 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fadb0039a70 0x7fadb003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.859+0000 7faee99539c0 1 --2- 172.21.15.62:0/870529907 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55f880fbb470 0x55f880fbd900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.859+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f880fbe050 con 0x55f880fbb470 2024-09-10T05:36:33.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.859+0000 7faee7c5a640 1 --2- 172.21.15.62:0/870529907 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55f880fbb470 0x55f880fbd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.859+0000 7faee6c58640 1 --2- 172.21.15.62:0/870529907 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fadb0039a70 0x7fadb003bf30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7faedc00efd0 tx=0x7faedc010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.859+0000 7faee7c5a640 1 --2- 172.21.15.62:0/870529907 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55f880fbb470 0x55f880fbd900 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.859+0000 7faee7c5a640 1 -- 172.21.15.62:0/870529907 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faed80083f0 con 0x55f880fbb470 2024-09-10T05:36:33.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.859+0000 7faee99539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:33.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.859+0000 7faee99539c0 20 realm 2024-09-10T05:36:33.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.859+0000 7faee99539c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.859+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f880fba7c0 con 0x55f880fbb470 2024-09-10T05:36:33.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.859+0000 7faee7c5a640 1 -- 172.21.15.62:0/870529907 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faed80083f0 con 0x55f880fbb470 2024-09-10T05:36:33.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.859+0000 7faee99539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:33.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.859+0000 7faee99539c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:33.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.859+0000 7faee99539c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.859+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f880fbeb10 con 0x55f880fbb470 2024-09-10T05:36:33.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.859+0000 7faee7c5a640 1 -- 172.21.15.62:0/870529907 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faed80083f0 con 0x55f880fbb470 2024-09-10T05:36:33.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.859+0000 7faee99539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:33.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.863+0000 7faee99539c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.863+0000 7faee99539c0 1 --2- 172.21.15.62:0/870529907 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55f880fbf8f0 0x55f880fc1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.863+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f880fc23b0 con 0x55f880fbf8f0 2024-09-10T05:36:33.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.863+0000 7faee7459640 1 --2- 172.21.15.62:0/870529907 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55f880fbf8f0 0x55f880fc1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.863+0000 7faee7459640 1 --2- 172.21.15.62:0/870529907 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55f880fbf8f0 0x55f880fc1ce0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.863+0000 7faee7459640 1 -- 172.21.15.62:0/870529907 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faee0112030 con 0x55f880fbf8f0 2024-09-10T05:36:33.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.863+0000 7faee99539c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:33.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.863+0000 7faee99539c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.863+0000 7faee99539c0 1 --2- 172.21.15.62:0/870529907 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55f880fc3110 0x55f880fc5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.863+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f880fc5cb0 con 0x55f880fc3110 2024-09-10T05:36:33.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.863+0000 7faee6c58640 1 --2- 172.21.15.62:0/870529907 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55f880fc3110 0x55f880fc5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.863+0000 7faee6c58640 1 --2- 172.21.15.62:0/870529907 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55f880fc3110 0x55f880fc5520 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.863+0000 7faee6c58640 1 -- 172.21.15.62:0/870529907 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7faedc026070 con 0x55f880fc3110 2024-09-10T05:36:33.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.863+0000 7faee99539c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:33.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.863+0000 7faee99539c0 20 searching for the correct realm 2024-09-10T05:36:33.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.863+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f880fc7580 con 0x55f880fc3110 2024-09-10T05:36:33.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.863+0000 7faee6c58640 1 -- 172.21.15.62:0/870529907 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faedc026070 con 0x55f880fc3110 2024-09-10T05:36:33.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.863+0000 7faee6c58640 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f880fc7580 con 0x55f880fbf8f0 2024-09-10T05:36:33.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.863+0000 7faee7459640 1 -- 172.21.15.62:0/870529907 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faee0112030 con 0x55f880fbf8f0 2024-09-10T05:36:33.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.863+0000 7faee7459640 1 --2- 172.21.15.62:0/870529907 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7faee0115060 0x7faee00f8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:33.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.863+0000 7faee7459640 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f880fc7580 con 0x7faee0115060 2024-09-10T05:36:33.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.863+0000 7faee7c5a640 1 --2- 172.21.15.62:0/870529907 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7faee0115060 0x7faee00f8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:33.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.863+0000 7faee7c5a640 1 --2- 172.21.15.62:0/870529907 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7faee0115060 0x7faee00f8760 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:33.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.867+0000 7faee7c5a640 1 -- 172.21.15.62:0/870529907 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faed80083f0 con 0x7faee0115060 2024-09-10T05:36:33.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.867+0000 7faee7c5a640 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f880fc7580 con 0x55f880fbb470 2024-09-10T05:36:33.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.867+0000 7faee7c5a640 1 -- 172.21.15.62:0/870529907 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faed80083f0 con 0x55f880fbb470 2024-09-10T05:36:33.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.867+0000 7faee7c5a640 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f880fc7580 con 0x55f880fbb470 2024-09-10T05:36:33.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.867+0000 7faee7c5a640 1 -- 172.21.15.62:0/870529907 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faed80083f0 con 0x55f880fbb470 2024-09-10T05:36:33.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.867+0000 7faee7c5a640 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f880fc7580 con 0x55f880fc3110 2024-09-10T05:36:33.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.867+0000 7faee6c58640 1 -- 172.21.15.62:0/870529907 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faedc026070 con 0x55f880fc3110 2024-09-10T05:36:33.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.867+0000 7faee6c58640 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f880fc7580 con 0x55f880fbb470 2024-09-10T05:36:33.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.867+0000 7faee7c5a640 1 -- 172.21.15.62:0/870529907 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faed80083f0 con 0x55f880fbb470 2024-09-10T05:36:33.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.867+0000 7faee7c5a640 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f880fc7580 con 0x55f880fbf8f0 2024-09-10T05:36:33.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.867+0000 7faee7459640 1 -- 172.21.15.62:0/870529907 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faee0112030 con 0x55f880fbf8f0 2024-09-10T05:36:33.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.867+0000 7faee7459640 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f880fc7580 con 0x55f880fbf8f0 2024-09-10T05:36:33.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.867+0000 7faee7459640 1 -- 172.21.15.62:0/870529907 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faee0112030 con 0x55f880fbf8f0 2024-09-10T05:36:33.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.867+0000 7faee7459640 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f880fc7580 con 0x55f880fbb470 2024-09-10T05:36:33.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.867+0000 7faee7c5a640 1 -- 172.21.15.62:0/870529907 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faed80083f0 con 0x55f880fbb470 2024-09-10T05:36:33.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.867+0000 7faee7c5a640 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f880fc7580 con 0x7faee0115060 2024-09-10T05:36:33.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.867+0000 7faee7c5a640 1 -- 172.21.15.62:0/870529907 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faed80083f0 con 0x7faee0115060 2024-09-10T05:36:33.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.867+0000 7faee7c5a640 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f880fc7580 con 0x55f880fbb470 2024-09-10T05:36:33.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.867+0000 7faee7c5a640 1 -- 172.21.15.62:0/870529907 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faed80083f0 con 0x55f880fbb470 2024-09-10T05:36:33.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.867+0000 7faee7c5a640 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f880fc7580 con 0x7faee0115060 2024-09-10T05:36:33.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.867+0000 7faee7c5a640 1 -- 172.21.15.62:0/870529907 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7faed80083f0 con 0x7faee0115060 2024-09-10T05:36:33.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.867+0000 7faee7c5a640 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f880fc7580 con 0x55f880fbf8f0 2024-09-10T05:36:33.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.871+0000 7faee7459640 1 -- 172.21.15.62:0/870529907 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faee0112030 con 0x55f880fbf8f0 2024-09-10T05:36:33.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.871+0000 7faee7459640 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f880fc7580 con 0x55f880fc3110 2024-09-10T05:36:33.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.871+0000 7faee6c58640 1 -- 172.21.15.62:0/870529907 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faedc026070 con 0x55f880fc3110 2024-09-10T05:36:33.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.871+0000 7faee6c58640 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f880fc7580 con 0x55f880fbb470 2024-09-10T05:36:33.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.871+0000 7faee7c5a640 1 -- 172.21.15.62:0/870529907 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faed80083f0 con 0x55f880fbb470 2024-09-10T05:36:33.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.871+0000 7faee7c5a640 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f880fc7580 con 0x55f880fbf8f0 2024-09-10T05:36:33.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.871+0000 7faee7459640 1 -- 172.21.15.62:0/870529907 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faee0112030 con 0x55f880fbf8f0 2024-09-10T05:36:33.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.871+0000 7faee7459640 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f880fc7580 con 0x55f880fc3110 2024-09-10T05:36:33.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.871+0000 7faee6c58640 1 -- 172.21.15.62:0/870529907 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 30 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7faedc026070 con 0x55f880fc3110 2024-09-10T05:36:33.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.871+0000 7faee6c58640 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f880fc7580 con 0x55f880fbb470 2024-09-10T05:36:33.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.871+0000 7faee7c5a640 1 -- 172.21.15.62:0/870529907 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faed80083f0 con 0x55f880fbb470 2024-09-10T05:36:33.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.871+0000 7faee7c5a640 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f880fc7580 con 0x55f880fbb470 2024-09-10T05:36:33.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.871+0000 7faee7c5a640 1 -- 172.21.15.62:0/870529907 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7faed80083f0 con 0x55f880fbb470 2024-09-10T05:36:33.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.871+0000 7faee7c5a640 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f880fc7580 con 0x55f880fbb470 2024-09-10T05:36:33.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.871+0000 7faee7c5a640 1 -- 172.21.15.62:0/870529907 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faed80083f0 con 0x55f880fbb470 2024-09-10T05:36:33.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.871+0000 7faee7c5a640 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f880fc7580 con 0x55f880fc3110 2024-09-10T05:36:33.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.871+0000 7faee6c58640 1 -- 172.21.15.62:0/870529907 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faedc026070 con 0x55f880fc3110 2024-09-10T05:36:33.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.871+0000 7faee6c58640 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f880fc7580 con 0x7faee0115060 2024-09-10T05:36:33.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.871+0000 7faee7c5a640 1 -- 172.21.15.62:0/870529907 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faed80083f0 con 0x7faee0115060 2024-09-10T05:36:33.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.871+0000 7faee7c5a640 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f880fc7580 con 0x55f880fbb470 2024-09-10T05:36:33.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.871+0000 7faee7c5a640 1 -- 172.21.15.62:0/870529907 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faed80083f0 con 0x55f880fbb470 2024-09-10T05:36:33.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.871+0000 7faee7c5a640 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f880fc7580 con 0x7faee0115060 2024-09-10T05:36:33.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.871+0000 7faee7c5a640 1 -- 172.21.15.62:0/870529907 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faed80083f0 con 0x7faee0115060 2024-09-10T05:36:33.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.871+0000 7faee7c5a640 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f880fc7580 con 0x55f880fc3110 2024-09-10T05:36:33.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.871+0000 7faee6c58640 1 -- 172.21.15.62:0/870529907 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faedc026070 con 0x55f880fc3110 2024-09-10T05:36:33.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.871+0000 7faee6c58640 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f880fc7580 con 0x7faee0115060 2024-09-10T05:36:33.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.871+0000 7faee7c5a640 1 -- 172.21.15.62:0/870529907 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faed80083f0 con 0x7faee0115060 2024-09-10T05:36:33.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.871+0000 7faee7c5a640 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f880fc7580 con 0x55f880fbf8f0 2024-09-10T05:36:33.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.875+0000 7faee7459640 1 -- 172.21.15.62:0/870529907 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faee0112030 con 0x55f880fbf8f0 2024-09-10T05:36:33.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.875+0000 7faee7459640 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f880fc7580 con 0x55f880fbf8f0 2024-09-10T05:36:33.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.875+0000 7faee7459640 1 -- 172.21.15.62:0/870529907 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faee0112030 con 0x55f880fbf8f0 2024-09-10T05:36:33.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.875+0000 7faee7459640 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f880fc7580 con 0x55f880fc3110 2024-09-10T05:36:33.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.875+0000 7faee6c58640 1 -- 172.21.15.62:0/870529907 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faedc026070 con 0x55f880fc3110 2024-09-10T05:36:33.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.875+0000 7faee6c58640 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f880fc7580 con 0x55f880fbf8f0 2024-09-10T05:36:33.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.875+0000 7faee7459640 1 -- 172.21.15.62:0/870529907 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7faee0112030 con 0x55f880fbf8f0 2024-09-10T05:36:33.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.875+0000 7faee7459640 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f880fc7580 con 0x55f880fbf8f0 2024-09-10T05:36:33.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.875+0000 7faee7459640 1 -- 172.21.15.62:0/870529907 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faee0112030 con 0x55f880fbf8f0 2024-09-10T05:36:33.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.875+0000 7faee99539c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:33.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.875+0000 7faee99539c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:33.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.875+0000 7faee99539c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:33.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.875+0000 7faee99539c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:33.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.875+0000 7faee99539c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:33.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.875+0000 7faee99539c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:33.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.875+0000 7faee99539c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.875+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f880fc6670 con 0x55f880fbb470 2024-09-10T05:36:33.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.875+0000 7faee7c5a640 1 -- 172.21.15.62:0/870529907 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faed80083f0 con 0x55f880fbb470 2024-09-10T05:36:33.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.875+0000 7faee99539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:33.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.875+0000 7faee99539c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.875+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f880fc6ec0 con 0x55f880fbf8f0 2024-09-10T05:36:33.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.875+0000 7faee7459640 1 -- 172.21.15.62:0/870529907 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faee0112030 con 0x55f880fbf8f0 2024-09-10T05:36:33.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.875+0000 7faee99539c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:33.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.875+0000 7faee99539c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.875+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f880fc62b0 con 0x55f880fc3110 2024-09-10T05:36:33.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.875+0000 7faee6c58640 1 -- 172.21.15.62:0/870529907 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7faedc026070 con 0x55f880fc3110 2024-09-10T05:36:33.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.875+0000 7faee99539c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:33.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.875+0000 7faee99539c0 20 zone default found 2024-09-10T05:36:33.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.875+0000 7faee99539c0 4 Realm: () 2024-09-10T05:36:33.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.875+0000 7faee99539c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:33.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.875+0000 7faee99539c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:33.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.875+0000 7faee99539c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:33.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.875+0000 7faee99539c0 20 zonegroup default 2024-09-10T05:36:33.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.875+0000 7faee99539c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.875+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f880fc7e60 con 0x7faee0115060 2024-09-10T05:36:33.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.879+0000 7faee7c5a640 1 -- 172.21.15.62:0/870529907 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7faed80083f0 con 0x7faee0115060 2024-09-10T05:36:33.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.879+0000 7faee99539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:33.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.879+0000 7faee99539c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.879+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f880fca0a0 con 0x55f880fc3110 2024-09-10T05:36:33.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.879+0000 7faee6c58640 1 -- 172.21.15.62:0/870529907 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faedc026070 con 0x55f880fc3110 2024-09-10T05:36:33.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.879+0000 7faee99539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:33.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.879+0000 7faee99539c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.879+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f880fca440 con 0x55f880fc3110 2024-09-10T05:36:33.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.879+0000 7faee6c58640 1 -- 172.21.15.62:0/870529907 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faedc026070 con 0x55f880fc3110 2024-09-10T05:36:33.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.879+0000 7faee99539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:33.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.879+0000 7faee99539c0 20 started sync module instance, tier type = 2024-09-10T05:36:33.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.879+0000 7faee99539c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:33.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.879+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f880fc94e0 con 0x55f880fbf8f0 2024-09-10T05:36:33.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.879+0000 7faee7459640 1 -- 172.21.15.62:0/870529907 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faee0112030 con 0x55f880fbf8f0 2024-09-10T05:36:33.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.879+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94525804288512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f880fc94e0 con 0x55f880fbf8f0 2024-09-10T05:36:33.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.879+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f880fcae00 con 0x55f880fbb470 2024-09-10T05:36:33.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.879+0000 7faee7c5a640 1 -- 172.21.15.62:0/870529907 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faed80083f0 con 0x55f880fbb470 2024-09-10T05:36:33.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.879+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94525804292432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f880fcb650 con 0x55f880fbb470 2024-09-10T05:36:33.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.879+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f880fcc050 con 0x55f880fbf8f0 2024-09-10T05:36:33.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.883+0000 7faee7459640 1 -- 172.21.15.62:0/870529907 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94525804288512] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faee0112030 con 0x55f880fbf8f0 2024-09-10T05:36:33.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.883+0000 7faee7c5a640 1 -- 172.21.15.62:0/870529907 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94525804292432] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faed80083f0 con 0x55f880fbb470 2024-09-10T05:36:33.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.883+0000 7faee7459640 1 -- 172.21.15.62:0/870529907 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faee0112030 con 0x55f880fbf8f0 2024-09-10T05:36:33.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.883+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94525804286000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f880fcb1a0 con 0x55f880fbf8f0 2024-09-10T05:36:33.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.883+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f880fcc8f0 con 0x7faee0115060 2024-09-10T05:36:33.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.883+0000 7faee7c5a640 1 -- 172.21.15.62:0/870529907 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faed80083f0 con 0x7faee0115060 2024-09-10T05:36:33.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.883+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94525804299328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f880fcb1a0 con 0x7faee0115060 2024-09-10T05:36:33.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.883+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f880fcd390 con 0x55f880fbf8f0 2024-09-10T05:36:33.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.883+0000 7faee7c5a640 1 -- 172.21.15.62:0/870529907 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94525804299328] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faed80083f0 con 0x7faee0115060 2024-09-10T05:36:33.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.887+0000 7faee7459640 1 -- 172.21.15.62:0/870529907 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94525804286000] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faee0112030 con 0x55f880fbf8f0 2024-09-10T05:36:33.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.887+0000 7faee7459640 1 -- 172.21.15.62:0/870529907 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faee0112030 con 0x55f880fbf8f0 2024-09-10T05:36:33.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.887+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94525804297056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f880fcd350 con 0x55f880fbf8f0 2024-09-10T05:36:33.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.887+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f880fcd780 con 0x55f880fc3110 2024-09-10T05:36:33.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.887+0000 7faee6c58640 1 -- 172.21.15.62:0/870529907 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faedc026070 con 0x55f880fc3110 2024-09-10T05:36:33.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.887+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94525804300384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f880fcd780 con 0x55f880fc3110 2024-09-10T05:36:33.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.887+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f880fce6c0 con 0x55f880fc3110 2024-09-10T05:36:33.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.887+0000 7faee7459640 1 -- 172.21.15.62:0/870529907 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94525804297056] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faee0112030 con 0x55f880fbf8f0 2024-09-10T05:36:33.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.887+0000 7faee6c58640 1 -- 172.21.15.62:0/870529907 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94525804300384] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faedc026070 con 0x55f880fc3110 2024-09-10T05:36:33.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.887+0000 7faee6c58640 1 -- 172.21.15.62:0/870529907 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faedc026070 con 0x55f880fc3110 2024-09-10T05:36:33.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.887+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94525804305264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f880fcce80 con 0x55f880fc3110 2024-09-10T05:36:33.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.887+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f880fceb70 con 0x7faee0115060 2024-09-10T05:36:33.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.887+0000 7faee6c58640 1 -- 172.21.15.62:0/870529907 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94525804305264] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faedc026070 con 0x55f880fc3110 2024-09-10T05:36:33.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.891+0000 7faee7c5a640 1 -- 172.21.15.62:0/870529907 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faed80083f0 con 0x7faee0115060 2024-09-10T05:36:33.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.891+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94525804306832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f880fceb30 con 0x7faee0115060 2024-09-10T05:36:33.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.891+0000 7faee99539c0 20 add_watcher() i=0 2024-09-10T05:36:33.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.891+0000 7faee99539c0 20 add_watcher() i=1 2024-09-10T05:36:33.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.891+0000 7faee99539c0 20 add_watcher() i=2 2024-09-10T05:36:33.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.891+0000 7faee99539c0 20 add_watcher() i=3 2024-09-10T05:36:33.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.891+0000 7faee99539c0 20 add_watcher() i=4 2024-09-10T05:36:33.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.891+0000 7faee99539c0 20 add_watcher() i=5 2024-09-10T05:36:33.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.891+0000 7faee99539c0 20 add_watcher() i=6 2024-09-10T05:36:33.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.891+0000 7faee7c5a640 1 -- 172.21.15.62:0/870529907 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94525804306832] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faed80083f0 con 0x7faee0115060 2024-09-10T05:36:33.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.891+0000 7faee99539c0 20 add_watcher() i=7 2024-09-10T05:36:33.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.891+0000 7faee99539c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:33.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.891+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f880fd1f90 con 0x55f880fbb470 2024-09-10T05:36:33.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.891+0000 7faee7c5a640 1 -- 172.21.15.62:0/870529907 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7faed80083f0 con 0x55f880fbb470 2024-09-10T05:36:33.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.891+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94525804308640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f880fcf510 con 0x55f880fbb470 2024-09-10T05:36:33.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.891+0000 7faee7c5a640 1 -- 172.21.15.62:0/870529907 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94525804308640] v30'88 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faed80083f0 con 0x55f880fbb470 2024-09-10T05:36:33.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.891+0000 7fad9e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:33.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.891+0000 7faee99539c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:33.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.891+0000 7faee99539c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:33.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.891+0000 7faee99539c0 5 note: GC not initialized 2024-09-10T05:36:33.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.891+0000 7fad9d7e2640 20 reqs_thread_entry: start 2024-09-10T05:36:33.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.895+0000 7faee99539c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:33.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.895+0000 7faee99539c0 20 Filter name: none 2024-09-10T05:36:33.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.895+0000 7fad967fc640 20 reqs_thread_entry: start 2024-09-10T05:36:33.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.895+0000 7faee99539c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T05:36:33.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.895+0000 7faee99539c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:33.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.895+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f880ff5230 con 0x55f880fbb470 2024-09-10T05:36:33.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.895+0000 7faee7c5a640 1 -- 172.21.15.62:0/870529907 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7faed80083f0 con 0x55f880fbb470 2024-09-10T05:36:33.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.895+0000 7faee99539c0 20 rados_obj.operate() r=0 bl.length=673 2024-09-10T05:36:33.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.895+0000 7faee99539c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T05:36:33.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.895+0000 7faee99539c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:36:33.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.895+0000 7faee99539c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:36:33.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.895+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f880ffbd20 con 0x55f880fbb470 2024-09-10T05:36:33.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.895+0000 7faee7c5a640 1 -- 172.21.15.62:0/870529907 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~582] v30'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7faed80083f0 con 0x55f880fbb470 2024-09-10T05:36:33.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.895+0000 7faee99539c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:36:33.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.895+0000 7faee99539c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:36:33.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.895+0000 7faee99539c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T05:36:33.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.895+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94525804492816 in=770b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f880ff74f0 con 0x55f880fbf8f0 2024-09-10T05:36:33.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.895+0000 7faee7459640 1 -- 172.21.15.62:0/870529907 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== watch-notify(notify (1) cookie 94525804297056 notify 128849018892 ret 0) ==== 800+0+0 (crc 0 0 0) 0x55f880f9dca0 con 0x55f880fbf8f0 2024-09-10T05:36:33.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.895+0000 7fadcaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018892 cookie 94525804297056 notifier 4402 bl.length()=758 2024-09-10T05:36:33.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.895+0000 7faee7459640 1 -- 172.21.15.62:0/870529907 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(64 notify.4 [notify cookie 94525804492816 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7faee0112030 con 0x55f880fbf8f0 2024-09-10T05:36:33.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.895+0000 7fadcaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:36:33.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.895+0000 7fadcaffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:36:33.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.895+0000 7fadcaffd640 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fadac003eb0 con 0x55f880fbf8f0 2024-09-10T05:36:33.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.895+0000 7faee7459640 1 -- 172.21.15.62:0/870529907 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faee0112030 con 0x55f880fbf8f0 2024-09-10T05:36:33.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.895+0000 7faee7459640 1 -- 172.21.15.62:0/870529907 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== watch-notify(notify_complete (2) cookie 94525804492816 notify 128849018892 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f880f9d440 con 0x55f880fbf8f0 2024-09-10T05:36:33.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.895+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:66 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f880ffb810 con 0x55f880fbb470 2024-09-10T05:36:33.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.899+0000 7faee7c5a640 1 -- 172.21.15.62:0/870529907 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(66 foo:foo1 [delete] v30'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faed80083f0 con 0x55f880fbb470 2024-09-10T05:36:33.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.899+0000 7faee99539c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-10T05:36:33.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.899+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94525804492816 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f880ff7040 con 0x55f880fbf8f0 2024-09-10T05:36:33.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.899+0000 7faee7459640 1 -- 172.21.15.62:0/870529907 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== watch-notify(notify (1) cookie 94525804288512 notify 128849018893 ret 0) ==== 201+0+0 (crc 0 0 0) 0x55f880f9d440 con 0x55f880fbf8f0 2024-09-10T05:36:33.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.899+0000 7fadca7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018893 cookie 94525804288512 notifier 4402 bl.length()=159 2024-09-10T05:36:33.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.899+0000 7faee7459640 1 -- 172.21.15.62:0/870529907 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(67 notify.0 [notify cookie 94525804492816 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7faee0112030 con 0x55f880fbf8f0 2024-09-10T05:36:33.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.899+0000 7fadca7fc640 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fad100032d0 con 0x55f880fbf8f0 2024-09-10T05:36:33.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.899+0000 7faee7459640 1 -- 172.21.15.62:0/870529907 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== watch-notify(notify_complete (2) cookie 94525804492816 notify 128849018893 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f880f7ffa0 con 0x55f880fbf8f0 2024-09-10T05:36:33.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.899+0000 7faee7459640 1 -- 172.21.15.62:0/870529907 <== osd.0 v2:172.21.15.2:6800/945139080 25 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faee0112030 con 0x55f880fbf8f0 2024-09-10T05:36:33.903 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T05:36:30.893777Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-10T05:36:33.541095Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:36:30.893760Z","tags":[],"group_ids":[]} 2024-09-10T05:36:33.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.899+0000 7fad9e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:33.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.899+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94525804308640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f880ff5f70 con 0x55f880fbb470 2024-09-10T05:36:33.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.903+0000 7faee7c5a640 1 -- 172.21.15.62:0/870529907 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94525804308640] v30'89 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faed80083f0 con 0x55f880fbb470 2024-09-10T05:36:33.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.903+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94525804288512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f880fce820 con 0x55f880fbf8f0 2024-09-10T05:36:33.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.903+0000 7faee7459640 1 -- 172.21.15.62:0/870529907 <== osd.0 v2:172.21.15.2:6800/945139080 26 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94525804288512] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faee0112030 con 0x55f880fbf8f0 2024-09-10T05:36:33.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.903+0000 7faee99539c0 20 remove_watcher() i=0 2024-09-10T05:36:33.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.903+0000 7faee99539c0 2 removed watcher, disabling cache 2024-09-10T05:36:33.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.903+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94525804292432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f880ff7cb0 con 0x55f880fbb470 2024-09-10T05:36:33.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.903+0000 7faee7c5a640 1 -- 172.21.15.62:0/870529907 <== osd.1 v2:172.21.15.62:6808/3442097179 23 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94525804292432] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faed80083f0 con 0x55f880fbb470 2024-09-10T05:36:33.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.903+0000 7faee99539c0 20 remove_watcher() i=1 2024-09-10T05:36:33.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.903+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94525804286000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f880ff7cb0 con 0x55f880fbf8f0 2024-09-10T05:36:33.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.907+0000 7faee7459640 1 -- 172.21.15.62:0/870529907 <== osd.0 v2:172.21.15.2:6800/945139080 27 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94525804286000] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faee0112030 con 0x55f880fbf8f0 2024-09-10T05:36:33.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.907+0000 7faee99539c0 20 remove_watcher() i=2 2024-09-10T05:36:33.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.907+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94525804299328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f880ff7cb0 con 0x7faee0115060 2024-09-10T05:36:33.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.907+0000 7faee7c5a640 1 -- 172.21.15.62:0/870529907 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94525804299328] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faed80083f0 con 0x7faee0115060 2024-09-10T05:36:33.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.907+0000 7faee99539c0 20 remove_watcher() i=3 2024-09-10T05:36:33.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.907+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94525804297056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f880ff7cb0 con 0x55f880fbf8f0 2024-09-10T05:36:33.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.911+0000 7faee7459640 1 -- 172.21.15.62:0/870529907 <== osd.0 v2:172.21.15.2:6800/945139080 28 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94525804297056] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faee0112030 con 0x55f880fbf8f0 2024-09-10T05:36:33.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.911+0000 7faee99539c0 20 remove_watcher() i=4 2024-09-10T05:36:33.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.911+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94525804300384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f880ff7cb0 con 0x55f880fc3110 2024-09-10T05:36:33.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.911+0000 7faee6c58640 1 -- 172.21.15.62:0/870529907 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94525804300384] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faedc026070 con 0x55f880fc3110 2024-09-10T05:36:33.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.911+0000 7faee99539c0 20 remove_watcher() i=5 2024-09-10T05:36:33.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.911+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94525804305264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f880ff7cb0 con 0x55f880fc3110 2024-09-10T05:36:33.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.911+0000 7faee6c58640 1 -- 172.21.15.62:0/870529907 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94525804305264] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faedc026070 con 0x55f880fc3110 2024-09-10T05:36:33.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.911+0000 7faee99539c0 20 remove_watcher() i=6 2024-09-10T05:36:33.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.911+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94525804306832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f880fca950 con 0x7faee0115060 2024-09-10T05:36:33.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.911+0000 7faee7c5a640 1 -- 172.21.15.62:0/870529907 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94525804306832] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faed80083f0 con 0x7faee0115060 2024-09-10T05:36:33.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.911+0000 7faee99539c0 20 remove_watcher() i=7 2024-09-10T05:36:33.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.911+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55f880fbf8f0 msgr2=0x55f880fc1ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.911+0000 7faee99539c0 1 --2- 172.21.15.62:0/870529907 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55f880fbf8f0 0x55f880fc1ce0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.911+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55f880fbb470 msgr2=0x55f880fbd900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.911+0000 7faee99539c0 1 --2- 172.21.15.62:0/870529907 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55f880fbb470 0x55f880fbd900 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.911+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7faee0115060 msgr2=0x7faee00f8760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.911+0000 7faee99539c0 1 --2- 172.21.15.62:0/870529907 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7faee0115060 0x7faee00f8760 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.911+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55f880fc3110 msgr2=0x55f880fc5520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.911+0000 7faee99539c0 1 --2- 172.21.15.62:0/870529907 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55f880fc3110 0x55f880fc5520 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.911+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fadb0039a70 msgr2=0x7fadb003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.911+0000 7faee99539c0 1 --2- 172.21.15.62:0/870529907 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fadb0039a70 0x7fadb003bf30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7faedc00efd0 tx=0x7faedc010000 comp rx=0 tx=0).stop 2024-09-10T05:36:33.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.911+0000 7faee7c5a640 1 -- 172.21.15.62:0/870529907 reap_dead start 2024-09-10T05:36:33.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.911+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f880faa170 msgr2=0x55f880fb0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.911+0000 7faee99539c0 1 --2- 172.21.15.62:0/870529907 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f880faa170 0x55f880fb0540 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7faee00c1f50 tx=0x7faee00b1ec0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.911+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 shutdown_connections 2024-09-10T05:36:33.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.911+0000 7faee99539c0 1 --2- 172.21.15.62:0/870529907 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f880faa170 0x55f880fb0540 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.911+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 >> 172.21.15.62:0/870529907 conn(0x55f880fa5590 msgr2=0x55f880fa37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:33.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.911+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 shutdown_connections 2024-09-10T05:36:33.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.911+0000 7faee99539c0 1 -- 172.21.15.62:0/870529907 wait complete. 2024-09-10T05:36:33.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.911+0000 7faee99539c0 1 -- 172.21.15.62:0/320704578 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fadc0039a70 msgr2=0x7fadc003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.911+0000 7faee99539c0 1 --2- 172.21.15.62:0/320704578 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fadc0039a70 0x7fadc003bf30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7faedc00c010 tx=0x7faedc00f000 comp rx=0 tx=0).stop 2024-09-10T05:36:33.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.911+0000 7faee99539c0 1 -- 172.21.15.62:0/320704578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f880f9c9e0 msgr2=0x55f880f9ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.911+0000 7faee99539c0 1 --2- 172.21.15.62:0/320704578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f880f9c9e0 0x55f880f9ce00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7faee00bf860 tx=0x7faee00bf430 comp rx=0 tx=0).stop 2024-09-10T05:36:33.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.911+0000 7faee99539c0 1 -- 172.21.15.62:0/320704578 shutdown_connections 2024-09-10T05:36:33.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.911+0000 7faee99539c0 1 --2- 172.21.15.62:0/320704578 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fadc0039a70 0x7fadc003bf30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.911+0000 7faee99539c0 1 --2- 172.21.15.62:0/320704578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f880f9c9e0 0x55f880f9ce00 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.911+0000 7faee99539c0 1 -- 172.21.15.62:0/320704578 >> 172.21.15.62:0/320704578 conn(0x55f880f92390 msgr2=0x55f880f92770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:33.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.915+0000 7faee99539c0 1 -- 172.21.15.62:0/320704578 shutdown_connections 2024-09-10T05:36:33.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.915+0000 7faee99539c0 1 -- 172.21.15.62:0/320704578 wait complete. 2024-09-10T05:36:33.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.915+0000 7faee99539c0 1 -- 172.21.15.62:0/4067538613 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55f880f86ea0 msgr2=0x55f880f89340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.915+0000 7faee99539c0 1 --2- 172.21.15.62:0/4067538613 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55f880f86ea0 0x55f880f89340 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.915+0000 7faee99539c0 1 -- 172.21.15.62:0/4067538613 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55f880e8f330 msgr2=0x55f880f85ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.915+0000 7faee99539c0 1 --2- 172.21.15.62:0/4067538613 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55f880e8f330 0x55f880f85ef0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.915+0000 7faee99539c0 1 -- 172.21.15.62:0/4067538613 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55f880f8b870 msgr2=0x55f880f8dc60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.915+0000 7faee99539c0 1 --2- 172.21.15.62:0/4067538613 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55f880f8b870 0x55f880f8dc60 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:33.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.915+0000 7faee99539c0 1 -- 172.21.15.62:0/4067538613 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fadcc039ac0 msgr2=0x7fadcc03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.915+0000 7faee99539c0 1 --2- 172.21.15.62:0/4067538613 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fadcc039ac0 0x7fadcc03bf80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7faedc004180 tx=0x7faedc001340 comp rx=0 tx=0).stop 2024-09-10T05:36:33.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.915+0000 7faee99539c0 1 -- 172.21.15.62:0/4067538613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f880e8c1f0 msgr2=0x55f880f7ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:33.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.915+0000 7faee99539c0 1 --2- 172.21.15.62:0/4067538613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f880e8c1f0 0x55f880f7ed80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7faee0018c00 tx=0x7faee0017d70 comp rx=0 tx=0).stop 2024-09-10T05:36:33.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.915+0000 7faee7c5a640 1 -- 172.21.15.62:0/4067538613 reap_dead start 2024-09-10T05:36:33.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.915+0000 7faee99539c0 1 -- 172.21.15.62:0/4067538613 shutdown_connections 2024-09-10T05:36:33.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.915+0000 7faee99539c0 1 -- 172.21.15.62:0/4067538613 >> 172.21.15.62:0/4067538613 conn(0x55f880dffb00 msgr2=0x55f880f71f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:33.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.915+0000 7faee99539c0 1 -- 172.21.15.62:0/4067538613 shutdown_connections 2024-09-10T05:36:33.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.915+0000 7faee99539c0 1 -- 172.21.15.62:0/4067538613 wait complete. 2024-09-10T05:36:33.926 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T05:36:30.893777Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-10T05:36:33.541095Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:36:30.893760Z', 'tags': [], 'group_ids': []} 2024-09-10T05:36:33.926 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-10T05:36:33.927 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-10T05:36:33.927 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2024-09-10T05:36:34.003 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:34.003 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:34.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.999+0000 7f67d0e2b9c0 1 Processor -- start 2024-09-10T05:36:34.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.999+0000 7f67d0e2b9c0 1 -- start start 2024-09-10T05:36:34.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.999+0000 7f67d0e2b9c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5639fa86e020 0x5639fa86cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.999+0000 7f67d0e2b9c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5639fa7ab9c0 con 0x5639fa86daf0 2024-09-10T05:36:34.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:33.999+0000 7f67d0e2b9c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x5639fa7fb6d0 con 0x5639fa86e020 2024-09-10T05:36:34.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.003+0000 7f67ce130640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5639fa86e020 0x5639fa86cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.003+0000 7f67ce931640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x5639fa86daf0 0x5639fa86c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:38650/0 (socket says 172.21.15.62:38650) 2024-09-10T05:36:34.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.003+0000 7f67ce931640 1 -- 172.21.15.62:0/1596152765 learned_addr learned my addr 172.21.15.62:0/1596152765 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-10T05:36:34.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.003+0000 7f67cd92f640 1 -- 172.21.15.62:0/1596152765 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 231939745 0 0) 0x5639fa7ab9c0 con 0x5639fa86daf0 2024-09-10T05:36:34.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.003+0000 7f67cd92f640 1 -- 172.21.15.62:0/1596152765 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67b8001e20 con 0x5639fa86daf0 2024-09-10T05:36:34.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.003+0000 7f67ce130640 1 -- 172.21.15.62:0/1596152765 >> v1:172.21.15.2:6789/0 conn(0x5639fa86daf0 legacy=0x5639fa86c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.003+0000 7f67ce130640 1 -- 172.21.15.62:0/1596152765 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639fa79fca0 con 0x5639fa86e020 2024-09-10T05:36:34.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.003+0000 7f67ce130640 1 --2- 172.21.15.62:0/1596152765 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639fa86e020 0x5639fa86cba0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f67c400a480 tx=0x7f67c401b220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e95460119f90fe6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.003+0000 7f67cd92f640 1 -- 172.21.15.62:0/1596152765 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67c40af070 con 0x5639fa86e020 2024-09-10T05:36:34.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.003+0000 7f67cd92f640 1 -- 172.21.15.62:0/1596152765 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67c40aa570 con 0x5639fa86e020 2024-09-10T05:36:34.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.003+0000 7f67cd92f640 1 -- 172.21.15.62:0/1596152765 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67c40aa850 con 0x5639fa86e020 2024-09-10T05:36:34.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.003+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/1596152765 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639fa86e020 msgr2=0x5639fa86cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.003+0000 7f67d0e2b9c0 1 --2- 172.21.15.62:0/1596152765 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639fa86e020 0x5639fa86cba0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f67c400a480 tx=0x7f67c401b220 comp rx=0 tx=0).stop 2024-09-10T05:36:34.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.003+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/1596152765 shutdown_connections 2024-09-10T05:36:34.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.003+0000 7f67d0e2b9c0 1 --2- 172.21.15.62:0/1596152765 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639fa86e020 0x5639fa86cba0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.007+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/1596152765 >> 172.21.15.62:0/1596152765 conn(0x5639fa8f2ad0 msgr2=0x5639fa8f4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:34.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.007+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/1596152765 shutdown_connections 2024-09-10T05:36:34.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.007+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/1596152765 wait complete. 2024-09-10T05:36:34.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.019+0000 7f67d0e2b9c0 1 Processor -- start 2024-09-10T05:36:34.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.019+0000 7f67d0e2b9c0 1 -- start start 2024-09-10T05:36:34.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.019+0000 7f67d0e2b9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639fa86daf0 0x5639fa9e4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.019+0000 7f67d0e2b9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5639fa7ff680 con 0x5639fa86daf0 2024-09-10T05:36:34.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.019+0000 7f67ce931640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639fa86daf0 0x5639fa9e4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.019+0000 7f67ce931640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639fa86daf0 0x5639fa9e4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:52174/0 (socket says 172.21.15.62:52174) 2024-09-10T05:36:34.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.019+0000 7f67ce931640 1 -- 172.21.15.62:0/3729505265 learned_addr learned my addr 172.21.15.62:0/3729505265 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:34.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.019+0000 7f67ce931640 1 -- 172.21.15.62:0/3729505265 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639fa77ada0 con 0x5639fa86daf0 2024-09-10T05:36:34.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.019+0000 7f67ce931640 1 --2- 172.21.15.62:0/3729505265 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639fa86daf0 0x5639fa9e4950 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f67c0001e40 tx=0x7f67c000b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20fff4590406d1e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.019+0000 7f66bce09640 1 -- 172.21.15.62:0/3729505265 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67c0012020 con 0x5639fa86daf0 2024-09-10T05:36:34.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.019+0000 7f66bce09640 1 -- 172.21.15.62:0/3729505265 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67c000e690 con 0x5639fa86daf0 2024-09-10T05:36:34.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.019+0000 7f66bce09640 1 -- 172.21.15.62:0/3729505265 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67c000e9b0 con 0x5639fa86daf0 2024-09-10T05:36:34.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.019+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/3729505265 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639fa86daf0 msgr2=0x5639fa9e4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.019+0000 7f67d0e2b9c0 1 --2- 172.21.15.62:0/3729505265 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639fa86daf0 0x5639fa9e4950 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f67c0001e40 tx=0x7f67c000b790 comp rx=0 tx=0).stop 2024-09-10T05:36:34.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.019+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/3729505265 shutdown_connections 2024-09-10T05:36:34.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.019+0000 7f67d0e2b9c0 1 --2- 172.21.15.62:0/3729505265 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639fa86daf0 0x5639fa9e4950 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.019+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/3729505265 >> 172.21.15.62:0/3729505265 conn(0x5639fa8f2ad0 msgr2=0x5639fa9e05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:34.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.019+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/3729505265 shutdown_connections 2024-09-10T05:36:34.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.019+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/3729505265 wait complete. 2024-09-10T05:36:34.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.019+0000 7f67d0e2b9c0 1 Processor -- start 2024-09-10T05:36:34.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.019+0000 7f67d0e2b9c0 1 -- start start 2024-09-10T05:36:34.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.019+0000 7f67d0e2b9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639fa86daf0 0x5639fa9ebfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.019+0000 7f67d0e2b9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5639fa7a1a50 con 0x5639fa86daf0 2024-09-10T05:36:34.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.023+0000 7f67ce931640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639fa86daf0 0x5639fa9ebfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.023+0000 7f67ce931640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639fa86daf0 0x5639fa9ebfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:52184/0 (socket says 172.21.15.62:52184) 2024-09-10T05:36:34.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.023+0000 7f67ce931640 1 -- 172.21.15.62:0/2933412174 learned_addr learned my addr 172.21.15.62:0/2933412174 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:34.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.023+0000 7f67ce931640 1 -- 172.21.15.62:0/2933412174 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639fa9ec540 con 0x5639fa86daf0 2024-09-10T05:36:34.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.023+0000 7f67ce931640 1 --2- 172.21.15.62:0/2933412174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639fa86daf0 0x5639fa9ebfe0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f67c0004180 tx=0x7f67c00040f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.023+0000 7f66bb606640 1 -- 172.21.15.62:0/2933412174 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67c0012030 con 0x5639fa86daf0 2024-09-10T05:36:34.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.023+0000 7f66bb606640 1 -- 172.21.15.62:0/2933412174 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67c001a7f0 con 0x5639fa86daf0 2024-09-10T05:36:34.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.023+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/2933412174 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5639fa9ec7d0 con 0x5639fa86daf0 2024-09-10T05:36:34.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.023+0000 7f66bb606640 1 -- 172.21.15.62:0/2933412174 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67c001aaf0 con 0x5639fa86daf0 2024-09-10T05:36:34.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.023+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/2933412174 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639fa9ed180 con 0x5639fa86daf0 2024-09-10T05:36:34.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.023+0000 7f66bb606640 1 -- 172.21.15.62:0/2933412174 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f67c0015020 con 0x5639fa86daf0 2024-09-10T05:36:34.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.023+0000 7f66bb606640 1 --2- 172.21.15.62:0/2933412174 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f66b4039a00 0x7f66b403bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.023+0000 7f66bb606640 1 -- 172.21.15.62:0/2933412174 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f67c0020070 con 0x5639fa86daf0 2024-09-10T05:36:34.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.023+0000 7f67ce130640 1 --2- 172.21.15.62:0/2933412174 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f66b4039a00 0x7f66b403bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.023+0000 7f67d0e2b9c0 1 --2- 172.21.15.62:0/2933412174 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5639fa86e020 0x5639fa9f3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.023+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/2933412174 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5639fa9f3690 con 0x5639fa86e020 2024-09-10T05:36:34.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.023+0000 7f67cf132640 1 --2- 172.21.15.62:0/2933412174 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5639fa86e020 0x5639fa9f3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.023+0000 7f67ce130640 1 --2- 172.21.15.62:0/2933412174 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f66b4039a00 0x7f66b403bec0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f67c40ac000 tx=0x7f67c40a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.023+0000 7f67cf132640 1 --2- 172.21.15.62:0/2933412174 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5639fa86e020 0x5639fa9f3150 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.023+0000 7f67cf132640 1 -- 172.21.15.62:0/2933412174 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f67c800a4d0 con 0x5639fa86e020 2024-09-10T05:36:34.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.023+0000 7f67d0e2b9c0 1 --2- 172.21.15.62:0/2933412174 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5639fa9f4100 0x5639fa9f65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.023+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/2933412174 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5639fa9f6d30 con 0x5639fa9f4100 2024-09-10T05:36:34.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.027+0000 7f67ce931640 1 --2- 172.21.15.62:0/2933412174 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5639fa9f4100 0x5639fa9f65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.027+0000 7f67ce931640 1 --2- 172.21.15.62:0/2933412174 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5639fa9f4100 0x5639fa9f65c0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.027+0000 7f67ce931640 1 -- 172.21.15.62:0/2933412174 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f67c0008030 con 0x5639fa9f4100 2024-09-10T05:36:34.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.027+0000 7f67d0e2b9c0 1 --2- 172.21.15.62:0/2933412174 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5639fa9f8af0 0x5639fa9faee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.027+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/2933412174 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5639fa9fb5b0 con 0x5639fa9f8af0 2024-09-10T05:36:34.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.027+0000 7f67ce130640 1 --2- 172.21.15.62:0/2933412174 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5639fa9f8af0 0x5639fa9faee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.027+0000 7f67ce130640 1 --2- 172.21.15.62:0/2933412174 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5639fa9f8af0 0x5639fa9faee0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.027+0000 7f67ce130640 1 -- 172.21.15.62:0/2933412174 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f67c40a8070 con 0x5639fa9f8af0 2024-09-10T05:36:34.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.027+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/2933412174 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5639fa9f7990 con 0x5639fa9f4100 2024-09-10T05:36:34.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.027+0000 7f67ce931640 1 -- 172.21.15.62:0/2933412174 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f67c0008030 con 0x5639fa9f4100 2024-09-10T05:36:34.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.027+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/2933412174 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5639fa9f7dd0 con 0x5639fa9f8af0 2024-09-10T05:36:34.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.027+0000 7f67ce130640 1 -- 172.21.15.62:0/2933412174 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f67c40a8070 con 0x5639fa9f8af0 2024-09-10T05:36:34.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.027+0000 7f67d0e2b9c0 1 Processor -- start 2024-09-10T05:36:34.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.027+0000 7f67d0e2b9c0 1 -- start start 2024-09-10T05:36:34.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.027+0000 7f67d0e2b9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639faa09c20 0x5639faa0a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.027+0000 7f67d0e2b9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5639fa80c450 con 0x5639faa09c20 2024-09-10T05:36:34.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.031+0000 7f67ce931640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639faa09c20 0x5639faa0a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.031+0000 7f67ce931640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639faa09c20 0x5639faa0a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:52190/0 (socket says 172.21.15.62:52190) 2024-09-10T05:36:34.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.031+0000 7f67ce931640 1 -- 172.21.15.62:0/2909608907 learned_addr learned my addr 172.21.15.62:0/2909608907 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:34.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.031+0000 7f67ce931640 1 -- 172.21.15.62:0/2909608907 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639faa0a680 con 0x5639faa09c20 2024-09-10T05:36:34.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.031+0000 7f67ce931640 1 --2- 172.21.15.62:0/2909608907 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639faa09c20 0x5639faa0a040 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f67c004eae0 tx=0x7f67c0040ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.031+0000 7f66b8e01640 1 -- 172.21.15.62:0/2909608907 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67c0047a50 con 0x5639faa09c20 2024-09-10T05:36:34.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.031+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/2909608907 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5639faa0aee0 con 0x5639faa09c20 2024-09-10T05:36:34.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.031+0000 7f66b8e01640 1 -- 172.21.15.62:0/2909608907 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67c0047bf0 con 0x5639faa09c20 2024-09-10T05:36:34.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.031+0000 7f66b8e01640 1 -- 172.21.15.62:0/2909608907 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67c0047ed0 con 0x5639faa09c20 2024-09-10T05:36:34.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.031+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/2909608907 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639faa0b450 con 0x5639faa09c20 2024-09-10T05:36:34.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.031+0000 7f66b8e01640 1 -- 172.21.15.62:0/2909608907 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f67c0009070 con 0x5639faa09c20 2024-09-10T05:36:34.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.031+0000 7f66b8e01640 1 --2- 172.21.15.62:0/2909608907 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f66a80399b0 0x7f66a803be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.031+0000 7f66b8e01640 1 -- 172.21.15.62:0/2909608907 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f67c0047050 con 0x5639faa09c20 2024-09-10T05:36:34.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.031+0000 7f67ce130640 1 --2- 172.21.15.62:0/2909608907 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f66a80399b0 0x7f66a803be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.031+0000 7f67d0e2b9c0 1 Processor -- start 2024-09-10T05:36:34.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.031+0000 7f67d0e2b9c0 1 -- start start 2024-09-10T05:36:34.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.031+0000 7f67d0e2b9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639faa163e0 0x5639faa167c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.031+0000 7f67d0e2b9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5639fa9e5180 con 0x5639faa163e0 2024-09-10T05:36:34.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.031+0000 7f67ce130640 1 --2- 172.21.15.62:0/2909608907 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f66a80399b0 0x7f66a803be70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x5639fa9ee100 tx=0x7f67c4005a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.031+0000 7f67ce931640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639faa163e0 0x5639faa167c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.035+0000 7f67ce931640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639faa163e0 0x5639faa167c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:52206/0 (socket says 172.21.15.62:52206) 2024-09-10T05:36:34.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.035+0000 7f67ce931640 1 -- 172.21.15.62:0/743107121 learned_addr learned my addr 172.21.15.62:0/743107121 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:34.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.035+0000 7f67ce931640 1 -- 172.21.15.62:0/743107121 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639faa16d90 con 0x5639faa163e0 2024-09-10T05:36:34.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.035+0000 7f67ce931640 1 --2- 172.21.15.62:0/743107121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639faa163e0 0x5639faa167c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f67c001a740 tx=0x7f67c00353a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b008fd057c15b5d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.035+0000 7f66b27fc640 1 -- 172.21.15.62:0/743107121 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67c003b070 con 0x5639faa163e0 2024-09-10T05:36:34.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.035+0000 7f66b27fc640 1 -- 172.21.15.62:0/743107121 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67c005e070 con 0x5639faa163e0 2024-09-10T05:36:34.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.035+0000 7f66b27fc640 1 -- 172.21.15.62:0/743107121 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67c00227a0 con 0x5639faa163e0 2024-09-10T05:36:34.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.035+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/743107121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639faa163e0 msgr2=0x5639faa167c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.035+0000 7f67d0e2b9c0 1 --2- 172.21.15.62:0/743107121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639faa163e0 0x5639faa167c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f67c001a740 tx=0x7f67c00353a0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.035+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/743107121 shutdown_connections 2024-09-10T05:36:34.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.035+0000 7f67d0e2b9c0 1 --2- 172.21.15.62:0/743107121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639faa163e0 0x5639faa167c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.035+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/743107121 >> 172.21.15.62:0/743107121 conn(0x5639faa12810 msgr2=0x5639faa10a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:34.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.035+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/743107121 shutdown_connections 2024-09-10T05:36:34.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.035+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/743107121 wait complete. 2024-09-10T05:36:34.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.035+0000 7f67d0e2b9c0 1 Processor -- start 2024-09-10T05:36:34.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.035+0000 7f67d0e2b9c0 1 -- start start 2024-09-10T05:36:34.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.035+0000 7f67d0e2b9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639faa163e0 0x5639faa1d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.035+0000 7f67d0e2b9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5639faa17270 con 0x5639faa163e0 2024-09-10T05:36:34.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.035+0000 7f67ce931640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639faa163e0 0x5639faa1d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.035+0000 7f67ce931640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639faa163e0 0x5639faa1d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:52220/0 (socket says 172.21.15.62:52220) 2024-09-10T05:36:34.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.035+0000 7f67ce931640 1 -- 172.21.15.62:0/594788551 learned_addr learned my addr 172.21.15.62:0/594788551 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:34.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.035+0000 7f67ce931640 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639faa1dc50 con 0x5639faa163e0 2024-09-10T05:36:34.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.035+0000 7f67ce931640 1 --2- 172.21.15.62:0/594788551 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639faa163e0 0x5639faa1d6f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f67c005b040 tx=0x7f67c0040930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.039+0000 7f66b0ff9640 1 -- 172.21.15.62:0/594788551 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67c002d520 con 0x5639faa163e0 2024-09-10T05:36:34.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.039+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5639faa1dc50 con 0x5639faa163e0 2024-09-10T05:36:34.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.039+0000 7f66b0ff9640 1 -- 172.21.15.62:0/594788551 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67c005e040 con 0x5639faa163e0 2024-09-10T05:36:34.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.039+0000 7f66b0ff9640 1 -- 172.21.15.62:0/594788551 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67c00228d0 con 0x5639faa163e0 2024-09-10T05:36:34.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.039+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639faa1dc50 con 0x5639faa163e0 2024-09-10T05:36:34.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.039+0000 7f66b0ff9640 1 -- 172.21.15.62:0/594788551 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f67c0040260 con 0x5639faa163e0 2024-09-10T05:36:34.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.039+0000 7f67d0e2b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.039+0000 7f66b0ff9640 1 --2- 172.21.15.62:0/594788551 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6698039a70 0x7f669803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.039+0000 7f66b0ff9640 1 -- 172.21.15.62:0/594788551 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f67c0056040 con 0x5639faa163e0 2024-09-10T05:36:34.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.039+0000 7f67ce130640 1 --2- 172.21.15.62:0/594788551 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6698039a70 0x7f669803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.039+0000 7f67d0e2b9c0 1 --2- 172.21.15.62:0/594788551 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5639faa28650 0x5639faa2aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.039+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5639faa2b230 con 0x5639faa28650 2024-09-10T05:36:34.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.039+0000 7f67cf132640 1 --2- 172.21.15.62:0/594788551 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5639faa28650 0x5639faa2aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.039+0000 7f67ce130640 1 --2- 172.21.15.62:0/594788551 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6698039a70 0x7f669803bf30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f67c400a480 tx=0x7f67c40a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.039+0000 7f67cf132640 1 --2- 172.21.15.62:0/594788551 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5639faa28650 0x5639faa2aae0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.039+0000 7f67cf132640 1 -- 172.21.15.62:0/594788551 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f67c800a4d0 con 0x5639faa28650 2024-09-10T05:36:34.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.039+0000 7f67d0e2b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:34.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.039+0000 7f67d0e2b9c0 20 realm 2024-09-10T05:36:34.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.039+0000 7f67d0e2b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.039+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5639faa27a40 con 0x5639faa28650 2024-09-10T05:36:34.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.039+0000 7f67cf132640 1 -- 172.21.15.62:0/594788551 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f67c800a4d0 con 0x5639faa28650 2024-09-10T05:36:34.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.039+0000 7f67d0e2b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:34.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.039+0000 7f67d0e2b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:34.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.039+0000 7f67d0e2b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.039+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5639faa2bcf0 con 0x5639faa28650 2024-09-10T05:36:34.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.039+0000 7f67cf132640 1 -- 172.21.15.62:0/594788551 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f67c800a4d0 con 0x5639faa28650 2024-09-10T05:36:34.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.039+0000 7f67d0e2b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:34.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.039+0000 7f67d0e2b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.039+0000 7f67d0e2b9c0 1 --2- 172.21.15.62:0/594788551 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5639faa2cad0 0x5639faa2eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.039+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5639faa2f590 con 0x5639faa2cad0 2024-09-10T05:36:34.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.039+0000 7f67ce931640 1 --2- 172.21.15.62:0/594788551 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5639faa2cad0 0x5639faa2eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.043+0000 7f67ce931640 1 --2- 172.21.15.62:0/594788551 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5639faa2cad0 0x5639faa2eec0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.043+0000 7f67ce931640 1 -- 172.21.15.62:0/594788551 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f67c0073020 con 0x5639faa2cad0 2024-09-10T05:36:34.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.043+0000 7f67d0e2b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:34.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.043+0000 7f67d0e2b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.043+0000 7f67d0e2b9c0 1 --2- 172.21.15.62:0/594788551 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5639faa302f0 0x5639faa32700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.043+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5639faa32e90 con 0x5639faa302f0 2024-09-10T05:36:34.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.043+0000 7f67ce130640 1 --2- 172.21.15.62:0/594788551 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5639faa302f0 0x5639faa32700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.043+0000 7f67ce130640 1 --2- 172.21.15.62:0/594788551 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5639faa302f0 0x5639faa32700 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.043+0000 7f67ce130640 1 -- 172.21.15.62:0/594788551 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f67c40a8070 con 0x5639faa302f0 2024-09-10T05:36:34.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.043+0000 7f67d0e2b9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:34.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.043+0000 7f67d0e2b9c0 20 searching for the correct realm 2024-09-10T05:36:34.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.043+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639faa34760 con 0x5639faa302f0 2024-09-10T05:36:34.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.043+0000 7f67ce130640 1 -- 172.21.15.62:0/594788551 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c40a8070 con 0x5639faa302f0 2024-09-10T05:36:34.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.043+0000 7f67ce130640 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639faa34760 con 0x5639faa2cad0 2024-09-10T05:36:34.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.043+0000 7f67ce931640 1 -- 172.21.15.62:0/594788551 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c0073020 con 0x5639faa2cad0 2024-09-10T05:36:34.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.043+0000 7f67ce931640 1 --2- 172.21.15.62:0/594788551 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f67c0017050 0x7f67c006d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.043+0000 7f67ce931640 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639faa34760 con 0x7f67c0017050 2024-09-10T05:36:34.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.043+0000 7f67cf132640 1 --2- 172.21.15.62:0/594788551 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f67c0017050 0x7f67c006d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.043+0000 7f67cf132640 1 --2- 172.21.15.62:0/594788551 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f67c0017050 0x7f67c006d430 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.043+0000 7f67cf132640 1 -- 172.21.15.62:0/594788551 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c800a4d0 con 0x7f67c0017050 2024-09-10T05:36:34.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.043+0000 7f67cf132640 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639faa34760 con 0x5639faa28650 2024-09-10T05:36:34.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.043+0000 7f67cf132640 1 -- 172.21.15.62:0/594788551 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c800a4d0 con 0x5639faa28650 2024-09-10T05:36:34.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.043+0000 7f67cf132640 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639faa34760 con 0x5639faa28650 2024-09-10T05:36:34.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.047+0000 7f67cf132640 1 -- 172.21.15.62:0/594788551 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c800a4d0 con 0x5639faa28650 2024-09-10T05:36:34.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.047+0000 7f67cf132640 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639faa34760 con 0x5639faa302f0 2024-09-10T05:36:34.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.047+0000 7f67ce130640 1 -- 172.21.15.62:0/594788551 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c40a8070 con 0x5639faa302f0 2024-09-10T05:36:34.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.047+0000 7f67ce130640 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639faa34760 con 0x5639faa28650 2024-09-10T05:36:34.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.047+0000 7f67cf132640 1 -- 172.21.15.62:0/594788551 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c800a4d0 con 0x5639faa28650 2024-09-10T05:36:34.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.047+0000 7f67cf132640 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639faa34760 con 0x5639faa2cad0 2024-09-10T05:36:34.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.047+0000 7f67ce931640 1 -- 172.21.15.62:0/594788551 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c0073020 con 0x5639faa2cad0 2024-09-10T05:36:34.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.047+0000 7f67ce931640 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639faa34760 con 0x5639faa2cad0 2024-09-10T05:36:34.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.047+0000 7f67ce931640 1 -- 172.21.15.62:0/594788551 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c0073020 con 0x5639faa2cad0 2024-09-10T05:36:34.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.047+0000 7f67ce931640 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639faa34760 con 0x5639faa28650 2024-09-10T05:36:34.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.047+0000 7f67cf132640 1 -- 172.21.15.62:0/594788551 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c800a4d0 con 0x5639faa28650 2024-09-10T05:36:34.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.047+0000 7f67cf132640 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639faa34760 con 0x7f67c0017050 2024-09-10T05:36:34.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.047+0000 7f67cf132640 1 -- 172.21.15.62:0/594788551 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c800a4d0 con 0x7f67c0017050 2024-09-10T05:36:34.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.047+0000 7f67cf132640 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639faa34760 con 0x5639faa28650 2024-09-10T05:36:34.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.047+0000 7f67cf132640 1 -- 172.21.15.62:0/594788551 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c800a4d0 con 0x5639faa28650 2024-09-10T05:36:34.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.047+0000 7f67cf132640 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639faa34760 con 0x7f67c0017050 2024-09-10T05:36:34.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.047+0000 7f67cf132640 1 -- 172.21.15.62:0/594788551 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f67c800a4d0 con 0x7f67c0017050 2024-09-10T05:36:34.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.047+0000 7f67cf132640 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639faa34760 con 0x5639faa2cad0 2024-09-10T05:36:34.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.047+0000 7f67ce931640 1 -- 172.21.15.62:0/594788551 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c0073020 con 0x5639faa2cad0 2024-09-10T05:36:34.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.047+0000 7f67ce931640 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639faa34760 con 0x5639faa302f0 2024-09-10T05:36:34.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.047+0000 7f67ce130640 1 -- 172.21.15.62:0/594788551 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c40a8070 con 0x5639faa302f0 2024-09-10T05:36:34.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.047+0000 7f67ce130640 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639faa34760 con 0x5639faa28650 2024-09-10T05:36:34.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.047+0000 7f67cf132640 1 -- 172.21.15.62:0/594788551 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c800a4d0 con 0x5639faa28650 2024-09-10T05:36:34.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.047+0000 7f67cf132640 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639faa34760 con 0x5639faa2cad0 2024-09-10T05:36:34.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.051+0000 7f67ce931640 1 -- 172.21.15.62:0/594788551 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c0073020 con 0x5639faa2cad0 2024-09-10T05:36:34.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.051+0000 7f67ce931640 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639faa34760 con 0x5639faa302f0 2024-09-10T05:36:34.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.051+0000 7f67ce130640 1 -- 172.21.15.62:0/594788551 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 30 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f67c40a8070 con 0x5639faa302f0 2024-09-10T05:36:34.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.051+0000 7f67ce130640 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639faa34760 con 0x5639faa28650 2024-09-10T05:36:34.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.051+0000 7f67cf132640 1 -- 172.21.15.62:0/594788551 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c800a4d0 con 0x5639faa28650 2024-09-10T05:36:34.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.051+0000 7f67cf132640 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639faa34760 con 0x5639faa28650 2024-09-10T05:36:34.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.051+0000 7f67cf132640 1 -- 172.21.15.62:0/594788551 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f67c800a4d0 con 0x5639faa28650 2024-09-10T05:36:34.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.051+0000 7f67cf132640 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639faa34760 con 0x5639faa28650 2024-09-10T05:36:34.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.051+0000 7f67cf132640 1 -- 172.21.15.62:0/594788551 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c800a4d0 con 0x5639faa28650 2024-09-10T05:36:34.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.051+0000 7f67cf132640 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639faa34760 con 0x5639faa302f0 2024-09-10T05:36:34.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.051+0000 7f67ce130640 1 -- 172.21.15.62:0/594788551 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c40a8070 con 0x5639faa302f0 2024-09-10T05:36:34.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.051+0000 7f67ce130640 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639faa34760 con 0x7f67c0017050 2024-09-10T05:36:34.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.051+0000 7f67cf132640 1 -- 172.21.15.62:0/594788551 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c800a4d0 con 0x7f67c0017050 2024-09-10T05:36:34.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.051+0000 7f67cf132640 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639faa34760 con 0x5639faa28650 2024-09-10T05:36:34.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.051+0000 7f67cf132640 1 -- 172.21.15.62:0/594788551 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c800a4d0 con 0x5639faa28650 2024-09-10T05:36:34.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.051+0000 7f67cf132640 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639faa34760 con 0x7f67c0017050 2024-09-10T05:36:34.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.051+0000 7f67cf132640 1 -- 172.21.15.62:0/594788551 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c800a4d0 con 0x7f67c0017050 2024-09-10T05:36:34.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.051+0000 7f67cf132640 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639faa34760 con 0x5639faa302f0 2024-09-10T05:36:34.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.051+0000 7f67ce130640 1 -- 172.21.15.62:0/594788551 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c40a8070 con 0x5639faa302f0 2024-09-10T05:36:34.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.051+0000 7f67ce130640 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639faa34760 con 0x7f67c0017050 2024-09-10T05:36:34.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.051+0000 7f67cf132640 1 -- 172.21.15.62:0/594788551 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c800a4d0 con 0x7f67c0017050 2024-09-10T05:36:34.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.051+0000 7f67cf132640 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639faa34760 con 0x5639faa2cad0 2024-09-10T05:36:34.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.051+0000 7f67ce931640 1 -- 172.21.15.62:0/594788551 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c0073020 con 0x5639faa2cad0 2024-09-10T05:36:34.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.051+0000 7f67ce931640 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639faa34760 con 0x5639faa2cad0 2024-09-10T05:36:34.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.055+0000 7f67ce931640 1 -- 172.21.15.62:0/594788551 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c0073020 con 0x5639faa2cad0 2024-09-10T05:36:34.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.055+0000 7f67ce931640 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639faa34760 con 0x5639faa302f0 2024-09-10T05:36:34.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.055+0000 7f67ce130640 1 -- 172.21.15.62:0/594788551 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c40a8070 con 0x5639faa302f0 2024-09-10T05:36:34.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.055+0000 7f67ce130640 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639faa34760 con 0x5639faa2cad0 2024-09-10T05:36:34.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.055+0000 7f67ce931640 1 -- 172.21.15.62:0/594788551 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f67c0073020 con 0x5639faa2cad0 2024-09-10T05:36:34.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.055+0000 7f67ce931640 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5639faa34760 con 0x5639faa2cad0 2024-09-10T05:36:34.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.055+0000 7f67ce931640 1 -- 172.21.15.62:0/594788551 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c0073020 con 0x5639faa2cad0 2024-09-10T05:36:34.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.055+0000 7f67d0e2b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:34.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.055+0000 7f67d0e2b9c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:34.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.055+0000 7f67d0e2b9c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:34.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.055+0000 7f67d0e2b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:34.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.055+0000 7f67d0e2b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:34.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.055+0000 7f67d0e2b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:34.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.055+0000 7f67d0e2b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.055+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5639faa33850 con 0x5639faa28650 2024-09-10T05:36:34.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.055+0000 7f67cf132640 1 -- 172.21.15.62:0/594788551 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f67c800a4d0 con 0x5639faa28650 2024-09-10T05:36:34.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.055+0000 7f67d0e2b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:34.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.055+0000 7f67d0e2b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.055+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5639faa33490 con 0x5639faa2cad0 2024-09-10T05:36:34.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.055+0000 7f67ce931640 1 -- 172.21.15.62:0/594788551 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f67c0073020 con 0x5639faa2cad0 2024-09-10T05:36:34.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.055+0000 7f67d0e2b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:34.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.055+0000 7f67d0e2b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.055+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5639faa341b0 con 0x5639faa302f0 2024-09-10T05:36:34.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.055+0000 7f67ce130640 1 -- 172.21.15.62:0/594788551 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f67c40a8070 con 0x5639faa302f0 2024-09-10T05:36:34.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.055+0000 7f67d0e2b9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:34.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.055+0000 7f67d0e2b9c0 20 zone default found 2024-09-10T05:36:34.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.055+0000 7f67d0e2b9c0 4 Realm: () 2024-09-10T05:36:34.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.055+0000 7f67d0e2b9c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:34.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.055+0000 7f67d0e2b9c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:34.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.055+0000 7f67d0e2b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:34.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.055+0000 7f67d0e2b9c0 20 zonegroup default 2024-09-10T05:36:34.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.055+0000 7f67d0e2b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.055+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5639faa35040 con 0x7f67c0017050 2024-09-10T05:36:34.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.055+0000 7f67cf132640 1 -- 172.21.15.62:0/594788551 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f67c800a4d0 con 0x7f67c0017050 2024-09-10T05:36:34.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.055+0000 7f67d0e2b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:34.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.055+0000 7f67d0e2b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.055+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5639faa37280 con 0x5639faa302f0 2024-09-10T05:36:34.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.055+0000 7f67ce130640 1 -- 172.21.15.62:0/594788551 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f67c40a8070 con 0x5639faa302f0 2024-09-10T05:36:34.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.055+0000 7f67d0e2b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:34.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.055+0000 7f67d0e2b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.055+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5639faa37620 con 0x5639faa302f0 2024-09-10T05:36:34.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.055+0000 7f67ce130640 1 -- 172.21.15.62:0/594788551 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f67c40a8070 con 0x5639faa302f0 2024-09-10T05:36:34.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.055+0000 7f67d0e2b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:34.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.055+0000 7f67d0e2b9c0 20 started sync module instance, tier type = 2024-09-10T05:36:34.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.055+0000 7f67d0e2b9c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:34.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.055+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5639faa366c0 con 0x5639faa2cad0 2024-09-10T05:36:34.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.059+0000 7f67ce931640 1 -- 172.21.15.62:0/594788551 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67c0073020 con 0x5639faa2cad0 2024-09-10T05:36:34.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.059+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94807018138288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5639faa36ed0 con 0x5639faa2cad0 2024-09-10T05:36:34.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.059+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5639faa38320 con 0x5639faa28650 2024-09-10T05:36:34.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.059+0000 7f67cf132640 1 -- 172.21.15.62:0/594788551 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67c800a4d0 con 0x5639faa28650 2024-09-10T05:36:34.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.059+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94807018145472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5639faa38f90 con 0x5639faa28650 2024-09-10T05:36:34.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.059+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5639faa39950 con 0x5639faa2cad0 2024-09-10T05:36:34.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.059+0000 7f67ce931640 1 -- 172.21.15.62:0/594788551 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94807018138288] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67c0073020 con 0x5639faa2cad0 2024-09-10T05:36:34.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.063+0000 7f67cf132640 1 -- 172.21.15.62:0/594788551 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94807018145472] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67c800a4d0 con 0x5639faa28650 2024-09-10T05:36:34.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.063+0000 7f67ce931640 1 -- 172.21.15.62:0/594788551 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67c0073020 con 0x5639faa2cad0 2024-09-10T05:36:34.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.063+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94807018146528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5639faa38f00 con 0x5639faa2cad0 2024-09-10T05:36:34.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.063+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5639faa39e00 con 0x7f67c0017050 2024-09-10T05:36:34.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.063+0000 7f67cf132640 1 -- 172.21.15.62:0/594788551 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67c800a4d0 con 0x7f67c0017050 2024-09-10T05:36:34.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.063+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94807018150224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5639faa3a220 con 0x7f67c0017050 2024-09-10T05:36:34.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.063+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5639faa3ac20 con 0x5639faa2cad0 2024-09-10T05:36:34.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.063+0000 7f67cf132640 1 -- 172.21.15.62:0/594788551 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94807018150224] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67c800a4d0 con 0x7f67c0017050 2024-09-10T05:36:34.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.063+0000 7f67ce931640 1 -- 172.21.15.62:0/594788551 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94807018146528] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67c0073020 con 0x5639faa2cad0 2024-09-10T05:36:34.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.067+0000 7f67ce931640 1 -- 172.21.15.62:0/594788551 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67c0073020 con 0x5639faa2cad0 2024-09-10T05:36:34.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.067+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94807018149024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5639faa39d70 con 0x5639faa2cad0 2024-09-10T05:36:34.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.067+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5639faa3b4c0 con 0x5639faa302f0 2024-09-10T05:36:34.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.067+0000 7f67ce130640 1 -- 172.21.15.62:0/594788551 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67c40a8070 con 0x5639faa302f0 2024-09-10T05:36:34.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.067+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94807018156048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5639faa39d70 con 0x5639faa302f0 2024-09-10T05:36:34.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.067+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5639faa3bf00 con 0x5639faa302f0 2024-09-10T05:36:34.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.067+0000 7f67ce931640 1 -- 172.21.15.62:0/594788551 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94807018149024] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67c0073020 con 0x5639faa2cad0 2024-09-10T05:36:34.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.067+0000 7f67ce130640 1 -- 172.21.15.62:0/594788551 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94807018156048] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67c40a8070 con 0x5639faa302f0 2024-09-10T05:36:34.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.067+0000 7f67ce130640 1 -- 172.21.15.62:0/594788551 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67c40a8070 con 0x5639faa302f0 2024-09-10T05:36:34.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.067+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94807018157104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5639faa3ba50 con 0x5639faa302f0 2024-09-10T05:36:34.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.067+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5639faa3c7a0 con 0x7f67c0017050 2024-09-10T05:36:34.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.067+0000 7f67cf132640 1 -- 172.21.15.62:0/594788551 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67c800a4d0 con 0x7f67c0017050 2024-09-10T05:36:34.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.067+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94807018160880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5639faa3ba50 con 0x7f67c0017050 2024-09-10T05:36:34.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.067+0000 7f67d0e2b9c0 20 add_watcher() i=0 2024-09-10T05:36:34.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.067+0000 7f67d0e2b9c0 20 add_watcher() i=1 2024-09-10T05:36:34.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.067+0000 7f67d0e2b9c0 20 add_watcher() i=2 2024-09-10T05:36:34.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.067+0000 7f67d0e2b9c0 20 add_watcher() i=3 2024-09-10T05:36:34.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.067+0000 7f67d0e2b9c0 20 add_watcher() i=4 2024-09-10T05:36:34.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.067+0000 7f67d0e2b9c0 20 add_watcher() i=5 2024-09-10T05:36:34.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.067+0000 7f67ce130640 1 -- 172.21.15.62:0/594788551 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94807018157104] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67c40a8070 con 0x5639faa302f0 2024-09-10T05:36:34.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.067+0000 7f67d0e2b9c0 20 add_watcher() i=6 2024-09-10T05:36:34.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.071+0000 7f67cf132640 1 -- 172.21.15.62:0/594788551 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94807018160880] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67c800a4d0 con 0x7f67c0017050 2024-09-10T05:36:34.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.071+0000 7f67d0e2b9c0 20 add_watcher() i=7 2024-09-10T05:36:34.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.071+0000 7f67d0e2b9c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:34.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.071+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5639faa3a730 con 0x5639faa28650 2024-09-10T05:36:34.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.071+0000 7f67cf132640 1 -- 172.21.15.62:0/594788551 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f67c800a4d0 con 0x5639faa28650 2024-09-10T05:36:34.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.071+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94807018153776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5639faa3c7f0 con 0x5639faa28650 2024-09-10T05:36:34.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.071+0000 7f67cf132640 1 -- 172.21.15.62:0/594788551 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94807018153776] v30'90 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f67c800a4d0 con 0x5639faa28650 2024-09-10T05:36:34.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.071+0000 7f66857e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:34.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.071+0000 7f67d0e2b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:34.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.071+0000 7f67d0e2b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:34.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.071+0000 7f67d0e2b9c0 5 note: GC not initialized 2024-09-10T05:36:34.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.071+0000 7f65fffff640 20 reqs_thread_entry: start 2024-09-10T05:36:34.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.071+0000 7f67d0e2b9c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:34.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.071+0000 7f67d0e2b9c0 20 Filter name: none 2024-09-10T05:36:34.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.071+0000 7f65fdffb640 20 reqs_thread_entry: start 2024-09-10T05:36:34.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.071+0000 7f67d0e2b9c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T05:36:34.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.071+0000 7f67d0e2b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.071+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5639faa62b50 con 0x5639faa28650 2024-09-10T05:36:34.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.075+0000 7f67cf132640 1 -- 172.21.15.62:0/594788551 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(62 foo [call out=48b,read 0~582 out=582b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+705 (crc 0 0 0) 0x7f67c800a4d0 con 0x5639faa28650 2024-09-10T05:36:34.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.075+0000 7f67d0e2b9c0 20 rados_obj.operate() r=0 bl.length=582 2024-09-10T05:36:34.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.075+0000 7f67d0e2b9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T05:36:34.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.075+0000 7f67d0e2b9c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:36:34.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.075+0000 7f67d0e2b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:36:34.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.075+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5639faa69040 con 0x5639faa28650 2024-09-10T05:36:34.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.075+0000 7f67cf132640 1 -- 172.21.15.62:0/594788551 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v30'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f67c800a4d0 con 0x5639faa28650 2024-09-10T05:36:34.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.075+0000 7f67d0e2b9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:36:34.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.075+0000 7f67d0e2b9c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:36:34.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.075+0000 7f67d0e2b9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T05:36:34.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.075+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94807018343152 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5639faa64a60 con 0x5639faa2cad0 2024-09-10T05:36:34.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.075+0000 7f67ce931640 1 -- 172.21.15.62:0/594788551 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== watch-notify(notify (1) cookie 94807018149024 notify 128849018894 ret 0) ==== 774+0+0 (crc 0 0 0) 0x5639faa0aee0 con 0x5639faa2cad0 2024-09-10T05:36:34.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.075+0000 7f66b27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018894 cookie 94807018149024 notifier 4409 bl.length()=732 2024-09-10T05:36:34.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.075+0000 7f66b27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:36:34.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.075+0000 7f66b27fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:36:34.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.075+0000 7f67ce931640 1 -- 172.21.15.62:0/594788551 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(64 notify.4 [notify cookie 94807018343152 out=8b] v0'0 uv75 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f67c0073020 con 0x5639faa2cad0 2024-09-10T05:36:34.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.075+0000 7f66b27fc640 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f6694003eb0 con 0x5639faa2cad0 2024-09-10T05:36:34.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.075+0000 7f67ce931640 1 -- 172.21.15.62:0/594788551 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67c0073020 con 0x5639faa2cad0 2024-09-10T05:36:34.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.075+0000 7f67ce931640 1 -- 172.21.15.62:0/594788551 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== watch-notify(notify_complete (2) cookie 94807018343152 notify 128849018894 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5639faa0a680 con 0x5639faa2cad0 2024-09-10T05:36:34.083 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T05:36:30.893777Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-10T05:36:33.541095Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:36:30.893760Z","tags":[],"group_ids":[]} 2024-09-10T05:36:34.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.075+0000 7f66857e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:34.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.075+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94807018153776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5639faa64a60 con 0x5639faa28650 2024-09-10T05:36:34.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.079+0000 7f67cf132640 1 -- 172.21.15.62:0/594788551 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94807018153776] v30'91 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f67c800a4d0 con 0x5639faa28650 2024-09-10T05:36:34.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.079+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94807018138288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5639faa64a60 con 0x5639faa2cad0 2024-09-10T05:36:34.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.079+0000 7f67ce931640 1 -- 172.21.15.62:0/594788551 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94807018138288] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67c0073020 con 0x5639faa2cad0 2024-09-10T05:36:34.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.079+0000 7f67d0e2b9c0 20 remove_watcher() i=0 2024-09-10T05:36:34.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.079+0000 7f67d0e2b9c0 2 removed watcher, disabling cache 2024-09-10T05:36:34.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.079+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94807018145472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5639faa64a60 con 0x5639faa28650 2024-09-10T05:36:34.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.083+0000 7f67cf132640 1 -- 172.21.15.62:0/594788551 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94807018145472] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67c800a4d0 con 0x5639faa28650 2024-09-10T05:36:34.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.083+0000 7f67d0e2b9c0 20 remove_watcher() i=1 2024-09-10T05:36:34.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.083+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94807018146528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5639faa64a60 con 0x5639faa2cad0 2024-09-10T05:36:34.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.083+0000 7f67ce931640 1 -- 172.21.15.62:0/594788551 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94807018146528] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67c0073020 con 0x5639faa2cad0 2024-09-10T05:36:34.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.083+0000 7f67d0e2b9c0 20 remove_watcher() i=2 2024-09-10T05:36:34.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.083+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94807018150224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5639faa36ab0 con 0x7f67c0017050 2024-09-10T05:36:34.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.083+0000 7f67cf132640 1 -- 172.21.15.62:0/594788551 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94807018150224] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67c800a4d0 con 0x7f67c0017050 2024-09-10T05:36:34.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.083+0000 7f67d0e2b9c0 20 remove_watcher() i=3 2024-09-10T05:36:34.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.083+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94807018149024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5639faa39950 con 0x5639faa2cad0 2024-09-10T05:36:34.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.087+0000 7f67ce931640 1 -- 172.21.15.62:0/594788551 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94807018149024] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67c0073020 con 0x5639faa2cad0 2024-09-10T05:36:34.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.087+0000 7f67d0e2b9c0 20 remove_watcher() i=4 2024-09-10T05:36:34.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.087+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94807018156048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5639faa36ab0 con 0x5639faa302f0 2024-09-10T05:36:34.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.087+0000 7f67ce130640 1 -- 172.21.15.62:0/594788551 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94807018156048] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67c40a8070 con 0x5639faa302f0 2024-09-10T05:36:34.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.087+0000 7f67d0e2b9c0 20 remove_watcher() i=5 2024-09-10T05:36:34.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.087+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94807018157104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5639faa394a0 con 0x5639faa302f0 2024-09-10T05:36:34.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.087+0000 7f67ce130640 1 -- 172.21.15.62:0/594788551 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94807018157104] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67c40a8070 con 0x5639faa302f0 2024-09-10T05:36:34.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.087+0000 7f67d0e2b9c0 20 remove_watcher() i=6 2024-09-10T05:36:34.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.087+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94807018160880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5639faa36ab0 con 0x7f67c0017050 2024-09-10T05:36:34.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.091+0000 7f67cf132640 1 -- 172.21.15.62:0/594788551 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94807018160880] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67c800a4d0 con 0x7f67c0017050 2024-09-10T05:36:34.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.091+0000 7f67d0e2b9c0 20 remove_watcher() i=7 2024-09-10T05:36:34.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.091+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5639faa2cad0 msgr2=0x5639faa2eec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.091+0000 7f67d0e2b9c0 1 --2- 172.21.15.62:0/594788551 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5639faa2cad0 0x5639faa2eec0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.091+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5639faa28650 msgr2=0x5639faa2aae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.091+0000 7f67d0e2b9c0 1 --2- 172.21.15.62:0/594788551 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5639faa28650 0x5639faa2aae0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.091+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f67c0017050 msgr2=0x7f67c006d430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.091+0000 7f67d0e2b9c0 1 --2- 172.21.15.62:0/594788551 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f67c0017050 0x7f67c006d430 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.091+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5639faa302f0 msgr2=0x5639faa32700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.091+0000 7f67d0e2b9c0 1 --2- 172.21.15.62:0/594788551 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5639faa302f0 0x5639faa32700 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.091+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6698039a70 msgr2=0x7f669803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.091+0000 7f67d0e2b9c0 1 --2- 172.21.15.62:0/594788551 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6698039a70 0x7f669803bf30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f67c400a480 tx=0x7f67c40a7000 comp rx=0 tx=0).stop 2024-09-10T05:36:34.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.091+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639faa163e0 msgr2=0x5639faa1d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.091+0000 7f67cf132640 1 -- 172.21.15.62:0/594788551 reap_dead start 2024-09-10T05:36:34.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.091+0000 7f67d0e2b9c0 1 --2- 172.21.15.62:0/594788551 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639faa163e0 0x5639faa1d6f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f67c005b040 tx=0x7f67c0040930 comp rx=0 tx=0).stop 2024-09-10T05:36:34.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.091+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 shutdown_connections 2024-09-10T05:36:34.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.091+0000 7f67d0e2b9c0 1 --2- 172.21.15.62:0/594788551 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639faa163e0 0x5639faa1d6f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.091+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 >> 172.21.15.62:0/594788551 conn(0x5639faa12810 msgr2=0x5639faa10a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:34.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.091+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 shutdown_connections 2024-09-10T05:36:34.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.091+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/594788551 wait complete. 2024-09-10T05:36:34.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.091+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/2909608907 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f66a80399b0 msgr2=0x7f66a803be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.091+0000 7f67d0e2b9c0 1 --2- 172.21.15.62:0/2909608907 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f66a80399b0 0x7f66a803be70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x5639fa9ee100 tx=0x7f67c4005a10 comp rx=0 tx=0).stop 2024-09-10T05:36:34.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.091+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/2909608907 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639faa09c20 msgr2=0x5639faa0a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.091+0000 7f67d0e2b9c0 1 --2- 172.21.15.62:0/2909608907 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639faa09c20 0x5639faa0a040 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f67c004eae0 tx=0x7f67c0040ef0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.091+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/2909608907 shutdown_connections 2024-09-10T05:36:34.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.091+0000 7f67d0e2b9c0 1 --2- 172.21.15.62:0/2909608907 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f66a80399b0 0x7f66a803be70 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.091+0000 7f67d0e2b9c0 1 --2- 172.21.15.62:0/2909608907 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639faa09c20 0x5639faa0a040 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.091+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/2909608907 >> 172.21.15.62:0/2909608907 conn(0x5639fa9ff5d0 msgr2=0x5639fa9ff9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:34.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.091+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/2909608907 shutdown_connections 2024-09-10T05:36:34.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.091+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/2909608907 wait complete. 2024-09-10T05:36:34.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.091+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/2933412174 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5639fa9f4100 msgr2=0x5639fa9f65c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.091+0000 7f67d0e2b9c0 1 --2- 172.21.15.62:0/2933412174 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5639fa9f4100 0x5639fa9f65c0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.091+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/2933412174 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5639fa86e020 msgr2=0x5639fa9f3150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.091+0000 7f67d0e2b9c0 1 --2- 172.21.15.62:0/2933412174 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5639fa86e020 0x5639fa9f3150 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.091+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/2933412174 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5639fa9f8af0 msgr2=0x5639fa9faee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.091+0000 7f67d0e2b9c0 1 --2- 172.21.15.62:0/2933412174 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5639fa9f8af0 0x5639fa9faee0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.091+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/2933412174 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f66b4039a00 msgr2=0x7f66b403bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.091+0000 7f67d0e2b9c0 1 --2- 172.21.15.62:0/2933412174 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f66b4039a00 0x7f66b403bec0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f67c40ac000 tx=0x7f67c40a5000 comp rx=0 tx=0).stop 2024-09-10T05:36:34.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.091+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/2933412174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639fa86daf0 msgr2=0x5639fa9ebfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.091+0000 7f67d0e2b9c0 1 --2- 172.21.15.62:0/2933412174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5639fa86daf0 0x5639fa9ebfe0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f67c0004180 tx=0x7f67c00040f0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.091+0000 7f67cf132640 1 -- 172.21.15.62:0/2933412174 reap_dead start 2024-09-10T05:36:34.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.091+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/2933412174 shutdown_connections 2024-09-10T05:36:34.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.091+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/2933412174 >> 172.21.15.62:0/2933412174 conn(0x5639fa8f2ad0 msgr2=0x5639fa9df080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:34.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.091+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/2933412174 shutdown_connections 2024-09-10T05:36:34.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.091+0000 7f67d0e2b9c0 1 -- 172.21.15.62:0/2933412174 wait complete. 2024-09-10T05:36:34.104 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T05:36:30.893777Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-10T05:36:33.541095Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:36:30.893760Z', 'tags': [], 'group_ids': []} 2024-09-10T05:36:34.104 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-10T05:36:34.104 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-10T05:36:34.104 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2024-09-10T05:36:34.183 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:34.183 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:34.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.179+0000 7f41301319c0 1 Processor -- start 2024-09-10T05:36:34.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.179+0000 7f41301319c0 1 -- start start 2024-09-10T05:36:34.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.179+0000 7f41301319c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x563fd630f180 0x563fd630f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.179+0000 7f41301319c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563fd61c19c0 con 0x563fd63122c0 2024-09-10T05:36:34.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.179+0000 7f41301319c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x563fd62116d0 con 0x563fd630f180 2024-09-10T05:36:34.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.183+0000 7f412dc37640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x563fd630f180 0x563fd630f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.183+0000 7f412dc37640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x563fd630f180 0x563fd630f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:52236/0 (socket says 172.21.15.62:52236) 2024-09-10T05:36:34.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.183+0000 7f412dc37640 1 -- 172.21.15.62:0/2166761540 learned_addr learned my addr 172.21.15.62:0/2166761540 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:34.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.183+0000 7f412d436640 1 --1- 172.21.15.62:0/2166761540 >> v1:172.21.15.2:6789/0 conn(0x563fd63122c0 0x563fd63146b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:38656/0 (socket says 172.21.15.62:38656) 2024-09-10T05:36:34.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.183+0000 7f412dc37640 1 -- 172.21.15.62:0/2166761540 >> v1:172.21.15.2:6789/0 conn(0x563fd63122c0 legacy=0x563fd63146b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.183+0000 7f412dc37640 1 -- 172.21.15.62:0/2166761540 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fd61b5ca0 con 0x563fd630f180 2024-09-10T05:36:34.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.183+0000 7f412dc37640 1 --2- 172.21.15.62:0/2166761540 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fd630f180 0x563fd630f560 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f412000a4e0 tx=0x7f412001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed7821561dcc6a94 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.187+0000 7f412cc35640 1 -- 172.21.15.62:0/2166761540 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41200aa540 con 0x563fd630f180 2024-09-10T05:36:34.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.187+0000 7f412cc35640 1 -- 172.21.15.62:0/2166761540 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41200aa6e0 con 0x563fd630f180 2024-09-10T05:36:34.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.187+0000 7f412cc35640 1 -- 172.21.15.62:0/2166761540 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41200aaa40 con 0x563fd630f180 2024-09-10T05:36:34.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.187+0000 7f41301319c0 1 -- 172.21.15.62:0/2166761540 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fd630f180 msgr2=0x563fd630f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.187+0000 7f41301319c0 1 --2- 172.21.15.62:0/2166761540 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fd630f180 0x563fd630f560 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f412000a4e0 tx=0x7f412001b090 comp rx=0 tx=0).stop 2024-09-10T05:36:34.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.187+0000 7f41301319c0 1 -- 172.21.15.62:0/2166761540 shutdown_connections 2024-09-10T05:36:34.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.187+0000 7f41301319c0 1 --2- 172.21.15.62:0/2166761540 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fd630f180 0x563fd630f560 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.187+0000 7f41301319c0 1 -- 172.21.15.62:0/2166761540 >> 172.21.15.62:0/2166761540 conn(0x563fd6282a90 msgr2=0x563fd6282ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:34.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.187+0000 7f41301319c0 1 -- 172.21.15.62:0/2166761540 shutdown_connections 2024-09-10T05:36:34.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.187+0000 7f41301319c0 1 -- 172.21.15.62:0/2166761540 wait complete. 2024-09-10T05:36:34.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.199+0000 7f41301319c0 1 Processor -- start 2024-09-10T05:36:34.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.199+0000 7f41301319c0 1 -- start start 2024-09-10T05:36:34.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.199+0000 7f41301319c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fd63122c0 0x563fd63fa980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.199+0000 7f41301319c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563fd6215680 con 0x563fd63122c0 2024-09-10T05:36:34.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.199+0000 7f412dc37640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fd63122c0 0x563fd63fa980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.199+0000 7f412dc37640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fd63122c0 0x563fd63fa980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:52248/0 (socket says 172.21.15.62:52248) 2024-09-10T05:36:34.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.199+0000 7f412dc37640 1 -- 172.21.15.62:0/4237053672 learned_addr learned my addr 172.21.15.62:0/4237053672 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:34.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.199+0000 7f412dc37640 1 -- 172.21.15.62:0/4237053672 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fd6190da0 con 0x563fd63122c0 2024-09-10T05:36:34.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.199+0000 7f412dc37640 1 --2- 172.21.15.62:0/4237053672 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fd63122c0 0x563fd63fa980 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4120019740 tx=0x7f41200033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b6c7226cbc40697 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.199+0000 7f401be07640 1 -- 172.21.15.62:0/4237053672 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41200b9070 con 0x563fd63122c0 2024-09-10T05:36:34.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.199+0000 7f401be07640 1 -- 172.21.15.62:0/4237053672 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41200aa910 con 0x563fd63122c0 2024-09-10T05:36:34.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.199+0000 7f401be07640 1 -- 172.21.15.62:0/4237053672 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41200aabf0 con 0x563fd63122c0 2024-09-10T05:36:34.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.199+0000 7f41301319c0 1 -- 172.21.15.62:0/4237053672 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fd63122c0 msgr2=0x563fd63fa980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.199+0000 7f41301319c0 1 --2- 172.21.15.62:0/4237053672 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fd63122c0 0x563fd63fa980 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4120019740 tx=0x7f41200033b0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.199+0000 7f41301319c0 1 -- 172.21.15.62:0/4237053672 shutdown_connections 2024-09-10T05:36:34.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.199+0000 7f41301319c0 1 --2- 172.21.15.62:0/4237053672 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fd63122c0 0x563fd63fa980 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.199+0000 7f41301319c0 1 -- 172.21.15.62:0/4237053672 >> 172.21.15.62:0/4237053672 conn(0x563fd6282a90 msgr2=0x563fd63f6580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:34.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.199+0000 7f41301319c0 1 -- 172.21.15.62:0/4237053672 shutdown_connections 2024-09-10T05:36:34.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.199+0000 7f41301319c0 1 -- 172.21.15.62:0/4237053672 wait complete. 2024-09-10T05:36:34.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.199+0000 7f41301319c0 1 Processor -- start 2024-09-10T05:36:34.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.199+0000 7f41301319c0 1 -- start start 2024-09-10T05:36:34.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.203+0000 7f41301319c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fd63122c0 0x563fd6401e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.203+0000 7f41301319c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563fd61b7a50 con 0x563fd63122c0 2024-09-10T05:36:34.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.203+0000 7f412dc37640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fd63122c0 0x563fd6401e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.203+0000 7f412dc37640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fd63122c0 0x563fd6401e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:52250/0 (socket says 172.21.15.62:52250) 2024-09-10T05:36:34.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.203+0000 7f412dc37640 1 -- 172.21.15.62:0/1503177094 learned_addr learned my addr 172.21.15.62:0/1503177094 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:34.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.203+0000 7f412dc37640 1 -- 172.21.15.62:0/1503177094 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fd64023f0 con 0x563fd63122c0 2024-09-10T05:36:34.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.203+0000 7f412dc37640 1 --2- 172.21.15.62:0/1503177094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fd63122c0 0x563fd6401e90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4120000f90 tx=0x7f4120017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.203+0000 7f401a604640 1 -- 172.21.15.62:0/1503177094 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41200b9030 con 0x563fd63122c0 2024-09-10T05:36:34.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.203+0000 7f41301319c0 1 -- 172.21.15.62:0/1503177094 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563fd6402680 con 0x563fd63122c0 2024-09-10T05:36:34.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.203+0000 7f401a604640 1 -- 172.21.15.62:0/1503177094 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41200b5a80 con 0x563fd63122c0 2024-09-10T05:36:34.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.203+0000 7f41301319c0 1 -- 172.21.15.62:0/1503177094 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fd64030b0 con 0x563fd63122c0 2024-09-10T05:36:34.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.203+0000 7f401a604640 1 -- 172.21.15.62:0/1503177094 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41200b5d60 con 0x563fd63122c0 2024-09-10T05:36:34.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.203+0000 7f401a604640 1 -- 172.21.15.62:0/1503177094 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f41200b3040 con 0x563fd63122c0 2024-09-10T05:36:34.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.203+0000 7f401a604640 1 --2- 172.21.15.62:0/1503177094 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4014039a70 0x7f401403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.203+0000 7f401a604640 1 -- 172.21.15.62:0/1503177094 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f41200c4030 con 0x563fd63122c0 2024-09-10T05:36:34.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.203+0000 7f412d436640 1 --2- 172.21.15.62:0/1503177094 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4014039a70 0x7f401403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.203+0000 7f41301319c0 1 --2- 172.21.15.62:0/1503177094 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x563fd6406ff0 0x563fd64093e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.203+0000 7f41301319c0 1 -- 172.21.15.62:0/1503177094 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563fd6409920 con 0x563fd6406ff0 2024-09-10T05:36:34.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.203+0000 7f412e438640 1 --2- 172.21.15.62:0/1503177094 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x563fd6406ff0 0x563fd64093e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.203+0000 7f412d436640 1 --2- 172.21.15.62:0/1503177094 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4014039a70 0x7f401403bf30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4124001e90 tx=0x7f41240013f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.203+0000 7f412e438640 1 --2- 172.21.15.62:0/1503177094 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x563fd6406ff0 0x563fd64093e0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.203+0000 7f412e438640 1 -- 172.21.15.62:0/1503177094 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f41280083f0 con 0x563fd6406ff0 2024-09-10T05:36:34.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.203+0000 7f41301319c0 1 --2- 172.21.15.62:0/1503177094 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x563fd640a410 0x563fd640c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.203+0000 7f41301319c0 1 -- 172.21.15.62:0/1503177094 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563fd640d040 con 0x563fd640a410 2024-09-10T05:36:34.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.207+0000 7f412dc37640 1 --2- 172.21.15.62:0/1503177094 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x563fd640a410 0x563fd640c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.207+0000 7f412dc37640 1 --2- 172.21.15.62:0/1503177094 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x563fd640a410 0x563fd640c8d0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.207+0000 7f412dc37640 1 -- 172.21.15.62:0/1503177094 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f41200b3d40 con 0x563fd640a410 2024-09-10T05:36:34.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.207+0000 7f41301319c0 1 --2- 172.21.15.62:0/1503177094 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x563fd640ee00 0x563fd64111f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.207+0000 7f41301319c0 1 -- 172.21.15.62:0/1503177094 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563fd64118e0 con 0x563fd640ee00 2024-09-10T05:36:34.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.207+0000 7f412d436640 1 --2- 172.21.15.62:0/1503177094 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x563fd640ee00 0x563fd64111f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.207+0000 7f412d436640 1 --2- 172.21.15.62:0/1503177094 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x563fd640ee00 0x563fd64111f0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.207+0000 7f412d436640 1 -- 172.21.15.62:0/1503177094 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f412400f6e0 con 0x563fd640ee00 2024-09-10T05:36:34.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.207+0000 7f41301319c0 1 -- 172.21.15.62:0/1503177094 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563fd640dca0 con 0x563fd640a410 2024-09-10T05:36:34.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.207+0000 7f412dc37640 1 -- 172.21.15.62:0/1503177094 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f41200b3d40 con 0x563fd640a410 2024-09-10T05:36:34.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.207+0000 7f41301319c0 1 -- 172.21.15.62:0/1503177094 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563fd640e100 con 0x563fd640ee00 2024-09-10T05:36:34.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.207+0000 7f412d436640 1 -- 172.21.15.62:0/1503177094 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f412400f6e0 con 0x563fd640ee00 2024-09-10T05:36:34.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.207+0000 7f41301319c0 1 Processor -- start 2024-09-10T05:36:34.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.207+0000 7f41301319c0 1 -- start start 2024-09-10T05:36:34.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.207+0000 7f41301319c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fd641ff30 0x563fd6420350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.207+0000 7f41301319c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563fd6222450 con 0x563fd641ff30 2024-09-10T05:36:34.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.211+0000 7f412dc37640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fd641ff30 0x563fd6420350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.211+0000 7f412dc37640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fd641ff30 0x563fd6420350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:52256/0 (socket says 172.21.15.62:52256) 2024-09-10T05:36:34.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.211+0000 7f412dc37640 1 -- 172.21.15.62:0/4116410708 learned_addr learned my addr 172.21.15.62:0/4116410708 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:34.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.211+0000 7f412dc37640 1 -- 172.21.15.62:0/4116410708 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fd6420990 con 0x563fd641ff30 2024-09-10T05:36:34.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.211+0000 7f412dc37640 1 --2- 172.21.15.62:0/4116410708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fd641ff30 0x563fd6420350 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f41200c7540 tx=0x7f41200cf530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.211+0000 7f40137fe640 1 -- 172.21.15.62:0/4116410708 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41200b43a0 con 0x563fd641ff30 2024-09-10T05:36:34.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.211+0000 7f40137fe640 1 -- 172.21.15.62:0/4116410708 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41200b4540 con 0x563fd641ff30 2024-09-10T05:36:34.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.211+0000 7f41301319c0 1 -- 172.21.15.62:0/4116410708 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563fd64211f0 con 0x563fd641ff30 2024-09-10T05:36:34.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.211+0000 7f40137fe640 1 -- 172.21.15.62:0/4116410708 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41200b4820 con 0x563fd641ff30 2024-09-10T05:36:34.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.211+0000 7f41301319c0 1 -- 172.21.15.62:0/4116410708 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fd6421760 con 0x563fd641ff30 2024-09-10T05:36:34.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.211+0000 7f40137fe640 1 -- 172.21.15.62:0/4116410708 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f41200e2970 con 0x563fd641ff30 2024-09-10T05:36:34.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.211+0000 7f40137fe640 1 --2- 172.21.15.62:0/4116410708 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4008039a20 0x7f400803bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.211+0000 7f40137fe640 1 -- 172.21.15.62:0/4116410708 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f41200c9ad0 con 0x563fd641ff30 2024-09-10T05:36:34.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.211+0000 7f412d436640 1 --2- 172.21.15.62:0/4116410708 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4008039a20 0x7f400803bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.211+0000 7f41301319c0 1 Processor -- start 2024-09-10T05:36:34.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.211+0000 7f41301319c0 1 -- start start 2024-09-10T05:36:34.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.211+0000 7f412d436640 1 --2- 172.21.15.62:0/4116410708 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4008039a20 0x7f400803bee0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x563fd6404010 tx=0x7f412400f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.211+0000 7f41301319c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fd642d720 0x563fd642db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.211+0000 7f41301319c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563fd63fb110 con 0x563fd642d720 2024-09-10T05:36:34.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.211+0000 7f412dc37640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fd642d720 0x563fd642db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.211+0000 7f412dc37640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fd642d720 0x563fd642db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:52270/0 (socket says 172.21.15.62:52270) 2024-09-10T05:36:34.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.211+0000 7f412dc37640 1 -- 172.21.15.62:0/2085947534 learned_addr learned my addr 172.21.15.62:0/2085947534 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:34.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.211+0000 7f412dc37640 1 -- 172.21.15.62:0/2085947534 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fd642e0f0 con 0x563fd642d720 2024-09-10T05:36:34.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.215+0000 7f412dc37640 1 --2- 172.21.15.62:0/2085947534 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fd642d720 0x563fd642db00 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f41200b5690 tx=0x7f41200bdbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=598e84e85136c72b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.215+0000 7f40117fa640 1 -- 172.21.15.62:0/2085947534 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41200d1cd0 con 0x563fd642d720 2024-09-10T05:36:34.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.215+0000 7f40117fa640 1 -- 172.21.15.62:0/2085947534 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41200fa030 con 0x563fd642d720 2024-09-10T05:36:34.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.215+0000 7f40117fa640 1 -- 172.21.15.62:0/2085947534 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41200d1400 con 0x563fd642d720 2024-09-10T05:36:34.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.215+0000 7f41301319c0 1 -- 172.21.15.62:0/2085947534 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fd642d720 msgr2=0x563fd642db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.215+0000 7f41301319c0 1 --2- 172.21.15.62:0/2085947534 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fd642d720 0x563fd642db00 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f41200b5690 tx=0x7f41200bdbd0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.215+0000 7f41301319c0 1 -- 172.21.15.62:0/2085947534 shutdown_connections 2024-09-10T05:36:34.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.215+0000 7f41301319c0 1 --2- 172.21.15.62:0/2085947534 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fd642d720 0x563fd642db00 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.215+0000 7f41301319c0 1 -- 172.21.15.62:0/2085947534 >> 172.21.15.62:0/2085947534 conn(0x563fd6428ae0 msgr2=0x563fd6426d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:34.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.215+0000 7f41301319c0 1 -- 172.21.15.62:0/2085947534 shutdown_connections 2024-09-10T05:36:34.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.215+0000 7f41301319c0 1 -- 172.21.15.62:0/2085947534 wait complete. 2024-09-10T05:36:34.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.215+0000 7f41301319c0 1 Processor -- start 2024-09-10T05:36:34.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.215+0000 7f41301319c0 1 -- start start 2024-09-10T05:36:34.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.215+0000 7f41301319c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fd642d720 0x563fd64339a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.215+0000 7f41301319c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563fd642c490 con 0x563fd642d720 2024-09-10T05:36:34.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.215+0000 7f412dc37640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fd642d720 0x563fd64339a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.215+0000 7f412dc37640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fd642d720 0x563fd64339a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:52282/0 (socket says 172.21.15.62:52282) 2024-09-10T05:36:34.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.215+0000 7f412dc37640 1 -- 172.21.15.62:0/1325353048 learned_addr learned my addr 172.21.15.62:0/1325353048 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:34.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.215+0000 7f412dc37640 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fd6433f00 con 0x563fd642d720 2024-09-10T05:36:34.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.215+0000 7f412dc37640 1 --2- 172.21.15.62:0/1325353048 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fd642d720 0x563fd64339a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4120005c10 tx=0x7f41200efea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.215+0000 7f3fff7fe640 1 -- 172.21.15.62:0/1325353048 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41200d1af0 con 0x563fd642d720 2024-09-10T05:36:34.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.215+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563fd6433f00 con 0x563fd642d720 2024-09-10T05:36:34.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.215+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fd6433f00 con 0x563fd642d720 2024-09-10T05:36:34.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.215+0000 7f3fff7fe640 1 -- 172.21.15.62:0/1325353048 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41200fa070 con 0x563fd642d720 2024-09-10T05:36:34.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.215+0000 7f3fff7fe640 1 -- 172.21.15.62:0/1325353048 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41200e2730 con 0x563fd642d720 2024-09-10T05:36:34.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.219+0000 7f3fff7fe640 1 -- 172.21.15.62:0/1325353048 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f41200e2210 con 0x563fd642d720 2024-09-10T05:36:34.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.219+0000 7f41301319c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.219+0000 7f3fff7fe640 1 --2- 172.21.15.62:0/1325353048 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3ff8039a20 0x7f3ff803bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.219+0000 7f3fff7fe640 1 -- 172.21.15.62:0/1325353048 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f4120106070 con 0x563fd642d720 2024-09-10T05:36:34.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.219+0000 7f412d436640 1 --2- 172.21.15.62:0/1325353048 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3ff8039a20 0x7f3ff803bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.219+0000 7f41301319c0 1 --2- 172.21.15.62:0/1325353048 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x563fd643e910 0x563fd6440da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.219+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563fd64414f0 con 0x563fd643e910 2024-09-10T05:36:34.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.219+0000 7f412e438640 1 --2- 172.21.15.62:0/1325353048 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x563fd643e910 0x563fd6440da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.219+0000 7f412d436640 1 --2- 172.21.15.62:0/1325353048 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3ff8039a20 0x7f3ff803bee0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f412400ffd0 tx=0x7f4124010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.219+0000 7f412e438640 1 --2- 172.21.15.62:0/1325353048 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x563fd643e910 0x563fd6440da0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.219+0000 7f412e438640 1 -- 172.21.15.62:0/1325353048 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f41280083f0 con 0x563fd643e910 2024-09-10T05:36:34.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.219+0000 7f41301319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:34.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.219+0000 7f41301319c0 20 realm 2024-09-10T05:36:34.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.219+0000 7f41301319c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.219+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563fd643dd00 con 0x563fd643e910 2024-09-10T05:36:34.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.219+0000 7f412e438640 1 -- 172.21.15.62:0/1325353048 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f41280083f0 con 0x563fd643e910 2024-09-10T05:36:34.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.219+0000 7f41301319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:34.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.219+0000 7f41301319c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:34.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.219+0000 7f41301319c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.219+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563fd6441fb0 con 0x563fd643e910 2024-09-10T05:36:34.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.219+0000 7f412e438640 1 -- 172.21.15.62:0/1325353048 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f41280083f0 con 0x563fd643e910 2024-09-10T05:36:34.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.219+0000 7f41301319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:34.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.219+0000 7f41301319c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.219+0000 7f41301319c0 1 --2- 172.21.15.62:0/1325353048 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x563fd6442d90 0x563fd6445180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.219+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563fd6445850 con 0x563fd6442d90 2024-09-10T05:36:34.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.219+0000 7f412dc37640 1 --2- 172.21.15.62:0/1325353048 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x563fd6442d90 0x563fd6445180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.219+0000 7f412dc37640 1 --2- 172.21.15.62:0/1325353048 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x563fd6442d90 0x563fd6445180 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.219+0000 7f412dc37640 1 -- 172.21.15.62:0/1325353048 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f41200db070 con 0x563fd6442d90 2024-09-10T05:36:34.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.219+0000 7f41301319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:34.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.219+0000 7f41301319c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.219+0000 7f41301319c0 1 --2- 172.21.15.62:0/1325353048 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x563fd64465b0 0x563fd64489c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.219+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563fd6449150 con 0x563fd64465b0 2024-09-10T05:36:34.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.219+0000 7f412d436640 1 --2- 172.21.15.62:0/1325353048 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x563fd64465b0 0x563fd64489c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.223+0000 7f412d436640 1 --2- 172.21.15.62:0/1325353048 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x563fd64465b0 0x563fd64489c0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.223+0000 7f412d436640 1 -- 172.21.15.62:0/1325353048 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f412400f6e0 con 0x563fd64465b0 2024-09-10T05:36:34.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.223+0000 7f41301319c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:34.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.223+0000 7f41301319c0 20 searching for the correct realm 2024-09-10T05:36:34.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.223+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fd644aa20 con 0x563fd64465b0 2024-09-10T05:36:34.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.223+0000 7f412d436640 1 -- 172.21.15.62:0/1325353048 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f412400f6e0 con 0x563fd64465b0 2024-09-10T05:36:34.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.223+0000 7f412d436640 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fd644aa20 con 0x563fd6442d90 2024-09-10T05:36:34.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.223+0000 7f412dc37640 1 -- 172.21.15.62:0/1325353048 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41200db070 con 0x563fd6442d90 2024-09-10T05:36:34.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.223+0000 7f412dc37640 1 --2- 172.21.15.62:0/1325353048 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f41200de070 0x7f41201112f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.223+0000 7f412dc37640 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fd644aa20 con 0x7f41200de070 2024-09-10T05:36:34.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.223+0000 7f412e438640 1 --2- 172.21.15.62:0/1325353048 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f41200de070 0x7f41201112f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.223+0000 7f412e438640 1 --2- 172.21.15.62:0/1325353048 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f41200de070 0x7f41201112f0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.223+0000 7f412e438640 1 -- 172.21.15.62:0/1325353048 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41280083f0 con 0x7f41200de070 2024-09-10T05:36:34.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.223+0000 7f412e438640 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fd644aa20 con 0x563fd643e910 2024-09-10T05:36:34.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.223+0000 7f412e438640 1 -- 172.21.15.62:0/1325353048 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41280083f0 con 0x563fd643e910 2024-09-10T05:36:34.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.223+0000 7f412e438640 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fd644aa20 con 0x563fd643e910 2024-09-10T05:36:34.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.223+0000 7f412e438640 1 -- 172.21.15.62:0/1325353048 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41280083f0 con 0x563fd643e910 2024-09-10T05:36:34.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.223+0000 7f412e438640 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fd644aa20 con 0x563fd64465b0 2024-09-10T05:36:34.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.223+0000 7f412d436640 1 -- 172.21.15.62:0/1325353048 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f412400f6e0 con 0x563fd64465b0 2024-09-10T05:36:34.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.223+0000 7f412d436640 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fd644aa20 con 0x563fd643e910 2024-09-10T05:36:34.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.223+0000 7f412e438640 1 -- 172.21.15.62:0/1325353048 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41280083f0 con 0x563fd643e910 2024-09-10T05:36:34.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.223+0000 7f412e438640 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fd644aa20 con 0x563fd6442d90 2024-09-10T05:36:34.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.223+0000 7f412dc37640 1 -- 172.21.15.62:0/1325353048 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41200db070 con 0x563fd6442d90 2024-09-10T05:36:34.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.223+0000 7f412dc37640 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fd644aa20 con 0x563fd6442d90 2024-09-10T05:36:34.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.227+0000 7f412dc37640 1 -- 172.21.15.62:0/1325353048 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41200db070 con 0x563fd6442d90 2024-09-10T05:36:34.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.227+0000 7f412dc37640 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fd644aa20 con 0x563fd643e910 2024-09-10T05:36:34.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.227+0000 7f412e438640 1 -- 172.21.15.62:0/1325353048 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41280083f0 con 0x563fd643e910 2024-09-10T05:36:34.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.227+0000 7f412e438640 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fd644aa20 con 0x7f41200de070 2024-09-10T05:36:34.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.227+0000 7f412e438640 1 -- 172.21.15.62:0/1325353048 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41280083f0 con 0x7f41200de070 2024-09-10T05:36:34.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.227+0000 7f412e438640 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fd644aa20 con 0x563fd643e910 2024-09-10T05:36:34.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.227+0000 7f412e438640 1 -- 172.21.15.62:0/1325353048 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41280083f0 con 0x563fd643e910 2024-09-10T05:36:34.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.227+0000 7f412e438640 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fd644aa20 con 0x7f41200de070 2024-09-10T05:36:34.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.227+0000 7f412e438640 1 -- 172.21.15.62:0/1325353048 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f41280083f0 con 0x7f41200de070 2024-09-10T05:36:34.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.227+0000 7f412e438640 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fd644aa20 con 0x563fd6442d90 2024-09-10T05:36:34.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.227+0000 7f412dc37640 1 -- 172.21.15.62:0/1325353048 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41200db070 con 0x563fd6442d90 2024-09-10T05:36:34.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.227+0000 7f412dc37640 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fd644aa20 con 0x563fd64465b0 2024-09-10T05:36:34.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.227+0000 7f412d436640 1 -- 172.21.15.62:0/1325353048 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f412400f6e0 con 0x563fd64465b0 2024-09-10T05:36:34.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.227+0000 7f412d436640 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fd644aa20 con 0x563fd643e910 2024-09-10T05:36:34.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.227+0000 7f412e438640 1 -- 172.21.15.62:0/1325353048 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41280083f0 con 0x563fd643e910 2024-09-10T05:36:34.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.227+0000 7f412e438640 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fd644aa20 con 0x563fd6442d90 2024-09-10T05:36:34.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.227+0000 7f412dc37640 1 -- 172.21.15.62:0/1325353048 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41200db070 con 0x563fd6442d90 2024-09-10T05:36:34.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.227+0000 7f412dc37640 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fd644aa20 con 0x563fd64465b0 2024-09-10T05:36:34.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.227+0000 7f412d436640 1 -- 172.21.15.62:0/1325353048 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 30 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f412400f6e0 con 0x563fd64465b0 2024-09-10T05:36:34.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.227+0000 7f412d436640 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fd644aa20 con 0x563fd643e910 2024-09-10T05:36:34.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.227+0000 7f412e438640 1 -- 172.21.15.62:0/1325353048 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41280083f0 con 0x563fd643e910 2024-09-10T05:36:34.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.227+0000 7f412e438640 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fd644aa20 con 0x563fd643e910 2024-09-10T05:36:34.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.231+0000 7f412e438640 1 -- 172.21.15.62:0/1325353048 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f41280083f0 con 0x563fd643e910 2024-09-10T05:36:34.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.231+0000 7f412e438640 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fd644aa20 con 0x563fd643e910 2024-09-10T05:36:34.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.231+0000 7f412e438640 1 -- 172.21.15.62:0/1325353048 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41280083f0 con 0x563fd643e910 2024-09-10T05:36:34.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.231+0000 7f412e438640 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fd644aa20 con 0x563fd64465b0 2024-09-10T05:36:34.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.231+0000 7f412d436640 1 -- 172.21.15.62:0/1325353048 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f412400f6e0 con 0x563fd64465b0 2024-09-10T05:36:34.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.231+0000 7f412d436640 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fd644aa20 con 0x7f41200de070 2024-09-10T05:36:34.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.231+0000 7f412e438640 1 -- 172.21.15.62:0/1325353048 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41280083f0 con 0x7f41200de070 2024-09-10T05:36:34.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.231+0000 7f412e438640 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fd644aa20 con 0x563fd643e910 2024-09-10T05:36:34.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.231+0000 7f412e438640 1 -- 172.21.15.62:0/1325353048 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41280083f0 con 0x563fd643e910 2024-09-10T05:36:34.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.231+0000 7f412e438640 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fd644aa20 con 0x7f41200de070 2024-09-10T05:36:34.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.231+0000 7f412e438640 1 -- 172.21.15.62:0/1325353048 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41280083f0 con 0x7f41200de070 2024-09-10T05:36:34.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.231+0000 7f412e438640 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fd644aa20 con 0x563fd64465b0 2024-09-10T05:36:34.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.231+0000 7f412d436640 1 -- 172.21.15.62:0/1325353048 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f412400f6e0 con 0x563fd64465b0 2024-09-10T05:36:34.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.231+0000 7f412d436640 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fd644aa20 con 0x7f41200de070 2024-09-10T05:36:34.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.231+0000 7f412e438640 1 -- 172.21.15.62:0/1325353048 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41280083f0 con 0x7f41200de070 2024-09-10T05:36:34.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.231+0000 7f412e438640 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fd644aa20 con 0x563fd6442d90 2024-09-10T05:36:34.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.231+0000 7f412dc37640 1 -- 172.21.15.62:0/1325353048 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41200db070 con 0x563fd6442d90 2024-09-10T05:36:34.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.231+0000 7f412dc37640 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fd644aa20 con 0x563fd6442d90 2024-09-10T05:36:34.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.231+0000 7f412dc37640 1 -- 172.21.15.62:0/1325353048 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41200db070 con 0x563fd6442d90 2024-09-10T05:36:34.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.231+0000 7f412dc37640 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fd644aa20 con 0x563fd64465b0 2024-09-10T05:36:34.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.231+0000 7f412d436640 1 -- 172.21.15.62:0/1325353048 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f412400f6e0 con 0x563fd64465b0 2024-09-10T05:36:34.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.231+0000 7f412d436640 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fd644aa20 con 0x563fd6442d90 2024-09-10T05:36:34.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.235+0000 7f412dc37640 1 -- 172.21.15.62:0/1325353048 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f41200db070 con 0x563fd6442d90 2024-09-10T05:36:34.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.235+0000 7f412dc37640 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fd644aa20 con 0x563fd6442d90 2024-09-10T05:36:34.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.235+0000 7f412dc37640 1 -- 172.21.15.62:0/1325353048 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41200db070 con 0x563fd6442d90 2024-09-10T05:36:34.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.235+0000 7f41301319c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:34.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.235+0000 7f41301319c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:34.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.235+0000 7f41301319c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:34.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.235+0000 7f41301319c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:34.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.235+0000 7f41301319c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:34.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.235+0000 7f41301319c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:34.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.235+0000 7f41301319c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.235+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563fd6449b40 con 0x563fd643e910 2024-09-10T05:36:34.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.235+0000 7f412e438640 1 -- 172.21.15.62:0/1325353048 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f41280083f0 con 0x563fd643e910 2024-09-10T05:36:34.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.235+0000 7f41301319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:34.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.235+0000 7f41301319c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.235+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563fd6449780 con 0x563fd6442d90 2024-09-10T05:36:34.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.235+0000 7f412dc37640 1 -- 172.21.15.62:0/1325353048 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f41200db070 con 0x563fd6442d90 2024-09-10T05:36:34.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.235+0000 7f41301319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:34.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.235+0000 7f41301319c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.235+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563fd644a4e0 con 0x563fd64465b0 2024-09-10T05:36:34.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.235+0000 7f412d436640 1 -- 172.21.15.62:0/1325353048 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f412400f6e0 con 0x563fd64465b0 2024-09-10T05:36:34.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.235+0000 7f41301319c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:34.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.235+0000 7f41301319c0 20 zone default found 2024-09-10T05:36:34.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.235+0000 7f41301319c0 4 Realm: () 2024-09-10T05:36:34.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.235+0000 7f41301319c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:34.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.235+0000 7f41301319c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:34.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.235+0000 7f41301319c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:34.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.235+0000 7f41301319c0 20 zonegroup default 2024-09-10T05:36:34.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.235+0000 7f41301319c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.235+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563fd644b300 con 0x7f41200de070 2024-09-10T05:36:34.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.235+0000 7f412e438640 1 -- 172.21.15.62:0/1325353048 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f41280083f0 con 0x7f41200de070 2024-09-10T05:36:34.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.235+0000 7f41301319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:34.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.235+0000 7f41301319c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.235+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563fd644d540 con 0x563fd64465b0 2024-09-10T05:36:34.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.235+0000 7f412d436640 1 -- 172.21.15.62:0/1325353048 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f412400f6e0 con 0x563fd64465b0 2024-09-10T05:36:34.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.235+0000 7f41301319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:34.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.235+0000 7f41301319c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.235+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563fd644d8e0 con 0x563fd64465b0 2024-09-10T05:36:34.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.235+0000 7f412d436640 1 -- 172.21.15.62:0/1325353048 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f412400f6e0 con 0x563fd64465b0 2024-09-10T05:36:34.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.235+0000 7f41301319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:34.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.235+0000 7f41301319c0 20 started sync module instance, tier type = 2024-09-10T05:36:34.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.235+0000 7f41301319c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:34.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.235+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fd644c9d0 con 0x563fd6442d90 2024-09-10T05:36:34.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.239+0000 7f412dc37640 1 -- 172.21.15.62:0/1325353048 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41200db070 con 0x563fd6442d90 2024-09-10T05:36:34.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.239+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94832177761728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fd644c630 con 0x563fd6442d90 2024-09-10T05:36:34.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.239+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fd644e660 con 0x563fd643e910 2024-09-10T05:36:34.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.239+0000 7f412e438640 1 -- 172.21.15.62:0/1325353048 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41280083f0 con 0x563fd643e910 2024-09-10T05:36:34.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.239+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94832177766704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fd644ef00 con 0x563fd643e910 2024-09-10T05:36:34.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.239+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fd644f900 con 0x563fd6442d90 2024-09-10T05:36:34.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.239+0000 7f412dc37640 1 -- 172.21.15.62:0/1325353048 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94832177761728] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41200db070 con 0x563fd6442d90 2024-09-10T05:36:34.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.239+0000 7f412e438640 1 -- 172.21.15.62:0/1325353048 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94832177766704] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41280083f0 con 0x563fd643e910 2024-09-10T05:36:34.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.239+0000 7f412dc37640 1 -- 172.21.15.62:0/1325353048 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41200db070 con 0x563fd6442d90 2024-09-10T05:36:34.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.239+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94832177765504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fd644ea50 con 0x563fd6442d90 2024-09-10T05:36:34.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.243+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fd64501a0 con 0x7f41200de070 2024-09-10T05:36:34.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.243+0000 7f412e438640 1 -- 172.21.15.62:0/1325353048 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41280083f0 con 0x7f41200de070 2024-09-10T05:36:34.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.243+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94832177773808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fd644ea50 con 0x7f41200de070 2024-09-10T05:36:34.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.243+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fd6450c20 con 0x563fd6442d90 2024-09-10T05:36:34.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.243+0000 7f412dc37640 1 -- 172.21.15.62:0/1325353048 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94832177765504] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41200db070 con 0x563fd6442d90 2024-09-10T05:36:34.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.247+0000 7f412e438640 1 -- 172.21.15.62:0/1325353048 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94832177773808] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41280083f0 con 0x7f41200de070 2024-09-10T05:36:34.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.247+0000 7f412dc37640 1 -- 172.21.15.62:0/1325353048 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41200db070 con 0x563fd6442d90 2024-09-10T05:36:34.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.247+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94832177774864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fd6450730 con 0x563fd6442d90 2024-09-10T05:36:34.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.247+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fd64514f0 con 0x563fd64465b0 2024-09-10T05:36:34.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.247+0000 7f412d436640 1 -- 172.21.15.62:0/1325353048 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f412400f6e0 con 0x563fd64465b0 2024-09-10T05:36:34.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.247+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94832177778752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fd6450730 con 0x563fd64465b0 2024-09-10T05:36:34.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.247+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fd6451f30 con 0x563fd64465b0 2024-09-10T05:36:34.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.247+0000 7f412dc37640 1 -- 172.21.15.62:0/1325353048 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94832177774864] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41200db070 con 0x563fd6442d90 2024-09-10T05:36:34.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.247+0000 7f412d436640 1 -- 172.21.15.62:0/1325353048 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94832177778752] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f412400f6e0 con 0x563fd64465b0 2024-09-10T05:36:34.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.247+0000 7f412d436640 1 -- 172.21.15.62:0/1325353048 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f412400f6e0 con 0x563fd64465b0 2024-09-10T05:36:34.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.247+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94832177779808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fd6451a80 con 0x563fd64465b0 2024-09-10T05:36:34.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.247+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fd64527d0 con 0x7f41200de070 2024-09-10T05:36:34.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.251+0000 7f412e438640 1 -- 172.21.15.62:0/1325353048 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41280083f0 con 0x7f41200de070 2024-09-10T05:36:34.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.251+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94832177783584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fd6451a80 con 0x7f41200de070 2024-09-10T05:36:34.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.251+0000 7f41301319c0 20 add_watcher() i=0 2024-09-10T05:36:34.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.251+0000 7f41301319c0 20 add_watcher() i=1 2024-09-10T05:36:34.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.251+0000 7f41301319c0 20 add_watcher() i=2 2024-09-10T05:36:34.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.251+0000 7f41301319c0 20 add_watcher() i=3 2024-09-10T05:36:34.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.251+0000 7f41301319c0 20 add_watcher() i=4 2024-09-10T05:36:34.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.251+0000 7f41301319c0 20 add_watcher() i=5 2024-09-10T05:36:34.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.251+0000 7f412d436640 1 -- 172.21.15.62:0/1325353048 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94832177779808] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f412400f6e0 con 0x563fd64465b0 2024-09-10T05:36:34.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.251+0000 7f41301319c0 20 add_watcher() i=6 2024-09-10T05:36:34.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.251+0000 7f412e438640 1 -- 172.21.15.62:0/1325353048 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94832177783584] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41280083f0 con 0x7f41200de070 2024-09-10T05:36:34.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.251+0000 7f41301319c0 20 add_watcher() i=7 2024-09-10T05:36:34.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.251+0000 7f41301319c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:34.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.251+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563fd644f410 con 0x563fd643e910 2024-09-10T05:36:34.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.251+0000 7f412e438640 1 -- 172.21.15.62:0/1325353048 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f41280083f0 con 0x563fd643e910 2024-09-10T05:36:34.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.251+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94832177771536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fd6452d90 con 0x563fd643e910 2024-09-10T05:36:34.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.251+0000 7f412e438640 1 -- 172.21.15.62:0/1325353048 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94832177771536] v30'92 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f41280083f0 con 0x563fd643e910 2024-09-10T05:36:34.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.255+0000 7f3fe3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:34.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.255+0000 7f41301319c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:34.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.255+0000 7f41301319c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:34.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.255+0000 7f41301319c0 5 note: GC not initialized 2024-09-10T05:36:34.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.255+0000 7f3fe2fe5640 20 reqs_thread_entry: start 2024-09-10T05:36:34.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.255+0000 7f41301319c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:34.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.255+0000 7f41301319c0 20 Filter name: none 2024-09-10T05:36:34.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.255+0000 7f3fe0fe1640 20 reqs_thread_entry: start 2024-09-10T05:36:34.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.255+0000 7f41301319c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T05:36:34.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.255+0000 7f41301319c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.255+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563fd6478a90 con 0x563fd643e910 2024-09-10T05:36:34.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.255+0000 7f412e438640 1 -- 172.21.15.62:0/1325353048 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f41280083f0 con 0x563fd643e910 2024-09-10T05:36:34.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.255+0000 7f41301319c0 20 rados_obj.operate() r=0 bl.length=556 2024-09-10T05:36:34.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.255+0000 7f41301319c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T05:36:34.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.255+0000 7f41301319c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:36:34.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.255+0000 7f41301319c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:36:34.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.255+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fd647f100 con 0x563fd643e910 2024-09-10T05:36:34.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.255+0000 7f412e438640 1 -- 172.21.15.62:0/1325353048 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v30'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f41280083f0 con 0x563fd643e910 2024-09-10T05:36:34.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.255+0000 7f41301319c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:36:34.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.255+0000 7f41301319c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:36:34.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.255+0000 7f41301319c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T05:36:34.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.255+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94832177966064 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563fd647a8d0 con 0x563fd6442d90 2024-09-10T05:36:34.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.255+0000 7f412dc37640 1 -- 172.21.15.62:0/1325353048 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== watch-notify(notify (1) cookie 94832177774864 notify 128849018895 ret 0) ==== 609+0+0 (crc 0 0 0) 0x563fd64211f0 con 0x563fd6442d90 2024-09-10T05:36:34.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.255+0000 7f40117fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018895 cookie 94832177774864 notifier 4416 bl.length()=567 2024-09-10T05:36:34.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.255+0000 7f412dc37640 1 -- 172.21.15.62:0/1325353048 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(64 notify.4 [notify cookie 94832177966064 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f41200db070 con 0x563fd6442d90 2024-09-10T05:36:34.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.255+0000 7f40117fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:36:34.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.255+0000 7f40117fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:36:34.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.255+0000 7f40117fa640 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f3ff0003eb0 con 0x563fd6442d90 2024-09-10T05:36:34.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.255+0000 7f412dc37640 1 -- 172.21.15.62:0/1325353048 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41200db070 con 0x563fd6442d90 2024-09-10T05:36:34.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.259+0000 7f412dc37640 1 -- 172.21.15.62:0/1325353048 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== watch-notify(notify_complete (2) cookie 94832177966064 notify 128849018895 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563fd6420990 con 0x563fd6442d90 2024-09-10T05:36:34.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.259+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:66 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fd647ebf0 con 0x7f41200de070 2024-09-10T05:36:34.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.259+0000 7f412e438640 1 -- 172.21.15.62:0/1325353048 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(66 foo:foo2 [delete] v30'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41280083f0 con 0x7f41200de070 2024-09-10T05:36:34.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.259+0000 7f41301319c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-10T05:36:34.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.259+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94832177966064 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563fd647a420 con 0x563fd6442d90 2024-09-10T05:36:34.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.259+0000 7f412dc37640 1 -- 172.21.15.62:0/1325353048 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== watch-notify(notify (1) cookie 94832177761728 notify 128849018896 ret 0) ==== 201+0+0 (crc 0 0 0) 0x563fd6420990 con 0x563fd6442d90 2024-09-10T05:36:34.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.259+0000 7f40117fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018896 cookie 94832177761728 notifier 4416 bl.length()=159 2024-09-10T05:36:34.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.259+0000 7f40117fa640 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f3ff0003eb0 con 0x563fd6442d90 2024-09-10T05:36:34.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.259+0000 7f412dc37640 1 -- 172.21.15.62:0/1325353048 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(67 notify.0 [notify cookie 94832177966064 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f41200db070 con 0x563fd6442d90 2024-09-10T05:36:34.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.259+0000 7f412dc37640 1 -- 172.21.15.62:0/1325353048 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== watch-notify(notify_complete (2) cookie 94832177966064 notify 128849018896 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563fd64030b0 con 0x563fd6442d90 2024-09-10T05:36:34.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.259+0000 7f412dc37640 1 -- 172.21.15.62:0/1325353048 <== osd.0 v2:172.21.15.2:6800/945139080 25 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41200db070 con 0x563fd6442d90 2024-09-10T05:36:34.264 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T05:36:30.893777Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:36:30.893760Z","tags":[],"group_ids":[]} 2024-09-10T05:36:34.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.259+0000 7f3fe3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:34.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.259+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94832177771536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fd64768a0 con 0x563fd643e910 2024-09-10T05:36:34.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.263+0000 7f412e438640 1 -- 172.21.15.62:0/1325353048 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94832177771536] v30'93 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f41280083f0 con 0x563fd643e910 2024-09-10T05:36:34.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.263+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94832177761728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fd64768a0 con 0x563fd6442d90 2024-09-10T05:36:34.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.263+0000 7f412dc37640 1 -- 172.21.15.62:0/1325353048 <== osd.0 v2:172.21.15.2:6800/945139080 26 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94832177761728] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41200db070 con 0x563fd6442d90 2024-09-10T05:36:34.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.263+0000 7f41301319c0 20 remove_watcher() i=0 2024-09-10T05:36:34.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.263+0000 7f41301319c0 2 removed watcher, disabling cache 2024-09-10T05:36:34.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.263+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94832177766704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fd64768a0 con 0x563fd643e910 2024-09-10T05:36:34.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.267+0000 7f412e438640 1 -- 172.21.15.62:0/1325353048 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94832177766704] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41280083f0 con 0x563fd643e910 2024-09-10T05:36:34.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.267+0000 7f41301319c0 20 remove_watcher() i=1 2024-09-10T05:36:34.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.267+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94832177765504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fd64768a0 con 0x563fd6442d90 2024-09-10T05:36:34.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.267+0000 7f412dc37640 1 -- 172.21.15.62:0/1325353048 <== osd.0 v2:172.21.15.2:6800/945139080 27 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94832177765504] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41200db070 con 0x563fd6442d90 2024-09-10T05:36:34.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.267+0000 7f41301319c0 20 remove_watcher() i=2 2024-09-10T05:36:34.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.267+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94832177773808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fd64768a0 con 0x7f41200de070 2024-09-10T05:36:34.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.267+0000 7f412e438640 1 -- 172.21.15.62:0/1325353048 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94832177773808] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41280083f0 con 0x7f41200de070 2024-09-10T05:36:34.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.267+0000 7f41301319c0 20 remove_watcher() i=3 2024-09-10T05:36:34.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.267+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94832177774864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fd64768a0 con 0x563fd6442d90 2024-09-10T05:36:34.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.271+0000 7f412dc37640 1 -- 172.21.15.62:0/1325353048 <== osd.0 v2:172.21.15.2:6800/945139080 28 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94832177774864] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41200db070 con 0x563fd6442d90 2024-09-10T05:36:34.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.271+0000 7f41301319c0 20 remove_watcher() i=4 2024-09-10T05:36:34.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.271+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94832177778752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fd64768a0 con 0x563fd64465b0 2024-09-10T05:36:34.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.271+0000 7f412d436640 1 -- 172.21.15.62:0/1325353048 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94832177778752] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f412400f6e0 con 0x563fd64465b0 2024-09-10T05:36:34.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.271+0000 7f41301319c0 20 remove_watcher() i=5 2024-09-10T05:36:34.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.271+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94832177779808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fd64768a0 con 0x563fd64465b0 2024-09-10T05:36:34.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.275+0000 7f412d436640 1 -- 172.21.15.62:0/1325353048 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94832177779808] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f412400f6e0 con 0x563fd64465b0 2024-09-10T05:36:34.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.275+0000 7f41301319c0 20 remove_watcher() i=6 2024-09-10T05:36:34.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.275+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94832177783584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fd64768a0 con 0x7f41200de070 2024-09-10T05:36:34.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.275+0000 7f412e438640 1 -- 172.21.15.62:0/1325353048 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94832177783584] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41280083f0 con 0x7f41200de070 2024-09-10T05:36:34.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.275+0000 7f41301319c0 20 remove_watcher() i=7 2024-09-10T05:36:34.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.275+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x563fd6442d90 msgr2=0x563fd6445180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.275+0000 7f41301319c0 1 --2- 172.21.15.62:0/1325353048 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x563fd6442d90 0x563fd6445180 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.275+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x563fd643e910 msgr2=0x563fd6440da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.275+0000 7f41301319c0 1 --2- 172.21.15.62:0/1325353048 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x563fd643e910 0x563fd6440da0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.275+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f41200de070 msgr2=0x7f41201112f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.275+0000 7f41301319c0 1 --2- 172.21.15.62:0/1325353048 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f41200de070 0x7f41201112f0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.275+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x563fd64465b0 msgr2=0x563fd64489c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.275+0000 7f41301319c0 1 --2- 172.21.15.62:0/1325353048 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x563fd64465b0 0x563fd64489c0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.275+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3ff8039a20 msgr2=0x7f3ff803bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.275+0000 7f41301319c0 1 --2- 172.21.15.62:0/1325353048 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3ff8039a20 0x7f3ff803bee0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f412400ffd0 tx=0x7f4124010000 comp rx=0 tx=0).stop 2024-09-10T05:36:34.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.275+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fd642d720 msgr2=0x563fd64339a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.275+0000 7f41301319c0 1 --2- 172.21.15.62:0/1325353048 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fd642d720 0x563fd64339a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4120005c10 tx=0x7f41200efea0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.275+0000 7f412e438640 1 -- 172.21.15.62:0/1325353048 reap_dead start 2024-09-10T05:36:34.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.275+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 shutdown_connections 2024-09-10T05:36:34.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.275+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 >> 172.21.15.62:0/1325353048 conn(0x563fd6428ae0 msgr2=0x563fd6426cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:34.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.275+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 shutdown_connections 2024-09-10T05:36:34.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.275+0000 7f41301319c0 1 -- 172.21.15.62:0/1325353048 wait complete. 2024-09-10T05:36:34.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.275+0000 7f41301319c0 1 -- 172.21.15.62:0/4116410708 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4008039a20 msgr2=0x7f400803bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.275+0000 7f41301319c0 1 --2- 172.21.15.62:0/4116410708 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4008039a20 0x7f400803bee0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x563fd6404010 tx=0x7f412400f000 comp rx=0 tx=0).stop 2024-09-10T05:36:34.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.275+0000 7f41301319c0 1 -- 172.21.15.62:0/4116410708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fd641ff30 msgr2=0x563fd6420350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.275+0000 7f41301319c0 1 --2- 172.21.15.62:0/4116410708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fd641ff30 0x563fd6420350 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f41200c7540 tx=0x7f41200cf530 comp rx=0 tx=0).stop 2024-09-10T05:36:34.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.275+0000 7f41301319c0 1 -- 172.21.15.62:0/4116410708 shutdown_connections 2024-09-10T05:36:34.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.275+0000 7f41301319c0 1 --2- 172.21.15.62:0/4116410708 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4008039a20 0x7f400803bee0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.275+0000 7f41301319c0 1 --2- 172.21.15.62:0/4116410708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fd641ff30 0x563fd6420350 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.275+0000 7f41301319c0 1 -- 172.21.15.62:0/4116410708 >> 172.21.15.62:0/4116410708 conn(0x563fd64158e0 msgr2=0x563fd6415cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:34.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.275+0000 7f41301319c0 1 -- 172.21.15.62:0/4116410708 shutdown_connections 2024-09-10T05:36:34.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.275+0000 7f41301319c0 1 -- 172.21.15.62:0/4116410708 wait complete. 2024-09-10T05:36:34.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.275+0000 7f41301319c0 1 -- 172.21.15.62:0/1503177094 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x563fd640a410 msgr2=0x563fd640c8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.275+0000 7f41301319c0 1 --2- 172.21.15.62:0/1503177094 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x563fd640a410 0x563fd640c8d0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.275+0000 7f41301319c0 1 -- 172.21.15.62:0/1503177094 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x563fd6406ff0 msgr2=0x563fd64093e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.275+0000 7f41301319c0 1 --2- 172.21.15.62:0/1503177094 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x563fd6406ff0 0x563fd64093e0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.275+0000 7f41301319c0 1 -- 172.21.15.62:0/1503177094 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x563fd640ee00 msgr2=0x563fd64111f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.275+0000 7f41301319c0 1 --2- 172.21.15.62:0/1503177094 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x563fd640ee00 0x563fd64111f0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.275+0000 7f41301319c0 1 -- 172.21.15.62:0/1503177094 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4014039a70 msgr2=0x7f401403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.275+0000 7f41301319c0 1 --2- 172.21.15.62:0/1503177094 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4014039a70 0x7f401403bf30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4124001e90 tx=0x7f41240013f0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.275+0000 7f41301319c0 1 -- 172.21.15.62:0/1503177094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fd63122c0 msgr2=0x563fd6401e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.275+0000 7f41301319c0 1 --2- 172.21.15.62:0/1503177094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fd63122c0 0x563fd6401e90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4120000f90 tx=0x7f4120017e30 comp rx=0 tx=0).stop 2024-09-10T05:36:34.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.275+0000 7f412e438640 1 -- 172.21.15.62:0/1503177094 reap_dead start 2024-09-10T05:36:34.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.275+0000 7f41301319c0 1 -- 172.21.15.62:0/1503177094 shutdown_connections 2024-09-10T05:36:34.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.275+0000 7f41301319c0 1 -- 172.21.15.62:0/1503177094 >> 172.21.15.62:0/1503177094 conn(0x563fd6282a90 msgr2=0x563fd63f5010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:34.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.275+0000 7f41301319c0 1 -- 172.21.15.62:0/1503177094 shutdown_connections 2024-09-10T05:36:34.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.275+0000 7f41301319c0 1 -- 172.21.15.62:0/1503177094 wait complete. 2024-09-10T05:36:34.289 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T05:36:30.893777Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:36:30.893760Z', 'tags': [], 'group_ids': []} 2024-09-10T05:36:34.289 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-10T05:36:34.289 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-10T05:36:34.289 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-10T05:36:34.359 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:34.360 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:34.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.359+0000 7fde664d79c0 1 Processor -- start 2024-09-10T05:36:34.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.359+0000 7fde664d79c0 1 -- start start 2024-09-10T05:36:34.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.359+0000 7fde664d79c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x557b9490e200 0x557b9499f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.359+0000 7fde664d79c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557b9484e9c0 con 0x557b9490e5e0 2024-09-10T05:36:34.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.359+0000 7fde664d79c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x557b9489e6d0 con 0x557b9490e200 2024-09-10T05:36:34.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.359+0000 7fde63fdd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x557b9490e200 0x557b9499f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.359+0000 7fde63fdd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x557b9490e200 0x557b9499f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:52286/0 (socket says 172.21.15.62:52286) 2024-09-10T05:36:34.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.359+0000 7fde63fdd640 1 -- 172.21.15.62:0/806428275 learned_addr learned my addr 172.21.15.62:0/806428275 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:34.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.359+0000 7fde637dc640 1 --1- 172.21.15.62:0/806428275 >> v1:172.21.15.2:6789/0 conn(0x557b9490e5e0 0x557b949a1580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:38672/0 (socket says 172.21.15.62:38672) 2024-09-10T05:36:34.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.359+0000 7fde63fdd640 1 -- 172.21.15.62:0/806428275 >> v1:172.21.15.2:6789/0 conn(0x557b9490e5e0 legacy=0x557b949a1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.359+0000 7fde63fdd640 1 -- 172.21.15.62:0/806428275 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b94842ca0 con 0x557b9490e200 2024-09-10T05:36:34.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.359+0000 7fde63fdd640 1 --2- 172.21.15.62:0/806428275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b9490e200 0x557b9499f030 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fde5c00a5c0 tx=0x7fde5c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74acc4f622bc4f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.359+0000 7fde62fdb640 1 -- 172.21.15.62:0/806428275 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde5c0a6070 con 0x557b9490e200 2024-09-10T05:36:34.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.359+0000 7fde62fdb640 1 -- 172.21.15.62:0/806428275 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde5c0af070 con 0x557b9490e200 2024-09-10T05:36:34.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.359+0000 7fde62fdb640 1 -- 172.21.15.62:0/806428275 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde5c0aa5c0 con 0x557b9490e200 2024-09-10T05:36:34.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.363+0000 7fde664d79c0 1 -- 172.21.15.62:0/806428275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b9490e200 msgr2=0x557b9499f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.363+0000 7fde664d79c0 1 --2- 172.21.15.62:0/806428275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b9490e200 0x557b9499f030 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fde5c00a5c0 tx=0x7fde5c01b340 comp rx=0 tx=0).stop 2024-09-10T05:36:34.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.363+0000 7fde664d79c0 1 -- 172.21.15.62:0/806428275 shutdown_connections 2024-09-10T05:36:34.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.363+0000 7fde664d79c0 1 --2- 172.21.15.62:0/806428275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b9490e200 0x557b9499f030 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.363+0000 7fde664d79c0 1 -- 172.21.15.62:0/806428275 >> 172.21.15.62:0/806428275 conn(0x557b94994920 msgr2=0x557b94996d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:34.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.363+0000 7fde664d79c0 1 -- 172.21.15.62:0/806428275 shutdown_connections 2024-09-10T05:36:34.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.363+0000 7fde664d79c0 1 -- 172.21.15.62:0/806428275 wait complete. 2024-09-10T05:36:34.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.375+0000 7fde664d79c0 1 Processor -- start 2024-09-10T05:36:34.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.375+0000 7fde664d79c0 1 -- start start 2024-09-10T05:36:34.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.375+0000 7fde664d79c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b9490e200 0x557b94a87860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.375+0000 7fde664d79c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557b948a2680 con 0x557b9490e200 2024-09-10T05:36:34.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.375+0000 7fde63fdd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b9490e200 0x557b94a87860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.375+0000 7fde63fdd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b9490e200 0x557b94a87860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:52292/0 (socket says 172.21.15.62:52292) 2024-09-10T05:36:34.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.375+0000 7fde63fdd640 1 -- 172.21.15.62:0/101681670 learned_addr learned my addr 172.21.15.62:0/101681670 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:34.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.375+0000 7fde63fdd640 1 -- 172.21.15.62:0/101681670 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b9481dda0 con 0x557b9490e200 2024-09-10T05:36:34.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.375+0000 7fde63fdd640 1 --2- 172.21.15.62:0/101681670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b9490e200 0x557b94a87860 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fde5c018f70 tx=0x7fde5c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1e111bef7275665 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.375+0000 7fdd51e0b640 1 -- 172.21.15.62:0/101681670 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde5c0aa9e0 con 0x557b9490e200 2024-09-10T05:36:34.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.375+0000 7fdd51e0b640 1 -- 172.21.15.62:0/101681670 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde5c0aab80 con 0x557b9490e200 2024-09-10T05:36:34.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.375+0000 7fdd51e0b640 1 -- 172.21.15.62:0/101681670 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde5c0aae60 con 0x557b9490e200 2024-09-10T05:36:34.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.375+0000 7fde664d79c0 1 -- 172.21.15.62:0/101681670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b9490e200 msgr2=0x557b94a87860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.375+0000 7fde664d79c0 1 --2- 172.21.15.62:0/101681670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b9490e200 0x557b94a87860 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fde5c018f70 tx=0x7fde5c003030 comp rx=0 tx=0).stop 2024-09-10T05:36:34.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.375+0000 7fde664d79c0 1 -- 172.21.15.62:0/101681670 shutdown_connections 2024-09-10T05:36:34.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.375+0000 7fde664d79c0 1 --2- 172.21.15.62:0/101681670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b9490e200 0x557b94a87860 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.375+0000 7fde664d79c0 1 -- 172.21.15.62:0/101681670 >> 172.21.15.62:0/101681670 conn(0x557b94994920 msgr2=0x557b94a834a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:34.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.375+0000 7fde664d79c0 1 -- 172.21.15.62:0/101681670 shutdown_connections 2024-09-10T05:36:34.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.375+0000 7fde664d79c0 1 -- 172.21.15.62:0/101681670 wait complete. 2024-09-10T05:36:34.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.375+0000 7fde664d79c0 1 Processor -- start 2024-09-10T05:36:34.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.375+0000 7fde664d79c0 1 -- start start 2024-09-10T05:36:34.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.379+0000 7fde664d79c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b9490e200 0x557b94a8edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.379+0000 7fde664d79c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557b94844a50 con 0x557b9490e200 2024-09-10T05:36:34.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.379+0000 7fde63fdd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b9490e200 0x557b94a8edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.379+0000 7fde63fdd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b9490e200 0x557b94a8edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:52296/0 (socket says 172.21.15.62:52296) 2024-09-10T05:36:34.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.379+0000 7fde63fdd640 1 -- 172.21.15.62:0/3195556844 learned_addr learned my addr 172.21.15.62:0/3195556844 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:34.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.379+0000 7fde63fdd640 1 -- 172.21.15.62:0/3195556844 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b94a8f330 con 0x557b9490e200 2024-09-10T05:36:34.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.379+0000 7fde63fdd640 1 --2- 172.21.15.62:0/3195556844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b9490e200 0x557b94a8edd0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fde5c000c10 tx=0x7fde5c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.379+0000 7fdd4bfff640 1 -- 172.21.15.62:0/3195556844 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde5c0c6750 con 0x557b9490e200 2024-09-10T05:36:34.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.379+0000 7fde664d79c0 1 -- 172.21.15.62:0/3195556844 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557b94a8f5c0 con 0x557b9490e200 2024-09-10T05:36:34.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.379+0000 7fdd4bfff640 1 -- 172.21.15.62:0/3195556844 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde5c0c68f0 con 0x557b9490e200 2024-09-10T05:36:34.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.379+0000 7fdd4bfff640 1 -- 172.21.15.62:0/3195556844 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde5c0c6bf0 con 0x557b9490e200 2024-09-10T05:36:34.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.379+0000 7fde664d79c0 1 -- 172.21.15.62:0/3195556844 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b94a8ff70 con 0x557b9490e200 2024-09-10T05:36:34.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.379+0000 7fdd4bfff640 1 -- 172.21.15.62:0/3195556844 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fde5c0ce030 con 0x557b9490e200 2024-09-10T05:36:34.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.379+0000 7fdd4bfff640 1 --2- 172.21.15.62:0/3195556844 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fdd4c039a70 0x7fdd4c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.379+0000 7fdd4bfff640 1 -- 172.21.15.62:0/3195556844 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fde5c0cc020 con 0x557b9490e200 2024-09-10T05:36:34.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.379+0000 7fde637dc640 1 --2- 172.21.15.62:0/3195556844 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fdd4c039a70 0x7fdd4c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.379+0000 7fde664d79c0 1 --2- 172.21.15.62:0/3195556844 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x557b9490e5e0 0x557b94a95f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.379+0000 7fde664d79c0 1 -- 172.21.15.62:0/3195556844 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557b94a96480 con 0x557b9490e5e0 2024-09-10T05:36:34.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.379+0000 7fde647de640 1 --2- 172.21.15.62:0/3195556844 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x557b9490e5e0 0x557b94a95f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.379+0000 7fde637dc640 1 --2- 172.21.15.62:0/3195556844 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fdd4c039a70 0x7fdd4c03bf30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fde58001640 tx=0x7fde580066a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.379+0000 7fde647de640 1 --2- 172.21.15.62:0/3195556844 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x557b9490e5e0 0x557b94a95f40 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.383+0000 7fde647de640 1 -- 172.21.15.62:0/3195556844 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fde540083f0 con 0x557b9490e5e0 2024-09-10T05:36:34.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.383+0000 7fde664d79c0 1 --2- 172.21.15.62:0/3195556844 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x557b94a96f80 0x557b94a99440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.383+0000 7fde664d79c0 1 -- 172.21.15.62:0/3195556844 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557b94a99bb0 con 0x557b94a96f80 2024-09-10T05:36:34.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.383+0000 7fde63fdd640 1 --2- 172.21.15.62:0/3195556844 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x557b94a96f80 0x557b94a99440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.383+0000 7fde63fdd640 1 --2- 172.21.15.62:0/3195556844 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x557b94a96f80 0x557b94a99440 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.383+0000 7fde63fdd640 1 -- 172.21.15.62:0/3195556844 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fde5c0c53e0 con 0x557b94a96f80 2024-09-10T05:36:34.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.383+0000 7fde664d79c0 1 --2- 172.21.15.62:0/3195556844 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x557b94a9b970 0x557b94a9dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.383+0000 7fde664d79c0 1 -- 172.21.15.62:0/3195556844 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557b94a9e450 con 0x557b94a9b970 2024-09-10T05:36:34.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.383+0000 7fde637dc640 1 --2- 172.21.15.62:0/3195556844 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x557b94a9b970 0x557b94a9dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.383+0000 7fde637dc640 1 --2- 172.21.15.62:0/3195556844 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x557b94a9b970 0x557b94a9dd60 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.383+0000 7fde637dc640 1 -- 172.21.15.62:0/3195556844 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fde5800f070 con 0x557b94a9b970 2024-09-10T05:36:34.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.383+0000 7fde664d79c0 1 -- 172.21.15.62:0/3195556844 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557b94a9a810 con 0x557b94a96f80 2024-09-10T05:36:34.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.383+0000 7fde63fdd640 1 -- 172.21.15.62:0/3195556844 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fde5c0c53e0 con 0x557b94a96f80 2024-09-10T05:36:34.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.383+0000 7fde664d79c0 1 -- 172.21.15.62:0/3195556844 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557b94a9ac70 con 0x557b94a9b970 2024-09-10T05:36:34.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.383+0000 7fde637dc640 1 -- 172.21.15.62:0/3195556844 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fde5800f070 con 0x557b94a9b970 2024-09-10T05:36:34.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.383+0000 7fde664d79c0 1 Processor -- start 2024-09-10T05:36:34.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.383+0000 7fde664d79c0 1 -- start start 2024-09-10T05:36:34.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.387+0000 7fde664d79c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b94aacaa0 0x557b94aacec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.387+0000 7fde664d79c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557b948af450 con 0x557b94aacaa0 2024-09-10T05:36:34.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.387+0000 7fde63fdd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b94aacaa0 0x557b94aacec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.387+0000 7fde63fdd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b94aacaa0 0x557b94aacec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:52306/0 (socket says 172.21.15.62:52306) 2024-09-10T05:36:34.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.387+0000 7fde63fdd640 1 -- 172.21.15.62:0/3036383567 learned_addr learned my addr 172.21.15.62:0/3036383567 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:34.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.387+0000 7fde63fdd640 1 -- 172.21.15.62:0/3036383567 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b94aad500 con 0x557b94aacaa0 2024-09-10T05:36:34.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.387+0000 7fde63fdd640 1 --2- 172.21.15.62:0/3036383567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b94aacaa0 0x557b94aacec0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fde5c0bcb60 tx=0x7fde5c0cfa20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.387+0000 7fdd497fa640 1 -- 172.21.15.62:0/3036383567 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde5c0f0070 con 0x557b94aacaa0 2024-09-10T05:36:34.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.387+0000 7fde664d79c0 1 -- 172.21.15.62:0/3036383567 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557b94aadd60 con 0x557b94aacaa0 2024-09-10T05:36:34.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.387+0000 7fdd497fa640 1 -- 172.21.15.62:0/3036383567 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde5c0ebb80 con 0x557b94aacaa0 2024-09-10T05:36:34.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.387+0000 7fdd497fa640 1 -- 172.21.15.62:0/3036383567 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde5c0ebe60 con 0x557b94aacaa0 2024-09-10T05:36:34.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.387+0000 7fde664d79c0 1 -- 172.21.15.62:0/3036383567 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b94aae2d0 con 0x557b94aacaa0 2024-09-10T05:36:34.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.387+0000 7fdd497fa640 1 -- 172.21.15.62:0/3036383567 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fde5c0f3070 con 0x557b94aacaa0 2024-09-10T05:36:34.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.387+0000 7fdd497fa640 1 --2- 172.21.15.62:0/3036383567 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fdd3c039ac0 0x7fdd3c03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.387+0000 7fdd497fa640 1 -- 172.21.15.62:0/3036383567 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fde5c0e1030 con 0x557b94aacaa0 2024-09-10T05:36:34.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.387+0000 7fde637dc640 1 --2- 172.21.15.62:0/3036383567 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fdd3c039ac0 0x7fdd3c03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.387+0000 7fde664d79c0 1 Processor -- start 2024-09-10T05:36:34.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.387+0000 7fde664d79c0 1 -- start start 2024-09-10T05:36:34.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.387+0000 7fde637dc640 1 --2- 172.21.15.62:0/3036383567 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fdd3c039ac0 0x7fdd3c03bf80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fde580063c0 tx=0x7fde5800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.387+0000 7fde664d79c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b94aba2a0 0x557b94aba680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.387+0000 7fde664d79c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557b94a87ff0 con 0x557b94aba2a0 2024-09-10T05:36:34.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.391+0000 7fde63fdd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b94aba2a0 0x557b94aba680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.391+0000 7fde63fdd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b94aba2a0 0x557b94aba680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:52308/0 (socket says 172.21.15.62:52308) 2024-09-10T05:36:34.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.391+0000 7fde63fdd640 1 -- 172.21.15.62:0/2977756358 learned_addr learned my addr 172.21.15.62:0/2977756358 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:34.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.391+0000 7fde63fdd640 1 -- 172.21.15.62:0/2977756358 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b94abac70 con 0x557b94aba2a0 2024-09-10T05:36:34.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.391+0000 7fde63fdd640 1 --2- 172.21.15.62:0/2977756358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b94aba2a0 0x557b94aba680 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fde5c0d0af0 tx=0x7fde5c0e81a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98281fba03d7c162 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.391+0000 7fdd42ffd640 1 -- 172.21.15.62:0/2977756358 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde5c107070 con 0x557b94aba2a0 2024-09-10T05:36:34.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.391+0000 7fdd42ffd640 1 -- 172.21.15.62:0/2977756358 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde5c0e2b70 con 0x557b94aba2a0 2024-09-10T05:36:34.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.391+0000 7fdd42ffd640 1 -- 172.21.15.62:0/2977756358 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde5c0c5930 con 0x557b94aba2a0 2024-09-10T05:36:34.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.391+0000 7fde664d79c0 1 -- 172.21.15.62:0/2977756358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b94aba2a0 msgr2=0x557b94aba680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.391+0000 7fde664d79c0 1 --2- 172.21.15.62:0/2977756358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b94aba2a0 0x557b94aba680 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fde5c0d0af0 tx=0x7fde5c0e81a0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.391+0000 7fde664d79c0 1 -- 172.21.15.62:0/2977756358 shutdown_connections 2024-09-10T05:36:34.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.391+0000 7fde664d79c0 1 --2- 172.21.15.62:0/2977756358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b94aba2a0 0x557b94aba680 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.391+0000 7fde664d79c0 1 -- 172.21.15.62:0/2977756358 >> 172.21.15.62:0/2977756358 conn(0x557b94ab5660 msgr2=0x557b94ab38a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:34.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.391+0000 7fde664d79c0 1 -- 172.21.15.62:0/2977756358 shutdown_connections 2024-09-10T05:36:34.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.391+0000 7fde664d79c0 1 -- 172.21.15.62:0/2977756358 wait complete. 2024-09-10T05:36:34.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.391+0000 7fde664d79c0 1 Processor -- start 2024-09-10T05:36:34.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.391+0000 7fde664d79c0 1 -- start start 2024-09-10T05:36:34.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.391+0000 7fde664d79c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b94aba2a0 0x557b94ac0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.391+0000 7fde664d79c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557b94ab9010 con 0x557b94aba2a0 2024-09-10T05:36:34.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.391+0000 7fde63fdd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b94aba2a0 0x557b94ac0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.391+0000 7fde63fdd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b94aba2a0 0x557b94ac0520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:52310/0 (socket says 172.21.15.62:52310) 2024-09-10T05:36:34.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.391+0000 7fde63fdd640 1 -- 172.21.15.62:0/1559984099 learned_addr learned my addr 172.21.15.62:0/1559984099 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:34.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.391+0000 7fde63fdd640 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b94ac0a80 con 0x557b94aba2a0 2024-09-10T05:36:34.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.391+0000 7fde63fdd640 1 --2- 172.21.15.62:0/1559984099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b94aba2a0 0x557b94ac0520 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fde5c0c6e30 tx=0x7fde5c0cae60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.391+0000 7fdd417fa640 1 -- 172.21.15.62:0/1559984099 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde5c112020 con 0x557b94aba2a0 2024-09-10T05:36:34.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.391+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557b94ac0a80 con 0x557b94aba2a0 2024-09-10T05:36:34.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.391+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b94ac0ef0 con 0x557b94aba2a0 2024-09-10T05:36:34.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.395+0000 7fdd417fa640 1 -- 172.21.15.62:0/1559984099 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde5c108040 con 0x557b94aba2a0 2024-09-10T05:36:34.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.395+0000 7fdd417fa640 1 -- 172.21.15.62:0/1559984099 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde5c107070 con 0x557b94aba2a0 2024-09-10T05:36:34.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.395+0000 7fde664d79c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.395+0000 7fdd417fa640 1 -- 172.21.15.62:0/1559984099 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fde5c115020 con 0x557b94aba2a0 2024-09-10T05:36:34.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.395+0000 7fdd417fa640 1 --2- 172.21.15.62:0/1559984099 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fdd2c039a70 0x7fdd2c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.395+0000 7fdd417fa640 1 -- 172.21.15.62:0/1559984099 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fde5c0f9170 con 0x557b94aba2a0 2024-09-10T05:36:34.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.395+0000 7fde637dc640 1 --2- 172.21.15.62:0/1559984099 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fdd2c039a70 0x7fdd2c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.395+0000 7fde664d79c0 1 --2- 172.21.15.62:0/1559984099 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x557b94acb310 0x557b94acd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.395+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557b94acdef0 con 0x557b94acb310 2024-09-10T05:36:34.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.395+0000 7fde647de640 1 --2- 172.21.15.62:0/1559984099 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x557b94acb310 0x557b94acd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.395+0000 7fde637dc640 1 --2- 172.21.15.62:0/1559984099 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fdd2c039a70 0x7fdd2c03bf30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x557b94a96820 tx=0x7fde58010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.395+0000 7fde647de640 1 --2- 172.21.15.62:0/1559984099 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x557b94acb310 0x557b94acd7a0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.395+0000 7fde647de640 1 -- 172.21.15.62:0/1559984099 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fde540083f0 con 0x557b94acb310 2024-09-10T05:36:34.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.395+0000 7fde664d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:34.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.395+0000 7fde664d79c0 20 realm 2024-09-10T05:36:34.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.395+0000 7fde664d79c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.395+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557b94aca6a0 con 0x557b94acb310 2024-09-10T05:36:34.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.395+0000 7fde647de640 1 -- 172.21.15.62:0/1559984099 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fde540083f0 con 0x557b94acb310 2024-09-10T05:36:34.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.395+0000 7fde664d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:34.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.395+0000 7fde664d79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:34.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.395+0000 7fde664d79c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.395+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557b94ace9b0 con 0x557b94acb310 2024-09-10T05:36:34.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.395+0000 7fde647de640 1 -- 172.21.15.62:0/1559984099 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fde540083f0 con 0x557b94acb310 2024-09-10T05:36:34.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.395+0000 7fde664d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:34.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.395+0000 7fde664d79c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.395+0000 7fde664d79c0 1 --2- 172.21.15.62:0/1559984099 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x557b94acf790 0x557b94ad1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.395+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557b94ad2210 con 0x557b94acf790 2024-09-10T05:36:34.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.395+0000 7fde63fdd640 1 --2- 172.21.15.62:0/1559984099 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x557b94acf790 0x557b94ad1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.395+0000 7fde63fdd640 1 --2- 172.21.15.62:0/1559984099 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x557b94acf790 0x557b94ad1b80 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.399+0000 7fde63fdd640 1 -- 172.21.15.62:0/1559984099 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fde5c100070 con 0x557b94acf790 2024-09-10T05:36:34.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.399+0000 7fde664d79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:34.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.399+0000 7fde664d79c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.399+0000 7fde664d79c0 1 --2- 172.21.15.62:0/1559984099 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x557b94ad2fc0 0x557b94ad53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.399+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557b94ad5a50 con 0x557b94ad2fc0 2024-09-10T05:36:34.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.399+0000 7fde637dc640 1 --2- 172.21.15.62:0/1559984099 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x557b94ad2fc0 0x557b94ad53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.399+0000 7fde637dc640 1 --2- 172.21.15.62:0/1559984099 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x557b94ad2fc0 0x557b94ad53b0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.399+0000 7fde637dc640 1 -- 172.21.15.62:0/1559984099 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fde5802d040 con 0x557b94ad2fc0 2024-09-10T05:36:34.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.399+0000 7fde664d79c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:34.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.399+0000 7fde664d79c0 20 searching for the correct realm 2024-09-10T05:36:34.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.399+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557b94ad7340 con 0x557b94ad2fc0 2024-09-10T05:36:34.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.399+0000 7fde637dc640 1 -- 172.21.15.62:0/1559984099 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde5802d040 con 0x557b94ad2fc0 2024-09-10T05:36:34.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.399+0000 7fde637dc640 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557b94ad7340 con 0x557b94acf790 2024-09-10T05:36:34.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.399+0000 7fde63fdd640 1 -- 172.21.15.62:0/1559984099 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde5c100070 con 0x557b94acf790 2024-09-10T05:36:34.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.399+0000 7fde63fdd640 1 --2- 172.21.15.62:0/1559984099 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fde5c120040 0x7fde5c1067e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.399+0000 7fde63fdd640 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557b94ad7340 con 0x7fde5c120040 2024-09-10T05:36:34.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.399+0000 7fde647de640 1 --2- 172.21.15.62:0/1559984099 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fde5c120040 0x7fde5c1067e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.399+0000 7fde647de640 1 --2- 172.21.15.62:0/1559984099 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fde5c120040 0x7fde5c1067e0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.399+0000 7fde647de640 1 -- 172.21.15.62:0/1559984099 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde540083f0 con 0x7fde5c120040 2024-09-10T05:36:34.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.399+0000 7fde647de640 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557b94ad7340 con 0x557b94acb310 2024-09-10T05:36:34.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.399+0000 7fde647de640 1 -- 172.21.15.62:0/1559984099 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde540083f0 con 0x557b94acb310 2024-09-10T05:36:34.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.399+0000 7fde647de640 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557b94ad7340 con 0x557b94acb310 2024-09-10T05:36:34.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.399+0000 7fde647de640 1 -- 172.21.15.62:0/1559984099 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde540083f0 con 0x557b94acb310 2024-09-10T05:36:34.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.399+0000 7fde647de640 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557b94ad7340 con 0x557b94ad2fc0 2024-09-10T05:36:34.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.399+0000 7fde637dc640 1 -- 172.21.15.62:0/1559984099 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde5802d040 con 0x557b94ad2fc0 2024-09-10T05:36:34.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.399+0000 7fde637dc640 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557b94ad7340 con 0x557b94acb310 2024-09-10T05:36:34.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.399+0000 7fde647de640 1 -- 172.21.15.62:0/1559984099 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde540083f0 con 0x557b94acb310 2024-09-10T05:36:34.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.399+0000 7fde647de640 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557b94ad7340 con 0x557b94acf790 2024-09-10T05:36:34.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.403+0000 7fde63fdd640 1 -- 172.21.15.62:0/1559984099 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde5c100070 con 0x557b94acf790 2024-09-10T05:36:34.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.403+0000 7fde63fdd640 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557b94ad7340 con 0x557b94acf790 2024-09-10T05:36:34.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.403+0000 7fde63fdd640 1 -- 172.21.15.62:0/1559984099 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde5c100070 con 0x557b94acf790 2024-09-10T05:36:34.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.403+0000 7fde63fdd640 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557b94ad7340 con 0x557b94acb310 2024-09-10T05:36:34.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.403+0000 7fde647de640 1 -- 172.21.15.62:0/1559984099 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde540083f0 con 0x557b94acb310 2024-09-10T05:36:34.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.403+0000 7fde647de640 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557b94ad7340 con 0x7fde5c120040 2024-09-10T05:36:34.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.403+0000 7fde647de640 1 -- 172.21.15.62:0/1559984099 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde540083f0 con 0x7fde5c120040 2024-09-10T05:36:34.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.403+0000 7fde647de640 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557b94ad7340 con 0x557b94acb310 2024-09-10T05:36:34.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.403+0000 7fde647de640 1 -- 172.21.15.62:0/1559984099 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde540083f0 con 0x557b94acb310 2024-09-10T05:36:34.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.403+0000 7fde647de640 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557b94ad7340 con 0x7fde5c120040 2024-09-10T05:36:34.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.403+0000 7fde647de640 1 -- 172.21.15.62:0/1559984099 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fde540083f0 con 0x7fde5c120040 2024-09-10T05:36:34.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.403+0000 7fde647de640 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557b94ad7340 con 0x557b94acf790 2024-09-10T05:36:34.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.403+0000 7fde63fdd640 1 -- 172.21.15.62:0/1559984099 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde5c100070 con 0x557b94acf790 2024-09-10T05:36:34.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.403+0000 7fde63fdd640 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557b94ad7340 con 0x557b94ad2fc0 2024-09-10T05:36:34.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.403+0000 7fde637dc640 1 -- 172.21.15.62:0/1559984099 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde5802d040 con 0x557b94ad2fc0 2024-09-10T05:36:34.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.403+0000 7fde637dc640 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557b94ad7340 con 0x557b94acb310 2024-09-10T05:36:34.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.403+0000 7fde647de640 1 -- 172.21.15.62:0/1559984099 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde540083f0 con 0x557b94acb310 2024-09-10T05:36:34.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.403+0000 7fde647de640 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557b94ad7340 con 0x557b94acf790 2024-09-10T05:36:34.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.407+0000 7fde63fdd640 1 -- 172.21.15.62:0/1559984099 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde5c100070 con 0x557b94acf790 2024-09-10T05:36:34.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.407+0000 7fde63fdd640 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557b94ad7340 con 0x557b94ad2fc0 2024-09-10T05:36:34.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.407+0000 7fde637dc640 1 -- 172.21.15.62:0/1559984099 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 30 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7fde5802d040 con 0x557b94ad2fc0 2024-09-10T05:36:34.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.407+0000 7fde637dc640 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557b94ad7340 con 0x557b94acb310 2024-09-10T05:36:34.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.407+0000 7fde647de640 1 -- 172.21.15.62:0/1559984099 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde540083f0 con 0x557b94acb310 2024-09-10T05:36:34.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.407+0000 7fde647de640 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557b94ad7340 con 0x557b94acb310 2024-09-10T05:36:34.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.407+0000 7fde647de640 1 -- 172.21.15.62:0/1559984099 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fde540083f0 con 0x557b94acb310 2024-09-10T05:36:34.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.407+0000 7fde647de640 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557b94ad7340 con 0x557b94acb310 2024-09-10T05:36:34.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.407+0000 7fde647de640 1 -- 172.21.15.62:0/1559984099 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde540083f0 con 0x557b94acb310 2024-09-10T05:36:34.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.407+0000 7fde647de640 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557b94ad7340 con 0x557b94ad2fc0 2024-09-10T05:36:34.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.407+0000 7fde637dc640 1 -- 172.21.15.62:0/1559984099 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde5802d040 con 0x557b94ad2fc0 2024-09-10T05:36:34.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.407+0000 7fde637dc640 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557b94ad7340 con 0x7fde5c120040 2024-09-10T05:36:34.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.407+0000 7fde647de640 1 -- 172.21.15.62:0/1559984099 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde540083f0 con 0x7fde5c120040 2024-09-10T05:36:34.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.407+0000 7fde647de640 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557b94ad7340 con 0x557b94acb310 2024-09-10T05:36:34.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.407+0000 7fde647de640 1 -- 172.21.15.62:0/1559984099 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde540083f0 con 0x557b94acb310 2024-09-10T05:36:34.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.407+0000 7fde647de640 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557b94ad7340 con 0x7fde5c120040 2024-09-10T05:36:34.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.407+0000 7fde647de640 1 -- 172.21.15.62:0/1559984099 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde540083f0 con 0x7fde5c120040 2024-09-10T05:36:34.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.407+0000 7fde647de640 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557b94ad7340 con 0x557b94ad2fc0 2024-09-10T05:36:34.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.407+0000 7fde637dc640 1 -- 172.21.15.62:0/1559984099 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde5802d040 con 0x557b94ad2fc0 2024-09-10T05:36:34.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.407+0000 7fde637dc640 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557b94ad7340 con 0x7fde5c120040 2024-09-10T05:36:34.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.407+0000 7fde647de640 1 -- 172.21.15.62:0/1559984099 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde540083f0 con 0x7fde5c120040 2024-09-10T05:36:34.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.407+0000 7fde647de640 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557b94ad7340 con 0x557b94acf790 2024-09-10T05:36:34.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.407+0000 7fde63fdd640 1 -- 172.21.15.62:0/1559984099 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde5c100070 con 0x557b94acf790 2024-09-10T05:36:34.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.407+0000 7fde63fdd640 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557b94ad7340 con 0x557b94acf790 2024-09-10T05:36:34.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.411+0000 7fde63fdd640 1 -- 172.21.15.62:0/1559984099 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde5c100070 con 0x557b94acf790 2024-09-10T05:36:34.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.411+0000 7fde63fdd640 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557b94ad7340 con 0x557b94ad2fc0 2024-09-10T05:36:34.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.411+0000 7fde637dc640 1 -- 172.21.15.62:0/1559984099 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde5802d040 con 0x557b94ad2fc0 2024-09-10T05:36:34.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.411+0000 7fde637dc640 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557b94ad7340 con 0x557b94acf790 2024-09-10T05:36:34.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.411+0000 7fde63fdd640 1 -- 172.21.15.62:0/1559984099 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fde5c100070 con 0x557b94acf790 2024-09-10T05:36:34.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.411+0000 7fde63fdd640 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557b94ad7340 con 0x557b94acf790 2024-09-10T05:36:34.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.411+0000 7fde63fdd640 1 -- 172.21.15.62:0/1559984099 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde5c100070 con 0x557b94acf790 2024-09-10T05:36:34.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.411+0000 7fde664d79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:34.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.411+0000 7fde664d79c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:34.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.411+0000 7fde664d79c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:34.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.411+0000 7fde664d79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:34.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.411+0000 7fde664d79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:34.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.411+0000 7fde664d79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:34.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.411+0000 7fde664d79c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.411+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557b94ad6440 con 0x557b94acb310 2024-09-10T05:36:34.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.411+0000 7fde647de640 1 -- 172.21.15.62:0/1559984099 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fde540083f0 con 0x557b94acb310 2024-09-10T05:36:34.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.411+0000 7fde664d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:34.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.411+0000 7fde664d79c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.411+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557b94ad6890 con 0x557b94acf790 2024-09-10T05:36:34.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.411+0000 7fde63fdd640 1 -- 172.21.15.62:0/1559984099 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fde5c100070 con 0x557b94acf790 2024-09-10T05:36:34.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.411+0000 7fde664d79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:34.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.411+0000 7fde664d79c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.411+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557b94ad6cf0 con 0x557b94ad2fc0 2024-09-10T05:36:34.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.411+0000 7fde637dc640 1 -- 172.21.15.62:0/1559984099 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fde5802d040 con 0x557b94ad2fc0 2024-09-10T05:36:34.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.411+0000 7fde664d79c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:34.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.411+0000 7fde664d79c0 20 zone default found 2024-09-10T05:36:34.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.411+0000 7fde664d79c0 4 Realm: () 2024-09-10T05:36:34.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.411+0000 7fde664d79c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:34.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.411+0000 7fde664d79c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:34.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.411+0000 7fde664d79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:34.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.411+0000 7fde664d79c0 20 zonegroup default 2024-09-10T05:36:34.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.411+0000 7fde664d79c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.411+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557b94ad5fc0 con 0x7fde5c120040 2024-09-10T05:36:34.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.411+0000 7fde647de640 1 -- 172.21.15.62:0/1559984099 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fde540083f0 con 0x7fde5c120040 2024-09-10T05:36:34.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.411+0000 7fde664d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:34.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.411+0000 7fde664d79c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.411+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557b94ad9a50 con 0x557b94ad2fc0 2024-09-10T05:36:34.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.411+0000 7fde637dc640 1 -- 172.21.15.62:0/1559984099 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fde5802d040 con 0x557b94ad2fc0 2024-09-10T05:36:34.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.411+0000 7fde664d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:34.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.411+0000 7fde664d79c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.411+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557b94ad9ee0 con 0x557b94ad2fc0 2024-09-10T05:36:34.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.415+0000 7fde637dc640 1 -- 172.21.15.62:0/1559984099 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fde5802d040 con 0x557b94ad2fc0 2024-09-10T05:36:34.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.415+0000 7fde664d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:34.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.415+0000 7fde664d79c0 20 started sync module instance, tier type = 2024-09-10T05:36:34.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.415+0000 7fde664d79c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:34.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.415+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557b94ad9480 con 0x557b94acf790 2024-09-10T05:36:34.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.415+0000 7fde63fdd640 1 -- 172.21.15.62:0/1559984099 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde5c100070 con 0x557b94acf790 2024-09-10T05:36:34.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.415+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93989263739168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557b94ada380 con 0x557b94acf790 2024-09-10T05:36:34.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.415+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557b94adae20 con 0x557b94acb310 2024-09-10T05:36:34.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.415+0000 7fde647de640 1 -- 172.21.15.62:0/1559984099 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde540083f0 con 0x557b94acb310 2024-09-10T05:36:34.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.415+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93989263749568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557b94adba90 con 0x557b94acb310 2024-09-10T05:36:34.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.415+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557b94adc450 con 0x557b94acf790 2024-09-10T05:36:34.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.415+0000 7fde63fdd640 1 -- 172.21.15.62:0/1559984099 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 93989263739168] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde5c100070 con 0x557b94acf790 2024-09-10T05:36:34.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.419+0000 7fde647de640 1 -- 172.21.15.62:0/1559984099 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93989263749568] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde540083f0 con 0x557b94acb310 2024-09-10T05:36:34.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.419+0000 7fde63fdd640 1 -- 172.21.15.62:0/1559984099 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde5c100070 con 0x557b94acf790 2024-09-10T05:36:34.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.419+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93989263753120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557b94adba90 con 0x557b94acf790 2024-09-10T05:36:34.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.419+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557b94adc3c0 con 0x7fde5c120040 2024-09-10T05:36:34.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.419+0000 7fde647de640 1 -- 172.21.15.62:0/1559984099 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde540083f0 con 0x7fde5c120040 2024-09-10T05:36:34.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.419+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93989263755328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557b94adc3c0 con 0x7fde5c120040 2024-09-10T05:36:34.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.419+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557b94add790 con 0x557b94acf790 2024-09-10T05:36:34.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.419+0000 7fde647de640 1 -- 172.21.15.62:0/1559984099 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93989263755328] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde540083f0 con 0x7fde5c120040 2024-09-10T05:36:34.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.419+0000 7fde63fdd640 1 -- 172.21.15.62:0/1559984099 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93989263753120] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde5c100070 con 0x557b94acf790 2024-09-10T05:36:34.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.423+0000 7fde63fdd640 1 -- 172.21.15.62:0/1559984099 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde5c100070 con 0x557b94acf790 2024-09-10T05:36:34.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.423+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93989263750624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557b94add750 con 0x557b94acf790 2024-09-10T05:36:34.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.423+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557b94addb80 con 0x557b94ad2fc0 2024-09-10T05:36:34.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.423+0000 7fde637dc640 1 -- 172.21.15.62:0/1559984099 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde5802d040 con 0x557b94ad2fc0 2024-09-10T05:36:34.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.423+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93989263756384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557b94ade420 con 0x557b94ad2fc0 2024-09-10T05:36:34.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.423+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557b94adede0 con 0x557b94ad2fc0 2024-09-10T05:36:34.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.423+0000 7fde63fdd640 1 -- 172.21.15.62:0/1559984099 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 93989263750624] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde5c100070 con 0x557b94acf790 2024-09-10T05:36:34.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.423+0000 7fde637dc640 1 -- 172.21.15.62:0/1559984099 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93989263756384] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde5802d040 con 0x557b94ad2fc0 2024-09-10T05:36:34.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.423+0000 7fde637dc640 1 -- 172.21.15.62:0/1559984099 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde5802d040 con 0x557b94ad2fc0 2024-09-10T05:36:34.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.423+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93989263763760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557b94ade420 con 0x557b94ad2fc0 2024-09-10T05:36:34.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.423+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557b94aded90 con 0x7fde5c120040 2024-09-10T05:36:34.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.427+0000 7fde637dc640 1 -- 172.21.15.62:0/1559984099 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93989263763760] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde5802d040 con 0x557b94ad2fc0 2024-09-10T05:36:34.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.427+0000 7fde647de640 1 -- 172.21.15.62:0/1559984099 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde540083f0 con 0x7fde5c120040 2024-09-10T05:36:34.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.427+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93989263761264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557b94ade390 con 0x7fde5c120040 2024-09-10T05:36:34.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.427+0000 7fde664d79c0 20 add_watcher() i=0 2024-09-10T05:36:34.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.427+0000 7fde664d79c0 20 add_watcher() i=1 2024-09-10T05:36:34.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.427+0000 7fde664d79c0 20 add_watcher() i=2 2024-09-10T05:36:34.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.427+0000 7fde664d79c0 20 add_watcher() i=3 2024-09-10T05:36:34.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.427+0000 7fde664d79c0 20 add_watcher() i=4 2024-09-10T05:36:34.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.427+0000 7fde664d79c0 20 add_watcher() i=5 2024-09-10T05:36:34.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.427+0000 7fde664d79c0 20 add_watcher() i=6 2024-09-10T05:36:34.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.427+0000 7fde647de640 1 -- 172.21.15.62:0/1559984099 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93989263761264] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde540083f0 con 0x7fde5c120040 2024-09-10T05:36:34.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.427+0000 7fde664d79c0 20 add_watcher() i=7 2024-09-10T05:36:34.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.427+0000 7fde664d79c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:34.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.427+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557b94ae2770 con 0x557b94acb310 2024-09-10T05:36:34.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.427+0000 7fde647de640 1 -- 172.21.15.62:0/1559984099 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fde540083f0 con 0x557b94acb310 2024-09-10T05:36:34.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.427+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93989263765968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557b94adfbf0 con 0x557b94acb310 2024-09-10T05:36:34.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.427+0000 7fde647de640 1 -- 172.21.15.62:0/1559984099 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93989263765968] v30'94 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fde540083f0 con 0x557b94acb310 2024-09-10T05:36:34.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.427+0000 7fdd19fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:34.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.427+0000 7fde664d79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:34.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.427+0000 7fde664d79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:34.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.427+0000 7fde664d79c0 5 note: GC not initialized 2024-09-10T05:36:34.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.427+0000 7fdd18fe1640 20 reqs_thread_entry: start 2024-09-10T05:36:34.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.427+0000 7fde664d79c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:34.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.427+0000 7fde664d79c0 20 Filter name: none 2024-09-10T05:36:34.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.427+0000 7fdc927fc640 20 reqs_thread_entry: start 2024-09-10T05:36:34.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.427+0000 7fde664d79c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.427+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557b94b055d0 con 0x557b94acb310 2024-09-10T05:36:34.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.431+0000 7fde647de640 1 -- 172.21.15.62:0/1559984099 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fde540083f0 con 0x557b94acb310 2024-09-10T05:36:34.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.431+0000 7fde664d79c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:36:34.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.431+0000 7fde664d79c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.431+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557b94b05ff0 con 0x557b94acb310 2024-09-10T05:36:34.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.431+0000 7fde647de640 1 -- 172.21.15.62:0/1559984099 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fde540083f0 con 0x557b94acb310 2024-09-10T05:36:34.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.431+0000 7fde664d79c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:36:34.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.431+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557b94b07000 con 0x7fde5c120040 2024-09-10T05:36:34.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.431+0000 7fde647de640 1 -- 172.21.15.62:0/1559984099 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fde540083f0 con 0x7fde5c120040 2024-09-10T05:36:34.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.431+0000 7fdd19fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:34.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.431+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93989263765968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557b94ac5910 con 0x557b94acb310 2024-09-10T05:36:34.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.431+0000 7fde647de640 1 -- 172.21.15.62:0/1559984099 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 93989263765968] v30'95 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fde540083f0 con 0x557b94acb310 2024-09-10T05:36:34.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.431+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93989263739168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557b94adf1d0 con 0x557b94acf790 2024-09-10T05:36:34.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.435+0000 7fde63fdd640 1 -- 172.21.15.62:0/1559984099 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 93989263739168] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde5c100070 con 0x557b94acf790 2024-09-10T05:36:34.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.435+0000 7fde664d79c0 20 remove_watcher() i=0 2024-09-10T05:36:34.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.435+0000 7fde664d79c0 2 removed watcher, disabling cache 2024-09-10T05:36:34.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.435+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93989263749568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557b94adf1d0 con 0x557b94acb310 2024-09-10T05:36:34.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.435+0000 7fde647de640 1 -- 172.21.15.62:0/1559984099 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 93989263749568] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde540083f0 con 0x557b94acb310 2024-09-10T05:36:34.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.435+0000 7fde664d79c0 20 remove_watcher() i=1 2024-09-10T05:36:34.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.435+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93989263753120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557b94adf1d0 con 0x557b94acf790 2024-09-10T05:36:34.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.439+0000 7fde63fdd640 1 -- 172.21.15.62:0/1559984099 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 93989263753120] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde5c100070 con 0x557b94acf790 2024-09-10T05:36:34.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.439+0000 7fde664d79c0 20 remove_watcher() i=2 2024-09-10T05:36:34.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.439+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93989263755328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557b94adbfa0 con 0x7fde5c120040 2024-09-10T05:36:34.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.439+0000 7fde647de640 1 -- 172.21.15.62:0/1559984099 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 93989263755328] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde540083f0 con 0x7fde5c120040 2024-09-10T05:36:34.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.439+0000 7fde664d79c0 20 remove_watcher() i=3 2024-09-10T05:36:34.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.439+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93989263750624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557b94adf1d0 con 0x557b94acf790 2024-09-10T05:36:34.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.439+0000 7fde63fdd640 1 -- 172.21.15.62:0/1559984099 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 93989263750624] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde5c100070 con 0x557b94acf790 2024-09-10T05:36:34.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.443+0000 7fde664d79c0 20 remove_watcher() i=4 2024-09-10T05:36:34.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.443+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93989263756384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557b94adc840 con 0x557b94ad2fc0 2024-09-10T05:36:34.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.443+0000 7fde637dc640 1 -- 172.21.15.62:0/1559984099 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 93989263756384] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde5802d040 con 0x557b94ad2fc0 2024-09-10T05:36:34.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.443+0000 7fde664d79c0 20 remove_watcher() i=5 2024-09-10T05:36:34.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.443+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93989263763760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557b94adbfa0 con 0x557b94ad2fc0 2024-09-10T05:36:34.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.443+0000 7fde637dc640 1 -- 172.21.15.62:0/1559984099 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 93989263763760] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde5802d040 con 0x557b94ad2fc0 2024-09-10T05:36:34.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.443+0000 7fde664d79c0 20 remove_watcher() i=6 2024-09-10T05:36:34.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.443+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93989263761264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557b94adbfa0 con 0x7fde5c120040 2024-09-10T05:36:34.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.443+0000 7fde647de640 1 -- 172.21.15.62:0/1559984099 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 93989263761264] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde540083f0 con 0x7fde5c120040 2024-09-10T05:36:34.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.443+0000 7fde664d79c0 20 remove_watcher() i=7 2024-09-10T05:36:34.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.443+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x557b94acf790 msgr2=0x557b94ad1b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.443+0000 7fde664d79c0 1 --2- 172.21.15.62:0/1559984099 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x557b94acf790 0x557b94ad1b80 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.443+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x557b94acb310 msgr2=0x557b94acd7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.443+0000 7fde664d79c0 1 --2- 172.21.15.62:0/1559984099 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x557b94acb310 0x557b94acd7a0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.443+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fde5c120040 msgr2=0x7fde5c1067e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.443+0000 7fde664d79c0 1 --2- 172.21.15.62:0/1559984099 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fde5c120040 0x7fde5c1067e0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.443+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x557b94ad2fc0 msgr2=0x557b94ad53b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.443+0000 7fde664d79c0 1 --2- 172.21.15.62:0/1559984099 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x557b94ad2fc0 0x557b94ad53b0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.443+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fdd2c039a70 msgr2=0x7fdd2c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.443+0000 7fde664d79c0 1 --2- 172.21.15.62:0/1559984099 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fdd2c039a70 0x7fdd2c03bf30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x557b94a96820 tx=0x7fde58010000 comp rx=0 tx=0).stop 2024-09-10T05:36:34.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.443+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b94aba2a0 msgr2=0x557b94ac0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.443+0000 7fde664d79c0 1 --2- 172.21.15.62:0/1559984099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b94aba2a0 0x557b94ac0520 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fde5c0c6e30 tx=0x7fde5c0cae60 comp rx=0 tx=0).stop 2024-09-10T05:36:34.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.443+0000 7fde647de640 1 -- 172.21.15.62:0/1559984099 reap_dead start 2024-09-10T05:36:34.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.443+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 shutdown_connections 2024-09-10T05:36:34.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.443+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 >> 172.21.15.62:0/1559984099 conn(0x557b94ab5660 msgr2=0x557b94ab3870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:34.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.443+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 shutdown_connections 2024-09-10T05:36:34.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.443+0000 7fde664d79c0 1 -- 172.21.15.62:0/1559984099 wait complete. 2024-09-10T05:36:34.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.443+0000 7fde664d79c0 1 -- 172.21.15.62:0/3036383567 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fdd3c039ac0 msgr2=0x7fdd3c03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.443+0000 7fde664d79c0 1 --2- 172.21.15.62:0/3036383567 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fdd3c039ac0 0x7fdd3c03bf80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fde580063c0 tx=0x7fde5800f000 comp rx=0 tx=0).stop 2024-09-10T05:36:34.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.443+0000 7fde664d79c0 1 -- 172.21.15.62:0/3036383567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b94aacaa0 msgr2=0x557b94aacec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.443+0000 7fde664d79c0 1 --2- 172.21.15.62:0/3036383567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b94aacaa0 0x557b94aacec0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fde5c0bcb60 tx=0x7fde5c0cfa20 comp rx=0 tx=0).stop 2024-09-10T05:36:34.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.447+0000 7fde664d79c0 1 -- 172.21.15.62:0/3036383567 shutdown_connections 2024-09-10T05:36:34.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.447+0000 7fde664d79c0 1 --2- 172.21.15.62:0/3036383567 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fdd3c039ac0 0x7fdd3c03bf80 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.447+0000 7fde664d79c0 1 --2- 172.21.15.62:0/3036383567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b94aacaa0 0x557b94aacec0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.447+0000 7fde664d79c0 1 -- 172.21.15.62:0/3036383567 >> 172.21.15.62:0/3036383567 conn(0x557b94aa2450 msgr2=0x557b94aa2830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:34.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.447+0000 7fde664d79c0 1 -- 172.21.15.62:0/3036383567 shutdown_connections 2024-09-10T05:36:34.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.447+0000 7fde664d79c0 1 -- 172.21.15.62:0/3036383567 wait complete. 2024-09-10T05:36:34.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.447+0000 7fde664d79c0 1 -- 172.21.15.62:0/3195556844 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x557b94a96f80 msgr2=0x557b94a99440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.447+0000 7fde664d79c0 1 --2- 172.21.15.62:0/3195556844 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x557b94a96f80 0x557b94a99440 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.447+0000 7fde664d79c0 1 -- 172.21.15.62:0/3195556844 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x557b9490e5e0 msgr2=0x557b94a95f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.447+0000 7fde664d79c0 1 --2- 172.21.15.62:0/3195556844 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x557b9490e5e0 0x557b94a95f40 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.447+0000 7fde664d79c0 1 -- 172.21.15.62:0/3195556844 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x557b94a9b970 msgr2=0x557b94a9dd60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.447+0000 7fde664d79c0 1 --2- 172.21.15.62:0/3195556844 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x557b94a9b970 0x557b94a9dd60 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.447+0000 7fde664d79c0 1 -- 172.21.15.62:0/3195556844 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fdd4c039a70 msgr2=0x7fdd4c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.447+0000 7fde664d79c0 1 --2- 172.21.15.62:0/3195556844 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fdd4c039a70 0x7fdd4c03bf30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fde58001640 tx=0x7fde580066a0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.447+0000 7fde664d79c0 1 -- 172.21.15.62:0/3195556844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b9490e200 msgr2=0x557b94a8edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.447+0000 7fde664d79c0 1 --2- 172.21.15.62:0/3195556844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b9490e200 0x557b94a8edd0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fde5c000c10 tx=0x7fde5c0180e0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.447+0000 7fde647de640 1 -- 172.21.15.62:0/3195556844 reap_dead start 2024-09-10T05:36:34.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.447+0000 7fde664d79c0 1 -- 172.21.15.62:0/3195556844 shutdown_connections 2024-09-10T05:36:34.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.447+0000 7fde664d79c0 1 -- 172.21.15.62:0/3195556844 >> 172.21.15.62:0/3195556844 conn(0x557b94994920 msgr2=0x557b94a81f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:34.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.447+0000 7fde664d79c0 1 -- 172.21.15.62:0/3195556844 shutdown_connections 2024-09-10T05:36:34.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.447+0000 7fde664d79c0 1 -- 172.21.15.62:0/3195556844 wait complete. 2024-09-10T05:36:34.458 INFO:teuthology.orchestra.run.smithi062.stdout:[] 2024-09-10T05:36:34.458 DEBUG:tasks.util.rgw: json result: [] 2024-09-10T05:36:34.458 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-10T05:36:34.459 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-10T05:36:34.459 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-10T05:36:34.540 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:34.540 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:34.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.539+0000 7faf4d4fe9c0 1 Processor -- start 2024-09-10T05:36:34.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.539+0000 7faf4d4fe9c0 1 -- start start 2024-09-10T05:36:34.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.539+0000 7faf4d4fe9c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55e79ce20200 0x55e79ce205e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.539+0000 7faf4d4fe9c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e79ccd29c0 con 0x55e79ce23340 2024-09-10T05:36:34.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.539+0000 7faf4d4fe9c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x55e79cd226d0 con 0x55e79ce20200 2024-09-10T05:36:34.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.539+0000 7faf4b004640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55e79ce20200 0x55e79ce205e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.539+0000 7faf4b004640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55e79ce20200 0x55e79ce205e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:52318/0 (socket says 172.21.15.62:52318) 2024-09-10T05:36:34.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.539+0000 7faf4b004640 1 -- 172.21.15.62:0/3787490608 learned_addr learned my addr 172.21.15.62:0/3787490608 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:34.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.539+0000 7faf4b004640 1 -- 172.21.15.62:0/3787490608 >> v1:172.21.15.2:6789/0 conn(0x55e79ce23340 legacy=0x55e79ce25730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.539+0000 7faf4b004640 1 -- 172.21.15.62:0/3787490608 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e79ccc6ca0 con 0x55e79ce20200 2024-09-10T05:36:34.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.539+0000 7faf4b004640 1 --2- 172.21.15.62:0/3787490608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e79ce20200 0x55e79ce205e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7faf4400a4e0 tx=0x7faf4401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2b0d668a4d83830 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.539+0000 7faf4a002640 1 -- 172.21.15.62:0/3787490608 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf440aa540 con 0x55e79ce20200 2024-09-10T05:36:34.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.539+0000 7faf4a002640 1 -- 172.21.15.62:0/3787490608 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf440aa6e0 con 0x55e79ce20200 2024-09-10T05:36:34.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.539+0000 7faf4a002640 1 -- 172.21.15.62:0/3787490608 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf440aaa40 con 0x55e79ce20200 2024-09-10T05:36:34.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.543+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/3787490608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e79ce20200 msgr2=0x55e79ce205e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.543+0000 7faf4d4fe9c0 1 --2- 172.21.15.62:0/3787490608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e79ce20200 0x55e79ce205e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7faf4400a4e0 tx=0x7faf4401b090 comp rx=0 tx=0).stop 2024-09-10T05:36:34.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.543+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/3787490608 shutdown_connections 2024-09-10T05:36:34.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.543+0000 7faf4d4fe9c0 1 --2- 172.21.15.62:0/3787490608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e79ce20200 0x55e79ce205e0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.543+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/3787490608 >> 172.21.15.62:0/3787490608 conn(0x55e79cd93b10 msgr2=0x55e79cd93f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:34.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.543+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/3787490608 shutdown_connections 2024-09-10T05:36:34.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.543+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/3787490608 wait complete. 2024-09-10T05:36:34.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.555+0000 7faf4d4fe9c0 1 Processor -- start 2024-09-10T05:36:34.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.555+0000 7faf4d4fe9c0 1 -- start start 2024-09-10T05:36:34.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.555+0000 7faf4d4fe9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e79ce20200 0x55e79cf0b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.555+0000 7faf4d4fe9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e79cd26680 con 0x55e79ce20200 2024-09-10T05:36:34.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.555+0000 7faf4b004640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e79ce20200 0x55e79cf0b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.555+0000 7faf4b004640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e79ce20200 0x55e79cf0b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:52324/0 (socket says 172.21.15.62:52324) 2024-09-10T05:36:34.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.555+0000 7faf4b004640 1 -- 172.21.15.62:0/2461190224 learned_addr learned my addr 172.21.15.62:0/2461190224 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:34.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.555+0000 7faf4b004640 1 -- 172.21.15.62:0/2461190224 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e79cca1da0 con 0x55e79ce20200 2024-09-10T05:36:34.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.555+0000 7faf4b004640 1 --2- 172.21.15.62:0/2461190224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e79ce20200 0x55e79cf0b810 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7faf44019740 tx=0x7faf440033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc6b2a5ccdaaa458 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.555+0000 7fae38e09640 1 -- 172.21.15.62:0/2461190224 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf440b9070 con 0x55e79ce20200 2024-09-10T05:36:34.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.555+0000 7fae38e09640 1 -- 172.21.15.62:0/2461190224 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf440aaa90 con 0x55e79ce20200 2024-09-10T05:36:34.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.555+0000 7fae38e09640 1 -- 172.21.15.62:0/2461190224 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf440aad70 con 0x55e79ce20200 2024-09-10T05:36:34.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.555+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2461190224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e79ce20200 msgr2=0x55e79cf0b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.555+0000 7faf4d4fe9c0 1 --2- 172.21.15.62:0/2461190224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e79ce20200 0x55e79cf0b810 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7faf44019740 tx=0x7faf440033b0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.555+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2461190224 shutdown_connections 2024-09-10T05:36:34.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.555+0000 7faf4d4fe9c0 1 --2- 172.21.15.62:0/2461190224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e79ce20200 0x55e79cf0b810 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.555+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2461190224 >> 172.21.15.62:0/2461190224 conn(0x55e79cd93b10 msgr2=0x55e79cf074b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:34.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.555+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2461190224 shutdown_connections 2024-09-10T05:36:34.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.555+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2461190224 wait complete. 2024-09-10T05:36:34.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.555+0000 7faf4d4fe9c0 1 Processor -- start 2024-09-10T05:36:34.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.555+0000 7faf4d4fe9c0 1 -- start start 2024-09-10T05:36:34.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.559+0000 7faf4d4fe9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e79ce20200 0x55e79cf12d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.559+0000 7faf4d4fe9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e79ccc8a50 con 0x55e79ce20200 2024-09-10T05:36:34.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.559+0000 7faf4b004640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e79ce20200 0x55e79cf12d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.559+0000 7faf4b004640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e79ce20200 0x55e79cf12d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:52338/0 (socket says 172.21.15.62:52338) 2024-09-10T05:36:34.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.559+0000 7faf4b004640 1 -- 172.21.15.62:0/1883616874 learned_addr learned my addr 172.21.15.62:0/1883616874 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:34.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.559+0000 7faf4b004640 1 -- 172.21.15.62:0/1883616874 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e79cf13260 con 0x55e79ce20200 2024-09-10T05:36:34.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.559+0000 7faf4b004640 1 --2- 172.21.15.62:0/1883616874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e79ce20200 0x55e79cf12d00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7faf44018cc0 tx=0x7faf44017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.559+0000 7fae37606640 1 -- 172.21.15.62:0/1883616874 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf440b9070 con 0x55e79ce20200 2024-09-10T05:36:34.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.559+0000 7fae37606640 1 -- 172.21.15.62:0/1883616874 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf440b5b10 con 0x55e79ce20200 2024-09-10T05:36:34.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.559+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/1883616874 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e79cf134f0 con 0x55e79ce20200 2024-09-10T05:36:34.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.559+0000 7fae37606640 1 -- 172.21.15.62:0/1883616874 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf440b5df0 con 0x55e79ce20200 2024-09-10T05:36:34.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.559+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/1883616874 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e79cf13ea0 con 0x55e79ce20200 2024-09-10T05:36:34.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.559+0000 7fae37606640 1 -- 172.21.15.62:0/1883616874 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7faf440b3040 con 0x55e79ce20200 2024-09-10T05:36:34.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.559+0000 7fae37606640 1 --2- 172.21.15.62:0/1883616874 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fae30039a70 0x7fae3003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.559+0000 7fae37606640 1 -- 172.21.15.62:0/1883616874 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7faf440c4070 con 0x55e79ce20200 2024-09-10T05:36:34.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.559+0000 7faf4a803640 1 --2- 172.21.15.62:0/1883616874 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fae30039a70 0x7fae3003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.559+0000 7faf4d4fe9c0 1 --2- 172.21.15.62:0/1883616874 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55e79ce23340 0x55e79cf19e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.559+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/1883616874 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf1a3b0 con 0x55e79ce23340 2024-09-10T05:36:34.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.559+0000 7faf4b805640 1 --2- 172.21.15.62:0/1883616874 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55e79ce23340 0x55e79cf19e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.559+0000 7faf4a803640 1 --2- 172.21.15.62:0/1883616874 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fae30039a70 0x7fae3003bf30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7faf40001ec0 tx=0x7faf40001440 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.559+0000 7faf4b805640 1 --2- 172.21.15.62:0/1883616874 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55e79ce23340 0x55e79cf19e70 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.563+0000 7faf4b805640 1 -- 172.21.15.62:0/1883616874 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faf3c0083f0 con 0x55e79ce23340 2024-09-10T05:36:34.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.563+0000 7faf4d4fe9c0 1 --2- 172.21.15.62:0/1883616874 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e79cf1aed0 0x55e79cf1d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.563+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/1883616874 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf1db00 con 0x55e79cf1aed0 2024-09-10T05:36:34.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.563+0000 7faf4b004640 1 --2- 172.21.15.62:0/1883616874 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e79cf1aed0 0x55e79cf1d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.563+0000 7faf4b004640 1 --2- 172.21.15.62:0/1883616874 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e79cf1aed0 0x55e79cf1d390 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.563+0000 7faf4b004640 1 -- 172.21.15.62:0/1883616874 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faf440e81a0 con 0x55e79cf1aed0 2024-09-10T05:36:34.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.563+0000 7faf4d4fe9c0 1 --2- 172.21.15.62:0/1883616874 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55e79cf1f8c0 0x55e79cf21cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.563+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/1883616874 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf223a0 con 0x55e79cf1f8c0 2024-09-10T05:36:34.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.563+0000 7faf4a803640 1 --2- 172.21.15.62:0/1883616874 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55e79cf1f8c0 0x55e79cf21cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.563+0000 7faf4a803640 1 --2- 172.21.15.62:0/1883616874 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55e79cf1f8c0 0x55e79cf21cb0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.563+0000 7faf4a803640 1 -- 172.21.15.62:0/1883616874 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7faf4000d040 con 0x55e79cf1f8c0 2024-09-10T05:36:34.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.563+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/1883616874 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf1e760 con 0x55e79cf1aed0 2024-09-10T05:36:34.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.563+0000 7faf4b004640 1 -- 172.21.15.62:0/1883616874 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faf440a9ce0 con 0x55e79cf1aed0 2024-09-10T05:36:34.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.563+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/1883616874 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf1eb80 con 0x55e79cf1f8c0 2024-09-10T05:36:34.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.563+0000 7faf4a803640 1 -- 172.21.15.62:0/1883616874 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7faf4000d040 con 0x55e79cf1f8c0 2024-09-10T05:36:34.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.563+0000 7faf4d4fe9c0 1 Processor -- start 2024-09-10T05:36:34.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.563+0000 7faf4d4fe9c0 1 -- start start 2024-09-10T05:36:34.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.567+0000 7faf4d4fe9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e79cf30a70 0x55e79cf30e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.567+0000 7faf4d4fe9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e79cd33450 con 0x55e79cf30a70 2024-09-10T05:36:34.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.567+0000 7faf4b004640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e79cf30a70 0x55e79cf30e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.567+0000 7faf4b004640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e79cf30a70 0x55e79cf30e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:52344/0 (socket says 172.21.15.62:52344) 2024-09-10T05:36:34.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.567+0000 7faf4b004640 1 -- 172.21.15.62:0/938749669 learned_addr learned my addr 172.21.15.62:0/938749669 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:34.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.567+0000 7faf4b004640 1 -- 172.21.15.62:0/938749669 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e79cf314d0 con 0x55e79cf30a70 2024-09-10T05:36:34.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.567+0000 7faf4b004640 1 --2- 172.21.15.62:0/938749669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e79cf30a70 0x55e79cf30e90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7faf44000f90 tx=0x7faf440b4da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.567+0000 7fae34e01640 1 -- 172.21.15.62:0/938749669 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf440e2200 con 0x55e79cf30a70 2024-09-10T05:36:34.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.567+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/938749669 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e79cf31d30 con 0x55e79cf30a70 2024-09-10T05:36:34.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.567+0000 7fae34e01640 1 -- 172.21.15.62:0/938749669 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf440c8860 con 0x55e79cf30a70 2024-09-10T05:36:34.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.567+0000 7fae34e01640 1 -- 172.21.15.62:0/938749669 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf440b43a0 con 0x55e79cf30a70 2024-09-10T05:36:34.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.567+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/938749669 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e79cf322a0 con 0x55e79cf30a70 2024-09-10T05:36:34.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.567+0000 7fae34e01640 1 -- 172.21.15.62:0/938749669 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7faf440b4540 con 0x55e79cf30a70 2024-09-10T05:36:34.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.567+0000 7fae34e01640 1 --2- 172.21.15.62:0/938749669 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fae24039a70 0x7fae2403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.567+0000 7fae34e01640 1 -- 172.21.15.62:0/938749669 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7faf440070a0 con 0x55e79cf30a70 2024-09-10T05:36:34.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.567+0000 7faf4a803640 1 --2- 172.21.15.62:0/938749669 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fae24039a70 0x7fae2403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.567+0000 7faf4d4fe9c0 1 Processor -- start 2024-09-10T05:36:34.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.567+0000 7faf4d4fe9c0 1 -- start start 2024-09-10T05:36:34.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.567+0000 7faf4a803640 1 --2- 172.21.15.62:0/938749669 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fae24039a70 0x7fae2403bf30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x55e79cf1eb00 tx=0x7faf40006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.567+0000 7faf4d4fe9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e79cd98a70 0x55e79cf43ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.567+0000 7faf4d4fe9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e79cf0bfa0 con 0x55e79cd98a70 2024-09-10T05:36:34.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.567+0000 7faf4b004640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e79cd98a70 0x55e79cf43ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.567+0000 7faf4b004640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e79cd98a70 0x55e79cf43ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:52350/0 (socket says 172.21.15.62:52350) 2024-09-10T05:36:34.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.567+0000 7faf4b004640 1 -- 172.21.15.62:0/3803506994 learned_addr learned my addr 172.21.15.62:0/3803506994 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:34.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.571+0000 7faf4b004640 1 -- 172.21.15.62:0/3803506994 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e79cd98f00 con 0x55e79cd98a70 2024-09-10T05:36:34.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.571+0000 7faf4b004640 1 --2- 172.21.15.62:0/3803506994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e79cd98a70 0x55e79cf43ed0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7faf440e9590 tx=0x7faf440da970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=238ab3e0c0248826 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.571+0000 7fae2e7fc640 1 -- 172.21.15.62:0/3803506994 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf440dac90 con 0x55e79cd98a70 2024-09-10T05:36:34.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.571+0000 7fae2e7fc640 1 -- 172.21.15.62:0/3803506994 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf440dae50 con 0x55e79cd98a70 2024-09-10T05:36:34.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.571+0000 7fae2e7fc640 1 -- 172.21.15.62:0/3803506994 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf440da3c0 con 0x55e79cd98a70 2024-09-10T05:36:34.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.571+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/3803506994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e79cd98a70 msgr2=0x55e79cf43ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.571+0000 7faf4d4fe9c0 1 --2- 172.21.15.62:0/3803506994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e79cd98a70 0x55e79cf43ed0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7faf440e9590 tx=0x7faf440da970 comp rx=0 tx=0).stop 2024-09-10T05:36:34.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.571+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/3803506994 shutdown_connections 2024-09-10T05:36:34.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.571+0000 7faf4d4fe9c0 1 --2- 172.21.15.62:0/3803506994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e79cd98a70 0x55e79cf43ed0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.571+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/3803506994 >> 172.21.15.62:0/3803506994 conn(0x55e79cd96c20 msgr2=0x55e79cd94e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:34.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.571+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/3803506994 shutdown_connections 2024-09-10T05:36:34.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.571+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/3803506994 wait complete. 2024-09-10T05:36:34.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.571+0000 7faf4d4fe9c0 1 Processor -- start 2024-09-10T05:36:34.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.571+0000 7faf4d4fe9c0 1 -- start start 2024-09-10T05:36:34.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.571+0000 7faf4d4fe9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e79cd98a70 0x55e79cf488b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.571+0000 7faf4d4fe9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e79cf44650 con 0x55e79cd98a70 2024-09-10T05:36:34.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.571+0000 7faf4b004640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e79cd98a70 0x55e79cf488b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.571+0000 7faf4b004640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e79cd98a70 0x55e79cf488b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:52352/0 (socket says 172.21.15.62:52352) 2024-09-10T05:36:34.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.571+0000 7faf4b004640 1 -- 172.21.15.62:0/2304126223 learned_addr learned my addr 172.21.15.62:0/2304126223 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:34.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.571+0000 7faf4b004640 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e79cf48e10 con 0x55e79cd98a70 2024-09-10T05:36:34.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.571+0000 7faf4b004640 1 --2- 172.21.15.62:0/2304126223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e79cd98a70 0x55e79cf488b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7faf440e2bd0 tx=0x7faf440caf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.571+0000 7fae2cff9640 1 -- 172.21.15.62:0/2304126223 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf44110070 con 0x55e79cd98a70 2024-09-10T05:36:34.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.571+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e79cf48e10 con 0x55e79cd98a70 2024-09-10T05:36:34.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.571+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e79cf48e10 con 0x55e79cd98a70 2024-09-10T05:36:34.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.571+0000 7fae2cff9640 1 -- 172.21.15.62:0/2304126223 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf440dae50 con 0x55e79cd98a70 2024-09-10T05:36:34.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.571+0000 7fae2cff9640 1 -- 172.21.15.62:0/2304126223 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf4411a060 con 0x55e79cd98a70 2024-09-10T05:36:34.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.575+0000 7faf4d4fe9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.575+0000 7fae2cff9640 1 -- 172.21.15.62:0/2304126223 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7faf44113070 con 0x55e79cd98a70 2024-09-10T05:36:34.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.575+0000 7fae2cff9640 1 --2- 172.21.15.62:0/2304126223 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fae140399d0 0x7fae1403be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.575+0000 7fae2cff9640 1 -- 172.21.15.62:0/2304126223 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7faf440d5190 con 0x55e79cd98a70 2024-09-10T05:36:34.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.575+0000 7faf4a803640 1 --2- 172.21.15.62:0/2304126223 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fae140399d0 0x7fae1403be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.575+0000 7faf4d4fe9c0 1 --2- 172.21.15.62:0/2304126223 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55e79cf53810 0x55e79cf55ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.575+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf563f0 con 0x55e79cf53810 2024-09-10T05:36:34.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.575+0000 7faf4b805640 1 --2- 172.21.15.62:0/2304126223 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55e79cf53810 0x55e79cf55ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.575+0000 7faf4a803640 1 --2- 172.21.15.62:0/2304126223 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fae140399d0 0x7fae1403be90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x55e79cf1e730 tx=0x7faf40011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.575+0000 7faf4b805640 1 --2- 172.21.15.62:0/2304126223 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55e79cf53810 0x55e79cf55ca0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.575+0000 7faf4b805640 1 -- 172.21.15.62:0/2304126223 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faf3c0083f0 con 0x55e79cf53810 2024-09-10T05:36:34.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.575+0000 7faf4d4fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:34.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.575+0000 7faf4d4fe9c0 20 realm 2024-09-10T05:36:34.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.575+0000 7faf4d4fe9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.575+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf52c50 con 0x55e79cf53810 2024-09-10T05:36:34.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.575+0000 7faf4b805640 1 -- 172.21.15.62:0/2304126223 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faf3c0083f0 con 0x55e79cf53810 2024-09-10T05:36:34.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.575+0000 7faf4d4fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:34.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.575+0000 7faf4d4fe9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:34.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.575+0000 7faf4d4fe9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.575+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf56f00 con 0x55e79cf53810 2024-09-10T05:36:34.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.575+0000 7faf4b805640 1 -- 172.21.15.62:0/2304126223 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faf3c0083f0 con 0x55e79cf53810 2024-09-10T05:36:34.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.575+0000 7faf4d4fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:34.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.575+0000 7faf4d4fe9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.575+0000 7faf4d4fe9c0 1 --2- 172.21.15.62:0/2304126223 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e79cf57ce0 0x55e79cf5a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.575+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf5a780 con 0x55e79cf57ce0 2024-09-10T05:36:34.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.575+0000 7faf4b004640 1 --2- 172.21.15.62:0/2304126223 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e79cf57ce0 0x55e79cf5a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.575+0000 7faf4b004640 1 --2- 172.21.15.62:0/2304126223 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e79cf57ce0 0x55e79cf5a0d0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.579+0000 7faf4b004640 1 -- 172.21.15.62:0/2304126223 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faf44112030 con 0x55e79cf57ce0 2024-09-10T05:36:34.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.579+0000 7faf4d4fe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:34.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.579+0000 7faf4d4fe9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.579+0000 7faf4d4fe9c0 1 --2- 172.21.15.62:0/2304126223 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55e79cf5b530 0x55e79cf5d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.579+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf5dfc0 con 0x55e79cf5b530 2024-09-10T05:36:34.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.579+0000 7faf4a803640 1 --2- 172.21.15.62:0/2304126223 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55e79cf5b530 0x55e79cf5d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.579+0000 7faf4a803640 1 --2- 172.21.15.62:0/2304126223 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55e79cf5b530 0x55e79cf5d920 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.579+0000 7faf4a803640 1 -- 172.21.15.62:0/2304126223 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7faf4000d040 con 0x55e79cf5b530 2024-09-10T05:36:34.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.579+0000 7faf4d4fe9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:34.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.579+0000 7faf4d4fe9c0 20 searching for the correct realm 2024-09-10T05:36:34.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.579+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf5f8b0 con 0x55e79cf5b530 2024-09-10T05:36:34.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.579+0000 7faf4a803640 1 -- 172.21.15.62:0/2304126223 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf4000d040 con 0x55e79cf5b530 2024-09-10T05:36:34.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.579+0000 7faf4a803640 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf5f8b0 con 0x55e79cf57ce0 2024-09-10T05:36:34.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.579+0000 7faf4b004640 1 -- 172.21.15.62:0/2304126223 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf44112030 con 0x55e79cf57ce0 2024-09-10T05:36:34.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.579+0000 7faf4b004640 1 --2- 172.21.15.62:0/2304126223 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7faf44115070 0x7faf440db600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.579+0000 7faf4b004640 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf5f8b0 con 0x7faf44115070 2024-09-10T05:36:34.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.579+0000 7faf4b805640 1 --2- 172.21.15.62:0/2304126223 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7faf44115070 0x7faf440db600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.579+0000 7faf4b805640 1 --2- 172.21.15.62:0/2304126223 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7faf44115070 0x7faf440db600 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.579+0000 7faf4b805640 1 -- 172.21.15.62:0/2304126223 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf3c0083f0 con 0x7faf44115070 2024-09-10T05:36:34.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.579+0000 7faf4b805640 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf5f8b0 con 0x55e79cf53810 2024-09-10T05:36:34.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.579+0000 7faf4b805640 1 -- 172.21.15.62:0/2304126223 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf3c0083f0 con 0x55e79cf53810 2024-09-10T05:36:34.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.579+0000 7faf4b805640 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf5f8b0 con 0x55e79cf53810 2024-09-10T05:36:34.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.579+0000 7faf4b805640 1 -- 172.21.15.62:0/2304126223 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf3c0083f0 con 0x55e79cf53810 2024-09-10T05:36:34.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.579+0000 7faf4b805640 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf5f8b0 con 0x55e79cf5b530 2024-09-10T05:36:34.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.579+0000 7faf4a803640 1 -- 172.21.15.62:0/2304126223 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf4000d040 con 0x55e79cf5b530 2024-09-10T05:36:34.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.579+0000 7faf4a803640 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf5f8b0 con 0x55e79cf53810 2024-09-10T05:36:34.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.579+0000 7faf4b805640 1 -- 172.21.15.62:0/2304126223 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf3c0083f0 con 0x55e79cf53810 2024-09-10T05:36:34.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.579+0000 7faf4b805640 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf5f8b0 con 0x55e79cf57ce0 2024-09-10T05:36:34.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.583+0000 7faf4b004640 1 -- 172.21.15.62:0/2304126223 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf44112030 con 0x55e79cf57ce0 2024-09-10T05:36:34.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.583+0000 7faf4b004640 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf5f8b0 con 0x55e79cf57ce0 2024-09-10T05:36:34.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.583+0000 7faf4b004640 1 -- 172.21.15.62:0/2304126223 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf44112030 con 0x55e79cf57ce0 2024-09-10T05:36:34.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.583+0000 7faf4b004640 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf5f8b0 con 0x55e79cf53810 2024-09-10T05:36:34.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.583+0000 7faf4b805640 1 -- 172.21.15.62:0/2304126223 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf3c0083f0 con 0x55e79cf53810 2024-09-10T05:36:34.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.583+0000 7faf4b805640 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf5f8b0 con 0x7faf44115070 2024-09-10T05:36:34.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.583+0000 7faf4b805640 1 -- 172.21.15.62:0/2304126223 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf3c0083f0 con 0x7faf44115070 2024-09-10T05:36:34.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.583+0000 7faf4b805640 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf5f8b0 con 0x55e79cf53810 2024-09-10T05:36:34.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.583+0000 7faf4b805640 1 -- 172.21.15.62:0/2304126223 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf3c0083f0 con 0x55e79cf53810 2024-09-10T05:36:34.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.583+0000 7faf4b805640 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf5f8b0 con 0x7faf44115070 2024-09-10T05:36:34.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.583+0000 7faf4b805640 1 -- 172.21.15.62:0/2304126223 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7faf3c0083f0 con 0x7faf44115070 2024-09-10T05:36:34.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.583+0000 7faf4b805640 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf5f8b0 con 0x55e79cf57ce0 2024-09-10T05:36:34.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.583+0000 7faf4b004640 1 -- 172.21.15.62:0/2304126223 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf44112030 con 0x55e79cf57ce0 2024-09-10T05:36:34.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.583+0000 7faf4b004640 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf5f8b0 con 0x55e79cf5b530 2024-09-10T05:36:34.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.583+0000 7faf4a803640 1 -- 172.21.15.62:0/2304126223 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf4000d040 con 0x55e79cf5b530 2024-09-10T05:36:34.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.583+0000 7faf4a803640 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf5f8b0 con 0x55e79cf53810 2024-09-10T05:36:34.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.583+0000 7faf4b805640 1 -- 172.21.15.62:0/2304126223 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf3c0083f0 con 0x55e79cf53810 2024-09-10T05:36:34.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.583+0000 7faf4b805640 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf5f8b0 con 0x55e79cf57ce0 2024-09-10T05:36:34.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.583+0000 7faf4b004640 1 -- 172.21.15.62:0/2304126223 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf44112030 con 0x55e79cf57ce0 2024-09-10T05:36:34.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.583+0000 7faf4b004640 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf5f8b0 con 0x55e79cf5b530 2024-09-10T05:36:34.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.583+0000 7faf4a803640 1 -- 172.21.15.62:0/2304126223 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 30 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7faf4000d040 con 0x55e79cf5b530 2024-09-10T05:36:34.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.583+0000 7faf4a803640 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf5f8b0 con 0x55e79cf53810 2024-09-10T05:36:34.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.587+0000 7faf4b805640 1 -- 172.21.15.62:0/2304126223 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf3c0083f0 con 0x55e79cf53810 2024-09-10T05:36:34.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.587+0000 7faf4b805640 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf5f8b0 con 0x55e79cf53810 2024-09-10T05:36:34.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.587+0000 7faf4b805640 1 -- 172.21.15.62:0/2304126223 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7faf3c0083f0 con 0x55e79cf53810 2024-09-10T05:36:34.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.587+0000 7faf4b805640 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf5f8b0 con 0x55e79cf53810 2024-09-10T05:36:34.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.587+0000 7faf4b805640 1 -- 172.21.15.62:0/2304126223 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf3c0083f0 con 0x55e79cf53810 2024-09-10T05:36:34.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.587+0000 7faf4b805640 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf5f8b0 con 0x55e79cf5b530 2024-09-10T05:36:34.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.587+0000 7faf4a803640 1 -- 172.21.15.62:0/2304126223 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf4000d040 con 0x55e79cf5b530 2024-09-10T05:36:34.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.587+0000 7faf4a803640 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf5f8b0 con 0x7faf44115070 2024-09-10T05:36:34.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.587+0000 7faf4b805640 1 -- 172.21.15.62:0/2304126223 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf3c0083f0 con 0x7faf44115070 2024-09-10T05:36:34.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.587+0000 7faf4b805640 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf5f8b0 con 0x55e79cf53810 2024-09-10T05:36:34.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.587+0000 7faf4b805640 1 -- 172.21.15.62:0/2304126223 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf3c0083f0 con 0x55e79cf53810 2024-09-10T05:36:34.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.587+0000 7faf4b805640 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf5f8b0 con 0x7faf44115070 2024-09-10T05:36:34.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.587+0000 7faf4b805640 1 -- 172.21.15.62:0/2304126223 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf3c0083f0 con 0x7faf44115070 2024-09-10T05:36:34.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.587+0000 7faf4b805640 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf5f8b0 con 0x55e79cf5b530 2024-09-10T05:36:34.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.587+0000 7faf4a803640 1 -- 172.21.15.62:0/2304126223 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf4000d040 con 0x55e79cf5b530 2024-09-10T05:36:34.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.587+0000 7faf4a803640 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf5f8b0 con 0x7faf44115070 2024-09-10T05:36:34.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.587+0000 7faf4b805640 1 -- 172.21.15.62:0/2304126223 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf3c0083f0 con 0x7faf44115070 2024-09-10T05:36:34.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.587+0000 7faf4b805640 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf5f8b0 con 0x55e79cf57ce0 2024-09-10T05:36:34.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.587+0000 7faf4b004640 1 -- 172.21.15.62:0/2304126223 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf44112030 con 0x55e79cf57ce0 2024-09-10T05:36:34.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.587+0000 7faf4b004640 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf5f8b0 con 0x55e79cf57ce0 2024-09-10T05:36:34.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.587+0000 7faf4b004640 1 -- 172.21.15.62:0/2304126223 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf44112030 con 0x55e79cf57ce0 2024-09-10T05:36:34.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.587+0000 7faf4b004640 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf5f8b0 con 0x55e79cf5b530 2024-09-10T05:36:34.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.587+0000 7faf4a803640 1 -- 172.21.15.62:0/2304126223 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf4000d040 con 0x55e79cf5b530 2024-09-10T05:36:34.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.587+0000 7faf4a803640 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf5f8b0 con 0x55e79cf57ce0 2024-09-10T05:36:34.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.591+0000 7faf4b004640 1 -- 172.21.15.62:0/2304126223 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7faf44112030 con 0x55e79cf57ce0 2024-09-10T05:36:34.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.591+0000 7faf4b004640 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf5f8b0 con 0x55e79cf57ce0 2024-09-10T05:36:34.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.591+0000 7faf4b004640 1 -- 172.21.15.62:0/2304126223 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf44112030 con 0x55e79cf57ce0 2024-09-10T05:36:34.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.591+0000 7faf4d4fe9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:34.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.591+0000 7faf4d4fe9c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:34.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.591+0000 7faf4d4fe9c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:34.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.591+0000 7faf4d4fe9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:34.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.591+0000 7faf4d4fe9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:34.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.591+0000 7faf4d4fe9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:34.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.591+0000 7faf4d4fe9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.591+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf5e9b0 con 0x55e79cf53810 2024-09-10T05:36:34.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.591+0000 7faf4b805640 1 -- 172.21.15.62:0/2304126223 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faf3c0083f0 con 0x55e79cf53810 2024-09-10T05:36:34.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.591+0000 7faf4d4fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:34.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.591+0000 7faf4d4fe9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.591+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf5ee00 con 0x55e79cf57ce0 2024-09-10T05:36:34.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.591+0000 7faf4b004640 1 -- 172.21.15.62:0/2304126223 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faf44112030 con 0x55e79cf57ce0 2024-09-10T05:36:34.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.591+0000 7faf4d4fe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:34.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.591+0000 7faf4d4fe9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.591+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf5f260 con 0x55e79cf5b530 2024-09-10T05:36:34.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.591+0000 7faf4a803640 1 -- 172.21.15.62:0/2304126223 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7faf4000d040 con 0x55e79cf5b530 2024-09-10T05:36:34.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.591+0000 7faf4d4fe9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:34.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.591+0000 7faf4d4fe9c0 20 zone default found 2024-09-10T05:36:34.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.591+0000 7faf4d4fe9c0 4 Realm: () 2024-09-10T05:36:34.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.591+0000 7faf4d4fe9c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:34.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.591+0000 7faf4d4fe9c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:34.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.591+0000 7faf4d4fe9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:34.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.591+0000 7faf4d4fe9c0 20 zonegroup default 2024-09-10T05:36:34.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.591+0000 7faf4d4fe9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.591+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf5e530 con 0x7faf44115070 2024-09-10T05:36:34.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.591+0000 7faf4b805640 1 -- 172.21.15.62:0/2304126223 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7faf3c0083f0 con 0x7faf44115070 2024-09-10T05:36:34.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.591+0000 7faf4d4fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:34.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.591+0000 7faf4d4fe9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.591+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf61fb0 con 0x55e79cf5b530 2024-09-10T05:36:34.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.591+0000 7faf4a803640 1 -- 172.21.15.62:0/2304126223 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faf4000d040 con 0x55e79cf5b530 2024-09-10T05:36:34.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.591+0000 7faf4d4fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:34.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.591+0000 7faf4d4fe9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.591+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf62460 con 0x55e79cf5b530 2024-09-10T05:36:34.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.591+0000 7faf4a803640 1 -- 172.21.15.62:0/2304126223 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faf4000d040 con 0x55e79cf5b530 2024-09-10T05:36:34.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.591+0000 7faf4d4fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:34.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.591+0000 7faf4d4fe9c0 20 started sync module instance, tier type = 2024-09-10T05:36:34.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.591+0000 7faf4d4fe9c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:34.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.591+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf60db0 con 0x55e79cf57ce0 2024-09-10T05:36:34.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.595+0000 7faf4b004640 1 -- 172.21.15.62:0/2304126223 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf44112030 con 0x55e79cf57ce0 2024-09-10T05:36:34.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.595+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94453259178400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf60db0 con 0x55e79cf57ce0 2024-09-10T05:36:34.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.595+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf62d70 con 0x55e79cf53810 2024-09-10T05:36:34.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.595+0000 7faf4b805640 1 -- 172.21.15.62:0/2304126223 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf3c0083f0 con 0x55e79cf53810 2024-09-10T05:36:34.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.595+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94453259184320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf635c0 con 0x55e79cf53810 2024-09-10T05:36:34.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.595+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf63e50 con 0x55e79cf57ce0 2024-09-10T05:36:34.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.595+0000 7faf4b004640 1 -- 172.21.15.62:0/2304126223 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94453259178400] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf44112030 con 0x55e79cf57ce0 2024-09-10T05:36:34.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.595+0000 7faf4b805640 1 -- 172.21.15.62:0/2304126223 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94453259184320] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf3c0083f0 con 0x55e79cf53810 2024-09-10T05:36:34.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.599+0000 7faf4b004640 1 -- 172.21.15.62:0/2304126223 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf44112030 con 0x55e79cf57ce0 2024-09-10T05:36:34.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.599+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94453259176192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf635c0 con 0x55e79cf57ce0 2024-09-10T05:36:34.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.599+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf646f0 con 0x7faf44115070 2024-09-10T05:36:34.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.599+0000 7faf4b805640 1 -- 172.21.15.62:0/2304126223 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf3c0083f0 con 0x7faf44115070 2024-09-10T05:36:34.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.599+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94453259190848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf635c0 con 0x7faf44115070 2024-09-10T05:36:34.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.599+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf65170 con 0x55e79cf57ce0 2024-09-10T05:36:34.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.599+0000 7faf4b805640 1 -- 172.21.15.62:0/2304126223 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94453259190848] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf3c0083f0 con 0x7faf44115070 2024-09-10T05:36:34.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.599+0000 7faf4b004640 1 -- 172.21.15.62:0/2304126223 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94453259176192] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf44112030 con 0x55e79cf57ce0 2024-09-10T05:36:34.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.603+0000 7faf4b004640 1 -- 172.21.15.62:0/2304126223 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf44112030 con 0x55e79cf57ce0 2024-09-10T05:36:34.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.603+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94453259191904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf63110 con 0x55e79cf57ce0 2024-09-10T05:36:34.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.603+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf65a10 con 0x55e79cf5b530 2024-09-10T05:36:34.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.603+0000 7faf4a803640 1 -- 172.21.15.62:0/2304126223 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf4000d040 con 0x55e79cf5b530 2024-09-10T05:36:34.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.603+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94453259195744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf63110 con 0x55e79cf5b530 2024-09-10T05:36:34.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.603+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf66450 con 0x55e79cf5b530 2024-09-10T05:36:34.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.603+0000 7faf4b004640 1 -- 172.21.15.62:0/2304126223 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94453259191904] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf44112030 con 0x55e79cf57ce0 2024-09-10T05:36:34.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.603+0000 7faf4a803640 1 -- 172.21.15.62:0/2304126223 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94453259195744] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf4000d040 con 0x55e79cf5b530 2024-09-10T05:36:34.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.603+0000 7faf4a803640 1 -- 172.21.15.62:0/2304126223 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf4000d040 con 0x55e79cf5b530 2024-09-10T05:36:34.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.603+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94453259196800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf65fa0 con 0x55e79cf5b530 2024-09-10T05:36:34.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.603+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf66cf0 con 0x7faf44115070 2024-09-10T05:36:34.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.603+0000 7faf4a803640 1 -- 172.21.15.62:0/2304126223 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94453259196800] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf4000d040 con 0x55e79cf5b530 2024-09-10T05:36:34.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.603+0000 7faf4b805640 1 -- 172.21.15.62:0/2304126223 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf3c0083f0 con 0x7faf44115070 2024-09-10T05:36:34.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.603+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94453259193472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf65fa0 con 0x7faf44115070 2024-09-10T05:36:34.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.603+0000 7faf4d4fe9c0 20 add_watcher() i=0 2024-09-10T05:36:34.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.603+0000 7faf4d4fe9c0 20 add_watcher() i=1 2024-09-10T05:36:34.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.603+0000 7faf4d4fe9c0 20 add_watcher() i=2 2024-09-10T05:36:34.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.603+0000 7faf4d4fe9c0 20 add_watcher() i=3 2024-09-10T05:36:34.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.603+0000 7faf4d4fe9c0 20 add_watcher() i=4 2024-09-10T05:36:34.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.603+0000 7faf4d4fe9c0 20 add_watcher() i=5 2024-09-10T05:36:34.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.603+0000 7faf4d4fe9c0 20 add_watcher() i=6 2024-09-10T05:36:34.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.607+0000 7faf4b805640 1 -- 172.21.15.62:0/2304126223 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94453259193472] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf3c0083f0 con 0x7faf44115070 2024-09-10T05:36:34.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.607+0000 7faf4d4fe9c0 20 add_watcher() i=7 2024-09-10T05:36:34.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.607+0000 7faf4d4fe9c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:34.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.607+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf69d50 con 0x55e79cf53810 2024-09-10T05:36:34.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.607+0000 7faf4b805640 1 -- 172.21.15.62:0/2304126223 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7faf3c0083f0 con 0x55e79cf53810 2024-09-10T05:36:34.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.607+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94453259200576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf672a0 con 0x55e79cf53810 2024-09-10T05:36:34.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.607+0000 7faf4b805640 1 -- 172.21.15.62:0/2304126223 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94453259200576] v30'96 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faf3c0083f0 con 0x55e79cf53810 2024-09-10T05:36:34.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.607+0000 7fae017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:34.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.607+0000 7faf4d4fe9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:34.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.607+0000 7faf4d4fe9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:34.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.607+0000 7faf4d4fe9c0 5 note: GC not initialized 2024-09-10T05:36:34.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.607+0000 7fad7bfff640 20 reqs_thread_entry: start 2024-09-10T05:36:34.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.607+0000 7faf4d4fe9c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:34.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.607+0000 7faf4d4fe9c0 20 Filter name: none 2024-09-10T05:36:34.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.607+0000 7fad79ffb640 20 reqs_thread_entry: start 2024-09-10T05:36:34.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.607+0000 7faf4d4fe9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.607+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf8cb50 con 0x55e79cf53810 2024-09-10T05:36:34.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.607+0000 7faf4b805640 1 -- 172.21.15.62:0/2304126223 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7faf3c0083f0 con 0x55e79cf53810 2024-09-10T05:36:34.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.607+0000 7faf4d4fe9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:36:34.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.607+0000 7faf4d4fe9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.607+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf8d540 con 0x55e79cf53810 2024-09-10T05:36:34.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.611+0000 7faf4b805640 1 -- 172.21.15.62:0/2304126223 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7faf3c0083f0 con 0x55e79cf53810 2024-09-10T05:36:34.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.611+0000 7faf4d4fe9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:36:34.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.611+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf8e550 con 0x7faf44115070 2024-09-10T05:36:34.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.611+0000 7faf4b805640 1 -- 172.21.15.62:0/2304126223 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7faf3c0083f0 con 0x7faf44115070 2024-09-10T05:36:34.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.611+0000 7fae017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:34.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.611+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94453259200576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf4de60 con 0x55e79cf53810 2024-09-10T05:36:34.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.611+0000 7faf4b805640 1 -- 172.21.15.62:0/2304126223 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94453259200576] v30'97 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faf3c0083f0 con 0x55e79cf53810 2024-09-10T05:36:34.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.611+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94453259178400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf66840 con 0x55e79cf57ce0 2024-09-10T05:36:34.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.615+0000 7faf4b004640 1 -- 172.21.15.62:0/2304126223 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94453259178400] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf44112030 con 0x55e79cf57ce0 2024-09-10T05:36:34.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.615+0000 7faf4d4fe9c0 20 remove_watcher() i=0 2024-09-10T05:36:34.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.615+0000 7faf4d4fe9c0 2 removed watcher, disabling cache 2024-09-10T05:36:34.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.615+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94453259184320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf611a0 con 0x55e79cf53810 2024-09-10T05:36:34.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.615+0000 7faf4b805640 1 -- 172.21.15.62:0/2304126223 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94453259184320] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf3c0083f0 con 0x55e79cf53810 2024-09-10T05:36:34.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.615+0000 7faf4d4fe9c0 20 remove_watcher() i=1 2024-09-10T05:36:34.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.615+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94453259176192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf611a0 con 0x55e79cf57ce0 2024-09-10T05:36:34.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.619+0000 7faf4b004640 1 -- 172.21.15.62:0/2304126223 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94453259176192] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf44112030 con 0x55e79cf57ce0 2024-09-10T05:36:34.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.619+0000 7faf4d4fe9c0 20 remove_watcher() i=2 2024-09-10T05:36:34.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.619+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94453259190848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf60900 con 0x7faf44115070 2024-09-10T05:36:34.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.619+0000 7faf4b805640 1 -- 172.21.15.62:0/2304126223 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94453259190848] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf3c0083f0 con 0x7faf44115070 2024-09-10T05:36:34.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.619+0000 7faf4d4fe9c0 20 remove_watcher() i=3 2024-09-10T05:36:34.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.619+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94453259191904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf611a0 con 0x55e79cf57ce0 2024-09-10T05:36:34.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.619+0000 7faf4b004640 1 -- 172.21.15.62:0/2304126223 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94453259191904] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf44112030 con 0x55e79cf57ce0 2024-09-10T05:36:34.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.619+0000 7faf4d4fe9c0 20 remove_watcher() i=4 2024-09-10T05:36:34.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.619+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94453259195744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf611a0 con 0x55e79cf5b530 2024-09-10T05:36:34.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.623+0000 7faf4a803640 1 -- 172.21.15.62:0/2304126223 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94453259195744] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf4000d040 con 0x55e79cf5b530 2024-09-10T05:36:34.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.623+0000 7faf4d4fe9c0 20 remove_watcher() i=5 2024-09-10T05:36:34.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.623+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94453259196800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf65560 con 0x55e79cf5b530 2024-09-10T05:36:34.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.623+0000 7faf4a803640 1 -- 172.21.15.62:0/2304126223 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94453259196800] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf4000d040 con 0x55e79cf5b530 2024-09-10T05:36:34.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.623+0000 7faf4d4fe9c0 20 remove_watcher() i=6 2024-09-10T05:36:34.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.623+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94453259193472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e79cf611a0 con 0x7faf44115070 2024-09-10T05:36:34.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.623+0000 7faf4b805640 1 -- 172.21.15.62:0/2304126223 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94453259193472] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf3c0083f0 con 0x7faf44115070 2024-09-10T05:36:34.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.623+0000 7faf4d4fe9c0 20 remove_watcher() i=7 2024-09-10T05:36:34.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.623+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e79cf57ce0 msgr2=0x55e79cf5a0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.623+0000 7faf4d4fe9c0 1 --2- 172.21.15.62:0/2304126223 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e79cf57ce0 0x55e79cf5a0d0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.623+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55e79cf53810 msgr2=0x55e79cf55ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.623+0000 7faf4d4fe9c0 1 --2- 172.21.15.62:0/2304126223 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55e79cf53810 0x55e79cf55ca0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.623+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7faf44115070 msgr2=0x7faf440db600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.623+0000 7faf4d4fe9c0 1 --2- 172.21.15.62:0/2304126223 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7faf44115070 0x7faf440db600 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.623+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55e79cf5b530 msgr2=0x55e79cf5d920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.623+0000 7faf4d4fe9c0 1 --2- 172.21.15.62:0/2304126223 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55e79cf5b530 0x55e79cf5d920 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.623+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fae140399d0 msgr2=0x7fae1403be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.623+0000 7faf4d4fe9c0 1 --2- 172.21.15.62:0/2304126223 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fae140399d0 0x7fae1403be90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x55e79cf1e730 tx=0x7faf40011000 comp rx=0 tx=0).stop 2024-09-10T05:36:34.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.623+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e79cd98a70 msgr2=0x55e79cf488b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.623+0000 7faf4d4fe9c0 1 --2- 172.21.15.62:0/2304126223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e79cd98a70 0x55e79cf488b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7faf440e2bd0 tx=0x7faf440caf80 comp rx=0 tx=0).stop 2024-09-10T05:36:34.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.623+0000 7faf4b805640 1 -- 172.21.15.62:0/2304126223 reap_dead start 2024-09-10T05:36:34.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.623+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 shutdown_connections 2024-09-10T05:36:34.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.623+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 >> 172.21.15.62:0/2304126223 conn(0x55e79cd96c20 msgr2=0x55e79cd94e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:34.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.623+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 shutdown_connections 2024-09-10T05:36:34.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.623+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/2304126223 wait complete. 2024-09-10T05:36:34.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.623+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/938749669 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fae24039a70 msgr2=0x7fae2403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.623+0000 7faf4d4fe9c0 1 --2- 172.21.15.62:0/938749669 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fae24039a70 0x7fae2403bf30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x55e79cf1eb00 tx=0x7faf40006000 comp rx=0 tx=0).stop 2024-09-10T05:36:34.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.623+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/938749669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e79cf30a70 msgr2=0x55e79cf30e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.623+0000 7faf4d4fe9c0 1 --2- 172.21.15.62:0/938749669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e79cf30a70 0x55e79cf30e90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7faf44000f90 tx=0x7faf440b4da0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.623+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/938749669 shutdown_connections 2024-09-10T05:36:34.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.623+0000 7faf4d4fe9c0 1 --2- 172.21.15.62:0/938749669 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fae24039a70 0x7fae2403bf30 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.623+0000 7faf4d4fe9c0 1 --2- 172.21.15.62:0/938749669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e79cf30a70 0x55e79cf30e90 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.623+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/938749669 >> 172.21.15.62:0/938749669 conn(0x55e79cf26420 msgr2=0x55e79cf26800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:34.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.623+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/938749669 shutdown_connections 2024-09-10T05:36:34.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.623+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/938749669 wait complete. 2024-09-10T05:36:34.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.623+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/1883616874 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e79cf1aed0 msgr2=0x55e79cf1d390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.623+0000 7faf4d4fe9c0 1 --2- 172.21.15.62:0/1883616874 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e79cf1aed0 0x55e79cf1d390 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.623+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/1883616874 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55e79ce23340 msgr2=0x55e79cf19e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.623+0000 7faf4d4fe9c0 1 --2- 172.21.15.62:0/1883616874 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55e79ce23340 0x55e79cf19e70 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.623+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/1883616874 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55e79cf1f8c0 msgr2=0x55e79cf21cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.623+0000 7faf4d4fe9c0 1 --2- 172.21.15.62:0/1883616874 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55e79cf1f8c0 0x55e79cf21cb0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.623+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/1883616874 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fae30039a70 msgr2=0x7fae3003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.623+0000 7faf4d4fe9c0 1 --2- 172.21.15.62:0/1883616874 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fae30039a70 0x7fae3003bf30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7faf40001ec0 tx=0x7faf40001440 comp rx=0 tx=0).stop 2024-09-10T05:36:34.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.627+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/1883616874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e79ce20200 msgr2=0x55e79cf12d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.627+0000 7faf4d4fe9c0 1 --2- 172.21.15.62:0/1883616874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e79ce20200 0x55e79cf12d00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7faf44018cc0 tx=0x7faf44017e30 comp rx=0 tx=0).stop 2024-09-10T05:36:34.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.627+0000 7faf4b805640 1 -- 172.21.15.62:0/1883616874 reap_dead start 2024-09-10T05:36:34.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.627+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/1883616874 shutdown_connections 2024-09-10T05:36:34.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.627+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/1883616874 >> 172.21.15.62:0/1883616874 conn(0x55e79cd93b10 msgr2=0x55e79cf05f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:34.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.627+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/1883616874 shutdown_connections 2024-09-10T05:36:34.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.627+0000 7faf4d4fe9c0 1 -- 172.21.15.62:0/1883616874 wait complete. 2024-09-10T05:36:34.638 INFO:teuthology.orchestra.run.smithi062.stdout:[] 2024-09-10T05:36:34.638 DEBUG:tasks.util.rgw: json result: [] 2024-09-10T05:36:34.656 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T05:36:34.656 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-10T05:36:34.656 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-10T05:36:34.656 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-10T05:36:34.707 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:34.708 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:34.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.707+0000 7fc8ac8929c0 1 Processor -- start 2024-09-10T05:36:34.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.707+0000 7fc8ac8929c0 1 -- start start 2024-09-10T05:36:34.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.707+0000 7fc8ac8929c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55c91aa0e310 0x55c91aa10700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.707+0000 7fc8ac8929c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c91a8be9c0 con 0x55c91a97e240 2024-09-10T05:36:34.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.707+0000 7fc8ac8929c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x55c91a90e6d0 con 0x55c91aa0e310 2024-09-10T05:36:34.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.707+0000 7fc8a9b97640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55c91aa0e310 0x55c91aa10700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.707+0000 7fc8a9b97640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55c91aa0e310 0x55c91aa10700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:46814/0 (socket says 172.21.15.62:46814) 2024-09-10T05:36:34.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.707+0000 7fc8aa398640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x55c91a97e240 0x55c91aa0cbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:52996/0 (socket says 172.21.15.62:52996) 2024-09-10T05:36:34.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.707+0000 7fc8a9b97640 1 -- 172.21.15.62:0/2903213274 learned_addr learned my addr 172.21.15.62:0/2903213274 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:34.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.707+0000 7fc8a9b97640 1 -- 172.21.15.62:0/2903213274 >> v1:172.21.15.2:6789/0 conn(0x55c91a97e240 legacy=0x55c91aa0cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.707+0000 7fc8a9b97640 1 -- 172.21.15.62:0/2903213274 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c91a8b2ca0 con 0x55c91aa0e310 2024-09-10T05:36:34.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.707+0000 7fc8a9b97640 1 --2- 172.21.15.62:0/2903213274 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91aa0e310 0x55c91aa10700 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc89400a5c0 tx=0x7fc89401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e25d051f08a8b0e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.707+0000 7fc8a9396640 1 -- 172.21.15.62:0/2903213274 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8940b1070 con 0x55c91aa0e310 2024-09-10T05:36:34.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.707+0000 7fc8a9396640 1 -- 172.21.15.62:0/2903213274 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8940a8070 con 0x55c91aa0e310 2024-09-10T05:36:34.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.707+0000 7fc8a9396640 1 -- 172.21.15.62:0/2903213274 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8940ac5b0 con 0x55c91aa0e310 2024-09-10T05:36:34.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.711+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/2903213274 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91aa0e310 msgr2=0x55c91aa10700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.711+0000 7fc8ac8929c0 1 --2- 172.21.15.62:0/2903213274 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91aa0e310 0x55c91aa10700 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc89400a5c0 tx=0x7fc89401b340 comp rx=0 tx=0).stop 2024-09-10T05:36:34.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.711+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/2903213274 shutdown_connections 2024-09-10T05:36:34.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.711+0000 7fc8ac8929c0 1 --2- 172.21.15.62:0/2903213274 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91aa0e310 0x55c91aa10700 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.711+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/2903213274 >> 172.21.15.62:0/2903213274 conn(0x55c91aa04920 msgr2=0x55c91aa06d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:34.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.711+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/2903213274 shutdown_connections 2024-09-10T05:36:34.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.711+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/2903213274 wait complete. 2024-09-10T05:36:34.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.723+0000 7fc8ac8929c0 1 Processor -- start 2024-09-10T05:36:34.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.723+0000 7fc8ac8929c0 1 -- start start 2024-09-10T05:36:34.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.723+0000 7fc8ac8929c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91a97e240 0x55c91aaf5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.723+0000 7fc8ac8929c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c91a912680 con 0x55c91a97e240 2024-09-10T05:36:34.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.723+0000 7fc8aa398640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91a97e240 0x55c91aaf5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.723+0000 7fc8aa398640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91a97e240 0x55c91aaf5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:46822/0 (socket says 172.21.15.62:46822) 2024-09-10T05:36:34.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.723+0000 7fc8aa398640 1 -- 172.21.15.62:0/1603911469 learned_addr learned my addr 172.21.15.62:0/1603911469 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:34.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.723+0000 7fc8aa398640 1 -- 172.21.15.62:0/1603911469 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c91a88dda0 con 0x55c91a97e240 2024-09-10T05:36:34.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.723+0000 7fc8aa398640 1 --2- 172.21.15.62:0/1603911469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91a97e240 0x55c91aaf5800 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc89c00b270 tx=0x7fc89c00b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dbb93b894d1c539 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.723+0000 7fc798608640 1 -- 172.21.15.62:0/1603911469 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc89c00e5d0 con 0x55c91a97e240 2024-09-10T05:36:34.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.723+0000 7fc798608640 1 -- 172.21.15.62:0/1603911469 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc89c00e770 con 0x55c91a97e240 2024-09-10T05:36:34.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.723+0000 7fc798608640 1 -- 172.21.15.62:0/1603911469 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc89c00ea70 con 0x55c91a97e240 2024-09-10T05:36:34.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.723+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/1603911469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91a97e240 msgr2=0x55c91aaf5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.723+0000 7fc8ac8929c0 1 --2- 172.21.15.62:0/1603911469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91a97e240 0x55c91aaf5800 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc89c00b270 tx=0x7fc89c00b670 comp rx=0 tx=0).stop 2024-09-10T05:36:34.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.723+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/1603911469 shutdown_connections 2024-09-10T05:36:34.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.723+0000 7fc8ac8929c0 1 --2- 172.21.15.62:0/1603911469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91a97e240 0x55c91aaf5800 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.723+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/1603911469 >> 172.21.15.62:0/1603911469 conn(0x55c91aa04920 msgr2=0x55c91aaf1440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:34.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.723+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/1603911469 shutdown_connections 2024-09-10T05:36:34.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.723+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/1603911469 wait complete. 2024-09-10T05:36:34.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.723+0000 7fc8ac8929c0 1 Processor -- start 2024-09-10T05:36:34.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.723+0000 7fc8ac8929c0 1 -- start start 2024-09-10T05:36:34.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.723+0000 7fc8ac8929c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91a97e240 0x55c91aafcea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.727+0000 7fc8ac8929c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c91a8b4a50 con 0x55c91a97e240 2024-09-10T05:36:34.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.727+0000 7fc8aa398640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91a97e240 0x55c91aafcea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.727+0000 7fc8aa398640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91a97e240 0x55c91aafcea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:46834/0 (socket says 172.21.15.62:46834) 2024-09-10T05:36:34.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.727+0000 7fc8aa398640 1 -- 172.21.15.62:0/1706913217 learned_addr learned my addr 172.21.15.62:0/1706913217 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:34.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.727+0000 7fc8aa398640 1 -- 172.21.15.62:0/1706913217 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c91aafd400 con 0x55c91a97e240 2024-09-10T05:36:34.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.727+0000 7fc8aa398640 1 --2- 172.21.15.62:0/1706913217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91a97e240 0x55c91aafcea0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x55c91aaf6790 tx=0x7fc89c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.727+0000 7fc796e05640 1 -- 172.21.15.62:0/1706913217 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc89c00be70 con 0x55c91a97e240 2024-09-10T05:36:34.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.727+0000 7fc796e05640 1 -- 172.21.15.62:0/1706913217 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc89c00f9f0 con 0x55c91a97e240 2024-09-10T05:36:34.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.727+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/1706913217 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c91aafd690 con 0x55c91a97e240 2024-09-10T05:36:34.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.727+0000 7fc796e05640 1 -- 172.21.15.62:0/1706913217 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc89c00fcf0 con 0x55c91a97e240 2024-09-10T05:36:34.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.727+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/1706913217 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c91aafe040 con 0x55c91a97e240 2024-09-10T05:36:34.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.727+0000 7fc796e05640 1 -- 172.21.15.62:0/1706913217 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc89c017070 con 0x55c91a97e240 2024-09-10T05:36:34.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.727+0000 7fc796e05640 1 --2- 172.21.15.62:0/1706913217 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc790039a70 0x7fc79003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.727+0000 7fc796e05640 1 -- 172.21.15.62:0/1706913217 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc89c015020 con 0x55c91a97e240 2024-09-10T05:36:34.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.727+0000 7fc8a9b97640 1 --2- 172.21.15.62:0/1706913217 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc790039a70 0x7fc79003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.727+0000 7fc8ac8929c0 1 --2- 172.21.15.62:0/1706913217 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55c91aa0e310 0x55c91ab04010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.727+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/1706913217 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab04550 con 0x55c91aa0e310 2024-09-10T05:36:34.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.727+0000 7fc8aab99640 1 --2- 172.21.15.62:0/1706913217 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55c91aa0e310 0x55c91ab04010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.727+0000 7fc8a9b97640 1 --2- 172.21.15.62:0/1706913217 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc790039a70 0x7fc79003bf30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc8940ae000 tx=0x7fc8940a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.727+0000 7fc8aab99640 1 --2- 172.21.15.62:0/1706913217 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55c91aa0e310 0x55c91ab04010 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.731+0000 7fc8aab99640 1 -- 172.21.15.62:0/1706913217 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8a400a4d0 con 0x55c91aa0e310 2024-09-10T05:36:34.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.731+0000 7fc8ac8929c0 1 --2- 172.21.15.62:0/1706913217 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55c91ab05050 0x55c91ab07510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.731+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/1706913217 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab07c80 con 0x55c91ab05050 2024-09-10T05:36:34.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.731+0000 7fc8aa398640 1 --2- 172.21.15.62:0/1706913217 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55c91ab05050 0x55c91ab07510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.731+0000 7fc8aa398640 1 --2- 172.21.15.62:0/1706913217 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55c91ab05050 0x55c91ab07510 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.731+0000 7fc8aa398640 1 -- 172.21.15.62:0/1706913217 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc89c02e070 con 0x55c91ab05050 2024-09-10T05:36:34.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.731+0000 7fc8ac8929c0 1 --2- 172.21.15.62:0/1706913217 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55c91ab09a40 0x55c91ab0be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.731+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/1706913217 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab0c500 con 0x55c91ab09a40 2024-09-10T05:36:34.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.731+0000 7fc8a9b97640 1 --2- 172.21.15.62:0/1706913217 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55c91ab09a40 0x55c91ab0be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.731+0000 7fc8a9b97640 1 --2- 172.21.15.62:0/1706913217 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55c91ab09a40 0x55c91ab0be30 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.731+0000 7fc8a9b97640 1 -- 172.21.15.62:0/1706913217 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc8940b4040 con 0x55c91ab09a40 2024-09-10T05:36:34.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.731+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/1706913217 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab088e0 con 0x55c91ab05050 2024-09-10T05:36:34.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.731+0000 7fc8aa398640 1 -- 172.21.15.62:0/1706913217 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc89c02e070 con 0x55c91ab05050 2024-09-10T05:36:34.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.731+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/1706913217 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab08d20 con 0x55c91ab09a40 2024-09-10T05:36:34.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.731+0000 7fc8a9b97640 1 -- 172.21.15.62:0/1706913217 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc8940b4040 con 0x55c91ab09a40 2024-09-10T05:36:34.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.731+0000 7fc8ac8929c0 1 Processor -- start 2024-09-10T05:36:34.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.735+0000 7fc8ac8929c0 1 -- start start 2024-09-10T05:36:34.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.735+0000 7fc8ac8929c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91ab1ab50 0x55c91ab1af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.735+0000 7fc8ac8929c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c91a91f450 con 0x55c91ab1ab50 2024-09-10T05:36:34.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.735+0000 7fc8aa398640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91ab1ab50 0x55c91ab1af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.735+0000 7fc8aa398640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91ab1ab50 0x55c91ab1af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:46846/0 (socket says 172.21.15.62:46846) 2024-09-10T05:36:34.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.735+0000 7fc8aa398640 1 -- 172.21.15.62:0/3772299274 learned_addr learned my addr 172.21.15.62:0/3772299274 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:34.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.735+0000 7fc8aa398640 1 -- 172.21.15.62:0/3772299274 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c91ab1b5b0 con 0x55c91ab1ab50 2024-09-10T05:36:34.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.735+0000 7fc8aa398640 1 --2- 172.21.15.62:0/3772299274 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91ab1ab50 0x55c91ab1af70 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc89c01cfd0 tx=0x7fc89c01beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.735+0000 7fc78ffff640 1 -- 172.21.15.62:0/3772299274 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc89c01db90 con 0x55c91ab1ab50 2024-09-10T05:36:34.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.735+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/3772299274 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c91ab1be10 con 0x55c91ab1ab50 2024-09-10T05:36:34.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.735+0000 7fc78ffff640 1 -- 172.21.15.62:0/3772299274 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc89c01dd30 con 0x55c91ab1ab50 2024-09-10T05:36:34.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.735+0000 7fc78ffff640 1 -- 172.21.15.62:0/3772299274 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc89c040060 con 0x55c91ab1ab50 2024-09-10T05:36:34.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.735+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/3772299274 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c91ab1be10 con 0x55c91ab1ab50 2024-09-10T05:36:34.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.735+0000 7fc78ffff640 1 -- 172.21.15.62:0/3772299274 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc89c01b500 con 0x55c91ab1ab50 2024-09-10T05:36:34.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.735+0000 7fc78ffff640 1 --2- 172.21.15.62:0/3772299274 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc784039a60 0x7fc78403bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.735+0000 7fc78ffff640 1 -- 172.21.15.62:0/3772299274 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc89c04b050 con 0x55c91ab1ab50 2024-09-10T05:36:34.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.735+0000 7fc8a9b97640 1 --2- 172.21.15.62:0/3772299274 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc784039a60 0x7fc78403bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.735+0000 7fc8ac8929c0 1 Processor -- start 2024-09-10T05:36:34.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.735+0000 7fc8ac8929c0 1 -- start start 2024-09-10T05:36:34.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.735+0000 7fc8a9b97640 1 --2- 172.21.15.62:0/3772299274 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc784039a60 0x7fc78403bf20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x55c91ab048f0 tx=0x7fc894005ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.735+0000 7fc8ac8929c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91aa08bb0 0x55c91aa08fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.735+0000 7fc8ac8929c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c91aaf6050 con 0x55c91aa08bb0 2024-09-10T05:36:34.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.739+0000 7fc8aa398640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91aa08bb0 0x55c91aa08fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.739+0000 7fc8aa398640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91aa08bb0 0x55c91aa08fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:46856/0 (socket says 172.21.15.62:46856) 2024-09-10T05:36:34.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.739+0000 7fc8aa398640 1 -- 172.21.15.62:0/1746393829 learned_addr learned my addr 172.21.15.62:0/1746393829 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:34.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.739+0000 7fc8aa398640 1 -- 172.21.15.62:0/1746393829 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c91aa095a0 con 0x55c91aa08bb0 2024-09-10T05:36:34.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.739+0000 7fc8aa398640 1 --2- 172.21.15.62:0/1746393829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91aa08bb0 0x55c91aa08fb0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc89c019c50 tx=0x7fc89c04f940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b91af7f74eb21f1b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.739+0000 7fc78dffb640 1 -- 172.21.15.62:0/1746393829 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc89c060070 con 0x55c91aa08bb0 2024-09-10T05:36:34.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.739+0000 7fc78dffb640 1 -- 172.21.15.62:0/1746393829 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc89c018bf0 con 0x55c91aa08bb0 2024-09-10T05:36:34.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.739+0000 7fc78dffb640 1 -- 172.21.15.62:0/1746393829 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc89c048300 con 0x55c91aa08bb0 2024-09-10T05:36:34.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.739+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/1746393829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91aa08bb0 msgr2=0x55c91aa08fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.739+0000 7fc8ac8929c0 1 --2- 172.21.15.62:0/1746393829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91aa08bb0 0x55c91aa08fb0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc89c019c50 tx=0x7fc89c04f940 comp rx=0 tx=0).stop 2024-09-10T05:36:34.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.739+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/1746393829 shutdown_connections 2024-09-10T05:36:34.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.739+0000 7fc8ac8929c0 1 --2- 172.21.15.62:0/1746393829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91aa08bb0 0x55c91aa08fb0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.739+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/1746393829 >> 172.21.15.62:0/1746393829 conn(0x55c91ab235b0 msgr2=0x55c91ab217f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:34.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.739+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/1746393829 shutdown_connections 2024-09-10T05:36:34.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.739+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/1746393829 wait complete. 2024-09-10T05:36:34.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.739+0000 7fc8ac8929c0 1 Processor -- start 2024-09-10T05:36:34.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.739+0000 7fc8ac8929c0 1 -- start start 2024-09-10T05:36:34.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.739+0000 7fc8ac8929c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91aa08bb0 0x55c91ab30690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.739+0000 7fc8ac8929c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c91aa09ac0 con 0x55c91aa08bb0 2024-09-10T05:36:34.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.739+0000 7fc8aa398640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91aa08bb0 0x55c91ab30690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.739+0000 7fc8aa398640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91aa08bb0 0x55c91ab30690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:46866/0 (socket says 172.21.15.62:46866) 2024-09-10T05:36:34.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.739+0000 7fc8aa398640 1 -- 172.21.15.62:0/659987936 learned_addr learned my addr 172.21.15.62:0/659987936 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:34.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.739+0000 7fc8aa398640 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c91ab30bf0 con 0x55c91aa08bb0 2024-09-10T05:36:34.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.739+0000 7fc8aa398640 1 --2- 172.21.15.62:0/659987936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91aa08bb0 0x55c91ab30690 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc89c0187e0 tx=0x7fc89c051ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.739+0000 7fc77bfff640 1 -- 172.21.15.62:0/659987936 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc89c075070 con 0x55c91aa08bb0 2024-09-10T05:36:34.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.739+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c91ab30bf0 con 0x55c91aa08bb0 2024-09-10T05:36:34.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.739+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c91ab30bf0 con 0x55c91aa08bb0 2024-09-10T05:36:34.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.739+0000 7fc77bfff640 1 -- 172.21.15.62:0/659987936 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc89c018bf0 con 0x55c91aa08bb0 2024-09-10T05:36:34.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.739+0000 7fc77bfff640 1 -- 172.21.15.62:0/659987936 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc89c033110 con 0x55c91aa08bb0 2024-09-10T05:36:34.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.743+0000 7fc8ac8929c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.743+0000 7fc77bfff640 1 -- 172.21.15.62:0/659987936 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc89c078070 con 0x55c91aa08bb0 2024-09-10T05:36:34.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.743+0000 7fc77bfff640 1 --2- 172.21.15.62:0/659987936 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc774039a20 0x7fc77403bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.743+0000 7fc77bfff640 1 -- 172.21.15.62:0/659987936 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc89c07baf0 con 0x55c91aa08bb0 2024-09-10T05:36:34.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.743+0000 7fc8a9b97640 1 --2- 172.21.15.62:0/659987936 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc774039a20 0x7fc77403bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.743+0000 7fc8ac8929c0 1 --2- 172.21.15.62:0/659987936 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55c91ab3b620 0x55c91ab3dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.743+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab3e200 con 0x55c91ab3b620 2024-09-10T05:36:34.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.743+0000 7fc8aab99640 1 --2- 172.21.15.62:0/659987936 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55c91ab3b620 0x55c91ab3dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.743+0000 7fc8a9b97640 1 --2- 172.21.15.62:0/659987936 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc774039a20 0x7fc77403bee0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc8940af040 tx=0x7fc8940a8000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.743+0000 7fc8aab99640 1 --2- 172.21.15.62:0/659987936 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55c91ab3b620 0x55c91ab3dab0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.743+0000 7fc8aab99640 1 -- 172.21.15.62:0/659987936 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8a400a4d0 con 0x55c91ab3b620 2024-09-10T05:36:34.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.743+0000 7fc8ac8929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:34.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.743+0000 7fc8ac8929c0 20 realm 2024-09-10T05:36:34.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.743+0000 7fc8ac8929c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.743+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab3a9d0 con 0x55c91ab3b620 2024-09-10T05:36:34.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.743+0000 7fc8aab99640 1 -- 172.21.15.62:0/659987936 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8a400a4d0 con 0x55c91ab3b620 2024-09-10T05:36:34.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.743+0000 7fc8ac8929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:34.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.743+0000 7fc8ac8929c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:34.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.743+0000 7fc8ac8929c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.743+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab3ecc0 con 0x55c91ab3b620 2024-09-10T05:36:34.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.743+0000 7fc8aab99640 1 -- 172.21.15.62:0/659987936 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8a400a4d0 con 0x55c91ab3b620 2024-09-10T05:36:34.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.743+0000 7fc8ac8929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:34.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.743+0000 7fc8ac8929c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.743+0000 7fc8ac8929c0 1 --2- 172.21.15.62:0/659987936 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55c91ab3faa0 0x55c91ab41e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.743+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab42520 con 0x55c91ab3faa0 2024-09-10T05:36:34.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.743+0000 7fc8aa398640 1 --2- 172.21.15.62:0/659987936 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55c91ab3faa0 0x55c91ab41e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.743+0000 7fc8aa398640 1 --2- 172.21.15.62:0/659987936 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55c91ab3faa0 0x55c91ab41e90 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.743+0000 7fc8aa398640 1 -- 172.21.15.62:0/659987936 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc89c077030 con 0x55c91ab3faa0 2024-09-10T05:36:34.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.743+0000 7fc8ac8929c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:34.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.743+0000 7fc8ac8929c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.743+0000 7fc8ac8929c0 1 --2- 172.21.15.62:0/659987936 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55c91ab432d0 0x55c91ab456c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.743+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab45d60 con 0x55c91ab432d0 2024-09-10T05:36:34.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.743+0000 7fc8a9b97640 1 --2- 172.21.15.62:0/659987936 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55c91ab432d0 0x55c91ab456c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.747+0000 7fc8a9b97640 1 --2- 172.21.15.62:0/659987936 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55c91ab432d0 0x55c91ab456c0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.747+0000 7fc8a9b97640 1 -- 172.21.15.62:0/659987936 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc8940b4040 con 0x55c91ab432d0 2024-09-10T05:36:34.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.747+0000 7fc8ac8929c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:34.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.747+0000 7fc8ac8929c0 20 searching for the correct realm 2024-09-10T05:36:34.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.747+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab47630 con 0x55c91ab432d0 2024-09-10T05:36:34.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.747+0000 7fc8a9b97640 1 -- 172.21.15.62:0/659987936 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8940b4040 con 0x55c91ab432d0 2024-09-10T05:36:34.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.747+0000 7fc8a9b97640 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab47630 con 0x55c91ab3faa0 2024-09-10T05:36:34.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.747+0000 7fc8aa398640 1 -- 172.21.15.62:0/659987936 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc89c077030 con 0x55c91ab3faa0 2024-09-10T05:36:34.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.747+0000 7fc8aa398640 1 --2- 172.21.15.62:0/659987936 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fc89c07a060 0x7fc89c053160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.747+0000 7fc8aa398640 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab47630 con 0x7fc89c07a060 2024-09-10T05:36:34.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.747+0000 7fc8aab99640 1 --2- 172.21.15.62:0/659987936 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fc89c07a060 0x7fc89c053160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.747+0000 7fc8aab99640 1 --2- 172.21.15.62:0/659987936 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fc89c07a060 0x7fc89c053160 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.747+0000 7fc8aab99640 1 -- 172.21.15.62:0/659987936 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8a400a4d0 con 0x7fc89c07a060 2024-09-10T05:36:34.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.747+0000 7fc8aab99640 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab47630 con 0x55c91ab3b620 2024-09-10T05:36:34.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.747+0000 7fc8aab99640 1 -- 172.21.15.62:0/659987936 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8a400a4d0 con 0x55c91ab3b620 2024-09-10T05:36:34.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.747+0000 7fc8aab99640 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab47630 con 0x55c91ab3b620 2024-09-10T05:36:34.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.747+0000 7fc8aab99640 1 -- 172.21.15.62:0/659987936 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8a400a4d0 con 0x55c91ab3b620 2024-09-10T05:36:34.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.747+0000 7fc8aab99640 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab47630 con 0x55c91ab432d0 2024-09-10T05:36:34.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.747+0000 7fc8a9b97640 1 -- 172.21.15.62:0/659987936 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8940b4040 con 0x55c91ab432d0 2024-09-10T05:36:34.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.747+0000 7fc8a9b97640 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab47630 con 0x55c91ab3b620 2024-09-10T05:36:34.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.747+0000 7fc8aab99640 1 -- 172.21.15.62:0/659987936 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8a400a4d0 con 0x55c91ab3b620 2024-09-10T05:36:34.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.747+0000 7fc8aab99640 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab47630 con 0x55c91ab3faa0 2024-09-10T05:36:34.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.751+0000 7fc8aa398640 1 -- 172.21.15.62:0/659987936 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc89c077030 con 0x55c91ab3faa0 2024-09-10T05:36:34.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.751+0000 7fc8aa398640 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab47630 con 0x55c91ab3faa0 2024-09-10T05:36:34.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.751+0000 7fc8aa398640 1 -- 172.21.15.62:0/659987936 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc89c077030 con 0x55c91ab3faa0 2024-09-10T05:36:34.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.751+0000 7fc8aa398640 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab47630 con 0x55c91ab3b620 2024-09-10T05:36:34.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.751+0000 7fc8aab99640 1 -- 172.21.15.62:0/659987936 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8a400a4d0 con 0x55c91ab3b620 2024-09-10T05:36:34.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.751+0000 7fc8aab99640 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab47630 con 0x7fc89c07a060 2024-09-10T05:36:34.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.751+0000 7fc8aab99640 1 -- 172.21.15.62:0/659987936 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8a400a4d0 con 0x7fc89c07a060 2024-09-10T05:36:34.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.751+0000 7fc8aab99640 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab47630 con 0x55c91ab3b620 2024-09-10T05:36:34.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.751+0000 7fc8aab99640 1 -- 172.21.15.62:0/659987936 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8a400a4d0 con 0x55c91ab3b620 2024-09-10T05:36:34.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.751+0000 7fc8aab99640 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab47630 con 0x7fc89c07a060 2024-09-10T05:36:34.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.751+0000 7fc8aab99640 1 -- 172.21.15.62:0/659987936 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc8a400a4d0 con 0x7fc89c07a060 2024-09-10T05:36:34.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.751+0000 7fc8aab99640 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab47630 con 0x55c91ab3faa0 2024-09-10T05:36:34.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.751+0000 7fc8aa398640 1 -- 172.21.15.62:0/659987936 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc89c077030 con 0x55c91ab3faa0 2024-09-10T05:36:34.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.751+0000 7fc8aa398640 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab47630 con 0x55c91ab432d0 2024-09-10T05:36:34.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.751+0000 7fc8a9b97640 1 -- 172.21.15.62:0/659987936 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8940b4040 con 0x55c91ab432d0 2024-09-10T05:36:34.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.751+0000 7fc8a9b97640 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab47630 con 0x55c91ab3b620 2024-09-10T05:36:34.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.751+0000 7fc8aab99640 1 -- 172.21.15.62:0/659987936 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8a400a4d0 con 0x55c91ab3b620 2024-09-10T05:36:34.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.751+0000 7fc8aab99640 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab47630 con 0x55c91ab3faa0 2024-09-10T05:36:34.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.751+0000 7fc8aa398640 1 -- 172.21.15.62:0/659987936 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc89c077030 con 0x55c91ab3faa0 2024-09-10T05:36:34.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.751+0000 7fc8aa398640 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab47630 con 0x55c91ab432d0 2024-09-10T05:36:34.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.751+0000 7fc8a9b97640 1 -- 172.21.15.62:0/659987936 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 30 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7fc8940b4040 con 0x55c91ab432d0 2024-09-10T05:36:34.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.751+0000 7fc8a9b97640 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab47630 con 0x55c91ab3b620 2024-09-10T05:36:34.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.755+0000 7fc8aab99640 1 -- 172.21.15.62:0/659987936 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8a400a4d0 con 0x55c91ab3b620 2024-09-10T05:36:34.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.755+0000 7fc8aab99640 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab47630 con 0x55c91ab3b620 2024-09-10T05:36:34.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.755+0000 7fc8aab99640 1 -- 172.21.15.62:0/659987936 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc8a400a4d0 con 0x55c91ab3b620 2024-09-10T05:36:34.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.755+0000 7fc8aab99640 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab47630 con 0x55c91ab3b620 2024-09-10T05:36:34.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.755+0000 7fc8aab99640 1 -- 172.21.15.62:0/659987936 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8a400a4d0 con 0x55c91ab3b620 2024-09-10T05:36:34.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.755+0000 7fc8aab99640 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab47630 con 0x55c91ab432d0 2024-09-10T05:36:34.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.755+0000 7fc8a9b97640 1 -- 172.21.15.62:0/659987936 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8940b4040 con 0x55c91ab432d0 2024-09-10T05:36:34.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.755+0000 7fc8a9b97640 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab47630 con 0x7fc89c07a060 2024-09-10T05:36:34.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.755+0000 7fc8aab99640 1 -- 172.21.15.62:0/659987936 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8a400a4d0 con 0x7fc89c07a060 2024-09-10T05:36:34.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.755+0000 7fc8aab99640 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab47630 con 0x55c91ab3b620 2024-09-10T05:36:34.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.755+0000 7fc8aab99640 1 -- 172.21.15.62:0/659987936 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8a400a4d0 con 0x55c91ab3b620 2024-09-10T05:36:34.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.755+0000 7fc8aab99640 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab47630 con 0x7fc89c07a060 2024-09-10T05:36:34.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.755+0000 7fc8aab99640 1 -- 172.21.15.62:0/659987936 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8a400a4d0 con 0x7fc89c07a060 2024-09-10T05:36:34.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.755+0000 7fc8aab99640 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab47630 con 0x55c91ab432d0 2024-09-10T05:36:34.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.755+0000 7fc8a9b97640 1 -- 172.21.15.62:0/659987936 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8940b4040 con 0x55c91ab432d0 2024-09-10T05:36:34.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.755+0000 7fc8a9b97640 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab47630 con 0x7fc89c07a060 2024-09-10T05:36:34.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.755+0000 7fc8aab99640 1 -- 172.21.15.62:0/659987936 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8a400a4d0 con 0x7fc89c07a060 2024-09-10T05:36:34.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.755+0000 7fc8aab99640 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab47630 con 0x55c91ab3faa0 2024-09-10T05:36:34.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.755+0000 7fc8aa398640 1 -- 172.21.15.62:0/659987936 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc89c077030 con 0x55c91ab3faa0 2024-09-10T05:36:34.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.755+0000 7fc8aa398640 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab47630 con 0x55c91ab3faa0 2024-09-10T05:36:34.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.755+0000 7fc8aa398640 1 -- 172.21.15.62:0/659987936 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc89c077030 con 0x55c91ab3faa0 2024-09-10T05:36:34.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.755+0000 7fc8aa398640 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab47630 con 0x55c91ab432d0 2024-09-10T05:36:34.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.755+0000 7fc8a9b97640 1 -- 172.21.15.62:0/659987936 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8940b4040 con 0x55c91ab432d0 2024-09-10T05:36:34.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.755+0000 7fc8a9b97640 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab47630 con 0x55c91ab3faa0 2024-09-10T05:36:34.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.759+0000 7fc8aa398640 1 -- 172.21.15.62:0/659987936 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc89c077030 con 0x55c91ab3faa0 2024-09-10T05:36:34.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.759+0000 7fc8aa398640 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab47630 con 0x55c91ab3faa0 2024-09-10T05:36:34.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.759+0000 7fc8aa398640 1 -- 172.21.15.62:0/659987936 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc89c077030 con 0x55c91ab3faa0 2024-09-10T05:36:34.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.759+0000 7fc8ac8929c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:34.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.759+0000 7fc8ac8929c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:34.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.759+0000 7fc8ac8929c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:34.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.759+0000 7fc8ac8929c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:34.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.759+0000 7fc8ac8929c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:34.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.759+0000 7fc8ac8929c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:34.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.759+0000 7fc8ac8929c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.759+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab46720 con 0x55c91ab3b620 2024-09-10T05:36:34.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.759+0000 7fc8aab99640 1 -- 172.21.15.62:0/659987936 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8a400a4d0 con 0x55c91ab3b620 2024-09-10T05:36:34.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.759+0000 7fc8ac8929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:34.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.759+0000 7fc8ac8929c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.759+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab46b70 con 0x55c91ab3faa0 2024-09-10T05:36:34.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.759+0000 7fc8aa398640 1 -- 172.21.15.62:0/659987936 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc89c077030 con 0x55c91ab3faa0 2024-09-10T05:36:34.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.759+0000 7fc8ac8929c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:34.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.759+0000 7fc8ac8929c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.759+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab46f90 con 0x55c91ab432d0 2024-09-10T05:36:34.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.759+0000 7fc8a9b97640 1 -- 172.21.15.62:0/659987936 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc8940b4040 con 0x55c91ab432d0 2024-09-10T05:36:34.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.759+0000 7fc8ac8929c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:34.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.759+0000 7fc8ac8929c0 20 zone default found 2024-09-10T05:36:34.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.759+0000 7fc8ac8929c0 4 Realm: () 2024-09-10T05:36:34.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.759+0000 7fc8ac8929c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:34.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.759+0000 7fc8ac8929c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:34.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.759+0000 7fc8ac8929c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:34.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.759+0000 7fc8ac8929c0 20 zonegroup default 2024-09-10T05:36:34.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.759+0000 7fc8ac8929c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.759+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab47ae0 con 0x7fc89c07a060 2024-09-10T05:36:34.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.759+0000 7fc8aab99640 1 -- 172.21.15.62:0/659987936 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc8a400a4d0 con 0x7fc89c07a060 2024-09-10T05:36:34.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.759+0000 7fc8ac8929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:34.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.759+0000 7fc8ac8929c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.759+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab49d70 con 0x55c91ab432d0 2024-09-10T05:36:34.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.759+0000 7fc8a9b97640 1 -- 172.21.15.62:0/659987936 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc8940b4040 con 0x55c91ab432d0 2024-09-10T05:36:34.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.759+0000 7fc8ac8929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:34.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.759+0000 7fc8ac8929c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.759+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab4a110 con 0x55c91ab432d0 2024-09-10T05:36:34.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.759+0000 7fc8a9b97640 1 -- 172.21.15.62:0/659987936 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc8940b4040 con 0x55c91ab432d0 2024-09-10T05:36:34.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.759+0000 7fc8ac8929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:34.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.759+0000 7fc8ac8929c0 20 started sync module instance, tier type = 2024-09-10T05:36:34.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.759+0000 7fc8ac8929c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:34.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.759+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab49200 con 0x55c91ab3faa0 2024-09-10T05:36:34.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.763+0000 7fc8aa398640 1 -- 172.21.15.62:0/659987936 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc89c077030 con 0x55c91ab3faa0 2024-09-10T05:36:34.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.763+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94322224829984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab48e60 con 0x55c91ab3faa0 2024-09-10T05:36:34.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.763+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab4aff0 con 0x55c91ab3b620 2024-09-10T05:36:34.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.763+0000 7fc8aab99640 1 -- 172.21.15.62:0/659987936 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8a400a4d0 con 0x55c91ab3b620 2024-09-10T05:36:34.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.763+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94322224835392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab4b840 con 0x55c91ab3b620 2024-09-10T05:36:34.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.763+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab4c240 con 0x55c91ab3faa0 2024-09-10T05:36:34.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.763+0000 7fc8aa398640 1 -- 172.21.15.62:0/659987936 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94322224829984] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc89c077030 con 0x55c91ab3faa0 2024-09-10T05:36:34.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.763+0000 7fc8aab99640 1 -- 172.21.15.62:0/659987936 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94322224835392] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8a400a4d0 con 0x55c91ab3b620 2024-09-10T05:36:34.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.767+0000 7fc8aa398640 1 -- 172.21.15.62:0/659987936 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc89c077030 con 0x55c91ab3faa0 2024-09-10T05:36:34.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.767+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94322224833824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab4b390 con 0x55c91ab3faa0 2024-09-10T05:36:34.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.767+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab4cae0 con 0x7fc89c07a060 2024-09-10T05:36:34.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.767+0000 7fc8aab99640 1 -- 172.21.15.62:0/659987936 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8a400a4d0 con 0x7fc89c07a060 2024-09-10T05:36:34.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.767+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94322224842288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab4b390 con 0x7fc89c07a060 2024-09-10T05:36:34.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.767+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab4d560 con 0x55c91ab3faa0 2024-09-10T05:36:34.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.767+0000 7fc8aab99640 1 -- 172.21.15.62:0/659987936 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94322224842288] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8a400a4d0 con 0x7fc89c07a060 2024-09-10T05:36:34.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.767+0000 7fc8aa398640 1 -- 172.21.15.62:0/659987936 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94322224833824] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc89c077030 con 0x55c91ab3faa0 2024-09-10T05:36:34.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.767+0000 7fc8aa398640 1 -- 172.21.15.62:0/659987936 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc89c077030 con 0x55c91ab3faa0 2024-09-10T05:36:34.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.767+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94322224840016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab4d070 con 0x55c91ab3faa0 2024-09-10T05:36:34.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.767+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab4de30 con 0x55c91ab432d0 2024-09-10T05:36:34.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.771+0000 7fc8a9b97640 1 -- 172.21.15.62:0/659987936 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8940b4040 con 0x55c91ab432d0 2024-09-10T05:36:34.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.771+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94322224847232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab4d070 con 0x55c91ab432d0 2024-09-10T05:36:34.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.771+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab4e870 con 0x55c91ab432d0 2024-09-10T05:36:34.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.771+0000 7fc8a9b97640 1 -- 172.21.15.62:0/659987936 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94322224847232] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8940b4040 con 0x55c91ab432d0 2024-09-10T05:36:34.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.771+0000 7fc8aa398640 1 -- 172.21.15.62:0/659987936 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94322224840016] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc89c077030 con 0x55c91ab3faa0 2024-09-10T05:36:34.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.771+0000 7fc8a9b97640 1 -- 172.21.15.62:0/659987936 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8940b4040 con 0x55c91ab432d0 2024-09-10T05:36:34.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.771+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94322224843344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab4e3c0 con 0x55c91ab432d0 2024-09-10T05:36:34.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.771+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab4f110 con 0x7fc89c07a060 2024-09-10T05:36:34.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.771+0000 7fc8a9b97640 1 -- 172.21.15.62:0/659987936 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94322224843344] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8940b4040 con 0x55c91ab432d0 2024-09-10T05:36:34.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.771+0000 7fc8aab99640 1 -- 172.21.15.62:0/659987936 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8a400a4d0 con 0x7fc89c07a060 2024-09-10T05:36:34.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.771+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94322224848288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab4e3c0 con 0x7fc89c07a060 2024-09-10T05:36:34.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.771+0000 7fc8ac8929c0 20 add_watcher() i=0 2024-09-10T05:36:34.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.771+0000 7fc8ac8929c0 20 add_watcher() i=1 2024-09-10T05:36:34.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.771+0000 7fc8ac8929c0 20 add_watcher() i=2 2024-09-10T05:36:34.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.771+0000 7fc8ac8929c0 20 add_watcher() i=3 2024-09-10T05:36:34.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.771+0000 7fc8ac8929c0 20 add_watcher() i=4 2024-09-10T05:36:34.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.771+0000 7fc8ac8929c0 20 add_watcher() i=5 2024-09-10T05:36:34.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.771+0000 7fc8ac8929c0 20 add_watcher() i=6 2024-09-10T05:36:34.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.775+0000 7fc8aab99640 1 -- 172.21.15.62:0/659987936 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94322224848288] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8a400a4d0 con 0x7fc89c07a060 2024-09-10T05:36:34.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.775+0000 7fc8ac8929c0 20 add_watcher() i=7 2024-09-10T05:36:34.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.775+0000 7fc8ac8929c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:34.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.775+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab521a0 con 0x55c91ab3b620 2024-09-10T05:36:34.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.775+0000 7fc8aab99640 1 -- 172.21.15.62:0/659987936 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc8a400a4d0 con 0x55c91ab3b620 2024-09-10T05:36:34.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.775+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94322224852064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab4f6c0 con 0x55c91ab3b620 2024-09-10T05:36:34.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.775+0000 7fc8aab99640 1 -- 172.21.15.62:0/659987936 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94322224852064] v30'98 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc8a400a4d0 con 0x55c91ab3b620 2024-09-10T05:36:34.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.775+0000 7fc760fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:34.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.775+0000 7fc8ac8929c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:34.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.775+0000 7fc8ac8929c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:34.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.775+0000 7fc8ac8929c0 5 note: GC not initialized 2024-09-10T05:36:34.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.775+0000 7fc6db7fe640 20 reqs_thread_entry: start 2024-09-10T05:36:34.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.775+0000 7fc8ac8929c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:34.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.775+0000 7fc8ac8929c0 20 Filter name: none 2024-09-10T05:36:34.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.775+0000 7fc6d97fa640 20 reqs_thread_entry: start 2024-09-10T05:36:34.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.775+0000 7fc8ac8929c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.775+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab74fb0 con 0x55c91ab3b620 2024-09-10T05:36:34.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.775+0000 7fc8aab99640 1 -- 172.21.15.62:0/659987936 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc8a400a4d0 con 0x55c91ab3b620 2024-09-10T05:36:34.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.775+0000 7fc8ac8929c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:36:34.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.775+0000 7fc8ac8929c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.775+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab759d0 con 0x55c91ab3b620 2024-09-10T05:36:34.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.775+0000 7fc8aab99640 1 -- 172.21.15.62:0/659987936 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc8a400a4d0 con 0x55c91ab3b620 2024-09-10T05:36:34.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.775+0000 7fc8ac8929c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:36:34.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.775+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab769e0 con 0x7fc89c07a060 2024-09-10T05:36:34.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.779+0000 7fc8aab99640 1 -- 172.21.15.62:0/659987936 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv2 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fc8a400a4d0 con 0x7fc89c07a060 2024-09-10T05:36:34.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.779+0000 7fc760fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:34.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.779+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94322224852064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab35be0 con 0x55c91ab3b620 2024-09-10T05:36:34.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.779+0000 7fc8aab99640 1 -- 172.21.15.62:0/659987936 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94322224852064] v30'99 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc8a400a4d0 con 0x55c91ab3b620 2024-09-10T05:36:34.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.779+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94322224829984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab4ec60 con 0x55c91ab3faa0 2024-09-10T05:36:34.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.783+0000 7fc8aa398640 1 -- 172.21.15.62:0/659987936 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94322224829984] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc89c077030 con 0x55c91ab3faa0 2024-09-10T05:36:34.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.783+0000 7fc8ac8929c0 20 remove_watcher() i=0 2024-09-10T05:36:34.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.783+0000 7fc8ac8929c0 2 removed watcher, disabling cache 2024-09-10T05:36:34.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.783+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94322224835392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab49620 con 0x55c91ab3b620 2024-09-10T05:36:34.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.783+0000 7fc8aab99640 1 -- 172.21.15.62:0/659987936 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94322224835392] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8a400a4d0 con 0x55c91ab3b620 2024-09-10T05:36:34.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.783+0000 7fc8ac8929c0 20 remove_watcher() i=1 2024-09-10T05:36:34.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.783+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94322224833824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab49620 con 0x55c91ab3faa0 2024-09-10T05:36:34.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.787+0000 7fc8aa398640 1 -- 172.21.15.62:0/659987936 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94322224833824] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc89c077030 con 0x55c91ab3faa0 2024-09-10T05:36:34.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.787+0000 7fc8ac8929c0 20 remove_watcher() i=2 2024-09-10T05:36:34.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.787+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94322224842288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab4a520 con 0x7fc89c07a060 2024-09-10T05:36:34.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.787+0000 7fc8aab99640 1 -- 172.21.15.62:0/659987936 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94322224842288] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8a400a4d0 con 0x7fc89c07a060 2024-09-10T05:36:34.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.787+0000 7fc8ac8929c0 20 remove_watcher() i=3 2024-09-10T05:36:34.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.787+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94322224840016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab49620 con 0x55c91ab3faa0 2024-09-10T05:36:34.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.787+0000 7fc8aa398640 1 -- 172.21.15.62:0/659987936 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94322224840016] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc89c077030 con 0x55c91ab3faa0 2024-09-10T05:36:34.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.787+0000 7fc8ac8929c0 20 remove_watcher() i=4 2024-09-10T05:36:34.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.787+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94322224847232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab4c630 con 0x55c91ab432d0 2024-09-10T05:36:34.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.791+0000 7fc8a9b97640 1 -- 172.21.15.62:0/659987936 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94322224847232] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8940b4040 con 0x55c91ab432d0 2024-09-10T05:36:34.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.791+0000 7fc8ac8929c0 20 remove_watcher() i=5 2024-09-10T05:36:34.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.791+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94322224843344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab4bd50 con 0x55c91ab432d0 2024-09-10T05:36:34.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.791+0000 7fc8a9b97640 1 -- 172.21.15.62:0/659987936 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94322224843344] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8940b4040 con 0x55c91ab432d0 2024-09-10T05:36:34.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.791+0000 7fc8ac8929c0 20 remove_watcher() i=6 2024-09-10T05:36:34.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.791+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94322224848288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c91ab49620 con 0x7fc89c07a060 2024-09-10T05:36:34.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.791+0000 7fc8aab99640 1 -- 172.21.15.62:0/659987936 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94322224848288] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8a400a4d0 con 0x7fc89c07a060 2024-09-10T05:36:34.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.791+0000 7fc8ac8929c0 20 remove_watcher() i=7 2024-09-10T05:36:34.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.791+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55c91ab3faa0 msgr2=0x55c91ab41e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.791+0000 7fc8ac8929c0 1 --2- 172.21.15.62:0/659987936 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55c91ab3faa0 0x55c91ab41e90 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.791+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55c91ab3b620 msgr2=0x55c91ab3dab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.791+0000 7fc8ac8929c0 1 --2- 172.21.15.62:0/659987936 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55c91ab3b620 0x55c91ab3dab0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.791+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fc89c07a060 msgr2=0x7fc89c053160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.791+0000 7fc8ac8929c0 1 --2- 172.21.15.62:0/659987936 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fc89c07a060 0x7fc89c053160 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.791+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55c91ab432d0 msgr2=0x55c91ab456c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.791+0000 7fc8ac8929c0 1 --2- 172.21.15.62:0/659987936 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55c91ab432d0 0x55c91ab456c0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.791+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc774039a20 msgr2=0x7fc77403bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.791+0000 7fc8ac8929c0 1 --2- 172.21.15.62:0/659987936 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc774039a20 0x7fc77403bee0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc8940af040 tx=0x7fc8940a8000 comp rx=0 tx=0).stop 2024-09-10T05:36:34.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.791+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91aa08bb0 msgr2=0x55c91ab30690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.791+0000 7fc8aab99640 1 -- 172.21.15.62:0/659987936 reap_dead start 2024-09-10T05:36:34.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.791+0000 7fc8ac8929c0 1 --2- 172.21.15.62:0/659987936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91aa08bb0 0x55c91ab30690 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc89c0187e0 tx=0x7fc89c051ef0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.791+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 shutdown_connections 2024-09-10T05:36:34.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.791+0000 7fc8ac8929c0 1 --2- 172.21.15.62:0/659987936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91aa08bb0 0x55c91ab30690 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.791+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 >> 172.21.15.62:0/659987936 conn(0x55c91ab235b0 msgr2=0x55c91ab217c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:34.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.791+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 shutdown_connections 2024-09-10T05:36:34.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.791+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/659987936 wait complete. 2024-09-10T05:36:34.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.791+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/3772299274 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc784039a60 msgr2=0x7fc78403bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.791+0000 7fc8ac8929c0 1 --2- 172.21.15.62:0/3772299274 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc784039a60 0x7fc78403bf20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x55c91ab048f0 tx=0x7fc894005ad0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.791+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/3772299274 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91ab1ab50 msgr2=0x55c91ab1af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.791+0000 7fc8ac8929c0 1 --2- 172.21.15.62:0/3772299274 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91ab1ab50 0x55c91ab1af70 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc89c01cfd0 tx=0x7fc89c01beb0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.791+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/3772299274 shutdown_connections 2024-09-10T05:36:34.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.791+0000 7fc8ac8929c0 1 --2- 172.21.15.62:0/3772299274 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc784039a60 0x7fc78403bf20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.791+0000 7fc8ac8929c0 1 --2- 172.21.15.62:0/3772299274 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91ab1ab50 0x55c91ab1af70 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.791+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/3772299274 >> 172.21.15.62:0/3772299274 conn(0x55c91ab10500 msgr2=0x55c91ab108e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:34.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.791+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/3772299274 shutdown_connections 2024-09-10T05:36:34.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.791+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/3772299274 wait complete. 2024-09-10T05:36:34.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.791+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/1706913217 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55c91ab05050 msgr2=0x55c91ab07510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.791+0000 7fc8ac8929c0 1 --2- 172.21.15.62:0/1706913217 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55c91ab05050 0x55c91ab07510 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.791+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/1706913217 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55c91aa0e310 msgr2=0x55c91ab04010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.791+0000 7fc8ac8929c0 1 --2- 172.21.15.62:0/1706913217 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55c91aa0e310 0x55c91ab04010 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.791+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/1706913217 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55c91ab09a40 msgr2=0x55c91ab0be30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.791+0000 7fc8ac8929c0 1 --2- 172.21.15.62:0/1706913217 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55c91ab09a40 0x55c91ab0be30 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.791+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/1706913217 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc790039a70 msgr2=0x7fc79003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.791+0000 7fc8ac8929c0 1 --2- 172.21.15.62:0/1706913217 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc790039a70 0x7fc79003bf30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc8940ae000 tx=0x7fc8940a6000 comp rx=0 tx=0).stop 2024-09-10T05:36:34.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.791+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/1706913217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91a97e240 msgr2=0x55c91aafcea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.791+0000 7fc8ac8929c0 1 --2- 172.21.15.62:0/1706913217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91a97e240 0x55c91aafcea0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x55c91aaf6790 tx=0x7fc89c000ee0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.791+0000 7fc8aab99640 1 -- 172.21.15.62:0/1706913217 reap_dead start 2024-09-10T05:36:34.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.791+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/1706913217 shutdown_connections 2024-09-10T05:36:34.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.791+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/1706913217 >> 172.21.15.62:0/1706913217 conn(0x55c91aa04920 msgr2=0x55c91aaefed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:34.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.791+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/1706913217 shutdown_connections 2024-09-10T05:36:34.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.791+0000 7fc8ac8929c0 1 -- 172.21.15.62:0/1706913217 wait complete. 2024-09-10T05:36:34.805 INFO:teuthology.orchestra.run.smithi062.stdout:["myfoo"] 2024-09-10T05:36:34.805 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-10T05:36:34.808 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T05:36:34.808 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-10T05:36:34.809 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-10T05:36:34.809 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-10T05:36:34.876 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:34.876 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:34.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.875+0000 7fbca6a499c0 1 Processor -- start 2024-09-10T05:36:34.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.875+0000 7fbca6a499c0 1 -- start start 2024-09-10T05:36:34.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.875+0000 7fbca6a499c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5595baf62320 0x5595baf64710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.875+0000 7fbca6a499c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5595bae129c0 con 0x5595baed21d0 2024-09-10T05:36:34.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.875+0000 7fbca6a499c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x5595bae626d0 con 0x5595baf62320 2024-09-10T05:36:34.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.875+0000 7fbca3d4e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5595baf62320 0x5595baf64710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.875+0000 7fbca454f640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x5595baed21d0 0x5595baf60c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:53010/0 (socket says 172.21.15.62:53010) 2024-09-10T05:36:34.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.875+0000 7fbca3d4e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5595baf62320 0x5595baf64710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:46880/0 (socket says 172.21.15.62:46880) 2024-09-10T05:36:34.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.875+0000 7fbca454f640 1 -- 172.21.15.62:0/2060714346 learned_addr learned my addr 172.21.15.62:0/2060714346 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-10T05:36:34.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.875+0000 7fbca3d4e640 1 -- 172.21.15.62:0/2060714346 >> v1:172.21.15.2:6789/0 conn(0x5595baed21d0 legacy=0x5595baf60c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.875+0000 7fbca3d4e640 1 -- 172.21.15.62:0/2060714346 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595bae06ca0 con 0x5595baf62320 2024-09-10T05:36:34.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.879+0000 7fbca3d4e640 1 --2- 172.21.15.62:0/2060714346 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595baf62320 0x5595baf64710 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fbc9800a480 tx=0x7fbc9801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b04fea3bdc19fe7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.879+0000 7fbca354d640 1 -- 172.21.15.62:0/2060714346 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc980af070 con 0x5595baf62320 2024-09-10T05:36:34.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.879+0000 7fbca354d640 1 -- 172.21.15.62:0/2060714346 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc980aa530 con 0x5595baf62320 2024-09-10T05:36:34.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.879+0000 7fbca354d640 1 -- 172.21.15.62:0/2060714346 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc980aa830 con 0x5595baf62320 2024-09-10T05:36:34.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.879+0000 7fbca6a499c0 1 -- 172.21.15.62:0/2060714346 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595baf62320 msgr2=0x5595baf64710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.879+0000 7fbca6a499c0 1 --2- 172.21.15.62:0/2060714346 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595baf62320 0x5595baf64710 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fbc9800a480 tx=0x7fbc9801b280 comp rx=0 tx=0).stop 2024-09-10T05:36:34.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.879+0000 7fbca6a499c0 1 -- 172.21.15.62:0/2060714346 shutdown_connections 2024-09-10T05:36:34.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.879+0000 7fbca6a499c0 1 --2- 172.21.15.62:0/2060714346 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595baf62320 0x5595baf64710 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.879+0000 7fbca6a499c0 1 -- 172.21.15.62:0/2060714346 >> 172.21.15.62:0/2060714346 conn(0x5595baf588f0 msgr2=0x5595baf5ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:34.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.879+0000 7fbca6a499c0 1 -- 172.21.15.62:0/2060714346 shutdown_connections 2024-09-10T05:36:34.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.879+0000 7fbca6a499c0 1 -- 172.21.15.62:0/2060714346 wait complete. 2024-09-10T05:36:34.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.891+0000 7fbca6a499c0 1 Processor -- start 2024-09-10T05:36:34.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.891+0000 7fbca6a499c0 1 -- start start 2024-09-10T05:36:34.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.891+0000 7fbca6a499c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595baed21d0 0x5595bb0497d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.891+0000 7fbca6a499c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5595bae66680 con 0x5595baed21d0 2024-09-10T05:36:34.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.891+0000 7fbca454f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595baed21d0 0x5595bb0497d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.891+0000 7fbca454f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595baed21d0 0x5595bb0497d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:46892/0 (socket says 172.21.15.62:46892) 2024-09-10T05:36:34.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.891+0000 7fbca454f640 1 -- 172.21.15.62:0/2185633684 learned_addr learned my addr 172.21.15.62:0/2185633684 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:34.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.891+0000 7fbca454f640 1 -- 172.21.15.62:0/2185633684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595bade1da0 con 0x5595baed21d0 2024-09-10T05:36:34.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.891+0000 7fbca454f640 1 --2- 172.21.15.62:0/2185633684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595baed21d0 0x5595bb0497d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fbc94001e50 tx=0x7fbc94001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=498fad27c92495f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.891+0000 7fbb9260c640 1 -- 172.21.15.62:0/2185633684 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc94012020 con 0x5595baed21d0 2024-09-10T05:36:34.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.891+0000 7fbb9260c640 1 -- 172.21.15.62:0/2185633684 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc9400e7c0 con 0x5595baed21d0 2024-09-10T05:36:34.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.891+0000 7fbb9260c640 1 -- 172.21.15.62:0/2185633684 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc9400eaa0 con 0x5595baed21d0 2024-09-10T05:36:34.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.895+0000 7fbca6a499c0 1 -- 172.21.15.62:0/2185633684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595baed21d0 msgr2=0x5595bb0497d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.895+0000 7fbca6a499c0 1 --2- 172.21.15.62:0/2185633684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595baed21d0 0x5595bb0497d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fbc94001e50 tx=0x7fbc94001e80 comp rx=0 tx=0).stop 2024-09-10T05:36:34.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.895+0000 7fbca6a499c0 1 -- 172.21.15.62:0/2185633684 shutdown_connections 2024-09-10T05:36:34.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.895+0000 7fbca6a499c0 1 --2- 172.21.15.62:0/2185633684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595baed21d0 0x5595bb0497d0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.895+0000 7fbca6a499c0 1 -- 172.21.15.62:0/2185633684 >> 172.21.15.62:0/2185633684 conn(0x5595baf588f0 msgr2=0x5595bb045410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:34.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.895+0000 7fbca6a499c0 1 -- 172.21.15.62:0/2185633684 shutdown_connections 2024-09-10T05:36:34.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.895+0000 7fbca6a499c0 1 -- 172.21.15.62:0/2185633684 wait complete. 2024-09-10T05:36:34.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.895+0000 7fbca6a499c0 1 Processor -- start 2024-09-10T05:36:34.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.895+0000 7fbca6a499c0 1 -- start start 2024-09-10T05:36:34.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.895+0000 7fbca6a499c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595baed21d0 0x5595bb050ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.895+0000 7fbca6a499c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5595bae08a50 con 0x5595baed21d0 2024-09-10T05:36:34.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.895+0000 7fbca454f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595baed21d0 0x5595bb050ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.895+0000 7fbca454f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595baed21d0 0x5595bb050ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:46900/0 (socket says 172.21.15.62:46900) 2024-09-10T05:36:34.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.895+0000 7fbca454f640 1 -- 172.21.15.62:0/3195298467 learned_addr learned my addr 172.21.15.62:0/3195298467 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:34.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.895+0000 7fbca454f640 1 -- 172.21.15.62:0/3195298467 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595bb051400 con 0x5595baed21d0 2024-09-10T05:36:34.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.895+0000 7fbca454f640 1 --2- 172.21.15.62:0/3195298467 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595baed21d0 0x5595bb050ea0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x5595bb04a760 tx=0x7fbc94000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.895+0000 7fbb90e09640 1 -- 172.21.15.62:0/3195298467 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc94012030 con 0x5595baed21d0 2024-09-10T05:36:34.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.895+0000 7fbb90e09640 1 -- 172.21.15.62:0/3195298467 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc9401a680 con 0x5595baed21d0 2024-09-10T05:36:34.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.895+0000 7fbb90e09640 1 -- 172.21.15.62:0/3195298467 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc9401a980 con 0x5595baed21d0 2024-09-10T05:36:34.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.895+0000 7fbca6a499c0 1 -- 172.21.15.62:0/3195298467 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5595bb051690 con 0x5595baed21d0 2024-09-10T05:36:34.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.895+0000 7fbca6a499c0 1 -- 172.21.15.62:0/3195298467 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595bb052040 con 0x5595baed21d0 2024-09-10T05:36:34.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.899+0000 7fbb90e09640 1 -- 172.21.15.62:0/3195298467 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fbc94015020 con 0x5595baed21d0 2024-09-10T05:36:34.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.899+0000 7fbb90e09640 1 --2- 172.21.15.62:0/3195298467 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fbb8c039ac0 0x7fbb8c03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.899+0000 7fbb90e09640 1 -- 172.21.15.62:0/3195298467 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fbc94020070 con 0x5595baed21d0 2024-09-10T05:36:34.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.899+0000 7fbca3d4e640 1 --2- 172.21.15.62:0/3195298467 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fbb8c039ac0 0x7fbb8c03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.899+0000 7fbca6a499c0 1 --2- 172.21.15.62:0/3195298467 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5595baf62320 0x5595bb058010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.899+0000 7fbca6a499c0 1 -- 172.21.15.62:0/3195298467 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5595bb058550 con 0x5595baf62320 2024-09-10T05:36:34.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.899+0000 7fbca4d50640 1 --2- 172.21.15.62:0/3195298467 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5595baf62320 0x5595bb058010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.899+0000 7fbca3d4e640 1 --2- 172.21.15.62:0/3195298467 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fbb8c039ac0 0x7fbb8c03bf80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbc980ac000 tx=0x7fbc980a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.899+0000 7fbca4d50640 1 --2- 172.21.15.62:0/3195298467 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5595baf62320 0x5595bb058010 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.899+0000 7fbca4d50640 1 -- 172.21.15.62:0/3195298467 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc9c00a4d0 con 0x5595baf62320 2024-09-10T05:36:34.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.899+0000 7fbca6a499c0 1 --2- 172.21.15.62:0/3195298467 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5595bb058fc0 0x5595bb05b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.899+0000 7fbca6a499c0 1 -- 172.21.15.62:0/3195298467 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5595bb05bbd0 con 0x5595bb058fc0 2024-09-10T05:36:34.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.899+0000 7fbca454f640 1 --2- 172.21.15.62:0/3195298467 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5595bb058fc0 0x5595bb05b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.899+0000 7fbca454f640 1 --2- 172.21.15.62:0/3195298467 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5595bb058fc0 0x5595bb05b460 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.899+0000 7fbca454f640 1 -- 172.21.15.62:0/3195298467 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbc94008030 con 0x5595bb058fc0 2024-09-10T05:36:34.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.899+0000 7fbca6a499c0 1 --2- 172.21.15.62:0/3195298467 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5595bb05d990 0x5595bb05fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.899+0000 7fbca6a499c0 1 -- 172.21.15.62:0/3195298467 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5595bb060470 con 0x5595bb05d990 2024-09-10T05:36:34.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.899+0000 7fbca3d4e640 1 --2- 172.21.15.62:0/3195298467 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5595bb05d990 0x5595bb05fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.899+0000 7fbca3d4e640 1 --2- 172.21.15.62:0/3195298467 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5595bb05d990 0x5595bb05fd80 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.899+0000 7fbca3d4e640 1 -- 172.21.15.62:0/3195298467 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbc980a8070 con 0x5595bb05d990 2024-09-10T05:36:34.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.899+0000 7fbca6a499c0 1 -- 172.21.15.62:0/3195298467 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5595bb05c830 con 0x5595bb058fc0 2024-09-10T05:36:34.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.903+0000 7fbca454f640 1 -- 172.21.15.62:0/3195298467 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbc94008030 con 0x5595bb058fc0 2024-09-10T05:36:34.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.903+0000 7fbca6a499c0 1 -- 172.21.15.62:0/3195298467 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5595bb05ccd0 con 0x5595bb05d990 2024-09-10T05:36:34.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.903+0000 7fbca3d4e640 1 -- 172.21.15.62:0/3195298467 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbc980a8070 con 0x5595bb05d990 2024-09-10T05:36:34.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.903+0000 7fbca6a499c0 1 Processor -- start 2024-09-10T05:36:34.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.903+0000 7fbca6a499c0 1 -- start start 2024-09-10T05:36:34.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.903+0000 7fbca6a499c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595bb06eac0 0x5595bb06eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.903+0000 7fbca6a499c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5595bae73450 con 0x5595bb06eac0 2024-09-10T05:36:34.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.903+0000 7fbca454f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595bb06eac0 0x5595bb06eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.903+0000 7fbca454f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595bb06eac0 0x5595bb06eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:46914/0 (socket says 172.21.15.62:46914) 2024-09-10T05:36:34.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.903+0000 7fbca454f640 1 -- 172.21.15.62:0/3483193074 learned_addr learned my addr 172.21.15.62:0/3483193074 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:34.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.903+0000 7fbca454f640 1 -- 172.21.15.62:0/3483193074 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595bb06f520 con 0x5595bb06eac0 2024-09-10T05:36:34.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.903+0000 7fbca454f640 1 --2- 172.21.15.62:0/3483193074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595bb06eac0 0x5595bb06eee0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fbc9404eca0 tx=0x7fbc94018f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.903+0000 7fbb89ffb640 1 -- 172.21.15.62:0/3483193074 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc94016b00 con 0x5595bb06eac0 2024-09-10T05:36:34.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.903+0000 7fbca6a499c0 1 -- 172.21.15.62:0/3483193074 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5595bb06fd80 con 0x5595bb06eac0 2024-09-10T05:36:34.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.903+0000 7fbb89ffb640 1 -- 172.21.15.62:0/3483193074 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc94016ca0 con 0x5595bb06eac0 2024-09-10T05:36:34.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.903+0000 7fbb89ffb640 1 -- 172.21.15.62:0/3483193074 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc94016570 con 0x5595bb06eac0 2024-09-10T05:36:34.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.903+0000 7fbca6a499c0 1 -- 172.21.15.62:0/3483193074 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595bb0702f0 con 0x5595bb06eac0 2024-09-10T05:36:34.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.907+0000 7fbb89ffb640 1 -- 172.21.15.62:0/3483193074 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fbc94009070 con 0x5595bb06eac0 2024-09-10T05:36:34.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.907+0000 7fbb89ffb640 1 --2- 172.21.15.62:0/3483193074 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fbb7c039a70 0x7fbb7c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.907+0000 7fbb89ffb640 1 -- 172.21.15.62:0/3483193074 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fbc94005050 con 0x5595bb06eac0 2024-09-10T05:36:34.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.907+0000 7fbca3d4e640 1 --2- 172.21.15.62:0/3483193074 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fbb7c039a70 0x7fbb7c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.907+0000 7fbca6a499c0 1 Processor -- start 2024-09-10T05:36:34.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.907+0000 7fbca6a499c0 1 -- start start 2024-09-10T05:36:34.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.907+0000 7fbca6a499c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595baf5cbc0 0x5595baf5cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.907+0000 7fbca6a499c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5595bb04a020 con 0x5595baf5cbc0 2024-09-10T05:36:34.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.907+0000 7fbca3d4e640 1 --2- 172.21.15.62:0/3483193074 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fbb7c039a70 0x7fbb7c03bf30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x5595bb05c800 tx=0x7fbc98005a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.907+0000 7fbca454f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595baf5cbc0 0x5595baf5cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.907+0000 7fbca454f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595baf5cbc0 0x5595baf5cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:46918/0 (socket says 172.21.15.62:46918) 2024-09-10T05:36:34.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.907+0000 7fbca454f640 1 -- 172.21.15.62:0/81548254 learned_addr learned my addr 172.21.15.62:0/81548254 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:34.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.907+0000 7fbca454f640 1 -- 172.21.15.62:0/81548254 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595baf5d500 con 0x5595baf5cbc0 2024-09-10T05:36:34.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.907+0000 7fbca454f640 1 --2- 172.21.15.62:0/81548254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595baf5cbc0 0x5595baf5cfc0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fbc9402c890 tx=0x7fbc94024750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d299b3e687805ca4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.907+0000 7fbb837fe640 1 -- 172.21.15.62:0/81548254 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc94060070 con 0x5595baf5cbc0 2024-09-10T05:36:34.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.907+0000 7fbb837fe640 1 -- 172.21.15.62:0/81548254 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc940503f0 con 0x5595baf5cbc0 2024-09-10T05:36:34.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.907+0000 7fbb837fe640 1 -- 172.21.15.62:0/81548254 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc94057040 con 0x5595baf5cbc0 2024-09-10T05:36:34.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.907+0000 7fbca6a499c0 1 -- 172.21.15.62:0/81548254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595baf5cbc0 msgr2=0x5595baf5cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.907+0000 7fbca6a499c0 1 --2- 172.21.15.62:0/81548254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595baf5cbc0 0x5595baf5cfc0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fbc9402c890 tx=0x7fbc94024750 comp rx=0 tx=0).stop 2024-09-10T05:36:34.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.907+0000 7fbca6a499c0 1 -- 172.21.15.62:0/81548254 shutdown_connections 2024-09-10T05:36:34.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.907+0000 7fbca6a499c0 1 --2- 172.21.15.62:0/81548254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595baf5cbc0 0x5595baf5cfc0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.907+0000 7fbca6a499c0 1 -- 172.21.15.62:0/81548254 >> 172.21.15.62:0/81548254 conn(0x5595bb077650 msgr2=0x5595bb075890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:34.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.907+0000 7fbca6a499c0 1 -- 172.21.15.62:0/81548254 shutdown_connections 2024-09-10T05:36:34.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.907+0000 7fbca6a499c0 1 -- 172.21.15.62:0/81548254 wait complete. 2024-09-10T05:36:34.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.907+0000 7fbca6a499c0 1 Processor -- start 2024-09-10T05:36:34.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.907+0000 7fbca6a499c0 1 -- start start 2024-09-10T05:36:34.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.907+0000 7fbca6a499c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595baf5cbc0 0x5595bb0847d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.907+0000 7fbca6a499c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5595baf5dad0 con 0x5595baf5cbc0 2024-09-10T05:36:34.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.907+0000 7fbca454f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595baf5cbc0 0x5595bb0847d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.907+0000 7fbca454f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595baf5cbc0 0x5595bb0847d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:46932/0 (socket says 172.21.15.62:46932) 2024-09-10T05:36:34.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.907+0000 7fbca454f640 1 -- 172.21.15.62:0/1965469860 learned_addr learned my addr 172.21.15.62:0/1965469860 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:34.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.907+0000 7fbca454f640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595bb084d30 con 0x5595baf5cbc0 2024-09-10T05:36:34.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.911+0000 7fbca454f640 1 --2- 172.21.15.62:0/1965469860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595baf5cbc0 0x5595bb0847d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fbc9404c770 tx=0x7fbc94010ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.911+0000 7fbb81ffb640 1 -- 172.21.15.62:0/1965469860 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc94069020 con 0x5595baf5cbc0 2024-09-10T05:36:34.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.911+0000 7fbca6a499c0 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5595bb084d30 con 0x5595baf5cbc0 2024-09-10T05:36:34.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.911+0000 7fbca6a499c0 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595bb085300 con 0x5595baf5cbc0 2024-09-10T05:36:34.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.911+0000 7fbb81ffb640 1 -- 172.21.15.62:0/1965469860 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc9403c2b0 con 0x5595baf5cbc0 2024-09-10T05:36:34.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.911+0000 7fbb81ffb640 1 -- 172.21.15.62:0/1965469860 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc94060040 con 0x5595baf5cbc0 2024-09-10T05:36:34.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.911+0000 7fbca6a499c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.911+0000 7fbb81ffb640 1 -- 172.21.15.62:0/1965469860 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fbc9406c020 con 0x5595baf5cbc0 2024-09-10T05:36:34.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.911+0000 7fbb81ffb640 1 --2- 172.21.15.62:0/1965469860 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fbb740399d0 0x7fbb7403be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.911+0000 7fbb81ffb640 1 -- 172.21.15.62:0/1965469860 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fbc94053160 con 0x5595baf5cbc0 2024-09-10T05:36:34.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.911+0000 7fbca3d4e640 1 --2- 172.21.15.62:0/1965469860 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fbb740399d0 0x7fbb7403be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.911+0000 7fbca6a499c0 1 --2- 172.21.15.62:0/1965469860 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5595bb08f6d0 0x5595bb091b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.911+0000 7fbca6a499c0 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5595bb0922b0 con 0x5595bb08f6d0 2024-09-10T05:36:34.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.911+0000 7fbca4d50640 1 --2- 172.21.15.62:0/1965469860 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5595bb08f6d0 0x5595bb091b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.911+0000 7fbca3d4e640 1 --2- 172.21.15.62:0/1965469860 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fbb740399d0 0x7fbb7403be90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x5595bb052f70 tx=0x7fbc980a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.911+0000 7fbca4d50640 1 --2- 172.21.15.62:0/1965469860 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5595bb08f6d0 0x5595bb091b60 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.911+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc9c00a4d0 con 0x5595bb08f6d0 2024-09-10T05:36:34.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.911+0000 7fbca6a499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:34.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.911+0000 7fbca6a499c0 20 realm 2024-09-10T05:36:34.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.911+0000 7fbca6a499c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.911+0000 7fbca6a499c0 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5595bb08ea60 con 0x5595bb08f6d0 2024-09-10T05:36:34.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.911+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc9c00a4d0 con 0x5595bb08f6d0 2024-09-10T05:36:34.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.911+0000 7fbca6a499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:34.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.911+0000 7fbca6a499c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:34.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.911+0000 7fbca6a499c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.911+0000 7fbca6a499c0 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5595bb092d70 con 0x5595bb08f6d0 2024-09-10T05:36:34.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.911+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc9c00a4d0 con 0x5595bb08f6d0 2024-09-10T05:36:34.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.911+0000 7fbca6a499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:34.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.911+0000 7fbca6a499c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.911+0000 7fbca6a499c0 1 --2- 172.21.15.62:0/1965469860 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5595bb093b50 0x5595bb095f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.911+0000 7fbca6a499c0 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5595bb0965f0 con 0x5595bb093b50 2024-09-10T05:36:34.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.911+0000 7fbca454f640 1 --2- 172.21.15.62:0/1965469860 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5595bb093b50 0x5595bb095f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.915+0000 7fbca454f640 1 --2- 172.21.15.62:0/1965469860 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5595bb093b50 0x5595bb095f40 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.915+0000 7fbca454f640 1 -- 172.21.15.62:0/1965469860 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbc94063040 con 0x5595bb093b50 2024-09-10T05:36:34.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.915+0000 7fbca6a499c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:34.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.915+0000 7fbca6a499c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.915+0000 7fbca6a499c0 1 --2- 172.21.15.62:0/1965469860 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5595bb0973a0 0x5595bb099790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.915+0000 7fbca6a499c0 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5595bb099de0 con 0x5595bb0973a0 2024-09-10T05:36:34.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.915+0000 7fbca3d4e640 1 --2- 172.21.15.62:0/1965469860 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5595bb0973a0 0x5595bb099790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.915+0000 7fbca3d4e640 1 --2- 172.21.15.62:0/1965469860 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5595bb0973a0 0x5595bb099790 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.915+0000 7fbca3d4e640 1 -- 172.21.15.62:0/1965469860 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbc980a8070 con 0x5595bb0973a0 2024-09-10T05:36:34.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.915+0000 7fbca6a499c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:34.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.915+0000 7fbca6a499c0 20 searching for the correct realm 2024-09-10T05:36:34.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.915+0000 7fbca6a499c0 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09b6b0 con 0x5595bb0973a0 2024-09-10T05:36:34.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.915+0000 7fbca3d4e640 1 -- 172.21.15.62:0/1965469860 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc980a8070 con 0x5595bb0973a0 2024-09-10T05:36:34.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.915+0000 7fbca3d4e640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09b6b0 con 0x5595bb093b50 2024-09-10T05:36:34.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.915+0000 7fbca454f640 1 -- 172.21.15.62:0/1965469860 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc94063040 con 0x5595bb093b50 2024-09-10T05:36:34.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.915+0000 7fbca454f640 1 --2- 172.21.15.62:0/1965469860 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fbc94077040 0x7fbc94023a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:34.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.915+0000 7fbca454f640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09b6b0 con 0x7fbc94077040 2024-09-10T05:36:34.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.915+0000 7fbca4d50640 1 --2- 172.21.15.62:0/1965469860 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fbc94077040 0x7fbc94023a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:34.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.915+0000 7fbca4d50640 1 --2- 172.21.15.62:0/1965469860 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fbc94077040 0x7fbc94023a60 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:34.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.915+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc9c00a4d0 con 0x7fbc94077040 2024-09-10T05:36:34.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.915+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09b6b0 con 0x5595bb08f6d0 2024-09-10T05:36:34.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.915+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc9c00a4d0 con 0x5595bb08f6d0 2024-09-10T05:36:34.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.915+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09b6b0 con 0x5595bb08f6d0 2024-09-10T05:36:34.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.915+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc9c00a4d0 con 0x5595bb08f6d0 2024-09-10T05:36:34.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.915+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09b6b0 con 0x5595bb0973a0 2024-09-10T05:36:34.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.915+0000 7fbca3d4e640 1 -- 172.21.15.62:0/1965469860 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc980a8070 con 0x5595bb0973a0 2024-09-10T05:36:34.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.915+0000 7fbca3d4e640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09b6b0 con 0x5595bb08f6d0 2024-09-10T05:36:34.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.919+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc9c00a4d0 con 0x5595bb08f6d0 2024-09-10T05:36:34.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.919+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09b6b0 con 0x5595bb093b50 2024-09-10T05:36:34.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.919+0000 7fbca454f640 1 -- 172.21.15.62:0/1965469860 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc94063040 con 0x5595bb093b50 2024-09-10T05:36:34.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.919+0000 7fbca454f640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09b6b0 con 0x5595bb093b50 2024-09-10T05:36:34.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.919+0000 7fbca454f640 1 -- 172.21.15.62:0/1965469860 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc94063040 con 0x5595bb093b50 2024-09-10T05:36:34.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.919+0000 7fbca454f640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09b6b0 con 0x5595bb08f6d0 2024-09-10T05:36:34.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.919+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc9c00a4d0 con 0x5595bb08f6d0 2024-09-10T05:36:34.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.919+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09b6b0 con 0x7fbc94077040 2024-09-10T05:36:34.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.919+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc9c00a4d0 con 0x7fbc94077040 2024-09-10T05:36:34.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.919+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09b6b0 con 0x5595bb08f6d0 2024-09-10T05:36:34.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.919+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc9c00a4d0 con 0x5595bb08f6d0 2024-09-10T05:36:34.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.919+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09b6b0 con 0x7fbc94077040 2024-09-10T05:36:34.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.919+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbc9c00a4d0 con 0x7fbc94077040 2024-09-10T05:36:34.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.919+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09b6b0 con 0x5595bb093b50 2024-09-10T05:36:34.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.919+0000 7fbca454f640 1 -- 172.21.15.62:0/1965469860 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc94063040 con 0x5595bb093b50 2024-09-10T05:36:34.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.919+0000 7fbca454f640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09b6b0 con 0x5595bb0973a0 2024-09-10T05:36:34.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.919+0000 7fbca3d4e640 1 -- 172.21.15.62:0/1965469860 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc980a8070 con 0x5595bb0973a0 2024-09-10T05:36:34.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.919+0000 7fbca3d4e640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09b6b0 con 0x5595bb08f6d0 2024-09-10T05:36:34.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.919+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc9c00a4d0 con 0x5595bb08f6d0 2024-09-10T05:36:34.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.919+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09b6b0 con 0x5595bb093b50 2024-09-10T05:36:34.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.923+0000 7fbca454f640 1 -- 172.21.15.62:0/1965469860 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc94063040 con 0x5595bb093b50 2024-09-10T05:36:34.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.923+0000 7fbca454f640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09b6b0 con 0x5595bb0973a0 2024-09-10T05:36:34.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.923+0000 7fbca3d4e640 1 -- 172.21.15.62:0/1965469860 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 30 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7fbc980a8070 con 0x5595bb0973a0 2024-09-10T05:36:34.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.923+0000 7fbca3d4e640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09b6b0 con 0x5595bb08f6d0 2024-09-10T05:36:34.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.923+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc9c00a4d0 con 0x5595bb08f6d0 2024-09-10T05:36:34.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.923+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09b6b0 con 0x5595bb08f6d0 2024-09-10T05:36:34.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.923+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbc9c00a4d0 con 0x5595bb08f6d0 2024-09-10T05:36:34.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.923+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09b6b0 con 0x5595bb08f6d0 2024-09-10T05:36:34.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.923+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc9c00a4d0 con 0x5595bb08f6d0 2024-09-10T05:36:34.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.923+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09b6b0 con 0x5595bb0973a0 2024-09-10T05:36:34.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.923+0000 7fbca3d4e640 1 -- 172.21.15.62:0/1965469860 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc980a8070 con 0x5595bb0973a0 2024-09-10T05:36:34.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.923+0000 7fbca3d4e640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09b6b0 con 0x7fbc94077040 2024-09-10T05:36:34.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.923+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc9c00a4d0 con 0x7fbc94077040 2024-09-10T05:36:34.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.923+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09b6b0 con 0x5595bb08f6d0 2024-09-10T05:36:34.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.923+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc9c00a4d0 con 0x5595bb08f6d0 2024-09-10T05:36:34.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.923+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09b6b0 con 0x7fbc94077040 2024-09-10T05:36:34.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.923+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc9c00a4d0 con 0x7fbc94077040 2024-09-10T05:36:34.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.923+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09b6b0 con 0x5595bb0973a0 2024-09-10T05:36:34.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.923+0000 7fbca3d4e640 1 -- 172.21.15.62:0/1965469860 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc980a8070 con 0x5595bb0973a0 2024-09-10T05:36:34.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.923+0000 7fbca3d4e640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09b6b0 con 0x7fbc94077040 2024-09-10T05:36:34.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.923+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc9c00a4d0 con 0x7fbc94077040 2024-09-10T05:36:34.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.923+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09b6b0 con 0x5595bb093b50 2024-09-10T05:36:34.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.923+0000 7fbca454f640 1 -- 172.21.15.62:0/1965469860 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc94063040 con 0x5595bb093b50 2024-09-10T05:36:34.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.923+0000 7fbca454f640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09b6b0 con 0x5595bb093b50 2024-09-10T05:36:34.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.923+0000 7fbca454f640 1 -- 172.21.15.62:0/1965469860 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc94063040 con 0x5595bb093b50 2024-09-10T05:36:34.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.923+0000 7fbca454f640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09b6b0 con 0x5595bb0973a0 2024-09-10T05:36:34.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.927+0000 7fbca3d4e640 1 -- 172.21.15.62:0/1965469860 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc980a8070 con 0x5595bb0973a0 2024-09-10T05:36:34.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.927+0000 7fbca3d4e640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09b6b0 con 0x5595bb093b50 2024-09-10T05:36:34.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.927+0000 7fbca454f640 1 -- 172.21.15.62:0/1965469860 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbc94063040 con 0x5595bb093b50 2024-09-10T05:36:34.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.927+0000 7fbca454f640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09b6b0 con 0x5595bb093b50 2024-09-10T05:36:34.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.927+0000 7fbca454f640 1 -- 172.21.15.62:0/1965469860 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc94063040 con 0x5595bb093b50 2024-09-10T05:36:34.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.927+0000 7fbca6a499c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:34.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.927+0000 7fbca6a499c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:34.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.927+0000 7fbca6a499c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:34.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.927+0000 7fbca6a499c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:34.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.927+0000 7fbca6a499c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:34.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.927+0000 7fbca6a499c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:34.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.927+0000 7fbca6a499c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.927+0000 7fbca6a499c0 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09a7d0 con 0x5595bb08f6d0 2024-09-10T05:36:34.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.927+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc9c00a4d0 con 0x5595bb08f6d0 2024-09-10T05:36:34.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.927+0000 7fbca6a499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:34.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.927+0000 7fbca6a499c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.927+0000 7fbca6a499c0 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09ac50 con 0x5595bb093b50 2024-09-10T05:36:34.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.927+0000 7fbca454f640 1 -- 172.21.15.62:0/1965469860 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbc94063040 con 0x5595bb093b50 2024-09-10T05:36:34.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.927+0000 7fbca6a499c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:34.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.927+0000 7fbca6a499c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.927+0000 7fbca6a499c0 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09ac50 con 0x5595bb0973a0 2024-09-10T05:36:34.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.927+0000 7fbca3d4e640 1 -- 172.21.15.62:0/1965469860 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbc980a8070 con 0x5595bb0973a0 2024-09-10T05:36:34.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.927+0000 7fbca6a499c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:34.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.927+0000 7fbca6a499c0 20 zone default found 2024-09-10T05:36:34.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.927+0000 7fbca6a499c0 4 Realm: () 2024-09-10T05:36:34.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.927+0000 7fbca6a499c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:34.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.927+0000 7fbca6a499c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:34.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.927+0000 7fbca6a499c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:34.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.927+0000 7fbca6a499c0 20 zonegroup default 2024-09-10T05:36:34.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.927+0000 7fbca6a499c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.927+0000 7fbca6a499c0 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09bb80 con 0x7fbc94077040 2024-09-10T05:36:34.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.927+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbc9c00a4d0 con 0x7fbc94077040 2024-09-10T05:36:34.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.927+0000 7fbca6a499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:34.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.927+0000 7fbca6a499c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.927+0000 7fbca6a499c0 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09da10 con 0x5595bb0973a0 2024-09-10T05:36:34.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.927+0000 7fbca3d4e640 1 -- 172.21.15.62:0/1965469860 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbc980a8070 con 0x5595bb0973a0 2024-09-10T05:36:34.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.927+0000 7fbca6a499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:34.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.927+0000 7fbca6a499c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:34.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.927+0000 7fbca6a499c0 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09de50 con 0x5595bb0973a0 2024-09-10T05:36:34.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.927+0000 7fbca3d4e640 1 -- 172.21.15.62:0/1965469860 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbc980a8070 con 0x5595bb0973a0 2024-09-10T05:36:34.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.927+0000 7fbca6a499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:34.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.927+0000 7fbca6a499c0 20 started sync module instance, tier type = 2024-09-10T05:36:34.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.927+0000 7fbca6a499c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:34.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.927+0000 7fbca6a499c0 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09cdb0 con 0x5595bb093b50 2024-09-10T05:36:34.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.931+0000 7fbca454f640 1 -- 172.21.15.62:0/1965469860 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc94063040 con 0x5595bb093b50 2024-09-10T05:36:34.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.931+0000 7fbca6a499c0 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94101576471248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09cdb0 con 0x5595bb093b50 2024-09-10T05:36:34.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.931+0000 7fbca6a499c0 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09e990 con 0x5595bb08f6d0 2024-09-10T05:36:34.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.931+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc9c00a4d0 con 0x5595bb08f6d0 2024-09-10T05:36:34.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.931+0000 7fbca6a499c0 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94101576475776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09f230 con 0x5595bb08f6d0 2024-09-10T05:36:34.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.931+0000 7fbca6a499c0 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09fc30 con 0x5595bb093b50 2024-09-10T05:36:34.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.931+0000 7fbca454f640 1 -- 172.21.15.62:0/1965469860 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94101576471248] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc94063040 con 0x5595bb093b50 2024-09-10T05:36:34.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.931+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94101576475776] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc9c00a4d0 con 0x5595bb08f6d0 2024-09-10T05:36:34.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.935+0000 7fbca454f640 1 -- 172.21.15.62:0/1965469860 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc94063040 con 0x5595bb093b50 2024-09-10T05:36:34.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.935+0000 7fbca6a499c0 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94101576468736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09ed80 con 0x5595bb093b50 2024-09-10T05:36:34.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.935+0000 7fbca6a499c0 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595bb0a04d0 con 0x7fbc94077040 2024-09-10T05:36:34.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.935+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc9c00a4d0 con 0x7fbc94077040 2024-09-10T05:36:34.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.935+0000 7fbca6a499c0 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94101576482848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09ed80 con 0x7fbc94077040 2024-09-10T05:36:34.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.935+0000 7fbca6a499c0 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595bb0a0f90 con 0x5595bb093b50 2024-09-10T05:36:34.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.935+0000 7fbca454f640 1 -- 172.21.15.62:0/1965469860 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94101576468736] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc94063040 con 0x5595bb093b50 2024-09-10T05:36:34.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.935+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94101576482848] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc9c00a4d0 con 0x7fbc94077040 2024-09-10T05:36:34.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.935+0000 7fbca454f640 1 -- 172.21.15.62:0/1965469860 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc94063040 con 0x5595bb093b50 2024-09-10T05:36:34.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.935+0000 7fbca6a499c0 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94101576483904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595bb0a0f50 con 0x5595bb093b50 2024-09-10T05:36:34.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.935+0000 7fbca6a499c0 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595bb0a1380 con 0x5595bb0973a0 2024-09-10T05:36:34.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.939+0000 7fbca3d4e640 1 -- 172.21.15.62:0/1965469860 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc980a8070 con 0x5595bb0973a0 2024-09-10T05:36:34.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.939+0000 7fbca6a499c0 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94101576480576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595bb0a1830 con 0x5595bb0973a0 2024-09-10T05:36:34.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.939+0000 7fbca6a499c0 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595bb0a2250 con 0x5595bb0973a0 2024-09-10T05:36:34.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.939+0000 7fbca454f640 1 -- 172.21.15.62:0/1965469860 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94101576483904] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc94063040 con 0x5595bb093b50 2024-09-10T05:36:34.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.939+0000 7fbca3d4e640 1 -- 172.21.15.62:0/1965469860 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94101576480576] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc980a8070 con 0x5595bb0973a0 2024-09-10T05:36:34.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.939+0000 7fbca3d4e640 1 -- 172.21.15.62:0/1965469860 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc980a8070 con 0x5595bb0973a0 2024-09-10T05:36:34.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.939+0000 7fbca6a499c0 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94101576490304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595bb0a1380 con 0x5595bb0973a0 2024-09-10T05:36:34.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.939+0000 7fbca6a499c0 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595bb0a2af0 con 0x7fbc94077040 2024-09-10T05:36:34.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.943+0000 7fbca3d4e640 1 -- 172.21.15.62:0/1965469860 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94101576490304] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc980a8070 con 0x5595bb0973a0 2024-09-10T05:36:34.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.943+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc9c00a4d0 con 0x7fbc94077040 2024-09-10T05:36:34.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.943+0000 7fbca6a499c0 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94101576485472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595bb0a1380 con 0x7fbc94077040 2024-09-10T05:36:34.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.943+0000 7fbca6a499c0 20 add_watcher() i=0 2024-09-10T05:36:34.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.943+0000 7fbca6a499c0 20 add_watcher() i=1 2024-09-10T05:36:34.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.943+0000 7fbca6a499c0 20 add_watcher() i=2 2024-09-10T05:36:34.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.943+0000 7fbca6a499c0 20 add_watcher() i=3 2024-09-10T05:36:34.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.943+0000 7fbca6a499c0 20 add_watcher() i=4 2024-09-10T05:36:34.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.943+0000 7fbca6a499c0 20 add_watcher() i=5 2024-09-10T05:36:34.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.943+0000 7fbca6a499c0 20 add_watcher() i=6 2024-09-10T05:36:34.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.943+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94101576485472] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc9c00a4d0 con 0x7fbc94077040 2024-09-10T05:36:34.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.943+0000 7fbca6a499c0 20 add_watcher() i=7 2024-09-10T05:36:34.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.943+0000 7fbca6a499c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:34.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.943+0000 7fbca6a499c0 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5595bb0a5bb0 con 0x5595bb08f6d0 2024-09-10T05:36:34.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.943+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbc9c00a4d0 con 0x5595bb08f6d0 2024-09-10T05:36:34.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.943+0000 7fbca6a499c0 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94101576492608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595bb0a3140 con 0x5595bb08f6d0 2024-09-10T05:36:34.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.943+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94101576492608] v30'100 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbc9c00a4d0 con 0x5595bb08f6d0 2024-09-10T05:36:34.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.943+0000 7fbb5a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:34.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.943+0000 7fbca6a499c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:34.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.943+0000 7fbca6a499c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:34.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.943+0000 7fbca6a499c0 5 note: GC not initialized 2024-09-10T05:36:34.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.947+0000 7fbb597e2640 20 reqs_thread_entry: start 2024-09-10T05:36:34.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.947+0000 7fbca6a499c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:34.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.947+0000 7fbca6a499c0 20 Filter name: none 2024-09-10T05:36:34.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.947+0000 7fbacaffd640 20 reqs_thread_entry: start 2024-09-10T05:36:34.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.947+0000 7fbca6a499c0 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595bb0c86e0 con 0x5595bb0973a0 2024-09-10T05:36:34.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.947+0000 7fbca3d4e640 1 -- 172.21.15.62:0/1965469860 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc980a8070 con 0x5595bb0973a0 2024-09-10T05:36:34.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.947+0000 7fbca3d4e640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09de50 con 0x5595bb093b50 2024-09-10T05:36:34.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.947+0000 7fbca454f640 1 -- 172.21.15.62:0/1965469860 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc94063040 con 0x5595bb093b50 2024-09-10T05:36:34.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.947+0000 7fbca454f640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09b6b0 con 0x5595bb08f6d0 2024-09-10T05:36:34.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.947+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v30'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc9c00a4d0 con 0x5595bb08f6d0 2024-09-10T05:36:34.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.947+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09e990 con 0x5595bb08f6d0 2024-09-10T05:36:34.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.947+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v30'11 uv11 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc9c00a4d0 con 0x5595bb08f6d0 2024-09-10T05:36:34.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.947+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09e990 con 0x7fbc94077040 2024-09-10T05:36:34.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.947+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc9c00a4d0 con 0x7fbc94077040 2024-09-10T05:36:34.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.947+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09e990 con 0x5595bb093b50 2024-09-10T05:36:34.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.947+0000 7fbca454f640 1 -- 172.21.15.62:0/1965469860 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc94063040 con 0x5595bb093b50 2024-09-10T05:36:34.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.947+0000 7fbca454f640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09e990 con 0x5595bb08f6d0 2024-09-10T05:36:34.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.947+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc9c00a4d0 con 0x5595bb08f6d0 2024-09-10T05:36:34.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.947+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09e990 con 0x5595bb0973a0 2024-09-10T05:36:34.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.947+0000 7fbca3d4e640 1 -- 172.21.15.62:0/1965469860 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc980a8070 con 0x5595bb0973a0 2024-09-10T05:36:34.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.947+0000 7fbca3d4e640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09e990 con 0x7fbc94077040 2024-09-10T05:36:34.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.947+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v30'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc9c00a4d0 con 0x7fbc94077040 2024-09-10T05:36:34.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.947+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09e990 con 0x5595bb093b50 2024-09-10T05:36:34.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.951+0000 7fbca454f640 1 -- 172.21.15.62:0/1965469860 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc94063040 con 0x5595bb093b50 2024-09-10T05:36:34.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.951+0000 7fbca454f640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09e990 con 0x5595bb08f6d0 2024-09-10T05:36:34.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.951+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc9c00a4d0 con 0x5595bb08f6d0 2024-09-10T05:36:34.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.951+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09e990 con 0x5595bb0973a0 2024-09-10T05:36:34.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.951+0000 7fbca3d4e640 1 -- 172.21.15.62:0/1965469860 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc980a8070 con 0x5595bb0973a0 2024-09-10T05:36:34.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.951+0000 7fbca3d4e640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09e990 con 0x5595bb08f6d0 2024-09-10T05:36:34.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.951+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 <== osd.1 v2:172.21.15.62:6808/3442097179 23 ==== osd_op_reply(74 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc9c00a4d0 con 0x5595bb08f6d0 2024-09-10T05:36:34.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.951+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09e990 con 0x5595bb0973a0 2024-09-10T05:36:34.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.951+0000 7fbca3d4e640 1 -- 172.21.15.62:0/1965469860 <== osd.3 v2:172.21.15.62:6816/2708991149 19 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc980a8070 con 0x5595bb0973a0 2024-09-10T05:36:34.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.951+0000 7fbca3d4e640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09e990 con 0x7fbc94077040 2024-09-10T05:36:34.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.951+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(76 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc9c00a4d0 con 0x7fbc94077040 2024-09-10T05:36:34.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.951+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09e990 con 0x5595bb0973a0 2024-09-10T05:36:34.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.951+0000 7fbca3d4e640 1 -- 172.21.15.62:0/1965469860 <== osd.3 v2:172.21.15.62:6816/2708991149 20 ==== osd_op_reply(77 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc980a8070 con 0x5595bb0973a0 2024-09-10T05:36:34.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.951+0000 7fbca3d4e640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09e990 con 0x5595bb08f6d0 2024-09-10T05:36:34.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.951+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 <== osd.1 v2:172.21.15.62:6808/3442097179 24 ==== osd_op_reply(78 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc9c00a4d0 con 0x5595bb08f6d0 2024-09-10T05:36:34.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.951+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09e990 con 0x5595bb093b50 2024-09-10T05:36:34.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.951+0000 7fbca454f640 1 -- 172.21.15.62:0/1965469860 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== osd_op_reply(79 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc94063040 con 0x5595bb093b50 2024-09-10T05:36:34.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.951+0000 7fbca454f640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09e990 con 0x7fbc94077040 2024-09-10T05:36:34.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.951+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 <== osd.2 v2:172.21.15.62:6800/2677868286 15 ==== osd_op_reply(80 [pgnls start_epoch 30 out=70b] v30'2 uv2 ondisk = 1) ==== 144+0+70 (crc 0 0 0) 0x7fbc9c00a4d0 con 0x7fbc94077040 2024-09-10T05:36:34.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.951+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fbc9c041040 con 0x5595bb093b50 2024-09-10T05:36:34.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.951+0000 7fbca454f640 1 -- 172.21.15.62:0/1965469860 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== osd_op_reply(81 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc94063040 con 0x5595bb093b50 2024-09-10T05:36:34.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.951+0000 7fbca454f640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fbc9c041040 con 0x5595bb08f6d0 2024-09-10T05:36:34.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.951+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 <== osd.1 v2:172.21.15.62:6808/3442097179 25 ==== osd_op_reply(82 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc9c00a4d0 con 0x5595bb08f6d0 2024-09-10T05:36:34.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.951+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fbc9c041040 con 0x5595bb0973a0 2024-09-10T05:36:34.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.955+0000 7fbca3d4e640 1 -- 172.21.15.62:0/1965469860 <== osd.3 v2:172.21.15.62:6816/2708991149 21 ==== osd_op_reply(83 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc980a8070 con 0x5595bb0973a0 2024-09-10T05:36:34.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.955+0000 7fbca3d4e640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fbc9c041040 con 0x7fbc94077040 2024-09-10T05:36:34.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.955+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 <== osd.2 v2:172.21.15.62:6800/2677868286 16 ==== osd_op_reply(84 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc9c00a4d0 con 0x7fbc94077040 2024-09-10T05:36:34.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.955+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fbc9c041040 con 0x5595bb08f6d0 2024-09-10T05:36:34.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.955+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 <== osd.1 v2:172.21.15.62:6808/3442097179 26 ==== osd_op_reply(85 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc9c00a4d0 con 0x5595bb08f6d0 2024-09-10T05:36:34.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.955+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fbc9c041040 con 0x5595bb08f6d0 2024-09-10T05:36:34.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.955+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 <== osd.1 v2:172.21.15.62:6808/3442097179 27 ==== osd_op_reply(86 [pgnls start_epoch 30 out=49b] v30'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc9c00a4d0 con 0x5595bb08f6d0 2024-09-10T05:36:34.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.955+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fbc9c041040 con 0x5595bb0973a0 2024-09-10T05:36:34.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.955+0000 7fbca3d4e640 1 -- 172.21.15.62:0/1965469860 <== osd.3 v2:172.21.15.62:6816/2708991149 22 ==== osd_op_reply(87 [pgnls start_epoch 30 out=49b] v30'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc980a8070 con 0x5595bb0973a0 2024-09-10T05:36:34.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.955+0000 7fbca3d4e640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fbc9c041040 con 0x5595bb0973a0 2024-09-10T05:36:34.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.955+0000 7fbca3d4e640 1 -- 172.21.15.62:0/1965469860 <== osd.3 v2:172.21.15.62:6816/2708991149 23 ==== osd_op_reply(88 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc980a8070 con 0x5595bb0973a0 2024-09-10T05:36:34.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.955+0000 7fbca3d4e640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fbc9c041040 con 0x7fbc94077040 2024-09-10T05:36:34.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.955+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 <== osd.2 v2:172.21.15.62:6800/2677868286 17 ==== osd_op_reply(89 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc9c00a4d0 con 0x7fbc94077040 2024-09-10T05:36:34.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.955+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fbc9c041040 con 0x5595bb08f6d0 2024-09-10T05:36:34.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.955+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 <== osd.1 v2:172.21.15.62:6808/3442097179 28 ==== osd_op_reply(90 [pgnls start_epoch 30 out=49b] v30'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc9c00a4d0 con 0x5595bb08f6d0 2024-09-10T05:36:34.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.955+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fbc9c041040 con 0x5595bb093b50 2024-09-10T05:36:34.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.955+0000 7fbca454f640 1 -- 172.21.15.62:0/1965469860 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(91 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc94063040 con 0x5595bb093b50 2024-09-10T05:36:34.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.955+0000 7fbca454f640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fbc9c041040 con 0x5595bb0973a0 2024-09-10T05:36:34.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.955+0000 7fbca3d4e640 1 -- 172.21.15.62:0/1965469860 <== osd.3 v2:172.21.15.62:6816/2708991149 24 ==== osd_op_reply(92 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc980a8070 con 0x5595bb0973a0 2024-09-10T05:36:34.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.955+0000 7fbca3d4e640 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fbc9c041040 con 0x7fbc94077040 2024-09-10T05:36:34.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.955+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 <== osd.2 v2:172.21.15.62:6800/2677868286 18 ==== osd_op_reply(93 [pgnls start_epoch 30 out=127b] v30'1 uv1 ondisk = 1) ==== 144+0+127 (crc 0 0 0) 0x7fbc9c00a4d0 con 0x7fbc94077040 2024-09-10T05:36:34.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.955+0000 7fbca6a499c0 20 RGWRados::pool_iterate: got myfoo 2024-09-10T05:36:34.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.955+0000 7fbca6a499c0 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 2024-09-10T05:36:34.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.955+0000 7fbb5a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:34.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.955+0000 7fbca6a499c0 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94101576492608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09de50 con 0x5595bb08f6d0 2024-09-10T05:36:34.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.959+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 <== osd.1 v2:172.21.15.62:6808/3442097179 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94101576492608] v30'101 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbc9c00a4d0 con 0x5595bb08f6d0 2024-09-10T05:36:34.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.959+0000 7fbca6a499c0 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94101576471248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09e990 con 0x5595bb093b50 2024-09-10T05:36:34.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.959+0000 7fbca454f640 1 -- 172.21.15.62:0/1965469860 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94101576471248] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc94063040 con 0x5595bb093b50 2024-09-10T05:36:34.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.959+0000 7fbca6a499c0 20 remove_watcher() i=0 2024-09-10T05:36:34.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.959+0000 7fbca6a499c0 2 removed watcher, disabling cache 2024-09-10T05:36:34.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.959+0000 7fbca6a499c0 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94101576475776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09b6b0 con 0x5595bb08f6d0 2024-09-10T05:36:34.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.963+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 <== osd.1 v2:172.21.15.62:6808/3442097179 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94101576475776] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc9c00a4d0 con 0x5595bb08f6d0 2024-09-10T05:36:34.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.963+0000 7fbca6a499c0 20 remove_watcher() i=1 2024-09-10T05:36:34.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.963+0000 7fbca6a499c0 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94101576468736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09b6b0 con 0x5595bb093b50 2024-09-10T05:36:34.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.963+0000 7fbca454f640 1 -- 172.21.15.62:0/1965469860 <== osd.0 v2:172.21.15.2:6800/945139080 25 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94101576468736] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc94063040 con 0x5595bb093b50 2024-09-10T05:36:34.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.963+0000 7fbca6a499c0 20 remove_watcher() i=2 2024-09-10T05:36:34.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.963+0000 7fbca6a499c0 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94101576482848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09b6b0 con 0x7fbc94077040 2024-09-10T05:36:34.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.963+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 <== osd.2 v2:172.21.15.62:6800/2677868286 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94101576482848] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc9c00a4d0 con 0x7fbc94077040 2024-09-10T05:36:34.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.963+0000 7fbca6a499c0 20 remove_watcher() i=3 2024-09-10T05:36:34.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.963+0000 7fbca6a499c0 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94101576483904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09b6b0 con 0x5595bb093b50 2024-09-10T05:36:34.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.967+0000 7fbca454f640 1 -- 172.21.15.62:0/1965469860 <== osd.0 v2:172.21.15.2:6800/945139080 26 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94101576483904] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc94063040 con 0x5595bb093b50 2024-09-10T05:36:34.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.967+0000 7fbca6a499c0 20 remove_watcher() i=4 2024-09-10T05:36:34.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.967+0000 7fbca6a499c0 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94101576480576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09b6b0 con 0x5595bb0973a0 2024-09-10T05:36:34.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.967+0000 7fbca3d4e640 1 -- 172.21.15.62:0/1965469860 <== osd.3 v2:172.21.15.62:6816/2708991149 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94101576480576] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc980a8070 con 0x5595bb0973a0 2024-09-10T05:36:34.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.967+0000 7fbca6a499c0 20 remove_watcher() i=5 2024-09-10T05:36:34.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.967+0000 7fbca6a499c0 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94101576490304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09de20 con 0x5595bb0973a0 2024-09-10T05:36:34.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.967+0000 7fbca3d4e640 1 -- 172.21.15.62:0/1965469860 <== osd.3 v2:172.21.15.62:6816/2708991149 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94101576490304] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc980a8070 con 0x5595bb0973a0 2024-09-10T05:36:34.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.967+0000 7fbca6a499c0 20 remove_watcher() i=6 2024-09-10T05:36:34.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.967+0000 7fbca6a499c0 1 -- 172.21.15.62:0/1965469860 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94101576485472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595bb09de20 con 0x7fbc94077040 2024-09-10T05:36:34.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.971+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 <== osd.2 v2:172.21.15.62:6800/2677868286 20 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94101576485472] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc9c00a4d0 con 0x7fbc94077040 2024-09-10T05:36:34.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.971+0000 7fbca6a499c0 20 remove_watcher() i=7 2024-09-10T05:36:34.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.971+0000 7fbca6a499c0 1 -- 172.21.15.62:0/1965469860 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5595bb093b50 msgr2=0x5595bb095f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.971+0000 7fbca6a499c0 1 --2- 172.21.15.62:0/1965469860 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5595bb093b50 0x5595bb095f40 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.971+0000 7fbca6a499c0 1 -- 172.21.15.62:0/1965469860 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5595bb08f6d0 msgr2=0x5595bb091b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.971+0000 7fbca6a499c0 1 --2- 172.21.15.62:0/1965469860 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5595bb08f6d0 0x5595bb091b60 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.971+0000 7fbca6a499c0 1 -- 172.21.15.62:0/1965469860 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fbc94077040 msgr2=0x7fbc94023a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.971+0000 7fbca6a499c0 1 --2- 172.21.15.62:0/1965469860 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fbc94077040 0x7fbc94023a60 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.971+0000 7fbca6a499c0 1 -- 172.21.15.62:0/1965469860 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5595bb0973a0 msgr2=0x5595bb099790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.971+0000 7fbca6a499c0 1 --2- 172.21.15.62:0/1965469860 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5595bb0973a0 0x5595bb099790 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.971+0000 7fbca6a499c0 1 -- 172.21.15.62:0/1965469860 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fbb740399d0 msgr2=0x7fbb7403be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.971+0000 7fbca6a499c0 1 --2- 172.21.15.62:0/1965469860 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fbb740399d0 0x7fbb7403be90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x5595bb052f70 tx=0x7fbc980a7000 comp rx=0 tx=0).stop 2024-09-10T05:36:34.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.971+0000 7fbca6a499c0 1 -- 172.21.15.62:0/1965469860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595baf5cbc0 msgr2=0x5595bb0847d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.971+0000 7fbca4d50640 1 -- 172.21.15.62:0/1965469860 reap_dead start 2024-09-10T05:36:34.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.971+0000 7fbca6a499c0 1 --2- 172.21.15.62:0/1965469860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595baf5cbc0 0x5595bb0847d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fbc9404c770 tx=0x7fbc94010ea0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.971+0000 7fbca6a499c0 1 -- 172.21.15.62:0/1965469860 shutdown_connections 2024-09-10T05:36:34.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.971+0000 7fbca6a499c0 1 --2- 172.21.15.62:0/1965469860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595baf5cbc0 0x5595bb0847d0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.971+0000 7fbca6a499c0 1 -- 172.21.15.62:0/1965469860 >> 172.21.15.62:0/1965469860 conn(0x5595bb077650 msgr2=0x5595bb075860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:34.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.971+0000 7fbca6a499c0 1 -- 172.21.15.62:0/1965469860 shutdown_connections 2024-09-10T05:36:34.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.971+0000 7fbca6a499c0 1 -- 172.21.15.62:0/1965469860 wait complete. 2024-09-10T05:36:34.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.971+0000 7fbca6a499c0 1 -- 172.21.15.62:0/3483193074 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fbb7c039a70 msgr2=0x7fbb7c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.971+0000 7fbca6a499c0 1 --2- 172.21.15.62:0/3483193074 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fbb7c039a70 0x7fbb7c03bf30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x5595bb05c800 tx=0x7fbc98005a10 comp rx=0 tx=0).stop 2024-09-10T05:36:34.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.971+0000 7fbca6a499c0 1 -- 172.21.15.62:0/3483193074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595bb06eac0 msgr2=0x5595bb06eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.971+0000 7fbca6a499c0 1 --2- 172.21.15.62:0/3483193074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595bb06eac0 0x5595bb06eee0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fbc9404eca0 tx=0x7fbc94018f20 comp rx=0 tx=0).stop 2024-09-10T05:36:34.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.971+0000 7fbca6a499c0 1 -- 172.21.15.62:0/3483193074 shutdown_connections 2024-09-10T05:36:34.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.971+0000 7fbca6a499c0 1 --2- 172.21.15.62:0/3483193074 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fbb7c039a70 0x7fbb7c03bf30 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.971+0000 7fbca6a499c0 1 --2- 172.21.15.62:0/3483193074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595bb06eac0 0x5595bb06eee0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.971+0000 7fbca6a499c0 1 -- 172.21.15.62:0/3483193074 >> 172.21.15.62:0/3483193074 conn(0x5595bb064470 msgr2=0x5595bb064850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:34.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.971+0000 7fbca6a499c0 1 -- 172.21.15.62:0/3483193074 shutdown_connections 2024-09-10T05:36:34.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.971+0000 7fbca6a499c0 1 -- 172.21.15.62:0/3483193074 wait complete. 2024-09-10T05:36:34.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.971+0000 7fbca6a499c0 1 -- 172.21.15.62:0/3195298467 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5595bb058fc0 msgr2=0x5595bb05b460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.971+0000 7fbca6a499c0 1 --2- 172.21.15.62:0/3195298467 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5595bb058fc0 0x5595bb05b460 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.971+0000 7fbca6a499c0 1 -- 172.21.15.62:0/3195298467 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5595baf62320 msgr2=0x5595bb058010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.971+0000 7fbca6a499c0 1 --2- 172.21.15.62:0/3195298467 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5595baf62320 0x5595bb058010 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.971+0000 7fbca6a499c0 1 -- 172.21.15.62:0/3195298467 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5595bb05d990 msgr2=0x5595bb05fd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.971+0000 7fbca6a499c0 1 --2- 172.21.15.62:0/3195298467 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5595bb05d990 0x5595bb05fd80 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.971+0000 7fbca6a499c0 1 -- 172.21.15.62:0/3195298467 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fbb8c039ac0 msgr2=0x7fbb8c03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.971+0000 7fbca6a499c0 1 --2- 172.21.15.62:0/3195298467 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fbb8c039ac0 0x7fbb8c03bf80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbc980ac000 tx=0x7fbc980a5000 comp rx=0 tx=0).stop 2024-09-10T05:36:34.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.971+0000 7fbca6a499c0 1 -- 172.21.15.62:0/3195298467 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595baed21d0 msgr2=0x5595bb050ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:34.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.971+0000 7fbca6a499c0 1 --2- 172.21.15.62:0/3195298467 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595baed21d0 0x5595bb050ea0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x5595bb04a760 tx=0x7fbc94000ee0 comp rx=0 tx=0).stop 2024-09-10T05:36:34.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.971+0000 7fbca4d50640 1 -- 172.21.15.62:0/3195298467 reap_dead start 2024-09-10T05:36:34.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.971+0000 7fbca6a499c0 1 -- 172.21.15.62:0/3195298467 shutdown_connections 2024-09-10T05:36:34.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.971+0000 7fbca6a499c0 1 -- 172.21.15.62:0/3195298467 >> 172.21.15.62:0/3195298467 conn(0x5595baf588f0 msgr2=0x5595bb043ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:34.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.971+0000 7fbca6a499c0 1 -- 172.21.15.62:0/3195298467 shutdown_connections 2024-09-10T05:36:34.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:34.971+0000 7fbca6a499c0 1 -- 172.21.15.62:0/3195298467 wait complete. 2024-09-10T05:36:34.983 INFO:teuthology.orchestra.run.smithi062.stdout:["myfoo"] 2024-09-10T05:36:34.984 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-10T05:36:35.003 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T05:36:35.019 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T05:36:35.037 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T05:36:35.081 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=237 failed=True 2024-09-10T05:36:35.150 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T05:36:35.220 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T05:36:35.295 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T05:36:35.295 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-10T05:36:35.295 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-10T05:36:35.295 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-10T05:36:35.335 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:35.335 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:35.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.331+0000 7fc7c977c9c0 1 Processor -- start 2024-09-10T05:36:35.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.331+0000 7fc7c977c9c0 1 -- start start 2024-09-10T05:36:35.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.331+0000 7fc7c977c9c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55afa1987350 0x55afa1989740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.331+0000 7fc7c977c9c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55afa18359c0 con 0x55afa1983200 2024-09-10T05:36:35.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.331+0000 7fc7c977c9c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x55afa18856d0 con 0x55afa1987350 2024-09-10T05:36:35.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.335+0000 7fc7c6a81640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55afa1987350 0x55afa1989740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.335+0000 7fc7c6a81640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55afa1987350 0x55afa1989740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:46942/0 (socket says 172.21.15.62:46942) 2024-09-10T05:36:35.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.335+0000 7fc7c6a81640 1 -- 172.21.15.62:0/100736172 learned_addr learned my addr 172.21.15.62:0/100736172 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:35.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.335+0000 7fc7c6a81640 1 -- 172.21.15.62:0/100736172 >> v1:172.21.15.2:6789/0 conn(0x55afa1983200 legacy=0x55afa19835e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.335+0000 7fc7c6a81640 1 -- 172.21.15.62:0/100736172 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afa1829ca0 con 0x55afa1987350 2024-09-10T05:36:35.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.335+0000 7fc7c6a81640 1 --2- 172.21.15.62:0/100736172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afa1987350 0x55afa1989740 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc7b800a5c0 tx=0x7fc7b801b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3b7d63185c30af0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.335+0000 7fc7c6280640 1 -- 172.21.15.62:0/100736172 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7b80a9590 con 0x55afa1987350 2024-09-10T05:36:35.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.335+0000 7fc7c6280640 1 -- 172.21.15.62:0/100736172 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7b80ae070 con 0x55afa1987350 2024-09-10T05:36:35.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.335+0000 7fc7c6280640 1 -- 172.21.15.62:0/100736172 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7b80a9880 con 0x55afa1987350 2024-09-10T05:36:35.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.339+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/100736172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afa1987350 msgr2=0x55afa1989740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.339+0000 7fc7c977c9c0 1 --2- 172.21.15.62:0/100736172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afa1987350 0x55afa1989740 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc7b800a5c0 tx=0x7fc7b801b3d0 comp rx=0 tx=0).stop 2024-09-10T05:36:35.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.339+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/100736172 shutdown_connections 2024-09-10T05:36:35.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.339+0000 7fc7c977c9c0 1 --2- 172.21.15.62:0/100736172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afa1987350 0x55afa1989740 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:35.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.339+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/100736172 >> 172.21.15.62:0/100736172 conn(0x55afa18f6b10 msgr2=0x55afa18f6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:35.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.339+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/100736172 shutdown_connections 2024-09-10T05:36:35.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.339+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/100736172 wait complete. 2024-09-10T05:36:35.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.355+0000 7fc7c977c9c0 1 Processor -- start 2024-09-10T05:36:35.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.355+0000 7fc7c977c9c0 1 -- start start 2024-09-10T05:36:35.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.355+0000 7fc7c977c9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afa1983200 0x55afa1a6e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.355+0000 7fc7c977c9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55afa1889680 con 0x55afa1983200 2024-09-10T05:36:35.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.355+0000 7fc7c7282640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afa1983200 0x55afa1a6e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.355+0000 7fc7c7282640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afa1983200 0x55afa1a6e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:46956/0 (socket says 172.21.15.62:46956) 2024-09-10T05:36:35.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.355+0000 7fc7c7282640 1 -- 172.21.15.62:0/407041879 learned_addr learned my addr 172.21.15.62:0/407041879 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:35.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.355+0000 7fc7c7282640 1 -- 172.21.15.62:0/407041879 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afa1804da0 con 0x55afa1983200 2024-09-10T05:36:35.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.355+0000 7fc7c7282640 1 --2- 172.21.15.62:0/407041879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afa1983200 0x55afa1a6e8a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc00b220 tx=0x7fc7bc00b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86f789112eb3a7e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.355+0000 7fc6b560a640 1 -- 172.21.15.62:0/407041879 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7bc00a040 con 0x55afa1983200 2024-09-10T05:36:35.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.355+0000 7fc6b560a640 1 -- 172.21.15.62:0/407041879 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7bc00f750 con 0x55afa1983200 2024-09-10T05:36:35.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.355+0000 7fc6b560a640 1 -- 172.21.15.62:0/407041879 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7bc00fa70 con 0x55afa1983200 2024-09-10T05:36:35.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.355+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/407041879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afa1983200 msgr2=0x55afa1a6e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.355+0000 7fc7c977c9c0 1 --2- 172.21.15.62:0/407041879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afa1983200 0x55afa1a6e8a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc00b220 tx=0x7fc7bc00b6e0 comp rx=0 tx=0).stop 2024-09-10T05:36:35.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.355+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/407041879 shutdown_connections 2024-09-10T05:36:35.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.355+0000 7fc7c977c9c0 1 --2- 172.21.15.62:0/407041879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afa1983200 0x55afa1a6e8a0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:35.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.355+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/407041879 >> 172.21.15.62:0/407041879 conn(0x55afa18f6b10 msgr2=0x55afa1a6a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:35.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.355+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/407041879 shutdown_connections 2024-09-10T05:36:35.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.355+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/407041879 wait complete. 2024-09-10T05:36:35.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.355+0000 7fc7c977c9c0 1 Processor -- start 2024-09-10T05:36:35.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.355+0000 7fc7c977c9c0 1 -- start start 2024-09-10T05:36:35.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.355+0000 7fc7c977c9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afa1983200 0x55afa1a75f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.355+0000 7fc7c977c9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55afa182ba50 con 0x55afa1983200 2024-09-10T05:36:35.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.359+0000 7fc7c7282640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afa1983200 0x55afa1a75f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.359+0000 7fc7c7282640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afa1983200 0x55afa1a75f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:46968/0 (socket says 172.21.15.62:46968) 2024-09-10T05:36:35.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.359+0000 7fc7c7282640 1 -- 172.21.15.62:0/3275876458 learned_addr learned my addr 172.21.15.62:0/3275876458 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:35.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.359+0000 7fc7c7282640 1 -- 172.21.15.62:0/3275876458 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afa1a764a0 con 0x55afa1983200 2024-09-10T05:36:35.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.359+0000 7fc7c7282640 1 --2- 172.21.15.62:0/3275876458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afa1983200 0x55afa1a75f40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x55afa1a6f830 tx=0x7fc7bc000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.359+0000 7fc6b3e07640 1 -- 172.21.15.62:0/3275876458 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7bc01a880 con 0x55afa1983200 2024-09-10T05:36:35.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.359+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/3275876458 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55afa1a76730 con 0x55afa1983200 2024-09-10T05:36:35.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.359+0000 7fc6b3e07640 1 -- 172.21.15.62:0/3275876458 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7bc01aa20 con 0x55afa1983200 2024-09-10T05:36:35.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.359+0000 7fc6b3e07640 1 -- 172.21.15.62:0/3275876458 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7bc01ad00 con 0x55afa1983200 2024-09-10T05:36:35.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.359+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/3275876458 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55afa1a770e0 con 0x55afa1983200 2024-09-10T05:36:35.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.359+0000 7fc6b3e07640 1 -- 172.21.15.62:0/3275876458 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc7bc017050 con 0x55afa1983200 2024-09-10T05:36:35.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.359+0000 7fc6b3e07640 1 --2- 172.21.15.62:0/3275876458 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc6ac039a70 0x7fc6ac03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.359+0000 7fc6b3e07640 1 -- 172.21.15.62:0/3275876458 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc7bc015020 con 0x55afa1983200 2024-09-10T05:36:35.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.359+0000 7fc7c6a81640 1 --2- 172.21.15.62:0/3275876458 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc6ac039a70 0x7fc6ac03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.359+0000 7fc7c977c9c0 1 --2- 172.21.15.62:0/3275876458 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55afa1987350 0x55afa1a7d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.359+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/3275876458 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55afa1a7d5f0 con 0x55afa1987350 2024-09-10T05:36:35.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.359+0000 7fc7c7a83640 1 --2- 172.21.15.62:0/3275876458 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55afa1987350 0x55afa1a7d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.359+0000 7fc7c6a81640 1 --2- 172.21.15.62:0/3275876458 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc6ac039a70 0x7fc6ac03bf30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc7b80ad000 tx=0x7fc7b80a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.359+0000 7fc7c7a83640 1 --2- 172.21.15.62:0/3275876458 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55afa1987350 0x55afa1a7d0b0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.363+0000 7fc7c7a83640 1 -- 172.21.15.62:0/3275876458 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc7c000a4d0 con 0x55afa1987350 2024-09-10T05:36:35.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.363+0000 7fc7c977c9c0 1 --2- 172.21.15.62:0/3275876458 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55afa1a7e350 0x55afa1a80740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.363+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/3275876458 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55afa1a80d70 con 0x55afa1a7e350 2024-09-10T05:36:35.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.363+0000 7fc7c7282640 1 --2- 172.21.15.62:0/3275876458 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55afa1a7e350 0x55afa1a80740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.363+0000 7fc7c7282640 1 --2- 172.21.15.62:0/3275876458 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55afa1a7e350 0x55afa1a80740 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.363+0000 7fc7c7282640 1 -- 172.21.15.62:0/3275876458 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc7bc02e070 con 0x55afa1a7e350 2024-09-10T05:36:35.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.363+0000 7fc7c977c9c0 1 --2- 172.21.15.62:0/3275876458 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55afa1a82b30 0x55afa1a84f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.363+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/3275876458 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55afa1a85610 con 0x55afa1a82b30 2024-09-10T05:36:35.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.363+0000 7fc7c6a81640 1 --2- 172.21.15.62:0/3275876458 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55afa1a82b30 0x55afa1a84f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.363+0000 7fc7c6a81640 1 --2- 172.21.15.62:0/3275876458 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55afa1a82b30 0x55afa1a84f20 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.363+0000 7fc7c6a81640 1 -- 172.21.15.62:0/3275876458 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc7b80a9a70 con 0x55afa1a82b30 2024-09-10T05:36:35.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.363+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/3275876458 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55afa1a819d0 con 0x55afa1a7e350 2024-09-10T05:36:35.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.363+0000 7fc7c7282640 1 -- 172.21.15.62:0/3275876458 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc7bc02e070 con 0x55afa1a7e350 2024-09-10T05:36:35.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.363+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/3275876458 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55afa1a81e30 con 0x55afa1a82b30 2024-09-10T05:36:35.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.363+0000 7fc7c6a81640 1 -- 172.21.15.62:0/3275876458 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc7b80a9a70 con 0x55afa1a82b30 2024-09-10T05:36:35.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.367+0000 7fc7c977c9c0 1 Processor -- start 2024-09-10T05:36:35.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.367+0000 7fc7c977c9c0 1 -- start start 2024-09-10T05:36:35.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.367+0000 7fc7c977c9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afa1a93c20 0x55afa1a94040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.367+0000 7fc7c977c9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55afa1896450 con 0x55afa1a93c20 2024-09-10T05:36:35.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.367+0000 7fc7c7282640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afa1a93c20 0x55afa1a94040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.367+0000 7fc7c7282640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afa1a93c20 0x55afa1a94040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:46978/0 (socket says 172.21.15.62:46978) 2024-09-10T05:36:35.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.367+0000 7fc7c7282640 1 -- 172.21.15.62:0/3164041545 learned_addr learned my addr 172.21.15.62:0/3164041545 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:35.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.367+0000 7fc7c7282640 1 -- 172.21.15.62:0/3164041545 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afa1a94680 con 0x55afa1a93c20 2024-09-10T05:36:35.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.367+0000 7fc7c7282640 1 --2- 172.21.15.62:0/3164041545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afa1a93c20 0x55afa1a94040 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc018ce0 tx=0x7fc7bc050480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.367+0000 7fc6b1602640 1 -- 172.21.15.62:0/3164041545 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7bc04d3a0 con 0x55afa1a93c20 2024-09-10T05:36:35.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.367+0000 7fc6b1602640 1 -- 172.21.15.62:0/3164041545 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7bc04d540 con 0x55afa1a93c20 2024-09-10T05:36:35.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.367+0000 7fc6b1602640 1 -- 172.21.15.62:0/3164041545 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7bc04d840 con 0x55afa1a93c20 2024-09-10T05:36:35.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.367+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/3164041545 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55afa1a94ee0 con 0x55afa1a93c20 2024-09-10T05:36:35.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.367+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/3164041545 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55afa1a94ee0 con 0x55afa1a93c20 2024-09-10T05:36:35.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.367+0000 7fc6b1602640 1 -- 172.21.15.62:0/3164041545 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc7bc03a030 con 0x55afa1a93c20 2024-09-10T05:36:35.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.367+0000 7fc6b1602640 1 --2- 172.21.15.62:0/3164041545 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc6a0039a70 0x7fc6a003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.367+0000 7fc6b1602640 1 -- 172.21.15.62:0/3164041545 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc7bc038070 con 0x55afa1a93c20 2024-09-10T05:36:35.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.367+0000 7fc7c6a81640 1 --2- 172.21.15.62:0/3164041545 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc6a0039a70 0x7fc6a003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.371+0000 7fc7c977c9c0 1 Processor -- start 2024-09-10T05:36:35.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.371+0000 7fc7c977c9c0 1 -- start start 2024-09-10T05:36:35.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.371+0000 7fc7c977c9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afa1aa1240 0x55afa1aa1620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.371+0000 7fc7c977c9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55afa1a6f0f0 con 0x55afa1aa1240 2024-09-10T05:36:35.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.371+0000 7fc7c6a81640 1 --2- 172.21.15.62:0/3164041545 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc6a0039a70 0x7fc6a003bf30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc7b80ab040 tx=0x7fc7b8005ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.371+0000 7fc7c7282640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afa1aa1240 0x55afa1aa1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.371+0000 7fc7c7282640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afa1aa1240 0x55afa1aa1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:46988/0 (socket says 172.21.15.62:46988) 2024-09-10T05:36:35.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.371+0000 7fc7c7282640 1 -- 172.21.15.62:0/3704073869 learned_addr learned my addr 172.21.15.62:0/3704073869 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:35.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.371+0000 7fc7c7282640 1 -- 172.21.15.62:0/3704073869 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afa1aa1c10 con 0x55afa1aa1240 2024-09-10T05:36:35.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.371+0000 7fc7c7282640 1 --2- 172.21.15.62:0/3704073869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afa1aa1240 0x55afa1aa1620 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc00b1c0 tx=0x7fc7bc047c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d41c1290ada0b954 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.371+0000 7fc6aaffd640 1 -- 172.21.15.62:0/3704073869 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7bc05b040 con 0x55afa1aa1240 2024-09-10T05:36:35.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.371+0000 7fc6aaffd640 1 -- 172.21.15.62:0/3704073869 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7bc01c930 con 0x55afa1aa1240 2024-09-10T05:36:35.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.371+0000 7fc6aaffd640 1 -- 172.21.15.62:0/3704073869 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7bc01c460 con 0x55afa1aa1240 2024-09-10T05:36:35.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.371+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/3704073869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afa1aa1240 msgr2=0x55afa1aa1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.371+0000 7fc7c977c9c0 1 --2- 172.21.15.62:0/3704073869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afa1aa1240 0x55afa1aa1620 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc00b1c0 tx=0x7fc7bc047c40 comp rx=0 tx=0).stop 2024-09-10T05:36:35.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.371+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/3704073869 shutdown_connections 2024-09-10T05:36:35.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.371+0000 7fc7c977c9c0 1 --2- 172.21.15.62:0/3704073869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afa1aa1240 0x55afa1aa1620 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:35.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.371+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/3704073869 >> 172.21.15.62:0/3704073869 conn(0x55afa1a9c660 msgr2=0x55afa1a9a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:35.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.371+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/3704073869 shutdown_connections 2024-09-10T05:36:35.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.371+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/3704073869 wait complete. 2024-09-10T05:36:35.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.371+0000 7fc7c977c9c0 1 Processor -- start 2024-09-10T05:36:35.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.371+0000 7fc7c977c9c0 1 -- start start 2024-09-10T05:36:35.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.371+0000 7fc7c977c9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afa1aa1240 0x55afa1aa7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.371+0000 7fc7c977c9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55afa1aa0010 con 0x55afa1aa1240 2024-09-10T05:36:35.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.371+0000 7fc7c7282640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afa1aa1240 0x55afa1aa7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.371+0000 7fc7c7282640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afa1aa1240 0x55afa1aa7530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:46990/0 (socket says 172.21.15.62:46990) 2024-09-10T05:36:35.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.371+0000 7fc7c7282640 1 -- 172.21.15.62:0/376036685 learned_addr learned my addr 172.21.15.62:0/376036685 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:35.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.371+0000 7fc7c7282640 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afa1aa7a90 con 0x55afa1aa1240 2024-09-10T05:36:35.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.375+0000 7fc7c7282640 1 --2- 172.21.15.62:0/376036685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afa1aa1240 0x55afa1aa7530 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc018a60 tx=0x7fc7bc01d4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.375+0000 7fc6a97fa640 1 -- 172.21.15.62:0/376036685 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7bc06c020 con 0x55afa1aa1240 2024-09-10T05:36:35.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.375+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55afa1aa7a90 con 0x55afa1aa1240 2024-09-10T05:36:35.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.375+0000 7fc6a97fa640 1 -- 172.21.15.62:0/376036685 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7bc01c590 con 0x55afa1aa1240 2024-09-10T05:36:35.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.375+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55afa1aa8060 con 0x55afa1aa1240 2024-09-10T05:36:35.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.375+0000 7fc6a97fa640 1 -- 172.21.15.62:0/376036685 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7bc041510 con 0x55afa1aa1240 2024-09-10T05:36:35.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.375+0000 7fc6a97fa640 1 -- 172.21.15.62:0/376036685 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc7bc06f020 con 0x55afa1aa1240 2024-09-10T05:36:35.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.375+0000 7fc7c977c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.375+0000 7fc6a97fa640 1 --2- 172.21.15.62:0/376036685 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc690039a70 0x7fc69003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.375+0000 7fc6a97fa640 1 -- 172.21.15.62:0/376036685 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc7bc064050 con 0x55afa1aa1240 2024-09-10T05:36:35.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.375+0000 7fc7c6a81640 1 --2- 172.21.15.62:0/376036685 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc690039a70 0x7fc69003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.375+0000 7fc7c977c9c0 1 --2- 172.21.15.62:0/376036685 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55afa1ab24f0 0x55afa1ab4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.375+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55afa1ab50d0 con 0x55afa1ab24f0 2024-09-10T05:36:35.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.375+0000 7fc7c7a83640 1 --2- 172.21.15.62:0/376036685 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55afa1ab24f0 0x55afa1ab4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.375+0000 7fc7c6a81640 1 --2- 172.21.15.62:0/376036685 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc690039a70 0x7fc69003bf30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc7b80ce040 tx=0x7fc7b80c1040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.375+0000 7fc7c7a83640 1 --2- 172.21.15.62:0/376036685 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55afa1ab24f0 0x55afa1ab4980 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.375+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc7c000a4d0 con 0x55afa1ab24f0 2024-09-10T05:36:35.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.375+0000 7fc7c977c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:35.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.375+0000 7fc7c977c9c0 20 realm 2024-09-10T05:36:35.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.375+0000 7fc7c977c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.375+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55afa1ab1840 con 0x55afa1ab24f0 2024-09-10T05:36:35.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.375+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc7c000a4d0 con 0x55afa1ab24f0 2024-09-10T05:36:35.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.375+0000 7fc7c977c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:35.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.375+0000 7fc7c977c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:35.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.375+0000 7fc7c977c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.375+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55afa1ab5b90 con 0x55afa1ab24f0 2024-09-10T05:36:35.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.375+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc7c000a4d0 con 0x55afa1ab24f0 2024-09-10T05:36:35.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.375+0000 7fc7c977c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:35.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.375+0000 7fc7c977c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.375+0000 7fc7c977c9c0 1 --2- 172.21.15.62:0/376036685 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55afa1ab6970 0x55afa1ab8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.375+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55afa1ab93f0 con 0x55afa1ab6970 2024-09-10T05:36:35.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.379+0000 7fc7c7282640 1 --2- 172.21.15.62:0/376036685 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55afa1ab6970 0x55afa1ab8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.379+0000 7fc7c7282640 1 --2- 172.21.15.62:0/376036685 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55afa1ab6970 0x55afa1ab8d60 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.379+0000 7fc7c7282640 1 -- 172.21.15.62:0/376036685 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc7bc02e070 con 0x55afa1ab6970 2024-09-10T05:36:35.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.379+0000 7fc7c977c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:35.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.379+0000 7fc7c977c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.379+0000 7fc7c977c9c0 1 --2- 172.21.15.62:0/376036685 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55afa1aba1a0 0x55afa1abc590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.379+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55afa1abcc30 con 0x55afa1aba1a0 2024-09-10T05:36:35.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.379+0000 7fc7c6a81640 1 --2- 172.21.15.62:0/376036685 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55afa1aba1a0 0x55afa1abc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.379+0000 7fc7c6a81640 1 --2- 172.21.15.62:0/376036685 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55afa1aba1a0 0x55afa1abc590 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.379+0000 7fc7c6a81640 1 -- 172.21.15.62:0/376036685 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc7b80a9a70 con 0x55afa1aba1a0 2024-09-10T05:36:35.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.379+0000 7fc7c977c9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:35.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.379+0000 7fc7c977c9c0 20 searching for the correct realm 2024-09-10T05:36:35.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.379+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55afa1abe500 con 0x55afa1aba1a0 2024-09-10T05:36:35.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.379+0000 7fc7c6a81640 1 -- 172.21.15.62:0/376036685 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b80a9a70 con 0x55afa1aba1a0 2024-09-10T05:36:35.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.379+0000 7fc7c6a81640 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55afa1abe500 con 0x55afa1ab6970 2024-09-10T05:36:35.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.379+0000 7fc7c7282640 1 -- 172.21.15.62:0/376036685 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7bc02e070 con 0x55afa1ab6970 2024-09-10T05:36:35.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.379+0000 7fc7c7282640 1 --2- 172.21.15.62:0/376036685 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fc7bc07c040 0x7fc7bc05f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.379+0000 7fc7c7282640 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55afa1abe500 con 0x7fc7bc07c040 2024-09-10T05:36:35.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.383+0000 7fc7c7a83640 1 --2- 172.21.15.62:0/376036685 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fc7bc07c040 0x7fc7bc05f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.383+0000 7fc7c7a83640 1 --2- 172.21.15.62:0/376036685 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fc7bc07c040 0x7fc7bc05f880 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.383+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c000a4d0 con 0x7fc7bc07c040 2024-09-10T05:36:35.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.383+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55afa1abe500 con 0x55afa1ab24f0 2024-09-10T05:36:35.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.383+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c000a4d0 con 0x55afa1ab24f0 2024-09-10T05:36:35.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.383+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55afa1abe500 con 0x55afa1ab24f0 2024-09-10T05:36:35.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.383+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c000a4d0 con 0x55afa1ab24f0 2024-09-10T05:36:35.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.383+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55afa1abe500 con 0x55afa1aba1a0 2024-09-10T05:36:35.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.383+0000 7fc7c6a81640 1 -- 172.21.15.62:0/376036685 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b80a9a70 con 0x55afa1aba1a0 2024-09-10T05:36:35.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.383+0000 7fc7c6a81640 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55afa1abe500 con 0x55afa1ab24f0 2024-09-10T05:36:35.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.383+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c000a4d0 con 0x55afa1ab24f0 2024-09-10T05:36:35.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.383+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55afa1abe500 con 0x55afa1ab6970 2024-09-10T05:36:35.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.383+0000 7fc7c7282640 1 -- 172.21.15.62:0/376036685 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7bc02e070 con 0x55afa1ab6970 2024-09-10T05:36:35.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.383+0000 7fc7c7282640 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55afa1abe500 con 0x55afa1ab6970 2024-09-10T05:36:35.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.383+0000 7fc7c7282640 1 -- 172.21.15.62:0/376036685 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7bc02e070 con 0x55afa1ab6970 2024-09-10T05:36:35.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.383+0000 7fc7c7282640 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55afa1abe500 con 0x55afa1ab24f0 2024-09-10T05:36:35.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.383+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c000a4d0 con 0x55afa1ab24f0 2024-09-10T05:36:35.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.383+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55afa1abe500 con 0x7fc7bc07c040 2024-09-10T05:36:35.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.387+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c000a4d0 con 0x7fc7bc07c040 2024-09-10T05:36:35.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.387+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55afa1abe500 con 0x55afa1ab24f0 2024-09-10T05:36:35.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.387+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c000a4d0 con 0x55afa1ab24f0 2024-09-10T05:36:35.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.387+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55afa1abe500 con 0x7fc7bc07c040 2024-09-10T05:36:35.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.387+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc7c000a4d0 con 0x7fc7bc07c040 2024-09-10T05:36:35.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.387+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55afa1abe500 con 0x55afa1ab6970 2024-09-10T05:36:35.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.387+0000 7fc7c7282640 1 -- 172.21.15.62:0/376036685 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7bc02e070 con 0x55afa1ab6970 2024-09-10T05:36:35.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.387+0000 7fc7c7282640 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55afa1abe500 con 0x55afa1aba1a0 2024-09-10T05:36:35.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.387+0000 7fc7c6a81640 1 -- 172.21.15.62:0/376036685 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b80a9a70 con 0x55afa1aba1a0 2024-09-10T05:36:35.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.387+0000 7fc7c6a81640 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55afa1abe500 con 0x55afa1ab24f0 2024-09-10T05:36:35.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.387+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c000a4d0 con 0x55afa1ab24f0 2024-09-10T05:36:35.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.387+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55afa1abe500 con 0x55afa1ab6970 2024-09-10T05:36:35.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.387+0000 7fc7c7282640 1 -- 172.21.15.62:0/376036685 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7bc02e070 con 0x55afa1ab6970 2024-09-10T05:36:35.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.387+0000 7fc7c7282640 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55afa1abe500 con 0x55afa1aba1a0 2024-09-10T05:36:35.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.387+0000 7fc7c6a81640 1 -- 172.21.15.62:0/376036685 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 30 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7fc7b80a9a70 con 0x55afa1aba1a0 2024-09-10T05:36:35.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.387+0000 7fc7c6a81640 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55afa1abe500 con 0x55afa1ab24f0 2024-09-10T05:36:35.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.387+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c000a4d0 con 0x55afa1ab24f0 2024-09-10T05:36:35.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.387+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55afa1abe500 con 0x55afa1ab24f0 2024-09-10T05:36:35.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.387+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc7c000a4d0 con 0x55afa1ab24f0 2024-09-10T05:36:35.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.387+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55afa1abe500 con 0x55afa1ab24f0 2024-09-10T05:36:35.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.391+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c000a4d0 con 0x55afa1ab24f0 2024-09-10T05:36:35.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.391+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55afa1abe500 con 0x55afa1aba1a0 2024-09-10T05:36:35.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.391+0000 7fc7c6a81640 1 -- 172.21.15.62:0/376036685 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b80a9a70 con 0x55afa1aba1a0 2024-09-10T05:36:35.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.391+0000 7fc7c6a81640 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55afa1abe500 con 0x7fc7bc07c040 2024-09-10T05:36:35.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.391+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c000a4d0 con 0x7fc7bc07c040 2024-09-10T05:36:35.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.391+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55afa1abe500 con 0x55afa1ab24f0 2024-09-10T05:36:35.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.391+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c000a4d0 con 0x55afa1ab24f0 2024-09-10T05:36:35.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.391+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55afa1abe500 con 0x7fc7bc07c040 2024-09-10T05:36:35.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.391+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c000a4d0 con 0x7fc7bc07c040 2024-09-10T05:36:35.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.391+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55afa1abe500 con 0x55afa1aba1a0 2024-09-10T05:36:35.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.391+0000 7fc7c6a81640 1 -- 172.21.15.62:0/376036685 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b80a9a70 con 0x55afa1aba1a0 2024-09-10T05:36:35.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.391+0000 7fc7c6a81640 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55afa1abe500 con 0x7fc7bc07c040 2024-09-10T05:36:35.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.391+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c000a4d0 con 0x7fc7bc07c040 2024-09-10T05:36:35.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.391+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55afa1abe500 con 0x55afa1ab6970 2024-09-10T05:36:35.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.391+0000 7fc7c7282640 1 -- 172.21.15.62:0/376036685 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7bc02e070 con 0x55afa1ab6970 2024-09-10T05:36:35.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.391+0000 7fc7c7282640 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55afa1abe500 con 0x55afa1ab6970 2024-09-10T05:36:35.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.391+0000 7fc7c7282640 1 -- 172.21.15.62:0/376036685 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7bc02e070 con 0x55afa1ab6970 2024-09-10T05:36:35.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.391+0000 7fc7c7282640 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55afa1abe500 con 0x55afa1aba1a0 2024-09-10T05:36:35.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.391+0000 7fc7c6a81640 1 -- 172.21.15.62:0/376036685 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b80a9a70 con 0x55afa1aba1a0 2024-09-10T05:36:35.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.391+0000 7fc7c6a81640 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55afa1abe500 con 0x55afa1ab6970 2024-09-10T05:36:35.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.395+0000 7fc7c7282640 1 -- 172.21.15.62:0/376036685 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc7bc02e070 con 0x55afa1ab6970 2024-09-10T05:36:35.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.395+0000 7fc7c7282640 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55afa1abe500 con 0x55afa1ab6970 2024-09-10T05:36:35.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.395+0000 7fc7c7282640 1 -- 172.21.15.62:0/376036685 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7bc02e070 con 0x55afa1ab6970 2024-09-10T05:36:35.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.395+0000 7fc7c977c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:35.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.395+0000 7fc7c977c9c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:35.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.395+0000 7fc7c977c9c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:35.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.395+0000 7fc7c977c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:35.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.395+0000 7fc7c977c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:35.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.395+0000 7fc7c977c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:35.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.395+0000 7fc7c977c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.395+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55afa1abd5f0 con 0x55afa1ab24f0 2024-09-10T05:36:35.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.395+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc7c000a4d0 con 0x55afa1ab24f0 2024-09-10T05:36:35.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.395+0000 7fc7c977c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:35.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.395+0000 7fc7c977c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.395+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55afa1abda40 con 0x55afa1ab6970 2024-09-10T05:36:35.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.395+0000 7fc7c7282640 1 -- 172.21.15.62:0/376036685 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc7bc02e070 con 0x55afa1ab6970 2024-09-10T05:36:35.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.395+0000 7fc7c977c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:35.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.395+0000 7fc7c977c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.395+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55afa1abde60 con 0x55afa1aba1a0 2024-09-10T05:36:35.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.395+0000 7fc7c6a81640 1 -- 172.21.15.62:0/376036685 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc7b80a9a70 con 0x55afa1aba1a0 2024-09-10T05:36:35.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.395+0000 7fc7c977c9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:35.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.395+0000 7fc7c977c9c0 20 zone default found 2024-09-10T05:36:35.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.395+0000 7fc7c977c9c0 4 Realm: () 2024-09-10T05:36:35.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.395+0000 7fc7c977c9c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:35.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.395+0000 7fc7c977c9c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:35.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.395+0000 7fc7c977c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:35.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.395+0000 7fc7c977c9c0 20 zonegroup default 2024-09-10T05:36:35.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.395+0000 7fc7c977c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.395+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55afa1abe9b0 con 0x7fc7bc07c040 2024-09-10T05:36:35.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.395+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc7c000a4d0 con 0x7fc7bc07c040 2024-09-10T05:36:35.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.395+0000 7fc7c977c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:35.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.395+0000 7fc7c977c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.395+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55afa1ac0c70 con 0x55afa1aba1a0 2024-09-10T05:36:35.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.395+0000 7fc7c6a81640 1 -- 172.21.15.62:0/376036685 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc7b80a9a70 con 0x55afa1aba1a0 2024-09-10T05:36:35.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.395+0000 7fc7c977c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:35.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.395+0000 7fc7c977c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.395+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55afa1ac1060 con 0x55afa1aba1a0 2024-09-10T05:36:35.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.399+0000 7fc7c6a81640 1 -- 172.21.15.62:0/376036685 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc7b80a9a70 con 0x55afa1aba1a0 2024-09-10T05:36:35.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.399+0000 7fc7c977c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:35.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.399+0000 7fc7c977c9c0 20 started sync module instance, tier type = 2024-09-10T05:36:35.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.399+0000 7fc7c977c9c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:35.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.399+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55afa1ac0100 con 0x55afa1ab6970 2024-09-10T05:36:35.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.399+0000 7fc7c7282640 1 -- 172.21.15.62:0/376036685 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7bc02e070 con 0x55afa1ab6970 2024-09-10T05:36:35.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.399+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94212820043040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55afa1ac1970 con 0x55afa1ab6970 2024-09-10T05:36:35.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.399+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55afa1ac21c0 con 0x55afa1ab24f0 2024-09-10T05:36:35.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.399+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c000a4d0 con 0x55afa1ab24f0 2024-09-10T05:36:35.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.399+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94212820048240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55afa1ac2a10 con 0x55afa1ab24f0 2024-09-10T05:36:35.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.399+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55afa1ac3260 con 0x55afa1ab6970 2024-09-10T05:36:35.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.403+0000 7fc7c7282640 1 -- 172.21.15.62:0/376036685 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94212820043040] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7bc02e070 con 0x55afa1ab6970 2024-09-10T05:36:35.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.403+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94212820048240] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c000a4d0 con 0x55afa1ab24f0 2024-09-10T05:36:35.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.403+0000 7fc7c7282640 1 -- 172.21.15.62:0/376036685 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7bc02e070 con 0x55afa1ab6970 2024-09-10T05:36:35.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.403+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94212820051296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55afa1ac2e30 con 0x55afa1ab6970 2024-09-10T05:36:35.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.403+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55afa1ac3680 con 0x7fc7bc07c040 2024-09-10T05:36:35.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.403+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c000a4d0 con 0x7fc7bc07c040 2024-09-10T05:36:35.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.403+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94212820053856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55afa1ac3a70 con 0x7fc7bc07c040 2024-09-10T05:36:35.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.403+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55afa1ac4520 con 0x55afa1ab6970 2024-09-10T05:36:35.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.403+0000 7fc7c7282640 1 -- 172.21.15.62:0/376036685 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94212820051296] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7bc02e070 con 0x55afa1ab6970 2024-09-10T05:36:35.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.407+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94212820053856] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c000a4d0 con 0x7fc7bc07c040 2024-09-10T05:36:35.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.407+0000 7fc7c7282640 1 -- 172.21.15.62:0/376036685 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7bc02e070 con 0x55afa1ab6970 2024-09-10T05:36:35.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.407+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94212820052352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55afa1ac4030 con 0x55afa1ab6970 2024-09-10T05:36:35.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.407+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55afa1ac4df0 con 0x55afa1aba1a0 2024-09-10T05:36:35.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.407+0000 7fc7c6a81640 1 -- 172.21.15.62:0/376036685 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b80a9a70 con 0x55afa1aba1a0 2024-09-10T05:36:35.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.407+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94212820060480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55afa1ac4030 con 0x55afa1aba1a0 2024-09-10T05:36:35.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.407+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55afa1ac5830 con 0x55afa1aba1a0 2024-09-10T05:36:35.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.407+0000 7fc7c7282640 1 -- 172.21.15.62:0/376036685 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94212820052352] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7bc02e070 con 0x55afa1ab6970 2024-09-10T05:36:35.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.407+0000 7fc7c6a81640 1 -- 172.21.15.62:0/376036685 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94212820060480] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b80a9a70 con 0x55afa1aba1a0 2024-09-10T05:36:35.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.407+0000 7fc7c6a81640 1 -- 172.21.15.62:0/376036685 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b80a9a70 con 0x55afa1aba1a0 2024-09-10T05:36:35.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.411+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94212820061536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55afa1ac5380 con 0x55afa1aba1a0 2024-09-10T05:36:35.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.411+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55afa1ac60d0 con 0x7fc7bc07c040 2024-09-10T05:36:35.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.411+0000 7fc7c6a81640 1 -- 172.21.15.62:0/376036685 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94212820061536] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b80a9a70 con 0x55afa1aba1a0 2024-09-10T05:36:35.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.411+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c000a4d0 con 0x7fc7bc07c040 2024-09-10T05:36:35.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.411+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94212820055104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55afa1ac5380 con 0x7fc7bc07c040 2024-09-10T05:36:35.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.411+0000 7fc7c977c9c0 20 add_watcher() i=0 2024-09-10T05:36:35.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.411+0000 7fc7c977c9c0 20 add_watcher() i=1 2024-09-10T05:36:35.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.411+0000 7fc7c977c9c0 20 add_watcher() i=2 2024-09-10T05:36:35.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.411+0000 7fc7c977c9c0 20 add_watcher() i=3 2024-09-10T05:36:35.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.411+0000 7fc7c977c9c0 20 add_watcher() i=4 2024-09-10T05:36:35.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.411+0000 7fc7c977c9c0 20 add_watcher() i=5 2024-09-10T05:36:35.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.411+0000 7fc7c977c9c0 20 add_watcher() i=6 2024-09-10T05:36:35.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.411+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94212820055104] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c000a4d0 con 0x7fc7bc07c040 2024-09-10T05:36:35.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.411+0000 7fc7c977c9c0 20 add_watcher() i=7 2024-09-10T05:36:35.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.411+0000 7fc7c977c9c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:35.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.411+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55afa1ac9100 con 0x55afa1ab24f0 2024-09-10T05:36:35.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.411+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc7c000a4d0 con 0x55afa1ab24f0 2024-09-10T05:36:35.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.411+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94212820065312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55afa1ac65c0 con 0x55afa1ab24f0 2024-09-10T05:36:35.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.415+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94212820065312] v30'102 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc7c000a4d0 con 0x55afa1ab24f0 2024-09-10T05:36:35.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.415+0000 7fc67e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:35.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.415+0000 7fc7c977c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:35.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.415+0000 7fc7c977c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:35.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.415+0000 7fc7c977c9c0 5 note: GC not initialized 2024-09-10T05:36:35.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.415+0000 7fc67d7e2640 20 reqs_thread_entry: start 2024-09-10T05:36:35.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.415+0000 7fc7c977c9c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:35.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.415+0000 7fc7c977c9c0 20 Filter name: none 2024-09-10T05:36:35.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.415+0000 7fc6767fc640 20 reqs_thread_entry: start 2024-09-10T05:36:35.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.415+0000 7fc7c977c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.415+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55afa1aec4c0 con 0x7fc7bc07c040 2024-09-10T05:36:35.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.415+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fc7c000a4d0 con 0x7fc7bc07c040 2024-09-10T05:36:35.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.415+0000 7fc7c977c9c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T05:36:35.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.415+0000 7fc7c977c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.415+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:63 8.1f 8:fcc5c255:root::.bucket.meta.myfoo%3a475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55afa1aecd50 con 0x7fc7bc07c040 2024-09-10T05:36:35.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.415+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(63 .bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fc7c000a4d0 con 0x7fc7bc07c040 2024-09-10T05:36:35.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.415+0000 7fc7c977c9c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T05:36:35.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.415+0000 7fc7c977c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-10T05:36:35.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.415+0000 7fc7c977c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.415+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55afa1aeb770 con 0x7fc7bc07c040 2024-09-10T05:36:35.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.415+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fc7c000a4d0 con 0x7fc7bc07c040 2024-09-10T05:36:35.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.415+0000 7fc7c977c9c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T05:36:35.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.415+0000 7fc7c977c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.415+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:65 8.1f 8:fcc5c255:root::.bucket.meta.myfoo%3a475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55afa1aee360 con 0x7fc7bc07c040 2024-09-10T05:36:35.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.419+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 <== osd.2 v2:172.21.15.62:6800/2677868286 15 ==== osd_op_reply(65 .bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fc7c000a4d0 con 0x7fc7bc07c040 2024-09-10T05:36:35.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.419+0000 7fc7c977c9c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T05:36:35.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.419+0000 7fc7c977c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-10T05:36:35.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.419+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:66 4.39 4:9f393805:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55afa1aedd90 con 0x55afa1aba1a0 2024-09-10T05:36:35.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.419+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:67 4.27 4:e72118f4:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55afa1af2c10 con 0x55afa1ab24f0 2024-09-10T05:36:35.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.419+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 4.32 4:4fe9cf27:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55afa1aedd90 con 0x55afa1ab6970 2024-09-10T05:36:35.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.419+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:69 4.c 4:3284697f:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55afa1af7df0 con 0x55afa1ab24f0 2024-09-10T05:36:35.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.419+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:70 4.a 4:5050a708:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55afa1afac90 con 0x55afa1ab6970 2024-09-10T05:36:35.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.419+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:71 4.1b 4:db0b4800:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55afa1afd620 con 0x7fc7bc07c040 2024-09-10T05:36:35.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.419+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:72 4.1f 4:fa625c04:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55afa1afac90 con 0x55afa1ab6970 2024-09-10T05:36:35.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.419+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:73 4.d 4:b20f8417:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55afa1b023e0 con 0x55afa1ab6970 2024-09-10T05:36:35.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.419+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:74 4.3 4:c3f62267:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55afa1b05050 con 0x55afa1ab24f0 2024-09-10T05:36:35.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.419+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:75 4.26 4:65fa9cda:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55afa1b07940 con 0x55afa1ab24f0 2024-09-10T05:36:35.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.419+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:76 4.3e 4:7c38a587:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55afa1b0a4a0 con 0x55afa1ab6970 2024-09-10T05:36:35.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.419+0000 7fc7c6a81640 1 -- 172.21.15.62:0/376036685 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(66 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc7b80a9a70 con 0x55afa1aba1a0 2024-09-10T05:36:35.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.419+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(67 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc7c003e070 con 0x55afa1ab24f0 2024-09-10T05:36:35.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.419+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(69 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc7c003e070 con 0x55afa1ab24f0 2024-09-10T05:36:35.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.419+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 <== osd.2 v2:172.21.15.62:6800/2677868286 16 ==== osd_op_reply(71 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc7c003e070 con 0x7fc7bc07c040 2024-09-10T05:36:35.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.419+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(74 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc7c003e070 con 0x55afa1ab24f0 2024-09-10T05:36:35.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.419+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(75 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc7c003e070 con 0x55afa1ab24f0 2024-09-10T05:36:35.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.419+0000 7fc7c7282640 1 -- 172.21.15.62:0/376036685 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(70 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc7bc02e070 con 0x55afa1ab6970 2024-09-10T05:36:35.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.419+0000 7fc7c7282640 1 -- 172.21.15.62:0/376036685 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(68 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc7bc02e070 con 0x55afa1ab6970 2024-09-10T05:36:35.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.419+0000 7fc7c7282640 1 -- 172.21.15.62:0/376036685 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(72 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc7bc02e070 con 0x55afa1ab6970 2024-09-10T05:36:35.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.419+0000 7fc7c7282640 1 -- 172.21.15.62:0/376036685 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== osd_op_reply(73 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc7bc02e070 con 0x55afa1ab6970 2024-09-10T05:36:35.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.419+0000 7fc7c7282640 1 -- 172.21.15.62:0/376036685 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== osd_op_reply(76 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fc7bc02e070 con 0x55afa1ab6970 2024-09-10T05:36:35.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.419+0000 7fc67e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:35.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.419+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94212820065312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55afa1b0a4a0 con 0x55afa1ab24f0 2024-09-10T05:36:35.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.423+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 <== osd.1 v2:172.21.15.62:6808/3442097179 23 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94212820065312] v30'103 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc7c003e070 con 0x55afa1ab24f0 2024-09-10T05:36:35.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.423+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94212820043040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55afa1b0a4a0 con 0x55afa1ab6970 2024-09-10T05:36:35.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.423+0000 7fc7c7282640 1 -- 172.21.15.62:0/376036685 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94212820043040] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7bc02e070 con 0x55afa1ab6970 2024-09-10T05:36:35.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.423+0000 7fc7c977c9c0 20 remove_watcher() i=0 2024-09-10T05:36:35.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.423+0000 7fc7c977c9c0 2 removed watcher, disabling cache 2024-09-10T05:36:35.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.423+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94212820048240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55afa1ac0520 con 0x55afa1ab24f0 2024-09-10T05:36:35.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.427+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 <== osd.1 v2:172.21.15.62:6808/3442097179 24 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94212820048240] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c003e070 con 0x55afa1ab24f0 2024-09-10T05:36:35.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.427+0000 7fc7c977c9c0 20 remove_watcher() i=1 2024-09-10T05:36:35.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.427+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94212820051296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55afa1ac0520 con 0x55afa1ab6970 2024-09-10T05:36:35.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.427+0000 7fc7c7282640 1 -- 172.21.15.62:0/376036685 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94212820051296] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7bc02e070 con 0x55afa1ab6970 2024-09-10T05:36:35.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.427+0000 7fc7c977c9c0 20 remove_watcher() i=2 2024-09-10T05:36:35.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.427+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94212820053856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55afa1ac2560 con 0x7fc7bc07c040 2024-09-10T05:36:35.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.431+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 <== osd.2 v2:172.21.15.62:6800/2677868286 17 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94212820053856] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c003e070 con 0x7fc7bc07c040 2024-09-10T05:36:35.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.431+0000 7fc7c977c9c0 20 remove_watcher() i=3 2024-09-10T05:36:35.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.431+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94212820052352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55afa1ac2f60 con 0x55afa1ab6970 2024-09-10T05:36:35.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.431+0000 7fc7c7282640 1 -- 172.21.15.62:0/376036685 <== osd.0 v2:172.21.15.2:6800/945139080 25 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94212820052352] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7bc02e070 con 0x55afa1ab6970 2024-09-10T05:36:35.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.431+0000 7fc7c977c9c0 20 remove_watcher() i=4 2024-09-10T05:36:35.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.431+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94212820060480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55afa1ac2f60 con 0x55afa1aba1a0 2024-09-10T05:36:35.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.431+0000 7fc7c6a81640 1 -- 172.21.15.62:0/376036685 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94212820060480] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b80a9a70 con 0x55afa1aba1a0 2024-09-10T05:36:35.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.431+0000 7fc7c977c9c0 20 remove_watcher() i=5 2024-09-10T05:36:35.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.431+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94212820061536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55afa1ac4940 con 0x55afa1aba1a0 2024-09-10T05:36:35.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.435+0000 7fc7c6a81640 1 -- 172.21.15.62:0/376036685 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94212820061536] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b80a9a70 con 0x55afa1aba1a0 2024-09-10T05:36:35.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.435+0000 7fc7c977c9c0 20 remove_watcher() i=6 2024-09-10T05:36:35.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.435+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94212820055104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55afa1ac2f60 con 0x7fc7bc07c040 2024-09-10T05:36:35.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.435+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 <== osd.2 v2:172.21.15.62:6800/2677868286 18 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94212820055104] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c003e070 con 0x7fc7bc07c040 2024-09-10T05:36:35.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.435+0000 7fc7c977c9c0 20 remove_watcher() i=7 2024-09-10T05:36:35.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.435+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55afa1ab6970 msgr2=0x55afa1ab8d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.435+0000 7fc7c977c9c0 1 --2- 172.21.15.62:0/376036685 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55afa1ab6970 0x55afa1ab8d60 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:35.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.435+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55afa1ab24f0 msgr2=0x55afa1ab4980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.435+0000 7fc7c977c9c0 1 --2- 172.21.15.62:0/376036685 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55afa1ab24f0 0x55afa1ab4980 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:35.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.435+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fc7bc07c040 msgr2=0x7fc7bc05f880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.435+0000 7fc7c977c9c0 1 --2- 172.21.15.62:0/376036685 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fc7bc07c040 0x7fc7bc05f880 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:35.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.435+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55afa1aba1a0 msgr2=0x55afa1abc590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.435+0000 7fc7c977c9c0 1 --2- 172.21.15.62:0/376036685 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55afa1aba1a0 0x55afa1abc590 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:35.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.435+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc690039a70 msgr2=0x7fc69003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.435+0000 7fc7c977c9c0 1 --2- 172.21.15.62:0/376036685 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc690039a70 0x7fc69003bf30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc7b80ce040 tx=0x7fc7b80c1040 comp rx=0 tx=0).stop 2024-09-10T05:36:35.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.435+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afa1aa1240 msgr2=0x55afa1aa7530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.435+0000 7fc7c7a83640 1 -- 172.21.15.62:0/376036685 reap_dead start 2024-09-10T05:36:35.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.435+0000 7fc7c977c9c0 1 --2- 172.21.15.62:0/376036685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afa1aa1240 0x55afa1aa7530 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc018a60 tx=0x7fc7bc01d4d0 comp rx=0 tx=0).stop 2024-09-10T05:36:35.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.435+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 shutdown_connections 2024-09-10T05:36:35.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.435+0000 7fc7c977c9c0 1 --2- 172.21.15.62:0/376036685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afa1aa1240 0x55afa1aa7530 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:35.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.435+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 >> 172.21.15.62:0/376036685 conn(0x55afa1a9c660 msgr2=0x55afa1a9a870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:35.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.435+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 shutdown_connections 2024-09-10T05:36:35.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.435+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/376036685 wait complete. 2024-09-10T05:36:35.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.435+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/3164041545 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc6a0039a70 msgr2=0x7fc6a003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.435+0000 7fc7c977c9c0 1 --2- 172.21.15.62:0/3164041545 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc6a0039a70 0x7fc6a003bf30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc7b80ab040 tx=0x7fc7b8005ad0 comp rx=0 tx=0).stop 2024-09-10T05:36:35.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.435+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/3164041545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afa1a93c20 msgr2=0x55afa1a94040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.435+0000 7fc7c977c9c0 1 --2- 172.21.15.62:0/3164041545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afa1a93c20 0x55afa1a94040 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc018ce0 tx=0x7fc7bc050480 comp rx=0 tx=0).stop 2024-09-10T05:36:35.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.435+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/3164041545 shutdown_connections 2024-09-10T05:36:35.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.435+0000 7fc7c977c9c0 1 --2- 172.21.15.62:0/3164041545 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc6a0039a70 0x7fc6a003bf30 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:35.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.435+0000 7fc7c977c9c0 1 --2- 172.21.15.62:0/3164041545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afa1a93c20 0x55afa1a94040 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:35.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.435+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/3164041545 >> 172.21.15.62:0/3164041545 conn(0x55afa1a895d0 msgr2=0x55afa1a899b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:35.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.435+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/3164041545 shutdown_connections 2024-09-10T05:36:35.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.435+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/3164041545 wait complete. 2024-09-10T05:36:35.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.435+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/3275876458 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55afa1a7e350 msgr2=0x55afa1a80740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.435+0000 7fc7c977c9c0 1 --2- 172.21.15.62:0/3275876458 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55afa1a7e350 0x55afa1a80740 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:35.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.435+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/3275876458 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55afa1987350 msgr2=0x55afa1a7d0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.435+0000 7fc7c977c9c0 1 --2- 172.21.15.62:0/3275876458 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55afa1987350 0x55afa1a7d0b0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:35.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.435+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/3275876458 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55afa1a82b30 msgr2=0x55afa1a84f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.435+0000 7fc7c977c9c0 1 --2- 172.21.15.62:0/3275876458 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55afa1a82b30 0x55afa1a84f20 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:35.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.435+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/3275876458 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc6ac039a70 msgr2=0x7fc6ac03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.435+0000 7fc7c977c9c0 1 --2- 172.21.15.62:0/3275876458 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc6ac039a70 0x7fc6ac03bf30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc7b80ad000 tx=0x7fc7b80a6000 comp rx=0 tx=0).stop 2024-09-10T05:36:35.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.435+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/3275876458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afa1983200 msgr2=0x55afa1a75f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.435+0000 7fc7c977c9c0 1 --2- 172.21.15.62:0/3275876458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afa1983200 0x55afa1a75f40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x55afa1a6f830 tx=0x7fc7bc000bd0 comp rx=0 tx=0).stop 2024-09-10T05:36:35.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.435+0000 7fc7c7a83640 1 -- 172.21.15.62:0/3275876458 reap_dead start 2024-09-10T05:36:35.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.435+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/3275876458 shutdown_connections 2024-09-10T05:36:35.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.435+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/3275876458 >> 172.21.15.62:0/3275876458 conn(0x55afa18f6b10 msgr2=0x55afa1a68f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:35.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.435+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/3275876458 shutdown_connections 2024-09-10T05:36:35.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.435+0000 7fc7c977c9c0 1 -- 172.21.15.62:0/3275876458 wait complete. 2024-09-10T05:36:35.451 INFO:teuthology.orchestra.run.smithi062.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"1e560b55-359a-4aa1-8333-6dabf7061701","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1","marker":"475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-10T05:36:34.651066Z","creation_time":"2024-09-10T05:36:34.646920Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":1} 2024-09-10T05:36:35.452 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '1e560b55-359a-4aa1-8333-6dabf7061701', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1', 'marker': '475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-10T05:36:34.651066Z', 'creation_time': '2024-09-10T05:36:34.646920Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-10T05:36:35.452 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-10T05:36:35.452 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-10T05:36:35.452 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-10T05:36:35.524 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:35.524 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:35.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.523+0000 7f7c53fd49c0 1 Processor -- start 2024-09-10T05:36:35.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.523+0000 7f7c53fd49c0 1 -- start start 2024-09-10T05:36:35.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.523+0000 7f7c53fd49c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x564103f1a350 0x564103f1c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.523+0000 7f7c53fd49c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564103dc89c0 con 0x564103f16200 2024-09-10T05:36:35.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.523+0000 7f7c53fd49c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x564103e186d0 con 0x564103f1a350 2024-09-10T05:36:35.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.523+0000 7f7c512d9640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x564103f1a350 0x564103f1c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.523+0000 7f7c51ada640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x564103f16200 0x564103f165e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:53018/0 (socket says 172.21.15.62:53018) 2024-09-10T05:36:35.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.523+0000 7f7c51ada640 1 -- 172.21.15.62:0/679713719 learned_addr learned my addr 172.21.15.62:0/679713719 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-10T05:36:35.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.523+0000 7f7c50ad8640 1 -- 172.21.15.62:0/679713719 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1983614676 0 0) 0x564103dc89c0 con 0x564103f16200 2024-09-10T05:36:35.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.523+0000 7f7c50ad8640 1 -- 172.21.15.62:0/679713719 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c40001e20 con 0x564103f16200 2024-09-10T05:36:35.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.523+0000 7f7c512d9640 1 -- 172.21.15.62:0/679713719 >> v1:172.21.15.2:6789/0 conn(0x564103f16200 legacy=0x564103f165e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.523+0000 7f7c512d9640 1 -- 172.21.15.62:0/679713719 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564103dbcca0 con 0x564103f1a350 2024-09-10T05:36:35.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.527+0000 7f7c512d9640 1 --2- 172.21.15.62:0/679713719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564103f1a350 0x564103f1c740 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c00a480 tx=0x7f7c3c01b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b14f1e573d684edc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.527+0000 7f7c50ad8640 1 -- 172.21.15.62:0/679713719 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c3c0aa570 con 0x564103f1a350 2024-09-10T05:36:35.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.527+0000 7f7c50ad8640 1 -- 172.21.15.62:0/679713719 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c3c0af070 con 0x564103f1a350 2024-09-10T05:36:35.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.527+0000 7f7c50ad8640 1 -- 172.21.15.62:0/679713719 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c3c0aa860 con 0x564103f1a350 2024-09-10T05:36:35.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.527+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/679713719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564103f1a350 msgr2=0x564103f1c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.527+0000 7f7c53fd49c0 1 --2- 172.21.15.62:0/679713719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564103f1a350 0x564103f1c740 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c00a480 tx=0x7f7c3c01b310 comp rx=0 tx=0).stop 2024-09-10T05:36:35.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.527+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/679713719 shutdown_connections 2024-09-10T05:36:35.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.527+0000 7f7c53fd49c0 1 --2- 172.21.15.62:0/679713719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564103f1a350 0x564103f1c740 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:35.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.527+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/679713719 >> 172.21.15.62:0/679713719 conn(0x564103e89b10 msgr2=0x564103e89f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:35.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.527+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/679713719 shutdown_connections 2024-09-10T05:36:35.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.527+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/679713719 wait complete. 2024-09-10T05:36:35.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.543+0000 7f7c53fd49c0 1 Processor -- start 2024-09-10T05:36:35.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.543+0000 7f7c53fd49c0 1 -- start start 2024-09-10T05:36:35.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.543+0000 7f7c53fd49c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564103f16200 0x5641040016d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.543+0000 7f7c53fd49c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564103e1c680 con 0x564103f16200 2024-09-10T05:36:35.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.543+0000 7f7c51ada640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564103f16200 0x5641040016d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.543+0000 7f7c51ada640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564103f16200 0x5641040016d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47004/0 (socket says 172.21.15.62:47004) 2024-09-10T05:36:35.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.543+0000 7f7c51ada640 1 -- 172.21.15.62:0/239975603 learned_addr learned my addr 172.21.15.62:0/239975603 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:35.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.543+0000 7f7c51ada640 1 -- 172.21.15.62:0/239975603 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564103d97da0 con 0x564103f16200 2024-09-10T05:36:35.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.543+0000 7f7c51ada640 1 --2- 172.21.15.62:0/239975603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564103f16200 0x5641040016d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c001e40 tx=0x7f7c4c00b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2553228ad4b5851e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.543+0000 7f7b3fe07640 1 -- 172.21.15.62:0/239975603 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c4c012020 con 0x564103f16200 2024-09-10T05:36:35.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.543+0000 7f7b3fe07640 1 -- 172.21.15.62:0/239975603 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c4c00e690 con 0x564103f16200 2024-09-10T05:36:35.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.543+0000 7f7b3fe07640 1 -- 172.21.15.62:0/239975603 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c4c00e9b0 con 0x564103f16200 2024-09-10T05:36:35.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.543+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/239975603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564103f16200 msgr2=0x5641040016d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.543+0000 7f7c53fd49c0 1 --2- 172.21.15.62:0/239975603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564103f16200 0x5641040016d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c001e40 tx=0x7f7c4c00b790 comp rx=0 tx=0).stop 2024-09-10T05:36:35.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.543+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/239975603 shutdown_connections 2024-09-10T05:36:35.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.543+0000 7f7c53fd49c0 1 --2- 172.21.15.62:0/239975603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564103f16200 0x5641040016d0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:35.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.543+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/239975603 >> 172.21.15.62:0/239975603 conn(0x564103e89b10 msgr2=0x564103ffd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:35.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.543+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/239975603 shutdown_connections 2024-09-10T05:36:35.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.543+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/239975603 wait complete. 2024-09-10T05:36:35.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.547+0000 7f7c53fd49c0 1 Processor -- start 2024-09-10T05:36:35.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.547+0000 7f7c53fd49c0 1 -- start start 2024-09-10T05:36:35.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.547+0000 7f7c53fd49c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564103f16200 0x564104008d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.547+0000 7f7c53fd49c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564103dbea50 con 0x564103f16200 2024-09-10T05:36:35.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.547+0000 7f7c51ada640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564103f16200 0x564104008d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.547+0000 7f7c51ada640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564103f16200 0x564104008d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47016/0 (socket says 172.21.15.62:47016) 2024-09-10T05:36:35.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.547+0000 7f7c51ada640 1 -- 172.21.15.62:0/3295367619 learned_addr learned my addr 172.21.15.62:0/3295367619 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:35.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.547+0000 7f7c51ada640 1 -- 172.21.15.62:0/3295367619 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641040092d0 con 0x564103f16200 2024-09-10T05:36:35.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.547+0000 7f7c51ada640 1 --2- 172.21.15.62:0/3295367619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564103f16200 0x564104008d70 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x564104002660 tx=0x7f7c4c0040f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.547+0000 7f7b3e604640 1 -- 172.21.15.62:0/3295367619 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c4c012030 con 0x564103f16200 2024-09-10T05:36:35.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.547+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3295367619 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564104009560 con 0x564103f16200 2024-09-10T05:36:35.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.547+0000 7f7b3e604640 1 -- 172.21.15.62:0/3295367619 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c4c01a720 con 0x564103f16200 2024-09-10T05:36:35.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.547+0000 7f7b3e604640 1 -- 172.21.15.62:0/3295367619 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c4c01aa60 con 0x564103f16200 2024-09-10T05:36:35.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.547+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3295367619 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564104009f10 con 0x564103f16200 2024-09-10T05:36:35.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.547+0000 7f7b3e604640 1 -- 172.21.15.62:0/3295367619 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f7c4c015020 con 0x564103f16200 2024-09-10T05:36:35.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.547+0000 7f7b3e604640 1 --2- 172.21.15.62:0/3295367619 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7b38039a70 0x7f7b3803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.547+0000 7f7b3e604640 1 -- 172.21.15.62:0/3295367619 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f7c4c020070 con 0x564103f16200 2024-09-10T05:36:35.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.547+0000 7f7c512d9640 1 --2- 172.21.15.62:0/3295367619 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7b38039a70 0x7f7b3803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.547+0000 7f7c53fd49c0 1 --2- 172.21.15.62:0/3295367619 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x564103f1a350 0x56410400fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.547+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3295367619 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564104010420 con 0x564103f1a350 2024-09-10T05:36:35.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.551+0000 7f7c522db640 1 --2- 172.21.15.62:0/3295367619 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x564103f1a350 0x56410400fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.551+0000 7f7c512d9640 1 --2- 172.21.15.62:0/3295367619 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7b38039a70 0x7f7b3803bf30 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c0ae000 tx=0x7f7c3c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.551+0000 7f7c522db640 1 --2- 172.21.15.62:0/3295367619 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x564103f1a350 0x56410400fee0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.551+0000 7f7c522db640 1 -- 172.21.15.62:0/3295367619 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7c4400a4d0 con 0x564103f1a350 2024-09-10T05:36:35.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.551+0000 7f7c53fd49c0 1 --2- 172.21.15.62:0/3295367619 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x564104011180 0x564104013570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.551+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3295367619 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564104013b60 con 0x564104011180 2024-09-10T05:36:35.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.551+0000 7f7c51ada640 1 --2- 172.21.15.62:0/3295367619 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x564104011180 0x564104013570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.551+0000 7f7c51ada640 1 --2- 172.21.15.62:0/3295367619 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x564104011180 0x564104013570 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.551+0000 7f7c51ada640 1 -- 172.21.15.62:0/3295367619 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7c4c008030 con 0x564104011180 2024-09-10T05:36:35.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.551+0000 7f7c53fd49c0 1 --2- 172.21.15.62:0/3295367619 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x564104015920 0x564104017d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.551+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3295367619 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5641040183e0 con 0x564104015920 2024-09-10T05:36:35.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.551+0000 7f7c512d9640 1 --2- 172.21.15.62:0/3295367619 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x564104015920 0x564104017d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.551+0000 7f7c512d9640 1 --2- 172.21.15.62:0/3295367619 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x564104015920 0x564104017d10 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.551+0000 7f7c512d9640 1 -- 172.21.15.62:0/3295367619 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7c3c0a8070 con 0x564104015920 2024-09-10T05:36:35.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.551+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3295367619 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5641040147c0 con 0x564104011180 2024-09-10T05:36:35.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.555+0000 7f7c51ada640 1 -- 172.21.15.62:0/3295367619 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7c4c008030 con 0x564104011180 2024-09-10T05:36:35.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.555+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3295367619 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564104014be0 con 0x564104015920 2024-09-10T05:36:35.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.555+0000 7f7c512d9640 1 -- 172.21.15.62:0/3295367619 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7c3c0a8070 con 0x564104015920 2024-09-10T05:36:35.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.555+0000 7f7c53fd49c0 1 Processor -- start 2024-09-10T05:36:35.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.555+0000 7f7c53fd49c0 1 -- start start 2024-09-10T05:36:35.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.555+0000 7f7c53fd49c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564104026a30 0x564104026e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.555+0000 7f7c53fd49c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564103e29450 con 0x564104026a30 2024-09-10T05:36:35.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.555+0000 7f7c51ada640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564104026a30 0x564104026e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.555+0000 7f7c51ada640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564104026a30 0x564104026e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47028/0 (socket says 172.21.15.62:47028) 2024-09-10T05:36:35.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.555+0000 7f7c51ada640 1 -- 172.21.15.62:0/2660213702 learned_addr learned my addr 172.21.15.62:0/2660213702 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:35.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.555+0000 7f7c51ada640 1 -- 172.21.15.62:0/2660213702 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564104027490 con 0x564104026a30 2024-09-10T05:36:35.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.555+0000 7f7c51ada640 1 --2- 172.21.15.62:0/2660213702 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564104026a30 0x564104026e50 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c04eb60 tx=0x7f7c4c040f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.555+0000 7f7b377fe640 1 -- 172.21.15.62:0/2660213702 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c4c050080 con 0x564104026a30 2024-09-10T05:36:35.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.555+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/2660213702 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564104027cf0 con 0x564104026a30 2024-09-10T05:36:35.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.555+0000 7f7b377fe640 1 -- 172.21.15.62:0/2660213702 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c4c050220 con 0x564104026a30 2024-09-10T05:36:35.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.555+0000 7f7b377fe640 1 -- 172.21.15.62:0/2660213702 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c4c050520 con 0x564104026a30 2024-09-10T05:36:35.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.555+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/2660213702 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564104028260 con 0x564104026a30 2024-09-10T05:36:35.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.559+0000 7f7b377fe640 1 -- 172.21.15.62:0/2660213702 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f7c4c009070 con 0x564104026a30 2024-09-10T05:36:35.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.559+0000 7f7b377fe640 1 --2- 172.21.15.62:0/2660213702 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7b2c039a70 0x7f7b2c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.559+0000 7f7b377fe640 1 -- 172.21.15.62:0/2660213702 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f7c4c005050 con 0x564104026a30 2024-09-10T05:36:35.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.559+0000 7f7c512d9640 1 --2- 172.21.15.62:0/2660213702 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7b2c039a70 0x7f7b2c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.559+0000 7f7c53fd49c0 1 Processor -- start 2024-09-10T05:36:35.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.559+0000 7f7c53fd49c0 1 -- start start 2024-09-10T05:36:35.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.559+0000 7f7c512d9640 1 --2- 172.21.15.62:0/2660213702 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7b2c039a70 0x7f7b2c03bf30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x56410400a1c0 tx=0x7f7c3c005a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.559+0000 7f7c53fd49c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564104033190 0x564104033570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.559+0000 7f7c53fd49c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564104001f20 con 0x564104033190 2024-09-10T05:36:35.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.559+0000 7f7c51ada640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564104033190 0x564104033570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.559+0000 7f7c51ada640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564104033190 0x564104033570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47030/0 (socket says 172.21.15.62:47030) 2024-09-10T05:36:35.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.559+0000 7f7c51ada640 1 -- 172.21.15.62:0/1828150449 learned_addr learned my addr 172.21.15.62:0/1828150449 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:35.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.559+0000 7f7c51ada640 1 -- 172.21.15.62:0/1828150449 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564104033b40 con 0x564104033190 2024-09-10T05:36:35.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.559+0000 7f7c51ada640 1 --2- 172.21.15.62:0/1828150449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564104033190 0x564104033570 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c022520 tx=0x7f7c4c00ff20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4162cf8276f51b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.559+0000 7f7b357fa640 1 -- 172.21.15.62:0/1828150449 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c4c03b070 con 0x564104033190 2024-09-10T05:36:35.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.559+0000 7f7b357fa640 1 -- 172.21.15.62:0/1828150449 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c4c00d3e0 con 0x564104033190 2024-09-10T05:36:35.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.559+0000 7f7b357fa640 1 -- 172.21.15.62:0/1828150449 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c4c047ad0 con 0x564104033190 2024-09-10T05:36:35.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.559+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/1828150449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564104033190 msgr2=0x564104033570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.559+0000 7f7c53fd49c0 1 --2- 172.21.15.62:0/1828150449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564104033190 0x564104033570 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c022520 tx=0x7f7c4c00ff20 comp rx=0 tx=0).stop 2024-09-10T05:36:35.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.559+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/1828150449 shutdown_connections 2024-09-10T05:36:35.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.559+0000 7f7c53fd49c0 1 --2- 172.21.15.62:0/1828150449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564104033190 0x564104033570 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:35.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.559+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/1828150449 >> 172.21.15.62:0/1828150449 conn(0x56410402f5c0 msgr2=0x56410402d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:35.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.559+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/1828150449 shutdown_connections 2024-09-10T05:36:35.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.559+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/1828150449 wait complete. 2024-09-10T05:36:35.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.559+0000 7f7c53fd49c0 1 Processor -- start 2024-09-10T05:36:35.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.559+0000 7f7c53fd49c0 1 -- start start 2024-09-10T05:36:35.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.559+0000 7f7c53fd49c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564104033190 0x56410403a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.559+0000 7f7c53fd49c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564104034020 con 0x564104033190 2024-09-10T05:36:35.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.563+0000 7f7c51ada640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564104033190 0x56410403a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.563+0000 7f7c51ada640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564104033190 0x56410403a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47032/0 (socket says 172.21.15.62:47032) 2024-09-10T05:36:35.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.563+0000 7f7c51ada640 1 -- 172.21.15.62:0/3133533302 learned_addr learned my addr 172.21.15.62:0/3133533302 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:35.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.563+0000 7f7c51ada640 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56410403a9d0 con 0x564104033190 2024-09-10T05:36:35.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.563+0000 7f7c51ada640 1 --2- 172.21.15.62:0/3133533302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564104033190 0x56410403a470 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c02ee60 tx=0x7f7c4c04dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.563+0000 7f7b237fe640 1 -- 172.21.15.62:0/3133533302 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c4c069070 con 0x564104033190 2024-09-10T05:36:35.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.563+0000 7f7b237fe640 1 -- 172.21.15.62:0/3133533302 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c4c00d3e0 con 0x564104033190 2024-09-10T05:36:35.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.563+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56410403a9d0 con 0x564104033190 2024-09-10T05:36:35.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.563+0000 7f7b237fe640 1 -- 172.21.15.62:0/3133533302 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c4c0228f0 con 0x564104033190 2024-09-10T05:36:35.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.563+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56410403a9d0 con 0x564104033190 2024-09-10T05:36:35.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.563+0000 7f7b237fe640 1 -- 172.21.15.62:0/3133533302 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f7c4c047e00 con 0x564104033190 2024-09-10T05:36:35.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.563+0000 7f7c53fd49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.563+0000 7f7b237fe640 1 --2- 172.21.15.62:0/3133533302 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7b1c039a70 0x7f7b1c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.563+0000 7f7b237fe640 1 -- 172.21.15.62:0/3133533302 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f7c4c05f070 con 0x564104033190 2024-09-10T05:36:35.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.563+0000 7f7c512d9640 1 --2- 172.21.15.62:0/3133533302 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7b1c039a70 0x7f7b1c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.563+0000 7f7c53fd49c0 1 --2- 172.21.15.62:0/3133533302 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x564104045420 0x5641040478b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.563+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564104048000 con 0x564104045420 2024-09-10T05:36:35.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.563+0000 7f7c522db640 1 --2- 172.21.15.62:0/3133533302 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x564104045420 0x5641040478b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.563+0000 7f7c512d9640 1 --2- 172.21.15.62:0/3133533302 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7b1c039a70 0x7f7b1c03bf30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c01b350 tx=0x7f7c3c0a8000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.563+0000 7f7c522db640 1 --2- 172.21.15.62:0/3133533302 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x564104045420 0x5641040478b0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.563+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7c4400a4d0 con 0x564104045420 2024-09-10T05:36:35.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.563+0000 7f7c53fd49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:35.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.563+0000 7f7c53fd49c0 20 realm 2024-09-10T05:36:35.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.563+0000 7f7c53fd49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.563+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5641040447b0 con 0x564104045420 2024-09-10T05:36:35.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.567+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7c4400a4d0 con 0x564104045420 2024-09-10T05:36:35.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.567+0000 7f7c53fd49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:35.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.567+0000 7f7c53fd49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:35.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.567+0000 7f7c53fd49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.567+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564104048ac0 con 0x564104045420 2024-09-10T05:36:35.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.567+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7c4400a4d0 con 0x564104045420 2024-09-10T05:36:35.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.567+0000 7f7c53fd49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:35.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.567+0000 7f7c53fd49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.567+0000 7f7c53fd49c0 1 --2- 172.21.15.62:0/3133533302 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5641040498a0 0x56410404bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.567+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56410404c320 con 0x5641040498a0 2024-09-10T05:36:35.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.567+0000 7f7c51ada640 1 --2- 172.21.15.62:0/3133533302 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5641040498a0 0x56410404bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.567+0000 7f7c51ada640 1 --2- 172.21.15.62:0/3133533302 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5641040498a0 0x56410404bc90 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.567+0000 7f7c51ada640 1 -- 172.21.15.62:0/3133533302 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7c4c034070 con 0x5641040498a0 2024-09-10T05:36:35.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.567+0000 7f7c53fd49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:35.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.567+0000 7f7c53fd49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.567+0000 7f7c53fd49c0 1 --2- 172.21.15.62:0/3133533302 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56410404d0d0 0x56410404f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.567+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56410404fb20 con 0x56410404d0d0 2024-09-10T05:36:35.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.567+0000 7f7c512d9640 1 --2- 172.21.15.62:0/3133533302 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56410404d0d0 0x56410404f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.567+0000 7f7c512d9640 1 --2- 172.21.15.62:0/3133533302 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56410404d0d0 0x56410404f4c0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.567+0000 7f7c512d9640 1 -- 172.21.15.62:0/3133533302 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7c3c0d2040 con 0x56410404d0d0 2024-09-10T05:36:35.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.567+0000 7f7c53fd49c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:35.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.567+0000 7f7c53fd49c0 20 searching for the correct realm 2024-09-10T05:36:35.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.567+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641040513f0 con 0x56410404d0d0 2024-09-10T05:36:35.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.567+0000 7f7c512d9640 1 -- 172.21.15.62:0/3133533302 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c3c0d2040 con 0x56410404d0d0 2024-09-10T05:36:35.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.567+0000 7f7c512d9640 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641040513f0 con 0x5641040498a0 2024-09-10T05:36:35.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.571+0000 7f7c51ada640 1 -- 172.21.15.62:0/3133533302 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c4c034070 con 0x5641040498a0 2024-09-10T05:36:35.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.571+0000 7f7c51ada640 1 --2- 172.21.15.62:0/3133533302 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f7c4c05a070 0x7f7c4c0541b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.571+0000 7f7c51ada640 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641040513f0 con 0x7f7c4c05a070 2024-09-10T05:36:35.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.571+0000 7f7c522db640 1 --2- 172.21.15.62:0/3133533302 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f7c4c05a070 0x7f7c4c0541b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.571+0000 7f7c522db640 1 --2- 172.21.15.62:0/3133533302 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f7c4c05a070 0x7f7c4c0541b0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.571+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c4400a4d0 con 0x7f7c4c05a070 2024-09-10T05:36:35.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.571+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641040513f0 con 0x564104045420 2024-09-10T05:36:35.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.571+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c4400a4d0 con 0x564104045420 2024-09-10T05:36:35.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.571+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641040513f0 con 0x564104045420 2024-09-10T05:36:35.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.571+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c4400a4d0 con 0x564104045420 2024-09-10T05:36:35.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.571+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641040513f0 con 0x56410404d0d0 2024-09-10T05:36:35.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.571+0000 7f7c512d9640 1 -- 172.21.15.62:0/3133533302 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c3c0d2040 con 0x56410404d0d0 2024-09-10T05:36:35.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.571+0000 7f7c512d9640 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641040513f0 con 0x564104045420 2024-09-10T05:36:35.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.571+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c4400a4d0 con 0x564104045420 2024-09-10T05:36:35.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.571+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641040513f0 con 0x5641040498a0 2024-09-10T05:36:35.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.571+0000 7f7c51ada640 1 -- 172.21.15.62:0/3133533302 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c4c034070 con 0x5641040498a0 2024-09-10T05:36:35.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.571+0000 7f7c51ada640 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641040513f0 con 0x5641040498a0 2024-09-10T05:36:35.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.571+0000 7f7c51ada640 1 -- 172.21.15.62:0/3133533302 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c4c034070 con 0x5641040498a0 2024-09-10T05:36:35.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.571+0000 7f7c51ada640 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641040513f0 con 0x564104045420 2024-09-10T05:36:35.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.571+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c4400a4d0 con 0x564104045420 2024-09-10T05:36:35.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.571+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641040513f0 con 0x7f7c4c05a070 2024-09-10T05:36:35.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.575+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c4400a4d0 con 0x7f7c4c05a070 2024-09-10T05:36:35.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.575+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641040513f0 con 0x564104045420 2024-09-10T05:36:35.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.575+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c4400a4d0 con 0x564104045420 2024-09-10T05:36:35.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.575+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641040513f0 con 0x7f7c4c05a070 2024-09-10T05:36:35.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.575+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7c4400a4d0 con 0x7f7c4c05a070 2024-09-10T05:36:35.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.575+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641040513f0 con 0x5641040498a0 2024-09-10T05:36:35.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.575+0000 7f7c51ada640 1 -- 172.21.15.62:0/3133533302 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c4c034070 con 0x5641040498a0 2024-09-10T05:36:35.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.575+0000 7f7c51ada640 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641040513f0 con 0x56410404d0d0 2024-09-10T05:36:35.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.575+0000 7f7c512d9640 1 -- 172.21.15.62:0/3133533302 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c3c0d2040 con 0x56410404d0d0 2024-09-10T05:36:35.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.575+0000 7f7c512d9640 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641040513f0 con 0x564104045420 2024-09-10T05:36:35.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.575+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c4400a4d0 con 0x564104045420 2024-09-10T05:36:35.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.575+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641040513f0 con 0x5641040498a0 2024-09-10T05:36:35.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.575+0000 7f7c51ada640 1 -- 172.21.15.62:0/3133533302 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c4c034070 con 0x5641040498a0 2024-09-10T05:36:35.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.575+0000 7f7c51ada640 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641040513f0 con 0x56410404d0d0 2024-09-10T05:36:35.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.575+0000 7f7c512d9640 1 -- 172.21.15.62:0/3133533302 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 30 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f7c3c0d2040 con 0x56410404d0d0 2024-09-10T05:36:35.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.575+0000 7f7c512d9640 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641040513f0 con 0x564104045420 2024-09-10T05:36:35.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.575+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c4400a4d0 con 0x564104045420 2024-09-10T05:36:35.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.575+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641040513f0 con 0x564104045420 2024-09-10T05:36:35.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.575+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7c4400a4d0 con 0x564104045420 2024-09-10T05:36:35.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.575+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641040513f0 con 0x564104045420 2024-09-10T05:36:35.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.579+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c4400a4d0 con 0x564104045420 2024-09-10T05:36:35.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.579+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641040513f0 con 0x56410404d0d0 2024-09-10T05:36:35.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.579+0000 7f7c512d9640 1 -- 172.21.15.62:0/3133533302 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c3c0d2040 con 0x56410404d0d0 2024-09-10T05:36:35.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.579+0000 7f7c512d9640 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641040513f0 con 0x7f7c4c05a070 2024-09-10T05:36:35.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.579+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c4400a4d0 con 0x7f7c4c05a070 2024-09-10T05:36:35.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.579+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641040513f0 con 0x564104045420 2024-09-10T05:36:35.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.579+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c4400a4d0 con 0x564104045420 2024-09-10T05:36:35.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.579+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641040513f0 con 0x7f7c4c05a070 2024-09-10T05:36:35.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.579+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c4400a4d0 con 0x7f7c4c05a070 2024-09-10T05:36:35.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.579+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641040513f0 con 0x56410404d0d0 2024-09-10T05:36:35.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.579+0000 7f7c512d9640 1 -- 172.21.15.62:0/3133533302 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c3c0d2040 con 0x56410404d0d0 2024-09-10T05:36:35.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.579+0000 7f7c512d9640 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641040513f0 con 0x7f7c4c05a070 2024-09-10T05:36:35.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.579+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c4400a4d0 con 0x7f7c4c05a070 2024-09-10T05:36:35.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.579+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641040513f0 con 0x5641040498a0 2024-09-10T05:36:35.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.579+0000 7f7c51ada640 1 -- 172.21.15.62:0/3133533302 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c4c034070 con 0x5641040498a0 2024-09-10T05:36:35.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.579+0000 7f7c51ada640 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641040513f0 con 0x5641040498a0 2024-09-10T05:36:35.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.579+0000 7f7c51ada640 1 -- 172.21.15.62:0/3133533302 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c4c034070 con 0x5641040498a0 2024-09-10T05:36:35.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.579+0000 7f7c51ada640 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641040513f0 con 0x56410404d0d0 2024-09-10T05:36:35.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.579+0000 7f7c512d9640 1 -- 172.21.15.62:0/3133533302 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c3c0d2040 con 0x56410404d0d0 2024-09-10T05:36:35.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.579+0000 7f7c512d9640 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641040513f0 con 0x5641040498a0 2024-09-10T05:36:35.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.583+0000 7f7c51ada640 1 -- 172.21.15.62:0/3133533302 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7c4c034070 con 0x5641040498a0 2024-09-10T05:36:35.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.583+0000 7f7c51ada640 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641040513f0 con 0x5641040498a0 2024-09-10T05:36:35.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.583+0000 7f7c51ada640 1 -- 172.21.15.62:0/3133533302 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c4c034070 con 0x5641040498a0 2024-09-10T05:36:35.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.583+0000 7f7c53fd49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:35.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.583+0000 7f7c53fd49c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:35.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.583+0000 7f7c53fd49c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:35.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.583+0000 7f7c53fd49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:35.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.583+0000 7f7c53fd49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:35.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.583+0000 7f7c53fd49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:35.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.583+0000 7f7c53fd49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.583+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5641040504e0 con 0x564104045420 2024-09-10T05:36:35.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.583+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7c4400a4d0 con 0x564104045420 2024-09-10T05:36:35.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.583+0000 7f7c53fd49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:35.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.583+0000 7f7c53fd49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.583+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564104050960 con 0x5641040498a0 2024-09-10T05:36:35.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.583+0000 7f7c51ada640 1 -- 172.21.15.62:0/3133533302 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7c4c034070 con 0x5641040498a0 2024-09-10T05:36:35.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.583+0000 7f7c53fd49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:35.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.583+0000 7f7c53fd49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.583+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564104050d80 con 0x56410404d0d0 2024-09-10T05:36:35.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.583+0000 7f7c512d9640 1 -- 172.21.15.62:0/3133533302 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7c3c0d2040 con 0x56410404d0d0 2024-09-10T05:36:35.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.583+0000 7f7c53fd49c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:35.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.583+0000 7f7c53fd49c0 20 zone default found 2024-09-10T05:36:35.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.583+0000 7f7c53fd49c0 4 Realm: () 2024-09-10T05:36:35.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.583+0000 7f7c53fd49c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:35.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.583+0000 7f7c53fd49c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:35.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.583+0000 7f7c53fd49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:35.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.583+0000 7f7c53fd49c0 20 zonegroup default 2024-09-10T05:36:35.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.583+0000 7f7c53fd49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.583+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5641040518c0 con 0x7f7c4c05a070 2024-09-10T05:36:35.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.583+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7c4400a4d0 con 0x7f7c4c05a070 2024-09-10T05:36:35.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.583+0000 7f7c53fd49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:35.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.583+0000 7f7c53fd49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.583+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564104053b80 con 0x56410404d0d0 2024-09-10T05:36:35.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.583+0000 7f7c512d9640 1 -- 172.21.15.62:0/3133533302 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7c3c0d2040 con 0x56410404d0d0 2024-09-10T05:36:35.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.583+0000 7f7c53fd49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:35.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.583+0000 7f7c53fd49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.583+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564104053fa0 con 0x56410404d0d0 2024-09-10T05:36:35.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.583+0000 7f7c512d9640 1 -- 172.21.15.62:0/3133533302 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7c3c0d2040 con 0x56410404d0d0 2024-09-10T05:36:35.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.583+0000 7f7c53fd49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:35.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.583+0000 7f7c53fd49c0 20 started sync module instance, tier type = 2024-09-10T05:36:35.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.583+0000 7f7c53fd49c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:35.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.583+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564104052fc0 con 0x5641040498a0 2024-09-10T05:36:35.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.587+0000 7f7c51ada640 1 -- 172.21.15.62:0/3133533302 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c4c034070 con 0x5641040498a0 2024-09-10T05:36:35.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.587+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94837240312800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564104052fc0 con 0x5641040498a0 2024-09-10T05:36:35.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.587+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5641040548b0 con 0x564104045420 2024-09-10T05:36:35.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.587+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c4400a4d0 con 0x564104045420 2024-09-10T05:36:35.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.587+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94837240316928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564104055100 con 0x564104045420 2024-09-10T05:36:35.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.587+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564104055990 con 0x5641040498a0 2024-09-10T05:36:35.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.587+0000 7f7c51ada640 1 -- 172.21.15.62:0/3133533302 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94837240312800] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c4c034070 con 0x5641040498a0 2024-09-10T05:36:35.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.591+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94837240316928] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c4400a4d0 con 0x564104045420 2024-09-10T05:36:35.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.591+0000 7f7c51ada640 1 -- 172.21.15.62:0/3133533302 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c4c034070 con 0x5641040498a0 2024-09-10T05:36:35.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.591+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94837240310544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564104055100 con 0x5641040498a0 2024-09-10T05:36:35.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.591+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564104056230 con 0x7f7c4c05a070 2024-09-10T05:36:35.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.591+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c4400a4d0 con 0x7f7c4c05a070 2024-09-10T05:36:35.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.591+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94837240323456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564104055100 con 0x7f7c4c05a070 2024-09-10T05:36:35.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.591+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564104056cd0 con 0x5641040498a0 2024-09-10T05:36:35.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.591+0000 7f7c51ada640 1 -- 172.21.15.62:0/3133533302 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94837240310544] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c4c034070 con 0x5641040498a0 2024-09-10T05:36:35.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.595+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94837240323456] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c4400a4d0 con 0x7f7c4c05a070 2024-09-10T05:36:35.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.595+0000 7f7c51ada640 1 -- 172.21.15.62:0/3133533302 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c4c034070 con 0x5641040498a0 2024-09-10T05:36:35.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.595+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94837240326080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564104054c50 con 0x5641040498a0 2024-09-10T05:36:35.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.595+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564104057570 con 0x56410404d0d0 2024-09-10T05:36:35.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.595+0000 7f7c512d9640 1 -- 172.21.15.62:0/3133533302 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c3c0d2040 con 0x56410404d0d0 2024-09-10T05:36:35.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.595+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94837240328384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564104054c50 con 0x56410404d0d0 2024-09-10T05:36:35.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.595+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564104057fb0 con 0x56410404d0d0 2024-09-10T05:36:35.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.595+0000 7f7c51ada640 1 -- 172.21.15.62:0/3133533302 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94837240326080] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c4c034070 con 0x5641040498a0 2024-09-10T05:36:35.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.599+0000 7f7c512d9640 1 -- 172.21.15.62:0/3133533302 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94837240328384] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c3c0d2040 con 0x56410404d0d0 2024-09-10T05:36:35.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.599+0000 7f7c512d9640 1 -- 172.21.15.62:0/3133533302 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c3c0d2040 con 0x56410404d0d0 2024-09-10T05:36:35.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.599+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94837240329440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564104057b00 con 0x56410404d0d0 2024-09-10T05:36:35.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.599+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5641040584c0 con 0x7f7c4c05a070 2024-09-10T05:36:35.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.599+0000 7f7c512d9640 1 -- 172.21.15.62:0/3133533302 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94837240329440] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c3c0d2040 con 0x56410404d0d0 2024-09-10T05:36:35.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.599+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c4400a4d0 con 0x7f7c4c05a070 2024-09-10T05:36:35.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.599+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94837240324512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5641040584c0 con 0x7f7c4c05a070 2024-09-10T05:36:35.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.599+0000 7f7c53fd49c0 20 add_watcher() i=0 2024-09-10T05:36:35.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.599+0000 7f7c53fd49c0 20 add_watcher() i=1 2024-09-10T05:36:35.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.599+0000 7f7c53fd49c0 20 add_watcher() i=2 2024-09-10T05:36:35.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.599+0000 7f7c53fd49c0 20 add_watcher() i=3 2024-09-10T05:36:35.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.599+0000 7f7c53fd49c0 20 add_watcher() i=4 2024-09-10T05:36:35.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.599+0000 7f7c53fd49c0 20 add_watcher() i=5 2024-09-10T05:36:35.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.599+0000 7f7c53fd49c0 20 add_watcher() i=6 2024-09-10T05:36:35.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.603+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94837240324512] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c4400a4d0 con 0x7f7c4c05a070 2024-09-10T05:36:35.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.603+0000 7f7c53fd49c0 20 add_watcher() i=7 2024-09-10T05:36:35.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.603+0000 7f7c53fd49c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:35.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.603+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56410405b970 con 0x564104045420 2024-09-10T05:36:35.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.603+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7c4400a4d0 con 0x564104045420 2024-09-10T05:36:35.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.603+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94837240332848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564104058ec0 con 0x564104045420 2024-09-10T05:36:35.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.603+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94837240332848] v30'104 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7c4400a4d0 con 0x564104045420 2024-09-10T05:36:35.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.603+0000 7f7b07fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:35.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.603+0000 7f7c53fd49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:35.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.603+0000 7f7c53fd49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:35.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.603+0000 7f7c53fd49c0 5 note: GC not initialized 2024-09-10T05:36:35.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.603+0000 7f7b06fe5640 20 reqs_thread_entry: start 2024-09-10T05:36:35.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.603+0000 7f7c53fd49c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:35.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.603+0000 7f7c53fd49c0 20 Filter name: none 2024-09-10T05:36:35.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.603+0000 7f7b04fe1640 20 reqs_thread_entry: start 2024-09-10T05:36:35.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.603+0000 7f7c53fd49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.603+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56410407e7c0 con 0x564104045420 2024-09-10T05:36:35.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.607+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f7c4400a4d0 con 0x564104045420 2024-09-10T05:36:35.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.607+0000 7f7c53fd49c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:36:35.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.607+0000 7f7c53fd49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.607+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56410407f1e0 con 0x564104045420 2024-09-10T05:36:35.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.607+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f7c4400a4d0 con 0x564104045420 2024-09-10T05:36:35.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.607+0000 7f7c53fd49c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:36:35.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.607+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5641040801f0 con 0x7f7c4c05a070 2024-09-10T05:36:35.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.607+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f7c4400a4d0 con 0x7f7c4c05a070 2024-09-10T05:36:35.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.607+0000 7f7c53fd49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.607+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:65 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56410407d940 con 0x7f7c4c05a070 2024-09-10T05:36:35.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.607+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(65 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f7c4400a4d0 con 0x7f7c4c05a070 2024-09-10T05:36:35.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.607+0000 7f7c53fd49c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T05:36:35.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.607+0000 7f7c53fd49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.607+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:66 8.1f 8:fcc5c255:root::.bucket.meta.myfoo%3a475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56410407fee0 con 0x7f7c4c05a070 2024-09-10T05:36:35.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.607+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(66 .bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f7c4400a4d0 con 0x7f7c4c05a070 2024-09-10T05:36:35.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.607+0000 7f7c53fd49c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T05:36:35.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.607+0000 7f7c53fd49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-10T05:36:35.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.607+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:67 4.39 4:9f393805:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56410407f450 con 0x56410404d0d0 2024-09-10T05:36:35.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.607+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:68 4.27 4:e72118f4:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564104084a50 con 0x564104045420 2024-09-10T05:36:35.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.607+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:69 4.32 4:4fe9cf27:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5641040872c0 con 0x5641040498a0 2024-09-10T05:36:35.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.607+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:70 4.c 4:3284697f:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564104089b30 con 0x564104045420 2024-09-10T05:36:35.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.607+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 4.a 4:5050a708:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564104089b30 con 0x5641040498a0 2024-09-10T05:36:35.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.607+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:72 4.1b 4:db0b4800:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56410408eb40 con 0x7f7c4c05a070 2024-09-10T05:36:35.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.607+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(68 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f7c4400a4d0 con 0x564104045420 2024-09-10T05:36:35.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.607+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:73 4.1f 4:fa625c04:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564104091570 con 0x5641040498a0 2024-09-10T05:36:35.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.607+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(70 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f7c4400a4d0 con 0x564104045420 2024-09-10T05:36:35.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.607+0000 7f7c512d9640 1 -- 172.21.15.62:0/3133533302 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(67 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f7c3c0d2040 con 0x56410404d0d0 2024-09-10T05:36:35.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.607+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:74 4.d 4:b20f8417:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564104091570 con 0x5641040498a0 2024-09-10T05:36:35.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.607+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:75 4.3 4:c3f62267:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564104082a30 con 0x564104045420 2024-09-10T05:36:35.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.607+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:76 4.26 4:65fa9cda:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564104084360 con 0x564104045420 2024-09-10T05:36:35.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.607+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 <== osd.2 v2:172.21.15.62:6800/2677868286 15 ==== osd_op_reply(72 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f7c4400a4d0 con 0x7f7c4c05a070 2024-09-10T05:36:35.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.607+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:77 4.3e 4:7c38a587:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564104082a30 con 0x5641040498a0 2024-09-10T05:36:35.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.607+0000 7f7c51ada640 1 -- 172.21.15.62:0/3133533302 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(71 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f7c4c034070 con 0x5641040498a0 2024-09-10T05:36:35.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.607+0000 7f7c51ada640 1 -- 172.21.15.62:0/3133533302 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(69 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f7c4c034070 con 0x5641040498a0 2024-09-10T05:36:35.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.607+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 <== osd.1 v2:172.21.15.62:6808/3442097179 23 ==== osd_op_reply(75 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f7c4400a4d0 con 0x564104045420 2024-09-10T05:36:35.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.607+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 <== osd.1 v2:172.21.15.62:6808/3442097179 24 ==== osd_op_reply(76 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f7c4400a4d0 con 0x564104045420 2024-09-10T05:36:35.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.607+0000 7f7c51ada640 1 -- 172.21.15.62:0/3133533302 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(73 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f7c4c034070 con 0x5641040498a0 2024-09-10T05:36:35.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.607+0000 7f7c51ada640 1 -- 172.21.15.62:0/3133533302 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== osd_op_reply(74 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f7c4c034070 con 0x5641040498a0 2024-09-10T05:36:35.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.607+0000 7f7c51ada640 1 -- 172.21.15.62:0/3133533302 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== osd_op_reply(77 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f7c4c034070 con 0x5641040498a0 2024-09-10T05:36:35.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.611+0000 7f7b07fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:35.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.611+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94837240332848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56410407c680 con 0x564104045420 2024-09-10T05:36:35.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.611+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 <== osd.1 v2:172.21.15.62:6808/3442097179 25 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94837240332848] v30'105 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7c4400a4d0 con 0x564104045420 2024-09-10T05:36:35.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.611+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94837240312800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56410407c680 con 0x5641040498a0 2024-09-10T05:36:35.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.615+0000 7f7c51ada640 1 -- 172.21.15.62:0/3133533302 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94837240312800] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c4c034070 con 0x5641040498a0 2024-09-10T05:36:35.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.615+0000 7f7c53fd49c0 20 remove_watcher() i=0 2024-09-10T05:36:35.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.615+0000 7f7c53fd49c0 2 removed watcher, disabling cache 2024-09-10T05:36:35.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.615+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94837240316928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56410407c680 con 0x564104045420 2024-09-10T05:36:35.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.615+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 <== osd.1 v2:172.21.15.62:6808/3442097179 26 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94837240316928] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c4400a4d0 con 0x564104045420 2024-09-10T05:36:35.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.615+0000 7f7c53fd49c0 20 remove_watcher() i=1 2024-09-10T05:36:35.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.615+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94837240310544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56410407c680 con 0x5641040498a0 2024-09-10T05:36:35.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.619+0000 7f7c51ada640 1 -- 172.21.15.62:0/3133533302 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94837240310544] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c4c034070 con 0x5641040498a0 2024-09-10T05:36:35.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.619+0000 7f7c53fd49c0 20 remove_watcher() i=2 2024-09-10T05:36:35.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.619+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94837240323456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56410407c680 con 0x7f7c4c05a070 2024-09-10T05:36:35.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.619+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 <== osd.2 v2:172.21.15.62:6800/2677868286 16 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94837240323456] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c4400a4d0 con 0x7f7c4c05a070 2024-09-10T05:36:35.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.619+0000 7f7c53fd49c0 20 remove_watcher() i=3 2024-09-10T05:36:35.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.619+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94837240326080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56410407c680 con 0x5641040498a0 2024-09-10T05:36:35.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.619+0000 7f7c51ada640 1 -- 172.21.15.62:0/3133533302 <== osd.0 v2:172.21.15.2:6800/945139080 25 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94837240326080] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c4c034070 con 0x5641040498a0 2024-09-10T05:36:35.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.619+0000 7f7c53fd49c0 20 remove_watcher() i=4 2024-09-10T05:36:35.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.619+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94837240328384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56410407c680 con 0x56410404d0d0 2024-09-10T05:36:35.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.623+0000 7f7c512d9640 1 -- 172.21.15.62:0/3133533302 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94837240328384] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c3c0d2040 con 0x56410404d0d0 2024-09-10T05:36:35.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.623+0000 7f7c53fd49c0 20 remove_watcher() i=5 2024-09-10T05:36:35.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.623+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94837240329440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56410407c680 con 0x56410404d0d0 2024-09-10T05:36:35.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.623+0000 7f7c512d9640 1 -- 172.21.15.62:0/3133533302 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94837240329440] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c3c0d2040 con 0x56410404d0d0 2024-09-10T05:36:35.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.623+0000 7f7c53fd49c0 20 remove_watcher() i=6 2024-09-10T05:36:35.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.623+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94837240324512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56410407c680 con 0x7f7c4c05a070 2024-09-10T05:36:35.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.623+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 <== osd.2 v2:172.21.15.62:6800/2677868286 17 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94837240324512] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c4400a4d0 con 0x7f7c4c05a070 2024-09-10T05:36:35.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.623+0000 7f7c53fd49c0 20 remove_watcher() i=7 2024-09-10T05:36:35.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.623+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5641040498a0 msgr2=0x56410404bc90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.623+0000 7f7c53fd49c0 1 --2- 172.21.15.62:0/3133533302 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5641040498a0 0x56410404bc90 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:35.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.623+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x564104045420 msgr2=0x5641040478b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.623+0000 7f7c53fd49c0 1 --2- 172.21.15.62:0/3133533302 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x564104045420 0x5641040478b0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:35.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.623+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f7c4c05a070 msgr2=0x7f7c4c0541b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.623+0000 7f7c53fd49c0 1 --2- 172.21.15.62:0/3133533302 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f7c4c05a070 0x7f7c4c0541b0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:35.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.623+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56410404d0d0 msgr2=0x56410404f4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.623+0000 7f7c53fd49c0 1 --2- 172.21.15.62:0/3133533302 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56410404d0d0 0x56410404f4c0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:35.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.623+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7b1c039a70 msgr2=0x7f7b1c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.623+0000 7f7c53fd49c0 1 --2- 172.21.15.62:0/3133533302 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7b1c039a70 0x7f7b1c03bf30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c01b350 tx=0x7f7c3c0a8000 comp rx=0 tx=0).stop 2024-09-10T05:36:35.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.623+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564104033190 msgr2=0x56410403a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.623+0000 7f7c53fd49c0 1 --2- 172.21.15.62:0/3133533302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564104033190 0x56410403a470 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c02ee60 tx=0x7f7c4c04dd90 comp rx=0 tx=0).stop 2024-09-10T05:36:35.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.623+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 reap_dead start 2024-09-10T05:36:35.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.623+0000 7f7c522db640 1 -- 172.21.15.62:0/3133533302 reap_dead start 2024-09-10T05:36:35.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.623+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 shutdown_connections 2024-09-10T05:36:35.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.623+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 >> 172.21.15.62:0/3133533302 conn(0x56410402f5c0 msgr2=0x56410402d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:35.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.623+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 shutdown_connections 2024-09-10T05:36:35.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.623+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3133533302 wait complete. 2024-09-10T05:36:35.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.623+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/2660213702 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7b2c039a70 msgr2=0x7f7b2c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.623+0000 7f7c53fd49c0 1 --2- 172.21.15.62:0/2660213702 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7b2c039a70 0x7f7b2c03bf30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x56410400a1c0 tx=0x7f7c3c005a10 comp rx=0 tx=0).stop 2024-09-10T05:36:35.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.623+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/2660213702 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564104026a30 msgr2=0x564104026e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.623+0000 7f7c53fd49c0 1 --2- 172.21.15.62:0/2660213702 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564104026a30 0x564104026e50 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c04eb60 tx=0x7f7c4c040f70 comp rx=0 tx=0).stop 2024-09-10T05:36:35.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.627+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/2660213702 shutdown_connections 2024-09-10T05:36:35.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.627+0000 7f7c53fd49c0 1 --2- 172.21.15.62:0/2660213702 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7b2c039a70 0x7f7b2c03bf30 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:35.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.627+0000 7f7c53fd49c0 1 --2- 172.21.15.62:0/2660213702 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564104026a30 0x564104026e50 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:35.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.627+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/2660213702 >> 172.21.15.62:0/2660213702 conn(0x56410401c3e0 msgr2=0x56410401c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:35.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.627+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/2660213702 shutdown_connections 2024-09-10T05:36:35.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.627+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/2660213702 wait complete. 2024-09-10T05:36:35.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.627+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3295367619 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x564104011180 msgr2=0x564104013570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.627+0000 7f7c53fd49c0 1 --2- 172.21.15.62:0/3295367619 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x564104011180 0x564104013570 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:35.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.627+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3295367619 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x564103f1a350 msgr2=0x56410400fee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.627+0000 7f7c53fd49c0 1 --2- 172.21.15.62:0/3295367619 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x564103f1a350 0x56410400fee0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:35.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.627+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3295367619 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x564104015920 msgr2=0x564104017d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.627+0000 7f7c53fd49c0 1 --2- 172.21.15.62:0/3295367619 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x564104015920 0x564104017d10 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:35.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.627+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3295367619 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7b38039a70 msgr2=0x7f7b3803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.627+0000 7f7c53fd49c0 1 --2- 172.21.15.62:0/3295367619 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7b38039a70 0x7f7b3803bf30 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c0ae000 tx=0x7f7c3c0a6000 comp rx=0 tx=0).stop 2024-09-10T05:36:35.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.627+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3295367619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564103f16200 msgr2=0x564104008d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.627+0000 7f7c53fd49c0 1 --2- 172.21.15.62:0/3295367619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564103f16200 0x564104008d70 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x564104002660 tx=0x7f7c4c0040f0 comp rx=0 tx=0).stop 2024-09-10T05:36:35.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.627+0000 7f7c522db640 1 -- 172.21.15.62:0/3295367619 reap_dead start 2024-09-10T05:36:35.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.627+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3295367619 shutdown_connections 2024-09-10T05:36:35.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.627+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3295367619 >> 172.21.15.62:0/3295367619 conn(0x564103e89b10 msgr2=0x564103ffbda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:35.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.627+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3295367619 shutdown_connections 2024-09-10T05:36:35.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.627+0000 7f7c53fd49c0 1 -- 172.21.15.62:0/3295367619 wait complete. 2024-09-10T05:36:35.640 INFO:teuthology.orchestra.run.smithi062.stdout:[{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"1e560b55-359a-4aa1-8333-6dabf7061701","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1","marker":"475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-10T05:36:34.651066Z","creation_time":"2024-09-10T05:36:34.646920Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":1}] 2024-09-10T05:36:35.640 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '1e560b55-359a-4aa1-8333-6dabf7061701', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1', 'marker': '475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-10T05:36:34.651066Z', 'creation_time': '2024-09-10T05:36:34.646920Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1}] 2024-09-10T05:36:35.649 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-10T05:36:35.649 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-10T05:36:35.649 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-10T05:36:35.649 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-10T05:36:35.717 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:35.717 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:35.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.715+0000 7f712c91e9c0 1 Processor -- start 2024-09-10T05:36:35.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.715+0000 7f712c91e9c0 1 -- start start 2024-09-10T05:36:35.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.715+0000 7f712c91e9c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x556ebc8f2200 0x556ebc980c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.715+0000 7f712c91e9c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556ebc8329c0 con 0x556ebc981170 2024-09-10T05:36:35.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.715+0000 7f712c91e9c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x556ebc8826d0 con 0x556ebc8f2200 2024-09-10T05:36:35.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.715+0000 7f712a424640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x556ebc8f2200 0x556ebc980c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.715+0000 7f7129c23640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x556ebc981170 0x556ebc983560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:53022/0 (socket says 172.21.15.62:53022) 2024-09-10T05:36:35.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.715+0000 7f712a424640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x556ebc8f2200 0x556ebc980c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47036/0 (socket says 172.21.15.62:47036) 2024-09-10T05:36:35.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.715+0000 7f7129c23640 1 -- 172.21.15.62:0/1809504674 learned_addr learned my addr 172.21.15.62:0/1809504674 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-10T05:36:35.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.715+0000 7f712a424640 1 -- 172.21.15.62:0/1809504674 >> v1:172.21.15.2:6789/0 conn(0x556ebc981170 legacy=0x556ebc983560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.715+0000 7f712a424640 1 -- 172.21.15.62:0/1809504674 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ebc826ca0 con 0x556ebc8f2200 2024-09-10T05:36:35.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.719+0000 7f712a424640 1 --2- 172.21.15.62:0/1809504674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ebc8f2200 0x556ebc980c30 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f711400a480 tx=0x7f711401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9370ae3a47bcaf31 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.719+0000 7f7129422640 1 -- 172.21.15.62:0/1809504674 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71140af070 con 0x556ebc8f2200 2024-09-10T05:36:35.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.719+0000 7f7129422640 1 -- 172.21.15.62:0/1809504674 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71140aa530 con 0x556ebc8f2200 2024-09-10T05:36:35.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.719+0000 7f7129422640 1 -- 172.21.15.62:0/1809504674 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71140aa830 con 0x556ebc8f2200 2024-09-10T05:36:35.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.719+0000 7f712c91e9c0 1 -- 172.21.15.62:0/1809504674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ebc8f2200 msgr2=0x556ebc980c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.719+0000 7f712c91e9c0 1 --2- 172.21.15.62:0/1809504674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ebc8f2200 0x556ebc980c30 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f711400a480 tx=0x7f711401b280 comp rx=0 tx=0).stop 2024-09-10T05:36:35.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.719+0000 7f712c91e9c0 1 -- 172.21.15.62:0/1809504674 shutdown_connections 2024-09-10T05:36:35.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.719+0000 7f712c91e9c0 1 --2- 172.21.15.62:0/1809504674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ebc8f2200 0x556ebc980c30 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:35.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.719+0000 7f712c91e9c0 1 -- 172.21.15.62:0/1809504674 >> 172.21.15.62:0/1809504674 conn(0x556ebc978920 msgr2=0x556ebc97ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:35.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.719+0000 7f712c91e9c0 1 -- 172.21.15.62:0/1809504674 shutdown_connections 2024-09-10T05:36:35.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.719+0000 7f712c91e9c0 1 -- 172.21.15.62:0/1809504674 wait complete. 2024-09-10T05:36:35.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.735+0000 7f712c91e9c0 1 Processor -- start 2024-09-10T05:36:35.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.735+0000 7f712c91e9c0 1 -- start start 2024-09-10T05:36:35.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.735+0000 7f712c91e9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ebc8f2200 0x556ebca697f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.735+0000 7f712c91e9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556ebc886680 con 0x556ebc8f2200 2024-09-10T05:36:35.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.735+0000 7f712a424640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ebc8f2200 0x556ebca697f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.735+0000 7f712a424640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ebc8f2200 0x556ebca697f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47050/0 (socket says 172.21.15.62:47050) 2024-09-10T05:36:35.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.735+0000 7f712a424640 1 -- 172.21.15.62:0/3602525438 learned_addr learned my addr 172.21.15.62:0/3602525438 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:35.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.739+0000 7f712a424640 1 -- 172.21.15.62:0/3602525438 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ebc801da0 con 0x556ebc8f2200 2024-09-10T05:36:35.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.739+0000 7f712a424640 1 --2- 172.21.15.62:0/3602525438 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ebc8f2200 0x556ebca697f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f71140aa500 tx=0x7f7114003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=222577d70b284f79 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.739+0000 7f7018608640 1 -- 172.21.15.62:0/3602525438 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71140af070 con 0x556ebc8f2200 2024-09-10T05:36:35.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.739+0000 7f7018608640 1 -- 172.21.15.62:0/3602525438 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71140bb070 con 0x556ebc8f2200 2024-09-10T05:36:35.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.739+0000 7f7018608640 1 -- 172.21.15.62:0/3602525438 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71140aa850 con 0x556ebc8f2200 2024-09-10T05:36:35.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.739+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3602525438 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ebc8f2200 msgr2=0x556ebca697f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.739+0000 7f712c91e9c0 1 --2- 172.21.15.62:0/3602525438 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ebc8f2200 0x556ebca697f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f71140aa500 tx=0x7f7114003030 comp rx=0 tx=0).stop 2024-09-10T05:36:35.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.739+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3602525438 shutdown_connections 2024-09-10T05:36:35.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.739+0000 7f712c91e9c0 1 --2- 172.21.15.62:0/3602525438 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ebc8f2200 0x556ebca697f0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:35.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.739+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3602525438 >> 172.21.15.62:0/3602525438 conn(0x556ebc978920 msgr2=0x556ebca65430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:35.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.739+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3602525438 shutdown_connections 2024-09-10T05:36:35.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.739+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3602525438 wait complete. 2024-09-10T05:36:35.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.739+0000 7f712c91e9c0 1 Processor -- start 2024-09-10T05:36:35.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.739+0000 7f712c91e9c0 1 -- start start 2024-09-10T05:36:35.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.739+0000 7f712c91e9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ebc8f2200 0x556ebca70d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.739+0000 7f712c91e9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556ebc828a50 con 0x556ebc8f2200 2024-09-10T05:36:35.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.739+0000 7f712a424640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ebc8f2200 0x556ebca70d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.739+0000 7f712a424640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ebc8f2200 0x556ebca70d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47060/0 (socket says 172.21.15.62:47060) 2024-09-10T05:36:35.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.739+0000 7f712a424640 1 -- 172.21.15.62:0/1636728867 learned_addr learned my addr 172.21.15.62:0/1636728867 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:35.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.739+0000 7f712a424640 1 -- 172.21.15.62:0/1636728867 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ebca712b0 con 0x556ebc8f2200 2024-09-10T05:36:35.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.743+0000 7f712a424640 1 --2- 172.21.15.62:0/1636728867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ebc8f2200 0x556ebca70d50 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7114019930 tx=0x7f7114018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.743+0000 7f7016e05640 1 -- 172.21.15.62:0/1636728867 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71140b6690 con 0x556ebc8f2200 2024-09-10T05:36:35.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.743+0000 7f7016e05640 1 -- 172.21.15.62:0/1636728867 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71140c3070 con 0x556ebc8f2200 2024-09-10T05:36:35.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.743+0000 7f7016e05640 1 -- 172.21.15.62:0/1636728867 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71140b6960 con 0x556ebc8f2200 2024-09-10T05:36:35.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.743+0000 7f712c91e9c0 1 -- 172.21.15.62:0/1636728867 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556ebca71540 con 0x556ebc8f2200 2024-09-10T05:36:35.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.743+0000 7f712c91e9c0 1 -- 172.21.15.62:0/1636728867 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ebca71ef0 con 0x556ebc8f2200 2024-09-10T05:36:35.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.743+0000 7f7016e05640 1 -- 172.21.15.62:0/1636728867 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f71140ce060 con 0x556ebc8f2200 2024-09-10T05:36:35.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.743+0000 7f7016e05640 1 --2- 172.21.15.62:0/1636728867 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7010039b10 0x7f701003bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.743+0000 7f7016e05640 1 -- 172.21.15.62:0/1636728867 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f71140ead80 con 0x556ebc8f2200 2024-09-10T05:36:35.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.743+0000 7f7129c23640 1 --2- 172.21.15.62:0/1636728867 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7010039b10 0x7f701003bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.743+0000 7f712c91e9c0 1 --2- 172.21.15.62:0/1636728867 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x556ebc981170 0x556ebca77ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.743+0000 7f712c91e9c0 1 -- 172.21.15.62:0/1636728867 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556ebca78400 con 0x556ebc981170 2024-09-10T05:36:35.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.743+0000 7f712ac25640 1 --2- 172.21.15.62:0/1636728867 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x556ebc981170 0x556ebca77ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.743+0000 7f7129c23640 1 --2- 172.21.15.62:0/1636728867 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7010039b10 0x7f701003bfd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f711c001650 tx=0x7f711c006720 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.747+0000 7f712ac25640 1 --2- 172.21.15.62:0/1636728867 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x556ebc981170 0x556ebca77ec0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.747+0000 7f712ac25640 1 -- 172.21.15.62:0/1636728867 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f71240083f0 con 0x556ebc981170 2024-09-10T05:36:35.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.747+0000 7f712c91e9c0 1 --2- 172.21.15.62:0/1636728867 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x556ebca78eb0 0x556ebca7b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.747+0000 7f712c91e9c0 1 -- 172.21.15.62:0/1636728867 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556ebca7bae0 con 0x556ebca78eb0 2024-09-10T05:36:35.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.747+0000 7f712a424640 1 --2- 172.21.15.62:0/1636728867 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x556ebca78eb0 0x556ebca7b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.747+0000 7f712a424640 1 --2- 172.21.15.62:0/1636728867 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x556ebca78eb0 0x556ebca7b370 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.747+0000 7f712a424640 1 -- 172.21.15.62:0/1636728867 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f71140a8070 con 0x556ebca78eb0 2024-09-10T05:36:35.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.747+0000 7f712c91e9c0 1 --2- 172.21.15.62:0/1636728867 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x556ebca7d8a0 0x556ebca7fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.747+0000 7f712c91e9c0 1 -- 172.21.15.62:0/1636728867 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556ebca80360 con 0x556ebca7d8a0 2024-09-10T05:36:35.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.747+0000 7f7129c23640 1 --2- 172.21.15.62:0/1636728867 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x556ebca7d8a0 0x556ebca7fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.747+0000 7f7129c23640 1 --2- 172.21.15.62:0/1636728867 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x556ebca7d8a0 0x556ebca7fc90 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.747+0000 7f7129c23640 1 -- 172.21.15.62:0/1636728867 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f711c00f070 con 0x556ebca7d8a0 2024-09-10T05:36:35.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.747+0000 7f712c91e9c0 1 -- 172.21.15.62:0/1636728867 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556ebca7c740 con 0x556ebca78eb0 2024-09-10T05:36:35.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.747+0000 7f712a424640 1 -- 172.21.15.62:0/1636728867 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f71140a8070 con 0x556ebca78eb0 2024-09-10T05:36:35.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.747+0000 7f712c91e9c0 1 -- 172.21.15.62:0/1636728867 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556ebca7cba0 con 0x556ebca7d8a0 2024-09-10T05:36:35.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.751+0000 7f7129c23640 1 -- 172.21.15.62:0/1636728867 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f711c00f070 con 0x556ebca7d8a0 2024-09-10T05:36:35.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.751+0000 7f712c91e9c0 1 Processor -- start 2024-09-10T05:36:35.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.751+0000 7f712c91e9c0 1 -- start start 2024-09-10T05:36:35.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.751+0000 7f712c91e9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ebc97e370 0x556ebc97cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.751+0000 7f712c91e9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556ebc893450 con 0x556ebc97e370 2024-09-10T05:36:35.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.751+0000 7f712a424640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ebc97e370 0x556ebc97cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.751+0000 7f712a424640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ebc97e370 0x556ebc97cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47072/0 (socket says 172.21.15.62:47072) 2024-09-10T05:36:35.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.751+0000 7f712a424640 1 -- 172.21.15.62:0/680692574 learned_addr learned my addr 172.21.15.62:0/680692574 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:35.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.751+0000 7f712a424640 1 -- 172.21.15.62:0/680692574 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ebc97e890 con 0x556ebc97e370 2024-09-10T05:36:35.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.751+0000 7f712a424640 1 --2- 172.21.15.62:0/680692574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ebc97e370 0x556ebc97cc10 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f71140e9580 tx=0x7f71140b56b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.751+0000 7f700ffff640 1 -- 172.21.15.62:0/680692574 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71140b4ad0 con 0x556ebc97e370 2024-09-10T05:36:35.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.751+0000 7f700ffff640 1 -- 172.21.15.62:0/680692574 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71140bb050 con 0x556ebc97e370 2024-09-10T05:36:35.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.751+0000 7f712c91e9c0 1 -- 172.21.15.62:0/680692574 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556ebc97d150 con 0x556ebc97e370 2024-09-10T05:36:35.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.751+0000 7f700ffff640 1 -- 172.21.15.62:0/680692574 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71140b4da0 con 0x556ebc97e370 2024-09-10T05:36:35.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.751+0000 7f712c91e9c0 1 -- 172.21.15.62:0/680692574 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ebc97d6c0 con 0x556ebc97e370 2024-09-10T05:36:35.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.751+0000 7f700ffff640 1 -- 172.21.15.62:0/680692574 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f71140c5030 con 0x556ebc97e370 2024-09-10T05:36:35.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.755+0000 7f700ffff640 1 --2- 172.21.15.62:0/680692574 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7004039ac0 0x7f700403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.755+0000 7f700ffff640 1 -- 172.21.15.62:0/680692574 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f71140d1000 con 0x556ebc97e370 2024-09-10T05:36:35.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.755+0000 7f7129c23640 1 --2- 172.21.15.62:0/680692574 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7004039ac0 0x7f700403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.755+0000 7f712c91e9c0 1 Processor -- start 2024-09-10T05:36:35.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.755+0000 7f712c91e9c0 1 -- start start 2024-09-10T05:36:35.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.755+0000 7f712c91e9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ebca9d390 0x556ebca9d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.755+0000 7f7129c23640 1 --2- 172.21.15.62:0/680692574 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7004039ac0 0x7f700403bf80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f711c0062e0 tx=0x7f711c00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.755+0000 7f712c91e9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556ebca69f80 con 0x556ebca9d390 2024-09-10T05:36:35.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.755+0000 7f712a424640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ebca9d390 0x556ebca9d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.755+0000 7f712a424640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ebca9d390 0x556ebca9d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47078/0 (socket says 172.21.15.62:47078) 2024-09-10T05:36:35.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.755+0000 7f712a424640 1 -- 172.21.15.62:0/820453496 learned_addr learned my addr 172.21.15.62:0/820453496 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:35.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.755+0000 7f712a424640 1 -- 172.21.15.62:0/820453496 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ebca9dd40 con 0x556ebca9d390 2024-09-10T05:36:35.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.755+0000 7f712a424640 1 --2- 172.21.15.62:0/820453496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ebca9d390 0x556ebca9d770 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f71140c76a0 tx=0x7f71140dcf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2e7caaf33bad7e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.755+0000 7f700dffb640 1 -- 172.21.15.62:0/820453496 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71140c7e20 con 0x556ebca9d390 2024-09-10T05:36:35.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.755+0000 7f700dffb640 1 -- 172.21.15.62:0/820453496 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7114103070 con 0x556ebca9d390 2024-09-10T05:36:35.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.755+0000 7f700dffb640 1 -- 172.21.15.62:0/820453496 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71140eab40 con 0x556ebca9d390 2024-09-10T05:36:35.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.755+0000 7f712c91e9c0 1 -- 172.21.15.62:0/820453496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ebca9d390 msgr2=0x556ebca9d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.755+0000 7f712c91e9c0 1 --2- 172.21.15.62:0/820453496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ebca9d390 0x556ebca9d770 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f71140c76a0 tx=0x7f71140dcf70 comp rx=0 tx=0).stop 2024-09-10T05:36:35.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.755+0000 7f712c91e9c0 1 -- 172.21.15.62:0/820453496 shutdown_connections 2024-09-10T05:36:35.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.755+0000 7f712c91e9c0 1 --2- 172.21.15.62:0/820453496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ebca9d390 0x556ebca9d770 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:35.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.755+0000 7f712c91e9c0 1 -- 172.21.15.62:0/820453496 >> 172.21.15.62:0/820453496 conn(0x556ebca997c0 msgr2=0x556ebca97a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:35.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.755+0000 7f712c91e9c0 1 -- 172.21.15.62:0/820453496 shutdown_connections 2024-09-10T05:36:35.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.755+0000 7f712c91e9c0 1 -- 172.21.15.62:0/820453496 wait complete. 2024-09-10T05:36:35.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.755+0000 7f712c91e9c0 1 Processor -- start 2024-09-10T05:36:35.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.755+0000 7f712c91e9c0 1 -- start start 2024-09-10T05:36:35.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.755+0000 7f712c91e9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ebca9d390 0x556ebcaa4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.755+0000 7f712c91e9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556ebca9e220 con 0x556ebca9d390 2024-09-10T05:36:35.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.759+0000 7f712a424640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ebca9d390 0x556ebcaa4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.759+0000 7f712a424640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ebca9d390 0x556ebcaa4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47082/0 (socket says 172.21.15.62:47082) 2024-09-10T05:36:35.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.759+0000 7f712a424640 1 -- 172.21.15.62:0/3034597973 learned_addr learned my addr 172.21.15.62:0/3034597973 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:35.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.759+0000 7f712a424640 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ebcaa4c80 con 0x556ebca9d390 2024-09-10T05:36:35.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.759+0000 7f712a424640 1 --2- 172.21.15.62:0/3034597973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ebca9d390 0x556ebcaa4720 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f71140a9910 tx=0x7f71140a7f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.759+0000 7f6ffbfff640 1 -- 172.21.15.62:0/3034597973 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71140c7e20 con 0x556ebca9d390 2024-09-10T05:36:35.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.759+0000 7f6ffbfff640 1 -- 172.21.15.62:0/3034597973 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71140b0040 con 0x556ebca9d390 2024-09-10T05:36:35.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.759+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556ebcaa4c80 con 0x556ebca9d390 2024-09-10T05:36:35.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.759+0000 7f6ffbfff640 1 -- 172.21.15.62:0/3034597973 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71140ad250 con 0x556ebca9d390 2024-09-10T05:36:35.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.759+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ebcaa4c80 con 0x556ebca9d390 2024-09-10T05:36:35.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.759+0000 7f6ffbfff640 1 -- 172.21.15.62:0/3034597973 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f71140fc030 con 0x556ebca9d390 2024-09-10T05:36:35.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.759+0000 7f712c91e9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.759+0000 7f6ffbfff640 1 --2- 172.21.15.62:0/3034597973 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6ff4039ac0 0x7f6ff403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.759+0000 7f6ffbfff640 1 -- 172.21.15.62:0/3034597973 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f7114113ae0 con 0x556ebca9d390 2024-09-10T05:36:35.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.759+0000 7f7129c23640 1 --2- 172.21.15.62:0/3034597973 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6ff4039ac0 0x7f6ff403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.759+0000 7f712c91e9c0 1 --2- 172.21.15.62:0/3034597973 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x556ebcaaf5c0 0x556ebcab1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.759+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556ebcab21a0 con 0x556ebcaaf5c0 2024-09-10T05:36:35.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.759+0000 7f712ac25640 1 --2- 172.21.15.62:0/3034597973 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x556ebcaaf5c0 0x556ebcab1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.763+0000 7f7129c23640 1 --2- 172.21.15.62:0/3034597973 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6ff4039ac0 0x7f6ff403bf80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x556ebca72ed0 tx=0x7f711c010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.763+0000 7f712ac25640 1 --2- 172.21.15.62:0/3034597973 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x556ebcaaf5c0 0x556ebcab1a50 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.763+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f71240083f0 con 0x556ebcaaf5c0 2024-09-10T05:36:35.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.763+0000 7f712c91e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:35.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.763+0000 7f712c91e9c0 20 realm 2024-09-10T05:36:35.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.763+0000 7f712c91e9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.763+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556ebcaaea00 con 0x556ebcaaf5c0 2024-09-10T05:36:35.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.763+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f71240083f0 con 0x556ebcaaf5c0 2024-09-10T05:36:35.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.763+0000 7f712c91e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:35.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.763+0000 7f712c91e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:35.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.763+0000 7f712c91e9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.763+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556ebcab2cb0 con 0x556ebcaaf5c0 2024-09-10T05:36:35.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.763+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f71240083f0 con 0x556ebcaaf5c0 2024-09-10T05:36:35.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.763+0000 7f712c91e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:35.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.763+0000 7f712c91e9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.763+0000 7f712c91e9c0 1 --2- 172.21.15.62:0/3034597973 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x556ebcab3a90 0x556ebcab5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.763+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556ebcab6510 con 0x556ebcab3a90 2024-09-10T05:36:35.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.763+0000 7f712a424640 1 --2- 172.21.15.62:0/3034597973 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x556ebcab3a90 0x556ebcab5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.763+0000 7f712a424640 1 --2- 172.21.15.62:0/3034597973 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x556ebcab3a90 0x556ebcab5e80 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.763+0000 7f712a424640 1 -- 172.21.15.62:0/3034597973 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7114118020 con 0x556ebcab3a90 2024-09-10T05:36:35.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.763+0000 7f712c91e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:35.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.763+0000 7f712c91e9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.763+0000 7f712c91e9c0 1 --2- 172.21.15.62:0/3034597973 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x556ebcab72c0 0x556ebcab96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.763+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556ebcab9d50 con 0x556ebcab72c0 2024-09-10T05:36:35.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.763+0000 7f7129c23640 1 --2- 172.21.15.62:0/3034597973 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x556ebcab72c0 0x556ebcab96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.763+0000 7f7129c23640 1 --2- 172.21.15.62:0/3034597973 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x556ebcab72c0 0x556ebcab96b0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.763+0000 7f7129c23640 1 -- 172.21.15.62:0/3034597973 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f711c02d040 con 0x556ebcab72c0 2024-09-10T05:36:35.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.767+0000 7f712c91e9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:35.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.767+0000 7f712c91e9c0 20 searching for the correct realm 2024-09-10T05:36:35.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.767+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556ebcabb640 con 0x556ebcab72c0 2024-09-10T05:36:35.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.767+0000 7f7129c23640 1 -- 172.21.15.62:0/3034597973 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f711c02d040 con 0x556ebcab72c0 2024-09-10T05:36:35.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.767+0000 7f7129c23640 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556ebcabb640 con 0x556ebcab3a90 2024-09-10T05:36:35.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.767+0000 7f712a424640 1 -- 172.21.15.62:0/3034597973 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7114118020 con 0x556ebcab3a90 2024-09-10T05:36:35.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.767+0000 7f712a424640 1 --2- 172.21.15.62:0/3034597973 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f71140dc070 0x7f71140ab020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.767+0000 7f712a424640 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556ebcabb640 con 0x7f71140dc070 2024-09-10T05:36:35.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.767+0000 7f712ac25640 1 --2- 172.21.15.62:0/3034597973 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f71140dc070 0x7f71140ab020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.767+0000 7f712ac25640 1 --2- 172.21.15.62:0/3034597973 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f71140dc070 0x7f71140ab020 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.767+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71240083f0 con 0x7f71140dc070 2024-09-10T05:36:35.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.767+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556ebcabb640 con 0x556ebcaaf5c0 2024-09-10T05:36:35.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.767+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71240083f0 con 0x556ebcaaf5c0 2024-09-10T05:36:35.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.767+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556ebcabb640 con 0x556ebcaaf5c0 2024-09-10T05:36:35.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.767+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71240083f0 con 0x556ebcaaf5c0 2024-09-10T05:36:35.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.767+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556ebcabb640 con 0x556ebcab72c0 2024-09-10T05:36:35.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.767+0000 7f7129c23640 1 -- 172.21.15.62:0/3034597973 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f711c02d040 con 0x556ebcab72c0 2024-09-10T05:36:35.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.767+0000 7f7129c23640 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556ebcabb640 con 0x556ebcaaf5c0 2024-09-10T05:36:35.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.767+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71240083f0 con 0x556ebcaaf5c0 2024-09-10T05:36:35.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.767+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556ebcabb640 con 0x556ebcab3a90 2024-09-10T05:36:35.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.767+0000 7f712a424640 1 -- 172.21.15.62:0/3034597973 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7114118020 con 0x556ebcab3a90 2024-09-10T05:36:35.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.767+0000 7f712a424640 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556ebcabb640 con 0x556ebcab3a90 2024-09-10T05:36:35.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.771+0000 7f712a424640 1 -- 172.21.15.62:0/3034597973 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7114118020 con 0x556ebcab3a90 2024-09-10T05:36:35.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.771+0000 7f712a424640 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556ebcabb640 con 0x556ebcaaf5c0 2024-09-10T05:36:35.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.771+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71240083f0 con 0x556ebcaaf5c0 2024-09-10T05:36:35.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.771+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556ebcabb640 con 0x7f71140dc070 2024-09-10T05:36:35.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.771+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71240083f0 con 0x7f71140dc070 2024-09-10T05:36:35.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.771+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556ebcabb640 con 0x556ebcaaf5c0 2024-09-10T05:36:35.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.771+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71240083f0 con 0x556ebcaaf5c0 2024-09-10T05:36:35.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.771+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556ebcabb640 con 0x7f71140dc070 2024-09-10T05:36:35.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.771+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f71240083f0 con 0x7f71140dc070 2024-09-10T05:36:35.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.771+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556ebcabb640 con 0x556ebcab3a90 2024-09-10T05:36:35.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.771+0000 7f712a424640 1 -- 172.21.15.62:0/3034597973 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7114118020 con 0x556ebcab3a90 2024-09-10T05:36:35.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.771+0000 7f712a424640 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556ebcabb640 con 0x556ebcab72c0 2024-09-10T05:36:35.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.771+0000 7f7129c23640 1 -- 172.21.15.62:0/3034597973 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f711c02d040 con 0x556ebcab72c0 2024-09-10T05:36:35.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.771+0000 7f7129c23640 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556ebcabb640 con 0x556ebcaaf5c0 2024-09-10T05:36:35.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.771+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71240083f0 con 0x556ebcaaf5c0 2024-09-10T05:36:35.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.771+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556ebcabb640 con 0x556ebcab3a90 2024-09-10T05:36:35.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.775+0000 7f712a424640 1 -- 172.21.15.62:0/3034597973 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7114118020 con 0x556ebcab3a90 2024-09-10T05:36:35.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.775+0000 7f712a424640 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556ebcabb640 con 0x556ebcab72c0 2024-09-10T05:36:35.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.775+0000 7f7129c23640 1 -- 172.21.15.62:0/3034597973 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 30 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f711c02d040 con 0x556ebcab72c0 2024-09-10T05:36:35.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.775+0000 7f7129c23640 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556ebcabb640 con 0x556ebcaaf5c0 2024-09-10T05:36:35.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.775+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71240083f0 con 0x556ebcaaf5c0 2024-09-10T05:36:35.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.775+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556ebcabb640 con 0x556ebcaaf5c0 2024-09-10T05:36:35.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.775+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f71240083f0 con 0x556ebcaaf5c0 2024-09-10T05:36:35.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.775+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556ebcabb640 con 0x556ebcaaf5c0 2024-09-10T05:36:35.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.775+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71240083f0 con 0x556ebcaaf5c0 2024-09-10T05:36:35.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.775+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556ebcabb640 con 0x556ebcab72c0 2024-09-10T05:36:35.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.775+0000 7f7129c23640 1 -- 172.21.15.62:0/3034597973 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f711c02d040 con 0x556ebcab72c0 2024-09-10T05:36:35.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.775+0000 7f7129c23640 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556ebcabb640 con 0x7f71140dc070 2024-09-10T05:36:35.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.775+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71240083f0 con 0x7f71140dc070 2024-09-10T05:36:35.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.775+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556ebcabb640 con 0x556ebcaaf5c0 2024-09-10T05:36:35.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.775+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71240083f0 con 0x556ebcaaf5c0 2024-09-10T05:36:35.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.775+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556ebcabb640 con 0x7f71140dc070 2024-09-10T05:36:35.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.775+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71240083f0 con 0x7f71140dc070 2024-09-10T05:36:35.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.775+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556ebcabb640 con 0x556ebcab72c0 2024-09-10T05:36:35.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.775+0000 7f7129c23640 1 -- 172.21.15.62:0/3034597973 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f711c02d040 con 0x556ebcab72c0 2024-09-10T05:36:35.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.775+0000 7f7129c23640 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556ebcabb640 con 0x7f71140dc070 2024-09-10T05:36:35.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.775+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71240083f0 con 0x7f71140dc070 2024-09-10T05:36:35.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.775+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556ebcabb640 con 0x556ebcab3a90 2024-09-10T05:36:35.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.775+0000 7f712a424640 1 -- 172.21.15.62:0/3034597973 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7114118020 con 0x556ebcab3a90 2024-09-10T05:36:35.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.775+0000 7f712a424640 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556ebcabb640 con 0x556ebcab3a90 2024-09-10T05:36:35.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.779+0000 7f712a424640 1 -- 172.21.15.62:0/3034597973 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7114118020 con 0x556ebcab3a90 2024-09-10T05:36:35.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.779+0000 7f712a424640 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556ebcabb640 con 0x556ebcab72c0 2024-09-10T05:36:35.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.779+0000 7f7129c23640 1 -- 172.21.15.62:0/3034597973 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f711c02d040 con 0x556ebcab72c0 2024-09-10T05:36:35.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.779+0000 7f7129c23640 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556ebcabb640 con 0x556ebcab3a90 2024-09-10T05:36:35.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.779+0000 7f712a424640 1 -- 172.21.15.62:0/3034597973 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7114118020 con 0x556ebcab3a90 2024-09-10T05:36:35.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.779+0000 7f712a424640 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556ebcabb640 con 0x556ebcab3a90 2024-09-10T05:36:35.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.779+0000 7f712a424640 1 -- 172.21.15.62:0/3034597973 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7114118020 con 0x556ebcab3a90 2024-09-10T05:36:35.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.779+0000 7f712c91e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:35.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.779+0000 7f712c91e9c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:35.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.779+0000 7f712c91e9c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:35.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.779+0000 7f712c91e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:35.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.779+0000 7f712c91e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:35.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.779+0000 7f712c91e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:35.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.779+0000 7f712c91e9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.779+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556ebcaba710 con 0x556ebcaaf5c0 2024-09-10T05:36:35.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.779+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f71240083f0 con 0x556ebcaaf5c0 2024-09-10T05:36:35.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.779+0000 7f712c91e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:35.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.779+0000 7f712c91e9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.779+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556ebcabab30 con 0x556ebcab3a90 2024-09-10T05:36:35.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.779+0000 7f712a424640 1 -- 172.21.15.62:0/3034597973 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7114118020 con 0x556ebcab3a90 2024-09-10T05:36:35.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.779+0000 7f712c91e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:35.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.779+0000 7f712c91e9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.779+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556ebcabaf90 con 0x556ebcab72c0 2024-09-10T05:36:35.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.779+0000 7f7129c23640 1 -- 172.21.15.62:0/3034597973 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f711c02d040 con 0x556ebcab72c0 2024-09-10T05:36:35.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.779+0000 7f712c91e9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:35.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.779+0000 7f712c91e9c0 20 zone default found 2024-09-10T05:36:35.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.779+0000 7f712c91e9c0 4 Realm: () 2024-09-10T05:36:35.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.779+0000 7f712c91e9c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:35.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.779+0000 7f712c91e9c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:35.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.779+0000 7f712c91e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:35.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.779+0000 7f712c91e9c0 20 zonegroup default 2024-09-10T05:36:35.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.779+0000 7f712c91e9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.779+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556ebcabbb10 con 0x7f71140dc070 2024-09-10T05:36:35.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.783+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f71240083f0 con 0x7f71140dc070 2024-09-10T05:36:35.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.783+0000 7f712c91e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:35.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.783+0000 7f712c91e9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.783+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556ebcabddd0 con 0x556ebcab72c0 2024-09-10T05:36:35.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.783+0000 7f7129c23640 1 -- 172.21.15.62:0/3034597973 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f711c02d040 con 0x556ebcab72c0 2024-09-10T05:36:35.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.783+0000 7f712c91e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:35.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.783+0000 7f712c91e9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.783+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556ebcabe170 con 0x556ebcab72c0 2024-09-10T05:36:35.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.783+0000 7f7129c23640 1 -- 172.21.15.62:0/3034597973 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f711c02d040 con 0x556ebcab72c0 2024-09-10T05:36:35.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.783+0000 7f712c91e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:35.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.783+0000 7f712c91e9c0 20 started sync module instance, tier type = 2024-09-10T05:36:35.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.783+0000 7f712c91e9c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:35.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.783+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556ebcabd260 con 0x556ebcab3a90 2024-09-10T05:36:35.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.783+0000 7f712a424640 1 -- 172.21.15.62:0/3034597973 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7114118020 con 0x556ebcab3a90 2024-09-10T05:36:35.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.783+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93934100141648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556ebcabcec0 con 0x556ebcab3a90 2024-09-10T05:36:35.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.783+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556ebcabf0d0 con 0x556ebcaaf5c0 2024-09-10T05:36:35.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.787+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71240083f0 con 0x556ebcaaf5c0 2024-09-10T05:36:35.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.787+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93934100149360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556ebcabfd40 con 0x556ebcaaf5c0 2024-09-10T05:36:35.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.787+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556ebcac0700 con 0x556ebcab3a90 2024-09-10T05:36:35.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.787+0000 7f712a424640 1 -- 172.21.15.62:0/3034597973 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 93934100141648] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7114118020 con 0x556ebcab3a90 2024-09-10T05:36:35.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.787+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93934100149360] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71240083f0 con 0x556ebcaaf5c0 2024-09-10T05:36:35.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.787+0000 7f712a424640 1 -- 172.21.15.62:0/3034597973 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7114118020 con 0x556ebcab3a90 2024-09-10T05:36:35.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.787+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93934100150416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556ebcabfcb0 con 0x556ebcab3a90 2024-09-10T05:36:35.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.787+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556ebcac0bb0 con 0x7f71140dc070 2024-09-10T05:36:35.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.791+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71240083f0 con 0x7f71140dc070 2024-09-10T05:36:35.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.791+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93934100154112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556ebcac0fd0 con 0x7f71140dc070 2024-09-10T05:36:35.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.791+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556ebcac19d0 con 0x556ebcab3a90 2024-09-10T05:36:35.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.791+0000 7f712a424640 1 -- 172.21.15.62:0/3034597973 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93934100150416] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7114118020 con 0x556ebcab3a90 2024-09-10T05:36:35.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.791+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93934100154112] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71240083f0 con 0x7f71140dc070 2024-09-10T05:36:35.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.791+0000 7f712a424640 1 -- 172.21.15.62:0/3034597973 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7114118020 con 0x556ebcab3a90 2024-09-10T05:36:35.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.791+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93934100152912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556ebcac0b20 con 0x556ebcab3a90 2024-09-10T05:36:35.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.791+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556ebcac2270 con 0x556ebcab72c0 2024-09-10T05:36:35.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.791+0000 7f7129c23640 1 -- 172.21.15.62:0/3034597973 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f711c02d040 con 0x556ebcab72c0 2024-09-10T05:36:35.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.791+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93934100159936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556ebcac0b20 con 0x556ebcab72c0 2024-09-10T05:36:35.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.791+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556ebcac30e0 con 0x556ebcab72c0 2024-09-10T05:36:35.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.795+0000 7f712a424640 1 -- 172.21.15.62:0/3034597973 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 93934100152912] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7114118020 con 0x556ebcab3a90 2024-09-10T05:36:35.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.795+0000 7f7129c23640 1 -- 172.21.15.62:0/3034597973 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93934100159936] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f711c02d040 con 0x556ebcab72c0 2024-09-10T05:36:35.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.795+0000 7f7129c23640 1 -- 172.21.15.62:0/3034597973 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f711c02d040 con 0x556ebcab72c0 2024-09-10T05:36:35.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.795+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93934100162064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556ebcac2c30 con 0x556ebcab72c0 2024-09-10T05:36:35.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.795+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556ebcac35f0 con 0x7f71140dc070 2024-09-10T05:36:35.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.795+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71240083f0 con 0x7f71140dc070 2024-09-10T05:36:35.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.795+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93934100164928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556ebcac3a10 con 0x7f71140dc070 2024-09-10T05:36:35.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.795+0000 7f712c91e9c0 20 add_watcher() i=0 2024-09-10T05:36:35.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.795+0000 7f712c91e9c0 20 add_watcher() i=1 2024-09-10T05:36:35.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.795+0000 7f712c91e9c0 20 add_watcher() i=2 2024-09-10T05:36:35.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.795+0000 7f712c91e9c0 20 add_watcher() i=3 2024-09-10T05:36:35.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.795+0000 7f712c91e9c0 20 add_watcher() i=4 2024-09-10T05:36:35.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.795+0000 7f712c91e9c0 20 add_watcher() i=5 2024-09-10T05:36:35.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.795+0000 7f7129c23640 1 -- 172.21.15.62:0/3034597973 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93934100162064] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f711c02d040 con 0x556ebcab72c0 2024-09-10T05:36:35.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.795+0000 7f712c91e9c0 20 add_watcher() i=6 2024-09-10T05:36:35.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.799+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93934100164928] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71240083f0 con 0x7f71140dc070 2024-09-10T05:36:35.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.799+0000 7f712c91e9c0 20 add_watcher() i=7 2024-09-10T05:36:35.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.799+0000 7f712c91e9c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:35.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.799+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556ebcac3a10 con 0x556ebcaaf5c0 2024-09-10T05:36:35.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.799+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f71240083f0 con 0x556ebcaaf5c0 2024-09-10T05:36:35.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.799+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93934100165984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556ebcac3980 con 0x556ebcaaf5c0 2024-09-10T05:36:35.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.799+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93934100165984] v30'106 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f71240083f0 con 0x556ebcaaf5c0 2024-09-10T05:36:35.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.799+0000 7f6fe0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:35.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.799+0000 7f712c91e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:35.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.799+0000 7f712c91e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:35.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.799+0000 7f712c91e9c0 5 note: GC not initialized 2024-09-10T05:36:35.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.799+0000 7f6f5b7fe640 20 reqs_thread_entry: start 2024-09-10T05:36:35.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.799+0000 7f712c91e9c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:35.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.799+0000 7f712c91e9c0 20 Filter name: none 2024-09-10T05:36:35.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.799+0000 7f6f597fa640 20 reqs_thread_entry: start 2024-09-10T05:36:35.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.799+0000 7f712c91e9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.799+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556ebcae9dd0 con 0x7f71140dc070 2024-09-10T05:36:35.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.799+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f71240083f0 con 0x7f71140dc070 2024-09-10T05:36:35.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.799+0000 7f712c91e9c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T05:36:35.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.799+0000 7f712c91e9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.799+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:63 8.1f 8:fcc5c255:root::.bucket.meta.myfoo%3a475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556ebcaea660 con 0x7f71140dc070 2024-09-10T05:36:35.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.803+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(63 .bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f71240083f0 con 0x7f71140dc070 2024-09-10T05:36:35.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.803+0000 7f712c91e9c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T05:36:35.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.803+0000 7f712c91e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-10T05:36:35.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.803+0000 7f712c91e9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.803+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556ebcae9080 con 0x7f71140dc070 2024-09-10T05:36:35.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.803+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f71240083f0 con 0x7f71140dc070 2024-09-10T05:36:35.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.803+0000 7f712c91e9c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T05:36:35.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.803+0000 7f712c91e9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.803+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:65 8.1f 8:fcc5c255:root::.bucket.meta.myfoo%3a475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556ebcaebc70 con 0x7f71140dc070 2024-09-10T05:36:35.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.803+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 <== osd.2 v2:172.21.15.62:6800/2677868286 15 ==== osd_op_reply(65 .bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f71240083f0 con 0x7f71140dc070 2024-09-10T05:36:35.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.803+0000 7f712c91e9c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T05:36:35.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.803+0000 7f712c91e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-10T05:36:35.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.803+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:66 4.39 4:9f393805:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556ebcaed6e0 con 0x556ebcab72c0 2024-09-10T05:36:35.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.803+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:67 4.27 4:e72118f4:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556ebcaf0260 con 0x556ebcaaf5c0 2024-09-10T05:36:35.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.803+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 4.32 4:4fe9cf27:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556ebcaf2e20 con 0x556ebcab3a90 2024-09-10T05:36:35.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.803+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:69 4.c 4:3284697f:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556ebcaf5b70 con 0x556ebcaaf5c0 2024-09-10T05:36:35.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.803+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:70 4.a 4:5050a708:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556ebcaf5b70 con 0x556ebcab3a90 2024-09-10T05:36:35.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.803+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:71 4.1b 4:db0b4800:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556ebcaf2e20 con 0x7f71140dc070 2024-09-10T05:36:35.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.803+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:72 4.1f 4:fa625c04:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556ebcafcfd0 con 0x556ebcab3a90 2024-09-10T05:36:35.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.803+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:73 4.d 4:b20f8417:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556ebcaffe90 con 0x556ebcab3a90 2024-09-10T05:36:35.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.803+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:74 4.3 4:c3f62267:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556ebcb027f0 con 0x556ebcaaf5c0 2024-09-10T05:36:35.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.803+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:75 4.26 4:65fa9cda:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556ebcb052f0 con 0x556ebcaaf5c0 2024-09-10T05:36:35.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.803+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:76 4.3e 4:7c38a587:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556ebcb07d40 con 0x556ebcab3a90 2024-09-10T05:36:35.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.803+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(67 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f712403f070 con 0x556ebcaaf5c0 2024-09-10T05:36:35.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.803+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(69 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f712403f070 con 0x556ebcaaf5c0 2024-09-10T05:36:35.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.803+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 <== osd.2 v2:172.21.15.62:6800/2677868286 16 ==== osd_op_reply(71 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.5 [call out=128b] v0'0 uv3 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f712403f070 con 0x7f71140dc070 2024-09-10T05:36:35.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.803+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(74 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f712403f070 con 0x556ebcaaf5c0 2024-09-10T05:36:35.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.803+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(75 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f712403f070 con 0x556ebcaaf5c0 2024-09-10T05:36:35.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.803+0000 7f7129c23640 1 -- 172.21.15.62:0/3034597973 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(66 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f711c02d040 con 0x556ebcab72c0 2024-09-10T05:36:35.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.803+0000 7f712a424640 1 -- 172.21.15.62:0/3034597973 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(70 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f7114118020 con 0x556ebcab3a90 2024-09-10T05:36:35.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.803+0000 7f712a424640 1 -- 172.21.15.62:0/3034597973 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(68 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f7114118020 con 0x556ebcab3a90 2024-09-10T05:36:35.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.803+0000 7f712a424640 1 -- 172.21.15.62:0/3034597973 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(73 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f7114118020 con 0x556ebcab3a90 2024-09-10T05:36:35.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.803+0000 7f712a424640 1 -- 172.21.15.62:0/3034597973 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== osd_op_reply(76 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f7114118020 con 0x556ebcab3a90 2024-09-10T05:36:35.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.803+0000 7f712a424640 1 -- 172.21.15.62:0/3034597973 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== osd_op_reply(72 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f7114118020 con 0x556ebcab3a90 2024-09-10T05:36:35.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.803+0000 7f6fe0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:35.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.803+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93934100165984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556ebcb07d40 con 0x556ebcaaf5c0 2024-09-10T05:36:35.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.807+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 <== osd.1 v2:172.21.15.62:6808/3442097179 23 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 93934100165984] v30'107 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f712403f070 con 0x556ebcaaf5c0 2024-09-10T05:36:35.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.807+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93934100141648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556ebcb07d40 con 0x556ebcab3a90 2024-09-10T05:36:35.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.807+0000 7f712a424640 1 -- 172.21.15.62:0/3034597973 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 93934100141648] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7114118020 con 0x556ebcab3a90 2024-09-10T05:36:35.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.807+0000 7f712c91e9c0 20 remove_watcher() i=0 2024-09-10T05:36:35.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.807+0000 7f712c91e9c0 2 removed watcher, disabling cache 2024-09-10T05:36:35.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.807+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93934100149360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556ebcb07d40 con 0x556ebcaaf5c0 2024-09-10T05:36:35.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.811+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 <== osd.1 v2:172.21.15.62:6808/3442097179 24 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 93934100149360] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f712403f070 con 0x556ebcaaf5c0 2024-09-10T05:36:35.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.811+0000 7f712c91e9c0 20 remove_watcher() i=1 2024-09-10T05:36:35.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.811+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93934100150416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556ebcb07d40 con 0x556ebcab3a90 2024-09-10T05:36:35.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.815+0000 7f712a424640 1 -- 172.21.15.62:0/3034597973 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 93934100150416] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7114118020 con 0x556ebcab3a90 2024-09-10T05:36:35.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.815+0000 7f712c91e9c0 20 remove_watcher() i=2 2024-09-10T05:36:35.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.815+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93934100154112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556ebcb07d40 con 0x7f71140dc070 2024-09-10T05:36:35.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.815+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 <== osd.2 v2:172.21.15.62:6800/2677868286 17 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 93934100154112] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f712403f070 con 0x7f71140dc070 2024-09-10T05:36:35.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.815+0000 7f712c91e9c0 20 remove_watcher() i=3 2024-09-10T05:36:35.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.815+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93934100152912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556ebcb07d40 con 0x556ebcab3a90 2024-09-10T05:36:35.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.815+0000 7f712a424640 1 -- 172.21.15.62:0/3034597973 <== osd.0 v2:172.21.15.2:6800/945139080 25 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 93934100152912] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7114118020 con 0x556ebcab3a90 2024-09-10T05:36:35.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.819+0000 7f712c91e9c0 20 remove_watcher() i=4 2024-09-10T05:36:35.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.819+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93934100159936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556ebcb07d40 con 0x556ebcab72c0 2024-09-10T05:36:35.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.819+0000 7f7129c23640 1 -- 172.21.15.62:0/3034597973 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 93934100159936] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f711c02d040 con 0x556ebcab72c0 2024-09-10T05:36:35.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.819+0000 7f712c91e9c0 20 remove_watcher() i=5 2024-09-10T05:36:35.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.819+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93934100162064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556ebcb07d40 con 0x556ebcab72c0 2024-09-10T05:36:35.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.819+0000 7f7129c23640 1 -- 172.21.15.62:0/3034597973 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 93934100162064] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f711c02d040 con 0x556ebcab72c0 2024-09-10T05:36:35.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.819+0000 7f712c91e9c0 20 remove_watcher() i=6 2024-09-10T05:36:35.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.819+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93934100164928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556ebcb07d40 con 0x7f71140dc070 2024-09-10T05:36:35.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.819+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 <== osd.2 v2:172.21.15.62:6800/2677868286 18 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 93934100164928] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f712403f070 con 0x7f71140dc070 2024-09-10T05:36:35.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.819+0000 7f712c91e9c0 20 remove_watcher() i=7 2024-09-10T05:36:35.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.819+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x556ebcab3a90 msgr2=0x556ebcab5e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.819+0000 7f712c91e9c0 1 --2- 172.21.15.62:0/3034597973 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x556ebcab3a90 0x556ebcab5e80 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:35.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.819+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x556ebcaaf5c0 msgr2=0x556ebcab1a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.819+0000 7f712c91e9c0 1 --2- 172.21.15.62:0/3034597973 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x556ebcaaf5c0 0x556ebcab1a50 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:35.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.819+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f71140dc070 msgr2=0x7f71140ab020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.819+0000 7f712c91e9c0 1 --2- 172.21.15.62:0/3034597973 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f71140dc070 0x7f71140ab020 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:35.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.819+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x556ebcab72c0 msgr2=0x556ebcab96b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.819+0000 7f712c91e9c0 1 --2- 172.21.15.62:0/3034597973 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x556ebcab72c0 0x556ebcab96b0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:35.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.823+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6ff4039ac0 msgr2=0x7f6ff403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.823+0000 7f712c91e9c0 1 --2- 172.21.15.62:0/3034597973 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6ff4039ac0 0x7f6ff403bf80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x556ebca72ed0 tx=0x7f711c010000 comp rx=0 tx=0).stop 2024-09-10T05:36:35.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.823+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ebca9d390 msgr2=0x556ebcaa4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.823+0000 7f712c91e9c0 1 --2- 172.21.15.62:0/3034597973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ebca9d390 0x556ebcaa4720 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f71140a9910 tx=0x7f71140a7f20 comp rx=0 tx=0).stop 2024-09-10T05:36:35.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.823+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 reap_dead start 2024-09-10T05:36:35.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.823+0000 7f712ac25640 1 -- 172.21.15.62:0/3034597973 reap_dead start 2024-09-10T05:36:35.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.823+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 shutdown_connections 2024-09-10T05:36:35.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.823+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 >> 172.21.15.62:0/3034597973 conn(0x556ebca997c0 msgr2=0x556ebca979d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:35.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.823+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 shutdown_connections 2024-09-10T05:36:35.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.823+0000 7f712c91e9c0 1 -- 172.21.15.62:0/3034597973 wait complete. 2024-09-10T05:36:35.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.823+0000 7f712c91e9c0 1 -- 172.21.15.62:0/680692574 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7004039ac0 msgr2=0x7f700403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.823+0000 7f712c91e9c0 1 --2- 172.21.15.62:0/680692574 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7004039ac0 0x7f700403bf80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f711c0062e0 tx=0x7f711c00f000 comp rx=0 tx=0).stop 2024-09-10T05:36:35.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.823+0000 7f712c91e9c0 1 -- 172.21.15.62:0/680692574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ebc97e370 msgr2=0x556ebc97cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.823+0000 7f712c91e9c0 1 --2- 172.21.15.62:0/680692574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ebc97e370 0x556ebc97cc10 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f71140e9580 tx=0x7f71140b56b0 comp rx=0 tx=0).stop 2024-09-10T05:36:35.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.823+0000 7f712c91e9c0 1 -- 172.21.15.62:0/680692574 shutdown_connections 2024-09-10T05:36:35.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.823+0000 7f712c91e9c0 1 --2- 172.21.15.62:0/680692574 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7004039ac0 0x7f700403bf80 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:35.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.823+0000 7f712c91e9c0 1 --2- 172.21.15.62:0/680692574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ebc97e370 0x556ebc97cc10 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:35.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.823+0000 7f712c91e9c0 1 -- 172.21.15.62:0/680692574 >> 172.21.15.62:0/680692574 conn(0x556ebca843c0 msgr2=0x556ebca847a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:35.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.823+0000 7f712c91e9c0 1 -- 172.21.15.62:0/680692574 shutdown_connections 2024-09-10T05:36:35.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.823+0000 7f712c91e9c0 1 -- 172.21.15.62:0/680692574 wait complete. 2024-09-10T05:36:35.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.823+0000 7f712c91e9c0 1 -- 172.21.15.62:0/1636728867 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x556ebca78eb0 msgr2=0x556ebca7b370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.823+0000 7f712c91e9c0 1 --2- 172.21.15.62:0/1636728867 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x556ebca78eb0 0x556ebca7b370 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:35.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.823+0000 7f712c91e9c0 1 -- 172.21.15.62:0/1636728867 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x556ebc981170 msgr2=0x556ebca77ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.823+0000 7f712c91e9c0 1 --2- 172.21.15.62:0/1636728867 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x556ebc981170 0x556ebca77ec0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:35.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.823+0000 7f712c91e9c0 1 -- 172.21.15.62:0/1636728867 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x556ebca7d8a0 msgr2=0x556ebca7fc90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.823+0000 7f712c91e9c0 1 --2- 172.21.15.62:0/1636728867 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x556ebca7d8a0 0x556ebca7fc90 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:35.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.823+0000 7f712c91e9c0 1 -- 172.21.15.62:0/1636728867 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7010039b10 msgr2=0x7f701003bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.823+0000 7f712c91e9c0 1 --2- 172.21.15.62:0/1636728867 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7010039b10 0x7f701003bfd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f711c001650 tx=0x7f711c006720 comp rx=0 tx=0).stop 2024-09-10T05:36:35.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.823+0000 7f712c91e9c0 1 -- 172.21.15.62:0/1636728867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ebc8f2200 msgr2=0x556ebca70d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.823+0000 7f712c91e9c0 1 --2- 172.21.15.62:0/1636728867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556ebc8f2200 0x556ebca70d50 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7114019930 tx=0x7f7114018020 comp rx=0 tx=0).stop 2024-09-10T05:36:35.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.823+0000 7f712ac25640 1 -- 172.21.15.62:0/1636728867 reap_dead start 2024-09-10T05:36:35.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.823+0000 7f712c91e9c0 1 -- 172.21.15.62:0/1636728867 shutdown_connections 2024-09-10T05:36:35.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.823+0000 7f712c91e9c0 1 -- 172.21.15.62:0/1636728867 >> 172.21.15.62:0/1636728867 conn(0x556ebc978920 msgr2=0x556ebca63ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:35.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.823+0000 7f712c91e9c0 1 -- 172.21.15.62:0/1636728867 shutdown_connections 2024-09-10T05:36:35.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.823+0000 7f712c91e9c0 1 -- 172.21.15.62:0/1636728867 wait complete. 2024-09-10T05:36:35.837 INFO:teuthology.orchestra.run.smithi062.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"1e560b55-359a-4aa1-8333-6dabf7061701","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1","marker":"475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-10T05:36:34.651066Z","creation_time":"2024-09-10T05:36:34.646920Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":3,"size_actual":4096,"size_utilized":3,"size_kb":1,"size_kb_actual":4,"size_kb_utilized":1,"num_objects":1}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":1} 2024-09-10T05:36:35.837 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '1e560b55-359a-4aa1-8333-6dabf7061701', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1', 'marker': '475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-10T05:36:34.651066Z', 'creation_time': '2024-09-10T05:36:34.646920Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-10T05:36:35.837 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-10T05:36:35.837 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-10T05:36:35.838 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2024-09-10T05:36:35.914 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:35.914 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:35.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.911+0000 7f044860a9c0 1 Processor -- start 2024-09-10T05:36:35.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.911+0000 7f044860a9c0 1 -- start start 2024-09-10T05:36:35.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.911+0000 7f044860a9c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5625db5fd1f0 0x5625db5fd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.911+0000 7f044860a9c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5625db4af9c0 con 0x5625db600330 2024-09-10T05:36:35.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.911+0000 7f044860a9c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x5625db4ff6d0 con 0x5625db5fd1f0 2024-09-10T05:36:35.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.911+0000 7f0446110640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5625db5fd1f0 0x5625db5fd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.911+0000 7f044590f640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x5625db600330 0x5625db602720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:53028/0 (socket says 172.21.15.62:53028) 2024-09-10T05:36:35.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.911+0000 7f044590f640 1 -- 172.21.15.62:0/1383157906 learned_addr learned my addr 172.21.15.62:0/1383157906 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-10T05:36:35.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.911+0000 7f0446110640 1 -- 172.21.15.62:0/1383157906 >> v1:172.21.15.2:6789/0 conn(0x5625db600330 legacy=0x5625db602720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.911+0000 7f0446110640 1 -- 172.21.15.62:0/1383157906 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625db4a3ca0 con 0x5625db5fd1f0 2024-09-10T05:36:35.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.915+0000 7f0446110640 1 --2- 172.21.15.62:0/1383157906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625db5fd1f0 0x5625db5fd5d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f043800a480 tx=0x7f043801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=515f13a22c88ece4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.919+0000 7f044510e640 1 -- 172.21.15.62:0/1383157906 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04380b0070 con 0x5625db5fd1f0 2024-09-10T05:36:35.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.919+0000 7f044510e640 1 -- 172.21.15.62:0/1383157906 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04380ab540 con 0x5625db5fd1f0 2024-09-10T05:36:35.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.919+0000 7f044510e640 1 -- 172.21.15.62:0/1383157906 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04380ab840 con 0x5625db5fd1f0 2024-09-10T05:36:35.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.919+0000 7f044860a9c0 1 -- 172.21.15.62:0/1383157906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625db5fd1f0 msgr2=0x5625db5fd5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.919+0000 7f044860a9c0 1 --2- 172.21.15.62:0/1383157906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625db5fd1f0 0x5625db5fd5d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f043800a480 tx=0x7f043801b280 comp rx=0 tx=0).stop 2024-09-10T05:36:35.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.919+0000 7f044860a9c0 1 -- 172.21.15.62:0/1383157906 shutdown_connections 2024-09-10T05:36:35.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.919+0000 7f044860a9c0 1 --2- 172.21.15.62:0/1383157906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625db5fd1f0 0x5625db5fd5d0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:35.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.919+0000 7f044860a9c0 1 -- 172.21.15.62:0/1383157906 >> 172.21.15.62:0/1383157906 conn(0x5625db570b00 msgr2=0x5625db570f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:35.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.919+0000 7f044860a9c0 1 -- 172.21.15.62:0/1383157906 shutdown_connections 2024-09-10T05:36:35.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.919+0000 7f044860a9c0 1 -- 172.21.15.62:0/1383157906 wait complete. 2024-09-10T05:36:35.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.935+0000 7f044860a9c0 1 Processor -- start 2024-09-10T05:36:35.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.935+0000 7f044860a9c0 1 -- start start 2024-09-10T05:36:35.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.935+0000 7f044860a9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625db5fd1f0 0x5625db6e88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.935+0000 7f044860a9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5625db503680 con 0x5625db5fd1f0 2024-09-10T05:36:35.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.935+0000 7f0446110640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625db5fd1f0 0x5625db6e88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.935+0000 7f0446110640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625db5fd1f0 0x5625db6e88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47092/0 (socket says 172.21.15.62:47092) 2024-09-10T05:36:35.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.935+0000 7f0446110640 1 -- 172.21.15.62:0/1403776274 learned_addr learned my addr 172.21.15.62:0/1403776274 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:35.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.935+0000 7f0446110640 1 -- 172.21.15.62:0/1403776274 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625db47eda0 con 0x5625db5fd1f0 2024-09-10T05:36:35.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.935+0000 7f0446110640 1 --2- 172.21.15.62:0/1403776274 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625db5fd1f0 0x5625db6e88c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0438018eb0 tx=0x7f0438003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa27f5c3a26fcc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.935+0000 7f0334608640 1 -- 172.21.15.62:0/1403776274 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04380b0070 con 0x5625db5fd1f0 2024-09-10T05:36:35.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.935+0000 7f0334608640 1 -- 172.21.15.62:0/1403776274 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04380b1040 con 0x5625db5fd1f0 2024-09-10T05:36:35.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.935+0000 7f0334608640 1 -- 172.21.15.62:0/1403776274 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04380ab6f0 con 0x5625db5fd1f0 2024-09-10T05:36:35.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.935+0000 7f044860a9c0 1 -- 172.21.15.62:0/1403776274 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625db5fd1f0 msgr2=0x5625db6e88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.935+0000 7f044860a9c0 1 --2- 172.21.15.62:0/1403776274 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625db5fd1f0 0x5625db6e88c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0438018eb0 tx=0x7f0438003030 comp rx=0 tx=0).stop 2024-09-10T05:36:35.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.935+0000 7f044860a9c0 1 -- 172.21.15.62:0/1403776274 shutdown_connections 2024-09-10T05:36:35.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.935+0000 7f044860a9c0 1 --2- 172.21.15.62:0/1403776274 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625db5fd1f0 0x5625db6e88c0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:35.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.935+0000 7f044860a9c0 1 -- 172.21.15.62:0/1403776274 >> 172.21.15.62:0/1403776274 conn(0x5625db570b00 msgr2=0x5625db6e4540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:35.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.935+0000 7f044860a9c0 1 -- 172.21.15.62:0/1403776274 shutdown_connections 2024-09-10T05:36:35.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.935+0000 7f044860a9c0 1 -- 172.21.15.62:0/1403776274 wait complete. 2024-09-10T05:36:35.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.935+0000 7f044860a9c0 1 Processor -- start 2024-09-10T05:36:35.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.935+0000 7f044860a9c0 1 -- start start 2024-09-10T05:36:35.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.939+0000 7f044860a9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625db5fd1f0 0x5625db6efe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.939+0000 7f044860a9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5625db4a5a50 con 0x5625db5fd1f0 2024-09-10T05:36:35.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.939+0000 7f0446110640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625db5fd1f0 0x5625db6efe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.939+0000 7f0446110640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625db5fd1f0 0x5625db6efe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47096/0 (socket says 172.21.15.62:47096) 2024-09-10T05:36:35.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.939+0000 7f0446110640 1 -- 172.21.15.62:0/3159879200 learned_addr learned my addr 172.21.15.62:0/3159879200 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:35.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.939+0000 7f0446110640 1 -- 172.21.15.62:0/3159879200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625db6f0360 con 0x5625db5fd1f0 2024-09-10T05:36:35.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.939+0000 7f0446110640 1 --2- 172.21.15.62:0/3159879200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625db5fd1f0 0x5625db6efe00 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0438018eb0 tx=0x7f0438018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.939+0000 7f0332e05640 1 -- 172.21.15.62:0/3159879200 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04380c4070 con 0x5625db5fd1f0 2024-09-10T05:36:35.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.939+0000 7f044860a9c0 1 -- 172.21.15.62:0/3159879200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5625db6f05f0 con 0x5625db5fd1f0 2024-09-10T05:36:35.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.939+0000 7f0332e05640 1 -- 172.21.15.62:0/3159879200 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04380b75b0 con 0x5625db5fd1f0 2024-09-10T05:36:35.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.939+0000 7f0332e05640 1 -- 172.21.15.62:0/3159879200 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04380ce060 con 0x5625db5fd1f0 2024-09-10T05:36:35.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.939+0000 7f044860a9c0 1 -- 172.21.15.62:0/3159879200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625db6f0fa0 con 0x5625db5fd1f0 2024-09-10T05:36:35.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.939+0000 7f0332e05640 1 -- 172.21.15.62:0/3159879200 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f04380c7070 con 0x5625db5fd1f0 2024-09-10T05:36:35.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.939+0000 7f0332e05640 1 --2- 172.21.15.62:0/3159879200 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f032c039ac0 0x7f032c03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.939+0000 7f0332e05640 1 -- 172.21.15.62:0/3159879200 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f04380bc070 con 0x5625db5fd1f0 2024-09-10T05:36:35.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.939+0000 7f044590f640 1 --2- 172.21.15.62:0/3159879200 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f032c039ac0 0x7f032c03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.939+0000 7f044860a9c0 1 --2- 172.21.15.62:0/3159879200 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5625db600330 0x5625db6f6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.939+0000 7f044860a9c0 1 -- 172.21.15.62:0/3159879200 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625db6f74b0 con 0x5625db600330 2024-09-10T05:36:35.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.939+0000 7f0446911640 1 --2- 172.21.15.62:0/3159879200 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5625db600330 0x5625db6f6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.943+0000 7f044590f640 1 --2- 172.21.15.62:0/3159879200 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f032c039ac0 0x7f032c03bf80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0430001d80 tx=0x7f04300012e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.943+0000 7f0446911640 1 --2- 172.21.15.62:0/3159879200 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5625db600330 0x5625db6f6f70 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.943+0000 7f0446911640 1 -- 172.21.15.62:0/3159879200 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f044000a4d0 con 0x5625db600330 2024-09-10T05:36:35.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.943+0000 7f044860a9c0 1 --2- 172.21.15.62:0/3159879200 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5625db6f8210 0x5625db6fa600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.943+0000 7f044860a9c0 1 -- 172.21.15.62:0/3159879200 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625db6fac10 con 0x5625db6f8210 2024-09-10T05:36:35.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.943+0000 7f0446110640 1 --2- 172.21.15.62:0/3159879200 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5625db6f8210 0x5625db6fa600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.943+0000 7f0446110640 1 --2- 172.21.15.62:0/3159879200 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5625db6f8210 0x5625db6fa600 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.943+0000 7f0446110640 1 -- 172.21.15.62:0/3159879200 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f04380c6030 con 0x5625db6f8210 2024-09-10T05:36:35.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.943+0000 7f044860a9c0 1 --2- 172.21.15.62:0/3159879200 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5625db6fc9d0 0x5625db6fedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.943+0000 7f044860a9c0 1 -- 172.21.15.62:0/3159879200 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625db6ff4b0 con 0x5625db6fc9d0 2024-09-10T05:36:35.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.943+0000 7f044590f640 1 --2- 172.21.15.62:0/3159879200 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5625db6fc9d0 0x5625db6fedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.943+0000 7f044590f640 1 --2- 172.21.15.62:0/3159879200 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5625db6fc9d0 0x5625db6fedc0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.943+0000 7f044590f640 1 -- 172.21.15.62:0/3159879200 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f043000e620 con 0x5625db6fc9d0 2024-09-10T05:36:35.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.943+0000 7f044860a9c0 1 -- 172.21.15.62:0/3159879200 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625db6fb870 con 0x5625db6f8210 2024-09-10T05:36:35.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.947+0000 7f0446110640 1 -- 172.21.15.62:0/3159879200 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f04380c6030 con 0x5625db6f8210 2024-09-10T05:36:35.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.947+0000 7f044860a9c0 1 -- 172.21.15.62:0/3159879200 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625db6fbcd0 con 0x5625db6fc9d0 2024-09-10T05:36:35.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.947+0000 7f044590f640 1 -- 172.21.15.62:0/3159879200 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f043000e620 con 0x5625db6fc9d0 2024-09-10T05:36:35.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.947+0000 7f044860a9c0 1 Processor -- start 2024-09-10T05:36:35.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.947+0000 7f044860a9c0 1 -- start start 2024-09-10T05:36:35.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.947+0000 7f044860a9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625db70db00 0x5625db70df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.947+0000 7f044860a9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5625db510450 con 0x5625db70db00 2024-09-10T05:36:35.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.947+0000 7f0446110640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625db70db00 0x5625db70df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.947+0000 7f0446110640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625db70db00 0x5625db70df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47110/0 (socket says 172.21.15.62:47110) 2024-09-10T05:36:35.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.947+0000 7f0446110640 1 -- 172.21.15.62:0/3129593669 learned_addr learned my addr 172.21.15.62:0/3129593669 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:35.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.947+0000 7f0446110640 1 -- 172.21.15.62:0/3129593669 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625db70e560 con 0x5625db70db00 2024-09-10T05:36:35.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.947+0000 7f0446110640 1 --2- 172.21.15.62:0/3129593669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625db70db00 0x5625db70df20 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f04380aa780 tx=0x7f04380a4c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.947+0000 7f032bfff640 1 -- 172.21.15.62:0/3129593669 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04380e8260 con 0x5625db70db00 2024-09-10T05:36:35.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.947+0000 7f032bfff640 1 -- 172.21.15.62:0/3129593669 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04380b7890 con 0x5625db70db00 2024-09-10T05:36:35.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.947+0000 7f044860a9c0 1 -- 172.21.15.62:0/3129593669 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5625db70edc0 con 0x5625db70db00 2024-09-10T05:36:35.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.947+0000 7f032bfff640 1 -- 172.21.15.62:0/3129593669 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04380b7b70 con 0x5625db70db00 2024-09-10T05:36:35.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.947+0000 7f044860a9c0 1 -- 172.21.15.62:0/3129593669 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625db70f330 con 0x5625db70db00 2024-09-10T05:36:35.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.951+0000 7f032bfff640 1 -- 172.21.15.62:0/3129593669 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f04380e0040 con 0x5625db70db00 2024-09-10T05:36:35.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.951+0000 7f032bfff640 1 --2- 172.21.15.62:0/3129593669 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0320039a70 0x7f032003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.951+0000 7f032bfff640 1 -- 172.21.15.62:0/3129593669 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f04380a8070 con 0x5625db70db00 2024-09-10T05:36:35.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.951+0000 7f044590f640 1 --2- 172.21.15.62:0/3129593669 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0320039a70 0x7f032003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.951+0000 7f044860a9c0 1 Processor -- start 2024-09-10T05:36:35.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.951+0000 7f044860a9c0 1 -- start start 2024-09-10T05:36:35.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.951+0000 7f044590f640 1 --2- 172.21.15.62:0/3129593669 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0320039a70 0x7f032003bf30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f043000bf50 tx=0x7f043000f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.951+0000 7f044860a9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625db71a290 0x5625db71a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.951+0000 7f044860a9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5625db6e9050 con 0x5625db71a290 2024-09-10T05:36:35.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.951+0000 7f0446110640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625db71a290 0x5625db71a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.951+0000 7f0446110640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625db71a290 0x5625db71a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47112/0 (socket says 172.21.15.62:47112) 2024-09-10T05:36:35.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.951+0000 7f0446110640 1 -- 172.21.15.62:0/2872184662 learned_addr learned my addr 172.21.15.62:0/2872184662 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:35.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.951+0000 7f0446110640 1 -- 172.21.15.62:0/2872184662 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625db71ac40 con 0x5625db71a290 2024-09-10T05:36:35.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.951+0000 7f0446110640 1 --2- 172.21.15.62:0/2872184662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625db71a290 0x5625db71a670 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f04380bc040 tx=0x7f04380f53f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=559b6ca84789009e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.951+0000 7f0329ffb640 1 -- 172.21.15.62:0/2872184662 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04380b7e40 con 0x5625db71a290 2024-09-10T05:36:35.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.951+0000 7f0329ffb640 1 -- 172.21.15.62:0/2872184662 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0438104070 con 0x5625db71a290 2024-09-10T05:36:35.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.951+0000 7f0329ffb640 1 -- 172.21.15.62:0/2872184662 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04380aa920 con 0x5625db71a290 2024-09-10T05:36:35.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.951+0000 7f044860a9c0 1 -- 172.21.15.62:0/2872184662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625db71a290 msgr2=0x5625db71a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:35.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.951+0000 7f044860a9c0 1 --2- 172.21.15.62:0/2872184662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625db71a290 0x5625db71a670 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f04380bc040 tx=0x7f04380f53f0 comp rx=0 tx=0).stop 2024-09-10T05:36:35.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.951+0000 7f044860a9c0 1 -- 172.21.15.62:0/2872184662 shutdown_connections 2024-09-10T05:36:35.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.951+0000 7f044860a9c0 1 --2- 172.21.15.62:0/2872184662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625db71a290 0x5625db71a670 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:35.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.951+0000 7f044860a9c0 1 -- 172.21.15.62:0/2872184662 >> 172.21.15.62:0/2872184662 conn(0x5625db7166c0 msgr2=0x5625db714900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:35.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.951+0000 7f044860a9c0 1 -- 172.21.15.62:0/2872184662 shutdown_connections 2024-09-10T05:36:35.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.951+0000 7f044860a9c0 1 -- 172.21.15.62:0/2872184662 wait complete. 2024-09-10T05:36:35.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.955+0000 7f044860a9c0 1 Processor -- start 2024-09-10T05:36:35.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.955+0000 7f044860a9c0 1 -- start start 2024-09-10T05:36:35.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.955+0000 7f044860a9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625db71a290 0x5625db721580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.955+0000 7f044860a9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5625db71b120 con 0x5625db71a290 2024-09-10T05:36:35.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.955+0000 7f0446110640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625db71a290 0x5625db721580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.955+0000 7f0446110640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625db71a290 0x5625db721580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47120/0 (socket says 172.21.15.62:47120) 2024-09-10T05:36:35.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.955+0000 7f0446110640 1 -- 172.21.15.62:0/3532407348 learned_addr learned my addr 172.21.15.62:0/3532407348 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:35.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.955+0000 7f0446110640 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625db721ae0 con 0x5625db71a290 2024-09-10T05:36:35.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.955+0000 7f0446110640 1 --2- 172.21.15.62:0/3532407348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625db71a290 0x5625db721580 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f04380f5560 tx=0x7f04380bcee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.955+0000 7f0317fff640 1 -- 172.21.15.62:0/3532407348 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04380f5700 con 0x5625db71a290 2024-09-10T05:36:35.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.955+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5625db721ae0 con 0x5625db71a290 2024-09-10T05:36:35.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.955+0000 7f0317fff640 1 -- 172.21.15.62:0/3532407348 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f043810f070 con 0x5625db71a290 2024-09-10T05:36:35.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.955+0000 7f0317fff640 1 -- 172.21.15.62:0/3532407348 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04380a41d0 con 0x5625db71a290 2024-09-10T05:36:35.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.955+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625db721ae0 con 0x5625db71a290 2024-09-10T05:36:35.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.955+0000 7f0317fff640 1 -- 172.21.15.62:0/3532407348 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f04380fe070 con 0x5625db71a290 2024-09-10T05:36:35.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.955+0000 7f044860a9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.955+0000 7f0317fff640 1 --2- 172.21.15.62:0/3532407348 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0310039ac0 0x7f031003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.955+0000 7f0317fff640 1 -- 172.21.15.62:0/3532407348 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f0438115b20 con 0x5625db71a290 2024-09-10T05:36:35.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.955+0000 7f044590f640 1 --2- 172.21.15.62:0/3532407348 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0310039ac0 0x7f031003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.955+0000 7f044860a9c0 1 --2- 172.21.15.62:0/3532407348 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5625db72c3a0 0x5625db72e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.955+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625db72ef40 con 0x5625db72c3a0 2024-09-10T05:36:35.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.959+0000 7f0446911640 1 --2- 172.21.15.62:0/3532407348 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5625db72c3a0 0x5625db72e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.959+0000 7f044590f640 1 --2- 172.21.15.62:0/3532407348 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0310039ac0 0x7f031003bf80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x5625db6f1250 tx=0x7f0430010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.959+0000 7f0446911640 1 --2- 172.21.15.62:0/3532407348 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5625db72c3a0 0x5625db72e7f0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.959+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f044000a4d0 con 0x5625db72c3a0 2024-09-10T05:36:35.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.959+0000 7f044860a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:35.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.959+0000 7f044860a9c0 20 realm 2024-09-10T05:36:35.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.959+0000 7f044860a9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.959+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625db72b790 con 0x5625db72c3a0 2024-09-10T05:36:35.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.959+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f044000a4d0 con 0x5625db72c3a0 2024-09-10T05:36:35.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.959+0000 7f044860a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:35.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.959+0000 7f044860a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:35.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.959+0000 7f044860a9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.959+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625db72fa00 con 0x5625db72c3a0 2024-09-10T05:36:35.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.959+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f044000a4d0 con 0x5625db72c3a0 2024-09-10T05:36:35.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.959+0000 7f044860a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:35.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.959+0000 7f044860a9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.959+0000 7f044860a9c0 1 --2- 172.21.15.62:0/3532407348 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5625db7307e0 0x5625db732bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.959+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625db733260 con 0x5625db7307e0 2024-09-10T05:36:35.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.959+0000 7f0446110640 1 --2- 172.21.15.62:0/3532407348 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5625db7307e0 0x5625db732bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.959+0000 7f0446110640 1 --2- 172.21.15.62:0/3532407348 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5625db7307e0 0x5625db732bd0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.959+0000 7f0446110640 1 -- 172.21.15.62:0/3532407348 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f04380c6030 con 0x5625db7307e0 2024-09-10T05:36:35.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.959+0000 7f044860a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:35.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.959+0000 7f044860a9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.959+0000 7f044860a9c0 1 --2- 172.21.15.62:0/3532407348 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5625db734010 0x5625db736400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.959+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625db736aa0 con 0x5625db734010 2024-09-10T05:36:35.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.959+0000 7f044590f640 1 --2- 172.21.15.62:0/3532407348 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5625db734010 0x5625db736400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.959+0000 7f044590f640 1 --2- 172.21.15.62:0/3532407348 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5625db734010 0x5625db736400 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.963+0000 7f044590f640 1 -- 172.21.15.62:0/3532407348 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0430026070 con 0x5625db734010 2024-09-10T05:36:35.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.963+0000 7f044860a9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:35.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.963+0000 7f044860a9c0 20 searching for the correct realm 2024-09-10T05:36:35.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.963+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625db738390 con 0x5625db734010 2024-09-10T05:36:35.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.963+0000 7f044590f640 1 -- 172.21.15.62:0/3532407348 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0430026070 con 0x5625db734010 2024-09-10T05:36:35.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.963+0000 7f044590f640 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625db738390 con 0x5625db7307e0 2024-09-10T05:36:35.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.963+0000 7f0446110640 1 -- 172.21.15.62:0/3532407348 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04380c6030 con 0x5625db7307e0 2024-09-10T05:36:35.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.963+0000 7f0446110640 1 --2- 172.21.15.62:0/3532407348 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f043810b040 0x7f04380f2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:35.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.963+0000 7f0446110640 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625db738390 con 0x7f043810b040 2024-09-10T05:36:35.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.963+0000 7f0446911640 1 --2- 172.21.15.62:0/3532407348 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f043810b040 0x7f04380f2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:35.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.963+0000 7f0446911640 1 --2- 172.21.15.62:0/3532407348 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f043810b040 0x7f04380f2860 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:35.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.963+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f044000a4d0 con 0x7f043810b040 2024-09-10T05:36:35.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.963+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625db738390 con 0x5625db72c3a0 2024-09-10T05:36:35.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.963+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f044000a4d0 con 0x5625db72c3a0 2024-09-10T05:36:35.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.963+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625db738390 con 0x5625db72c3a0 2024-09-10T05:36:35.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.963+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f044000a4d0 con 0x5625db72c3a0 2024-09-10T05:36:35.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.963+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625db738390 con 0x5625db734010 2024-09-10T05:36:35.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.963+0000 7f044590f640 1 -- 172.21.15.62:0/3532407348 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0430026070 con 0x5625db734010 2024-09-10T05:36:35.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.963+0000 7f044590f640 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625db738390 con 0x5625db72c3a0 2024-09-10T05:36:35.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.963+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f044000a4d0 con 0x5625db72c3a0 2024-09-10T05:36:35.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.963+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625db738390 con 0x5625db7307e0 2024-09-10T05:36:35.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.967+0000 7f0446110640 1 -- 172.21.15.62:0/3532407348 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04380c6030 con 0x5625db7307e0 2024-09-10T05:36:35.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.967+0000 7f0446110640 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625db738390 con 0x5625db7307e0 2024-09-10T05:36:35.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.967+0000 7f0446110640 1 -- 172.21.15.62:0/3532407348 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04380c6030 con 0x5625db7307e0 2024-09-10T05:36:35.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.967+0000 7f0446110640 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625db738390 con 0x5625db72c3a0 2024-09-10T05:36:35.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.967+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f044000a4d0 con 0x5625db72c3a0 2024-09-10T05:36:35.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.967+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625db738390 con 0x7f043810b040 2024-09-10T05:36:35.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.967+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f044000a4d0 con 0x7f043810b040 2024-09-10T05:36:35.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.967+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625db738390 con 0x5625db72c3a0 2024-09-10T05:36:35.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.967+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f044000a4d0 con 0x5625db72c3a0 2024-09-10T05:36:35.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.967+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625db738390 con 0x7f043810b040 2024-09-10T05:36:35.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.967+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f044000a4d0 con 0x7f043810b040 2024-09-10T05:36:35.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.967+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625db738390 con 0x5625db7307e0 2024-09-10T05:36:35.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.967+0000 7f0446110640 1 -- 172.21.15.62:0/3532407348 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04380c6030 con 0x5625db7307e0 2024-09-10T05:36:35.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.967+0000 7f0446110640 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625db738390 con 0x5625db734010 2024-09-10T05:36:35.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.967+0000 7f044590f640 1 -- 172.21.15.62:0/3532407348 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0430026070 con 0x5625db734010 2024-09-10T05:36:35.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.967+0000 7f044590f640 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625db738390 con 0x5625db72c3a0 2024-09-10T05:36:35.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.967+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f044000a4d0 con 0x5625db72c3a0 2024-09-10T05:36:35.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.967+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625db738390 con 0x5625db7307e0 2024-09-10T05:36:35.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.971+0000 7f0446110640 1 -- 172.21.15.62:0/3532407348 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04380c6030 con 0x5625db7307e0 2024-09-10T05:36:35.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.971+0000 7f0446110640 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625db738390 con 0x5625db734010 2024-09-10T05:36:35.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.971+0000 7f044590f640 1 -- 172.21.15.62:0/3532407348 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 30 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f0430026070 con 0x5625db734010 2024-09-10T05:36:35.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.971+0000 7f044590f640 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625db738390 con 0x5625db72c3a0 2024-09-10T05:36:35.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.971+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f044000a4d0 con 0x5625db72c3a0 2024-09-10T05:36:35.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.971+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625db738390 con 0x5625db72c3a0 2024-09-10T05:36:35.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.971+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f044000a4d0 con 0x5625db72c3a0 2024-09-10T05:36:35.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.971+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625db738390 con 0x5625db72c3a0 2024-09-10T05:36:35.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.971+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f044000a4d0 con 0x5625db72c3a0 2024-09-10T05:36:35.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.971+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625db738390 con 0x5625db734010 2024-09-10T05:36:35.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.971+0000 7f044590f640 1 -- 172.21.15.62:0/3532407348 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0430026070 con 0x5625db734010 2024-09-10T05:36:35.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.971+0000 7f044590f640 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625db738390 con 0x7f043810b040 2024-09-10T05:36:35.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.971+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f044000a4d0 con 0x7f043810b040 2024-09-10T05:36:35.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.971+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625db738390 con 0x5625db72c3a0 2024-09-10T05:36:35.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.971+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f044000a4d0 con 0x5625db72c3a0 2024-09-10T05:36:35.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.971+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625db738390 con 0x7f043810b040 2024-09-10T05:36:35.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.971+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f044000a4d0 con 0x7f043810b040 2024-09-10T05:36:35.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.971+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625db738390 con 0x5625db734010 2024-09-10T05:36:35.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.971+0000 7f044590f640 1 -- 172.21.15.62:0/3532407348 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0430026070 con 0x5625db734010 2024-09-10T05:36:35.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.971+0000 7f044590f640 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625db738390 con 0x7f043810b040 2024-09-10T05:36:35.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.971+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f044000a4d0 con 0x7f043810b040 2024-09-10T05:36:35.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.971+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625db738390 con 0x5625db7307e0 2024-09-10T05:36:35.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.975+0000 7f0446110640 1 -- 172.21.15.62:0/3532407348 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04380c6030 con 0x5625db7307e0 2024-09-10T05:36:35.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.975+0000 7f0446110640 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625db738390 con 0x5625db7307e0 2024-09-10T05:36:35.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.975+0000 7f0446110640 1 -- 172.21.15.62:0/3532407348 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04380c6030 con 0x5625db7307e0 2024-09-10T05:36:35.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.975+0000 7f0446110640 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625db738390 con 0x5625db734010 2024-09-10T05:36:35.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.975+0000 7f044590f640 1 -- 172.21.15.62:0/3532407348 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0430026070 con 0x5625db734010 2024-09-10T05:36:35.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.975+0000 7f044590f640 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625db738390 con 0x5625db7307e0 2024-09-10T05:36:35.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.975+0000 7f0446110640 1 -- 172.21.15.62:0/3532407348 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f04380c6030 con 0x5625db7307e0 2024-09-10T05:36:35.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.975+0000 7f0446110640 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625db738390 con 0x5625db7307e0 2024-09-10T05:36:35.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.975+0000 7f0446110640 1 -- 172.21.15.62:0/3532407348 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04380c6030 con 0x5625db7307e0 2024-09-10T05:36:35.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.975+0000 7f044860a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:35.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.975+0000 7f044860a9c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:35.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.975+0000 7f044860a9c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:35.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.975+0000 7f044860a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:35.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.975+0000 7f044860a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:35.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.975+0000 7f044860a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:35.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.975+0000 7f044860a9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.975+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625db737490 con 0x5625db72c3a0 2024-09-10T05:36:35.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.975+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f044000a4d0 con 0x5625db72c3a0 2024-09-10T05:36:35.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.975+0000 7f044860a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:35.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.975+0000 7f044860a9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.975+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625db7378b0 con 0x5625db7307e0 2024-09-10T05:36:35.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.979+0000 7f0446110640 1 -- 172.21.15.62:0/3532407348 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f04380c6030 con 0x5625db7307e0 2024-09-10T05:36:35.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.979+0000 7f044860a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:35.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.979+0000 7f044860a9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.979+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625db737cd0 con 0x5625db734010 2024-09-10T05:36:35.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.979+0000 7f044590f640 1 -- 172.21.15.62:0/3532407348 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0430026070 con 0x5625db734010 2024-09-10T05:36:35.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.979+0000 7f044860a9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:35.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.979+0000 7f044860a9c0 20 zone default found 2024-09-10T05:36:35.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.979+0000 7f044860a9c0 4 Realm: () 2024-09-10T05:36:35.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.979+0000 7f044860a9c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:35.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.979+0000 7f044860a9c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:35.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.979+0000 7f044860a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:35.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.979+0000 7f044860a9c0 20 zonegroup default 2024-09-10T05:36:35.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.979+0000 7f044860a9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.979+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625db737000 con 0x7f043810b040 2024-09-10T05:36:35.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.979+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f044000a4d0 con 0x7f043810b040 2024-09-10T05:36:35.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.979+0000 7f044860a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:35.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.979+0000 7f044860a9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.979+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625db73aaa0 con 0x5625db734010 2024-09-10T05:36:35.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.979+0000 7f044590f640 1 -- 172.21.15.62:0/3532407348 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0430026070 con 0x5625db734010 2024-09-10T05:36:35.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.979+0000 7f044860a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:35.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.979+0000 7f044860a9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:35.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.979+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625db73af30 con 0x5625db734010 2024-09-10T05:36:35.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.979+0000 7f044590f640 1 -- 172.21.15.62:0/3532407348 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0430026070 con 0x5625db734010 2024-09-10T05:36:35.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.979+0000 7f044860a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:35.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.979+0000 7f044860a9c0 20 started sync module instance, tier type = 2024-09-10T05:36:35.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.979+0000 7f044860a9c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:35.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.979+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625db7398a0 con 0x5625db7307e0 2024-09-10T05:36:35.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.983+0000 7f0446110640 1 -- 172.21.15.62:0/3532407348 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04380c6030 con 0x5625db7307e0 2024-09-10T05:36:35.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.983+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94720595566016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625db7398a0 con 0x5625db7307e0 2024-09-10T05:36:35.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.983+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625db73ba60 con 0x5625db72c3a0 2024-09-10T05:36:35.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.983+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f044000a4d0 con 0x5625db72c3a0 2024-09-10T05:36:35.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.983+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94720595572048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625db73c300 con 0x5625db72c3a0 2024-09-10T05:36:35.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.983+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625db73cd40 con 0x5625db7307e0 2024-09-10T05:36:35.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.983+0000 7f0446110640 1 -- 172.21.15.62:0/3532407348 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94720595566016] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04380c6030 con 0x5625db7307e0 2024-09-10T05:36:35.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.983+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94720595572048] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f044000a4d0 con 0x5625db72c3a0 2024-09-10T05:36:35.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.987+0000 7f0446110640 1 -- 172.21.15.62:0/3532407348 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04380c6030 con 0x5625db7307e0 2024-09-10T05:36:35.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.987+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94720595576848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625db73be50 con 0x5625db7307e0 2024-09-10T05:36:35.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.987+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625db73d5e0 con 0x7f043810b040 2024-09-10T05:36:35.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.987+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f044000a4d0 con 0x7f043810b040 2024-09-10T05:36:35.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.987+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94720595579184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625db73be50 con 0x7f043810b040 2024-09-10T05:36:35.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.987+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625db73e0a0 con 0x5625db7307e0 2024-09-10T05:36:35.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.987+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94720595579184] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f044000a4d0 con 0x7f043810b040 2024-09-10T05:36:35.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.987+0000 7f0446110640 1 -- 172.21.15.62:0/3532407348 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94720595576848] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04380c6030 con 0x5625db7307e0 2024-09-10T05:36:35.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.987+0000 7f0446110640 1 -- 172.21.15.62:0/3532407348 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04380c6030 con 0x5625db7307e0 2024-09-10T05:36:35.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.987+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94720595563504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625db73e060 con 0x5625db7307e0 2024-09-10T05:36:35.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.987+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625db73e490 con 0x5625db734010 2024-09-10T05:36:35.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.991+0000 7f044590f640 1 -- 172.21.15.62:0/3532407348 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0430026070 con 0x5625db734010 2024-09-10T05:36:35.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.991+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94720595580240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625db73e490 con 0x5625db734010 2024-09-10T05:36:35.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.991+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625db73f390 con 0x5625db734010 2024-09-10T05:36:35.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.991+0000 7f044590f640 1 -- 172.21.15.62:0/3532407348 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94720595580240] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0430026070 con 0x5625db734010 2024-09-10T05:36:35.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.991+0000 7f0446110640 1 -- 172.21.15.62:0/3532407348 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94720595563504] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04380c6030 con 0x5625db7307e0 2024-09-10T05:36:35.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.991+0000 7f044590f640 1 -- 172.21.15.62:0/3532407348 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0430026070 con 0x5625db734010 2024-09-10T05:36:35.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.991+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94720595581808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625db73eea0 con 0x5625db734010 2024-09-10T05:36:35.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.991+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625db73fc30 con 0x7f043810b040 2024-09-10T05:36:35.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.995+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f044000a4d0 con 0x7f043810b040 2024-09-10T05:36:35.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.995+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94720595588992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625db73eea0 con 0x7f043810b040 2024-09-10T05:36:35.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.995+0000 7f044860a9c0 20 add_watcher() i=0 2024-09-10T05:36:35.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.995+0000 7f044860a9c0 20 add_watcher() i=1 2024-09-10T05:36:35.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.995+0000 7f044860a9c0 20 add_watcher() i=2 2024-09-10T05:36:35.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.995+0000 7f044860a9c0 20 add_watcher() i=3 2024-09-10T05:36:35.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.995+0000 7f044860a9c0 20 add_watcher() i=4 2024-09-10T05:36:35.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.995+0000 7f044860a9c0 20 add_watcher() i=5 2024-09-10T05:36:35.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.995+0000 7f044590f640 1 -- 172.21.15.62:0/3532407348 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94720595581808] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0430026070 con 0x5625db734010 2024-09-10T05:36:35.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.995+0000 7f044860a9c0 20 add_watcher() i=6 2024-09-10T05:36:35.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.995+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94720595588992] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f044000a4d0 con 0x7f043810b040 2024-09-10T05:36:35.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.995+0000 7f044860a9c0 20 add_watcher() i=7 2024-09-10T05:36:35.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.995+0000 7f044860a9c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:35.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.995+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625db73e880 con 0x5625db72c3a0 2024-09-10T05:36:35.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.995+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f044000a4d0 con 0x5625db72c3a0 2024-09-10T05:36:35.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.995+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94720595585152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625db7401f0 con 0x5625db72c3a0 2024-09-10T05:36:36.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.995+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94720595585152] v30'108 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f044000a4d0 con 0x5625db72c3a0 2024-09-10T05:36:36.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.999+0000 7f02fcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:36.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.999+0000 7f044860a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:36.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.999+0000 7f044860a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:36.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.999+0000 7f044860a9c0 5 note: GC not initialized 2024-09-10T05:36:36.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.999+0000 7f02777fe640 20 reqs_thread_entry: start 2024-09-10T05:36:36.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.999+0000 7f044860a9c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:36.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.999+0000 7f044860a9c0 20 Filter name: none 2024-09-10T05:36:36.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.999+0000 7f02757fa640 20 reqs_thread_entry: start 2024-09-10T05:36:36.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.999+0000 7f044860a9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.999+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625db765b00 con 0x5625db72c3a0 2024-09-10T05:36:36.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.999+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f044000a4d0 con 0x5625db72c3a0 2024-09-10T05:36:36.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.999+0000 7f044860a9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:36:36.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.999+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625db767080 con 0x7f043810b040 2024-09-10T05:36:36.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.999+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f044000a4d0 con 0x7f043810b040 2024-09-10T05:36:36.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.999+0000 7f044860a9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.999+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:64 8.1f 8:fcc5c255:root::.bucket.meta.myfoo%3a475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625db767050 con 0x7f043810b040 2024-09-10T05:36:36.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.999+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(64 .bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f044000a4d0 con 0x7f043810b040 2024-09-10T05:36:36.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.999+0000 7f044860a9c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T05:36:36.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.999+0000 7f044860a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-10T05:36:36.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.999+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:65 4.39 4:9f393805:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625db768b40 con 0x5625db734010 2024-09-10T05:36:36.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.999+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:66 4.27 4:e72118f4:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625db76b810 con 0x5625db72c3a0 2024-09-10T05:36:36.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.999+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:67 4.32 4:4fe9cf27:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625db76e4e0 con 0x5625db7307e0 2024-09-10T05:36:36.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.999+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:68 4.c 4:3284697f:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625db771070 con 0x5625db72c3a0 2024-09-10T05:36:36.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.999+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:69 4.a 4:5050a708:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625db7738e0 con 0x5625db7307e0 2024-09-10T05:36:36.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.999+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:70 4.1b 4:db0b4800:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625db771070 con 0x7f043810b040 2024-09-10T05:36:36.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.999+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 4.1f 4:fa625c04:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625db7738e0 con 0x5625db7307e0 2024-09-10T05:36:36.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.999+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:72 4.d 4:b20f8417:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625db77afc0 con 0x5625db7307e0 2024-09-10T05:36:36.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.999+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:73 4.3 4:c3f62267:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625db77da60 con 0x5625db72c3a0 2024-09-10T05:36:36.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.999+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:74 4.26 4:65fa9cda:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625db7807c0 con 0x5625db72c3a0 2024-09-10T05:36:36.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.999+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:75 4.3e 4:7c38a587:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625db783550 con 0x5625db7307e0 2024-09-10T05:36:36.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.999+0000 7f044590f640 1 -- 172.21.15.62:0/3532407348 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(65 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f0430026070 con 0x5625db734010 2024-09-10T05:36:36.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.999+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(66 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f044000a4d0 con 0x5625db72c3a0 2024-09-10T05:36:36.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.999+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(70 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.5 [call out=128b] v0'0 uv3 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f044000a4d0 con 0x7f043810b040 2024-09-10T05:36:36.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.999+0000 7f0446110640 1 -- 172.21.15.62:0/3532407348 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(67 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f04380c6030 con 0x5625db7307e0 2024-09-10T05:36:36.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.999+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(68 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f044000a4d0 con 0x5625db72c3a0 2024-09-10T05:36:36.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.999+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(73 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f044000a4d0 con 0x5625db72c3a0 2024-09-10T05:36:36.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.999+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 <== osd.1 v2:172.21.15.62:6808/3442097179 23 ==== osd_op_reply(74 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f044000a4d0 con 0x5625db72c3a0 2024-09-10T05:36:36.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.999+0000 7f0446110640 1 -- 172.21.15.62:0/3532407348 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(69 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f04380c6030 con 0x5625db7307e0 2024-09-10T05:36:36.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.999+0000 7f0446110640 1 -- 172.21.15.62:0/3532407348 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(71 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f04380c6030 con 0x5625db7307e0 2024-09-10T05:36:36.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.999+0000 7f0446110640 1 -- 172.21.15.62:0/3532407348 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== osd_op_reply(75 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f04380c6030 con 0x5625db7307e0 2024-09-10T05:36:36.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.999+0000 7f0446110640 1 -- 172.21.15.62:0/3532407348 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== osd_op_reply(72 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f04380c6030 con 0x5625db7307e0 2024-09-10T05:36:36.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:35.999+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:76 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625db783550 con 0x7f043810b040 2024-09-10T05:36:36.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.003+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 <== osd.2 v2:172.21.15.62:6800/2677868286 15 ==== osd_op_reply(76 foo.buckets [call] v30'15 uv15 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f044000a4d0 con 0x7f043810b040 2024-09-10T05:36:36.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.003+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:77 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625db783550 con 0x7f043810b040 2024-09-10T05:36:36.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.003+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 <== osd.2 v2:172.21.15.62:6800/2677868286 16 ==== osd_op_reply(77 foo.buckets [call] v30'16 uv16 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f044000a4d0 con 0x7f043810b040 2024-09-10T05:36:36.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.003+0000 7f044860a9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.003+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:78 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625db783550 con 0x5625db72c3a0 2024-09-10T05:36:36.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.003+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 <== osd.1 v2:172.21.15.62:6808/3442097179 24 ==== osd_op_reply(78 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f044000a4d0 con 0x5625db72c3a0 2024-09-10T05:36:36.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.003+0000 7f044860a9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:36:36.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.003+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:79 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625db783550 con 0x7f043810b040 2024-09-10T05:36:36.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.003+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 <== osd.2 v2:172.21.15.62:6800/2677868286 17 ==== osd_op_reply(79 foo.buckets [call out=58b] v0'0 uv16 ondisk = 0) ==== 155+0+58 (crc 0 0 0) 0x7f044000a4d0 con 0x7f043810b040 2024-09-10T05:36:36.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.007+0000 7f02fcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:36.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.007+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:80 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94720595585152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625db783550 con 0x5625db72c3a0 2024-09-10T05:36:36.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.007+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 <== osd.1 v2:172.21.15.62:6808/3442097179 25 ==== osd_op_reply(80 data_loggenerations_metadata [watch unwatch cookie 94720595585152] v30'109 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f044000a4d0 con 0x5625db72c3a0 2024-09-10T05:36:36.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.007+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:81 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94720595566016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625db783550 con 0x5625db7307e0 2024-09-10T05:36:36.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.011+0000 7f0446110640 1 -- 172.21.15.62:0/3532407348 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(81 notify.0 [watch unwatch cookie 94720595566016] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04380c6030 con 0x5625db7307e0 2024-09-10T05:36:36.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.011+0000 7f044860a9c0 20 remove_watcher() i=0 2024-09-10T05:36:36.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.011+0000 7f044860a9c0 2 removed watcher, disabling cache 2024-09-10T05:36:36.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.011+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:82 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94720595572048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625db783550 con 0x5625db72c3a0 2024-09-10T05:36:36.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.011+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 <== osd.1 v2:172.21.15.62:6808/3442097179 26 ==== osd_op_reply(82 notify.1 [watch unwatch cookie 94720595572048] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f044000a4d0 con 0x5625db72c3a0 2024-09-10T05:36:36.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.011+0000 7f044860a9c0 20 remove_watcher() i=1 2024-09-10T05:36:36.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.011+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:83 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94720595576848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625db783550 con 0x5625db7307e0 2024-09-10T05:36:36.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.015+0000 7f0446110640 1 -- 172.21.15.62:0/3532407348 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(83 notify.2 [watch unwatch cookie 94720595576848] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04380c6030 con 0x5625db7307e0 2024-09-10T05:36:36.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.015+0000 7f044860a9c0 20 remove_watcher() i=2 2024-09-10T05:36:36.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.015+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:84 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94720595579184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625db783550 con 0x7f043810b040 2024-09-10T05:36:36.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.015+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 <== osd.2 v2:172.21.15.62:6800/2677868286 18 ==== osd_op_reply(84 notify.3 [watch unwatch cookie 94720595579184] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f044000a4d0 con 0x7f043810b040 2024-09-10T05:36:36.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.015+0000 7f044860a9c0 20 remove_watcher() i=3 2024-09-10T05:36:36.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.015+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:85 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94720595563504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625db783550 con 0x5625db7307e0 2024-09-10T05:36:36.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.015+0000 7f0446110640 1 -- 172.21.15.62:0/3532407348 <== osd.0 v2:172.21.15.2:6800/945139080 25 ==== osd_op_reply(85 notify.4 [watch unwatch cookie 94720595563504] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04380c6030 con 0x5625db7307e0 2024-09-10T05:36:36.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.019+0000 7f044860a9c0 20 remove_watcher() i=4 2024-09-10T05:36:36.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.019+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:86 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94720595580240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625db783550 con 0x5625db734010 2024-09-10T05:36:36.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.019+0000 7f044590f640 1 -- 172.21.15.62:0/3532407348 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(86 notify.5 [watch unwatch cookie 94720595580240] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0430026070 con 0x5625db734010 2024-09-10T05:36:36.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.019+0000 7f044860a9c0 20 remove_watcher() i=5 2024-09-10T05:36:36.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.019+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:87 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94720595581808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625db783550 con 0x5625db734010 2024-09-10T05:36:36.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.019+0000 7f044590f640 1 -- 172.21.15.62:0/3532407348 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== osd_op_reply(87 notify.6 [watch unwatch cookie 94720595581808] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0430026070 con 0x5625db734010 2024-09-10T05:36:36.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.019+0000 7f044860a9c0 20 remove_watcher() i=6 2024-09-10T05:36:36.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.019+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:88 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94720595588992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625db783550 con 0x7f043810b040 2024-09-10T05:36:36.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.019+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 <== osd.2 v2:172.21.15.62:6800/2677868286 19 ==== osd_op_reply(88 notify.7 [watch unwatch cookie 94720595588992] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f044000a4d0 con 0x7f043810b040 2024-09-10T05:36:36.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.019+0000 7f044860a9c0 20 remove_watcher() i=7 2024-09-10T05:36:36.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.023+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5625db7307e0 msgr2=0x5625db732bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.023+0000 7f044860a9c0 1 --2- 172.21.15.62:0/3532407348 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5625db7307e0 0x5625db732bd0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.023+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5625db72c3a0 msgr2=0x5625db72e7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.023+0000 7f044860a9c0 1 --2- 172.21.15.62:0/3532407348 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5625db72c3a0 0x5625db72e7f0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.023+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f043810b040 msgr2=0x7f04380f2860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.023+0000 7f044860a9c0 1 --2- 172.21.15.62:0/3532407348 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f043810b040 0x7f04380f2860 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.023+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5625db734010 msgr2=0x5625db736400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.023+0000 7f044860a9c0 1 --2- 172.21.15.62:0/3532407348 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5625db734010 0x5625db736400 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.023+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0310039ac0 msgr2=0x7f031003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.023+0000 7f044860a9c0 1 --2- 172.21.15.62:0/3532407348 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0310039ac0 0x7f031003bf80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x5625db6f1250 tx=0x7f0430010000 comp rx=0 tx=0).stop 2024-09-10T05:36:36.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.023+0000 7f0446911640 1 -- 172.21.15.62:0/3532407348 reap_dead start 2024-09-10T05:36:36.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.023+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625db71a290 msgr2=0x5625db721580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.023+0000 7f044860a9c0 1 --2- 172.21.15.62:0/3532407348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625db71a290 0x5625db721580 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f04380f5560 tx=0x7f04380bcee0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.023+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 shutdown_connections 2024-09-10T05:36:36.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.023+0000 7f044860a9c0 1 --2- 172.21.15.62:0/3532407348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625db71a290 0x5625db721580 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.023+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 >> 172.21.15.62:0/3532407348 conn(0x5625db7166c0 msgr2=0x5625db7148d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:36.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.023+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 shutdown_connections 2024-09-10T05:36:36.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.023+0000 7f044860a9c0 1 -- 172.21.15.62:0/3532407348 wait complete. 2024-09-10T05:36:36.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.023+0000 7f044860a9c0 1 -- 172.21.15.62:0/3129593669 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0320039a70 msgr2=0x7f032003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.023+0000 7f044860a9c0 1 --2- 172.21.15.62:0/3129593669 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0320039a70 0x7f032003bf30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f043000bf50 tx=0x7f043000f000 comp rx=0 tx=0).stop 2024-09-10T05:36:36.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.023+0000 7f044860a9c0 1 -- 172.21.15.62:0/3129593669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625db70db00 msgr2=0x5625db70df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.023+0000 7f044860a9c0 1 --2- 172.21.15.62:0/3129593669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625db70db00 0x5625db70df20 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f04380aa780 tx=0x7f04380a4c40 comp rx=0 tx=0).stop 2024-09-10T05:36:36.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.023+0000 7f044860a9c0 1 -- 172.21.15.62:0/3129593669 shutdown_connections 2024-09-10T05:36:36.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.023+0000 7f044860a9c0 1 --2- 172.21.15.62:0/3129593669 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0320039a70 0x7f032003bf30 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.023+0000 7f044860a9c0 1 --2- 172.21.15.62:0/3129593669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625db70db00 0x5625db70df20 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.023+0000 7f044860a9c0 1 -- 172.21.15.62:0/3129593669 >> 172.21.15.62:0/3129593669 conn(0x5625db7034b0 msgr2=0x5625db703890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:36.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.023+0000 7f044860a9c0 1 -- 172.21.15.62:0/3129593669 shutdown_connections 2024-09-10T05:36:36.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.023+0000 7f044860a9c0 1 -- 172.21.15.62:0/3129593669 wait complete. 2024-09-10T05:36:36.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.023+0000 7f044860a9c0 1 -- 172.21.15.62:0/3159879200 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5625db6f8210 msgr2=0x5625db6fa600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.023+0000 7f044860a9c0 1 --2- 172.21.15.62:0/3159879200 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5625db6f8210 0x5625db6fa600 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.023+0000 7f044860a9c0 1 -- 172.21.15.62:0/3159879200 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5625db600330 msgr2=0x5625db6f6f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.023+0000 7f044860a9c0 1 --2- 172.21.15.62:0/3159879200 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5625db600330 0x5625db6f6f70 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.023+0000 7f044860a9c0 1 -- 172.21.15.62:0/3159879200 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5625db6fc9d0 msgr2=0x5625db6fedc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.023+0000 7f044860a9c0 1 --2- 172.21.15.62:0/3159879200 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5625db6fc9d0 0x5625db6fedc0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.023+0000 7f044860a9c0 1 -- 172.21.15.62:0/3159879200 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f032c039ac0 msgr2=0x7f032c03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.023+0000 7f044860a9c0 1 --2- 172.21.15.62:0/3159879200 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f032c039ac0 0x7f032c03bf80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0430001d80 tx=0x7f04300012e0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.023+0000 7f044860a9c0 1 -- 172.21.15.62:0/3159879200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625db5fd1f0 msgr2=0x5625db6efe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.023+0000 7f044860a9c0 1 --2- 172.21.15.62:0/3159879200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625db5fd1f0 0x5625db6efe00 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0438018eb0 tx=0x7f0438018020 comp rx=0 tx=0).stop 2024-09-10T05:36:36.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.023+0000 7f0446911640 1 -- 172.21.15.62:0/3159879200 reap_dead start 2024-09-10T05:36:36.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.023+0000 7f044860a9c0 1 -- 172.21.15.62:0/3159879200 shutdown_connections 2024-09-10T05:36:36.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.023+0000 7f044860a9c0 1 -- 172.21.15.62:0/3159879200 >> 172.21.15.62:0/3159879200 conn(0x5625db570b00 msgr2=0x5625db6e2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:36.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.023+0000 7f044860a9c0 1 -- 172.21.15.62:0/3159879200 shutdown_connections 2024-09-10T05:36:36.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.023+0000 7f044860a9c0 1 -- 172.21.15.62:0/3159879200 wait complete. 2024-09-10T05:36:36.037 INFO:teuthology.orchestra.run.smithi062.stdout:{"stats":{"size":3,"size_actual":4096,"size_kb":1,"size_kb_actual":4,"num_objects":1},"last_stats_sync":"2024-09-10T05:36:36.006803Z","last_stats_update":"2024-09-10T05:36:36.005459Z"} 2024-09-10T05:36:36.037 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2024-09-10T05:36:36.006803Z', 'last_stats_update': '2024-09-10T05:36:36.005459Z'} 2024-09-10T05:36:36.043 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T05:36:36.043 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-10T05:36:36.043 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-10T05:36:36.043 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2024-09-10T05:36:36.120 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:36.120 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:36.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.119+0000 7f54d77a19c0 1 Processor -- start 2024-09-10T05:36:36.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.119+0000 7f54d77a19c0 1 -- start start 2024-09-10T05:36:36.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.119+0000 7f54d77a19c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x559672cb4300 0x559672cb66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.119+0000 7f54d77a19c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559672b649c0 con 0x559672c24230 2024-09-10T05:36:36.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.119+0000 7f54d77a19c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x559672bb46d0 con 0x559672cb4300 2024-09-10T05:36:36.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.119+0000 7f54d4aa6640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x559672cb4300 0x559672cb66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.119+0000 7f54d4aa6640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x559672cb4300 0x559672cb66f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47126/0 (socket says 172.21.15.62:47126) 2024-09-10T05:36:36.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.119+0000 7f54d4aa6640 1 -- 172.21.15.62:0/3083919969 learned_addr learned my addr 172.21.15.62:0/3083919969 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:36.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.119+0000 7f54d4aa6640 1 -- 172.21.15.62:0/3083919969 >> v1:172.21.15.2:6789/0 conn(0x559672c24230 legacy=0x559672cb2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.119+0000 7f54d4aa6640 1 -- 172.21.15.62:0/3083919969 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559672b58ca0 con 0x559672cb4300 2024-09-10T05:36:36.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.123+0000 7f54d4aa6640 1 --2- 172.21.15.62:0/3083919969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559672cb4300 0x559672cb66f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f54cc00a5c0 tx=0x7f54cc01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3982badd856a1ad1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.123+0000 7f54c7fff640 1 -- 172.21.15.62:0/3083919969 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54cc0b1070 con 0x559672cb4300 2024-09-10T05:36:36.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.123+0000 7f54c7fff640 1 -- 172.21.15.62:0/3083919969 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54cc0a8070 con 0x559672cb4300 2024-09-10T05:36:36.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.123+0000 7f54c7fff640 1 -- 172.21.15.62:0/3083919969 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54cc0ac5b0 con 0x559672cb4300 2024-09-10T05:36:36.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.123+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3083919969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559672cb4300 msgr2=0x559672cb66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.123+0000 7f54d77a19c0 1 --2- 172.21.15.62:0/3083919969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559672cb4300 0x559672cb66f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f54cc00a5c0 tx=0x7f54cc01b340 comp rx=0 tx=0).stop 2024-09-10T05:36:36.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.123+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3083919969 shutdown_connections 2024-09-10T05:36:36.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.123+0000 7f54d77a19c0 1 --2- 172.21.15.62:0/3083919969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559672cb4300 0x559672cb66f0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.123+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3083919969 >> 172.21.15.62:0/3083919969 conn(0x559672caa910 msgr2=0x559672cacd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:36.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.123+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3083919969 shutdown_connections 2024-09-10T05:36:36.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.123+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3083919969 wait complete. 2024-09-10T05:36:36.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.139+0000 7f54d77a19c0 1 Processor -- start 2024-09-10T05:36:36.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.139+0000 7f54d77a19c0 1 -- start start 2024-09-10T05:36:36.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.139+0000 7f54d77a19c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559672c24230 0x559672d9b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.139+0000 7f54d77a19c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559672bb8680 con 0x559672c24230 2024-09-10T05:36:36.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.139+0000 7f54d52a7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559672c24230 0x559672d9b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.139+0000 7f54d52a7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559672c24230 0x559672d9b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47140/0 (socket says 172.21.15.62:47140) 2024-09-10T05:36:36.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.139+0000 7f54d52a7640 1 -- 172.21.15.62:0/3196064138 learned_addr learned my addr 172.21.15.62:0/3196064138 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:36.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.139+0000 7f54d52a7640 1 -- 172.21.15.62:0/3196064138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559672b33da0 con 0x559672c24230 2024-09-10T05:36:36.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.139+0000 7f54d52a7640 1 --2- 172.21.15.62:0/3196064138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559672c24230 0x559672d9b7b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f54c800b220 tx=0x7f54c800b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=517946f09c5fbf6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.139+0000 7f53c3606640 1 -- 172.21.15.62:0/3196064138 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54c800a040 con 0x559672c24230 2024-09-10T05:36:36.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.139+0000 7f53c3606640 1 -- 172.21.15.62:0/3196064138 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54c800f750 con 0x559672c24230 2024-09-10T05:36:36.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.139+0000 7f53c3606640 1 -- 172.21.15.62:0/3196064138 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54c800fa70 con 0x559672c24230 2024-09-10T05:36:36.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.139+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3196064138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559672c24230 msgr2=0x559672d9b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.139+0000 7f54d77a19c0 1 --2- 172.21.15.62:0/3196064138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559672c24230 0x559672d9b7b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f54c800b220 tx=0x7f54c800b6e0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.139+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3196064138 shutdown_connections 2024-09-10T05:36:36.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.139+0000 7f54d77a19c0 1 --2- 172.21.15.62:0/3196064138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559672c24230 0x559672d9b7b0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.139+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3196064138 >> 172.21.15.62:0/3196064138 conn(0x559672caa910 msgr2=0x559672d973f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:36.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.139+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3196064138 shutdown_connections 2024-09-10T05:36:36.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.139+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3196064138 wait complete. 2024-09-10T05:36:36.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.143+0000 7f54d77a19c0 1 Processor -- start 2024-09-10T05:36:36.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.143+0000 7f54d77a19c0 1 -- start start 2024-09-10T05:36:36.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.143+0000 7f54d77a19c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559672c24230 0x559672cb02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.143+0000 7f54d77a19c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559672b5aa50 con 0x559672c24230 2024-09-10T05:36:36.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.143+0000 7f54d52a7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559672c24230 0x559672cb02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.143+0000 7f54d52a7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559672c24230 0x559672cb02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47154/0 (socket says 172.21.15.62:47154) 2024-09-10T05:36:36.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.143+0000 7f54d52a7640 1 -- 172.21.15.62:0/843393057 learned_addr learned my addr 172.21.15.62:0/843393057 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:36.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.143+0000 7f54d52a7640 1 -- 172.21.15.62:0/843393057 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559672cb0820 con 0x559672c24230 2024-09-10T05:36:36.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.143+0000 7f54d52a7640 1 --2- 172.21.15.62:0/843393057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559672c24230 0x559672cb02c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x559672d9c740 tx=0x7f54c8000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.143+0000 7f53c1e03640 1 -- 172.21.15.62:0/843393057 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54c801a880 con 0x559672c24230 2024-09-10T05:36:36.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.143+0000 7f54d77a19c0 1 -- 172.21.15.62:0/843393057 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559672caec00 con 0x559672c24230 2024-09-10T05:36:36.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.143+0000 7f53c1e03640 1 -- 172.21.15.62:0/843393057 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54c801aa20 con 0x559672c24230 2024-09-10T05:36:36.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.143+0000 7f54d77a19c0 1 -- 172.21.15.62:0/843393057 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559672caf130 con 0x559672c24230 2024-09-10T05:36:36.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.143+0000 7f53c1e03640 1 -- 172.21.15.62:0/843393057 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54c802c060 con 0x559672c24230 2024-09-10T05:36:36.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.143+0000 7f53c1e03640 1 -- 172.21.15.62:0/843393057 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f54c8017050 con 0x559672c24230 2024-09-10T05:36:36.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.143+0000 7f53c1e03640 1 --2- 172.21.15.62:0/843393057 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f53bc039ac0 0x7f53bc03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.143+0000 7f53c1e03640 1 -- 172.21.15.62:0/843393057 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f54c8015020 con 0x559672c24230 2024-09-10T05:36:36.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.143+0000 7f54d4aa6640 1 --2- 172.21.15.62:0/843393057 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f53bc039ac0 0x7f53bc03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.147+0000 7f54d77a19c0 1 --2- 172.21.15.62:0/843393057 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x559672cb4300 0x559672dac260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.147+0000 7f54d77a19c0 1 -- 172.21.15.62:0/843393057 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559672dac7a0 con 0x559672cb4300 2024-09-10T05:36:36.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.147+0000 7f54d5aa8640 1 --2- 172.21.15.62:0/843393057 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x559672cb4300 0x559672dac260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.147+0000 7f54d4aa6640 1 --2- 172.21.15.62:0/843393057 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f53bc039ac0 0x7f53bc03bf80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f54cc0ae000 tx=0x7f54cc0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.147+0000 7f54d5aa8640 1 --2- 172.21.15.62:0/843393057 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x559672cb4300 0x559672dac260 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.147+0000 7f54d5aa8640 1 -- 172.21.15.62:0/843393057 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f54d000a4d0 con 0x559672cb4300 2024-09-10T05:36:36.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.147+0000 7f54d77a19c0 1 --2- 172.21.15.62:0/843393057 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x559672dad1c0 0x559672daf680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.147+0000 7f54d77a19c0 1 -- 172.21.15.62:0/843393057 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559672dafdf0 con 0x559672dad1c0 2024-09-10T05:36:36.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.147+0000 7f54d52a7640 1 --2- 172.21.15.62:0/843393057 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x559672dad1c0 0x559672daf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.147+0000 7f54d52a7640 1 --2- 172.21.15.62:0/843393057 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x559672dad1c0 0x559672daf680 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.147+0000 7f54d52a7640 1 -- 172.21.15.62:0/843393057 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f54c802e070 con 0x559672dad1c0 2024-09-10T05:36:36.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.147+0000 7f54d77a19c0 1 --2- 172.21.15.62:0/843393057 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x559672db1c00 0x559672db3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.147+0000 7f54d77a19c0 1 -- 172.21.15.62:0/843393057 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559672db46c0 con 0x559672db1c00 2024-09-10T05:36:36.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.147+0000 7f54d4aa6640 1 --2- 172.21.15.62:0/843393057 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x559672db1c00 0x559672db3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.147+0000 7f54d4aa6640 1 --2- 172.21.15.62:0/843393057 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x559672db1c00 0x559672db3ff0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.151+0000 7f54d4aa6640 1 -- 172.21.15.62:0/843393057 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f54cc0b4040 con 0x559672db1c00 2024-09-10T05:36:36.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.151+0000 7f54d77a19c0 1 -- 172.21.15.62:0/843393057 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559672db0aa0 con 0x559672dad1c0 2024-09-10T05:36:36.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.151+0000 7f54d52a7640 1 -- 172.21.15.62:0/843393057 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f54c802e070 con 0x559672dad1c0 2024-09-10T05:36:36.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.151+0000 7f54d77a19c0 1 -- 172.21.15.62:0/843393057 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559672db0ec0 con 0x559672db1c00 2024-09-10T05:36:36.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.151+0000 7f54d4aa6640 1 -- 172.21.15.62:0/843393057 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f54cc0b4040 con 0x559672db1c00 2024-09-10T05:36:36.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.151+0000 7f54d77a19c0 1 Processor -- start 2024-09-10T05:36:36.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.151+0000 7f54d77a19c0 1 -- start start 2024-09-10T05:36:36.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.151+0000 7f54d77a19c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559672dc2d10 0x559672dc3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.151+0000 7f54d77a19c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559672bc5450 con 0x559672dc2d10 2024-09-10T05:36:36.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.151+0000 7f54d52a7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559672dc2d10 0x559672dc3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.151+0000 7f54d52a7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559672dc2d10 0x559672dc3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47162/0 (socket says 172.21.15.62:47162) 2024-09-10T05:36:36.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.151+0000 7f54d52a7640 1 -- 172.21.15.62:0/606238433 learned_addr learned my addr 172.21.15.62:0/606238433 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:36.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.151+0000 7f54d52a7640 1 -- 172.21.15.62:0/606238433 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559672dc3770 con 0x559672dc2d10 2024-09-10T05:36:36.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.151+0000 7f54d52a7640 1 --2- 172.21.15.62:0/606238433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559672dc2d10 0x559672dc3130 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f54c8050010 tx=0x7f54c800ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.151+0000 7f53baffd640 1 -- 172.21.15.62:0/606238433 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54c8019b70 con 0x559672dc2d10 2024-09-10T05:36:36.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.151+0000 7f53baffd640 1 -- 172.21.15.62:0/606238433 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54c8019d10 con 0x559672dc2d10 2024-09-10T05:36:36.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.151+0000 7f54d77a19c0 1 -- 172.21.15.62:0/606238433 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559672dc3fd0 con 0x559672dc2d10 2024-09-10T05:36:36.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.151+0000 7f53baffd640 1 -- 172.21.15.62:0/606238433 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54c80193e0 con 0x559672dc2d10 2024-09-10T05:36:36.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.151+0000 7f54d77a19c0 1 -- 172.21.15.62:0/606238433 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559672dc4540 con 0x559672dc2d10 2024-09-10T05:36:36.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.155+0000 7f53baffd640 1 -- 172.21.15.62:0/606238433 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f54c804b040 con 0x559672dc2d10 2024-09-10T05:36:36.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.155+0000 7f53baffd640 1 --2- 172.21.15.62:0/606238433 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f53ac039ac0 0x7f53ac03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.155+0000 7f53baffd640 1 -- 172.21.15.62:0/606238433 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f54c8038070 con 0x559672dc2d10 2024-09-10T05:36:36.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.155+0000 7f54d4aa6640 1 --2- 172.21.15.62:0/606238433 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f53ac039ac0 0x7f53ac03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.155+0000 7f54d77a19c0 1 Processor -- start 2024-09-10T05:36:36.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.155+0000 7f54d77a19c0 1 -- start start 2024-09-10T05:36:36.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.155+0000 7f54d4aa6640 1 --2- 172.21.15.62:0/606238433 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f53ac039ac0 0x7f53ac03bf80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x559672cafb80 tx=0x7f54cc005ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.155+0000 7f54d77a19c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559672dd0530 0x559672dd0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.155+0000 7f54d77a19c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559672d9c000 con 0x559672dd0530 2024-09-10T05:36:36.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.155+0000 7f54d52a7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559672dd0530 0x559672dd0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.155+0000 7f54d52a7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559672dd0530 0x559672dd0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47172/0 (socket says 172.21.15.62:47172) 2024-09-10T05:36:36.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.155+0000 7f54d52a7640 1 -- 172.21.15.62:0/2110474818 learned_addr learned my addr 172.21.15.62:0/2110474818 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:36.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.155+0000 7f54d52a7640 1 -- 172.21.15.62:0/2110474818 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559672dd0ee0 con 0x559672dd0530 2024-09-10T05:36:36.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.155+0000 7f54d52a7640 1 --2- 172.21.15.62:0/2110474818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559672dd0530 0x559672dd0910 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f54c80505e0 tx=0x7f54c8026450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48037e349a98a924 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.155+0000 7f53b8ff9640 1 -- 172.21.15.62:0/2110474818 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54c8041b80 con 0x559672dd0530 2024-09-10T05:36:36.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.155+0000 7f53b8ff9640 1 -- 172.21.15.62:0/2110474818 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54c8041260 con 0x559672dd0530 2024-09-10T05:36:36.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.155+0000 7f53b8ff9640 1 -- 172.21.15.62:0/2110474818 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54c8026750 con 0x559672dd0530 2024-09-10T05:36:36.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.155+0000 7f54d77a19c0 1 -- 172.21.15.62:0/2110474818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559672dd0530 msgr2=0x559672dd0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.155+0000 7f54d77a19c0 1 --2- 172.21.15.62:0/2110474818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559672dd0530 0x559672dd0910 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f54c80505e0 tx=0x7f54c8026450 comp rx=0 tx=0).stop 2024-09-10T05:36:36.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.155+0000 7f54d77a19c0 1 -- 172.21.15.62:0/2110474818 shutdown_connections 2024-09-10T05:36:36.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.155+0000 7f54d77a19c0 1 --2- 172.21.15.62:0/2110474818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559672dd0530 0x559672dd0910 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.155+0000 7f54d77a19c0 1 -- 172.21.15.62:0/2110474818 >> 172.21.15.62:0/2110474818 conn(0x559672dcb8f0 msgr2=0x559672dc9b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:36.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.155+0000 7f54d77a19c0 1 -- 172.21.15.62:0/2110474818 shutdown_connections 2024-09-10T05:36:36.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.155+0000 7f54d77a19c0 1 -- 172.21.15.62:0/2110474818 wait complete. 2024-09-10T05:36:36.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.159+0000 7f54d77a19c0 1 Processor -- start 2024-09-10T05:36:36.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.159+0000 7f54d77a19c0 1 -- start start 2024-09-10T05:36:36.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.159+0000 7f54d77a19c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559672dd0530 0x559672dd67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.159+0000 7f54d77a19c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559672dcf2a0 con 0x559672dd0530 2024-09-10T05:36:36.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.159+0000 7f54d52a7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559672dd0530 0x559672dd67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.159+0000 7f54d52a7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559672dd0530 0x559672dd67d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47184/0 (socket says 172.21.15.62:47184) 2024-09-10T05:36:36.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.159+0000 7f54d52a7640 1 -- 172.21.15.62:0/3377085863 learned_addr learned my addr 172.21.15.62:0/3377085863 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:36.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.159+0000 7f54d52a7640 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559672dd6d30 con 0x559672dd0530 2024-09-10T05:36:36.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.159+0000 7f54d52a7640 1 --2- 172.21.15.62:0/3377085863 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559672dd0530 0x559672dd67d0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f54c804db30 tx=0x7f54c8005ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.159+0000 7f53aaffd640 1 -- 172.21.15.62:0/3377085863 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54c8047270 con 0x559672dd0530 2024-09-10T05:36:36.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.159+0000 7f53aaffd640 1 -- 172.21.15.62:0/3377085863 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54c8041b80 con 0x559672dd0530 2024-09-10T05:36:36.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.159+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559672dd6d30 con 0x559672dd0530 2024-09-10T05:36:36.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.159+0000 7f53aaffd640 1 -- 172.21.15.62:0/3377085863 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54c8031c50 con 0x559672dd0530 2024-09-10T05:36:36.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.159+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559672dd6d30 con 0x559672dd0530 2024-09-10T05:36:36.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.159+0000 7f53aaffd640 1 -- 172.21.15.62:0/3377085863 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f54c8073030 con 0x559672dd0530 2024-09-10T05:36:36.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.159+0000 7f53aaffd640 1 --2- 172.21.15.62:0/3377085863 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f53a0039a70 0x7f53a003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.159+0000 7f53aaffd640 1 -- 172.21.15.62:0/3377085863 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f54c8071070 con 0x559672dd0530 2024-09-10T05:36:36.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.159+0000 7f54d4aa6640 1 --2- 172.21.15.62:0/3377085863 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f53a0039a70 0x7f53a003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.159+0000 7f54d77a19c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.159+0000 7f54d77a19c0 1 --2- 172.21.15.62:0/3377085863 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x559672de1770 0x559672de3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.159+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559672de4350 con 0x559672de1770 2024-09-10T05:36:36.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.159+0000 7f54d5aa8640 1 --2- 172.21.15.62:0/3377085863 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x559672de1770 0x559672de3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.163+0000 7f54d4aa6640 1 --2- 172.21.15.62:0/3377085863 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f53a0039a70 0x7f53a003bf30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f54cc0af040 tx=0x7f54cc0a8000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.163+0000 7f54d5aa8640 1 --2- 172.21.15.62:0/3377085863 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x559672de1770 0x559672de3c00 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.163+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f54d000a4d0 con 0x559672de1770 2024-09-10T05:36:36.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.163+0000 7f54d77a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:36.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.163+0000 7f54d77a19c0 20 realm 2024-09-10T05:36:36.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.163+0000 7f54d77a19c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.163+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559672de0b40 con 0x559672de1770 2024-09-10T05:36:36.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.163+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f54d000a4d0 con 0x559672de1770 2024-09-10T05:36:36.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.163+0000 7f54d77a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:36.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.163+0000 7f54d77a19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:36.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.163+0000 7f54d77a19c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.163+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559672de4e20 con 0x559672de1770 2024-09-10T05:36:36.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.163+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f54d000a4d0 con 0x559672de1770 2024-09-10T05:36:36.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.163+0000 7f54d77a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:36.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.163+0000 7f54d77a19c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.163+0000 7f54d77a19c0 1 --2- 172.21.15.62:0/3377085863 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x559672de5c00 0x559672de7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.163+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559672de8680 con 0x559672de5c00 2024-09-10T05:36:36.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.163+0000 7f54d52a7640 1 --2- 172.21.15.62:0/3377085863 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x559672de5c00 0x559672de7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.163+0000 7f54d52a7640 1 --2- 172.21.15.62:0/3377085863 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x559672de5c00 0x559672de7ff0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.163+0000 7f54d52a7640 1 -- 172.21.15.62:0/3377085863 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f54c802e070 con 0x559672de5c00 2024-09-10T05:36:36.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.163+0000 7f54d77a19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:36.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.163+0000 7f54d77a19c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.163+0000 7f54d77a19c0 1 --2- 172.21.15.62:0/3377085863 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x559672de93e0 0x559672deb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.163+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559672debf80 con 0x559672de93e0 2024-09-10T05:36:36.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.163+0000 7f54d4aa6640 1 --2- 172.21.15.62:0/3377085863 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x559672de93e0 0x559672deb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.163+0000 7f54d4aa6640 1 --2- 172.21.15.62:0/3377085863 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x559672de93e0 0x559672deb7f0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.167+0000 7f54d4aa6640 1 -- 172.21.15.62:0/3377085863 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f54cc0b4040 con 0x559672de93e0 2024-09-10T05:36:36.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.167+0000 7f54d77a19c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:36.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.167+0000 7f54d77a19c0 20 searching for the correct realm 2024-09-10T05:36:36.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.167+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559672ded850 con 0x559672de93e0 2024-09-10T05:36:36.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.167+0000 7f54d4aa6640 1 -- 172.21.15.62:0/3377085863 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54cc0b4040 con 0x559672de93e0 2024-09-10T05:36:36.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.167+0000 7f54d4aa6640 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559672ded850 con 0x559672de5c00 2024-09-10T05:36:36.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.167+0000 7f54d52a7640 1 -- 172.21.15.62:0/3377085863 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54c802e070 con 0x559672de5c00 2024-09-10T05:36:36.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.167+0000 7f54d52a7640 1 --2- 172.21.15.62:0/3377085863 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f54c80415f0 0x7f54c80507d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.167+0000 7f54d52a7640 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559672ded850 con 0x7f54c80415f0 2024-09-10T05:36:36.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.167+0000 7f54d5aa8640 1 --2- 172.21.15.62:0/3377085863 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f54c80415f0 0x7f54c80507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.167+0000 7f54d5aa8640 1 --2- 172.21.15.62:0/3377085863 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f54c80415f0 0x7f54c80507d0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.167+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54d000a4d0 con 0x7f54c80415f0 2024-09-10T05:36:36.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.167+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559672ded850 con 0x559672de1770 2024-09-10T05:36:36.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.167+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54d000a4d0 con 0x559672de1770 2024-09-10T05:36:36.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.167+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559672ded850 con 0x559672de1770 2024-09-10T05:36:36.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.167+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54d000a4d0 con 0x559672de1770 2024-09-10T05:36:36.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.167+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559672ded850 con 0x559672de93e0 2024-09-10T05:36:36.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.167+0000 7f54d4aa6640 1 -- 172.21.15.62:0/3377085863 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54cc0b4040 con 0x559672de93e0 2024-09-10T05:36:36.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.167+0000 7f54d4aa6640 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559672ded850 con 0x559672de1770 2024-09-10T05:36:36.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.167+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54d000a4d0 con 0x559672de1770 2024-09-10T05:36:36.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.167+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559672ded850 con 0x559672de5c00 2024-09-10T05:36:36.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.171+0000 7f54d52a7640 1 -- 172.21.15.62:0/3377085863 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54c802e070 con 0x559672de5c00 2024-09-10T05:36:36.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.171+0000 7f54d52a7640 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559672ded850 con 0x559672de5c00 2024-09-10T05:36:36.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.171+0000 7f54d52a7640 1 -- 172.21.15.62:0/3377085863 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54c802e070 con 0x559672de5c00 2024-09-10T05:36:36.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.171+0000 7f54d52a7640 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559672ded850 con 0x559672de1770 2024-09-10T05:36:36.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.171+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54d000a4d0 con 0x559672de1770 2024-09-10T05:36:36.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.171+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559672ded850 con 0x7f54c80415f0 2024-09-10T05:36:36.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.171+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54d000a4d0 con 0x7f54c80415f0 2024-09-10T05:36:36.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.171+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559672ded850 con 0x559672de1770 2024-09-10T05:36:36.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.171+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54d000a4d0 con 0x559672de1770 2024-09-10T05:36:36.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.171+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559672ded850 con 0x7f54c80415f0 2024-09-10T05:36:36.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.171+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f54d000a4d0 con 0x7f54c80415f0 2024-09-10T05:36:36.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.171+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559672ded850 con 0x559672de5c00 2024-09-10T05:36:36.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.171+0000 7f54d52a7640 1 -- 172.21.15.62:0/3377085863 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54c802e070 con 0x559672de5c00 2024-09-10T05:36:36.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.171+0000 7f54d52a7640 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559672ded850 con 0x559672de93e0 2024-09-10T05:36:36.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.171+0000 7f54d4aa6640 1 -- 172.21.15.62:0/3377085863 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54cc0b4040 con 0x559672de93e0 2024-09-10T05:36:36.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.171+0000 7f54d4aa6640 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559672ded850 con 0x559672de1770 2024-09-10T05:36:36.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.171+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54d000a4d0 con 0x559672de1770 2024-09-10T05:36:36.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.171+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559672ded850 con 0x559672de5c00 2024-09-10T05:36:36.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.171+0000 7f54d52a7640 1 -- 172.21.15.62:0/3377085863 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54c802e070 con 0x559672de5c00 2024-09-10T05:36:36.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.171+0000 7f54d52a7640 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559672ded850 con 0x559672de93e0 2024-09-10T05:36:36.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.175+0000 7f54d4aa6640 1 -- 172.21.15.62:0/3377085863 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 30 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f54cc0b4040 con 0x559672de93e0 2024-09-10T05:36:36.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.175+0000 7f54d4aa6640 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559672ded850 con 0x559672de1770 2024-09-10T05:36:36.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.175+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54d000a4d0 con 0x559672de1770 2024-09-10T05:36:36.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.175+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559672ded850 con 0x559672de1770 2024-09-10T05:36:36.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.175+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f54d000a4d0 con 0x559672de1770 2024-09-10T05:36:36.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.175+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559672ded850 con 0x559672de1770 2024-09-10T05:36:36.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.175+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54d000a4d0 con 0x559672de1770 2024-09-10T05:36:36.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.175+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559672ded850 con 0x559672de93e0 2024-09-10T05:36:36.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.175+0000 7f54d4aa6640 1 -- 172.21.15.62:0/3377085863 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54cc0b4040 con 0x559672de93e0 2024-09-10T05:36:36.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.175+0000 7f54d4aa6640 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559672ded850 con 0x7f54c80415f0 2024-09-10T05:36:36.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.175+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54d000a4d0 con 0x7f54c80415f0 2024-09-10T05:36:36.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.175+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559672ded850 con 0x559672de1770 2024-09-10T05:36:36.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.175+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54d000a4d0 con 0x559672de1770 2024-09-10T05:36:36.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.175+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559672ded850 con 0x7f54c80415f0 2024-09-10T05:36:36.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.175+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54d000a4d0 con 0x7f54c80415f0 2024-09-10T05:36:36.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.175+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559672ded850 con 0x559672de93e0 2024-09-10T05:36:36.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.175+0000 7f54d4aa6640 1 -- 172.21.15.62:0/3377085863 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54cc0b4040 con 0x559672de93e0 2024-09-10T05:36:36.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.175+0000 7f54d4aa6640 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559672ded850 con 0x7f54c80415f0 2024-09-10T05:36:36.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.175+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54d000a4d0 con 0x7f54c80415f0 2024-09-10T05:36:36.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.175+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559672ded850 con 0x559672de5c00 2024-09-10T05:36:36.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.175+0000 7f54d52a7640 1 -- 172.21.15.62:0/3377085863 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54c802e070 con 0x559672de5c00 2024-09-10T05:36:36.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.175+0000 7f54d52a7640 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559672ded850 con 0x559672de5c00 2024-09-10T05:36:36.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.179+0000 7f54d52a7640 1 -- 172.21.15.62:0/3377085863 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54c802e070 con 0x559672de5c00 2024-09-10T05:36:36.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.179+0000 7f54d52a7640 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559672ded850 con 0x559672de93e0 2024-09-10T05:36:36.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.179+0000 7f54d4aa6640 1 -- 172.21.15.62:0/3377085863 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54cc0b4040 con 0x559672de93e0 2024-09-10T05:36:36.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.179+0000 7f54d4aa6640 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559672ded850 con 0x559672de5c00 2024-09-10T05:36:36.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.179+0000 7f54d52a7640 1 -- 172.21.15.62:0/3377085863 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f54c802e070 con 0x559672de5c00 2024-09-10T05:36:36.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.179+0000 7f54d52a7640 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559672ded850 con 0x559672de5c00 2024-09-10T05:36:36.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.179+0000 7f54d52a7640 1 -- 172.21.15.62:0/3377085863 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54c802e070 con 0x559672de5c00 2024-09-10T05:36:36.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.179+0000 7f54d77a19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:36.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.179+0000 7f54d77a19c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:36.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.179+0000 7f54d77a19c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:36.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.179+0000 7f54d77a19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:36.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.179+0000 7f54d77a19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:36.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.179+0000 7f54d77a19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:36.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.179+0000 7f54d77a19c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.179+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559672dec940 con 0x559672de1770 2024-09-10T05:36:36.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.179+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f54d000a4d0 con 0x559672de1770 2024-09-10T05:36:36.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.179+0000 7f54d77a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:36.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.179+0000 7f54d77a19c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.179+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559672dec580 con 0x559672de5c00 2024-09-10T05:36:36.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.179+0000 7f54d52a7640 1 -- 172.21.15.62:0/3377085863 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f54c802e070 con 0x559672de5c00 2024-09-10T05:36:36.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.179+0000 7f54d77a19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:36.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.179+0000 7f54d77a19c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.179+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559672ded2a0 con 0x559672de93e0 2024-09-10T05:36:36.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.183+0000 7f54d4aa6640 1 -- 172.21.15.62:0/3377085863 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f54cc0b4040 con 0x559672de93e0 2024-09-10T05:36:36.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.183+0000 7f54d77a19c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:36.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.183+0000 7f54d77a19c0 20 zone default found 2024-09-10T05:36:36.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.183+0000 7f54d77a19c0 4 Realm: () 2024-09-10T05:36:36.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.183+0000 7f54d77a19c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:36.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.183+0000 7f54d77a19c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:36.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.183+0000 7f54d77a19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:36.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.183+0000 7f54d77a19c0 20 zonegroup default 2024-09-10T05:36:36.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.183+0000 7f54d77a19c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.183+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559672dee130 con 0x7f54c80415f0 2024-09-10T05:36:36.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.183+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f54d000a4d0 con 0x7f54c80415f0 2024-09-10T05:36:36.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.183+0000 7f54d77a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:36.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.183+0000 7f54d77a19c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.183+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559672df0370 con 0x559672de93e0 2024-09-10T05:36:36.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.183+0000 7f54d4aa6640 1 -- 172.21.15.62:0/3377085863 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f54cc0b4040 con 0x559672de93e0 2024-09-10T05:36:36.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.183+0000 7f54d77a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:36.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.183+0000 7f54d77a19c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.183+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559672df0710 con 0x559672de93e0 2024-09-10T05:36:36.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.183+0000 7f54d4aa6640 1 -- 172.21.15.62:0/3377085863 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f54cc0b4040 con 0x559672de93e0 2024-09-10T05:36:36.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.183+0000 7f54d77a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:36.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.183+0000 7f54d77a19c0 20 started sync module instance, tier type = 2024-09-10T05:36:36.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.183+0000 7f54d77a19c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:36.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.183+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559672def7b0 con 0x559672de5c00 2024-09-10T05:36:36.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.183+0000 7f54d52a7640 1 -- 172.21.15.62:0/3377085863 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54c802e070 con 0x559672de5c00 2024-09-10T05:36:36.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.183+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94104660671664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559672def7b0 con 0x559672de5c00 2024-09-10T05:36:36.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.183+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559672df0fc0 con 0x559672de1770 2024-09-10T05:36:36.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.187+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54d000a4d0 con 0x559672de1770 2024-09-10T05:36:36.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.187+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94104660675248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559672df1810 con 0x559672de1770 2024-09-10T05:36:36.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.187+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559672df22e0 con 0x559672de5c00 2024-09-10T05:36:36.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.187+0000 7f54d52a7640 1 -- 172.21.15.62:0/3377085863 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94104660671664] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54c802e070 con 0x559672de5c00 2024-09-10T05:36:36.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.187+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94104660675248] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54d000a4d0 con 0x559672de1770 2024-09-10T05:36:36.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.187+0000 7f54d52a7640 1 -- 172.21.15.62:0/3377085863 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54c802e070 con 0x559672de5c00 2024-09-10T05:36:36.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.187+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94104660680144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559672df1360 con 0x559672de5c00 2024-09-10T05:36:36.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.187+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559672df2bb0 con 0x7f54c80415f0 2024-09-10T05:36:36.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.191+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54d000a4d0 con 0x7f54c80415f0 2024-09-10T05:36:36.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.191+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94104660682496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559672df1360 con 0x7f54c80415f0 2024-09-10T05:36:36.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.191+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559672df35f0 con 0x559672de5c00 2024-09-10T05:36:36.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.191+0000 7f54d52a7640 1 -- 172.21.15.62:0/3377085863 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94104660680144] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54c802e070 con 0x559672de5c00 2024-09-10T05:36:36.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.191+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94104660682496] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54d000a4d0 con 0x7f54c80415f0 2024-09-10T05:36:36.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.191+0000 7f54d52a7640 1 -- 172.21.15.62:0/3377085863 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54c802e070 con 0x559672de5c00 2024-09-10T05:36:36.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.191+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94104660683552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559672df3140 con 0x559672de5c00 2024-09-10T05:36:36.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.191+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559672df3a10 con 0x559672de93e0 2024-09-10T05:36:36.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.191+0000 7f54d4aa6640 1 -- 172.21.15.62:0/3377085863 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54cc0b4040 con 0x559672de93e0 2024-09-10T05:36:36.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.191+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94104660685120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559672df3560 con 0x559672de93e0 2024-09-10T05:36:36.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.191+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559672df4930 con 0x559672de93e0 2024-09-10T05:36:36.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.195+0000 7f54d52a7640 1 -- 172.21.15.62:0/3377085863 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94104660683552] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54c802e070 con 0x559672de5c00 2024-09-10T05:36:36.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.195+0000 7f54d4aa6640 1 -- 172.21.15.62:0/3377085863 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(56 notify.6 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54cc0b4040 con 0x559672de93e0 2024-09-10T05:36:36.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.195+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94104660689952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559672df48f0 con 0x559672de93e0 2024-09-10T05:36:36.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.195+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559672df5380 con 0x7f54c80415f0 2024-09-10T05:36:36.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.195+0000 7f54d4aa6640 1 -- 172.21.15.62:0/3377085863 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94104660685120] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54cc0b4040 con 0x559672de93e0 2024-09-10T05:36:36.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.195+0000 7f54d4aa6640 1 -- 172.21.15.62:0/3377085863 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94104660689952] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54cc0b4040 con 0x559672de93e0 2024-09-10T05:36:36.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.195+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54d000a4d0 con 0x7f54c80415f0 2024-09-10T05:36:36.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.195+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94104660669184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559672df5380 con 0x7f54c80415f0 2024-09-10T05:36:36.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.195+0000 7f54d77a19c0 20 add_watcher() i=0 2024-09-10T05:36:36.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.195+0000 7f54d77a19c0 20 add_watcher() i=1 2024-09-10T05:36:36.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.195+0000 7f54d77a19c0 20 add_watcher() i=2 2024-09-10T05:36:36.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.195+0000 7f54d77a19c0 20 add_watcher() i=3 2024-09-10T05:36:36.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.195+0000 7f54d77a19c0 20 add_watcher() i=4 2024-09-10T05:36:36.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.195+0000 7f54d77a19c0 20 add_watcher() i=5 2024-09-10T05:36:36.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.195+0000 7f54d77a19c0 20 add_watcher() i=6 2024-09-10T05:36:36.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.195+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94104660669184] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54d000a4d0 con 0x7f54c80415f0 2024-09-10T05:36:36.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.195+0000 7f54d77a19c0 20 add_watcher() i=7 2024-09-10T05:36:36.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.195+0000 7f54d77a19c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:36.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.195+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559672df3e00 con 0x559672de1770 2024-09-10T05:36:36.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.199+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f54d000a4d0 con 0x559672de1770 2024-09-10T05:36:36.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.199+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94104660692624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559672df5b80 con 0x559672de1770 2024-09-10T05:36:36.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.199+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94104660692624] v30'110 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f54d000a4d0 con 0x559672de1770 2024-09-10T05:36:36.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.199+0000 7f538bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:36.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.199+0000 7f54d77a19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:36.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.199+0000 7f54d77a19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:36.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.199+0000 7f54d77a19c0 5 note: GC not initialized 2024-09-10T05:36:36.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.199+0000 7f538afe5640 20 reqs_thread_entry: start 2024-09-10T05:36:36.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.199+0000 7f54d77a19c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:36.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.199+0000 7f54d77a19c0 20 Filter name: none 2024-09-10T05:36:36.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.199+0000 7f5388fe1640 20 reqs_thread_entry: start 2024-09-10T05:36:36.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.199+0000 7f54d77a19c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T05:36:36.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.199+0000 7f54d77a19c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.199+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559672e1b560 con 0x559672de1770 2024-09-10T05:36:36.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.199+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f54d000a4d0 con 0x559672de1770 2024-09-10T05:36:36.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.199+0000 7f54d77a19c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:36:36.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.199+0000 7f54d77a19c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T05:36:36.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.199+0000 7f54d77a19c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:36:36.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.199+0000 7f54d77a19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:36:36.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.199+0000 7f54d77a19c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T05:36:36.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.199+0000 7f54d77a19c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.199+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559672e1d650 con 0x7f54c80415f0 2024-09-10T05:36:36.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.199+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f54d000a4d0 con 0x7f54c80415f0 2024-09-10T05:36:36.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.199+0000 7f54d77a19c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T05:36:36.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.199+0000 7f54d77a19c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-10T05:36:36.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.199+0000 7f54d77a19c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T05:36:36.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.199+0000 7f54d77a19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 : miss 2024-09-10T05:36:36.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.199+0000 7f54d77a19c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.199+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:64 8.1f 8:fcc5c255:root::.bucket.meta.myfoo%3a475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559672e1ee50 con 0x7f54c80415f0 2024-09-10T05:36:36.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.203+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(64 .bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f54d000a4d0 con 0x7f54c80415f0 2024-09-10T05:36:36.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.203+0000 7f54d77a19c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T05:36:36.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.203+0000 7f54d77a19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 info.flags=0x17 2024-09-10T05:36:36.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.203+0000 7f54d77a19c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 to cache LRU end 2024-09-10T05:36:36.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.203+0000 7f54d77a19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:36:36.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.203+0000 7f54d77a19c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T05:36:36.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.203+0000 7f54d77a19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 2024-09-10T05:36:36.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.203+0000 7f54d77a19c0 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-10T05:36:36.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.203+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559672e22590 con 0x7f54c80415f0 2024-09-10T05:36:36.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.203+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(65 foo.buckets [call] v30'17 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f54d000a4d0 con 0x7f54c80415f0 2024-09-10T05:36:36.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.203+0000 7f54d77a19c0 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-10T05:36:36.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.203+0000 7f54d77a19c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.203+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559672e215e0 con 0x7f54c80415f0 2024-09-10T05:36:36.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.203+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 <== osd.2 v2:172.21.15.62:6800/2677868286 15 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f54d000a4d0 con 0x7f54c80415f0 2024-09-10T05:36:36.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.203+0000 7f54d77a19c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T05:36:36.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.203+0000 7f54d77a19c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-10T05:36:36.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.203+0000 7f54d77a19c0 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T05:36:36.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.203+0000 7f54d77a19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:36:36.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.203+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559672e26090 con 0x7f54c80415f0 2024-09-10T05:36:36.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.203+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 <== osd.2 v2:172.21.15.62:6800/2677868286 16 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v30'18 uv18 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f54d000a4d0 con 0x7f54c80415f0 2024-09-10T05:36:36.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.203+0000 7f54d77a19c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-10T05:36:36.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.203+0000 7f54d77a19c0 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T05:36:36.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.203+0000 7f54d77a19c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-10T05:36:36.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.203+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94104660876064 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559672e23680 con 0x559672de93e0 2024-09-10T05:36:36.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.203+0000 7f54d4aa6640 1 -- 172.21.15.62:0/3377085863 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== watch-notify(notify (1) cookie 94104660689952 notify 128849018882 ret 0) ==== 380+0+0 (crc 0 0 0) 0x7f54cc0e5040 con 0x559672de93e0 2024-09-10T05:36:36.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.203+0000 7f53b8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018882 cookie 94104660689952 notifier 4479 bl.length()=338 2024-09-10T05:36:36.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.203+0000 7f53b8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-10T05:36:36.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.203+0000 7f53b8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T05:36:36.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.203+0000 7f54d4aa6640 1 -- 172.21.15.62:0/3377085863 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(68 notify.6 [notify cookie 94104660876064 out=8b] v0'0 uv105 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f54cc0b4040 con 0x559672de93e0 2024-09-10T05:36:36.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.203+0000 7f53b8ff9640 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f5398003eb0 con 0x559672de93e0 2024-09-10T05:36:36.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.207+0000 7f54d4aa6640 1 -- 172.21.15.62:0/3377085863 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54cc0b4040 con 0x559672de93e0 2024-09-10T05:36:36.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.207+0000 7f54d4aa6640 1 -- 172.21.15.62:0/3377085863 <== osd.3 v2:172.21.15.62:6816/2708991149 19 ==== watch-notify(notify_complete (2) cookie 94104660876064 notify 128849018882 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559672b58ca0 con 0x559672de93e0 2024-09-10T05:36:36.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.207+0000 7f538bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:36.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.207+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94104660692624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559672e19340 con 0x559672de1770 2024-09-10T05:36:36.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.207+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94104660692624] v30'111 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f54d000a4d0 con 0x559672de1770 2024-09-10T05:36:36.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.207+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94104660671664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559672e19340 con 0x559672de5c00 2024-09-10T05:36:36.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.211+0000 7f54d52a7640 1 -- 172.21.15.62:0/3377085863 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94104660671664] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54c802e070 con 0x559672de5c00 2024-09-10T05:36:36.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.211+0000 7f54d77a19c0 20 remove_watcher() i=0 2024-09-10T05:36:36.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.211+0000 7f54d77a19c0 2 removed watcher, disabling cache 2024-09-10T05:36:36.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.211+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94104660675248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559672defcb0 con 0x559672de1770 2024-09-10T05:36:36.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.211+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94104660675248] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54d000a4d0 con 0x559672de1770 2024-09-10T05:36:36.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.211+0000 7f54d77a19c0 20 remove_watcher() i=1 2024-09-10T05:36:36.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.211+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94104660680144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559672e19340 con 0x559672de5c00 2024-09-10T05:36:36.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.215+0000 7f54d52a7640 1 -- 172.21.15.62:0/3377085863 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94104660680144] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54c802e070 con 0x559672de5c00 2024-09-10T05:36:36.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.215+0000 7f54d77a19c0 20 remove_watcher() i=2 2024-09-10T05:36:36.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.215+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94104660682496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559672df1dd0 con 0x7f54c80415f0 2024-09-10T05:36:36.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.215+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 <== osd.2 v2:172.21.15.62:6800/2677868286 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94104660682496] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54d000a4d0 con 0x7f54c80415f0 2024-09-10T05:36:36.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.215+0000 7f54d77a19c0 20 remove_watcher() i=3 2024-09-10T05:36:36.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.215+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94104660683552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559672e19340 con 0x559672de5c00 2024-09-10T05:36:36.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.219+0000 7f54d52a7640 1 -- 172.21.15.62:0/3377085863 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94104660683552] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54c802e070 con 0x559672de5c00 2024-09-10T05:36:36.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.219+0000 7f54d77a19c0 20 remove_watcher() i=4 2024-09-10T05:36:36.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.219+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94104660685120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559672e19340 con 0x559672de93e0 2024-09-10T05:36:36.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.219+0000 7f54d4aa6640 1 -- 172.21.15.62:0/3377085863 <== osd.3 v2:172.21.15.62:6816/2708991149 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94104660685120] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54cc0b4040 con 0x559672de93e0 2024-09-10T05:36:36.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.219+0000 7f54d77a19c0 20 remove_watcher() i=5 2024-09-10T05:36:36.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.219+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94104660689952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559672df3140 con 0x559672de93e0 2024-09-10T05:36:36.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.219+0000 7f54d4aa6640 1 -- 172.21.15.62:0/3377085863 <== osd.3 v2:172.21.15.62:6816/2708991149 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94104660689952] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54cc0b4040 con 0x559672de93e0 2024-09-10T05:36:36.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.219+0000 7f54d77a19c0 20 remove_watcher() i=6 2024-09-10T05:36:36.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.219+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94104660669184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559672e19340 con 0x7f54c80415f0 2024-09-10T05:36:36.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.223+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 <== osd.2 v2:172.21.15.62:6800/2677868286 18 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94104660669184] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54d000a4d0 con 0x7f54c80415f0 2024-09-10T05:36:36.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.223+0000 7f54d77a19c0 20 remove_watcher() i=7 2024-09-10T05:36:36.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.223+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x559672de5c00 msgr2=0x559672de7ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.223+0000 7f54d77a19c0 1 --2- 172.21.15.62:0/3377085863 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x559672de5c00 0x559672de7ff0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.223+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x559672de1770 msgr2=0x559672de3c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.223+0000 7f54d77a19c0 1 --2- 172.21.15.62:0/3377085863 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x559672de1770 0x559672de3c00 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.223+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f54c80415f0 msgr2=0x7f54c80507d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.223+0000 7f54d77a19c0 1 --2- 172.21.15.62:0/3377085863 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f54c80415f0 0x7f54c80507d0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.223+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x559672de93e0 msgr2=0x559672deb7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.223+0000 7f54d77a19c0 1 --2- 172.21.15.62:0/3377085863 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x559672de93e0 0x559672deb7f0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.223+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f53a0039a70 msgr2=0x7f53a003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.223+0000 7f54d77a19c0 1 --2- 172.21.15.62:0/3377085863 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f53a0039a70 0x7f53a003bf30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f54cc0af040 tx=0x7f54cc0a8000 comp rx=0 tx=0).stop 2024-09-10T05:36:36.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.223+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559672dd0530 msgr2=0x559672dd67d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.223+0000 7f54d77a19c0 1 --2- 172.21.15.62:0/3377085863 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559672dd0530 0x559672dd67d0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f54c804db30 tx=0x7f54c8005ea0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.223+0000 7f54d5aa8640 1 -- 172.21.15.62:0/3377085863 reap_dead start 2024-09-10T05:36:36.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.223+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 shutdown_connections 2024-09-10T05:36:36.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.223+0000 7f54d77a19c0 1 --2- 172.21.15.62:0/3377085863 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559672dd0530 0x559672dd67d0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.223+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 >> 172.21.15.62:0/3377085863 conn(0x559672dcb8f0 msgr2=0x559672dc9b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:36.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.223+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 shutdown_connections 2024-09-10T05:36:36.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.223+0000 7f54d77a19c0 1 -- 172.21.15.62:0/3377085863 wait complete. 2024-09-10T05:36:36.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.223+0000 7f54d77a19c0 1 -- 172.21.15.62:0/606238433 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f53ac039ac0 msgr2=0x7f53ac03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.223+0000 7f54d77a19c0 1 --2- 172.21.15.62:0/606238433 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f53ac039ac0 0x7f53ac03bf80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x559672cafb80 tx=0x7f54cc005ad0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.223+0000 7f54d77a19c0 1 -- 172.21.15.62:0/606238433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559672dc2d10 msgr2=0x559672dc3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.223+0000 7f54d77a19c0 1 --2- 172.21.15.62:0/606238433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559672dc2d10 0x559672dc3130 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f54c8050010 tx=0x7f54c800ead0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.223+0000 7f54d77a19c0 1 -- 172.21.15.62:0/606238433 shutdown_connections 2024-09-10T05:36:36.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.223+0000 7f54d77a19c0 1 --2- 172.21.15.62:0/606238433 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f53ac039ac0 0x7f53ac03bf80 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.223+0000 7f54d77a19c0 1 --2- 172.21.15.62:0/606238433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559672dc2d10 0x559672dc3130 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.223+0000 7f54d77a19c0 1 -- 172.21.15.62:0/606238433 >> 172.21.15.62:0/606238433 conn(0x559672db86c0 msgr2=0x559672db8aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:36.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.223+0000 7f54d77a19c0 1 -- 172.21.15.62:0/606238433 shutdown_connections 2024-09-10T05:36:36.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.223+0000 7f54d77a19c0 1 -- 172.21.15.62:0/606238433 wait complete. 2024-09-10T05:36:36.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.223+0000 7f54d77a19c0 1 -- 172.21.15.62:0/843393057 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x559672dad1c0 msgr2=0x559672daf680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.223+0000 7f54d77a19c0 1 --2- 172.21.15.62:0/843393057 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x559672dad1c0 0x559672daf680 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.223+0000 7f54d77a19c0 1 -- 172.21.15.62:0/843393057 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x559672cb4300 msgr2=0x559672dac260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.223+0000 7f54d77a19c0 1 --2- 172.21.15.62:0/843393057 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x559672cb4300 0x559672dac260 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.223+0000 7f54d77a19c0 1 -- 172.21.15.62:0/843393057 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x559672db1c00 msgr2=0x559672db3ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.223+0000 7f54d77a19c0 1 --2- 172.21.15.62:0/843393057 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x559672db1c00 0x559672db3ff0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.223+0000 7f54d77a19c0 1 -- 172.21.15.62:0/843393057 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f53bc039ac0 msgr2=0x7f53bc03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.223+0000 7f54d77a19c0 1 --2- 172.21.15.62:0/843393057 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f53bc039ac0 0x7f53bc03bf80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f54cc0ae000 tx=0x7f54cc0a6000 comp rx=0 tx=0).stop 2024-09-10T05:36:36.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.223+0000 7f54d77a19c0 1 -- 172.21.15.62:0/843393057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559672c24230 msgr2=0x559672cb02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.223+0000 7f54d77a19c0 1 --2- 172.21.15.62:0/843393057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559672c24230 0x559672cb02c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x559672d9c740 tx=0x7f54c8000bd0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.223+0000 7f54d5aa8640 1 -- 172.21.15.62:0/843393057 reap_dead start 2024-09-10T05:36:36.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.223+0000 7f54d77a19c0 1 -- 172.21.15.62:0/843393057 shutdown_connections 2024-09-10T05:36:36.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.223+0000 7f54d77a19c0 1 -- 172.21.15.62:0/843393057 >> 172.21.15.62:0/843393057 conn(0x559672caa910 msgr2=0x559672d95e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:36.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.223+0000 7f54d77a19c0 1 -- 172.21.15.62:0/843393057 shutdown_connections 2024-09-10T05:36:36.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.223+0000 7f54d77a19c0 1 -- 172.21.15.62:0/843393057 wait complete. 2024-09-10T05:36:36.237 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-10T05:36:36.237 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-10T05:36:36.238 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-10T05:36:36.323 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:36.323 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:36.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.319+0000 7f5bb6fce9c0 1 Processor -- start 2024-09-10T05:36:36.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.323+0000 7f5bb6fce9c0 1 -- start start 2024-09-10T05:36:36.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.323+0000 7f5bb6fce9c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x556f01479220 0x556f01479600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.323+0000 7f5bb6fce9c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556f0132b9c0 con 0x556f0147c360 2024-09-10T05:36:36.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.323+0000 7f5bb6fce9c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x556f0137b6d0 con 0x556f01479220 2024-09-10T05:36:36.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.323+0000 7f5bb4ad4640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x556f01479220 0x556f01479600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.323+0000 7f5bb4ad4640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x556f01479220 0x556f01479600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47200/0 (socket says 172.21.15.62:47200) 2024-09-10T05:36:36.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.323+0000 7f5bb4ad4640 1 -- 172.21.15.62:0/422667159 learned_addr learned my addr 172.21.15.62:0/422667159 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:36.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.323+0000 7f5bb42d3640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x556f0147c360 0x556f0147e750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:53040/0 (socket says 172.21.15.62:53040) 2024-09-10T05:36:36.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.323+0000 7f5bb4ad4640 1 -- 172.21.15.62:0/422667159 >> v1:172.21.15.2:6789/0 conn(0x556f0147c360 legacy=0x556f0147e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.323+0000 7f5bb4ad4640 1 -- 172.21.15.62:0/422667159 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f0131fca0 con 0x556f01479220 2024-09-10T05:36:36.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.323+0000 7f5bb4ad4640 1 --2- 172.21.15.62:0/422667159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f01479220 0x556f01479600 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f5ba400a5c0 tx=0x7f5ba401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ece5d8e91873b37c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.323+0000 7f5bb3ad2640 1 -- 172.21.15.62:0/422667159 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ba40a6070 con 0x556f01479220 2024-09-10T05:36:36.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.327+0000 7f5bb3ad2640 1 -- 172.21.15.62:0/422667159 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ba40af070 con 0x556f01479220 2024-09-10T05:36:36.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.327+0000 7f5bb3ad2640 1 -- 172.21.15.62:0/422667159 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ba40aa5c0 con 0x556f01479220 2024-09-10T05:36:36.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.327+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/422667159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f01479220 msgr2=0x556f01479600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.327+0000 7f5bb6fce9c0 1 --2- 172.21.15.62:0/422667159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f01479220 0x556f01479600 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f5ba400a5c0 tx=0x7f5ba401b340 comp rx=0 tx=0).stop 2024-09-10T05:36:36.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.327+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/422667159 shutdown_connections 2024-09-10T05:36:36.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.327+0000 7f5bb6fce9c0 1 --2- 172.21.15.62:0/422667159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f01479220 0x556f01479600 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.327+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/422667159 >> 172.21.15.62:0/422667159 conn(0x556f013ecb30 msgr2=0x556f013ecf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:36.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.327+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/422667159 shutdown_connections 2024-09-10T05:36:36.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.327+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/422667159 wait complete. 2024-09-10T05:36:36.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.339+0000 7f5bb6fce9c0 1 Processor -- start 2024-09-10T05:36:36.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.339+0000 7f5bb6fce9c0 1 -- start start 2024-09-10T05:36:36.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.339+0000 7f5bb6fce9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f01479220 0x556f01564970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.339+0000 7f5bb6fce9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556f0137f680 con 0x556f01479220 2024-09-10T05:36:36.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.343+0000 7f5bb4ad4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f01479220 0x556f01564970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.343+0000 7f5bb4ad4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f01479220 0x556f01564970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47206/0 (socket says 172.21.15.62:47206) 2024-09-10T05:36:36.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.343+0000 7f5bb4ad4640 1 -- 172.21.15.62:0/3415869898 learned_addr learned my addr 172.21.15.62:0/3415869898 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:36.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.343+0000 7f5bb4ad4640 1 -- 172.21.15.62:0/3415869898 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f012fada0 con 0x556f01479220 2024-09-10T05:36:36.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.343+0000 7f5bb4ad4640 1 --2- 172.21.15.62:0/3415869898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f01479220 0x556f01564970 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4018f70 tx=0x7f5ba4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c3d37dadd4991b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.343+0000 7f5aa2e0d640 1 -- 172.21.15.62:0/3415869898 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ba40aa8b0 con 0x556f01479220 2024-09-10T05:36:36.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.343+0000 7f5aa2e0d640 1 -- 172.21.15.62:0/3415869898 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ba40aaa50 con 0x556f01479220 2024-09-10T05:36:36.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.343+0000 7f5aa2e0d640 1 -- 172.21.15.62:0/3415869898 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ba40aad30 con 0x556f01479220 2024-09-10T05:36:36.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.343+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/3415869898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f01479220 msgr2=0x556f01564970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.343+0000 7f5bb6fce9c0 1 --2- 172.21.15.62:0/3415869898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f01479220 0x556f01564970 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4018f70 tx=0x7f5ba4003030 comp rx=0 tx=0).stop 2024-09-10T05:36:36.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.343+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/3415869898 shutdown_connections 2024-09-10T05:36:36.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.343+0000 7f5bb6fce9c0 1 --2- 172.21.15.62:0/3415869898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f01479220 0x556f01564970 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.343+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/3415869898 >> 172.21.15.62:0/3415869898 conn(0x556f013ecb30 msgr2=0x556f015605f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:36.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.343+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/3415869898 shutdown_connections 2024-09-10T05:36:36.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.343+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/3415869898 wait complete. 2024-09-10T05:36:36.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.343+0000 7f5bb6fce9c0 1 Processor -- start 2024-09-10T05:36:36.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.343+0000 7f5bb6fce9c0 1 -- start start 2024-09-10T05:36:36.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.343+0000 7f5bb6fce9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f01479220 0x556f0156bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.343+0000 7f5bb6fce9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556f01321a50 con 0x556f01479220 2024-09-10T05:36:36.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.343+0000 7f5bb4ad4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f01479220 0x556f0156bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.343+0000 7f5bb4ad4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f01479220 0x556f0156bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47214/0 (socket says 172.21.15.62:47214) 2024-09-10T05:36:36.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.343+0000 7f5bb4ad4640 1 -- 172.21.15.62:0/402605081 learned_addr learned my addr 172.21.15.62:0/402605081 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:36.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.343+0000 7f5bb4ad4640 1 -- 172.21.15.62:0/402605081 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f0156c430 con 0x556f01479220 2024-09-10T05:36:36.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.347+0000 7f5bb4ad4640 1 --2- 172.21.15.62:0/402605081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f01479220 0x556f0156bed0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4018f70 tx=0x7f5ba40180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.347+0000 7f5aa160a640 1 -- 172.21.15.62:0/402605081 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ba40c6690 con 0x556f01479220 2024-09-10T05:36:36.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.347+0000 7f5aa160a640 1 -- 172.21.15.62:0/402605081 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ba40c6830 con 0x556f01479220 2024-09-10T05:36:36.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.347+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/402605081 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556f0156c6c0 con 0x556f01479220 2024-09-10T05:36:36.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.347+0000 7f5aa160a640 1 -- 172.21.15.62:0/402605081 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ba40c6b10 con 0x556f01479220 2024-09-10T05:36:36.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.347+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/402605081 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f0156d070 con 0x556f01479220 2024-09-10T05:36:36.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.347+0000 7f5aa160a640 1 -- 172.21.15.62:0/402605081 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f5ba40ce030 con 0x556f01479220 2024-09-10T05:36:36.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.347+0000 7f5aa160a640 1 --2- 172.21.15.62:0/402605081 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5a9c039a70 0x7f5a9c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.347+0000 7f5aa160a640 1 -- 172.21.15.62:0/402605081 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f5ba40cc020 con 0x556f01479220 2024-09-10T05:36:36.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.347+0000 7f5bb42d3640 1 --2- 172.21.15.62:0/402605081 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5a9c039a70 0x7f5a9c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.347+0000 7f5bb6fce9c0 1 --2- 172.21.15.62:0/402605081 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x556f0147c360 0x556f01573040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.347+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/402605081 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556f01573580 con 0x556f0147c360 2024-09-10T05:36:36.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.347+0000 7f5bb52d5640 1 --2- 172.21.15.62:0/402605081 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x556f0147c360 0x556f01573040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.347+0000 7f5bb42d3640 1 --2- 172.21.15.62:0/402605081 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5a9c039a70 0x7f5a9c03bf30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8001e40 tx=0x7f5ba80013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.347+0000 7f5bb52d5640 1 --2- 172.21.15.62:0/402605081 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x556f0147c360 0x556f01573040 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.347+0000 7f5bb52d5640 1 -- 172.21.15.62:0/402605081 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5bac00a4d0 con 0x556f0147c360 2024-09-10T05:36:36.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.347+0000 7f5bb6fce9c0 1 --2- 172.21.15.62:0/402605081 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x556f01574330 0x556f01576720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.347+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/402605081 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556f01576d60 con 0x556f01574330 2024-09-10T05:36:36.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.347+0000 7f5bb4ad4640 1 --2- 172.21.15.62:0/402605081 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x556f01574330 0x556f01576720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.351+0000 7f5bb4ad4640 1 --2- 172.21.15.62:0/402605081 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x556f01574330 0x556f01576720 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.351+0000 7f5bb4ad4640 1 -- 172.21.15.62:0/402605081 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5ba40bc580 con 0x556f01574330 2024-09-10T05:36:36.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.351+0000 7f5bb6fce9c0 1 --2- 172.21.15.62:0/402605081 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x556f01578b20 0x556f0157af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.351+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/402605081 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556f0157b600 con 0x556f01578b20 2024-09-10T05:36:36.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.351+0000 7f5bb42d3640 1 --2- 172.21.15.62:0/402605081 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x556f01578b20 0x556f0157af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.351+0000 7f5bb42d3640 1 --2- 172.21.15.62:0/402605081 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x556f01578b20 0x556f0157af10 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.351+0000 7f5bb42d3640 1 -- 172.21.15.62:0/402605081 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5ba800bd60 con 0x556f01578b20 2024-09-10T05:36:36.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.351+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/402605081 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556f015779c0 con 0x556f01574330 2024-09-10T05:36:36.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.351+0000 7f5bb4ad4640 1 -- 172.21.15.62:0/402605081 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5ba40bc580 con 0x556f01574330 2024-09-10T05:36:36.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.351+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/402605081 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556f01577e60 con 0x556f01578b20 2024-09-10T05:36:36.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.351+0000 7f5bb42d3640 1 -- 172.21.15.62:0/402605081 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5ba800bd60 con 0x556f01578b20 2024-09-10T05:36:36.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.351+0000 7f5bb6fce9c0 1 Processor -- start 2024-09-10T05:36:36.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.351+0000 7f5bb6fce9c0 1 -- start start 2024-09-10T05:36:36.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.351+0000 7f5bb6fce9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f01589c90 0x556f0158a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.351+0000 7f5bb6fce9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556f0138c450 con 0x556f01589c90 2024-09-10T05:36:36.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.355+0000 7f5bb4ad4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f01589c90 0x556f0158a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.355+0000 7f5bb4ad4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f01589c90 0x556f0158a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47222/0 (socket says 172.21.15.62:47222) 2024-09-10T05:36:36.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.355+0000 7f5bb4ad4640 1 -- 172.21.15.62:0/886332045 learned_addr learned my addr 172.21.15.62:0/886332045 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:36.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.355+0000 7f5bb4ad4640 1 -- 172.21.15.62:0/886332045 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f0158a6f0 con 0x556f01589c90 2024-09-10T05:36:36.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.355+0000 7f5bb4ad4640 1 --2- 172.21.15.62:0/886332045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f01589c90 0x556f0158a0b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5ba40d0e20 tx=0x7f5ba40bce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.355+0000 7f5a9a7fc640 1 -- 172.21.15.62:0/886332045 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ba40cf6b0 con 0x556f01589c90 2024-09-10T05:36:36.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.355+0000 7f5a9a7fc640 1 -- 172.21.15.62:0/886332045 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ba40cf850 con 0x556f01589c90 2024-09-10T05:36:36.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.355+0000 7f5a9a7fc640 1 -- 172.21.15.62:0/886332045 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ba40ab3a0 con 0x556f01589c90 2024-09-10T05:36:36.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.355+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/886332045 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556f0158af50 con 0x556f01589c90 2024-09-10T05:36:36.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.355+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/886332045 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f0158b4c0 con 0x556f01589c90 2024-09-10T05:36:36.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.355+0000 7f5a9a7fc640 1 -- 172.21.15.62:0/886332045 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f5ba40ab540 con 0x556f01589c90 2024-09-10T05:36:36.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.355+0000 7f5a9a7fc640 1 --2- 172.21.15.62:0/886332045 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5a8c039a70 0x7f5a8c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.355+0000 7f5a9a7fc640 1 -- 172.21.15.62:0/886332045 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f5ba40e8af0 con 0x556f01589c90 2024-09-10T05:36:36.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.355+0000 7f5bb42d3640 1 --2- 172.21.15.62:0/886332045 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5a8c039a70 0x7f5a8c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.355+0000 7f5bb6fce9c0 1 Processor -- start 2024-09-10T05:36:36.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.359+0000 7f5bb6fce9c0 1 -- start start 2024-09-10T05:36:36.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.359+0000 7f5bb42d3640 1 --2- 172.21.15.62:0/886332045 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5a8c039a70 0x7f5a8c03bf30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x556f0156d350 tx=0x7f5ba800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.359+0000 7f5bb6fce9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f015974c0 0x556f015978c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.359+0000 7f5bb6fce9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556f01565100 con 0x556f015974c0 2024-09-10T05:36:36.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.359+0000 7f5bb4ad4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f015974c0 0x556f015978c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.359+0000 7f5bb4ad4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f015974c0 0x556f015978c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47228/0 (socket says 172.21.15.62:47228) 2024-09-10T05:36:36.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.359+0000 7f5bb4ad4640 1 -- 172.21.15.62:0/1360559293 learned_addr learned my addr 172.21.15.62:0/1360559293 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:36.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.359+0000 7f5bb4ad4640 1 -- 172.21.15.62:0/1360559293 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f01597eb0 con 0x556f015974c0 2024-09-10T05:36:36.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.359+0000 7f5bb4ad4640 1 --2- 172.21.15.62:0/1360559293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f015974c0 0x556f015978c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f5ba401b360 tx=0x7f5ba40ea7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd8dd835e0a6f13c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.359+0000 7f5a8bfff640 1 -- 172.21.15.62:0/1360559293 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ba4105070 con 0x556f015974c0 2024-09-10T05:36:36.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.359+0000 7f5a8bfff640 1 -- 172.21.15.62:0/1360559293 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ba40ea990 con 0x556f015974c0 2024-09-10T05:36:36.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.359+0000 7f5a8bfff640 1 -- 172.21.15.62:0/1360559293 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ba40bf0d0 con 0x556f015974c0 2024-09-10T05:36:36.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.359+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/1360559293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f015974c0 msgr2=0x556f015978c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.359+0000 7f5bb6fce9c0 1 --2- 172.21.15.62:0/1360559293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f015974c0 0x556f015978c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f5ba401b360 tx=0x7f5ba40ea7d0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.359+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/1360559293 shutdown_connections 2024-09-10T05:36:36.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.359+0000 7f5bb6fce9c0 1 --2- 172.21.15.62:0/1360559293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f015974c0 0x556f015978c0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.359+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/1360559293 >> 172.21.15.62:0/1360559293 conn(0x556f01592880 msgr2=0x556f01590ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:36.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.359+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/1360559293 shutdown_connections 2024-09-10T05:36:36.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.359+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/1360559293 wait complete. 2024-09-10T05:36:36.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.359+0000 7f5bb6fce9c0 1 Processor -- start 2024-09-10T05:36:36.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.359+0000 7f5bb6fce9c0 1 -- start start 2024-09-10T05:36:36.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.359+0000 7f5bb6fce9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f015974c0 0x556f0159d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.359+0000 7f5bb6fce9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556f01597eb0 con 0x556f015974c0 2024-09-10T05:36:36.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.359+0000 7f5bb4ad4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f015974c0 0x556f0159d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.359+0000 7f5bb4ad4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f015974c0 0x556f0159d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47232/0 (socket says 172.21.15.62:47232) 2024-09-10T05:36:36.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.359+0000 7f5bb4ad4640 1 -- 172.21.15.62:0/899966774 learned_addr learned my addr 172.21.15.62:0/899966774 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:36.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.359+0000 7f5bb4ad4640 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f0159db90 con 0x556f015974c0 2024-09-10T05:36:36.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.363+0000 7f5bb4ad4640 1 --2- 172.21.15.62:0/899966774 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f015974c0 0x556f0159d630 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5ba401b380 tx=0x7f5ba40bff50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.363+0000 7f5a8a7fc640 1 -- 172.21.15.62:0/899966774 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ba4110020 con 0x556f015974c0 2024-09-10T05:36:36.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.363+0000 7f5a8a7fc640 1 -- 172.21.15.62:0/899966774 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ba40eae20 con 0x556f015974c0 2024-09-10T05:36:36.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.363+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556f0159db90 con 0x556f015974c0 2024-09-10T05:36:36.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.363+0000 7f5a8a7fc640 1 -- 172.21.15.62:0/899966774 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ba4105030 con 0x556f015974c0 2024-09-10T05:36:36.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.363+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f0159db90 con 0x556f015974c0 2024-09-10T05:36:36.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.363+0000 7f5a8a7fc640 1 -- 172.21.15.62:0/899966774 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f5ba4113020 con 0x556f015974c0 2024-09-10T05:36:36.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.363+0000 7f5bb6fce9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.363+0000 7f5a8a7fc640 1 --2- 172.21.15.62:0/899966774 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5a80039b10 0x7f5a8003bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.363+0000 7f5a8a7fc640 1 -- 172.21.15.62:0/899966774 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f5ba4106070 con 0x556f015974c0 2024-09-10T05:36:36.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.363+0000 7f5bb42d3640 1 --2- 172.21.15.62:0/899966774 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5a80039b10 0x7f5a8003bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.363+0000 7f5bb6fce9c0 1 --2- 172.21.15.62:0/899966774 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x556f015a8490 0x556f015aa900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.363+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556f015ab050 con 0x556f015a8490 2024-09-10T05:36:36.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.363+0000 7f5bb52d5640 1 --2- 172.21.15.62:0/899966774 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x556f015a8490 0x556f015aa900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.363+0000 7f5bb42d3640 1 --2- 172.21.15.62:0/899966774 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5a80039b10 0x7f5a8003bfd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x556f01577990 tx=0x7f5ba8010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.363+0000 7f5bb52d5640 1 --2- 172.21.15.62:0/899966774 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x556f015a8490 0x556f015aa900 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.363+0000 7f5bb52d5640 1 -- 172.21.15.62:0/899966774 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5bac00a4d0 con 0x556f015a8490 2024-09-10T05:36:36.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.363+0000 7f5bb6fce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:36.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.363+0000 7f5bb6fce9c0 20 realm 2024-09-10T05:36:36.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.363+0000 7f5bb6fce9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.363+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556f015a7840 con 0x556f015a8490 2024-09-10T05:36:36.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.363+0000 7f5bb52d5640 1 -- 172.21.15.62:0/899966774 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5bac00a4d0 con 0x556f015a8490 2024-09-10T05:36:36.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.363+0000 7f5bb6fce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:36.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.363+0000 7f5bb6fce9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:36.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.363+0000 7f5bb6fce9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.363+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556f015abb10 con 0x556f015a8490 2024-09-10T05:36:36.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.363+0000 7f5bb52d5640 1 -- 172.21.15.62:0/899966774 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5bac00a4d0 con 0x556f015a8490 2024-09-10T05:36:36.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.363+0000 7f5bb6fce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:36.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.363+0000 7f5bb6fce9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.363+0000 7f5bb6fce9c0 1 --2- 172.21.15.62:0/899966774 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x556f015ac8f0 0x556f015aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.363+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556f015af3b0 con 0x556f015ac8f0 2024-09-10T05:36:36.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.367+0000 7f5bb4ad4640 1 --2- 172.21.15.62:0/899966774 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x556f015ac8f0 0x556f015aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.367+0000 7f5bb4ad4640 1 --2- 172.21.15.62:0/899966774 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x556f015ac8f0 0x556f015aece0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.367+0000 7f5bb4ad4640 1 -- 172.21.15.62:0/899966774 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5ba40f1020 con 0x556f015ac8f0 2024-09-10T05:36:36.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.367+0000 7f5bb6fce9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:36.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.367+0000 7f5bb6fce9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.367+0000 7f5bb6fce9c0 1 --2- 172.21.15.62:0/899966774 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x556f015b0110 0x556f015b2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.367+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556f015b2c70 con 0x556f015b0110 2024-09-10T05:36:36.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.367+0000 7f5bb42d3640 1 --2- 172.21.15.62:0/899966774 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x556f015b0110 0x556f015b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.367+0000 7f5bb42d3640 1 --2- 172.21.15.62:0/899966774 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x556f015b0110 0x556f015b2500 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.367+0000 7f5bb42d3640 1 -- 172.21.15.62:0/899966774 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5ba800bd60 con 0x556f015b0110 2024-09-10T05:36:36.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.367+0000 7f5bb6fce9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:36.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.367+0000 7f5bb6fce9c0 20 searching for the correct realm 2024-09-10T05:36:36.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.367+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556f015b4540 con 0x556f015b0110 2024-09-10T05:36:36.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.367+0000 7f5bb42d3640 1 -- 172.21.15.62:0/899966774 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ba800bd60 con 0x556f015b0110 2024-09-10T05:36:36.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.367+0000 7f5bb42d3640 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556f015b4540 con 0x556f015ac8f0 2024-09-10T05:36:36.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.367+0000 7f5bb4ad4640 1 -- 172.21.15.62:0/899966774 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ba40f1020 con 0x556f015ac8f0 2024-09-10T05:36:36.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.367+0000 7f5bb4ad4640 1 --2- 172.21.15.62:0/899966774 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f5ba4120040 0x7f5ba40f4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.367+0000 7f5bb4ad4640 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556f015b4540 con 0x7f5ba4120040 2024-09-10T05:36:36.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.367+0000 7f5bb52d5640 1 --2- 172.21.15.62:0/899966774 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f5ba4120040 0x7f5ba40f4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.367+0000 7f5bb52d5640 1 --2- 172.21.15.62:0/899966774 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f5ba4120040 0x7f5ba40f4600 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.371+0000 7f5bb52d5640 1 -- 172.21.15.62:0/899966774 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bac00a4d0 con 0x7f5ba4120040 2024-09-10T05:36:36.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.371+0000 7f5bb52d5640 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556f015b4540 con 0x556f015a8490 2024-09-10T05:36:36.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.371+0000 7f5bb52d5640 1 -- 172.21.15.62:0/899966774 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bac00a4d0 con 0x556f015a8490 2024-09-10T05:36:36.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.371+0000 7f5bb52d5640 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556f015b4540 con 0x556f015a8490 2024-09-10T05:36:36.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.371+0000 7f5bb52d5640 1 -- 172.21.15.62:0/899966774 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bac00a4d0 con 0x556f015a8490 2024-09-10T05:36:36.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.371+0000 7f5bb52d5640 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556f015b4540 con 0x556f015b0110 2024-09-10T05:36:36.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.371+0000 7f5bb42d3640 1 -- 172.21.15.62:0/899966774 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ba800bd60 con 0x556f015b0110 2024-09-10T05:36:36.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.371+0000 7f5bb42d3640 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556f015b4540 con 0x556f015a8490 2024-09-10T05:36:36.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.371+0000 7f5bb52d5640 1 -- 172.21.15.62:0/899966774 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bac00a4d0 con 0x556f015a8490 2024-09-10T05:36:36.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.371+0000 7f5bb52d5640 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556f015b4540 con 0x556f015ac8f0 2024-09-10T05:36:36.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.371+0000 7f5bb4ad4640 1 -- 172.21.15.62:0/899966774 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ba40f1020 con 0x556f015ac8f0 2024-09-10T05:36:36.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.371+0000 7f5bb4ad4640 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556f015b4540 con 0x556f015ac8f0 2024-09-10T05:36:36.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.371+0000 7f5bb4ad4640 1 -- 172.21.15.62:0/899966774 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ba40f1020 con 0x556f015ac8f0 2024-09-10T05:36:36.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.371+0000 7f5bb4ad4640 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556f015b4540 con 0x556f015a8490 2024-09-10T05:36:36.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.371+0000 7f5bb52d5640 1 -- 172.21.15.62:0/899966774 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bac00a4d0 con 0x556f015a8490 2024-09-10T05:36:36.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.371+0000 7f5bb52d5640 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556f015b4540 con 0x7f5ba4120040 2024-09-10T05:36:36.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.371+0000 7f5bb52d5640 1 -- 172.21.15.62:0/899966774 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bac00a4d0 con 0x7f5ba4120040 2024-09-10T05:36:36.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.371+0000 7f5bb52d5640 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556f015b4540 con 0x556f015a8490 2024-09-10T05:36:36.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.371+0000 7f5bb52d5640 1 -- 172.21.15.62:0/899966774 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bac00a4d0 con 0x556f015a8490 2024-09-10T05:36:36.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.371+0000 7f5bb52d5640 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556f015b4540 con 0x7f5ba4120040 2024-09-10T05:36:36.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.371+0000 7f5bb52d5640 1 -- 172.21.15.62:0/899966774 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5bac00a4d0 con 0x7f5ba4120040 2024-09-10T05:36:36.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.371+0000 7f5bb52d5640 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556f015b4540 con 0x556f015ac8f0 2024-09-10T05:36:36.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.375+0000 7f5bb4ad4640 1 -- 172.21.15.62:0/899966774 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ba40f1020 con 0x556f015ac8f0 2024-09-10T05:36:36.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.375+0000 7f5bb4ad4640 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556f015b4540 con 0x556f015b0110 2024-09-10T05:36:36.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.375+0000 7f5bb42d3640 1 -- 172.21.15.62:0/899966774 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ba800bd60 con 0x556f015b0110 2024-09-10T05:36:36.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.375+0000 7f5bb42d3640 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556f015b4540 con 0x556f015a8490 2024-09-10T05:36:36.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.375+0000 7f5bb52d5640 1 -- 172.21.15.62:0/899966774 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bac00a4d0 con 0x556f015a8490 2024-09-10T05:36:36.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.375+0000 7f5bb52d5640 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556f015b4540 con 0x556f015ac8f0 2024-09-10T05:36:36.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.375+0000 7f5bb4ad4640 1 -- 172.21.15.62:0/899966774 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ba40f1020 con 0x556f015ac8f0 2024-09-10T05:36:36.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.375+0000 7f5bb4ad4640 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556f015b4540 con 0x556f015b0110 2024-09-10T05:36:36.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.375+0000 7f5bb42d3640 1 -- 172.21.15.62:0/899966774 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 30 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f5ba800bd60 con 0x556f015b0110 2024-09-10T05:36:36.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.375+0000 7f5bb42d3640 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556f015b4540 con 0x556f015a8490 2024-09-10T05:36:36.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.375+0000 7f5bb52d5640 1 -- 172.21.15.62:0/899966774 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bac00a4d0 con 0x556f015a8490 2024-09-10T05:36:36.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.375+0000 7f5bb52d5640 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556f015b4540 con 0x556f015a8490 2024-09-10T05:36:36.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.375+0000 7f5bb52d5640 1 -- 172.21.15.62:0/899966774 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5bac00a4d0 con 0x556f015a8490 2024-09-10T05:36:36.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.375+0000 7f5bb52d5640 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556f015b4540 con 0x556f015a8490 2024-09-10T05:36:36.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.375+0000 7f5bb52d5640 1 -- 172.21.15.62:0/899966774 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bac00a4d0 con 0x556f015a8490 2024-09-10T05:36:36.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.375+0000 7f5bb52d5640 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556f015b4540 con 0x556f015b0110 2024-09-10T05:36:36.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.375+0000 7f5bb42d3640 1 -- 172.21.15.62:0/899966774 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ba800bd60 con 0x556f015b0110 2024-09-10T05:36:36.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.375+0000 7f5bb42d3640 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556f015b4540 con 0x7f5ba4120040 2024-09-10T05:36:36.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.375+0000 7f5bb52d5640 1 -- 172.21.15.62:0/899966774 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bac00a4d0 con 0x7f5ba4120040 2024-09-10T05:36:36.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.379+0000 7f5bb52d5640 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556f015b4540 con 0x556f015a8490 2024-09-10T05:36:36.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.379+0000 7f5bb52d5640 1 -- 172.21.15.62:0/899966774 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bac00a4d0 con 0x556f015a8490 2024-09-10T05:36:36.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.379+0000 7f5bb52d5640 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556f015b4540 con 0x7f5ba4120040 2024-09-10T05:36:36.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.379+0000 7f5bb52d5640 1 -- 172.21.15.62:0/899966774 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bac00a4d0 con 0x7f5ba4120040 2024-09-10T05:36:36.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.379+0000 7f5bb52d5640 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556f015b4540 con 0x556f015b0110 2024-09-10T05:36:36.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.379+0000 7f5bb42d3640 1 -- 172.21.15.62:0/899966774 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ba800bd60 con 0x556f015b0110 2024-09-10T05:36:36.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.379+0000 7f5bb42d3640 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556f015b4540 con 0x7f5ba4120040 2024-09-10T05:36:36.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.379+0000 7f5bb52d5640 1 -- 172.21.15.62:0/899966774 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bac00a4d0 con 0x7f5ba4120040 2024-09-10T05:36:36.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.379+0000 7f5bb52d5640 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556f015b4540 con 0x556f015ac8f0 2024-09-10T05:36:36.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.379+0000 7f5bb4ad4640 1 -- 172.21.15.62:0/899966774 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ba40f1020 con 0x556f015ac8f0 2024-09-10T05:36:36.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.379+0000 7f5bb4ad4640 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556f015b4540 con 0x556f015ac8f0 2024-09-10T05:36:36.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.379+0000 7f5bb4ad4640 1 -- 172.21.15.62:0/899966774 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ba40f1020 con 0x556f015ac8f0 2024-09-10T05:36:36.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.379+0000 7f5bb4ad4640 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556f015b4540 con 0x556f015b0110 2024-09-10T05:36:36.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.379+0000 7f5bb42d3640 1 -- 172.21.15.62:0/899966774 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ba800bd60 con 0x556f015b0110 2024-09-10T05:36:36.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.379+0000 7f5bb42d3640 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556f015b4540 con 0x556f015ac8f0 2024-09-10T05:36:36.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.379+0000 7f5bb4ad4640 1 -- 172.21.15.62:0/899966774 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5ba40f1020 con 0x556f015ac8f0 2024-09-10T05:36:36.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.379+0000 7f5bb4ad4640 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556f015b4540 con 0x556f015ac8f0 2024-09-10T05:36:36.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.383+0000 7f5bb4ad4640 1 -- 172.21.15.62:0/899966774 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ba40f1020 con 0x556f015ac8f0 2024-09-10T05:36:36.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.383+0000 7f5bb6fce9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:36.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.383+0000 7f5bb6fce9c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:36.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.383+0000 7f5bb6fce9c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:36.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.383+0000 7f5bb6fce9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:36.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.383+0000 7f5bb6fce9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:36.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.383+0000 7f5bb6fce9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:36.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.383+0000 7f5bb6fce9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.383+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556f015b3630 con 0x556f015a8490 2024-09-10T05:36:36.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.383+0000 7f5bb52d5640 1 -- 172.21.15.62:0/899966774 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5bac00a4d0 con 0x556f015a8490 2024-09-10T05:36:36.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.383+0000 7f5bb6fce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:36.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.383+0000 7f5bb6fce9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.383+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556f015b3ed0 con 0x556f015ac8f0 2024-09-10T05:36:36.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.383+0000 7f5bb4ad4640 1 -- 172.21.15.62:0/899966774 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5ba40f1020 con 0x556f015ac8f0 2024-09-10T05:36:36.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.383+0000 7f5bb6fce9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:36.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.383+0000 7f5bb6fce9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.383+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556f015b3270 con 0x556f015b0110 2024-09-10T05:36:36.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.383+0000 7f5bb42d3640 1 -- 172.21.15.62:0/899966774 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5ba800bd60 con 0x556f015b0110 2024-09-10T05:36:36.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.383+0000 7f5bb6fce9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:36.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.383+0000 7f5bb6fce9c0 20 zone default found 2024-09-10T05:36:36.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.383+0000 7f5bb6fce9c0 4 Realm: () 2024-09-10T05:36:36.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.383+0000 7f5bb6fce9c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:36.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.383+0000 7f5bb6fce9c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:36.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.383+0000 7f5bb6fce9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:36.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.383+0000 7f5bb6fce9c0 20 zonegroup default 2024-09-10T05:36:36.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.383+0000 7f5bb6fce9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.383+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556f015b4e20 con 0x7f5ba4120040 2024-09-10T05:36:36.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.383+0000 7f5bb52d5640 1 -- 172.21.15.62:0/899966774 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5bac00a4d0 con 0x7f5ba4120040 2024-09-10T05:36:36.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.383+0000 7f5bb6fce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:36.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.383+0000 7f5bb6fce9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.383+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556f015b7060 con 0x556f015b0110 2024-09-10T05:36:36.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.383+0000 7f5bb42d3640 1 -- 172.21.15.62:0/899966774 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5ba800bd60 con 0x556f015b0110 2024-09-10T05:36:36.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.383+0000 7f5bb6fce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:36.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.383+0000 7f5bb6fce9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.383+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556f015b7400 con 0x556f015b0110 2024-09-10T05:36:36.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.383+0000 7f5bb42d3640 1 -- 172.21.15.62:0/899966774 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5ba800bd60 con 0x556f015b0110 2024-09-10T05:36:36.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.383+0000 7f5bb6fce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:36.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.383+0000 7f5bb6fce9c0 20 started sync module instance, tier type = 2024-09-10T05:36:36.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.383+0000 7f5bb6fce9c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:36.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.383+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556f015b6540 con 0x556f015ac8f0 2024-09-10T05:36:36.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.387+0000 7f5bb4ad4640 1 -- 172.21.15.62:0/899966774 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ba40f1020 con 0x556f015ac8f0 2024-09-10T05:36:36.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.387+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93935252498736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556f015b7d40 con 0x556f015ac8f0 2024-09-10T05:36:36.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.387+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556f015b8590 con 0x556f015a8490 2024-09-10T05:36:36.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.387+0000 7f5bb52d5640 1 -- 172.21.15.62:0/899966774 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bac00a4d0 con 0x556f015a8490 2024-09-10T05:36:36.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.387+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93935252503872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556f015b8160 con 0x556f015a8490 2024-09-10T05:36:36.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.387+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556f015b9530 con 0x556f015ac8f0 2024-09-10T05:36:36.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.387+0000 7f5bb4ad4640 1 -- 172.21.15.62:0/899966774 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 93935252498736] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ba40f1020 con 0x556f015ac8f0 2024-09-10T05:36:36.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.387+0000 7f5bb52d5640 1 -- 172.21.15.62:0/899966774 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93935252503872] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bac00a4d0 con 0x556f015a8490 2024-09-10T05:36:36.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.391+0000 7f5bb4ad4640 1 -- 172.21.15.62:0/899966774 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ba40f1020 con 0x556f015ac8f0 2024-09-10T05:36:36.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.391+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93935252506928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556f015b94f0 con 0x556f015ac8f0 2024-09-10T05:36:36.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.391+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556f015b9960 con 0x7f5ba4120040 2024-09-10T05:36:36.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.391+0000 7f5bb52d5640 1 -- 172.21.15.62:0/899966774 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bac00a4d0 con 0x7f5ba4120040 2024-09-10T05:36:36.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.391+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93935252502672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556f015b9920 con 0x7f5ba4120040 2024-09-10T05:36:36.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.391+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556f015ba860 con 0x556f015ac8f0 2024-09-10T05:36:36.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.391+0000 7f5bb4ad4640 1 -- 172.21.15.62:0/899966774 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93935252506928] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ba40f1020 con 0x556f015ac8f0 2024-09-10T05:36:36.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.395+0000 7f5bb52d5640 1 -- 172.21.15.62:0/899966774 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93935252502672] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bac00a4d0 con 0x7f5ba4120040 2024-09-10T05:36:36.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.395+0000 7f5bb4ad4640 1 -- 172.21.15.62:0/899966774 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ba40f1020 con 0x556f015ac8f0 2024-09-10T05:36:36.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.395+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93935252512080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556f015ba860 con 0x556f015ac8f0 2024-09-10T05:36:36.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.395+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556f015bac50 con 0x556f015b0110 2024-09-10T05:36:36.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.395+0000 7f5bb42d3640 1 -- 172.21.15.62:0/899966774 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ba800bd60 con 0x556f015b0110 2024-09-10T05:36:36.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.395+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93935252508672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556f015bac50 con 0x556f015b0110 2024-09-10T05:36:36.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.395+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556f015bbb80 con 0x556f015b0110 2024-09-10T05:36:36.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.395+0000 7f5bb4ad4640 1 -- 172.21.15.62:0/899966774 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 93935252512080] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ba40f1020 con 0x556f015ac8f0 2024-09-10T05:36:36.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.399+0000 7f5bb42d3640 1 -- 172.21.15.62:0/899966774 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93935252508672] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ba800bd60 con 0x556f015b0110 2024-09-10T05:36:36.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.399+0000 7f5bb42d3640 1 -- 172.21.15.62:0/899966774 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ba800bd60 con 0x556f015b0110 2024-09-10T05:36:36.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.399+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93935252516976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556f015bb690 con 0x556f015b0110 2024-09-10T05:36:36.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.399+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556f015bc050 con 0x7f5ba4120040 2024-09-10T05:36:36.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.399+0000 7f5bb42d3640 1 -- 172.21.15.62:0/899966774 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93935252516976] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ba800bd60 con 0x556f015b0110 2024-09-10T05:36:36.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.399+0000 7f5bb52d5640 1 -- 172.21.15.62:0/899966774 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bac00a4d0 con 0x7f5ba4120040 2024-09-10T05:36:36.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.399+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93935252513648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556f015bc050 con 0x7f5ba4120040 2024-09-10T05:36:36.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.399+0000 7f5bb6fce9c0 20 add_watcher() i=0 2024-09-10T05:36:36.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.399+0000 7f5bb6fce9c0 20 add_watcher() i=1 2024-09-10T05:36:36.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.399+0000 7f5bb6fce9c0 20 add_watcher() i=2 2024-09-10T05:36:36.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.399+0000 7f5bb6fce9c0 20 add_watcher() i=3 2024-09-10T05:36:36.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.399+0000 7f5bb6fce9c0 20 add_watcher() i=4 2024-09-10T05:36:36.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.399+0000 7f5bb6fce9c0 20 add_watcher() i=5 2024-09-10T05:36:36.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.399+0000 7f5bb6fce9c0 20 add_watcher() i=6 2024-09-10T05:36:36.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.403+0000 7f5bb52d5640 1 -- 172.21.15.62:0/899966774 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93935252513648] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bac00a4d0 con 0x7f5ba4120040 2024-09-10T05:36:36.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.403+0000 7f5bb6fce9c0 20 add_watcher() i=7 2024-09-10T05:36:36.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.403+0000 7f5bb6fce9c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:36.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.403+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556f015bf3f0 con 0x556f015a8490 2024-09-10T05:36:36.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.403+0000 7f5bb52d5640 1 -- 172.21.15.62:0/899966774 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5bac00a4d0 con 0x556f015a8490 2024-09-10T05:36:36.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.403+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93935252532656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556f015bc1c0 con 0x556f015a8490 2024-09-10T05:36:36.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.403+0000 7f5bb52d5640 1 -- 172.21.15.62:0/899966774 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93935252532656] v30'112 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5bac00a4d0 con 0x556f015a8490 2024-09-10T05:36:36.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.403+0000 7f5a6b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:36.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.403+0000 7f5bb6fce9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:36.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.403+0000 7f5bb6fce9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:36.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.403+0000 7f5bb6fce9c0 5 note: GC not initialized 2024-09-10T05:36:36.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.403+0000 7f5a6a7e4640 20 reqs_thread_entry: start 2024-09-10T05:36:36.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.403+0000 7f5bb6fce9c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:36.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.403+0000 7f5bb6fce9c0 20 Filter name: none 2024-09-10T05:36:36.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.403+0000 7f5a63fff640 20 reqs_thread_entry: start 2024-09-10T05:36:36.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.407+0000 7f5bb6fce9c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-10T05:36:36.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.407+0000 7f5bb6fce9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.407+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556f015e27b0 con 0x7f5ba4120040 2024-09-10T05:36:36.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.407+0000 7f5bb52d5640 1 -- 172.21.15.62:0/899966774 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f5bac00a4d0 con 0x7f5ba4120040 2024-09-10T05:36:36.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.407+0000 7f5bb6fce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:36.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.407+0000 7f5bb6fce9c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-10T05:36:36.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.407+0000 7f5bb6fce9c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T05:36:36.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.407+0000 7f5bb6fce9c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-10T05:36:36.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.407+0000 7f5bb6fce9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.407+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556f015e0e50 con 0x556f015b0110 2024-09-10T05:36:36.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.407+0000 7f5bb42d3640 1 -- 172.21.15.62:0/899966774 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f5ba800bd60 con 0x556f015b0110 2024-09-10T05:36:36.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.407+0000 7f5bb6fce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:36.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.407+0000 7f5bb6fce9c0 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-10T05:36:36.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.407+0000 7f5bb6fce9c0 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T05:36:36.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.407+0000 7f5bb6fce9c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-10T05:36:36.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.407+0000 7f5bb6fce9c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-10T05:36:36.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.407+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556f015e1720 con 0x7f5ba4120040 2024-09-10T05:36:36.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.407+0000 7f5bb52d5640 1 -- 172.21.15.62:0/899966774 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v30'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f5bac00a4d0 con 0x7f5ba4120040 2024-09-10T05:36:36.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.407+0000 7f5bb6fce9c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-10T05:36:36.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.407+0000 7f5bb6fce9c0 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T05:36:36.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.407+0000 7f5bb6fce9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-10T05:36:36.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.407+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 93935252673136 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556f015e6250 con 0x556f015b0110 2024-09-10T05:36:36.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.407+0000 7f5bb42d3640 1 -- 172.21.15.62:0/899966774 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== watch-notify(notify (1) cookie 93935252508672 notify 128849018883 ret 0) ==== 598+0+0 (crc 0 0 0) 0x7f5ba8018040 con 0x556f015b0110 2024-09-10T05:36:36.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.407+0000 7f5a8bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018883 cookie 93935252508672 notifier 4486 bl.length()=556 2024-09-10T05:36:36.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.407+0000 7f5a8bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-10T05:36:36.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.407+0000 7f5a8bfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T05:36:36.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.411+0000 7f5a8bfff640 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f5a78003eb0 con 0x556f015b0110 2024-09-10T05:36:36.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.411+0000 7f5bb42d3640 1 -- 172.21.15.62:0/899966774 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== osd_op_reply(65 notify.5 [notify cookie 93935252673136 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5ba800bd60 con 0x556f015b0110 2024-09-10T05:36:36.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.411+0000 7f5bb42d3640 1 -- 172.21.15.62:0/899966774 <== osd.3 v2:172.21.15.62:6816/2708991149 19 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ba800bd60 con 0x556f015b0110 2024-09-10T05:36:36.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.411+0000 7f5bb42d3640 1 -- 172.21.15.62:0/899966774 <== osd.3 v2:172.21.15.62:6816/2708991149 20 ==== watch-notify(notify_complete (2) cookie 93935252673136 notify 128849018883 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556f0132b9c0 con 0x556f015b0110 2024-09-10T05:36:36.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.411+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556f015e1720 con 0x556f015b0110 2024-09-10T05:36:36.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.411+0000 7f5bb42d3640 1 -- 172.21.15.62:0/899966774 <== osd.3 v2:172.21.15.62:6816/2708991149 21 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v30'3 uv3 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f5ba800bd60 con 0x556f015b0110 2024-09-10T05:36:36.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.411+0000 7f5bb6fce9c0 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-10T05:36:36.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.411+0000 7f5bb6fce9c0 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T05:36:36.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.411+0000 7f5bb6fce9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-10T05:36:36.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.411+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 93935252673136 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556f015e63b0 con 0x556f015ac8f0 2024-09-10T05:36:36.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.411+0000 7f5bb4ad4640 1 -- 172.21.15.62:0/899966774 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== watch-notify(notify (1) cookie 93935252506928 notify 128849018903 ret 0) ==== 219+0+0 (crc 0 0 0) 0x556f0158af50 con 0x556f015ac8f0 2024-09-10T05:36:36.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.411+0000 7f5bb4ad4640 1 -- 172.21.15.62:0/899966774 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(68 notify.2 [notify cookie 93935252673136 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5ba40f1020 con 0x556f015ac8f0 2024-09-10T05:36:36.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.411+0000 7f5a8b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018903 cookie 93935252506928 notifier 4486 bl.length()=177 2024-09-10T05:36:36.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.411+0000 7f5a8b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-10T05:36:36.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.411+0000 7f5a8b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T05:36:36.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.411+0000 7f5a8b7fe640 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f59dc003410 con 0x556f015ac8f0 2024-09-10T05:36:36.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.411+0000 7f5bb4ad4640 1 -- 172.21.15.62:0/899966774 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ba40f1020 con 0x556f015ac8f0 2024-09-10T05:36:36.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.411+0000 7f5bb4ad4640 1 -- 172.21.15.62:0/899966774 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== watch-notify(notify_complete (2) cookie 93935252673136 notify 128849018903 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556f0158a6f0 con 0x556f015ac8f0 2024-09-10T05:36:36.416 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-10T05:36:36.410564Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:36:36.410539Z","tags":[],"group_ids":[]} 2024-09-10T05:36:36.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.415+0000 7f5a6b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:36.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.415+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93935252532656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556f015e0550 con 0x556f015a8490 2024-09-10T05:36:36.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.415+0000 7f5bb52d5640 1 -- 172.21.15.62:0/899966774 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93935252532656] v30'113 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5bac00a4d0 con 0x556f015a8490 2024-09-10T05:36:36.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.415+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93935252498736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556f015e0550 con 0x556f015ac8f0 2024-09-10T05:36:36.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.419+0000 7f5bb4ad4640 1 -- 172.21.15.62:0/899966774 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93935252498736] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ba40f1020 con 0x556f015ac8f0 2024-09-10T05:36:36.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.419+0000 7f5bb6fce9c0 20 remove_watcher() i=0 2024-09-10T05:36:36.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.419+0000 7f5bb6fce9c0 2 removed watcher, disabling cache 2024-09-10T05:36:36.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.419+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93935252503872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556f015e0550 con 0x556f015a8490 2024-09-10T05:36:36.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.419+0000 7f5bb52d5640 1 -- 172.21.15.62:0/899966774 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93935252503872] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bac00a4d0 con 0x556f015a8490 2024-09-10T05:36:36.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.419+0000 7f5bb6fce9c0 20 remove_watcher() i=1 2024-09-10T05:36:36.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.419+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93935252506928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556f015e0550 con 0x556f015ac8f0 2024-09-10T05:36:36.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.423+0000 7f5bb4ad4640 1 -- 172.21.15.62:0/899966774 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93935252506928] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ba40f1020 con 0x556f015ac8f0 2024-09-10T05:36:36.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.423+0000 7f5bb6fce9c0 20 remove_watcher() i=2 2024-09-10T05:36:36.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.423+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93935252502672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556f015e0550 con 0x7f5ba4120040 2024-09-10T05:36:36.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.423+0000 7f5bb52d5640 1 -- 172.21.15.62:0/899966774 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93935252502672] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bac00a4d0 con 0x7f5ba4120040 2024-09-10T05:36:36.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.423+0000 7f5bb6fce9c0 20 remove_watcher() i=3 2024-09-10T05:36:36.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.423+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93935252512080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556f015e0550 con 0x556f015ac8f0 2024-09-10T05:36:36.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.423+0000 7f5bb4ad4640 1 -- 172.21.15.62:0/899966774 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93935252512080] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ba40f1020 con 0x556f015ac8f0 2024-09-10T05:36:36.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.423+0000 7f5bb6fce9c0 20 remove_watcher() i=4 2024-09-10T05:36:36.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.423+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93935252508672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556f015e0550 con 0x556f015b0110 2024-09-10T05:36:36.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.427+0000 7f5bb42d3640 1 -- 172.21.15.62:0/899966774 <== osd.3 v2:172.21.15.62:6816/2708991149 22 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93935252508672] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ba800bd60 con 0x556f015b0110 2024-09-10T05:36:36.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.427+0000 7f5bb6fce9c0 20 remove_watcher() i=5 2024-09-10T05:36:36.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.427+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93935252516976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556f015e0550 con 0x556f015b0110 2024-09-10T05:36:36.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.427+0000 7f5bb42d3640 1 -- 172.21.15.62:0/899966774 <== osd.3 v2:172.21.15.62:6816/2708991149 23 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93935252516976] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ba800bd60 con 0x556f015b0110 2024-09-10T05:36:36.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.427+0000 7f5bb6fce9c0 20 remove_watcher() i=6 2024-09-10T05:36:36.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.427+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93935252513648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556f015e0550 con 0x7f5ba4120040 2024-09-10T05:36:36.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.427+0000 7f5bb52d5640 1 -- 172.21.15.62:0/899966774 <== osd.2 v2:172.21.15.62:6800/2677868286 15 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93935252513648] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bac00a4d0 con 0x7f5ba4120040 2024-09-10T05:36:36.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.427+0000 7f5bb6fce9c0 20 remove_watcher() i=7 2024-09-10T05:36:36.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.427+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x556f015ac8f0 msgr2=0x556f015aece0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.427+0000 7f5bb6fce9c0 1 --2- 172.21.15.62:0/899966774 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x556f015ac8f0 0x556f015aece0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.427+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x556f015a8490 msgr2=0x556f015aa900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.427+0000 7f5bb6fce9c0 1 --2- 172.21.15.62:0/899966774 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x556f015a8490 0x556f015aa900 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.427+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f5ba4120040 msgr2=0x7f5ba40f4600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.427+0000 7f5bb6fce9c0 1 --2- 172.21.15.62:0/899966774 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f5ba4120040 0x7f5ba40f4600 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.427+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x556f015b0110 msgr2=0x556f015b2500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.427+0000 7f5bb6fce9c0 1 --2- 172.21.15.62:0/899966774 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x556f015b0110 0x556f015b2500 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.427+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5a80039b10 msgr2=0x7f5a8003bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.427+0000 7f5bb6fce9c0 1 --2- 172.21.15.62:0/899966774 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5a80039b10 0x7f5a8003bfd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x556f01577990 tx=0x7f5ba8010000 comp rx=0 tx=0).stop 2024-09-10T05:36:36.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.427+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f015974c0 msgr2=0x556f0159d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.427+0000 7f5bb52d5640 1 -- 172.21.15.62:0/899966774 reap_dead start 2024-09-10T05:36:36.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.427+0000 7f5bb6fce9c0 1 --2- 172.21.15.62:0/899966774 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f015974c0 0x556f0159d630 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5ba401b380 tx=0x7f5ba40bff50 comp rx=0 tx=0).stop 2024-09-10T05:36:36.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.431+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 shutdown_connections 2024-09-10T05:36:36.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.431+0000 7f5bb6fce9c0 1 --2- 172.21.15.62:0/899966774 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f015974c0 0x556f0159d630 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.431+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 >> 172.21.15.62:0/899966774 conn(0x556f01592880 msgr2=0x556f01590a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:36.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.431+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 shutdown_connections 2024-09-10T05:36:36.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.431+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/899966774 wait complete. 2024-09-10T05:36:36.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.431+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/886332045 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5a8c039a70 msgr2=0x7f5a8c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.431+0000 7f5bb6fce9c0 1 --2- 172.21.15.62:0/886332045 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5a8c039a70 0x7f5a8c03bf30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x556f0156d350 tx=0x7f5ba800f000 comp rx=0 tx=0).stop 2024-09-10T05:36:36.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.431+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/886332045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f01589c90 msgr2=0x556f0158a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.431+0000 7f5bb6fce9c0 1 --2- 172.21.15.62:0/886332045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f01589c90 0x556f0158a0b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5ba40d0e20 tx=0x7f5ba40bce80 comp rx=0 tx=0).stop 2024-09-10T05:36:36.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.431+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/886332045 shutdown_connections 2024-09-10T05:36:36.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.431+0000 7f5bb6fce9c0 1 --2- 172.21.15.62:0/886332045 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5a8c039a70 0x7f5a8c03bf30 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.431+0000 7f5bb6fce9c0 1 --2- 172.21.15.62:0/886332045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f01589c90 0x556f0158a0b0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.431+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/886332045 >> 172.21.15.62:0/886332045 conn(0x556f0157f640 msgr2=0x556f0157fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:36.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.431+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/886332045 shutdown_connections 2024-09-10T05:36:36.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.431+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/886332045 wait complete. 2024-09-10T05:36:36.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.431+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/402605081 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x556f01574330 msgr2=0x556f01576720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.431+0000 7f5bb6fce9c0 1 --2- 172.21.15.62:0/402605081 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x556f01574330 0x556f01576720 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.431+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/402605081 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x556f0147c360 msgr2=0x556f01573040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.431+0000 7f5bb6fce9c0 1 --2- 172.21.15.62:0/402605081 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x556f0147c360 0x556f01573040 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.431+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/402605081 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x556f01578b20 msgr2=0x556f0157af10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.431+0000 7f5bb6fce9c0 1 --2- 172.21.15.62:0/402605081 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x556f01578b20 0x556f0157af10 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.431+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/402605081 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5a9c039a70 msgr2=0x7f5a9c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.431+0000 7f5bb6fce9c0 1 --2- 172.21.15.62:0/402605081 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5a9c039a70 0x7f5a9c03bf30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8001e40 tx=0x7f5ba80013a0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.431+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/402605081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f01479220 msgr2=0x556f0156bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.431+0000 7f5bb6fce9c0 1 --2- 172.21.15.62:0/402605081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f01479220 0x556f0156bed0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4018f70 tx=0x7f5ba40180e0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.431+0000 7f5bb52d5640 1 -- 172.21.15.62:0/402605081 reap_dead start 2024-09-10T05:36:36.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.431+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/402605081 shutdown_connections 2024-09-10T05:36:36.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.431+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/402605081 >> 172.21.15.62:0/402605081 conn(0x556f013ecb30 msgr2=0x556f0155f080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:36.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.431+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/402605081 shutdown_connections 2024-09-10T05:36:36.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.431+0000 7f5bb6fce9c0 1 -- 172.21.15.62:0/402605081 wait complete. 2024-09-10T05:36:36.445 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-10T05:36:36.410564Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:36:36.410539Z', 'tags': [], 'group_ids': []} 2024-09-10T05:36:36.451 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-10T05:36:36.456 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T05:36:36.456 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2024-09-10T05:36:36.456 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2024-09-10T05:36:36.456 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2024-09-10T05:36:36.519 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:36.519 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:36.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.515+0000 7f4789d399c0 1 Processor -- start 2024-09-10T05:36:36.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.515+0000 7f4789d399c0 1 -- start start 2024-09-10T05:36:36.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.515+0000 7f4789d399c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5596449fe350 0x559644a00740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.515+0000 7f4789d399c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5596448ac9c0 con 0x5596449fa200 2024-09-10T05:36:36.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.515+0000 7f4789d399c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x5596448fc6d0 con 0x5596449fe350 2024-09-10T05:36:36.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.515+0000 7f478703e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5596449fe350 0x559644a00740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.515+0000 7f478703e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5596449fe350 0x559644a00740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47242/0 (socket says 172.21.15.62:47242) 2024-09-10T05:36:36.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.515+0000 7f478783f640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x5596449fa200 0x5596449fa5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:53054/0 (socket says 172.21.15.62:53054) 2024-09-10T05:36:36.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.519+0000 7f478703e640 1 -- 172.21.15.62:0/2722820593 learned_addr learned my addr 172.21.15.62:0/2722820593 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:36.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.519+0000 7f478703e640 1 -- 172.21.15.62:0/2722820593 >> v1:172.21.15.2:6789/0 conn(0x5596449fa200 legacy=0x5596449fa5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.519+0000 7f478703e640 1 -- 172.21.15.62:0/2722820593 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596448a0ca0 con 0x5596449fe350 2024-09-10T05:36:36.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.519+0000 7f478703e640 1 --2- 172.21.15.62:0/2722820593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596449fe350 0x559644a00740 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f477000a5c0 tx=0x7f477001b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28ea7c545167998c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.519+0000 7f478683d640 1 -- 172.21.15.62:0/2722820593 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47700a9590 con 0x5596449fe350 2024-09-10T05:36:36.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.519+0000 7f478683d640 1 -- 172.21.15.62:0/2722820593 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47700ae070 con 0x5596449fe350 2024-09-10T05:36:36.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.519+0000 7f478683d640 1 -- 172.21.15.62:0/2722820593 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47700a9880 con 0x5596449fe350 2024-09-10T05:36:36.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.519+0000 7f4789d399c0 1 -- 172.21.15.62:0/2722820593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596449fe350 msgr2=0x559644a00740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.519+0000 7f4789d399c0 1 --2- 172.21.15.62:0/2722820593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596449fe350 0x559644a00740 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f477000a5c0 tx=0x7f477001b3d0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.519+0000 7f4789d399c0 1 -- 172.21.15.62:0/2722820593 shutdown_connections 2024-09-10T05:36:36.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.519+0000 7f4789d399c0 1 --2- 172.21.15.62:0/2722820593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596449fe350 0x559644a00740 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.519+0000 7f4789d399c0 1 -- 172.21.15.62:0/2722820593 >> 172.21.15.62:0/2722820593 conn(0x55964496db10 msgr2=0x55964496df20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:36.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.523+0000 7f4789d399c0 1 -- 172.21.15.62:0/2722820593 shutdown_connections 2024-09-10T05:36:36.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.523+0000 7f4789d399c0 1 -- 172.21.15.62:0/2722820593 wait complete. 2024-09-10T05:36:36.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.535+0000 7f4789d399c0 1 Processor -- start 2024-09-10T05:36:36.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.535+0000 7f4789d399c0 1 -- start start 2024-09-10T05:36:36.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.535+0000 7f4789d399c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596449fa200 0x559644ae58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.535+0000 7f4789d399c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559644900680 con 0x5596449fa200 2024-09-10T05:36:36.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.539+0000 7f478783f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596449fa200 0x559644ae58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.539+0000 7f478783f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596449fa200 0x559644ae58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47254/0 (socket says 172.21.15.62:47254) 2024-09-10T05:36:36.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.539+0000 7f478783f640 1 -- 172.21.15.62:0/1878107437 learned_addr learned my addr 172.21.15.62:0/1878107437 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:36.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.539+0000 7f478783f640 1 -- 172.21.15.62:0/1878107437 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55964487bda0 con 0x5596449fa200 2024-09-10T05:36:36.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.539+0000 7f478783f640 1 --2- 172.21.15.62:0/1878107437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596449fa200 0x559644ae58d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f4780001680 tx=0x7f4780001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=613e979ca3ae94bb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.539+0000 7f4675e0b640 1 -- 172.21.15.62:0/1878107437 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4780013420 con 0x5596449fa200 2024-09-10T05:36:36.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.539+0000 7f4675e0b640 1 -- 172.21.15.62:0/1878107437 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47800135c0 con 0x5596449fa200 2024-09-10T05:36:36.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.539+0000 7f4675e0b640 1 -- 172.21.15.62:0/1878107437 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47800138e0 con 0x5596449fa200 2024-09-10T05:36:36.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.539+0000 7f4789d399c0 1 -- 172.21.15.62:0/1878107437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596449fa200 msgr2=0x559644ae58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.539+0000 7f4789d399c0 1 --2- 172.21.15.62:0/1878107437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596449fa200 0x559644ae58d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f4780001680 tx=0x7f4780001b40 comp rx=0 tx=0).stop 2024-09-10T05:36:36.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.539+0000 7f4789d399c0 1 -- 172.21.15.62:0/1878107437 shutdown_connections 2024-09-10T05:36:36.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.539+0000 7f4789d399c0 1 --2- 172.21.15.62:0/1878107437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596449fa200 0x559644ae58d0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.539+0000 7f4789d399c0 1 -- 172.21.15.62:0/1878107437 >> 172.21.15.62:0/1878107437 conn(0x55964496db10 msgr2=0x559644ae1510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:36.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.539+0000 7f4789d399c0 1 -- 172.21.15.62:0/1878107437 shutdown_connections 2024-09-10T05:36:36.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.539+0000 7f4789d399c0 1 -- 172.21.15.62:0/1878107437 wait complete. 2024-09-10T05:36:36.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.539+0000 7f4789d399c0 1 Processor -- start 2024-09-10T05:36:36.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.539+0000 7f4789d399c0 1 -- start start 2024-09-10T05:36:36.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.539+0000 7f4789d399c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596449fa200 0x559644aecfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.539+0000 7f4789d399c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5596448a2a50 con 0x5596449fa200 2024-09-10T05:36:36.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.539+0000 7f478783f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596449fa200 0x559644aecfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.539+0000 7f478783f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596449fa200 0x559644aecfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47266/0 (socket says 172.21.15.62:47266) 2024-09-10T05:36:36.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.539+0000 7f478783f640 1 -- 172.21.15.62:0/1063476528 learned_addr learned my addr 172.21.15.62:0/1063476528 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:36.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.543+0000 7f478783f640 1 -- 172.21.15.62:0/1063476528 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559644aed520 con 0x5596449fa200 2024-09-10T05:36:36.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.543+0000 7f478783f640 1 --2- 172.21.15.62:0/1063476528 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596449fa200 0x559644aecfc0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f4780001b80 tx=0x7f4780000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.543+0000 7f466ffff640 1 -- 172.21.15.62:0/1063476528 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4780013630 con 0x5596449fa200 2024-09-10T05:36:36.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.543+0000 7f466ffff640 1 -- 172.21.15.62:0/1063476528 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4780023070 con 0x5596449fa200 2024-09-10T05:36:36.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.543+0000 7f4789d399c0 1 -- 172.21.15.62:0/1063476528 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559644aed7b0 con 0x5596449fa200 2024-09-10T05:36:36.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.543+0000 7f466ffff640 1 -- 172.21.15.62:0/1063476528 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4780013920 con 0x5596449fa200 2024-09-10T05:36:36.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.543+0000 7f4789d399c0 1 -- 172.21.15.62:0/1063476528 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559644aee160 con 0x5596449fa200 2024-09-10T05:36:36.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.543+0000 7f466ffff640 1 -- 172.21.15.62:0/1063476528 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f4780010070 con 0x5596449fa200 2024-09-10T05:36:36.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.543+0000 7f466ffff640 1 --2- 172.21.15.62:0/1063476528 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4670039ac0 0x7f467003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.543+0000 7f466ffff640 1 -- 172.21.15.62:0/1063476528 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f478004fef0 con 0x5596449fa200 2024-09-10T05:36:36.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.543+0000 7f478703e640 1 --2- 172.21.15.62:0/1063476528 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4670039ac0 0x7f467003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.543+0000 7f4789d399c0 1 --2- 172.21.15.62:0/1063476528 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5596449fe350 0x559644af4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.543+0000 7f4789d399c0 1 -- 172.21.15.62:0/1063476528 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559644af4670 con 0x5596449fe350 2024-09-10T05:36:36.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.543+0000 7f4788040640 1 --2- 172.21.15.62:0/1063476528 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5596449fe350 0x559644af4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.543+0000 7f478703e640 1 --2- 172.21.15.62:0/1063476528 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4670039ac0 0x7f467003bf80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f47700ad000 tx=0x7f47700a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.543+0000 7f4788040640 1 --2- 172.21.15.62:0/1063476528 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5596449fe350 0x559644af4130 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.543+0000 7f4788040640 1 -- 172.21.15.62:0/1063476528 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f47780083f0 con 0x5596449fe350 2024-09-10T05:36:36.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.543+0000 7f4789d399c0 1 --2- 172.21.15.62:0/1063476528 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x559644af5420 0x559644af7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.543+0000 7f4789d399c0 1 -- 172.21.15.62:0/1063476528 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559644af7e20 con 0x559644af5420 2024-09-10T05:36:36.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.547+0000 7f478783f640 1 --2- 172.21.15.62:0/1063476528 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x559644af5420 0x559644af7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.547+0000 7f478783f640 1 --2- 172.21.15.62:0/1063476528 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x559644af5420 0x559644af7810 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.547+0000 7f478783f640 1 -- 172.21.15.62:0/1063476528 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f478000f030 con 0x559644af5420 2024-09-10T05:36:36.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.547+0000 7f4789d399c0 1 --2- 172.21.15.62:0/1063476528 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x559644af9be0 0x559644afbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.547+0000 7f4789d399c0 1 -- 172.21.15.62:0/1063476528 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559644afc6c0 con 0x559644af9be0 2024-09-10T05:36:36.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.547+0000 7f478703e640 1 --2- 172.21.15.62:0/1063476528 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x559644af9be0 0x559644afbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.547+0000 7f478703e640 1 --2- 172.21.15.62:0/1063476528 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x559644af9be0 0x559644afbfd0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.547+0000 7f478703e640 1 -- 172.21.15.62:0/1063476528 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f47700a9ad0 con 0x559644af9be0 2024-09-10T05:36:36.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.547+0000 7f4789d399c0 1 -- 172.21.15.62:0/1063476528 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559644af8ab0 con 0x559644af5420 2024-09-10T05:36:36.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.547+0000 7f478783f640 1 -- 172.21.15.62:0/1063476528 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f478000f030 con 0x559644af5420 2024-09-10T05:36:36.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.547+0000 7f4789d399c0 1 -- 172.21.15.62:0/1063476528 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559644af8ed0 con 0x559644af9be0 2024-09-10T05:36:36.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.547+0000 7f478703e640 1 -- 172.21.15.62:0/1063476528 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f47700a9ad0 con 0x559644af9be0 2024-09-10T05:36:36.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.547+0000 7f4789d399c0 1 Processor -- start 2024-09-10T05:36:36.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.547+0000 7f4789d399c0 1 -- start start 2024-09-10T05:36:36.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.551+0000 7f4789d399c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559644b0ac90 0x559644b0b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.551+0000 7f4789d399c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55964490d450 con 0x559644b0ac90 2024-09-10T05:36:36.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.551+0000 7f478783f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559644b0ac90 0x559644b0b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.551+0000 7f478783f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559644b0ac90 0x559644b0b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47276/0 (socket says 172.21.15.62:47276) 2024-09-10T05:36:36.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.551+0000 7f478783f640 1 -- 172.21.15.62:0/1457372611 learned_addr learned my addr 172.21.15.62:0/1457372611 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:36.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.551+0000 7f478783f640 1 -- 172.21.15.62:0/1457372611 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559644b0b6f0 con 0x559644b0ac90 2024-09-10T05:36:36.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.551+0000 7f478783f640 1 --2- 172.21.15.62:0/1457372611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559644b0ac90 0x559644b0b0b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f478004e4f0 tx=0x7f4780011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.551+0000 7f466d7fa640 1 -- 172.21.15.62:0/1457372611 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4780047360 con 0x559644b0ac90 2024-09-10T05:36:36.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.551+0000 7f4789d399c0 1 -- 172.21.15.62:0/1457372611 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559644b0bf50 con 0x559644b0ac90 2024-09-10T05:36:36.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.551+0000 7f466d7fa640 1 -- 172.21.15.62:0/1457372611 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4780019040 con 0x559644b0ac90 2024-09-10T05:36:36.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.551+0000 7f466d7fa640 1 -- 172.21.15.62:0/1457372611 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4780047650 con 0x559644b0ac90 2024-09-10T05:36:36.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.551+0000 7f4789d399c0 1 -- 172.21.15.62:0/1457372611 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559644b0c4c0 con 0x559644b0ac90 2024-09-10T05:36:36.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.551+0000 7f466d7fa640 1 -- 172.21.15.62:0/1457372611 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f4780041250 con 0x559644b0ac90 2024-09-10T05:36:36.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.551+0000 7f466d7fa640 1 --2- 172.21.15.62:0/1457372611 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4660039a70 0x7f466003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.551+0000 7f466d7fa640 1 -- 172.21.15.62:0/1457372611 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f478004d430 con 0x559644b0ac90 2024-09-10T05:36:36.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.551+0000 7f478703e640 1 --2- 172.21.15.62:0/1457372611 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4660039a70 0x7f466003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.551+0000 7f4789d399c0 1 Processor -- start 2024-09-10T05:36:36.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.551+0000 7f4789d399c0 1 -- start start 2024-09-10T05:36:36.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.551+0000 7f4789d399c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559644b17390 0x559644b17770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.551+0000 7f4789d399c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559644ae6120 con 0x559644b17390 2024-09-10T05:36:36.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.551+0000 7f478703e640 1 --2- 172.21.15.62:0/1457372611 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4660039a70 0x7f466003bf30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x559644aee410 tx=0x7f4770005ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.555+0000 7f478783f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559644b17390 0x559644b17770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.555+0000 7f478783f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559644b17390 0x559644b17770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47278/0 (socket says 172.21.15.62:47278) 2024-09-10T05:36:36.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.555+0000 7f478783f640 1 -- 172.21.15.62:0/7805182 learned_addr learned my addr 172.21.15.62:0/7805182 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:36.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.555+0000 7f478783f640 1 -- 172.21.15.62:0/7805182 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559644b17d40 con 0x559644b17390 2024-09-10T05:36:36.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.555+0000 7f478783f640 1 --2- 172.21.15.62:0/7805182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559644b17390 0x559644b17770 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f4780004f60 tx=0x7f478003b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5c4e1ad2a6880d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.555+0000 7f4666ffd640 1 -- 172.21.15.62:0/7805182 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4780063070 con 0x559644b17390 2024-09-10T05:36:36.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.555+0000 7f4666ffd640 1 -- 172.21.15.62:0/7805182 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f478001d780 con 0x559644b17390 2024-09-10T05:36:36.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.555+0000 7f4666ffd640 1 -- 172.21.15.62:0/7805182 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4780040040 con 0x559644b17390 2024-09-10T05:36:36.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.555+0000 7f4789d399c0 1 -- 172.21.15.62:0/7805182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559644b17390 msgr2=0x559644b17770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.555+0000 7f4789d399c0 1 --2- 172.21.15.62:0/7805182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559644b17390 0x559644b17770 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f4780004f60 tx=0x7f478003b940 comp rx=0 tx=0).stop 2024-09-10T05:36:36.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.555+0000 7f4789d399c0 1 -- 172.21.15.62:0/7805182 shutdown_connections 2024-09-10T05:36:36.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.555+0000 7f4789d399c0 1 --2- 172.21.15.62:0/7805182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559644b17390 0x559644b17770 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.555+0000 7f4789d399c0 1 -- 172.21.15.62:0/7805182 >> 172.21.15.62:0/7805182 conn(0x559644b137c0 msgr2=0x559644b11a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:36.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.555+0000 7f4789d399c0 1 -- 172.21.15.62:0/7805182 shutdown_connections 2024-09-10T05:36:36.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.555+0000 7f4789d399c0 1 -- 172.21.15.62:0/7805182 wait complete. 2024-09-10T05:36:36.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.555+0000 7f4789d399c0 1 Processor -- start 2024-09-10T05:36:36.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.555+0000 7f4789d399c0 1 -- start start 2024-09-10T05:36:36.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.555+0000 7f4789d399c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559644b17390 0x559644b1e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.555+0000 7f4789d399c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559644b18220 con 0x559644b17390 2024-09-10T05:36:36.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.555+0000 7f478783f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559644b17390 0x559644b1e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.555+0000 7f478783f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559644b17390 0x559644b1e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47292/0 (socket says 172.21.15.62:47292) 2024-09-10T05:36:36.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.555+0000 7f478783f640 1 -- 172.21.15.62:0/3325786944 learned_addr learned my addr 172.21.15.62:0/3325786944 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:36.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.555+0000 7f478783f640 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559644b1ebf0 con 0x559644b17390 2024-09-10T05:36:36.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.555+0000 7f478783f640 1 --2- 172.21.15.62:0/3325786944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559644b17390 0x559644b1e690 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f478004b980 tx=0x7f478002eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.559+0000 7f46657fa640 1 -- 172.21.15.62:0/3325786944 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f478006b070 con 0x559644b17390 2024-09-10T05:36:36.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.559+0000 7f46657fa640 1 -- 172.21.15.62:0/3325786944 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f478001dca0 con 0x559644b17390 2024-09-10T05:36:36.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.559+0000 7f4789d399c0 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559644b1ebf0 con 0x559644b17390 2024-09-10T05:36:36.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.559+0000 7f46657fa640 1 -- 172.21.15.62:0/3325786944 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4780063040 con 0x559644b17390 2024-09-10T05:36:36.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.559+0000 7f4789d399c0 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559644b1ebf0 con 0x559644b17390 2024-09-10T05:36:36.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.559+0000 7f4789d399c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.559+0000 7f46657fa640 1 -- 172.21.15.62:0/3325786944 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f478006e070 con 0x559644b17390 2024-09-10T05:36:36.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.559+0000 7f46657fa640 1 --2- 172.21.15.62:0/3325786944 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4650039a70 0x7f465003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.559+0000 7f46657fa640 1 -- 172.21.15.62:0/3325786944 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f478005b070 con 0x559644b17390 2024-09-10T05:36:36.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.559+0000 7f478703e640 1 --2- 172.21.15.62:0/3325786944 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4650039a70 0x7f465003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.559+0000 7f4789d399c0 1 --2- 172.21.15.62:0/3325786944 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x559644b295d0 0x559644b2ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.559+0000 7f4789d399c0 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559644b2c1b0 con 0x559644b295d0 2024-09-10T05:36:36.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.559+0000 7f4788040640 1 --2- 172.21.15.62:0/3325786944 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x559644b295d0 0x559644b2ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.559+0000 7f478703e640 1 --2- 172.21.15.62:0/3325786944 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4650039a70 0x7f465003bf30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f47700a9fd0 tx=0x7f47700c1040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.559+0000 7f4788040640 1 --2- 172.21.15.62:0/3325786944 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x559644b295d0 0x559644b2ba60 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.559+0000 7f4788040640 1 -- 172.21.15.62:0/3325786944 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f47780083f0 con 0x559644b295d0 2024-09-10T05:36:36.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.559+0000 7f4789d399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:36.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.559+0000 7f4789d399c0 20 realm 2024-09-10T05:36:36.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.559+0000 7f4789d399c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.559+0000 7f4789d399c0 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559644b28a10 con 0x559644b295d0 2024-09-10T05:36:36.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.559+0000 7f4788040640 1 -- 172.21.15.62:0/3325786944 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f47780083f0 con 0x559644b295d0 2024-09-10T05:36:36.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.559+0000 7f4789d399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:36.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.559+0000 7f4789d399c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:36.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.559+0000 7f4789d399c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.559+0000 7f4789d399c0 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559644b2ccc0 con 0x559644b295d0 2024-09-10T05:36:36.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.559+0000 7f4788040640 1 -- 172.21.15.62:0/3325786944 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f47780083f0 con 0x559644b295d0 2024-09-10T05:36:36.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.559+0000 7f4789d399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:36.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.559+0000 7f4789d399c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.559+0000 7f4789d399c0 1 --2- 172.21.15.62:0/3325786944 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x559644b2daa0 0x559644b2fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.559+0000 7f4789d399c0 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559644b30520 con 0x559644b2daa0 2024-09-10T05:36:36.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.559+0000 7f478783f640 1 --2- 172.21.15.62:0/3325786944 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x559644b2daa0 0x559644b2fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.563+0000 7f478783f640 1 --2- 172.21.15.62:0/3325786944 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x559644b2daa0 0x559644b2fe90 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.563+0000 7f478783f640 1 -- 172.21.15.62:0/3325786944 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4780077070 con 0x559644b2daa0 2024-09-10T05:36:36.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.563+0000 7f4789d399c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:36.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.563+0000 7f4789d399c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.563+0000 7f4789d399c0 1 --2- 172.21.15.62:0/3325786944 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x559644b312d0 0x559644b336c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.563+0000 7f4789d399c0 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559644b33d60 con 0x559644b312d0 2024-09-10T05:36:36.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.563+0000 7f478703e640 1 --2- 172.21.15.62:0/3325786944 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x559644b312d0 0x559644b336c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.563+0000 7f478703e640 1 --2- 172.21.15.62:0/3325786944 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x559644b312d0 0x559644b336c0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.563+0000 7f478703e640 1 -- 172.21.15.62:0/3325786944 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f47700a9ad0 con 0x559644b312d0 2024-09-10T05:36:36.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.563+0000 7f4789d399c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:36.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.563+0000 7f4789d399c0 20 searching for the correct realm 2024-09-10T05:36:36.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.563+0000 7f4789d399c0 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559644b35630 con 0x559644b312d0 2024-09-10T05:36:36.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.563+0000 7f478703e640 1 -- 172.21.15.62:0/3325786944 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47700a9ad0 con 0x559644b312d0 2024-09-10T05:36:36.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.563+0000 7f478703e640 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559644b35630 con 0x559644b2daa0 2024-09-10T05:36:36.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.563+0000 7f478783f640 1 -- 172.21.15.62:0/3325786944 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4780077070 con 0x559644b2daa0 2024-09-10T05:36:36.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.563+0000 7f478783f640 1 --2- 172.21.15.62:0/3325786944 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f4780070070 0x7f4780010520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.563+0000 7f478783f640 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559644b35630 con 0x7f4780070070 2024-09-10T05:36:36.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.563+0000 7f4788040640 1 --2- 172.21.15.62:0/3325786944 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f4780070070 0x7f4780010520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.567+0000 7f4788040640 1 --2- 172.21.15.62:0/3325786944 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f4780070070 0x7f4780010520 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.567+0000 7f4788040640 1 -- 172.21.15.62:0/3325786944 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47780083f0 con 0x7f4780070070 2024-09-10T05:36:36.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.567+0000 7f4788040640 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559644b35630 con 0x559644b295d0 2024-09-10T05:36:36.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.567+0000 7f4788040640 1 -- 172.21.15.62:0/3325786944 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47780083f0 con 0x559644b295d0 2024-09-10T05:36:36.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.567+0000 7f4788040640 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559644b35630 con 0x559644b295d0 2024-09-10T05:36:36.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.567+0000 7f4788040640 1 -- 172.21.15.62:0/3325786944 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47780083f0 con 0x559644b295d0 2024-09-10T05:36:36.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.567+0000 7f4788040640 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559644b35630 con 0x559644b312d0 2024-09-10T05:36:36.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.567+0000 7f478703e640 1 -- 172.21.15.62:0/3325786944 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47700a9ad0 con 0x559644b312d0 2024-09-10T05:36:36.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.567+0000 7f478703e640 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559644b35630 con 0x559644b295d0 2024-09-10T05:36:36.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.567+0000 7f4788040640 1 -- 172.21.15.62:0/3325786944 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47780083f0 con 0x559644b295d0 2024-09-10T05:36:36.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.567+0000 7f4788040640 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559644b35630 con 0x559644b2daa0 2024-09-10T05:36:36.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.567+0000 7f478783f640 1 -- 172.21.15.62:0/3325786944 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4780077070 con 0x559644b2daa0 2024-09-10T05:36:36.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.567+0000 7f478783f640 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559644b35630 con 0x559644b2daa0 2024-09-10T05:36:36.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.567+0000 7f478783f640 1 -- 172.21.15.62:0/3325786944 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4780077070 con 0x559644b2daa0 2024-09-10T05:36:36.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.567+0000 7f478783f640 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559644b35630 con 0x559644b295d0 2024-09-10T05:36:36.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.567+0000 7f4788040640 1 -- 172.21.15.62:0/3325786944 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47780083f0 con 0x559644b295d0 2024-09-10T05:36:36.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.567+0000 7f4788040640 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559644b35630 con 0x7f4780070070 2024-09-10T05:36:36.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.567+0000 7f4788040640 1 -- 172.21.15.62:0/3325786944 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47780083f0 con 0x7f4780070070 2024-09-10T05:36:36.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.567+0000 7f4788040640 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559644b35630 con 0x559644b295d0 2024-09-10T05:36:36.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.567+0000 7f4788040640 1 -- 172.21.15.62:0/3325786944 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47780083f0 con 0x559644b295d0 2024-09-10T05:36:36.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.567+0000 7f4788040640 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559644b35630 con 0x7f4780070070 2024-09-10T05:36:36.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.571+0000 7f4788040640 1 -- 172.21.15.62:0/3325786944 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f47780083f0 con 0x7f4780070070 2024-09-10T05:36:36.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.571+0000 7f4788040640 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559644b35630 con 0x559644b2daa0 2024-09-10T05:36:36.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.571+0000 7f478783f640 1 -- 172.21.15.62:0/3325786944 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4780077070 con 0x559644b2daa0 2024-09-10T05:36:36.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.571+0000 7f478783f640 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559644b35630 con 0x559644b312d0 2024-09-10T05:36:36.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.571+0000 7f478703e640 1 -- 172.21.15.62:0/3325786944 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47700a9ad0 con 0x559644b312d0 2024-09-10T05:36:36.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.571+0000 7f478703e640 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559644b35630 con 0x559644b295d0 2024-09-10T05:36:36.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.571+0000 7f4788040640 1 -- 172.21.15.62:0/3325786944 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47780083f0 con 0x559644b295d0 2024-09-10T05:36:36.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.571+0000 7f4788040640 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559644b35630 con 0x559644b2daa0 2024-09-10T05:36:36.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.571+0000 7f478783f640 1 -- 172.21.15.62:0/3325786944 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4780077070 con 0x559644b2daa0 2024-09-10T05:36:36.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.571+0000 7f478783f640 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559644b35630 con 0x559644b312d0 2024-09-10T05:36:36.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.571+0000 7f478703e640 1 -- 172.21.15.62:0/3325786944 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 30 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f47700a9ad0 con 0x559644b312d0 2024-09-10T05:36:36.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.571+0000 7f478703e640 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559644b35630 con 0x559644b295d0 2024-09-10T05:36:36.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.571+0000 7f4788040640 1 -- 172.21.15.62:0/3325786944 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47780083f0 con 0x559644b295d0 2024-09-10T05:36:36.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.571+0000 7f4788040640 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559644b35630 con 0x559644b295d0 2024-09-10T05:36:36.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.571+0000 7f4788040640 1 -- 172.21.15.62:0/3325786944 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f47780083f0 con 0x559644b295d0 2024-09-10T05:36:36.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.571+0000 7f4788040640 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559644b35630 con 0x559644b295d0 2024-09-10T05:36:36.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.571+0000 7f4788040640 1 -- 172.21.15.62:0/3325786944 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47780083f0 con 0x559644b295d0 2024-09-10T05:36:36.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.571+0000 7f4788040640 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559644b35630 con 0x559644b312d0 2024-09-10T05:36:36.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.571+0000 7f478703e640 1 -- 172.21.15.62:0/3325786944 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47700a9ad0 con 0x559644b312d0 2024-09-10T05:36:36.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.571+0000 7f478703e640 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559644b35630 con 0x7f4780070070 2024-09-10T05:36:36.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.575+0000 7f4788040640 1 -- 172.21.15.62:0/3325786944 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47780083f0 con 0x7f4780070070 2024-09-10T05:36:36.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.575+0000 7f4788040640 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559644b35630 con 0x559644b295d0 2024-09-10T05:36:36.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.575+0000 7f4788040640 1 -- 172.21.15.62:0/3325786944 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47780083f0 con 0x559644b295d0 2024-09-10T05:36:36.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.575+0000 7f4788040640 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559644b35630 con 0x7f4780070070 2024-09-10T05:36:36.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.575+0000 7f4788040640 1 -- 172.21.15.62:0/3325786944 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47780083f0 con 0x7f4780070070 2024-09-10T05:36:36.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.575+0000 7f4788040640 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559644b35630 con 0x559644b312d0 2024-09-10T05:36:36.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.575+0000 7f478703e640 1 -- 172.21.15.62:0/3325786944 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47700a9ad0 con 0x559644b312d0 2024-09-10T05:36:36.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.575+0000 7f478703e640 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559644b35630 con 0x7f4780070070 2024-09-10T05:36:36.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.575+0000 7f4788040640 1 -- 172.21.15.62:0/3325786944 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47780083f0 con 0x7f4780070070 2024-09-10T05:36:36.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.575+0000 7f4788040640 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559644b35630 con 0x559644b2daa0 2024-09-10T05:36:36.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.575+0000 7f478783f640 1 -- 172.21.15.62:0/3325786944 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4780077070 con 0x559644b2daa0 2024-09-10T05:36:36.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.575+0000 7f478783f640 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559644b35630 con 0x559644b2daa0 2024-09-10T05:36:36.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.575+0000 7f478783f640 1 -- 172.21.15.62:0/3325786944 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4780077070 con 0x559644b2daa0 2024-09-10T05:36:36.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.575+0000 7f478783f640 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559644b35630 con 0x559644b312d0 2024-09-10T05:36:36.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.575+0000 7f478703e640 1 -- 172.21.15.62:0/3325786944 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47700a9ad0 con 0x559644b312d0 2024-09-10T05:36:36.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.575+0000 7f478703e640 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559644b35630 con 0x559644b2daa0 2024-09-10T05:36:36.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.579+0000 7f478783f640 1 -- 172.21.15.62:0/3325786944 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4780077070 con 0x559644b2daa0 2024-09-10T05:36:36.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.579+0000 7f478783f640 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559644b35630 con 0x559644b2daa0 2024-09-10T05:36:36.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.579+0000 7f478783f640 1 -- 172.21.15.62:0/3325786944 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4780077070 con 0x559644b2daa0 2024-09-10T05:36:36.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.579+0000 7f4789d399c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:36.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.579+0000 7f4789d399c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:36.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.579+0000 7f4789d399c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:36.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.579+0000 7f4789d399c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:36.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.579+0000 7f4789d399c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:36.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.579+0000 7f4789d399c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:36.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.579+0000 7f4789d399c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.579+0000 7f4789d399c0 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559644b34720 con 0x559644b295d0 2024-09-10T05:36:36.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.579+0000 7f4788040640 1 -- 172.21.15.62:0/3325786944 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f47780083f0 con 0x559644b295d0 2024-09-10T05:36:36.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.579+0000 7f4789d399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:36.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.579+0000 7f4789d399c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.579+0000 7f4789d399c0 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559644b34b40 con 0x559644b2daa0 2024-09-10T05:36:36.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.579+0000 7f478783f640 1 -- 172.21.15.62:0/3325786944 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4780077070 con 0x559644b2daa0 2024-09-10T05:36:36.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.579+0000 7f4789d399c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:36.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.579+0000 7f4789d399c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.579+0000 7f4789d399c0 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559644b34b40 con 0x559644b312d0 2024-09-10T05:36:36.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.579+0000 7f478703e640 1 -- 172.21.15.62:0/3325786944 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f47700a9ad0 con 0x559644b312d0 2024-09-10T05:36:36.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.579+0000 7f4789d399c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:36.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.579+0000 7f4789d399c0 20 zone default found 2024-09-10T05:36:36.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.579+0000 7f4789d399c0 4 Realm: () 2024-09-10T05:36:36.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.579+0000 7f4789d399c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:36.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.579+0000 7f4789d399c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:36.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.579+0000 7f4789d399c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:36.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.579+0000 7f4789d399c0 20 zonegroup default 2024-09-10T05:36:36.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.579+0000 7f4789d399c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.579+0000 7f4789d399c0 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559644b35ae0 con 0x7f4780070070 2024-09-10T05:36:36.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.579+0000 7f4788040640 1 -- 172.21.15.62:0/3325786944 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f47780083f0 con 0x7f4780070070 2024-09-10T05:36:36.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.579+0000 7f4789d399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:36.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.579+0000 7f4789d399c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.579+0000 7f4789d399c0 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559644b37970 con 0x559644b312d0 2024-09-10T05:36:36.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.579+0000 7f478703e640 1 -- 172.21.15.62:0/3325786944 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f47700a9ad0 con 0x559644b312d0 2024-09-10T05:36:36.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.579+0000 7f4789d399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:36.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.579+0000 7f4789d399c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.579+0000 7f4789d399c0 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559644b37db0 con 0x559644b312d0 2024-09-10T05:36:36.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.579+0000 7f478703e640 1 -- 172.21.15.62:0/3325786944 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f47700a9ad0 con 0x559644b312d0 2024-09-10T05:36:36.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.579+0000 7f4789d399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:36.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.579+0000 7f4789d399c0 20 started sync module instance, tier type = 2024-09-10T05:36:36.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.579+0000 7f4789d399c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:36.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.579+0000 7f4789d399c0 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559644b36d10 con 0x559644b2daa0 2024-09-10T05:36:36.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.583+0000 7f478783f640 1 -- 172.21.15.62:0/3325786944 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4780077070 con 0x559644b2daa0 2024-09-10T05:36:36.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.583+0000 7f4789d399c0 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94103886066192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559644b36d10 con 0x559644b2daa0 2024-09-10T05:36:36.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.583+0000 7f4789d399c0 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559644b38870 con 0x559644b295d0 2024-09-10T05:36:36.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.583+0000 7f4788040640 1 -- 172.21.15.62:0/3325786944 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47780083f0 con 0x559644b295d0 2024-09-10T05:36:36.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.583+0000 7f4789d399c0 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94103886070656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559644b39110 con 0x559644b295d0 2024-09-10T05:36:36.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.583+0000 7f4789d399c0 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559644b39b50 con 0x559644b2daa0 2024-09-10T05:36:36.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.583+0000 7f478783f640 1 -- 172.21.15.62:0/3325786944 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94103886066192] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4780077070 con 0x559644b2daa0 2024-09-10T05:36:36.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.587+0000 7f4788040640 1 -- 172.21.15.62:0/3325786944 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94103886070656] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47780083f0 con 0x559644b295d0 2024-09-10T05:36:36.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.587+0000 7f478783f640 1 -- 172.21.15.62:0/3325786944 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4780077070 con 0x559644b2daa0 2024-09-10T05:36:36.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.587+0000 7f4789d399c0 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94103886075424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559644b38c60 con 0x559644b2daa0 2024-09-10T05:36:36.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.587+0000 7f4789d399c0 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559644b3a3f0 con 0x7f4780070070 2024-09-10T05:36:36.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.587+0000 7f4788040640 1 -- 172.21.15.62:0/3325786944 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47780083f0 con 0x7f4780070070 2024-09-10T05:36:36.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.587+0000 7f4789d399c0 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94103886077760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559644b38c60 con 0x7f4780070070 2024-09-10T05:36:36.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.587+0000 7f4789d399c0 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559644b3aeb0 con 0x559644b2daa0 2024-09-10T05:36:36.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.587+0000 7f478783f640 1 -- 172.21.15.62:0/3325786944 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94103886075424] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4780077070 con 0x559644b2daa0 2024-09-10T05:36:36.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.587+0000 7f4788040640 1 -- 172.21.15.62:0/3325786944 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94103886077760] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47780083f0 con 0x7f4780070070 2024-09-10T05:36:36.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.591+0000 7f478783f640 1 -- 172.21.15.62:0/3325786944 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4780077070 con 0x559644b2daa0 2024-09-10T05:36:36.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.591+0000 7f4789d399c0 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94103886078816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559644b3ae70 con 0x559644b2daa0 2024-09-10T05:36:36.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.591+0000 7f4789d399c0 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559644b3b2a0 con 0x559644b312d0 2024-09-10T05:36:36.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.591+0000 7f478703e640 1 -- 172.21.15.62:0/3325786944 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47700a9ad0 con 0x559644b312d0 2024-09-10T05:36:36.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.591+0000 7f4789d399c0 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94103886063712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559644b3b2a0 con 0x559644b312d0 2024-09-10T05:36:36.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.591+0000 7f4789d399c0 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559644b3c1a0 con 0x559644b312d0 2024-09-10T05:36:36.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.591+0000 7f478783f640 1 -- 172.21.15.62:0/3325786944 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94103886078816] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4780077070 con 0x559644b2daa0 2024-09-10T05:36:36.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.591+0000 7f478703e640 1 -- 172.21.15.62:0/3325786944 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(56 notify.6 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47700a9ad0 con 0x559644b312d0 2024-09-10T05:36:36.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.591+0000 7f4789d399c0 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94103886080384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559644b3c160 con 0x559644b312d0 2024-09-10T05:36:36.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.591+0000 7f4789d399c0 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559644b3cb60 con 0x7f4780070070 2024-09-10T05:36:36.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.591+0000 7f478703e640 1 -- 172.21.15.62:0/3325786944 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94103886063712] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47700a9ad0 con 0x559644b312d0 2024-09-10T05:36:36.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.595+0000 7f478703e640 1 -- 172.21.15.62:0/3325786944 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94103886080384] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47700a9ad0 con 0x559644b312d0 2024-09-10T05:36:36.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.595+0000 7f4788040640 1 -- 172.21.15.62:0/3325786944 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47780083f0 con 0x7f4780070070 2024-09-10T05:36:36.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.595+0000 7f4789d399c0 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94103886083728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559644b3bcb0 con 0x7f4780070070 2024-09-10T05:36:36.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.595+0000 7f4789d399c0 20 add_watcher() i=0 2024-09-10T05:36:36.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.595+0000 7f4789d399c0 20 add_watcher() i=1 2024-09-10T05:36:36.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.595+0000 7f4789d399c0 20 add_watcher() i=2 2024-09-10T05:36:36.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.595+0000 7f4789d399c0 20 add_watcher() i=3 2024-09-10T05:36:36.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.595+0000 7f4789d399c0 20 add_watcher() i=4 2024-09-10T05:36:36.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.595+0000 7f4789d399c0 20 add_watcher() i=5 2024-09-10T05:36:36.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.595+0000 7f4789d399c0 20 add_watcher() i=6 2024-09-10T05:36:36.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.595+0000 7f4788040640 1 -- 172.21.15.62:0/3325786944 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94103886083728] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47780083f0 con 0x7f4780070070 2024-09-10T05:36:36.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.595+0000 7f4789d399c0 20 add_watcher() i=7 2024-09-10T05:36:36.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.595+0000 7f4789d399c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:36.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.595+0000 7f4789d399c0 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559644b3bcb0 con 0x559644b295d0 2024-09-10T05:36:36.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.595+0000 7f4788040640 1 -- 172.21.15.62:0/3325786944 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f47780083f0 con 0x559644b295d0 2024-09-10T05:36:36.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.595+0000 7f4789d399c0 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94103886087792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559644b3bcb0 con 0x559644b295d0 2024-09-10T05:36:36.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.599+0000 7f4788040640 1 -- 172.21.15.62:0/3325786944 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94103886087792] v30'114 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f47780083f0 con 0x559644b295d0 2024-09-10T05:36:36.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.599+0000 7f463dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:36.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.599+0000 7f4789d399c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:36.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.599+0000 7f4789d399c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:36.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.599+0000 7f4789d399c0 5 note: GC not initialized 2024-09-10T05:36:36.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.599+0000 7f463cfe1640 20 reqs_thread_entry: start 2024-09-10T05:36:36.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.599+0000 7f4789d399c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:36.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.599+0000 7f4789d399c0 20 Filter name: none 2024-09-10T05:36:36.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.599+0000 7f45b67fc640 20 reqs_thread_entry: start 2024-09-10T05:36:36.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.599+0000 7f4789d399c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.599+0000 7f4789d399c0 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559644b627e0 con 0x7f4780070070 2024-09-10T05:36:36.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.599+0000 7f4788040640 1 -- 172.21.15.62:0/3325786944 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(62 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv18 ondisk = 0) ==== 275+0+304 (crc 0 0 0) 0x7f47780083f0 con 0x7f4780070070 2024-09-10T05:36:36.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.599+0000 7f4789d399c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T05:36:36.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.599+0000 7f463dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:36.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.599+0000 7f4789d399c0 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94103886087792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559644b606c0 con 0x559644b295d0 2024-09-10T05:36:36.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.603+0000 7f4788040640 1 -- 172.21.15.62:0/3325786944 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94103886087792] v30'115 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f47780083f0 con 0x559644b295d0 2024-09-10T05:36:36.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.603+0000 7f4789d399c0 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94103886066192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559644b606c0 con 0x559644b2daa0 2024-09-10T05:36:36.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.603+0000 7f478783f640 1 -- 172.21.15.62:0/3325786944 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94103886066192] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4780077070 con 0x559644b2daa0 2024-09-10T05:36:36.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.603+0000 7f4789d399c0 20 remove_watcher() i=0 2024-09-10T05:36:36.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.603+0000 7f4789d399c0 2 removed watcher, disabling cache 2024-09-10T05:36:36.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.603+0000 7f4789d399c0 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94103886070656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559644b606c0 con 0x559644b295d0 2024-09-10T05:36:36.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.607+0000 7f4788040640 1 -- 172.21.15.62:0/3325786944 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94103886070656] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47780083f0 con 0x559644b295d0 2024-09-10T05:36:36.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.607+0000 7f4789d399c0 20 remove_watcher() i=1 2024-09-10T05:36:36.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.607+0000 7f4789d399c0 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94103886075424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559644b606c0 con 0x559644b2daa0 2024-09-10T05:36:36.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.607+0000 7f478783f640 1 -- 172.21.15.62:0/3325786944 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94103886075424] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4780077070 con 0x559644b2daa0 2024-09-10T05:36:36.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.607+0000 7f4789d399c0 20 remove_watcher() i=2 2024-09-10T05:36:36.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.607+0000 7f4789d399c0 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94103886077760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559644b606c0 con 0x7f4780070070 2024-09-10T05:36:36.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.607+0000 7f4788040640 1 -- 172.21.15.62:0/3325786944 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94103886077760] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47780083f0 con 0x7f4780070070 2024-09-10T05:36:36.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.607+0000 7f4789d399c0 20 remove_watcher() i=3 2024-09-10T05:36:36.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.607+0000 7f4789d399c0 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94103886078816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559644b606c0 con 0x559644b2daa0 2024-09-10T05:36:36.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.611+0000 7f478783f640 1 -- 172.21.15.62:0/3325786944 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94103886078816] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4780077070 con 0x559644b2daa0 2024-09-10T05:36:36.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.611+0000 7f4789d399c0 20 remove_watcher() i=4 2024-09-10T05:36:36.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.611+0000 7f4789d399c0 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94103886063712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559644b606c0 con 0x559644b312d0 2024-09-10T05:36:36.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.611+0000 7f478703e640 1 -- 172.21.15.62:0/3325786944 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94103886063712] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47700a9ad0 con 0x559644b312d0 2024-09-10T05:36:36.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.611+0000 7f4789d399c0 20 remove_watcher() i=5 2024-09-10T05:36:36.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.611+0000 7f4789d399c0 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94103886080384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559644b3a3c0 con 0x559644b312d0 2024-09-10T05:36:36.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.615+0000 7f478703e640 1 -- 172.21.15.62:0/3325786944 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94103886080384] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47700a9ad0 con 0x559644b312d0 2024-09-10T05:36:36.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.615+0000 7f4789d399c0 20 remove_watcher() i=6 2024-09-10T05:36:36.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.615+0000 7f4789d399c0 1 -- 172.21.15.62:0/3325786944 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94103886083728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559644b3a3a0 con 0x7f4780070070 2024-09-10T05:36:36.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.615+0000 7f4788040640 1 -- 172.21.15.62:0/3325786944 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94103886083728] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47780083f0 con 0x7f4780070070 2024-09-10T05:36:36.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.615+0000 7f4789d399c0 20 remove_watcher() i=7 2024-09-10T05:36:36.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.615+0000 7f4789d399c0 1 -- 172.21.15.62:0/3325786944 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x559644b2daa0 msgr2=0x559644b2fe90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.615+0000 7f4789d399c0 1 --2- 172.21.15.62:0/3325786944 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x559644b2daa0 0x559644b2fe90 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.615+0000 7f4789d399c0 1 -- 172.21.15.62:0/3325786944 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x559644b295d0 msgr2=0x559644b2ba60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.615+0000 7f4789d399c0 1 --2- 172.21.15.62:0/3325786944 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x559644b295d0 0x559644b2ba60 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.615+0000 7f4789d399c0 1 -- 172.21.15.62:0/3325786944 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f4780070070 msgr2=0x7f4780010520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.615+0000 7f4789d399c0 1 --2- 172.21.15.62:0/3325786944 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f4780070070 0x7f4780010520 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.615+0000 7f4789d399c0 1 -- 172.21.15.62:0/3325786944 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x559644b312d0 msgr2=0x559644b336c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.615+0000 7f4789d399c0 1 --2- 172.21.15.62:0/3325786944 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x559644b312d0 0x559644b336c0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.615+0000 7f4789d399c0 1 -- 172.21.15.62:0/3325786944 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4650039a70 msgr2=0x7f465003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.615+0000 7f4789d399c0 1 --2- 172.21.15.62:0/3325786944 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4650039a70 0x7f465003bf30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f47700a9fd0 tx=0x7f47700c1040 comp rx=0 tx=0).stop 2024-09-10T05:36:36.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.615+0000 7f4789d399c0 1 -- 172.21.15.62:0/3325786944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559644b17390 msgr2=0x559644b1e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.615+0000 7f4789d399c0 1 --2- 172.21.15.62:0/3325786944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559644b17390 0x559644b1e690 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f478004b980 tx=0x7f478002eee0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.615+0000 7f4788040640 1 -- 172.21.15.62:0/3325786944 reap_dead start 2024-09-10T05:36:36.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.615+0000 7f4788040640 1 -- 172.21.15.62:0/3325786944 reap_dead start 2024-09-10T05:36:36.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.615+0000 7f4789d399c0 1 -- 172.21.15.62:0/3325786944 shutdown_connections 2024-09-10T05:36:36.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.615+0000 7f4789d399c0 1 -- 172.21.15.62:0/3325786944 >> 172.21.15.62:0/3325786944 conn(0x559644b137c0 msgr2=0x559644b119d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:36.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.615+0000 7f4789d399c0 1 -- 172.21.15.62:0/3325786944 shutdown_connections 2024-09-10T05:36:36.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.615+0000 7f4789d399c0 1 -- 172.21.15.62:0/3325786944 wait complete. 2024-09-10T05:36:36.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.615+0000 7f4789d399c0 1 -- 172.21.15.62:0/1457372611 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4660039a70 msgr2=0x7f466003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.615+0000 7f4789d399c0 1 --2- 172.21.15.62:0/1457372611 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4660039a70 0x7f466003bf30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x559644aee410 tx=0x7f4770005ad0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.615+0000 7f4789d399c0 1 -- 172.21.15.62:0/1457372611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559644b0ac90 msgr2=0x559644b0b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.615+0000 7f4789d399c0 1 --2- 172.21.15.62:0/1457372611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559644b0ac90 0x559644b0b0b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f478004e4f0 tx=0x7f4780011b20 comp rx=0 tx=0).stop 2024-09-10T05:36:36.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.615+0000 7f4789d399c0 1 -- 172.21.15.62:0/1457372611 shutdown_connections 2024-09-10T05:36:36.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.615+0000 7f4789d399c0 1 --2- 172.21.15.62:0/1457372611 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4660039a70 0x7f466003bf30 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.615+0000 7f4789d399c0 1 --2- 172.21.15.62:0/1457372611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559644b0ac90 0x559644b0b0b0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.615+0000 7f4789d399c0 1 -- 172.21.15.62:0/1457372611 >> 172.21.15.62:0/1457372611 conn(0x559644b00640 msgr2=0x559644b00a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:36.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.615+0000 7f4789d399c0 1 -- 172.21.15.62:0/1457372611 shutdown_connections 2024-09-10T05:36:36.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.615+0000 7f4789d399c0 1 -- 172.21.15.62:0/1457372611 wait complete. 2024-09-10T05:36:36.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.615+0000 7f4789d399c0 1 -- 172.21.15.62:0/1063476528 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x559644af5420 msgr2=0x559644af7810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.615+0000 7f4789d399c0 1 --2- 172.21.15.62:0/1063476528 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x559644af5420 0x559644af7810 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.615+0000 7f4789d399c0 1 -- 172.21.15.62:0/1063476528 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5596449fe350 msgr2=0x559644af4130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.615+0000 7f4789d399c0 1 --2- 172.21.15.62:0/1063476528 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5596449fe350 0x559644af4130 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.615+0000 7f4789d399c0 1 -- 172.21.15.62:0/1063476528 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x559644af9be0 msgr2=0x559644afbfd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.615+0000 7f4789d399c0 1 --2- 172.21.15.62:0/1063476528 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x559644af9be0 0x559644afbfd0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.615+0000 7f4789d399c0 1 -- 172.21.15.62:0/1063476528 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4670039ac0 msgr2=0x7f467003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.615+0000 7f4789d399c0 1 --2- 172.21.15.62:0/1063476528 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4670039ac0 0x7f467003bf80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f47700ad000 tx=0x7f47700a6000 comp rx=0 tx=0).stop 2024-09-10T05:36:36.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.615+0000 7f4789d399c0 1 -- 172.21.15.62:0/1063476528 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596449fa200 msgr2=0x559644aecfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.615+0000 7f4789d399c0 1 --2- 172.21.15.62:0/1063476528 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596449fa200 0x559644aecfc0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f4780001b80 tx=0x7f4780000f50 comp rx=0 tx=0).stop 2024-09-10T05:36:36.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.615+0000 7f4788040640 1 -- 172.21.15.62:0/1063476528 reap_dead start 2024-09-10T05:36:36.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.615+0000 7f4789d399c0 1 -- 172.21.15.62:0/1063476528 shutdown_connections 2024-09-10T05:36:36.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.615+0000 7f4789d399c0 1 -- 172.21.15.62:0/1063476528 >> 172.21.15.62:0/1063476528 conn(0x55964496db10 msgr2=0x559644adffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:36.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.615+0000 7f4789d399c0 1 -- 172.21.15.62:0/1063476528 shutdown_connections 2024-09-10T05:36:36.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.615+0000 7f4789d399c0 1 -- 172.21.15.62:0/1063476528 wait complete. 2024-09-10T05:36:36.631 INFO:teuthology.orchestra.run.smithi062.stdout:{"key":"bucket:myfoo","ver":{"tag":"_5x-By9sg3zX82Qa4-aF1hTE","ver":2},"mtime":"2024-09-10T05:36:36.207651Z","data":{"bucket":{"name":"myfoo","marker":"475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1","bucket_id":"475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1","tenant":"","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"foo","creation_time":"2024-09-10T05:36:34.646920Z","linked":false,"has_bucket_info":false}} 2024-09-10T05:36:36.631 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_5x-By9sg3zX82Qa4-aF1hTE', 'ver': 2}, 'mtime': '2024-09-10T05:36:36.207651Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1', 'bucket_id': '475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2024-09-10T05:36:34.646920Z', 'linked': False, 'has_bucket_info': False}} 2024-09-10T05:36:36.632 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1'] 2024-09-10T05:36:36.632 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1'] 2024-09-10T05:36:36.632 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id 475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 2024-09-10T05:36:36.716 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:36.716 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:36.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.715+0000 7fd0ef70c9c0 1 Processor -- start 2024-09-10T05:36:36.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.715+0000 7fd0ef70c9c0 1 -- start start 2024-09-10T05:36:36.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.715+0000 7fd0ef70c9c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5594881f72d0 0x5594881f96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.715+0000 7fd0ef70c9c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5594880a59c0 con 0x5594881f3180 2024-09-10T05:36:36.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.715+0000 7fd0ef70c9c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x5594880f56d0 con 0x5594881f72d0 2024-09-10T05:36:36.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.715+0000 7fd0eca11640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5594881f72d0 0x5594881f96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.715+0000 7fd0eca11640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5594881f72d0 0x5594881f96c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47308/0 (socket says 172.21.15.62:47308) 2024-09-10T05:36:36.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.715+0000 7fd0eca11640 1 -- 172.21.15.62:0/2066508162 learned_addr learned my addr 172.21.15.62:0/2066508162 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:36.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.715+0000 7fd0ed212640 1 --1- 172.21.15.62:0/2066508162 >> v1:172.21.15.2:6789/0 conn(0x5594881f3180 0x5594881f3560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:53060/0 (socket says 172.21.15.62:53060) 2024-09-10T05:36:36.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.715+0000 7fd0eca11640 1 -- 172.21.15.62:0/2066508162 >> v1:172.21.15.2:6789/0 conn(0x5594881f3180 legacy=0x5594881f3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.715+0000 7fd0eca11640 1 -- 172.21.15.62:0/2066508162 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559488099ca0 con 0x5594881f72d0 2024-09-10T05:36:36.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.719+0000 7fd0eca11640 1 --2- 172.21.15.62:0/2066508162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594881f72d0 0x5594881f96c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd0d800a5c0 tx=0x7fd0d801b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e7d3e7de730f889 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.719+0000 7fd0e7fff640 1 -- 172.21.15.62:0/2066508162 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0d80a9590 con 0x5594881f72d0 2024-09-10T05:36:36.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.719+0000 7fd0e7fff640 1 -- 172.21.15.62:0/2066508162 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0d80ae070 con 0x5594881f72d0 2024-09-10T05:36:36.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.719+0000 7fd0e7fff640 1 -- 172.21.15.62:0/2066508162 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0d80a9880 con 0x5594881f72d0 2024-09-10T05:36:36.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.719+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2066508162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594881f72d0 msgr2=0x5594881f96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.719+0000 7fd0ef70c9c0 1 --2- 172.21.15.62:0/2066508162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594881f72d0 0x5594881f96c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd0d800a5c0 tx=0x7fd0d801b3d0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.719+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2066508162 shutdown_connections 2024-09-10T05:36:36.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.719+0000 7fd0ef70c9c0 1 --2- 172.21.15.62:0/2066508162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594881f72d0 0x5594881f96c0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.719+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2066508162 >> 172.21.15.62:0/2066508162 conn(0x559488166a90 msgr2=0x559488166ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:36.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.719+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2066508162 shutdown_connections 2024-09-10T05:36:36.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.719+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2066508162 wait complete. 2024-09-10T05:36:36.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.735+0000 7fd0ef70c9c0 1 Processor -- start 2024-09-10T05:36:36.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.735+0000 7fd0ef70c9c0 1 -- start start 2024-09-10T05:36:36.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.735+0000 7fd0ef70c9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594881f3180 0x5594882de970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.735+0000 7fd0ef70c9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5594880f9680 con 0x5594881f3180 2024-09-10T05:36:36.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.735+0000 7fd0ed212640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594881f3180 0x5594882de970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.735+0000 7fd0ed212640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594881f3180 0x5594882de970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47322/0 (socket says 172.21.15.62:47322) 2024-09-10T05:36:36.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.735+0000 7fd0ed212640 1 -- 172.21.15.62:0/499496296 learned_addr learned my addr 172.21.15.62:0/499496296 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:36.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.739+0000 7fd0ed212640 1 -- 172.21.15.62:0/499496296 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559488074da0 con 0x5594881f3180 2024-09-10T05:36:36.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.739+0000 7fd0ed212640 1 --2- 172.21.15.62:0/499496296 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594881f3180 0x5594882de970 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fd0e000b270 tx=0x7fd0e000b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4accbd24642baee server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.739+0000 7fcfdb606640 1 -- 172.21.15.62:0/499496296 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0e000e5d0 con 0x5594881f3180 2024-09-10T05:36:36.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.739+0000 7fcfdb606640 1 -- 172.21.15.62:0/499496296 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0e000e770 con 0x5594881f3180 2024-09-10T05:36:36.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.739+0000 7fcfdb606640 1 -- 172.21.15.62:0/499496296 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0e000ea70 con 0x5594881f3180 2024-09-10T05:36:36.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.739+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/499496296 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594881f3180 msgr2=0x5594882de970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.739+0000 7fd0ef70c9c0 1 --2- 172.21.15.62:0/499496296 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594881f3180 0x5594882de970 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fd0e000b270 tx=0x7fd0e000b670 comp rx=0 tx=0).stop 2024-09-10T05:36:36.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.739+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/499496296 shutdown_connections 2024-09-10T05:36:36.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.739+0000 7fd0ef70c9c0 1 --2- 172.21.15.62:0/499496296 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594881f3180 0x5594882de970 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.739+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/499496296 >> 172.21.15.62:0/499496296 conn(0x559488166a90 msgr2=0x5594882da5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:36.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.739+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/499496296 shutdown_connections 2024-09-10T05:36:36.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.739+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/499496296 wait complete. 2024-09-10T05:36:36.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.739+0000 7fd0ef70c9c0 1 Processor -- start 2024-09-10T05:36:36.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.739+0000 7fd0ef70c9c0 1 -- start start 2024-09-10T05:36:36.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.739+0000 7fd0ef70c9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594881f72d0 0x5594882e62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.739+0000 7fd0ef70c9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55948809ba50 con 0x5594881f72d0 2024-09-10T05:36:36.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.739+0000 7fd0ed212640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594881f72d0 0x5594882e62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.739+0000 7fd0ed212640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594881f72d0 0x5594882e62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47336/0 (socket says 172.21.15.62:47336) 2024-09-10T05:36:36.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.739+0000 7fd0ed212640 1 -- 172.21.15.62:0/875077515 learned_addr learned my addr 172.21.15.62:0/875077515 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:36.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.739+0000 7fd0ed212640 1 -- 172.21.15.62:0/875077515 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594882e6800 con 0x5594881f72d0 2024-09-10T05:36:36.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.743+0000 7fd0ed212640 1 --2- 172.21.15.62:0/875077515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594881f72d0 0x5594882e62a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x5594882df900 tx=0x7fd0e0000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.743+0000 7fcfd9e03640 1 -- 172.21.15.62:0/875077515 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0e000ee20 con 0x5594881f72d0 2024-09-10T05:36:36.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.743+0000 7fcfd9e03640 1 -- 172.21.15.62:0/875077515 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0e0001570 con 0x5594881f72d0 2024-09-10T05:36:36.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.743+0000 7fcfd9e03640 1 -- 172.21.15.62:0/875077515 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0e000fb10 con 0x5594881f72d0 2024-09-10T05:36:36.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.743+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/875077515 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5594882e6a90 con 0x5594881f72d0 2024-09-10T05:36:36.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.743+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/875077515 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594882e7440 con 0x5594881f72d0 2024-09-10T05:36:36.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.743+0000 7fcfd9e03640 1 -- 172.21.15.62:0/875077515 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd0e0017070 con 0x5594881f72d0 2024-09-10T05:36:36.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.743+0000 7fcfd9e03640 1 --2- 172.21.15.62:0/875077515 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fcfd4039a70 0x7fcfd403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.743+0000 7fcfd9e03640 1 -- 172.21.15.62:0/875077515 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fd0e0015020 con 0x5594881f72d0 2024-09-10T05:36:36.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.743+0000 7fd0eca11640 1 --2- 172.21.15.62:0/875077515 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fcfd4039a70 0x7fcfd403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.743+0000 7fd0ef70c9c0 1 --2- 172.21.15.62:0/875077515 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5594882eb400 0x5594882ed7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.743+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/875077515 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5594882edd30 con 0x5594882eb400 2024-09-10T05:36:36.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.743+0000 7fd0eda13640 1 --2- 172.21.15.62:0/875077515 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5594882eb400 0x5594882ed7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.743+0000 7fd0eca11640 1 --2- 172.21.15.62:0/875077515 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fcfd4039a70 0x7fcfd403bf30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd0d80ad000 tx=0x7fd0d80a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.743+0000 7fd0eda13640 1 --2- 172.21.15.62:0/875077515 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5594882eb400 0x5594882ed7f0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.747+0000 7fd0eda13640 1 -- 172.21.15.62:0/875077515 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd0e800a4d0 con 0x5594882eb400 2024-09-10T05:36:36.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.747+0000 7fd0ef70c9c0 1 --2- 172.21.15.62:0/875077515 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5594882eeae0 0x5594882f0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.747+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/875077515 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5594882f14e0 con 0x5594882eeae0 2024-09-10T05:36:36.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.747+0000 7fd0ed212640 1 --2- 172.21.15.62:0/875077515 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5594882eeae0 0x5594882f0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.747+0000 7fd0ed212640 1 --2- 172.21.15.62:0/875077515 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5594882eeae0 0x5594882f0ed0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.747+0000 7fd0ed212640 1 -- 172.21.15.62:0/875077515 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd0e002e070 con 0x5594882eeae0 2024-09-10T05:36:36.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.747+0000 7fd0ef70c9c0 1 --2- 172.21.15.62:0/875077515 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5594882f32a0 0x5594882f5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.747+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/875077515 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5594882f5d60 con 0x5594882f32a0 2024-09-10T05:36:36.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.747+0000 7fd0eca11640 1 --2- 172.21.15.62:0/875077515 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5594882f32a0 0x5594882f5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.747+0000 7fd0eca11640 1 --2- 172.21.15.62:0/875077515 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5594882f32a0 0x5594882f5690 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.747+0000 7fd0eca11640 1 -- 172.21.15.62:0/875077515 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd0d80a9ac0 con 0x5594882f32a0 2024-09-10T05:36:36.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.747+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/875077515 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5594882f2170 con 0x5594882eeae0 2024-09-10T05:36:36.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.747+0000 7fd0ed212640 1 -- 172.21.15.62:0/875077515 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd0e002e070 con 0x5594882eeae0 2024-09-10T05:36:36.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.747+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/875077515 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5594882f2590 con 0x5594882f32a0 2024-09-10T05:36:36.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.747+0000 7fd0eca11640 1 -- 172.21.15.62:0/875077515 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd0d80a9ac0 con 0x5594882f32a0 2024-09-10T05:36:36.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.751+0000 7fd0ef70c9c0 1 Processor -- start 2024-09-10T05:36:36.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.751+0000 7fd0ef70c9c0 1 -- start start 2024-09-10T05:36:36.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.751+0000 7fd0ef70c9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559488304330 0x559488304750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.751+0000 7fd0ef70c9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559488106450 con 0x559488304330 2024-09-10T05:36:36.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.751+0000 7fd0ed212640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559488304330 0x559488304750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.751+0000 7fd0ed212640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559488304330 0x559488304750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47346/0 (socket says 172.21.15.62:47346) 2024-09-10T05:36:36.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.751+0000 7fd0ed212640 1 -- 172.21.15.62:0/4056977611 learned_addr learned my addr 172.21.15.62:0/4056977611 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:36.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.751+0000 7fd0ed212640 1 -- 172.21.15.62:0/4056977611 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559488304d90 con 0x559488304330 2024-09-10T05:36:36.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.751+0000 7fd0ed212640 1 --2- 172.21.15.62:0/4056977611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559488304330 0x559488304750 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd0e001cfd0 tx=0x7fd0e0017d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.751+0000 7fcfd2ffd640 1 -- 172.21.15.62:0/4056977611 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0e0036070 con 0x559488304330 2024-09-10T05:36:36.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.751+0000 7fcfd2ffd640 1 -- 172.21.15.62:0/4056977611 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0e001a480 con 0x559488304330 2024-09-10T05:36:36.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.751+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/4056977611 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5594883055f0 con 0x559488304330 2024-09-10T05:36:36.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.751+0000 7fcfd2ffd640 1 -- 172.21.15.62:0/4056977611 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0e0050370 con 0x559488304330 2024-09-10T05:36:36.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.751+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/4056977611 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594883055f0 con 0x559488304330 2024-09-10T05:36:36.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.751+0000 7fcfd2ffd640 1 -- 172.21.15.62:0/4056977611 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd0e0050510 con 0x559488304330 2024-09-10T05:36:36.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.755+0000 7fcfd2ffd640 1 --2- 172.21.15.62:0/4056977611 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fcfc8039a70 0x7fcfc803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.755+0000 7fcfd2ffd640 1 -- 172.21.15.62:0/4056977611 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fd0e0039020 con 0x559488304330 2024-09-10T05:36:36.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.755+0000 7fd0eca11640 1 --2- 172.21.15.62:0/4056977611 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fcfc8039a70 0x7fcfc803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.755+0000 7fd0ef70c9c0 1 Processor -- start 2024-09-10T05:36:36.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.755+0000 7fd0ef70c9c0 1 -- start start 2024-09-10T05:36:36.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.755+0000 7fd0eca11640 1 --2- 172.21.15.62:0/4056977611 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fcfc8039a70 0x7fcfc803bf30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x5594882f2140 tx=0x7fd0d8005ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.755+0000 7fd0ef70c9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559488311950 0x559488311d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.755+0000 7fd0ef70c9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5594882df1c0 con 0x559488311950 2024-09-10T05:36:36.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.755+0000 7fd0ed212640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559488311950 0x559488311d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.755+0000 7fd0ed212640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559488311950 0x559488311d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47362/0 (socket says 172.21.15.62:47362) 2024-09-10T05:36:36.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.755+0000 7fd0ed212640 1 -- 172.21.15.62:0/1210346157 learned_addr learned my addr 172.21.15.62:0/1210346157 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:36.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.755+0000 7fd0ed212640 1 -- 172.21.15.62:0/1210346157 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559488312340 con 0x559488311950 2024-09-10T05:36:36.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.755+0000 7fd0ed212640 1 --2- 172.21.15.62:0/1210346157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559488311950 0x559488311d50 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd0e0018fd0 tx=0x7fd0e0025dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d46d8accf5b470a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.755+0000 7fcfd0ff9640 1 -- 172.21.15.62:0/1210346157 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0e0044cd0 con 0x559488311950 2024-09-10T05:36:36.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.755+0000 7fcfd0ff9640 1 -- 172.21.15.62:0/1210346157 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0e0062020 con 0x559488311950 2024-09-10T05:36:36.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.755+0000 7fcfd0ff9640 1 -- 172.21.15.62:0/1210346157 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0e001dd50 con 0x559488311950 2024-09-10T05:36:36.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.755+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/1210346157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559488311950 msgr2=0x559488311d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.755+0000 7fd0ef70c9c0 1 --2- 172.21.15.62:0/1210346157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559488311950 0x559488311d50 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd0e0018fd0 tx=0x7fd0e0025dc0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.755+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/1210346157 shutdown_connections 2024-09-10T05:36:36.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.755+0000 7fd0ef70c9c0 1 --2- 172.21.15.62:0/1210346157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559488311950 0x559488311d50 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.755+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/1210346157 >> 172.21.15.62:0/1210346157 conn(0x55948830cd10 msgr2=0x55948830af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:36.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.755+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/1210346157 shutdown_connections 2024-09-10T05:36:36.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.755+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/1210346157 wait complete. 2024-09-10T05:36:36.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.755+0000 7fd0ef70c9c0 1 Processor -- start 2024-09-10T05:36:36.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.755+0000 7fd0ef70c9c0 1 -- start start 2024-09-10T05:36:36.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.755+0000 7fd0ef70c9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559488311950 0x559488317c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.755+0000 7fd0ef70c9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5594883106c0 con 0x559488311950 2024-09-10T05:36:36.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.759+0000 7fd0ed212640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559488311950 0x559488317c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.759+0000 7fd0ed212640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559488311950 0x559488317c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47374/0 (socket says 172.21.15.62:47374) 2024-09-10T05:36:36.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.759+0000 7fd0ed212640 1 -- 172.21.15.62:0/2945170850 learned_addr learned my addr 172.21.15.62:0/2945170850 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:36.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.759+0000 7fd0ed212640 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559488318170 con 0x559488311950 2024-09-10T05:36:36.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.759+0000 7fd0ed212640 1 --2- 172.21.15.62:0/2945170850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559488311950 0x559488317c10 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fd0e004f280 tx=0x7fd0e004bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.759+0000 7fcfbeffd640 1 -- 172.21.15.62:0/2945170850 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0e0061050 con 0x559488311950 2024-09-10T05:36:36.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.759+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559488318170 con 0x559488311950 2024-09-10T05:36:36.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.759+0000 7fcfbeffd640 1 -- 172.21.15.62:0/2945170850 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0e00275f0 con 0x559488311950 2024-09-10T05:36:36.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.759+0000 7fcfbeffd640 1 -- 172.21.15.62:0/2945170850 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0e0051190 con 0x559488311950 2024-09-10T05:36:36.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.759+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559488318740 con 0x559488311950 2024-09-10T05:36:36.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.759+0000 7fcfbeffd640 1 -- 172.21.15.62:0/2945170850 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd0e0058070 con 0x559488311950 2024-09-10T05:36:36.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.759+0000 7fcfbeffd640 1 --2- 172.21.15.62:0/2945170850 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fcfb8039a70 0x7fcfb803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.759+0000 7fcfbeffd640 1 -- 172.21.15.62:0/2945170850 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fd0e006f070 con 0x559488311950 2024-09-10T05:36:36.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.759+0000 7fd0eca11640 1 --2- 172.21.15.62:0/2945170850 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fcfb8039a70 0x7fcfb803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.759+0000 7fd0ef70c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.759+0000 7fd0ef70c9c0 1 --2- 172.21.15.62:0/2945170850 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x559488322b00 0x559488324fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.759+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559488325710 con 0x559488322b00 2024-09-10T05:36:36.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.759+0000 7fd0eda13640 1 --2- 172.21.15.62:0/2945170850 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x559488322b00 0x559488324fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.759+0000 7fd0eca11640 1 --2- 172.21.15.62:0/2945170850 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fcfb8039a70 0x7fcfb803bf30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd0d801b410 tx=0x7fd0d80c1040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.763+0000 7fd0eda13640 1 --2- 172.21.15.62:0/2945170850 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x559488322b00 0x559488324fc0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.763+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd0e800a4d0 con 0x559488322b00 2024-09-10T05:36:36.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.763+0000 7fd0ef70c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:36.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.763+0000 7fd0ef70c9c0 20 realm 2024-09-10T05:36:36.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.763+0000 7fd0ef70c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.763+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559488321e30 con 0x559488322b00 2024-09-10T05:36:36.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.763+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd0e800a4d0 con 0x559488322b00 2024-09-10T05:36:36.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.763+0000 7fd0ef70c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:36.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.763+0000 7fd0ef70c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:36.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.763+0000 7fd0ef70c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.763+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5594883261d0 con 0x559488322b00 2024-09-10T05:36:36.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.763+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd0e800a4d0 con 0x559488322b00 2024-09-10T05:36:36.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.763+0000 7fd0ef70c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:36.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.763+0000 7fd0ef70c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.763+0000 7fd0ef70c9c0 1 --2- 172.21.15.62:0/2945170850 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x559488326fb0 0x5594883293a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.763+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559488329a70 con 0x559488326fb0 2024-09-10T05:36:36.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.763+0000 7fd0ed212640 1 --2- 172.21.15.62:0/2945170850 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x559488326fb0 0x5594883293a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.763+0000 7fd0ed212640 1 --2- 172.21.15.62:0/2945170850 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x559488326fb0 0x5594883293a0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.763+0000 7fd0ed212640 1 -- 172.21.15.62:0/2945170850 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd0e0079020 con 0x559488326fb0 2024-09-10T05:36:36.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.763+0000 7fd0ef70c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:36.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.763+0000 7fd0ef70c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.763+0000 7fd0ef70c9c0 1 --2- 172.21.15.62:0/2945170850 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55948832a7d0 0x55948832cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.763+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55948832d330 con 0x55948832a7d0 2024-09-10T05:36:36.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.763+0000 7fd0eca11640 1 --2- 172.21.15.62:0/2945170850 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55948832a7d0 0x55948832cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.763+0000 7fd0eca11640 1 --2- 172.21.15.62:0/2945170850 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55948832a7d0 0x55948832cbc0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.763+0000 7fd0eca11640 1 -- 172.21.15.62:0/2945170850 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd0d80a9ac0 con 0x55948832a7d0 2024-09-10T05:36:36.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.763+0000 7fd0ef70c9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:36.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.763+0000 7fd0ef70c9c0 20 searching for the correct realm 2024-09-10T05:36:36.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.763+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55948832ec00 con 0x55948832a7d0 2024-09-10T05:36:36.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.767+0000 7fd0eca11640 1 -- 172.21.15.62:0/2945170850 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0d80a9ac0 con 0x55948832a7d0 2024-09-10T05:36:36.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.767+0000 7fd0eca11640 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55948832ec00 con 0x559488326fb0 2024-09-10T05:36:36.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.767+0000 7fd0ed212640 1 -- 172.21.15.62:0/2945170850 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e0079020 con 0x559488326fb0 2024-09-10T05:36:36.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.767+0000 7fd0ed212640 1 --2- 172.21.15.62:0/2945170850 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x5594881f3180 0x7fd0e00318d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.767+0000 7fd0ed212640 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55948832ec00 con 0x5594881f3180 2024-09-10T05:36:36.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.767+0000 7fd0eda13640 1 --2- 172.21.15.62:0/2945170850 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x5594881f3180 0x7fd0e00318d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.767+0000 7fd0eda13640 1 --2- 172.21.15.62:0/2945170850 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x5594881f3180 0x7fd0e00318d0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.767+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e800a4d0 con 0x5594881f3180 2024-09-10T05:36:36.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.767+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55948832ec00 con 0x559488322b00 2024-09-10T05:36:36.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.767+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e800a4d0 con 0x559488322b00 2024-09-10T05:36:36.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.767+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55948832ec00 con 0x559488322b00 2024-09-10T05:36:36.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.767+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e800a4d0 con 0x559488322b00 2024-09-10T05:36:36.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.767+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55948832ec00 con 0x55948832a7d0 2024-09-10T05:36:36.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.767+0000 7fd0eca11640 1 -- 172.21.15.62:0/2945170850 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0d80a9ac0 con 0x55948832a7d0 2024-09-10T05:36:36.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.767+0000 7fd0eca11640 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55948832ec00 con 0x559488322b00 2024-09-10T05:36:36.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.767+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e800a4d0 con 0x559488322b00 2024-09-10T05:36:36.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.767+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55948832ec00 con 0x559488326fb0 2024-09-10T05:36:36.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.771+0000 7fd0ed212640 1 -- 172.21.15.62:0/2945170850 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e0079020 con 0x559488326fb0 2024-09-10T05:36:36.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.771+0000 7fd0ed212640 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55948832ec00 con 0x559488326fb0 2024-09-10T05:36:36.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.771+0000 7fd0ed212640 1 -- 172.21.15.62:0/2945170850 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e0079020 con 0x559488326fb0 2024-09-10T05:36:36.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.771+0000 7fd0ed212640 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55948832ec00 con 0x559488322b00 2024-09-10T05:36:36.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.771+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e800a4d0 con 0x559488322b00 2024-09-10T05:36:36.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.771+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55948832ec00 con 0x5594881f3180 2024-09-10T05:36:36.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.771+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e800a4d0 con 0x5594881f3180 2024-09-10T05:36:36.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.771+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55948832ec00 con 0x559488322b00 2024-09-10T05:36:36.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.771+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e800a4d0 con 0x559488322b00 2024-09-10T05:36:36.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.771+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55948832ec00 con 0x5594881f3180 2024-09-10T05:36:36.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.771+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd0e800a4d0 con 0x5594881f3180 2024-09-10T05:36:36.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.771+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55948832ec00 con 0x559488326fb0 2024-09-10T05:36:36.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.771+0000 7fd0ed212640 1 -- 172.21.15.62:0/2945170850 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e0079020 con 0x559488326fb0 2024-09-10T05:36:36.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.771+0000 7fd0ed212640 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55948832ec00 con 0x55948832a7d0 2024-09-10T05:36:36.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.771+0000 7fd0eca11640 1 -- 172.21.15.62:0/2945170850 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0d80a9ac0 con 0x55948832a7d0 2024-09-10T05:36:36.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.771+0000 7fd0eca11640 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55948832ec00 con 0x559488322b00 2024-09-10T05:36:36.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.771+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e800a4d0 con 0x559488322b00 2024-09-10T05:36:36.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.771+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55948832ec00 con 0x559488326fb0 2024-09-10T05:36:36.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.775+0000 7fd0ed212640 1 -- 172.21.15.62:0/2945170850 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e0079020 con 0x559488326fb0 2024-09-10T05:36:36.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.775+0000 7fd0ed212640 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55948832ec00 con 0x55948832a7d0 2024-09-10T05:36:36.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.775+0000 7fd0eca11640 1 -- 172.21.15.62:0/2945170850 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 30 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7fd0d80a9ac0 con 0x55948832a7d0 2024-09-10T05:36:36.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.775+0000 7fd0eca11640 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55948832ec00 con 0x559488322b00 2024-09-10T05:36:36.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.775+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e800a4d0 con 0x559488322b00 2024-09-10T05:36:36.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.775+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55948832ec00 con 0x559488322b00 2024-09-10T05:36:36.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.775+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd0e800a4d0 con 0x559488322b00 2024-09-10T05:36:36.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.775+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55948832ec00 con 0x559488322b00 2024-09-10T05:36:36.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.775+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e800a4d0 con 0x559488322b00 2024-09-10T05:36:36.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.775+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55948832ec00 con 0x55948832a7d0 2024-09-10T05:36:36.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.775+0000 7fd0eca11640 1 -- 172.21.15.62:0/2945170850 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0d80a9ac0 con 0x55948832a7d0 2024-09-10T05:36:36.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.775+0000 7fd0eca11640 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55948832ec00 con 0x5594881f3180 2024-09-10T05:36:36.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.775+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e800a4d0 con 0x5594881f3180 2024-09-10T05:36:36.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.775+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55948832ec00 con 0x559488322b00 2024-09-10T05:36:36.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.775+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e800a4d0 con 0x559488322b00 2024-09-10T05:36:36.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.775+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55948832ec00 con 0x5594881f3180 2024-09-10T05:36:36.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.775+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e800a4d0 con 0x5594881f3180 2024-09-10T05:36:36.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.775+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55948832ec00 con 0x55948832a7d0 2024-09-10T05:36:36.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.775+0000 7fd0eca11640 1 -- 172.21.15.62:0/2945170850 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0d80a9ac0 con 0x55948832a7d0 2024-09-10T05:36:36.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.775+0000 7fd0eca11640 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55948832ec00 con 0x5594881f3180 2024-09-10T05:36:36.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.775+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e800a4d0 con 0x5594881f3180 2024-09-10T05:36:36.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.775+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55948832ec00 con 0x559488326fb0 2024-09-10T05:36:36.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.779+0000 7fd0ed212640 1 -- 172.21.15.62:0/2945170850 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e0079020 con 0x559488326fb0 2024-09-10T05:36:36.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.779+0000 7fd0ed212640 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55948832ec00 con 0x559488326fb0 2024-09-10T05:36:36.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.779+0000 7fd0ed212640 1 -- 172.21.15.62:0/2945170850 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e0079020 con 0x559488326fb0 2024-09-10T05:36:36.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.779+0000 7fd0ed212640 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55948832ec00 con 0x55948832a7d0 2024-09-10T05:36:36.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.779+0000 7fd0eca11640 1 -- 172.21.15.62:0/2945170850 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0d80a9ac0 con 0x55948832a7d0 2024-09-10T05:36:36.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.779+0000 7fd0eca11640 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55948832ec00 con 0x559488326fb0 2024-09-10T05:36:36.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.779+0000 7fd0ed212640 1 -- 172.21.15.62:0/2945170850 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd0e0079020 con 0x559488326fb0 2024-09-10T05:36:36.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.779+0000 7fd0ed212640 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55948832ec00 con 0x559488326fb0 2024-09-10T05:36:36.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.779+0000 7fd0ed212640 1 -- 172.21.15.62:0/2945170850 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e0079020 con 0x559488326fb0 2024-09-10T05:36:36.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.779+0000 7fd0ef70c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:36.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.779+0000 7fd0ef70c9c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:36.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.779+0000 7fd0ef70c9c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:36.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.779+0000 7fd0ef70c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:36.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.779+0000 7fd0ef70c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:36.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.779+0000 7fd0ef70c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:36.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.779+0000 7fd0ef70c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.779+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55948832dcf0 con 0x559488322b00 2024-09-10T05:36:36.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.779+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd0e800a4d0 con 0x559488322b00 2024-09-10T05:36:36.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.779+0000 7fd0ef70c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:36.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.779+0000 7fd0ef70c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.779+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55948832d930 con 0x559488326fb0 2024-09-10T05:36:36.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.779+0000 7fd0ed212640 1 -- 172.21.15.62:0/2945170850 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd0e0079020 con 0x559488326fb0 2024-09-10T05:36:36.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.779+0000 7fd0ef70c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:36.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.779+0000 7fd0ef70c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.779+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55948832e650 con 0x55948832a7d0 2024-09-10T05:36:36.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.779+0000 7fd0eca11640 1 -- 172.21.15.62:0/2945170850 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd0d80a9ac0 con 0x55948832a7d0 2024-09-10T05:36:36.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.779+0000 7fd0ef70c9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:36.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.779+0000 7fd0ef70c9c0 20 zone default found 2024-09-10T05:36:36.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.779+0000 7fd0ef70c9c0 4 Realm: () 2024-09-10T05:36:36.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.779+0000 7fd0ef70c9c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:36.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.779+0000 7fd0ef70c9c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:36.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.779+0000 7fd0ef70c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:36.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.779+0000 7fd0ef70c9c0 20 zonegroup default 2024-09-10T05:36:36.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.783+0000 7fd0ef70c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.783+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55948832f4e0 con 0x5594881f3180 2024-09-10T05:36:36.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.783+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd0e800a4d0 con 0x5594881f3180 2024-09-10T05:36:36.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.783+0000 7fd0ef70c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:36.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.783+0000 7fd0ef70c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.783+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559488331720 con 0x55948832a7d0 2024-09-10T05:36:36.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.783+0000 7fd0eca11640 1 -- 172.21.15.62:0/2945170850 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd0d80a9ac0 con 0x55948832a7d0 2024-09-10T05:36:36.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.783+0000 7fd0ef70c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:36.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.783+0000 7fd0ef70c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.783+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559488331ac0 con 0x55948832a7d0 2024-09-10T05:36:36.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.783+0000 7fd0eca11640 1 -- 172.21.15.62:0/2945170850 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd0d80a9ac0 con 0x55948832a7d0 2024-09-10T05:36:36.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.783+0000 7fd0ef70c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:36.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.783+0000 7fd0ef70c9c0 20 started sync module instance, tier type = 2024-09-10T05:36:36.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.783+0000 7fd0ef70c9c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:36.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.783+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559488330b60 con 0x559488326fb0 2024-09-10T05:36:36.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.783+0000 7fd0ed212640 1 -- 172.21.15.62:0/2945170850 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0e0079020 con 0x559488326fb0 2024-09-10T05:36:36.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.783+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94096428568400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559488331370 con 0x559488326fb0 2024-09-10T05:36:36.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.783+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5594883327c0 con 0x559488322b00 2024-09-10T05:36:36.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.787+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0e800a4d0 con 0x559488322b00 2024-09-10T05:36:36.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.787+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94096428575584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559488333430 con 0x559488322b00 2024-09-10T05:36:36.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.787+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559488333df0 con 0x559488326fb0 2024-09-10T05:36:36.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.787+0000 7fd0ed212640 1 -- 172.21.15.62:0/2945170850 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94096428568400] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0e0079020 con 0x559488326fb0 2024-09-10T05:36:36.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.787+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94096428575584] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0e800a4d0 con 0x559488322b00 2024-09-10T05:36:36.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.787+0000 7fd0ed212640 1 -- 172.21.15.62:0/2945170850 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0e0079020 con 0x559488326fb0 2024-09-10T05:36:36.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.787+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94096428579136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559488333430 con 0x559488326fb0 2024-09-10T05:36:36.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.787+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559488333d60 con 0x5594881f3180 2024-09-10T05:36:36.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.791+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0e800a4d0 con 0x5594881f3180 2024-09-10T05:36:36.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.791+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94096428581344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559488333d60 con 0x5594881f3180 2024-09-10T05:36:36.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.791+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559488335110 con 0x559488326fb0 2024-09-10T05:36:36.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.791+0000 7fd0ed212640 1 -- 172.21.15.62:0/2945170850 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94096428579136] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0e0079020 con 0x559488326fb0 2024-09-10T05:36:36.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.791+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94096428581344] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0e800a4d0 con 0x5594881f3180 2024-09-10T05:36:36.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.791+0000 7fd0ed212640 1 -- 172.21.15.62:0/2945170850 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0e0079020 con 0x559488326fb0 2024-09-10T05:36:36.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.791+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94096428582400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559488334c20 con 0x559488326fb0 2024-09-10T05:36:36.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.791+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5594883359e0 con 0x55948832a7d0 2024-09-10T05:36:36.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.791+0000 7fd0eca11640 1 -- 172.21.15.62:0/2945170850 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0d80a9ac0 con 0x55948832a7d0 2024-09-10T05:36:36.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.791+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94096428586288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559488334c20 con 0x55948832a7d0 2024-09-10T05:36:36.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.791+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559488336420 con 0x55948832a7d0 2024-09-10T05:36:36.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.795+0000 7fd0ed212640 1 -- 172.21.15.62:0/2945170850 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94096428582400] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0e0079020 con 0x559488326fb0 2024-09-10T05:36:36.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.795+0000 7fd0eca11640 1 -- 172.21.15.62:0/2945170850 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94096428586288] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0d80a9ac0 con 0x55948832a7d0 2024-09-10T05:36:36.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.795+0000 7fd0eca11640 1 -- 172.21.15.62:0/2945170850 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0d80a9ac0 con 0x55948832a7d0 2024-09-10T05:36:36.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.795+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94096428587344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559488335f70 con 0x55948832a7d0 2024-09-10T05:36:36.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.795+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559488336cc0 con 0x5594881f3180 2024-09-10T05:36:36.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.795+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0e800a4d0 con 0x5594881f3180 2024-09-10T05:36:36.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.795+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94096428591120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559488335f70 con 0x5594881f3180 2024-09-10T05:36:36.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.795+0000 7fd0ef70c9c0 20 add_watcher() i=0 2024-09-10T05:36:36.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.795+0000 7fd0ef70c9c0 20 add_watcher() i=1 2024-09-10T05:36:36.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.795+0000 7fd0ef70c9c0 20 add_watcher() i=2 2024-09-10T05:36:36.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.795+0000 7fd0ef70c9c0 20 add_watcher() i=3 2024-09-10T05:36:36.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.795+0000 7fd0ef70c9c0 20 add_watcher() i=4 2024-09-10T05:36:36.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.795+0000 7fd0ef70c9c0 20 add_watcher() i=5 2024-09-10T05:36:36.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.795+0000 7fd0eca11640 1 -- 172.21.15.62:0/2945170850 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94096428587344] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0d80a9ac0 con 0x55948832a7d0 2024-09-10T05:36:36.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.795+0000 7fd0ef70c9c0 20 add_watcher() i=6 2024-09-10T05:36:36.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.799+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94096428591120] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0e800a4d0 con 0x5594881f3180 2024-09-10T05:36:36.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.799+0000 7fd0ef70c9c0 20 add_watcher() i=7 2024-09-10T05:36:36.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.799+0000 7fd0ef70c9c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:36.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.799+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559488332f80 con 0x559488322b00 2024-09-10T05:36:36.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.799+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd0e800a4d0 con 0x559488322b00 2024-09-10T05:36:36.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.799+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94096428592176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559488332f80 con 0x559488322b00 2024-09-10T05:36:36.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.799+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94096428592176] v30'116 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd0e800a4d0 con 0x559488322b00 2024-09-10T05:36:36.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.799+0000 7fcfa37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:36.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.799+0000 7fd0ef70c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:36.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.799+0000 7fd0ef70c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:36.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.799+0000 7fd0ef70c9c0 5 note: GC not initialized 2024-09-10T05:36:36.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.799+0000 7fcfa27e4640 20 reqs_thread_entry: start 2024-09-10T05:36:36.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.799+0000 7fd0ef70c9c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:36.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.799+0000 7fd0ef70c9c0 20 Filter name: none 2024-09-10T05:36:36.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.799+0000 7fcf13fff640 20 reqs_thread_entry: start 2024-09-10T05:36:36.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.799+0000 7fd0ef70c9c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-10T05:36:36.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.799+0000 7fd0ef70c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.799+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55948835cfa0 con 0x5594881f3180 2024-09-10T05:36:36.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.803+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fd0e800a4d0 con 0x5594881f3180 2024-09-10T05:36:36.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.803+0000 7fd0ef70c9c0 20 rados_obj.operate() r=0 bl.length=380 2024-09-10T05:36:36.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.803+0000 7fd0ef70c9c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-10T05:36:36.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.803+0000 7fd0ef70c9c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T05:36:36.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.803+0000 7fd0ef70c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:36:36.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.803+0000 7fd0ef70c9c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T05:36:36.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.803+0000 7fd0ef70c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.803+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55948835f090 con 0x5594881f3180 2024-09-10T05:36:36.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.803+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv18 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fd0e800a4d0 con 0x5594881f3180 2024-09-10T05:36:36.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.803+0000 7fd0ef70c9c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T05:36:36.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.803+0000 7fd0ef70c9c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-10T05:36:36.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.803+0000 7fd0ef70c9c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T05:36:36.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.803+0000 7fd0ef70c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 : miss 2024-09-10T05:36:36.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.803+0000 7fd0ef70c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.803+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:64 8.1f 8:fcc5c255:root::.bucket.meta.myfoo%3a475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559488360b00 con 0x5594881f3180 2024-09-10T05:36:36.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.803+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(64 .bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fd0e800a4d0 con 0x5594881f3180 2024-09-10T05:36:36.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.803+0000 7fd0ef70c9c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T05:36:36.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.803+0000 7fd0ef70c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 info.flags=0x17 2024-09-10T05:36:36.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.803+0000 7fd0ef70c9c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 to cache LRU end 2024-09-10T05:36:36.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.803+0000 7fd0ef70c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:36:36.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.803+0000 7fd0ef70c9c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T05:36:36.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.803+0000 7fd0ef70c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 2024-09-10T05:36:36.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.803+0000 7fd0ef70c9c0 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-10T05:36:36.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.803+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559488365160 con 0x5594881f3180 2024-09-10T05:36:36.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.803+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 <== osd.2 v2:172.21.15.62:6800/2677868286 15 ==== osd_op_reply(65 foo.buckets [call] v30'19 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fd0e800a4d0 con 0x5594881f3180 2024-09-10T05:36:36.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.803+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:66 8.1f 8:fcc5c255:root::.bucket.meta.myfoo%3a475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55948836aea0 con 0x5594881f3180 2024-09-10T05:36:36.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.807+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 <== osd.2 v2:172.21.15.62:6800/2677868286 16 ==== osd_op_reply(66 .bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v30'2 uv2 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7fd0e800a4d0 con 0x5594881f3180 2024-09-10T05:36:36.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.807+0000 7fd0ef70c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 info.flags=0x17 2024-09-10T05:36:36.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.807+0000 7fd0ef70c9c0 10 moving default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 to cache LRU end 2024-09-10T05:36:36.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.807+0000 7fd0ef70c9c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T05:36:36.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.807+0000 7fd0ef70c9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1, ofs0, ns] 2024-09-10T05:36:36.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.807+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94096428765632 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559488365590 con 0x55948832a7d0 2024-09-10T05:36:36.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.807+0000 7fd0eca11640 1 -- 172.21.15.62:0/2945170850 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== watch-notify(notify (1) cookie 94096428586288 notify 128849018884 ret 0) ==== 802+0+0 (crc 0 0 0) 0x7fd0d80e7040 con 0x55948832a7d0 2024-09-10T05:36:36.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.807+0000 7fcfd0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018884 cookie 94096428586288 notifier 4500 bl.length()=760 2024-09-10T05:36:36.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.807+0000 7fcfd0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 info.flags=0x17 2024-09-10T05:36:36.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.807+0000 7fcfd0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 to cache LRU end 2024-09-10T05:36:36.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.807+0000 7fcfd0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T05:36:36.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.807+0000 7fd0eca11640 1 -- 172.21.15.62:0/2945170850 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(67 notify.5 [notify cookie 94096428765632 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd0d80a9ac0 con 0x55948832a7d0 2024-09-10T05:36:36.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.807+0000 7fcfd0ff9640 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fcfb0003eb0 con 0x55948832a7d0 2024-09-10T05:36:36.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.807+0000 7fd0eca11640 1 -- 172.21.15.62:0/2945170850 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0d80a9ac0 con 0x55948832a7d0 2024-09-10T05:36:36.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.807+0000 7fd0eca11640 1 -- 172.21.15.62:0/2945170850 <== osd.3 v2:172.21.15.62:6816/2708991149 19 ==== watch-notify(notify_complete (2) cookie 94096428765632 notify 128849018884 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559488099ca0 con 0x55948832a7d0 2024-09-10T05:36:36.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.807+0000 7fd0ef70c9c0 20 handle_bi_update(): bucket=:myfoo[475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1]): orig_sources= new_sources= 2024-09-10T05:36:36.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.807+0000 7fd0ef70c9c0 20 handle_bi_update(): bucket=:myfoo[475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1]): potential sources added=[] removed=[] 2024-09-10T05:36:36.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.807+0000 7fd0ef70c9c0 20 handle_bi_update(): bucket=:myfoo[475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1]): orig_dests= new_dests= 2024-09-10T05:36:36.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.807+0000 7fd0ef70c9c0 20 handle_bi_update(): bucket=:myfoo[475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1]): potential dests added=[] removed=[] 2024-09-10T05:36:36.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.807+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:69 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559488369880 con 0x559488322b00 2024-09-10T05:36:36.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.807+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(69 fud.buckets [call] v30'1 uv1 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fd0e800a4d0 con 0x559488322b00 2024-09-10T05:36:36.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.807+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5594883611a0 con 0x5594881f3180 2024-09-10T05:36:36.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.811+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 <== osd.2 v2:172.21.15.62:6800/2677868286 17 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v30'20 uv20 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7fd0e800a4d0 con 0x5594881f3180 2024-09-10T05:36:36.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.811+0000 7fd0ef70c9c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-10T05:36:36.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.811+0000 7fd0ef70c9c0 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T05:36:36.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.811+0000 7fd0ef70c9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-10T05:36:36.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.811+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94096428765600 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559488369d30 con 0x55948832a7d0 2024-09-10T05:36:36.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.811+0000 7fd0eca11640 1 -- 172.21.15.62:0/2945170850 <== osd.3 v2:172.21.15.62:6816/2708991149 20 ==== watch-notify(notify (1) cookie 94096428587344 notify 128849018885 ret 0) ==== 356+0+0 (crc 0 0 0) 0x7fd0d80eb850 con 0x55948832a7d0 2024-09-10T05:36:36.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.811+0000 7fcfd0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018885 cookie 94096428587344 notifier 4500 bl.length()=314 2024-09-10T05:36:36.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.811+0000 7fcfd0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-10T05:36:36.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.811+0000 7fcfd0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T05:36:36.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.811+0000 7fcfd0ff9640 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fcfb0003eb0 con 0x55948832a7d0 2024-09-10T05:36:36.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.811+0000 7fd0eca11640 1 -- 172.21.15.62:0/2945170850 <== osd.3 v2:172.21.15.62:6816/2708991149 21 ==== osd_op_reply(71 notify.6 [notify cookie 94096428765600 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd0d80a9ac0 con 0x55948832a7d0 2024-09-10T05:36:36.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.811+0000 7fd0eca11640 1 -- 172.21.15.62:0/2945170850 <== osd.3 v2:172.21.15.62:6816/2708991149 22 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0d80a9ac0 con 0x55948832a7d0 2024-09-10T05:36:36.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.811+0000 7fd0eca11640 1 -- 172.21.15.62:0/2945170850 <== osd.3 v2:172.21.15.62:6816/2708991149 23 ==== watch-notify(notify_complete (2) cookie 94096428765600 notify 128849018885 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fd0d80ebaf0 con 0x55948832a7d0 2024-09-10T05:36:36.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.811+0000 7fcfa37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:36.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.811+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94096428592176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55948835adb0 con 0x559488322b00 2024-09-10T05:36:36.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.815+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94096428592176] v30'117 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd0e800a4d0 con 0x559488322b00 2024-09-10T05:36:36.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.815+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94096428568400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55948835adb0 con 0x559488326fb0 2024-09-10T05:36:36.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.815+0000 7fd0ed212640 1 -- 172.21.15.62:0/2945170850 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94096428568400] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0e0079020 con 0x559488326fb0 2024-09-10T05:36:36.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.815+0000 7fd0ef70c9c0 20 remove_watcher() i=0 2024-09-10T05:36:36.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.815+0000 7fd0ef70c9c0 2 removed watcher, disabling cache 2024-09-10T05:36:36.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.815+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94096428575584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55948835adb0 con 0x559488322b00 2024-09-10T05:36:36.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.819+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94096428575584] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0e800a4d0 con 0x559488322b00 2024-09-10T05:36:36.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.819+0000 7fd0ef70c9c0 20 remove_watcher() i=1 2024-09-10T05:36:36.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.819+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94096428579136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55948835adb0 con 0x559488326fb0 2024-09-10T05:36:36.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.819+0000 7fd0ed212640 1 -- 172.21.15.62:0/2945170850 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94096428579136] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0e0079020 con 0x559488326fb0 2024-09-10T05:36:36.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.819+0000 7fd0ef70c9c0 20 remove_watcher() i=2 2024-09-10T05:36:36.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.819+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94096428581344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55948835adb0 con 0x5594881f3180 2024-09-10T05:36:36.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.819+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 <== osd.2 v2:172.21.15.62:6800/2677868286 18 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94096428581344] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0e800a4d0 con 0x5594881f3180 2024-09-10T05:36:36.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.819+0000 7fd0ef70c9c0 20 remove_watcher() i=3 2024-09-10T05:36:36.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.819+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94096428582400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55948835adb0 con 0x559488326fb0 2024-09-10T05:36:36.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.823+0000 7fd0ed212640 1 -- 172.21.15.62:0/2945170850 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94096428582400] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0e0079020 con 0x559488326fb0 2024-09-10T05:36:36.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.823+0000 7fd0ef70c9c0 20 remove_watcher() i=4 2024-09-10T05:36:36.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.823+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94096428586288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55948835adb0 con 0x55948832a7d0 2024-09-10T05:36:36.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.823+0000 7fd0eca11640 1 -- 172.21.15.62:0/2945170850 <== osd.3 v2:172.21.15.62:6816/2708991149 24 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94096428586288] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0d80a9ac0 con 0x55948832a7d0 2024-09-10T05:36:36.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.823+0000 7fd0ef70c9c0 20 remove_watcher() i=5 2024-09-10T05:36:36.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.823+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94096428587344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55948835adb0 con 0x55948832a7d0 2024-09-10T05:36:36.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.827+0000 7fd0eca11640 1 -- 172.21.15.62:0/2945170850 <== osd.3 v2:172.21.15.62:6816/2708991149 25 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94096428587344] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0d80a9ac0 con 0x55948832a7d0 2024-09-10T05:36:36.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.827+0000 7fd0ef70c9c0 20 remove_watcher() i=6 2024-09-10T05:36:36.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.827+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94096428591120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55948835adb0 con 0x5594881f3180 2024-09-10T05:36:36.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.827+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 <== osd.2 v2:172.21.15.62:6800/2677868286 19 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94096428591120] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0e800a4d0 con 0x5594881f3180 2024-09-10T05:36:36.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.827+0000 7fd0ef70c9c0 20 remove_watcher() i=7 2024-09-10T05:36:36.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.827+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x559488326fb0 msgr2=0x5594883293a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.827+0000 7fd0ef70c9c0 1 --2- 172.21.15.62:0/2945170850 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x559488326fb0 0x5594883293a0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.827+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x559488322b00 msgr2=0x559488324fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.827+0000 7fd0ef70c9c0 1 --2- 172.21.15.62:0/2945170850 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x559488322b00 0x559488324fc0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.827+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x5594881f3180 msgr2=0x7fd0e00318d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.827+0000 7fd0ef70c9c0 1 --2- 172.21.15.62:0/2945170850 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x5594881f3180 0x7fd0e00318d0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.827+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55948832a7d0 msgr2=0x55948832cbc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.827+0000 7fd0ef70c9c0 1 --2- 172.21.15.62:0/2945170850 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55948832a7d0 0x55948832cbc0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.827+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fcfb8039a70 msgr2=0x7fcfb803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.827+0000 7fd0ef70c9c0 1 --2- 172.21.15.62:0/2945170850 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fcfb8039a70 0x7fcfb803bf30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd0d801b410 tx=0x7fd0d80c1040 comp rx=0 tx=0).stop 2024-09-10T05:36:36.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.827+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559488311950 msgr2=0x559488317c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.827+0000 7fd0ef70c9c0 1 --2- 172.21.15.62:0/2945170850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559488311950 0x559488317c10 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fd0e004f280 tx=0x7fd0e004bf10 comp rx=0 tx=0).stop 2024-09-10T05:36:36.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.827+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 reap_dead start 2024-09-10T05:36:36.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.827+0000 7fd0eda13640 1 -- 172.21.15.62:0/2945170850 reap_dead start 2024-09-10T05:36:36.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.827+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 shutdown_connections 2024-09-10T05:36:36.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.827+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 >> 172.21.15.62:0/2945170850 conn(0x55948830cd10 msgr2=0x55948830af20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:36.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.827+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 shutdown_connections 2024-09-10T05:36:36.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.827+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/2945170850 wait complete. 2024-09-10T05:36:36.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.827+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/4056977611 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fcfc8039a70 msgr2=0x7fcfc803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.827+0000 7fd0ef70c9c0 1 --2- 172.21.15.62:0/4056977611 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fcfc8039a70 0x7fcfc803bf30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x5594882f2140 tx=0x7fd0d8005ad0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.827+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/4056977611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559488304330 msgr2=0x559488304750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.827+0000 7fd0ef70c9c0 1 --2- 172.21.15.62:0/4056977611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559488304330 0x559488304750 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd0e001cfd0 tx=0x7fd0e0017d60 comp rx=0 tx=0).stop 2024-09-10T05:36:36.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.827+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/4056977611 shutdown_connections 2024-09-10T05:36:36.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.827+0000 7fd0ef70c9c0 1 --2- 172.21.15.62:0/4056977611 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fcfc8039a70 0x7fcfc803bf30 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.827+0000 7fd0ef70c9c0 1 --2- 172.21.15.62:0/4056977611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559488304330 0x559488304750 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.827+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/4056977611 >> 172.21.15.62:0/4056977611 conn(0x5594882f9ce0 msgr2=0x5594882fa0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:36.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.827+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/4056977611 shutdown_connections 2024-09-10T05:36:36.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.827+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/4056977611 wait complete. 2024-09-10T05:36:36.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.827+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/875077515 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5594882eeae0 msgr2=0x5594882f0ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.827+0000 7fd0ef70c9c0 1 --2- 172.21.15.62:0/875077515 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5594882eeae0 0x5594882f0ed0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.827+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/875077515 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5594882eb400 msgr2=0x5594882ed7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.827+0000 7fd0ef70c9c0 1 --2- 172.21.15.62:0/875077515 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5594882eb400 0x5594882ed7f0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.827+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/875077515 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5594882f32a0 msgr2=0x5594882f5690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.827+0000 7fd0ef70c9c0 1 --2- 172.21.15.62:0/875077515 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5594882f32a0 0x5594882f5690 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.827+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/875077515 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fcfd4039a70 msgr2=0x7fcfd403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.827+0000 7fd0ef70c9c0 1 --2- 172.21.15.62:0/875077515 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fcfd4039a70 0x7fcfd403bf30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd0d80ad000 tx=0x7fd0d80a6000 comp rx=0 tx=0).stop 2024-09-10T05:36:36.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.827+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/875077515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594881f72d0 msgr2=0x5594882e62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.827+0000 7fd0ef70c9c0 1 --2- 172.21.15.62:0/875077515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594881f72d0 0x5594882e62a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x5594882df900 tx=0x7fd0e0000ee0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.831+0000 7fd0eda13640 1 -- 172.21.15.62:0/875077515 reap_dead start 2024-09-10T05:36:36.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.831+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/875077515 shutdown_connections 2024-09-10T05:36:36.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.831+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/875077515 >> 172.21.15.62:0/875077515 conn(0x559488166a90 msgr2=0x5594882d9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:36.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.831+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/875077515 shutdown_connections 2024-09-10T05:36:36.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.831+0000 7fd0ef70c9c0 1 -- 172.21.15.62:0/875077515 wait complete. 2024-09-10T05:36:36.844 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-10T05:36:36.844 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-10T05:36:36.845 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-10T05:36:36.927 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:36.927 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:36.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.923+0000 7f2b92b979c0 1 Processor -- start 2024-09-10T05:36:36.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.923+0000 7f2b92b979c0 1 -- start start 2024-09-10T05:36:36.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.923+0000 7f2b92b979c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x559448a25020 0x559448a23ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.923+0000 7f2b92b979c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5594489629c0 con 0x559448a24af0 2024-09-10T05:36:36.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.923+0000 7f2b92b979c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x5594489b26d0 con 0x559448a25020 2024-09-10T05:36:36.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.927+0000 7f2b8fe9c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x559448a25020 0x559448a23ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.927+0000 7f2b8fe9c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x559448a25020 0x559448a23ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47388/0 (socket says 172.21.15.62:47388) 2024-09-10T05:36:36.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.927+0000 7f2b8fe9c640 1 -- 172.21.15.62:0/861385523 learned_addr learned my addr 172.21.15.62:0/861385523 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:36.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.927+0000 7f2b8fe9c640 1 -- 172.21.15.62:0/861385523 >> v1:172.21.15.2:6789/0 conn(0x559448a24af0 legacy=0x559448a23490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.927+0000 7f2b8fe9c640 1 -- 172.21.15.62:0/861385523 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559448956ca0 con 0x559448a25020 2024-09-10T05:36:36.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.927+0000 7f2b8fe9c640 1 --2- 172.21.15.62:0/861385523 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559448a25020 0x559448a23ba0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f2b8400a5c0 tx=0x7f2b8401b2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39aaa06e7b6ba9e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.927+0000 7f2b8f69b640 1 -- 172.21.15.62:0/861385523 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b840aa540 con 0x559448a25020 2024-09-10T05:36:36.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.927+0000 7f2b8f69b640 1 -- 172.21.15.62:0/861385523 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b840af070 con 0x559448a25020 2024-09-10T05:36:36.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.927+0000 7f2b8f69b640 1 -- 172.21.15.62:0/861385523 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b840aa830 con 0x559448a25020 2024-09-10T05:36:36.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.927+0000 7f2b92b979c0 1 -- 172.21.15.62:0/861385523 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559448a25020 msgr2=0x559448a23ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.927+0000 7f2b92b979c0 1 --2- 172.21.15.62:0/861385523 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559448a25020 0x559448a23ba0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f2b8400a5c0 tx=0x7f2b8401b2e0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.927+0000 7f2b92b979c0 1 -- 172.21.15.62:0/861385523 shutdown_connections 2024-09-10T05:36:36.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.927+0000 7f2b92b979c0 1 --2- 172.21.15.62:0/861385523 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559448a25020 0x559448a23ba0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.927+0000 7f2b92b979c0 1 -- 172.21.15.62:0/861385523 >> 172.21.15.62:0/861385523 conn(0x559448aa9ad0 msgr2=0x559448aabef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:36.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.931+0000 7f2b92b979c0 1 -- 172.21.15.62:0/861385523 shutdown_connections 2024-09-10T05:36:36.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.931+0000 7f2b92b979c0 1 -- 172.21.15.62:0/861385523 wait complete. 2024-09-10T05:36:36.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.943+0000 7f2b92b979c0 1 Processor -- start 2024-09-10T05:36:36.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.943+0000 7f2b92b979c0 1 -- start start 2024-09-10T05:36:36.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.943+0000 7f2b92b979c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559448a24af0 0x559448b9bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.943+0000 7f2b92b979c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5594489b6680 con 0x559448a24af0 2024-09-10T05:36:36.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.943+0000 7f2b9069d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559448a24af0 0x559448b9bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.947+0000 7f2b9069d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559448a24af0 0x559448b9bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47392/0 (socket says 172.21.15.62:47392) 2024-09-10T05:36:36.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.947+0000 7f2b9069d640 1 -- 172.21.15.62:0/802592468 learned_addr learned my addr 172.21.15.62:0/802592468 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:36.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.947+0000 7f2b9069d640 1 -- 172.21.15.62:0/802592468 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559448931da0 con 0x559448a24af0 2024-09-10T05:36:36.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.947+0000 7f2b9069d640 1 --2- 172.21.15.62:0/802592468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559448a24af0 0x559448b9bb50 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2b8000b2d0 tx=0x7f2b8000b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cdf86a6ba86cdbb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.947+0000 7f2a7e60c640 1 -- 172.21.15.62:0/802592468 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b8000a040 con 0x559448a24af0 2024-09-10T05:36:36.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.947+0000 7f2a7e60c640 1 -- 172.21.15.62:0/802592468 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b8000f750 con 0x559448a24af0 2024-09-10T05:36:36.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.947+0000 7f2a7e60c640 1 -- 172.21.15.62:0/802592468 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b8000fa70 con 0x559448a24af0 2024-09-10T05:36:36.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.947+0000 7f2b92b979c0 1 -- 172.21.15.62:0/802592468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559448a24af0 msgr2=0x559448b9bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.947+0000 7f2b92b979c0 1 --2- 172.21.15.62:0/802592468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559448a24af0 0x559448b9bb50 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2b8000b2d0 tx=0x7f2b8000b790 comp rx=0 tx=0).stop 2024-09-10T05:36:36.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.947+0000 7f2b92b979c0 1 -- 172.21.15.62:0/802592468 shutdown_connections 2024-09-10T05:36:36.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.947+0000 7f2b92b979c0 1 --2- 172.21.15.62:0/802592468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559448a24af0 0x559448b9bb50 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.947+0000 7f2b92b979c0 1 -- 172.21.15.62:0/802592468 >> 172.21.15.62:0/802592468 conn(0x559448aa9ad0 msgr2=0x559448b977f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:36.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.947+0000 7f2b92b979c0 1 -- 172.21.15.62:0/802592468 shutdown_connections 2024-09-10T05:36:36.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.947+0000 7f2b92b979c0 1 -- 172.21.15.62:0/802592468 wait complete. 2024-09-10T05:36:36.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.947+0000 7f2b92b979c0 1 Processor -- start 2024-09-10T05:36:36.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.947+0000 7f2b92b979c0 1 -- start start 2024-09-10T05:36:36.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.947+0000 7f2b92b979c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559448a24af0 0x559448ba31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.947+0000 7f2b92b979c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559448958a50 con 0x559448a24af0 2024-09-10T05:36:36.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.947+0000 7f2b9069d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559448a24af0 0x559448ba31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.947+0000 7f2b9069d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559448a24af0 0x559448ba31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47406/0 (socket says 172.21.15.62:47406) 2024-09-10T05:36:36.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.947+0000 7f2b9069d640 1 -- 172.21.15.62:0/2468037875 learned_addr learned my addr 172.21.15.62:0/2468037875 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:36.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.947+0000 7f2b9069d640 1 -- 172.21.15.62:0/2468037875 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559448ba3740 con 0x559448a24af0 2024-09-10T05:36:36.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.947+0000 7f2b9069d640 1 --2- 172.21.15.62:0/2468037875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559448a24af0 0x559448ba31e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2b80000c10 tx=0x7f2b80000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.951+0000 7f2a7ce09640 1 -- 172.21.15.62:0/2468037875 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b8001c9f0 con 0x559448a24af0 2024-09-10T05:36:36.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.951+0000 7f2a7ce09640 1 -- 172.21.15.62:0/2468037875 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b8001cb90 con 0x559448a24af0 2024-09-10T05:36:36.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.951+0000 7f2a7ce09640 1 -- 172.21.15.62:0/2468037875 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b8001a480 con 0x559448a24af0 2024-09-10T05:36:36.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.951+0000 7f2b92b979c0 1 -- 172.21.15.62:0/2468037875 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559448ba39d0 con 0x559448a24af0 2024-09-10T05:36:36.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.951+0000 7f2b92b979c0 1 -- 172.21.15.62:0/2468037875 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559448ba4380 con 0x559448a24af0 2024-09-10T05:36:36.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.951+0000 7f2a7ce09640 1 -- 172.21.15.62:0/2468037875 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2b80017050 con 0x559448a24af0 2024-09-10T05:36:36.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.951+0000 7f2a7ce09640 1 --2- 172.21.15.62:0/2468037875 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2a78039a70 0x7f2a7803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.951+0000 7f2a7ce09640 1 -- 172.21.15.62:0/2468037875 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f2b80015020 con 0x559448a24af0 2024-09-10T05:36:36.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.951+0000 7f2b8fe9c640 1 --2- 172.21.15.62:0/2468037875 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2a78039a70 0x7f2a7803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.951+0000 7f2b92b979c0 1 --2- 172.21.15.62:0/2468037875 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x559448a25020 0x559448baa350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.951+0000 7f2b92b979c0 1 -- 172.21.15.62:0/2468037875 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559448baa890 con 0x559448a25020 2024-09-10T05:36:36.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.951+0000 7f2b90e9e640 1 --2- 172.21.15.62:0/2468037875 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x559448a25020 0x559448baa350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.951+0000 7f2b8fe9c640 1 --2- 172.21.15.62:0/2468037875 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2a78039a70 0x7f2a7803bf30 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2b840ae000 tx=0x7f2b840a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.951+0000 7f2b90e9e640 1 --2- 172.21.15.62:0/2468037875 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x559448a25020 0x559448baa350 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.951+0000 7f2b90e9e640 1 -- 172.21.15.62:0/2468037875 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b8800a4d0 con 0x559448a25020 2024-09-10T05:36:36.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.951+0000 7f2b92b979c0 1 --2- 172.21.15.62:0/2468037875 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x559448bab5f0 0x559448bad9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.951+0000 7f2b92b979c0 1 -- 172.21.15.62:0/2468037875 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559448badfd0 con 0x559448bab5f0 2024-09-10T05:36:36.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.951+0000 7f2b9069d640 1 --2- 172.21.15.62:0/2468037875 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x559448bab5f0 0x559448bad9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.955+0000 7f2b9069d640 1 --2- 172.21.15.62:0/2468037875 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x559448bab5f0 0x559448bad9e0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.955+0000 7f2b9069d640 1 -- 172.21.15.62:0/2468037875 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2b8002e070 con 0x559448bab5f0 2024-09-10T05:36:36.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.955+0000 7f2b92b979c0 1 --2- 172.21.15.62:0/2468037875 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x559448bafd90 0x559448bb2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.955+0000 7f2b92b979c0 1 -- 172.21.15.62:0/2468037875 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559448bb2870 con 0x559448bafd90 2024-09-10T05:36:36.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.955+0000 7f2b8fe9c640 1 --2- 172.21.15.62:0/2468037875 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x559448bafd90 0x559448bb2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.955+0000 7f2b8fe9c640 1 --2- 172.21.15.62:0/2468037875 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x559448bafd90 0x559448bb2180 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.955+0000 7f2b8fe9c640 1 -- 172.21.15.62:0/2468037875 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2b840aaa10 con 0x559448bafd90 2024-09-10T05:36:36.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.955+0000 7f2b92b979c0 1 -- 172.21.15.62:0/2468037875 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559448baec30 con 0x559448bab5f0 2024-09-10T05:36:36.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.955+0000 7f2b9069d640 1 -- 172.21.15.62:0/2468037875 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2b8002e070 con 0x559448bab5f0 2024-09-10T05:36:36.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.955+0000 7f2b92b979c0 1 -- 172.21.15.62:0/2468037875 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559448baf090 con 0x559448bafd90 2024-09-10T05:36:36.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.955+0000 7f2b8fe9c640 1 -- 172.21.15.62:0/2468037875 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2b840aaa10 con 0x559448bafd90 2024-09-10T05:36:36.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.955+0000 7f2b92b979c0 1 Processor -- start 2024-09-10T05:36:36.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.955+0000 7f2b92b979c0 1 -- start start 2024-09-10T05:36:36.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.955+0000 7f2b92b979c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559448bc0eb0 0x559448bc12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.955+0000 7f2b92b979c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5594489c3450 con 0x559448bc0eb0 2024-09-10T05:36:36.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.955+0000 7f2b9069d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559448bc0eb0 0x559448bc12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.955+0000 7f2b9069d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559448bc0eb0 0x559448bc12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47412/0 (socket says 172.21.15.62:47412) 2024-09-10T05:36:36.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.959+0000 7f2b9069d640 1 -- 172.21.15.62:0/3091695470 learned_addr learned my addr 172.21.15.62:0/3091695470 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:36.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.959+0000 7f2b9069d640 1 -- 172.21.15.62:0/3091695470 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559448bc1910 con 0x559448bc0eb0 2024-09-10T05:36:36.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.959+0000 7f2b9069d640 1 --2- 172.21.15.62:0/3091695470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559448bc0eb0 0x559448bc12d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2b80001750 tx=0x7f2b80050480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.959+0000 7f2a75ffb640 1 -- 172.21.15.62:0/3091695470 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b8000eda0 con 0x559448bc0eb0 2024-09-10T05:36:36.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.959+0000 7f2a75ffb640 1 -- 172.21.15.62:0/3091695470 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b80041e50 con 0x559448bc0eb0 2024-09-10T05:36:36.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.959+0000 7f2b92b979c0 1 -- 172.21.15.62:0/3091695470 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559448bc2170 con 0x559448bc0eb0 2024-09-10T05:36:36.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.959+0000 7f2a75ffb640 1 -- 172.21.15.62:0/3091695470 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b80019a50 con 0x559448bc0eb0 2024-09-10T05:36:36.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.959+0000 7f2b92b979c0 1 -- 172.21.15.62:0/3091695470 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559448bc2170 con 0x559448bc0eb0 2024-09-10T05:36:36.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.959+0000 7f2a75ffb640 1 -- 172.21.15.62:0/3091695470 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2b8003a030 con 0x559448bc0eb0 2024-09-10T05:36:36.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.959+0000 7f2a75ffb640 1 --2- 172.21.15.62:0/3091695470 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2a68039ac0 0x7f2a6803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.959+0000 7f2a75ffb640 1 -- 172.21.15.62:0/3091695470 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f2b80038070 con 0x559448bc0eb0 2024-09-10T05:36:36.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.959+0000 7f2b8fe9c640 1 --2- 172.21.15.62:0/3091695470 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2a68039ac0 0x7f2a6803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.959+0000 7f2b92b979c0 1 Processor -- start 2024-09-10T05:36:36.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.959+0000 7f2b92b979c0 1 -- start start 2024-09-10T05:36:36.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.959+0000 7f2b8fe9c640 1 --2- 172.21.15.62:0/3091695470 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2a68039ac0 0x7f2a6803bf80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x559448ba4630 tx=0x7f2b84005ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.959+0000 7f2b92b979c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559448bcd460 0x559448bcd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.959+0000 7f2b92b979c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559448b9c380 con 0x559448bcd460 2024-09-10T05:36:36.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.959+0000 7f2b9069d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559448bcd460 0x559448bcd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.963+0000 7f2b9069d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559448bcd460 0x559448bcd840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47428/0 (socket says 172.21.15.62:47428) 2024-09-10T05:36:36.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.963+0000 7f2b9069d640 1 -- 172.21.15.62:0/868001849 learned_addr learned my addr 172.21.15.62:0/868001849 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:36.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.963+0000 7f2b9069d640 1 -- 172.21.15.62:0/868001849 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559448bcde10 con 0x559448bcd460 2024-09-10T05:36:36.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.963+0000 7f2b9069d640 1 --2- 172.21.15.62:0/868001849 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559448bcd460 0x559448bcd840 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f2b80048270 tx=0x7f2b80031f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ad93084a69ddbb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.963+0000 7f2a6f7fe640 1 -- 172.21.15.62:0/868001849 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b80047b80 con 0x559448bcd460 2024-09-10T05:36:36.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.963+0000 7f2a6f7fe640 1 -- 172.21.15.62:0/868001849 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b80041060 con 0x559448bcd460 2024-09-10T05:36:36.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.963+0000 7f2a6f7fe640 1 -- 172.21.15.62:0/868001849 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b80047d20 con 0x559448bcd460 2024-09-10T05:36:36.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.963+0000 7f2b92b979c0 1 -- 172.21.15.62:0/868001849 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559448bcd460 msgr2=0x559448bcd840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:36.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.963+0000 7f2b92b979c0 1 --2- 172.21.15.62:0/868001849 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559448bcd460 0x559448bcd840 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f2b80048270 tx=0x7f2b80031f60 comp rx=0 tx=0).stop 2024-09-10T05:36:36.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.963+0000 7f2b92b979c0 1 -- 172.21.15.62:0/868001849 shutdown_connections 2024-09-10T05:36:36.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.963+0000 7f2b92b979c0 1 --2- 172.21.15.62:0/868001849 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559448bcd460 0x559448bcd840 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:36.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.963+0000 7f2b92b979c0 1 -- 172.21.15.62:0/868001849 >> 172.21.15.62:0/868001849 conn(0x559448bc9890 msgr2=0x559448bc7ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:36.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.963+0000 7f2b92b979c0 1 -- 172.21.15.62:0/868001849 shutdown_connections 2024-09-10T05:36:36.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.963+0000 7f2b92b979c0 1 -- 172.21.15.62:0/868001849 wait complete. 2024-09-10T05:36:36.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.963+0000 7f2b92b979c0 1 Processor -- start 2024-09-10T05:36:36.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.963+0000 7f2b92b979c0 1 -- start start 2024-09-10T05:36:36.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.963+0000 7f2b92b979c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559448bcd460 0x559448bd47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.963+0000 7f2b92b979c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559448bce2f0 con 0x559448bcd460 2024-09-10T05:36:36.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.963+0000 7f2b9069d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559448bcd460 0x559448bd47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.963+0000 7f2b9069d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559448bcd460 0x559448bd47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47432/0 (socket says 172.21.15.62:47432) 2024-09-10T05:36:36.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.963+0000 7f2b9069d640 1 -- 172.21.15.62:0/431762482 learned_addr learned my addr 172.21.15.62:0/431762482 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:36.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.963+0000 7f2b9069d640 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559448bd4d00 con 0x559448bcd460 2024-09-10T05:36:36.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.963+0000 7f2b9069d640 1 --2- 172.21.15.62:0/431762482 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559448bcd460 0x559448bd47a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2b80052010 tx=0x7f2b80019f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.963+0000 7f2a6dffb640 1 -- 172.21.15.62:0/431762482 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b8001a870 con 0x559448bcd460 2024-09-10T05:36:36.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.963+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559448bd4d00 con 0x559448bcd460 2024-09-10T05:36:36.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.963+0000 7f2a6dffb640 1 -- 172.21.15.62:0/431762482 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b8006d030 con 0x559448bcd460 2024-09-10T05:36:36.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.963+0000 7f2a6dffb640 1 -- 172.21.15.62:0/431762482 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b80047210 con 0x559448bcd460 2024-09-10T05:36:36.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.963+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559448bd52d0 con 0x559448bcd460 2024-09-10T05:36:36.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.967+0000 7f2a6dffb640 1 -- 172.21.15.62:0/431762482 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2b80064040 con 0x559448bcd460 2024-09-10T05:36:36.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.967+0000 7f2b92b979c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.967+0000 7f2a6dffb640 1 --2- 172.21.15.62:0/431762482 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2a60039ac0 0x7f2a6003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.967+0000 7f2a6dffb640 1 -- 172.21.15.62:0/431762482 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f2b80057040 con 0x559448bcd460 2024-09-10T05:36:36.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.967+0000 7f2b8fe9c640 1 --2- 172.21.15.62:0/431762482 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2a60039ac0 0x7f2a6003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.967+0000 7f2b92b979c0 1 --2- 172.21.15.62:0/431762482 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x559448bdf6b0 0x559448be1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.967+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559448be2290 con 0x559448bdf6b0 2024-09-10T05:36:36.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.967+0000 7f2b90e9e640 1 --2- 172.21.15.62:0/431762482 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x559448bdf6b0 0x559448be1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.967+0000 7f2b8fe9c640 1 --2- 172.21.15.62:0/431762482 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2a60039ac0 0x7f2a6003bf80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2b8401b320 tx=0x7f2b840c2040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.967+0000 7f2b90e9e640 1 --2- 172.21.15.62:0/431762482 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x559448bdf6b0 0x559448be1b40 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.967+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b8800a4d0 con 0x559448bdf6b0 2024-09-10T05:36:36.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.967+0000 7f2b92b979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:36.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.967+0000 7f2b92b979c0 20 realm 2024-09-10T05:36:36.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.967+0000 7f2b92b979c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.967+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559448bdeaa0 con 0x559448bdf6b0 2024-09-10T05:36:36.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.967+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b8800a4d0 con 0x559448bdf6b0 2024-09-10T05:36:36.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.967+0000 7f2b92b979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:36.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.967+0000 7f2b92b979c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:36.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.967+0000 7f2b92b979c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.967+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559448be2d50 con 0x559448bdf6b0 2024-09-10T05:36:36.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.967+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b8800a4d0 con 0x559448bdf6b0 2024-09-10T05:36:36.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.967+0000 7f2b92b979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:36.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.967+0000 7f2b92b979c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.967+0000 7f2b92b979c0 1 --2- 172.21.15.62:0/431762482 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x559448be3b30 0x559448be5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.967+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559448be65f0 con 0x559448be3b30 2024-09-10T05:36:36.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.967+0000 7f2b9069d640 1 --2- 172.21.15.62:0/431762482 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x559448be3b30 0x559448be5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.971+0000 7f2b9069d640 1 --2- 172.21.15.62:0/431762482 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x559448be3b30 0x559448be5f20 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.971+0000 7f2b9069d640 1 -- 172.21.15.62:0/431762482 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2b80079070 con 0x559448be3b30 2024-09-10T05:36:36.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.971+0000 7f2b92b979c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:36.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.971+0000 7f2b92b979c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.971+0000 7f2b92b979c0 1 --2- 172.21.15.62:0/431762482 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x559448be7350 0x559448be9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.971+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559448be9ef0 con 0x559448be7350 2024-09-10T05:36:36.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.971+0000 7f2b8fe9c640 1 --2- 172.21.15.62:0/431762482 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x559448be7350 0x559448be9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.971+0000 7f2b8fe9c640 1 --2- 172.21.15.62:0/431762482 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x559448be7350 0x559448be9760 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.971+0000 7f2b8fe9c640 1 -- 172.21.15.62:0/431762482 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2b840aaa10 con 0x559448be7350 2024-09-10T05:36:36.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.971+0000 7f2b92b979c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:36.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.971+0000 7f2b92b979c0 20 searching for the correct realm 2024-09-10T05:36:36.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.971+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559448beb7c0 con 0x559448be7350 2024-09-10T05:36:36.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.971+0000 7f2b8fe9c640 1 -- 172.21.15.62:0/431762482 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b840aaa10 con 0x559448be7350 2024-09-10T05:36:36.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.971+0000 7f2b8fe9c640 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559448beb7c0 con 0x559448be3b30 2024-09-10T05:36:36.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.971+0000 7f2b9069d640 1 -- 172.21.15.62:0/431762482 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b80079070 con 0x559448be3b30 2024-09-10T05:36:36.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.971+0000 7f2b9069d640 1 --2- 172.21.15.62:0/431762482 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f2b80068870 0x7f2b800437e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:36.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.971+0000 7f2b9069d640 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559448beb7c0 con 0x7f2b80068870 2024-09-10T05:36:36.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.971+0000 7f2b90e9e640 1 --2- 172.21.15.62:0/431762482 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f2b80068870 0x7f2b800437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:36.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.971+0000 7f2b90e9e640 1 --2- 172.21.15.62:0/431762482 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f2b80068870 0x7f2b800437e0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:36.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.975+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b8800a4d0 con 0x7f2b80068870 2024-09-10T05:36:36.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.975+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559448beb7c0 con 0x559448bdf6b0 2024-09-10T05:36:36.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.975+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b8800a4d0 con 0x559448bdf6b0 2024-09-10T05:36:36.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.975+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559448beb7c0 con 0x559448bdf6b0 2024-09-10T05:36:36.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.975+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b8800a4d0 con 0x559448bdf6b0 2024-09-10T05:36:36.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.975+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559448beb7c0 con 0x559448be7350 2024-09-10T05:36:36.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.975+0000 7f2b8fe9c640 1 -- 172.21.15.62:0/431762482 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b840aaa10 con 0x559448be7350 2024-09-10T05:36:36.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.975+0000 7f2b8fe9c640 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559448beb7c0 con 0x559448bdf6b0 2024-09-10T05:36:36.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.975+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b8800a4d0 con 0x559448bdf6b0 2024-09-10T05:36:36.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.975+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559448beb7c0 con 0x559448be3b30 2024-09-10T05:36:36.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.975+0000 7f2b9069d640 1 -- 172.21.15.62:0/431762482 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b80079070 con 0x559448be3b30 2024-09-10T05:36:36.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.975+0000 7f2b9069d640 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559448beb7c0 con 0x559448be3b30 2024-09-10T05:36:36.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.975+0000 7f2b9069d640 1 -- 172.21.15.62:0/431762482 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b80079070 con 0x559448be3b30 2024-09-10T05:36:36.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.975+0000 7f2b9069d640 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559448beb7c0 con 0x559448bdf6b0 2024-09-10T05:36:36.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.975+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b8800a4d0 con 0x559448bdf6b0 2024-09-10T05:36:36.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.975+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559448beb7c0 con 0x7f2b80068870 2024-09-10T05:36:36.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.975+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b8800a4d0 con 0x7f2b80068870 2024-09-10T05:36:36.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.975+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559448beb7c0 con 0x559448bdf6b0 2024-09-10T05:36:36.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.975+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b8800a4d0 con 0x559448bdf6b0 2024-09-10T05:36:36.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.975+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559448beb7c0 con 0x7f2b80068870 2024-09-10T05:36:36.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.979+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2b8800a4d0 con 0x7f2b80068870 2024-09-10T05:36:36.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.979+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559448beb7c0 con 0x559448be3b30 2024-09-10T05:36:36.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.979+0000 7f2b9069d640 1 -- 172.21.15.62:0/431762482 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b80079070 con 0x559448be3b30 2024-09-10T05:36:36.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.979+0000 7f2b9069d640 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559448beb7c0 con 0x559448be7350 2024-09-10T05:36:36.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.979+0000 7f2b8fe9c640 1 -- 172.21.15.62:0/431762482 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b840aaa10 con 0x559448be7350 2024-09-10T05:36:36.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.979+0000 7f2b8fe9c640 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559448beb7c0 con 0x559448bdf6b0 2024-09-10T05:36:36.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.979+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b8800a4d0 con 0x559448bdf6b0 2024-09-10T05:36:36.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.979+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559448beb7c0 con 0x559448be3b30 2024-09-10T05:36:36.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.979+0000 7f2b9069d640 1 -- 172.21.15.62:0/431762482 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b80079070 con 0x559448be3b30 2024-09-10T05:36:36.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.979+0000 7f2b9069d640 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559448beb7c0 con 0x559448be7350 2024-09-10T05:36:36.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.979+0000 7f2b8fe9c640 1 -- 172.21.15.62:0/431762482 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 30 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f2b840aaa10 con 0x559448be7350 2024-09-10T05:36:36.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.979+0000 7f2b8fe9c640 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559448beb7c0 con 0x559448bdf6b0 2024-09-10T05:36:36.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.979+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b8800a4d0 con 0x559448bdf6b0 2024-09-10T05:36:36.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.979+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559448beb7c0 con 0x559448bdf6b0 2024-09-10T05:36:36.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.979+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2b8800a4d0 con 0x559448bdf6b0 2024-09-10T05:36:36.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.979+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559448beb7c0 con 0x559448bdf6b0 2024-09-10T05:36:36.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.979+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b8800a4d0 con 0x559448bdf6b0 2024-09-10T05:36:36.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.979+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559448beb7c0 con 0x559448be7350 2024-09-10T05:36:36.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.979+0000 7f2b8fe9c640 1 -- 172.21.15.62:0/431762482 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b840aaa10 con 0x559448be7350 2024-09-10T05:36:36.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.979+0000 7f2b8fe9c640 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559448beb7c0 con 0x7f2b80068870 2024-09-10T05:36:36.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.983+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b8800a4d0 con 0x7f2b80068870 2024-09-10T05:36:36.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.983+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559448beb7c0 con 0x559448bdf6b0 2024-09-10T05:36:36.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.983+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b8800a4d0 con 0x559448bdf6b0 2024-09-10T05:36:36.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.983+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559448beb7c0 con 0x7f2b80068870 2024-09-10T05:36:36.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.983+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b8800a4d0 con 0x7f2b80068870 2024-09-10T05:36:36.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.983+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559448beb7c0 con 0x559448be7350 2024-09-10T05:36:36.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.983+0000 7f2b8fe9c640 1 -- 172.21.15.62:0/431762482 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b840aaa10 con 0x559448be7350 2024-09-10T05:36:36.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.983+0000 7f2b8fe9c640 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559448beb7c0 con 0x7f2b80068870 2024-09-10T05:36:36.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.983+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b8800a4d0 con 0x7f2b80068870 2024-09-10T05:36:36.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.983+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559448beb7c0 con 0x559448be3b30 2024-09-10T05:36:36.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.983+0000 7f2b9069d640 1 -- 172.21.15.62:0/431762482 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b80079070 con 0x559448be3b30 2024-09-10T05:36:36.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.983+0000 7f2b9069d640 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559448beb7c0 con 0x559448be3b30 2024-09-10T05:36:36.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.983+0000 7f2b9069d640 1 -- 172.21.15.62:0/431762482 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b80079070 con 0x559448be3b30 2024-09-10T05:36:36.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.983+0000 7f2b9069d640 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559448beb7c0 con 0x559448be7350 2024-09-10T05:36:36.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.983+0000 7f2b8fe9c640 1 -- 172.21.15.62:0/431762482 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b840aaa10 con 0x559448be7350 2024-09-10T05:36:36.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.983+0000 7f2b8fe9c640 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559448beb7c0 con 0x559448be3b30 2024-09-10T05:36:36.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.983+0000 7f2b9069d640 1 -- 172.21.15.62:0/431762482 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2b80079070 con 0x559448be3b30 2024-09-10T05:36:36.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.983+0000 7f2b9069d640 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559448beb7c0 con 0x559448be3b30 2024-09-10T05:36:36.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.987+0000 7f2b9069d640 1 -- 172.21.15.62:0/431762482 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b80079070 con 0x559448be3b30 2024-09-10T05:36:36.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.987+0000 7f2b92b979c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:36.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.987+0000 7f2b92b979c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:36.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.987+0000 7f2b92b979c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:36.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.987+0000 7f2b92b979c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:36.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.987+0000 7f2b92b979c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:36.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.987+0000 7f2b92b979c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:36.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.987+0000 7f2b92b979c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.987+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559448bea8b0 con 0x559448bdf6b0 2024-09-10T05:36:36.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.987+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b8800a4d0 con 0x559448bdf6b0 2024-09-10T05:36:36.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.987+0000 7f2b92b979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:36.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.987+0000 7f2b92b979c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.987+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559448bead30 con 0x559448be3b30 2024-09-10T05:36:36.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.987+0000 7f2b9069d640 1 -- 172.21.15.62:0/431762482 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2b80079070 con 0x559448be3b30 2024-09-10T05:36:36.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.987+0000 7f2b92b979c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:36.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.987+0000 7f2b92b979c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.987+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559448bea450 con 0x559448be7350 2024-09-10T05:36:36.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.987+0000 7f2b8fe9c640 1 -- 172.21.15.62:0/431762482 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2b840aaa10 con 0x559448be7350 2024-09-10T05:36:36.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.987+0000 7f2b92b979c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:36.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.987+0000 7f2b92b979c0 20 zone default found 2024-09-10T05:36:36.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.987+0000 7f2b92b979c0 4 Realm: () 2024-09-10T05:36:36.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.987+0000 7f2b92b979c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:36.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.987+0000 7f2b92b979c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:36.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.987+0000 7f2b92b979c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:36.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.987+0000 7f2b92b979c0 20 zonegroup default 2024-09-10T05:36:36.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.987+0000 7f2b92b979c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.987+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559448bec0a0 con 0x7f2b80068870 2024-09-10T05:36:36.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.987+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2b8800a4d0 con 0x7f2b80068870 2024-09-10T05:36:36.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.987+0000 7f2b92b979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:36.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.987+0000 7f2b92b979c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.987+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559448bee2e0 con 0x559448be7350 2024-09-10T05:36:36.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.987+0000 7f2b8fe9c640 1 -- 172.21.15.62:0/431762482 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2b840aaa10 con 0x559448be7350 2024-09-10T05:36:36.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.987+0000 7f2b92b979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:36.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.987+0000 7f2b92b979c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:36.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.987+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559448bee680 con 0x559448be7350 2024-09-10T05:36:36.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.987+0000 7f2b8fe9c640 1 -- 172.21.15.62:0/431762482 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2b840aaa10 con 0x559448be7350 2024-09-10T05:36:36.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.987+0000 7f2b92b979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:36.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.987+0000 7f2b92b979c0 20 started sync module instance, tier type = 2024-09-10T05:36:36.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.987+0000 7f2b92b979c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:36.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.987+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448bed720 con 0x559448be3b30 2024-09-10T05:36:36.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.991+0000 7f2b9069d640 1 -- 172.21.15.62:0/431762482 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b80079070 con 0x559448be3b30 2024-09-10T05:36:36.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.991+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94095363986304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448bedd30 con 0x559448be3b30 2024-09-10T05:36:36.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.991+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448beeca0 con 0x559448bdf6b0 2024-09-10T05:36:36.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.991+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b8800a4d0 con 0x559448bdf6b0 2024-09-10T05:36:36.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.991+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94095363991536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448bef4f0 con 0x559448bdf6b0 2024-09-10T05:36:37.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.991+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448befeb0 con 0x559448be3b30 2024-09-10T05:36:37.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.991+0000 7f2b9069d640 1 -- 172.21.15.62:0/431762482 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94095363986304] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b80079070 con 0x559448be3b30 2024-09-10T05:36:37.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.991+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94095363991536] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b8800a4d0 con 0x559448bdf6b0 2024-09-10T05:36:37.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.995+0000 7f2b9069d640 1 -- 172.21.15.62:0/431762482 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b80079070 con 0x559448be3b30 2024-09-10T05:36:37.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.995+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94095363996160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448bef4f0 con 0x559448be3b30 2024-09-10T05:36:37.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.995+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448befe60 con 0x7f2b80068870 2024-09-10T05:36:37.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.995+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b8800a4d0 con 0x7f2b80068870 2024-09-10T05:36:37.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.995+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94095363998368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448befe20 con 0x7f2b80068870 2024-09-10T05:36:37.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.995+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448bf1230 con 0x559448be3b30 2024-09-10T05:36:37.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.995+0000 7f2b9069d640 1 -- 172.21.15.62:0/431762482 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94095363996160] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b80079070 con 0x559448be3b30 2024-09-10T05:36:37.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.995+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94095363998368] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b8800a4d0 con 0x7f2b80068870 2024-09-10T05:36:37.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.999+0000 7f2b9069d640 1 -- 172.21.15.62:0/431762482 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b80079070 con 0x559448be3b30 2024-09-10T05:36:37.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.999+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94095364001088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448bf1230 con 0x559448be3b30 2024-09-10T05:36:37.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.999+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448bf1650 con 0x559448be7350 2024-09-10T05:36:37.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.999+0000 7f2b8fe9c640 1 -- 172.21.15.62:0/431762482 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b840aaa10 con 0x559448be7350 2024-09-10T05:36:37.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.999+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94095363999424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448bf1b00 con 0x559448be7350 2024-09-10T05:36:37.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.999+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448bf24c0 con 0x559448be7350 2024-09-10T05:36:37.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.999+0000 7f2b9069d640 1 -- 172.21.15.62:0/431762482 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94095364001088] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b80079070 con 0x559448be3b30 2024-09-10T05:36:37.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.999+0000 7f2b8fe9c640 1 -- 172.21.15.62:0/431762482 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94095363999424] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b840aaa10 con 0x559448be7350 2024-09-10T05:36:37.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.999+0000 7f2b8fe9c640 1 -- 172.21.15.62:0/431762482 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b840aaa10 con 0x559448be7350 2024-09-10T05:36:37.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.999+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94095364005904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448bf1b00 con 0x559448be7350 2024-09-10T05:36:37.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:36.999+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448bf2470 con 0x7f2b80068870 2024-09-10T05:36:37.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.003+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b8800a4d0 con 0x7f2b80068870 2024-09-10T05:36:37.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.003+0000 7f2b8fe9c640 1 -- 172.21.15.62:0/431762482 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94095364005904] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b840aaa10 con 0x559448be7350 2024-09-10T05:36:37.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.003+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94095364008112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448bf2430 con 0x7f2b80068870 2024-09-10T05:36:37.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.003+0000 7f2b92b979c0 20 add_watcher() i=0 2024-09-10T05:36:37.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.003+0000 7f2b92b979c0 20 add_watcher() i=1 2024-09-10T05:36:37.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.003+0000 7f2b92b979c0 20 add_watcher() i=2 2024-09-10T05:36:37.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.003+0000 7f2b92b979c0 20 add_watcher() i=3 2024-09-10T05:36:37.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.003+0000 7f2b92b979c0 20 add_watcher() i=4 2024-09-10T05:36:37.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.003+0000 7f2b92b979c0 20 add_watcher() i=5 2024-09-10T05:36:37.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.003+0000 7f2b92b979c0 20 add_watcher() i=6 2024-09-10T05:36:37.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.003+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94095364008112] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b8800a4d0 con 0x7f2b80068870 2024-09-10T05:36:37.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.003+0000 7f2b92b979c0 20 add_watcher() i=7 2024-09-10T05:36:37.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.003+0000 7f2b92b979c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:37.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.003+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559448bf2430 con 0x559448bdf6b0 2024-09-10T05:36:37.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.003+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2b8800a4d0 con 0x559448bdf6b0 2024-09-10T05:36:37.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.003+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94095364006960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448bf32d0 con 0x559448bdf6b0 2024-09-10T05:36:37.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.007+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94095364006960] v30'118 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2b8800a4d0 con 0x559448bdf6b0 2024-09-10T05:36:37.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.007+0000 7f2a467e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:37.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.007+0000 7f2b92b979c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:37.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.007+0000 7f2b92b979c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:37.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.007+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448bfe5f0 con 0x559448be3b30 2024-09-10T05:36:37.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.007+0000 7f2b9069d640 1 -- 172.21.15.62:0/431762482 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'44 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2b80079070 con 0x559448be3b30 2024-09-10T05:36:37.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.007+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448bfe700 con 0x7f2b80068870 2024-09-10T05:36:37.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.011+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2b8800a4d0 con 0x7f2b80068870 2024-09-10T05:36:37.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.011+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448bfee10 con 0x559448be7350 2024-09-10T05:36:37.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.011+0000 7f2b8fe9c640 1 -- 172.21.15.62:0/431762482 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2b840aaa10 con 0x559448be7350 2024-09-10T05:36:37.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.011+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448bff2c0 con 0x559448bdf6b0 2024-09-10T05:36:37.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.015+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'119 uv12 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2b8800a4d0 con 0x559448bdf6b0 2024-09-10T05:36:37.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.015+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448bfc490 con 0x559448be3b30 2024-09-10T05:36:37.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.015+0000 7f2b9069d640 1 -- 172.21.15.62:0/431762482 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'38 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2b80079070 con 0x559448be3b30 2024-09-10T05:36:37.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.015+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448bfc490 con 0x559448be7350 2024-09-10T05:36:37.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.019+0000 7f2b8fe9c640 1 -- 172.21.15.62:0/431762482 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'33 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2b840aaa10 con 0x559448be7350 2024-09-10T05:36:37.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.019+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448bfc490 con 0x559448be3b30 2024-09-10T05:36:37.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.019+0000 7f2b9069d640 1 -- 172.21.15.62:0/431762482 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2b80079070 con 0x559448be3b30 2024-09-10T05:36:37.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.019+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448bffe20 con 0x559448bdf6b0 2024-09-10T05:36:37.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.023+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'27 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2b8800a4d0 con 0x559448bdf6b0 2024-09-10T05:36:37.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.023+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448c002d0 con 0x559448be3b30 2024-09-10T05:36:37.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.023+0000 7f2b9069d640 1 -- 172.21.15.62:0/431762482 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2b80079070 con 0x559448be3b30 2024-09-10T05:36:37.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.023+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448c002d0 con 0x559448be3b30 2024-09-10T05:36:37.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.027+0000 7f2b9069d640 1 -- 172.21.15.62:0/431762482 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'20 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2b80079070 con 0x559448be3b30 2024-09-10T05:36:37.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.027+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448c002d0 con 0x559448be3b30 2024-09-10T05:36:37.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.027+0000 7f2b9069d640 1 -- 172.21.15.62:0/431762482 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'39 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b80079070 con 0x559448be3b30 2024-09-10T05:36:37.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.027+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448c002d0 con 0x559448be7350 2024-09-10T05:36:37.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.031+0000 7f2b8fe9c640 1 -- 172.21.15.62:0/431762482 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b840aaa10 con 0x559448be7350 2024-09-10T05:36:37.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.031+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448c002d0 con 0x559448be3b30 2024-09-10T05:36:37.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.031+0000 7f2b9069d640 1 -- 172.21.15.62:0/431762482 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b80079070 con 0x559448be3b30 2024-09-10T05:36:37.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.031+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448c002d0 con 0x559448bdf6b0 2024-09-10T05:36:37.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.035+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'39 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b8800a4d0 con 0x559448bdf6b0 2024-09-10T05:36:37.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.035+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448c008a0 con 0x559448bdf6b0 2024-09-10T05:36:37.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.035+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'120 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b8800a4d0 con 0x559448bdf6b0 2024-09-10T05:36:37.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.035+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448c007c0 con 0x559448be3b30 2024-09-10T05:36:37.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.039+0000 7f2b9069d640 1 -- 172.21.15.62:0/431762482 <== osd.0 v2:172.21.15.2:6800/945139080 25 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'33 uv16 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b80079070 con 0x559448be3b30 2024-09-10T05:36:37.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.039+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448c006c0 con 0x559448be3b30 2024-09-10T05:36:37.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.043+0000 7f2b9069d640 1 -- 172.21.15.62:0/431762482 <== osd.0 v2:172.21.15.2:6800/945139080 26 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'40 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b80079070 con 0x559448be3b30 2024-09-10T05:36:37.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.043+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448c006a0 con 0x559448be7350 2024-09-10T05:36:37.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.043+0000 7f2b8fe9c640 1 -- 172.21.15.62:0/431762482 <== osd.3 v2:172.21.15.62:6816/2708991149 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'26 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b840aaa10 con 0x559448be7350 2024-09-10T05:36:37.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.043+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448c007d0 con 0x559448be3b30 2024-09-10T05:36:37.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.047+0000 7f2b9069d640 1 -- 172.21.15.62:0/431762482 <== osd.0 v2:172.21.15.2:6800/945139080 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b80079070 con 0x559448be3b30 2024-09-10T05:36:37.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.047+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448c00790 con 0x559448bdf6b0 2024-09-10T05:36:37.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.047+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 <== osd.1 v2:172.21.15.62:6808/3442097179 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'121 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b8800a4d0 con 0x559448bdf6b0 2024-09-10T05:36:37.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.047+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448c00b90 con 0x559448be3b30 2024-09-10T05:36:37.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.051+0000 7f2b9069d640 1 -- 172.21.15.62:0/431762482 <== osd.0 v2:172.21.15.2:6800/945139080 28 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'34 uv18 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b80079070 con 0x559448be3b30 2024-09-10T05:36:37.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.051+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448c00a20 con 0x559448be3b30 2024-09-10T05:36:37.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.055+0000 7f2b9069d640 1 -- 172.21.15.62:0/431762482 <== osd.0 v2:172.21.15.2:6800/945139080 29 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'30 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b80079070 con 0x559448be3b30 2024-09-10T05:36:37.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.055+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448c009f0 con 0x559448be7350 2024-09-10T05:36:37.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.055+0000 7f2b8fe9c640 1 -- 172.21.15.62:0/431762482 <== osd.3 v2:172.21.15.62:6816/2708991149 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'22 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b840aaa10 con 0x559448be7350 2024-09-10T05:36:37.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.055+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448c00e40 con 0x559448be3b30 2024-09-10T05:36:37.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.059+0000 7f2b9069d640 1 -- 172.21.15.62:0/431762482 <== osd.0 v2:172.21.15.2:6800/945139080 30 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'33 uv18 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b80079070 con 0x559448be3b30 2024-09-10T05:36:37.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.059+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448c00dd0 con 0x559448be7350 2024-09-10T05:36:37.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.059+0000 7f2b8fe9c640 1 -- 172.21.15.62:0/431762482 <== osd.3 v2:172.21.15.62:6816/2708991149 21 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'16 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b840aaa10 con 0x559448be7350 2024-09-10T05:36:37.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.059+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448c00db0 con 0x559448be7350 2024-09-10T05:36:37.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.063+0000 7f2b8fe9c640 1 -- 172.21.15.62:0/431762482 <== osd.3 v2:172.21.15.62:6816/2708991149 22 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'34 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b840aaa10 con 0x559448be7350 2024-09-10T05:36:37.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.063+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448c00c40 con 0x559448be7350 2024-09-10T05:36:37.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.063+0000 7f2b8fe9c640 1 -- 172.21.15.62:0/431762482 <== osd.3 v2:172.21.15.62:6816/2708991149 23 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'22 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b840aaa10 con 0x559448be7350 2024-09-10T05:36:37.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.063+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448c00c20 con 0x559448be3b30 2024-09-10T05:36:37.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.067+0000 7f2b9069d640 1 -- 172.21.15.62:0/431762482 <== osd.0 v2:172.21.15.2:6800/945139080 31 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'26 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b80079070 con 0x559448be3b30 2024-09-10T05:36:37.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.067+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448c00be0 con 0x559448bdf6b0 2024-09-10T05:36:37.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.067+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 <== osd.1 v2:172.21.15.62:6808/3442097179 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'28 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b8800a4d0 con 0x559448bdf6b0 2024-09-10T05:36:37.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.067+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448c00be0 con 0x559448be3b30 2024-09-10T05:36:37.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.071+0000 7f2b9069d640 1 -- 172.21.15.62:0/431762482 <== osd.0 v2:172.21.15.2:6800/945139080 32 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'35 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b80079070 con 0x559448be3b30 2024-09-10T05:36:37.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.071+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448c00be0 con 0x559448bdf6b0 2024-09-10T05:36:37.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.071+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 <== osd.1 v2:172.21.15.62:6808/3442097179 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'40 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b8800a4d0 con 0x559448bdf6b0 2024-09-10T05:36:37.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.071+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448c00c20 con 0x7f2b80068870 2024-09-10T05:36:37.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.075+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b8800a4d0 con 0x7f2b80068870 2024-09-10T05:36:37.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.075+0000 7f2a457e2640 20 reqs_thread_entry: start 2024-09-10T05:36:37.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.075+0000 7f2b92b979c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:37.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.075+0000 7f2b92b979c0 20 Filter name: none 2024-09-10T05:36:37.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.075+0000 7f29b6ffd640 20 reqs_thread_entry: start 2024-09-10T05:36:37.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.075+0000 7f2b92b979c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-10T05:36:37.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.075+0000 7f2b92b979c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.075+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559448bfb7c0 con 0x7f2b80068870 2024-09-10T05:36:37.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.075+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f2b8800a4d0 con 0x7f2b80068870 2024-09-10T05:36:37.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.075+0000 7f2b92b979c0 20 rados_obj.operate() r=0 bl.length=380 2024-09-10T05:36:37.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.075+0000 7f2b92b979c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-10T05:36:37.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.075+0000 7f2b92b979c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T05:36:37.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.075+0000 7f2b92b979c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:36:37.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.075+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559448c1e7c0 con 0x559448bdf6b0 2024-09-10T05:36:37.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.075+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 <== osd.1 v2:172.21.15.62:6808/3442097179 26 ==== osd_op_reply(95 fud.buckets [call out=183b] v0'0 uv1 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f2b8800a4d0 con 0x559448bdf6b0 2024-09-10T05:36:37.080 INFO:teuthology.orchestra.run.smithi062.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-10T05:36:37.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.075+0000 7f2a467e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:37.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.075+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94095364006960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448bd9e70 con 0x559448bdf6b0 2024-09-10T05:36:37.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.079+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 <== osd.1 v2:172.21.15.62:6808/3442097179 27 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94095364006960] v30'122 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2b8800a4d0 con 0x559448bdf6b0 2024-09-10T05:36:37.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.079+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94095363986304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448bf2430 con 0x559448be3b30 2024-09-10T05:36:37.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.083+0000 7f2b9069d640 1 -- 172.21.15.62:0/431762482 <== osd.0 v2:172.21.15.2:6800/945139080 33 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94095363986304] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b80079070 con 0x559448be3b30 2024-09-10T05:36:37.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.083+0000 7f2b92b979c0 20 remove_watcher() i=0 2024-09-10T05:36:37.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.083+0000 7f2b92b979c0 2 removed watcher, disabling cache 2024-09-10T05:36:37.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.083+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94095363991536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448bed380 con 0x559448bdf6b0 2024-09-10T05:36:37.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.083+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 <== osd.1 v2:172.21.15.62:6808/3442097179 28 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94095363991536] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b8800a4d0 con 0x559448bdf6b0 2024-09-10T05:36:37.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.083+0000 7f2b92b979c0 20 remove_watcher() i=1 2024-09-10T05:36:37.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.083+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94095363996160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448bed380 con 0x559448be3b30 2024-09-10T05:36:37.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.083+0000 7f2b9069d640 1 -- 172.21.15.62:0/431762482 <== osd.0 v2:172.21.15.2:6800/945139080 34 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94095363996160] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b80079070 con 0x559448be3b30 2024-09-10T05:36:37.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.083+0000 7f2b92b979c0 20 remove_watcher() i=2 2024-09-10T05:36:37.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.083+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94095363998368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448befa00 con 0x7f2b80068870 2024-09-10T05:36:37.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.087+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 <== osd.2 v2:172.21.15.62:6800/2677868286 15 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94095363998368] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b8800a4d0 con 0x7f2b80068870 2024-09-10T05:36:37.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.087+0000 7f2b92b979c0 20 remove_watcher() i=3 2024-09-10T05:36:37.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.087+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94095364001088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448bed380 con 0x559448be3b30 2024-09-10T05:36:37.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.087+0000 7f2b9069d640 1 -- 172.21.15.62:0/431762482 <== osd.0 v2:172.21.15.2:6800/945139080 35 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94095364001088] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b80079070 con 0x559448be3b30 2024-09-10T05:36:37.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.087+0000 7f2b92b979c0 20 remove_watcher() i=4 2024-09-10T05:36:37.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.087+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94095363999424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448befa00 con 0x559448be7350 2024-09-10T05:36:37.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.091+0000 7f2b8fe9c640 1 -- 172.21.15.62:0/431762482 <== osd.3 v2:172.21.15.62:6816/2708991149 24 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94095363999424] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b840aaa10 con 0x559448be7350 2024-09-10T05:36:37.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.091+0000 7f2b92b979c0 20 remove_watcher() i=5 2024-09-10T05:36:37.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.091+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94095364005904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448bf0720 con 0x559448be7350 2024-09-10T05:36:37.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.091+0000 7f2b8fe9c640 1 -- 172.21.15.62:0/431762482 <== osd.3 v2:172.21.15.62:6816/2708991149 25 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94095364005904] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b840aaa10 con 0x559448be7350 2024-09-10T05:36:37.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.091+0000 7f2b92b979c0 20 remove_watcher() i=6 2024-09-10T05:36:37.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.091+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94095364008112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559448bf0700 con 0x7f2b80068870 2024-09-10T05:36:37.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.091+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 <== osd.2 v2:172.21.15.62:6800/2677868286 16 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94095364008112] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b8800a4d0 con 0x7f2b80068870 2024-09-10T05:36:37.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.091+0000 7f2b92b979c0 20 remove_watcher() i=7 2024-09-10T05:36:37.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.091+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x559448be3b30 msgr2=0x559448be5f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.091+0000 7f2b92b979c0 1 --2- 172.21.15.62:0/431762482 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x559448be3b30 0x559448be5f20 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.091+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x559448bdf6b0 msgr2=0x559448be1b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.091+0000 7f2b92b979c0 1 --2- 172.21.15.62:0/431762482 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x559448bdf6b0 0x559448be1b40 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.091+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f2b80068870 msgr2=0x7f2b800437e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.091+0000 7f2b92b979c0 1 --2- 172.21.15.62:0/431762482 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f2b80068870 0x7f2b800437e0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.091+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x559448be7350 msgr2=0x559448be9760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.091+0000 7f2b92b979c0 1 --2- 172.21.15.62:0/431762482 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x559448be7350 0x559448be9760 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.091+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2a60039ac0 msgr2=0x7f2a6003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.091+0000 7f2b92b979c0 1 --2- 172.21.15.62:0/431762482 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2a60039ac0 0x7f2a6003bf80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2b8401b320 tx=0x7f2b840c2040 comp rx=0 tx=0).stop 2024-09-10T05:36:37.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.091+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559448bcd460 msgr2=0x559448bd47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.091+0000 7f2b92b979c0 1 --2- 172.21.15.62:0/431762482 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559448bcd460 0x559448bd47a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2b80052010 tx=0x7f2b80019f30 comp rx=0 tx=0).stop 2024-09-10T05:36:37.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.091+0000 7f2b90e9e640 1 -- 172.21.15.62:0/431762482 reap_dead start 2024-09-10T05:36:37.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.095+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 shutdown_connections 2024-09-10T05:36:37.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.095+0000 7f2b92b979c0 1 --2- 172.21.15.62:0/431762482 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559448bcd460 0x559448bd47a0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.095+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 >> 172.21.15.62:0/431762482 conn(0x559448bc9890 msgr2=0x559448bc7aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:37.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.095+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 shutdown_connections 2024-09-10T05:36:37.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.095+0000 7f2b92b979c0 1 -- 172.21.15.62:0/431762482 wait complete. 2024-09-10T05:36:37.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.095+0000 7f2b92b979c0 1 -- 172.21.15.62:0/3091695470 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2a68039ac0 msgr2=0x7f2a6803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.095+0000 7f2b92b979c0 1 --2- 172.21.15.62:0/3091695470 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2a68039ac0 0x7f2a6803bf80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x559448ba4630 tx=0x7f2b84005ad0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.095+0000 7f2b92b979c0 1 -- 172.21.15.62:0/3091695470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559448bc0eb0 msgr2=0x559448bc12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.095+0000 7f2b92b979c0 1 --2- 172.21.15.62:0/3091695470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559448bc0eb0 0x559448bc12d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2b80001750 tx=0x7f2b80050480 comp rx=0 tx=0).stop 2024-09-10T05:36:37.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.095+0000 7f2b92b979c0 1 -- 172.21.15.62:0/3091695470 shutdown_connections 2024-09-10T05:36:37.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.095+0000 7f2b92b979c0 1 --2- 172.21.15.62:0/3091695470 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2a68039ac0 0x7f2a6803bf80 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.095+0000 7f2b92b979c0 1 --2- 172.21.15.62:0/3091695470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559448bc0eb0 0x559448bc12d0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.095+0000 7f2b92b979c0 1 -- 172.21.15.62:0/3091695470 >> 172.21.15.62:0/3091695470 conn(0x559448bb6860 msgr2=0x559448bb6c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:37.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.095+0000 7f2b92b979c0 1 -- 172.21.15.62:0/3091695470 shutdown_connections 2024-09-10T05:36:37.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.095+0000 7f2b92b979c0 1 -- 172.21.15.62:0/3091695470 wait complete. 2024-09-10T05:36:37.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.095+0000 7f2b92b979c0 1 -- 172.21.15.62:0/2468037875 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x559448bab5f0 msgr2=0x559448bad9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.095+0000 7f2b92b979c0 1 --2- 172.21.15.62:0/2468037875 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x559448bab5f0 0x559448bad9e0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.095+0000 7f2b92b979c0 1 -- 172.21.15.62:0/2468037875 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x559448a25020 msgr2=0x559448baa350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.095+0000 7f2b92b979c0 1 --2- 172.21.15.62:0/2468037875 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x559448a25020 0x559448baa350 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.095+0000 7f2b92b979c0 1 -- 172.21.15.62:0/2468037875 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x559448bafd90 msgr2=0x559448bb2180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.095+0000 7f2b92b979c0 1 --2- 172.21.15.62:0/2468037875 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x559448bafd90 0x559448bb2180 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.095+0000 7f2b92b979c0 1 -- 172.21.15.62:0/2468037875 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2a78039a70 msgr2=0x7f2a7803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.095+0000 7f2b92b979c0 1 --2- 172.21.15.62:0/2468037875 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2a78039a70 0x7f2a7803bf30 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2b840ae000 tx=0x7f2b840a6000 comp rx=0 tx=0).stop 2024-09-10T05:36:37.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.095+0000 7f2b92b979c0 1 -- 172.21.15.62:0/2468037875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559448a24af0 msgr2=0x559448ba31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.095+0000 7f2b92b979c0 1 --2- 172.21.15.62:0/2468037875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559448a24af0 0x559448ba31e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2b80000c10 tx=0x7f2b80000ee0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.095+0000 7f2b90e9e640 1 -- 172.21.15.62:0/2468037875 reap_dead start 2024-09-10T05:36:37.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.095+0000 7f2b92b979c0 1 -- 172.21.15.62:0/2468037875 shutdown_connections 2024-09-10T05:36:37.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.095+0000 7f2b92b979c0 1 -- 172.21.15.62:0/2468037875 >> 172.21.15.62:0/2468037875 conn(0x559448aa9ad0 msgr2=0x559448b96280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:37.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.095+0000 7f2b92b979c0 1 -- 172.21.15.62:0/2468037875 shutdown_connections 2024-09-10T05:36:37.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.095+0000 7f2b92b979c0 1 -- 172.21.15.62:0/2468037875 wait complete. 2024-09-10T05:36:37.110 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-10T05:36:37.110 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-10T05:36:37.110 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-10T05:36:37.110 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2024-09-10T05:36:37.192 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:37.192 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:37.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.191+0000 7f2a110259c0 1 Processor -- start 2024-09-10T05:36:37.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.191+0000 7f2a110259c0 1 -- start start 2024-09-10T05:36:37.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.191+0000 7f2a110259c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x558fc0b2efa0 0x558fc0b2f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.191+0000 7f2a110259c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558fc09e39c0 con 0x558fc0b32130 2024-09-10T05:36:37.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.191+0000 7f2a110259c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x558fc0a336d0 con 0x558fc0b2efa0 2024-09-10T05:36:37.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.191+0000 7f2a0eb2b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x558fc0b2efa0 0x558fc0b2f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.191+0000 7f2a0eb2b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x558fc0b2efa0 0x558fc0b2f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47442/0 (socket says 172.21.15.62:47442) 2024-09-10T05:36:37.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.191+0000 7f2a0eb2b640 1 -- 172.21.15.62:0/997116997 learned_addr learned my addr 172.21.15.62:0/997116997 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:37.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.191+0000 7f2a0e32a640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x558fc0b32130 0x558fc0b34520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:53072/0 (socket says 172.21.15.62:53072) 2024-09-10T05:36:37.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.191+0000 7f2a0eb2b640 1 -- 172.21.15.62:0/997116997 >> v1:172.21.15.2:6789/0 conn(0x558fc0b32130 legacy=0x558fc0b34520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.191+0000 7f2a0eb2b640 1 -- 172.21.15.62:0/997116997 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fc09d7ca0 con 0x558fc0b2efa0 2024-09-10T05:36:37.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.195+0000 7f2a0eb2b640 1 --2- 172.21.15.62:0/997116997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fc0b2efa0 0x558fc0b2f380 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f2a0000a5c0 tx=0x7f2a0001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f48234154e60d5b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.195+0000 7f2a0db29640 1 -- 172.21.15.62:0/997116997 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a000a6070 con 0x558fc0b2efa0 2024-09-10T05:36:37.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.195+0000 7f2a0db29640 1 -- 172.21.15.62:0/997116997 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a000af070 con 0x558fc0b2efa0 2024-09-10T05:36:37.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.195+0000 7f2a0db29640 1 -- 172.21.15.62:0/997116997 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a000aa5c0 con 0x558fc0b2efa0 2024-09-10T05:36:37.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.195+0000 7f2a110259c0 1 -- 172.21.15.62:0/997116997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fc0b2efa0 msgr2=0x558fc0b2f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.195+0000 7f2a110259c0 1 --2- 172.21.15.62:0/997116997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fc0b2efa0 0x558fc0b2f380 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f2a0000a5c0 tx=0x7f2a0001b340 comp rx=0 tx=0).stop 2024-09-10T05:36:37.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.195+0000 7f2a110259c0 1 -- 172.21.15.62:0/997116997 shutdown_connections 2024-09-10T05:36:37.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.195+0000 7f2a110259c0 1 --2- 172.21.15.62:0/997116997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fc0b2efa0 0x558fc0b2f380 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.195+0000 7f2a110259c0 1 -- 172.21.15.62:0/997116997 >> 172.21.15.62:0/997116997 conn(0x558fc0b2aac0 msgr2=0x558fc0b2cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:37.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.195+0000 7f2a110259c0 1 -- 172.21.15.62:0/997116997 shutdown_connections 2024-09-10T05:36:37.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.195+0000 7f2a110259c0 1 -- 172.21.15.62:0/997116997 wait complete. 2024-09-10T05:36:37.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.211+0000 7f2a110259c0 1 Processor -- start 2024-09-10T05:36:37.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.211+0000 7f2a110259c0 1 -- start start 2024-09-10T05:36:37.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.211+0000 7f2a110259c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fc0b2efa0 0x558fc0aa5a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.211+0000 7f2a110259c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558fc0a37680 con 0x558fc0b2efa0 2024-09-10T05:36:37.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.211+0000 7f2a0eb2b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fc0b2efa0 0x558fc0aa5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.211+0000 7f2a0eb2b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fc0b2efa0 0x558fc0aa5a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47456/0 (socket says 172.21.15.62:47456) 2024-09-10T05:36:37.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.211+0000 7f2a0eb2b640 1 -- 172.21.15.62:0/3210685045 learned_addr learned my addr 172.21.15.62:0/3210685045 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:37.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.211+0000 7f2a0eb2b640 1 -- 172.21.15.62:0/3210685045 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fc09b2da0 con 0x558fc0b2efa0 2024-09-10T05:36:37.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.211+0000 7f2a0eb2b640 1 --2- 172.21.15.62:0/3210685045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fc0b2efa0 0x558fc0aa5a00 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f2a000ac040 tx=0x7f2a00003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1043163307fa890 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.211+0000 7f28fce09640 1 -- 172.21.15.62:0/3210685045 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a000aa9d0 con 0x558fc0b2efa0 2024-09-10T05:36:37.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.211+0000 7f28fce09640 1 -- 172.21.15.62:0/3210685045 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a000aab70 con 0x558fc0b2efa0 2024-09-10T05:36:37.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.211+0000 7f28fce09640 1 -- 172.21.15.62:0/3210685045 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a000bd3f0 con 0x558fc0b2efa0 2024-09-10T05:36:37.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.215+0000 7f2a110259c0 1 -- 172.21.15.62:0/3210685045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fc0b2efa0 msgr2=0x558fc0aa5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.215+0000 7f2a110259c0 1 --2- 172.21.15.62:0/3210685045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fc0b2efa0 0x558fc0aa5a00 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f2a000ac040 tx=0x7f2a00003030 comp rx=0 tx=0).stop 2024-09-10T05:36:37.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.215+0000 7f2a110259c0 1 -- 172.21.15.62:0/3210685045 shutdown_connections 2024-09-10T05:36:37.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.215+0000 7f2a110259c0 1 --2- 172.21.15.62:0/3210685045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fc0b2efa0 0x558fc0aa5a00 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.215+0000 7f2a110259c0 1 -- 172.21.15.62:0/3210685045 >> 172.21.15.62:0/3210685045 conn(0x558fc0b2aac0 msgr2=0x558fc0c16360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:37.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.215+0000 7f2a110259c0 1 -- 172.21.15.62:0/3210685045 shutdown_connections 2024-09-10T05:36:37.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.215+0000 7f2a110259c0 1 -- 172.21.15.62:0/3210685045 wait complete. 2024-09-10T05:36:37.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.215+0000 7f2a110259c0 1 Processor -- start 2024-09-10T05:36:37.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.215+0000 7f2a110259c0 1 -- start start 2024-09-10T05:36:37.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.215+0000 7f2a110259c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fc0b2efa0 0x558fc0c23e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.215+0000 7f2a110259c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558fc09d9a50 con 0x558fc0b2efa0 2024-09-10T05:36:37.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.215+0000 7f2a0eb2b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fc0b2efa0 0x558fc0c23e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.215+0000 7f2a0eb2b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fc0b2efa0 0x558fc0c23e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47460/0 (socket says 172.21.15.62:47460) 2024-09-10T05:36:37.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.215+0000 7f2a0eb2b640 1 -- 172.21.15.62:0/1727252454 learned_addr learned my addr 172.21.15.62:0/1727252454 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:37.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.215+0000 7f2a0eb2b640 1 -- 172.21.15.62:0/1727252454 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fc0c243b0 con 0x558fc0b2efa0 2024-09-10T05:36:37.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.215+0000 7f2a0eb2b640 1 --2- 172.21.15.62:0/1727252454 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fc0b2efa0 0x558fc0c23e50 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f2a0001b380 tx=0x7f2a000180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.215+0000 7f28fb606640 1 -- 172.21.15.62:0/1727252454 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a000c6690 con 0x558fc0b2efa0 2024-09-10T05:36:37.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.215+0000 7f28fb606640 1 -- 172.21.15.62:0/1727252454 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a000cc070 con 0x558fc0b2efa0 2024-09-10T05:36:37.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.215+0000 7f28fb606640 1 -- 172.21.15.62:0/1727252454 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a000c6960 con 0x558fc0b2efa0 2024-09-10T05:36:37.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.215+0000 7f2a110259c0 1 -- 172.21.15.62:0/1727252454 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558fc0c24640 con 0x558fc0b2efa0 2024-09-10T05:36:37.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.215+0000 7f2a110259c0 1 -- 172.21.15.62:0/1727252454 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558fc0c24ff0 con 0x558fc0b2efa0 2024-09-10T05:36:37.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.219+0000 7f28fb606640 1 -- 172.21.15.62:0/1727252454 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2a000c6b90 con 0x558fc0b2efa0 2024-09-10T05:36:37.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.219+0000 7f28fb606640 1 --2- 172.21.15.62:0/1727252454 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f28f4039ac0 0x7f28f403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.219+0000 7f28fb606640 1 -- 172.21.15.62:0/1727252454 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f2a000ebc90 con 0x558fc0b2efa0 2024-09-10T05:36:37.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.219+0000 7f2a110259c0 1 --2- 172.21.15.62:0/1727252454 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x558fc0b32130 0x558fc0c2afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.219+0000 7f2a110259c0 1 -- 172.21.15.62:0/1727252454 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558fc0c2b500 con 0x558fc0b32130 2024-09-10T05:36:37.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.219+0000 7f2a0e32a640 1 --2- 172.21.15.62:0/1727252454 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f28f4039ac0 0x7f28f403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.219+0000 7f2a0f32c640 1 --2- 172.21.15.62:0/1727252454 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x558fc0b32130 0x558fc0c2afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.219+0000 7f2a0f32c640 1 --2- 172.21.15.62:0/1727252454 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x558fc0b32130 0x558fc0c2afc0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.219+0000 7f2a0e32a640 1 --2- 172.21.15.62:0/1727252454 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f28f4039ac0 0x7f28f403bf80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2a040016b0 tx=0x7f2a040066c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.219+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1727252454 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2a080083f0 con 0x558fc0b32130 2024-09-10T05:36:37.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.219+0000 7f2a110259c0 1 --2- 172.21.15.62:0/1727252454 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x558fc0c2bfb0 0x558fc0c2e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.219+0000 7f2a110259c0 1 -- 172.21.15.62:0/1727252454 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558fc0c2ebe0 con 0x558fc0c2bfb0 2024-09-10T05:36:37.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.219+0000 7f2a0eb2b640 1 --2- 172.21.15.62:0/1727252454 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x558fc0c2bfb0 0x558fc0c2e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.219+0000 7f2a0eb2b640 1 --2- 172.21.15.62:0/1727252454 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x558fc0c2bfb0 0x558fc0c2e470 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.223+0000 7f2a0eb2b640 1 -- 172.21.15.62:0/1727252454 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2a000c5cd0 con 0x558fc0c2bfb0 2024-09-10T05:36:37.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.223+0000 7f2a110259c0 1 --2- 172.21.15.62:0/1727252454 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x558fc0c309a0 0x558fc0c32d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.223+0000 7f2a110259c0 1 -- 172.21.15.62:0/1727252454 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558fc0c33460 con 0x558fc0c309a0 2024-09-10T05:36:37.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.223+0000 7f2a0e32a640 1 --2- 172.21.15.62:0/1727252454 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x558fc0c309a0 0x558fc0c32d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.223+0000 7f2a0e32a640 1 --2- 172.21.15.62:0/1727252454 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x558fc0c309a0 0x558fc0c32d90 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.223+0000 7f2a0e32a640 1 -- 172.21.15.62:0/1727252454 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2a0400f070 con 0x558fc0c309a0 2024-09-10T05:36:37.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.223+0000 7f2a110259c0 1 -- 172.21.15.62:0/1727252454 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558fc0c2f840 con 0x558fc0c2bfb0 2024-09-10T05:36:37.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.223+0000 7f2a0eb2b640 1 -- 172.21.15.62:0/1727252454 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2a000c5cd0 con 0x558fc0c2bfb0 2024-09-10T05:36:37.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.223+0000 7f2a110259c0 1 -- 172.21.15.62:0/1727252454 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558fc0c2fca0 con 0x558fc0c309a0 2024-09-10T05:36:37.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.223+0000 7f2a0e32a640 1 -- 172.21.15.62:0/1727252454 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2a0400f070 con 0x558fc0c309a0 2024-09-10T05:36:37.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.223+0000 7f2a110259c0 1 Processor -- start 2024-09-10T05:36:37.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.223+0000 7f2a110259c0 1 -- start start 2024-09-10T05:36:37.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.223+0000 7f2a110259c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fc0c41af0 0x558fc0c41f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.223+0000 7f2a110259c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558fc0a44450 con 0x558fc0c41af0 2024-09-10T05:36:37.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.223+0000 7f2a0eb2b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fc0c41af0 0x558fc0c41f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.223+0000 7f2a0eb2b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fc0c41af0 0x558fc0c41f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47464/0 (socket says 172.21.15.62:47464) 2024-09-10T05:36:37.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.223+0000 7f2a0eb2b640 1 -- 172.21.15.62:0/1085813192 learned_addr learned my addr 172.21.15.62:0/1085813192 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:37.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.223+0000 7f2a0eb2b640 1 -- 172.21.15.62:0/1085813192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fc0c42550 con 0x558fc0c41af0 2024-09-10T05:36:37.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.227+0000 7f2a0eb2b640 1 --2- 172.21.15.62:0/1085813192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fc0c41af0 0x558fc0c41f10 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f2a000ea1d0 tx=0x7f2a000b3da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.227+0000 7f28f8e01640 1 -- 172.21.15.62:0/1085813192 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a000bc920 con 0x558fc0c41af0 2024-09-10T05:36:37.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.227+0000 7f2a110259c0 1 -- 172.21.15.62:0/1085813192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558fc0c42db0 con 0x558fc0c41af0 2024-09-10T05:36:37.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.227+0000 7f28f8e01640 1 -- 172.21.15.62:0/1085813192 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a000cf580 con 0x558fc0c41af0 2024-09-10T05:36:37.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.227+0000 7f28f8e01640 1 -- 172.21.15.62:0/1085813192 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a000b33f0 con 0x558fc0c41af0 2024-09-10T05:36:37.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.227+0000 7f2a110259c0 1 -- 172.21.15.62:0/1085813192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558fc0c43320 con 0x558fc0c41af0 2024-09-10T05:36:37.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.227+0000 7f28f8e01640 1 -- 172.21.15.62:0/1085813192 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2a000b3590 con 0x558fc0c41af0 2024-09-10T05:36:37.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.227+0000 7f28f8e01640 1 --2- 172.21.15.62:0/1085813192 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f28e8039a20 0x7f28e803bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.227+0000 7f28f8e01640 1 -- 172.21.15.62:0/1085813192 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f2a000f4aa0 con 0x558fc0c41af0 2024-09-10T05:36:37.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.227+0000 7f2a0e32a640 1 --2- 172.21.15.62:0/1085813192 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f28e8039a20 0x7f28e803bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.227+0000 7f2a110259c0 1 Processor -- start 2024-09-10T05:36:37.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.227+0000 7f2a110259c0 1 -- start start 2024-09-10T05:36:37.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.227+0000 7f2a110259c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fc0c4e290 0x558fc0c4e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.227+0000 7f2a0e32a640 1 --2- 172.21.15.62:0/1085813192 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f28e8039a20 0x7f28e803bee0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2a040063a0 tx=0x7f2a0400f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.227+0000 7f2a110259c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558fc0aa6170 con 0x558fc0c4e290 2024-09-10T05:36:37.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.227+0000 7f2a0eb2b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fc0c4e290 0x558fc0c4e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.227+0000 7f2a0eb2b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fc0c4e290 0x558fc0c4e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47480/0 (socket says 172.21.15.62:47480) 2024-09-10T05:36:37.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.227+0000 7f2a0eb2b640 1 -- 172.21.15.62:0/3837745848 learned_addr learned my addr 172.21.15.62:0/3837745848 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:37.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.227+0000 7f2a0eb2b640 1 -- 172.21.15.62:0/3837745848 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fc0c4ec40 con 0x558fc0c4e290 2024-09-10T05:36:37.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.231+0000 7f2a0eb2b640 1 --2- 172.21.15.62:0/3837745848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fc0c4e290 0x558fc0c4e670 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f2a000d0c90 tx=0x7f2a000ebba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dd5835ea1f25930 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.231+0000 7f28f27fc640 1 -- 172.21.15.62:0/3837745848 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a000f8040 con 0x558fc0c4e290 2024-09-10T05:36:37.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.231+0000 7f28f27fc640 1 -- 172.21.15.62:0/3837745848 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a000db5a0 con 0x558fc0c4e290 2024-09-10T05:36:37.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.231+0000 7f28f27fc640 1 -- 172.21.15.62:0/3837745848 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a000b3880 con 0x558fc0c4e290 2024-09-10T05:36:37.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.231+0000 7f2a110259c0 1 -- 172.21.15.62:0/3837745848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fc0c4e290 msgr2=0x558fc0c4e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.231+0000 7f2a110259c0 1 --2- 172.21.15.62:0/3837745848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fc0c4e290 0x558fc0c4e670 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f2a000d0c90 tx=0x7f2a000ebba0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.231+0000 7f2a110259c0 1 -- 172.21.15.62:0/3837745848 shutdown_connections 2024-09-10T05:36:37.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.231+0000 7f2a110259c0 1 --2- 172.21.15.62:0/3837745848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fc0c4e290 0x558fc0c4e670 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.231+0000 7f2a110259c0 1 -- 172.21.15.62:0/3837745848 >> 172.21.15.62:0/3837745848 conn(0x558fc0c4a6c0 msgr2=0x558fc0c48900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:37.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.231+0000 7f2a110259c0 1 -- 172.21.15.62:0/3837745848 shutdown_connections 2024-09-10T05:36:37.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.231+0000 7f2a110259c0 1 -- 172.21.15.62:0/3837745848 wait complete. 2024-09-10T05:36:37.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.231+0000 7f2a110259c0 1 Processor -- start 2024-09-10T05:36:37.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.231+0000 7f2a110259c0 1 -- start start 2024-09-10T05:36:37.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.231+0000 7f2a110259c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fc0c4e290 0x558fc0c555d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.231+0000 7f2a110259c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558fc0c4f120 con 0x558fc0c4e290 2024-09-10T05:36:37.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.231+0000 7f2a0eb2b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fc0c4e290 0x558fc0c555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.231+0000 7f2a0eb2b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fc0c4e290 0x558fc0c555d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47482/0 (socket says 172.21.15.62:47482) 2024-09-10T05:36:37.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.231+0000 7f2a0eb2b640 1 -- 172.21.15.62:0/1484885654 learned_addr learned my addr 172.21.15.62:0/1484885654 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:37.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.231+0000 7f2a0eb2b640 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fc0c55b30 con 0x558fc0c4e290 2024-09-10T05:36:37.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.231+0000 7f2a0eb2b640 1 --2- 172.21.15.62:0/1484885654 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fc0c4e290 0x558fc0c555d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f2a000e8ff0 tx=0x7f2a000cf8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.231+0000 7f28f0ff9640 1 -- 172.21.15.62:0/1484885654 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a0010b040 con 0x558fc0c4e290 2024-09-10T05:36:37.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.231+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558fc0c55b30 con 0x558fc0c4e290 2024-09-10T05:36:37.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.231+0000 7f28f0ff9640 1 -- 172.21.15.62:0/1484885654 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a000b3880 con 0x558fc0c4e290 2024-09-10T05:36:37.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.231+0000 7f28f0ff9640 1 -- 172.21.15.62:0/1484885654 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a000f8040 con 0x558fc0c4e290 2024-09-10T05:36:37.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.231+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558fc0c55fa0 con 0x558fc0c4e290 2024-09-10T05:36:37.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.235+0000 7f28f0ff9640 1 -- 172.21.15.62:0/1484885654 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2a00118020 con 0x558fc0c4e290 2024-09-10T05:36:37.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.235+0000 7f28f0ff9640 1 --2- 172.21.15.62:0/1484885654 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f28d8039a70 0x7f28d803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.235+0000 7f28f0ff9640 1 -- 172.21.15.62:0/1484885654 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f2a00116020 con 0x558fc0c4e290 2024-09-10T05:36:37.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.235+0000 7f2a110259c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.235+0000 7f2a0e32a640 1 --2- 172.21.15.62:0/1484885654 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f28d8039a70 0x7f28d803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.235+0000 7f2a110259c0 1 --2- 172.21.15.62:0/1484885654 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x558fc0c603d0 0x558fc0c62860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.235+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558fc0c62fb0 con 0x558fc0c603d0 2024-09-10T05:36:37.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.235+0000 7f2a0f32c640 1 --2- 172.21.15.62:0/1484885654 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x558fc0c603d0 0x558fc0c62860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.235+0000 7f2a0e32a640 1 --2- 172.21.15.62:0/1484885654 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f28d8039a70 0x7f28d803bf30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x558fc0c25f90 tx=0x7f2a04010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.235+0000 7f2a0f32c640 1 --2- 172.21.15.62:0/1484885654 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x558fc0c603d0 0x558fc0c62860 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.235+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2a080083f0 con 0x558fc0c603d0 2024-09-10T05:36:37.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.235+0000 7f2a110259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:37.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.235+0000 7f2a110259c0 20 realm 2024-09-10T05:36:37.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.235+0000 7f2a110259c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.235+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558fc0c5f760 con 0x558fc0c603d0 2024-09-10T05:36:37.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.235+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2a080083f0 con 0x558fc0c603d0 2024-09-10T05:36:37.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.235+0000 7f2a110259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:37.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.235+0000 7f2a110259c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:37.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.235+0000 7f2a110259c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.235+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558fc0c63a80 con 0x558fc0c603d0 2024-09-10T05:36:37.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.235+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2a080083f0 con 0x558fc0c603d0 2024-09-10T05:36:37.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.235+0000 7f2a110259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:37.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.235+0000 7f2a110259c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.235+0000 7f2a110259c0 1 --2- 172.21.15.62:0/1484885654 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x558fc0c64860 0x558fc0c66c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.235+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558fc0c67300 con 0x558fc0c64860 2024-09-10T05:36:37.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.235+0000 7f2a0eb2b640 1 --2- 172.21.15.62:0/1484885654 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x558fc0c64860 0x558fc0c66c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.235+0000 7f2a0eb2b640 1 --2- 172.21.15.62:0/1484885654 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x558fc0c64860 0x558fc0c66c50 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.239+0000 7f2a0eb2b640 1 -- 172.21.15.62:0/1484885654 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2a000fa070 con 0x558fc0c64860 2024-09-10T05:36:37.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.239+0000 7f2a110259c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:37.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.239+0000 7f2a110259c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.239+0000 7f2a110259c0 1 --2- 172.21.15.62:0/1484885654 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x558fc0c67d50 0x558fc0c6a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.239+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558fc0c6a880 con 0x558fc0c67d50 2024-09-10T05:36:37.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.239+0000 7f2a0e32a640 1 --2- 172.21.15.62:0/1484885654 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x558fc0c67d50 0x558fc0c6a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.239+0000 7f2a0e32a640 1 --2- 172.21.15.62:0/1484885654 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x558fc0c67d50 0x558fc0c6a140 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.239+0000 7f2a0e32a640 1 -- 172.21.15.62:0/1484885654 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2a0402d040 con 0x558fc0c67d50 2024-09-10T05:36:37.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.239+0000 7f2a110259c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:37.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.239+0000 7f2a110259c0 20 searching for the correct realm 2024-09-10T05:36:37.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.239+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558fc0c6c0e0 con 0x558fc0c67d50 2024-09-10T05:36:37.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.239+0000 7f2a0e32a640 1 -- 172.21.15.62:0/1484885654 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a0402d040 con 0x558fc0c67d50 2024-09-10T05:36:37.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.239+0000 7f2a0e32a640 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558fc0c6c0e0 con 0x558fc0c64860 2024-09-10T05:36:37.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.239+0000 7f2a0eb2b640 1 -- 172.21.15.62:0/1484885654 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a000fa070 con 0x558fc0c64860 2024-09-10T05:36:37.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.239+0000 7f2a0eb2b640 1 --2- 172.21.15.62:0/1484885654 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f2a00009040 0x7f2a00116a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.239+0000 7f2a0eb2b640 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2a00123040 con 0x7f2a00009040 2024-09-10T05:36:37.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.239+0000 7f2a0f32c640 1 --2- 172.21.15.62:0/1484885654 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f2a00009040 0x7f2a00116a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.239+0000 7f2a0f32c640 1 --2- 172.21.15.62:0/1484885654 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f2a00009040 0x7f2a00116a80 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.239+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a080083f0 con 0x7f2a00009040 2024-09-10T05:36:37.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.239+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2a00123040 con 0x558fc0c603d0 2024-09-10T05:36:37.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.239+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a080083f0 con 0x558fc0c603d0 2024-09-10T05:36:37.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.239+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2a00123040 con 0x558fc0c603d0 2024-09-10T05:36:37.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.239+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a080083f0 con 0x558fc0c603d0 2024-09-10T05:36:37.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.239+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2a00123040 con 0x558fc0c67d50 2024-09-10T05:36:37.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.239+0000 7f2a0e32a640 1 -- 172.21.15.62:0/1484885654 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a0402d040 con 0x558fc0c67d50 2024-09-10T05:36:37.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.239+0000 7f2a0e32a640 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2a00123040 con 0x558fc0c603d0 2024-09-10T05:36:37.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.243+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a080083f0 con 0x558fc0c603d0 2024-09-10T05:36:37.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.243+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2a00123040 con 0x558fc0c64860 2024-09-10T05:36:37.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.243+0000 7f2a0eb2b640 1 -- 172.21.15.62:0/1484885654 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a000fa070 con 0x558fc0c64860 2024-09-10T05:36:37.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.243+0000 7f2a0eb2b640 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2a00123040 con 0x558fc0c64860 2024-09-10T05:36:37.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.243+0000 7f2a0eb2b640 1 -- 172.21.15.62:0/1484885654 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a000fa070 con 0x558fc0c64860 2024-09-10T05:36:37.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.243+0000 7f2a0eb2b640 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2a00123040 con 0x558fc0c603d0 2024-09-10T05:36:37.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.243+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a080083f0 con 0x558fc0c603d0 2024-09-10T05:36:37.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.243+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2a00123040 con 0x7f2a00009040 2024-09-10T05:36:37.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.243+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a080083f0 con 0x7f2a00009040 2024-09-10T05:36:37.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.243+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2a00123040 con 0x558fc0c603d0 2024-09-10T05:36:37.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.243+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a080083f0 con 0x558fc0c603d0 2024-09-10T05:36:37.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.243+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2a00123040 con 0x7f2a00009040 2024-09-10T05:36:37.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.243+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2a080083f0 con 0x7f2a00009040 2024-09-10T05:36:37.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.243+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2a00123040 con 0x558fc0c64860 2024-09-10T05:36:37.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.243+0000 7f2a0eb2b640 1 -- 172.21.15.62:0/1484885654 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a000fa070 con 0x558fc0c64860 2024-09-10T05:36:37.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.243+0000 7f2a0eb2b640 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2a00123040 con 0x558fc0c67d50 2024-09-10T05:36:37.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.247+0000 7f2a0e32a640 1 -- 172.21.15.62:0/1484885654 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a0402d040 con 0x558fc0c67d50 2024-09-10T05:36:37.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.247+0000 7f2a0e32a640 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2a00123040 con 0x558fc0c603d0 2024-09-10T05:36:37.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.247+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a080083f0 con 0x558fc0c603d0 2024-09-10T05:36:37.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.247+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2a00123040 con 0x558fc0c64860 2024-09-10T05:36:37.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.247+0000 7f2a0eb2b640 1 -- 172.21.15.62:0/1484885654 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a000fa070 con 0x558fc0c64860 2024-09-10T05:36:37.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.247+0000 7f2a0eb2b640 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2a00123040 con 0x558fc0c67d50 2024-09-10T05:36:37.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.247+0000 7f2a0e32a640 1 -- 172.21.15.62:0/1484885654 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 30 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f2a0402d040 con 0x558fc0c67d50 2024-09-10T05:36:37.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.247+0000 7f2a0e32a640 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2a00123040 con 0x558fc0c603d0 2024-09-10T05:36:37.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.247+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a080083f0 con 0x558fc0c603d0 2024-09-10T05:36:37.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.247+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2a00123040 con 0x558fc0c603d0 2024-09-10T05:36:37.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.247+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2a080083f0 con 0x558fc0c603d0 2024-09-10T05:36:37.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.247+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2a00123040 con 0x558fc0c603d0 2024-09-10T05:36:37.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.247+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a080083f0 con 0x558fc0c603d0 2024-09-10T05:36:37.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.247+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2a00123040 con 0x558fc0c67d50 2024-09-10T05:36:37.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.247+0000 7f2a0e32a640 1 -- 172.21.15.62:0/1484885654 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a0402d040 con 0x558fc0c67d50 2024-09-10T05:36:37.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.247+0000 7f2a0e32a640 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2a00123040 con 0x7f2a00009040 2024-09-10T05:36:37.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.247+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a080083f0 con 0x7f2a00009040 2024-09-10T05:36:37.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.247+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2a00123040 con 0x558fc0c603d0 2024-09-10T05:36:37.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.247+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a080083f0 con 0x558fc0c603d0 2024-09-10T05:36:37.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.247+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2a00123040 con 0x7f2a00009040 2024-09-10T05:36:37.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.247+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a080083f0 con 0x7f2a00009040 2024-09-10T05:36:37.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.247+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2a00123040 con 0x558fc0c67d50 2024-09-10T05:36:37.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.247+0000 7f2a0e32a640 1 -- 172.21.15.62:0/1484885654 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a0402d040 con 0x558fc0c67d50 2024-09-10T05:36:37.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.247+0000 7f2a0e32a640 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2a00123040 con 0x7f2a00009040 2024-09-10T05:36:37.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.251+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a080083f0 con 0x7f2a00009040 2024-09-10T05:36:37.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.251+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2a00123040 con 0x558fc0c64860 2024-09-10T05:36:37.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.251+0000 7f2a0eb2b640 1 -- 172.21.15.62:0/1484885654 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a000fa070 con 0x558fc0c64860 2024-09-10T05:36:37.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.251+0000 7f2a0eb2b640 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2a00123040 con 0x558fc0c64860 2024-09-10T05:36:37.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.251+0000 7f2a0eb2b640 1 -- 172.21.15.62:0/1484885654 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a000fa070 con 0x558fc0c64860 2024-09-10T05:36:37.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.251+0000 7f2a0eb2b640 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2a00123040 con 0x558fc0c67d50 2024-09-10T05:36:37.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.251+0000 7f2a0e32a640 1 -- 172.21.15.62:0/1484885654 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a0402d040 con 0x558fc0c67d50 2024-09-10T05:36:37.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.251+0000 7f2a0e32a640 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2a00123040 con 0x558fc0c64860 2024-09-10T05:36:37.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.251+0000 7f2a0eb2b640 1 -- 172.21.15.62:0/1484885654 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2a000fa070 con 0x558fc0c64860 2024-09-10T05:36:37.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.251+0000 7f2a0eb2b640 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2a00123040 con 0x558fc0c64860 2024-09-10T05:36:37.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.251+0000 7f2a0eb2b640 1 -- 172.21.15.62:0/1484885654 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a000fa070 con 0x558fc0c64860 2024-09-10T05:36:37.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.251+0000 7f2a110259c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:37.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.251+0000 7f2a110259c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:37.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.251+0000 7f2a110259c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:37.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.251+0000 7f2a110259c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:37.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.251+0000 7f2a110259c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:37.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.251+0000 7f2a110259c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:37.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.251+0000 7f2a110259c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.251+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558fc0c6b200 con 0x558fc0c603d0 2024-09-10T05:36:37.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.251+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2a080083f0 con 0x558fc0c603d0 2024-09-10T05:36:37.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.251+0000 7f2a110259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:37.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.251+0000 7f2a110259c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.251+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558fc0c6baa0 con 0x558fc0c64860 2024-09-10T05:36:37.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.255+0000 7f2a0eb2b640 1 -- 172.21.15.62:0/1484885654 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2a000fa070 con 0x558fc0c64860 2024-09-10T05:36:37.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.255+0000 7f2a110259c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:37.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.255+0000 7f2a110259c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.255+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558fc0c6ae40 con 0x558fc0c67d50 2024-09-10T05:36:37.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.255+0000 7f2a0e32a640 1 -- 172.21.15.62:0/1484885654 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2a0402d040 con 0x558fc0c67d50 2024-09-10T05:36:37.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.255+0000 7f2a110259c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:37.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.255+0000 7f2a110259c0 20 zone default found 2024-09-10T05:36:37.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.255+0000 7f2a110259c0 4 Realm: () 2024-09-10T05:36:37.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.255+0000 7f2a110259c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:37.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.255+0000 7f2a110259c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:37.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.255+0000 7f2a110259c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:37.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.255+0000 7f2a110259c0 20 zonegroup default 2024-09-10T05:36:37.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.255+0000 7f2a110259c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.255+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558fc0c6baa0 con 0x7f2a00009040 2024-09-10T05:36:37.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.255+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2a080083f0 con 0x7f2a00009040 2024-09-10T05:36:37.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.255+0000 7f2a110259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:37.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.255+0000 7f2a110259c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.255+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558fc0c6e460 con 0x558fc0c67d50 2024-09-10T05:36:37.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.255+0000 7f2a0e32a640 1 -- 172.21.15.62:0/1484885654 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2a0402d040 con 0x558fc0c67d50 2024-09-10T05:36:37.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.255+0000 7f2a110259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:37.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.255+0000 7f2a110259c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.255+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558fc0c6e800 con 0x558fc0c67d50 2024-09-10T05:36:37.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.255+0000 7f2a0e32a640 1 -- 172.21.15.62:0/1484885654 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2a0402d040 con 0x558fc0c67d50 2024-09-10T05:36:37.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.255+0000 7f2a110259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:37.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.255+0000 7f2a110259c0 20 started sync module instance, tier type = 2024-09-10T05:36:37.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.255+0000 7f2a110259c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:37.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.255+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558fc0c6d8f0 con 0x558fc0c64860 2024-09-10T05:36:37.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.255+0000 7f2a0eb2b640 1 -- 172.21.15.62:0/1484885654 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a000fa070 con 0x558fc0c64860 2024-09-10T05:36:37.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.255+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94075902942736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558fc0c6d8f0 con 0x558fc0c64860 2024-09-10T05:36:37.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.255+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558fc0c6f2b0 con 0x558fc0c603d0 2024-09-10T05:36:37.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.259+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a080083f0 con 0x558fc0c603d0 2024-09-10T05:36:37.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.259+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94075902946816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558fc0c6fb00 con 0x558fc0c603d0 2024-09-10T05:36:37.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.259+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558fc0c70500 con 0x558fc0c64860 2024-09-10T05:36:37.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.259+0000 7f2a0eb2b640 1 -- 172.21.15.62:0/1484885654 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94075902942736] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a000fa070 con 0x558fc0c64860 2024-09-10T05:36:37.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.259+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94075902946816] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a080083f0 con 0x558fc0c603d0 2024-09-10T05:36:37.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.259+0000 7f2a0eb2b640 1 -- 172.21.15.62:0/1484885654 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a000fa070 con 0x558fc0c64860 2024-09-10T05:36:37.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.259+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94075902940224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558fc0c6f650 con 0x558fc0c64860 2024-09-10T05:36:37.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.259+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558fc0c70dd0 con 0x7f2a00009040 2024-09-10T05:36:37.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.263+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a080083f0 con 0x7f2a00009040 2024-09-10T05:36:37.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.263+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94075902953760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558fc0c6f650 con 0x7f2a00009040 2024-09-10T05:36:37.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.263+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558fc0c71870 con 0x558fc0c64860 2024-09-10T05:36:37.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.263+0000 7f2a0eb2b640 1 -- 172.21.15.62:0/1484885654 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94075902940224] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a000fa070 con 0x558fc0c64860 2024-09-10T05:36:37.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.263+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94075902953760] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a080083f0 con 0x7f2a00009040 2024-09-10T05:36:37.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.263+0000 7f2a0eb2b640 1 -- 172.21.15.62:0/1484885654 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a000fa070 con 0x558fc0c64860 2024-09-10T05:36:37.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.263+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94075902954816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558fc0c71830 con 0x558fc0c64860 2024-09-10T05:36:37.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.263+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558fc0c71c90 con 0x558fc0c67d50 2024-09-10T05:36:37.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.267+0000 7f2a0e32a640 1 -- 172.21.15.62:0/1484885654 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a0402d040 con 0x558fc0c67d50 2024-09-10T05:36:37.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.267+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94075902951440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558fc0c72530 con 0x558fc0c67d50 2024-09-10T05:36:37.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.267+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558fc0c72ef0 con 0x558fc0c67d50 2024-09-10T05:36:37.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.267+0000 7f2a0eb2b640 1 -- 172.21.15.62:0/1484885654 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94075902954816] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a000fa070 con 0x558fc0c64860 2024-09-10T05:36:37.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.267+0000 7f2a0e32a640 1 -- 172.21.15.62:0/1484885654 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94075902951440] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a0402d040 con 0x558fc0c67d50 2024-09-10T05:36:37.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.267+0000 7f2a0e32a640 1 -- 172.21.15.62:0/1484885654 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a0402d040 con 0x558fc0c67d50 2024-09-10T05:36:37.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.267+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94075902962240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558fc0c72530 con 0x558fc0c67d50 2024-09-10T05:36:37.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.267+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558fc0c72ea0 con 0x7f2a00009040 2024-09-10T05:36:37.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.267+0000 7f2a0e32a640 1 -- 172.21.15.62:0/1484885654 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94075902962240] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a0402d040 con 0x558fc0c67d50 2024-09-10T05:36:37.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.267+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a080083f0 con 0x7f2a00009040 2024-09-10T05:36:37.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.267+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94075902959744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558fc0c724a0 con 0x7f2a00009040 2024-09-10T05:36:37.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.267+0000 7f2a110259c0 20 add_watcher() i=0 2024-09-10T05:36:37.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.267+0000 7f2a110259c0 20 add_watcher() i=1 2024-09-10T05:36:37.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.267+0000 7f2a110259c0 20 add_watcher() i=2 2024-09-10T05:36:37.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.267+0000 7f2a110259c0 20 add_watcher() i=3 2024-09-10T05:36:37.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.267+0000 7f2a110259c0 20 add_watcher() i=4 2024-09-10T05:36:37.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.267+0000 7f2a110259c0 20 add_watcher() i=5 2024-09-10T05:36:37.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.267+0000 7f2a110259c0 20 add_watcher() i=6 2024-09-10T05:36:37.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.271+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94075902959744] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a080083f0 con 0x7f2a00009040 2024-09-10T05:36:37.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.271+0000 7f2a110259c0 20 add_watcher() i=7 2024-09-10T05:36:37.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.271+0000 7f2a110259c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:37.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.271+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558fc0c767f0 con 0x558fc0c603d0 2024-09-10T05:36:37.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.271+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2a080083f0 con 0x558fc0c603d0 2024-09-10T05:36:37.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.271+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94075902964448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558fc0c73d80 con 0x558fc0c603d0 2024-09-10T05:36:37.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.271+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94075902964448] v30'123 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2a080083f0 con 0x558fc0c603d0 2024-09-10T05:36:37.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.271+0000 7f28c57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:37.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.271+0000 7f2a110259c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:37.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.271+0000 7f2a110259c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:37.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.271+0000 7f2a110259c0 5 note: GC not initialized 2024-09-10T05:36:37.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.271+0000 7f283ffff640 20 reqs_thread_entry: start 2024-09-10T05:36:37.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.271+0000 7f2a110259c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:37.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.271+0000 7f2a110259c0 20 Filter name: none 2024-09-10T05:36:37.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.271+0000 7f283dffb640 20 reqs_thread_entry: start 2024-09-10T05:36:37.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.271+0000 7f2a110259c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-10T05:36:37.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.271+0000 7f2a110259c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.271+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558fc0c99a90 con 0x7f2a00009040 2024-09-10T05:36:37.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.275+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f2a080083f0 con 0x7f2a00009040 2024-09-10T05:36:37.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.275+0000 7f2a110259c0 20 rados_obj.operate() r=0 bl.length=380 2024-09-10T05:36:37.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.275+0000 7f2a110259c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-10T05:36:37.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.275+0000 7f2a110259c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T05:36:37.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.275+0000 7f2a110259c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:36:37.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.275+0000 7f2a110259c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T05:36:37.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.275+0000 7f2a110259c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.275+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558fc0c9bb80 con 0x7f2a00009040 2024-09-10T05:36:37.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.275+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv20 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f2a080083f0 con 0x7f2a00009040 2024-09-10T05:36:37.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.275+0000 7f2a110259c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T05:36:37.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.275+0000 7f2a110259c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-10T05:36:37.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.275+0000 7f2a110259c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T05:36:37.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.275+0000 7f2a110259c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 : miss 2024-09-10T05:36:37.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.275+0000 7f2a110259c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.275+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:64 8.1f 8:fcc5c255:root::.bucket.meta.myfoo%3a475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558fc0c9d570 con 0x7f2a00009040 2024-09-10T05:36:37.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.275+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(64 .bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f2a080083f0 con 0x7f2a00009040 2024-09-10T05:36:37.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.275+0000 7f2a110259c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T05:36:37.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.275+0000 7f2a110259c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 info.flags=0x17 2024-09-10T05:36:37.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.275+0000 7f2a110259c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 to cache LRU end 2024-09-10T05:36:37.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.275+0000 7f2a110259c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:36:37.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.275+0000 7f2a110259c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T05:36:37.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.275+0000 7f2a110259c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 2024-09-10T05:36:37.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.275+0000 7f2a110259c0 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-10T05:36:37.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.275+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558fc0ca0cb0 con 0x558fc0c603d0 2024-09-10T05:36:37.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.275+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(65 fud.buckets [call] v30'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f2a080083f0 con 0x558fc0c603d0 2024-09-10T05:36:37.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.275+0000 7f2a110259c0 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-10T05:36:37.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.275+0000 7f2a110259c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.275+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558fc0c9fcc0 con 0x7f2a00009040 2024-09-10T05:36:37.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.275+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 <== osd.2 v2:172.21.15.62:6800/2677868286 15 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv20 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f2a080083f0 con 0x7f2a00009040 2024-09-10T05:36:37.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.275+0000 7f2a110259c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T05:36:37.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.275+0000 7f2a110259c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-10T05:36:37.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.275+0000 7f2a110259c0 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T05:36:37.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.275+0000 7f2a110259c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:36:37.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.275+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558fc0ca4770 con 0x7f2a00009040 2024-09-10T05:36:37.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.279+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 <== osd.2 v2:172.21.15.62:6800/2677868286 16 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v30'21 uv21 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f2a080083f0 con 0x7f2a00009040 2024-09-10T05:36:37.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.279+0000 7f2a110259c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-10T05:36:37.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.279+0000 7f2a110259c0 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T05:36:37.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.279+0000 7f2a110259c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-10T05:36:37.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.279+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94075903148544 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558fc0ca1d60 con 0x558fc0c67d50 2024-09-10T05:36:37.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.279+0000 7f2a0e32a640 1 -- 172.21.15.62:0/1484885654 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== watch-notify(notify (1) cookie 94075902962240 notify 128849018886 ret 0) ==== 380+0+0 (crc 0 0 0) 0x7f2a0404a040 con 0x558fc0c67d50 2024-09-10T05:36:37.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.279+0000 7f28f27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018886 cookie 94075902962240 notifier 4514 bl.length()=338 2024-09-10T05:36:37.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.279+0000 7f28f27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-10T05:36:37.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.279+0000 7f28f27fc640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T05:36:37.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.279+0000 7f2a0e32a640 1 -- 172.21.15.62:0/1484885654 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(68 notify.6 [notify cookie 94075903148544 out=8b] v0'0 uv120 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2a0402d040 con 0x558fc0c67d50 2024-09-10T05:36:37.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.279+0000 7f28f27fc640 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f28d4003eb0 con 0x558fc0c67d50 2024-09-10T05:36:37.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.279+0000 7f2a0e32a640 1 -- 172.21.15.62:0/1484885654 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a0402d040 con 0x558fc0c67d50 2024-09-10T05:36:37.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.279+0000 7f2a0e32a640 1 -- 172.21.15.62:0/1484885654 <== osd.3 v2:172.21.15.62:6816/2708991149 19 ==== watch-notify(notify_complete (2) cookie 94075903148544 notify 128849018886 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f2a0401b040 con 0x558fc0c67d50 2024-09-10T05:36:37.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.279+0000 7f28c57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:37.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.279+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94075902964448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558fc0c9ec90 con 0x558fc0c603d0 2024-09-10T05:36:37.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.283+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94075902964448] v30'124 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2a080083f0 con 0x558fc0c603d0 2024-09-10T05:36:37.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.283+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94075902942736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558fc0c73270 con 0x558fc0c64860 2024-09-10T05:36:37.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.283+0000 7f2a0eb2b640 1 -- 172.21.15.62:0/1484885654 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94075902942736] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a000fa070 con 0x558fc0c64860 2024-09-10T05:36:37.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.283+0000 7f2a110259c0 20 remove_watcher() i=0 2024-09-10T05:36:37.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.283+0000 7f2a110259c0 2 removed watcher, disabling cache 2024-09-10T05:36:37.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.283+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94075902946816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558fc0c6de10 con 0x558fc0c603d0 2024-09-10T05:36:37.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.287+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94075902946816] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a080083f0 con 0x558fc0c603d0 2024-09-10T05:36:37.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.287+0000 7f2a110259c0 20 remove_watcher() i=1 2024-09-10T05:36:37.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.287+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94075902940224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558fc0c6de10 con 0x558fc0c64860 2024-09-10T05:36:37.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.287+0000 7f2a0eb2b640 1 -- 172.21.15.62:0/1484885654 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94075902940224] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a000fa070 con 0x558fc0c64860 2024-09-10T05:36:37.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.287+0000 7f2a110259c0 20 remove_watcher() i=2 2024-09-10T05:36:37.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.287+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94075902953760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558fc0c6de10 con 0x7f2a00009040 2024-09-10T05:36:37.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.287+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 <== osd.2 v2:172.21.15.62:6800/2677868286 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94075902953760] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a080083f0 con 0x7f2a00009040 2024-09-10T05:36:37.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.287+0000 7f2a110259c0 20 remove_watcher() i=3 2024-09-10T05:36:37.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.287+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94075902954816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558fc0c6de10 con 0x558fc0c64860 2024-09-10T05:36:37.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.291+0000 7f2a0eb2b640 1 -- 172.21.15.62:0/1484885654 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94075902954816] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a000fa070 con 0x558fc0c64860 2024-09-10T05:36:37.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.291+0000 7f2a110259c0 20 remove_watcher() i=4 2024-09-10T05:36:37.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.291+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94075902951440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558fc0c6de10 con 0x558fc0c67d50 2024-09-10T05:36:37.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.291+0000 7f2a0e32a640 1 -- 172.21.15.62:0/1484885654 <== osd.3 v2:172.21.15.62:6816/2708991149 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94075902951440] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a0402d040 con 0x558fc0c67d50 2024-09-10T05:36:37.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.291+0000 7f2a110259c0 20 remove_watcher() i=5 2024-09-10T05:36:37.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.291+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94075902962240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558fc0c6de10 con 0x558fc0c67d50 2024-09-10T05:36:37.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.295+0000 7f2a0e32a640 1 -- 172.21.15.62:0/1484885654 <== osd.3 v2:172.21.15.62:6816/2708991149 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94075902962240] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a0402d040 con 0x558fc0c67d50 2024-09-10T05:36:37.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.295+0000 7f2a110259c0 20 remove_watcher() i=6 2024-09-10T05:36:37.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.295+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94075902959744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558fc0c72a40 con 0x7f2a00009040 2024-09-10T05:36:37.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.295+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 <== osd.2 v2:172.21.15.62:6800/2677868286 18 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94075902959744] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a080083f0 con 0x7f2a00009040 2024-09-10T05:36:37.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.295+0000 7f2a110259c0 20 remove_watcher() i=7 2024-09-10T05:36:37.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.295+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x558fc0c64860 msgr2=0x558fc0c66c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.295+0000 7f2a110259c0 1 --2- 172.21.15.62:0/1484885654 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x558fc0c64860 0x558fc0c66c50 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.295+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x558fc0c603d0 msgr2=0x558fc0c62860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.295+0000 7f2a110259c0 1 --2- 172.21.15.62:0/1484885654 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x558fc0c603d0 0x558fc0c62860 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.295+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f2a00009040 msgr2=0x7f2a00116a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.295+0000 7f2a110259c0 1 --2- 172.21.15.62:0/1484885654 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f2a00009040 0x7f2a00116a80 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.295+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x558fc0c67d50 msgr2=0x558fc0c6a140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.295+0000 7f2a110259c0 1 --2- 172.21.15.62:0/1484885654 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x558fc0c67d50 0x558fc0c6a140 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.295+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f28d8039a70 msgr2=0x7f28d803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.295+0000 7f2a110259c0 1 --2- 172.21.15.62:0/1484885654 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f28d8039a70 0x7f28d803bf30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x558fc0c25f90 tx=0x7f2a04010000 comp rx=0 tx=0).stop 2024-09-10T05:36:37.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.295+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fc0c4e290 msgr2=0x558fc0c555d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.295+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1484885654 reap_dead start 2024-09-10T05:36:37.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.295+0000 7f2a110259c0 1 --2- 172.21.15.62:0/1484885654 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fc0c4e290 0x558fc0c555d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f2a000e8ff0 tx=0x7f2a000cf8c0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.295+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 shutdown_connections 2024-09-10T05:36:37.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.295+0000 7f2a110259c0 1 --2- 172.21.15.62:0/1484885654 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fc0c4e290 0x558fc0c555d0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.295+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 >> 172.21.15.62:0/1484885654 conn(0x558fc0c4a6c0 msgr2=0x558fc0c488d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:37.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.295+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 shutdown_connections 2024-09-10T05:36:37.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.295+0000 7f2a110259c0 1 -- 172.21.15.62:0/1484885654 wait complete. 2024-09-10T05:36:37.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.295+0000 7f2a110259c0 1 -- 172.21.15.62:0/1085813192 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f28e8039a20 msgr2=0x7f28e803bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.295+0000 7f2a110259c0 1 --2- 172.21.15.62:0/1085813192 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f28e8039a20 0x7f28e803bee0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2a040063a0 tx=0x7f2a0400f000 comp rx=0 tx=0).stop 2024-09-10T05:36:37.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.295+0000 7f2a110259c0 1 -- 172.21.15.62:0/1085813192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fc0c41af0 msgr2=0x558fc0c41f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.295+0000 7f2a110259c0 1 --2- 172.21.15.62:0/1085813192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fc0c41af0 0x558fc0c41f10 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f2a000ea1d0 tx=0x7f2a000b3da0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.295+0000 7f2a110259c0 1 -- 172.21.15.62:0/1085813192 shutdown_connections 2024-09-10T05:36:37.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.295+0000 7f2a110259c0 1 --2- 172.21.15.62:0/1085813192 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f28e8039a20 0x7f28e803bee0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.295+0000 7f2a110259c0 1 --2- 172.21.15.62:0/1085813192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fc0c41af0 0x558fc0c41f10 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.295+0000 7f2a110259c0 1 -- 172.21.15.62:0/1085813192 >> 172.21.15.62:0/1085813192 conn(0x558fc0c374a0 msgr2=0x558fc0c37880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:37.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.295+0000 7f2a110259c0 1 -- 172.21.15.62:0/1085813192 shutdown_connections 2024-09-10T05:36:37.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.295+0000 7f2a110259c0 1 -- 172.21.15.62:0/1085813192 wait complete. 2024-09-10T05:36:37.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.295+0000 7f2a110259c0 1 -- 172.21.15.62:0/1727252454 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x558fc0c2bfb0 msgr2=0x558fc0c2e470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.295+0000 7f2a110259c0 1 --2- 172.21.15.62:0/1727252454 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x558fc0c2bfb0 0x558fc0c2e470 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.295+0000 7f2a110259c0 1 -- 172.21.15.62:0/1727252454 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x558fc0b32130 msgr2=0x558fc0c2afc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.295+0000 7f2a110259c0 1 --2- 172.21.15.62:0/1727252454 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x558fc0b32130 0x558fc0c2afc0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.295+0000 7f2a110259c0 1 -- 172.21.15.62:0/1727252454 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x558fc0c309a0 msgr2=0x558fc0c32d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.295+0000 7f2a110259c0 1 --2- 172.21.15.62:0/1727252454 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x558fc0c309a0 0x558fc0c32d90 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.295+0000 7f2a110259c0 1 -- 172.21.15.62:0/1727252454 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f28f4039ac0 msgr2=0x7f28f403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.295+0000 7f2a110259c0 1 --2- 172.21.15.62:0/1727252454 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f28f4039ac0 0x7f28f403bf80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2a040016b0 tx=0x7f2a040066c0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.295+0000 7f2a110259c0 1 -- 172.21.15.62:0/1727252454 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fc0b2efa0 msgr2=0x558fc0c23e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.295+0000 7f2a110259c0 1 --2- 172.21.15.62:0/1727252454 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fc0b2efa0 0x558fc0c23e50 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f2a0001b380 tx=0x7f2a000180e0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.295+0000 7f2a0f32c640 1 -- 172.21.15.62:0/1727252454 reap_dead start 2024-09-10T05:36:37.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.295+0000 7f2a110259c0 1 -- 172.21.15.62:0/1727252454 shutdown_connections 2024-09-10T05:36:37.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.295+0000 7f2a110259c0 1 -- 172.21.15.62:0/1727252454 >> 172.21.15.62:0/1727252454 conn(0x558fc0b2aac0 msgr2=0x558fc0aa4640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:37.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.295+0000 7f2a110259c0 1 -- 172.21.15.62:0/1727252454 shutdown_connections 2024-09-10T05:36:37.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.295+0000 7f2a110259c0 1 -- 172.21.15.62:0/1727252454 wait complete. 2024-09-10T05:36:37.311 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1'] 2024-09-10T05:36:37.311 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1'] 2024-09-10T05:36:37.311 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id 475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 2024-09-10T05:36:37.389 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:37.389 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:37.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.387+0000 7f63711c49c0 1 Processor -- start 2024-09-10T05:36:37.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.387+0000 7f63711c49c0 1 -- start start 2024-09-10T05:36:37.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.387+0000 7f63711c49c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5608f455d1a0 0x5608f455f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.387+0000 7f63711c49c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5608f440b9c0 con 0x5608f4559690 2024-09-10T05:36:37.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.387+0000 7f63711c49c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x5608f445b6d0 con 0x5608f455d1a0 2024-09-10T05:36:37.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.387+0000 7f636e4c9640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5608f455d1a0 0x5608f455f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.387+0000 7f636ecca640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x5608f4559690 0x5608f455ba80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:53082/0 (socket says 172.21.15.62:53082) 2024-09-10T05:36:37.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.387+0000 7f636e4c9640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5608f455d1a0 0x5608f455f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47488/0 (socket says 172.21.15.62:47488) 2024-09-10T05:36:37.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.387+0000 7f636ecca640 1 -- 172.21.15.62:0/1079507300 learned_addr learned my addr 172.21.15.62:0/1079507300 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-10T05:36:37.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.387+0000 7f636e4c9640 1 -- 172.21.15.62:0/1079507300 >> v1:172.21.15.2:6789/0 conn(0x5608f4559690 legacy=0x5608f455ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.387+0000 7f636e4c9640 1 -- 172.21.15.62:0/1079507300 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608f43ffca0 con 0x5608f455d1a0 2024-09-10T05:36:37.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.391+0000 7f636e4c9640 1 --2- 172.21.15.62:0/1079507300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608f455d1a0 0x5608f455f590 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f636400a480 tx=0x7f636401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb7d585ed676f5f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.391+0000 7f636dcc8640 1 -- 172.21.15.62:0/1079507300 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63640b0070 con 0x5608f455d1a0 2024-09-10T05:36:37.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.391+0000 7f636dcc8640 1 -- 172.21.15.62:0/1079507300 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63640ab540 con 0x5608f455d1a0 2024-09-10T05:36:37.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.391+0000 7f636dcc8640 1 -- 172.21.15.62:0/1079507300 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63640ab840 con 0x5608f455d1a0 2024-09-10T05:36:37.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.391+0000 7f63711c49c0 1 -- 172.21.15.62:0/1079507300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608f455d1a0 msgr2=0x5608f455f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.391+0000 7f63711c49c0 1 --2- 172.21.15.62:0/1079507300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608f455d1a0 0x5608f455f590 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f636400a480 tx=0x7f636401b280 comp rx=0 tx=0).stop 2024-09-10T05:36:37.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.391+0000 7f63711c49c0 1 -- 172.21.15.62:0/1079507300 shutdown_connections 2024-09-10T05:36:37.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.391+0000 7f63711c49c0 1 --2- 172.21.15.62:0/1079507300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608f455d1a0 0x5608f455f590 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.391+0000 7f63711c49c0 1 -- 172.21.15.62:0/1079507300 >> 172.21.15.62:0/1079507300 conn(0x5608f44cca20 msgr2=0x5608f44cce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:37.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.391+0000 7f63711c49c0 1 -- 172.21.15.62:0/1079507300 shutdown_connections 2024-09-10T05:36:37.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.391+0000 7f63711c49c0 1 -- 172.21.15.62:0/1079507300 wait complete. 2024-09-10T05:36:37.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.407+0000 7f63711c49c0 1 Processor -- start 2024-09-10T05:36:37.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.407+0000 7f63711c49c0 1 -- start start 2024-09-10T05:36:37.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.407+0000 7f63711c49c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608f4559690 0x5608f46449c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.407+0000 7f63711c49c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5608f445f680 con 0x5608f4559690 2024-09-10T05:36:37.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.407+0000 7f636ecca640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608f4559690 0x5608f46449c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.407+0000 7f636ecca640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608f4559690 0x5608f46449c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47504/0 (socket says 172.21.15.62:47504) 2024-09-10T05:36:37.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.407+0000 7f636ecca640 1 -- 172.21.15.62:0/3162781860 learned_addr learned my addr 172.21.15.62:0/3162781860 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:37.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.407+0000 7f636ecca640 1 -- 172.21.15.62:0/3162781860 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608f43dada0 con 0x5608f4559690 2024-09-10T05:36:37.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.407+0000 7f636ecca640 1 --2- 172.21.15.62:0/3162781860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608f4559690 0x5608f46449c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f6368001810 tx=0x7f6368001cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67fce11c764cde0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.407+0000 7f625ce09640 1 -- 172.21.15.62:0/3162781860 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6368004530 con 0x5608f4559690 2024-09-10T05:36:37.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.407+0000 7f625ce09640 1 -- 172.21.15.62:0/3162781860 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63680046d0 con 0x5608f4559690 2024-09-10T05:36:37.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.407+0000 7f625ce09640 1 -- 172.21.15.62:0/3162781860 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63680049f0 con 0x5608f4559690 2024-09-10T05:36:37.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.407+0000 7f63711c49c0 1 -- 172.21.15.62:0/3162781860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608f4559690 msgr2=0x5608f46449c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.407+0000 7f63711c49c0 1 --2- 172.21.15.62:0/3162781860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608f4559690 0x5608f46449c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f6368001810 tx=0x7f6368001cd0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.407+0000 7f63711c49c0 1 -- 172.21.15.62:0/3162781860 shutdown_connections 2024-09-10T05:36:37.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.407+0000 7f63711c49c0 1 --2- 172.21.15.62:0/3162781860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608f4559690 0x5608f46449c0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.407+0000 7f63711c49c0 1 -- 172.21.15.62:0/3162781860 >> 172.21.15.62:0/3162781860 conn(0x5608f44cca20 msgr2=0x5608f4640660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:37.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.407+0000 7f63711c49c0 1 -- 172.21.15.62:0/3162781860 shutdown_connections 2024-09-10T05:36:37.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.407+0000 7f63711c49c0 1 -- 172.21.15.62:0/3162781860 wait complete. 2024-09-10T05:36:37.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.411+0000 7f63711c49c0 1 Processor -- start 2024-09-10T05:36:37.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.411+0000 7f63711c49c0 1 -- start start 2024-09-10T05:36:37.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.411+0000 7f63711c49c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608f4559690 0x5608f464c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.411+0000 7f63711c49c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5608f4401a50 con 0x5608f4559690 2024-09-10T05:36:37.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.411+0000 7f636ecca640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608f4559690 0x5608f464c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.411+0000 7f636ecca640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608f4559690 0x5608f464c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47520/0 (socket says 172.21.15.62:47520) 2024-09-10T05:36:37.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.411+0000 7f636ecca640 1 -- 172.21.15.62:0/1770116108 learned_addr learned my addr 172.21.15.62:0/1770116108 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:37.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.411+0000 7f636ecca640 1 -- 172.21.15.62:0/1770116108 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608f464c610 con 0x5608f4559690 2024-09-10T05:36:37.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.411+0000 7f636ecca640 1 --2- 172.21.15.62:0/1770116108 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608f4559690 0x5608f464c0b0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f6368000f90 tx=0x7f6368001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.411+0000 7f625b606640 1 -- 172.21.15.62:0/1770116108 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6368013630 con 0x5608f4559690 2024-09-10T05:36:37.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.411+0000 7f625b606640 1 -- 172.21.15.62:0/1770116108 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63680137d0 con 0x5608f4559690 2024-09-10T05:36:37.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.411+0000 7f63711c49c0 1 -- 172.21.15.62:0/1770116108 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5608f464c8a0 con 0x5608f4559690 2024-09-10T05:36:37.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.411+0000 7f625b606640 1 -- 172.21.15.62:0/1770116108 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6368013ad0 con 0x5608f4559690 2024-09-10T05:36:37.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.411+0000 7f63711c49c0 1 -- 172.21.15.62:0/1770116108 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608f464d250 con 0x5608f4559690 2024-09-10T05:36:37.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.411+0000 7f625b606640 1 -- 172.21.15.62:0/1770116108 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6368010070 con 0x5608f4559690 2024-09-10T05:36:37.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.411+0000 7f625b606640 1 --2- 172.21.15.62:0/1770116108 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6254039a70 0x7f625403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.411+0000 7f625b606640 1 -- 172.21.15.62:0/1770116108 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f6368018070 con 0x5608f4559690 2024-09-10T05:36:37.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.411+0000 7f636e4c9640 1 --2- 172.21.15.62:0/1770116108 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6254039a70 0x7f625403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.411+0000 7f63711c49c0 1 --2- 172.21.15.62:0/1770116108 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5608f455d1a0 0x5608f4653220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.411+0000 7f63711c49c0 1 -- 172.21.15.62:0/1770116108 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608f4653760 con 0x5608f455d1a0 2024-09-10T05:36:37.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.415+0000 7f636f4cb640 1 --2- 172.21.15.62:0/1770116108 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5608f455d1a0 0x5608f4653220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.415+0000 7f636e4c9640 1 --2- 172.21.15.62:0/1770116108 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6254039a70 0x7f625403bf30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f63640ad000 tx=0x7f63640a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.415+0000 7f636f4cb640 1 --2- 172.21.15.62:0/1770116108 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5608f455d1a0 0x5608f4653220 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.415+0000 7f636f4cb640 1 -- 172.21.15.62:0/1770116108 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f63600083f0 con 0x5608f455d1a0 2024-09-10T05:36:37.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.415+0000 7f63711c49c0 1 --2- 172.21.15.62:0/1770116108 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5608f46544c0 0x5608f46568b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.415+0000 7f63711c49c0 1 -- 172.21.15.62:0/1770116108 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608f4656ea0 con 0x5608f46544c0 2024-09-10T05:36:37.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.415+0000 7f636ecca640 1 --2- 172.21.15.62:0/1770116108 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5608f46544c0 0x5608f46568b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.415+0000 7f636ecca640 1 --2- 172.21.15.62:0/1770116108 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5608f46544c0 0x5608f46568b0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.415+0000 7f636ecca640 1 -- 172.21.15.62:0/1770116108 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f636801b030 con 0x5608f46544c0 2024-09-10T05:36:37.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.415+0000 7f63711c49c0 1 --2- 172.21.15.62:0/1770116108 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5608f4658c60 0x5608f465b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.415+0000 7f63711c49c0 1 -- 172.21.15.62:0/1770116108 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608f465b720 con 0x5608f4658c60 2024-09-10T05:36:37.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.415+0000 7f636e4c9640 1 --2- 172.21.15.62:0/1770116108 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5608f4658c60 0x5608f465b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.415+0000 7f636e4c9640 1 --2- 172.21.15.62:0/1770116108 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5608f4658c60 0x5608f465b050 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.415+0000 7f636e4c9640 1 -- 172.21.15.62:0/1770116108 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f63640b3040 con 0x5608f4658c60 2024-09-10T05:36:37.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.415+0000 7f63711c49c0 1 -- 172.21.15.62:0/1770116108 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608f4657b00 con 0x5608f46544c0 2024-09-10T05:36:37.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.419+0000 7f636ecca640 1 -- 172.21.15.62:0/1770116108 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f636801b030 con 0x5608f46544c0 2024-09-10T05:36:37.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.419+0000 7f63711c49c0 1 -- 172.21.15.62:0/1770116108 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608f4657f40 con 0x5608f4658c60 2024-09-10T05:36:37.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.419+0000 7f636e4c9640 1 -- 172.21.15.62:0/1770116108 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f63640b3040 con 0x5608f4658c60 2024-09-10T05:36:37.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.419+0000 7f63711c49c0 1 Processor -- start 2024-09-10T05:36:37.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.419+0000 7f63711c49c0 1 -- start start 2024-09-10T05:36:37.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.419+0000 7f63711c49c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608f4669d10 0x5608f466a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.419+0000 7f63711c49c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5608f446c450 con 0x5608f4669d10 2024-09-10T05:36:37.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.419+0000 7f636ecca640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608f4669d10 0x5608f466a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.419+0000 7f636ecca640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608f4669d10 0x5608f466a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47536/0 (socket says 172.21.15.62:47536) 2024-09-10T05:36:37.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.419+0000 7f636ecca640 1 -- 172.21.15.62:0/2759707715 learned_addr learned my addr 172.21.15.62:0/2759707715 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:37.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.419+0000 7f636ecca640 1 -- 172.21.15.62:0/2759707715 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608f466a770 con 0x5608f4669d10 2024-09-10T05:36:37.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.419+0000 7f636ecca640 1 --2- 172.21.15.62:0/2759707715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608f4669d10 0x5608f466a130 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f6368010ad0 tx=0x7f6368012690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.419+0000 7f6258e01640 1 -- 172.21.15.62:0/2759707715 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f636801d350 con 0x5608f4669d10 2024-09-10T05:36:37.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.419+0000 7f63711c49c0 1 -- 172.21.15.62:0/2759707715 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5608f466afd0 con 0x5608f4669d10 2024-09-10T05:36:37.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.419+0000 7f6258e01640 1 -- 172.21.15.62:0/2759707715 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f636801d4f0 con 0x5608f4669d10 2024-09-10T05:36:37.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.419+0000 7f6258e01640 1 -- 172.21.15.62:0/2759707715 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f636804e9e0 con 0x5608f4669d10 2024-09-10T05:36:37.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.419+0000 7f63711c49c0 1 -- 172.21.15.62:0/2759707715 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608f466afd0 con 0x5608f4669d10 2024-09-10T05:36:37.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.423+0000 7f6258e01640 1 -- 172.21.15.62:0/2759707715 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6368029d10 con 0x5608f4669d10 2024-09-10T05:36:37.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.423+0000 7f6258e01640 1 --2- 172.21.15.62:0/2759707715 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6248039ac0 0x7f624803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.423+0000 7f6258e01640 1 -- 172.21.15.62:0/2759707715 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f6368051b50 con 0x5608f4669d10 2024-09-10T05:36:37.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.423+0000 7f636e4c9640 1 --2- 172.21.15.62:0/2759707715 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6248039ac0 0x7f624803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.423+0000 7f63711c49c0 1 Processor -- start 2024-09-10T05:36:37.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.423+0000 7f63711c49c0 1 -- start start 2024-09-10T05:36:37.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.423+0000 7f636e4c9640 1 --2- 172.21.15.62:0/2759707715 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6248039ac0 0x7f624803bf80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x5608f464d500 tx=0x7f6364005a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.423+0000 7f63711c49c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608f4677330 0x5608f4677710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.423+0000 7f63711c49c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5608f46451f0 con 0x5608f4677330 2024-09-10T05:36:37.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.423+0000 7f636ecca640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608f4677330 0x5608f4677710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.423+0000 7f636ecca640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608f4677330 0x5608f4677710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47542/0 (socket says 172.21.15.62:47542) 2024-09-10T05:36:37.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.423+0000 7f636ecca640 1 -- 172.21.15.62:0/4010332689 learned_addr learned my addr 172.21.15.62:0/4010332689 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:37.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.423+0000 7f636ecca640 1 -- 172.21.15.62:0/4010332689 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608f4677d00 con 0x5608f4677330 2024-09-10T05:36:37.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.423+0000 7f636ecca640 1 --2- 172.21.15.62:0/4010332689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608f4677330 0x5608f4677710 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f636804a9e0 tx=0x7f636804a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89eed750173a8627 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.423+0000 7f62527fc640 1 -- 172.21.15.62:0/4010332689 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6368041d30 con 0x5608f4677330 2024-09-10T05:36:37.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.423+0000 7f62527fc640 1 -- 172.21.15.62:0/4010332689 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63680283d0 con 0x5608f4677330 2024-09-10T05:36:37.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.423+0000 7f62527fc640 1 -- 172.21.15.62:0/4010332689 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6368026320 con 0x5608f4677330 2024-09-10T05:36:37.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.423+0000 7f63711c49c0 1 -- 172.21.15.62:0/4010332689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608f4677330 msgr2=0x5608f4677710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.423+0000 7f63711c49c0 1 --2- 172.21.15.62:0/4010332689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608f4677330 0x5608f4677710 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f636804a9e0 tx=0x7f636804a8e0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.423+0000 7f63711c49c0 1 -- 172.21.15.62:0/4010332689 shutdown_connections 2024-09-10T05:36:37.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.423+0000 7f63711c49c0 1 --2- 172.21.15.62:0/4010332689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608f4677330 0x5608f4677710 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.423+0000 7f63711c49c0 1 -- 172.21.15.62:0/4010332689 >> 172.21.15.62:0/4010332689 conn(0x5608f46726f0 msgr2=0x5608f4670930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:37.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.423+0000 7f63711c49c0 1 -- 172.21.15.62:0/4010332689 shutdown_connections 2024-09-10T05:36:37.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.423+0000 7f63711c49c0 1 -- 172.21.15.62:0/4010332689 wait complete. 2024-09-10T05:36:37.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.423+0000 7f63711c49c0 1 Processor -- start 2024-09-10T05:36:37.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.423+0000 7f63711c49c0 1 -- start start 2024-09-10T05:36:37.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.423+0000 7f63711c49c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608f4677330 0x5608f467d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.423+0000 7f63711c49c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5608f46760a0 con 0x5608f4677330 2024-09-10T05:36:37.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.427+0000 7f636ecca640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608f4677330 0x5608f467d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.427+0000 7f636ecca640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608f4677330 0x5608f467d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47558/0 (socket says 172.21.15.62:47558) 2024-09-10T05:36:37.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.427+0000 7f636ecca640 1 -- 172.21.15.62:0/530512548 learned_addr learned my addr 172.21.15.62:0/530512548 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:37.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.427+0000 7f636ecca640 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608f467db10 con 0x5608f4677330 2024-09-10T05:36:37.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.427+0000 7f636ecca640 1 --2- 172.21.15.62:0/530512548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608f4677330 0x5608f467d5b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f636804a9e0 tx=0x7f6368028a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.427+0000 7f6250ff9640 1 -- 172.21.15.62:0/530512548 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6368041e00 con 0x5608f4677330 2024-09-10T05:36:37.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.427+0000 7f6250ff9640 1 -- 172.21.15.62:0/530512548 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f636806c070 con 0x5608f4677330 2024-09-10T05:36:37.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.427+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5608f467db10 con 0x5608f4677330 2024-09-10T05:36:37.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.427+0000 7f6250ff9640 1 -- 172.21.15.62:0/530512548 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6368011dc0 con 0x5608f4677330 2024-09-10T05:36:37.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.427+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608f467db10 con 0x5608f4677330 2024-09-10T05:36:37.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.427+0000 7f6250ff9640 1 -- 172.21.15.62:0/530512548 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6368063040 con 0x5608f4677330 2024-09-10T05:36:37.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.427+0000 7f6250ff9640 1 --2- 172.21.15.62:0/530512548 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6238039a70 0x7f623803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.427+0000 7f6250ff9640 1 -- 172.21.15.62:0/530512548 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f6368061020 con 0x5608f4677330 2024-09-10T05:36:37.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.427+0000 7f63711c49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.427+0000 7f636e4c9640 1 --2- 172.21.15.62:0/530512548 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6238039a70 0x7f623803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.427+0000 7f63711c49c0 1 --2- 172.21.15.62:0/530512548 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5608f4688510 0x5608f468a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.427+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608f468b0f0 con 0x5608f4688510 2024-09-10T05:36:37.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.427+0000 7f636f4cb640 1 --2- 172.21.15.62:0/530512548 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5608f4688510 0x5608f468a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.431+0000 7f636e4c9640 1 --2- 172.21.15.62:0/530512548 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6238039a70 0x7f623803bf30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f63640ab820 tx=0x7f63640a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.431+0000 7f636f4cb640 1 --2- 172.21.15.62:0/530512548 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5608f4688510 0x5608f468a9a0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.431+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f63600083f0 con 0x5608f4688510 2024-09-10T05:36:37.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.431+0000 7f63711c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:37.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.431+0000 7f63711c49c0 20 realm 2024-09-10T05:36:37.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.431+0000 7f63711c49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.431+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608f4687860 con 0x5608f4688510 2024-09-10T05:36:37.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.431+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f63600083f0 con 0x5608f4688510 2024-09-10T05:36:37.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.431+0000 7f63711c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:37.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.431+0000 7f63711c49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:37.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.431+0000 7f63711c49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.431+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608f468bbb0 con 0x5608f4688510 2024-09-10T05:36:37.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.431+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f63600083f0 con 0x5608f4688510 2024-09-10T05:36:37.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.431+0000 7f63711c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:37.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.431+0000 7f63711c49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.431+0000 7f63711c49c0 1 --2- 172.21.15.62:0/530512548 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5608f468c990 0x5608f468ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.431+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608f468f450 con 0x5608f468c990 2024-09-10T05:36:37.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.431+0000 7f636ecca640 1 --2- 172.21.15.62:0/530512548 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5608f468c990 0x5608f468ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.431+0000 7f636ecca640 1 --2- 172.21.15.62:0/530512548 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5608f468c990 0x5608f468ed80 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.431+0000 7f636ecca640 1 -- 172.21.15.62:0/530512548 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6368047020 con 0x5608f468c990 2024-09-10T05:36:37.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.431+0000 7f63711c49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:37.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.431+0000 7f63711c49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.431+0000 7f63711c49c0 1 --2- 172.21.15.62:0/530512548 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5608f46901b0 0x5608f46925c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.431+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608f4692d50 con 0x5608f46901b0 2024-09-10T05:36:37.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.431+0000 7f636e4c9640 1 --2- 172.21.15.62:0/530512548 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5608f46901b0 0x5608f46925c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.431+0000 7f636e4c9640 1 --2- 172.21.15.62:0/530512548 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5608f46901b0 0x5608f46925c0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.431+0000 7f636e4c9640 1 -- 172.21.15.62:0/530512548 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f63640b3040 con 0x5608f46901b0 2024-09-10T05:36:37.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.431+0000 7f63711c49c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:37.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.431+0000 7f63711c49c0 20 searching for the correct realm 2024-09-10T05:36:37.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.431+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608f4694620 con 0x5608f46901b0 2024-09-10T05:36:37.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.435+0000 7f636e4c9640 1 -- 172.21.15.62:0/530512548 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63640b3040 con 0x5608f46901b0 2024-09-10T05:36:37.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.435+0000 7f636e4c9640 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608f4694620 con 0x5608f468c990 2024-09-10T05:36:37.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.435+0000 7f636ecca640 1 -- 172.21.15.62:0/530512548 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6368047020 con 0x5608f468c990 2024-09-10T05:36:37.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.435+0000 7f636ecca640 1 --2- 172.21.15.62:0/530512548 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f6368034b20 0x7f6368050900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.435+0000 7f636ecca640 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608f4694620 con 0x7f6368034b20 2024-09-10T05:36:37.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.435+0000 7f636f4cb640 1 --2- 172.21.15.62:0/530512548 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f6368034b20 0x7f6368050900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.435+0000 7f636f4cb640 1 --2- 172.21.15.62:0/530512548 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f6368034b20 0x7f6368050900 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.435+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63600083f0 con 0x7f6368034b20 2024-09-10T05:36:37.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.435+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608f4694620 con 0x5608f4688510 2024-09-10T05:36:37.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.435+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63600083f0 con 0x5608f4688510 2024-09-10T05:36:37.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.435+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608f4694620 con 0x5608f4688510 2024-09-10T05:36:37.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.435+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63600083f0 con 0x5608f4688510 2024-09-10T05:36:37.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.435+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608f4694620 con 0x5608f46901b0 2024-09-10T05:36:37.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.435+0000 7f636e4c9640 1 -- 172.21.15.62:0/530512548 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63640b3040 con 0x5608f46901b0 2024-09-10T05:36:37.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.435+0000 7f636e4c9640 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608f4694620 con 0x5608f4688510 2024-09-10T05:36:37.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.435+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63600083f0 con 0x5608f4688510 2024-09-10T05:36:37.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.435+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608f4694620 con 0x5608f468c990 2024-09-10T05:36:37.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.435+0000 7f636ecca640 1 -- 172.21.15.62:0/530512548 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6368047020 con 0x5608f468c990 2024-09-10T05:36:37.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.435+0000 7f636ecca640 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608f4694620 con 0x5608f468c990 2024-09-10T05:36:37.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.439+0000 7f636ecca640 1 -- 172.21.15.62:0/530512548 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6368047020 con 0x5608f468c990 2024-09-10T05:36:37.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.439+0000 7f636ecca640 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608f4694620 con 0x5608f4688510 2024-09-10T05:36:37.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.439+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63600083f0 con 0x5608f4688510 2024-09-10T05:36:37.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.439+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608f4694620 con 0x7f6368034b20 2024-09-10T05:36:37.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.439+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63600083f0 con 0x7f6368034b20 2024-09-10T05:36:37.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.439+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608f4694620 con 0x5608f4688510 2024-09-10T05:36:37.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.439+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63600083f0 con 0x5608f4688510 2024-09-10T05:36:37.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.439+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608f4694620 con 0x7f6368034b20 2024-09-10T05:36:37.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.439+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f63600083f0 con 0x7f6368034b20 2024-09-10T05:36:37.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.439+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608f4694620 con 0x5608f468c990 2024-09-10T05:36:37.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.439+0000 7f636ecca640 1 -- 172.21.15.62:0/530512548 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6368047020 con 0x5608f468c990 2024-09-10T05:36:37.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.439+0000 7f636ecca640 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608f4694620 con 0x5608f46901b0 2024-09-10T05:36:37.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.439+0000 7f636e4c9640 1 -- 172.21.15.62:0/530512548 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63640b3040 con 0x5608f46901b0 2024-09-10T05:36:37.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.439+0000 7f636e4c9640 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608f4694620 con 0x5608f4688510 2024-09-10T05:36:37.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.439+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63600083f0 con 0x5608f4688510 2024-09-10T05:36:37.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.439+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608f4694620 con 0x5608f468c990 2024-09-10T05:36:37.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.439+0000 7f636ecca640 1 -- 172.21.15.62:0/530512548 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6368047020 con 0x5608f468c990 2024-09-10T05:36:37.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.439+0000 7f636ecca640 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608f4694620 con 0x5608f46901b0 2024-09-10T05:36:37.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.439+0000 7f636e4c9640 1 -- 172.21.15.62:0/530512548 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 30 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f63640b3040 con 0x5608f46901b0 2024-09-10T05:36:37.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.439+0000 7f636e4c9640 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608f4694620 con 0x5608f4688510 2024-09-10T05:36:37.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.439+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63600083f0 con 0x5608f4688510 2024-09-10T05:36:37.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.443+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608f4694620 con 0x5608f4688510 2024-09-10T05:36:37.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.443+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f63600083f0 con 0x5608f4688510 2024-09-10T05:36:37.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.443+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608f4694620 con 0x5608f4688510 2024-09-10T05:36:37.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.443+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63600083f0 con 0x5608f4688510 2024-09-10T05:36:37.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.443+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608f4694620 con 0x5608f46901b0 2024-09-10T05:36:37.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.443+0000 7f636e4c9640 1 -- 172.21.15.62:0/530512548 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63640b3040 con 0x5608f46901b0 2024-09-10T05:36:37.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.443+0000 7f636e4c9640 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608f4694620 con 0x7f6368034b20 2024-09-10T05:36:37.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.443+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63600083f0 con 0x7f6368034b20 2024-09-10T05:36:37.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.443+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608f4694620 con 0x5608f4688510 2024-09-10T05:36:37.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.443+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63600083f0 con 0x5608f4688510 2024-09-10T05:36:37.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.443+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608f4694620 con 0x7f6368034b20 2024-09-10T05:36:37.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.443+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63600083f0 con 0x7f6368034b20 2024-09-10T05:36:37.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.443+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608f4694620 con 0x5608f46901b0 2024-09-10T05:36:37.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.443+0000 7f636e4c9640 1 -- 172.21.15.62:0/530512548 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63640b3040 con 0x5608f46901b0 2024-09-10T05:36:37.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.443+0000 7f636e4c9640 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608f4694620 con 0x7f6368034b20 2024-09-10T05:36:37.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.443+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63600083f0 con 0x7f6368034b20 2024-09-10T05:36:37.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.443+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608f4694620 con 0x5608f468c990 2024-09-10T05:36:37.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.443+0000 7f636ecca640 1 -- 172.21.15.62:0/530512548 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6368047020 con 0x5608f468c990 2024-09-10T05:36:37.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.443+0000 7f636ecca640 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608f4694620 con 0x5608f468c990 2024-09-10T05:36:37.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.443+0000 7f636ecca640 1 -- 172.21.15.62:0/530512548 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6368047020 con 0x5608f468c990 2024-09-10T05:36:37.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.443+0000 7f636ecca640 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608f4694620 con 0x5608f46901b0 2024-09-10T05:36:37.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.447+0000 7f636e4c9640 1 -- 172.21.15.62:0/530512548 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63640b3040 con 0x5608f46901b0 2024-09-10T05:36:37.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.447+0000 7f636e4c9640 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608f4694620 con 0x5608f468c990 2024-09-10T05:36:37.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.447+0000 7f636ecca640 1 -- 172.21.15.62:0/530512548 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6368047020 con 0x5608f468c990 2024-09-10T05:36:37.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.447+0000 7f636ecca640 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608f4694620 con 0x5608f468c990 2024-09-10T05:36:37.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.447+0000 7f636ecca640 1 -- 172.21.15.62:0/530512548 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6368047020 con 0x5608f468c990 2024-09-10T05:36:37.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.447+0000 7f63711c49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:37.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.447+0000 7f63711c49c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:37.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.447+0000 7f63711c49c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:37.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.447+0000 7f63711c49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:37.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.447+0000 7f63711c49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:37.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.447+0000 7f63711c49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:37.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.447+0000 7f63711c49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.447+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608f4693710 con 0x5608f4688510 2024-09-10T05:36:37.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.447+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f63600083f0 con 0x5608f4688510 2024-09-10T05:36:37.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.447+0000 7f63711c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:37.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.447+0000 7f63711c49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.447+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608f4693320 con 0x5608f468c990 2024-09-10T05:36:37.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.447+0000 7f636ecca640 1 -- 172.21.15.62:0/530512548 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6368047020 con 0x5608f468c990 2024-09-10T05:36:37.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.447+0000 7f63711c49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:37.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.447+0000 7f63711c49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.447+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608f4693330 con 0x5608f46901b0 2024-09-10T05:36:37.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.447+0000 7f636e4c9640 1 -- 172.21.15.62:0/530512548 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f63640b3040 con 0x5608f46901b0 2024-09-10T05:36:37.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.447+0000 7f63711c49c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:37.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.447+0000 7f63711c49c0 20 zone default found 2024-09-10T05:36:37.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.447+0000 7f63711c49c0 4 Realm: () 2024-09-10T05:36:37.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.447+0000 7f63711c49c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:37.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.447+0000 7f63711c49c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:37.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.447+0000 7f63711c49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:37.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.447+0000 7f63711c49c0 20 zonegroup default 2024-09-10T05:36:37.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.447+0000 7f63711c49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.447+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608f4694a50 con 0x7f6368034b20 2024-09-10T05:36:37.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.447+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f63600083f0 con 0x7f6368034b20 2024-09-10T05:36:37.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.447+0000 7f63711c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:37.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.447+0000 7f63711c49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.447+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608f4696c90 con 0x5608f46901b0 2024-09-10T05:36:37.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.447+0000 7f636e4c9640 1 -- 172.21.15.62:0/530512548 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f63640b3040 con 0x5608f46901b0 2024-09-10T05:36:37.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.447+0000 7f63711c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:37.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.447+0000 7f63711c49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.447+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608f4697030 con 0x5608f46901b0 2024-09-10T05:36:37.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.447+0000 7f636e4c9640 1 -- 172.21.15.62:0/530512548 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f63640b3040 con 0x5608f46901b0 2024-09-10T05:36:37.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.451+0000 7f63711c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:37.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.451+0000 7f63711c49c0 20 started sync module instance, tier type = 2024-09-10T05:36:37.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.451+0000 7f63711c49c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:37.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.451+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608f46960d0 con 0x5608f468c990 2024-09-10T05:36:37.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.451+0000 7f636ecca640 1 -- 172.21.15.62:0/530512548 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6368047020 con 0x5608f468c990 2024-09-10T05:36:37.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.451+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94596460274880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608f46960d0 con 0x5608f468c990 2024-09-10T05:36:37.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.451+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608f46978d0 con 0x5608f4688510 2024-09-10T05:36:37.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.451+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63600083f0 con 0x5608f4688510 2024-09-10T05:36:37.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.451+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94596460278816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608f4698120 con 0x5608f4688510 2024-09-10T05:36:37.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.451+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608f46989b0 con 0x5608f468c990 2024-09-10T05:36:37.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.455+0000 7f636ecca640 1 -- 172.21.15.62:0/530512548 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94596460274880] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6368047020 con 0x5608f468c990 2024-09-10T05:36:37.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.455+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94596460278816] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63600083f0 con 0x5608f4688510 2024-09-10T05:36:37.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.455+0000 7f636ecca640 1 -- 172.21.15.62:0/530512548 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6368047020 con 0x5608f468c990 2024-09-10T05:36:37.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.455+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94596460272672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608f4698120 con 0x5608f468c990 2024-09-10T05:36:37.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.455+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608f4699250 con 0x7f6368034b20 2024-09-10T05:36:37.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.455+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63600083f0 con 0x7f6368034b20 2024-09-10T05:36:37.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.455+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94596460285344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608f4698120 con 0x7f6368034b20 2024-09-10T05:36:37.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.455+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608f4699cf0 con 0x5608f468c990 2024-09-10T05:36:37.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.455+0000 7f636ecca640 1 -- 172.21.15.62:0/530512548 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94596460272672] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6368047020 con 0x5608f468c990 2024-09-10T05:36:37.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.459+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94596460285344] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63600083f0 con 0x7f6368034b20 2024-09-10T05:36:37.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.459+0000 7f636ecca640 1 -- 172.21.15.62:0/530512548 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6368047020 con 0x5608f468c990 2024-09-10T05:36:37.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.459+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94596460287968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608f4697c70 con 0x5608f468c990 2024-09-10T05:36:37.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.459+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608f469a590 con 0x5608f46901b0 2024-09-10T05:36:37.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.459+0000 7f636e4c9640 1 -- 172.21.15.62:0/530512548 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63640b3040 con 0x5608f46901b0 2024-09-10T05:36:37.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.459+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94596460290272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608f4697c70 con 0x5608f46901b0 2024-09-10T05:36:37.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.459+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608f469afd0 con 0x5608f46901b0 2024-09-10T05:36:37.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.459+0000 7f636ecca640 1 -- 172.21.15.62:0/530512548 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94596460287968] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6368047020 con 0x5608f468c990 2024-09-10T05:36:37.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.459+0000 7f636e4c9640 1 -- 172.21.15.62:0/530512548 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94596460290272] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63640b3040 con 0x5608f46901b0 2024-09-10T05:36:37.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.459+0000 7f636e4c9640 1 -- 172.21.15.62:0/530512548 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63640b3040 con 0x5608f46901b0 2024-09-10T05:36:37.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.459+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94596460291328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608f469ab20 con 0x5608f46901b0 2024-09-10T05:36:37.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.459+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608f469b870 con 0x7f6368034b20 2024-09-10T05:36:37.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.463+0000 7f636e4c9640 1 -- 172.21.15.62:0/530512548 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94596460291328] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63640b3040 con 0x5608f46901b0 2024-09-10T05:36:37.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.463+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63600083f0 con 0x7f6368034b20 2024-09-10T05:36:37.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.463+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94596460286400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608f469ab20 con 0x7f6368034b20 2024-09-10T05:36:37.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.463+0000 7f63711c49c0 20 add_watcher() i=0 2024-09-10T05:36:37.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.463+0000 7f63711c49c0 20 add_watcher() i=1 2024-09-10T05:36:37.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.463+0000 7f63711c49c0 20 add_watcher() i=2 2024-09-10T05:36:37.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.463+0000 7f63711c49c0 20 add_watcher() i=3 2024-09-10T05:36:37.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.463+0000 7f63711c49c0 20 add_watcher() i=4 2024-09-10T05:36:37.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.463+0000 7f63711c49c0 20 add_watcher() i=5 2024-09-10T05:36:37.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.463+0000 7f63711c49c0 20 add_watcher() i=6 2024-09-10T05:36:37.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.463+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94596460286400] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63600083f0 con 0x7f6368034b20 2024-09-10T05:36:37.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.463+0000 7f63711c49c0 20 add_watcher() i=7 2024-09-10T05:36:37.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.463+0000 7f63711c49c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:37.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.463+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608f469e990 con 0x5608f4688510 2024-09-10T05:36:37.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.463+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f63600083f0 con 0x5608f4688510 2024-09-10T05:36:37.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.463+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94596460295104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608f469bd80 con 0x5608f4688510 2024-09-10T05:36:37.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.467+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94596460295104] v30'125 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f63600083f0 con 0x5608f4688510 2024-09-10T05:36:37.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.467+0000 7f62257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:37.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.467+0000 7f63711c49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:37.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.467+0000 7f63711c49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:37.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.467+0000 7f63711c49c0 5 note: GC not initialized 2024-09-10T05:36:37.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.467+0000 7f619ffff640 20 reqs_thread_entry: start 2024-09-10T05:36:37.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.467+0000 7f63711c49c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:37.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.467+0000 7f63711c49c0 20 Filter name: none 2024-09-10T05:36:37.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.467+0000 7f619dffb640 20 reqs_thread_entry: start 2024-09-10T05:36:37.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.467+0000 7f63711c49c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T05:36:37.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.467+0000 7f63711c49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.467+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608f46c1b90 con 0x5608f4688510 2024-09-10T05:36:37.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.467+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f63600083f0 con 0x5608f4688510 2024-09-10T05:36:37.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.467+0000 7f63711c49c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:36:37.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.467+0000 7f63711c49c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T05:36:37.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.467+0000 7f63711c49c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:36:37.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.467+0000 7f63711c49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:36:37.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.467+0000 7f63711c49c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T05:36:37.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.467+0000 7f63711c49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.467+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608f46c3c80 con 0x7f6368034b20 2024-09-10T05:36:37.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.467+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv21 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f63600083f0 con 0x7f6368034b20 2024-09-10T05:36:37.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.467+0000 7f63711c49c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T05:36:37.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.467+0000 7f63711c49c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-10T05:36:37.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.467+0000 7f63711c49c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T05:36:37.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.467+0000 7f63711c49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 : miss 2024-09-10T05:36:37.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.467+0000 7f63711c49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.467+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:64 8.1f 8:fcc5c255:root::.bucket.meta.myfoo%3a475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608f46c5470 con 0x7f6368034b20 2024-09-10T05:36:37.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.467+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(64 .bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f63600083f0 con 0x7f6368034b20 2024-09-10T05:36:37.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.467+0000 7f63711c49c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T05:36:37.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.467+0000 7f63711c49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 info.flags=0x17 2024-09-10T05:36:37.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.467+0000 7f63711c49c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 to cache LRU end 2024-09-10T05:36:37.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.467+0000 7f63711c49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:36:37.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.467+0000 7f63711c49c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T05:36:37.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.467+0000 7f63711c49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 2024-09-10T05:36:37.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.467+0000 7f63711c49c0 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-10T05:36:37.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.467+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608f46c9af0 con 0x5608f4688510 2024-09-10T05:36:37.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.471+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(65 fud.buckets [call] v30'3 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f63600083f0 con 0x5608f4688510 2024-09-10T05:36:37.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.471+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:66 8.1f 8:fcc5c255:root::.bucket.meta.myfoo%3a475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608f46cf900 con 0x7f6368034b20 2024-09-10T05:36:37.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.471+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(66 .bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v30'3 uv3 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f63600083f0 con 0x7f6368034b20 2024-09-10T05:36:37.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.471+0000 7f63711c49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 info.flags=0x17 2024-09-10T05:36:37.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.471+0000 7f63711c49c0 10 moving default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 to cache LRU end 2024-09-10T05:36:37.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.471+0000 7f63711c49c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T05:36:37.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.471+0000 7f63711c49c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1, ofs0, ns] 2024-09-10T05:36:37.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.471+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94596460469040 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608f46c9f20 con 0x5608f46901b0 2024-09-10T05:36:37.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.471+0000 7f636e4c9640 1 -- 172.21.15.62:0/530512548 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== watch-notify(notify (1) cookie 94596460290272 notify 128849018887 ret 0) ==== 802+0+0 (crc 0 0 0) 0x7f63640e4040 con 0x5608f46901b0 2024-09-10T05:36:37.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.471+0000 7f62527fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018887 cookie 94596460290272 notifier 4521 bl.length()=760 2024-09-10T05:36:37.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.471+0000 7f636e4c9640 1 -- 172.21.15.62:0/530512548 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(67 notify.5 [notify cookie 94596460469040 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f63640b3040 con 0x5608f46901b0 2024-09-10T05:36:37.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.471+0000 7f62527fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 info.flags=0x17 2024-09-10T05:36:37.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.471+0000 7f62527fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 to cache LRU end 2024-09-10T05:36:37.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.471+0000 7f62527fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T05:36:37.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.475+0000 7f62527fc640 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f6234003eb0 con 0x5608f46901b0 2024-09-10T05:36:37.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.475+0000 7f636e4c9640 1 -- 172.21.15.62:0/530512548 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== watch-notify(notify_complete (2) cookie 94596460469040 notify 128849018887 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5608f43ffca0 con 0x5608f46901b0 2024-09-10T05:36:37.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.475+0000 7f636e4c9640 1 -- 172.21.15.62:0/530512548 <== osd.3 v2:172.21.15.62:6816/2708991149 19 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63640b3040 con 0x5608f46901b0 2024-09-10T05:36:37.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.475+0000 7f63711c49c0 20 handle_bi_update(): bucket=:myfoo[475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1]): orig_sources= new_sources= 2024-09-10T05:36:37.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.475+0000 7f63711c49c0 20 handle_bi_update(): bucket=:myfoo[475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1]): potential sources added=[] removed=[] 2024-09-10T05:36:37.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.475+0000 7f63711c49c0 20 handle_bi_update(): bucket=:myfoo[475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1]): orig_dests= new_dests= 2024-09-10T05:36:37.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.475+0000 7f63711c49c0 20 handle_bi_update(): bucket=:myfoo[475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1]): potential dests added=[] removed=[] 2024-09-10T05:36:37.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.475+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608f46ce210 con 0x7f6368034b20 2024-09-10T05:36:37.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.475+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 <== osd.2 v2:172.21.15.62:6800/2677868286 15 ==== osd_op_reply(69 foo.buckets [call] v30'22 uv22 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f63600083f0 con 0x7f6368034b20 2024-09-10T05:36:37.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.475+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608f46c5b10 con 0x7f6368034b20 2024-09-10T05:36:37.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.475+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 <== osd.2 v2:172.21.15.62:6800/2677868286 16 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v30'23 uv23 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f63600083f0 con 0x7f6368034b20 2024-09-10T05:36:37.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.475+0000 7f63711c49c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-10T05:36:37.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.475+0000 7f63711c49c0 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T05:36:37.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.475+0000 7f63711c49c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-10T05:36:37.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.475+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94596460469008 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608f46ce6c0 con 0x5608f46901b0 2024-09-10T05:36:37.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.475+0000 7f636e4c9640 1 -- 172.21.15.62:0/530512548 <== osd.3 v2:172.21.15.62:6816/2708991149 20 ==== watch-notify(notify (1) cookie 94596460291328 notify 128849018888 ret 0) ==== 356+0+0 (crc 0 0 0) 0x7f63640dfc60 con 0x5608f46901b0 2024-09-10T05:36:37.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.475+0000 7f636e4c9640 1 -- 172.21.15.62:0/530512548 <== osd.3 v2:172.21.15.62:6816/2708991149 21 ==== osd_op_reply(71 notify.6 [notify cookie 94596460469008 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f63640b3040 con 0x5608f46901b0 2024-09-10T05:36:37.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.475+0000 7f62527fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018888 cookie 94596460291328 notifier 4521 bl.length()=314 2024-09-10T05:36:37.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.475+0000 7f62527fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-10T05:36:37.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.475+0000 7f62527fc640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T05:36:37.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.475+0000 7f62527fc640 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f6234003eb0 con 0x5608f46901b0 2024-09-10T05:36:37.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.475+0000 7f636e4c9640 1 -- 172.21.15.62:0/530512548 <== osd.3 v2:172.21.15.62:6816/2708991149 22 ==== watch-notify(notify_complete (2) cookie 94596460469008 notify 128849018888 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f63640b76a0 con 0x5608f46901b0 2024-09-10T05:36:37.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.475+0000 7f636e4c9640 1 -- 172.21.15.62:0/530512548 <== osd.3 v2:172.21.15.62:6816/2708991149 23 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63640b3040 con 0x5608f46901b0 2024-09-10T05:36:37.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.479+0000 7f62257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:37.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.479+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94596460295104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608f46bf9a0 con 0x5608f4688510 2024-09-10T05:36:37.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.479+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94596460295104] v30'126 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f63600083f0 con 0x5608f4688510 2024-09-10T05:36:37.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.479+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94596460274880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608f46bf9a0 con 0x5608f468c990 2024-09-10T05:36:37.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.483+0000 7f636ecca640 1 -- 172.21.15.62:0/530512548 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94596460274880] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6368047020 con 0x5608f468c990 2024-09-10T05:36:37.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.483+0000 7f63711c49c0 20 remove_watcher() i=0 2024-09-10T05:36:37.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.483+0000 7f63711c49c0 2 removed watcher, disabling cache 2024-09-10T05:36:37.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.483+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94596460278816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608f46bf9a0 con 0x5608f4688510 2024-09-10T05:36:37.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.483+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94596460278816] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63600083f0 con 0x5608f4688510 2024-09-10T05:36:37.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.483+0000 7f63711c49c0 20 remove_watcher() i=1 2024-09-10T05:36:37.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.483+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94596460272672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608f46bf9a0 con 0x5608f468c990 2024-09-10T05:36:37.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.487+0000 7f636ecca640 1 -- 172.21.15.62:0/530512548 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94596460272672] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6368047020 con 0x5608f468c990 2024-09-10T05:36:37.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.487+0000 7f63711c49c0 20 remove_watcher() i=2 2024-09-10T05:36:37.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.487+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94596460285344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608f46bf9a0 con 0x7f6368034b20 2024-09-10T05:36:37.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.487+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 <== osd.2 v2:172.21.15.62:6800/2677868286 17 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94596460285344] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63600083f0 con 0x7f6368034b20 2024-09-10T05:36:37.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.487+0000 7f63711c49c0 20 remove_watcher() i=3 2024-09-10T05:36:37.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.487+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94596460287968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608f46bf9a0 con 0x5608f468c990 2024-09-10T05:36:37.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.491+0000 7f636ecca640 1 -- 172.21.15.62:0/530512548 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94596460287968] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6368047020 con 0x5608f468c990 2024-09-10T05:36:37.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.491+0000 7f63711c49c0 20 remove_watcher() i=4 2024-09-10T05:36:37.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.491+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94596460290272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608f46bf9a0 con 0x5608f46901b0 2024-09-10T05:36:37.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.491+0000 7f636e4c9640 1 -- 172.21.15.62:0/530512548 <== osd.3 v2:172.21.15.62:6816/2708991149 24 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94596460290272] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63640b3040 con 0x5608f46901b0 2024-09-10T05:36:37.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.491+0000 7f63711c49c0 20 remove_watcher() i=5 2024-09-10T05:36:37.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.491+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94596460291328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608f46bf9a0 con 0x5608f46901b0 2024-09-10T05:36:37.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.491+0000 7f636e4c9640 1 -- 172.21.15.62:0/530512548 <== osd.3 v2:172.21.15.62:6816/2708991149 25 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94596460291328] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63640b3040 con 0x5608f46901b0 2024-09-10T05:36:37.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.491+0000 7f63711c49c0 20 remove_watcher() i=6 2024-09-10T05:36:37.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.491+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94596460286400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608f46bf9a0 con 0x7f6368034b20 2024-09-10T05:36:37.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.491+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 <== osd.2 v2:172.21.15.62:6800/2677868286 18 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94596460286400] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63600083f0 con 0x7f6368034b20 2024-09-10T05:36:37.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.491+0000 7f63711c49c0 20 remove_watcher() i=7 2024-09-10T05:36:37.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.495+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5608f468c990 msgr2=0x5608f468ed80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.495+0000 7f63711c49c0 1 --2- 172.21.15.62:0/530512548 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5608f468c990 0x5608f468ed80 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.495+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5608f4688510 msgr2=0x5608f468a9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.495+0000 7f63711c49c0 1 --2- 172.21.15.62:0/530512548 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5608f4688510 0x5608f468a9a0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.495+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f6368034b20 msgr2=0x7f6368050900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.495+0000 7f63711c49c0 1 --2- 172.21.15.62:0/530512548 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f6368034b20 0x7f6368050900 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.495+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5608f46901b0 msgr2=0x5608f46925c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.495+0000 7f63711c49c0 1 --2- 172.21.15.62:0/530512548 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5608f46901b0 0x5608f46925c0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.495+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6238039a70 msgr2=0x7f623803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.495+0000 7f63711c49c0 1 --2- 172.21.15.62:0/530512548 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6238039a70 0x7f623803bf30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f63640ab820 tx=0x7f63640a6000 comp rx=0 tx=0).stop 2024-09-10T05:36:37.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.495+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608f4677330 msgr2=0x5608f467d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.495+0000 7f63711c49c0 1 --2- 172.21.15.62:0/530512548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608f4677330 0x5608f467d5b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f636804a9e0 tx=0x7f6368028a00 comp rx=0 tx=0).stop 2024-09-10T05:36:37.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.495+0000 7f636f4cb640 1 -- 172.21.15.62:0/530512548 reap_dead start 2024-09-10T05:36:37.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.495+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 shutdown_connections 2024-09-10T05:36:37.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.495+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 >> 172.21.15.62:0/530512548 conn(0x5608f46726f0 msgr2=0x5608f4670900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:37.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.495+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 shutdown_connections 2024-09-10T05:36:37.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.495+0000 7f63711c49c0 1 -- 172.21.15.62:0/530512548 wait complete. 2024-09-10T05:36:37.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.495+0000 7f63711c49c0 1 -- 172.21.15.62:0/2759707715 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6248039ac0 msgr2=0x7f624803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.495+0000 7f63711c49c0 1 --2- 172.21.15.62:0/2759707715 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6248039ac0 0x7f624803bf80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x5608f464d500 tx=0x7f6364005a10 comp rx=0 tx=0).stop 2024-09-10T05:36:37.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.495+0000 7f63711c49c0 1 -- 172.21.15.62:0/2759707715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608f4669d10 msgr2=0x5608f466a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.495+0000 7f63711c49c0 1 --2- 172.21.15.62:0/2759707715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608f4669d10 0x5608f466a130 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f6368010ad0 tx=0x7f6368012690 comp rx=0 tx=0).stop 2024-09-10T05:36:37.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.495+0000 7f63711c49c0 1 -- 172.21.15.62:0/2759707715 shutdown_connections 2024-09-10T05:36:37.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.495+0000 7f63711c49c0 1 --2- 172.21.15.62:0/2759707715 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6248039ac0 0x7f624803bf80 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.495+0000 7f63711c49c0 1 --2- 172.21.15.62:0/2759707715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608f4669d10 0x5608f466a130 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.495+0000 7f63711c49c0 1 -- 172.21.15.62:0/2759707715 >> 172.21.15.62:0/2759707715 conn(0x5608f465f6c0 msgr2=0x5608f465faa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:37.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.495+0000 7f63711c49c0 1 -- 172.21.15.62:0/2759707715 shutdown_connections 2024-09-10T05:36:37.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.495+0000 7f63711c49c0 1 -- 172.21.15.62:0/2759707715 wait complete. 2024-09-10T05:36:37.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.495+0000 7f63711c49c0 1 -- 172.21.15.62:0/1770116108 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5608f46544c0 msgr2=0x5608f46568b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.495+0000 7f63711c49c0 1 --2- 172.21.15.62:0/1770116108 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5608f46544c0 0x5608f46568b0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.495+0000 7f63711c49c0 1 -- 172.21.15.62:0/1770116108 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5608f455d1a0 msgr2=0x5608f4653220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.495+0000 7f63711c49c0 1 --2- 172.21.15.62:0/1770116108 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5608f455d1a0 0x5608f4653220 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.495+0000 7f63711c49c0 1 -- 172.21.15.62:0/1770116108 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5608f4658c60 msgr2=0x5608f465b050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.495+0000 7f63711c49c0 1 --2- 172.21.15.62:0/1770116108 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5608f4658c60 0x5608f465b050 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.495+0000 7f63711c49c0 1 -- 172.21.15.62:0/1770116108 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6254039a70 msgr2=0x7f625403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.495+0000 7f63711c49c0 1 --2- 172.21.15.62:0/1770116108 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6254039a70 0x7f625403bf30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f63640ad000 tx=0x7f63640a5040 comp rx=0 tx=0).stop 2024-09-10T05:36:37.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.495+0000 7f63711c49c0 1 -- 172.21.15.62:0/1770116108 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608f4559690 msgr2=0x5608f464c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.495+0000 7f63711c49c0 1 --2- 172.21.15.62:0/1770116108 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608f4559690 0x5608f464c0b0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f6368000f90 tx=0x7f6368001260 comp rx=0 tx=0).stop 2024-09-10T05:36:37.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.495+0000 7f636f4cb640 1 -- 172.21.15.62:0/1770116108 reap_dead start 2024-09-10T05:36:37.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.495+0000 7f63711c49c0 1 -- 172.21.15.62:0/1770116108 shutdown_connections 2024-09-10T05:36:37.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.495+0000 7f63711c49c0 1 -- 172.21.15.62:0/1770116108 >> 172.21.15.62:0/1770116108 conn(0x5608f44cca20 msgr2=0x5608f463f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:37.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.495+0000 7f63711c49c0 1 -- 172.21.15.62:0/1770116108 shutdown_connections 2024-09-10T05:36:37.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.495+0000 7f63711c49c0 1 -- 172.21.15.62:0/1770116108 wait complete. 2024-09-10T05:36:37.509 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-10T05:36:37.509 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-10T05:36:37.509 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-10T05:36:37.582 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:37.583 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:37.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.579+0000 7f9160ee49c0 1 Processor -- start 2024-09-10T05:36:37.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.579+0000 7f9160ee49c0 1 -- start start 2024-09-10T05:36:37.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.579+0000 7f9160ee49c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55d956d50280 0x55d956d50660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.579+0000 7f9160ee49c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d956c8e9c0 con 0x55d956d4ec70 2024-09-10T05:36:37.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.579+0000 7f9160ee49c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x55d956cde6d0 con 0x55d956d50280 2024-09-10T05:36:37.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.583+0000 7f915e9ea640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55d956d50280 0x55d956d50660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.583+0000 7f915e1e9640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x55d956d4ec70 0x55d956d4f080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:53084/0 (socket says 172.21.15.62:53084) 2024-09-10T05:36:37.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.583+0000 7f915e1e9640 1 -- 172.21.15.62:0/3408383660 learned_addr learned my addr 172.21.15.62:0/3408383660 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-10T05:36:37.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.583+0000 7f915e9ea640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55d956d50280 0x55d956d50660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47562/0 (socket says 172.21.15.62:47562) 2024-09-10T05:36:37.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.583+0000 7f915e9ea640 1 -- 172.21.15.62:0/3408383660 >> v1:172.21.15.2:6789/0 conn(0x55d956d4ec70 legacy=0x55d956d4f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.583+0000 7f915e9ea640 1 -- 172.21.15.62:0/3408383660 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d956c82ca0 con 0x55d956d50280 2024-09-10T05:36:37.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.583+0000 7f915e9ea640 1 --2- 172.21.15.62:0/3408383660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d956d50280 0x55d956d50660 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f915800a420 tx=0x7f915801afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a51c22389fa78462 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.587+0000 7f915d9e8640 1 -- 172.21.15.62:0/3408383660 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91580af070 con 0x55d956d50280 2024-09-10T05:36:37.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.587+0000 7f915d9e8640 1 -- 172.21.15.62:0/3408383660 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91580aa530 con 0x55d956d50280 2024-09-10T05:36:37.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.587+0000 7f915d9e8640 1 -- 172.21.15.62:0/3408383660 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91580aa850 con 0x55d956d50280 2024-09-10T05:36:37.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.587+0000 7f9160ee49c0 1 -- 172.21.15.62:0/3408383660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d956d50280 msgr2=0x55d956d50660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.587+0000 7f9160ee49c0 1 --2- 172.21.15.62:0/3408383660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d956d50280 0x55d956d50660 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f915800a420 tx=0x7f915801afd0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.587+0000 7f9160ee49c0 1 -- 172.21.15.62:0/3408383660 shutdown_connections 2024-09-10T05:36:37.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.587+0000 7f9160ee49c0 1 --2- 172.21.15.62:0/3408383660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d956d50280 0x55d956d50660 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.587+0000 7f9160ee49c0 1 -- 172.21.15.62:0/3408383660 >> 172.21.15.62:0/3408383660 conn(0x55d956dd5aa0 msgr2=0x55d956dd7ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:37.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.587+0000 7f9160ee49c0 1 -- 172.21.15.62:0/3408383660 shutdown_connections 2024-09-10T05:36:37.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.587+0000 7f9160ee49c0 1 -- 172.21.15.62:0/3408383660 wait complete. 2024-09-10T05:36:37.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.603+0000 7f9160ee49c0 1 Processor -- start 2024-09-10T05:36:37.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.603+0000 7f9160ee49c0 1 -- start start 2024-09-10T05:36:37.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.603+0000 7f9160ee49c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d956d4ec70 0x55d956ec7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.603+0000 7f9160ee49c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d956ce2680 con 0x55d956d4ec70 2024-09-10T05:36:37.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.603+0000 7f915e9ea640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d956d4ec70 0x55d956ec7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.603+0000 7f915e9ea640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d956d4ec70 0x55d956ec7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47566/0 (socket says 172.21.15.62:47566) 2024-09-10T05:36:37.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.603+0000 7f915e9ea640 1 -- 172.21.15.62:0/621372959 learned_addr learned my addr 172.21.15.62:0/621372959 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:37.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.603+0000 7f915e9ea640 1 -- 172.21.15.62:0/621372959 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d956c5dda0 con 0x55d956d4ec70 2024-09-10T05:36:37.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.603+0000 7f915e9ea640 1 --2- 172.21.15.62:0/621372959 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d956d4ec70 0x55d956ec7bd0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9158018c00 tx=0x7f91580033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2b443428689d0ee server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.603+0000 7f904ce09640 1 -- 172.21.15.62:0/621372959 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91580af050 con 0x55d956d4ec70 2024-09-10T05:36:37.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.603+0000 7f904ce09640 1 -- 172.21.15.62:0/621372959 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91580b0040 con 0x55d956d4ec70 2024-09-10T05:36:37.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.603+0000 7f904ce09640 1 -- 172.21.15.62:0/621372959 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91580aabb0 con 0x55d956d4ec70 2024-09-10T05:36:37.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.603+0000 7f9160ee49c0 1 -- 172.21.15.62:0/621372959 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d956d4ec70 msgr2=0x55d956ec7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.603+0000 7f9160ee49c0 1 --2- 172.21.15.62:0/621372959 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d956d4ec70 0x55d956ec7bd0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9158018c00 tx=0x7f91580033b0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.603+0000 7f9160ee49c0 1 -- 172.21.15.62:0/621372959 shutdown_connections 2024-09-10T05:36:37.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.603+0000 7f9160ee49c0 1 --2- 172.21.15.62:0/621372959 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d956d4ec70 0x55d956ec7bd0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.603+0000 7f9160ee49c0 1 -- 172.21.15.62:0/621372959 >> 172.21.15.62:0/621372959 conn(0x55d956dd5aa0 msgr2=0x55d956ec3810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:37.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.603+0000 7f9160ee49c0 1 -- 172.21.15.62:0/621372959 shutdown_connections 2024-09-10T05:36:37.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.603+0000 7f9160ee49c0 1 -- 172.21.15.62:0/621372959 wait complete. 2024-09-10T05:36:37.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.603+0000 7f9160ee49c0 1 Processor -- start 2024-09-10T05:36:37.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.603+0000 7f9160ee49c0 1 -- start start 2024-09-10T05:36:37.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.607+0000 7f9160ee49c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d956d4ec70 0x55d956ecf140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.607+0000 7f9160ee49c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d956c84a50 con 0x55d956d4ec70 2024-09-10T05:36:37.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.607+0000 7f915e9ea640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d956d4ec70 0x55d956ecf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.607+0000 7f915e9ea640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d956d4ec70 0x55d956ecf140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47576/0 (socket says 172.21.15.62:47576) 2024-09-10T05:36:37.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.607+0000 7f915e9ea640 1 -- 172.21.15.62:0/762022210 learned_addr learned my addr 172.21.15.62:0/762022210 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:37.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.607+0000 7f915e9ea640 1 -- 172.21.15.62:0/762022210 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d956ecf6a0 con 0x55d956d4ec70 2024-09-10T05:36:37.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.607+0000 7f915e9ea640 1 --2- 172.21.15.62:0/762022210 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d956d4ec70 0x55d956ecf140 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f9158019680 tx=0x7f9158017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.607+0000 7f904b606640 1 -- 172.21.15.62:0/762022210 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91580c4070 con 0x55d956d4ec70 2024-09-10T05:36:37.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.607+0000 7f904b606640 1 -- 172.21.15.62:0/762022210 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91580b6b30 con 0x55d956d4ec70 2024-09-10T05:36:37.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.607+0000 7f9160ee49c0 1 -- 172.21.15.62:0/762022210 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d956ecf930 con 0x55d956d4ec70 2024-09-10T05:36:37.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.607+0000 7f904b606640 1 -- 172.21.15.62:0/762022210 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91580b6e50 con 0x55d956d4ec70 2024-09-10T05:36:37.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.607+0000 7f9160ee49c0 1 -- 172.21.15.62:0/762022210 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d956ed02e0 con 0x55d956d4ec70 2024-09-10T05:36:37.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.607+0000 7f904b606640 1 -- 172.21.15.62:0/762022210 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f91580c7070 con 0x55d956d4ec70 2024-09-10T05:36:37.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.607+0000 7f904b606640 1 --2- 172.21.15.62:0/762022210 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f9044039c10 0x7f904403c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.607+0000 7f904b606640 1 -- 172.21.15.62:0/762022210 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f91580bb070 con 0x55d956d4ec70 2024-09-10T05:36:37.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.607+0000 7f915e1e9640 1 --2- 172.21.15.62:0/762022210 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f9044039c10 0x7f904403c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.607+0000 7f9160ee49c0 1 --2- 172.21.15.62:0/762022210 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55d956d50280 0x55d956ed62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.607+0000 7f9160ee49c0 1 -- 172.21.15.62:0/762022210 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d956ed67f0 con 0x55d956d50280 2024-09-10T05:36:37.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.607+0000 7f915f1eb640 1 --2- 172.21.15.62:0/762022210 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55d956d50280 0x55d956ed62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.611+0000 7f915e1e9640 1 --2- 172.21.15.62:0/762022210 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f9044039c10 0x7f904403c0d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9154001d80 tx=0x7f91540012e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.611+0000 7f915f1eb640 1 --2- 172.21.15.62:0/762022210 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55d956d50280 0x55d956ed62b0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.611+0000 7f915f1eb640 1 -- 172.21.15.62:0/762022210 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f915000a510 con 0x55d956d50280 2024-09-10T05:36:37.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.611+0000 7f9160ee49c0 1 --2- 172.21.15.62:0/762022210 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55d956ed72a0 0x55d956ed9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.611+0000 7f9160ee49c0 1 -- 172.21.15.62:0/762022210 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d956ed9eb0 con 0x55d956ed72a0 2024-09-10T05:36:37.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.611+0000 7f915e9ea640 1 --2- 172.21.15.62:0/762022210 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55d956ed72a0 0x55d956ed9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.611+0000 7f915e9ea640 1 --2- 172.21.15.62:0/762022210 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55d956ed72a0 0x55d956ed9740 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.611+0000 7f915e9ea640 1 -- 172.21.15.62:0/762022210 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f91580d0070 con 0x55d956ed72a0 2024-09-10T05:36:37.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.611+0000 7f9160ee49c0 1 --2- 172.21.15.62:0/762022210 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55d956edbc70 0x55d956ede060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.611+0000 7f9160ee49c0 1 -- 172.21.15.62:0/762022210 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d956ede750 con 0x55d956edbc70 2024-09-10T05:36:37.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.611+0000 7f915e1e9640 1 --2- 172.21.15.62:0/762022210 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55d956edbc70 0x55d956ede060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.611+0000 7f915e1e9640 1 --2- 172.21.15.62:0/762022210 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55d956edbc70 0x55d956ede060 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.611+0000 7f915e1e9640 1 -- 172.21.15.62:0/762022210 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f915400e620 con 0x55d956edbc70 2024-09-10T05:36:37.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.611+0000 7f9160ee49c0 1 -- 172.21.15.62:0/762022210 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d956edab10 con 0x55d956ed72a0 2024-09-10T05:36:37.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.615+0000 7f915e9ea640 1 -- 172.21.15.62:0/762022210 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f91580d0070 con 0x55d956ed72a0 2024-09-10T05:36:37.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.615+0000 7f9160ee49c0 1 -- 172.21.15.62:0/762022210 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d956edaf30 con 0x55d956edbc70 2024-09-10T05:36:37.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.615+0000 7f915e1e9640 1 -- 172.21.15.62:0/762022210 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f915400e620 con 0x55d956edbc70 2024-09-10T05:36:37.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.615+0000 7f9160ee49c0 1 Processor -- start 2024-09-10T05:36:37.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.615+0000 7f9160ee49c0 1 -- start start 2024-09-10T05:36:37.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.615+0000 7f9160ee49c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d956eecdf0 0x55d956eed210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.615+0000 7f9160ee49c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d956cef450 con 0x55d956eecdf0 2024-09-10T05:36:37.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.615+0000 7f915e9ea640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d956eecdf0 0x55d956eed210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.615+0000 7f915e9ea640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d956eecdf0 0x55d956eed210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47580/0 (socket says 172.21.15.62:47580) 2024-09-10T05:36:37.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.615+0000 7f915e9ea640 1 -- 172.21.15.62:0/2566592417 learned_addr learned my addr 172.21.15.62:0/2566592417 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:37.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.615+0000 7f915e9ea640 1 -- 172.21.15.62:0/2566592417 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d956eed850 con 0x55d956eecdf0 2024-09-10T05:36:37.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.615+0000 7f915e9ea640 1 --2- 172.21.15.62:0/2566592417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d956eecdf0 0x55d956eed210 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f91580e9b20 tx=0x7f91580d1a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.615+0000 7f9048e01640 1 -- 172.21.15.62:0/2566592417 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91580be4e0 con 0x55d956eecdf0 2024-09-10T05:36:37.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.615+0000 7f9048e01640 1 -- 172.21.15.62:0/2566592417 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91580a9a60 con 0x55d956eecdf0 2024-09-10T05:36:37.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.615+0000 7f9160ee49c0 1 -- 172.21.15.62:0/2566592417 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d956eee0b0 con 0x55d956eecdf0 2024-09-10T05:36:37.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.615+0000 7f9048e01640 1 -- 172.21.15.62:0/2566592417 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91580a9d40 con 0x55d956eecdf0 2024-09-10T05:36:37.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.615+0000 7f9160ee49c0 1 -- 172.21.15.62:0/2566592417 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d956eee620 con 0x55d956eecdf0 2024-09-10T05:36:37.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.619+0000 7f9048e01640 1 -- 172.21.15.62:0/2566592417 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f91580dc030 con 0x55d956eecdf0 2024-09-10T05:36:37.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.619+0000 7f9048e01640 1 --2- 172.21.15.62:0/2566592417 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f9038039ac0 0x7f903803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.619+0000 7f9048e01640 1 -- 172.21.15.62:0/2566592417 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f91580ecd50 con 0x55d956eecdf0 2024-09-10T05:36:37.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.619+0000 7f915e1e9640 1 --2- 172.21.15.62:0/2566592417 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f9038039ac0 0x7f903803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.619+0000 7f9160ee49c0 1 Processor -- start 2024-09-10T05:36:37.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.619+0000 7f9160ee49c0 1 -- start start 2024-09-10T05:36:37.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.619+0000 7f9160ee49c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d956ef9550 0x55d956ef9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.619+0000 7f915e1e9640 1 --2- 172.21.15.62:0/2566592417 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f9038039ac0 0x7f903803bf80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f915400bf50 tx=0x7f915400f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.619+0000 7f9160ee49c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d956ec8360 con 0x55d956ef9550 2024-09-10T05:36:37.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.619+0000 7f915e9ea640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d956ef9550 0x55d956ef9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.619+0000 7f915e9ea640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d956ef9550 0x55d956ef9930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47586/0 (socket says 172.21.15.62:47586) 2024-09-10T05:36:37.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.619+0000 7f915e9ea640 1 -- 172.21.15.62:0/1410858414 learned_addr learned my addr 172.21.15.62:0/1410858414 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:37.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.619+0000 7f915e9ea640 1 -- 172.21.15.62:0/1410858414 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d956ef9f20 con 0x55d956ef9550 2024-09-10T05:36:37.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.619+0000 7f915e9ea640 1 --2- 172.21.15.62:0/1410858414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d956ef9550 0x55d956ef9930 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f91580c4ff0 tx=0x7f91580a9460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f96c8474a13e3d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.619+0000 7f90427fc640 1 -- 172.21.15.62:0/1410858414 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9158102020 con 0x55d956ef9550 2024-09-10T05:36:37.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.619+0000 7f90427fc640 1 -- 172.21.15.62:0/1410858414 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91580d7130 con 0x55d956ef9550 2024-09-10T05:36:37.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.619+0000 7f90427fc640 1 -- 172.21.15.62:0/1410858414 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91580b2300 con 0x55d956ef9550 2024-09-10T05:36:37.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.619+0000 7f9160ee49c0 1 -- 172.21.15.62:0/1410858414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d956ef9550 msgr2=0x55d956ef9930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.619+0000 7f9160ee49c0 1 --2- 172.21.15.62:0/1410858414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d956ef9550 0x55d956ef9930 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f91580c4ff0 tx=0x7f91580a9460 comp rx=0 tx=0).stop 2024-09-10T05:36:37.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.619+0000 7f9160ee49c0 1 -- 172.21.15.62:0/1410858414 shutdown_connections 2024-09-10T05:36:37.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.619+0000 7f9160ee49c0 1 --2- 172.21.15.62:0/1410858414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d956ef9550 0x55d956ef9930 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.619+0000 7f9160ee49c0 1 -- 172.21.15.62:0/1410858414 >> 172.21.15.62:0/1410858414 conn(0x55d956ef59a0 msgr2=0x55d956ef3be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:37.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.619+0000 7f9160ee49c0 1 -- 172.21.15.62:0/1410858414 shutdown_connections 2024-09-10T05:36:37.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.619+0000 7f9160ee49c0 1 -- 172.21.15.62:0/1410858414 wait complete. 2024-09-10T05:36:37.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.623+0000 7f9160ee49c0 1 Processor -- start 2024-09-10T05:36:37.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.623+0000 7f9160ee49c0 1 -- start start 2024-09-10T05:36:37.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.623+0000 7f9160ee49c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d956ef9550 0x55d956f00890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.623+0000 7f9160ee49c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d956efa3e0 con 0x55d956ef9550 2024-09-10T05:36:37.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.623+0000 7f915e9ea640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d956ef9550 0x55d956f00890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.623+0000 7f915e9ea640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d956ef9550 0x55d956f00890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47588/0 (socket says 172.21.15.62:47588) 2024-09-10T05:36:37.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.623+0000 7f915e9ea640 1 -- 172.21.15.62:0/4184182155 learned_addr learned my addr 172.21.15.62:0/4184182155 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:37.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.623+0000 7f915e9ea640 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d956f00df0 con 0x55d956ef9550 2024-09-10T05:36:37.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.623+0000 7f915e9ea640 1 --2- 172.21.15.62:0/4184182155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d956ef9550 0x55d956f00890 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f91580a9fb0 tx=0x7f91580bfeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.623+0000 7f9040ff9640 1 -- 172.21.15.62:0/4184182155 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9158102030 con 0x55d956ef9550 2024-09-10T05:36:37.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.623+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d956f00df0 con 0x55d956ef9550 2024-09-10T05:36:37.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.623+0000 7f9040ff9640 1 -- 172.21.15.62:0/4184182155 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f915810e070 con 0x55d956ef9550 2024-09-10T05:36:37.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.623+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d956f00df0 con 0x55d956ef9550 2024-09-10T05:36:37.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.623+0000 7f9040ff9640 1 -- 172.21.15.62:0/4184182155 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9158118060 con 0x55d956ef9550 2024-09-10T05:36:37.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.623+0000 7f9040ff9640 1 -- 172.21.15.62:0/4184182155 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f91580fd070 con 0x55d956ef9550 2024-09-10T05:36:37.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.623+0000 7f9040ff9640 1 --2- 172.21.15.62:0/4184182155 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f9028039a70 0x7f902803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.623+0000 7f9040ff9640 1 -- 172.21.15.62:0/4184182155 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f91580fa1b0 con 0x55d956ef9550 2024-09-10T05:36:37.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.623+0000 7f915e1e9640 1 --2- 172.21.15.62:0/4184182155 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f9028039a70 0x7f902803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.627+0000 7f9160ee49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.627+0000 7f9160ee49c0 1 --2- 172.21.15.62:0/4184182155 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55d956f0b820 0x55d956f0dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.627+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d956f0e430 con 0x55d956f0b820 2024-09-10T05:36:37.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.627+0000 7f915f1eb640 1 --2- 172.21.15.62:0/4184182155 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55d956f0b820 0x55d956f0dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.627+0000 7f915e1e9640 1 --2- 172.21.15.62:0/4184182155 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f9028039a70 0x7f902803bf30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x55d956edaeb0 tx=0x7f9154010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.627+0000 7f915f1eb640 1 --2- 172.21.15.62:0/4184182155 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55d956f0b820 0x55d956f0dce0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.627+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f915000a510 con 0x55d956f0b820 2024-09-10T05:36:37.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.627+0000 7f9160ee49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:37.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.627+0000 7f9160ee49c0 20 realm 2024-09-10T05:36:37.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.627+0000 7f9160ee49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.627+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d956f0ab50 con 0x55d956f0b820 2024-09-10T05:36:37.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.627+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f915000a510 con 0x55d956f0b820 2024-09-10T05:36:37.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.627+0000 7f9160ee49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:37.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.627+0000 7f9160ee49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:37.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.627+0000 7f9160ee49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.627+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d956f0eef0 con 0x55d956f0b820 2024-09-10T05:36:37.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.627+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f915000a510 con 0x55d956f0b820 2024-09-10T05:36:37.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.627+0000 7f9160ee49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:37.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.627+0000 7f9160ee49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.627+0000 7f9160ee49c0 1 --2- 172.21.15.62:0/4184182155 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55d956f0fcd0 0x55d956f120c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.627+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d956f12790 con 0x55d956f0fcd0 2024-09-10T05:36:37.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.627+0000 7f915e9ea640 1 --2- 172.21.15.62:0/4184182155 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55d956f0fcd0 0x55d956f120c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.627+0000 7f915e9ea640 1 --2- 172.21.15.62:0/4184182155 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55d956f0fcd0 0x55d956f120c0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.627+0000 7f915e9ea640 1 -- 172.21.15.62:0/4184182155 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9158104040 con 0x55d956f0fcd0 2024-09-10T05:36:37.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.627+0000 7f9160ee49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:37.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.627+0000 7f9160ee49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.627+0000 7f9160ee49c0 1 --2- 172.21.15.62:0/4184182155 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55d956f134f0 0x55d956f15900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.627+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d956f16090 con 0x55d956f134f0 2024-09-10T05:36:37.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.627+0000 7f915e1e9640 1 --2- 172.21.15.62:0/4184182155 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55d956f134f0 0x55d956f15900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.631+0000 7f915e1e9640 1 --2- 172.21.15.62:0/4184182155 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55d956f134f0 0x55d956f15900 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.631+0000 7f915e1e9640 1 -- 172.21.15.62:0/4184182155 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9154026070 con 0x55d956f134f0 2024-09-10T05:36:37.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.631+0000 7f9160ee49c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:37.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.631+0000 7f9160ee49c0 20 searching for the correct realm 2024-09-10T05:36:37.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.631+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d956f17960 con 0x55d956f134f0 2024-09-10T05:36:37.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.631+0000 7f915e1e9640 1 -- 172.21.15.62:0/4184182155 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9154026070 con 0x55d956f134f0 2024-09-10T05:36:37.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.631+0000 7f915e1e9640 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d956f17960 con 0x55d956f0fcd0 2024-09-10T05:36:37.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.631+0000 7f915e9ea640 1 -- 172.21.15.62:0/4184182155 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9158104040 con 0x55d956f0fcd0 2024-09-10T05:36:37.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.631+0000 7f915e9ea640 1 --2- 172.21.15.62:0/4184182155 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f91580c9070 0x7f91580f18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.631+0000 7f915e9ea640 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d956f17960 con 0x7f91580c9070 2024-09-10T05:36:37.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.631+0000 7f915f1eb640 1 --2- 172.21.15.62:0/4184182155 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f91580c9070 0x7f91580f18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.631+0000 7f915f1eb640 1 --2- 172.21.15.62:0/4184182155 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f91580c9070 0x7f91580f18e0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.631+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f915000a510 con 0x7f91580c9070 2024-09-10T05:36:37.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.631+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d956f17960 con 0x55d956f0b820 2024-09-10T05:36:37.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.631+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f915000a510 con 0x55d956f0b820 2024-09-10T05:36:37.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.631+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d956f17960 con 0x55d956f0b820 2024-09-10T05:36:37.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.631+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f915000a510 con 0x55d956f0b820 2024-09-10T05:36:37.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.631+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d956f17960 con 0x55d956f134f0 2024-09-10T05:36:37.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.631+0000 7f915e1e9640 1 -- 172.21.15.62:0/4184182155 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9154026070 con 0x55d956f134f0 2024-09-10T05:36:37.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.631+0000 7f915e1e9640 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d956f17960 con 0x55d956f0b820 2024-09-10T05:36:37.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.631+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f915000a510 con 0x55d956f0b820 2024-09-10T05:36:37.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.631+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d956f17960 con 0x55d956f0fcd0 2024-09-10T05:36:37.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.635+0000 7f915e9ea640 1 -- 172.21.15.62:0/4184182155 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9158104040 con 0x55d956f0fcd0 2024-09-10T05:36:37.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.635+0000 7f915e9ea640 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d956f17960 con 0x55d956f0fcd0 2024-09-10T05:36:37.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.635+0000 7f915e9ea640 1 -- 172.21.15.62:0/4184182155 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9158104040 con 0x55d956f0fcd0 2024-09-10T05:36:37.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.635+0000 7f915e9ea640 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d956f17960 con 0x55d956f0b820 2024-09-10T05:36:37.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.635+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f915000a510 con 0x55d956f0b820 2024-09-10T05:36:37.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.635+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d956f17960 con 0x7f91580c9070 2024-09-10T05:36:37.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.635+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f915000a510 con 0x7f91580c9070 2024-09-10T05:36:37.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.635+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d956f17960 con 0x55d956f0b820 2024-09-10T05:36:37.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.635+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f915000a510 con 0x55d956f0b820 2024-09-10T05:36:37.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.635+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d956f17960 con 0x7f91580c9070 2024-09-10T05:36:37.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.635+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f915000a510 con 0x7f91580c9070 2024-09-10T05:36:37.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.635+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d956f17960 con 0x55d956f0fcd0 2024-09-10T05:36:37.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.635+0000 7f915e9ea640 1 -- 172.21.15.62:0/4184182155 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9158104040 con 0x55d956f0fcd0 2024-09-10T05:36:37.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.635+0000 7f915e9ea640 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d956f17960 con 0x55d956f134f0 2024-09-10T05:36:37.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.635+0000 7f915e1e9640 1 -- 172.21.15.62:0/4184182155 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9154026070 con 0x55d956f134f0 2024-09-10T05:36:37.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.635+0000 7f915e1e9640 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d956f17960 con 0x55d956f0b820 2024-09-10T05:36:37.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.635+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f915000a510 con 0x55d956f0b820 2024-09-10T05:36:37.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.635+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d956f17960 con 0x55d956f0fcd0 2024-09-10T05:36:37.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.635+0000 7f915e9ea640 1 -- 172.21.15.62:0/4184182155 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9158104040 con 0x55d956f0fcd0 2024-09-10T05:36:37.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.635+0000 7f915e9ea640 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d956f17960 con 0x55d956f134f0 2024-09-10T05:36:37.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.639+0000 7f915e1e9640 1 -- 172.21.15.62:0/4184182155 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 30 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f9154026070 con 0x55d956f134f0 2024-09-10T05:36:37.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.639+0000 7f915e1e9640 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d956f17960 con 0x55d956f0b820 2024-09-10T05:36:37.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.639+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f915000a510 con 0x55d956f0b820 2024-09-10T05:36:37.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.639+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d956f17960 con 0x55d956f0b820 2024-09-10T05:36:37.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.639+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f915000a510 con 0x55d956f0b820 2024-09-10T05:36:37.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.639+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9150030060 con 0x55d956f0b820 2024-09-10T05:36:37.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.639+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f915000a510 con 0x55d956f0b820 2024-09-10T05:36:37.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.639+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9150030060 con 0x55d956f134f0 2024-09-10T05:36:37.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.639+0000 7f915e1e9640 1 -- 172.21.15.62:0/4184182155 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9154026070 con 0x55d956f134f0 2024-09-10T05:36:37.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.639+0000 7f915e1e9640 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9150030060 con 0x7f91580c9070 2024-09-10T05:36:37.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.639+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f915000a510 con 0x7f91580c9070 2024-09-10T05:36:37.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.639+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9150030060 con 0x55d956f0b820 2024-09-10T05:36:37.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.639+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f915000a510 con 0x55d956f0b820 2024-09-10T05:36:37.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.639+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9150030060 con 0x7f91580c9070 2024-09-10T05:36:37.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.639+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f915000a510 con 0x7f91580c9070 2024-09-10T05:36:37.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.639+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9150030060 con 0x55d956f134f0 2024-09-10T05:36:37.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.639+0000 7f915e1e9640 1 -- 172.21.15.62:0/4184182155 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9154026070 con 0x55d956f134f0 2024-09-10T05:36:37.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.639+0000 7f915e1e9640 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9150030060 con 0x7f91580c9070 2024-09-10T05:36:37.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.639+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f915000a510 con 0x7f91580c9070 2024-09-10T05:36:37.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.639+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9150030060 con 0x55d956f0fcd0 2024-09-10T05:36:37.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.639+0000 7f915e9ea640 1 -- 172.21.15.62:0/4184182155 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9158104040 con 0x55d956f0fcd0 2024-09-10T05:36:37.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.639+0000 7f915e9ea640 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9150030060 con 0x55d956f0fcd0 2024-09-10T05:36:37.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.643+0000 7f915e9ea640 1 -- 172.21.15.62:0/4184182155 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9158104040 con 0x55d956f0fcd0 2024-09-10T05:36:37.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.643+0000 7f915e9ea640 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9150030060 con 0x55d956f134f0 2024-09-10T05:36:37.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.643+0000 7f915e1e9640 1 -- 172.21.15.62:0/4184182155 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9154026070 con 0x55d956f134f0 2024-09-10T05:36:37.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.643+0000 7f915e1e9640 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9150030060 con 0x55d956f0fcd0 2024-09-10T05:36:37.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.643+0000 7f915e9ea640 1 -- 172.21.15.62:0/4184182155 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9158104040 con 0x55d956f0fcd0 2024-09-10T05:36:37.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.643+0000 7f915e9ea640 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9150030060 con 0x55d956f0fcd0 2024-09-10T05:36:37.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.643+0000 7f915e9ea640 1 -- 172.21.15.62:0/4184182155 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9158104040 con 0x55d956f0fcd0 2024-09-10T05:36:37.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.643+0000 7f9160ee49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:37.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.643+0000 7f9160ee49c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:37.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.643+0000 7f9160ee49c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:37.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.643+0000 7f9160ee49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:37.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.643+0000 7f9160ee49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:37.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.643+0000 7f9160ee49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:37.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.643+0000 7f9160ee49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.643+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d956f16a50 con 0x55d956f0b820 2024-09-10T05:36:37.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.643+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f915000a510 con 0x55d956f0b820 2024-09-10T05:36:37.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.643+0000 7f9160ee49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:37.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.643+0000 7f9160ee49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.643+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d956f16690 con 0x55d956f0fcd0 2024-09-10T05:36:37.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.643+0000 7f915e9ea640 1 -- 172.21.15.62:0/4184182155 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9158104040 con 0x55d956f0fcd0 2024-09-10T05:36:37.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.643+0000 7f9160ee49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:37.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.643+0000 7f9160ee49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.643+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d956f173f0 con 0x55d956f134f0 2024-09-10T05:36:37.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.643+0000 7f915e1e9640 1 -- 172.21.15.62:0/4184182155 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9154026070 con 0x55d956f134f0 2024-09-10T05:36:37.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.643+0000 7f9160ee49c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:37.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.643+0000 7f9160ee49c0 20 zone default found 2024-09-10T05:36:37.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.643+0000 7f9160ee49c0 4 Realm: () 2024-09-10T05:36:37.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.643+0000 7f9160ee49c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:37.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.643+0000 7f9160ee49c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:37.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.643+0000 7f9160ee49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:37.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.643+0000 7f9160ee49c0 20 zonegroup default 2024-09-10T05:36:37.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.643+0000 7f9160ee49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.643+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d956f18240 con 0x7f91580c9070 2024-09-10T05:36:37.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.643+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f915000a510 con 0x7f91580c9070 2024-09-10T05:36:37.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.643+0000 7f9160ee49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:37.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.643+0000 7f9160ee49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.643+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d956f1a480 con 0x55d956f134f0 2024-09-10T05:36:37.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.647+0000 7f915e1e9640 1 -- 172.21.15.62:0/4184182155 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9154026070 con 0x55d956f134f0 2024-09-10T05:36:37.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.647+0000 7f9160ee49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:37.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.647+0000 7f9160ee49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.647+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d956f1a820 con 0x55d956f134f0 2024-09-10T05:36:37.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.647+0000 7f915e1e9640 1 -- 172.21.15.62:0/4184182155 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9154026070 con 0x55d956f134f0 2024-09-10T05:36:37.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.647+0000 7f9160ee49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:37.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.647+0000 7f9160ee49c0 20 started sync module instance, tier type = 2024-09-10T05:36:37.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.647+0000 7f9160ee49c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:37.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.647+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f19910 con 0x55d956f0fcd0 2024-09-10T05:36:37.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.647+0000 7f915e9ea640 1 -- 172.21.15.62:0/4184182155 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9158104040 con 0x55d956f0fcd0 2024-09-10T05:36:37.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.647+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94391954939136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f1b070 con 0x55d956f0fcd0 2024-09-10T05:36:37.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.647+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f1b8c0 con 0x55d956f0b820 2024-09-10T05:36:37.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.651+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f915000a510 con 0x55d956f0b820 2024-09-10T05:36:37.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.651+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94391954944112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f1b980 con 0x55d956f0b820 2024-09-10T05:36:37.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.651+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f1c4a0 con 0x55d956f0fcd0 2024-09-10T05:36:37.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.651+0000 7f915e9ea640 1 -- 172.21.15.62:0/4184182155 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94391954939136] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9158104040 con 0x55d956f0fcd0 2024-09-10T05:36:37.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.651+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94391954944112] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f915000a510 con 0x55d956f0b820 2024-09-10T05:36:37.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.651+0000 7f915e9ea640 1 -- 172.21.15.62:0/4184182155 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9158104040 con 0x55d956f0fcd0 2024-09-10T05:36:37.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.651+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94391954947952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f1c460 con 0x55d956f0fcd0 2024-09-10T05:36:37.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.651+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f1cd40 con 0x7f91580c9070 2024-09-10T05:36:37.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.651+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f915000a510 con 0x7f91580c9070 2024-09-10T05:36:37.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.651+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94391954950288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f1c460 con 0x7f91580c9070 2024-09-10T05:36:37.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.651+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f1d780 con 0x55d956f0fcd0 2024-09-10T05:36:37.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.655+0000 7f915e9ea640 1 -- 172.21.15.62:0/4184182155 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94391954947952] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9158104040 con 0x55d956f0fcd0 2024-09-10T05:36:37.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.655+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94391954950288] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f915000a510 con 0x7f91580c9070 2024-09-10T05:36:37.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.655+0000 7f915e9ea640 1 -- 172.21.15.62:0/4184182155 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9158104040 con 0x55d956f0fcd0 2024-09-10T05:36:37.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.655+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94391954951344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f1d2d0 con 0x55d956f0fcd0 2024-09-10T05:36:37.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.655+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f1e050 con 0x55d956f134f0 2024-09-10T05:36:37.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.655+0000 7f915e1e9640 1 -- 172.21.15.62:0/4184182155 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9154026070 con 0x55d956f134f0 2024-09-10T05:36:37.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.655+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94391954955168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f1d2d0 con 0x55d956f134f0 2024-09-10T05:36:37.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.655+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f1ea90 con 0x55d956f134f0 2024-09-10T05:36:37.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.655+0000 7f915e9ea640 1 -- 172.21.15.62:0/4184182155 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94391954951344] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9158104040 con 0x55d956f0fcd0 2024-09-10T05:36:37.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.659+0000 7f915e1e9640 1 -- 172.21.15.62:0/4184182155 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94391954955168] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9154026070 con 0x55d956f134f0 2024-09-10T05:36:37.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.663+0000 7f915e1e9640 1 -- 172.21.15.62:0/4184182155 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9154026070 con 0x55d956f134f0 2024-09-10T05:36:37.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.663+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94391954956224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f1e5e0 con 0x55d956f134f0 2024-09-10T05:36:37.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.663+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f1efa0 con 0x7f91580c9070 2024-09-10T05:36:37.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.663+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f915000a510 con 0x7f91580c9070 2024-09-10T05:36:37.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.663+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94391954959088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f1f3c0 con 0x7f91580c9070 2024-09-10T05:36:37.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.663+0000 7f9160ee49c0 20 add_watcher() i=0 2024-09-10T05:36:37.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.663+0000 7f9160ee49c0 20 add_watcher() i=1 2024-09-10T05:36:37.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.663+0000 7f9160ee49c0 20 add_watcher() i=2 2024-09-10T05:36:37.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.663+0000 7f9160ee49c0 20 add_watcher() i=3 2024-09-10T05:36:37.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.663+0000 7f9160ee49c0 20 add_watcher() i=4 2024-09-10T05:36:37.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.663+0000 7f9160ee49c0 20 add_watcher() i=5 2024-09-10T05:36:37.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.663+0000 7f915e1e9640 1 -- 172.21.15.62:0/4184182155 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94391954956224] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9154026070 con 0x55d956f134f0 2024-09-10T05:36:37.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.663+0000 7f9160ee49c0 20 add_watcher() i=6 2024-09-10T05:36:37.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.663+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94391954959088] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f915000a510 con 0x7f91580c9070 2024-09-10T05:36:37.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.663+0000 7f9160ee49c0 20 add_watcher() i=7 2024-09-10T05:36:37.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.663+0000 7f9160ee49c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:37.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.663+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d956f1f3c0 con 0x55d956f0b820 2024-09-10T05:36:37.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.663+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f915000a510 con 0x55d956f0b820 2024-09-10T05:36:37.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.667+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94391954960144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f1f330 con 0x55d956f0b820 2024-09-10T05:36:37.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.667+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94391954960144] v30'127 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f915000a510 con 0x55d956f0b820 2024-09-10T05:36:37.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.667+0000 7f90157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:37.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.667+0000 7f9160ee49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:37.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.667+0000 7f9160ee49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:37.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.667+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f2ad20 con 0x55d956f0fcd0 2024-09-10T05:36:37.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.671+0000 7f915e9ea640 1 -- 172.21.15.62:0/4184182155 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'45 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9158104040 con 0x55d956f0fcd0 2024-09-10T05:36:37.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.671+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f2ad20 con 0x7f91580c9070 2024-09-10T05:36:37.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.671+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f915000a510 con 0x7f91580c9070 2024-09-10T05:36:37.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.671+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f2ad20 con 0x55d956f134f0 2024-09-10T05:36:37.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.671+0000 7f915e1e9640 1 -- 172.21.15.62:0/4184182155 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9154026070 con 0x55d956f134f0 2024-09-10T05:36:37.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.671+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f2b740 con 0x55d956f0b820 2024-09-10T05:36:37.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.675+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'128 uv12 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f915000a510 con 0x55d956f0b820 2024-09-10T05:36:37.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.675+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f2bcb0 con 0x55d956f0fcd0 2024-09-10T05:36:37.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.675+0000 7f915e9ea640 1 -- 172.21.15.62:0/4184182155 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'41 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9158104040 con 0x55d956f0fcd0 2024-09-10T05:36:37.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.675+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f2bcb0 con 0x55d956f134f0 2024-09-10T05:36:37.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.679+0000 7f915e1e9640 1 -- 172.21.15.62:0/4184182155 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'35 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9154026070 con 0x55d956f134f0 2024-09-10T05:36:37.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.679+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f2c220 con 0x55d956f0fcd0 2024-09-10T05:36:37.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.679+0000 7f915e9ea640 1 -- 172.21.15.62:0/4184182155 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9158104040 con 0x55d956f0fcd0 2024-09-10T05:36:37.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.679+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f2c220 con 0x55d956f0b820 2024-09-10T05:36:37.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.683+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'29 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f915000a510 con 0x55d956f0b820 2024-09-10T05:36:37.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.683+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f2c790 con 0x55d956f0fcd0 2024-09-10T05:36:37.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.683+0000 7f915e9ea640 1 -- 172.21.15.62:0/4184182155 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9158104040 con 0x55d956f0fcd0 2024-09-10T05:36:37.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.683+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f2cb50 con 0x55d956f0fcd0 2024-09-10T05:36:37.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.687+0000 7f915e9ea640 1 -- 172.21.15.62:0/4184182155 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'21 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9158104040 con 0x55d956f0fcd0 2024-09-10T05:36:37.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.687+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f2c8c0 con 0x55d956f0fcd0 2024-09-10T05:36:37.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.687+0000 7f915e9ea640 1 -- 172.21.15.62:0/4184182155 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'42 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9158104040 con 0x55d956f0fcd0 2024-09-10T05:36:37.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.687+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f2c8c0 con 0x55d956f134f0 2024-09-10T05:36:37.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.687+0000 7f915e1e9640 1 -- 172.21.15.62:0/4184182155 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9154026070 con 0x55d956f134f0 2024-09-10T05:36:37.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.687+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f2c950 con 0x55d956f0fcd0 2024-09-10T05:36:37.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.691+0000 7f915e9ea640 1 -- 172.21.15.62:0/4184182155 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9158104040 con 0x55d956f0fcd0 2024-09-10T05:36:37.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.691+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f2c950 con 0x55d956f0b820 2024-09-10T05:36:37.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.691+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'41 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f915000a510 con 0x55d956f0b820 2024-09-10T05:36:37.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.691+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f2ca60 con 0x55d956f0b820 2024-09-10T05:36:37.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.695+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'129 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f915000a510 con 0x55d956f0b820 2024-09-10T05:36:37.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.695+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f2ce40 con 0x55d956f0fcd0 2024-09-10T05:36:37.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.695+0000 7f915e9ea640 1 -- 172.21.15.62:0/4184182155 <== osd.0 v2:172.21.15.2:6800/945139080 25 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'36 uv16 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9158104040 con 0x55d956f0fcd0 2024-09-10T05:36:37.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.695+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f2cbb0 con 0x55d956f0fcd0 2024-09-10T05:36:37.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.699+0000 7f915e9ea640 1 -- 172.21.15.62:0/4184182155 <== osd.0 v2:172.21.15.2:6800/945139080 26 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'43 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9158104040 con 0x55d956f0fcd0 2024-09-10T05:36:37.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.699+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f2cbb0 con 0x55d956f134f0 2024-09-10T05:36:37.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.699+0000 7f915e1e9640 1 -- 172.21.15.62:0/4184182155 <== osd.3 v2:172.21.15.62:6816/2708991149 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'27 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9154026070 con 0x55d956f134f0 2024-09-10T05:36:37.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.699+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f2cc40 con 0x55d956f0fcd0 2024-09-10T05:36:37.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.703+0000 7f915e9ea640 1 -- 172.21.15.62:0/4184182155 <== osd.0 v2:172.21.15.2:6800/945139080 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9158104040 con 0x55d956f0fcd0 2024-09-10T05:36:37.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.703+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f2cc40 con 0x55d956f0b820 2024-09-10T05:36:37.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.707+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 <== osd.1 v2:172.21.15.62:6808/3442097179 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'130 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f915000a510 con 0x55d956f0b820 2024-09-10T05:36:37.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.707+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f2cc40 con 0x55d956f0fcd0 2024-09-10T05:36:37.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.707+0000 7f915e9ea640 1 -- 172.21.15.62:0/4184182155 <== osd.0 v2:172.21.15.2:6800/945139080 28 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'37 uv18 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9158104040 con 0x55d956f0fcd0 2024-09-10T05:36:37.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.707+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f2cc40 con 0x55d956f0fcd0 2024-09-10T05:36:37.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.711+0000 7f915e9ea640 1 -- 172.21.15.62:0/4184182155 <== osd.0 v2:172.21.15.2:6800/945139080 29 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'31 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9158104040 con 0x55d956f0fcd0 2024-09-10T05:36:37.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.711+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f2cc40 con 0x55d956f134f0 2024-09-10T05:36:37.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.711+0000 7f915e1e9640 1 -- 172.21.15.62:0/4184182155 <== osd.3 v2:172.21.15.62:6816/2708991149 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'23 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9154026070 con 0x55d956f134f0 2024-09-10T05:36:37.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.711+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f2cd70 con 0x55d956f0fcd0 2024-09-10T05:36:37.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.715+0000 7f915e9ea640 1 -- 172.21.15.62:0/4184182155 <== osd.0 v2:172.21.15.2:6800/945139080 30 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'34 uv18 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9158104040 con 0x55d956f0fcd0 2024-09-10T05:36:37.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.715+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f2cd70 con 0x55d956f134f0 2024-09-10T05:36:37.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.715+0000 7f915e1e9640 1 -- 172.21.15.62:0/4184182155 <== osd.3 v2:172.21.15.62:6816/2708991149 21 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'17 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9154026070 con 0x55d956f134f0 2024-09-10T05:36:37.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.715+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f2cd70 con 0x55d956f134f0 2024-09-10T05:36:37.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.719+0000 7f915e1e9640 1 -- 172.21.15.62:0/4184182155 <== osd.3 v2:172.21.15.62:6816/2708991149 22 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'36 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9154026070 con 0x55d956f134f0 2024-09-10T05:36:37.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.719+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f2cd70 con 0x55d956f134f0 2024-09-10T05:36:37.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.719+0000 7f915e1e9640 1 -- 172.21.15.62:0/4184182155 <== osd.3 v2:172.21.15.62:6816/2708991149 23 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'23 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9154026070 con 0x55d956f134f0 2024-09-10T05:36:37.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.719+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f2cd70 con 0x55d956f0fcd0 2024-09-10T05:36:37.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.723+0000 7f915e9ea640 1 -- 172.21.15.62:0/4184182155 <== osd.0 v2:172.21.15.2:6800/945139080 31 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'27 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9158104040 con 0x55d956f0fcd0 2024-09-10T05:36:37.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.723+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f2cd70 con 0x55d956f0b820 2024-09-10T05:36:37.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.727+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 <== osd.1 v2:172.21.15.62:6808/3442097179 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'30 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f915000a510 con 0x55d956f0b820 2024-09-10T05:36:37.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.727+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f2cdb0 con 0x55d956f0fcd0 2024-09-10T05:36:37.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.727+0000 7f915e9ea640 1 -- 172.21.15.62:0/4184182155 <== osd.0 v2:172.21.15.2:6800/945139080 32 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'38 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9158104040 con 0x55d956f0fcd0 2024-09-10T05:36:37.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.727+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f2cdb0 con 0x55d956f0b820 2024-09-10T05:36:37.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.731+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 <== osd.1 v2:172.21.15.62:6808/3442097179 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'42 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f915000a510 con 0x55d956f0b820 2024-09-10T05:36:37.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.731+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f2cdb0 con 0x7f91580c9070 2024-09-10T05:36:37.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.731+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f915000a510 con 0x7f91580c9070 2024-09-10T05:36:37.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.731+0000 7f8f8ffff640 20 reqs_thread_entry: start 2024-09-10T05:36:37.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.731+0000 7f9160ee49c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:37.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.731+0000 7f9160ee49c0 20 Filter name: none 2024-09-10T05:36:37.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.731+0000 7f8f8dffb640 20 reqs_thread_entry: start 2024-09-10T05:36:37.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.731+0000 7f9160ee49c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-10T05:36:37.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.731+0000 7f9160ee49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.731+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d956f295d0 con 0x7f91580c9070 2024-09-10T05:36:37.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.735+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f915000a510 con 0x7f91580c9070 2024-09-10T05:36:37.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.735+0000 7f9160ee49c0 20 rados_obj.operate() r=0 bl.length=380 2024-09-10T05:36:37.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.735+0000 7f9160ee49c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-10T05:36:37.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.735+0000 7f9160ee49c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T05:36:37.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.735+0000 7f9160ee49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:36:37.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.735+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d956f4a900 con 0x55d956f0b820 2024-09-10T05:36:37.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.735+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 <== osd.1 v2:172.21.15.62:6808/3442097179 26 ==== osd_op_reply(95 fud.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 155+0+15 (crc 0 0 0) 0x7f915000a510 con 0x55d956f0b820 2024-09-10T05:36:37.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.735+0000 7f9160ee49c0 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-10T05:36:37.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.735+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f488e0 con 0x55d956f134f0 2024-09-10T05:36:37.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.735+0000 7f915e1e9640 1 -- 172.21.15.62:0/4184182155 <== osd.3 v2:172.21.15.62:6816/2708991149 24 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v30'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f9154026070 con 0x55d956f134f0 2024-09-10T05:36:37.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.735+0000 7f9160ee49c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-10T05:36:37.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.735+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94391955133504 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d956f4ae20 con 0x55d956f0fcd0 2024-09-10T05:36:37.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.735+0000 7f915e9ea640 1 -- 172.21.15.62:0/4184182155 <== osd.0 v2:172.21.15.2:6800/945139080 33 ==== watch-notify(notify (1) cookie 94391954947952 notify 128849018904 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55d956f2c3f0 con 0x55d956f0fcd0 2024-09-10T05:36:37.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.735+0000 7f90427fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018904 cookie 94391954947952 notifier 4528 bl.length()=170 2024-09-10T05:36:37.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.735+0000 7f90427fc640 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f9024003d70 con 0x55d956f0fcd0 2024-09-10T05:36:37.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.735+0000 7f915e9ea640 1 -- 172.21.15.62:0/4184182155 <== osd.0 v2:172.21.15.2:6800/945139080 34 ==== osd_op_reply(97 notify.2 [notify cookie 94391955133504 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9158104040 con 0x55d956f0fcd0 2024-09-10T05:36:37.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.739+0000 7f915e9ea640 1 -- 172.21.15.62:0/4184182155 <== osd.0 v2:172.21.15.2:6800/945139080 35 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9158104040 con 0x55d956f0fcd0 2024-09-10T05:36:37.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.739+0000 7f915e9ea640 1 -- 172.21.15.62:0/4184182155 <== osd.0 v2:172.21.15.2:6800/945139080 36 ==== watch-notify(notify_complete (2) cookie 94391955133504 notify 128849018904 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d956eed850 con 0x55d956f0fcd0 2024-09-10T05:36:37.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.739+0000 7f9160ee49c0 10 removing email index: 2024-09-10T05:36:37.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.739+0000 7f9160ee49c0 10 removing user buckets index 2024-09-10T05:36:37.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.739+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:99 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f4ada0 con 0x55d956f0b820 2024-09-10T05:36:37.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.739+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 <== osd.1 v2:172.21.15.62:6808/3442097179 27 ==== osd_op_reply(99 fud.buckets [delete] v30'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f915000a510 con 0x55d956f0b820 2024-09-10T05:36:37.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.739+0000 7f9160ee49c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-10T05:36:37.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.739+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94391955140000 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d956f4a900 con 0x55d956f134f0 2024-09-10T05:36:37.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.739+0000 7f915e1e9640 1 -- 172.21.15.62:0/4184182155 <== osd.3 v2:172.21.15.62:6816/2708991149 25 ==== watch-notify(notify (1) cookie 94391954956224 notify 128849018889 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55d956f2c220 con 0x55d956f134f0 2024-09-10T05:36:37.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.739+0000 7f9041ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018889 cookie 94391954956224 notifier 4528 bl.length()=160 2024-09-10T05:36:37.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.739+0000 7f9041ffb640 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f8f940032d0 con 0x55d956f134f0 2024-09-10T05:36:37.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.739+0000 7f915e1e9640 1 -- 172.21.15.62:0/4184182155 <== osd.3 v2:172.21.15.62:6816/2708991149 26 ==== osd_op_reply(100 notify.6 [notify cookie 94391955140000 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9154026070 con 0x55d956f134f0 2024-09-10T05:36:37.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.739+0000 7f915e1e9640 1 -- 172.21.15.62:0/4184182155 <== osd.3 v2:172.21.15.62:6816/2708991149 27 ==== watch-notify(notify_complete (2) cookie 94391955140000 notify 128849018889 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d956f2c050 con 0x55d956f134f0 2024-09-10T05:36:37.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.739+0000 7f915e1e9640 1 -- 172.21.15.62:0/4184182155 <== osd.3 v2:172.21.15.62:6816/2708991149 28 ==== osd_op_reply(101 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9154026070 con 0x55d956f134f0 2024-09-10T05:36:37.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.739+0000 7f9160ee49c0 10 removing user index: fud 2024-09-10T05:36:37.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.739+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f4a900 con 0x7f91580c9070 2024-09-10T05:36:37.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.743+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 <== osd.2 v2:172.21.15.62:6800/2677868286 15 ==== osd_op_reply(102 fud [call,call,delete] v30'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f915000a510 con 0x7f91580c9070 2024-09-10T05:36:37.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.743+0000 7f9160ee49c0 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-10T05:36:37.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.743+0000 7f9160ee49c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-10T05:36:37.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.743+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify cookie 94391955129392 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d956f49d10 con 0x55d956f134f0 2024-09-10T05:36:37.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.743+0000 7f915e1e9640 1 -- 172.21.15.62:0/4184182155 <== osd.3 v2:172.21.15.62:6816/2708991149 29 ==== watch-notify(notify (1) cookie 94391954955168 notify 128849018890 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55d956f2c050 con 0x55d956f134f0 2024-09-10T05:36:37.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.743+0000 7f90427fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018890 cookie 94391954955168 notifier 4528 bl.length()=152 2024-09-10T05:36:37.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.743+0000 7f90427fc640 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f9024003d70 con 0x55d956f134f0 2024-09-10T05:36:37.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.743+0000 7f915e1e9640 1 -- 172.21.15.62:0/4184182155 <== osd.3 v2:172.21.15.62:6816/2708991149 30 ==== osd_op_reply(103 notify.5 [notify cookie 94391955129392 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9154026070 con 0x55d956f134f0 2024-09-10T05:36:37.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.743+0000 7f915e1e9640 1 -- 172.21.15.62:0/4184182155 <== osd.3 v2:172.21.15.62:6816/2708991149 31 ==== osd_op_reply(104 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9154026070 con 0x55d956f134f0 2024-09-10T05:36:37.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.743+0000 7f915e1e9640 1 -- 172.21.15.62:0/4184182155 <== osd.3 v2:172.21.15.62:6816/2708991149 32 ==== watch-notify(notify_complete (2) cookie 94391955129392 notify 128849018890 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d956f241d0 con 0x55d956f134f0 2024-09-10T05:36:37.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.747+0000 7f90157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:37.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.747+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94391954960144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f08f20 con 0x55d956f0b820 2024-09-10T05:36:37.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.747+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 <== osd.1 v2:172.21.15.62:6808/3442097179 28 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94391954960144] v30'131 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f915000a510 con 0x55d956f0b820 2024-09-10T05:36:37.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.747+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94391954939136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f1ef10 con 0x55d956f0fcd0 2024-09-10T05:36:37.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.751+0000 7f915e9ea640 1 -- 172.21.15.62:0/4184182155 <== osd.0 v2:172.21.15.2:6800/945139080 37 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94391954939136] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9158104040 con 0x55d956f0fcd0 2024-09-10T05:36:37.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.751+0000 7f9160ee49c0 20 remove_watcher() i=0 2024-09-10T05:36:37.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.751+0000 7f9160ee49c0 2 removed watcher, disabling cache 2024-09-10T05:36:37.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.751+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94391954944112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f1ef10 con 0x55d956f0b820 2024-09-10T05:36:37.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.751+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 <== osd.1 v2:172.21.15.62:6808/3442097179 29 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94391954944112] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f915000a510 con 0x55d956f0b820 2024-09-10T05:36:37.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.751+0000 7f9160ee49c0 20 remove_watcher() i=1 2024-09-10T05:36:37.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.751+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94391954947952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f1ef10 con 0x55d956f0fcd0 2024-09-10T05:36:37.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.755+0000 7f915e9ea640 1 -- 172.21.15.62:0/4184182155 <== osd.0 v2:172.21.15.2:6800/945139080 38 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94391954947952] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9158104040 con 0x55d956f0fcd0 2024-09-10T05:36:37.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.755+0000 7f9160ee49c0 20 remove_watcher() i=2 2024-09-10T05:36:37.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.755+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94391954950288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f1ef10 con 0x7f91580c9070 2024-09-10T05:36:37.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.755+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 <== osd.2 v2:172.21.15.62:6800/2677868286 16 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94391954950288] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f915000a510 con 0x7f91580c9070 2024-09-10T05:36:37.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.755+0000 7f9160ee49c0 20 remove_watcher() i=3 2024-09-10T05:36:37.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.755+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94391954951344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f1ef10 con 0x55d956f0fcd0 2024-09-10T05:36:37.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.759+0000 7f915e9ea640 1 -- 172.21.15.62:0/4184182155 <== osd.0 v2:172.21.15.2:6800/945139080 39 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94391954951344] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9158104040 con 0x55d956f0fcd0 2024-09-10T05:36:37.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.759+0000 7f9160ee49c0 20 remove_watcher() i=4 2024-09-10T05:36:37.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.759+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94391954955168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f1ef10 con 0x55d956f134f0 2024-09-10T05:36:37.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.759+0000 7f915e1e9640 1 -- 172.21.15.62:0/4184182155 <== osd.3 v2:172.21.15.62:6816/2708991149 33 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94391954955168] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9154026070 con 0x55d956f134f0 2024-09-10T05:36:37.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.759+0000 7f9160ee49c0 20 remove_watcher() i=5 2024-09-10T05:36:37.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.759+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94391954956224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f1dba0 con 0x55d956f134f0 2024-09-10T05:36:37.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.759+0000 7f915e1e9640 1 -- 172.21.15.62:0/4184182155 <== osd.3 v2:172.21.15.62:6816/2708991149 34 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94391954956224] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9154026070 con 0x55d956f134f0 2024-09-10T05:36:37.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.763+0000 7f9160ee49c0 20 remove_watcher() i=6 2024-09-10T05:36:37.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.763+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94391954959088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d956f1ef10 con 0x7f91580c9070 2024-09-10T05:36:37.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.763+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 <== osd.2 v2:172.21.15.62:6800/2677868286 17 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94391954959088] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f915000a510 con 0x7f91580c9070 2024-09-10T05:36:37.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.763+0000 7f9160ee49c0 20 remove_watcher() i=7 2024-09-10T05:36:37.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.763+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55d956f0fcd0 msgr2=0x55d956f120c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.763+0000 7f9160ee49c0 1 --2- 172.21.15.62:0/4184182155 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55d956f0fcd0 0x55d956f120c0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.763+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55d956f0b820 msgr2=0x55d956f0dce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.763+0000 7f9160ee49c0 1 --2- 172.21.15.62:0/4184182155 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55d956f0b820 0x55d956f0dce0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.763+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f91580c9070 msgr2=0x7f91580f18e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.763+0000 7f9160ee49c0 1 --2- 172.21.15.62:0/4184182155 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f91580c9070 0x7f91580f18e0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.763+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55d956f134f0 msgr2=0x55d956f15900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.763+0000 7f9160ee49c0 1 --2- 172.21.15.62:0/4184182155 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55d956f134f0 0x55d956f15900 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.763+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f9028039a70 msgr2=0x7f902803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.763+0000 7f9160ee49c0 1 --2- 172.21.15.62:0/4184182155 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f9028039a70 0x7f902803bf30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x55d956edaeb0 tx=0x7f9154010000 comp rx=0 tx=0).stop 2024-09-10T05:36:37.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.763+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d956ef9550 msgr2=0x55d956f00890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.763+0000 7f9160ee49c0 1 --2- 172.21.15.62:0/4184182155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d956ef9550 0x55d956f00890 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f91580a9fb0 tx=0x7f91580bfeb0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.763+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 reap_dead start 2024-09-10T05:36:37.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.763+0000 7f915f1eb640 1 -- 172.21.15.62:0/4184182155 reap_dead start 2024-09-10T05:36:37.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.763+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 shutdown_connections 2024-09-10T05:36:37.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.763+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 >> 172.21.15.62:0/4184182155 conn(0x55d956ef59a0 msgr2=0x55d956ef3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:37.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.763+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 shutdown_connections 2024-09-10T05:36:37.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.763+0000 7f9160ee49c0 1 -- 172.21.15.62:0/4184182155 wait complete. 2024-09-10T05:36:37.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.763+0000 7f9160ee49c0 1 -- 172.21.15.62:0/2566592417 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f9038039ac0 msgr2=0x7f903803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.763+0000 7f9160ee49c0 1 --2- 172.21.15.62:0/2566592417 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f9038039ac0 0x7f903803bf80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f915400bf50 tx=0x7f915400f000 comp rx=0 tx=0).stop 2024-09-10T05:36:37.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.763+0000 7f9160ee49c0 1 -- 172.21.15.62:0/2566592417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d956eecdf0 msgr2=0x55d956eed210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.763+0000 7f9160ee49c0 1 --2- 172.21.15.62:0/2566592417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d956eecdf0 0x55d956eed210 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f91580e9b20 tx=0x7f91580d1a10 comp rx=0 tx=0).stop 2024-09-10T05:36:37.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.763+0000 7f9160ee49c0 1 -- 172.21.15.62:0/2566592417 shutdown_connections 2024-09-10T05:36:37.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.763+0000 7f9160ee49c0 1 --2- 172.21.15.62:0/2566592417 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f9038039ac0 0x7f903803bf80 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.763+0000 7f9160ee49c0 1 --2- 172.21.15.62:0/2566592417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d956eecdf0 0x55d956eed210 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.763+0000 7f9160ee49c0 1 -- 172.21.15.62:0/2566592417 >> 172.21.15.62:0/2566592417 conn(0x55d956ee27a0 msgr2=0x55d956ee2b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:37.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.763+0000 7f9160ee49c0 1 -- 172.21.15.62:0/2566592417 shutdown_connections 2024-09-10T05:36:37.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.763+0000 7f9160ee49c0 1 -- 172.21.15.62:0/2566592417 wait complete. 2024-09-10T05:36:37.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.763+0000 7f9160ee49c0 1 -- 172.21.15.62:0/762022210 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55d956ed72a0 msgr2=0x55d956ed9740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.763+0000 7f9160ee49c0 1 --2- 172.21.15.62:0/762022210 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55d956ed72a0 0x55d956ed9740 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.763+0000 7f9160ee49c0 1 -- 172.21.15.62:0/762022210 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55d956d50280 msgr2=0x55d956ed62b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.763+0000 7f9160ee49c0 1 --2- 172.21.15.62:0/762022210 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55d956d50280 0x55d956ed62b0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.763+0000 7f9160ee49c0 1 -- 172.21.15.62:0/762022210 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55d956edbc70 msgr2=0x55d956ede060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.763+0000 7f9160ee49c0 1 --2- 172.21.15.62:0/762022210 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55d956edbc70 0x55d956ede060 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.767+0000 7f9160ee49c0 1 -- 172.21.15.62:0/762022210 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f9044039c10 msgr2=0x7f904403c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.767+0000 7f9160ee49c0 1 --2- 172.21.15.62:0/762022210 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f9044039c10 0x7f904403c0d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9154001d80 tx=0x7f91540012e0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.767+0000 7f9160ee49c0 1 -- 172.21.15.62:0/762022210 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d956d4ec70 msgr2=0x55d956ecf140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.767+0000 7f9160ee49c0 1 --2- 172.21.15.62:0/762022210 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d956d4ec70 0x55d956ecf140 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f9158019680 tx=0x7f9158017d70 comp rx=0 tx=0).stop 2024-09-10T05:36:37.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.767+0000 7f915f1eb640 1 -- 172.21.15.62:0/762022210 reap_dead start 2024-09-10T05:36:37.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.767+0000 7f9160ee49c0 1 -- 172.21.15.62:0/762022210 shutdown_connections 2024-09-10T05:36:37.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.767+0000 7f9160ee49c0 1 -- 172.21.15.62:0/762022210 >> 172.21.15.62:0/762022210 conn(0x55d956dd5aa0 msgr2=0x55d956ec22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:37.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.767+0000 7f9160ee49c0 1 -- 172.21.15.62:0/762022210 shutdown_connections 2024-09-10T05:36:37.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.767+0000 7f9160ee49c0 1 -- 172.21.15.62:0/762022210 wait complete. 2024-09-10T05:36:37.781 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-10T05:36:37.781 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-10T05:36:37.781 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-10T05:36:37.875 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:37.875 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:37.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.871+0000 7fab67ff89c0 1 Processor -- start 2024-09-10T05:36:37.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.875+0000 7fab67ff89c0 1 -- start start 2024-09-10T05:36:37.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.875+0000 7fab67ff89c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55cbfe40e680 0x55cbfe410a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.875+0000 7fab67ff89c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cbfe2b89c0 con 0x55cbfe37af20 2024-09-10T05:36:37.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.875+0000 7fab67ff89c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x55cbfe3086d0 con 0x55cbfe40e680 2024-09-10T05:36:37.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.875+0000 7fab652fd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55cbfe40e680 0x55cbfe410a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.875+0000 7fab652fd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55cbfe40e680 0x55cbfe410a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47590/0 (socket says 172.21.15.62:47590) 2024-09-10T05:36:37.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.875+0000 7fab652fd640 1 -- 172.21.15.62:0/4021725643 learned_addr learned my addr 172.21.15.62:0/4021725643 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:37.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.875+0000 7fab652fd640 1 -- 172.21.15.62:0/4021725643 >> v1:172.21.15.2:6789/0 conn(0x55cbfe37af20 legacy=0x55cbfe37b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.875+0000 7fab652fd640 1 -- 172.21.15.62:0/4021725643 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbfe2acca0 con 0x55cbfe40e680 2024-09-10T05:36:37.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.875+0000 7fab652fd640 1 --2- 172.21.15.62:0/4021725643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cbfe40e680 0x55cbfe410a70 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fab5c00a5c0 tx=0x7fab5c01b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba9b250654cdd3fb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.879+0000 7fab64afc640 1 -- 172.21.15.62:0/4021725643 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab5c0a9590 con 0x55cbfe40e680 2024-09-10T05:36:37.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.879+0000 7fab64afc640 1 -- 172.21.15.62:0/4021725643 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab5c0ae070 con 0x55cbfe40e680 2024-09-10T05:36:37.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.879+0000 7fab64afc640 1 -- 172.21.15.62:0/4021725643 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab5c0a9880 con 0x55cbfe40e680 2024-09-10T05:36:37.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.879+0000 7fab67ff89c0 1 -- 172.21.15.62:0/4021725643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cbfe40e680 msgr2=0x55cbfe410a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.879+0000 7fab67ff89c0 1 --2- 172.21.15.62:0/4021725643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cbfe40e680 0x55cbfe410a70 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fab5c00a5c0 tx=0x7fab5c01b3d0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.879+0000 7fab67ff89c0 1 -- 172.21.15.62:0/4021725643 shutdown_connections 2024-09-10T05:36:37.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.879+0000 7fab67ff89c0 1 --2- 172.21.15.62:0/4021725643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cbfe40e680 0x55cbfe410a70 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.879+0000 7fab67ff89c0 1 -- 172.21.15.62:0/4021725643 >> 172.21.15.62:0/4021725643 conn(0x55cbfe379a90 msgr2=0x55cbfe379ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:37.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.879+0000 7fab67ff89c0 1 -- 172.21.15.62:0/4021725643 shutdown_connections 2024-09-10T05:36:37.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.879+0000 7fab67ff89c0 1 -- 172.21.15.62:0/4021725643 wait complete. 2024-09-10T05:36:37.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.895+0000 7fab67ff89c0 1 Processor -- start 2024-09-10T05:36:37.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.895+0000 7fab67ff89c0 1 -- start start 2024-09-10T05:36:37.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.895+0000 7fab67ff89c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cbfe37af20 0x55cbfe4f5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.895+0000 7fab67ff89c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55cbfe30c680 con 0x55cbfe37af20 2024-09-10T05:36:37.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.895+0000 7fab65afe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cbfe37af20 0x55cbfe4f5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.895+0000 7fab65afe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cbfe37af20 0x55cbfe4f5e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47604/0 (socket says 172.21.15.62:47604) 2024-09-10T05:36:37.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.895+0000 7fab65afe640 1 -- 172.21.15.62:0/508139497 learned_addr learned my addr 172.21.15.62:0/508139497 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:37.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.895+0000 7fab65afe640 1 -- 172.21.15.62:0/508139497 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbfe287da0 con 0x55cbfe37af20 2024-09-10T05:36:37.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.895+0000 7fab65afe640 1 --2- 172.21.15.62:0/508139497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cbfe37af20 0x55cbfe4f5e60 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fab60001690 tx=0x7fab60001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adbd17d97bdff0c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.895+0000 7faa53e07640 1 -- 172.21.15.62:0/508139497 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab60016070 con 0x55cbfe37af20 2024-09-10T05:36:37.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.895+0000 7faa53e07640 1 -- 172.21.15.62:0/508139497 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab6000f640 con 0x55cbfe37af20 2024-09-10T05:36:37.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.895+0000 7faa53e07640 1 -- 172.21.15.62:0/508139497 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab6000f960 con 0x55cbfe37af20 2024-09-10T05:36:37.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.895+0000 7fab67ff89c0 1 -- 172.21.15.62:0/508139497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cbfe37af20 msgr2=0x55cbfe4f5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.895+0000 7fab67ff89c0 1 --2- 172.21.15.62:0/508139497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cbfe37af20 0x55cbfe4f5e60 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fab60001690 tx=0x7fab60001b50 comp rx=0 tx=0).stop 2024-09-10T05:36:37.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.895+0000 7fab67ff89c0 1 -- 172.21.15.62:0/508139497 shutdown_connections 2024-09-10T05:36:37.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.895+0000 7fab67ff89c0 1 --2- 172.21.15.62:0/508139497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cbfe37af20 0x55cbfe4f5e60 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.895+0000 7fab67ff89c0 1 -- 172.21.15.62:0/508139497 >> 172.21.15.62:0/508139497 conn(0x55cbfe379a90 msgr2=0x55cbfe4f1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:37.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.895+0000 7fab67ff89c0 1 -- 172.21.15.62:0/508139497 shutdown_connections 2024-09-10T05:36:37.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.895+0000 7fab67ff89c0 1 -- 172.21.15.62:0/508139497 wait complete. 2024-09-10T05:36:37.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.895+0000 7fab67ff89c0 1 Processor -- start 2024-09-10T05:36:37.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.895+0000 7fab67ff89c0 1 -- start start 2024-09-10T05:36:37.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.895+0000 7fab67ff89c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cbfe4fd800 0x55cbfe4fdc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.895+0000 7fab67ff89c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55cbfe2aea50 con 0x55cbfe4fd800 2024-09-10T05:36:37.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.899+0000 7fab65afe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cbfe4fd800 0x55cbfe4fdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.899+0000 7fab65afe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cbfe4fd800 0x55cbfe4fdc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47614/0 (socket says 172.21.15.62:47614) 2024-09-10T05:36:37.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.899+0000 7fab65afe640 1 -- 172.21.15.62:0/421734608 learned_addr learned my addr 172.21.15.62:0/421734608 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:37.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.899+0000 7fab65afe640 1 -- 172.21.15.62:0/421734608 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbfe4fe180 con 0x55cbfe4fd800 2024-09-10T05:36:37.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.899+0000 7fab65afe640 1 --2- 172.21.15.62:0/421734608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cbfe4fd800 0x55cbfe4fdc20 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x55cbfe4f6df0 tx=0x7fab60001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.899+0000 7faa52604640 1 -- 172.21.15.62:0/421734608 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab60020070 con 0x55cbfe4fd800 2024-09-10T05:36:37.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.899+0000 7faa52604640 1 -- 172.21.15.62:0/421734608 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab60011570 con 0x55cbfe4fd800 2024-09-10T05:36:37.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.899+0000 7fab67ff89c0 1 -- 172.21.15.62:0/421734608 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cbfe4fe410 con 0x55cbfe4fd800 2024-09-10T05:36:37.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.899+0000 7faa52604640 1 -- 172.21.15.62:0/421734608 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab60016040 con 0x55cbfe4fd800 2024-09-10T05:36:37.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.899+0000 7fab67ff89c0 1 -- 172.21.15.62:0/421734608 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbfe4fecb0 con 0x55cbfe4fd800 2024-09-10T05:36:37.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.899+0000 7faa52604640 1 -- 172.21.15.62:0/421734608 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fab60023070 con 0x55cbfe4fd800 2024-09-10T05:36:37.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.899+0000 7faa52604640 1 --2- 172.21.15.62:0/421734608 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7faa4c039a70 0x7faa4c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.899+0000 7faa52604640 1 -- 172.21.15.62:0/421734608 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fab6004f7d0 con 0x55cbfe4fd800 2024-09-10T05:36:37.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.899+0000 7fab652fd640 1 --2- 172.21.15.62:0/421734608 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7faa4c039a70 0x7faa4c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.899+0000 7fab67ff89c0 1 --2- 172.21.15.62:0/421734608 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55cbfe502dc0 0x55cbfe5051b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.899+0000 7fab67ff89c0 1 -- 172.21.15.62:0/421734608 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe5056f0 con 0x55cbfe502dc0 2024-09-10T05:36:37.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.899+0000 7fab662ff640 1 --2- 172.21.15.62:0/421734608 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55cbfe502dc0 0x55cbfe5051b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.899+0000 7fab652fd640 1 --2- 172.21.15.62:0/421734608 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7faa4c039a70 0x7faa4c03bf30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fab5c0ad000 tx=0x7fab5c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.899+0000 7fab662ff640 1 --2- 172.21.15.62:0/421734608 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55cbfe502dc0 0x55cbfe5051b0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.903+0000 7fab662ff640 1 -- 172.21.15.62:0/421734608 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab580083f0 con 0x55cbfe502dc0 2024-09-10T05:36:37.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.903+0000 7fab67ff89c0 1 --2- 172.21.15.62:0/421734608 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55cbfe506110 0x55cbfe508580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.903+0000 7fab67ff89c0 1 -- 172.21.15.62:0/421734608 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe508cf0 con 0x55cbfe506110 2024-09-10T05:36:37.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.903+0000 7fab65afe640 1 --2- 172.21.15.62:0/421734608 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55cbfe506110 0x55cbfe508580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.903+0000 7fab65afe640 1 --2- 172.21.15.62:0/421734608 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55cbfe506110 0x55cbfe508580 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.903+0000 7fab65afe640 1 -- 172.21.15.62:0/421734608 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fab6002c070 con 0x55cbfe506110 2024-09-10T05:36:37.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.903+0000 7fab67ff89c0 1 --2- 172.21.15.62:0/421734608 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55cbfe50aab0 0x55cbfe50cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.903+0000 7fab67ff89c0 1 -- 172.21.15.62:0/421734608 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe50d570 con 0x55cbfe50aab0 2024-09-10T05:36:37.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.903+0000 7fab652fd640 1 --2- 172.21.15.62:0/421734608 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55cbfe50aab0 0x55cbfe50cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.903+0000 7fab652fd640 1 --2- 172.21.15.62:0/421734608 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55cbfe50aab0 0x55cbfe50cea0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.903+0000 7fab652fd640 1 -- 172.21.15.62:0/421734608 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fab5c0a9990 con 0x55cbfe50aab0 2024-09-10T05:36:37.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.903+0000 7fab67ff89c0 1 -- 172.21.15.62:0/421734608 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe509950 con 0x55cbfe506110 2024-09-10T05:36:37.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.903+0000 7fab65afe640 1 -- 172.21.15.62:0/421734608 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fab6002c070 con 0x55cbfe506110 2024-09-10T05:36:37.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.903+0000 7fab67ff89c0 1 -- 172.21.15.62:0/421734608 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe509db0 con 0x55cbfe50aab0 2024-09-10T05:36:37.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.907+0000 7fab652fd640 1 -- 172.21.15.62:0/421734608 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fab5c0a9990 con 0x55cbfe50aab0 2024-09-10T05:36:37.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.907+0000 7fab67ff89c0 1 Processor -- start 2024-09-10T05:36:37.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.907+0000 7fab67ff89c0 1 -- start start 2024-09-10T05:36:37.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.907+0000 7fab67ff89c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cbfe51bba0 0x55cbfe51bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.907+0000 7fab67ff89c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55cbfe319450 con 0x55cbfe51bba0 2024-09-10T05:36:37.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.907+0000 7fab65afe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cbfe51bba0 0x55cbfe51bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.907+0000 7fab65afe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cbfe51bba0 0x55cbfe51bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47630/0 (socket says 172.21.15.62:47630) 2024-09-10T05:36:37.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.907+0000 7fab65afe640 1 -- 172.21.15.62:0/1246849255 learned_addr learned my addr 172.21.15.62:0/1246849255 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:37.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.907+0000 7fab65afe640 1 -- 172.21.15.62:0/1246849255 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbfe51c600 con 0x55cbfe51bba0 2024-09-10T05:36:37.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.907+0000 7fab65afe640 1 --2- 172.21.15.62:0/1246849255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cbfe51bba0 0x55cbfe51bfc0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fab6002df70 tx=0x7fab6001bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.907+0000 7faa4b7fe640 1 -- 172.21.15.62:0/1246849255 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab6001c8b0 con 0x55cbfe51bba0 2024-09-10T05:36:37.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.907+0000 7faa4b7fe640 1 -- 172.21.15.62:0/1246849255 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab60040e50 con 0x55cbfe51bba0 2024-09-10T05:36:37.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.907+0000 7fab67ff89c0 1 -- 172.21.15.62:0/1246849255 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cbfe51ce60 con 0x55cbfe51bba0 2024-09-10T05:36:37.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.907+0000 7faa4b7fe640 1 -- 172.21.15.62:0/1246849255 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab60011bb0 con 0x55cbfe51bba0 2024-09-10T05:36:37.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.907+0000 7fab67ff89c0 1 -- 172.21.15.62:0/1246849255 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbfe51d3d0 con 0x55cbfe51bba0 2024-09-10T05:36:37.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.907+0000 7faa4b7fe640 1 -- 172.21.15.62:0/1246849255 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fab6001b350 con 0x55cbfe51bba0 2024-09-10T05:36:37.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.907+0000 7faa4b7fe640 1 --2- 172.21.15.62:0/1246849255 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7faa40039a20 0x7faa4003bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.911+0000 7faa4b7fe640 1 -- 172.21.15.62:0/1246849255 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fab60038aa0 con 0x55cbfe51bba0 2024-09-10T05:36:37.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.911+0000 7fab652fd640 1 --2- 172.21.15.62:0/1246849255 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7faa40039a20 0x7faa4003bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.911+0000 7fab67ff89c0 1 Processor -- start 2024-09-10T05:36:37.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.911+0000 7fab67ff89c0 1 -- start start 2024-09-10T05:36:37.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.911+0000 7fab67ff89c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cbfe528500 0x55cbfe5288e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.911+0000 7fab652fd640 1 --2- 172.21.15.62:0/1246849255 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7faa40039a20 0x7faa4003bee0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x55cbfe509920 tx=0x7fab5c005ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.911+0000 7fab67ff89c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55cbfe4f66b0 con 0x55cbfe528500 2024-09-10T05:36:37.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.911+0000 7fab65afe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cbfe528500 0x55cbfe5288e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.911+0000 7fab65afe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cbfe528500 0x55cbfe5288e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47642/0 (socket says 172.21.15.62:47642) 2024-09-10T05:36:37.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.911+0000 7fab65afe640 1 -- 172.21.15.62:0/3992532662 learned_addr learned my addr 172.21.15.62:0/3992532662 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:37.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.911+0000 7fab65afe640 1 -- 172.21.15.62:0/3992532662 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbfe528eb0 con 0x55cbfe528500 2024-09-10T05:36:37.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.911+0000 7fab65afe640 1 --2- 172.21.15.62:0/3992532662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cbfe528500 0x55cbfe5288e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fab6002fe90 tx=0x7fab60046d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31cd38c8e961fb7c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.911+0000 7faa497fa640 1 -- 172.21.15.62:0/3992532662 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab6003c040 con 0x55cbfe528500 2024-09-10T05:36:37.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.911+0000 7faa497fa640 1 -- 172.21.15.62:0/3992532662 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab6001b7c0 con 0x55cbfe528500 2024-09-10T05:36:37.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.911+0000 7faa497fa640 1 -- 172.21.15.62:0/3992532662 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab60012160 con 0x55cbfe528500 2024-09-10T05:36:37.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.911+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3992532662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cbfe528500 msgr2=0x55cbfe5288e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.911+0000 7fab67ff89c0 1 --2- 172.21.15.62:0/3992532662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cbfe528500 0x55cbfe5288e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fab6002fe90 tx=0x7fab60046d10 comp rx=0 tx=0).stop 2024-09-10T05:36:37.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.911+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3992532662 shutdown_connections 2024-09-10T05:36:37.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.911+0000 7fab67ff89c0 1 --2- 172.21.15.62:0/3992532662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cbfe528500 0x55cbfe5288e0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.911+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3992532662 >> 172.21.15.62:0/3992532662 conn(0x55cbfe524930 msgr2=0x55cbfe522b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:37.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.911+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3992532662 shutdown_connections 2024-09-10T05:36:37.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.911+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3992532662 wait complete. 2024-09-10T05:36:37.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.911+0000 7fab67ff89c0 1 Processor -- start 2024-09-10T05:36:37.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.911+0000 7fab67ff89c0 1 -- start start 2024-09-10T05:36:37.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.911+0000 7fab67ff89c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cbfe528500 0x55cbfe52f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.911+0000 7fab67ff89c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55cbfe529390 con 0x55cbfe528500 2024-09-10T05:36:37.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.911+0000 7fab65afe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cbfe528500 0x55cbfe52f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.911+0000 7fab65afe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cbfe528500 0x55cbfe52f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47656/0 (socket says 172.21.15.62:47656) 2024-09-10T05:36:37.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.911+0000 7fab65afe640 1 -- 172.21.15.62:0/3006178870 learned_addr learned my addr 172.21.15.62:0/3006178870 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:37.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.915+0000 7fab65afe640 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbfe52fd90 con 0x55cbfe528500 2024-09-10T05:36:37.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.915+0000 7fab65afe640 1 --2- 172.21.15.62:0/3006178870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cbfe528500 0x55cbfe52f830 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fab60011f60 tx=0x7fab60010f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.915+0000 7faa377fe640 1 -- 172.21.15.62:0/3006178870 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab6003c050 con 0x55cbfe528500 2024-09-10T05:36:37.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.915+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cbfe52fd90 con 0x55cbfe528500 2024-09-10T05:36:37.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.915+0000 7faa377fe640 1 -- 172.21.15.62:0/3006178870 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab600405f0 con 0x55cbfe528500 2024-09-10T05:36:37.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.915+0000 7faa377fe640 1 -- 172.21.15.62:0/3006178870 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab6002f450 con 0x55cbfe528500 2024-09-10T05:36:37.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.915+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbfe530360 con 0x55cbfe528500 2024-09-10T05:36:37.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.915+0000 7faa377fe640 1 -- 172.21.15.62:0/3006178870 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fab6002f5f0 con 0x55cbfe528500 2024-09-10T05:36:37.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.915+0000 7faa377fe640 1 --2- 172.21.15.62:0/3006178870 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7faa30039a70 0x7faa3003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.915+0000 7faa377fe640 1 -- 172.21.15.62:0/3006178870 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fab60063070 con 0x55cbfe528500 2024-09-10T05:36:37.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.915+0000 7fab67ff89c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.915+0000 7fab652fd640 1 --2- 172.21.15.62:0/3006178870 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7faa30039a70 0x7faa3003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.915+0000 7fab67ff89c0 1 --2- 172.21.15.62:0/3006178870 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55cbfe53a830 0x55cbfe53ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.915+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe53d410 con 0x55cbfe53a830 2024-09-10T05:36:37.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.915+0000 7fab662ff640 1 --2- 172.21.15.62:0/3006178870 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55cbfe53a830 0x55cbfe53ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.915+0000 7fab652fd640 1 --2- 172.21.15.62:0/3006178870 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7faa30039a70 0x7faa3003bf30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fab5c0c33f0 tx=0x7fab5c0c1040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.915+0000 7fab662ff640 1 --2- 172.21.15.62:0/3006178870 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55cbfe53a830 0x55cbfe53ccc0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.915+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab580083f0 con 0x55cbfe53a830 2024-09-10T05:36:37.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.915+0000 7fab67ff89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:37.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.915+0000 7fab67ff89c0 20 realm 2024-09-10T05:36:37.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.915+0000 7fab67ff89c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.915+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe539b80 con 0x55cbfe53a830 2024-09-10T05:36:37.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.919+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab580083f0 con 0x55cbfe53a830 2024-09-10T05:36:37.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.919+0000 7fab67ff89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:37.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.919+0000 7fab67ff89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:37.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.919+0000 7fab67ff89c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.919+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe53dee0 con 0x55cbfe53a830 2024-09-10T05:36:37.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.919+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab580083f0 con 0x55cbfe53a830 2024-09-10T05:36:37.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.919+0000 7fab67ff89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:37.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.919+0000 7fab67ff89c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.919+0000 7fab67ff89c0 1 --2- 172.21.15.62:0/3006178870 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55cbfe53ecc0 0x55cbfe5410b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.919+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe541740 con 0x55cbfe53ecc0 2024-09-10T05:36:37.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.919+0000 7fab65afe640 1 --2- 172.21.15.62:0/3006178870 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55cbfe53ecc0 0x55cbfe5410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.919+0000 7fab65afe640 1 --2- 172.21.15.62:0/3006178870 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55cbfe53ecc0 0x55cbfe5410b0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.919+0000 7fab65afe640 1 -- 172.21.15.62:0/3006178870 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fab6003e070 con 0x55cbfe53ecc0 2024-09-10T05:36:37.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.919+0000 7fab67ff89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:37.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.919+0000 7fab67ff89c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.919+0000 7fab67ff89c0 1 --2- 172.21.15.62:0/3006178870 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55cbfe5424a0 0x55cbfe5448b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.919+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe545040 con 0x55cbfe5424a0 2024-09-10T05:36:37.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.919+0000 7fab652fd640 1 --2- 172.21.15.62:0/3006178870 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55cbfe5424a0 0x55cbfe5448b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.919+0000 7fab652fd640 1 --2- 172.21.15.62:0/3006178870 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55cbfe5424a0 0x55cbfe5448b0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.919+0000 7fab652fd640 1 -- 172.21.15.62:0/3006178870 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fab5c0a9990 con 0x55cbfe5424a0 2024-09-10T05:36:37.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.919+0000 7fab67ff89c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:37.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.919+0000 7fab67ff89c0 20 searching for the correct realm 2024-09-10T05:36:37.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.919+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe546910 con 0x55cbfe5424a0 2024-09-10T05:36:37.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.919+0000 7fab652fd640 1 -- 172.21.15.62:0/3006178870 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab5c0a9990 con 0x55cbfe5424a0 2024-09-10T05:36:37.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.919+0000 7fab652fd640 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe546910 con 0x55cbfe53ecc0 2024-09-10T05:36:37.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.923+0000 7fab65afe640 1 -- 172.21.15.62:0/3006178870 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6003e070 con 0x55cbfe53ecc0 2024-09-10T05:36:37.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.923+0000 7fab65afe640 1 --2- 172.21.15.62:0/3006178870 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fab60025070 0x7fab600472e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:37.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.923+0000 7fab65afe640 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe546910 con 0x7fab60025070 2024-09-10T05:36:37.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.923+0000 7fab662ff640 1 --2- 172.21.15.62:0/3006178870 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fab60025070 0x7fab600472e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:37.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.923+0000 7fab662ff640 1 --2- 172.21.15.62:0/3006178870 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fab60025070 0x7fab600472e0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:37.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.923+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab580083f0 con 0x7fab60025070 2024-09-10T05:36:37.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.923+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe546910 con 0x55cbfe53a830 2024-09-10T05:36:37.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.923+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab580083f0 con 0x55cbfe53a830 2024-09-10T05:36:37.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.923+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe546910 con 0x55cbfe53a830 2024-09-10T05:36:37.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.923+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab580083f0 con 0x55cbfe53a830 2024-09-10T05:36:37.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.923+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe546910 con 0x55cbfe5424a0 2024-09-10T05:36:37.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.923+0000 7fab652fd640 1 -- 172.21.15.62:0/3006178870 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab5c0a9990 con 0x55cbfe5424a0 2024-09-10T05:36:37.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.923+0000 7fab652fd640 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe546910 con 0x55cbfe53a830 2024-09-10T05:36:37.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.923+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab580083f0 con 0x55cbfe53a830 2024-09-10T05:36:37.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.923+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe546910 con 0x55cbfe53ecc0 2024-09-10T05:36:37.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.923+0000 7fab65afe640 1 -- 172.21.15.62:0/3006178870 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6003e070 con 0x55cbfe53ecc0 2024-09-10T05:36:37.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.923+0000 7fab65afe640 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe546910 con 0x55cbfe53ecc0 2024-09-10T05:36:37.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.923+0000 7fab65afe640 1 -- 172.21.15.62:0/3006178870 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6003e070 con 0x55cbfe53ecc0 2024-09-10T05:36:37.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.923+0000 7fab65afe640 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe546910 con 0x55cbfe53a830 2024-09-10T05:36:37.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.923+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab580083f0 con 0x55cbfe53a830 2024-09-10T05:36:37.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.923+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe546910 con 0x7fab60025070 2024-09-10T05:36:37.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.927+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab580083f0 con 0x7fab60025070 2024-09-10T05:36:37.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.927+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe546910 con 0x55cbfe53a830 2024-09-10T05:36:37.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.927+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab580083f0 con 0x55cbfe53a830 2024-09-10T05:36:37.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.927+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe546910 con 0x7fab60025070 2024-09-10T05:36:37.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.927+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fab580083f0 con 0x7fab60025070 2024-09-10T05:36:37.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.927+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe546910 con 0x55cbfe53ecc0 2024-09-10T05:36:37.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.927+0000 7fab65afe640 1 -- 172.21.15.62:0/3006178870 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6003e070 con 0x55cbfe53ecc0 2024-09-10T05:36:37.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.927+0000 7fab65afe640 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe546910 con 0x55cbfe5424a0 2024-09-10T05:36:37.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.927+0000 7fab652fd640 1 -- 172.21.15.62:0/3006178870 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab5c0a9990 con 0x55cbfe5424a0 2024-09-10T05:36:37.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.927+0000 7fab652fd640 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe546910 con 0x55cbfe53a830 2024-09-10T05:36:37.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.927+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab580083f0 con 0x55cbfe53a830 2024-09-10T05:36:37.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.927+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe546910 con 0x55cbfe53ecc0 2024-09-10T05:36:37.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.927+0000 7fab65afe640 1 -- 172.21.15.62:0/3006178870 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6003e070 con 0x55cbfe53ecc0 2024-09-10T05:36:37.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.927+0000 7fab65afe640 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe546910 con 0x55cbfe5424a0 2024-09-10T05:36:37.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.927+0000 7fab652fd640 1 -- 172.21.15.62:0/3006178870 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 30 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7fab5c0a9990 con 0x55cbfe5424a0 2024-09-10T05:36:37.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.927+0000 7fab652fd640 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe546910 con 0x55cbfe53a830 2024-09-10T05:36:37.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.927+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab580083f0 con 0x55cbfe53a830 2024-09-10T05:36:37.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.927+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe546910 con 0x55cbfe53a830 2024-09-10T05:36:37.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.927+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fab580083f0 con 0x55cbfe53a830 2024-09-10T05:36:37.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.927+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe546910 con 0x55cbfe53a830 2024-09-10T05:36:37.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.927+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab580083f0 con 0x55cbfe53a830 2024-09-10T05:36:37.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.927+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe546910 con 0x55cbfe5424a0 2024-09-10T05:36:37.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.931+0000 7fab652fd640 1 -- 172.21.15.62:0/3006178870 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab5c0a9990 con 0x55cbfe5424a0 2024-09-10T05:36:37.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.931+0000 7fab652fd640 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe546910 con 0x7fab60025070 2024-09-10T05:36:37.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.931+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab580083f0 con 0x7fab60025070 2024-09-10T05:36:37.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.931+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe546910 con 0x55cbfe53a830 2024-09-10T05:36:37.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.931+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab580083f0 con 0x55cbfe53a830 2024-09-10T05:36:37.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.931+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe546910 con 0x7fab60025070 2024-09-10T05:36:37.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.931+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab580083f0 con 0x7fab60025070 2024-09-10T05:36:37.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.931+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe546910 con 0x55cbfe5424a0 2024-09-10T05:36:37.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.931+0000 7fab652fd640 1 -- 172.21.15.62:0/3006178870 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab5c0a9990 con 0x55cbfe5424a0 2024-09-10T05:36:37.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.931+0000 7fab652fd640 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe546910 con 0x7fab60025070 2024-09-10T05:36:37.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.931+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab580083f0 con 0x7fab60025070 2024-09-10T05:36:37.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.931+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe546910 con 0x55cbfe53ecc0 2024-09-10T05:36:37.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.931+0000 7fab65afe640 1 -- 172.21.15.62:0/3006178870 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6003e070 con 0x55cbfe53ecc0 2024-09-10T05:36:37.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.931+0000 7fab65afe640 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe546910 con 0x55cbfe53ecc0 2024-09-10T05:36:37.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.931+0000 7fab65afe640 1 -- 172.21.15.62:0/3006178870 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6003e070 con 0x55cbfe53ecc0 2024-09-10T05:36:37.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.931+0000 7fab65afe640 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe546910 con 0x55cbfe5424a0 2024-09-10T05:36:37.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.931+0000 7fab652fd640 1 -- 172.21.15.62:0/3006178870 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab5c0a9990 con 0x55cbfe5424a0 2024-09-10T05:36:37.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.931+0000 7fab652fd640 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe546910 con 0x55cbfe53ecc0 2024-09-10T05:36:37.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.935+0000 7fab65afe640 1 -- 172.21.15.62:0/3006178870 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fab6003e070 con 0x55cbfe53ecc0 2024-09-10T05:36:37.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.935+0000 7fab65afe640 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe546910 con 0x55cbfe53ecc0 2024-09-10T05:36:37.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.935+0000 7fab65afe640 1 -- 172.21.15.62:0/3006178870 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6003e070 con 0x55cbfe53ecc0 2024-09-10T05:36:37.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.935+0000 7fab67ff89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:37.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.935+0000 7fab67ff89c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:37.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.935+0000 7fab67ff89c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:37.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.935+0000 7fab67ff89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:37.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.935+0000 7fab67ff89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:37.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.935+0000 7fab67ff89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:37.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.935+0000 7fab67ff89c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.935+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe545a00 con 0x55cbfe53a830 2024-09-10T05:36:37.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.935+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab580083f0 con 0x55cbfe53a830 2024-09-10T05:36:37.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.935+0000 7fab67ff89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:37.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.935+0000 7fab67ff89c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.935+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe545640 con 0x55cbfe53ecc0 2024-09-10T05:36:37.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.935+0000 7fab65afe640 1 -- 172.21.15.62:0/3006178870 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fab6003e070 con 0x55cbfe53ecc0 2024-09-10T05:36:37.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.935+0000 7fab67ff89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:37.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.935+0000 7fab67ff89c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.935+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe546360 con 0x55cbfe5424a0 2024-09-10T05:36:37.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.935+0000 7fab652fd640 1 -- 172.21.15.62:0/3006178870 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fab5c0a9990 con 0x55cbfe5424a0 2024-09-10T05:36:37.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.935+0000 7fab67ff89c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:37.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.935+0000 7fab67ff89c0 20 zone default found 2024-09-10T05:36:37.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.935+0000 7fab67ff89c0 4 Realm: () 2024-09-10T05:36:37.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.935+0000 7fab67ff89c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:37.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.935+0000 7fab67ff89c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:37.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.935+0000 7fab67ff89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:37.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.935+0000 7fab67ff89c0 20 zonegroup default 2024-09-10T05:36:37.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.935+0000 7fab67ff89c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.935+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe5471f0 con 0x7fab60025070 2024-09-10T05:36:37.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.935+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fab580083f0 con 0x7fab60025070 2024-09-10T05:36:37.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.935+0000 7fab67ff89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:37.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.935+0000 7fab67ff89c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.935+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe549430 con 0x55cbfe5424a0 2024-09-10T05:36:37.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.935+0000 7fab652fd640 1 -- 172.21.15.62:0/3006178870 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fab5c0a9990 con 0x55cbfe5424a0 2024-09-10T05:36:37.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.935+0000 7fab67ff89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:37.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.935+0000 7fab67ff89c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.935+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe5497d0 con 0x55cbfe5424a0 2024-09-10T05:36:37.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.935+0000 7fab652fd640 1 -- 172.21.15.62:0/3006178870 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fab5c0a9990 con 0x55cbfe5424a0 2024-09-10T05:36:37.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.935+0000 7fab67ff89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:37.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.935+0000 7fab67ff89c0 20 started sync module instance, tier type = 2024-09-10T05:36:37.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.935+0000 7fab67ff89c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:37.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.935+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe548870 con 0x55cbfe53ecc0 2024-09-10T05:36:37.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.939+0000 7fab65afe640 1 -- 172.21.15.62:0/3006178870 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6003e070 con 0x55cbfe53ecc0 2024-09-10T05:36:37.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.939+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94334633675872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe549080 con 0x55cbfe53ecc0 2024-09-10T05:36:37.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.939+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe54a4d0 con 0x55cbfe53a830 2024-09-10T05:36:37.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.939+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab580083f0 con 0x55cbfe53a830 2024-09-10T05:36:37.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.939+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94334633683056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe54b140 con 0x55cbfe53a830 2024-09-10T05:36:37.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.939+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe54bb00 con 0x55cbfe53ecc0 2024-09-10T05:36:37.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.939+0000 7fab65afe640 1 -- 172.21.15.62:0/3006178870 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94334633675872] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6003e070 con 0x55cbfe53ecc0 2024-09-10T05:36:37.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.943+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94334633683056] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab580083f0 con 0x55cbfe53a830 2024-09-10T05:36:37.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.943+0000 7fab65afe640 1 -- 172.21.15.62:0/3006178870 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6003e070 con 0x55cbfe53ecc0 2024-09-10T05:36:37.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.943+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94334633686608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe54b140 con 0x55cbfe53ecc0 2024-09-10T05:36:37.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.943+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe54ba70 con 0x7fab60025070 2024-09-10T05:36:37.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.943+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab580083f0 con 0x7fab60025070 2024-09-10T05:36:37.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.943+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94334633687664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe54c3a0 con 0x7fab60025070 2024-09-10T05:36:37.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.943+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe54ce90 con 0x55cbfe53ecc0 2024-09-10T05:36:37.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.947+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94334633687664] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab580083f0 con 0x7fab60025070 2024-09-10T05:36:37.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.947+0000 7fab65afe640 1 -- 172.21.15.62:0/3006178870 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94334633686608] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6003e070 con 0x55cbfe53ecc0 2024-09-10T05:36:37.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.947+0000 7fab65afe640 1 -- 172.21.15.62:0/3006178870 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6003e070 con 0x55cbfe53ecc0 2024-09-10T05:36:37.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.947+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94334633691488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe54bea0 con 0x55cbfe53ecc0 2024-09-10T05:36:37.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.947+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe54d730 con 0x55cbfe5424a0 2024-09-10T05:36:37.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.947+0000 7fab652fd640 1 -- 172.21.15.62:0/3006178870 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab5c0a9990 con 0x55cbfe5424a0 2024-09-10T05:36:37.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.947+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94334633693824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe54bea0 con 0x55cbfe5424a0 2024-09-10T05:36:37.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.947+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe54e170 con 0x55cbfe5424a0 2024-09-10T05:36:37.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.951+0000 7fab65afe640 1 -- 172.21.15.62:0/3006178870 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94334633691488] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6003e070 con 0x55cbfe53ecc0 2024-09-10T05:36:37.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.951+0000 7fab652fd640 1 -- 172.21.15.62:0/3006178870 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94334633693824] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab5c0a9990 con 0x55cbfe5424a0 2024-09-10T05:36:37.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.951+0000 7fab652fd640 1 -- 172.21.15.62:0/3006178870 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab5c0a9990 con 0x55cbfe5424a0 2024-09-10T05:36:37.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.951+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94334633694880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe54dcc0 con 0x55cbfe5424a0 2024-09-10T05:36:37.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.951+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe54ea10 con 0x7fab60025070 2024-09-10T05:36:37.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.951+0000 7fab652fd640 1 -- 172.21.15.62:0/3006178870 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94334633694880] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab5c0a9990 con 0x55cbfe5424a0 2024-09-10T05:36:37.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.951+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab580083f0 con 0x7fab60025070 2024-09-10T05:36:37.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.951+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94334633684112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe54dcc0 con 0x7fab60025070 2024-09-10T05:36:37.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.951+0000 7fab67ff89c0 20 add_watcher() i=0 2024-09-10T05:36:37.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.951+0000 7fab67ff89c0 20 add_watcher() i=1 2024-09-10T05:36:37.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.951+0000 7fab67ff89c0 20 add_watcher() i=2 2024-09-10T05:36:37.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.951+0000 7fab67ff89c0 20 add_watcher() i=3 2024-09-10T05:36:37.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.951+0000 7fab67ff89c0 20 add_watcher() i=4 2024-09-10T05:36:37.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.951+0000 7fab67ff89c0 20 add_watcher() i=5 2024-09-10T05:36:37.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.951+0000 7fab67ff89c0 20 add_watcher() i=6 2024-09-10T05:36:37.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.951+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94334633684112] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab580083f0 con 0x7fab60025070 2024-09-10T05:36:37.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.951+0000 7fab67ff89c0 20 add_watcher() i=7 2024-09-10T05:36:37.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.951+0000 7fab67ff89c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:37.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.951+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe551a70 con 0x55cbfe53a830 2024-09-10T05:36:37.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.955+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fab580083f0 con 0x55cbfe53a830 2024-09-10T05:36:37.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.955+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94334633698656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe54efc0 con 0x55cbfe53a830 2024-09-10T05:36:37.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.955+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94334633698656] v30'132 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fab580083f0 con 0x55cbfe53a830 2024-09-10T05:36:37.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.955+0000 7faa177fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:37.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.955+0000 7fab67ff89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:37.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.955+0000 7fab67ff89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:37.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.955+0000 7fab67ff89c0 5 note: GC not initialized 2024-09-10T05:36:37.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.955+0000 7faa167fc640 20 reqs_thread_entry: start 2024-09-10T05:36:37.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.955+0000 7fab67ff89c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:37.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.955+0000 7fab67ff89c0 20 Filter name: none 2024-09-10T05:36:37.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.955+0000 7fab67ff89c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-10T05:36:37.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.955+0000 7fa987fff640 20 reqs_thread_entry: start 2024-09-10T05:36:37.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.955+0000 7fab67ff89c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.955+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe574ef0 con 0x55cbfe5424a0 2024-09-10T05:36:37.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.955+0000 7fab652fd640 1 -- 172.21.15.62:0/3006178870 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(62 testx$tenanteduser [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 246+0+0 (crc 0 0 0) 0x7fab5c0a9990 con 0x55cbfe5424a0 2024-09-10T05:36:37.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.955+0000 7fab67ff89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:37.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.955+0000 7fab67ff89c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2024-09-10T05:36:37.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.955+0000 7fab67ff89c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-10T05:36:37.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.955+0000 7fab67ff89c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-10T05:36:37.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.955+0000 7fab67ff89c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:37.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.955+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe5734e0 con 0x55cbfe5424a0 2024-09-10T05:36:37.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.959+0000 7fab652fd640 1 -- 172.21.15.62:0/3006178870 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fab5c0a9990 con 0x55cbfe5424a0 2024-09-10T05:36:37.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.959+0000 7fab67ff89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:37.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.959+0000 7fab67ff89c0 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-10T05:36:37.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.959+0000 7fab67ff89c0 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T05:36:37.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.959+0000 7fab67ff89c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-10T05:36:37.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.959+0000 7fab67ff89c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-10T05:36:37.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.959+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:64 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~419 in=419b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe573d60 con 0x55cbfe5424a0 2024-09-10T05:36:37.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.959+0000 7fab652fd640 1 -- 172.21.15.62:0/3006178870 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== osd_op_reply(64 testx$tenanteduser [delete,create,call,writefull 0~419] v30'5 uv5 ondisk = 0) ==== 288+0+0 (crc 0 0 0) 0x7fab5c0a9990 con 0x55cbfe5424a0 2024-09-10T05:36:37.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.959+0000 7fab67ff89c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-10T05:36:37.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.959+0000 7fab67ff89c0 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-10T05:36:37.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.959+0000 7fab67ff89c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-10T05:36:37.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.959+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:65 7.e 7:7759931f:::notify.3:head [notify cookie 94334633851056 in=622b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe578990 con 0x7fab60025070 2024-09-10T05:36:37.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.959+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== watch-notify(notify (1) cookie 94334633687664 notify 128849018888 ret 0) ==== 652+0+0 (crc 0 0 0) 0x7fab5802a990 con 0x7fab60025070 2024-09-10T05:36:37.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.959+0000 7faa497fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018888 cookie 94334633687664 notifier 4535 bl.length()=610 2024-09-10T05:36:37.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.959+0000 7faa497fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-10T05:36:37.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.959+0000 7faa497fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-10T05:36:37.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.959+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(65 notify.3 [notify cookie 94334633851056 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fab580083f0 con 0x7fab60025070 2024-09-10T05:36:37.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.959+0000 7faa497fa640 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7faa28003eb0 con 0x7fab60025070 2024-09-10T05:36:37.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.959+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(66 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab580083f0 con 0x7fab60025070 2024-09-10T05:36:37.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.959+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 <== osd.2 v2:172.21.15.62:6800/2677868286 15 ==== watch-notify(notify_complete (2) cookie 94334633851056 notify 128849018888 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fab5802ac30 con 0x7fab60025070 2024-09-10T05:36:37.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.959+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe573860 con 0x55cbfe5424a0 2024-09-10T05:36:37.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.959+0000 7fab652fd640 1 -- 172.21.15.62:0/3006178870 <== osd.3 v2:172.21.15.62:6816/2708991149 19 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v30'6 uv6 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fab5c0a9990 con 0x55cbfe5424a0 2024-09-10T05:36:37.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.959+0000 7fab67ff89c0 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-10T05:36:37.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.959+0000 7fab67ff89c0 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T05:36:37.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.959+0000 7fab67ff89c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-10T05:36:37.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.959+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94334633850976 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe578990 con 0x55cbfe53ecc0 2024-09-10T05:36:37.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.963+0000 7fab65afe640 1 -- 172.21.15.62:0/3006178870 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== watch-notify(notify (1) cookie 94334633686608 notify 128849018905 ret 0) ==== 234+0+0 (crc 0 0 0) 0x55cbfe51d3d0 con 0x55cbfe53ecc0 2024-09-10T05:36:37.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.963+0000 7faa497fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018905 cookie 94334633686608 notifier 4535 bl.length()=192 2024-09-10T05:36:37.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.963+0000 7faa497fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-10T05:36:37.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.963+0000 7faa497fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T05:36:37.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.963+0000 7fab65afe640 1 -- 172.21.15.62:0/3006178870 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(68 notify.2 [notify cookie 94334633850976 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fab6003e070 con 0x55cbfe53ecc0 2024-09-10T05:36:37.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.963+0000 7faa497fa640 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7faa28003eb0 con 0x55cbfe53ecc0 2024-09-10T05:36:37.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.963+0000 7fab65afe640 1 -- 172.21.15.62:0/3006178870 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6003e070 con 0x55cbfe53ecc0 2024-09-10T05:36:37.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.963+0000 7fab65afe640 1 -- 172.21.15.62:0/3006178870 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== watch-notify(notify_complete (2) cookie 94334633850976 notify 128849018905 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fab60083020 con 0x55cbfe53ecc0 2024-09-10T05:36:37.967 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"testx$tenanteduser","display_name":"tenanted-user","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"testx$tenanteduser","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-10T05:36:37.961834Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:36:37.961820Z","tags":[],"group_ids":[]} 2024-09-10T05:36:37.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.963+0000 7faa177fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:37.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.963+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94334633698656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe534dc0 con 0x55cbfe53a830 2024-09-10T05:36:37.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.967+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94334633698656] v30'133 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fab580083f0 con 0x55cbfe53a830 2024-09-10T05:36:37.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.967+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94334633675872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe54e560 con 0x55cbfe53ecc0 2024-09-10T05:36:37.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.967+0000 7fab65afe640 1 -- 172.21.15.62:0/3006178870 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94334633675872] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6003e070 con 0x55cbfe53ecc0 2024-09-10T05:36:37.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.967+0000 7fab67ff89c0 20 remove_watcher() i=0 2024-09-10T05:36:37.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.967+0000 7fab67ff89c0 2 removed watcher, disabling cache 2024-09-10T05:36:37.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.967+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94334633683056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe548c60 con 0x55cbfe53a830 2024-09-10T05:36:37.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.971+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94334633683056] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab580083f0 con 0x55cbfe53a830 2024-09-10T05:36:37.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.971+0000 7fab67ff89c0 20 remove_watcher() i=1 2024-09-10T05:36:37.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.971+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94334633686608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe548c60 con 0x55cbfe53ecc0 2024-09-10T05:36:37.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.971+0000 7fab65afe640 1 -- 172.21.15.62:0/3006178870 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94334633686608] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6003e070 con 0x55cbfe53ecc0 2024-09-10T05:36:37.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.971+0000 7fab67ff89c0 20 remove_watcher() i=2 2024-09-10T05:36:37.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.971+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94334633687664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe54b650 con 0x7fab60025070 2024-09-10T05:36:37.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.975+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 <== osd.2 v2:172.21.15.62:6800/2677868286 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94334633687664] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab580083f0 con 0x7fab60025070 2024-09-10T05:36:37.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.975+0000 7fab67ff89c0 20 remove_watcher() i=3 2024-09-10T05:36:37.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.975+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94334633691488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe548c60 con 0x55cbfe53ecc0 2024-09-10T05:36:37.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.975+0000 7fab65afe640 1 -- 172.21.15.62:0/3006178870 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94334633691488] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6003e070 con 0x55cbfe53ecc0 2024-09-10T05:36:37.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.975+0000 7fab67ff89c0 20 remove_watcher() i=4 2024-09-10T05:36:37.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.975+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94334633693824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe54c960 con 0x55cbfe5424a0 2024-09-10T05:36:37.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.975+0000 7fab652fd640 1 -- 172.21.15.62:0/3006178870 <== osd.3 v2:172.21.15.62:6816/2708991149 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94334633693824] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab5c0a9990 con 0x55cbfe5424a0 2024-09-10T05:36:37.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.979+0000 7fab67ff89c0 20 remove_watcher() i=5 2024-09-10T05:36:37.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.979+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94334633694880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe548c60 con 0x55cbfe5424a0 2024-09-10T05:36:37.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.979+0000 7fab652fd640 1 -- 172.21.15.62:0/3006178870 <== osd.3 v2:172.21.15.62:6816/2708991149 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94334633694880] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab5c0a9990 con 0x55cbfe5424a0 2024-09-10T05:36:37.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.979+0000 7fab67ff89c0 20 remove_watcher() i=6 2024-09-10T05:36:37.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.979+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94334633684112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cbfe54c960 con 0x7fab60025070 2024-09-10T05:36:37.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.979+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 <== osd.2 v2:172.21.15.62:6800/2677868286 17 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94334633684112] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab580083f0 con 0x7fab60025070 2024-09-10T05:36:37.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.979+0000 7fab67ff89c0 20 remove_watcher() i=7 2024-09-10T05:36:37.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.979+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55cbfe53ecc0 msgr2=0x55cbfe5410b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.979+0000 7fab67ff89c0 1 --2- 172.21.15.62:0/3006178870 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55cbfe53ecc0 0x55cbfe5410b0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.979+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55cbfe53a830 msgr2=0x55cbfe53ccc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.979+0000 7fab67ff89c0 1 --2- 172.21.15.62:0/3006178870 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55cbfe53a830 0x55cbfe53ccc0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.979+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fab60025070 msgr2=0x7fab600472e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.979+0000 7fab67ff89c0 1 --2- 172.21.15.62:0/3006178870 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fab60025070 0x7fab600472e0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.979+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55cbfe5424a0 msgr2=0x55cbfe5448b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.979+0000 7fab67ff89c0 1 --2- 172.21.15.62:0/3006178870 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55cbfe5424a0 0x55cbfe5448b0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.979+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7faa30039a70 msgr2=0x7faa3003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.979+0000 7fab67ff89c0 1 --2- 172.21.15.62:0/3006178870 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7faa30039a70 0x7faa3003bf30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fab5c0c33f0 tx=0x7fab5c0c1040 comp rx=0 tx=0).stop 2024-09-10T05:36:37.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.979+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cbfe528500 msgr2=0x55cbfe52f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.979+0000 7fab662ff640 1 -- 172.21.15.62:0/3006178870 reap_dead start 2024-09-10T05:36:37.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.979+0000 7fab67ff89c0 1 --2- 172.21.15.62:0/3006178870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cbfe528500 0x55cbfe52f830 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fab60011f60 tx=0x7fab60010f00 comp rx=0 tx=0).stop 2024-09-10T05:36:37.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.979+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 shutdown_connections 2024-09-10T05:36:37.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.979+0000 7fab67ff89c0 1 --2- 172.21.15.62:0/3006178870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cbfe528500 0x55cbfe52f830 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.979+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 >> 172.21.15.62:0/3006178870 conn(0x55cbfe524930 msgr2=0x55cbfe522b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:37.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.979+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 shutdown_connections 2024-09-10T05:36:37.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.979+0000 7fab67ff89c0 1 -- 172.21.15.62:0/3006178870 wait complete. 2024-09-10T05:36:37.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.979+0000 7fab67ff89c0 1 -- 172.21.15.62:0/1246849255 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7faa40039a20 msgr2=0x7faa4003bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.979+0000 7fab67ff89c0 1 --2- 172.21.15.62:0/1246849255 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7faa40039a20 0x7faa4003bee0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x55cbfe509920 tx=0x7fab5c005ad0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.979+0000 7fab67ff89c0 1 -- 172.21.15.62:0/1246849255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cbfe51bba0 msgr2=0x55cbfe51bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.979+0000 7fab67ff89c0 1 --2- 172.21.15.62:0/1246849255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cbfe51bba0 0x55cbfe51bfc0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fab6002df70 tx=0x7fab6001bd50 comp rx=0 tx=0).stop 2024-09-10T05:36:37.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.979+0000 7fab67ff89c0 1 -- 172.21.15.62:0/1246849255 shutdown_connections 2024-09-10T05:36:37.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.979+0000 7fab67ff89c0 1 --2- 172.21.15.62:0/1246849255 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7faa40039a20 0x7faa4003bee0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.979+0000 7fab67ff89c0 1 --2- 172.21.15.62:0/1246849255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cbfe51bba0 0x55cbfe51bfc0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.979+0000 7fab67ff89c0 1 -- 172.21.15.62:0/1246849255 >> 172.21.15.62:0/1246849255 conn(0x55cbfe511550 msgr2=0x55cbfe511930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:37.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.979+0000 7fab67ff89c0 1 -- 172.21.15.62:0/1246849255 shutdown_connections 2024-09-10T05:36:37.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.979+0000 7fab67ff89c0 1 -- 172.21.15.62:0/1246849255 wait complete. 2024-09-10T05:36:37.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.983+0000 7fab67ff89c0 1 -- 172.21.15.62:0/421734608 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55cbfe506110 msgr2=0x55cbfe508580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.983+0000 7fab67ff89c0 1 --2- 172.21.15.62:0/421734608 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55cbfe506110 0x55cbfe508580 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.983+0000 7fab67ff89c0 1 -- 172.21.15.62:0/421734608 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55cbfe502dc0 msgr2=0x55cbfe5051b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.983+0000 7fab67ff89c0 1 --2- 172.21.15.62:0/421734608 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55cbfe502dc0 0x55cbfe5051b0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.983+0000 7fab67ff89c0 1 -- 172.21.15.62:0/421734608 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55cbfe50aab0 msgr2=0x55cbfe50cea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.983+0000 7fab67ff89c0 1 --2- 172.21.15.62:0/421734608 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55cbfe50aab0 0x55cbfe50cea0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:37.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.983+0000 7fab67ff89c0 1 -- 172.21.15.62:0/421734608 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7faa4c039a70 msgr2=0x7faa4c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.983+0000 7fab67ff89c0 1 --2- 172.21.15.62:0/421734608 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7faa4c039a70 0x7faa4c03bf30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fab5c0ad000 tx=0x7fab5c0a6000 comp rx=0 tx=0).stop 2024-09-10T05:36:37.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.983+0000 7fab67ff89c0 1 -- 172.21.15.62:0/421734608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cbfe4fd800 msgr2=0x55cbfe4fdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:37.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.983+0000 7fab67ff89c0 1 --2- 172.21.15.62:0/421734608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cbfe4fd800 0x55cbfe4fdc20 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x55cbfe4f6df0 tx=0x7fab60001260 comp rx=0 tx=0).stop 2024-09-10T05:36:37.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.983+0000 7fab662ff640 1 -- 172.21.15.62:0/421734608 reap_dead start 2024-09-10T05:36:37.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.983+0000 7fab67ff89c0 1 -- 172.21.15.62:0/421734608 shutdown_connections 2024-09-10T05:36:37.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.983+0000 7fab67ff89c0 1 -- 172.21.15.62:0/421734608 >> 172.21.15.62:0/421734608 conn(0x55cbfe379a90 msgr2=0x55cbfe4f7130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:37.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.983+0000 7fab67ff89c0 1 -- 172.21.15.62:0/421734608 shutdown_connections 2024-09-10T05:36:37.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:37.983+0000 7fab67ff89c0 1 -- 172.21.15.62:0/421734608 wait complete. 2024-09-10T05:36:37.996 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-10T05:36:37.961834Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:36:37.961820Z', 'tags': [], 'group_ids': []} 2024-09-10T05:36:37.996 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-10T05:36:37.996 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-10T05:36:37.997 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2024-09-10T05:36:38.032 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:38.032 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:38.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.031+0000 7fdb149ed9c0 1 Processor -- start 2024-09-10T05:36:38.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.031+0000 7fdb149ed9c0 1 -- start start 2024-09-10T05:36:38.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.031+0000 7fdb149ed9c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5562edaad2d0 0x5562edaaf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.031+0000 7fdb149ed9c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5562ed95d9c0 con 0x5562eda1d180 2024-09-10T05:36:38.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.031+0000 7fdb149ed9c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x5562ed9ad6d0 con 0x5562edaad2d0 2024-09-10T05:36:38.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.031+0000 7fdb11cf2640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5562edaad2d0 0x5562edaaf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.031+0000 7fdb11cf2640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5562edaad2d0 0x5562edaaf6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47662/0 (socket says 172.21.15.62:47662) 2024-09-10T05:36:38.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.031+0000 7fdb11cf2640 1 -- 172.21.15.62:0/3278328138 learned_addr learned my addr 172.21.15.62:0/3278328138 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:38.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.031+0000 7fdb124f3640 1 --1- 172.21.15.62:0/3278328138 >> v1:172.21.15.2:6789/0 conn(0x5562eda1d180 0x5562edaabbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:53102/0 (socket says 172.21.15.62:53102) 2024-09-10T05:36:38.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.031+0000 7fdb11cf2640 1 -- 172.21.15.62:0/3278328138 >> v1:172.21.15.2:6789/0 conn(0x5562eda1d180 legacy=0x5562edaabbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.031+0000 7fdb11cf2640 1 -- 172.21.15.62:0/3278328138 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562ed951ca0 con 0x5562edaad2d0 2024-09-10T05:36:38.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.035+0000 7fdb11cf2640 1 --2- 172.21.15.62:0/3278328138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562edaad2d0 0x5562edaaf6c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fdb0800a5c0 tx=0x7fdb0801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e28b3e36bd1999c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.035+0000 7fdb114f1640 1 -- 172.21.15.62:0/3278328138 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb080b1070 con 0x5562edaad2d0 2024-09-10T05:36:38.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.035+0000 7fdb114f1640 1 -- 172.21.15.62:0/3278328138 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb080a8070 con 0x5562edaad2d0 2024-09-10T05:36:38.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.035+0000 7fdb114f1640 1 -- 172.21.15.62:0/3278328138 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb080ac5b0 con 0x5562edaad2d0 2024-09-10T05:36:38.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.035+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/3278328138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562edaad2d0 msgr2=0x5562edaaf6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.035+0000 7fdb149ed9c0 1 --2- 172.21.15.62:0/3278328138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562edaad2d0 0x5562edaaf6c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fdb0800a5c0 tx=0x7fdb0801b340 comp rx=0 tx=0).stop 2024-09-10T05:36:38.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.035+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/3278328138 shutdown_connections 2024-09-10T05:36:38.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.035+0000 7fdb149ed9c0 1 --2- 172.21.15.62:0/3278328138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562edaad2d0 0x5562edaaf6c0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.035+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/3278328138 >> 172.21.15.62:0/3278328138 conn(0x5562edaa38a0 msgr2=0x5562edaa5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:38.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.035+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/3278328138 shutdown_connections 2024-09-10T05:36:38.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.035+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/3278328138 wait complete. 2024-09-10T05:36:38.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.051+0000 7fdb149ed9c0 1 Processor -- start 2024-09-10T05:36:38.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.051+0000 7fdb149ed9c0 1 -- start start 2024-09-10T05:36:38.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.051+0000 7fdb149ed9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562eda1d180 0x5562edb947d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.051+0000 7fdb149ed9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5562ed9b1680 con 0x5562eda1d180 2024-09-10T05:36:38.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.051+0000 7fdb124f3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562eda1d180 0x5562edb947d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.051+0000 7fdb124f3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562eda1d180 0x5562edb947d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47668/0 (socket says 172.21.15.62:47668) 2024-09-10T05:36:38.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.051+0000 7fdb124f3640 1 -- 172.21.15.62:0/1375363474 learned_addr learned my addr 172.21.15.62:0/1375363474 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:38.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.051+0000 7fdb124f3640 1 -- 172.21.15.62:0/1375363474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562ed92cda0 con 0x5562eda1d180 2024-09-10T05:36:38.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.051+0000 7fdb124f3640 1 --2- 172.21.15.62:0/1375363474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562eda1d180 0x5562edb947d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fdb04001ec0 tx=0x7fdb0400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9375163f8a3fe03 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.051+0000 7fda00608640 1 -- 172.21.15.62:0/1375363474 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb0400e5d0 con 0x5562eda1d180 2024-09-10T05:36:38.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.051+0000 7fda00608640 1 -- 172.21.15.62:0/1375363474 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb0400e770 con 0x5562eda1d180 2024-09-10T05:36:38.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.051+0000 7fda00608640 1 -- 172.21.15.62:0/1375363474 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb0400ea70 con 0x5562eda1d180 2024-09-10T05:36:38.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.051+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/1375363474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562eda1d180 msgr2=0x5562edb947d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.051+0000 7fdb149ed9c0 1 --2- 172.21.15.62:0/1375363474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562eda1d180 0x5562edb947d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fdb04001ec0 tx=0x7fdb0400b6d0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.051+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/1375363474 shutdown_connections 2024-09-10T05:36:38.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.051+0000 7fdb149ed9c0 1 --2- 172.21.15.62:0/1375363474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562eda1d180 0x5562edb947d0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.051+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/1375363474 >> 172.21.15.62:0/1375363474 conn(0x5562edaa38a0 msgr2=0x5562edb90410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:38.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.051+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/1375363474 shutdown_connections 2024-09-10T05:36:38.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.051+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/1375363474 wait complete. 2024-09-10T05:36:38.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.051+0000 7fdb149ed9c0 1 Processor -- start 2024-09-10T05:36:38.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.051+0000 7fdb149ed9c0 1 -- start start 2024-09-10T05:36:38.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.051+0000 7fdb149ed9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562eda1d180 0x5562edb9be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.051+0000 7fdb149ed9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5562ed953a50 con 0x5562eda1d180 2024-09-10T05:36:38.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.051+0000 7fdb124f3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562eda1d180 0x5562edb9be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.051+0000 7fdb124f3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562eda1d180 0x5562edb9be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47680/0 (socket says 172.21.15.62:47680) 2024-09-10T05:36:38.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.051+0000 7fdb124f3640 1 -- 172.21.15.62:0/2853094593 learned_addr learned my addr 172.21.15.62:0/2853094593 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:38.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.055+0000 7fdb124f3640 1 -- 172.21.15.62:0/2853094593 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562edb9c3e0 con 0x5562eda1d180 2024-09-10T05:36:38.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.055+0000 7fdb124f3640 1 --2- 172.21.15.62:0/2853094593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562eda1d180 0x5562edb9be80 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x5562edb95760 tx=0x7fdb04000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.055+0000 7fd9fee05640 1 -- 172.21.15.62:0/2853094593 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb0400f8e0 con 0x5562eda1d180 2024-09-10T05:36:38.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.055+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/2853094593 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5562edb9c670 con 0x5562eda1d180 2024-09-10T05:36:38.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.055+0000 7fd9fee05640 1 -- 172.21.15.62:0/2853094593 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb0400fa80 con 0x5562eda1d180 2024-09-10T05:36:38.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.055+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/2853094593 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562edb9d020 con 0x5562eda1d180 2024-09-10T05:36:38.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.055+0000 7fd9fee05640 1 -- 172.21.15.62:0/2853094593 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb0402c060 con 0x5562eda1d180 2024-09-10T05:36:38.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.055+0000 7fd9fee05640 1 -- 172.21.15.62:0/2853094593 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fdb04017070 con 0x5562eda1d180 2024-09-10T05:36:38.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.055+0000 7fd9fee05640 1 --2- 172.21.15.62:0/2853094593 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fd9f8039ac0 0x7fd9f803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.055+0000 7fd9fee05640 1 -- 172.21.15.62:0/2853094593 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fdb04015020 con 0x5562eda1d180 2024-09-10T05:36:38.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.055+0000 7fdb11cf2640 1 --2- 172.21.15.62:0/2853094593 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fd9f8039ac0 0x7fd9f803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.055+0000 7fdb149ed9c0 1 --2- 172.21.15.62:0/2853094593 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5562edaad2d0 0x5562edba2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.055+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/2853094593 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5562edba3530 con 0x5562edaad2d0 2024-09-10T05:36:38.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.055+0000 7fdb12cf4640 1 --2- 172.21.15.62:0/2853094593 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5562edaad2d0 0x5562edba2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.055+0000 7fdb11cf2640 1 --2- 172.21.15.62:0/2853094593 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fd9f8039ac0 0x7fd9f803bf80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdb080ae000 tx=0x7fdb080a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.055+0000 7fdb12cf4640 1 --2- 172.21.15.62:0/2853094593 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5562edaad2d0 0x5562edba2ff0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.055+0000 7fdb12cf4640 1 -- 172.21.15.62:0/2853094593 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb0c00a4d0 con 0x5562edaad2d0 2024-09-10T05:36:38.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.055+0000 7fdb149ed9c0 1 --2- 172.21.15.62:0/2853094593 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5562edba3fe0 0x5562edba64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.055+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/2853094593 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5562edba6c10 con 0x5562edba3fe0 2024-09-10T05:36:38.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.059+0000 7fdb124f3640 1 --2- 172.21.15.62:0/2853094593 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5562edba3fe0 0x5562edba64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.059+0000 7fdb124f3640 1 --2- 172.21.15.62:0/2853094593 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5562edba3fe0 0x5562edba64a0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.059+0000 7fdb124f3640 1 -- 172.21.15.62:0/2853094593 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdb0402e070 con 0x5562edba3fe0 2024-09-10T05:36:38.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.059+0000 7fdb149ed9c0 1 --2- 172.21.15.62:0/2853094593 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5562edba89d0 0x5562edbaadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.059+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/2853094593 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5562edbab4b0 con 0x5562edba89d0 2024-09-10T05:36:38.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.059+0000 7fdb11cf2640 1 --2- 172.21.15.62:0/2853094593 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5562edba89d0 0x5562edbaadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.059+0000 7fdb11cf2640 1 --2- 172.21.15.62:0/2853094593 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5562edba89d0 0x5562edbaadc0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.059+0000 7fdb11cf2640 1 -- 172.21.15.62:0/2853094593 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdb080b4040 con 0x5562edba89d0 2024-09-10T05:36:38.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.059+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/2853094593 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5562edba7870 con 0x5562edba3fe0 2024-09-10T05:36:38.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.059+0000 7fdb124f3640 1 -- 172.21.15.62:0/2853094593 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdb0402e070 con 0x5562edba3fe0 2024-09-10T05:36:38.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.059+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/2853094593 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5562edba7cd0 con 0x5562edba89d0 2024-09-10T05:36:38.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.059+0000 7fdb11cf2640 1 -- 172.21.15.62:0/2853094593 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdb080b4040 con 0x5562edba89d0 2024-09-10T05:36:38.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.059+0000 7fdb149ed9c0 1 Processor -- start 2024-09-10T05:36:38.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.059+0000 7fdb149ed9c0 1 -- start start 2024-09-10T05:36:38.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.063+0000 7fdb149ed9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562edbb9af0 0x5562edbb9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.063+0000 7fdb149ed9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5562ed9be450 con 0x5562edbb9af0 2024-09-10T05:36:38.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.063+0000 7fdb124f3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562edbb9af0 0x5562edbb9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.063+0000 7fdb124f3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562edbb9af0 0x5562edbb9f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47682/0 (socket says 172.21.15.62:47682) 2024-09-10T05:36:38.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.063+0000 7fdb124f3640 1 -- 172.21.15.62:0/2377236573 learned_addr learned my addr 172.21.15.62:0/2377236573 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:38.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.063+0000 7fdb124f3640 1 -- 172.21.15.62:0/2377236573 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562edbba550 con 0x5562edbb9af0 2024-09-10T05:36:38.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.063+0000 7fdb124f3640 1 --2- 172.21.15.62:0/2377236573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562edbb9af0 0x5562edbb9f10 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fdb04048210 tx=0x7fdb0400ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.063+0000 7fd9f7fff640 1 -- 172.21.15.62:0/2377236573 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb04019510 con 0x5562edbb9af0 2024-09-10T05:36:38.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.063+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/2377236573 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5562edbba550 con 0x5562edbb9af0 2024-09-10T05:36:38.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.063+0000 7fd9f7fff640 1 -- 172.21.15.62:0/2377236573 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb0401a480 con 0x5562edbb9af0 2024-09-10T05:36:38.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.063+0000 7fd9f7fff640 1 -- 172.21.15.62:0/2377236573 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb04041060 con 0x5562edbb9af0 2024-09-10T05:36:38.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.063+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/2377236573 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562edbba550 con 0x5562edbb9af0 2024-09-10T05:36:38.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.063+0000 7fd9f7fff640 1 -- 172.21.15.62:0/2377236573 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fdb0401a760 con 0x5562edbb9af0 2024-09-10T05:36:38.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.063+0000 7fd9f7fff640 1 --2- 172.21.15.62:0/2377236573 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fd9ec039a70 0x7fd9ec03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.063+0000 7fd9f7fff640 1 -- 172.21.15.62:0/2377236573 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fdb04038070 con 0x5562edbb9af0 2024-09-10T05:36:38.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.063+0000 7fdb11cf2640 1 --2- 172.21.15.62:0/2377236573 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fd9ec039a70 0x7fd9ec03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.063+0000 7fdb149ed9c0 1 Processor -- start 2024-09-10T05:36:38.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.063+0000 7fdb149ed9c0 1 -- start start 2024-09-10T05:36:38.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.063+0000 7fdb11cf2640 1 --2- 172.21.15.62:0/2377236573 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fd9ec039a70 0x7fd9ec03bf30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x5562edb9dfe0 tx=0x7fdb08005ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.063+0000 7fdb149ed9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562edbc5ec0 0x5562edbc62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.063+0000 7fdb149ed9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5562edb95020 con 0x5562edbc5ec0 2024-09-10T05:36:38.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.067+0000 7fdb124f3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562edbc5ec0 0x5562edbc62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.067+0000 7fdb124f3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562edbc5ec0 0x5562edbc62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47692/0 (socket says 172.21.15.62:47692) 2024-09-10T05:36:38.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.067+0000 7fdb124f3640 1 -- 172.21.15.62:0/208321201 learned_addr learned my addr 172.21.15.62:0/208321201 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:38.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.067+0000 7fdb124f3640 1 -- 172.21.15.62:0/208321201 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562edbc6870 con 0x5562edbc5ec0 2024-09-10T05:36:38.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.067+0000 7fdb124f3640 1 --2- 172.21.15.62:0/208321201 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562edbc5ec0 0x5562edbc62a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fdb04033fe0 tx=0x7fdb0402a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60e90c4244a4fcba server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.067+0000 7fd9f5ffb640 1 -- 172.21.15.62:0/208321201 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb040483b0 con 0x5562edbc5ec0 2024-09-10T05:36:38.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.067+0000 7fd9f5ffb640 1 -- 172.21.15.62:0/208321201 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb040485b0 con 0x5562edbc5ec0 2024-09-10T05:36:38.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.067+0000 7fd9f5ffb640 1 -- 172.21.15.62:0/208321201 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb0403c820 con 0x5562edbc5ec0 2024-09-10T05:36:38.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.067+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/208321201 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562edbc5ec0 msgr2=0x5562edbc62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.067+0000 7fdb149ed9c0 1 --2- 172.21.15.62:0/208321201 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562edbc5ec0 0x5562edbc62a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fdb04033fe0 tx=0x7fdb0402a290 comp rx=0 tx=0).stop 2024-09-10T05:36:38.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.067+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/208321201 shutdown_connections 2024-09-10T05:36:38.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.067+0000 7fdb149ed9c0 1 --2- 172.21.15.62:0/208321201 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562edbc5ec0 0x5562edbc62a0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.067+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/208321201 >> 172.21.15.62:0/208321201 conn(0x5562edbc22f0 msgr2=0x5562edbc0530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:38.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.067+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/208321201 shutdown_connections 2024-09-10T05:36:38.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.067+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/208321201 wait complete. 2024-09-10T05:36:38.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.067+0000 7fdb149ed9c0 1 Processor -- start 2024-09-10T05:36:38.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.067+0000 7fdb149ed9c0 1 -- start start 2024-09-10T05:36:38.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.067+0000 7fdb149ed9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562edbc5ec0 0x5562edbcd200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.067+0000 7fdb149ed9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5562edbc6d50 con 0x5562edbc5ec0 2024-09-10T05:36:38.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.067+0000 7fdb124f3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562edbc5ec0 0x5562edbcd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.067+0000 7fdb124f3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562edbc5ec0 0x5562edbcd200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47698/0 (socket says 172.21.15.62:47698) 2024-09-10T05:36:38.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.067+0000 7fdb124f3640 1 -- 172.21.15.62:0/49581153 learned_addr learned my addr 172.21.15.62:0/49581153 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:38.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.067+0000 7fdb124f3640 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562edbcd760 con 0x5562edbc5ec0 2024-09-10T05:36:38.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.067+0000 7fdb124f3640 1 --2- 172.21.15.62:0/49581153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562edbc5ec0 0x5562edbcd200 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fdb0401bd70 tx=0x7fdb0401e7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.067+0000 7fd9e3fff640 1 -- 172.21.15.62:0/49581153 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb04031480 con 0x5562edbc5ec0 2024-09-10T05:36:38.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.071+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5562edbcd760 con 0x5562edbc5ec0 2024-09-10T05:36:38.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.071+0000 7fd9e3fff640 1 -- 172.21.15.62:0/49581153 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb0406b070 con 0x5562edbc5ec0 2024-09-10T05:36:38.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.071+0000 7fd9e3fff640 1 -- 172.21.15.62:0/49581153 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb04031620 con 0x5562edbc5ec0 2024-09-10T05:36:38.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.071+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562edbcdd90 con 0x5562edbc5ec0 2024-09-10T05:36:38.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.071+0000 7fd9e3fff640 1 -- 172.21.15.62:0/49581153 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fdb04062040 con 0x5562edbc5ec0 2024-09-10T05:36:38.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.071+0000 7fdb149ed9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.071+0000 7fd9e3fff640 1 --2- 172.21.15.62:0/49581153 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fd9dc039a70 0x7fd9dc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.071+0000 7fd9e3fff640 1 -- 172.21.15.62:0/49581153 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fdb04060020 con 0x5562edbc5ec0 2024-09-10T05:36:38.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.071+0000 7fdb11cf2640 1 --2- 172.21.15.62:0/49581153 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fd9dc039a70 0x7fd9dc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.071+0000 7fdb149ed9c0 1 --2- 172.21.15.62:0/49581153 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5562edbd8140 0x5562edbda5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.071+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5562edbdad20 con 0x5562edbd8140 2024-09-10T05:36:38.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.071+0000 7fdb12cf4640 1 --2- 172.21.15.62:0/49581153 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5562edbd8140 0x5562edbda5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.071+0000 7fdb11cf2640 1 --2- 172.21.15.62:0/49581153 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fd9dc039a70 0x7fd9dc03bf30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdb080af040 tx=0x7fdb080a8000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.071+0000 7fdb12cf4640 1 --2- 172.21.15.62:0/49581153 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5562edbd8140 0x5562edbda5d0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.071+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb0c00a4d0 con 0x5562edbd8140 2024-09-10T05:36:38.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.071+0000 7fdb149ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:38.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.071+0000 7fdb149ed9c0 20 realm 2024-09-10T05:36:38.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.071+0000 7fdb149ed9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.071+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5562edbd7580 con 0x5562edbd8140 2024-09-10T05:36:38.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.071+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb0c00a4d0 con 0x5562edbd8140 2024-09-10T05:36:38.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.071+0000 7fdb149ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:38.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.071+0000 7fdb149ed9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:38.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.071+0000 7fdb149ed9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.071+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5562edbdb830 con 0x5562edbd8140 2024-09-10T05:36:38.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.071+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb0c00a4d0 con 0x5562edbd8140 2024-09-10T05:36:38.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.071+0000 7fdb149ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:38.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.071+0000 7fdb149ed9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.071+0000 7fdb149ed9c0 1 --2- 172.21.15.62:0/49581153 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5562edbdc610 0x5562edbdea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.071+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5562edbdf0d0 con 0x5562edbdc610 2024-09-10T05:36:38.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.075+0000 7fdb124f3640 1 --2- 172.21.15.62:0/49581153 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5562edbdc610 0x5562edbdea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.075+0000 7fdb124f3640 1 --2- 172.21.15.62:0/49581153 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5562edbdc610 0x5562edbdea00 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.075+0000 7fdb124f3640 1 -- 172.21.15.62:0/49581153 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdb0402e070 con 0x5562edbdc610 2024-09-10T05:36:38.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.075+0000 7fdb149ed9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:38.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.075+0000 7fdb149ed9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.075+0000 7fdb149ed9c0 1 --2- 172.21.15.62:0/49581153 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5562edbdfe30 0x5562edbe2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.075+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5562edbe29d0 con 0x5562edbdfe30 2024-09-10T05:36:38.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.075+0000 7fdb11cf2640 1 --2- 172.21.15.62:0/49581153 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5562edbdfe30 0x5562edbe2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.075+0000 7fdb11cf2640 1 --2- 172.21.15.62:0/49581153 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5562edbdfe30 0x5562edbe2240 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.075+0000 7fdb11cf2640 1 -- 172.21.15.62:0/49581153 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdb080b4040 con 0x5562edbdfe30 2024-09-10T05:36:38.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.075+0000 7fdb149ed9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:38.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.075+0000 7fdb149ed9c0 20 searching for the correct realm 2024-09-10T05:36:38.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.075+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5562edbe42a0 con 0x5562edbdfe30 2024-09-10T05:36:38.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.075+0000 7fdb11cf2640 1 -- 172.21.15.62:0/49581153 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb080b4040 con 0x5562edbdfe30 2024-09-10T05:36:38.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.075+0000 7fdb11cf2640 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5562edbe42a0 con 0x5562edbdc610 2024-09-10T05:36:38.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.075+0000 7fdb124f3640 1 -- 172.21.15.62:0/49581153 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb0402e070 con 0x5562edbdc610 2024-09-10T05:36:38.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.075+0000 7fdb124f3640 1 --2- 172.21.15.62:0/49581153 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fdb0401ec20 0x7fdb04004950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.075+0000 7fdb124f3640 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5562edbe42a0 con 0x7fdb0401ec20 2024-09-10T05:36:38.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.075+0000 7fdb12cf4640 1 --2- 172.21.15.62:0/49581153 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fdb0401ec20 0x7fdb04004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.079+0000 7fdb12cf4640 1 --2- 172.21.15.62:0/49581153 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fdb0401ec20 0x7fdb04004950 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.079+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb0c00a4d0 con 0x7fdb0401ec20 2024-09-10T05:36:38.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.079+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5562edbe42a0 con 0x5562edbd8140 2024-09-10T05:36:38.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.079+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb0c00a4d0 con 0x5562edbd8140 2024-09-10T05:36:38.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.079+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5562edbe42a0 con 0x5562edbd8140 2024-09-10T05:36:38.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.079+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb0c00a4d0 con 0x5562edbd8140 2024-09-10T05:36:38.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.079+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5562edbe42a0 con 0x5562edbdfe30 2024-09-10T05:36:38.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.079+0000 7fdb11cf2640 1 -- 172.21.15.62:0/49581153 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb080b4040 con 0x5562edbdfe30 2024-09-10T05:36:38.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.079+0000 7fdb11cf2640 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5562edbe42a0 con 0x5562edbd8140 2024-09-10T05:36:38.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.079+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb0c00a4d0 con 0x5562edbd8140 2024-09-10T05:36:38.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.079+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5562edbe42a0 con 0x5562edbdc610 2024-09-10T05:36:38.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.079+0000 7fdb124f3640 1 -- 172.21.15.62:0/49581153 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb0402e070 con 0x5562edbdc610 2024-09-10T05:36:38.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.079+0000 7fdb124f3640 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5562edbe42a0 con 0x5562edbdc610 2024-09-10T05:36:38.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.079+0000 7fdb124f3640 1 -- 172.21.15.62:0/49581153 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb0402e070 con 0x5562edbdc610 2024-09-10T05:36:38.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.079+0000 7fdb124f3640 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5562edbe42a0 con 0x5562edbd8140 2024-09-10T05:36:38.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.079+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb0c00a4d0 con 0x5562edbd8140 2024-09-10T05:36:38.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.079+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5562edbe42a0 con 0x7fdb0401ec20 2024-09-10T05:36:38.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.079+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb0c00a4d0 con 0x7fdb0401ec20 2024-09-10T05:36:38.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.079+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5562edbe42a0 con 0x5562edbd8140 2024-09-10T05:36:38.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.083+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb0c00a4d0 con 0x5562edbd8140 2024-09-10T05:36:38.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.083+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5562edbe42a0 con 0x7fdb0401ec20 2024-09-10T05:36:38.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.083+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdb0c00a4d0 con 0x7fdb0401ec20 2024-09-10T05:36:38.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.083+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5562edbe42a0 con 0x5562edbdc610 2024-09-10T05:36:38.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.083+0000 7fdb124f3640 1 -- 172.21.15.62:0/49581153 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb0402e070 con 0x5562edbdc610 2024-09-10T05:36:38.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.083+0000 7fdb124f3640 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5562edbe42a0 con 0x5562edbdfe30 2024-09-10T05:36:38.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.083+0000 7fdb11cf2640 1 -- 172.21.15.62:0/49581153 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb080b4040 con 0x5562edbdfe30 2024-09-10T05:36:38.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.083+0000 7fdb11cf2640 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5562edbe42a0 con 0x5562edbd8140 2024-09-10T05:36:38.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.083+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb0c00a4d0 con 0x5562edbd8140 2024-09-10T05:36:38.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.083+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5562edbe42a0 con 0x5562edbdc610 2024-09-10T05:36:38.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.083+0000 7fdb124f3640 1 -- 172.21.15.62:0/49581153 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb0402e070 con 0x5562edbdc610 2024-09-10T05:36:38.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.083+0000 7fdb124f3640 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5562edbe42a0 con 0x5562edbdfe30 2024-09-10T05:36:38.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.083+0000 7fdb11cf2640 1 -- 172.21.15.62:0/49581153 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 30 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7fdb080b4040 con 0x5562edbdfe30 2024-09-10T05:36:38.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.083+0000 7fdb11cf2640 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5562edbe42a0 con 0x5562edbd8140 2024-09-10T05:36:38.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.083+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb0c00a4d0 con 0x5562edbd8140 2024-09-10T05:36:38.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.083+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5562edbe42a0 con 0x5562edbd8140 2024-09-10T05:36:38.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.083+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdb0c00a4d0 con 0x5562edbd8140 2024-09-10T05:36:38.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.083+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5562edbe42a0 con 0x5562edbd8140 2024-09-10T05:36:38.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.083+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb0c00a4d0 con 0x5562edbd8140 2024-09-10T05:36:38.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.083+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5562edbe42a0 con 0x5562edbdfe30 2024-09-10T05:36:38.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.083+0000 7fdb11cf2640 1 -- 172.21.15.62:0/49581153 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb080b4040 con 0x5562edbdfe30 2024-09-10T05:36:38.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.083+0000 7fdb11cf2640 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5562edbe42a0 con 0x7fdb0401ec20 2024-09-10T05:36:38.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.087+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb0c00a4d0 con 0x7fdb0401ec20 2024-09-10T05:36:38.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.087+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5562edbe42a0 con 0x5562edbd8140 2024-09-10T05:36:38.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.087+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb0c00a4d0 con 0x5562edbd8140 2024-09-10T05:36:38.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.087+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5562edbe42a0 con 0x7fdb0401ec20 2024-09-10T05:36:38.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.087+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb0c00a4d0 con 0x7fdb0401ec20 2024-09-10T05:36:38.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.087+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5562edbe42a0 con 0x5562edbdfe30 2024-09-10T05:36:38.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.087+0000 7fdb11cf2640 1 -- 172.21.15.62:0/49581153 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb080b4040 con 0x5562edbdfe30 2024-09-10T05:36:38.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.087+0000 7fdb11cf2640 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5562edbe42a0 con 0x7fdb0401ec20 2024-09-10T05:36:38.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.087+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb0c00a4d0 con 0x7fdb0401ec20 2024-09-10T05:36:38.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.087+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5562edbe42a0 con 0x5562edbdc610 2024-09-10T05:36:38.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.087+0000 7fdb124f3640 1 -- 172.21.15.62:0/49581153 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb0402e070 con 0x5562edbdc610 2024-09-10T05:36:38.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.087+0000 7fdb124f3640 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5562edbe42a0 con 0x5562edbdc610 2024-09-10T05:36:38.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.087+0000 7fdb124f3640 1 -- 172.21.15.62:0/49581153 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb0402e070 con 0x5562edbdc610 2024-09-10T05:36:38.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.087+0000 7fdb124f3640 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5562edbe42a0 con 0x5562edbdfe30 2024-09-10T05:36:38.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.087+0000 7fdb11cf2640 1 -- 172.21.15.62:0/49581153 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb080b4040 con 0x5562edbdfe30 2024-09-10T05:36:38.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.087+0000 7fdb11cf2640 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5562edbe42a0 con 0x5562edbdc610 2024-09-10T05:36:38.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.087+0000 7fdb124f3640 1 -- 172.21.15.62:0/49581153 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdb0402e070 con 0x5562edbdc610 2024-09-10T05:36:38.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.087+0000 7fdb124f3640 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5562edbe42a0 con 0x5562edbdc610 2024-09-10T05:36:38.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.091+0000 7fdb124f3640 1 -- 172.21.15.62:0/49581153 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb0402e070 con 0x5562edbdc610 2024-09-10T05:36:38.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.091+0000 7fdb149ed9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:38.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.091+0000 7fdb149ed9c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:38.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.091+0000 7fdb149ed9c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:38.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.091+0000 7fdb149ed9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:38.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.091+0000 7fdb149ed9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:38.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.091+0000 7fdb149ed9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:38.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.091+0000 7fdb149ed9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.091+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5562edbe3390 con 0x5562edbd8140 2024-09-10T05:36:38.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.091+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb0c00a4d0 con 0x5562edbd8140 2024-09-10T05:36:38.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.091+0000 7fdb149ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:38.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.091+0000 7fdb149ed9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.091+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5562edbe2fa0 con 0x5562edbdc610 2024-09-10T05:36:38.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.091+0000 7fdb124f3640 1 -- 172.21.15.62:0/49581153 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdb0402e070 con 0x5562edbdc610 2024-09-10T05:36:38.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.091+0000 7fdb149ed9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:38.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.091+0000 7fdb149ed9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.091+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5562edbe3c80 con 0x5562edbdfe30 2024-09-10T05:36:38.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.091+0000 7fdb11cf2640 1 -- 172.21.15.62:0/49581153 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdb080b4040 con 0x5562edbdfe30 2024-09-10T05:36:38.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.091+0000 7fdb149ed9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:38.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.091+0000 7fdb149ed9c0 20 zone default found 2024-09-10T05:36:38.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.091+0000 7fdb149ed9c0 4 Realm: () 2024-09-10T05:36:38.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.091+0000 7fdb149ed9c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:38.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.091+0000 7fdb149ed9c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:38.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.091+0000 7fdb149ed9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:38.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.091+0000 7fdb149ed9c0 20 zonegroup default 2024-09-10T05:36:38.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.091+0000 7fdb149ed9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.091+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5562edbe4b80 con 0x7fdb0401ec20 2024-09-10T05:36:38.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.091+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdb0c00a4d0 con 0x7fdb0401ec20 2024-09-10T05:36:38.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.091+0000 7fdb149ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:38.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.091+0000 7fdb149ed9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.091+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5562edbe6dc0 con 0x5562edbdfe30 2024-09-10T05:36:38.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.091+0000 7fdb11cf2640 1 -- 172.21.15.62:0/49581153 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdb080b4040 con 0x5562edbdfe30 2024-09-10T05:36:38.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.091+0000 7fdb149ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:38.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.091+0000 7fdb149ed9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.091+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5562edbe7160 con 0x5562edbdfe30 2024-09-10T05:36:38.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.091+0000 7fdb11cf2640 1 -- 172.21.15.62:0/49581153 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdb080b4040 con 0x5562edbdfe30 2024-09-10T05:36:38.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.091+0000 7fdb149ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:38.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.091+0000 7fdb149ed9c0 20 started sync module instance, tier type = 2024-09-10T05:36:38.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.091+0000 7fdb149ed9c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:38.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.091+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5562edbe6200 con 0x5562edbdc610 2024-09-10T05:36:38.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.095+0000 7fdb124f3640 1 -- 172.21.15.62:0/49581153 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb0402e070 con 0x5562edbdc610 2024-09-10T05:36:38.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.095+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93883383834448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5562edbe6200 con 0x5562edbdc610 2024-09-10T05:36:38.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.095+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5562edbe7a10 con 0x5562edbd8140 2024-09-10T05:36:38.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.095+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb0c00a4d0 con 0x5562edbd8140 2024-09-10T05:36:38.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.095+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93883383837952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5562edbe82b0 con 0x5562edbd8140 2024-09-10T05:36:38.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.095+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5562edbe8cb0 con 0x5562edbdc610 2024-09-10T05:36:38.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.095+0000 7fdb124f3640 1 -- 172.21.15.62:0/49581153 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 93883383834448] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb0402e070 con 0x5562edbdc610 2024-09-10T05:36:38.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.095+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93883383837952] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb0c00a4d0 con 0x5562edbd8140 2024-09-10T05:36:38.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.099+0000 7fdb124f3640 1 -- 172.21.15.62:0/49581153 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb0402e070 con 0x5562edbdc610 2024-09-10T05:36:38.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.099+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93883383831888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5562edbe7e00 con 0x5562edbdc610 2024-09-10T05:36:38.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.099+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5562edbe9550 con 0x7fdb0401ec20 2024-09-10T05:36:38.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.099+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb0c00a4d0 con 0x7fdb0401ec20 2024-09-10T05:36:38.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.099+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93883383845024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5562edbe7e00 con 0x7fdb0401ec20 2024-09-10T05:36:38.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.099+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5562edbea010 con 0x5562edbdc610 2024-09-10T05:36:38.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.099+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93883383845024] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb0c00a4d0 con 0x7fdb0401ec20 2024-09-10T05:36:38.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.103+0000 7fdb124f3640 1 -- 172.21.15.62:0/49581153 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93883383831888] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb0402e070 con 0x5562edbdc610 2024-09-10T05:36:38.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.103+0000 7fdb124f3640 1 -- 172.21.15.62:0/49581153 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb0402e070 con 0x5562edbdc610 2024-09-10T05:36:38.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.103+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93883383842752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5562edbe9fd0 con 0x5562edbdc610 2024-09-10T05:36:38.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.103+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5562edbea400 con 0x5562edbdfe30 2024-09-10T05:36:38.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.103+0000 7fdb11cf2640 1 -- 172.21.15.62:0/49581153 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb080b4040 con 0x5562edbdfe30 2024-09-10T05:36:38.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.103+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93883383846080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5562edbea400 con 0x5562edbdfe30 2024-09-10T05:36:38.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.103+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5562edbeb320 con 0x5562edbdfe30 2024-09-10T05:36:38.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.103+0000 7fdb124f3640 1 -- 172.21.15.62:0/49581153 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 93883383842752] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb0402e070 con 0x5562edbdc610 2024-09-10T05:36:38.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.103+0000 7fdb11cf2640 1 -- 172.21.15.62:0/49581153 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93883383846080] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb080b4040 con 0x5562edbdfe30 2024-09-10T05:36:38.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.103+0000 7fdb11cf2640 1 -- 172.21.15.62:0/49581153 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb080b4040 con 0x5562edbdfe30 2024-09-10T05:36:38.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.103+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93883383850992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5562edbe9ae0 con 0x5562edbdfe30 2024-09-10T05:36:38.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.103+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5562edbeb900 con 0x7fdb0401ec20 2024-09-10T05:36:38.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.107+0000 7fdb11cf2640 1 -- 172.21.15.62:0/49581153 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93883383850992] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb080b4040 con 0x5562edbdfe30 2024-09-10T05:36:38.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.107+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb0c00a4d0 con 0x7fdb0401ec20 2024-09-10T05:36:38.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.107+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93883383852560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5562edbeb900 con 0x7fdb0401ec20 2024-09-10T05:36:38.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.107+0000 7fdb149ed9c0 20 add_watcher() i=0 2024-09-10T05:36:38.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.107+0000 7fdb149ed9c0 20 add_watcher() i=1 2024-09-10T05:36:38.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.107+0000 7fdb149ed9c0 20 add_watcher() i=2 2024-09-10T05:36:38.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.107+0000 7fdb149ed9c0 20 add_watcher() i=3 2024-09-10T05:36:38.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.107+0000 7fdb149ed9c0 20 add_watcher() i=4 2024-09-10T05:36:38.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.107+0000 7fdb149ed9c0 20 add_watcher() i=5 2024-09-10T05:36:38.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.107+0000 7fdb149ed9c0 20 add_watcher() i=6 2024-09-10T05:36:38.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.107+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93883383852560] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb0c00a4d0 con 0x7fdb0401ec20 2024-09-10T05:36:38.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.107+0000 7fdb149ed9c0 20 add_watcher() i=7 2024-09-10T05:36:38.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.107+0000 7fdb149ed9c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:38.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.107+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5562edbeeb90 con 0x5562edbd8140 2024-09-10T05:36:38.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.107+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdb0c00a4d0 con 0x5562edbd8140 2024-09-10T05:36:38.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.107+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93883383854528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5562edbebe90 con 0x5562edbd8140 2024-09-10T05:36:38.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.111+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93883383854528] v30'134 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdb0c00a4d0 con 0x5562edbd8140 2024-09-10T05:36:38.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.111+0000 7fd9c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:38.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.111+0000 7fdb149ed9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:38.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.111+0000 7fdb149ed9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:38.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.111+0000 7fdb149ed9c0 5 note: GC not initialized 2024-09-10T05:36:38.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.111+0000 7fd9c37fe640 20 reqs_thread_entry: start 2024-09-10T05:36:38.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.111+0000 7fdb149ed9c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:38.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.111+0000 7fdb149ed9c0 20 Filter name: none 2024-09-10T05:36:38.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.111+0000 7fd9c17fa640 20 reqs_thread_entry: start 2024-09-10T05:36:38.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.111+0000 7fdb149ed9c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-10T05:36:38.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.111+0000 7fdb149ed9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.111+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5562edc11f70 con 0x5562edbdfe30 2024-09-10T05:36:38.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.111+0000 7fdb11cf2640 1 -- 172.21.15.62:0/49581153 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7fdb080b4040 con 0x5562edbdfe30 2024-09-10T05:36:38.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.111+0000 7fdb149ed9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-10T05:36:38.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.111+0000 7fdb149ed9c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-10T05:36:38.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.111+0000 7fdb149ed9c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-10T05:36:38.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.111+0000 7fdb149ed9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:36:38.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.111+0000 7fdb149ed9c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T05:36:38.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.111+0000 7fdb149ed9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.111+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5562edc11900 con 0x7fdb0401ec20 2024-09-10T05:36:38.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.111+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fdb0c00a4d0 con 0x7fdb0401ec20 2024-09-10T05:36:38.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.111+0000 7fdb149ed9c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T05:36:38.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.111+0000 7fdb149ed9c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-10T05:36:38.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.111+0000 7fdb149ed9c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T05:36:38.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.111+0000 7fdb149ed9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 : miss 2024-09-10T05:36:38.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.111+0000 7fdb149ed9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.111+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:64 8.1f 8:fcc5c255:root::.bucket.meta.myfoo%3a475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5562edc15750 con 0x7fdb0401ec20 2024-09-10T05:36:38.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.111+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(64 .bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fdb0c00a4d0 con 0x7fdb0401ec20 2024-09-10T05:36:38.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.111+0000 7fdb149ed9c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T05:36:38.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.111+0000 7fdb149ed9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 info.flags=0x17 2024-09-10T05:36:38.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.111+0000 7fdb149ed9c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 to cache LRU end 2024-09-10T05:36:38.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.111+0000 7fdb149ed9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:36:38.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.111+0000 7fdb149ed9c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T05:36:38.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.111+0000 7fdb149ed9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 2024-09-10T05:36:38.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.111+0000 7fdb149ed9c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x13) 2024-09-10T05:36:38.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.111+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5562edc19d20 con 0x7fdb0401ec20 2024-09-10T05:36:38.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.115+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(65 foo.buckets [call] v30'24 uv24 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fdb0c00a4d0 con 0x7fdb0401ec20 2024-09-10T05:36:38.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.115+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:66 8.8 8:1226e205:root::.bucket.meta.testx%3amyfoo%3a475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1:head [create,call version.inc in=38b,writefull 0~420 in=420b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5562edc1d630 con 0x5562edbd8140 2024-09-10T05:36:38.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.115+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(66 .bucket.meta.testx:myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 [create,call,writefull 0~420,setxattr (203)] v30'3 uv3 ondisk = 0) ==== 338+0+0 (crc 0 0 0) 0x7fdb0c00a4d0 con 0x5562edbd8140 2024-09-10T05:36:38.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.115+0000 7fdb149ed9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 info.flags=0x7 2024-09-10T05:36:38.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.115+0000 7fdb149ed9c0 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 to cache LRU end 2024-09-10T05:36:38.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.115+0000 7fdb149ed9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-10T05:36:38.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.115+0000 7fdb149ed9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1, ofs0, ns] 2024-09-10T05:36:38.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.115+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify cookie 93883384050784 in=867b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5562edc1d020 con 0x5562edbdc610 2024-09-10T05:36:38.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.115+0000 7fdb124f3640 1 -- 172.21.15.62:0/49581153 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== watch-notify(notify (1) cookie 93883383842752 notify 128849018906 ret 0) ==== 897+0+0 (crc 0 0 0) 0x7fdb04048040 con 0x5562edbdc610 2024-09-10T05:36:38.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.115+0000 7fd9f5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018906 cookie 93883383842752 notifier 4542 bl.length()=855 2024-09-10T05:36:38.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.115+0000 7fd9f5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 info.flags=0x7 2024-09-10T05:36:38.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.115+0000 7fd9f5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 to cache LRU end 2024-09-10T05:36:38.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.115+0000 7fd9f5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-10T05:36:38.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.115+0000 7fd9f5ffb640 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fd9d8003eb0 con 0x5562edbdc610 2024-09-10T05:36:38.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.115+0000 7fdb124f3640 1 -- 172.21.15.62:0/49581153 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(67 notify.4 [notify cookie 93883384050784 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdb0402e070 con 0x5562edbdc610 2024-09-10T05:36:38.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.119+0000 7fdb124f3640 1 -- 172.21.15.62:0/49581153 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(68 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb0402e070 con 0x5562edbdc610 2024-09-10T05:36:38.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.119+0000 7fdb124f3640 1 -- 172.21.15.62:0/49581153 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== watch-notify(notify_complete (2) cookie 93883384050784 notify 128849018906 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5562edb9d020 con 0x5562edbdc610 2024-09-10T05:36:38.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.119+0000 7fdb149ed9c0 20 handle_bi_update(): bucket=testx:myfoo[475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1]): orig_sources= new_sources= 2024-09-10T05:36:38.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.119+0000 7fdb149ed9c0 20 handle_bi_update(): bucket=testx:myfoo[475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1]): potential sources added=[] removed=[] 2024-09-10T05:36:38.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.119+0000 7fdb149ed9c0 20 handle_bi_update(): bucket=testx:myfoo[475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1]): orig_dests= new_dests= 2024-09-10T05:36:38.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.119+0000 7fdb149ed9c0 20 handle_bi_update(): bucket=testx:myfoo[475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1]): potential dests added=[] removed=[] 2024-09-10T05:36:38.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.119+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:69 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5562edc1d180 con 0x5562edbd8140 2024-09-10T05:36:38.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.119+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(69 testx$tenanteduser.buckets [call] v30'1 uv1 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7fdb0c00a4d0 con 0x5562edbd8140 2024-09-10T05:36:38.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.119+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:70 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5562edc1d180 con 0x5562edbd8140 2024-09-10T05:36:38.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.123+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(70 testx/myfoo [delete,create,call,writefull 0~193] v30'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7fdb0c00a4d0 con 0x5562edbd8140 2024-09-10T05:36:38.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.123+0000 7fdb149ed9c0 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-10T05:36:38.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.123+0000 7fdb149ed9c0 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-10T05:36:38.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.123+0000 7fdb149ed9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-10T05:36:38.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.123+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify cookie 93883384057040 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5562edc1d0f0 con 0x5562edbdc610 2024-09-10T05:36:38.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.123+0000 7fdb124f3640 1 -- 172.21.15.62:0/49581153 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== watch-notify(notify (1) cookie 93883383842752 notify 128849018907 ret 0) ==== 390+0+0 (crc 0 0 0) 0x5562edb9d020 con 0x5562edbdc610 2024-09-10T05:36:38.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.123+0000 7fd9f57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018907 cookie 93883383842752 notifier 4542 bl.length()=348 2024-09-10T05:36:38.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.123+0000 7fd9f57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-10T05:36:38.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.123+0000 7fd9f57fa640 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-10T05:36:38.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.123+0000 7fd9f57fa640 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fd93c003410 con 0x5562edbdc610 2024-09-10T05:36:38.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.123+0000 7fdb124f3640 1 -- 172.21.15.62:0/49581153 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(71 notify.4 [notify cookie 93883384057040 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdb0402e070 con 0x5562edbdc610 2024-09-10T05:36:38.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.123+0000 7fdb124f3640 1 -- 172.21.15.62:0/49581153 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(72 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb0402e070 con 0x5562edbdc610 2024-09-10T05:36:38.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.123+0000 7fdb124f3640 1 -- 172.21.15.62:0/49581153 <== osd.0 v2:172.21.15.2:6800/945139080 25 ==== watch-notify(notify_complete (2) cookie 93883384057040 notify 128849018907 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5562edb9c670 con 0x5562edbdc610 2024-09-10T05:36:38.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.123+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:73 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5562edc1d180 con 0x7fdb0401ec20 2024-09-10T05:36:38.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.127+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 <== osd.2 v2:172.21.15.62:6800/2677868286 15 ==== osd_op_reply(73 myfoo [call,delete] v30'25 uv25 ondisk = 0) ==== 191+0+0 (crc 0 0 0) 0x7fdb0c00a4d0 con 0x7fdb0401ec20 2024-09-10T05:36:38.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.127+0000 7fdb149ed9c0 10 removing default.rgw.meta+root+myfoo from cache 2024-09-10T05:36:38.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.127+0000 7fdb149ed9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-10T05:36:38.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.127+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93883384057040 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5562edc1d0f0 con 0x5562edbdfe30 2024-09-10T05:36:38.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.127+0000 7fdb11cf2640 1 -- 172.21.15.62:0/49581153 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== watch-notify(notify (1) cookie 93883383850992 notify 128849018891 ret 0) ==== 191+0+0 (crc 0 0 0) 0x7fdb080e5040 con 0x5562edbdfe30 2024-09-10T05:36:38.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.127+0000 7fd9f5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018891 cookie 93883383850992 notifier 4542 bl.length()=149 2024-09-10T05:36:38.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.127+0000 7fd9f5ffb640 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:75 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fd9d8003eb0 con 0x5562edbdfe30 2024-09-10T05:36:38.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.127+0000 7fdb11cf2640 1 -- 172.21.15.62:0/49581153 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== osd_op_reply(74 notify.6 [notify cookie 93883384057040 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdb080b4040 con 0x5562edbdfe30 2024-09-10T05:36:38.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.127+0000 7fdb11cf2640 1 -- 172.21.15.62:0/49581153 <== osd.3 v2:172.21.15.62:6816/2708991149 19 ==== osd_op_reply(75 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb080b4040 con 0x5562edbdfe30 2024-09-10T05:36:38.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.127+0000 7fdb11cf2640 1 -- 172.21.15.62:0/49581153 <== osd.3 v2:172.21.15.62:6816/2708991149 20 ==== watch-notify(notify_complete (2) cookie 93883384057040 notify 128849018891 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5562ed951ca0 con 0x5562edbdfe30 2024-09-10T05:36:38.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.127+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:76 8.1f 8:fcc5c255:root::.bucket.meta.myfoo%3a475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5562edc1d140 con 0x7fdb0401ec20 2024-09-10T05:36:38.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.127+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 <== osd.2 v2:172.21.15.62:6800/2677868286 16 ==== osd_op_reply(76 .bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 [call,delete] v30'4 uv4 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fdb0c00a4d0 con 0x7fdb0401ec20 2024-09-10T05:36:38.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.127+0000 7fdb149ed9c0 10 removing default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 from cache 2024-09-10T05:36:38.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.127+0000 7fdb149ed9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1, ofs0, ns] 2024-09-10T05:36:38.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.127+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:77 7.3 7:c609908c:::notify.5:head [notify cookie 93883384028624 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5562edc1d140 con 0x5562edbdfe30 2024-09-10T05:36:38.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.131+0000 7fdb11cf2640 1 -- 172.21.15.62:0/49581153 <== osd.3 v2:172.21.15.62:6816/2708991149 21 ==== watch-notify(notify (1) cookie 93883383846080 notify 128849018892 ret 0) ==== 248+0+0 (crc 0 0 0) 0x5562ed951ca0 con 0x5562edbdfe30 2024-09-10T05:36:38.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.131+0000 7fd9f57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018892 cookie 93883383846080 notifier 4542 bl.length()=206 2024-09-10T05:36:38.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.131+0000 7fd9f57fa640 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fd93c003410 con 0x5562edbdfe30 2024-09-10T05:36:38.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.131+0000 7fdb11cf2640 1 -- 172.21.15.62:0/49581153 <== osd.3 v2:172.21.15.62:6816/2708991149 22 ==== osd_op_reply(77 notify.5 [notify cookie 93883384028624 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdb080b4040 con 0x5562edbdfe30 2024-09-10T05:36:38.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.131+0000 7fdb11cf2640 1 -- 172.21.15.62:0/49581153 <== osd.3 v2:172.21.15.62:6816/2708991149 23 ==== osd_op_reply(78 notify.5 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb080b4040 con 0x5562edbdfe30 2024-09-10T05:36:38.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.131+0000 7fdb11cf2640 1 -- 172.21.15.62:0/49581153 <== osd.3 v2:172.21.15.62:6816/2708991149 24 ==== watch-notify(notify_complete (2) cookie 93883384028624 notify 128849018892 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fdb080b7a60 con 0x5562edbdfe30 2024-09-10T05:36:38.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.131+0000 7fd9c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:38.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.131+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93883383854528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5562edc0fc60 con 0x5562edbd8140 2024-09-10T05:36:38.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.131+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 93883383854528] v30'135 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdb0c00a4d0 con 0x5562edbd8140 2024-09-10T05:36:38.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.131+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93883383834448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5562edc0fc60 con 0x5562edbdc610 2024-09-10T05:36:38.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.135+0000 7fdb124f3640 1 -- 172.21.15.62:0/49581153 <== osd.0 v2:172.21.15.2:6800/945139080 26 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 93883383834448] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb0402e070 con 0x5562edbdc610 2024-09-10T05:36:38.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.135+0000 7fdb149ed9c0 20 remove_watcher() i=0 2024-09-10T05:36:38.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.135+0000 7fdb149ed9c0 2 removed watcher, disabling cache 2024-09-10T05:36:38.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.135+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93883383837952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5562edc0fc60 con 0x5562edbd8140 2024-09-10T05:36:38.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.135+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 <== osd.1 v2:172.21.15.62:6808/3442097179 23 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 93883383837952] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb0c00a4d0 con 0x5562edbd8140 2024-09-10T05:36:38.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.135+0000 7fdb149ed9c0 20 remove_watcher() i=1 2024-09-10T05:36:38.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.135+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93883383831888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5562edc0fc60 con 0x5562edbdc610 2024-09-10T05:36:38.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.139+0000 7fdb124f3640 1 -- 172.21.15.62:0/49581153 <== osd.0 v2:172.21.15.2:6800/945139080 27 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 93883383831888] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb0402e070 con 0x5562edbdc610 2024-09-10T05:36:38.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.139+0000 7fdb149ed9c0 20 remove_watcher() i=2 2024-09-10T05:36:38.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.139+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93883383845024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5562edc0fc60 con 0x7fdb0401ec20 2024-09-10T05:36:38.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.139+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 <== osd.2 v2:172.21.15.62:6800/2677868286 17 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 93883383845024] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb0c00a4d0 con 0x7fdb0401ec20 2024-09-10T05:36:38.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.139+0000 7fdb149ed9c0 20 remove_watcher() i=3 2024-09-10T05:36:38.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.139+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93883383842752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5562edc0fc60 con 0x5562edbdc610 2024-09-10T05:36:38.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.143+0000 7fdb124f3640 1 -- 172.21.15.62:0/49581153 <== osd.0 v2:172.21.15.2:6800/945139080 28 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 93883383842752] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb0402e070 con 0x5562edbdc610 2024-09-10T05:36:38.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.143+0000 7fdb149ed9c0 20 remove_watcher() i=4 2024-09-10T05:36:38.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.143+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93883383846080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5562edc0fc60 con 0x5562edbdfe30 2024-09-10T05:36:38.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.143+0000 7fdb11cf2640 1 -- 172.21.15.62:0/49581153 <== osd.3 v2:172.21.15.62:6816/2708991149 25 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 93883383846080] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb080b4040 con 0x5562edbdfe30 2024-09-10T05:36:38.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.143+0000 7fdb149ed9c0 20 remove_watcher() i=5 2024-09-10T05:36:38.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.143+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93883383850992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5562edc0fc60 con 0x5562edbdfe30 2024-09-10T05:36:38.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.143+0000 7fdb11cf2640 1 -- 172.21.15.62:0/49581153 <== osd.3 v2:172.21.15.62:6816/2708991149 26 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 93883383850992] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb080b4040 con 0x5562edbdfe30 2024-09-10T05:36:38.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.143+0000 7fdb149ed9c0 20 remove_watcher() i=6 2024-09-10T05:36:38.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.143+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93883383852560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5562edc0fc60 con 0x7fdb0401ec20 2024-09-10T05:36:38.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.147+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 <== osd.2 v2:172.21.15.62:6800/2677868286 18 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 93883383852560] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb0c00a4d0 con 0x7fdb0401ec20 2024-09-10T05:36:38.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.147+0000 7fdb149ed9c0 20 remove_watcher() i=7 2024-09-10T05:36:38.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.147+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5562edbdc610 msgr2=0x5562edbdea00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.147+0000 7fdb149ed9c0 1 --2- 172.21.15.62:0/49581153 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5562edbdc610 0x5562edbdea00 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.147+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5562edbd8140 msgr2=0x5562edbda5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.147+0000 7fdb149ed9c0 1 --2- 172.21.15.62:0/49581153 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5562edbd8140 0x5562edbda5d0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.147+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fdb0401ec20 msgr2=0x7fdb04004950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.147+0000 7fdb149ed9c0 1 --2- 172.21.15.62:0/49581153 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fdb0401ec20 0x7fdb04004950 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.147+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5562edbdfe30 msgr2=0x5562edbe2240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.147+0000 7fdb149ed9c0 1 --2- 172.21.15.62:0/49581153 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5562edbdfe30 0x5562edbe2240 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.147+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fd9dc039a70 msgr2=0x7fd9dc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.147+0000 7fdb149ed9c0 1 --2- 172.21.15.62:0/49581153 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fd9dc039a70 0x7fd9dc03bf30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdb080af040 tx=0x7fdb080a8000 comp rx=0 tx=0).stop 2024-09-10T05:36:38.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.147+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562edbc5ec0 msgr2=0x5562edbcd200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.147+0000 7fdb12cf4640 1 -- 172.21.15.62:0/49581153 reap_dead start 2024-09-10T05:36:38.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.147+0000 7fdb149ed9c0 1 --2- 172.21.15.62:0/49581153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562edbc5ec0 0x5562edbcd200 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fdb0401bd70 tx=0x7fdb0401e7a0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.147+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 shutdown_connections 2024-09-10T05:36:38.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.147+0000 7fdb149ed9c0 1 --2- 172.21.15.62:0/49581153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562edbc5ec0 0x5562edbcd200 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.147+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 >> 172.21.15.62:0/49581153 conn(0x5562edbc22f0 msgr2=0x5562edbc0500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:38.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.147+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 shutdown_connections 2024-09-10T05:36:38.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.147+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/49581153 wait complete. 2024-09-10T05:36:38.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.147+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/2377236573 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fd9ec039a70 msgr2=0x7fd9ec03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.147+0000 7fdb149ed9c0 1 --2- 172.21.15.62:0/2377236573 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fd9ec039a70 0x7fd9ec03bf30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x5562edb9dfe0 tx=0x7fdb08005ad0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.147+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/2377236573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562edbb9af0 msgr2=0x5562edbb9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.147+0000 7fdb149ed9c0 1 --2- 172.21.15.62:0/2377236573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562edbb9af0 0x5562edbb9f10 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fdb04048210 tx=0x7fdb0400ff90 comp rx=0 tx=0).stop 2024-09-10T05:36:38.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.147+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/2377236573 shutdown_connections 2024-09-10T05:36:38.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.147+0000 7fdb149ed9c0 1 --2- 172.21.15.62:0/2377236573 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fd9ec039a70 0x7fd9ec03bf30 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.147+0000 7fdb149ed9c0 1 --2- 172.21.15.62:0/2377236573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562edbb9af0 0x5562edbb9f10 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.147+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/2377236573 >> 172.21.15.62:0/2377236573 conn(0x5562edbaf4a0 msgr2=0x5562edbaf880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:38.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.147+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/2377236573 shutdown_connections 2024-09-10T05:36:38.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.147+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/2377236573 wait complete. 2024-09-10T05:36:38.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.147+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/2853094593 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5562edba3fe0 msgr2=0x5562edba64a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.147+0000 7fdb149ed9c0 1 --2- 172.21.15.62:0/2853094593 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5562edba3fe0 0x5562edba64a0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.147+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/2853094593 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5562edaad2d0 msgr2=0x5562edba2ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.147+0000 7fdb149ed9c0 1 --2- 172.21.15.62:0/2853094593 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5562edaad2d0 0x5562edba2ff0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.147+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/2853094593 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5562edba89d0 msgr2=0x5562edbaadc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.147+0000 7fdb149ed9c0 1 --2- 172.21.15.62:0/2853094593 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5562edba89d0 0x5562edbaadc0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.147+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/2853094593 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fd9f8039ac0 msgr2=0x7fd9f803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.147+0000 7fdb149ed9c0 1 --2- 172.21.15.62:0/2853094593 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fd9f8039ac0 0x7fd9f803bf80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdb080ae000 tx=0x7fdb080a6000 comp rx=0 tx=0).stop 2024-09-10T05:36:38.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.147+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/2853094593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562eda1d180 msgr2=0x5562edb9be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.147+0000 7fdb149ed9c0 1 --2- 172.21.15.62:0/2853094593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562eda1d180 0x5562edb9be80 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x5562edb95760 tx=0x7fdb04000bd0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.147+0000 7fdb12cf4640 1 -- 172.21.15.62:0/2853094593 reap_dead start 2024-09-10T05:36:38.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.147+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/2853094593 shutdown_connections 2024-09-10T05:36:38.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.147+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/2853094593 >> 172.21.15.62:0/2853094593 conn(0x5562edaa38a0 msgr2=0x5562edb8eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:38.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.147+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/2853094593 shutdown_connections 2024-09-10T05:36:38.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.147+0000 7fdb149ed9c0 1 -- 172.21.15.62:0/2853094593 wait complete. 2024-09-10T05:36:38.163 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2024-09-10T05:36:38.163 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2024-09-10T05:36:38.163 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2024-09-10T05:36:38.235 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:38.235 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:38.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.231+0000 7fc93a4219c0 1 Processor -- start 2024-09-10T05:36:38.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.231+0000 7fc93a4219c0 1 -- start start 2024-09-10T05:36:38.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.231+0000 7fc93a4219c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55a5f12b3240 0x55a5f1343ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.231+0000 7fc93a4219c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a5f11f39c0 con 0x55a5f12b3620 2024-09-10T05:36:38.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.231+0000 7fc93a4219c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x55a5f12436d0 con 0x55a5f12b3240 2024-09-10T05:36:38.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.235+0000 7fc937f27640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55a5f12b3240 0x55a5f1343ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.235+0000 7fc937f27640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55a5f12b3240 0x55a5f1343ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47714/0 (socket says 172.21.15.62:47714) 2024-09-10T05:36:38.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.235+0000 7fc937726640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x55a5f12b3620 0x55a5f1346540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:53118/0 (socket says 172.21.15.62:53118) 2024-09-10T05:36:38.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.235+0000 7fc937f27640 1 -- 172.21.15.62:0/3988273465 learned_addr learned my addr 172.21.15.62:0/3988273465 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:38.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.235+0000 7fc937f27640 1 -- 172.21.15.62:0/3988273465 >> v1:172.21.15.2:6789/0 conn(0x55a5f12b3620 legacy=0x55a5f1346540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.235+0000 7fc937f27640 1 -- 172.21.15.62:0/3988273465 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5f11e7ca0 con 0x55a5f12b3240 2024-09-10T05:36:38.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.235+0000 7fc937f27640 1 --2- 172.21.15.62:0/3988273465 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5f12b3240 0x55a5f1343ff0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fc93000a4e0 tx=0x7fc93001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1ba8809b38ae254 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.235+0000 7fc936f25640 1 -- 172.21.15.62:0/3988273465 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9300aa540 con 0x55a5f12b3240 2024-09-10T05:36:38.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.235+0000 7fc936f25640 1 -- 172.21.15.62:0/3988273465 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9300aa6e0 con 0x55a5f12b3240 2024-09-10T05:36:38.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.235+0000 7fc936f25640 1 -- 172.21.15.62:0/3988273465 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9300aaa40 con 0x55a5f12b3240 2024-09-10T05:36:38.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.239+0000 7fc93a4219c0 1 -- 172.21.15.62:0/3988273465 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5f12b3240 msgr2=0x55a5f1343ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.239+0000 7fc93a4219c0 1 --2- 172.21.15.62:0/3988273465 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5f12b3240 0x55a5f1343ff0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fc93000a4e0 tx=0x7fc93001b090 comp rx=0 tx=0).stop 2024-09-10T05:36:38.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.239+0000 7fc93a4219c0 1 -- 172.21.15.62:0/3988273465 shutdown_connections 2024-09-10T05:36:38.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.239+0000 7fc93a4219c0 1 --2- 172.21.15.62:0/3988273465 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5f12b3240 0x55a5f1343ff0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.239+0000 7fc93a4219c0 1 -- 172.21.15.62:0/3988273465 >> 172.21.15.62:0/3988273465 conn(0x55a5f1339920 msgr2=0x55a5f133bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:38.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.239+0000 7fc93a4219c0 1 -- 172.21.15.62:0/3988273465 shutdown_connections 2024-09-10T05:36:38.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.239+0000 7fc93a4219c0 1 -- 172.21.15.62:0/3988273465 wait complete. 2024-09-10T05:36:38.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.251+0000 7fc93a4219c0 1 Processor -- start 2024-09-10T05:36:38.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.251+0000 7fc93a4219c0 1 -- start start 2024-09-10T05:36:38.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.255+0000 7fc93a4219c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5f12b3240 0x55a5f142c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.255+0000 7fc93a4219c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a5f1247680 con 0x55a5f12b3240 2024-09-10T05:36:38.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.255+0000 7fc937f27640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5f12b3240 0x55a5f142c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.255+0000 7fc937f27640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5f12b3240 0x55a5f142c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47726/0 (socket says 172.21.15.62:47726) 2024-09-10T05:36:38.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.255+0000 7fc937f27640 1 -- 172.21.15.62:0/2151462907 learned_addr learned my addr 172.21.15.62:0/2151462907 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:38.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.255+0000 7fc937f27640 1 -- 172.21.15.62:0/2151462907 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5f11c2da0 con 0x55a5f12b3240 2024-09-10T05:36:38.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.255+0000 7fc937f27640 1 --2- 172.21.15.62:0/2151462907 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5f12b3240 0x55a5f142c910 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fc930018cc0 tx=0x7fc9300033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff5040745e321733 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.255+0000 7fc825e0b640 1 -- 172.21.15.62:0/2151462907 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9300b9070 con 0x55a5f12b3240 2024-09-10T05:36:38.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.255+0000 7fc825e0b640 1 -- 172.21.15.62:0/2151462907 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9300aaa80 con 0x55a5f12b3240 2024-09-10T05:36:38.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.255+0000 7fc825e0b640 1 -- 172.21.15.62:0/2151462907 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9300aad60 con 0x55a5f12b3240 2024-09-10T05:36:38.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.255+0000 7fc93a4219c0 1 -- 172.21.15.62:0/2151462907 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5f12b3240 msgr2=0x55a5f142c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.255+0000 7fc93a4219c0 1 --2- 172.21.15.62:0/2151462907 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5f12b3240 0x55a5f142c910 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fc930018cc0 tx=0x7fc9300033b0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.255+0000 7fc93a4219c0 1 -- 172.21.15.62:0/2151462907 shutdown_connections 2024-09-10T05:36:38.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.255+0000 7fc93a4219c0 1 --2- 172.21.15.62:0/2151462907 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5f12b3240 0x55a5f142c910 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.255+0000 7fc93a4219c0 1 -- 172.21.15.62:0/2151462907 >> 172.21.15.62:0/2151462907 conn(0x55a5f1339920 msgr2=0x55a5f1428560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:38.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.255+0000 7fc93a4219c0 1 -- 172.21.15.62:0/2151462907 shutdown_connections 2024-09-10T05:36:38.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.255+0000 7fc93a4219c0 1 -- 172.21.15.62:0/2151462907 wait complete. 2024-09-10T05:36:38.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.255+0000 7fc93a4219c0 1 Processor -- start 2024-09-10T05:36:38.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.255+0000 7fc93a4219c0 1 -- start start 2024-09-10T05:36:38.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.255+0000 7fc93a4219c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5f12b3240 0x55a5f1433e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.255+0000 7fc93a4219c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a5f11e9a50 con 0x55a5f12b3240 2024-09-10T05:36:38.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.255+0000 7fc937f27640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5f12b3240 0x55a5f1433e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.255+0000 7fc937f27640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5f12b3240 0x55a5f1433e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47728/0 (socket says 172.21.15.62:47728) 2024-09-10T05:36:38.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.255+0000 7fc937f27640 1 -- 172.21.15.62:0/3271019529 learned_addr learned my addr 172.21.15.62:0/3271019529 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:38.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.259+0000 7fc937f27640 1 -- 172.21.15.62:0/3271019529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5f1434390 con 0x55a5f12b3240 2024-09-10T05:36:38.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.259+0000 7fc937f27640 1 --2- 172.21.15.62:0/3271019529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5f12b3240 0x55a5f1433e30 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fc930018cc0 tx=0x7fc930017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.259+0000 7fc81ffff640 1 -- 172.21.15.62:0/3271019529 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9300b9070 con 0x55a5f12b3240 2024-09-10T05:36:38.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.259+0000 7fc81ffff640 1 -- 172.21.15.62:0/3271019529 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9300b5b10 con 0x55a5f12b3240 2024-09-10T05:36:38.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.259+0000 7fc93a4219c0 1 -- 172.21.15.62:0/3271019529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a5f1434620 con 0x55a5f12b3240 2024-09-10T05:36:38.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.259+0000 7fc81ffff640 1 -- 172.21.15.62:0/3271019529 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9300b5df0 con 0x55a5f12b3240 2024-09-10T05:36:38.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.259+0000 7fc93a4219c0 1 -- 172.21.15.62:0/3271019529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5f1434fd0 con 0x55a5f12b3240 2024-09-10T05:36:38.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.259+0000 7fc81ffff640 1 -- 172.21.15.62:0/3271019529 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc9300b3040 con 0x55a5f12b3240 2024-09-10T05:36:38.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.259+0000 7fc81ffff640 1 --2- 172.21.15.62:0/3271019529 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc820039a70 0x7fc82003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.259+0000 7fc81ffff640 1 -- 172.21.15.62:0/3271019529 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc9300c4070 con 0x55a5f12b3240 2024-09-10T05:36:38.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.259+0000 7fc937726640 1 --2- 172.21.15.62:0/3271019529 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc820039a70 0x7fc82003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.259+0000 7fc93a4219c0 1 --2- 172.21.15.62:0/3271019529 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55a5f12b3620 0x55a5f143afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.259+0000 7fc93a4219c0 1 -- 172.21.15.62:0/3271019529 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a5f143b4e0 con 0x55a5f12b3620 2024-09-10T05:36:38.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.259+0000 7fc938728640 1 --2- 172.21.15.62:0/3271019529 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55a5f12b3620 0x55a5f143afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.259+0000 7fc937726640 1 --2- 172.21.15.62:0/3271019529 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc820039a70 0x7fc82003bf30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc92c001e90 tx=0x7fc92c0013f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.259+0000 7fc938728640 1 --2- 172.21.15.62:0/3271019529 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55a5f12b3620 0x55a5f143afa0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.259+0000 7fc938728640 1 -- 172.21.15.62:0/3271019529 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9280083f0 con 0x55a5f12b3620 2024-09-10T05:36:38.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.259+0000 7fc93a4219c0 1 --2- 172.21.15.62:0/3271019529 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55a5f143bfb0 0x55a5f143e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.259+0000 7fc93a4219c0 1 -- 172.21.15.62:0/3271019529 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a5f143ebe0 con 0x55a5f143bfb0 2024-09-10T05:36:38.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.259+0000 7fc937f27640 1 --2- 172.21.15.62:0/3271019529 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55a5f143bfb0 0x55a5f143e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.263+0000 7fc937f27640 1 --2- 172.21.15.62:0/3271019529 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55a5f143bfb0 0x55a5f143e470 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.263+0000 7fc937f27640 1 -- 172.21.15.62:0/3271019529 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc9300cd060 con 0x55a5f143bfb0 2024-09-10T05:36:38.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.263+0000 7fc93a4219c0 1 --2- 172.21.15.62:0/3271019529 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55a5f14409a0 0x55a5f1442d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.263+0000 7fc93a4219c0 1 -- 172.21.15.62:0/3271019529 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a5f1443480 con 0x55a5f14409a0 2024-09-10T05:36:38.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.263+0000 7fc937726640 1 --2- 172.21.15.62:0/3271019529 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55a5f14409a0 0x55a5f1442d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.263+0000 7fc937726640 1 --2- 172.21.15.62:0/3271019529 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55a5f14409a0 0x55a5f1442d90 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.263+0000 7fc937726640 1 -- 172.21.15.62:0/3271019529 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc92c00f6e0 con 0x55a5f14409a0 2024-09-10T05:36:38.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.263+0000 7fc93a4219c0 1 -- 172.21.15.62:0/3271019529 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a5f143f840 con 0x55a5f143bfb0 2024-09-10T05:36:38.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.263+0000 7fc937f27640 1 -- 172.21.15.62:0/3271019529 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc9300cd060 con 0x55a5f143bfb0 2024-09-10T05:36:38.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.263+0000 7fc93a4219c0 1 -- 172.21.15.62:0/3271019529 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a5f143fc60 con 0x55a5f14409a0 2024-09-10T05:36:38.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.263+0000 7fc937726640 1 -- 172.21.15.62:0/3271019529 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc92c00f6e0 con 0x55a5f14409a0 2024-09-10T05:36:38.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.263+0000 7fc93a4219c0 1 Processor -- start 2024-09-10T05:36:38.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.263+0000 7fc93a4219c0 1 -- start start 2024-09-10T05:36:38.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.263+0000 7fc93a4219c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5f1451b30 0x55a5f1451f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.267+0000 7fc93a4219c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a5f1254450 con 0x55a5f1451b30 2024-09-10T05:36:38.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.267+0000 7fc937f27640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5f1451b30 0x55a5f1451f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.267+0000 7fc937f27640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5f1451b30 0x55a5f1451f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47734/0 (socket says 172.21.15.62:47734) 2024-09-10T05:36:38.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.267+0000 7fc937f27640 1 -- 172.21.15.62:0/1837206616 learned_addr learned my addr 172.21.15.62:0/1837206616 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:38.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.267+0000 7fc937f27640 1 -- 172.21.15.62:0/1837206616 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5f1452590 con 0x55a5f1451b30 2024-09-10T05:36:38.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.267+0000 7fc937f27640 1 --2- 172.21.15.62:0/1837206616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5f1451b30 0x55a5f1451f50 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fc9300e9050 tx=0x7fc9300c6df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.267+0000 7fc81d7fa640 1 -- 172.21.15.62:0/1837206616 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9300a95d0 con 0x55a5f1451b30 2024-09-10T05:36:38.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.267+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1837206616 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a5f1452df0 con 0x55a5f1451b30 2024-09-10T05:36:38.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.267+0000 7fc81d7fa640 1 -- 172.21.15.62:0/1837206616 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9300a9770 con 0x55a5f1451b30 2024-09-10T05:36:38.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.267+0000 7fc81d7fa640 1 -- 172.21.15.62:0/1837206616 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9300e1ec0 con 0x55a5f1451b30 2024-09-10T05:36:38.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.267+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1837206616 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5f1453360 con 0x55a5f1451b30 2024-09-10T05:36:38.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.267+0000 7fc81d7fa640 1 -- 172.21.15.62:0/1837206616 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc9300e2060 con 0x55a5f1451b30 2024-09-10T05:36:38.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.267+0000 7fc81d7fa640 1 --2- 172.21.15.62:0/1837206616 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc810039a70 0x7fc81003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.267+0000 7fc81d7fa640 1 -- 172.21.15.62:0/1837206616 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc9300077c0 con 0x55a5f1451b30 2024-09-10T05:36:38.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.267+0000 7fc937726640 1 --2- 172.21.15.62:0/1837206616 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc810039a70 0x7fc81003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.267+0000 7fc93a4219c0 1 Processor -- start 2024-09-10T05:36:38.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.267+0000 7fc93a4219c0 1 -- start start 2024-09-10T05:36:38.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.267+0000 7fc93a4219c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5f145e290 0x55a5f145e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.267+0000 7fc937726640 1 --2- 172.21.15.62:0/1837206616 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc810039a70 0x7fc81003bf30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x55a5f143fbe0 tx=0x7fc92c00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.267+0000 7fc93a4219c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a5f142d0a0 con 0x55a5f145e290 2024-09-10T05:36:38.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.271+0000 7fc937f27640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5f145e290 0x55a5f145e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.271+0000 7fc937f27640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5f145e290 0x55a5f145e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47740/0 (socket says 172.21.15.62:47740) 2024-09-10T05:36:38.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.271+0000 7fc937f27640 1 -- 172.21.15.62:0/3671913887 learned_addr learned my addr 172.21.15.62:0/3671913887 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:38.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.271+0000 7fc937f27640 1 -- 172.21.15.62:0/3671913887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5f145ec40 con 0x55a5f145e290 2024-09-10T05:36:38.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.271+0000 7fc937f27640 1 --2- 172.21.15.62:0/3671913887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5f145e290 0x55a5f145e670 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fc9300dbd80 tx=0x7fc9300dba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=240b6e5f44c92cbb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.271+0000 7fc816ffd640 1 -- 172.21.15.62:0/3671913887 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9300ef040 con 0x55a5f145e290 2024-09-10T05:36:38.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.271+0000 7fc816ffd640 1 -- 172.21.15.62:0/3671913887 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9300ab560 con 0x55a5f145e290 2024-09-10T05:36:38.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.271+0000 7fc816ffd640 1 -- 172.21.15.62:0/3671913887 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9300db450 con 0x55a5f145e290 2024-09-10T05:36:38.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.271+0000 7fc93a4219c0 1 -- 172.21.15.62:0/3671913887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5f145e290 msgr2=0x55a5f145e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.271+0000 7fc93a4219c0 1 --2- 172.21.15.62:0/3671913887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5f145e290 0x55a5f145e670 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fc9300dbd80 tx=0x7fc9300dba50 comp rx=0 tx=0).stop 2024-09-10T05:36:38.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.271+0000 7fc93a4219c0 1 -- 172.21.15.62:0/3671913887 shutdown_connections 2024-09-10T05:36:38.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.271+0000 7fc93a4219c0 1 --2- 172.21.15.62:0/3671913887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5f145e290 0x55a5f145e670 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.271+0000 7fc93a4219c0 1 -- 172.21.15.62:0/3671913887 >> 172.21.15.62:0/3671913887 conn(0x55a5f145a6c0 msgr2=0x55a5f1458900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:38.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.271+0000 7fc93a4219c0 1 -- 172.21.15.62:0/3671913887 shutdown_connections 2024-09-10T05:36:38.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.271+0000 7fc93a4219c0 1 -- 172.21.15.62:0/3671913887 wait complete. 2024-09-10T05:36:38.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.271+0000 7fc93a4219c0 1 Processor -- start 2024-09-10T05:36:38.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.271+0000 7fc93a4219c0 1 -- start start 2024-09-10T05:36:38.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.271+0000 7fc93a4219c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5f145e290 0x55a5f1465510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.271+0000 7fc93a4219c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a5f145f120 con 0x55a5f145e290 2024-09-10T05:36:38.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.271+0000 7fc937f27640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5f145e290 0x55a5f1465510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.271+0000 7fc937f27640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5f145e290 0x55a5f1465510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47754/0 (socket says 172.21.15.62:47754) 2024-09-10T05:36:38.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.271+0000 7fc937f27640 1 -- 172.21.15.62:0/1571808776 learned_addr learned my addr 172.21.15.62:0/1571808776 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:38.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.271+0000 7fc937f27640 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5f1465a70 con 0x55a5f145e290 2024-09-10T05:36:38.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.275+0000 7fc937f27640 1 --2- 172.21.15.62:0/1571808776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5f145e290 0x55a5f1465510 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc9300ac010 tx=0x7fc930007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.275+0000 7fc8157fa640 1 -- 172.21.15.62:0/1571808776 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc93010e020 con 0x55a5f145e290 2024-09-10T05:36:38.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.275+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a5f1465a70 con 0x55a5f145e290 2024-09-10T05:36:38.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.275+0000 7fc8157fa640 1 -- 172.21.15.62:0/1571808776 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9300db450 con 0x55a5f145e290 2024-09-10T05:36:38.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.275+0000 7fc8157fa640 1 -- 172.21.15.62:0/1571808776 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc930104040 con 0x55a5f145e290 2024-09-10T05:36:38.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.275+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5f1465a70 con 0x55a5f145e290 2024-09-10T05:36:38.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.275+0000 7fc8157fa640 1 -- 172.21.15.62:0/1571808776 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc930111020 con 0x55a5f145e290 2024-09-10T05:36:38.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.275+0000 7fc8157fa640 1 --2- 172.21.15.62:0/1571808776 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc800039a70 0x7fc80003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.275+0000 7fc8157fa640 1 -- 172.21.15.62:0/1571808776 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc9300fb070 con 0x55a5f145e290 2024-09-10T05:36:38.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.275+0000 7fc937726640 1 --2- 172.21.15.62:0/1571808776 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc800039a70 0x7fc80003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.275+0000 7fc93a4219c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.275+0000 7fc93a4219c0 1 --2- 172.21.15.62:0/1571808776 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55a5f1470480 0x55a5f1472940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.275+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a5f1473090 con 0x55a5f1470480 2024-09-10T05:36:38.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.275+0000 7fc938728640 1 --2- 172.21.15.62:0/1571808776 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55a5f1470480 0x55a5f1472940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.275+0000 7fc937726640 1 --2- 172.21.15.62:0/1571808776 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc800039a70 0x7fc80003bf30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x55a5f143f810 tx=0x7fc92c010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.275+0000 7fc938728640 1 --2- 172.21.15.62:0/1571808776 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55a5f1470480 0x55a5f1472940 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.275+0000 7fc938728640 1 -- 172.21.15.62:0/1571808776 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9280083f0 con 0x55a5f1470480 2024-09-10T05:36:38.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.275+0000 7fc93a4219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:38.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.275+0000 7fc93a4219c0 20 realm 2024-09-10T05:36:38.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.275+0000 7fc93a4219c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.275+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a5f146f800 con 0x55a5f1470480 2024-09-10T05:36:38.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.275+0000 7fc938728640 1 -- 172.21.15.62:0/1571808776 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9280083f0 con 0x55a5f1470480 2024-09-10T05:36:38.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.275+0000 7fc93a4219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:38.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.275+0000 7fc93a4219c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:38.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.275+0000 7fc93a4219c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.275+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a5f1473b50 con 0x55a5f1470480 2024-09-10T05:36:38.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.275+0000 7fc938728640 1 -- 172.21.15.62:0/1571808776 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9280083f0 con 0x55a5f1470480 2024-09-10T05:36:38.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.275+0000 7fc93a4219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:38.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.275+0000 7fc93a4219c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.279+0000 7fc93a4219c0 1 --2- 172.21.15.62:0/1571808776 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55a5f1474930 0x55a5f1476d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.279+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a5f14773b0 con 0x55a5f1474930 2024-09-10T05:36:38.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.279+0000 7fc937f27640 1 --2- 172.21.15.62:0/1571808776 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55a5f1474930 0x55a5f1476d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.279+0000 7fc937f27640 1 --2- 172.21.15.62:0/1571808776 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55a5f1474930 0x55a5f1476d20 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.279+0000 7fc937f27640 1 -- 172.21.15.62:0/1571808776 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc930107040 con 0x55a5f1474930 2024-09-10T05:36:38.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.279+0000 7fc93a4219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:38.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.279+0000 7fc93a4219c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.279+0000 7fc93a4219c0 1 --2- 172.21.15.62:0/1571808776 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55a5f1478160 0x55a5f147a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.279+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a5f147abf0 con 0x55a5f1478160 2024-09-10T05:36:38.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.279+0000 7fc937726640 1 --2- 172.21.15.62:0/1571808776 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55a5f1478160 0x55a5f147a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.279+0000 7fc937726640 1 --2- 172.21.15.62:0/1571808776 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55a5f1478160 0x55a5f147a550 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.279+0000 7fc937726640 1 -- 172.21.15.62:0/1571808776 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc92c00f6e0 con 0x55a5f1478160 2024-09-10T05:36:38.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.279+0000 7fc93a4219c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:38.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.279+0000 7fc93a4219c0 20 searching for the correct realm 2024-09-10T05:36:38.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.279+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a5f147c4e0 con 0x55a5f1478160 2024-09-10T05:36:38.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.279+0000 7fc937726640 1 -- 172.21.15.62:0/1571808776 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc92c00f6e0 con 0x55a5f1478160 2024-09-10T05:36:38.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.279+0000 7fc937726640 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a5f147c4e0 con 0x55a5f1474930 2024-09-10T05:36:38.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.279+0000 7fc937f27640 1 -- 172.21.15.62:0/1571808776 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc930107040 con 0x55a5f1474930 2024-09-10T05:36:38.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.279+0000 7fc937f27640 1 --2- 172.21.15.62:0/1571808776 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fc930113020 0x7fc9300e1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.279+0000 7fc937f27640 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a5f147c4e0 con 0x7fc930113020 2024-09-10T05:36:38.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.283+0000 7fc938728640 1 --2- 172.21.15.62:0/1571808776 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fc930113020 0x7fc9300e1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.283+0000 7fc938728640 1 --2- 172.21.15.62:0/1571808776 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fc930113020 0x7fc9300e1710 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.283+0000 7fc938728640 1 -- 172.21.15.62:0/1571808776 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9280083f0 con 0x7fc930113020 2024-09-10T05:36:38.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.283+0000 7fc938728640 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a5f147c4e0 con 0x55a5f1470480 2024-09-10T05:36:38.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.283+0000 7fc938728640 1 -- 172.21.15.62:0/1571808776 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9280083f0 con 0x55a5f1470480 2024-09-10T05:36:38.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.283+0000 7fc938728640 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a5f147c4e0 con 0x55a5f1470480 2024-09-10T05:36:38.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.283+0000 7fc938728640 1 -- 172.21.15.62:0/1571808776 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9280083f0 con 0x55a5f1470480 2024-09-10T05:36:38.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.283+0000 7fc938728640 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a5f147c4e0 con 0x55a5f1478160 2024-09-10T05:36:38.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.283+0000 7fc937726640 1 -- 172.21.15.62:0/1571808776 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc92c00f6e0 con 0x55a5f1478160 2024-09-10T05:36:38.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.283+0000 7fc937726640 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a5f147c4e0 con 0x55a5f1470480 2024-09-10T05:36:38.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.283+0000 7fc938728640 1 -- 172.21.15.62:0/1571808776 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9280083f0 con 0x55a5f1470480 2024-09-10T05:36:38.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.283+0000 7fc938728640 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a5f147c4e0 con 0x55a5f1474930 2024-09-10T05:36:38.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.283+0000 7fc937f27640 1 -- 172.21.15.62:0/1571808776 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc930107040 con 0x55a5f1474930 2024-09-10T05:36:38.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.283+0000 7fc937f27640 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a5f147c4e0 con 0x55a5f1474930 2024-09-10T05:36:38.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.283+0000 7fc937f27640 1 -- 172.21.15.62:0/1571808776 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc930107040 con 0x55a5f1474930 2024-09-10T05:36:38.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.283+0000 7fc937f27640 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a5f147c4e0 con 0x55a5f1470480 2024-09-10T05:36:38.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.283+0000 7fc938728640 1 -- 172.21.15.62:0/1571808776 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9280083f0 con 0x55a5f1470480 2024-09-10T05:36:38.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.283+0000 7fc938728640 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a5f147c4e0 con 0x7fc930113020 2024-09-10T05:36:38.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.283+0000 7fc938728640 1 -- 172.21.15.62:0/1571808776 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9280083f0 con 0x7fc930113020 2024-09-10T05:36:38.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.283+0000 7fc938728640 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a5f147c4e0 con 0x55a5f1470480 2024-09-10T05:36:38.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.287+0000 7fc938728640 1 -- 172.21.15.62:0/1571808776 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9280083f0 con 0x55a5f1470480 2024-09-10T05:36:38.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.287+0000 7fc938728640 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a5f147c4e0 con 0x7fc930113020 2024-09-10T05:36:38.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.287+0000 7fc938728640 1 -- 172.21.15.62:0/1571808776 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc9280083f0 con 0x7fc930113020 2024-09-10T05:36:38.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.287+0000 7fc938728640 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a5f147c4e0 con 0x55a5f1474930 2024-09-10T05:36:38.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.287+0000 7fc937f27640 1 -- 172.21.15.62:0/1571808776 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc930107040 con 0x55a5f1474930 2024-09-10T05:36:38.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.287+0000 7fc937f27640 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a5f147c4e0 con 0x55a5f1478160 2024-09-10T05:36:38.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.287+0000 7fc937726640 1 -- 172.21.15.62:0/1571808776 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc92c00f6e0 con 0x55a5f1478160 2024-09-10T05:36:38.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.287+0000 7fc937726640 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a5f147c4e0 con 0x55a5f1470480 2024-09-10T05:36:38.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.287+0000 7fc938728640 1 -- 172.21.15.62:0/1571808776 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9280083f0 con 0x55a5f1470480 2024-09-10T05:36:38.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.287+0000 7fc938728640 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a5f147c4e0 con 0x55a5f1474930 2024-09-10T05:36:38.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.287+0000 7fc937f27640 1 -- 172.21.15.62:0/1571808776 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc930107040 con 0x55a5f1474930 2024-09-10T05:36:38.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.287+0000 7fc937f27640 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a5f147c4e0 con 0x55a5f1478160 2024-09-10T05:36:38.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.287+0000 7fc937726640 1 -- 172.21.15.62:0/1571808776 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 30 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7fc92c00f6e0 con 0x55a5f1478160 2024-09-10T05:36:38.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.287+0000 7fc937726640 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a5f147c4e0 con 0x55a5f1470480 2024-09-10T05:36:38.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.287+0000 7fc938728640 1 -- 172.21.15.62:0/1571808776 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9280083f0 con 0x55a5f1470480 2024-09-10T05:36:38.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.287+0000 7fc938728640 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a5f147c4e0 con 0x55a5f1470480 2024-09-10T05:36:38.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.287+0000 7fc938728640 1 -- 172.21.15.62:0/1571808776 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc9280083f0 con 0x55a5f1470480 2024-09-10T05:36:38.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.287+0000 7fc938728640 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a5f147c4e0 con 0x55a5f1470480 2024-09-10T05:36:38.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.287+0000 7fc938728640 1 -- 172.21.15.62:0/1571808776 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9280083f0 con 0x55a5f1470480 2024-09-10T05:36:38.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.287+0000 7fc938728640 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a5f147c4e0 con 0x55a5f1478160 2024-09-10T05:36:38.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.291+0000 7fc937726640 1 -- 172.21.15.62:0/1571808776 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc92c00f6e0 con 0x55a5f1478160 2024-09-10T05:36:38.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.291+0000 7fc937726640 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a5f147c4e0 con 0x7fc930113020 2024-09-10T05:36:38.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.291+0000 7fc938728640 1 -- 172.21.15.62:0/1571808776 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9280083f0 con 0x7fc930113020 2024-09-10T05:36:38.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.291+0000 7fc938728640 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a5f147c4e0 con 0x55a5f1470480 2024-09-10T05:36:38.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.291+0000 7fc938728640 1 -- 172.21.15.62:0/1571808776 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9280083f0 con 0x55a5f1470480 2024-09-10T05:36:38.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.291+0000 7fc938728640 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a5f147c4e0 con 0x7fc930113020 2024-09-10T05:36:38.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.291+0000 7fc938728640 1 -- 172.21.15.62:0/1571808776 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9280083f0 con 0x7fc930113020 2024-09-10T05:36:38.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.291+0000 7fc938728640 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a5f147c4e0 con 0x55a5f1478160 2024-09-10T05:36:38.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.291+0000 7fc937726640 1 -- 172.21.15.62:0/1571808776 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc92c00f6e0 con 0x55a5f1478160 2024-09-10T05:36:38.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.291+0000 7fc937726640 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a5f147c4e0 con 0x7fc930113020 2024-09-10T05:36:38.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.291+0000 7fc938728640 1 -- 172.21.15.62:0/1571808776 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9280083f0 con 0x7fc930113020 2024-09-10T05:36:38.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.291+0000 7fc938728640 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a5f147c4e0 con 0x55a5f1474930 2024-09-10T05:36:38.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.291+0000 7fc937f27640 1 -- 172.21.15.62:0/1571808776 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc930107040 con 0x55a5f1474930 2024-09-10T05:36:38.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.291+0000 7fc937f27640 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a5f147c4e0 con 0x55a5f1474930 2024-09-10T05:36:38.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.291+0000 7fc937f27640 1 -- 172.21.15.62:0/1571808776 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc930107040 con 0x55a5f1474930 2024-09-10T05:36:38.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.291+0000 7fc937f27640 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a5f147c4e0 con 0x55a5f1478160 2024-09-10T05:36:38.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.291+0000 7fc937726640 1 -- 172.21.15.62:0/1571808776 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc92c00f6e0 con 0x55a5f1478160 2024-09-10T05:36:38.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.291+0000 7fc937726640 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a5f147c4e0 con 0x55a5f1474930 2024-09-10T05:36:38.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.295+0000 7fc937f27640 1 -- 172.21.15.62:0/1571808776 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc930107040 con 0x55a5f1474930 2024-09-10T05:36:38.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.295+0000 7fc937f27640 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a5f147c4e0 con 0x55a5f1474930 2024-09-10T05:36:38.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.295+0000 7fc937f27640 1 -- 172.21.15.62:0/1571808776 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc930107040 con 0x55a5f1474930 2024-09-10T05:36:38.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.295+0000 7fc93a4219c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:38.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.295+0000 7fc93a4219c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:38.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.295+0000 7fc93a4219c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:38.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.295+0000 7fc93a4219c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:38.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.295+0000 7fc93a4219c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:38.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.295+0000 7fc93a4219c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:38.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.295+0000 7fc93a4219c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.295+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a5f147b5b0 con 0x55a5f1470480 2024-09-10T05:36:38.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.295+0000 7fc938728640 1 -- 172.21.15.62:0/1571808776 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9280083f0 con 0x55a5f1470480 2024-09-10T05:36:38.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.295+0000 7fc93a4219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:38.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.295+0000 7fc93a4219c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.295+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a5f147ba00 con 0x55a5f1474930 2024-09-10T05:36:38.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.295+0000 7fc937f27640 1 -- 172.21.15.62:0/1571808776 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc930107040 con 0x55a5f1474930 2024-09-10T05:36:38.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.295+0000 7fc93a4219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:38.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.295+0000 7fc93a4219c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.295+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a5f147be20 con 0x55a5f1478160 2024-09-10T05:36:38.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.295+0000 7fc937726640 1 -- 172.21.15.62:0/1571808776 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc92c00f6e0 con 0x55a5f1478160 2024-09-10T05:36:38.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.295+0000 7fc93a4219c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:38.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.295+0000 7fc93a4219c0 20 zone default found 2024-09-10T05:36:38.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.295+0000 7fc93a4219c0 4 Realm: () 2024-09-10T05:36:38.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.295+0000 7fc93a4219c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:38.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.295+0000 7fc93a4219c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:38.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.295+0000 7fc93a4219c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:38.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.295+0000 7fc93a4219c0 20 zonegroup default 2024-09-10T05:36:38.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.295+0000 7fc93a4219c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.295+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a5f147c9b0 con 0x7fc930113020 2024-09-10T05:36:38.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.295+0000 7fc938728640 1 -- 172.21.15.62:0/1571808776 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc9280083f0 con 0x7fc930113020 2024-09-10T05:36:38.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.295+0000 7fc93a4219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:38.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.295+0000 7fc93a4219c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.295+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a5f147e870 con 0x55a5f1478160 2024-09-10T05:36:38.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.295+0000 7fc937726640 1 -- 172.21.15.62:0/1571808776 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc92c00f6e0 con 0x55a5f1478160 2024-09-10T05:36:38.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.295+0000 7fc93a4219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:38.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.295+0000 7fc93a4219c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.295+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a5f147ecb0 con 0x55a5f1478160 2024-09-10T05:36:38.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.295+0000 7fc937726640 1 -- 172.21.15.62:0/1571808776 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc92c00f6e0 con 0x55a5f1478160 2024-09-10T05:36:38.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.295+0000 7fc93a4219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:38.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.295+0000 7fc93a4219c0 20 started sync module instance, tier type = 2024-09-10T05:36:38.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.295+0000 7fc93a4219c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:38.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.295+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a5f147dbe0 con 0x55a5f1474930 2024-09-10T05:36:38.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.299+0000 7fc937f27640 1 -- 172.21.15.62:0/1571808776 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc930107040 con 0x55a5f1474930 2024-09-10T05:36:38.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.299+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94171205984512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a5f147dbe0 con 0x55a5f1474930 2024-09-10T05:36:38.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.299+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a5f147f7a0 con 0x55a5f1470480 2024-09-10T05:36:38.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.299+0000 7fc938728640 1 -- 172.21.15.62:0/1571808776 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9280083f0 con 0x55a5f1470480 2024-09-10T05:36:38.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.299+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94171205988992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a5f1480040 con 0x55a5f1470480 2024-09-10T05:36:38.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.299+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a5f1480a60 con 0x55a5f1474930 2024-09-10T05:36:38.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.299+0000 7fc937f27640 1 -- 172.21.15.62:0/1571808776 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94171205984512] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc930107040 con 0x55a5f1474930 2024-09-10T05:36:38.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.299+0000 7fc938728640 1 -- 172.21.15.62:0/1571808776 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94171205988992] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9280083f0 con 0x55a5f1470480 2024-09-10T05:36:38.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.303+0000 7fc937f27640 1 -- 172.21.15.62:0/1571808776 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc930107040 con 0x55a5f1474930 2024-09-10T05:36:38.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.303+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94171205993808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a5f147fb90 con 0x55a5f1474930 2024-09-10T05:36:38.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.303+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a5f1481300 con 0x7fc930113020 2024-09-10T05:36:38.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.303+0000 7fc938728640 1 -- 172.21.15.62:0/1571808776 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9280083f0 con 0x7fc930113020 2024-09-10T05:36:38.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.303+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94171205996112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a5f147fb90 con 0x7fc930113020 2024-09-10T05:36:38.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.303+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a5f1481d80 con 0x55a5f1474930 2024-09-10T05:36:38.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.303+0000 7fc938728640 1 -- 172.21.15.62:0/1571808776 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94171205996112] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9280083f0 con 0x7fc930113020 2024-09-10T05:36:38.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.303+0000 7fc937f27640 1 -- 172.21.15.62:0/1571808776 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94171205993808] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc930107040 con 0x55a5f1474930 2024-09-10T05:36:38.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.307+0000 7fc937f27640 1 -- 172.21.15.62:0/1571808776 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc930107040 con 0x55a5f1474930 2024-09-10T05:36:38.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.307+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94171205982000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a5f1481890 con 0x55a5f1474930 2024-09-10T05:36:38.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.307+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a5f1482650 con 0x55a5f1478160 2024-09-10T05:36:38.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.307+0000 7fc937726640 1 -- 172.21.15.62:0/1571808776 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc92c00f6e0 con 0x55a5f1478160 2024-09-10T05:36:38.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.307+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94171206001056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a5f1481890 con 0x55a5f1478160 2024-09-10T05:36:38.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.307+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a5f1483090 con 0x55a5f1478160 2024-09-10T05:36:38.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.307+0000 7fc937f27640 1 -- 172.21.15.62:0/1571808776 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94171205982000] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc930107040 con 0x55a5f1474930 2024-09-10T05:36:38.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.307+0000 7fc937726640 1 -- 172.21.15.62:0/1571808776 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94171206001056] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc92c00f6e0 con 0x55a5f1478160 2024-09-10T05:36:38.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.307+0000 7fc937726640 1 -- 172.21.15.62:0/1571808776 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc92c00f6e0 con 0x55a5f1478160 2024-09-10T05:36:38.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.307+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94171206002112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a5f1482be0 con 0x55a5f1478160 2024-09-10T05:36:38.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.307+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a5f14835a0 con 0x7fc930113020 2024-09-10T05:36:38.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.311+0000 7fc937726640 1 -- 172.21.15.62:0/1571808776 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94171206002112] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc92c00f6e0 con 0x55a5f1478160 2024-09-10T05:36:38.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.311+0000 7fc938728640 1 -- 172.21.15.62:0/1571808776 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9280083f0 con 0x7fc930113020 2024-09-10T05:36:38.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.311+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94171205997168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a5f14835a0 con 0x7fc930113020 2024-09-10T05:36:38.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.311+0000 7fc93a4219c0 20 add_watcher() i=0 2024-09-10T05:36:38.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.311+0000 7fc93a4219c0 20 add_watcher() i=1 2024-09-10T05:36:38.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.311+0000 7fc93a4219c0 20 add_watcher() i=2 2024-09-10T05:36:38.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.311+0000 7fc93a4219c0 20 add_watcher() i=3 2024-09-10T05:36:38.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.311+0000 7fc93a4219c0 20 add_watcher() i=4 2024-09-10T05:36:38.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.311+0000 7fc93a4219c0 20 add_watcher() i=5 2024-09-10T05:36:38.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.311+0000 7fc93a4219c0 20 add_watcher() i=6 2024-09-10T05:36:38.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.311+0000 7fc938728640 1 -- 172.21.15.62:0/1571808776 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94171205997168] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9280083f0 con 0x7fc930113020 2024-09-10T05:36:38.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.311+0000 7fc93a4219c0 20 add_watcher() i=7 2024-09-10T05:36:38.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.311+0000 7fc93a4219c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:38.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.311+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a5f1486900 con 0x55a5f1470480 2024-09-10T05:36:38.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.311+0000 7fc938728640 1 -- 172.21.15.62:0/1571808776 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc9280083f0 con 0x55a5f1470480 2024-09-10T05:36:38.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.311+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94171206005344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a5f1483b30 con 0x55a5f1470480 2024-09-10T05:36:38.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.315+0000 7fc938728640 1 -- 172.21.15.62:0/1571808776 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94171206005344] v30'136 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc9280083f0 con 0x55a5f1470480 2024-09-10T05:36:38.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.315+0000 7fc7edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:38.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.315+0000 7fc93a4219c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:38.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.315+0000 7fc93a4219c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:38.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.315+0000 7fc93a4219c0 5 note: GC not initialized 2024-09-10T05:36:38.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.315+0000 7fc7ecfe1640 20 reqs_thread_entry: start 2024-09-10T05:36:38.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.315+0000 7fc93a4219c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:38.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.315+0000 7fc93a4219c0 20 Filter name: none 2024-09-10T05:36:38.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.315+0000 7fc7667fc640 20 reqs_thread_entry: start 2024-09-10T05:36:38.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.315+0000 7fc93a4219c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.315+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:62 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a5f14a96d0 con 0x55a5f1470480 2024-09-10T05:36:38.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.315+0000 7fc938728640 1 -- 172.21.15.62:0/1571808776 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(62 testx/myfoo [call out=48b,stat out=16b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 281+0+332 (crc 0 0 0) 0x7fc9280083f0 con 0x55a5f1470480 2024-09-10T05:36:38.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.315+0000 7fc93a4219c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-10T05:36:38.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.315+0000 7fc7edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:38.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.315+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94171206005344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a5f146a540 con 0x55a5f1470480 2024-09-10T05:36:38.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.319+0000 7fc938728640 1 -- 172.21.15.62:0/1571808776 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94171206005344] v30'137 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc9280083f0 con 0x55a5f1470480 2024-09-10T05:36:38.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.319+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94171205984512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a5f14a7660 con 0x55a5f1474930 2024-09-10T05:36:38.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.319+0000 7fc937f27640 1 -- 172.21.15.62:0/1571808776 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94171205984512] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc930107040 con 0x55a5f1474930 2024-09-10T05:36:38.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.319+0000 7fc93a4219c0 20 remove_watcher() i=0 2024-09-10T05:36:38.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.319+0000 7fc93a4219c0 2 removed watcher, disabling cache 2024-09-10T05:36:38.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.319+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94171205988992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a5f14a7660 con 0x55a5f1470480 2024-09-10T05:36:38.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.323+0000 7fc938728640 1 -- 172.21.15.62:0/1571808776 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94171205988992] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9280083f0 con 0x55a5f1470480 2024-09-10T05:36:38.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.323+0000 7fc93a4219c0 20 remove_watcher() i=1 2024-09-10T05:36:38.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.323+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94171205993808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a5f14a7660 con 0x55a5f1474930 2024-09-10T05:36:38.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.323+0000 7fc937f27640 1 -- 172.21.15.62:0/1571808776 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94171205993808] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc930107040 con 0x55a5f1474930 2024-09-10T05:36:38.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.323+0000 7fc93a4219c0 20 remove_watcher() i=2 2024-09-10T05:36:38.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.323+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94171205996112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a5f14a7660 con 0x7fc930113020 2024-09-10T05:36:38.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.323+0000 7fc938728640 1 -- 172.21.15.62:0/1571808776 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94171205996112] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9280083f0 con 0x7fc930113020 2024-09-10T05:36:38.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.323+0000 7fc93a4219c0 20 remove_watcher() i=3 2024-09-10T05:36:38.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.323+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94171205982000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a5f14a7660 con 0x55a5f1474930 2024-09-10T05:36:38.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.327+0000 7fc937f27640 1 -- 172.21.15.62:0/1571808776 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94171205982000] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc930107040 con 0x55a5f1474930 2024-09-10T05:36:38.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.327+0000 7fc93a4219c0 20 remove_watcher() i=4 2024-09-10T05:36:38.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.327+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94171206001056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a5f14a7660 con 0x55a5f1478160 2024-09-10T05:36:38.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.327+0000 7fc937726640 1 -- 172.21.15.62:0/1571808776 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94171206001056] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc92c00f6e0 con 0x55a5f1478160 2024-09-10T05:36:38.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.327+0000 7fc93a4219c0 20 remove_watcher() i=5 2024-09-10T05:36:38.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.327+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94171206002112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a5f14a7660 con 0x55a5f1478160 2024-09-10T05:36:38.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.331+0000 7fc937726640 1 -- 172.21.15.62:0/1571808776 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94171206002112] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc92c00f6e0 con 0x55a5f1478160 2024-09-10T05:36:38.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.331+0000 7fc93a4219c0 20 remove_watcher() i=6 2024-09-10T05:36:38.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.331+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1571808776 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94171205997168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a5f14a7660 con 0x7fc930113020 2024-09-10T05:36:38.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.331+0000 7fc938728640 1 -- 172.21.15.62:0/1571808776 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94171205997168] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9280083f0 con 0x7fc930113020 2024-09-10T05:36:38.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.331+0000 7fc93a4219c0 20 remove_watcher() i=7 2024-09-10T05:36:38.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.331+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1571808776 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55a5f1474930 msgr2=0x55a5f1476d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.331+0000 7fc93a4219c0 1 --2- 172.21.15.62:0/1571808776 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55a5f1474930 0x55a5f1476d20 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.331+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1571808776 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55a5f1470480 msgr2=0x55a5f1472940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.331+0000 7fc93a4219c0 1 --2- 172.21.15.62:0/1571808776 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55a5f1470480 0x55a5f1472940 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.331+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1571808776 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fc930113020 msgr2=0x7fc9300e1710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.331+0000 7fc93a4219c0 1 --2- 172.21.15.62:0/1571808776 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fc930113020 0x7fc9300e1710 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.331+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1571808776 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55a5f1478160 msgr2=0x55a5f147a550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.331+0000 7fc93a4219c0 1 --2- 172.21.15.62:0/1571808776 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55a5f1478160 0x55a5f147a550 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.331+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1571808776 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc800039a70 msgr2=0x7fc80003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.331+0000 7fc93a4219c0 1 --2- 172.21.15.62:0/1571808776 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc800039a70 0x7fc80003bf30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x55a5f143f810 tx=0x7fc92c010000 comp rx=0 tx=0).stop 2024-09-10T05:36:38.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.331+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1571808776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5f145e290 msgr2=0x55a5f1465510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.331+0000 7fc93a4219c0 1 --2- 172.21.15.62:0/1571808776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5f145e290 0x55a5f1465510 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc9300ac010 tx=0x7fc930007430 comp rx=0 tx=0).stop 2024-09-10T05:36:38.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.331+0000 7fc938728640 1 -- 172.21.15.62:0/1571808776 reap_dead start 2024-09-10T05:36:38.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.331+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1571808776 shutdown_connections 2024-09-10T05:36:38.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.331+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1571808776 >> 172.21.15.62:0/1571808776 conn(0x55a5f145a6c0 msgr2=0x55a5f14588d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:38.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.331+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1571808776 shutdown_connections 2024-09-10T05:36:38.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.331+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1571808776 wait complete. 2024-09-10T05:36:38.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.331+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1837206616 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc810039a70 msgr2=0x7fc81003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.331+0000 7fc93a4219c0 1 --2- 172.21.15.62:0/1837206616 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc810039a70 0x7fc81003bf30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x55a5f143fbe0 tx=0x7fc92c00f000 comp rx=0 tx=0).stop 2024-09-10T05:36:38.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.331+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1837206616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5f1451b30 msgr2=0x55a5f1451f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.331+0000 7fc93a4219c0 1 --2- 172.21.15.62:0/1837206616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5f1451b30 0x55a5f1451f50 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fc9300e9050 tx=0x7fc9300c6df0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.331+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1837206616 shutdown_connections 2024-09-10T05:36:38.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.331+0000 7fc93a4219c0 1 --2- 172.21.15.62:0/1837206616 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc810039a70 0x7fc81003bf30 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.331+0000 7fc93a4219c0 1 --2- 172.21.15.62:0/1837206616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5f1451b30 0x55a5f1451f50 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.331+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1837206616 >> 172.21.15.62:0/1837206616 conn(0x55a5f14474e0 msgr2=0x55a5f14478c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:38.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.331+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1837206616 shutdown_connections 2024-09-10T05:36:38.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.331+0000 7fc93a4219c0 1 -- 172.21.15.62:0/1837206616 wait complete. 2024-09-10T05:36:38.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.331+0000 7fc93a4219c0 1 -- 172.21.15.62:0/3271019529 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55a5f143bfb0 msgr2=0x55a5f143e470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.331+0000 7fc93a4219c0 1 --2- 172.21.15.62:0/3271019529 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55a5f143bfb0 0x55a5f143e470 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.331+0000 7fc93a4219c0 1 -- 172.21.15.62:0/3271019529 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55a5f12b3620 msgr2=0x55a5f143afa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.331+0000 7fc93a4219c0 1 --2- 172.21.15.62:0/3271019529 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55a5f12b3620 0x55a5f143afa0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.331+0000 7fc93a4219c0 1 -- 172.21.15.62:0/3271019529 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55a5f14409a0 msgr2=0x55a5f1442d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.331+0000 7fc93a4219c0 1 --2- 172.21.15.62:0/3271019529 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55a5f14409a0 0x55a5f1442d90 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.331+0000 7fc93a4219c0 1 -- 172.21.15.62:0/3271019529 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc820039a70 msgr2=0x7fc82003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.331+0000 7fc93a4219c0 1 --2- 172.21.15.62:0/3271019529 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc820039a70 0x7fc82003bf30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc92c001e90 tx=0x7fc92c0013f0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.331+0000 7fc93a4219c0 1 -- 172.21.15.62:0/3271019529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5f12b3240 msgr2=0x55a5f1433e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.331+0000 7fc93a4219c0 1 --2- 172.21.15.62:0/3271019529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5f12b3240 0x55a5f1433e30 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fc930018cc0 tx=0x7fc930017e30 comp rx=0 tx=0).stop 2024-09-10T05:36:38.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.331+0000 7fc938728640 1 -- 172.21.15.62:0/3271019529 reap_dead start 2024-09-10T05:36:38.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.331+0000 7fc93a4219c0 1 -- 172.21.15.62:0/3271019529 shutdown_connections 2024-09-10T05:36:38.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.331+0000 7fc93a4219c0 1 -- 172.21.15.62:0/3271019529 >> 172.21.15.62:0/3271019529 conn(0x55a5f1339920 msgr2=0x55a5f1426ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:38.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.331+0000 7fc93a4219c0 1 -- 172.21.15.62:0/3271019529 shutdown_connections 2024-09-10T05:36:38.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.331+0000 7fc93a4219c0 1 -- 172.21.15.62:0/3271019529 wait complete. 2024-09-10T05:36:38.347 INFO:teuthology.orchestra.run.smithi062.stdout:{"key":"bucket:testx/myfoo","ver":{"tag":"QhobIqaI5eff0RUU11QGblQS","ver":2},"mtime":"2024-09-10T05:36:38.124231Z","data":{"bucket":{"name":"myfoo","marker":"475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1","bucket_id":"475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1","tenant":"testx","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"testx$tenanteduser","creation_time":"2024-09-10T05:36:34.646920Z","linked":true,"has_bucket_info":false}} 2024-09-10T05:36:38.347 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': 'QhobIqaI5eff0RUU11QGblQS', 'ver': 2}, 'mtime': '2024-09-10T05:36:38.124231Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1', 'bucket_id': '475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2024-09-10T05:36:34.646920Z', 'linked': True, 'has_bucket_info': False}} 2024-09-10T05:36:38.347 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-10T05:36:38.347 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-10T05:36:38.348 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2024-09-10T05:36:38.434 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:38.434 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:38.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.431+0000 7f1e606c29c0 1 Processor -- start 2024-09-10T05:36:38.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.431+0000 7f1e606c29c0 1 -- start start 2024-09-10T05:36:38.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.431+0000 7f1e606c29c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5589efeb6340 0x5589efeb8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.431+0000 7f1e606c29c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5589efd669c0 con 0x5589efe261f0 2024-09-10T05:36:38.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.431+0000 7f1e606c29c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x5589efdb66d0 con 0x5589efeb6340 2024-09-10T05:36:38.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.431+0000 7f1e5d9c7640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5589efeb6340 0x5589efeb8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.431+0000 7f1e5e1c8640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x5589efe261f0 0x5589efeb4c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:53128/0 (socket says 172.21.15.62:53128) 2024-09-10T05:36:38.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.431+0000 7f1e5e1c8640 1 -- 172.21.15.62:0/2243148328 learned_addr learned my addr 172.21.15.62:0/2243148328 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-10T05:36:38.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.431+0000 7f1e5d9c7640 1 -- 172.21.15.62:0/2243148328 >> v1:172.21.15.2:6789/0 conn(0x5589efe261f0 legacy=0x5589efeb4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.431+0000 7f1e5d9c7640 1 -- 172.21.15.62:0/2243148328 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589efd5aca0 con 0x5589efeb6340 2024-09-10T05:36:38.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.435+0000 7f1e5d9c7640 1 --2- 172.21.15.62:0/2243148328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5589efeb6340 0x5589efeb8730 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f1e4800a420 tx=0x7f1e4801afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32513cba9d8fb452 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.435+0000 7f1e5d1c6640 1 -- 172.21.15.62:0/2243148328 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e480b0070 con 0x5589efeb6340 2024-09-10T05:36:38.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.435+0000 7f1e5d1c6640 1 -- 172.21.15.62:0/2243148328 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e480a3dc0 con 0x5589efeb6340 2024-09-10T05:36:38.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.435+0000 7f1e5d1c6640 1 -- 172.21.15.62:0/2243148328 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e480ab570 con 0x5589efeb6340 2024-09-10T05:36:38.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.435+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2243148328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5589efeb6340 msgr2=0x5589efeb8730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.435+0000 7f1e606c29c0 1 --2- 172.21.15.62:0/2243148328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5589efeb6340 0x5589efeb8730 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f1e4800a420 tx=0x7f1e4801afd0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.435+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2243148328 shutdown_connections 2024-09-10T05:36:38.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.435+0000 7f1e606c29c0 1 --2- 172.21.15.62:0/2243148328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5589efeb6340 0x5589efeb8730 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.435+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2243148328 >> 172.21.15.62:0/2243148328 conn(0x5589efeac910 msgr2=0x5589efeaed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:38.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.435+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2243148328 shutdown_connections 2024-09-10T05:36:38.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.435+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2243148328 wait complete. 2024-09-10T05:36:38.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.451+0000 7f1e606c29c0 1 Processor -- start 2024-09-10T05:36:38.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.451+0000 7f1e606c29c0 1 -- start start 2024-09-10T05:36:38.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.451+0000 7f1e606c29c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5589efe261f0 0x5589eff9d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.451+0000 7f1e606c29c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5589efdba680 con 0x5589efe261f0 2024-09-10T05:36:38.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.451+0000 7f1e5e1c8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5589efe261f0 0x5589eff9d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.451+0000 7f1e5e1c8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5589efe261f0 0x5589eff9d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47776/0 (socket says 172.21.15.62:47776) 2024-09-10T05:36:38.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.451+0000 7f1e5e1c8640 1 -- 172.21.15.62:0/3813093959 learned_addr learned my addr 172.21.15.62:0/3813093959 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:38.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.451+0000 7f1e5e1c8640 1 -- 172.21.15.62:0/3813093959 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589efd35da0 con 0x5589efe261f0 2024-09-10T05:36:38.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.451+0000 7f1e5e1c8640 1 --2- 172.21.15.62:0/3813093959 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5589efe261f0 0x5589eff9d7f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f1e50001e50 tx=0x7f1e50001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd79f95a2fdf39cd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.451+0000 7f1d4c608640 1 -- 172.21.15.62:0/3813093959 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e50012020 con 0x5589efe261f0 2024-09-10T05:36:38.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.455+0000 7f1d4c608640 1 -- 172.21.15.62:0/3813093959 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e5000e7c0 con 0x5589efe261f0 2024-09-10T05:36:38.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.455+0000 7f1d4c608640 1 -- 172.21.15.62:0/3813093959 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e5000eaa0 con 0x5589efe261f0 2024-09-10T05:36:38.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.455+0000 7f1e606c29c0 1 -- 172.21.15.62:0/3813093959 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5589efe261f0 msgr2=0x5589eff9d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.455+0000 7f1e606c29c0 1 --2- 172.21.15.62:0/3813093959 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5589efe261f0 0x5589eff9d7f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f1e50001e50 tx=0x7f1e50001e80 comp rx=0 tx=0).stop 2024-09-10T05:36:38.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.455+0000 7f1e606c29c0 1 -- 172.21.15.62:0/3813093959 shutdown_connections 2024-09-10T05:36:38.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.455+0000 7f1e606c29c0 1 --2- 172.21.15.62:0/3813093959 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5589efe261f0 0x5589eff9d7f0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.455+0000 7f1e606c29c0 1 -- 172.21.15.62:0/3813093959 >> 172.21.15.62:0/3813093959 conn(0x5589efeac910 msgr2=0x5589eff99430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:38.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.455+0000 7f1e606c29c0 1 -- 172.21.15.62:0/3813093959 shutdown_connections 2024-09-10T05:36:38.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.455+0000 7f1e606c29c0 1 -- 172.21.15.62:0/3813093959 wait complete. 2024-09-10T05:36:38.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.455+0000 7f1e606c29c0 1 Processor -- start 2024-09-10T05:36:38.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.455+0000 7f1e606c29c0 1 -- start start 2024-09-10T05:36:38.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.455+0000 7f1e606c29c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5589efe261f0 0x5589effa4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.455+0000 7f1e606c29c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5589efd5ca50 con 0x5589efe261f0 2024-09-10T05:36:38.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.455+0000 7f1e5e1c8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5589efe261f0 0x5589effa4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.455+0000 7f1e5e1c8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5589efe261f0 0x5589effa4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47790/0 (socket says 172.21.15.62:47790) 2024-09-10T05:36:38.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.455+0000 7f1e5e1c8640 1 -- 172.21.15.62:0/3065980732 learned_addr learned my addr 172.21.15.62:0/3065980732 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:38.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.455+0000 7f1e5e1c8640 1 -- 172.21.15.62:0/3065980732 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589effa5420 con 0x5589efe261f0 2024-09-10T05:36:38.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.455+0000 7f1e5e1c8640 1 --2- 172.21.15.62:0/3065980732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5589efe261f0 0x5589effa4ec0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x5589eff9e780 tx=0x7f1e50000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.455+0000 7f1d4ae05640 1 -- 172.21.15.62:0/3065980732 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e50012030 con 0x5589efe261f0 2024-09-10T05:36:38.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.455+0000 7f1d4ae05640 1 -- 172.21.15.62:0/3065980732 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e5001a680 con 0x5589efe261f0 2024-09-10T05:36:38.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.455+0000 7f1e606c29c0 1 -- 172.21.15.62:0/3065980732 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5589effa56b0 con 0x5589efe261f0 2024-09-10T05:36:38.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.455+0000 7f1d4ae05640 1 -- 172.21.15.62:0/3065980732 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e5001a980 con 0x5589efe261f0 2024-09-10T05:36:38.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.455+0000 7f1e606c29c0 1 -- 172.21.15.62:0/3065980732 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589effa6060 con 0x5589efe261f0 2024-09-10T05:36:38.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.459+0000 7f1d4ae05640 1 -- 172.21.15.62:0/3065980732 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1e50015020 con 0x5589efe261f0 2024-09-10T05:36:38.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.459+0000 7f1d4ae05640 1 --2- 172.21.15.62:0/3065980732 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1d44039a70 0x7f1d4403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.459+0000 7f1d4ae05640 1 -- 172.21.15.62:0/3065980732 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f1e50020070 con 0x5589efe261f0 2024-09-10T05:36:38.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.459+0000 7f1e5d9c7640 1 --2- 172.21.15.62:0/3065980732 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1d44039a70 0x7f1d4403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.459+0000 7f1e606c29c0 1 --2- 172.21.15.62:0/3065980732 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5589efeb6340 0x5589effac030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.459+0000 7f1e606c29c0 1 -- 172.21.15.62:0/3065980732 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5589effac570 con 0x5589efeb6340 2024-09-10T05:36:38.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.459+0000 7f1e5e9c9640 1 --2- 172.21.15.62:0/3065980732 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5589efeb6340 0x5589effac030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.459+0000 7f1e5d9c7640 1 --2- 172.21.15.62:0/3065980732 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1d44039a70 0x7f1d4403bf30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1e480ad000 tx=0x7f1e480a5070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.459+0000 7f1e5e9c9640 1 --2- 172.21.15.62:0/3065980732 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5589efeb6340 0x5589effac030 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.459+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/3065980732 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e580083f0 con 0x5589efeb6340 2024-09-10T05:36:38.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.459+0000 7f1e606c29c0 1 --2- 172.21.15.62:0/3065980732 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5589effad2d0 0x5589effaf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.459+0000 7f1e606c29c0 1 -- 172.21.15.62:0/3065980732 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5589effafcb0 con 0x5589effad2d0 2024-09-10T05:36:38.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.459+0000 7f1e5e1c8640 1 --2- 172.21.15.62:0/3065980732 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5589effad2d0 0x5589effaf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.459+0000 7f1e5e1c8640 1 --2- 172.21.15.62:0/3065980732 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5589effad2d0 0x5589effaf6c0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.459+0000 7f1e5e1c8640 1 -- 172.21.15.62:0/3065980732 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1e50008030 con 0x5589effad2d0 2024-09-10T05:36:38.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.459+0000 7f1e606c29c0 1 --2- 172.21.15.62:0/3065980732 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5589effb1a70 0x5589effb3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.459+0000 7f1e606c29c0 1 -- 172.21.15.62:0/3065980732 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5589effb4530 con 0x5589effb1a70 2024-09-10T05:36:38.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.463+0000 7f1e5d9c7640 1 --2- 172.21.15.62:0/3065980732 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5589effb1a70 0x5589effb3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.463+0000 7f1e5d9c7640 1 --2- 172.21.15.62:0/3065980732 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5589effb1a70 0x5589effb3e60 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.463+0000 7f1e5d9c7640 1 -- 172.21.15.62:0/3065980732 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1e480aba70 con 0x5589effb1a70 2024-09-10T05:36:38.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.463+0000 7f1e606c29c0 1 -- 172.21.15.62:0/3065980732 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5589effb0910 con 0x5589effad2d0 2024-09-10T05:36:38.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.463+0000 7f1e5e1c8640 1 -- 172.21.15.62:0/3065980732 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1e50008030 con 0x5589effad2d0 2024-09-10T05:36:38.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.463+0000 7f1e606c29c0 1 -- 172.21.15.62:0/3065980732 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5589effb0d70 con 0x5589effb1a70 2024-09-10T05:36:38.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.463+0000 7f1e5d9c7640 1 -- 172.21.15.62:0/3065980732 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1e480aba70 con 0x5589effb1a70 2024-09-10T05:36:38.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.463+0000 7f1e606c29c0 1 Processor -- start 2024-09-10T05:36:38.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.463+0000 7f1e606c29c0 1 -- start start 2024-09-10T05:36:38.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.463+0000 7f1e606c29c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5589effc2ae0 0x5589effc2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.463+0000 7f1e606c29c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5589efdc7450 con 0x5589effc2ae0 2024-09-10T05:36:38.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.463+0000 7f1e5e1c8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5589effc2ae0 0x5589effc2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.463+0000 7f1e5e1c8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5589effc2ae0 0x5589effc2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47806/0 (socket says 172.21.15.62:47806) 2024-09-10T05:36:38.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.463+0000 7f1e5e1c8640 1 -- 172.21.15.62:0/3821146412 learned_addr learned my addr 172.21.15.62:0/3821146412 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:38.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.463+0000 7f1e5e1c8640 1 -- 172.21.15.62:0/3821146412 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589effc3540 con 0x5589effc2ae0 2024-09-10T05:36:38.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.463+0000 7f1e5e1c8640 1 --2- 172.21.15.62:0/3821146412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5589effc2ae0 0x5589effc2f00 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1e5004ecf0 tx=0x7f1e50018430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.467+0000 7f1d43fff640 1 -- 172.21.15.62:0/3821146412 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e5002cd90 con 0x5589effc2ae0 2024-09-10T05:36:38.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.467+0000 7f1d43fff640 1 -- 172.21.15.62:0/3821146412 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e50043e50 con 0x5589effc2ae0 2024-09-10T05:36:38.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.467+0000 7f1e606c29c0 1 -- 172.21.15.62:0/3821146412 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5589effc3540 con 0x5589effc2ae0 2024-09-10T05:36:38.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.467+0000 7f1d43fff640 1 -- 172.21.15.62:0/3821146412 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e50016c50 con 0x5589effc2ae0 2024-09-10T05:36:38.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.467+0000 7f1e606c29c0 1 -- 172.21.15.62:0/3821146412 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589effc3540 con 0x5589effc2ae0 2024-09-10T05:36:38.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.467+0000 7f1d43fff640 1 -- 172.21.15.62:0/3821146412 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1e50049040 con 0x5589effc2ae0 2024-09-10T05:36:38.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.467+0000 7f1d43fff640 1 --2- 172.21.15.62:0/3821146412 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1d38039a70 0x7f1d3803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.467+0000 7f1d43fff640 1 -- 172.21.15.62:0/3821146412 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f1e50005050 con 0x5589effc2ae0 2024-09-10T05:36:38.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.467+0000 7f1e5d9c7640 1 --2- 172.21.15.62:0/3821146412 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1d38039a70 0x7f1d3803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.467+0000 7f1e606c29c0 1 Processor -- start 2024-09-10T05:36:38.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.467+0000 7f1e606c29c0 1 -- start start 2024-09-10T05:36:38.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.467+0000 7f1e606c29c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5589effcff40 0x5589effd0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.467+0000 7f1e606c29c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5589eff9e040 con 0x5589effcff40 2024-09-10T05:36:38.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.467+0000 7f1e5d9c7640 1 --2- 172.21.15.62:0/3821146412 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1d38039a70 0x7f1d3803bf30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1e48017be0 tx=0x7f1e48005d90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.467+0000 7f1e5e1c8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5589effcff40 0x5589effd0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.467+0000 7f1e5e1c8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5589effcff40 0x5589effd0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47822/0 (socket says 172.21.15.62:47822) 2024-09-10T05:36:38.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.467+0000 7f1e5e1c8640 1 -- 172.21.15.62:0/3755546477 learned_addr learned my addr 172.21.15.62:0/3755546477 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:38.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.467+0000 7f1e5e1c8640 1 -- 172.21.15.62:0/3755546477 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589effd0930 con 0x5589effcff40 2024-09-10T05:36:38.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.467+0000 7f1e5e1c8640 1 --2- 172.21.15.62:0/3755546477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5589effcff40 0x5589effd0340 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f1e50018fd0 tx=0x7f1e50024560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e1b371501100861 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.471+0000 7f1d41ffb640 1 -- 172.21.15.62:0/3755546477 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e5003b030 con 0x5589effcff40 2024-09-10T05:36:38.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.471+0000 7f1d41ffb640 1 -- 172.21.15.62:0/3755546477 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e50023d20 con 0x5589effcff40 2024-09-10T05:36:38.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.471+0000 7f1d41ffb640 1 -- 172.21.15.62:0/3755546477 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e500500d0 con 0x5589effcff40 2024-09-10T05:36:38.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.471+0000 7f1e606c29c0 1 -- 172.21.15.62:0/3755546477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5589effcff40 msgr2=0x5589effd0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.471+0000 7f1e606c29c0 1 --2- 172.21.15.62:0/3755546477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5589effcff40 0x5589effd0340 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f1e50018fd0 tx=0x7f1e50024560 comp rx=0 tx=0).stop 2024-09-10T05:36:38.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.471+0000 7f1e606c29c0 1 -- 172.21.15.62:0/3755546477 shutdown_connections 2024-09-10T05:36:38.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.471+0000 7f1e606c29c0 1 --2- 172.21.15.62:0/3755546477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5589effcff40 0x5589effd0340 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.471+0000 7f1e606c29c0 1 -- 172.21.15.62:0/3755546477 >> 172.21.15.62:0/3755546477 conn(0x5589effcb300 msgr2=0x5589effc9540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:38.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.471+0000 7f1e606c29c0 1 -- 172.21.15.62:0/3755546477 shutdown_connections 2024-09-10T05:36:38.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.471+0000 7f1e606c29c0 1 -- 172.21.15.62:0/3755546477 wait complete. 2024-09-10T05:36:38.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.471+0000 7f1e606c29c0 1 Processor -- start 2024-09-10T05:36:38.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.471+0000 7f1e606c29c0 1 -- start start 2024-09-10T05:36:38.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.471+0000 7f1e606c29c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5589effcff40 0x5589effd6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.471+0000 7f1e606c29c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5589effcecb0 con 0x5589effcff40 2024-09-10T05:36:38.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.471+0000 7f1e5e1c8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5589effcff40 0x5589effd6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.471+0000 7f1e5e1c8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5589effcff40 0x5589effd6220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47828/0 (socket says 172.21.15.62:47828) 2024-09-10T05:36:38.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.471+0000 7f1e5e1c8640 1 -- 172.21.15.62:0/2509634592 learned_addr learned my addr 172.21.15.62:0/2509634592 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:38.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.471+0000 7f1e5e1c8640 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589effd6780 con 0x5589effcff40 2024-09-10T05:36:38.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.471+0000 7f1e5e1c8640 1 --2- 172.21.15.62:0/2509634592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5589effcff40 0x5589effd6220 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f1e50024040 tx=0x7f1e50046ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.471+0000 7f1d2ffff640 1 -- 172.21.15.62:0/2509634592 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e5003b040 con 0x5589effcff40 2024-09-10T05:36:38.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.471+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5589effd6780 con 0x5589effcff40 2024-09-10T05:36:38.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.471+0000 7f1d2ffff640 1 -- 172.21.15.62:0/2509634592 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e5004d0b0 con 0x5589effcff40 2024-09-10T05:36:38.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.471+0000 7f1d2ffff640 1 -- 172.21.15.62:0/2509634592 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e50016570 con 0x5589effcff40 2024-09-10T05:36:38.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.471+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589effd6780 con 0x5589effcff40 2024-09-10T05:36:38.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.475+0000 7f1d2ffff640 1 -- 172.21.15.62:0/2509634592 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1e50060030 con 0x5589effcff40 2024-09-10T05:36:38.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.475+0000 7f1e606c29c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.475+0000 7f1d2ffff640 1 --2- 172.21.15.62:0/2509634592 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1d28039a70 0x7f1d2803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.475+0000 7f1d2ffff640 1 -- 172.21.15.62:0/2509634592 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f1e5005e020 con 0x5589effcff40 2024-09-10T05:36:38.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.475+0000 7f1e5d9c7640 1 --2- 172.21.15.62:0/2509634592 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1d28039a70 0x7f1d2803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.475+0000 7f1e606c29c0 1 --2- 172.21.15.62:0/2509634592 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5589effe1190 0x5589effe3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.475+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5589effe3d70 con 0x5589effe1190 2024-09-10T05:36:38.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.475+0000 7f1e5e9c9640 1 --2- 172.21.15.62:0/2509634592 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5589effe1190 0x5589effe3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.475+0000 7f1e5d9c7640 1 --2- 172.21.15.62:0/2509634592 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1d28039a70 0x7f1d2803bf30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x5589effa62e0 tx=0x7f1e480b8040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.475+0000 7f1e5e9c9640 1 --2- 172.21.15.62:0/2509634592 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5589effe1190 0x5589effe3620 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.475+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e580083f0 con 0x5589effe1190 2024-09-10T05:36:38.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.475+0000 7f1e606c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:38.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.475+0000 7f1e606c29c0 20 realm 2024-09-10T05:36:38.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.475+0000 7f1e606c29c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.475+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5589effe05d0 con 0x5589effe1190 2024-09-10T05:36:38.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.475+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e580083f0 con 0x5589effe1190 2024-09-10T05:36:38.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.475+0000 7f1e606c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:38.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.475+0000 7f1e606c29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:38.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.475+0000 7f1e606c29c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.475+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5589effe4880 con 0x5589effe1190 2024-09-10T05:36:38.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.475+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e580083f0 con 0x5589effe1190 2024-09-10T05:36:38.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.475+0000 7f1e606c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:38.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.475+0000 7f1e606c29c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.475+0000 7f1e606c29c0 1 --2- 172.21.15.62:0/2509634592 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5589effe5660 0x5589effe7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.475+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5589effe8120 con 0x5589effe5660 2024-09-10T05:36:38.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.475+0000 7f1e5e1c8640 1 --2- 172.21.15.62:0/2509634592 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5589effe5660 0x5589effe7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.475+0000 7f1e5e1c8640 1 --2- 172.21.15.62:0/2509634592 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5589effe5660 0x5589effe7a50 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.479+0000 7f1e5e1c8640 1 -- 172.21.15.62:0/2509634592 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1e50008030 con 0x5589effe5660 2024-09-10T05:36:38.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.479+0000 7f1e606c29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:38.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.479+0000 7f1e606c29c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.479+0000 7f1e606c29c0 1 --2- 172.21.15.62:0/2509634592 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5589effe8e80 0x5589effeb270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.479+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5589effeb9e0 con 0x5589effe8e80 2024-09-10T05:36:38.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.479+0000 7f1e5d9c7640 1 --2- 172.21.15.62:0/2509634592 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5589effe8e80 0x5589effeb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.479+0000 7f1e5d9c7640 1 --2- 172.21.15.62:0/2509634592 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5589effe8e80 0x5589effeb270 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.479+0000 7f1e5d9c7640 1 -- 172.21.15.62:0/2509634592 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1e480c2050 con 0x5589effe8e80 2024-09-10T05:36:38.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.479+0000 7f1e606c29c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:38.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.479+0000 7f1e606c29c0 20 searching for the correct realm 2024-09-10T05:36:38.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.479+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5589effed2b0 con 0x5589effe8e80 2024-09-10T05:36:38.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.479+0000 7f1e5d9c7640 1 -- 172.21.15.62:0/2509634592 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e480c2050 con 0x5589effe8e80 2024-09-10T05:36:38.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.479+0000 7f1e5d9c7640 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5589effed2b0 con 0x5589effe5660 2024-09-10T05:36:38.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.479+0000 7f1e5e1c8640 1 -- 172.21.15.62:0/2509634592 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e50008030 con 0x5589effe5660 2024-09-10T05:36:38.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.479+0000 7f1e5e1c8640 1 --2- 172.21.15.62:0/2509634592 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f1e50017050 0x7f1e50036480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.479+0000 7f1e5e1c8640 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5589effed2b0 con 0x7f1e50017050 2024-09-10T05:36:38.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.479+0000 7f1e5e9c9640 1 --2- 172.21.15.62:0/2509634592 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f1e50017050 0x7f1e50036480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.479+0000 7f1e5e9c9640 1 --2- 172.21.15.62:0/2509634592 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f1e50017050 0x7f1e50036480 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.479+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e580083f0 con 0x7f1e50017050 2024-09-10T05:36:38.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.479+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5589effed2b0 con 0x5589effe1190 2024-09-10T05:36:38.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.479+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e580083f0 con 0x5589effe1190 2024-09-10T05:36:38.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.479+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5589effed2b0 con 0x5589effe1190 2024-09-10T05:36:38.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.483+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e580083f0 con 0x5589effe1190 2024-09-10T05:36:38.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.483+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5589effed2b0 con 0x5589effe8e80 2024-09-10T05:36:38.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.483+0000 7f1e5d9c7640 1 -- 172.21.15.62:0/2509634592 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e480c2050 con 0x5589effe8e80 2024-09-10T05:36:38.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.483+0000 7f1e5d9c7640 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5589effed2b0 con 0x5589effe1190 2024-09-10T05:36:38.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.483+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e580083f0 con 0x5589effe1190 2024-09-10T05:36:38.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.483+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5589effed2b0 con 0x5589effe5660 2024-09-10T05:36:38.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.483+0000 7f1e5e1c8640 1 -- 172.21.15.62:0/2509634592 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e50008030 con 0x5589effe5660 2024-09-10T05:36:38.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.483+0000 7f1e5e1c8640 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5589effed2b0 con 0x5589effe5660 2024-09-10T05:36:38.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.483+0000 7f1e5e1c8640 1 -- 172.21.15.62:0/2509634592 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e50008030 con 0x5589effe5660 2024-09-10T05:36:38.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.483+0000 7f1e5e1c8640 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5589effed2b0 con 0x5589effe1190 2024-09-10T05:36:38.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.483+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e580083f0 con 0x5589effe1190 2024-09-10T05:36:38.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.483+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5589effed2b0 con 0x7f1e50017050 2024-09-10T05:36:38.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.483+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e580083f0 con 0x7f1e50017050 2024-09-10T05:36:38.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.483+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5589effed2b0 con 0x5589effe1190 2024-09-10T05:36:38.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.483+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e580083f0 con 0x5589effe1190 2024-09-10T05:36:38.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.483+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5589effed2b0 con 0x7f1e50017050 2024-09-10T05:36:38.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.483+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1e580083f0 con 0x7f1e50017050 2024-09-10T05:36:38.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.483+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5589effed2b0 con 0x5589effe5660 2024-09-10T05:36:38.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.483+0000 7f1e5e1c8640 1 -- 172.21.15.62:0/2509634592 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e50008030 con 0x5589effe5660 2024-09-10T05:36:38.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.483+0000 7f1e5e1c8640 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5589effed2b0 con 0x5589effe8e80 2024-09-10T05:36:38.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.487+0000 7f1e5d9c7640 1 -- 172.21.15.62:0/2509634592 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e480c2050 con 0x5589effe8e80 2024-09-10T05:36:38.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.487+0000 7f1e5d9c7640 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5589effed2b0 con 0x5589effe1190 2024-09-10T05:36:38.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.487+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e580083f0 con 0x5589effe1190 2024-09-10T05:36:38.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.487+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5589effed2b0 con 0x5589effe5660 2024-09-10T05:36:38.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.487+0000 7f1e5e1c8640 1 -- 172.21.15.62:0/2509634592 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e50008030 con 0x5589effe5660 2024-09-10T05:36:38.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.487+0000 7f1e5e1c8640 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5589effed2b0 con 0x5589effe8e80 2024-09-10T05:36:38.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.487+0000 7f1e5d9c7640 1 -- 172.21.15.62:0/2509634592 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 30 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f1e480c2050 con 0x5589effe8e80 2024-09-10T05:36:38.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.487+0000 7f1e5d9c7640 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5589effed2b0 con 0x5589effe1190 2024-09-10T05:36:38.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.487+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e580083f0 con 0x5589effe1190 2024-09-10T05:36:38.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.487+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5589effed2b0 con 0x5589effe1190 2024-09-10T05:36:38.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.487+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1e580083f0 con 0x5589effe1190 2024-09-10T05:36:38.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.487+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5589effed2b0 con 0x5589effe1190 2024-09-10T05:36:38.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.487+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e580083f0 con 0x5589effe1190 2024-09-10T05:36:38.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.487+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5589effed2b0 con 0x5589effe8e80 2024-09-10T05:36:38.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.487+0000 7f1e5d9c7640 1 -- 172.21.15.62:0/2509634592 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e480c2050 con 0x5589effe8e80 2024-09-10T05:36:38.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.487+0000 7f1e5d9c7640 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5589effed2b0 con 0x7f1e50017050 2024-09-10T05:36:38.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.487+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e580083f0 con 0x7f1e50017050 2024-09-10T05:36:38.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.487+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5589effed2b0 con 0x5589effe1190 2024-09-10T05:36:38.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.487+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e580083f0 con 0x5589effe1190 2024-09-10T05:36:38.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.487+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5589effed2b0 con 0x7f1e50017050 2024-09-10T05:36:38.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.487+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e580083f0 con 0x7f1e50017050 2024-09-10T05:36:38.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.487+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5589effed2b0 con 0x5589effe8e80 2024-09-10T05:36:38.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.491+0000 7f1e5d9c7640 1 -- 172.21.15.62:0/2509634592 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e480c2050 con 0x5589effe8e80 2024-09-10T05:36:38.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.491+0000 7f1e5d9c7640 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5589effed2b0 con 0x7f1e50017050 2024-09-10T05:36:38.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.491+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e580083f0 con 0x7f1e50017050 2024-09-10T05:36:38.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.491+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5589effed2b0 con 0x5589effe5660 2024-09-10T05:36:38.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.491+0000 7f1e5e1c8640 1 -- 172.21.15.62:0/2509634592 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e50008030 con 0x5589effe5660 2024-09-10T05:36:38.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.491+0000 7f1e5e1c8640 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5589effed2b0 con 0x5589effe5660 2024-09-10T05:36:38.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.491+0000 7f1e5e1c8640 1 -- 172.21.15.62:0/2509634592 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e50008030 con 0x5589effe5660 2024-09-10T05:36:38.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.491+0000 7f1e5e1c8640 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5589effed2b0 con 0x5589effe8e80 2024-09-10T05:36:38.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.491+0000 7f1e5d9c7640 1 -- 172.21.15.62:0/2509634592 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e480c2050 con 0x5589effe8e80 2024-09-10T05:36:38.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.491+0000 7f1e5d9c7640 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5589effed2b0 con 0x5589effe5660 2024-09-10T05:36:38.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.491+0000 7f1e5e1c8640 1 -- 172.21.15.62:0/2509634592 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1e50008030 con 0x5589effe5660 2024-09-10T05:36:38.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.491+0000 7f1e5e1c8640 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5589effed2b0 con 0x5589effe5660 2024-09-10T05:36:38.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.491+0000 7f1e5e1c8640 1 -- 172.21.15.62:0/2509634592 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e50008030 con 0x5589effe5660 2024-09-10T05:36:38.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.491+0000 7f1e606c29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:38.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.491+0000 7f1e606c29c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:38.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.491+0000 7f1e606c29c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:38.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.491+0000 7f1e606c29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:38.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.491+0000 7f1e606c29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:38.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.491+0000 7f1e606c29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:38.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.491+0000 7f1e606c29c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.491+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5589effec3a0 con 0x5589effe1190 2024-09-10T05:36:38.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.495+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e580083f0 con 0x5589effe1190 2024-09-10T05:36:38.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.495+0000 7f1e606c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:38.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.495+0000 7f1e606c29c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.495+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5589effecc40 con 0x5589effe5660 2024-09-10T05:36:38.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.495+0000 7f1e5e1c8640 1 -- 172.21.15.62:0/2509634592 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1e50008030 con 0x5589effe5660 2024-09-10T05:36:38.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.495+0000 7f1e606c29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:38.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.495+0000 7f1e606c29c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.495+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5589effebfe0 con 0x5589effe8e80 2024-09-10T05:36:38.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.495+0000 7f1e5d9c7640 1 -- 172.21.15.62:0/2509634592 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1e480c2050 con 0x5589effe8e80 2024-09-10T05:36:38.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.495+0000 7f1e606c29c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:38.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.495+0000 7f1e606c29c0 20 zone default found 2024-09-10T05:36:38.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.495+0000 7f1e606c29c0 4 Realm: () 2024-09-10T05:36:38.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.495+0000 7f1e606c29c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:38.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.495+0000 7f1e606c29c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:38.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.495+0000 7f1e606c29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:38.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.495+0000 7f1e606c29c0 20 zonegroup default 2024-09-10T05:36:38.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.495+0000 7f1e606c29c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.495+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5589effedb90 con 0x7f1e50017050 2024-09-10T05:36:38.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.495+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1e580083f0 con 0x7f1e50017050 2024-09-10T05:36:38.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.495+0000 7f1e606c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:38.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.495+0000 7f1e606c29c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.495+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5589effefdd0 con 0x5589effe8e80 2024-09-10T05:36:38.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.495+0000 7f1e5d9c7640 1 -- 172.21.15.62:0/2509634592 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1e480c2050 con 0x5589effe8e80 2024-09-10T05:36:38.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.495+0000 7f1e606c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:38.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.495+0000 7f1e606c29c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.495+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5589efff0170 con 0x5589effe8e80 2024-09-10T05:36:38.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.495+0000 7f1e5d9c7640 1 -- 172.21.15.62:0/2509634592 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1e480c2050 con 0x5589effe8e80 2024-09-10T05:36:38.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.495+0000 7f1e606c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:38.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.495+0000 7f1e606c29c0 20 started sync module instance, tier type = 2024-09-10T05:36:38.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.495+0000 7f1e606c29c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:38.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.495+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5589effef260 con 0x5589effe5660 2024-09-10T05:36:38.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.499+0000 7f1e5e1c8640 1 -- 172.21.15.62:0/2509634592 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e50008030 con 0x5589effe5660 2024-09-10T05:36:38.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.499+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94050925344336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5589effeeec0 con 0x5589effe5660 2024-09-10T05:36:38.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.499+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5589efff0ed0 con 0x5589effe1190 2024-09-10T05:36:38.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.499+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e580083f0 con 0x5589effe1190 2024-09-10T05:36:38.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.499+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94050925349312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5589efff1770 con 0x5589effe1190 2024-09-10T05:36:38.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.499+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5589efff21b0 con 0x5589effe5660 2024-09-10T05:36:38.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.499+0000 7f1e5e1c8640 1 -- 172.21.15.62:0/2509634592 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94050925344336] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e50008030 con 0x5589effe5660 2024-09-10T05:36:38.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.499+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94050925349312] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e580083f0 con 0x5589effe1190 2024-09-10T05:36:38.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.499+0000 7f1e5e1c8640 1 -- 172.21.15.62:0/2509634592 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e50008030 con 0x5589effe5660 2024-09-10T05:36:38.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.499+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94050925354112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5589efff12c0 con 0x5589effe5660 2024-09-10T05:36:38.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.499+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5589efff2a50 con 0x7f1e50017050 2024-09-10T05:36:38.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.503+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e580083f0 con 0x7f1e50017050 2024-09-10T05:36:38.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.503+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94050925356448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5589efff12c0 con 0x7f1e50017050 2024-09-10T05:36:38.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.503+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5589efff3510 con 0x5589effe5660 2024-09-10T05:36:38.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.503+0000 7f1e5e1c8640 1 -- 172.21.15.62:0/2509634592 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94050925354112] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e50008030 con 0x5589effe5660 2024-09-10T05:36:38.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.503+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94050925356448] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e580083f0 con 0x7f1e50017050 2024-09-10T05:36:38.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.503+0000 7f1e5e1c8640 1 -- 172.21.15.62:0/2509634592 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e50008030 con 0x5589effe5660 2024-09-10T05:36:38.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.503+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94050925357504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5589efff34d0 con 0x5589effe5660 2024-09-10T05:36:38.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.503+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5589efff3900 con 0x5589effe8e80 2024-09-10T05:36:38.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.507+0000 7f1e5d9c7640 1 -- 172.21.15.62:0/2509634592 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e480c2050 con 0x5589effe8e80 2024-09-10T05:36:38.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.507+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94050925348112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5589efff41a0 con 0x5589effe8e80 2024-09-10T05:36:38.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.507+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5589efff4b60 con 0x5589effe8e80 2024-09-10T05:36:38.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.507+0000 7f1e5e1c8640 1 -- 172.21.15.62:0/2509634592 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94050925357504] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e50008030 con 0x5589effe5660 2024-09-10T05:36:38.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.507+0000 7f1e5d9c7640 1 -- 172.21.15.62:0/2509634592 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(56 notify.6 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e480c2050 con 0x5589effe8e80 2024-09-10T05:36:38.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.507+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94050925359072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5589efff4b60 con 0x5589effe8e80 2024-09-10T05:36:38.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.507+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5589efff55b0 con 0x7f1e50017050 2024-09-10T05:36:38.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.507+0000 7f1e5d9c7640 1 -- 172.21.15.62:0/2509634592 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94050925348112] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e480c2050 con 0x5589effe8e80 2024-09-10T05:36:38.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.507+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e580083f0 con 0x7f1e50017050 2024-09-10T05:36:38.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.507+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94050925362416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5589efff5570 con 0x7f1e50017050 2024-09-10T05:36:38.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.507+0000 7f1e606c29c0 20 add_watcher() i=0 2024-09-10T05:36:38.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.507+0000 7f1e606c29c0 20 add_watcher() i=1 2024-09-10T05:36:38.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.507+0000 7f1e606c29c0 20 add_watcher() i=2 2024-09-10T05:36:38.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.507+0000 7f1e606c29c0 20 add_watcher() i=3 2024-09-10T05:36:38.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.507+0000 7f1e606c29c0 20 add_watcher() i=4 2024-09-10T05:36:38.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.507+0000 7f1e606c29c0 20 add_watcher() i=5 2024-09-10T05:36:38.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.507+0000 7f1e5d9c7640 1 -- 172.21.15.62:0/2509634592 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94050925359072] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e480c2050 con 0x5589effe8e80 2024-09-10T05:36:38.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.507+0000 7f1e606c29c0 20 add_watcher() i=6 2024-09-10T05:36:38.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.511+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94050925362416] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e580083f0 con 0x7f1e50017050 2024-09-10T05:36:38.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.511+0000 7f1e606c29c0 20 add_watcher() i=7 2024-09-10T05:36:38.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.511+0000 7f1e606c29c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:38.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.511+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5589efff5570 con 0x5589effe1190 2024-09-10T05:36:38.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.511+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1e580083f0 con 0x5589effe1190 2024-09-10T05:36:38.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.511+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94050925367488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5589efff54e0 con 0x5589effe1190 2024-09-10T05:36:38.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.511+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94050925367488] v30'138 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1e580083f0 con 0x5589effe1190 2024-09-10T05:36:38.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.511+0000 7f1d14fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:38.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.511+0000 7f1e606c29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:38.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.511+0000 7f1e606c29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:38.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.511+0000 7f1e606c29c0 5 note: GC not initialized 2024-09-10T05:36:38.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.511+0000 7f1c8f7fe640 20 reqs_thread_entry: start 2024-09-10T05:36:38.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.511+0000 7f1e606c29c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:38.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.511+0000 7f1e606c29c0 20 Filter name: none 2024-09-10T05:36:38.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.511+0000 7f1c8d7fa640 20 reqs_thread_entry: start 2024-09-10T05:36:38.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.515+0000 7f1e606c29c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T05:36:38.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.515+0000 7f1e606c29c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.515+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5589f001b740 con 0x5589effe1190 2024-09-10T05:36:38.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.515+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f1e580083f0 con 0x5589effe1190 2024-09-10T05:36:38.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.515+0000 7f1e606c29c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:36:38.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.515+0000 7f1e606c29c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T05:36:38.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.515+0000 7f1e606c29c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:36:38.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.515+0000 7f1e606c29c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:36:38.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.515+0000 7f1e606c29c0 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2024-09-10T05:36:38.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.515+0000 7f1e606c29c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.515+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:63 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5589f001b190 con 0x5589effe1190 2024-09-10T05:36:38.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.515+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(63 testx/myfoo [call out=48b,read 0~193 out=193b] v0'0 uv1 ondisk = 0) ==== 197+0+241 (crc 0 0 0) 0x7f1e580083f0 con 0x5589effe1190 2024-09-10T05:36:38.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.515+0000 7f1e606c29c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-10T05:36:38.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.515+0000 7f1e606c29c0 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2024-09-10T05:36:38.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.515+0000 7f1e606c29c0 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-10T05:36:38.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.515+0000 7f1e606c29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 : miss 2024-09-10T05:36:38.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.515+0000 7f1e606c29c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.515+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:64 8.8 8:1226e205:root::.bucket.meta.testx%3amyfoo%3a475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5589f001f420 con 0x5589effe1190 2024-09-10T05:36:38.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.515+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(64 .bucket.meta.testx:myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 [call out=48b,stat out=16b,read 0~420 out=420b,getxattrs out=298b] v0'0 uv3 ondisk = 0) ==== 338+0+782 (crc 0 0 0) 0x7f1e580083f0 con 0x5589effe1190 2024-09-10T05:36:38.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.515+0000 7f1e606c29c0 20 rados_obj.operate() r=0 bl.length=420 2024-09-10T05:36:38.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.515+0000 7f1e606c29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 info.flags=0x17 2024-09-10T05:36:38.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.515+0000 7f1e606c29c0 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 to cache LRU end 2024-09-10T05:36:38.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.515+0000 7f1e606c29c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:36:38.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.515+0000 7f1e606c29c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-10T05:36:38.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.515+0000 7f1e606c29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 2024-09-10T05:36:38.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.515+0000 7f1e606c29c0 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-10T05:36:38.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.515+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:65 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5589f0023ac0 con 0x5589effe1190 2024-09-10T05:36:38.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.515+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(65 testx$tenanteduser.buckets [call] v30'2 uv2 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f1e580083f0 con 0x5589effe1190 2024-09-10T05:36:38.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.515+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:66 8.1f 8:fcc5c255:root::.bucket.meta.myfoo%3a475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1:head [create,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5589f00273d0 con 0x7f1e50017050 2024-09-10T05:36:38.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.519+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(66 .bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 [create,call,writefull 0~387,setxattr (123)] v30'5 uv5 ondisk = 0) ==== 332+0+0 (crc 0 0 0) 0x7f1e580083f0 con 0x7f1e50017050 2024-09-10T05:36:38.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.519+0000 7f1e606c29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 info.flags=0x7 2024-09-10T05:36:38.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.519+0000 7f1e606c29c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 to cache LRU end 2024-09-10T05:36:38.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.519+0000 7f1e606c29c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T05:36:38.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.519+0000 7f1e606c29c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1, ofs0, ns] 2024-09-10T05:36:38.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.519+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94050925564272 in=748b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5589f0026e50 con 0x5589effe8e80 2024-09-10T05:36:38.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.519+0000 7f1e5d9c7640 1 -- 172.21.15.62:0/2509634592 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== watch-notify(notify (1) cookie 94050925348112 notify 128849018893 ret 0) ==== 778+0+0 (crc 0 0 0) 0x7f1e480e2040 con 0x5589effe8e80 2024-09-10T05:36:38.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.519+0000 7f1d41ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018893 cookie 94050925348112 notifier 4556 bl.length()=736 2024-09-10T05:36:38.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.519+0000 7f1d41ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 info.flags=0x7 2024-09-10T05:36:38.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.519+0000 7f1d41ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 to cache LRU end 2024-09-10T05:36:38.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.519+0000 7f1d41ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T05:36:38.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.519+0000 7f1e5d9c7640 1 -- 172.21.15.62:0/2509634592 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(67 notify.5 [notify cookie 94050925564272 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1e480c2050 con 0x5589effe8e80 2024-09-10T05:36:38.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.519+0000 7f1d41ffb640 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f1d24003eb0 con 0x5589effe8e80 2024-09-10T05:36:38.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.519+0000 7f1e5d9c7640 1 -- 172.21.15.62:0/2509634592 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e480c2050 con 0x5589effe8e80 2024-09-10T05:36:38.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.519+0000 7f1e5d9c7640 1 -- 172.21.15.62:0/2509634592 <== osd.3 v2:172.21.15.62:6816/2708991149 19 ==== watch-notify(notify_complete (2) cookie 94050925564272 notify 128849018893 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5589efd5aca0 con 0x5589effe8e80 2024-09-10T05:36:38.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.519+0000 7f1e606c29c0 20 handle_bi_update(): bucket=:myfoo[475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1]): orig_sources= new_sources= 2024-09-10T05:36:38.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.519+0000 7f1e606c29c0 20 handle_bi_update(): bucket=:myfoo[475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1]): potential sources added=[] removed=[] 2024-09-10T05:36:38.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.519+0000 7f1e606c29c0 20 handle_bi_update(): bucket=:myfoo[475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1]): orig_dests= new_dests= 2024-09-10T05:36:38.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.519+0000 7f1e606c29c0 20 handle_bi_update(): bucket=:myfoo[475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1]): potential dests added=[] removed=[] 2024-09-10T05:36:38.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.519+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5589f0026fd0 con 0x7f1e50017050 2024-09-10T05:36:38.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.519+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(69 foo.buckets [call] v30'26 uv26 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f1e580083f0 con 0x7f1e50017050 2024-09-10T05:36:38.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.519+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5589f0026fd0 con 0x7f1e50017050 2024-09-10T05:36:38.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.523+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v30'27 uv27 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f1e580083f0 con 0x7f1e50017050 2024-09-10T05:36:38.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.523+0000 7f1e606c29c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-10T05:36:38.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.523+0000 7f1e606c29c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T05:36:38.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.523+0000 7f1e606c29c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-10T05:36:38.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.523+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94050925570848 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5589f0026f40 con 0x5589effe8e80 2024-09-10T05:36:38.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.523+0000 7f1e5d9c7640 1 -- 172.21.15.62:0/2509634592 <== osd.3 v2:172.21.15.62:6816/2708991149 20 ==== watch-notify(notify (1) cookie 94050925359072 notify 128849018894 ret 0) ==== 356+0+0 (crc 0 0 0) 0x7f1e480dd790 con 0x5589effe8e80 2024-09-10T05:36:38.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.523+0000 7f1d41ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018894 cookie 94050925359072 notifier 4556 bl.length()=314 2024-09-10T05:36:38.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.523+0000 7f1d41ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-10T05:36:38.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.523+0000 7f1d41ffb640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T05:36:38.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.523+0000 7f1e5d9c7640 1 -- 172.21.15.62:0/2509634592 <== osd.3 v2:172.21.15.62:6816/2708991149 21 ==== osd_op_reply(71 notify.6 [notify cookie 94050925570848 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1e480c2050 con 0x5589effe8e80 2024-09-10T05:36:38.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.523+0000 7f1d41ffb640 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f1d24003eb0 con 0x5589effe8e80 2024-09-10T05:36:38.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.523+0000 7f1e5d9c7640 1 -- 172.21.15.62:0/2509634592 <== osd.3 v2:172.21.15.62:6816/2708991149 22 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e480c2050 con 0x5589effe8e80 2024-09-10T05:36:38.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.523+0000 7f1e5d9c7640 1 -- 172.21.15.62:0/2509634592 <== osd.3 v2:172.21.15.62:6816/2708991149 23 ==== watch-notify(notify_complete (2) cookie 94050925570848 notify 128849018894 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f1e480dda30 con 0x5589effe8e80 2024-09-10T05:36:38.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.523+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:73 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5589f0026f90 con 0x5589effe1190 2024-09-10T05:36:38.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.523+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 <== osd.1 v2:172.21.15.62:6808/3442097179 23 ==== osd_op_reply(73 testx/myfoo [call,delete] v30'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7f1e580083f0 con 0x5589effe1190 2024-09-10T05:36:38.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.523+0000 7f1e606c29c0 10 removing default.rgw.meta+root+testx/myfoo from cache 2024-09-10T05:36:38.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.523+0000 7f1e606c29c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-10T05:36:38.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.523+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [notify cookie 94050925570784 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5589f0026f00 con 0x5589effe5660 2024-09-10T05:36:38.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.527+0000 7f1e5e1c8640 1 -- 172.21.15.62:0/2509634592 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== watch-notify(notify (1) cookie 94050925357504 notify 128849018908 ret 0) ==== 197+0+0 (crc 0 0 0) 0x7f1e50031070 con 0x5589effe5660 2024-09-10T05:36:38.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.527+0000 7f1d417fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018908 cookie 94050925357504 notifier 4556 bl.length()=155 2024-09-10T05:36:38.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.527+0000 7f1d417fa640 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f1c940032d0 con 0x5589effe5660 2024-09-10T05:36:38.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.527+0000 7f1e5e1c8640 1 -- 172.21.15.62:0/2509634592 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(74 notify.4 [notify cookie 94050925570784 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1e50008030 con 0x5589effe5660 2024-09-10T05:36:38.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.527+0000 7f1e5e1c8640 1 -- 172.21.15.62:0/2509634592 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(75 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e50008030 con 0x5589effe5660 2024-09-10T05:36:38.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.527+0000 7f1e5e1c8640 1 -- 172.21.15.62:0/2509634592 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== watch-notify(notify_complete (2) cookie 94050925570784 notify 128849018908 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f1e50041e30 con 0x5589effe5660 2024-09-10T05:36:38.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.527+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:76 8.8 8:1226e205:root::.bucket.meta.testx%3amyfoo%3a475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5589f0026f50 con 0x5589effe1190 2024-09-10T05:36:38.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.527+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 <== osd.1 v2:172.21.15.62:6808/3442097179 24 ==== osd_op_reply(76 .bucket.meta.testx:myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 [call,delete] v30'4 uv4 ondisk = 0) ==== 254+0+0 (crc 0 0 0) 0x7f1e580083f0 con 0x5589effe1190 2024-09-10T05:36:38.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.527+0000 7f1e606c29c0 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 from cache 2024-09-10T05:36:38.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.527+0000 7f1e606c29c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1, ofs0, ns] 2024-09-10T05:36:38.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.527+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [notify cookie 94050925542080 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5589f0026f50 con 0x5589effe5660 2024-09-10T05:36:38.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.527+0000 7f1e5e1c8640 1 -- 172.21.15.62:0/2509634592 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== watch-notify(notify (1) cookie 94050925357504 notify 128849018909 ret 0) ==== 254+0+0 (crc 0 0 0) 0x7f1e50041e30 con 0x5589effe5660 2024-09-10T05:36:38.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.527+0000 7f1d41ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018909 cookie 94050925357504 notifier 4556 bl.length()=212 2024-09-10T05:36:38.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.527+0000 7f1d41ffb640 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f1d24003eb0 con 0x5589effe5660 2024-09-10T05:36:38.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.527+0000 7f1e5e1c8640 1 -- 172.21.15.62:0/2509634592 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(77 notify.4 [notify cookie 94050925542080 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1e50008030 con 0x5589effe5660 2024-09-10T05:36:38.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.531+0000 7f1e5e1c8640 1 -- 172.21.15.62:0/2509634592 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(78 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e50008030 con 0x5589effe5660 2024-09-10T05:36:38.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.531+0000 7f1e5e1c8640 1 -- 172.21.15.62:0/2509634592 <== osd.0 v2:172.21.15.2:6800/945139080 25 ==== watch-notify(notify_complete (2) cookie 94050925542080 notify 128849018909 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5589effa6060 con 0x5589effe5660 2024-09-10T05:36:38.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.531+0000 7f1d14fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:38.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.531+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94050925367488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5589f001ed90 con 0x5589effe1190 2024-09-10T05:36:38.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.531+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 <== osd.1 v2:172.21.15.62:6808/3442097179 25 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94050925367488] v30'139 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1e580083f0 con 0x5589effe1190 2024-09-10T05:36:38.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.531+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94050925344336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5589efff50c0 con 0x5589effe5660 2024-09-10T05:36:38.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.535+0000 7f1e5e1c8640 1 -- 172.21.15.62:0/2509634592 <== osd.0 v2:172.21.15.2:6800/945139080 26 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94050925344336] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e50008030 con 0x5589effe5660 2024-09-10T05:36:38.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.535+0000 7f1e606c29c0 20 remove_watcher() i=0 2024-09-10T05:36:38.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.535+0000 7f1e606c29c0 2 removed watcher, disabling cache 2024-09-10T05:36:38.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.535+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94050925349312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5589effef650 con 0x5589effe1190 2024-09-10T05:36:38.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.535+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 <== osd.1 v2:172.21.15.62:6808/3442097179 26 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94050925349312] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e580083f0 con 0x5589effe1190 2024-09-10T05:36:38.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.535+0000 7f1e606c29c0 20 remove_watcher() i=1 2024-09-10T05:36:38.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.535+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94050925354112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5589efff50c0 con 0x5589effe5660 2024-09-10T05:36:38.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.539+0000 7f1e5e1c8640 1 -- 172.21.15.62:0/2509634592 <== osd.0 v2:172.21.15.2:6800/945139080 27 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94050925354112] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e50008030 con 0x5589effe5660 2024-09-10T05:36:38.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.539+0000 7f1e606c29c0 20 remove_watcher() i=2 2024-09-10T05:36:38.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.539+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94050925356448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5589effef650 con 0x7f1e50017050 2024-09-10T05:36:38.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.539+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 <== osd.2 v2:172.21.15.62:6800/2677868286 15 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94050925356448] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e580083f0 con 0x7f1e50017050 2024-09-10T05:36:38.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.539+0000 7f1e606c29c0 20 remove_watcher() i=3 2024-09-10T05:36:38.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.539+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94050925357504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5589efff1c80 con 0x5589effe5660 2024-09-10T05:36:38.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.543+0000 7f1e5e1c8640 1 -- 172.21.15.62:0/2509634592 <== osd.0 v2:172.21.15.2:6800/945139080 28 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94050925357504] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e50008030 con 0x5589effe5660 2024-09-10T05:36:38.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.543+0000 7f1e606c29c0 20 remove_watcher() i=4 2024-09-10T05:36:38.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.543+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94050925348112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5589efff50c0 con 0x5589effe8e80 2024-09-10T05:36:38.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.543+0000 7f1e5d9c7640 1 -- 172.21.15.62:0/2509634592 <== osd.3 v2:172.21.15.62:6816/2708991149 24 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94050925348112] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e480c2050 con 0x5589effe8e80 2024-09-10T05:36:38.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.543+0000 7f1e606c29c0 20 remove_watcher() i=5 2024-09-10T05:36:38.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.543+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94050925359072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5589effef650 con 0x5589effe8e80 2024-09-10T05:36:38.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.543+0000 7f1e5d9c7640 1 -- 172.21.15.62:0/2509634592 <== osd.3 v2:172.21.15.62:6816/2708991149 25 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94050925359072] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e480c2050 con 0x5589effe8e80 2024-09-10T05:36:38.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.543+0000 7f1e606c29c0 20 remove_watcher() i=6 2024-09-10T05:36:38.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.543+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94050925362416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5589efff50c0 con 0x7f1e50017050 2024-09-10T05:36:38.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.547+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 <== osd.2 v2:172.21.15.62:6800/2677868286 16 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94050925362416] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e580083f0 con 0x7f1e50017050 2024-09-10T05:36:38.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.547+0000 7f1e606c29c0 20 remove_watcher() i=7 2024-09-10T05:36:38.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.547+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5589effe5660 msgr2=0x5589effe7a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.547+0000 7f1e606c29c0 1 --2- 172.21.15.62:0/2509634592 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5589effe5660 0x5589effe7a50 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.547+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5589effe1190 msgr2=0x5589effe3620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.547+0000 7f1e606c29c0 1 --2- 172.21.15.62:0/2509634592 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5589effe1190 0x5589effe3620 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.547+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f1e50017050 msgr2=0x7f1e50036480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.547+0000 7f1e606c29c0 1 --2- 172.21.15.62:0/2509634592 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f1e50017050 0x7f1e50036480 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.547+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5589effe8e80 msgr2=0x5589effeb270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.547+0000 7f1e606c29c0 1 --2- 172.21.15.62:0/2509634592 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5589effe8e80 0x5589effeb270 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.547+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1d28039a70 msgr2=0x7f1d2803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.547+0000 7f1e606c29c0 1 --2- 172.21.15.62:0/2509634592 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1d28039a70 0x7f1d2803bf30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x5589effa62e0 tx=0x7f1e480b8040 comp rx=0 tx=0).stop 2024-09-10T05:36:38.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.547+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5589effcff40 msgr2=0x5589effd6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.547+0000 7f1e606c29c0 1 --2- 172.21.15.62:0/2509634592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5589effcff40 0x5589effd6220 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f1e50024040 tx=0x7f1e50046ea0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.547+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 reap_dead start 2024-09-10T05:36:38.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.547+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/2509634592 reap_dead start 2024-09-10T05:36:38.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.547+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 shutdown_connections 2024-09-10T05:36:38.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.547+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 >> 172.21.15.62:0/2509634592 conn(0x5589effcb300 msgr2=0x5589effc9510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:38.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.547+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 shutdown_connections 2024-09-10T05:36:38.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.547+0000 7f1e606c29c0 1 -- 172.21.15.62:0/2509634592 wait complete. 2024-09-10T05:36:38.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.547+0000 7f1e606c29c0 1 -- 172.21.15.62:0/3821146412 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1d38039a70 msgr2=0x7f1d3803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.547+0000 7f1e606c29c0 1 --2- 172.21.15.62:0/3821146412 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1d38039a70 0x7f1d3803bf30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1e48017be0 tx=0x7f1e48005d90 comp rx=0 tx=0).stop 2024-09-10T05:36:38.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.547+0000 7f1e606c29c0 1 -- 172.21.15.62:0/3821146412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5589effc2ae0 msgr2=0x5589effc2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.547+0000 7f1e606c29c0 1 --2- 172.21.15.62:0/3821146412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5589effc2ae0 0x5589effc2f00 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1e5004ecf0 tx=0x7f1e50018430 comp rx=0 tx=0).stop 2024-09-10T05:36:38.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.547+0000 7f1e606c29c0 1 -- 172.21.15.62:0/3821146412 shutdown_connections 2024-09-10T05:36:38.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.547+0000 7f1e606c29c0 1 --2- 172.21.15.62:0/3821146412 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1d38039a70 0x7f1d3803bf30 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.547+0000 7f1e606c29c0 1 --2- 172.21.15.62:0/3821146412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5589effc2ae0 0x5589effc2f00 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.547+0000 7f1e606c29c0 1 -- 172.21.15.62:0/3821146412 >> 172.21.15.62:0/3821146412 conn(0x5589effb8490 msgr2=0x5589effb8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:38.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.547+0000 7f1e606c29c0 1 -- 172.21.15.62:0/3821146412 shutdown_connections 2024-09-10T05:36:38.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.547+0000 7f1e606c29c0 1 -- 172.21.15.62:0/3821146412 wait complete. 2024-09-10T05:36:38.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.547+0000 7f1e606c29c0 1 -- 172.21.15.62:0/3065980732 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5589effad2d0 msgr2=0x5589effaf6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.547+0000 7f1e606c29c0 1 --2- 172.21.15.62:0/3065980732 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5589effad2d0 0x5589effaf6c0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.547+0000 7f1e606c29c0 1 -- 172.21.15.62:0/3065980732 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5589efeb6340 msgr2=0x5589effac030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.547+0000 7f1e606c29c0 1 --2- 172.21.15.62:0/3065980732 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5589efeb6340 0x5589effac030 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.547+0000 7f1e606c29c0 1 -- 172.21.15.62:0/3065980732 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5589effb1a70 msgr2=0x5589effb3e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.547+0000 7f1e606c29c0 1 --2- 172.21.15.62:0/3065980732 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5589effb1a70 0x5589effb3e60 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.547+0000 7f1e606c29c0 1 -- 172.21.15.62:0/3065980732 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1d44039a70 msgr2=0x7f1d4403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.547+0000 7f1e606c29c0 1 --2- 172.21.15.62:0/3065980732 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1d44039a70 0x7f1d4403bf30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1e480ad000 tx=0x7f1e480a5070 comp rx=0 tx=0).stop 2024-09-10T05:36:38.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.547+0000 7f1e606c29c0 1 -- 172.21.15.62:0/3065980732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5589efe261f0 msgr2=0x5589effa4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.547+0000 7f1e606c29c0 1 --2- 172.21.15.62:0/3065980732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5589efe261f0 0x5589effa4ec0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x5589eff9e780 tx=0x7f1e50000ee0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.547+0000 7f1e5e9c9640 1 -- 172.21.15.62:0/3065980732 reap_dead start 2024-09-10T05:36:38.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.547+0000 7f1e606c29c0 1 -- 172.21.15.62:0/3065980732 shutdown_connections 2024-09-10T05:36:38.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.547+0000 7f1e606c29c0 1 -- 172.21.15.62:0/3065980732 >> 172.21.15.62:0/3065980732 conn(0x5589efeac910 msgr2=0x5589eff97ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:38.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.547+0000 7f1e606c29c0 1 -- 172.21.15.62:0/3065980732 shutdown_connections 2024-09-10T05:36:38.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.547+0000 7f1e606c29c0 1 -- 172.21.15.62:0/3065980732 wait complete. 2024-09-10T05:36:38.563 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-10T05:36:38.563 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-10T05:36:38.563 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2024-09-10T05:36:38.639 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:38.639 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:38.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.635+0000 7ff2160859c0 1 Processor -- start 2024-09-10T05:36:38.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.635+0000 7ff2160859c0 1 -- start start 2024-09-10T05:36:38.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.635+0000 7ff2160859c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55642500adf0 0x55642500b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.635+0000 7ff2160859c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556424ec09c0 con 0x55642500dfd0 2024-09-10T05:36:38.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.635+0000 7ff2160859c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x556424f106d0 con 0x55642500adf0 2024-09-10T05:36:38.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.639+0000 7ff213b8b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55642500adf0 0x55642500b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.639+0000 7ff21338a640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x55642500dfd0 0x5564250103c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:53140/0 (socket says 172.21.15.62:53140) 2024-09-10T05:36:38.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.639+0000 7ff213b8b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55642500adf0 0x55642500b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47836/0 (socket says 172.21.15.62:47836) 2024-09-10T05:36:38.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.639+0000 7ff21338a640 1 -- 172.21.15.62:0/1981430969 learned_addr learned my addr 172.21.15.62:0/1981430969 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-10T05:36:38.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.639+0000 7ff213b8b640 1 -- 172.21.15.62:0/1981430969 >> v1:172.21.15.2:6789/0 conn(0x55642500dfd0 legacy=0x5564250103c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.639+0000 7ff213b8b640 1 -- 172.21.15.62:0/1981430969 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556424eb4ca0 con 0x55642500adf0 2024-09-10T05:36:38.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.643+0000 7ff213b8b640 1 --2- 172.21.15.62:0/1981430969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55642500adf0 0x55642500b1d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff20c00a420 tx=0x7ff20c01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af46c6efe245125b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.643+0000 7ff212b89640 1 -- 172.21.15.62:0/1981430969 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff20c0af070 con 0x55642500adf0 2024-09-10T05:36:38.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.643+0000 7ff212b89640 1 -- 172.21.15.62:0/1981430969 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff20c0aa530 con 0x55642500adf0 2024-09-10T05:36:38.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.643+0000 7ff212b89640 1 -- 172.21.15.62:0/1981430969 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff20c0aa850 con 0x55642500adf0 2024-09-10T05:36:38.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.643+0000 7ff2160859c0 1 -- 172.21.15.62:0/1981430969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55642500adf0 msgr2=0x55642500b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.643+0000 7ff2160859c0 1 --2- 172.21.15.62:0/1981430969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55642500adf0 0x55642500b1d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff20c00a420 tx=0x7ff20c01afd0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.643+0000 7ff2160859c0 1 -- 172.21.15.62:0/1981430969 shutdown_connections 2024-09-10T05:36:38.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.643+0000 7ff2160859c0 1 --2- 172.21.15.62:0/1981430969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55642500adf0 0x55642500b1d0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.643+0000 7ff2160859c0 1 -- 172.21.15.62:0/1981430969 >> 172.21.15.62:0/1981430969 conn(0x556425006910 msgr2=0x556425008d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:38.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.643+0000 7ff2160859c0 1 -- 172.21.15.62:0/1981430969 shutdown_connections 2024-09-10T05:36:38.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.643+0000 7ff2160859c0 1 -- 172.21.15.62:0/1981430969 wait complete. 2024-09-10T05:36:38.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.659+0000 7ff2160859c0 1 Processor -- start 2024-09-10T05:36:38.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.659+0000 7ff2160859c0 1 -- start start 2024-09-10T05:36:38.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.659+0000 7ff2160859c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55642500adf0 0x556424f7fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.659+0000 7ff2160859c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556424f14680 con 0x55642500adf0 2024-09-10T05:36:38.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.659+0000 7ff213b8b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55642500adf0 0x556424f7fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.659+0000 7ff213b8b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55642500adf0 0x556424f7fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47842/0 (socket says 172.21.15.62:47842) 2024-09-10T05:36:38.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.659+0000 7ff213b8b640 1 -- 172.21.15.62:0/964702575 learned_addr learned my addr 172.21.15.62:0/964702575 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:38.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.659+0000 7ff213b8b640 1 -- 172.21.15.62:0/964702575 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556424e8fda0 con 0x55642500adf0 2024-09-10T05:36:38.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.659+0000 7ff213b8b640 1 --2- 172.21.15.62:0/964702575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55642500adf0 0x556424f7fd40 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff20c018c00 tx=0x7ff20c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4d01507beebf2f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.659+0000 7ff101e0b640 1 -- 172.21.15.62:0/964702575 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff20c0af040 con 0x55642500adf0 2024-09-10T05:36:38.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.659+0000 7ff101e0b640 1 -- 172.21.15.62:0/964702575 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff20c0aaa00 con 0x55642500adf0 2024-09-10T05:36:38.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.659+0000 7ff101e0b640 1 -- 172.21.15.62:0/964702575 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff20c0aace0 con 0x55642500adf0 2024-09-10T05:36:38.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.659+0000 7ff2160859c0 1 -- 172.21.15.62:0/964702575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55642500adf0 msgr2=0x556424f7fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.659+0000 7ff2160859c0 1 --2- 172.21.15.62:0/964702575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55642500adf0 0x556424f7fd40 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff20c018c00 tx=0x7ff20c0033b0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.659+0000 7ff2160859c0 1 -- 172.21.15.62:0/964702575 shutdown_connections 2024-09-10T05:36:38.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.659+0000 7ff2160859c0 1 --2- 172.21.15.62:0/964702575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55642500adf0 0x556424f7fd40 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.659+0000 7ff2160859c0 1 -- 172.21.15.62:0/964702575 >> 172.21.15.62:0/964702575 conn(0x556425006910 msgr2=0x5564250f2190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:38.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.659+0000 7ff2160859c0 1 -- 172.21.15.62:0/964702575 shutdown_connections 2024-09-10T05:36:38.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.659+0000 7ff2160859c0 1 -- 172.21.15.62:0/964702575 wait complete. 2024-09-10T05:36:38.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.663+0000 7ff2160859c0 1 Processor -- start 2024-09-10T05:36:38.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.663+0000 7ff2160859c0 1 -- start start 2024-09-10T05:36:38.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.663+0000 7ff2160859c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55642500adf0 0x5564250f7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.663+0000 7ff2160859c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556424eb6a50 con 0x55642500adf0 2024-09-10T05:36:38.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.663+0000 7ff213b8b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55642500adf0 0x5564250f7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.663+0000 7ff213b8b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55642500adf0 0x5564250f7ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47856/0 (socket says 172.21.15.62:47856) 2024-09-10T05:36:38.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.663+0000 7ff213b8b640 1 -- 172.21.15.62:0/439816053 learned_addr learned my addr 172.21.15.62:0/439816053 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:38.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.663+0000 7ff213b8b640 1 -- 172.21.15.62:0/439816053 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564250f8040 con 0x55642500adf0 2024-09-10T05:36:38.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.663+0000 7ff213b8b640 1 --2- 172.21.15.62:0/439816053 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55642500adf0 0x5564250f7ae0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7ff20c018c00 tx=0x7ff20c017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.663+0000 7ff0fbfff640 1 -- 172.21.15.62:0/439816053 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff20c0c5070 con 0x55642500adf0 2024-09-10T05:36:38.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.663+0000 7ff2160859c0 1 -- 172.21.15.62:0/439816053 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5564250f6420 con 0x55642500adf0 2024-09-10T05:36:38.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.663+0000 7ff2160859c0 1 -- 172.21.15.62:0/439816053 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564250f6a10 con 0x55642500adf0 2024-09-10T05:36:38.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.663+0000 7ff0fbfff640 1 -- 172.21.15.62:0/439816053 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff20c0c1690 con 0x55642500adf0 2024-09-10T05:36:38.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.663+0000 7ff0fbfff640 1 -- 172.21.15.62:0/439816053 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff20c0c1970 con 0x55642500adf0 2024-09-10T05:36:38.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.663+0000 7ff0fbfff640 1 -- 172.21.15.62:0/439816053 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff20c0c1b10 con 0x55642500adf0 2024-09-10T05:36:38.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.663+0000 7ff0fbfff640 1 --2- 172.21.15.62:0/439816053 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff0fc039ac0 0x7ff0fc03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.663+0000 7ff0fbfff640 1 -- 172.21.15.62:0/439816053 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7ff20c0bb070 con 0x55642500adf0 2024-09-10T05:36:38.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.663+0000 7ff21338a640 1 --2- 172.21.15.62:0/439816053 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff0fc039ac0 0x7ff0fc03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.663+0000 7ff2160859c0 1 --2- 172.21.15.62:0/439816053 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55642500dfd0 0x556425107fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.663+0000 7ff2160859c0 1 -- 172.21.15.62:0/439816053 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5564251084f0 con 0x55642500dfd0 2024-09-10T05:36:38.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.663+0000 7ff21438c640 1 --2- 172.21.15.62:0/439816053 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55642500dfd0 0x556425107fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.667+0000 7ff21338a640 1 --2- 172.21.15.62:0/439816053 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff0fc039ac0 0x7ff0fc03bf80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff208004180 tx=0x7ff208001340 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.667+0000 7ff21438c640 1 --2- 172.21.15.62:0/439816053 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55642500dfd0 0x556425107fb0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.667+0000 7ff21438c640 1 -- 172.21.15.62:0/439816053 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff2040083f0 con 0x55642500dfd0 2024-09-10T05:36:38.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.667+0000 7ff2160859c0 1 --2- 172.21.15.62:0/439816053 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x556425108f10 0x55642510b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.667+0000 7ff2160859c0 1 -- 172.21.15.62:0/439816053 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55642510bb10 con 0x556425108f10 2024-09-10T05:36:38.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.667+0000 7ff213b8b640 1 --2- 172.21.15.62:0/439816053 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x556425108f10 0x55642510b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.667+0000 7ff213b8b640 1 --2- 172.21.15.62:0/439816053 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x556425108f10 0x55642510b3a0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.667+0000 7ff213b8b640 1 -- 172.21.15.62:0/439816053 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff20c0c7070 con 0x556425108f10 2024-09-10T05:36:38.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.667+0000 7ff2160859c0 1 --2- 172.21.15.62:0/439816053 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55642510d8d0 0x55642510fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.667+0000 7ff2160859c0 1 -- 172.21.15.62:0/439816053 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556425110390 con 0x55642510d8d0 2024-09-10T05:36:38.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.667+0000 7ff21338a640 1 --2- 172.21.15.62:0/439816053 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55642510d8d0 0x55642510fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.667+0000 7ff21338a640 1 --2- 172.21.15.62:0/439816053 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55642510d8d0 0x55642510fcc0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.667+0000 7ff21338a640 1 -- 172.21.15.62:0/439816053 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff20800e6c0 con 0x55642510d8d0 2024-09-10T05:36:38.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.667+0000 7ff2160859c0 1 -- 172.21.15.62:0/439816053 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55642510c770 con 0x556425108f10 2024-09-10T05:36:38.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.671+0000 7ff213b8b640 1 -- 172.21.15.62:0/439816053 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff20c0c7070 con 0x556425108f10 2024-09-10T05:36:38.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.671+0000 7ff2160859c0 1 -- 172.21.15.62:0/439816053 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55642510cbb0 con 0x55642510d8d0 2024-09-10T05:36:38.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.671+0000 7ff21338a640 1 -- 172.21.15.62:0/439816053 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff20800e6c0 con 0x55642510d8d0 2024-09-10T05:36:38.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.671+0000 7ff2160859c0 1 Processor -- start 2024-09-10T05:36:38.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.671+0000 7ff2160859c0 1 -- start start 2024-09-10T05:36:38.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.671+0000 7ff2160859c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55642511ea20 0x55642511ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.671+0000 7ff2160859c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556424f21450 con 0x55642511ea20 2024-09-10T05:36:38.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.671+0000 7ff213b8b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55642511ea20 0x55642511ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.671+0000 7ff213b8b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55642511ea20 0x55642511ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47866/0 (socket says 172.21.15.62:47866) 2024-09-10T05:36:38.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.671+0000 7ff213b8b640 1 -- 172.21.15.62:0/1932694227 learned_addr learned my addr 172.21.15.62:0/1932694227 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:38.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.671+0000 7ff213b8b640 1 -- 172.21.15.62:0/1932694227 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55642511f480 con 0x55642511ea20 2024-09-10T05:36:38.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.671+0000 7ff213b8b640 1 --2- 172.21.15.62:0/1932694227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55642511ea20 0x55642511ee40 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7ff20c0bfaa0 tx=0x7ff20c0c0f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.671+0000 7ff0f97fa640 1 -- 172.21.15.62:0/1932694227 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff20c0d9070 con 0x55642511ea20 2024-09-10T05:36:38.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.671+0000 7ff0f97fa640 1 -- 172.21.15.62:0/1932694227 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff20c0b3c40 con 0x55642511ea20 2024-09-10T05:36:38.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.671+0000 7ff2160859c0 1 -- 172.21.15.62:0/1932694227 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55642511fce0 con 0x55642511ea20 2024-09-10T05:36:38.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.671+0000 7ff0f97fa640 1 -- 172.21.15.62:0/1932694227 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff20c0b3370 con 0x55642511ea20 2024-09-10T05:36:38.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.671+0000 7ff2160859c0 1 -- 172.21.15.62:0/1932694227 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556425120250 con 0x55642511ea20 2024-09-10T05:36:38.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.675+0000 7ff0f97fa640 1 -- 172.21.15.62:0/1932694227 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff20c0b3510 con 0x55642511ea20 2024-09-10T05:36:38.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.675+0000 7ff0f97fa640 1 --2- 172.21.15.62:0/1932694227 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff0ec039ac0 0x7ff0ec03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.675+0000 7ff0f97fa640 1 -- 172.21.15.62:0/1932694227 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7ff20c0c2020 con 0x55642511ea20 2024-09-10T05:36:38.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.675+0000 7ff21338a640 1 --2- 172.21.15.62:0/1932694227 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff0ec039ac0 0x7ff0ec03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.675+0000 7ff2160859c0 1 Processor -- start 2024-09-10T05:36:38.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.675+0000 7ff2160859c0 1 -- start start 2024-09-10T05:36:38.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.675+0000 7ff21338a640 1 --2- 172.21.15.62:0/1932694227 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff0ec039ac0 0x7ff0ec03bf80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff20800c010 tx=0x7ff20800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.675+0000 7ff2160859c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55642512b160 0x55642512b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.675+0000 7ff2160859c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556424f804d0 con 0x55642512b160 2024-09-10T05:36:38.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.675+0000 7ff213b8b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55642512b160 0x55642512b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.675+0000 7ff213b8b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55642512b160 0x55642512b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47868/0 (socket says 172.21.15.62:47868) 2024-09-10T05:36:38.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.675+0000 7ff213b8b640 1 -- 172.21.15.62:0/3833595778 learned_addr learned my addr 172.21.15.62:0/3833595778 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:38.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.675+0000 7ff213b8b640 1 -- 172.21.15.62:0/3833595778 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55642512bb10 con 0x55642512b160 2024-09-10T05:36:38.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.675+0000 7ff213b8b640 1 --2- 172.21.15.62:0/3833595778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55642512b160 0x55642512b540 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ff20c0aaee0 tx=0x7ff20c0b4eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35c096a396c1f032 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.675+0000 7ff0f2ffd640 1 -- 172.21.15.62:0/3833595778 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff20c0be370 con 0x55642512b160 2024-09-10T05:36:38.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.675+0000 7ff0f2ffd640 1 -- 172.21.15.62:0/3833595778 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff20c0bd2f0 con 0x55642512b160 2024-09-10T05:36:38.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.675+0000 7ff0f2ffd640 1 -- 172.21.15.62:0/3833595778 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff20c0d5450 con 0x55642512b160 2024-09-10T05:36:38.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.675+0000 7ff2160859c0 1 -- 172.21.15.62:0/3833595778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55642512b160 msgr2=0x55642512b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.675+0000 7ff2160859c0 1 --2- 172.21.15.62:0/3833595778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55642512b160 0x55642512b540 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ff20c0aaee0 tx=0x7ff20c0b4eb0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.675+0000 7ff2160859c0 1 -- 172.21.15.62:0/3833595778 shutdown_connections 2024-09-10T05:36:38.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.675+0000 7ff2160859c0 1 --2- 172.21.15.62:0/3833595778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55642512b160 0x55642512b540 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.675+0000 7ff2160859c0 1 -- 172.21.15.62:0/3833595778 >> 172.21.15.62:0/3833595778 conn(0x556425127590 msgr2=0x5564251257d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:38.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.675+0000 7ff2160859c0 1 -- 172.21.15.62:0/3833595778 shutdown_connections 2024-09-10T05:36:38.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.675+0000 7ff2160859c0 1 -- 172.21.15.62:0/3833595778 wait complete. 2024-09-10T05:36:38.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.675+0000 7ff2160859c0 1 Processor -- start 2024-09-10T05:36:38.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.675+0000 7ff2160859c0 1 -- start start 2024-09-10T05:36:38.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.675+0000 7ff2160859c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55642512b160 0x556425132470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.675+0000 7ff2160859c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55642512bff0 con 0x55642512b160 2024-09-10T05:36:38.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.679+0000 7ff213b8b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55642512b160 0x556425132470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.679+0000 7ff213b8b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55642512b160 0x556425132470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47882/0 (socket says 172.21.15.62:47882) 2024-09-10T05:36:38.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.679+0000 7ff213b8b640 1 -- 172.21.15.62:0/4201265066 learned_addr learned my addr 172.21.15.62:0/4201265066 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:38.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.679+0000 7ff213b8b640 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564251329d0 con 0x55642512b160 2024-09-10T05:36:38.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.679+0000 7ff213b8b640 1 --2- 172.21.15.62:0/4201265066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55642512b160 0x556425132470 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ff20c0bee20 tx=0x7ff20c0e2900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.679+0000 7ff0f17fa640 1 -- 172.21.15.62:0/4201265066 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff20c10c020 con 0x55642512b160 2024-09-10T05:36:38.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.679+0000 7ff0f17fa640 1 -- 172.21.15.62:0/4201265066 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff20c0bd2f0 con 0x55642512b160 2024-09-10T05:36:38.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.679+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5564251329d0 con 0x55642512b160 2024-09-10T05:36:38.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.679+0000 7ff0f17fa640 1 -- 172.21.15.62:0/4201265066 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff20c0d5b40 con 0x55642512b160 2024-09-10T05:36:38.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.679+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564251329d0 con 0x55642512b160 2024-09-10T05:36:38.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.679+0000 7ff0f17fa640 1 -- 172.21.15.62:0/4201265066 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff20c10f020 con 0x55642512b160 2024-09-10T05:36:38.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.679+0000 7ff2160859c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.679+0000 7ff0f17fa640 1 --2- 172.21.15.62:0/4201265066 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff0dc039a70 0x7ff0dc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.679+0000 7ff0f17fa640 1 -- 172.21.15.62:0/4201265066 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7ff20c103070 con 0x55642512b160 2024-09-10T05:36:38.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.679+0000 7ff21338a640 1 --2- 172.21.15.62:0/4201265066 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff0dc039a70 0x7ff0dc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.679+0000 7ff2160859c0 1 --2- 172.21.15.62:0/4201265066 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55642513d400 0x55642513f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.679+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55642513ffe0 con 0x55642513d400 2024-09-10T05:36:38.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.679+0000 7ff21438c640 1 --2- 172.21.15.62:0/4201265066 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55642513d400 0x55642513f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.679+0000 7ff21338a640 1 --2- 172.21.15.62:0/4201265066 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff0dc039a70 0x7ff0dc03bf30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff20801d040 tx=0x7ff208010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.679+0000 7ff21438c640 1 --2- 172.21.15.62:0/4201265066 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55642513d400 0x55642513f890 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.683+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff2040083f0 con 0x55642513d400 2024-09-10T05:36:38.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.683+0000 7ff2160859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:38.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.683+0000 7ff2160859c0 20 realm 2024-09-10T05:36:38.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.683+0000 7ff2160859c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.683+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55642513c790 con 0x55642513d400 2024-09-10T05:36:38.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.683+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff2040083f0 con 0x55642513d400 2024-09-10T05:36:38.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.683+0000 7ff2160859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:38.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.683+0000 7ff2160859c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:38.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.683+0000 7ff2160859c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.683+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556425140ab0 con 0x55642513d400 2024-09-10T05:36:38.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.683+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff2040083f0 con 0x55642513d400 2024-09-10T05:36:38.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.683+0000 7ff2160859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:38.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.683+0000 7ff2160859c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.683+0000 7ff2160859c0 1 --2- 172.21.15.62:0/4201265066 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x556425141890 0x556425143c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.683+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556425144330 con 0x556425141890 2024-09-10T05:36:38.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.683+0000 7ff213b8b640 1 --2- 172.21.15.62:0/4201265066 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x556425141890 0x556425143c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.683+0000 7ff213b8b640 1 --2- 172.21.15.62:0/4201265066 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x556425141890 0x556425143c80 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.683+0000 7ff213b8b640 1 -- 172.21.15.62:0/4201265066 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff20c0c7070 con 0x556425141890 2024-09-10T05:36:38.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.683+0000 7ff2160859c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:38.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.683+0000 7ff2160859c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.683+0000 7ff2160859c0 1 --2- 172.21.15.62:0/4201265066 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x556425145090 0x5564251474a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.683+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556425147c30 con 0x556425145090 2024-09-10T05:36:38.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.683+0000 7ff21338a640 1 --2- 172.21.15.62:0/4201265066 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x556425145090 0x5564251474a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.683+0000 7ff21338a640 1 --2- 172.21.15.62:0/4201265066 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x556425145090 0x5564251474a0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.683+0000 7ff21338a640 1 -- 172.21.15.62:0/4201265066 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff208026070 con 0x556425145090 2024-09-10T05:36:38.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.683+0000 7ff2160859c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:38.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.683+0000 7ff2160859c0 20 searching for the correct realm 2024-09-10T05:36:38.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.683+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556425149500 con 0x556425145090 2024-09-10T05:36:38.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.687+0000 7ff21338a640 1 -- 172.21.15.62:0/4201265066 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff208026070 con 0x556425145090 2024-09-10T05:36:38.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.687+0000 7ff21338a640 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556425149500 con 0x556425141890 2024-09-10T05:36:38.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.687+0000 7ff213b8b640 1 -- 172.21.15.62:0/4201265066 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff20c0c7070 con 0x556425141890 2024-09-10T05:36:38.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.687+0000 7ff213b8b640 1 --2- 172.21.15.62:0/4201265066 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7ff20c111020 0x7ff20c0d8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.687+0000 7ff213b8b640 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556425149500 con 0x7ff20c111020 2024-09-10T05:36:38.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.687+0000 7ff21438c640 1 --2- 172.21.15.62:0/4201265066 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7ff20c111020 0x7ff20c0d8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.687+0000 7ff21438c640 1 --2- 172.21.15.62:0/4201265066 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7ff20c111020 0x7ff20c0d8880 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.687+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2040083f0 con 0x7ff20c111020 2024-09-10T05:36:38.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.687+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556425149500 con 0x55642513d400 2024-09-10T05:36:38.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.687+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2040083f0 con 0x55642513d400 2024-09-10T05:36:38.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.687+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556425149500 con 0x55642513d400 2024-09-10T05:36:38.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.687+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2040083f0 con 0x55642513d400 2024-09-10T05:36:38.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.687+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556425149500 con 0x556425145090 2024-09-10T05:36:38.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.687+0000 7ff21338a640 1 -- 172.21.15.62:0/4201265066 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff208026070 con 0x556425145090 2024-09-10T05:36:38.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.687+0000 7ff21338a640 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556425149500 con 0x55642513d400 2024-09-10T05:36:38.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.687+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2040083f0 con 0x55642513d400 2024-09-10T05:36:38.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.687+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556425149500 con 0x556425141890 2024-09-10T05:36:38.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.687+0000 7ff213b8b640 1 -- 172.21.15.62:0/4201265066 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff20c0c7070 con 0x556425141890 2024-09-10T05:36:38.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.687+0000 7ff213b8b640 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556425149500 con 0x556425141890 2024-09-10T05:36:38.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.691+0000 7ff213b8b640 1 -- 172.21.15.62:0/4201265066 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff20c0c7070 con 0x556425141890 2024-09-10T05:36:38.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.691+0000 7ff213b8b640 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556425149500 con 0x55642513d400 2024-09-10T05:36:38.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.691+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2040083f0 con 0x55642513d400 2024-09-10T05:36:38.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.691+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556425149500 con 0x7ff20c111020 2024-09-10T05:36:38.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.691+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2040083f0 con 0x7ff20c111020 2024-09-10T05:36:38.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.691+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556425149500 con 0x55642513d400 2024-09-10T05:36:38.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.691+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2040083f0 con 0x55642513d400 2024-09-10T05:36:38.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.691+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556425149500 con 0x7ff20c111020 2024-09-10T05:36:38.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.691+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff2040083f0 con 0x7ff20c111020 2024-09-10T05:36:38.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.691+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556425149500 con 0x556425141890 2024-09-10T05:36:38.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.691+0000 7ff213b8b640 1 -- 172.21.15.62:0/4201265066 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff20c0c7070 con 0x556425141890 2024-09-10T05:36:38.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.691+0000 7ff213b8b640 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556425149500 con 0x556425145090 2024-09-10T05:36:38.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.691+0000 7ff21338a640 1 -- 172.21.15.62:0/4201265066 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff208026070 con 0x556425145090 2024-09-10T05:36:38.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.691+0000 7ff21338a640 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556425149500 con 0x55642513d400 2024-09-10T05:36:38.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.691+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2040083f0 con 0x55642513d400 2024-09-10T05:36:38.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.691+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556425149500 con 0x556425141890 2024-09-10T05:36:38.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.691+0000 7ff213b8b640 1 -- 172.21.15.62:0/4201265066 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff20c0c7070 con 0x556425141890 2024-09-10T05:36:38.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.691+0000 7ff213b8b640 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556425149500 con 0x556425145090 2024-09-10T05:36:38.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.691+0000 7ff21338a640 1 -- 172.21.15.62:0/4201265066 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 30 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7ff208026070 con 0x556425145090 2024-09-10T05:36:38.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.691+0000 7ff21338a640 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556425149500 con 0x55642513d400 2024-09-10T05:36:38.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.691+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2040083f0 con 0x55642513d400 2024-09-10T05:36:38.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.691+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556425149500 con 0x55642513d400 2024-09-10T05:36:38.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.695+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff2040083f0 con 0x55642513d400 2024-09-10T05:36:38.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.695+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556425149500 con 0x55642513d400 2024-09-10T05:36:38.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.695+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2040083f0 con 0x55642513d400 2024-09-10T05:36:38.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.695+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556425149500 con 0x556425145090 2024-09-10T05:36:38.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.695+0000 7ff21338a640 1 -- 172.21.15.62:0/4201265066 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff208026070 con 0x556425145090 2024-09-10T05:36:38.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.695+0000 7ff21338a640 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556425149500 con 0x7ff20c111020 2024-09-10T05:36:38.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.695+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2040083f0 con 0x7ff20c111020 2024-09-10T05:36:38.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.695+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556425149500 con 0x55642513d400 2024-09-10T05:36:38.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.695+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2040083f0 con 0x55642513d400 2024-09-10T05:36:38.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.695+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556425149500 con 0x7ff20c111020 2024-09-10T05:36:38.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.695+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2040083f0 con 0x7ff20c111020 2024-09-10T05:36:38.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.695+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556425149500 con 0x556425145090 2024-09-10T05:36:38.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.695+0000 7ff21338a640 1 -- 172.21.15.62:0/4201265066 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff208026070 con 0x556425145090 2024-09-10T05:36:38.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.695+0000 7ff21338a640 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556425149500 con 0x7ff20c111020 2024-09-10T05:36:38.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.695+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2040083f0 con 0x7ff20c111020 2024-09-10T05:36:38.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.695+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556425149500 con 0x556425141890 2024-09-10T05:36:38.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.695+0000 7ff213b8b640 1 -- 172.21.15.62:0/4201265066 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff20c0c7070 con 0x556425141890 2024-09-10T05:36:38.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.695+0000 7ff213b8b640 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556425149500 con 0x556425141890 2024-09-10T05:36:38.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.695+0000 7ff213b8b640 1 -- 172.21.15.62:0/4201265066 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff20c0c7070 con 0x556425141890 2024-09-10T05:36:38.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.695+0000 7ff213b8b640 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556425149500 con 0x556425145090 2024-09-10T05:36:38.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.695+0000 7ff21338a640 1 -- 172.21.15.62:0/4201265066 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff208026070 con 0x556425145090 2024-09-10T05:36:38.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.695+0000 7ff21338a640 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556425149500 con 0x556425141890 2024-09-10T05:36:38.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.699+0000 7ff213b8b640 1 -- 172.21.15.62:0/4201265066 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff20c0c7070 con 0x556425141890 2024-09-10T05:36:38.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.699+0000 7ff213b8b640 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556425149500 con 0x556425141890 2024-09-10T05:36:38.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.699+0000 7ff213b8b640 1 -- 172.21.15.62:0/4201265066 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff20c0c7070 con 0x556425141890 2024-09-10T05:36:38.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.699+0000 7ff2160859c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:38.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.699+0000 7ff2160859c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:38.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.699+0000 7ff2160859c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:38.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.699+0000 7ff2160859c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:38.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.699+0000 7ff2160859c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:38.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.699+0000 7ff2160859c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:38.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.699+0000 7ff2160859c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.699+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556425148620 con 0x55642513d400 2024-09-10T05:36:38.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.699+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff2040083f0 con 0x55642513d400 2024-09-10T05:36:38.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.699+0000 7ff2160859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:38.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.699+0000 7ff2160859c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.699+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556425148ec0 con 0x556425141890 2024-09-10T05:36:38.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.699+0000 7ff213b8b640 1 -- 172.21.15.62:0/4201265066 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff20c0c7070 con 0x556425141890 2024-09-10T05:36:38.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.699+0000 7ff2160859c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:38.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.699+0000 7ff2160859c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.699+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556425148260 con 0x556425145090 2024-09-10T05:36:38.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.699+0000 7ff21338a640 1 -- 172.21.15.62:0/4201265066 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff208026070 con 0x556425145090 2024-09-10T05:36:38.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.699+0000 7ff2160859c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:38.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.699+0000 7ff2160859c0 20 zone default found 2024-09-10T05:36:38.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.699+0000 7ff2160859c0 4 Realm: () 2024-09-10T05:36:38.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.699+0000 7ff2160859c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:38.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.699+0000 7ff2160859c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:38.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.699+0000 7ff2160859c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:38.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.699+0000 7ff2160859c0 20 zonegroup default 2024-09-10T05:36:38.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.699+0000 7ff2160859c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.699+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556425149930 con 0x7ff20c111020 2024-09-10T05:36:38.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.699+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff2040083f0 con 0x7ff20c111020 2024-09-10T05:36:38.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.699+0000 7ff2160859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:38.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.699+0000 7ff2160859c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.699+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55642514bbf0 con 0x556425145090 2024-09-10T05:36:38.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.699+0000 7ff21338a640 1 -- 172.21.15.62:0/4201265066 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff208026070 con 0x556425145090 2024-09-10T05:36:38.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.699+0000 7ff2160859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:38.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.699+0000 7ff2160859c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.699+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55642514bf90 con 0x556425145090 2024-09-10T05:36:38.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.699+0000 7ff21338a640 1 -- 172.21.15.62:0/4201265066 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff208026070 con 0x556425145090 2024-09-10T05:36:38.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.699+0000 7ff2160859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:38.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.699+0000 7ff2160859c0 20 started sync module instance, tier type = 2024-09-10T05:36:38.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.699+0000 7ff2160859c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:38.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.699+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642514b080 con 0x556425141890 2024-09-10T05:36:38.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.703+0000 7ff213b8b640 1 -- 172.21.15.62:0/4201265066 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff20c0c7070 con 0x556425141890 2024-09-10T05:36:38.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.703+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93888607204736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642514b080 con 0x556425141890 2024-09-10T05:36:38.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.703+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642514ca40 con 0x55642513d400 2024-09-10T05:36:38.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.703+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2040083f0 con 0x55642513d400 2024-09-10T05:36:38.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.703+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93888607208848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642514d290 con 0x55642513d400 2024-09-10T05:36:38.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.703+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642514dcb0 con 0x556425141890 2024-09-10T05:36:38.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.703+0000 7ff213b8b640 1 -- 172.21.15.62:0/4201265066 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 93888607204736] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff20c0c7070 con 0x556425141890 2024-09-10T05:36:38.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.707+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93888607208848] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2040083f0 con 0x55642513d400 2024-09-10T05:36:38.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.707+0000 7ff213b8b640 1 -- 172.21.15.62:0/4201265066 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff20c0c7070 con 0x556425141890 2024-09-10T05:36:38.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.707+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93888607213472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642514cde0 con 0x556425141890 2024-09-10T05:36:38.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.707+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642514e550 con 0x7ff20c111020 2024-09-10T05:36:38.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.707+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2040083f0 con 0x7ff20c111020 2024-09-10T05:36:38.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.707+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93888607215776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642514cde0 con 0x7ff20c111020 2024-09-10T05:36:38.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.707+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642514eff0 con 0x556425141890 2024-09-10T05:36:38.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.711+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93888607215776] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2040083f0 con 0x7ff20c111020 2024-09-10T05:36:38.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.711+0000 7ff213b8b640 1 -- 172.21.15.62:0/4201265066 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93888607213472] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff20c0c7070 con 0x556425141890 2024-09-10T05:36:38.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.711+0000 7ff213b8b640 1 -- 172.21.15.62:0/4201265066 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff20c0c7070 con 0x556425141890 2024-09-10T05:36:38.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.711+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93888607202256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642514efb0 con 0x556425141890 2024-09-10T05:36:38.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.711+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642514f3e0 con 0x556425145090 2024-09-10T05:36:38.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.711+0000 7ff21338a640 1 -- 172.21.15.62:0/4201265066 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff208026070 con 0x556425145090 2024-09-10T05:36:38.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.711+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93888607216832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642514f3e0 con 0x556425145090 2024-09-10T05:36:38.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.711+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5564251502e0 con 0x556425145090 2024-09-10T05:36:38.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.711+0000 7ff213b8b640 1 -- 172.21.15.62:0/4201265066 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 93888607202256] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff20c0c7070 con 0x556425141890 2024-09-10T05:36:38.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.715+0000 7ff21338a640 1 -- 172.21.15.62:0/4201265066 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93888607216832] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff208026070 con 0x556425145090 2024-09-10T05:36:38.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.715+0000 7ff21338a640 1 -- 172.21.15.62:0/4201265066 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff208026070 con 0x556425145090 2024-09-10T05:36:38.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.715+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93888607221712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642514fdf0 con 0x556425145090 2024-09-10T05:36:38.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.715+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556425150b80 con 0x7ff20c111020 2024-09-10T05:36:38.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.715+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2040083f0 con 0x7ff20c111020 2024-09-10T05:36:38.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.715+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93888607225552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642514fdf0 con 0x7ff20c111020 2024-09-10T05:36:38.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.715+0000 7ff2160859c0 20 add_watcher() i=0 2024-09-10T05:36:38.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.715+0000 7ff2160859c0 20 add_watcher() i=1 2024-09-10T05:36:38.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.715+0000 7ff2160859c0 20 add_watcher() i=2 2024-09-10T05:36:38.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.715+0000 7ff2160859c0 20 add_watcher() i=3 2024-09-10T05:36:38.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.715+0000 7ff2160859c0 20 add_watcher() i=4 2024-09-10T05:36:38.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.715+0000 7ff2160859c0 20 add_watcher() i=5 2024-09-10T05:36:38.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.715+0000 7ff21338a640 1 -- 172.21.15.62:0/4201265066 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93888607221712] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff208026070 con 0x556425145090 2024-09-10T05:36:38.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.715+0000 7ff2160859c0 20 add_watcher() i=6 2024-09-10T05:36:38.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.715+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93888607225552] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2040083f0 con 0x7ff20c111020 2024-09-10T05:36:38.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.715+0000 7ff2160859c0 20 add_watcher() i=7 2024-09-10T05:36:38.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.715+0000 7ff2160859c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:38.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.715+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55642514eae0 con 0x55642513d400 2024-09-10T05:36:38.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.715+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff2040083f0 con 0x55642513d400 2024-09-10T05:36:38.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.715+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93888607226608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642514eae0 con 0x55642513d400 2024-09-10T05:36:38.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.719+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93888607226608] v30'140 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff2040083f0 con 0x55642513d400 2024-09-10T05:36:38.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.719+0000 7ff0c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:38.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.719+0000 7ff2160859c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:38.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.719+0000 7ff2160859c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:38.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.719+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642515c520 con 0x556425141890 2024-09-10T05:36:38.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.723+0000 7ff213b8b640 1 -- 172.21.15.62:0/4201265066 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'46 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff20c0c7070 con 0x556425141890 2024-09-10T05:36:38.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.723+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642515c610 con 0x7ff20c111020 2024-09-10T05:36:38.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.723+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff2040083f0 con 0x7ff20c111020 2024-09-10T05:36:38.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.723+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642515cce0 con 0x556425145090 2024-09-10T05:36:38.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.723+0000 7ff21338a640 1 -- 172.21.15.62:0/4201265066 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff208026070 con 0x556425145090 2024-09-10T05:36:38.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.723+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642515d250 con 0x55642513d400 2024-09-10T05:36:38.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.727+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'141 uv12 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff2040083f0 con 0x55642513d400 2024-09-10T05:36:38.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.727+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642515d700 con 0x556425141890 2024-09-10T05:36:38.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.727+0000 7ff213b8b640 1 -- 172.21.15.62:0/4201265066 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'44 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff20c0c7070 con 0x556425141890 2024-09-10T05:36:38.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.727+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642515d700 con 0x556425145090 2024-09-10T05:36:38.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.731+0000 7ff21338a640 1 -- 172.21.15.62:0/4201265066 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'37 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff208026070 con 0x556425145090 2024-09-10T05:36:38.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.731+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642515bcc0 con 0x556425141890 2024-09-10T05:36:38.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.731+0000 7ff213b8b640 1 -- 172.21.15.62:0/4201265066 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff20c0c7070 con 0x556425141890 2024-09-10T05:36:38.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.731+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642515bcc0 con 0x55642513d400 2024-09-10T05:36:38.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.735+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'31 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff2040083f0 con 0x55642513d400 2024-09-10T05:36:38.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.735+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642515e260 con 0x556425141890 2024-09-10T05:36:38.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.735+0000 7ff213b8b640 1 -- 172.21.15.62:0/4201265066 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff20c0c7070 con 0x556425141890 2024-09-10T05:36:38.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.735+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642515e260 con 0x556425141890 2024-09-10T05:36:38.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.739+0000 7ff213b8b640 1 -- 172.21.15.62:0/4201265066 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'22 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff20c0c7070 con 0x556425141890 2024-09-10T05:36:38.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.739+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642515e260 con 0x556425141890 2024-09-10T05:36:38.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.743+0000 7ff213b8b640 1 -- 172.21.15.62:0/4201265066 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'45 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff20c0c7070 con 0x556425141890 2024-09-10T05:36:38.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.743+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642515e260 con 0x556425145090 2024-09-10T05:36:38.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.743+0000 7ff21338a640 1 -- 172.21.15.62:0/4201265066 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff208026070 con 0x556425145090 2024-09-10T05:36:38.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.743+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642515e260 con 0x556425141890 2024-09-10T05:36:38.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.743+0000 7ff213b8b640 1 -- 172.21.15.62:0/4201265066 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff20c0c7070 con 0x556425141890 2024-09-10T05:36:38.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.743+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642515e260 con 0x55642513d400 2024-09-10T05:36:38.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.747+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'43 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff2040083f0 con 0x55642513d400 2024-09-10T05:36:38.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.747+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642515e710 con 0x55642513d400 2024-09-10T05:36:38.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.747+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'142 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff2040083f0 con 0x55642513d400 2024-09-10T05:36:38.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.747+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642515e710 con 0x556425141890 2024-09-10T05:36:38.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.751+0000 7ff213b8b640 1 -- 172.21.15.62:0/4201265066 <== osd.0 v2:172.21.15.2:6800/945139080 25 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'39 uv16 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff20c0c7070 con 0x556425141890 2024-09-10T05:36:38.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.751+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642515e710 con 0x556425141890 2024-09-10T05:36:38.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.751+0000 7ff213b8b640 1 -- 172.21.15.62:0/4201265066 <== osd.0 v2:172.21.15.2:6800/945139080 26 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'46 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff20c0c7070 con 0x556425141890 2024-09-10T05:36:38.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.751+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642515e710 con 0x556425145090 2024-09-10T05:36:38.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.755+0000 7ff21338a640 1 -- 172.21.15.62:0/4201265066 <== osd.3 v2:172.21.15.62:6816/2708991149 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'28 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff208026070 con 0x556425145090 2024-09-10T05:36:38.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.755+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642515e710 con 0x556425141890 2024-09-10T05:36:38.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.755+0000 7ff213b8b640 1 -- 172.21.15.62:0/4201265066 <== osd.0 v2:172.21.15.2:6800/945139080 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff20c0c7070 con 0x556425141890 2024-09-10T05:36:38.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.755+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642515e710 con 0x55642513d400 2024-09-10T05:36:38.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.759+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 <== osd.1 v2:172.21.15.62:6808/3442097179 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'143 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff2040083f0 con 0x55642513d400 2024-09-10T05:36:38.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.759+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642515e710 con 0x556425141890 2024-09-10T05:36:38.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.763+0000 7ff213b8b640 1 -- 172.21.15.62:0/4201265066 <== osd.0 v2:172.21.15.2:6800/945139080 28 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'40 uv18 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff20c0c7070 con 0x556425141890 2024-09-10T05:36:38.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.763+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642515e710 con 0x556425141890 2024-09-10T05:36:38.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.763+0000 7ff213b8b640 1 -- 172.21.15.62:0/4201265066 <== osd.0 v2:172.21.15.2:6800/945139080 29 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'32 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff20c0c7070 con 0x556425141890 2024-09-10T05:36:38.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.763+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642515e710 con 0x556425145090 2024-09-10T05:36:38.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.767+0000 7ff21338a640 1 -- 172.21.15.62:0/4201265066 <== osd.3 v2:172.21.15.62:6816/2708991149 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'24 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff208026070 con 0x556425145090 2024-09-10T05:36:38.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.767+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642515e840 con 0x556425141890 2024-09-10T05:36:38.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.767+0000 7ff213b8b640 1 -- 172.21.15.62:0/4201265066 <== osd.0 v2:172.21.15.2:6800/945139080 30 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'35 uv18 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff20c0c7070 con 0x556425141890 2024-09-10T05:36:38.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.767+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642515e840 con 0x556425145090 2024-09-10T05:36:38.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.771+0000 7ff21338a640 1 -- 172.21.15.62:0/4201265066 <== osd.3 v2:172.21.15.62:6816/2708991149 21 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff208026070 con 0x556425145090 2024-09-10T05:36:38.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.771+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642515e840 con 0x556425145090 2024-09-10T05:36:38.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.771+0000 7ff21338a640 1 -- 172.21.15.62:0/4201265066 <== osd.3 v2:172.21.15.62:6816/2708991149 22 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'38 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff208026070 con 0x556425145090 2024-09-10T05:36:38.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.771+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642515e840 con 0x556425145090 2024-09-10T05:36:38.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.775+0000 7ff21338a640 1 -- 172.21.15.62:0/4201265066 <== osd.3 v2:172.21.15.62:6816/2708991149 23 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'24 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff208026070 con 0x556425145090 2024-09-10T05:36:38.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.775+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642515e840 con 0x556425141890 2024-09-10T05:36:38.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.779+0000 7ff213b8b640 1 -- 172.21.15.62:0/4201265066 <== osd.0 v2:172.21.15.2:6800/945139080 31 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'28 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff20c0c7070 con 0x556425141890 2024-09-10T05:36:38.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.779+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642515e840 con 0x55642513d400 2024-09-10T05:36:38.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.779+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 <== osd.1 v2:172.21.15.62:6808/3442097179 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'32 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff2040083f0 con 0x55642513d400 2024-09-10T05:36:38.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.779+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642515ee50 con 0x556425141890 2024-09-10T05:36:38.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.783+0000 7ff213b8b640 1 -- 172.21.15.62:0/4201265066 <== osd.0 v2:172.21.15.2:6800/945139080 32 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'41 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff20c0c7070 con 0x556425141890 2024-09-10T05:36:38.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.783+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642515b510 con 0x55642513d400 2024-09-10T05:36:38.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.783+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 <== osd.1 v2:172.21.15.62:6808/3442097179 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'44 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff2040083f0 con 0x55642513d400 2024-09-10T05:36:38.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.783+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642515b510 con 0x7ff20c111020 2024-09-10T05:36:38.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.787+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff2040083f0 con 0x7ff20c111020 2024-09-10T05:36:38.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.787+0000 7ff0c8fe1640 20 reqs_thread_entry: start 2024-09-10T05:36:38.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.787+0000 7ff2160859c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:38.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.787+0000 7ff2160859c0 20 Filter name: none 2024-09-10T05:36:38.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.787+0000 7ff0427fc640 20 reqs_thread_entry: start 2024-09-10T05:36:38.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.787+0000 7ff2160859c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-10T05:36:38.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.787+0000 7ff2160859c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.787+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:94 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55642515b1a0 con 0x556425145090 2024-09-10T05:36:38.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.787+0000 7ff21338a640 1 -- 172.21.15.62:0/4201265066 <== osd.3 v2:172.21.15.62:6816/2708991149 24 ==== osd_op_reply(94 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7ff208026070 con 0x556425145090 2024-09-10T05:36:38.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.787+0000 7ff2160859c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-10T05:36:38.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.787+0000 7ff2160859c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-10T05:36:38.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.787+0000 7ff2160859c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-10T05:36:38.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.787+0000 7ff2160859c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:36:38.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.787+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:95 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55642517bf40 con 0x55642513d400 2024-09-10T05:36:38.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.787+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 <== osd.1 v2:172.21.15.62:6808/3442097179 26 ==== osd_op_reply(95 testx$tenanteduser.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 170+0+15 (crc 0 0 0) 0x7ff2040083f0 con 0x55642513d400 2024-09-10T05:36:38.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.787+0000 7ff2160859c0 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-10T05:36:38.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.787+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556425179f20 con 0x556425145090 2024-09-10T05:36:38.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.791+0000 7ff21338a640 1 -- 172.21.15.62:0/4201265066 <== osd.3 v2:172.21.15.62:6816/2708991149 25 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v30'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7ff208026070 con 0x556425145090 2024-09-10T05:36:38.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.791+0000 7ff2160859c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-10T05:36:38.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.791+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 93888607267584 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55642517c810 con 0x556425141890 2024-09-10T05:36:38.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.791+0000 7ff213b8b640 1 -- 172.21.15.62:0/4201265066 <== osd.0 v2:172.21.15.2:6800/945139080 33 ==== watch-notify(notify (1) cookie 93888607213472 notify 128849018910 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55642515e260 con 0x556425141890 2024-09-10T05:36:38.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.791+0000 7ff0f2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018910 cookie 93888607213472 notifier 4563 bl.length()=170 2024-09-10T05:36:38.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.791+0000 7ff213b8b640 1 -- 172.21.15.62:0/4201265066 <== osd.0 v2:172.21.15.2:6800/945139080 34 ==== osd_op_reply(97 notify.2 [notify cookie 93888607267584 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff20c0c7070 con 0x556425141890 2024-09-10T05:36:38.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.791+0000 7ff0f2ffd640 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7ff0d8003d70 con 0x556425141890 2024-09-10T05:36:38.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.791+0000 7ff213b8b640 1 -- 172.21.15.62:0/4201265066 <== osd.0 v2:172.21.15.2:6800/945139080 35 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff20c0c7070 con 0x556425141890 2024-09-10T05:36:38.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.791+0000 7ff213b8b640 1 -- 172.21.15.62:0/4201265066 <== osd.0 v2:172.21.15.2:6800/945139080 36 ==== watch-notify(notify_complete (2) cookie 93888607267584 notify 128849018910 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55642511f480 con 0x556425141890 2024-09-10T05:36:38.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.791+0000 7ff2160859c0 10 removing email index: 2024-09-10T05:36:38.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.791+0000 7ff2160859c0 10 removing user buckets index 2024-09-10T05:36:38.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.791+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:99 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642515ab00 con 0x55642513d400 2024-09-10T05:36:38.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.795+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 <== osd.1 v2:172.21.15.62:6808/3442097179 27 ==== osd_op_reply(99 testx$tenanteduser.buckets [delete] v30'3 uv3 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7ff2040083f0 con 0x55642513d400 2024-09-10T05:36:38.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.795+0000 7ff2160859c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2024-09-10T05:36:38.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.795+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [notify cookie 93888607267584 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55642517c810 con 0x556425141890 2024-09-10T05:36:38.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.795+0000 7ff213b8b640 1 -- 172.21.15.62:0/4201265066 <== osd.0 v2:172.21.15.2:6800/945139080 37 ==== watch-notify(notify (1) cookie 93888607202256 notify 128849018911 ret 0) ==== 217+0+0 (crc 0 0 0) 0x55642511f480 con 0x556425141890 2024-09-10T05:36:38.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.795+0000 7ff0f2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018911 cookie 93888607202256 notifier 4563 bl.length()=175 2024-09-10T05:36:38.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.795+0000 7ff213b8b640 1 -- 172.21.15.62:0/4201265066 <== osd.0 v2:172.21.15.2:6800/945139080 38 ==== osd_op_reply(100 notify.4 [notify cookie 93888607267584 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff20c0c7070 con 0x556425141890 2024-09-10T05:36:38.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.795+0000 7ff0f2ffd640 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7ff0d8003d70 con 0x556425141890 2024-09-10T05:36:38.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.795+0000 7ff213b8b640 1 -- 172.21.15.62:0/4201265066 <== osd.0 v2:172.21.15.2:6800/945139080 39 ==== watch-notify(notify_complete (2) cookie 93888607267584 notify 128849018911 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5564250f6a10 con 0x556425141890 2024-09-10T05:36:38.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.795+0000 7ff213b8b640 1 -- 172.21.15.62:0/4201265066 <== osd.0 v2:172.21.15.2:6800/945139080 40 ==== osd_op_reply(101 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff20c0c7070 con 0x556425141890 2024-09-10T05:36:38.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.795+0000 7ff2160859c0 10 removing user index: testx$tenanteduser 2024-09-10T05:36:38.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.795+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:102 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642517e830 con 0x556425145090 2024-09-10T05:36:38.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.795+0000 7ff21338a640 1 -- 172.21.15.62:0/4201265066 <== osd.3 v2:172.21.15.62:6816/2708991149 26 ==== osd_op_reply(102 testx$tenanteduser [call,call,delete] v30'8 uv8 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7ff208026070 con 0x556425145090 2024-09-10T05:36:38.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.795+0000 7ff2160859c0 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2024-09-10T05:36:38.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.795+0000 7ff2160859c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-10T05:36:38.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.795+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:103 7.e 7:7759931f:::notify.3:head [notify cookie 93888607395616 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55642517b800 con 0x7ff20c111020 2024-09-10T05:36:38.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.799+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== watch-notify(notify (1) cookie 93888607215776 notify 128849018889 ret 0) ==== 209+0+0 (crc 0 0 0) 0x55642515c2d0 con 0x7ff20c111020 2024-09-10T05:36:38.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.799+0000 7ff0f2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018889 cookie 93888607215776 notifier 4563 bl.length()=167 2024-09-10T05:36:38.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.799+0000 7ff0f2ffd640 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7ff0d8003d70 con 0x7ff20c111020 2024-09-10T05:36:38.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.799+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 <== osd.2 v2:172.21.15.62:6800/2677868286 15 ==== osd_op_reply(103 notify.3 [notify cookie 93888607395616 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff2040083f0 con 0x7ff20c111020 2024-09-10T05:36:38.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.799+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 <== osd.2 v2:172.21.15.62:6800/2677868286 16 ==== watch-notify(notify_complete (2) cookie 93888607395616 notify 128849018889 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55642515c060 con 0x7ff20c111020 2024-09-10T05:36:38.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.799+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 <== osd.2 v2:172.21.15.62:6800/2677868286 17 ==== osd_op_reply(104 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2040083f0 con 0x7ff20c111020 2024-09-10T05:36:38.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.799+0000 7ff0c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:38.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.799+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93888607226608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556425159920 con 0x55642513d400 2024-09-10T05:36:38.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.803+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 <== osd.1 v2:172.21.15.62:6808/3442097179 28 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 93888607226608] v30'144 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff2040083f0 con 0x55642513d400 2024-09-10T05:36:38.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.803+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93888607204736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556425150af0 con 0x556425141890 2024-09-10T05:36:38.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.803+0000 7ff213b8b640 1 -- 172.21.15.62:0/4201265066 <== osd.0 v2:172.21.15.2:6800/945139080 41 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 93888607204736] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff20c0c7070 con 0x556425141890 2024-09-10T05:36:38.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.803+0000 7ff2160859c0 20 remove_watcher() i=0 2024-09-10T05:36:38.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.803+0000 7ff2160859c0 2 removed watcher, disabling cache 2024-09-10T05:36:38.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.803+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93888607208848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556425150af0 con 0x55642513d400 2024-09-10T05:36:38.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.807+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 <== osd.1 v2:172.21.15.62:6808/3442097179 29 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 93888607208848] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2040083f0 con 0x55642513d400 2024-09-10T05:36:38.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.807+0000 7ff2160859c0 20 remove_watcher() i=1 2024-09-10T05:36:38.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.807+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93888607213472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556425150af0 con 0x556425141890 2024-09-10T05:36:38.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.807+0000 7ff213b8b640 1 -- 172.21.15.62:0/4201265066 <== osd.0 v2:172.21.15.2:6800/945139080 42 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 93888607213472] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff20c0c7070 con 0x556425141890 2024-09-10T05:36:38.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.807+0000 7ff2160859c0 20 remove_watcher() i=2 2024-09-10T05:36:38.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.807+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93888607215776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556425150af0 con 0x7ff20c111020 2024-09-10T05:36:38.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.807+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 <== osd.2 v2:172.21.15.62:6800/2677868286 18 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 93888607215776] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2040083f0 con 0x7ff20c111020 2024-09-10T05:36:38.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.807+0000 7ff2160859c0 20 remove_watcher() i=3 2024-09-10T05:36:38.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.807+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93888607202256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642514e0a0 con 0x556425141890 2024-09-10T05:36:38.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.811+0000 7ff213b8b640 1 -- 172.21.15.62:0/4201265066 <== osd.0 v2:172.21.15.2:6800/945139080 43 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 93888607202256] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff20c0c7070 con 0x556425141890 2024-09-10T05:36:38.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.811+0000 7ff2160859c0 20 remove_watcher() i=4 2024-09-10T05:36:38.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.811+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93888607216832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556425150af0 con 0x556425145090 2024-09-10T05:36:38.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.811+0000 7ff21338a640 1 -- 172.21.15.62:0/4201265066 <== osd.3 v2:172.21.15.62:6816/2708991149 27 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 93888607216832] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff208026070 con 0x556425145090 2024-09-10T05:36:38.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.811+0000 7ff2160859c0 20 remove_watcher() i=5 2024-09-10T05:36:38.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.811+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93888607221712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642514abd0 con 0x556425145090 2024-09-10T05:36:38.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.815+0000 7ff21338a640 1 -- 172.21.15.62:0/4201265066 <== osd.3 v2:172.21.15.62:6816/2708991149 28 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 93888607221712] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff208026070 con 0x556425145090 2024-09-10T05:36:38.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.815+0000 7ff2160859c0 20 remove_watcher() i=6 2024-09-10T05:36:38.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.815+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93888607225552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642514f7d0 con 0x7ff20c111020 2024-09-10T05:36:38.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.815+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 <== osd.2 v2:172.21.15.62:6800/2677868286 19 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 93888607225552] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2040083f0 con 0x7ff20c111020 2024-09-10T05:36:38.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.815+0000 7ff2160859c0 20 remove_watcher() i=7 2024-09-10T05:36:38.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.815+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x556425141890 msgr2=0x556425143c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.815+0000 7ff2160859c0 1 --2- 172.21.15.62:0/4201265066 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x556425141890 0x556425143c80 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.815+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55642513d400 msgr2=0x55642513f890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.815+0000 7ff2160859c0 1 --2- 172.21.15.62:0/4201265066 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55642513d400 0x55642513f890 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.815+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7ff20c111020 msgr2=0x7ff20c0d8880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.815+0000 7ff2160859c0 1 --2- 172.21.15.62:0/4201265066 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7ff20c111020 0x7ff20c0d8880 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.815+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x556425145090 msgr2=0x5564251474a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.815+0000 7ff2160859c0 1 --2- 172.21.15.62:0/4201265066 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x556425145090 0x5564251474a0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.815+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff0dc039a70 msgr2=0x7ff0dc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.815+0000 7ff2160859c0 1 --2- 172.21.15.62:0/4201265066 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff0dc039a70 0x7ff0dc03bf30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff20801d040 tx=0x7ff208010000 comp rx=0 tx=0).stop 2024-09-10T05:36:38.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.815+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55642512b160 msgr2=0x556425132470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.815+0000 7ff21438c640 1 -- 172.21.15.62:0/4201265066 reap_dead start 2024-09-10T05:36:38.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.815+0000 7ff2160859c0 1 --2- 172.21.15.62:0/4201265066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55642512b160 0x556425132470 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ff20c0bee20 tx=0x7ff20c0e2900 comp rx=0 tx=0).stop 2024-09-10T05:36:38.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.815+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 shutdown_connections 2024-09-10T05:36:38.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.815+0000 7ff2160859c0 1 --2- 172.21.15.62:0/4201265066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55642512b160 0x556425132470 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.815+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 >> 172.21.15.62:0/4201265066 conn(0x556425127590 msgr2=0x5564251257a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:38.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.815+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 shutdown_connections 2024-09-10T05:36:38.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.815+0000 7ff2160859c0 1 -- 172.21.15.62:0/4201265066 wait complete. 2024-09-10T05:36:38.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.819+0000 7ff2160859c0 1 -- 172.21.15.62:0/1932694227 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff0ec039ac0 msgr2=0x7ff0ec03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.819+0000 7ff2160859c0 1 --2- 172.21.15.62:0/1932694227 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff0ec039ac0 0x7ff0ec03bf80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff20800c010 tx=0x7ff20800f000 comp rx=0 tx=0).stop 2024-09-10T05:36:38.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.819+0000 7ff2160859c0 1 -- 172.21.15.62:0/1932694227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55642511ea20 msgr2=0x55642511ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.819+0000 7ff2160859c0 1 --2- 172.21.15.62:0/1932694227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55642511ea20 0x55642511ee40 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7ff20c0bfaa0 tx=0x7ff20c0c0f90 comp rx=0 tx=0).stop 2024-09-10T05:36:38.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.819+0000 7ff2160859c0 1 -- 172.21.15.62:0/1932694227 shutdown_connections 2024-09-10T05:36:38.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.819+0000 7ff2160859c0 1 --2- 172.21.15.62:0/1932694227 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff0ec039ac0 0x7ff0ec03bf80 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.819+0000 7ff2160859c0 1 --2- 172.21.15.62:0/1932694227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55642511ea20 0x55642511ee40 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.819+0000 7ff2160859c0 1 -- 172.21.15.62:0/1932694227 >> 172.21.15.62:0/1932694227 conn(0x5564251143d0 msgr2=0x5564251147b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:38.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.819+0000 7ff2160859c0 1 -- 172.21.15.62:0/1932694227 shutdown_connections 2024-09-10T05:36:38.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.819+0000 7ff2160859c0 1 -- 172.21.15.62:0/1932694227 wait complete. 2024-09-10T05:36:38.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.819+0000 7ff2160859c0 1 -- 172.21.15.62:0/439816053 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x556425108f10 msgr2=0x55642510b3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.819+0000 7ff2160859c0 1 --2- 172.21.15.62:0/439816053 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x556425108f10 0x55642510b3a0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.819+0000 7ff2160859c0 1 -- 172.21.15.62:0/439816053 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55642500dfd0 msgr2=0x556425107fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.819+0000 7ff2160859c0 1 --2- 172.21.15.62:0/439816053 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55642500dfd0 0x556425107fb0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.819+0000 7ff2160859c0 1 -- 172.21.15.62:0/439816053 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55642510d8d0 msgr2=0x55642510fcc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.819+0000 7ff2160859c0 1 --2- 172.21.15.62:0/439816053 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55642510d8d0 0x55642510fcc0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.819+0000 7ff2160859c0 1 -- 172.21.15.62:0/439816053 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff0fc039ac0 msgr2=0x7ff0fc03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.819+0000 7ff2160859c0 1 --2- 172.21.15.62:0/439816053 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff0fc039ac0 0x7ff0fc03bf80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff208004180 tx=0x7ff208001340 comp rx=0 tx=0).stop 2024-09-10T05:36:38.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.819+0000 7ff2160859c0 1 -- 172.21.15.62:0/439816053 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55642500adf0 msgr2=0x5564250f7ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.819+0000 7ff2160859c0 1 --2- 172.21.15.62:0/439816053 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55642500adf0 0x5564250f7ae0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7ff20c018c00 tx=0x7ff20c017d70 comp rx=0 tx=0).stop 2024-09-10T05:36:38.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.819+0000 7ff21438c640 1 -- 172.21.15.62:0/439816053 reap_dead start 2024-09-10T05:36:38.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.819+0000 7ff2160859c0 1 -- 172.21.15.62:0/439816053 shutdown_connections 2024-09-10T05:36:38.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.819+0000 7ff2160859c0 1 -- 172.21.15.62:0/439816053 >> 172.21.15.62:0/439816053 conn(0x556425006910 msgr2=0x5564250f0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:38.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.819+0000 7ff2160859c0 1 -- 172.21.15.62:0/439816053 shutdown_connections 2024-09-10T05:36:38.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.819+0000 7ff2160859c0 1 -- 172.21.15.62:0/439816053 wait complete. 2024-09-10T05:36:38.844 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-10T05:36:38.846 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2024-09-10T05:36:38.893 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T05:36:38.893 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-10T05:36:38.893 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-10T05:36:38.894 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2024-09-10T05:36:38.937 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:38.937 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:38.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.935+0000 7f3cdb69c9c0 1 Processor -- start 2024-09-10T05:36:38.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.935+0000 7f3cdb69c9c0 1 -- start start 2024-09-10T05:36:38.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.935+0000 7f3cdb69c9c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x561e56935340 0x561e56937730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.935+0000 7f3cdb69c9c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561e567e59c0 con 0x561e568a51f0 2024-09-10T05:36:38.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.935+0000 7f3cdb69c9c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x561e568356d0 con 0x561e56935340 2024-09-10T05:36:38.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.935+0000 7f3cd89a1640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x561e56935340 0x561e56937730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.935+0000 7f3cd89a1640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x561e56935340 0x561e56937730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47896/0 (socket says 172.21.15.62:47896) 2024-09-10T05:36:38.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.935+0000 7f3cd91a2640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x561e568a51f0 0x561e56933c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:53144/0 (socket says 172.21.15.62:53144) 2024-09-10T05:36:38.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.935+0000 7f3cd89a1640 1 -- 172.21.15.62:0/3702353181 learned_addr learned my addr 172.21.15.62:0/3702353181 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:38.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.935+0000 7f3cd89a1640 1 -- 172.21.15.62:0/3702353181 >> v1:172.21.15.2:6789/0 conn(0x561e568a51f0 legacy=0x561e56933c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.935+0000 7f3cd89a1640 1 -- 172.21.15.62:0/3702353181 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e567d9ca0 con 0x561e56935340 2024-09-10T05:36:38.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.939+0000 7f3cd89a1640 1 --2- 172.21.15.62:0/3702353181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e56935340 0x561e56937730 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f3cd000a5c0 tx=0x7f3cd001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b4374f2e65884dc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.939+0000 7f3ccbfff640 1 -- 172.21.15.62:0/3702353181 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3cd00b1070 con 0x561e56935340 2024-09-10T05:36:38.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.939+0000 7f3ccbfff640 1 -- 172.21.15.62:0/3702353181 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cd00a8070 con 0x561e56935340 2024-09-10T05:36:38.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.939+0000 7f3ccbfff640 1 -- 172.21.15.62:0/3702353181 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3cd00ac5b0 con 0x561e56935340 2024-09-10T05:36:38.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.939+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/3702353181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e56935340 msgr2=0x561e56937730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.939+0000 7f3cdb69c9c0 1 --2- 172.21.15.62:0/3702353181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e56935340 0x561e56937730 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f3cd000a5c0 tx=0x7f3cd001b340 comp rx=0 tx=0).stop 2024-09-10T05:36:38.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.939+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/3702353181 shutdown_connections 2024-09-10T05:36:38.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.939+0000 7f3cdb69c9c0 1 --2- 172.21.15.62:0/3702353181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e56935340 0x561e56937730 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.939+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/3702353181 >> 172.21.15.62:0/3702353181 conn(0x561e5692b910 msgr2=0x561e5692dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:38.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.939+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/3702353181 shutdown_connections 2024-09-10T05:36:38.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.939+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/3702353181 wait complete. 2024-09-10T05:36:38.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.955+0000 7f3cdb69c9c0 1 Processor -- start 2024-09-10T05:36:38.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.955+0000 7f3cdb69c9c0 1 -- start start 2024-09-10T05:36:38.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.955+0000 7f3cdb69c9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e568a51f0 0x561e56a1c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.955+0000 7f3cdb69c9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561e56839680 con 0x561e568a51f0 2024-09-10T05:36:38.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.955+0000 7f3cd91a2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e568a51f0 0x561e56a1c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.955+0000 7f3cd91a2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e568a51f0 0x561e56a1c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47898/0 (socket says 172.21.15.62:47898) 2024-09-10T05:36:38.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.955+0000 7f3cd91a2640 1 -- 172.21.15.62:0/1451010129 learned_addr learned my addr 172.21.15.62:0/1451010129 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:38.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.955+0000 7f3cd91a2640 1 -- 172.21.15.62:0/1451010129 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e567b4da0 con 0x561e568a51f0 2024-09-10T05:36:38.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.955+0000 7f3cd91a2640 1 --2- 172.21.15.62:0/1451010129 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e568a51f0 0x561e56a1c7b0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc001680 tx=0x7f3ccc001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24c2fb54e6f98cee server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.955+0000 7f3bc7606640 1 -- 172.21.15.62:0/1451010129 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ccc013420 con 0x561e568a51f0 2024-09-10T05:36:38.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.955+0000 7f3bc7606640 1 -- 172.21.15.62:0/1451010129 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ccc0135c0 con 0x561e568a51f0 2024-09-10T05:36:38.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.955+0000 7f3bc7606640 1 -- 172.21.15.62:0/1451010129 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ccc0138e0 con 0x561e568a51f0 2024-09-10T05:36:38.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.959+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1451010129 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e568a51f0 msgr2=0x561e56a1c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.959+0000 7f3cdb69c9c0 1 --2- 172.21.15.62:0/1451010129 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e568a51f0 0x561e56a1c7b0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc001680 tx=0x7f3ccc001b40 comp rx=0 tx=0).stop 2024-09-10T05:36:38.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.959+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1451010129 shutdown_connections 2024-09-10T05:36:38.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.959+0000 7f3cdb69c9c0 1 --2- 172.21.15.62:0/1451010129 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e568a51f0 0x561e56a1c7b0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.959+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1451010129 >> 172.21.15.62:0/1451010129 conn(0x561e5692b910 msgr2=0x561e56a183f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:38.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.959+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1451010129 shutdown_connections 2024-09-10T05:36:38.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.959+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1451010129 wait complete. 2024-09-10T05:36:38.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.959+0000 7f3cdb69c9c0 1 Processor -- start 2024-09-10T05:36:38.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.959+0000 7f3cdb69c9c0 1 -- start start 2024-09-10T05:36:38.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.959+0000 7f3cdb69c9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e568a51f0 0x561e56a23e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.959+0000 7f3cdb69c9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561e567dba50 con 0x561e568a51f0 2024-09-10T05:36:38.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.959+0000 7f3cd91a2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e568a51f0 0x561e56a23e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.959+0000 7f3cd91a2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e568a51f0 0x561e56a23e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47912/0 (socket says 172.21.15.62:47912) 2024-09-10T05:36:38.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.959+0000 7f3cd91a2640 1 -- 172.21.15.62:0/1917481126 learned_addr learned my addr 172.21.15.62:0/1917481126 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:38.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.959+0000 7f3cd91a2640 1 -- 172.21.15.62:0/1917481126 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e56a243e0 con 0x561e568a51f0 2024-09-10T05:36:38.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.959+0000 7f3cd91a2640 1 --2- 172.21.15.62:0/1917481126 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e568a51f0 0x561e56a23e80 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x561e56a1d740 tx=0x7f3ccc000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.959+0000 7f3bc5e03640 1 -- 172.21.15.62:0/1917481126 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ccc0037a0 con 0x561e568a51f0 2024-09-10T05:36:38.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.959+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1917481126 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561e56a24670 con 0x561e568a51f0 2024-09-10T05:36:38.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.959+0000 7f3bc5e03640 1 -- 172.21.15.62:0/1917481126 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ccc023070 con 0x561e568a51f0 2024-09-10T05:36:38.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.959+0000 7f3bc5e03640 1 -- 172.21.15.62:0/1917481126 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ccc003ad0 con 0x561e568a51f0 2024-09-10T05:36:38.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.959+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1917481126 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e56a25020 con 0x561e568a51f0 2024-09-10T05:36:38.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.963+0000 7f3bc5e03640 1 -- 172.21.15.62:0/1917481126 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f3ccc010070 con 0x561e568a51f0 2024-09-10T05:36:38.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.963+0000 7f3bc5e03640 1 --2- 172.21.15.62:0/1917481126 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3bc0039a70 0x7f3bc003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.963+0000 7f3bc5e03640 1 -- 172.21.15.62:0/1917481126 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f3ccc050020 con 0x561e568a51f0 2024-09-10T05:36:38.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.963+0000 7f3cd89a1640 1 --2- 172.21.15.62:0/1917481126 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3bc0039a70 0x7f3bc003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.963+0000 7f3cdb69c9c0 1 --2- 172.21.15.62:0/1917481126 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x561e56935340 0x561e56a2aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.963+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1917481126 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e56a2b530 con 0x561e56935340 2024-09-10T05:36:38.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.963+0000 7f3cd99a3640 1 --2- 172.21.15.62:0/1917481126 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x561e56935340 0x561e56a2aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.963+0000 7f3cd89a1640 1 --2- 172.21.15.62:0/1917481126 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3bc0039a70 0x7f3bc003bf30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3cd00ae000 tx=0x7f3cd00a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.963+0000 7f3cd99a3640 1 --2- 172.21.15.62:0/1917481126 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x561e56935340 0x561e56a2aff0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.963+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1917481126 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3cd40083f0 con 0x561e56935340 2024-09-10T05:36:38.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.963+0000 7f3cdb69c9c0 1 --2- 172.21.15.62:0/1917481126 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561e56a2c290 0x561e56a2e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.963+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1917481126 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e56a2ec70 con 0x561e56a2c290 2024-09-10T05:36:38.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.963+0000 7f3cd91a2640 1 --2- 172.21.15.62:0/1917481126 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561e56a2c290 0x561e56a2e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.963+0000 7f3cd91a2640 1 --2- 172.21.15.62:0/1917481126 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561e56a2c290 0x561e56a2e680 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.963+0000 7f3cd91a2640 1 -- 172.21.15.62:0/1917481126 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3ccc00f030 con 0x561e56a2c290 2024-09-10T05:36:38.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.963+0000 7f3cdb69c9c0 1 --2- 172.21.15.62:0/1917481126 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x561e56a30a30 0x561e56a32e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.963+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1917481126 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e56a33510 con 0x561e56a30a30 2024-09-10T05:36:38.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.963+0000 7f3cd89a1640 1 --2- 172.21.15.62:0/1917481126 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x561e56a30a30 0x561e56a32e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.967+0000 7f3cd89a1640 1 --2- 172.21.15.62:0/1917481126 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x561e56a30a30 0x561e56a32e20 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.967+0000 7f3cd89a1640 1 -- 172.21.15.62:0/1917481126 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3cd00b4040 con 0x561e56a30a30 2024-09-10T05:36:38.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.967+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1917481126 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e56a2f8d0 con 0x561e56a2c290 2024-09-10T05:36:38.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.967+0000 7f3cd91a2640 1 -- 172.21.15.62:0/1917481126 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3ccc00f030 con 0x561e56a2c290 2024-09-10T05:36:38.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.967+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1917481126 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e56a2fd30 con 0x561e56a30a30 2024-09-10T05:36:38.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.967+0000 7f3cd89a1640 1 -- 172.21.15.62:0/1917481126 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3cd00b4040 con 0x561e56a30a30 2024-09-10T05:36:38.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.967+0000 7f3cdb69c9c0 1 Processor -- start 2024-09-10T05:36:38.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.967+0000 7f3cdb69c9c0 1 -- start start 2024-09-10T05:36:38.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.967+0000 7f3cdb69c9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e56931380 0x561e5692fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.967+0000 7f3cdb69c9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561e56846450 con 0x561e56931380 2024-09-10T05:36:38.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.967+0000 7f3cd91a2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e56931380 0x561e5692fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.967+0000 7f3cd91a2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e56931380 0x561e5692fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47914/0 (socket says 172.21.15.62:47914) 2024-09-10T05:36:38.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.967+0000 7f3cd91a2640 1 -- 172.21.15.62:0/3208534768 learned_addr learned my addr 172.21.15.62:0/3208534768 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:38.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.967+0000 7f3cd91a2640 1 -- 172.21.15.62:0/3208534768 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e569318a0 con 0x561e56931380 2024-09-10T05:36:38.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.967+0000 7f3cd91a2640 1 --2- 172.21.15.62:0/3208534768 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e56931380 0x561e5692fc20 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc01dce0 tx=0x7f3ccc010df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.967+0000 7f3bbeffd640 1 -- 172.21.15.62:0/3208534768 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ccc045070 con 0x561e56931380 2024-09-10T05:36:38.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.971+0000 7f3bbeffd640 1 -- 172.21.15.62:0/3208534768 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ccc019040 con 0x561e56931380 2024-09-10T05:36:38.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.971+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/3208534768 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561e56930160 con 0x561e56931380 2024-09-10T05:36:38.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.971+0000 7f3bbeffd640 1 -- 172.21.15.62:0/3208534768 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ccc012700 con 0x561e56931380 2024-09-10T05:36:38.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.971+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/3208534768 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e569306d0 con 0x561e56931380 2024-09-10T05:36:38.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.971+0000 7f3bbeffd640 1 -- 172.21.15.62:0/3208534768 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f3ccc048070 con 0x561e56931380 2024-09-10T05:36:38.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.971+0000 7f3bbeffd640 1 --2- 172.21.15.62:0/3208534768 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3bb0039a70 0x7f3bb003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.971+0000 7f3bbeffd640 1 -- 172.21.15.62:0/3208534768 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f3ccc052b00 con 0x561e56931380 2024-09-10T05:36:38.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.971+0000 7f3cd89a1640 1 --2- 172.21.15.62:0/3208534768 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3bb0039a70 0x7f3bb003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.971+0000 7f3cdb69c9c0 1 Processor -- start 2024-09-10T05:36:38.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.971+0000 7f3cdb69c9c0 1 -- start start 2024-09-10T05:36:38.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.971+0000 7f3cdb69c9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e56a50520 0x561e56a50900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.971+0000 7f3cdb69c9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561e56a1d000 con 0x561e56a50520 2024-09-10T05:36:38.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.971+0000 7f3cd89a1640 1 --2- 172.21.15.62:0/3208534768 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3bb0039a70 0x7f3bb003bf30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x561e56a2f8a0 tx=0x7f3cd0005ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.971+0000 7f3cd91a2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e56a50520 0x561e56a50900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.971+0000 7f3cd91a2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e56a50520 0x561e56a50900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47922/0 (socket says 172.21.15.62:47922) 2024-09-10T05:36:38.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.971+0000 7f3cd91a2640 1 -- 172.21.15.62:0/2492332846 learned_addr learned my addr 172.21.15.62:0/2492332846 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:38.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.971+0000 7f3cd91a2640 1 -- 172.21.15.62:0/2492332846 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e56a50ef0 con 0x561e56a50520 2024-09-10T05:36:38.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.971+0000 7f3cd91a2640 1 --2- 172.21.15.62:0/2492332846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e56a50520 0x561e56a50900 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc01da60 tx=0x7f3ccc028ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8392ebbc374a16 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.971+0000 7f3bbcff9640 1 -- 172.21.15.62:0/2492332846 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ccc05c040 con 0x561e56a50520 2024-09-10T05:36:38.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.971+0000 7f3bbcff9640 1 -- 172.21.15.62:0/2492332846 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ccc050940 con 0x561e56a50520 2024-09-10T05:36:38.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.971+0000 7f3bbcff9640 1 -- 172.21.15.62:0/2492332846 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ccc0343f0 con 0x561e56a50520 2024-09-10T05:36:38.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.975+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/2492332846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e56a50520 msgr2=0x561e56a50900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:38.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.975+0000 7f3cdb69c9c0 1 --2- 172.21.15.62:0/2492332846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e56a50520 0x561e56a50900 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc01da60 tx=0x7f3ccc028ab0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.975+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/2492332846 shutdown_connections 2024-09-10T05:36:38.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.975+0000 7f3cdb69c9c0 1 --2- 172.21.15.62:0/2492332846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e56a50520 0x561e56a50900 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:38.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.975+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/2492332846 >> 172.21.15.62:0/2492332846 conn(0x561e56a4c970 msgr2=0x561e56a4abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:38.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.975+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/2492332846 shutdown_connections 2024-09-10T05:36:38.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.975+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/2492332846 wait complete. 2024-09-10T05:36:38.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.975+0000 7f3cdb69c9c0 1 Processor -- start 2024-09-10T05:36:38.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.975+0000 7f3cdb69c9c0 1 -- start start 2024-09-10T05:36:38.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.975+0000 7f3cdb69c9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e56a50520 0x561e56a57850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.975+0000 7f3cdb69c9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561e56a513b0 con 0x561e56a50520 2024-09-10T05:36:38.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.975+0000 7f3cd91a2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e56a50520 0x561e56a57850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.975+0000 7f3cd91a2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e56a50520 0x561e56a57850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47936/0 (socket says 172.21.15.62:47936) 2024-09-10T05:36:38.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.975+0000 7f3cd91a2640 1 -- 172.21.15.62:0/1464202765 learned_addr learned my addr 172.21.15.62:0/1464202765 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:38.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.975+0000 7f3cd91a2640 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e56a57db0 con 0x561e56a50520 2024-09-10T05:36:38.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.975+0000 7f3cd91a2640 1 --2- 172.21.15.62:0/1464202765 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e56a50520 0x561e56a57850 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc010750 tx=0x7f3ccc017f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.975+0000 7f3baeffd640 1 -- 172.21.15.62:0/1464202765 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ccc0360b0 con 0x561e56a50520 2024-09-10T05:36:38.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.975+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561e56a57db0 con 0x561e56a50520 2024-09-10T05:36:38.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.975+0000 7f3baeffd640 1 -- 172.21.15.62:0/1464202765 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ccc071070 con 0x561e56a50520 2024-09-10T05:36:38.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.975+0000 7f3baeffd640 1 -- 172.21.15.62:0/1464202765 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ccc011890 con 0x561e56a50520 2024-09-10T05:36:38.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.975+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e56a57db0 con 0x561e56a50520 2024-09-10T05:36:38.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.975+0000 7f3baeffd640 1 -- 172.21.15.62:0/1464202765 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f3ccc028460 con 0x561e56a50520 2024-09-10T05:36:38.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.979+0000 7f3baeffd640 1 --2- 172.21.15.62:0/1464202765 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3ba4039a70 0x7f3ba403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.979+0000 7f3baeffd640 1 -- 172.21.15.62:0/1464202765 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f3ccc016160 con 0x561e56a50520 2024-09-10T05:36:38.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.979+0000 7f3cdb69c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.979+0000 7f3cd89a1640 1 --2- 172.21.15.62:0/1464202765 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3ba4039a70 0x7f3ba403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.979+0000 7f3cdb69c9c0 1 --2- 172.21.15.62:0/1464202765 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x561e56a62830 0x561e56a64cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.979+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e56a65410 con 0x561e56a62830 2024-09-10T05:36:38.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.979+0000 7f3cd99a3640 1 --2- 172.21.15.62:0/1464202765 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x561e56a62830 0x561e56a64cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.979+0000 7f3cd89a1640 1 --2- 172.21.15.62:0/1464202765 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3ba4039a70 0x7f3ba403bf30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0000c10 tx=0x7f3cd00a8000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.979+0000 7f3cd99a3640 1 --2- 172.21.15.62:0/1464202765 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x561e56a62830 0x561e56a64cc0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.979+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3cd40083f0 con 0x561e56a62830 2024-09-10T05:36:38.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.979+0000 7f3cdb69c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:38.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.979+0000 7f3cdb69c9c0 20 realm 2024-09-10T05:36:38.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.979+0000 7f3cdb69c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.979+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e56a61bc0 con 0x561e56a62830 2024-09-10T05:36:38.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.979+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3cd40083f0 con 0x561e56a62830 2024-09-10T05:36:38.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.979+0000 7f3cdb69c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:38.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.979+0000 7f3cdb69c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:38.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.979+0000 7f3cdb69c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.979+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e56a65ed0 con 0x561e56a62830 2024-09-10T05:36:38.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.979+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3cd40083f0 con 0x561e56a62830 2024-09-10T05:36:38.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.979+0000 7f3cdb69c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:38.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.979+0000 7f3cdb69c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.979+0000 7f3cdb69c9c0 1 --2- 172.21.15.62:0/1464202765 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561e56a66cb0 0x561e56a690a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.979+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e56a69770 con 0x561e56a66cb0 2024-09-10T05:36:38.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.979+0000 7f3cd91a2640 1 --2- 172.21.15.62:0/1464202765 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561e56a66cb0 0x561e56a690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.979+0000 7f3cd91a2640 1 --2- 172.21.15.62:0/1464202765 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561e56a66cb0 0x561e56a690a0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.979+0000 7f3cd91a2640 1 -- 172.21.15.62:0/1464202765 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3ccc047030 con 0x561e56a66cb0 2024-09-10T05:36:38.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.979+0000 7f3cdb69c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:38.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.979+0000 7f3cdb69c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:38.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.979+0000 7f3cdb69c9c0 1 --2- 172.21.15.62:0/1464202765 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x561e56a6a4d0 0x561e56a6c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.979+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e56a6d070 con 0x561e56a6a4d0 2024-09-10T05:36:38.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.983+0000 7f3cd89a1640 1 --2- 172.21.15.62:0/1464202765 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x561e56a6a4d0 0x561e56a6c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.983+0000 7f3cd89a1640 1 --2- 172.21.15.62:0/1464202765 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x561e56a6a4d0 0x561e56a6c8e0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.983+0000 7f3cd89a1640 1 -- 172.21.15.62:0/1464202765 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3cd00b4040 con 0x561e56a6a4d0 2024-09-10T05:36:38.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.983+0000 7f3cdb69c9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:38.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.983+0000 7f3cdb69c9c0 20 searching for the correct realm 2024-09-10T05:36:38.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.983+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e56a6e940 con 0x561e56a6a4d0 2024-09-10T05:36:38.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.983+0000 7f3cd89a1640 1 -- 172.21.15.62:0/1464202765 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cd00b4040 con 0x561e56a6a4d0 2024-09-10T05:36:38.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.983+0000 7f3cd89a1640 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e56a6e940 con 0x561e56a66cb0 2024-09-10T05:36:38.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.983+0000 7f3cd91a2640 1 -- 172.21.15.62:0/1464202765 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ccc047030 con 0x561e56a66cb0 2024-09-10T05:36:38.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.983+0000 7f3cd91a2640 1 --2- 172.21.15.62:0/1464202765 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f3ccc04e170 0x7f3ccc0345b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:38.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.983+0000 7f3cd91a2640 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e56a6e940 con 0x7f3ccc04e170 2024-09-10T05:36:38.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.983+0000 7f3cd99a3640 1 --2- 172.21.15.62:0/1464202765 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f3ccc04e170 0x7f3ccc0345b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:38.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.983+0000 7f3cd99a3640 1 --2- 172.21.15.62:0/1464202765 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f3ccc04e170 0x7f3ccc0345b0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:38.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.983+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cd40083f0 con 0x7f3ccc04e170 2024-09-10T05:36:38.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.983+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e56a6e940 con 0x561e56a62830 2024-09-10T05:36:38.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.983+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cd40083f0 con 0x561e56a62830 2024-09-10T05:36:38.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.983+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e56a6e940 con 0x561e56a62830 2024-09-10T05:36:38.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.983+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cd40083f0 con 0x561e56a62830 2024-09-10T05:36:38.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.983+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e56a6e940 con 0x561e56a6a4d0 2024-09-10T05:36:38.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.983+0000 7f3cd89a1640 1 -- 172.21.15.62:0/1464202765 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cd00b4040 con 0x561e56a6a4d0 2024-09-10T05:36:38.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.983+0000 7f3cd89a1640 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e56a6e940 con 0x561e56a62830 2024-09-10T05:36:38.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.987+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cd40083f0 con 0x561e56a62830 2024-09-10T05:36:38.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.987+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e56a6e940 con 0x561e56a66cb0 2024-09-10T05:36:38.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.987+0000 7f3cd91a2640 1 -- 172.21.15.62:0/1464202765 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ccc047030 con 0x561e56a66cb0 2024-09-10T05:36:38.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.987+0000 7f3cd91a2640 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e56a6e940 con 0x561e56a66cb0 2024-09-10T05:36:38.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.987+0000 7f3cd91a2640 1 -- 172.21.15.62:0/1464202765 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ccc047030 con 0x561e56a66cb0 2024-09-10T05:36:38.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.987+0000 7f3cd91a2640 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e56a6e940 con 0x561e56a62830 2024-09-10T05:36:38.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.987+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cd40083f0 con 0x561e56a62830 2024-09-10T05:36:38.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.987+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e56a6e940 con 0x7f3ccc04e170 2024-09-10T05:36:38.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.987+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cd40083f0 con 0x7f3ccc04e170 2024-09-10T05:36:38.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.987+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e56a6e940 con 0x561e56a62830 2024-09-10T05:36:38.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.987+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cd40083f0 con 0x561e56a62830 2024-09-10T05:36:38.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.987+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e56a6e940 con 0x7f3ccc04e170 2024-09-10T05:36:38.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.987+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3cd40083f0 con 0x7f3ccc04e170 2024-09-10T05:36:38.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.987+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e56a6e940 con 0x561e56a66cb0 2024-09-10T05:36:38.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.987+0000 7f3cd91a2640 1 -- 172.21.15.62:0/1464202765 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ccc047030 con 0x561e56a66cb0 2024-09-10T05:36:38.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.987+0000 7f3cd91a2640 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e56a6e940 con 0x561e56a6a4d0 2024-09-10T05:36:38.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.987+0000 7f3cd89a1640 1 -- 172.21.15.62:0/1464202765 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cd00b4040 con 0x561e56a6a4d0 2024-09-10T05:36:38.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.991+0000 7f3cd89a1640 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e56a6e940 con 0x561e56a62830 2024-09-10T05:36:38.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.991+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cd40083f0 con 0x561e56a62830 2024-09-10T05:36:38.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.991+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e56a6e940 con 0x561e56a66cb0 2024-09-10T05:36:38.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.991+0000 7f3cd91a2640 1 -- 172.21.15.62:0/1464202765 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ccc047030 con 0x561e56a66cb0 2024-09-10T05:36:38.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.991+0000 7f3cd91a2640 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e56a6e940 con 0x561e56a6a4d0 2024-09-10T05:36:38.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.991+0000 7f3cd89a1640 1 -- 172.21.15.62:0/1464202765 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 30 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f3cd00b4040 con 0x561e56a6a4d0 2024-09-10T05:36:38.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.991+0000 7f3cd89a1640 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e56a6e940 con 0x561e56a62830 2024-09-10T05:36:38.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.991+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cd40083f0 con 0x561e56a62830 2024-09-10T05:36:38.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.991+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e56a6e940 con 0x561e56a62830 2024-09-10T05:36:38.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.991+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3cd40083f0 con 0x561e56a62830 2024-09-10T05:36:38.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.991+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e56a6e940 con 0x561e56a62830 2024-09-10T05:36:38.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.991+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cd40083f0 con 0x561e56a62830 2024-09-10T05:36:38.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.991+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e56a6e940 con 0x561e56a6a4d0 2024-09-10T05:36:38.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.991+0000 7f3cd89a1640 1 -- 172.21.15.62:0/1464202765 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cd00b4040 con 0x561e56a6a4d0 2024-09-10T05:36:38.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.991+0000 7f3cd89a1640 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e56a6e940 con 0x7f3ccc04e170 2024-09-10T05:36:38.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.991+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cd40083f0 con 0x7f3ccc04e170 2024-09-10T05:36:38.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.991+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e56a6e940 con 0x561e56a62830 2024-09-10T05:36:38.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.991+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cd40083f0 con 0x561e56a62830 2024-09-10T05:36:38.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.991+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e56a6e940 con 0x7f3ccc04e170 2024-09-10T05:36:38.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.991+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cd40083f0 con 0x7f3ccc04e170 2024-09-10T05:36:38.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.991+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e56a6e940 con 0x561e56a6a4d0 2024-09-10T05:36:38.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.991+0000 7f3cd89a1640 1 -- 172.21.15.62:0/1464202765 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cd00b4040 con 0x561e56a6a4d0 2024-09-10T05:36:38.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.991+0000 7f3cd89a1640 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e56a6e940 con 0x7f3ccc04e170 2024-09-10T05:36:38.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.995+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cd40083f0 con 0x7f3ccc04e170 2024-09-10T05:36:38.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.995+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e56a6e940 con 0x561e56a66cb0 2024-09-10T05:36:38.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.995+0000 7f3cd91a2640 1 -- 172.21.15.62:0/1464202765 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ccc047030 con 0x561e56a66cb0 2024-09-10T05:36:38.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.995+0000 7f3cd91a2640 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f3ccc08f040 con 0x561e56a66cb0 2024-09-10T05:36:38.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.995+0000 7f3cd91a2640 1 -- 172.21.15.62:0/1464202765 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ccc047030 con 0x561e56a66cb0 2024-09-10T05:36:38.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.995+0000 7f3cd91a2640 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f3ccc08f040 con 0x561e56a6a4d0 2024-09-10T05:36:38.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.995+0000 7f3cd89a1640 1 -- 172.21.15.62:0/1464202765 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cd00b4040 con 0x561e56a6a4d0 2024-09-10T05:36:38.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.995+0000 7f3cd89a1640 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f3ccc08f040 con 0x561e56a66cb0 2024-09-10T05:36:39.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.995+0000 7f3cd91a2640 1 -- 172.21.15.62:0/1464202765 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3ccc047030 con 0x561e56a66cb0 2024-09-10T05:36:39.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.995+0000 7f3cd91a2640 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f3ccc08f040 con 0x561e56a66cb0 2024-09-10T05:36:39.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.995+0000 7f3cd91a2640 1 -- 172.21.15.62:0/1464202765 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ccc047030 con 0x561e56a66cb0 2024-09-10T05:36:39.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.995+0000 7f3cdb69c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:39.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.995+0000 7f3cdb69c9c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:39.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.995+0000 7f3cdb69c9c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:39.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.995+0000 7f3cdb69c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:39.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.995+0000 7f3cdb69c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:39.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.995+0000 7f3cdb69c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:39.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.995+0000 7f3cdb69c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.995+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e56a6da30 con 0x561e56a62830 2024-09-10T05:36:39.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.995+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3cd40083f0 con 0x561e56a62830 2024-09-10T05:36:39.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.995+0000 7f3cdb69c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:39.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.995+0000 7f3cdb69c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.995+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e56a6d670 con 0x561e56a66cb0 2024-09-10T05:36:39.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.999+0000 7f3cd91a2640 1 -- 172.21.15.62:0/1464202765 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3ccc047030 con 0x561e56a66cb0 2024-09-10T05:36:39.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.999+0000 7f3cdb69c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:39.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.999+0000 7f3cdb69c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.999+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e56a6d680 con 0x561e56a6a4d0 2024-09-10T05:36:39.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.999+0000 7f3cd89a1640 1 -- 172.21.15.62:0/1464202765 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3cd00b4040 con 0x561e56a6a4d0 2024-09-10T05:36:39.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.999+0000 7f3cdb69c9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:39.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.999+0000 7f3cdb69c9c0 20 zone default found 2024-09-10T05:36:39.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.999+0000 7f3cdb69c9c0 4 Realm: () 2024-09-10T05:36:39.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.999+0000 7f3cdb69c9c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:39.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.999+0000 7f3cdb69c9c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:39.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.999+0000 7f3cdb69c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:39.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.999+0000 7f3cdb69c9c0 20 zonegroup default 2024-09-10T05:36:39.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.999+0000 7f3cdb69c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.999+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e56a6ed70 con 0x7f3ccc04e170 2024-09-10T05:36:39.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.999+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3cd40083f0 con 0x7f3ccc04e170 2024-09-10T05:36:39.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.999+0000 7f3cdb69c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:39.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.999+0000 7f3cdb69c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.999+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e56a70fb0 con 0x561e56a6a4d0 2024-09-10T05:36:39.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.999+0000 7f3cd89a1640 1 -- 172.21.15.62:0/1464202765 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3cd00b4040 con 0x561e56a6a4d0 2024-09-10T05:36:39.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.999+0000 7f3cdb69c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:39.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.999+0000 7f3cdb69c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.999+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e56a71350 con 0x561e56a6a4d0 2024-09-10T05:36:39.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.999+0000 7f3cd89a1640 1 -- 172.21.15.62:0/1464202765 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3cd00b4040 con 0x561e56a6a4d0 2024-09-10T05:36:39.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.999+0000 7f3cdb69c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:39.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.999+0000 7f3cdb69c9c0 20 started sync module instance, tier type = 2024-09-10T05:36:39.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.999+0000 7f3cdb69c9c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:39.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:38.999+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a70490 con 0x561e56a66cb0 2024-09-10T05:36:39.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.003+0000 7f3cd91a2640 1 -- 172.21.15.62:0/1464202765 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ccc047030 con 0x561e56a66cb0 2024-09-10T05:36:39.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.003+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94688302795184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a70490 con 0x561e56a66cb0 2024-09-10T05:36:39.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.003+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a71dc0 con 0x561e56a62830 2024-09-10T05:36:39.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.003+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cd40083f0 con 0x561e56a62830 2024-09-10T05:36:39.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.003+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94688302799024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a72660 con 0x561e56a62830 2024-09-10T05:36:39.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.003+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a730a0 con 0x561e56a66cb0 2024-09-10T05:36:39.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.003+0000 7f3cd91a2640 1 -- 172.21.15.62:0/1464202765 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94688302795184] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ccc047030 con 0x561e56a66cb0 2024-09-10T05:36:39.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.003+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94688302799024] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cd40083f0 con 0x561e56a62830 2024-09-10T05:36:39.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.003+0000 7f3cd91a2640 1 -- 172.21.15.62:0/1464202765 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ccc047030 con 0x561e56a66cb0 2024-09-10T05:36:39.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.003+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94688302803824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a721b0 con 0x561e56a66cb0 2024-09-10T05:36:39.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.003+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a73940 con 0x7f3ccc04e170 2024-09-10T05:36:39.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.007+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cd40083f0 con 0x7f3ccc04e170 2024-09-10T05:36:39.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.007+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94688302806160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a721b0 con 0x7f3ccc04e170 2024-09-10T05:36:39.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.007+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a743f0 con 0x561e56a66cb0 2024-09-10T05:36:39.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.007+0000 7f3cd91a2640 1 -- 172.21.15.62:0/1464202765 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94688302803824] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ccc047030 con 0x561e56a66cb0 2024-09-10T05:36:39.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.007+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94688302806160] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cd40083f0 con 0x7f3ccc04e170 2024-09-10T05:36:39.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.007+0000 7f3cd91a2640 1 -- 172.21.15.62:0/1464202765 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ccc047030 con 0x561e56a66cb0 2024-09-10T05:36:39.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.007+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94688302807216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a73f00 con 0x561e56a66cb0 2024-09-10T05:36:39.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.007+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a74cc0 con 0x561e56a6a4d0 2024-09-10T05:36:39.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.011+0000 7f3cd89a1640 1 -- 172.21.15.62:0/1464202765 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cd00b4040 con 0x561e56a6a4d0 2024-09-10T05:36:39.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.011+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94688302811152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a73f00 con 0x561e56a6a4d0 2024-09-10T05:36:39.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.011+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a75b30 con 0x561e56a6a4d0 2024-09-10T05:36:39.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.011+0000 7f3cd91a2640 1 -- 172.21.15.62:0/1464202765 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94688302807216] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ccc047030 con 0x561e56a66cb0 2024-09-10T05:36:39.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.011+0000 7f3cd89a1640 1 -- 172.21.15.62:0/1464202765 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94688302811152] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cd00b4040 con 0x561e56a6a4d0 2024-09-10T05:36:39.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.011+0000 7f3cd89a1640 1 -- 172.21.15.62:0/1464202765 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cd00b4040 con 0x561e56a6a4d0 2024-09-10T05:36:39.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.011+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94688302813280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a75680 con 0x561e56a6a4d0 2024-09-10T05:36:39.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.011+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a75f20 con 0x7f3ccc04e170 2024-09-10T05:36:39.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.011+0000 7f3cd89a1640 1 -- 172.21.15.62:0/1464202765 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94688302813280] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cd00b4040 con 0x561e56a6a4d0 2024-09-10T05:36:39.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.011+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cd40083f0 con 0x7f3ccc04e170 2024-09-10T05:36:39.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.011+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94688302792672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a75f20 con 0x7f3ccc04e170 2024-09-10T05:36:39.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.011+0000 7f3cdb69c9c0 20 add_watcher() i=0 2024-09-10T05:36:39.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.011+0000 7f3cdb69c9c0 20 add_watcher() i=1 2024-09-10T05:36:39.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.011+0000 7f3cdb69c9c0 20 add_watcher() i=2 2024-09-10T05:36:39.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.011+0000 7f3cdb69c9c0 20 add_watcher() i=3 2024-09-10T05:36:39.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.011+0000 7f3cdb69c9c0 20 add_watcher() i=4 2024-09-10T05:36:39.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.011+0000 7f3cdb69c9c0 20 add_watcher() i=5 2024-09-10T05:36:39.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.011+0000 7f3cdb69c9c0 20 add_watcher() i=6 2024-09-10T05:36:39.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.015+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94688302792672] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cd40083f0 con 0x7f3ccc04e170 2024-09-10T05:36:39.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.015+0000 7f3cdb69c9c0 20 add_watcher() i=7 2024-09-10T05:36:39.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.015+0000 7f3cdb69c9c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:39.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.015+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e56a79370 con 0x561e56a62830 2024-09-10T05:36:39.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.015+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3cd40083f0 con 0x561e56a62830 2024-09-10T05:36:39.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.015+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94688302815056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a76860 con 0x561e56a62830 2024-09-10T05:36:39.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.015+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94688302815056] v30'145 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3cd40083f0 con 0x561e56a62830 2024-09-10T05:36:39.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.015+0000 7f3b8ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:39.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.015+0000 7f3cdb69c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:39.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.015+0000 7f3cdb69c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:39.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.019+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a81bc0 con 0x561e56a66cb0 2024-09-10T05:36:39.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.019+0000 7f3cd91a2640 1 -- 172.21.15.62:0/1464202765 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'47 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3ccc047030 con 0x561e56a66cb0 2024-09-10T05:36:39.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.019+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a81cb0 con 0x7f3ccc04e170 2024-09-10T05:36:39.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.019+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3cd40083f0 con 0x7f3ccc04e170 2024-09-10T05:36:39.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.019+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a823e0 con 0x561e56a6a4d0 2024-09-10T05:36:39.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.023+0000 7f3cd89a1640 1 -- 172.21.15.62:0/1464202765 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3cd00b4040 con 0x561e56a6a4d0 2024-09-10T05:36:39.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.023+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a82890 con 0x561e56a62830 2024-09-10T05:36:39.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.027+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'146 uv12 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3cd40083f0 con 0x561e56a62830 2024-09-10T05:36:39.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.027+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a7fb90 con 0x561e56a66cb0 2024-09-10T05:36:39.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.027+0000 7f3cd91a2640 1 -- 172.21.15.62:0/1464202765 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'47 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3ccc047030 con 0x561e56a66cb0 2024-09-10T05:36:39.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.027+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a7fb50 con 0x561e56a6a4d0 2024-09-10T05:36:39.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.031+0000 7f3cd89a1640 1 -- 172.21.15.62:0/1464202765 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'39 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3cd00b4040 con 0x561e56a6a4d0 2024-09-10T05:36:39.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.031+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a7faf0 con 0x561e56a66cb0 2024-09-10T05:36:39.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.031+0000 7f3cd91a2640 1 -- 172.21.15.62:0/1464202765 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'27 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3ccc047030 con 0x561e56a66cb0 2024-09-10T05:36:39.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.031+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a833f0 con 0x561e56a62830 2024-09-10T05:36:39.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.035+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'33 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3cd40083f0 con 0x561e56a62830 2024-09-10T05:36:39.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.035+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a838a0 con 0x561e56a66cb0 2024-09-10T05:36:39.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.035+0000 7f3cd91a2640 1 -- 172.21.15.62:0/1464202765 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3ccc047030 con 0x561e56a66cb0 2024-09-10T05:36:39.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.035+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a838a0 con 0x561e56a66cb0 2024-09-10T05:36:39.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.039+0000 7f3cd91a2640 1 -- 172.21.15.62:0/1464202765 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'23 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3ccc047030 con 0x561e56a66cb0 2024-09-10T05:36:39.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.039+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a838a0 con 0x561e56a66cb0 2024-09-10T05:36:39.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.043+0000 7f3cd91a2640 1 -- 172.21.15.62:0/1464202765 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'48 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ccc047030 con 0x561e56a66cb0 2024-09-10T05:36:39.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.043+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a838a0 con 0x561e56a6a4d0 2024-09-10T05:36:39.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.043+0000 7f3cd89a1640 1 -- 172.21.15.62:0/1464202765 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3cd00b4040 con 0x561e56a6a4d0 2024-09-10T05:36:39.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.043+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a83930 con 0x561e56a66cb0 2024-09-10T05:36:39.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.047+0000 7f3cd91a2640 1 -- 172.21.15.62:0/1464202765 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ccc047030 con 0x561e56a66cb0 2024-09-10T05:36:39.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.047+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a83de0 con 0x561e56a62830 2024-09-10T05:36:39.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.047+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'45 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3cd40083f0 con 0x561e56a62830 2024-09-10T05:36:39.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.047+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a83de0 con 0x561e56a62830 2024-09-10T05:36:39.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.051+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'147 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3cd40083f0 con 0x561e56a62830 2024-09-10T05:36:39.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.051+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a83de0 con 0x561e56a66cb0 2024-09-10T05:36:39.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.051+0000 7f3cd91a2640 1 -- 172.21.15.62:0/1464202765 <== osd.0 v2:172.21.15.2:6800/945139080 25 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'42 uv16 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ccc047030 con 0x561e56a66cb0 2024-09-10T05:36:39.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.051+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a83de0 con 0x561e56a66cb0 2024-09-10T05:36:39.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.055+0000 7f3cd91a2640 1 -- 172.21.15.62:0/1464202765 <== osd.0 v2:172.21.15.2:6800/945139080 26 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'49 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ccc047030 con 0x561e56a66cb0 2024-09-10T05:36:39.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.055+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a83de0 con 0x561e56a6a4d0 2024-09-10T05:36:39.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.059+0000 7f3cd89a1640 1 -- 172.21.15.62:0/1464202765 <== osd.3 v2:172.21.15.62:6816/2708991149 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'29 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3cd00b4040 con 0x561e56a6a4d0 2024-09-10T05:36:39.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.059+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a83de0 con 0x561e56a66cb0 2024-09-10T05:36:39.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.059+0000 7f3cd91a2640 1 -- 172.21.15.62:0/1464202765 <== osd.0 v2:172.21.15.2:6800/945139080 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ccc047030 con 0x561e56a66cb0 2024-09-10T05:36:39.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.059+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a83de0 con 0x561e56a62830 2024-09-10T05:36:39.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.063+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 <== osd.1 v2:172.21.15.62:6808/3442097179 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'148 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3cd40083f0 con 0x561e56a62830 2024-09-10T05:36:39.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.063+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a83de0 con 0x561e56a66cb0 2024-09-10T05:36:39.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.067+0000 7f3cd91a2640 1 -- 172.21.15.62:0/1464202765 <== osd.0 v2:172.21.15.2:6800/945139080 28 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'43 uv18 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ccc047030 con 0x561e56a66cb0 2024-09-10T05:36:39.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.067+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a83de0 con 0x561e56a66cb0 2024-09-10T05:36:39.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.067+0000 7f3cd91a2640 1 -- 172.21.15.62:0/1464202765 <== osd.0 v2:172.21.15.2:6800/945139080 29 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'33 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ccc047030 con 0x561e56a66cb0 2024-09-10T05:36:39.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.067+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a83de0 con 0x561e56a6a4d0 2024-09-10T05:36:39.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.071+0000 7f3cd89a1640 1 -- 172.21.15.62:0/1464202765 <== osd.3 v2:172.21.15.62:6816/2708991149 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'25 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3cd00b4040 con 0x561e56a6a4d0 2024-09-10T05:36:39.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.071+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a83de0 con 0x561e56a66cb0 2024-09-10T05:36:39.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.071+0000 7f3cd91a2640 1 -- 172.21.15.62:0/1464202765 <== osd.0 v2:172.21.15.2:6800/945139080 30 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'36 uv18 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ccc047030 con 0x561e56a66cb0 2024-09-10T05:36:39.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.071+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a83de0 con 0x561e56a6a4d0 2024-09-10T05:36:39.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.075+0000 7f3cd89a1640 1 -- 172.21.15.62:0/1464202765 <== osd.3 v2:172.21.15.62:6816/2708991149 21 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'19 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3cd00b4040 con 0x561e56a6a4d0 2024-09-10T05:36:39.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.075+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a83de0 con 0x561e56a6a4d0 2024-09-10T05:36:39.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.075+0000 7f3cd89a1640 1 -- 172.21.15.62:0/1464202765 <== osd.3 v2:172.21.15.62:6816/2708991149 22 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'40 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3cd00b4040 con 0x561e56a6a4d0 2024-09-10T05:36:39.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.075+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a83e00 con 0x561e56a6a4d0 2024-09-10T05:36:39.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.079+0000 7f3cd89a1640 1 -- 172.21.15.62:0/1464202765 <== osd.3 v2:172.21.15.62:6816/2708991149 23 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'25 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3cd00b4040 con 0x561e56a6a4d0 2024-09-10T05:36:39.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.079+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a83e00 con 0x561e56a66cb0 2024-09-10T05:36:39.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.083+0000 7f3cd91a2640 1 -- 172.21.15.62:0/1464202765 <== osd.0 v2:172.21.15.2:6800/945139080 31 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'29 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ccc047030 con 0x561e56a66cb0 2024-09-10T05:36:39.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.083+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a83e30 con 0x561e56a62830 2024-09-10T05:36:39.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.083+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 <== osd.1 v2:172.21.15.62:6808/3442097179 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'34 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3cd40083f0 con 0x561e56a62830 2024-09-10T05:36:39.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.083+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a83e30 con 0x561e56a66cb0 2024-09-10T05:36:39.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.087+0000 7f3cd91a2640 1 -- 172.21.15.62:0/1464202765 <== osd.0 v2:172.21.15.2:6800/945139080 32 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'44 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ccc047030 con 0x561e56a66cb0 2024-09-10T05:36:39.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.087+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a83e30 con 0x561e56a62830 2024-09-10T05:36:39.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.091+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 <== osd.1 v2:172.21.15.62:6808/3442097179 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'46 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3cd40083f0 con 0x561e56a62830 2024-09-10T05:36:39.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.091+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a83e30 con 0x7f3ccc04e170 2024-09-10T05:36:39.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.091+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3cd40083f0 con 0x7f3ccc04e170 2024-09-10T05:36:39.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.091+0000 7f3b8efe5640 20 reqs_thread_entry: start 2024-09-10T05:36:39.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.095+0000 7f3cdb69c9c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:39.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.095+0000 7f3cdb69c9c0 20 Filter name: none 2024-09-10T05:36:39.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.095+0000 7f3b8cfe1640 20 reqs_thread_entry: start 2024-09-10T05:36:39.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.095+0000 7f3cdb69c9c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T05:36:39.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.095+0000 7f3cdb69c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.095+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e56a7ed90 con 0x7f3ccc04e170 2024-09-10T05:36:39.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.095+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f3cd40083f0 con 0x7f3ccc04e170 2024-09-10T05:36:39.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.095+0000 7f3cdb69c9c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T05:36:39.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.095+0000 7f3cdb69c9c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-10T05:36:39.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.095+0000 7f3cdb69c9c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T05:36:39.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.095+0000 7f3cdb69c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 : miss 2024-09-10T05:36:39.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.095+0000 7f3cdb69c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.095+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:95 8.1f 8:fcc5c255:root::.bucket.meta.myfoo%3a475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e56aa0950 con 0x7f3ccc04e170 2024-09-10T05:36:39.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.095+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 <== osd.2 v2:172.21.15.62:6800/2677868286 15 ==== osd_op_reply(95 .bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f3cd40083f0 con 0x7f3ccc04e170 2024-09-10T05:36:39.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.095+0000 7f3cdb69c9c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T05:36:39.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.095+0000 7f3cdb69c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 info.flags=0x17 2024-09-10T05:36:39.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.095+0000 7f3cdb69c9c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 to cache LRU end 2024-09-10T05:36:39.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.095+0000 7f3cdb69c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:36:39.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.095+0000 7f3cdb69c9c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T05:36:39.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.095+0000 7f3cdb69c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 2024-09-10T05:36:39.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.095+0000 7f3cdb69c9c0 20 get_obj_state: octx=0x7f3cd4008ae0 obj=myfoo:four state=0x561e56aa1678 s->prefetch_data=0 2024-09-10T05:36:39.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.095+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:96 3.2f 3:f7a7958a:::475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1_four:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e56aa27b0 con 0x561e56a6a4d0 2024-09-10T05:36:39.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.095+0000 7f3cd89a1640 1 -- 172.21.15.62:0/1464202765 <== osd.3 v2:172.21.15.62:6816/2708991149 24 ==== osd_op_reply(96 475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1_four [getxattrs out=849b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 234+0+865 (crc 0 0 0) 0x7f3cd00b4040 con 0x561e56a6a4d0 2024-09-10T05:36:39.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.095+0000 7f3cdb69c9c0 10 manifest: total_size = 4 2024-09-10T05:36:39.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.095+0000 7f3cdb69c9c0 20 get_obj_state: setting s->obj_tag to 475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5220985751997241588 2024-09-10T05:36:39.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.095+0000 7f3cdb69c9c0 20 get_obj_state: octx=0x7f3cd4008ae0 obj=myfoo:four state=0x561e56aa1678 s->prefetch_data=0 2024-09-10T05:36:39.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.095+0000 7f3cdb69c9c0 20 prepare_atomic_modification: state is not atomic. state=0x561e56aa1678 2024-09-10T05:36:39.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.095+0000 7f3cdb69c9c0 20 bucket index object: :.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.6 2024-09-10T05:36:39.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.095+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:97 4.1f 4:fa625c04:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56aa71b0 con 0x561e56a66cb0 2024-09-10T05:36:39.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.099+0000 7f3cd91a2640 1 -- 172.21.15.62:0/1464202765 <== osd.0 v2:172.21.15.2:6800/945139080 33 ==== osd_op_reply(97 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.6 [stat,call,call] v30'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f3ccc047030 con 0x561e56a66cb0 2024-09-10T05:36:39.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.099+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:98 3.2f 3:f7a7958a:::475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56aa71b0 con 0x561e56a6a4d0 2024-09-10T05:36:39.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.099+0000 7f3cd89a1640 1 -- 172.21.15.62:0/1464202765 <== osd.3 v2:172.21.15.62:6816/2708991149 25 ==== osd_op_reply(98 475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1_four [call] v30'2 uv2 ondisk = 0) ==== 192+0+0 (crc 0 0 0) 0x7f3cd00b4040 con 0x561e56a6a4d0 2024-09-10T05:36:39.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.099+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:99 4.1f 4:fa625c04:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56aa7c40 con 0x561e56a66cb0 2024-09-10T05:36:39.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.103+0000 7f3b8ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:39.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.103+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94688302815056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56aa7c40 con 0x561e56a62830 2024-09-10T05:36:39.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.103+0000 7f3cd91a2640 1 -- 172.21.15.62:0/1464202765 <== osd.0 v2:172.21.15.2:6800/945139080 34 ==== osd_op_reply(99 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.6 [stat,call,call] v30'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f3ccc047030 con 0x561e56a66cb0 2024-09-10T05:36:39.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.103+0000 7f3bbcff9640 20 handle_completion(): completion ok for obj=four 2024-09-10T05:36:39.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.103+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 <== osd.1 v2:172.21.15.62:6808/3442097179 26 ==== osd_op_reply(100 data_loggenerations_metadata [watch unwatch cookie 94688302815056] v30'149 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3cd40083f0 con 0x561e56a62830 2024-09-10T05:36:39.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.103+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94688302795184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56aa7c40 con 0x561e56a66cb0 2024-09-10T05:36:39.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.107+0000 7f3cd91a2640 1 -- 172.21.15.62:0/1464202765 <== osd.0 v2:172.21.15.2:6800/945139080 35 ==== osd_op_reply(101 notify.0 [watch unwatch cookie 94688302795184] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ccc047030 con 0x561e56a66cb0 2024-09-10T05:36:39.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.107+0000 7f3cdb69c9c0 20 remove_watcher() i=0 2024-09-10T05:36:39.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.107+0000 7f3cdb69c9c0 2 removed watcher, disabling cache 2024-09-10T05:36:39.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.107+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:102 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94688302799024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a709b0 con 0x561e56a62830 2024-09-10T05:36:39.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.107+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 <== osd.1 v2:172.21.15.62:6808/3442097179 27 ==== osd_op_reply(102 notify.1 [watch unwatch cookie 94688302799024] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cd40083f0 con 0x561e56a62830 2024-09-10T05:36:39.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.107+0000 7f3cdb69c9c0 20 remove_watcher() i=1 2024-09-10T05:36:39.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.107+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:103 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94688302803824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a709b0 con 0x561e56a66cb0 2024-09-10T05:36:39.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.111+0000 7f3cd91a2640 1 -- 172.21.15.62:0/1464202765 <== osd.0 v2:172.21.15.2:6800/945139080 36 ==== osd_op_reply(103 notify.2 [watch unwatch cookie 94688302803824] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ccc047030 con 0x561e56a66cb0 2024-09-10T05:36:39.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.111+0000 7f3cdb69c9c0 20 remove_watcher() i=2 2024-09-10T05:36:39.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.111+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94688302806160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a72b70 con 0x7f3ccc04e170 2024-09-10T05:36:39.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.111+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 <== osd.2 v2:172.21.15.62:6800/2677868286 16 ==== osd_op_reply(104 notify.3 [watch unwatch cookie 94688302806160] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cd40083f0 con 0x7f3ccc04e170 2024-09-10T05:36:39.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.111+0000 7f3cdb69c9c0 20 remove_watcher() i=3 2024-09-10T05:36:39.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.111+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94688302807216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a709b0 con 0x561e56a66cb0 2024-09-10T05:36:39.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.115+0000 7f3cd91a2640 1 -- 172.21.15.62:0/1464202765 <== osd.0 v2:172.21.15.2:6800/945139080 37 ==== osd_op_reply(105 notify.4 [watch unwatch cookie 94688302807216] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ccc047030 con 0x561e56a66cb0 2024-09-10T05:36:39.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.115+0000 7f3cdb69c9c0 20 remove_watcher() i=4 2024-09-10T05:36:39.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.115+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94688302811152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a72b70 con 0x561e56a6a4d0 2024-09-10T05:36:39.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.115+0000 7f3cd89a1640 1 -- 172.21.15.62:0/1464202765 <== osd.3 v2:172.21.15.62:6816/2708991149 26 ==== osd_op_reply(106 notify.5 [watch unwatch cookie 94688302811152] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cd00b4040 con 0x561e56a6a4d0 2024-09-10T05:36:39.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.115+0000 7f3cdb69c9c0 20 remove_watcher() i=5 2024-09-10T05:36:39.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.115+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:107 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94688302813280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a709b0 con 0x561e56a6a4d0 2024-09-10T05:36:39.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.115+0000 7f3cd89a1640 1 -- 172.21.15.62:0/1464202765 <== osd.3 v2:172.21.15.62:6816/2708991149 27 ==== osd_op_reply(107 notify.6 [watch unwatch cookie 94688302813280] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cd00b4040 con 0x561e56a6a4d0 2024-09-10T05:36:39.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.115+0000 7f3cdb69c9c0 20 remove_watcher() i=6 2024-09-10T05:36:39.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.115+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:108 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94688302792672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e56a72b70 con 0x7f3ccc04e170 2024-09-10T05:36:39.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.119+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 <== osd.2 v2:172.21.15.62:6800/2677868286 17 ==== osd_op_reply(108 notify.7 [watch unwatch cookie 94688302792672] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cd40083f0 con 0x7f3ccc04e170 2024-09-10T05:36:39.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.119+0000 7f3cdb69c9c0 20 remove_watcher() i=7 2024-09-10T05:36:39.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.119+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561e56a66cb0 msgr2=0x561e56a690a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.119+0000 7f3cdb69c9c0 1 --2- 172.21.15.62:0/1464202765 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561e56a66cb0 0x561e56a690a0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.119+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x561e56a62830 msgr2=0x561e56a64cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.119+0000 7f3cdb69c9c0 1 --2- 172.21.15.62:0/1464202765 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x561e56a62830 0x561e56a64cc0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.119+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f3ccc04e170 msgr2=0x7f3ccc0345b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.119+0000 7f3cdb69c9c0 1 --2- 172.21.15.62:0/1464202765 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f3ccc04e170 0x7f3ccc0345b0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.119+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x561e56a6a4d0 msgr2=0x561e56a6c8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.119+0000 7f3cdb69c9c0 1 --2- 172.21.15.62:0/1464202765 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x561e56a6a4d0 0x561e56a6c8e0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.119+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3ba4039a70 msgr2=0x7f3ba403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.119+0000 7f3cdb69c9c0 1 --2- 172.21.15.62:0/1464202765 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3ba4039a70 0x7f3ba403bf30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0000c10 tx=0x7f3cd00a8000 comp rx=0 tx=0).stop 2024-09-10T05:36:39.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.119+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e56a50520 msgr2=0x561e56a57850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.119+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1464202765 reap_dead start 2024-09-10T05:36:39.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.119+0000 7f3cdb69c9c0 1 --2- 172.21.15.62:0/1464202765 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e56a50520 0x561e56a57850 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc010750 tx=0x7f3ccc017f60 comp rx=0 tx=0).stop 2024-09-10T05:36:39.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.119+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 shutdown_connections 2024-09-10T05:36:39.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.119+0000 7f3cdb69c9c0 1 --2- 172.21.15.62:0/1464202765 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e56a50520 0x561e56a57850 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.119+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 >> 172.21.15.62:0/1464202765 conn(0x561e56a4c970 msgr2=0x561e56a4ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:39.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.119+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 shutdown_connections 2024-09-10T05:36:39.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.119+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1464202765 wait complete. 2024-09-10T05:36:39.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.119+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/3208534768 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3bb0039a70 msgr2=0x7f3bb003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.119+0000 7f3cdb69c9c0 1 --2- 172.21.15.62:0/3208534768 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3bb0039a70 0x7f3bb003bf30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x561e56a2f8a0 tx=0x7f3cd0005ad0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.119+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/3208534768 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e56931380 msgr2=0x561e5692fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.119+0000 7f3cdb69c9c0 1 --2- 172.21.15.62:0/3208534768 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e56931380 0x561e5692fc20 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc01dce0 tx=0x7f3ccc010df0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.119+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/3208534768 shutdown_connections 2024-09-10T05:36:39.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.119+0000 7f3cdb69c9c0 1 --2- 172.21.15.62:0/3208534768 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3bb0039a70 0x7f3bb003bf30 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.119+0000 7f3cdb69c9c0 1 --2- 172.21.15.62:0/3208534768 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e56931380 0x561e5692fc20 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.119+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/3208534768 >> 172.21.15.62:0/3208534768 conn(0x561e56a37510 msgr2=0x561e56a378f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:39.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.119+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/3208534768 shutdown_connections 2024-09-10T05:36:39.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.119+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/3208534768 wait complete. 2024-09-10T05:36:39.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.119+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1917481126 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561e56a2c290 msgr2=0x561e56a2e680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.119+0000 7f3cdb69c9c0 1 --2- 172.21.15.62:0/1917481126 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561e56a2c290 0x561e56a2e680 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.119+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1917481126 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x561e56935340 msgr2=0x561e56a2aff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.119+0000 7f3cdb69c9c0 1 --2- 172.21.15.62:0/1917481126 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x561e56935340 0x561e56a2aff0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.119+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1917481126 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x561e56a30a30 msgr2=0x561e56a32e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.119+0000 7f3cdb69c9c0 1 --2- 172.21.15.62:0/1917481126 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x561e56a30a30 0x561e56a32e20 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.123+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1917481126 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3bc0039a70 msgr2=0x7f3bc003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.123+0000 7f3cdb69c9c0 1 --2- 172.21.15.62:0/1917481126 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3bc0039a70 0x7f3bc003bf30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3cd00ae000 tx=0x7f3cd00a6000 comp rx=0 tx=0).stop 2024-09-10T05:36:39.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.123+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1917481126 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e568a51f0 msgr2=0x561e56a23e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.123+0000 7f3cdb69c9c0 1 --2- 172.21.15.62:0/1917481126 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e568a51f0 0x561e56a23e80 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x561e56a1d740 tx=0x7f3ccc000f50 comp rx=0 tx=0).stop 2024-09-10T05:36:39.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.123+0000 7f3cd99a3640 1 -- 172.21.15.62:0/1917481126 reap_dead start 2024-09-10T05:36:39.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.123+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1917481126 shutdown_connections 2024-09-10T05:36:39.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.123+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1917481126 >> 172.21.15.62:0/1917481126 conn(0x561e5692b910 msgr2=0x561e56a16e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:39.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.123+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1917481126 shutdown_connections 2024-09-10T05:36:39.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.123+0000 7f3cdb69c9c0 1 -- 172.21.15.62:0/1917481126 wait complete. 2024-09-10T05:36:39.137 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-10T05:36:39.137 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-10T05:36:39.138 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-10T05:36:39.219 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:39.219 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:39.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.219+0000 7f98d09d09c0 1 Processor -- start 2024-09-10T05:36:39.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.219+0000 7f98d09d09c0 1 -- start start 2024-09-10T05:36:39.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.219+0000 7f98d09d09c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5558733c6200 0x555873457030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.219+0000 7f98d09d09c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5558733069c0 con 0x5558733c65e0 2024-09-10T05:36:39.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.219+0000 7f98d09d09c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x5558733566d0 con 0x5558733c6200 2024-09-10T05:36:39.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.219+0000 7f98ce4d6640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5558733c6200 0x555873457030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.219+0000 7f98ce4d6640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5558733c6200 0x555873457030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47952/0 (socket says 172.21.15.62:47952) 2024-09-10T05:36:39.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.219+0000 7f98ce4d6640 1 -- 172.21.15.62:0/3955009683 learned_addr learned my addr 172.21.15.62:0/3955009683 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:39.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.219+0000 7f98c5cd5640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x5558733c65e0 0x555873459580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:53160/0 (socket says 172.21.15.62:53160) 2024-09-10T05:36:39.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.219+0000 7f98ce4d6640 1 -- 172.21.15.62:0/3955009683 >> v1:172.21.15.2:6789/0 conn(0x5558733c65e0 legacy=0x555873459580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.219+0000 7f98ce4d6640 1 -- 172.21.15.62:0/3955009683 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558732faca0 con 0x5558733c6200 2024-09-10T05:36:39.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.223+0000 7f98ce4d6640 1 --2- 172.21.15.62:0/3955009683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5558733c6200 0x555873457030 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f98c000a5c0 tx=0x7f98c001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15aea309a1e95523 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.223+0000 7f98cdcd5640 1 -- 172.21.15.62:0/3955009683 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98c00a6070 con 0x5558733c6200 2024-09-10T05:36:39.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.223+0000 7f98cdcd5640 1 -- 172.21.15.62:0/3955009683 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98c00af070 con 0x5558733c6200 2024-09-10T05:36:39.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.223+0000 7f98cdcd5640 1 -- 172.21.15.62:0/3955009683 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98c00aa5c0 con 0x5558733c6200 2024-09-10T05:36:39.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.223+0000 7f98d09d09c0 1 -- 172.21.15.62:0/3955009683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5558733c6200 msgr2=0x555873457030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.223+0000 7f98d09d09c0 1 --2- 172.21.15.62:0/3955009683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5558733c6200 0x555873457030 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f98c000a5c0 tx=0x7f98c001b340 comp rx=0 tx=0).stop 2024-09-10T05:36:39.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.223+0000 7f98d09d09c0 1 -- 172.21.15.62:0/3955009683 shutdown_connections 2024-09-10T05:36:39.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.223+0000 7f98d09d09c0 1 --2- 172.21.15.62:0/3955009683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5558733c6200 0x555873457030 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.223+0000 7f98d09d09c0 1 -- 172.21.15.62:0/3955009683 >> 172.21.15.62:0/3955009683 conn(0x55587344c920 msgr2=0x55587344ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:39.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.223+0000 7f98d09d09c0 1 -- 172.21.15.62:0/3955009683 shutdown_connections 2024-09-10T05:36:39.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.223+0000 7f98d09d09c0 1 -- 172.21.15.62:0/3955009683 wait complete. 2024-09-10T05:36:39.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.239+0000 7f98d09d09c0 1 Processor -- start 2024-09-10T05:36:39.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.239+0000 7f98d09d09c0 1 -- start start 2024-09-10T05:36:39.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.239+0000 7f98d09d09c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5558733c6200 0x55587353f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.239+0000 7f98d09d09c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55587335a680 con 0x5558733c6200 2024-09-10T05:36:39.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.239+0000 7f98ce4d6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5558733c6200 0x55587353f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.239+0000 7f98ce4d6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5558733c6200 0x55587353f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47964/0 (socket says 172.21.15.62:47964) 2024-09-10T05:36:39.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.239+0000 7f98ce4d6640 1 -- 172.21.15.62:0/3833838011 learned_addr learned my addr 172.21.15.62:0/3833838011 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:39.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.239+0000 7f98ce4d6640 1 -- 172.21.15.62:0/3833838011 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558732d5da0 con 0x5558733c6200 2024-09-10T05:36:39.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.239+0000 7f98ce4d6640 1 --2- 172.21.15.62:0/3833838011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5558733c6200 0x55587353f8d0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f98c00ac040 tx=0x7f98c0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=164140b852fb7750 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.239+0000 7f97bc608640 1 -- 172.21.15.62:0/3833838011 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98c00aa970 con 0x5558733c6200 2024-09-10T05:36:39.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.239+0000 7f97bc608640 1 -- 172.21.15.62:0/3833838011 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98c00aab10 con 0x5558733c6200 2024-09-10T05:36:39.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.239+0000 7f97bc608640 1 -- 172.21.15.62:0/3833838011 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98c00aae30 con 0x5558733c6200 2024-09-10T05:36:39.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.243+0000 7f98d09d09c0 1 -- 172.21.15.62:0/3833838011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5558733c6200 msgr2=0x55587353f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.243+0000 7f98d09d09c0 1 --2- 172.21.15.62:0/3833838011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5558733c6200 0x55587353f8d0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f98c00ac040 tx=0x7f98c0003030 comp rx=0 tx=0).stop 2024-09-10T05:36:39.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.243+0000 7f98d09d09c0 1 -- 172.21.15.62:0/3833838011 shutdown_connections 2024-09-10T05:36:39.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.243+0000 7f98d09d09c0 1 --2- 172.21.15.62:0/3833838011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5558733c6200 0x55587353f8d0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.243+0000 7f98d09d09c0 1 -- 172.21.15.62:0/3833838011 >> 172.21.15.62:0/3833838011 conn(0x55587344c920 msgr2=0x55587353b510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:39.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.243+0000 7f98d09d09c0 1 -- 172.21.15.62:0/3833838011 shutdown_connections 2024-09-10T05:36:39.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.243+0000 7f98d09d09c0 1 -- 172.21.15.62:0/3833838011 wait complete. 2024-09-10T05:36:39.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.243+0000 7f98d09d09c0 1 Processor -- start 2024-09-10T05:36:39.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.243+0000 7f98d09d09c0 1 -- start start 2024-09-10T05:36:39.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.243+0000 7f98d09d09c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5558733c6200 0x555873546e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.243+0000 7f98d09d09c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5558732fca50 con 0x5558733c6200 2024-09-10T05:36:39.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.243+0000 7f98ce4d6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5558733c6200 0x555873546e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.243+0000 7f98ce4d6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5558733c6200 0x555873546e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47980/0 (socket says 172.21.15.62:47980) 2024-09-10T05:36:39.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.243+0000 7f98ce4d6640 1 -- 172.21.15.62:0/501570156 learned_addr learned my addr 172.21.15.62:0/501570156 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:39.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.243+0000 7f98ce4d6640 1 -- 172.21.15.62:0/501570156 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555873547390 con 0x5558733c6200 2024-09-10T05:36:39.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.243+0000 7f98ce4d6640 1 --2- 172.21.15.62:0/501570156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5558733c6200 0x555873546e30 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f98c001b170 tx=0x7f98c00180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.243+0000 7f97bae05640 1 -- 172.21.15.62:0/501570156 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98c00c6690 con 0x5558733c6200 2024-09-10T05:36:39.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.243+0000 7f98d09d09c0 1 -- 172.21.15.62:0/501570156 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555873547620 con 0x5558733c6200 2024-09-10T05:36:39.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.243+0000 7f97bae05640 1 -- 172.21.15.62:0/501570156 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98c00cc070 con 0x5558733c6200 2024-09-10T05:36:39.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.243+0000 7f97bae05640 1 -- 172.21.15.62:0/501570156 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98c00c6960 con 0x5558733c6200 2024-09-10T05:36:39.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.243+0000 7f98d09d09c0 1 -- 172.21.15.62:0/501570156 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555873547fd0 con 0x5558733c6200 2024-09-10T05:36:39.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.247+0000 7f97bae05640 1 -- 172.21.15.62:0/501570156 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f98c00c6b00 con 0x5558733c6200 2024-09-10T05:36:39.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.247+0000 7f97bae05640 1 --2- 172.21.15.62:0/501570156 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f97b4039a70 0x7f97b403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.247+0000 7f97bae05640 1 -- 172.21.15.62:0/501570156 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f98c00ebb50 con 0x5558733c6200 2024-09-10T05:36:39.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.247+0000 7f98c5cd5640 1 --2- 172.21.15.62:0/501570156 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f97b4039a70 0x7f97b403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.247+0000 7f98d09d09c0 1 --2- 172.21.15.62:0/501570156 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5558733c65e0 0x55587354dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.247+0000 7f98d09d09c0 1 -- 172.21.15.62:0/501570156 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55587354e4e0 con 0x5558733c65e0 2024-09-10T05:36:39.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.247+0000 7f98cecd7640 1 --2- 172.21.15.62:0/501570156 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5558733c65e0 0x55587354dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.247+0000 7f98c5cd5640 1 --2- 172.21.15.62:0/501570156 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f97b4039a70 0x7f97b403bf30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f98b8001e40 tx=0x7f98b80013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.247+0000 7f98cecd7640 1 --2- 172.21.15.62:0/501570156 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5558733c65e0 0x55587354dfa0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.247+0000 7f98cecd7640 1 -- 172.21.15.62:0/501570156 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98c800a4d0 con 0x5558733c65e0 2024-09-10T05:36:39.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.247+0000 7f98d09d09c0 1 --2- 172.21.15.62:0/501570156 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55587354ef90 0x555873551450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.247+0000 7f98d09d09c0 1 -- 172.21.15.62:0/501570156 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555873551bc0 con 0x55587354ef90 2024-09-10T05:36:39.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.247+0000 7f98ce4d6640 1 --2- 172.21.15.62:0/501570156 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55587354ef90 0x555873551450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.247+0000 7f98ce4d6640 1 --2- 172.21.15.62:0/501570156 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55587354ef90 0x555873551450 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.247+0000 7f98ce4d6640 1 -- 172.21.15.62:0/501570156 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f98c00bc690 con 0x55587354ef90 2024-09-10T05:36:39.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.247+0000 7f98d09d09c0 1 --2- 172.21.15.62:0/501570156 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x555873553980 0x555873555d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.247+0000 7f98d09d09c0 1 -- 172.21.15.62:0/501570156 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555873556440 con 0x555873553980 2024-09-10T05:36:39.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.251+0000 7f98c5cd5640 1 --2- 172.21.15.62:0/501570156 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x555873553980 0x555873555d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.251+0000 7f98c5cd5640 1 --2- 172.21.15.62:0/501570156 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x555873553980 0x555873555d70 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.251+0000 7f98c5cd5640 1 -- 172.21.15.62:0/501570156 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f98b800bd60 con 0x555873553980 2024-09-10T05:36:39.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.251+0000 7f98d09d09c0 1 -- 172.21.15.62:0/501570156 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555873552820 con 0x55587354ef90 2024-09-10T05:36:39.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.251+0000 7f98ce4d6640 1 -- 172.21.15.62:0/501570156 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f98c00bc690 con 0x55587354ef90 2024-09-10T05:36:39.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.251+0000 7f98d09d09c0 1 -- 172.21.15.62:0/501570156 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555873552c80 con 0x555873553980 2024-09-10T05:36:39.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.251+0000 7f98c5cd5640 1 -- 172.21.15.62:0/501570156 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f98b800bd60 con 0x555873553980 2024-09-10T05:36:39.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.251+0000 7f98d09d09c0 1 Processor -- start 2024-09-10T05:36:39.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.251+0000 7f98d09d09c0 1 -- start start 2024-09-10T05:36:39.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.251+0000 7f98d09d09c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555873564b10 0x555873564f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.251+0000 7f98d09d09c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555873367450 con 0x555873564b10 2024-09-10T05:36:39.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.251+0000 7f98ce4d6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555873564b10 0x555873564f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.251+0000 7f98ce4d6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555873564b10 0x555873564f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47994/0 (socket says 172.21.15.62:47994) 2024-09-10T05:36:39.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.251+0000 7f98ce4d6640 1 -- 172.21.15.62:0/835375851 learned_addr learned my addr 172.21.15.62:0/835375851 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:39.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.251+0000 7f98ce4d6640 1 -- 172.21.15.62:0/835375851 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555873565570 con 0x555873564b10 2024-09-10T05:36:39.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.255+0000 7f98ce4d6640 1 --2- 172.21.15.62:0/835375851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555873564b10 0x555873564f30 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f98c00bffd0 tx=0x7f98c00c5e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.255+0000 7f97b3fff640 1 -- 172.21.15.62:0/835375851 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98c00f0070 con 0x555873564b10 2024-09-10T05:36:39.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.255+0000 7f97b3fff640 1 -- 172.21.15.62:0/835375851 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98c00c55f0 con 0x555873564b10 2024-09-10T05:36:39.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.255+0000 7f97b3fff640 1 -- 172.21.15.62:0/835375851 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98c00c58f0 con 0x555873564b10 2024-09-10T05:36:39.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.255+0000 7f98d09d09c0 1 -- 172.21.15.62:0/835375851 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555873565dd0 con 0x555873564b10 2024-09-10T05:36:39.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.255+0000 7f98d09d09c0 1 -- 172.21.15.62:0/835375851 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555873565dd0 con 0x555873564b10 2024-09-10T05:36:39.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.255+0000 7f97b3fff640 1 -- 172.21.15.62:0/835375851 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f98c00f3070 con 0x555873564b10 2024-09-10T05:36:39.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.255+0000 7f97b3fff640 1 --2- 172.21.15.62:0/835375851 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f97a8039a70 0x7f97a803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.255+0000 7f97b3fff640 1 -- 172.21.15.62:0/835375851 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f98c00f6af0 con 0x555873564b10 2024-09-10T05:36:39.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.255+0000 7f98c5cd5640 1 --2- 172.21.15.62:0/835375851 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f97a8039a70 0x7f97a803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.255+0000 7f98d09d09c0 1 Processor -- start 2024-09-10T05:36:39.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.255+0000 7f98d09d09c0 1 -- start start 2024-09-10T05:36:39.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.255+0000 7f98d09d09c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555873571080 0x555873571460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.255+0000 7f98d09d09c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555873540060 con 0x555873571080 2024-09-10T05:36:39.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.255+0000 7f98c5cd5640 1 --2- 172.21.15.62:0/835375851 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f97a8039a70 0x7f97a803bf30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f98b800c010 tx=0x7f98b800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.255+0000 7f98ce4d6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555873571080 0x555873571460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.255+0000 7f98ce4d6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555873571080 0x555873571460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:48004/0 (socket says 172.21.15.62:48004) 2024-09-10T05:36:39.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.255+0000 7f98ce4d6640 1 -- 172.21.15.62:0/1631159472 learned_addr learned my addr 172.21.15.62:0/1631159472 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:39.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.255+0000 7f98ce4d6640 1 -- 172.21.15.62:0/1631159472 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555873571a30 con 0x555873571080 2024-09-10T05:36:39.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.259+0000 7f98ce4d6640 1 --2- 172.21.15.62:0/1631159472 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555873571080 0x555873571460 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f98c00e6dd0 tx=0x7f98c00c4db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaca5d99ec689f7d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.259+0000 7f97b1ffb640 1 -- 172.21.15.62:0/1631159472 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98c00add90 con 0x555873571080 2024-09-10T05:36:39.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.259+0000 7f97b1ffb640 1 -- 172.21.15.62:0/1631159472 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98c00db440 con 0x555873571080 2024-09-10T05:36:39.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.259+0000 7f97b1ffb640 1 -- 172.21.15.62:0/1631159472 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98c00c1cd0 con 0x555873571080 2024-09-10T05:36:39.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.259+0000 7f98d09d09c0 1 -- 172.21.15.62:0/1631159472 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555873571080 msgr2=0x555873571460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.259+0000 7f98d09d09c0 1 --2- 172.21.15.62:0/1631159472 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555873571080 0x555873571460 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f98c00e6dd0 tx=0x7f98c00c4db0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.259+0000 7f98d09d09c0 1 -- 172.21.15.62:0/1631159472 shutdown_connections 2024-09-10T05:36:39.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.259+0000 7f98d09d09c0 1 --2- 172.21.15.62:0/1631159472 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555873571080 0x555873571460 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.259+0000 7f98d09d09c0 1 -- 172.21.15.62:0/1631159472 >> 172.21.15.62:0/1631159472 conn(0x55587356d4b0 msgr2=0x55587356b6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:39.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.259+0000 7f98d09d09c0 1 -- 172.21.15.62:0/1631159472 shutdown_connections 2024-09-10T05:36:39.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.259+0000 7f98d09d09c0 1 -- 172.21.15.62:0/1631159472 wait complete. 2024-09-10T05:36:39.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.259+0000 7f98d09d09c0 1 Processor -- start 2024-09-10T05:36:39.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.259+0000 7f98d09d09c0 1 -- start start 2024-09-10T05:36:39.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.259+0000 7f98d09d09c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555873571080 0x5558735783b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.259+0000 7f98d09d09c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555873571f10 con 0x555873571080 2024-09-10T05:36:39.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.259+0000 7f98ce4d6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555873571080 0x5558735783b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.259+0000 7f98ce4d6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555873571080 0x5558735783b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:48016/0 (socket says 172.21.15.62:48016) 2024-09-10T05:36:39.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.259+0000 7f98ce4d6640 1 -- 172.21.15.62:0/172618468 learned_addr learned my addr 172.21.15.62:0/172618468 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:39.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.259+0000 7f98ce4d6640 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555873578910 con 0x555873571080 2024-09-10T05:36:39.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.259+0000 7f98ce4d6640 1 --2- 172.21.15.62:0/172618468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555873571080 0x5558735783b0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f98c00cf3e0 tx=0x7f98c00f8ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.259+0000 7f979ffff640 1 -- 172.21.15.62:0/172618468 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98c00e2220 con 0x555873571080 2024-09-10T05:36:39.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.259+0000 7f979ffff640 1 -- 172.21.15.62:0/172618468 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98c00e23c0 con 0x555873571080 2024-09-10T05:36:39.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.259+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555873578910 con 0x555873571080 2024-09-10T05:36:39.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.259+0000 7f979ffff640 1 -- 172.21.15.62:0/172618468 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98c00b3850 con 0x555873571080 2024-09-10T05:36:39.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.259+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555873578910 con 0x555873571080 2024-09-10T05:36:39.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.263+0000 7f98d09d09c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.263+0000 7f979ffff640 1 -- 172.21.15.62:0/172618468 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f98c00b39f0 con 0x555873571080 2024-09-10T05:36:39.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.263+0000 7f979ffff640 1 --2- 172.21.15.62:0/172618468 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f9798039ac0 0x7f979803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.263+0000 7f979ffff640 1 -- 172.21.15.62:0/172618468 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f98c0100070 con 0x555873571080 2024-09-10T05:36:39.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.263+0000 7f98c5cd5640 1 --2- 172.21.15.62:0/172618468 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f9798039ac0 0x7f979803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.263+0000 7f98d09d09c0 1 --2- 172.21.15.62:0/172618468 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x555873583280 0x555873585710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.263+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555873585e60 con 0x555873583280 2024-09-10T05:36:39.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.263+0000 7f98cecd7640 1 --2- 172.21.15.62:0/172618468 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x555873583280 0x555873585710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.263+0000 7f98c5cd5640 1 --2- 172.21.15.62:0/172618468 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f9798039ac0 0x7f979803bf80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x555873552bc0 tx=0x7f98b8010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.263+0000 7f98cecd7640 1 --2- 172.21.15.62:0/172618468 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x555873583280 0x555873585710 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.263+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98c800a4d0 con 0x555873583280 2024-09-10T05:36:39.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.263+0000 7f98d09d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:39.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.263+0000 7f98d09d09c0 20 realm 2024-09-10T05:36:39.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.263+0000 7f98d09d09c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.263+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555873582670 con 0x555873583280 2024-09-10T05:36:39.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.263+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98c800a4d0 con 0x555873583280 2024-09-10T05:36:39.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.263+0000 7f98d09d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:39.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.263+0000 7f98d09d09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:39.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.263+0000 7f98d09d09c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.263+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555873586920 con 0x555873583280 2024-09-10T05:36:39.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.263+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98c800a4d0 con 0x555873583280 2024-09-10T05:36:39.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.263+0000 7f98d09d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:39.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.263+0000 7f98d09d09c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.263+0000 7f98d09d09c0 1 --2- 172.21.15.62:0/172618468 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x555873587700 0x555873589af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.263+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55587358a1a0 con 0x555873587700 2024-09-10T05:36:39.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.263+0000 7f98ce4d6640 1 --2- 172.21.15.62:0/172618468 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x555873587700 0x555873589af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.267+0000 7f98ce4d6640 1 --2- 172.21.15.62:0/172618468 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x555873587700 0x555873589af0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.267+0000 7f98ce4d6640 1 -- 172.21.15.62:0/172618468 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f98c011d020 con 0x555873587700 2024-09-10T05:36:39.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.267+0000 7f98d09d09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:39.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.267+0000 7f98d09d09c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.267+0000 7f98d09d09c0 1 --2- 172.21.15.62:0/172618468 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55587358af50 0x55587358d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.267+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55587358d9e0 con 0x55587358af50 2024-09-10T05:36:39.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.267+0000 7f98c5cd5640 1 --2- 172.21.15.62:0/172618468 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55587358af50 0x55587358d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.267+0000 7f98c5cd5640 1 --2- 172.21.15.62:0/172618468 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55587358af50 0x55587358d340 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.267+0000 7f98c5cd5640 1 -- 172.21.15.62:0/172618468 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f98b800bd60 con 0x55587358af50 2024-09-10T05:36:39.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.267+0000 7f98d09d09c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:39.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.267+0000 7f98d09d09c0 20 searching for the correct realm 2024-09-10T05:36:39.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.267+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55587358f2d0 con 0x55587358af50 2024-09-10T05:36:39.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.267+0000 7f98c5cd5640 1 -- 172.21.15.62:0/172618468 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b800bd60 con 0x55587358af50 2024-09-10T05:36:39.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.267+0000 7f98c5cd5640 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55587358f2d0 con 0x555873587700 2024-09-10T05:36:39.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.267+0000 7f98ce4d6640 1 -- 172.21.15.62:0/172618468 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c011d020 con 0x555873587700 2024-09-10T05:36:39.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.267+0000 7f98ce4d6640 1 --2- 172.21.15.62:0/172618468 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f98c010e040 0x7f98c0120440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.267+0000 7f98ce4d6640 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55587358f2d0 con 0x7f98c010e040 2024-09-10T05:36:39.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.267+0000 7f98cecd7640 1 --2- 172.21.15.62:0/172618468 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f98c010e040 0x7f98c0120440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.267+0000 7f98cecd7640 1 --2- 172.21.15.62:0/172618468 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f98c010e040 0x7f98c0120440 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.267+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c800a4d0 con 0x7f98c010e040 2024-09-10T05:36:39.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.267+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55587358f2d0 con 0x555873583280 2024-09-10T05:36:39.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.271+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c800a4d0 con 0x555873583280 2024-09-10T05:36:39.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.271+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55587358f2d0 con 0x555873583280 2024-09-10T05:36:39.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.271+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c800a4d0 con 0x555873583280 2024-09-10T05:36:39.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.271+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55587358f2d0 con 0x55587358af50 2024-09-10T05:36:39.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.271+0000 7f98c5cd5640 1 -- 172.21.15.62:0/172618468 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b800bd60 con 0x55587358af50 2024-09-10T05:36:39.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.271+0000 7f98c5cd5640 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55587358f2d0 con 0x555873583280 2024-09-10T05:36:39.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.271+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c800a4d0 con 0x555873583280 2024-09-10T05:36:39.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.271+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55587358f2d0 con 0x555873587700 2024-09-10T05:36:39.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.271+0000 7f98ce4d6640 1 -- 172.21.15.62:0/172618468 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c011d020 con 0x555873587700 2024-09-10T05:36:39.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.271+0000 7f98ce4d6640 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55587358f2d0 con 0x555873587700 2024-09-10T05:36:39.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.271+0000 7f98ce4d6640 1 -- 172.21.15.62:0/172618468 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c011d020 con 0x555873587700 2024-09-10T05:36:39.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.271+0000 7f98ce4d6640 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55587358f2d0 con 0x555873583280 2024-09-10T05:36:39.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.271+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c800a4d0 con 0x555873583280 2024-09-10T05:36:39.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.271+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55587358f2d0 con 0x7f98c010e040 2024-09-10T05:36:39.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.271+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c800a4d0 con 0x7f98c010e040 2024-09-10T05:36:39.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.271+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55587358f2d0 con 0x555873583280 2024-09-10T05:36:39.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.271+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c800a4d0 con 0x555873583280 2024-09-10T05:36:39.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.271+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55587358f2d0 con 0x7f98c010e040 2024-09-10T05:36:39.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.271+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f98c800a4d0 con 0x7f98c010e040 2024-09-10T05:36:39.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.271+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55587358f2d0 con 0x555873587700 2024-09-10T05:36:39.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.275+0000 7f98ce4d6640 1 -- 172.21.15.62:0/172618468 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c011d020 con 0x555873587700 2024-09-10T05:36:39.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.275+0000 7f98ce4d6640 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55587358f2d0 con 0x55587358af50 2024-09-10T05:36:39.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.275+0000 7f98c5cd5640 1 -- 172.21.15.62:0/172618468 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b800bd60 con 0x55587358af50 2024-09-10T05:36:39.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.275+0000 7f98c5cd5640 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55587358f2d0 con 0x555873583280 2024-09-10T05:36:39.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.275+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c800a4d0 con 0x555873583280 2024-09-10T05:36:39.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.275+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55587358f2d0 con 0x555873587700 2024-09-10T05:36:39.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.275+0000 7f98ce4d6640 1 -- 172.21.15.62:0/172618468 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c011d020 con 0x555873587700 2024-09-10T05:36:39.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.275+0000 7f98ce4d6640 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55587358f2d0 con 0x55587358af50 2024-09-10T05:36:39.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.275+0000 7f98c5cd5640 1 -- 172.21.15.62:0/172618468 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 30 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f98b800bd60 con 0x55587358af50 2024-09-10T05:36:39.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.275+0000 7f98c5cd5640 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55587358f2d0 con 0x555873583280 2024-09-10T05:36:39.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.275+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c800a4d0 con 0x555873583280 2024-09-10T05:36:39.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.275+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55587358f2d0 con 0x555873583280 2024-09-10T05:36:39.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.275+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f98c800a4d0 con 0x555873583280 2024-09-10T05:36:39.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.275+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55587358f2d0 con 0x555873583280 2024-09-10T05:36:39.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.275+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c800a4d0 con 0x555873583280 2024-09-10T05:36:39.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.275+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55587358f2d0 con 0x55587358af50 2024-09-10T05:36:39.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.275+0000 7f98c5cd5640 1 -- 172.21.15.62:0/172618468 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b800bd60 con 0x55587358af50 2024-09-10T05:36:39.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.275+0000 7f98c5cd5640 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55587358f2d0 con 0x7f98c010e040 2024-09-10T05:36:39.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.275+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c800a4d0 con 0x7f98c010e040 2024-09-10T05:36:39.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.275+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55587358f2d0 con 0x555873583280 2024-09-10T05:36:39.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.279+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c800a4d0 con 0x555873583280 2024-09-10T05:36:39.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.279+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55587358f2d0 con 0x7f98c010e040 2024-09-10T05:36:39.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.279+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c800a4d0 con 0x7f98c010e040 2024-09-10T05:36:39.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.279+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55587358f2d0 con 0x55587358af50 2024-09-10T05:36:39.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.279+0000 7f98c5cd5640 1 -- 172.21.15.62:0/172618468 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b800bd60 con 0x55587358af50 2024-09-10T05:36:39.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.279+0000 7f98c5cd5640 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55587358f2d0 con 0x7f98c010e040 2024-09-10T05:36:39.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.279+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c800a4d0 con 0x7f98c010e040 2024-09-10T05:36:39.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.279+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55587358f2d0 con 0x555873587700 2024-09-10T05:36:39.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.279+0000 7f98ce4d6640 1 -- 172.21.15.62:0/172618468 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c011d020 con 0x555873587700 2024-09-10T05:36:39.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.279+0000 7f98ce4d6640 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55587358f2d0 con 0x555873587700 2024-09-10T05:36:39.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.279+0000 7f98ce4d6640 1 -- 172.21.15.62:0/172618468 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c011d020 con 0x555873587700 2024-09-10T05:36:39.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.279+0000 7f98ce4d6640 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55587358f2d0 con 0x55587358af50 2024-09-10T05:36:39.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.279+0000 7f98c5cd5640 1 -- 172.21.15.62:0/172618468 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b800bd60 con 0x55587358af50 2024-09-10T05:36:39.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.279+0000 7f98c5cd5640 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55587358f2d0 con 0x555873587700 2024-09-10T05:36:39.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.279+0000 7f98ce4d6640 1 -- 172.21.15.62:0/172618468 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f98c011d020 con 0x555873587700 2024-09-10T05:36:39.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.279+0000 7f98ce4d6640 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55587358f2d0 con 0x555873587700 2024-09-10T05:36:39.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.283+0000 7f98ce4d6640 1 -- 172.21.15.62:0/172618468 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c011d020 con 0x555873587700 2024-09-10T05:36:39.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.283+0000 7f98d09d09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:39.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.283+0000 7f98d09d09c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:39.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.283+0000 7f98d09d09c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:39.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.283+0000 7f98d09d09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:39.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.283+0000 7f98d09d09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:39.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.283+0000 7f98d09d09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:39.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.283+0000 7f98d09d09c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.283+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55587358e3d0 con 0x555873583280 2024-09-10T05:36:39.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.283+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98c800a4d0 con 0x555873583280 2024-09-10T05:36:39.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.283+0000 7f98d09d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:39.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.283+0000 7f98d09d09c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.283+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55587358e820 con 0x555873587700 2024-09-10T05:36:39.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.283+0000 7f98ce4d6640 1 -- 172.21.15.62:0/172618468 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f98c011d020 con 0x555873587700 2024-09-10T05:36:39.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.283+0000 7f98d09d09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:39.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.283+0000 7f98d09d09c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.283+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55587358ec80 con 0x55587358af50 2024-09-10T05:36:39.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.283+0000 7f98c5cd5640 1 -- 172.21.15.62:0/172618468 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f98b800bd60 con 0x55587358af50 2024-09-10T05:36:39.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.283+0000 7f98d09d09c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:39.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.283+0000 7f98d09d09c0 20 zone default found 2024-09-10T05:36:39.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.283+0000 7f98d09d09c0 4 Realm: () 2024-09-10T05:36:39.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.283+0000 7f98d09d09c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:39.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.283+0000 7f98d09d09c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:39.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.283+0000 7f98d09d09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:39.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.283+0000 7f98d09d09c0 20 zonegroup default 2024-09-10T05:36:39.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.283+0000 7f98d09d09c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.283+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55587358f7a0 con 0x7f98c010e040 2024-09-10T05:36:39.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.283+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f98c800a4d0 con 0x7f98c010e040 2024-09-10T05:36:39.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.283+0000 7f98d09d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:39.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.283+0000 7f98d09d09c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.283+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555873591a60 con 0x55587358af50 2024-09-10T05:36:39.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.283+0000 7f98c5cd5640 1 -- 172.21.15.62:0/172618468 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f98b800bd60 con 0x55587358af50 2024-09-10T05:36:39.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.283+0000 7f98d09d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:39.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.283+0000 7f98d09d09c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.283+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555873591e00 con 0x55587358af50 2024-09-10T05:36:39.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.283+0000 7f98c5cd5640 1 -- 172.21.15.62:0/172618468 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f98b800bd60 con 0x55587358af50 2024-09-10T05:36:39.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.283+0000 7f98d09d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:39.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.283+0000 7f98d09d09c0 20 started sync module instance, tier type = 2024-09-10T05:36:39.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.283+0000 7f98d09d09c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:39.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.283+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555873590ef0 con 0x555873587700 2024-09-10T05:36:39.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.287+0000 7f98ce4d6640 1 -- 172.21.15.62:0/172618468 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c011d020 con 0x555873587700 2024-09-10T05:36:39.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.287+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93838380700384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555873592710 con 0x555873587700 2024-09-10T05:36:39.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.287+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555873592f60 con 0x555873583280 2024-09-10T05:36:39.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.287+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c800a4d0 con 0x555873583280 2024-09-10T05:36:39.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.287+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93838380705552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5558735937b0 con 0x555873583280 2024-09-10T05:36:39.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.287+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555873594000 con 0x555873587700 2024-09-10T05:36:39.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.287+0000 7f98ce4d6640 1 -- 172.21.15.62:0/172618468 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 93838380700384] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c011d020 con 0x555873587700 2024-09-10T05:36:39.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.287+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93838380705552] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c800a4d0 con 0x555873583280 2024-09-10T05:36:39.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.291+0000 7f98ce4d6640 1 -- 172.21.15.62:0/172618468 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c011d020 con 0x555873587700 2024-09-10T05:36:39.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.291+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93838380708608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555873593bd0 con 0x555873587700 2024-09-10T05:36:39.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.291+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555873594420 con 0x7f98c010e040 2024-09-10T05:36:39.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.291+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c800a4d0 con 0x7f98c010e040 2024-09-10T05:36:39.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.291+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93838380711136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555873594810 con 0x7f98c010e040 2024-09-10T05:36:39.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.291+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5558735952e0 con 0x555873587700 2024-09-10T05:36:39.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.291+0000 7f98ce4d6640 1 -- 172.21.15.62:0/172618468 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93838380708608] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c011d020 con 0x555873587700 2024-09-10T05:36:39.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.291+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93838380711136] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c800a4d0 con 0x7f98c010e040 2024-09-10T05:36:39.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.291+0000 7f98ce4d6640 1 -- 172.21.15.62:0/172618468 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c011d020 con 0x555873587700 2024-09-10T05:36:39.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.291+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93838380715472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5558735952a0 con 0x555873587700 2024-09-10T05:36:39.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.291+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555873595b80 con 0x55587358af50 2024-09-10T05:36:39.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.295+0000 7f98c5cd5640 1 -- 172.21.15.62:0/172618468 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98b800bd60 con 0x55587358af50 2024-09-10T05:36:39.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.295+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93838380717776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5558735952a0 con 0x55587358af50 2024-09-10T05:36:39.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.295+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5558735965c0 con 0x55587358af50 2024-09-10T05:36:39.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.295+0000 7f98ce4d6640 1 -- 172.21.15.62:0/172618468 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 93838380715472] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c011d020 con 0x555873587700 2024-09-10T05:36:39.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.295+0000 7f98c5cd5640 1 -- 172.21.15.62:0/172618468 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93838380717776] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98b800bd60 con 0x55587358af50 2024-09-10T05:36:39.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.295+0000 7f98c5cd5640 1 -- 172.21.15.62:0/172618468 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98b800bd60 con 0x55587358af50 2024-09-10T05:36:39.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.295+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93838380718832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555873596110 con 0x55587358af50 2024-09-10T05:36:39.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.295+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555873596e90 con 0x7f98c010e040 2024-09-10T05:36:39.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.299+0000 7f98c5cd5640 1 -- 172.21.15.62:0/172618468 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93838380718832] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98b800bd60 con 0x55587358af50 2024-09-10T05:36:39.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.299+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c800a4d0 con 0x7f98c010e040 2024-09-10T05:36:39.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.299+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93838380709664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555873596110 con 0x7f98c010e040 2024-09-10T05:36:39.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.299+0000 7f98d09d09c0 20 add_watcher() i=0 2024-09-10T05:36:39.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.299+0000 7f98d09d09c0 20 add_watcher() i=1 2024-09-10T05:36:39.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.299+0000 7f98d09d09c0 20 add_watcher() i=2 2024-09-10T05:36:39.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.299+0000 7f98d09d09c0 20 add_watcher() i=3 2024-09-10T05:36:39.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.299+0000 7f98d09d09c0 20 add_watcher() i=4 2024-09-10T05:36:39.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.299+0000 7f98d09d09c0 20 add_watcher() i=5 2024-09-10T05:36:39.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.299+0000 7f98d09d09c0 20 add_watcher() i=6 2024-09-10T05:36:39.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.299+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93838380709664] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c800a4d0 con 0x7f98c010e040 2024-09-10T05:36:39.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.299+0000 7f98d09d09c0 20 add_watcher() i=7 2024-09-10T05:36:39.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.299+0000 7f98d09d09c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:39.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.299+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555873599ef0 con 0x555873583280 2024-09-10T05:36:39.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.299+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f98c800a4d0 con 0x555873583280 2024-09-10T05:36:39.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.299+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93838380722656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555873597480 con 0x555873583280 2024-09-10T05:36:39.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.303+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93838380722656] v30'150 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f98c800a4d0 con 0x555873583280 2024-09-10T05:36:39.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.303+0000 7f9784fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:39.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.303+0000 7f98d09d09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:39.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.303+0000 7f98d09d09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:39.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.303+0000 7f98d09d09c0 5 note: GC not initialized 2024-09-10T05:36:39.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.303+0000 7f96ff7fe640 20 reqs_thread_entry: start 2024-09-10T05:36:39.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.303+0000 7f98d09d09c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:39.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.303+0000 7f98d09d09c0 20 Filter name: none 2024-09-10T05:36:39.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.303+0000 7f96fd7fa640 20 reqs_thread_entry: start 2024-09-10T05:36:39.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.303+0000 7f98d09d09c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.303+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5558735bd2a0 con 0x7f98c010e040 2024-09-10T05:36:39.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.303+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f98c800a4d0 con 0x7f98c010e040 2024-09-10T05:36:39.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.303+0000 7f98d09d09c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T05:36:39.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.303+0000 7f98d09d09c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.303+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:63 8.1f 8:fcc5c255:root::.bucket.meta.myfoo%3a475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5558735bdb30 con 0x7f98c010e040 2024-09-10T05:36:39.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.303+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(63 .bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f98c800a4d0 con 0x7f98c010e040 2024-09-10T05:36:39.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.303+0000 7f98d09d09c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T05:36:39.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.303+0000 7f98d09d09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-10T05:36:39.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.303+0000 7f98d09d09c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.303+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5558735bc550 con 0x7f98c010e040 2024-09-10T05:36:39.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.303+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f98c800a4d0 con 0x7f98c010e040 2024-09-10T05:36:39.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.303+0000 7f98d09d09c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T05:36:39.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.303+0000 7f98d09d09c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.303+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:65 8.1f 8:fcc5c255:root::.bucket.meta.myfoo%3a475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5558735bf140 con 0x7f98c010e040 2024-09-10T05:36:39.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.303+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 <== osd.2 v2:172.21.15.62:6800/2677868286 15 ==== osd_op_reply(65 .bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f98c800a4d0 con 0x7f98c010e040 2024-09-10T05:36:39.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.303+0000 7f98d09d09c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T05:36:39.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.303+0000 7f98d09d09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-10T05:36:39.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.303+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:66 4.39 4:9f393805:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5558735beb70 con 0x55587358af50 2024-09-10T05:36:39.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.303+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:67 4.27 4:e72118f4:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5558735c3a60 con 0x555873583280 2024-09-10T05:36:39.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.303+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 4.32 4:4fe9cf27:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5558735c6350 con 0x555873587700 2024-09-10T05:36:39.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.303+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:69 4.c 4:3284697f:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5558735c8c00 con 0x555873583280 2024-09-10T05:36:39.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.303+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:70 4.a 4:5050a708:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5558735c6350 con 0x555873587700 2024-09-10T05:36:39.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.303+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:71 4.1b 4:db0b4800:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5558735cdca0 con 0x7f98c010e040 2024-09-10T05:36:39.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.303+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:72 4.1f 4:fa625c04:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5558735d0550 con 0x555873587700 2024-09-10T05:36:39.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.303+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:73 4.d 4:b20f8417:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5558735d33e0 con 0x555873587700 2024-09-10T05:36:39.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.303+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:74 4.3 4:c3f62267:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5558735d5ee0 con 0x555873583280 2024-09-10T05:36:39.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.303+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:75 4.26 4:65fa9cda:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5558735d8750 con 0x555873583280 2024-09-10T05:36:39.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.303+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:76 4.3e 4:7c38a587:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5558735db270 con 0x555873587700 2024-09-10T05:36:39.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.307+0000 7f98c5cd5640 1 -- 172.21.15.62:0/172618468 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(66 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f98b800bd60 con 0x55587358af50 2024-09-10T05:36:39.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.307+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(67 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f98c803e070 con 0x555873583280 2024-09-10T05:36:39.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.307+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(69 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f98c803e070 con 0x555873583280 2024-09-10T05:36:39.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.307+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(75 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f98c803e070 con 0x555873583280 2024-09-10T05:36:39.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.307+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(74 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.8 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f98c803e070 con 0x555873583280 2024-09-10T05:36:39.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.307+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 <== osd.2 v2:172.21.15.62:6800/2677868286 16 ==== osd_op_reply(71 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.5 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f98c803e070 con 0x7f98c010e040 2024-09-10T05:36:39.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.307+0000 7f98ce4d6640 1 -- 172.21.15.62:0/172618468 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(68 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f98c011d020 con 0x555873587700 2024-09-10T05:36:39.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.307+0000 7f98ce4d6640 1 -- 172.21.15.62:0/172618468 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(73 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f98c011d020 con 0x555873587700 2024-09-10T05:36:39.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.307+0000 7f98ce4d6640 1 -- 172.21.15.62:0/172618468 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(70 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f98c011d020 con 0x555873587700 2024-09-10T05:36:39.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.307+0000 7f98ce4d6640 1 -- 172.21.15.62:0/172618468 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== osd_op_reply(72 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.6 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f98c011d020 con 0x555873587700 2024-09-10T05:36:39.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.307+0000 7f98ce4d6640 1 -- 172.21.15.62:0/172618468 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== osd_op_reply(76 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f98c011d020 con 0x555873587700 2024-09-10T05:36:39.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.307+0000 7f9784fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:39.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.307+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93838380722656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5558735db270 con 0x555873583280 2024-09-10T05:36:39.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.311+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 <== osd.1 v2:172.21.15.62:6808/3442097179 23 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 93838380722656] v30'151 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f98c803e070 con 0x555873583280 2024-09-10T05:36:39.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.311+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93838380700384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5558735db270 con 0x555873587700 2024-09-10T05:36:39.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.311+0000 7f98ce4d6640 1 -- 172.21.15.62:0/172618468 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 93838380700384] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c011d020 con 0x555873587700 2024-09-10T05:36:39.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.311+0000 7f98d09d09c0 20 remove_watcher() i=0 2024-09-10T05:36:39.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.311+0000 7f98d09d09c0 2 removed watcher, disabling cache 2024-09-10T05:36:39.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.311+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93838380705552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5558735db270 con 0x555873583280 2024-09-10T05:36:39.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.311+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 <== osd.1 v2:172.21.15.62:6808/3442097179 24 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 93838380705552] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c803e070 con 0x555873583280 2024-09-10T05:36:39.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.311+0000 7f98d09d09c0 20 remove_watcher() i=1 2024-09-10T05:36:39.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.311+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93838380708608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5558735db270 con 0x555873587700 2024-09-10T05:36:39.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.315+0000 7f98ce4d6640 1 -- 172.21.15.62:0/172618468 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 93838380708608] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c011d020 con 0x555873587700 2024-09-10T05:36:39.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.315+0000 7f98d09d09c0 20 remove_watcher() i=2 2024-09-10T05:36:39.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.315+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93838380711136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5558735db270 con 0x7f98c010e040 2024-09-10T05:36:39.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.315+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 <== osd.2 v2:172.21.15.62:6800/2677868286 17 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 93838380711136] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c803e070 con 0x7f98c010e040 2024-09-10T05:36:39.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.315+0000 7f98d09d09c0 20 remove_watcher() i=3 2024-09-10T05:36:39.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.315+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93838380715472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5558735db270 con 0x555873587700 2024-09-10T05:36:39.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.319+0000 7f98ce4d6640 1 -- 172.21.15.62:0/172618468 <== osd.0 v2:172.21.15.2:6800/945139080 25 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 93838380715472] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c011d020 con 0x555873587700 2024-09-10T05:36:39.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.319+0000 7f98d09d09c0 20 remove_watcher() i=4 2024-09-10T05:36:39.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.319+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93838380717776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5558735db270 con 0x55587358af50 2024-09-10T05:36:39.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.319+0000 7f98c5cd5640 1 -- 172.21.15.62:0/172618468 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 93838380717776] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98b800bd60 con 0x55587358af50 2024-09-10T05:36:39.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.319+0000 7f98d09d09c0 20 remove_watcher() i=5 2024-09-10T05:36:39.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.319+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93838380718832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5558735db270 con 0x55587358af50 2024-09-10T05:36:39.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.323+0000 7f98c5cd5640 1 -- 172.21.15.62:0/172618468 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 93838380718832] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98b800bd60 con 0x55587358af50 2024-09-10T05:36:39.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.323+0000 7f98d09d09c0 20 remove_watcher() i=6 2024-09-10T05:36:39.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.323+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93838380709664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5558735db270 con 0x7f98c010e040 2024-09-10T05:36:39.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.323+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 <== osd.2 v2:172.21.15.62:6800/2677868286 18 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 93838380709664] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c803e070 con 0x7f98c010e040 2024-09-10T05:36:39.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.323+0000 7f98d09d09c0 20 remove_watcher() i=7 2024-09-10T05:36:39.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.323+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x555873587700 msgr2=0x555873589af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.323+0000 7f98d09d09c0 1 --2- 172.21.15.62:0/172618468 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x555873587700 0x555873589af0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.323+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x555873583280 msgr2=0x555873585710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.323+0000 7f98d09d09c0 1 --2- 172.21.15.62:0/172618468 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x555873583280 0x555873585710 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.323+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f98c010e040 msgr2=0x7f98c0120440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.323+0000 7f98d09d09c0 1 --2- 172.21.15.62:0/172618468 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f98c010e040 0x7f98c0120440 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.323+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55587358af50 msgr2=0x55587358d340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.323+0000 7f98d09d09c0 1 --2- 172.21.15.62:0/172618468 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55587358af50 0x55587358d340 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.323+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f9798039ac0 msgr2=0x7f979803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.323+0000 7f98d09d09c0 1 --2- 172.21.15.62:0/172618468 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f9798039ac0 0x7f979803bf80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x555873552bc0 tx=0x7f98b8010000 comp rx=0 tx=0).stop 2024-09-10T05:36:39.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.323+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555873571080 msgr2=0x5558735783b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.323+0000 7f98d09d09c0 1 --2- 172.21.15.62:0/172618468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555873571080 0x5558735783b0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f98c00cf3e0 tx=0x7f98c00f8ee0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.323+0000 7f98cecd7640 1 -- 172.21.15.62:0/172618468 reap_dead start 2024-09-10T05:36:39.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.323+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 shutdown_connections 2024-09-10T05:36:39.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.323+0000 7f98d09d09c0 1 --2- 172.21.15.62:0/172618468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555873571080 0x5558735783b0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.323+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 >> 172.21.15.62:0/172618468 conn(0x55587356d4b0 msgr2=0x55587356b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:39.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.323+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 shutdown_connections 2024-09-10T05:36:39.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.323+0000 7f98d09d09c0 1 -- 172.21.15.62:0/172618468 wait complete. 2024-09-10T05:36:39.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.323+0000 7f98d09d09c0 1 -- 172.21.15.62:0/835375851 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f97a8039a70 msgr2=0x7f97a803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.323+0000 7f98d09d09c0 1 --2- 172.21.15.62:0/835375851 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f97a8039a70 0x7f97a803bf30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f98b800c010 tx=0x7f98b800f000 comp rx=0 tx=0).stop 2024-09-10T05:36:39.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.323+0000 7f98d09d09c0 1 -- 172.21.15.62:0/835375851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555873564b10 msgr2=0x555873564f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.323+0000 7f98d09d09c0 1 --2- 172.21.15.62:0/835375851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555873564b10 0x555873564f30 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f98c00bffd0 tx=0x7f98c00c5e00 comp rx=0 tx=0).stop 2024-09-10T05:36:39.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.323+0000 7f98d09d09c0 1 -- 172.21.15.62:0/835375851 shutdown_connections 2024-09-10T05:36:39.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.323+0000 7f98d09d09c0 1 --2- 172.21.15.62:0/835375851 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f97a8039a70 0x7f97a803bf30 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.323+0000 7f98d09d09c0 1 --2- 172.21.15.62:0/835375851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555873564b10 0x555873564f30 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.323+0000 7f98d09d09c0 1 -- 172.21.15.62:0/835375851 >> 172.21.15.62:0/835375851 conn(0x55587355a4c0 msgr2=0x55587355a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:39.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.323+0000 7f98d09d09c0 1 -- 172.21.15.62:0/835375851 shutdown_connections 2024-09-10T05:36:39.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.323+0000 7f98d09d09c0 1 -- 172.21.15.62:0/835375851 wait complete. 2024-09-10T05:36:39.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.323+0000 7f98d09d09c0 1 -- 172.21.15.62:0/501570156 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55587354ef90 msgr2=0x555873551450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.323+0000 7f98d09d09c0 1 --2- 172.21.15.62:0/501570156 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55587354ef90 0x555873551450 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.323+0000 7f98d09d09c0 1 -- 172.21.15.62:0/501570156 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5558733c65e0 msgr2=0x55587354dfa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.323+0000 7f98d09d09c0 1 --2- 172.21.15.62:0/501570156 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5558733c65e0 0x55587354dfa0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.323+0000 7f98d09d09c0 1 -- 172.21.15.62:0/501570156 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x555873553980 msgr2=0x555873555d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.323+0000 7f98d09d09c0 1 --2- 172.21.15.62:0/501570156 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x555873553980 0x555873555d70 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.323+0000 7f98d09d09c0 1 -- 172.21.15.62:0/501570156 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f97b4039a70 msgr2=0x7f97b403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.323+0000 7f98d09d09c0 1 --2- 172.21.15.62:0/501570156 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f97b4039a70 0x7f97b403bf30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f98b8001e40 tx=0x7f98b80013a0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.323+0000 7f98d09d09c0 1 -- 172.21.15.62:0/501570156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5558733c6200 msgr2=0x555873546e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.323+0000 7f98d09d09c0 1 --2- 172.21.15.62:0/501570156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5558733c6200 0x555873546e30 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f98c001b170 tx=0x7f98c00180e0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.323+0000 7f98cecd7640 1 -- 172.21.15.62:0/501570156 reap_dead start 2024-09-10T05:36:39.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.323+0000 7f98d09d09c0 1 -- 172.21.15.62:0/501570156 shutdown_connections 2024-09-10T05:36:39.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.323+0000 7f98d09d09c0 1 -- 172.21.15.62:0/501570156 >> 172.21.15.62:0/501570156 conn(0x55587344c920 msgr2=0x555873539fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:39.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.323+0000 7f98d09d09c0 1 -- 172.21.15.62:0/501570156 shutdown_connections 2024-09-10T05:36:39.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.323+0000 7f98d09d09c0 1 -- 172.21.15.62:0/501570156 wait complete. 2024-09-10T05:36:39.339 INFO:teuthology.orchestra.run.smithi062.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"1e560b55-359a-4aa1-8333-6dabf7061701","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1","marker":"475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-10T05:36:38.520615Z","creation_time":"2024-09-10T05:36:34.646920Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":0,"size_actual":0,"size_utilized":0,"size_kb":0,"size_kb_actual":0,"size_kb_utilized":0,"num_objects":0}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":2} 2024-09-10T05:36:39.340 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '1e560b55-359a-4aa1-8333-6dabf7061701', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1', 'marker': '475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-10T05:36:38.520615Z', 'creation_time': '2024-09-10T05:36:34.646920Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 2} 2024-09-10T05:36:39.340 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2024-09-10T05:36:39.340 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2024-09-10T05:36:39.340 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2024-09-10T05:36:39.409 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:39.409 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:39.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.407+0000 7f06ef3fe9c0 1 Processor -- start 2024-09-10T05:36:39.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.407+0000 7f06ef3fe9c0 1 -- start start 2024-09-10T05:36:39.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.407+0000 7f06ef3fe9c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5566e2a8dfc0 0x5566e2a903b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.407+0000 7f06ef3fe9c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5566e293f9c0 con 0x5566e2a89dd0 2024-09-10T05:36:39.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.407+0000 7f06ef3fe9c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x5566e298f6d0 con 0x5566e2a8dfc0 2024-09-10T05:36:39.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.407+0000 7f06ec703640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5566e2a8dfc0 0x5566e2a903b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.407+0000 7f06ecf04640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x5566e2a89dd0 0x5566e2a8a1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:53176/0 (socket says 172.21.15.62:53176) 2024-09-10T05:36:39.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.407+0000 7f06ec703640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5566e2a8dfc0 0x5566e2a903b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:48020/0 (socket says 172.21.15.62:48020) 2024-09-10T05:36:39.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.407+0000 7f06ecf04640 1 -- 172.21.15.62:0/1313991339 learned_addr learned my addr 172.21.15.62:0/1313991339 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-10T05:36:39.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.407+0000 7f06ec703640 1 -- 172.21.15.62:0/1313991339 >> v1:172.21.15.2:6789/0 conn(0x5566e2a89dd0 legacy=0x5566e2a8a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.407+0000 7f06ec703640 1 -- 172.21.15.62:0/1313991339 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566e2933ca0 con 0x5566e2a8dfc0 2024-09-10T05:36:39.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.411+0000 7f06ec703640 1 --2- 172.21.15.62:0/1313991339 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566e2a8dfc0 0x5566e2a903b0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f06d400a480 tx=0x7f06d401b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6a41408e1b18033 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.411+0000 7f06ebf02640 1 -- 172.21.15.62:0/1313991339 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06d40aa570 con 0x5566e2a8dfc0 2024-09-10T05:36:39.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.411+0000 7f06ebf02640 1 -- 172.21.15.62:0/1313991339 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06d40af070 con 0x5566e2a8dfc0 2024-09-10T05:36:39.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.411+0000 7f06ebf02640 1 -- 172.21.15.62:0/1313991339 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06d40aa860 con 0x5566e2a8dfc0 2024-09-10T05:36:39.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.411+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/1313991339 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566e2a8dfc0 msgr2=0x5566e2a903b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.411+0000 7f06ef3fe9c0 1 --2- 172.21.15.62:0/1313991339 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566e2a8dfc0 0x5566e2a903b0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f06d400a480 tx=0x7f06d401b310 comp rx=0 tx=0).stop 2024-09-10T05:36:39.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.411+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/1313991339 shutdown_connections 2024-09-10T05:36:39.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.411+0000 7f06ef3fe9c0 1 --2- 172.21.15.62:0/1313991339 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566e2a8dfc0 0x5566e2a903b0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.411+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/1313991339 >> 172.21.15.62:0/1313991339 conn(0x5566e2a858f0 msgr2=0x5566e2a87d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:39.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.411+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/1313991339 shutdown_connections 2024-09-10T05:36:39.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.411+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/1313991339 wait complete. 2024-09-10T05:36:39.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.427+0000 7f06ef3fe9c0 1 Processor -- start 2024-09-10T05:36:39.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.427+0000 7f06ef3fe9c0 1 -- start start 2024-09-10T05:36:39.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.427+0000 7f06ef3fe9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566e2a89dd0 0x5566e2b744b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.427+0000 7f06ef3fe9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5566e2993680 con 0x5566e2a89dd0 2024-09-10T05:36:39.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.427+0000 7f06ecf04640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566e2a89dd0 0x5566e2b744b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.427+0000 7f06ecf04640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566e2a89dd0 0x5566e2b744b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:48024/0 (socket says 172.21.15.62:48024) 2024-09-10T05:36:39.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.427+0000 7f06ecf04640 1 -- 172.21.15.62:0/1144493246 learned_addr learned my addr 172.21.15.62:0/1144493246 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:39.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.427+0000 7f06ecf04640 1 -- 172.21.15.62:0/1144493246 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566e290eda0 con 0x5566e2a89dd0 2024-09-10T05:36:39.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.431+0000 7f06ecf04640 1 --2- 172.21.15.62:0/1144493246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566e2a89dd0 0x5566e2b744b0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f06dc0017b0 tx=0x7f06dc001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a5cdccd83d7555f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.431+0000 7f05dae0d640 1 -- 172.21.15.62:0/1144493246 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06dc0044f0 con 0x5566e2a89dd0 2024-09-10T05:36:39.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.431+0000 7f05dae0d640 1 -- 172.21.15.62:0/1144493246 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06dc0046b0 con 0x5566e2a89dd0 2024-09-10T05:36:39.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.431+0000 7f05dae0d640 1 -- 172.21.15.62:0/1144493246 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06dc004a10 con 0x5566e2a89dd0 2024-09-10T05:36:39.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.431+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/1144493246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566e2a89dd0 msgr2=0x5566e2b744b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.431+0000 7f06ef3fe9c0 1 --2- 172.21.15.62:0/1144493246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566e2a89dd0 0x5566e2b744b0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f06dc0017b0 tx=0x7f06dc001c70 comp rx=0 tx=0).stop 2024-09-10T05:36:39.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.431+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/1144493246 shutdown_connections 2024-09-10T05:36:39.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.431+0000 7f06ef3fe9c0 1 --2- 172.21.15.62:0/1144493246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566e2a89dd0 0x5566e2b744b0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.431+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/1144493246 >> 172.21.15.62:0/1144493246 conn(0x5566e2a858f0 msgr2=0x5566e2b700f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:39.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.431+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/1144493246 shutdown_connections 2024-09-10T05:36:39.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.431+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/1144493246 wait complete. 2024-09-10T05:36:39.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.431+0000 7f06ef3fe9c0 1 Processor -- start 2024-09-10T05:36:39.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.431+0000 7f06ef3fe9c0 1 -- start start 2024-09-10T05:36:39.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.431+0000 7f06ef3fe9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566e2a89dd0 0x5566e2b7bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.431+0000 7f06ef3fe9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5566e2935a50 con 0x5566e2a89dd0 2024-09-10T05:36:39.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.431+0000 7f06ecf04640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566e2a89dd0 0x5566e2b7bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.431+0000 7f06ecf04640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566e2a89dd0 0x5566e2b7bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:48038/0 (socket says 172.21.15.62:48038) 2024-09-10T05:36:39.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.431+0000 7f06ecf04640 1 -- 172.21.15.62:0/2396254207 learned_addr learned my addr 172.21.15.62:0/2396254207 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:39.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.431+0000 7f06ecf04640 1 -- 172.21.15.62:0/2396254207 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566e2b7c0b0 con 0x5566e2a89dd0 2024-09-10T05:36:39.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.431+0000 7f06ecf04640 1 --2- 172.21.15.62:0/2396254207 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566e2a89dd0 0x5566e2b7bb50 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f06dc0012f0 tx=0x7f06dc000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.431+0000 7f05d960a640 1 -- 172.21.15.62:0/2396254207 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06dc013820 con 0x5566e2a89dd0 2024-09-10T05:36:39.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.431+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/2396254207 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5566e2b7c340 con 0x5566e2a89dd0 2024-09-10T05:36:39.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.431+0000 7f05d960a640 1 -- 172.21.15.62:0/2396254207 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06dc0139c0 con 0x5566e2a89dd0 2024-09-10T05:36:39.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.431+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/2396254207 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566e2b7ccf0 con 0x5566e2a89dd0 2024-09-10T05:36:39.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.431+0000 7f05d960a640 1 -- 172.21.15.62:0/2396254207 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06dc013ca0 con 0x5566e2a89dd0 2024-09-10T05:36:39.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.435+0000 7f05d960a640 1 -- 172.21.15.62:0/2396254207 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f06dc010070 con 0x5566e2a89dd0 2024-09-10T05:36:39.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.435+0000 7f05d960a640 1 --2- 172.21.15.62:0/2396254207 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f05d4039a70 0x7f05d403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.435+0000 7f05d960a640 1 -- 172.21.15.62:0/2396254207 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f06dc018070 con 0x5566e2a89dd0 2024-09-10T05:36:39.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.435+0000 7f06ec703640 1 --2- 172.21.15.62:0/2396254207 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f05d4039a70 0x7f05d403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.435+0000 7f06ef3fe9c0 1 --2- 172.21.15.62:0/2396254207 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5566e2a8dfc0 0x5566e2b82cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.435+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/2396254207 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5566e2b83200 con 0x5566e2a8dfc0 2024-09-10T05:36:39.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.435+0000 7f06ed705640 1 --2- 172.21.15.62:0/2396254207 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5566e2a8dfc0 0x5566e2b82cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.435+0000 7f06ec703640 1 --2- 172.21.15.62:0/2396254207 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f05d4039a70 0x7f05d403bf30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f06d40ae000 tx=0x7f06d40a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.435+0000 7f06ed705640 1 --2- 172.21.15.62:0/2396254207 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5566e2a8dfc0 0x5566e2b82cc0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.435+0000 7f06ed705640 1 -- 172.21.15.62:0/2396254207 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06e40083f0 con 0x5566e2a8dfc0 2024-09-10T05:36:39.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.435+0000 7f06ef3fe9c0 1 --2- 172.21.15.62:0/2396254207 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5566e2b83fb0 0x5566e2b863a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.435+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/2396254207 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5566e2b869d0 con 0x5566e2b83fb0 2024-09-10T05:36:39.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.435+0000 7f06ecf04640 1 --2- 172.21.15.62:0/2396254207 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5566e2b83fb0 0x5566e2b863a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.435+0000 7f06ecf04640 1 --2- 172.21.15.62:0/2396254207 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5566e2b83fb0 0x5566e2b863a0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.439+0000 7f06ecf04640 1 -- 172.21.15.62:0/2396254207 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f06dc01b030 con 0x5566e2b83fb0 2024-09-10T05:36:39.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.439+0000 7f06ef3fe9c0 1 --2- 172.21.15.62:0/2396254207 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5566e2b88790 0x5566e2b8ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.439+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/2396254207 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5566e2b8b270 con 0x5566e2b88790 2024-09-10T05:36:39.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.439+0000 7f06ec703640 1 --2- 172.21.15.62:0/2396254207 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5566e2b88790 0x5566e2b8ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.439+0000 7f06ec703640 1 --2- 172.21.15.62:0/2396254207 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5566e2b88790 0x5566e2b8ab80 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.439+0000 7f06ec703640 1 -- 172.21.15.62:0/2396254207 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f06d40a8070 con 0x5566e2b88790 2024-09-10T05:36:39.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.439+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/2396254207 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5566e2b87630 con 0x5566e2b83fb0 2024-09-10T05:36:39.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.439+0000 7f06ecf04640 1 -- 172.21.15.62:0/2396254207 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f06dc01b030 con 0x5566e2b83fb0 2024-09-10T05:36:39.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.439+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/2396254207 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5566e2b87a90 con 0x5566e2b88790 2024-09-10T05:36:39.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.439+0000 7f06ec703640 1 -- 172.21.15.62:0/2396254207 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f06d40a8070 con 0x5566e2b88790 2024-09-10T05:36:39.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.439+0000 7f06ef3fe9c0 1 Processor -- start 2024-09-10T05:36:39.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.439+0000 7f06ef3fe9c0 1 -- start start 2024-09-10T05:36:39.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.439+0000 7f06ef3fe9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566e2b9dc80 0x5566e2b9e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.439+0000 7f06ef3fe9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5566e29a0450 con 0x5566e2b9dc80 2024-09-10T05:36:39.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.439+0000 7f06ecf04640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566e2b9dc80 0x5566e2b9e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.443+0000 7f06ecf04640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566e2b9dc80 0x5566e2b9e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:48042/0 (socket says 172.21.15.62:48042) 2024-09-10T05:36:39.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.443+0000 7f06ecf04640 1 -- 172.21.15.62:0/1733790278 learned_addr learned my addr 172.21.15.62:0/1733790278 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:39.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.443+0000 7f06ecf04640 1 -- 172.21.15.62:0/1733790278 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566e2b9e6e0 con 0x5566e2b9dc80 2024-09-10T05:36:39.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.443+0000 7f06ecf04640 1 --2- 172.21.15.62:0/1733790278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566e2b9dc80 0x5566e2b9e0a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f06dc010cc0 tx=0x7f06dc028e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.443+0000 7f05d27fc640 1 -- 172.21.15.62:0/1733790278 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06dc048070 con 0x5566e2b9dc80 2024-09-10T05:36:39.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.443+0000 7f05d27fc640 1 -- 172.21.15.62:0/1733790278 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06dc0104e0 con 0x5566e2b9dc80 2024-09-10T05:36:39.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.443+0000 7f05d27fc640 1 -- 172.21.15.62:0/1733790278 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06dc0123c0 con 0x5566e2b9dc80 2024-09-10T05:36:39.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.443+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/1733790278 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5566e2b9ef40 con 0x5566e2b9dc80 2024-09-10T05:36:39.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.443+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/1733790278 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566e2b9ef40 con 0x5566e2b9dc80 2024-09-10T05:36:39.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.443+0000 7f05d27fc640 1 -- 172.21.15.62:0/1733790278 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f06dc01d350 con 0x5566e2b9dc80 2024-09-10T05:36:39.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.443+0000 7f05d27fc640 1 --2- 172.21.15.62:0/1733790278 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f05c4039a70 0x7f05c403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.443+0000 7f05d27fc640 1 -- 172.21.15.62:0/1733790278 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f06dc043ad0 con 0x5566e2b9dc80 2024-09-10T05:36:39.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.443+0000 7f06ec703640 1 --2- 172.21.15.62:0/1733790278 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f05c4039a70 0x7f05c403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.443+0000 7f06ef3fe9c0 1 Processor -- start 2024-09-10T05:36:39.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.443+0000 7f06ef3fe9c0 1 -- start start 2024-09-10T05:36:39.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.443+0000 7f06ec703640 1 --2- 172.21.15.62:0/1733790278 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f05c4039a70 0x7f05c403bf30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f06d4000c10 tx=0x7f06d4005a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.443+0000 7f06ef3fe9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566e2bab240 0x5566e2bab620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.443+0000 7f06ef3fe9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5566e2b74d00 con 0x5566e2bab240 2024-09-10T05:36:39.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.447+0000 7f06ecf04640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566e2bab240 0x5566e2bab620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.447+0000 7f06ecf04640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566e2bab240 0x5566e2bab620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:48058/0 (socket says 172.21.15.62:48058) 2024-09-10T05:36:39.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.447+0000 7f06ecf04640 1 -- 172.21.15.62:0/2395723277 learned_addr learned my addr 172.21.15.62:0/2395723277 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:39.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.447+0000 7f06ecf04640 1 -- 172.21.15.62:0/2395723277 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566e2babc10 con 0x5566e2bab240 2024-09-10T05:36:39.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.447+0000 7f06ecf04640 1 --2- 172.21.15.62:0/2395723277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566e2bab240 0x5566e2bab620 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f06dc052030 tx=0x7f06dc035b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22d995066a27ccc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.447+0000 7f05c3fff640 1 -- 172.21.15.62:0/2395723277 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06dc05e020 con 0x5566e2bab240 2024-09-10T05:36:39.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.447+0000 7f05c3fff640 1 -- 172.21.15.62:0/2395723277 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06dc026c20 con 0x5566e2bab240 2024-09-10T05:36:39.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.447+0000 7f05c3fff640 1 -- 172.21.15.62:0/2395723277 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06dc01d640 con 0x5566e2bab240 2024-09-10T05:36:39.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.447+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/2395723277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566e2bab240 msgr2=0x5566e2bab620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.447+0000 7f06ef3fe9c0 1 --2- 172.21.15.62:0/2395723277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566e2bab240 0x5566e2bab620 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f06dc052030 tx=0x7f06dc035b40 comp rx=0 tx=0).stop 2024-09-10T05:36:39.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.447+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/2395723277 shutdown_connections 2024-09-10T05:36:39.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.447+0000 7f06ef3fe9c0 1 --2- 172.21.15.62:0/2395723277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566e2bab240 0x5566e2bab620 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.447+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/2395723277 >> 172.21.15.62:0/2395723277 conn(0x5566e2ba6660 msgr2=0x5566e2ba48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:39.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.447+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/2395723277 shutdown_connections 2024-09-10T05:36:39.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.447+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/2395723277 wait complete. 2024-09-10T05:36:39.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.447+0000 7f06ef3fe9c0 1 Processor -- start 2024-09-10T05:36:39.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.447+0000 7f06ef3fe9c0 1 -- start start 2024-09-10T05:36:39.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.447+0000 7f06ef3fe9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566e2bab240 0x5566e2bb1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.447+0000 7f06ef3fe9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5566e2baa010 con 0x5566e2bab240 2024-09-10T05:36:39.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.447+0000 7f06ecf04640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566e2bab240 0x5566e2bb1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.447+0000 7f06ecf04640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566e2bab240 0x5566e2bb1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:48074/0 (socket says 172.21.15.62:48074) 2024-09-10T05:36:39.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.447+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 learned_addr learned my addr 172.21.15.62:0/207264806 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:39.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.447+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566e2bb1aa0 con 0x5566e2bab240 2024-09-10T05:36:39.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.447+0000 7f06ecf04640 1 --2- 172.21.15.62:0/207264806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566e2bab240 0x5566e2bb1540 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f06dc052030 tx=0x7f06dc04e750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.447+0000 7f05c27fc640 1 -- 172.21.15.62:0/207264806 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06dc068070 con 0x5566e2bab240 2024-09-10T05:36:39.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.447+0000 7f05c27fc640 1 -- 172.21.15.62:0/207264806 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06dc033e00 con 0x5566e2bab240 2024-09-10T05:36:39.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.447+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5566e2bb1aa0 con 0x5566e2bab240 2024-09-10T05:36:39.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.447+0000 7f05c27fc640 1 -- 172.21.15.62:0/207264806 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06dc05e030 con 0x5566e2bab240 2024-09-10T05:36:39.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.447+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566e2bb1aa0 con 0x5566e2bab240 2024-09-10T05:36:39.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.451+0000 7f05c27fc640 1 -- 172.21.15.62:0/207264806 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f06dc06b070 con 0x5566e2bab240 2024-09-10T05:36:39.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.451+0000 7f06ef3fe9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.451+0000 7f05c27fc640 1 --2- 172.21.15.62:0/207264806 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f05b80399f0 0x7f05b803beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.451+0000 7f05c27fc640 1 -- 172.21.15.62:0/207264806 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f06dc023190 con 0x5566e2bab240 2024-09-10T05:36:39.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.451+0000 7f06ec703640 1 --2- 172.21.15.62:0/207264806 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f05b80399f0 0x7f05b803beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.451+0000 7f06ef3fe9c0 1 --2- 172.21.15.62:0/207264806 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5566e2bbc430 0x5566e2bbe8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.451+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bbf010 con 0x5566e2bbc430 2024-09-10T05:36:39.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.451+0000 7f06ed705640 1 --2- 172.21.15.62:0/207264806 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5566e2bbc430 0x5566e2bbe8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.451+0000 7f06ec703640 1 --2- 172.21.15.62:0/207264806 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f05b80399f0 0x7f05b803beb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f06d40aa650 tx=0x7f06d40a8000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.451+0000 7f06ed705640 1 --2- 172.21.15.62:0/207264806 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5566e2bbc430 0x5566e2bbe8c0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.451+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06e40083f0 con 0x5566e2bbc430 2024-09-10T05:36:39.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.451+0000 7f06ef3fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:39.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.451+0000 7f06ef3fe9c0 20 realm 2024-09-10T05:36:39.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.451+0000 7f06ef3fe9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.451+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bbb820 con 0x5566e2bbc430 2024-09-10T05:36:39.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.451+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06e40083f0 con 0x5566e2bbc430 2024-09-10T05:36:39.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.451+0000 7f06ef3fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:39.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.451+0000 7f06ef3fe9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:39.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.451+0000 7f06ef3fe9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.451+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bbfad0 con 0x5566e2bbc430 2024-09-10T05:36:39.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.451+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06e40083f0 con 0x5566e2bbc430 2024-09-10T05:36:39.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.451+0000 7f06ef3fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:39.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.451+0000 7f06ef3fe9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.451+0000 7f06ef3fe9c0 1 --2- 172.21.15.62:0/207264806 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5566e2bc08b0 0x5566e2bc2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.451+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bc3330 con 0x5566e2bc08b0 2024-09-10T05:36:39.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.451+0000 7f06ecf04640 1 --2- 172.21.15.62:0/207264806 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5566e2bc08b0 0x5566e2bc2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.455+0000 7f06ecf04640 1 --2- 172.21.15.62:0/207264806 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5566e2bc08b0 0x5566e2bc2ca0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.455+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f06dc06a030 con 0x5566e2bc08b0 2024-09-10T05:36:39.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.455+0000 7f06ef3fe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:39.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.455+0000 7f06ef3fe9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.455+0000 7f06ef3fe9c0 1 --2- 172.21.15.62:0/207264806 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5566e2bc40e0 0x5566e2bc64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.455+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bc6b20 con 0x5566e2bc40e0 2024-09-10T05:36:39.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.455+0000 7f06ec703640 1 --2- 172.21.15.62:0/207264806 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5566e2bc40e0 0x5566e2bc64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.455+0000 7f06ec703640 1 --2- 172.21.15.62:0/207264806 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5566e2bc40e0 0x5566e2bc64d0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.455+0000 7f06ec703640 1 -- 172.21.15.62:0/207264806 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f06d40a8070 con 0x5566e2bc40e0 2024-09-10T05:36:39.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.455+0000 7f06ef3fe9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:39.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.455+0000 7f06ef3fe9c0 20 searching for the correct realm 2024-09-10T05:36:39.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.455+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bc83f0 con 0x5566e2bc40e0 2024-09-10T05:36:39.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.455+0000 7f06ec703640 1 -- 172.21.15.62:0/207264806 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d40a8070 con 0x5566e2bc40e0 2024-09-10T05:36:39.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.455+0000 7f06ec703640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bc83f0 con 0x5566e2bc08b0 2024-09-10T05:36:39.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.455+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06dc06a030 con 0x5566e2bc08b0 2024-09-10T05:36:39.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.455+0000 7f06ecf04640 1 --2- 172.21.15.62:0/207264806 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f06dc06d070 0x7f06dc00c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.455+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bc83f0 con 0x7f06dc06d070 2024-09-10T05:36:39.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.455+0000 7f06ed705640 1 --2- 172.21.15.62:0/207264806 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f06dc06d070 0x7f06dc00c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.455+0000 7f06ed705640 1 --2- 172.21.15.62:0/207264806 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f06dc06d070 0x7f06dc00c150 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.455+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e40083f0 con 0x7f06dc06d070 2024-09-10T05:36:39.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.455+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bc83f0 con 0x5566e2bbc430 2024-09-10T05:36:39.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.459+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e40083f0 con 0x5566e2bbc430 2024-09-10T05:36:39.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.459+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bc83f0 con 0x5566e2bbc430 2024-09-10T05:36:39.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.459+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e40083f0 con 0x5566e2bbc430 2024-09-10T05:36:39.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.459+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bc83f0 con 0x5566e2bc40e0 2024-09-10T05:36:39.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.459+0000 7f06ec703640 1 -- 172.21.15.62:0/207264806 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d40a8070 con 0x5566e2bc40e0 2024-09-10T05:36:39.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.459+0000 7f06ec703640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bc83f0 con 0x5566e2bbc430 2024-09-10T05:36:39.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.459+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e40083f0 con 0x5566e2bbc430 2024-09-10T05:36:39.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.459+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bc83f0 con 0x5566e2bc08b0 2024-09-10T05:36:39.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.459+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06dc06a030 con 0x5566e2bc08b0 2024-09-10T05:36:39.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.459+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bc83f0 con 0x5566e2bc08b0 2024-09-10T05:36:39.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.459+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06dc06a030 con 0x5566e2bc08b0 2024-09-10T05:36:39.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.459+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bc83f0 con 0x5566e2bbc430 2024-09-10T05:36:39.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.459+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e40083f0 con 0x5566e2bbc430 2024-09-10T05:36:39.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.459+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bc83f0 con 0x7f06dc06d070 2024-09-10T05:36:39.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.459+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e40083f0 con 0x7f06dc06d070 2024-09-10T05:36:39.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.459+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bc83f0 con 0x5566e2bbc430 2024-09-10T05:36:39.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.459+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e40083f0 con 0x5566e2bbc430 2024-09-10T05:36:39.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.459+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bc83f0 con 0x7f06dc06d070 2024-09-10T05:36:39.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.459+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f06e40083f0 con 0x7f06dc06d070 2024-09-10T05:36:39.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.459+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bc83f0 con 0x5566e2bc08b0 2024-09-10T05:36:39.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.463+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06dc06a030 con 0x5566e2bc08b0 2024-09-10T05:36:39.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.463+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bc83f0 con 0x5566e2bc40e0 2024-09-10T05:36:39.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.463+0000 7f06ec703640 1 -- 172.21.15.62:0/207264806 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d40a8070 con 0x5566e2bc40e0 2024-09-10T05:36:39.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.463+0000 7f06ec703640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bc83f0 con 0x5566e2bbc430 2024-09-10T05:36:39.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.463+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e40083f0 con 0x5566e2bbc430 2024-09-10T05:36:39.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.463+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bc83f0 con 0x5566e2bc08b0 2024-09-10T05:36:39.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.463+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06dc06a030 con 0x5566e2bc08b0 2024-09-10T05:36:39.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.463+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bc83f0 con 0x5566e2bc40e0 2024-09-10T05:36:39.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.463+0000 7f06ec703640 1 -- 172.21.15.62:0/207264806 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 30 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f06d40a8070 con 0x5566e2bc40e0 2024-09-10T05:36:39.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.463+0000 7f06ec703640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bc83f0 con 0x5566e2bbc430 2024-09-10T05:36:39.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.463+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e40083f0 con 0x5566e2bbc430 2024-09-10T05:36:39.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.463+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bc83f0 con 0x5566e2bbc430 2024-09-10T05:36:39.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.463+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f06e40083f0 con 0x5566e2bbc430 2024-09-10T05:36:39.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.463+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bc83f0 con 0x5566e2bbc430 2024-09-10T05:36:39.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.463+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e40083f0 con 0x5566e2bbc430 2024-09-10T05:36:39.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.463+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bc83f0 con 0x5566e2bc40e0 2024-09-10T05:36:39.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.463+0000 7f06ec703640 1 -- 172.21.15.62:0/207264806 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d40a8070 con 0x5566e2bc40e0 2024-09-10T05:36:39.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.463+0000 7f06ec703640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bc83f0 con 0x7f06dc06d070 2024-09-10T05:36:39.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.463+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e40083f0 con 0x7f06dc06d070 2024-09-10T05:36:39.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.463+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bc83f0 con 0x5566e2bbc430 2024-09-10T05:36:39.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.463+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e40083f0 con 0x5566e2bbc430 2024-09-10T05:36:39.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.463+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bc83f0 con 0x7f06dc06d070 2024-09-10T05:36:39.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.463+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e40083f0 con 0x7f06dc06d070 2024-09-10T05:36:39.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.463+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bc83f0 con 0x5566e2bc40e0 2024-09-10T05:36:39.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.467+0000 7f06ec703640 1 -- 172.21.15.62:0/207264806 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d40a8070 con 0x5566e2bc40e0 2024-09-10T05:36:39.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.467+0000 7f06ec703640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bc83f0 con 0x7f06dc06d070 2024-09-10T05:36:39.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.467+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e40083f0 con 0x7f06dc06d070 2024-09-10T05:36:39.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.467+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bc83f0 con 0x5566e2bc08b0 2024-09-10T05:36:39.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.467+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06dc06a030 con 0x5566e2bc08b0 2024-09-10T05:36:39.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.467+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bc83f0 con 0x5566e2bc08b0 2024-09-10T05:36:39.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.467+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06dc06a030 con 0x5566e2bc08b0 2024-09-10T05:36:39.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.467+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bc83f0 con 0x5566e2bc40e0 2024-09-10T05:36:39.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.467+0000 7f06ec703640 1 -- 172.21.15.62:0/207264806 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d40a8070 con 0x5566e2bc40e0 2024-09-10T05:36:39.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.467+0000 7f06ec703640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bc83f0 con 0x5566e2bc08b0 2024-09-10T05:36:39.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.467+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f06dc06a030 con 0x5566e2bc08b0 2024-09-10T05:36:39.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.467+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bc83f0 con 0x5566e2bc08b0 2024-09-10T05:36:39.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.467+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06dc06a030 con 0x5566e2bc08b0 2024-09-10T05:36:39.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.467+0000 7f06ef3fe9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:39.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.467+0000 7f06ef3fe9c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:39.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.467+0000 7f06ef3fe9c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:39.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.467+0000 7f06ef3fe9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:39.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.467+0000 7f06ef3fe9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:39.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.467+0000 7f06ef3fe9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:39.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.467+0000 7f06ef3fe9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.467+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bc74e0 con 0x5566e2bbc430 2024-09-10T05:36:39.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.467+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06e40083f0 con 0x5566e2bbc430 2024-09-10T05:36:39.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.467+0000 7f06ef3fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:39.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.467+0000 7f06ef3fe9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.467+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bc7960 con 0x5566e2bc08b0 2024-09-10T05:36:39.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.471+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f06dc06a030 con 0x5566e2bc08b0 2024-09-10T05:36:39.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.471+0000 7f06ef3fe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:39.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.471+0000 7f06ef3fe9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.471+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bc7960 con 0x5566e2bc40e0 2024-09-10T05:36:39.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.471+0000 7f06ec703640 1 -- 172.21.15.62:0/207264806 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f06d40a8070 con 0x5566e2bc40e0 2024-09-10T05:36:39.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.471+0000 7f06ef3fe9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:39.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.471+0000 7f06ef3fe9c0 20 zone default found 2024-09-10T05:36:39.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.471+0000 7f06ef3fe9c0 4 Realm: () 2024-09-10T05:36:39.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.471+0000 7f06ef3fe9c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:39.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.471+0000 7f06ef3fe9c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:39.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.471+0000 7f06ef3fe9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:39.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.471+0000 7f06ef3fe9c0 20 zonegroup default 2024-09-10T05:36:39.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.471+0000 7f06ef3fe9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.471+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bc88c0 con 0x7f06dc06d070 2024-09-10T05:36:39.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.471+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f06e40083f0 con 0x7f06dc06d070 2024-09-10T05:36:39.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.471+0000 7f06ef3fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:39.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.471+0000 7f06ef3fe9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.471+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bca780 con 0x5566e2bc40e0 2024-09-10T05:36:39.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.471+0000 7f06ec703640 1 -- 172.21.15.62:0/207264806 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f06d40a8070 con 0x5566e2bc40e0 2024-09-10T05:36:39.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.471+0000 7f06ef3fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:39.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.471+0000 7f06ef3fe9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.471+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bcac10 con 0x5566e2bc40e0 2024-09-10T05:36:39.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.471+0000 7f06ec703640 1 -- 172.21.15.62:0/207264806 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f06d40a8070 con 0x5566e2bc40e0 2024-09-10T05:36:39.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.471+0000 7f06ef3fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:39.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.471+0000 7f06ef3fe9c0 20 started sync module instance, tier type = 2024-09-10T05:36:39.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.471+0000 7f06ef3fe9c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:39.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.471+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bc9af0 con 0x5566e2bc08b0 2024-09-10T05:36:39.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.475+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06dc06a030 con 0x5566e2bc08b0 2024-09-10T05:36:39.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.475+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93900379037712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bc9af0 con 0x5566e2bc08b0 2024-09-10T05:36:39.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.475+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bcb740 con 0x5566e2bbc430 2024-09-10T05:36:39.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.475+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e40083f0 con 0x5566e2bbc430 2024-09-10T05:36:39.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.475+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93900379042320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bcbfe0 con 0x5566e2bbc430 2024-09-10T05:36:39.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.475+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bcca00 con 0x5566e2bc08b0 2024-09-10T05:36:39.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.475+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 93900379037712] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06dc06a030 con 0x5566e2bc08b0 2024-09-10T05:36:39.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.475+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93900379042320] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e40083f0 con 0x5566e2bbc430 2024-09-10T05:36:39.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.479+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06dc06a030 con 0x5566e2bc08b0 2024-09-10T05:36:39.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.479+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93900379047152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bcbb30 con 0x5566e2bc08b0 2024-09-10T05:36:39.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.479+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bcd2d0 con 0x7f06dc06d070 2024-09-10T05:36:39.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.479+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e40083f0 con 0x7f06dc06d070 2024-09-10T05:36:39.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.479+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93900379049504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bcbb30 con 0x7f06dc06d070 2024-09-10T05:36:39.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.479+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bcdd50 con 0x5566e2bc08b0 2024-09-10T05:36:39.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.479+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93900379047152] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06dc06a030 con 0x5566e2bc08b0 2024-09-10T05:36:39.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.479+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93900379049504] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e40083f0 con 0x7f06dc06d070 2024-09-10T05:36:39.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.483+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06dc06a030 con 0x5566e2bc08b0 2024-09-10T05:36:39.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.483+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93900379050560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bcd860 con 0x5566e2bc08b0 2024-09-10T05:36:39.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.483+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bce5f0 con 0x5566e2bc40e0 2024-09-10T05:36:39.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.483+0000 7f06ec703640 1 -- 172.21.15.62:0/207264806 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d40a8070 con 0x5566e2bc40e0 2024-09-10T05:36:39.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.483+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93900379054400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bcd860 con 0x5566e2bc40e0 2024-09-10T05:36:39.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.483+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bcf030 con 0x5566e2bc40e0 2024-09-10T05:36:39.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.483+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 93900379050560] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06dc06a030 con 0x5566e2bc08b0 2024-09-10T05:36:39.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.483+0000 7f06ec703640 1 -- 172.21.15.62:0/207264806 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93900379054400] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d40a8070 con 0x5566e2bc40e0 2024-09-10T05:36:39.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.487+0000 7f06ec703640 1 -- 172.21.15.62:0/207264806 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d40a8070 con 0x5566e2bc40e0 2024-09-10T05:36:39.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.487+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93900379055456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bceb80 con 0x5566e2bc40e0 2024-09-10T05:36:39.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.487+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bcf8d0 con 0x7f06dc06d070 2024-09-10T05:36:39.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.487+0000 7f06ec703640 1 -- 172.21.15.62:0/207264806 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93900379055456] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d40a8070 con 0x5566e2bc40e0 2024-09-10T05:36:39.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.487+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e40083f0 con 0x7f06dc06d070 2024-09-10T05:36:39.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.487+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93900379035200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bceb80 con 0x7f06dc06d070 2024-09-10T05:36:39.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.487+0000 7f06ef3fe9c0 20 add_watcher() i=0 2024-09-10T05:36:39.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.487+0000 7f06ef3fe9c0 20 add_watcher() i=1 2024-09-10T05:36:39.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.487+0000 7f06ef3fe9c0 20 add_watcher() i=2 2024-09-10T05:36:39.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.487+0000 7f06ef3fe9c0 20 add_watcher() i=3 2024-09-10T05:36:39.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.487+0000 7f06ef3fe9c0 20 add_watcher() i=4 2024-09-10T05:36:39.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.487+0000 7f06ef3fe9c0 20 add_watcher() i=5 2024-09-10T05:36:39.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.487+0000 7f06ef3fe9c0 20 add_watcher() i=6 2024-09-10T05:36:39.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.487+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93900379035200] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e40083f0 con 0x7f06dc06d070 2024-09-10T05:36:39.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.487+0000 7f06ef3fe9c0 20 add_watcher() i=7 2024-09-10T05:36:39.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.487+0000 7f06ef3fe9c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:39.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.487+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bd2900 con 0x5566e2bbc430 2024-09-10T05:36:39.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.487+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f06e40083f0 con 0x5566e2bbc430 2024-09-10T05:36:39.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.487+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93900379059232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bcfe40 con 0x5566e2bbc430 2024-09-10T05:36:39.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.491+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93900379059232] v30'152 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f06e40083f0 con 0x5566e2bbc430 2024-09-10T05:36:39.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.491+0000 7f05a2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:39.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.491+0000 7f06ef3fe9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:39.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.491+0000 7f06ef3fe9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:39.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.491+0000 7f06ef3fe9c0 5 note: GC not initialized 2024-09-10T05:36:39.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.491+0000 7f05a1fe3640 20 reqs_thread_entry: start 2024-09-10T05:36:39.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.491+0000 7f06ef3fe9c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:39.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.491+0000 7f06ef3fe9c0 20 Filter name: none 2024-09-10T05:36:39.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.491+0000 7f05137fe640 20 reqs_thread_entry: start 2024-09-10T05:36:39.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.491+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:62 6.0 6:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bf5310 con 0x5566e2bbc430 2024-09-10T05:36:39.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.491+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(62 [pgnls start_epoch 30 out=254b] v30'46 uv30 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f06e40083f0 con 0x5566e2bbc430 2024-09-10T05:36:39.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.491+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:63 6.10 6:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bcb740 con 0x5566e2bbc430 2024-09-10T05:36:39.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.491+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(63 [pgnls start_epoch 30 out=131b] v30'4 uv4 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f06e40083f0 con 0x5566e2bbc430 2024-09-10T05:36:39.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.491+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:64 6.8 6:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bcb740 con 0x5566e2bc08b0 2024-09-10T05:36:39.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.495+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(64 [pgnls start_epoch 30 out=295b] v30'36 uv27 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f06dc06a030 con 0x5566e2bc08b0 2024-09-10T05:36:39.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.495+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:65 6.18 6:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bc83f0 con 0x7f06dc06d070 2024-09-10T05:36:39.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.495+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(65 [pgnls start_epoch 30 out=172b] v30'23 uv15 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f06e40083f0 con 0x7f06dc06d070 2024-09-10T05:36:39.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.495+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:66 6.4 6:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bc83f0 con 0x5566e2bbc430 2024-09-10T05:36:39.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.495+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(66 [pgnls start_epoch 30 out=335b] v30'152 uv29 ondisk = 1) ==== 144+0+335 (crc 0 0 0) 0x7f06e40083f0 con 0x5566e2bbc430 2024-09-10T05:36:39.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.495+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:67 6.14 6:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bc83f0 con 0x7f06dc06d070 2024-09-10T05:36:39.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.495+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(67 [pgnls start_epoch 30 out=213b] v30'23 uv22 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f06e40083f0 con 0x7f06dc06d070 2024-09-10T05:36:39.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.495+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:68 6.c 6:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bc83f0 con 0x5566e2bc40e0 2024-09-10T05:36:39.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.495+0000 7f06ec703640 1 -- 172.21.15.62:0/207264806 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(68 [pgnls start_epoch 30 out=254b] v30'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f06d40a8070 con 0x5566e2bc40e0 2024-09-10T05:36:39.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.495+0000 7f06ec703640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:69 6.1c 6:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bcac10 con 0x5566e2bc08b0 2024-09-10T05:36:39.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.495+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(69 [pgnls start_epoch 30 out=295b] v30'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f06dc06a030 con 0x5566e2bc08b0 2024-09-10T05:36:39.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.495+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:70 6.2 6:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bcac10 con 0x5566e2bc40e0 2024-09-10T05:36:39.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.495+0000 7f06ec703640 1 -- 172.21.15.62:0/207264806 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(70 [pgnls start_epoch 30 out=213b] v30'16 uv16 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f06d40a8070 con 0x5566e2bc40e0 2024-09-10T05:36:39.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.495+0000 7f06ec703640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 6.12 6:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bcac10 con 0x5566e2bc08b0 2024-09-10T05:36:39.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.499+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(71 [pgnls start_epoch 30 out=172b] v30'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f06dc06a030 con 0x5566e2bc08b0 2024-09-10T05:36:39.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.499+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:72 6.a 6:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bcac10 con 0x5566e2bc08b0 2024-09-10T05:36:39.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.499+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== osd_op_reply(72 [pgnls start_epoch 30 out=336b] v30'33 uv25 ondisk = 1) ==== 144+0+336 (crc 0 0 0) 0x7f06dc06a030 con 0x5566e2bc08b0 2024-09-10T05:36:39.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.499+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:73 6.1a 6:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bcac10 con 0x5566e2bc08b0 2024-09-10T05:36:39.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.499+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== osd_op_reply(73 [pgnls start_epoch 30 out=131b] v30'29 uv21 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f06dc06a030 con 0x5566e2bc08b0 2024-09-10T05:36:39.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.499+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:74 6.6 6:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bcac10 con 0x5566e2bc40e0 2024-09-10T05:36:39.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.499+0000 7f06ec703640 1 -- 172.21.15.62:0/207264806 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== osd_op_reply(74 [pgnls start_epoch 30 out=254b] v30'12 uv12 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f06d40a8070 con 0x5566e2bc40e0 2024-09-10T05:36:39.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.499+0000 7f06ec703640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:75 6.16 6:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bcac10 con 0x5566e2bc40e0 2024-09-10T05:36:39.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.499+0000 7f06ec703640 1 -- 172.21.15.62:0/207264806 <== osd.3 v2:172.21.15.62:6816/2708991149 19 ==== osd_op_reply(75 [pgnls start_epoch 30 out=90b] v30'29 uv21 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f06d40a8070 con 0x5566e2bc40e0 2024-09-10T05:36:39.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.499+0000 7f06ec703640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:76 6.e 6:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bcac10 con 0x5566e2bc08b0 2024-09-10T05:36:39.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.503+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(76 [pgnls start_epoch 30 out=213b] v30'27 uv19 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f06dc06a030 con 0x5566e2bc08b0 2024-09-10T05:36:39.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.503+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:77 6.1e 6:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bcac10 con 0x5566e2bc40e0 2024-09-10T05:36:39.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.503+0000 7f06ec703640 1 -- 172.21.15.62:0/207264806 <== osd.3 v2:172.21.15.62:6816/2708991149 20 ==== osd_op_reply(77 [pgnls start_epoch 30 out=254b] v30'16 uv16 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f06d40a8070 con 0x5566e2bc40e0 2024-09-10T05:36:39.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.503+0000 7f06ec703640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:78 6.1 6:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bcac10 con 0x5566e2bbc430 2024-09-10T05:36:39.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.503+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(78 [pgnls start_epoch 30 out=254b] v30'20 uv20 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f06e40083f0 con 0x5566e2bbc430 2024-09-10T05:36:39.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.503+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:79 6.11 6:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bcac10 con 0x5566e2bc40e0 2024-09-10T05:36:39.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.503+0000 7f06ec703640 1 -- 172.21.15.62:0/207264806 <== osd.3 v2:172.21.15.62:6816/2708991149 21 ==== osd_op_reply(79 [pgnls start_epoch 30 out=213b] v30'25 uv17 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f06d40a8070 con 0x5566e2bc40e0 2024-09-10T05:36:39.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.503+0000 7f06ec703640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:80 6.9 6:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bcac10 con 0x5566e2bc40e0 2024-09-10T05:36:39.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.503+0000 7f06ec703640 1 -- 172.21.15.62:0/207264806 <== osd.3 v2:172.21.15.62:6816/2708991149 22 ==== osd_op_reply(80 [pgnls start_epoch 30 out=172b] v30'40 uv24 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f06d40a8070 con 0x5566e2bc40e0 2024-09-10T05:36:39.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.503+0000 7f06ec703640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:81 6.19 6:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bcac10 con 0x5566e2bc08b0 2024-09-10T05:36:39.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.503+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(81 [pgnls start_epoch 30 out=295b] v30'47 uv39 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f06dc06a030 con 0x5566e2bc08b0 2024-09-10T05:36:39.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.503+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:82 6.5 6:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bcac10 con 0x5566e2bc08b0 2024-09-10T05:36:39.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.503+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 <== osd.0 v2:172.21.15.2:6800/945139080 25 ==== osd_op_reply(82 [pgnls start_epoch 30 out=276b] v30'15 uv15 ondisk = 1) ==== 144+0+276 (crc 0 0 0) 0x7f06dc06a030 con 0x5566e2bc08b0 2024-09-10T05:36:39.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.503+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:83 6.15 6:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bcac10 con 0x5566e2bc08b0 2024-09-10T05:36:39.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.507+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 <== osd.0 v2:172.21.15.2:6800/945139080 26 ==== osd_op_reply(83 [pgnls start_epoch 30 out=172b] v30'23 uv15 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f06dc06a030 con 0x5566e2bc08b0 2024-09-10T05:36:39.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.507+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:84 6.d 6:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bcac10 con 0x5566e2bc08b0 2024-09-10T05:36:39.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.507+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 <== osd.0 v2:172.21.15.2:6800/945139080 27 ==== osd_op_reply(84 [pgnls start_epoch 30 out=295b] v30'25 uv17 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f06dc06a030 con 0x5566e2bc08b0 2024-09-10T05:36:39.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.507+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:85 6.1d 6:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bcac10 con 0x5566e2bbc430 2024-09-10T05:36:39.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.507+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 <== osd.1 v2:172.21.15.62:6808/3442097179 23 ==== osd_op_reply(85 [pgnls start_epoch 30 out=172b] v30'34 uv18 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f06e40083f0 con 0x5566e2bbc430 2024-09-10T05:36:39.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.507+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:86 6.3 6:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bcac10 con 0x5566e2bc08b0 2024-09-10T05:36:39.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.507+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 <== osd.0 v2:172.21.15.2:6800/945139080 28 ==== osd_op_reply(86 [pgnls start_epoch 30 out=213b] v30'49 uv25 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f06dc06a030 con 0x5566e2bc08b0 2024-09-10T05:36:39.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.507+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:87 6.13 6:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bcac10 con 0x5566e2bc40e0 2024-09-10T05:36:39.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.507+0000 7f06ec703640 1 -- 172.21.15.62:0/207264806 <== osd.3 v2:172.21.15.62:6816/2708991149 23 ==== osd_op_reply(87 [pgnls start_epoch 30 out=172b] v30'20 uv11 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f06d40a8070 con 0x5566e2bc40e0 2024-09-10T05:36:39.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.507+0000 7f06ec703640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:88 6.b 6:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bcac10 con 0x5566e2bc40e0 2024-09-10T05:36:39.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.507+0000 7f06ec703640 1 -- 172.21.15.62:0/207264806 <== osd.3 v2:172.21.15.62:6816/2708991149 24 ==== osd_op_reply(88 [pgnls start_epoch 30 out=172b] v30'23 uv15 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f06d40a8070 con 0x5566e2bc40e0 2024-09-10T05:36:39.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.511+0000 7f06ec703640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:89 6.1b 6:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bcac10 con 0x5566e2bc40e0 2024-09-10T05:36:39.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.511+0000 7f06ec703640 1 -- 172.21.15.62:0/207264806 <== osd.3 v2:172.21.15.62:6816/2708991149 25 ==== osd_op_reply(89 [pgnls start_epoch 30 out=90b] v30'19 uv11 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f06d40a8070 con 0x5566e2bc40e0 2024-09-10T05:36:39.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.511+0000 7f06ec703640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:90 6.7 6:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bcac10 con 0x5566e2bc08b0 2024-09-10T05:36:39.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.511+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 <== osd.0 v2:172.21.15.2:6800/945139080 29 ==== osd_op_reply(90 [pgnls start_epoch 30 out=90b] v30'44 uv20 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f06dc06a030 con 0x5566e2bc08b0 2024-09-10T05:36:39.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.511+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:91 6.17 6:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bcac10 con 0x5566e2bbc430 2024-09-10T05:36:39.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.511+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 <== osd.1 v2:172.21.15.62:6808/3442097179 24 ==== osd_op_reply(91 [pgnls start_epoch 30 out=131b] v30'12 uv12 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f06e40083f0 con 0x5566e2bbc430 2024-09-10T05:36:39.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.511+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:92 6.f 6:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bcac10 con 0x7f06dc06d070 2024-09-10T05:36:39.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.511+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(92 [pgnls start_epoch 30 out=295b] v30'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f06e40083f0 con 0x7f06dc06d070 2024-09-10T05:36:39.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.511+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:93 6.1f 6:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bcac10 con 0x5566e2bc40e0 2024-09-10T05:36:39.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.511+0000 7f06ec703640 1 -- 172.21.15.62:0/207264806 <== osd.3 v2:172.21.15.62:6816/2708991149 26 ==== osd_op_reply(93 [pgnls start_epoch 30 out=213b] v30'25 uv17 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f06d40a8070 con 0x5566e2bc40e0 2024-09-10T05:36:39.515 INFO:teuthology.orchestra.run.smithi062.stdout:["obj_delete_at_hint.0000000078","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","obj_delete_at_hint.0000000040","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_loggenerations_metadata","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","obj_delete_at_hint.0000000027","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2024-09-10T05:36:39.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.515+0000 7f05a2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:39.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.515+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93900379059232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bf52d0 con 0x5566e2bbc430 2024-09-10T05:36:39.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.515+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 <== osd.1 v2:172.21.15.62:6808/3442097179 25 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 93900379059232] v30'153 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f06e40083f0 con 0x5566e2bbc430 2024-09-10T05:36:39.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.515+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93900379037712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bf8770 con 0x5566e2bc08b0 2024-09-10T05:36:39.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.519+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 <== osd.0 v2:172.21.15.2:6800/945139080 30 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 93900379037712] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06dc06a030 con 0x5566e2bc08b0 2024-09-10T05:36:39.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.519+0000 7f06ef3fe9c0 20 remove_watcher() i=0 2024-09-10T05:36:39.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.519+0000 7f06ef3fe9c0 2 removed watcher, disabling cache 2024-09-10T05:36:39.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.519+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93900379042320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bc9ff0 con 0x5566e2bbc430 2024-09-10T05:36:39.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.519+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 <== osd.1 v2:172.21.15.62:6808/3442097179 26 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 93900379042320] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e40083f0 con 0x5566e2bbc430 2024-09-10T05:36:39.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.519+0000 7f06ef3fe9c0 20 remove_watcher() i=1 2024-09-10T05:36:39.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.519+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93900379047152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bc9ff0 con 0x5566e2bc08b0 2024-09-10T05:36:39.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.523+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 <== osd.0 v2:172.21.15.2:6800/945139080 31 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 93900379047152] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06dc06a030 con 0x5566e2bc08b0 2024-09-10T05:36:39.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.523+0000 7f06ef3fe9c0 20 remove_watcher() i=2 2024-09-10T05:36:39.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.523+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93900379049504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bcc4f0 con 0x7f06dc06d070 2024-09-10T05:36:39.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.523+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 <== osd.2 v2:172.21.15.62:6800/2677868286 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 93900379049504] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e40083f0 con 0x7f06dc06d070 2024-09-10T05:36:39.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.523+0000 7f06ef3fe9c0 20 remove_watcher() i=3 2024-09-10T05:36:39.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.523+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93900379050560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bcc4f0 con 0x5566e2bc08b0 2024-09-10T05:36:39.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.527+0000 7f06ecf04640 1 -- 172.21.15.62:0/207264806 <== osd.0 v2:172.21.15.2:6800/945139080 32 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 93900379050560] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06dc06a030 con 0x5566e2bc08b0 2024-09-10T05:36:39.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.527+0000 7f06ef3fe9c0 20 remove_watcher() i=4 2024-09-10T05:36:39.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.527+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93900379054400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bcc4f0 con 0x5566e2bc40e0 2024-09-10T05:36:39.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.527+0000 7f06ec703640 1 -- 172.21.15.62:0/207264806 <== osd.3 v2:172.21.15.62:6816/2708991149 27 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 93900379054400] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d40a8070 con 0x5566e2bc40e0 2024-09-10T05:36:39.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.527+0000 7f06ef3fe9c0 20 remove_watcher() i=5 2024-09-10T05:36:39.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.527+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93900379055456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bcc4f0 con 0x5566e2bc40e0 2024-09-10T05:36:39.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.527+0000 7f06ec703640 1 -- 172.21.15.62:0/207264806 <== osd.3 v2:172.21.15.62:6816/2708991149 28 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 93900379055456] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d40a8070 con 0x5566e2bc40e0 2024-09-10T05:36:39.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.527+0000 7f06ef3fe9c0 20 remove_watcher() i=6 2024-09-10T05:36:39.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.527+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/207264806 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93900379035200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5566e2bcc4f0 con 0x7f06dc06d070 2024-09-10T05:36:39.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.531+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 <== osd.2 v2:172.21.15.62:6800/2677868286 16 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 93900379035200] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e40083f0 con 0x7f06dc06d070 2024-09-10T05:36:39.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.531+0000 7f06ef3fe9c0 20 remove_watcher() i=7 2024-09-10T05:36:39.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.531+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/207264806 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5566e2bc08b0 msgr2=0x5566e2bc2ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.531+0000 7f06ef3fe9c0 1 --2- 172.21.15.62:0/207264806 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5566e2bc08b0 0x5566e2bc2ca0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.531+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/207264806 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5566e2bbc430 msgr2=0x5566e2bbe8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.531+0000 7f06ef3fe9c0 1 --2- 172.21.15.62:0/207264806 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5566e2bbc430 0x5566e2bbe8c0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.531+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/207264806 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f06dc06d070 msgr2=0x7f06dc00c150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.531+0000 7f06ef3fe9c0 1 --2- 172.21.15.62:0/207264806 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f06dc06d070 0x7f06dc00c150 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.531+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/207264806 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5566e2bc40e0 msgr2=0x5566e2bc64d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.531+0000 7f06ef3fe9c0 1 --2- 172.21.15.62:0/207264806 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5566e2bc40e0 0x5566e2bc64d0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.531+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/207264806 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f05b80399f0 msgr2=0x7f05b803beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.531+0000 7f06ef3fe9c0 1 --2- 172.21.15.62:0/207264806 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f05b80399f0 0x7f05b803beb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f06d40aa650 tx=0x7f06d40a8000 comp rx=0 tx=0).stop 2024-09-10T05:36:39.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.531+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/207264806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566e2bab240 msgr2=0x5566e2bb1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.531+0000 7f06ef3fe9c0 1 --2- 172.21.15.62:0/207264806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566e2bab240 0x5566e2bb1540 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f06dc052030 tx=0x7f06dc04e750 comp rx=0 tx=0).stop 2024-09-10T05:36:39.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.531+0000 7f06ed705640 1 -- 172.21.15.62:0/207264806 reap_dead start 2024-09-10T05:36:39.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.531+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/207264806 shutdown_connections 2024-09-10T05:36:39.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.531+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/207264806 >> 172.21.15.62:0/207264806 conn(0x5566e2ba6660 msgr2=0x5566e2ba4870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:39.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.531+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/207264806 shutdown_connections 2024-09-10T05:36:39.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.531+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/207264806 wait complete. 2024-09-10T05:36:39.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.531+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/1733790278 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f05c4039a70 msgr2=0x7f05c403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.531+0000 7f06ef3fe9c0 1 --2- 172.21.15.62:0/1733790278 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f05c4039a70 0x7f05c403bf30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f06d4000c10 tx=0x7f06d4005a10 comp rx=0 tx=0).stop 2024-09-10T05:36:39.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.531+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/1733790278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566e2b9dc80 msgr2=0x5566e2b9e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.531+0000 7f06ef3fe9c0 1 --2- 172.21.15.62:0/1733790278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566e2b9dc80 0x5566e2b9e0a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f06dc010cc0 tx=0x7f06dc028e60 comp rx=0 tx=0).stop 2024-09-10T05:36:39.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.531+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/1733790278 shutdown_connections 2024-09-10T05:36:39.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.531+0000 7f06ef3fe9c0 1 --2- 172.21.15.62:0/1733790278 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f05c4039a70 0x7f05c403bf30 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.531+0000 7f06ef3fe9c0 1 --2- 172.21.15.62:0/1733790278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566e2b9dc80 0x5566e2b9e0a0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.531+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/1733790278 >> 172.21.15.62:0/1733790278 conn(0x5566e2b8f220 msgr2=0x5566e2b8f600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:39.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.531+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/1733790278 shutdown_connections 2024-09-10T05:36:39.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.531+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/1733790278 wait complete. 2024-09-10T05:36:39.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.531+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/2396254207 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5566e2b83fb0 msgr2=0x5566e2b863a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.531+0000 7f06ef3fe9c0 1 --2- 172.21.15.62:0/2396254207 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5566e2b83fb0 0x5566e2b863a0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.531+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/2396254207 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5566e2a8dfc0 msgr2=0x5566e2b82cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.531+0000 7f06ef3fe9c0 1 --2- 172.21.15.62:0/2396254207 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5566e2a8dfc0 0x5566e2b82cc0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.531+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/2396254207 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5566e2b88790 msgr2=0x5566e2b8ab80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.531+0000 7f06ef3fe9c0 1 --2- 172.21.15.62:0/2396254207 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5566e2b88790 0x5566e2b8ab80 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.531+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/2396254207 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f05d4039a70 msgr2=0x7f05d403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.531+0000 7f06ef3fe9c0 1 --2- 172.21.15.62:0/2396254207 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f05d4039a70 0x7f05d403bf30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f06d40ae000 tx=0x7f06d40a6000 comp rx=0 tx=0).stop 2024-09-10T05:36:39.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.531+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/2396254207 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566e2a89dd0 msgr2=0x5566e2b7bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.531+0000 7f06ef3fe9c0 1 --2- 172.21.15.62:0/2396254207 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566e2a89dd0 0x5566e2b7bb50 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f06dc0012f0 tx=0x7f06dc000f50 comp rx=0 tx=0).stop 2024-09-10T05:36:39.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.531+0000 7f06ed705640 1 -- 172.21.15.62:0/2396254207 reap_dead start 2024-09-10T05:36:39.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.531+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/2396254207 shutdown_connections 2024-09-10T05:36:39.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.531+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/2396254207 >> 172.21.15.62:0/2396254207 conn(0x5566e2a858f0 msgr2=0x5566e2b6eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:39.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.531+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/2396254207 shutdown_connections 2024-09-10T05:36:39.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.531+0000 7f06ef3fe9c0 1 -- 172.21.15.62:0/2396254207 wait complete. 2024-09-10T05:36:39.546 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2024-09-10T05:36:39.546 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-10T05:36:39.547 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-10T05:36:39.547 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-10T05:36:39.628 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:39.628 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:39.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.627+0000 7f2504ef89c0 1 Processor -- start 2024-09-10T05:36:39.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.627+0000 7f2504ef89c0 1 -- start start 2024-09-10T05:36:39.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.627+0000 7f2504ef89c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5615869fbfb0 0x5615869fc390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.627+0000 7f2504ef89c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5615868b09c0 con 0x5615869ff140 2024-09-10T05:36:39.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.627+0000 7f2504ef89c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x5615869006d0 con 0x5615869fbfb0 2024-09-10T05:36:39.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.627+0000 7f25029fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5615869fbfb0 0x5615869fc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.627+0000 7f24fbfff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x5615869ff140 0x561586a01530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:53182/0 (socket says 172.21.15.62:53182) 2024-09-10T05:36:39.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.627+0000 7f24fbfff640 1 -- 172.21.15.62:0/2343671463 learned_addr learned my addr 172.21.15.62:0/2343671463 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-10T05:36:39.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.627+0000 7f25029fe640 1 -- 172.21.15.62:0/2343671463 >> v1:172.21.15.2:6789/0 conn(0x5615869ff140 legacy=0x561586a01530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.627+0000 7f25029fe640 1 -- 172.21.15.62:0/2343671463 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615868a4ca0 con 0x5615869fbfb0 2024-09-10T05:36:39.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.631+0000 7f25029fe640 1 --2- 172.21.15.62:0/2343671463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615869fbfb0 0x5615869fc390 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f24f400a480 tx=0x7f24f401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2c8e3ba1a9d5a0e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.631+0000 7f25021fd640 1 -- 172.21.15.62:0/2343671463 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24f40b0070 con 0x5615869fbfb0 2024-09-10T05:36:39.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.631+0000 7f25021fd640 1 -- 172.21.15.62:0/2343671463 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24f40ab540 con 0x5615869fbfb0 2024-09-10T05:36:39.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.631+0000 7f25021fd640 1 -- 172.21.15.62:0/2343671463 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24f40ab840 con 0x5615869fbfb0 2024-09-10T05:36:39.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.631+0000 7f2504ef89c0 1 -- 172.21.15.62:0/2343671463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615869fbfb0 msgr2=0x5615869fc390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.631+0000 7f2504ef89c0 1 --2- 172.21.15.62:0/2343671463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615869fbfb0 0x5615869fc390 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f24f400a480 tx=0x7f24f401b280 comp rx=0 tx=0).stop 2024-09-10T05:36:39.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.631+0000 7f2504ef89c0 1 -- 172.21.15.62:0/2343671463 shutdown_connections 2024-09-10T05:36:39.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.631+0000 7f2504ef89c0 1 --2- 172.21.15.62:0/2343671463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615869fbfb0 0x5615869fc390 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.631+0000 7f2504ef89c0 1 -- 172.21.15.62:0/2343671463 >> 172.21.15.62:0/2343671463 conn(0x5615869f7ad0 msgr2=0x5615869f9ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:39.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.631+0000 7f2504ef89c0 1 -- 172.21.15.62:0/2343671463 shutdown_connections 2024-09-10T05:36:39.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.631+0000 7f2504ef89c0 1 -- 172.21.15.62:0/2343671463 wait complete. 2024-09-10T05:36:39.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.647+0000 7f2504ef89c0 1 Processor -- start 2024-09-10T05:36:39.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.647+0000 7f2504ef89c0 1 -- start start 2024-09-10T05:36:39.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.647+0000 7f2504ef89c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615869fbfb0 0x561586972a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.647+0000 7f2504ef89c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561586904680 con 0x5615869fbfb0 2024-09-10T05:36:39.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.647+0000 7f25029fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615869fbfb0 0x561586972a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.647+0000 7f25029fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615869fbfb0 0x561586972a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:48092/0 (socket says 172.21.15.62:48092) 2024-09-10T05:36:39.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.647+0000 7f25029fe640 1 -- 172.21.15.62:0/828473344 learned_addr learned my addr 172.21.15.62:0/828473344 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:39.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.647+0000 7f25029fe640 1 -- 172.21.15.62:0/828473344 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56158687fda0 con 0x5615869fbfb0 2024-09-10T05:36:39.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.647+0000 7f25029fe640 1 --2- 172.21.15.62:0/828473344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615869fbfb0 0x561586972a10 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f24f4018eb0 tx=0x7f24f4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2402f3626b662890 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.647+0000 7f23f0e09640 1 -- 172.21.15.62:0/828473344 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24f40b0070 con 0x5615869fbfb0 2024-09-10T05:36:39.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.647+0000 7f23f0e09640 1 -- 172.21.15.62:0/828473344 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24f40b1040 con 0x5615869fbfb0 2024-09-10T05:36:39.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.647+0000 7f23f0e09640 1 -- 172.21.15.62:0/828473344 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24f40ab6f0 con 0x5615869fbfb0 2024-09-10T05:36:39.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.647+0000 7f2504ef89c0 1 -- 172.21.15.62:0/828473344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615869fbfb0 msgr2=0x561586972a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.647+0000 7f2504ef89c0 1 --2- 172.21.15.62:0/828473344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615869fbfb0 0x561586972a10 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f24f4018eb0 tx=0x7f24f4003030 comp rx=0 tx=0).stop 2024-09-10T05:36:39.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.647+0000 7f2504ef89c0 1 -- 172.21.15.62:0/828473344 shutdown_connections 2024-09-10T05:36:39.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.647+0000 7f2504ef89c0 1 --2- 172.21.15.62:0/828473344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615869fbfb0 0x561586972a10 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.647+0000 7f2504ef89c0 1 -- 172.21.15.62:0/828473344 >> 172.21.15.62:0/828473344 conn(0x5615869f7ad0 msgr2=0x561586ae3370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:39.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.647+0000 7f2504ef89c0 1 -- 172.21.15.62:0/828473344 shutdown_connections 2024-09-10T05:36:39.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.647+0000 7f2504ef89c0 1 -- 172.21.15.62:0/828473344 wait complete. 2024-09-10T05:36:39.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.651+0000 7f2504ef89c0 1 Processor -- start 2024-09-10T05:36:39.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.651+0000 7f2504ef89c0 1 -- start start 2024-09-10T05:36:39.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.651+0000 7f2504ef89c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615869fbfb0 0x561586af0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.651+0000 7f2504ef89c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5615868a6a50 con 0x5615869fbfb0 2024-09-10T05:36:39.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.651+0000 7f25029fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615869fbfb0 0x561586af0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.651+0000 7f25029fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615869fbfb0 0x561586af0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:48100/0 (socket says 172.21.15.62:48100) 2024-09-10T05:36:39.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.651+0000 7f25029fe640 1 -- 172.21.15.62:0/2673810392 learned_addr learned my addr 172.21.15.62:0/2673810392 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:39.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.651+0000 7f25029fe640 1 -- 172.21.15.62:0/2673810392 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561586af1330 con 0x5615869fbfb0 2024-09-10T05:36:39.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.651+0000 7f25029fe640 1 --2- 172.21.15.62:0/2673810392 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615869fbfb0 0x561586af0dd0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f24f40ab510 tx=0x7f24f4018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.651+0000 7f23ef606640 1 -- 172.21.15.62:0/2673810392 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24f40c4070 con 0x5615869fbfb0 2024-09-10T05:36:39.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.651+0000 7f2504ef89c0 1 -- 172.21.15.62:0/2673810392 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561586af15c0 con 0x5615869fbfb0 2024-09-10T05:36:39.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.651+0000 7f2504ef89c0 1 -- 172.21.15.62:0/2673810392 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561586af1f70 con 0x5615869fbfb0 2024-09-10T05:36:39.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.651+0000 7f23ef606640 1 -- 172.21.15.62:0/2673810392 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24f40b75b0 con 0x5615869fbfb0 2024-09-10T05:36:39.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.651+0000 7f23ef606640 1 -- 172.21.15.62:0/2673810392 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24f40ce060 con 0x5615869fbfb0 2024-09-10T05:36:39.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.651+0000 7f23ef606640 1 -- 172.21.15.62:0/2673810392 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f24f40c7070 con 0x5615869fbfb0 2024-09-10T05:36:39.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.651+0000 7f23ef606640 1 --2- 172.21.15.62:0/2673810392 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f23e8039ac0 0x7f23e803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.651+0000 7f23ef606640 1 -- 172.21.15.62:0/2673810392 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f24f40bc070 con 0x5615869fbfb0 2024-09-10T05:36:39.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.651+0000 7f24fbfff640 1 --2- 172.21.15.62:0/2673810392 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f23e8039ac0 0x7f23e803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.651+0000 7f2504ef89c0 1 --2- 172.21.15.62:0/2673810392 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5615869ff140 0x561586af7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.651+0000 7f2504ef89c0 1 -- 172.21.15.62:0/2673810392 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561586af8480 con 0x5615869ff140 2024-09-10T05:36:39.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.651+0000 7f25031ff640 1 --2- 172.21.15.62:0/2673810392 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5615869ff140 0x561586af7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.655+0000 7f24fbfff640 1 --2- 172.21.15.62:0/2673810392 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f23e8039ac0 0x7f23e803bf80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f24ec001d80 tx=0x7f24ec0012e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.655+0000 7f25031ff640 1 --2- 172.21.15.62:0/2673810392 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5615869ff140 0x561586af7f40 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.655+0000 7f25031ff640 1 -- 172.21.15.62:0/2673810392 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24fc00a4d0 con 0x5615869ff140 2024-09-10T05:36:39.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.655+0000 7f2504ef89c0 1 --2- 172.21.15.62:0/2673810392 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561586af8ea0 0x561586afb340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.655+0000 7f2504ef89c0 1 -- 172.21.15.62:0/2673810392 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561586afbab0 con 0x561586af8ea0 2024-09-10T05:36:39.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.655+0000 7f25029fe640 1 --2- 172.21.15.62:0/2673810392 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561586af8ea0 0x561586afb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.655+0000 7f25029fe640 1 --2- 172.21.15.62:0/2673810392 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561586af8ea0 0x561586afb340 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.655+0000 7f25029fe640 1 -- 172.21.15.62:0/2673810392 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f24f40c6030 con 0x561586af8ea0 2024-09-10T05:36:39.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.655+0000 7f2504ef89c0 1 --2- 172.21.15.62:0/2673810392 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x561586afd870 0x561586affc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.655+0000 7f2504ef89c0 1 -- 172.21.15.62:0/2673810392 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561586b00350 con 0x561586afd870 2024-09-10T05:36:39.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.655+0000 7f24fbfff640 1 --2- 172.21.15.62:0/2673810392 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x561586afd870 0x561586affc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.655+0000 7f24fbfff640 1 --2- 172.21.15.62:0/2673810392 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x561586afd870 0x561586affc60 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.655+0000 7f24fbfff640 1 -- 172.21.15.62:0/2673810392 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f24ec00e620 con 0x561586afd870 2024-09-10T05:36:39.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.655+0000 7f2504ef89c0 1 -- 172.21.15.62:0/2673810392 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561586afc710 con 0x561586af8ea0 2024-09-10T05:36:39.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.659+0000 7f25029fe640 1 -- 172.21.15.62:0/2673810392 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f24f40c6030 con 0x561586af8ea0 2024-09-10T05:36:39.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.659+0000 7f2504ef89c0 1 -- 172.21.15.62:0/2673810392 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561586afcbb0 con 0x561586afd870 2024-09-10T05:36:39.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.659+0000 7f24fbfff640 1 -- 172.21.15.62:0/2673810392 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f24ec00e620 con 0x561586afd870 2024-09-10T05:36:39.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.659+0000 7f2504ef89c0 1 Processor -- start 2024-09-10T05:36:39.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.659+0000 7f2504ef89c0 1 -- start start 2024-09-10T05:36:39.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.659+0000 7f2504ef89c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561586b0ea00 0x561586b0ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.659+0000 7f2504ef89c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561586911450 con 0x561586b0ea00 2024-09-10T05:36:39.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.659+0000 7f25029fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561586b0ea00 0x561586b0ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.659+0000 7f25029fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561586b0ea00 0x561586b0ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:48112/0 (socket says 172.21.15.62:48112) 2024-09-10T05:36:39.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.659+0000 7f25029fe640 1 -- 172.21.15.62:0/433697561 learned_addr learned my addr 172.21.15.62:0/433697561 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:39.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.659+0000 7f25029fe640 1 -- 172.21.15.62:0/433697561 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561586b0f460 con 0x561586b0ea00 2024-09-10T05:36:39.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.659+0000 7f25029fe640 1 --2- 172.21.15.62:0/433697561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561586b0ea00 0x561586b0ee20 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f24f40c0fd0 tx=0x7f24f40c0ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.659+0000 7f23ece01640 1 -- 172.21.15.62:0/433697561 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24f40e21d0 con 0x561586b0ea00 2024-09-10T05:36:39.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.659+0000 7f2504ef89c0 1 -- 172.21.15.62:0/433697561 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561586b0fcc0 con 0x561586b0ea00 2024-09-10T05:36:39.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.659+0000 7f23ece01640 1 -- 172.21.15.62:0/433697561 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24f40e2370 con 0x561586b0ea00 2024-09-10T05:36:39.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.659+0000 7f23ece01640 1 -- 172.21.15.62:0/433697561 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24f40e2760 con 0x561586b0ea00 2024-09-10T05:36:39.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.659+0000 7f2504ef89c0 1 -- 172.21.15.62:0/433697561 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561586b10230 con 0x561586b0ea00 2024-09-10T05:36:39.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.663+0000 7f23ece01640 1 -- 172.21.15.62:0/433697561 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f24f40e2900 con 0x561586b0ea00 2024-09-10T05:36:39.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.663+0000 7f23ece01640 1 --2- 172.21.15.62:0/433697561 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f23dc039a70 0x7f23dc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.663+0000 7f23ece01640 1 -- 172.21.15.62:0/433697561 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f24f40a8070 con 0x561586b0ea00 2024-09-10T05:36:39.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.663+0000 7f24fbfff640 1 --2- 172.21.15.62:0/433697561 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f23dc039a70 0x7f23dc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.663+0000 7f2504ef89c0 1 Processor -- start 2024-09-10T05:36:39.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.663+0000 7f2504ef89c0 1 -- start start 2024-09-10T05:36:39.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.663+0000 7f24fbfff640 1 --2- 172.21.15.62:0/433697561 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f23dc039a70 0x7f23dc03bf30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f24ec00bf50 tx=0x7f24ec00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.663+0000 7f2504ef89c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561586b1af80 0x561586b1b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.663+0000 7f2504ef89c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561586973180 con 0x561586b1af80 2024-09-10T05:36:39.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.663+0000 7f25029fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561586b1af80 0x561586b1b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.663+0000 7f25029fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561586b1af80 0x561586b1b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:48122/0 (socket says 172.21.15.62:48122) 2024-09-10T05:36:39.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.663+0000 7f25029fe640 1 -- 172.21.15.62:0/1399001004 learned_addr learned my addr 172.21.15.62:0/1399001004 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:39.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.663+0000 7f25029fe640 1 -- 172.21.15.62:0/1399001004 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561586b1b930 con 0x561586b1af80 2024-09-10T05:36:39.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.663+0000 7f25029fe640 1 --2- 172.21.15.62:0/1399001004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561586b1af80 0x561586b1b360 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f24f40d5fd0 tx=0x7f24f40e2c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbd346548812f37d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.663+0000 7f23e67fc640 1 -- 172.21.15.62:0/1399001004 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24f40c69b0 con 0x561586b1af80 2024-09-10T05:36:39.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.663+0000 7f23e67fc640 1 -- 172.21.15.62:0/1399001004 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24f40aa7b0 con 0x561586b1af80 2024-09-10T05:36:39.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.663+0000 7f23e67fc640 1 -- 172.21.15.62:0/1399001004 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24f40c62c0 con 0x561586b1af80 2024-09-10T05:36:39.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.663+0000 7f2504ef89c0 1 -- 172.21.15.62:0/1399001004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561586b1af80 msgr2=0x561586b1b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.663+0000 7f2504ef89c0 1 --2- 172.21.15.62:0/1399001004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561586b1af80 0x561586b1b360 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f24f40d5fd0 tx=0x7f24f40e2c70 comp rx=0 tx=0).stop 2024-09-10T05:36:39.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.663+0000 7f2504ef89c0 1 -- 172.21.15.62:0/1399001004 shutdown_connections 2024-09-10T05:36:39.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.663+0000 7f2504ef89c0 1 --2- 172.21.15.62:0/1399001004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561586b1af80 0x561586b1b360 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.663+0000 7f2504ef89c0 1 -- 172.21.15.62:0/1399001004 >> 172.21.15.62:0/1399001004 conn(0x561586b173b0 msgr2=0x561586b155f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:39.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.663+0000 7f2504ef89c0 1 -- 172.21.15.62:0/1399001004 shutdown_connections 2024-09-10T05:36:39.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.663+0000 7f2504ef89c0 1 -- 172.21.15.62:0/1399001004 wait complete. 2024-09-10T05:36:39.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.663+0000 7f2504ef89c0 1 Processor -- start 2024-09-10T05:36:39.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.663+0000 7f2504ef89c0 1 -- start start 2024-09-10T05:36:39.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.663+0000 7f2504ef89c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561586b1af80 0x561586b22150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.663+0000 7f2504ef89c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561586b1b930 con 0x561586b1af80 2024-09-10T05:36:39.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.663+0000 7f25029fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561586b1af80 0x561586b22150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.667+0000 7f25029fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561586b1af80 0x561586b22150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:48134/0 (socket says 172.21.15.62:48134) 2024-09-10T05:36:39.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.667+0000 7f25029fe640 1 -- 172.21.15.62:0/3962027951 learned_addr learned my addr 172.21.15.62:0/3962027951 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:39.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.667+0000 7f25029fe640 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561586b226b0 con 0x561586b1af80 2024-09-10T05:36:39.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.667+0000 7f25029fe640 1 --2- 172.21.15.62:0/3962027951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561586b1af80 0x561586b22150 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f24f40d5fd0 tx=0x7f24f40e1f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.667+0000 7f23e4ff9640 1 -- 172.21.15.62:0/3962027951 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24f40c62c0 con 0x561586b1af80 2024-09-10T05:36:39.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.667+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561586b226b0 con 0x561586b1af80 2024-09-10T05:36:39.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.667+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561586b226b0 con 0x561586b1af80 2024-09-10T05:36:39.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.667+0000 7f23e4ff9640 1 -- 172.21.15.62:0/3962027951 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24f4111070 con 0x561586b1af80 2024-09-10T05:36:39.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.667+0000 7f23e4ff9640 1 -- 172.21.15.62:0/3962027951 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24f40c69b0 con 0x561586b1af80 2024-09-10T05:36:39.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.667+0000 7f23e4ff9640 1 -- 172.21.15.62:0/3962027951 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f24f40e90f0 con 0x561586b1af80 2024-09-10T05:36:39.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.667+0000 7f23e4ff9640 1 --2- 172.21.15.62:0/3962027951 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f23cc039a70 0x7f23cc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.667+0000 7f23e4ff9640 1 -- 172.21.15.62:0/3962027951 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f24f4117b10 con 0x561586b1af80 2024-09-10T05:36:39.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.667+0000 7f2504ef89c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.667+0000 7f24fbfff640 1 --2- 172.21.15.62:0/3962027951 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f23cc039a70 0x7f23cc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.667+0000 7f2504ef89c0 1 --2- 172.21.15.62:0/3962027951 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x561586b2cf30 0x561586b2f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.667+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561586b2fb40 con 0x561586b2cf30 2024-09-10T05:36:39.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.667+0000 7f25031ff640 1 --2- 172.21.15.62:0/3962027951 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x561586b2cf30 0x561586b2f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.667+0000 7f24fbfff640 1 --2- 172.21.15.62:0/3962027951 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f23cc039a70 0x7f23cc03bf30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f24ec01d040 tx=0x7f24ec010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.667+0000 7f25031ff640 1 --2- 172.21.15.62:0/3962027951 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x561586b2cf30 0x561586b2f3f0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.667+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24fc00a4d0 con 0x561586b2cf30 2024-09-10T05:36:39.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.667+0000 7f2504ef89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:39.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.667+0000 7f2504ef89c0 20 realm 2024-09-10T05:36:39.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.667+0000 7f2504ef89c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.667+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561586b2c260 con 0x561586b2cf30 2024-09-10T05:36:39.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.671+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24fc00a4d0 con 0x561586b2cf30 2024-09-10T05:36:39.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.671+0000 7f2504ef89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:39.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.671+0000 7f2504ef89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:39.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.671+0000 7f2504ef89c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.671+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561586b30610 con 0x561586b2cf30 2024-09-10T05:36:39.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.671+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24fc00a4d0 con 0x561586b2cf30 2024-09-10T05:36:39.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.671+0000 7f2504ef89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:39.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.671+0000 7f2504ef89c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.671+0000 7f2504ef89c0 1 --2- 172.21.15.62:0/3962027951 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561586b313f0 0x561586b337e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.671+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561586b33e70 con 0x561586b313f0 2024-09-10T05:36:39.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.671+0000 7f25029fe640 1 --2- 172.21.15.62:0/3962027951 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561586b313f0 0x561586b337e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.671+0000 7f25029fe640 1 --2- 172.21.15.62:0/3962027951 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561586b313f0 0x561586b337e0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.671+0000 7f25029fe640 1 -- 172.21.15.62:0/3962027951 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f24f40c6030 con 0x561586b313f0 2024-09-10T05:36:39.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.671+0000 7f2504ef89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:39.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.671+0000 7f2504ef89c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.671+0000 7f2504ef89c0 1 --2- 172.21.15.62:0/3962027951 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x561586b34bd0 0x561586b37000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.671+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561586b37790 con 0x561586b34bd0 2024-09-10T05:36:39.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.671+0000 7f24fbfff640 1 --2- 172.21.15.62:0/3962027951 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x561586b34bd0 0x561586b37000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.671+0000 7f24fbfff640 1 --2- 172.21.15.62:0/3962027951 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x561586b34bd0 0x561586b37000 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.671+0000 7f24fbfff640 1 -- 172.21.15.62:0/3962027951 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f24ec026070 con 0x561586b34bd0 2024-09-10T05:36:39.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.671+0000 7f2504ef89c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:39.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.671+0000 7f2504ef89c0 20 searching for the correct realm 2024-09-10T05:36:39.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.671+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561586b39060 con 0x561586b34bd0 2024-09-10T05:36:39.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.671+0000 7f24fbfff640 1 -- 172.21.15.62:0/3962027951 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24ec026070 con 0x561586b34bd0 2024-09-10T05:36:39.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.671+0000 7f24fbfff640 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561586b39060 con 0x561586b313f0 2024-09-10T05:36:39.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.675+0000 7f25029fe640 1 -- 172.21.15.62:0/3962027951 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24f40c6030 con 0x561586b313f0 2024-09-10T05:36:39.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.675+0000 7f25029fe640 1 --2- 172.21.15.62:0/3962027951 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f24f40c9070 0x7f24f40e7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.675+0000 7f25029fe640 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561586b39060 con 0x7f24f40c9070 2024-09-10T05:36:39.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.675+0000 7f25031ff640 1 --2- 172.21.15.62:0/3962027951 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f24f40c9070 0x7f24f40e7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.675+0000 7f25031ff640 1 --2- 172.21.15.62:0/3962027951 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f24f40c9070 0x7f24f40e7810 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.675+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24fc00a4d0 con 0x7f24f40c9070 2024-09-10T05:36:39.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.675+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561586b39060 con 0x561586b2cf30 2024-09-10T05:36:39.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.675+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24fc00a4d0 con 0x561586b2cf30 2024-09-10T05:36:39.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.675+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561586b39060 con 0x561586b2cf30 2024-09-10T05:36:39.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.675+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24fc00a4d0 con 0x561586b2cf30 2024-09-10T05:36:39.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.675+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561586b39060 con 0x561586b34bd0 2024-09-10T05:36:39.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.675+0000 7f24fbfff640 1 -- 172.21.15.62:0/3962027951 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24ec026070 con 0x561586b34bd0 2024-09-10T05:36:39.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.675+0000 7f24fbfff640 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561586b39060 con 0x561586b2cf30 2024-09-10T05:36:39.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.675+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24fc00a4d0 con 0x561586b2cf30 2024-09-10T05:36:39.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.675+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561586b39060 con 0x561586b313f0 2024-09-10T05:36:39.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.675+0000 7f25029fe640 1 -- 172.21.15.62:0/3962027951 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24f40c6030 con 0x561586b313f0 2024-09-10T05:36:39.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.675+0000 7f25029fe640 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561586b39060 con 0x561586b313f0 2024-09-10T05:36:39.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.675+0000 7f25029fe640 1 -- 172.21.15.62:0/3962027951 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24f40c6030 con 0x561586b313f0 2024-09-10T05:36:39.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.675+0000 7f25029fe640 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561586b39060 con 0x561586b2cf30 2024-09-10T05:36:39.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.679+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24fc00a4d0 con 0x561586b2cf30 2024-09-10T05:36:39.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.679+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561586b39060 con 0x7f24f40c9070 2024-09-10T05:36:39.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.679+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24fc00a4d0 con 0x7f24f40c9070 2024-09-10T05:36:39.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.679+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561586b39060 con 0x561586b2cf30 2024-09-10T05:36:39.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.679+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24fc00a4d0 con 0x561586b2cf30 2024-09-10T05:36:39.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.679+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561586b39060 con 0x7f24f40c9070 2024-09-10T05:36:39.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.679+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f24fc00a4d0 con 0x7f24f40c9070 2024-09-10T05:36:39.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.679+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561586b39060 con 0x561586b313f0 2024-09-10T05:36:39.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.679+0000 7f25029fe640 1 -- 172.21.15.62:0/3962027951 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24f40c6030 con 0x561586b313f0 2024-09-10T05:36:39.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.679+0000 7f25029fe640 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561586b39060 con 0x561586b34bd0 2024-09-10T05:36:39.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.679+0000 7f24fbfff640 1 -- 172.21.15.62:0/3962027951 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24ec026070 con 0x561586b34bd0 2024-09-10T05:36:39.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.679+0000 7f24fbfff640 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561586b39060 con 0x561586b2cf30 2024-09-10T05:36:39.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.679+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24fc00a4d0 con 0x561586b2cf30 2024-09-10T05:36:39.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.679+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561586b39060 con 0x561586b313f0 2024-09-10T05:36:39.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.679+0000 7f25029fe640 1 -- 172.21.15.62:0/3962027951 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24f40c6030 con 0x561586b313f0 2024-09-10T05:36:39.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.679+0000 7f25029fe640 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561586b39060 con 0x561586b34bd0 2024-09-10T05:36:39.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.679+0000 7f24fbfff640 1 -- 172.21.15.62:0/3962027951 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 30 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f24ec026070 con 0x561586b34bd0 2024-09-10T05:36:39.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.679+0000 7f24fbfff640 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561586b39060 con 0x561586b2cf30 2024-09-10T05:36:39.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.679+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24fc00a4d0 con 0x561586b2cf30 2024-09-10T05:36:39.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.679+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561586b39060 con 0x561586b2cf30 2024-09-10T05:36:39.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.679+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f24fc00a4d0 con 0x561586b2cf30 2024-09-10T05:36:39.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.679+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561586b39060 con 0x561586b2cf30 2024-09-10T05:36:39.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.683+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24fc00a4d0 con 0x561586b2cf30 2024-09-10T05:36:39.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.683+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561586b39060 con 0x561586b34bd0 2024-09-10T05:36:39.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.683+0000 7f24fbfff640 1 -- 172.21.15.62:0/3962027951 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24ec026070 con 0x561586b34bd0 2024-09-10T05:36:39.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.683+0000 7f24fbfff640 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561586b39060 con 0x7f24f40c9070 2024-09-10T05:36:39.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.683+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24fc00a4d0 con 0x7f24f40c9070 2024-09-10T05:36:39.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.683+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561586b39060 con 0x561586b2cf30 2024-09-10T05:36:39.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.683+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24fc00a4d0 con 0x561586b2cf30 2024-09-10T05:36:39.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.683+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561586b39060 con 0x7f24f40c9070 2024-09-10T05:36:39.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.683+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24fc00a4d0 con 0x7f24f40c9070 2024-09-10T05:36:39.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.683+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561586b39060 con 0x561586b34bd0 2024-09-10T05:36:39.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.683+0000 7f24fbfff640 1 -- 172.21.15.62:0/3962027951 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24ec026070 con 0x561586b34bd0 2024-09-10T05:36:39.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.683+0000 7f24fbfff640 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561586b39060 con 0x7f24f40c9070 2024-09-10T05:36:39.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.683+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24fc00a4d0 con 0x7f24f40c9070 2024-09-10T05:36:39.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.683+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561586b39060 con 0x561586b313f0 2024-09-10T05:36:39.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.683+0000 7f25029fe640 1 -- 172.21.15.62:0/3962027951 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24f40c6030 con 0x561586b313f0 2024-09-10T05:36:39.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.683+0000 7f25029fe640 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561586b39060 con 0x561586b313f0 2024-09-10T05:36:39.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.683+0000 7f25029fe640 1 -- 172.21.15.62:0/3962027951 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24f40c6030 con 0x561586b313f0 2024-09-10T05:36:39.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.683+0000 7f25029fe640 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561586b39060 con 0x561586b34bd0 2024-09-10T05:36:39.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.683+0000 7f24fbfff640 1 -- 172.21.15.62:0/3962027951 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24ec026070 con 0x561586b34bd0 2024-09-10T05:36:39.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.683+0000 7f24fbfff640 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561586b39060 con 0x561586b313f0 2024-09-10T05:36:39.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.687+0000 7f25029fe640 1 -- 172.21.15.62:0/3962027951 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f24f40c6030 con 0x561586b313f0 2024-09-10T05:36:39.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.687+0000 7f25029fe640 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561586b39060 con 0x561586b313f0 2024-09-10T05:36:39.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.687+0000 7f25029fe640 1 -- 172.21.15.62:0/3962027951 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24f40c6030 con 0x561586b313f0 2024-09-10T05:36:39.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.687+0000 7f2504ef89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:39.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.687+0000 7f2504ef89c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:39.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.687+0000 7f2504ef89c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:39.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.687+0000 7f2504ef89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:39.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.687+0000 7f2504ef89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:39.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.687+0000 7f2504ef89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:39.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.687+0000 7f2504ef89c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.687+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561586b38180 con 0x561586b2cf30 2024-09-10T05:36:39.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.687+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24fc00a4d0 con 0x561586b2cf30 2024-09-10T05:36:39.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.687+0000 7f2504ef89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:39.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.687+0000 7f2504ef89c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.687+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561586b38a20 con 0x561586b313f0 2024-09-10T05:36:39.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.687+0000 7f25029fe640 1 -- 172.21.15.62:0/3962027951 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f24f40c6030 con 0x561586b313f0 2024-09-10T05:36:39.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.687+0000 7f2504ef89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:39.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.687+0000 7f2504ef89c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.687+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561586b37dc0 con 0x561586b34bd0 2024-09-10T05:36:39.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.687+0000 7f24fbfff640 1 -- 172.21.15.62:0/3962027951 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f24ec026070 con 0x561586b34bd0 2024-09-10T05:36:39.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.687+0000 7f2504ef89c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:39.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.687+0000 7f2504ef89c0 20 zone default found 2024-09-10T05:36:39.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.687+0000 7f2504ef89c0 4 Realm: () 2024-09-10T05:36:39.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.687+0000 7f2504ef89c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:39.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.687+0000 7f2504ef89c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:39.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.687+0000 7f2504ef89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:39.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.687+0000 7f2504ef89c0 20 zonegroup default 2024-09-10T05:36:39.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.687+0000 7f2504ef89c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.687+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561586b39940 con 0x7f24f40c9070 2024-09-10T05:36:39.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.687+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f24fc00a4d0 con 0x7f24f40c9070 2024-09-10T05:36:39.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.687+0000 7f2504ef89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:39.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.687+0000 7f2504ef89c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.687+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561586b3bb80 con 0x561586b34bd0 2024-09-10T05:36:39.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.687+0000 7f24fbfff640 1 -- 172.21.15.62:0/3962027951 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f24ec026070 con 0x561586b34bd0 2024-09-10T05:36:39.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.687+0000 7f2504ef89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:39.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.687+0000 7f2504ef89c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.687+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561586b3bf20 con 0x561586b34bd0 2024-09-10T05:36:39.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.687+0000 7f24fbfff640 1 -- 172.21.15.62:0/3962027951 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f24ec026070 con 0x561586b34bd0 2024-09-10T05:36:39.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.687+0000 7f2504ef89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:39.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.687+0000 7f2504ef89c0 20 started sync module instance, tier type = 2024-09-10T05:36:39.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.687+0000 7f2504ef89c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:39.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.687+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561586b3b010 con 0x561586b313f0 2024-09-10T05:36:39.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.691+0000 7f25029fe640 1 -- 172.21.15.62:0/3962027951 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24f40c6030 con 0x561586b313f0 2024-09-10T05:36:39.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.691+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94650454225968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561586b3c7c0 con 0x561586b313f0 2024-09-10T05:36:39.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.691+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561586b3d010 con 0x561586b2cf30 2024-09-10T05:36:39.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.691+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24fc00a4d0 con 0x561586b2cf30 2024-09-10T05:36:39.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.691+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94650454230976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561586b3cbe0 con 0x561586b2cf30 2024-09-10T05:36:39.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.691+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561586b3dfb0 con 0x561586b313f0 2024-09-10T05:36:39.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.691+0000 7f25029fe640 1 -- 172.21.15.62:0/3962027951 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94650454225968] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24f40c6030 con 0x561586b313f0 2024-09-10T05:36:39.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.691+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94650454230976] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24fc00a4d0 con 0x561586b2cf30 2024-09-10T05:36:39.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.695+0000 7f25029fe640 1 -- 172.21.15.62:0/3962027951 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24f40c6030 con 0x561586b313f0 2024-09-10T05:36:39.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.695+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94650454234032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561586b3df70 con 0x561586b313f0 2024-09-10T05:36:39.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.695+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561586b3e850 con 0x7f24f40c9070 2024-09-10T05:36:39.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.695+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24fc00a4d0 con 0x7f24f40c9070 2024-09-10T05:36:39.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.695+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94650454238112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561586b3df70 con 0x7f24f40c9070 2024-09-10T05:36:39.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.695+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561586b3f290 con 0x561586b313f0 2024-09-10T05:36:39.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.695+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94650454238112] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24fc00a4d0 con 0x7f24f40c9070 2024-09-10T05:36:39.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.695+0000 7f25029fe640 1 -- 172.21.15.62:0/3962027951 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94650454234032] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24f40c6030 con 0x561586b313f0 2024-09-10T05:36:39.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.695+0000 7f25029fe640 1 -- 172.21.15.62:0/3962027951 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24f40c6030 con 0x561586b313f0 2024-09-10T05:36:39.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.695+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94650454235776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561586b3ede0 con 0x561586b313f0 2024-09-10T05:36:39.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.695+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561586b3f690 con 0x561586b34bd0 2024-09-10T05:36:39.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.699+0000 7f24fbfff640 1 -- 172.21.15.62:0/3962027951 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24ec026070 con 0x561586b34bd0 2024-09-10T05:36:39.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.699+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94650454240736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561586b3f200 con 0x561586b34bd0 2024-09-10T05:36:39.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.699+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561586b40590 con 0x561586b34bd0 2024-09-10T05:36:39.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.699+0000 7f24fbfff640 1 -- 172.21.15.62:0/3962027951 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94650454240736] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24ec026070 con 0x561586b34bd0 2024-09-10T05:36:39.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.699+0000 7f25029fe640 1 -- 172.21.15.62:0/3962027951 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94650454235776] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24f40c6030 con 0x561586b313f0 2024-09-10T05:36:39.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.699+0000 7f24fbfff640 1 -- 172.21.15.62:0/3962027951 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24ec026070 con 0x561586b34bd0 2024-09-10T05:36:39.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.699+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94650454239168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561586b400a0 con 0x561586b34bd0 2024-09-10T05:36:39.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.699+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561586b40e60 con 0x7f24f40c9070 2024-09-10T05:36:39.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.699+0000 7f24fbfff640 1 -- 172.21.15.62:0/3962027951 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94650454239168] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24ec026070 con 0x561586b34bd0 2024-09-10T05:36:39.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.699+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24fc00a4d0 con 0x7f24f40c9070 2024-09-10T05:36:39.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.699+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94650454243968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561586b400a0 con 0x7f24f40c9070 2024-09-10T05:36:39.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.699+0000 7f2504ef89c0 20 add_watcher() i=0 2024-09-10T05:36:39.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.699+0000 7f2504ef89c0 20 add_watcher() i=1 2024-09-10T05:36:39.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.699+0000 7f2504ef89c0 20 add_watcher() i=2 2024-09-10T05:36:39.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.699+0000 7f2504ef89c0 20 add_watcher() i=3 2024-09-10T05:36:39.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.699+0000 7f2504ef89c0 20 add_watcher() i=4 2024-09-10T05:36:39.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.699+0000 7f2504ef89c0 20 add_watcher() i=5 2024-09-10T05:36:39.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.699+0000 7f2504ef89c0 20 add_watcher() i=6 2024-09-10T05:36:39.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.699+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94650454243968] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24fc00a4d0 con 0x7f24f40c9070 2024-09-10T05:36:39.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.699+0000 7f2504ef89c0 20 add_watcher() i=7 2024-09-10T05:36:39.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.699+0000 7f2504ef89c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:39.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.699+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561586b43f20 con 0x561586b2cf30 2024-09-10T05:36:39.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.703+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f24fc00a4d0 con 0x561586b2cf30 2024-09-10T05:36:39.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.703+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94650454247856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561586b41470 con 0x561586b2cf30 2024-09-10T05:36:39.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.703+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94650454247856] v30'154 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f24fc00a4d0 con 0x561586b2cf30 2024-09-10T05:36:39.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.703+0000 7f23b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:39.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.703+0000 7f2504ef89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:39.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.703+0000 7f2504ef89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:39.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.703+0000 7f2504ef89c0 5 note: GC not initialized 2024-09-10T05:36:39.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.703+0000 7f23b8fe1640 20 reqs_thread_entry: start 2024-09-10T05:36:39.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.703+0000 7f2504ef89c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:39.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.703+0000 7f2504ef89c0 20 Filter name: none 2024-09-10T05:36:39.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.703+0000 7f23b1ffb640 20 reqs_thread_entry: start 2024-09-10T05:36:39.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.703+0000 7f2504ef89c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T05:36:39.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.703+0000 7f2504ef89c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.703+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561586b67180 con 0x561586b2cf30 2024-09-10T05:36:39.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.703+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f24fc00a4d0 con 0x561586b2cf30 2024-09-10T05:36:39.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.703+0000 7f2504ef89c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:36:39.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.703+0000 7f2504ef89c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T05:36:39.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.703+0000 7f2504ef89c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:36:39.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.703+0000 7f2504ef89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:36:39.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.703+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561586b69c10 con 0x7f24f40c9070 2024-09-10T05:36:39.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.707+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f24fc00a4d0 con 0x7f24f40c9070 2024-09-10T05:36:39.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.707+0000 7f2504ef89c0 20 disabling bucket name=myfoo 2024-09-10T05:36:39.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.707+0000 7f2504ef89c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T05:36:39.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.707+0000 7f2504ef89c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.707+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561586b67bf0 con 0x7f24f40c9070 2024-09-10T05:36:39.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.707+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7f24fc00a4d0 con 0x7f24f40c9070 2024-09-10T05:36:39.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.707+0000 7f2504ef89c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T05:36:39.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.707+0000 7f2504ef89c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-10T05:36:39.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.707+0000 7f2504ef89c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T05:36:39.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.707+0000 7f2504ef89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 : miss 2024-09-10T05:36:39.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.707+0000 7f2504ef89c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.707+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:65 8.1f 8:fcc5c255:root::.bucket.meta.myfoo%3a475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561586b6a4e0 con 0x7f24f40c9070 2024-09-10T05:36:39.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.707+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(65 .bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f24fc00a4d0 con 0x7f24f40c9070 2024-09-10T05:36:39.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.707+0000 7f2504ef89c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T05:36:39.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.707+0000 7f2504ef89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 info.flags=0x17 2024-09-10T05:36:39.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.707+0000 7f2504ef89c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 to cache LRU end 2024-09-10T05:36:39.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.707+0000 7f2504ef89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:36:39.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.707+0000 7f2504ef89c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T05:36:39.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.707+0000 7f2504ef89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 2024-09-10T05:36:39.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.707+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:66 8.1f 8:fcc5c255:root::.bucket.meta.myfoo%3a475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561586b71d40 con 0x7f24f40c9070 2024-09-10T05:36:39.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.707+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 <== osd.2 v2:172.21.15.62:6800/2677868286 15 ==== osd_op_reply(66 .bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v30'6 uv6 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f24fc00a4d0 con 0x7f24f40c9070 2024-09-10T05:36:39.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.707+0000 7f2504ef89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 info.flags=0x17 2024-09-10T05:36:39.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.707+0000 7f2504ef89c0 10 moving default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 to cache LRU end 2024-09-10T05:36:39.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.707+0000 7f2504ef89c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T05:36:39.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.707+0000 7f2504ef89c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1, ofs0, ns] 2024-09-10T05:36:39.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.707+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94650454420352 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561586b70a40 con 0x561586b34bd0 2024-09-10T05:36:39.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.711+0000 7f24fbfff640 1 -- 172.21.15.62:0/3962027951 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== watch-notify(notify (1) cookie 94650454240736 notify 128849018895 ret 0) ==== 802+0+0 (crc 0 0 0) 0x7f24ec041040 con 0x561586b34bd0 2024-09-10T05:36:39.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.711+0000 7f23e67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018895 cookie 94650454240736 notifier 4591 bl.length()=760 2024-09-10T05:36:39.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.711+0000 7f23e67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 info.flags=0x17 2024-09-10T05:36:39.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.711+0000 7f23e67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 to cache LRU end 2024-09-10T05:36:39.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.711+0000 7f23e67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T05:36:39.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.711+0000 7f24fbfff640 1 -- 172.21.15.62:0/3962027951 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(67 notify.5 [notify cookie 94650454420352 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f24ec026070 con 0x561586b34bd0 2024-09-10T05:36:39.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.711+0000 7f23e67fc640 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f23c8003eb0 con 0x561586b34bd0 2024-09-10T05:36:39.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.711+0000 7f24fbfff640 1 -- 172.21.15.62:0/3962027951 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24ec026070 con 0x561586b34bd0 2024-09-10T05:36:39.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.711+0000 7f24fbfff640 1 -- 172.21.15.62:0/3962027951 <== osd.3 v2:172.21.15.62:6816/2708991149 19 ==== watch-notify(notify_complete (2) cookie 94650454420352 notify 128849018895 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5615868b09c0 con 0x561586b34bd0 2024-09-10T05:36:39.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.711+0000 7f2504ef89c0 20 handle_bi_update(): bucket=:myfoo[475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1]): orig_sources= new_sources= 2024-09-10T05:36:39.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.711+0000 7f2504ef89c0 20 handle_bi_update(): bucket=:myfoo[475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1]): potential sources added=[] removed=[] 2024-09-10T05:36:39.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.711+0000 7f2504ef89c0 20 handle_bi_update(): bucket=:myfoo[475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1]): orig_dests= new_dests= 2024-09-10T05:36:39.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.711+0000 7f2504ef89c0 20 handle_bi_update(): bucket=:myfoo[475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1]): potential dests added=[] removed=[] 2024-09-10T05:36:39.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.711+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561586b6ab60 con 0x561586b2cf30 2024-09-10T05:36:39.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.711+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v30'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f24fc00a4d0 con 0x561586b2cf30 2024-09-10T05:36:39.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.711+0000 7f2504ef89c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:36:39.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.711+0000 7f2504ef89c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:36:39.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.711+0000 7f2504ef89c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T05:36:39.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.711+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94650454420320 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561586b70a40 con 0x561586b313f0 2024-09-10T05:36:39.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.711+0000 7f25029fe640 1 -- 172.21.15.62:0/3962027951 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== watch-notify(notify (1) cookie 94650454235776 notify 128849018912 ret 0) ==== 609+0+0 (crc 0 0 0) 0x561586b0f460 con 0x561586b313f0 2024-09-10T05:36:39.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.711+0000 7f23e67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018912 cookie 94650454235776 notifier 4591 bl.length()=567 2024-09-10T05:36:39.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.711+0000 7f23e67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:36:39.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.711+0000 7f23e67fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:36:39.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.711+0000 7f23e67fc640 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f23c8003eb0 con 0x561586b313f0 2024-09-10T05:36:39.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.711+0000 7f25029fe640 1 -- 172.21.15.62:0/3962027951 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(70 notify.4 [notify cookie 94650454420320 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f24f40c6030 con 0x561586b313f0 2024-09-10T05:36:39.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.715+0000 7f25029fe640 1 -- 172.21.15.62:0/3962027951 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== watch-notify(notify_complete (2) cookie 94650454420320 notify 128849018912 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f24f40e8040 con 0x561586b313f0 2024-09-10T05:36:39.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.715+0000 7f25029fe640 1 -- 172.21.15.62:0/3962027951 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24f40c6030 con 0x561586b313f0 2024-09-10T05:36:39.718 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T05:36:30.893777Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:36:30.893760Z","tags":[],"group_ids":[]} 2024-09-10T05:36:39.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.715+0000 7f23b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:39.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.715+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94650454247856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561586b6fa80 con 0x561586b2cf30 2024-09-10T05:36:39.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.715+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94650454247856] v30'155 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f24fc00a4d0 con 0x561586b2cf30 2024-09-10T05:36:39.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.715+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94650454225968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561586b40980 con 0x561586b313f0 2024-09-10T05:36:39.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.719+0000 7f25029fe640 1 -- 172.21.15.62:0/3962027951 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94650454225968] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24f40c6030 con 0x561586b313f0 2024-09-10T05:36:39.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.719+0000 7f2504ef89c0 20 remove_watcher() i=0 2024-09-10T05:36:39.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.719+0000 7f2504ef89c0 2 removed watcher, disabling cache 2024-09-10T05:36:39.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.719+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94650454230976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561586b3b430 con 0x561586b2cf30 2024-09-10T05:36:39.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.719+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94650454230976] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24fc00a4d0 con 0x561586b2cf30 2024-09-10T05:36:39.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.719+0000 7f2504ef89c0 20 remove_watcher() i=1 2024-09-10T05:36:39.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.719+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94650454234032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561586b3b430 con 0x561586b313f0 2024-09-10T05:36:39.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.723+0000 7f25029fe640 1 -- 172.21.15.62:0/3962027951 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94650454234032] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24f40c6030 con 0x561586b313f0 2024-09-10T05:36:39.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.723+0000 7f2504ef89c0 20 remove_watcher() i=2 2024-09-10T05:36:39.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.723+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94650454238112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561586b3b430 con 0x7f24f40c9070 2024-09-10T05:36:39.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.723+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 <== osd.2 v2:172.21.15.62:6800/2677868286 16 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94650454238112] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24fc00a4d0 con 0x7f24f40c9070 2024-09-10T05:36:39.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.723+0000 7f2504ef89c0 20 remove_watcher() i=3 2024-09-10T05:36:39.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.723+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94650454235776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561586b3e3a0 con 0x561586b313f0 2024-09-10T05:36:39.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.727+0000 7f25029fe640 1 -- 172.21.15.62:0/3962027951 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94650454235776] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24f40c6030 con 0x561586b313f0 2024-09-10T05:36:39.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.727+0000 7f2504ef89c0 20 remove_watcher() i=4 2024-09-10T05:36:39.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.727+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94650454240736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561586b3e3a0 con 0x561586b34bd0 2024-09-10T05:36:39.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.727+0000 7f24fbfff640 1 -- 172.21.15.62:0/3962027951 <== osd.3 v2:172.21.15.62:6816/2708991149 20 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94650454240736] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24ec026070 con 0x561586b34bd0 2024-09-10T05:36:39.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.727+0000 7f2504ef89c0 20 remove_watcher() i=5 2024-09-10T05:36:39.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.727+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94650454239168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561586b3ede0 con 0x561586b34bd0 2024-09-10T05:36:39.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.727+0000 7f24fbfff640 1 -- 172.21.15.62:0/3962027951 <== osd.3 v2:172.21.15.62:6816/2708991149 21 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94650454239168] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24ec026070 con 0x561586b34bd0 2024-09-10T05:36:39.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.727+0000 7f2504ef89c0 20 remove_watcher() i=6 2024-09-10T05:36:39.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.727+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94650454243968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561586b3ede0 con 0x7f24f40c9070 2024-09-10T05:36:39.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.731+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 <== osd.2 v2:172.21.15.62:6800/2677868286 17 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94650454243968] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24fc00a4d0 con 0x7f24f40c9070 2024-09-10T05:36:39.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.731+0000 7f2504ef89c0 20 remove_watcher() i=7 2024-09-10T05:36:39.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.731+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561586b313f0 msgr2=0x561586b337e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.731+0000 7f2504ef89c0 1 --2- 172.21.15.62:0/3962027951 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561586b313f0 0x561586b337e0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.731+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x561586b2cf30 msgr2=0x561586b2f3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.731+0000 7f2504ef89c0 1 --2- 172.21.15.62:0/3962027951 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x561586b2cf30 0x561586b2f3f0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.731+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f24f40c9070 msgr2=0x7f24f40e7810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.731+0000 7f2504ef89c0 1 --2- 172.21.15.62:0/3962027951 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f24f40c9070 0x7f24f40e7810 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.731+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x561586b34bd0 msgr2=0x561586b37000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.731+0000 7f2504ef89c0 1 --2- 172.21.15.62:0/3962027951 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x561586b34bd0 0x561586b37000 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.731+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f23cc039a70 msgr2=0x7f23cc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.731+0000 7f2504ef89c0 1 --2- 172.21.15.62:0/3962027951 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f23cc039a70 0x7f23cc03bf30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f24ec01d040 tx=0x7f24ec010000 comp rx=0 tx=0).stop 2024-09-10T05:36:39.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.731+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561586b1af80 msgr2=0x561586b22150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.731+0000 7f2504ef89c0 1 --2- 172.21.15.62:0/3962027951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561586b1af80 0x561586b22150 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f24f40d5fd0 tx=0x7f24f40e1f50 comp rx=0 tx=0).stop 2024-09-10T05:36:39.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.731+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 reap_dead start 2024-09-10T05:36:39.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.731+0000 7f25031ff640 1 -- 172.21.15.62:0/3962027951 reap_dead start 2024-09-10T05:36:39.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.731+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 shutdown_connections 2024-09-10T05:36:39.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.731+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 >> 172.21.15.62:0/3962027951 conn(0x561586b173b0 msgr2=0x561586b155c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:39.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.731+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 shutdown_connections 2024-09-10T05:36:39.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.731+0000 7f2504ef89c0 1 -- 172.21.15.62:0/3962027951 wait complete. 2024-09-10T05:36:39.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.731+0000 7f2504ef89c0 1 -- 172.21.15.62:0/433697561 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f23dc039a70 msgr2=0x7f23dc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.731+0000 7f2504ef89c0 1 --2- 172.21.15.62:0/433697561 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f23dc039a70 0x7f23dc03bf30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f24ec00bf50 tx=0x7f24ec00f000 comp rx=0 tx=0).stop 2024-09-10T05:36:39.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.731+0000 7f2504ef89c0 1 -- 172.21.15.62:0/433697561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561586b0ea00 msgr2=0x561586b0ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.731+0000 7f2504ef89c0 1 --2- 172.21.15.62:0/433697561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561586b0ea00 0x561586b0ee20 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f24f40c0fd0 tx=0x7f24f40c0ab0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.731+0000 7f2504ef89c0 1 -- 172.21.15.62:0/433697561 shutdown_connections 2024-09-10T05:36:39.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.731+0000 7f2504ef89c0 1 --2- 172.21.15.62:0/433697561 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f23dc039a70 0x7f23dc03bf30 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.731+0000 7f2504ef89c0 1 --2- 172.21.15.62:0/433697561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561586b0ea00 0x561586b0ee20 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.731+0000 7f2504ef89c0 1 -- 172.21.15.62:0/433697561 >> 172.21.15.62:0/433697561 conn(0x561586b043b0 msgr2=0x561586b04790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:39.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.731+0000 7f2504ef89c0 1 -- 172.21.15.62:0/433697561 shutdown_connections 2024-09-10T05:36:39.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.731+0000 7f2504ef89c0 1 -- 172.21.15.62:0/433697561 wait complete. 2024-09-10T05:36:39.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.731+0000 7f2504ef89c0 1 -- 172.21.15.62:0/2673810392 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561586af8ea0 msgr2=0x561586afb340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.731+0000 7f2504ef89c0 1 --2- 172.21.15.62:0/2673810392 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561586af8ea0 0x561586afb340 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.731+0000 7f2504ef89c0 1 -- 172.21.15.62:0/2673810392 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5615869ff140 msgr2=0x561586af7f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.731+0000 7f2504ef89c0 1 --2- 172.21.15.62:0/2673810392 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5615869ff140 0x561586af7f40 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.731+0000 7f2504ef89c0 1 -- 172.21.15.62:0/2673810392 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x561586afd870 msgr2=0x561586affc60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.731+0000 7f2504ef89c0 1 --2- 172.21.15.62:0/2673810392 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x561586afd870 0x561586affc60 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.731+0000 7f2504ef89c0 1 -- 172.21.15.62:0/2673810392 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f23e8039ac0 msgr2=0x7f23e803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.731+0000 7f2504ef89c0 1 --2- 172.21.15.62:0/2673810392 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f23e8039ac0 0x7f23e803bf80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f24ec001d80 tx=0x7f24ec0012e0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.731+0000 7f2504ef89c0 1 -- 172.21.15.62:0/2673810392 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615869fbfb0 msgr2=0x561586af0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.731+0000 7f2504ef89c0 1 --2- 172.21.15.62:0/2673810392 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615869fbfb0 0x561586af0dd0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f24f40ab510 tx=0x7f24f4018020 comp rx=0 tx=0).stop 2024-09-10T05:36:39.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.731+0000 7f25031ff640 1 -- 172.21.15.62:0/2673810392 reap_dead start 2024-09-10T05:36:39.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.731+0000 7f2504ef89c0 1 -- 172.21.15.62:0/2673810392 shutdown_connections 2024-09-10T05:36:39.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.731+0000 7f2504ef89c0 1 -- 172.21.15.62:0/2673810392 >> 172.21.15.62:0/2673810392 conn(0x5615869f7ad0 msgr2=0x561586971650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:39.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.731+0000 7f2504ef89c0 1 -- 172.21.15.62:0/2673810392 shutdown_connections 2024-09-10T05:36:39.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.731+0000 7f2504ef89c0 1 -- 172.21.15.62:0/2673810392 wait complete. 2024-09-10T05:36:39.744 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T05:36:30.893777Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:36:30.893760Z', 'tags': [], 'group_ids': []} 2024-09-10T05:36:39.746 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-10T05:36:39.746 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-10T05:36:39.746 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-10T05:36:39.828 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:39.828 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:39.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.827+0000 7f284dee09c0 1 Processor -- start 2024-09-10T05:36:39.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.827+0000 7f284dee09c0 1 -- start start 2024-09-10T05:36:39.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.827+0000 7f284dee09c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55f7bb3ffff0 0x55f7bb4023e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.827+0000 7f284dee09c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f7bb2b19c0 con 0x55f7bb3fbe00 2024-09-10T05:36:39.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.827+0000 7f284dee09c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x55f7bb3016d0 con 0x55f7bb3ffff0 2024-09-10T05:36:39.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.827+0000 7f284b1e5640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55f7bb3ffff0 0x55f7bb4023e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.827+0000 7f284b9e6640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x55f7bb3fbe00 0x55f7bb3fc1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:53190/0 (socket says 172.21.15.62:53190) 2024-09-10T05:36:39.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.827+0000 7f284b9e6640 1 -- 172.21.15.62:0/3995592002 learned_addr learned my addr 172.21.15.62:0/3995592002 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-10T05:36:39.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.827+0000 7f284b1e5640 1 -- 172.21.15.62:0/3995592002 >> v1:172.21.15.2:6789/0 conn(0x55f7bb3fbe00 legacy=0x55f7bb3fc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.827+0000 7f284b1e5640 1 -- 172.21.15.62:0/3995592002 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7bb2a5ca0 con 0x55f7bb3ffff0 2024-09-10T05:36:39.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.831+0000 7f284b1e5640 1 --2- 172.21.15.62:0/3995592002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7bb3ffff0 0x55f7bb4023e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f284000a480 tx=0x7f284001b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96431ebbc8237c05 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.831+0000 7f284a9e4640 1 -- 172.21.15.62:0/3995592002 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28400aa570 con 0x55f7bb3ffff0 2024-09-10T05:36:39.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.831+0000 7f284a9e4640 1 -- 172.21.15.62:0/3995592002 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28400af070 con 0x55f7bb3ffff0 2024-09-10T05:36:39.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.831+0000 7f284a9e4640 1 -- 172.21.15.62:0/3995592002 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28400aa860 con 0x55f7bb3ffff0 2024-09-10T05:36:39.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.831+0000 7f284dee09c0 1 -- 172.21.15.62:0/3995592002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7bb3ffff0 msgr2=0x55f7bb4023e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.831+0000 7f284dee09c0 1 --2- 172.21.15.62:0/3995592002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7bb3ffff0 0x55f7bb4023e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f284000a480 tx=0x7f284001b310 comp rx=0 tx=0).stop 2024-09-10T05:36:39.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.831+0000 7f284dee09c0 1 -- 172.21.15.62:0/3995592002 shutdown_connections 2024-09-10T05:36:39.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.831+0000 7f284dee09c0 1 --2- 172.21.15.62:0/3995592002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7bb3ffff0 0x55f7bb4023e0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.831+0000 7f284dee09c0 1 -- 172.21.15.62:0/3995592002 >> 172.21.15.62:0/3995592002 conn(0x55f7bb3f7920 msgr2=0x55f7bb3f9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:39.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.831+0000 7f284dee09c0 1 -- 172.21.15.62:0/3995592002 shutdown_connections 2024-09-10T05:36:39.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.831+0000 7f284dee09c0 1 -- 172.21.15.62:0/3995592002 wait complete. 2024-09-10T05:36:39.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.843+0000 7f284dee09c0 1 Processor -- start 2024-09-10T05:36:39.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.843+0000 7f284dee09c0 1 -- start start 2024-09-10T05:36:39.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.843+0000 7f284dee09c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7bb3fbe00 0x55f7bb4e8940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.843+0000 7f284dee09c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f7bb305680 con 0x55f7bb3fbe00 2024-09-10T05:36:39.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.847+0000 7f284b9e6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7bb3fbe00 0x55f7bb4e8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.847+0000 7f284b9e6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7bb3fbe00 0x55f7bb4e8940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:48162/0 (socket says 172.21.15.62:48162) 2024-09-10T05:36:39.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.847+0000 7f284b9e6640 1 -- 172.21.15.62:0/3740638618 learned_addr learned my addr 172.21.15.62:0/3740638618 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:39.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.847+0000 7f284b9e6640 1 -- 172.21.15.62:0/3740638618 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7bb280da0 con 0x55f7bb3fbe00 2024-09-10T05:36:39.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.847+0000 7f284b9e6640 1 --2- 172.21.15.62:0/3740638618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7bb3fbe00 0x55f7bb4e8940 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f28440017b0 tx=0x7f2844001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=951de5f3e752b908 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.847+0000 7f2739e0b640 1 -- 172.21.15.62:0/3740638618 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28440044f0 con 0x55f7bb3fbe00 2024-09-10T05:36:39.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.847+0000 7f2739e0b640 1 -- 172.21.15.62:0/3740638618 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28440046b0 con 0x55f7bb3fbe00 2024-09-10T05:36:39.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.847+0000 7f2739e0b640 1 -- 172.21.15.62:0/3740638618 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2844004a10 con 0x55f7bb3fbe00 2024-09-10T05:36:39.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.847+0000 7f284dee09c0 1 -- 172.21.15.62:0/3740638618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7bb3fbe00 msgr2=0x55f7bb4e8940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.847+0000 7f284dee09c0 1 --2- 172.21.15.62:0/3740638618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7bb3fbe00 0x55f7bb4e8940 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f28440017b0 tx=0x7f2844001c70 comp rx=0 tx=0).stop 2024-09-10T05:36:39.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.847+0000 7f284dee09c0 1 -- 172.21.15.62:0/3740638618 shutdown_connections 2024-09-10T05:36:39.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.847+0000 7f284dee09c0 1 --2- 172.21.15.62:0/3740638618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7bb3fbe00 0x55f7bb4e8940 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.847+0000 7f284dee09c0 1 -- 172.21.15.62:0/3740638618 >> 172.21.15.62:0/3740638618 conn(0x55f7bb3f7920 msgr2=0x55f7bb4e3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:39.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.847+0000 7f284dee09c0 1 -- 172.21.15.62:0/3740638618 shutdown_connections 2024-09-10T05:36:39.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.847+0000 7f284dee09c0 1 -- 172.21.15.62:0/3740638618 wait complete. 2024-09-10T05:36:39.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.847+0000 7f284dee09c0 1 Processor -- start 2024-09-10T05:36:39.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.847+0000 7f284dee09c0 1 -- start start 2024-09-10T05:36:39.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.847+0000 7f284dee09c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7bb3fbe00 0x55f7bb4f2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.847+0000 7f284dee09c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f7bb2a7a50 con 0x55f7bb3fbe00 2024-09-10T05:36:39.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.847+0000 7f284b9e6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7bb3fbe00 0x55f7bb4f2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.847+0000 7f284b9e6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7bb3fbe00 0x55f7bb4f2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:48168/0 (socket says 172.21.15.62:48168) 2024-09-10T05:36:39.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.847+0000 7f284b9e6640 1 -- 172.21.15.62:0/266784557 learned_addr learned my addr 172.21.15.62:0/266784557 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:39.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.847+0000 7f284b9e6640 1 -- 172.21.15.62:0/266784557 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7bb4f2590 con 0x55f7bb3fbe00 2024-09-10T05:36:39.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.847+0000 7f284b9e6640 1 --2- 172.21.15.62:0/266784557 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7bb3fbe00 0x55f7bb4f2030 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f28440012f0 tx=0x7f2844000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.847+0000 7f2733fff640 1 -- 172.21.15.62:0/266784557 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2844013820 con 0x55f7bb3fbe00 2024-09-10T05:36:39.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.851+0000 7f2733fff640 1 -- 172.21.15.62:0/266784557 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28440139c0 con 0x55f7bb3fbe00 2024-09-10T05:36:39.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.851+0000 7f284dee09c0 1 -- 172.21.15.62:0/266784557 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f7bb4f2820 con 0x55f7bb3fbe00 2024-09-10T05:36:39.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.851+0000 7f2733fff640 1 -- 172.21.15.62:0/266784557 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2844013ca0 con 0x55f7bb3fbe00 2024-09-10T05:36:39.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.851+0000 7f284dee09c0 1 -- 172.21.15.62:0/266784557 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7bb4f3180 con 0x55f7bb3fbe00 2024-09-10T05:36:39.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.851+0000 7f2733fff640 1 -- 172.21.15.62:0/266784557 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2844010070 con 0x55f7bb3fbe00 2024-09-10T05:36:39.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.851+0000 7f2733fff640 1 --2- 172.21.15.62:0/266784557 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2734039a70 0x7f273403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.851+0000 7f2733fff640 1 -- 172.21.15.62:0/266784557 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f2844018070 con 0x55f7bb3fbe00 2024-09-10T05:36:39.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.851+0000 7f284b1e5640 1 --2- 172.21.15.62:0/266784557 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2734039a70 0x7f273403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.851+0000 7f284dee09c0 1 --2- 172.21.15.62:0/266784557 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55f7bb3ffff0 0x55f7bb4f9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.851+0000 7f284dee09c0 1 -- 172.21.15.62:0/266784557 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb4f9690 con 0x55f7bb3ffff0 2024-09-10T05:36:39.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.851+0000 7f284c1e7640 1 --2- 172.21.15.62:0/266784557 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55f7bb3ffff0 0x55f7bb4f9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.851+0000 7f284b1e5640 1 --2- 172.21.15.62:0/266784557 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2734039a70 0x7f273403bf30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f28400ae000 tx=0x7f28400a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.851+0000 7f284c1e7640 1 --2- 172.21.15.62:0/266784557 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55f7bb3ffff0 0x55f7bb4f9150 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.851+0000 7f284c1e7640 1 -- 172.21.15.62:0/266784557 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f283c0083f0 con 0x55f7bb3ffff0 2024-09-10T05:36:39.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.851+0000 7f284dee09c0 1 --2- 172.21.15.62:0/266784557 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55f7bb4fa440 0x55f7bb4fc830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.851+0000 7f284dee09c0 1 -- 172.21.15.62:0/266784557 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb4fce60 con 0x55f7bb4fa440 2024-09-10T05:36:39.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.851+0000 7f284b9e6640 1 --2- 172.21.15.62:0/266784557 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55f7bb4fa440 0x55f7bb4fc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.851+0000 7f284b9e6640 1 --2- 172.21.15.62:0/266784557 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55f7bb4fa440 0x55f7bb4fc830 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.855+0000 7f284b9e6640 1 -- 172.21.15.62:0/266784557 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f284401b030 con 0x55f7bb4fa440 2024-09-10T05:36:39.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.855+0000 7f284dee09c0 1 --2- 172.21.15.62:0/266784557 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55f7bb4fec20 0x55f7bb501010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.855+0000 7f284dee09c0 1 -- 172.21.15.62:0/266784557 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb501700 con 0x55f7bb4fec20 2024-09-10T05:36:39.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.855+0000 7f284b1e5640 1 --2- 172.21.15.62:0/266784557 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55f7bb4fec20 0x55f7bb501010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.855+0000 7f284b1e5640 1 --2- 172.21.15.62:0/266784557 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55f7bb4fec20 0x55f7bb501010 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.855+0000 7f284b1e5640 1 -- 172.21.15.62:0/266784557 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f28400a8070 con 0x55f7bb4fec20 2024-09-10T05:36:39.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.855+0000 7f284dee09c0 1 -- 172.21.15.62:0/266784557 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb4fdac0 con 0x55f7bb4fa440 2024-09-10T05:36:39.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.855+0000 7f284b9e6640 1 -- 172.21.15.62:0/266784557 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f284401b030 con 0x55f7bb4fa440 2024-09-10T05:36:39.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.855+0000 7f284dee09c0 1 -- 172.21.15.62:0/266784557 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb4fdf20 con 0x55f7bb4fec20 2024-09-10T05:36:39.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.855+0000 7f284b1e5640 1 -- 172.21.15.62:0/266784557 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f28400a8070 con 0x55f7bb4fec20 2024-09-10T05:36:39.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.855+0000 7f284dee09c0 1 Processor -- start 2024-09-10T05:36:39.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.855+0000 7f284dee09c0 1 -- start start 2024-09-10T05:36:39.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.855+0000 7f284dee09c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7bb50fcf0 0x55f7bb510110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.855+0000 7f284dee09c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f7bb312450 con 0x55f7bb50fcf0 2024-09-10T05:36:39.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.855+0000 7f284b9e6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7bb50fcf0 0x55f7bb510110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.855+0000 7f284b9e6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7bb50fcf0 0x55f7bb510110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:48176/0 (socket says 172.21.15.62:48176) 2024-09-10T05:36:39.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.855+0000 7f284b9e6640 1 -- 172.21.15.62:0/2991528240 learned_addr learned my addr 172.21.15.62:0/2991528240 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:39.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.859+0000 7f284b9e6640 1 -- 172.21.15.62:0/2991528240 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7bb510750 con 0x55f7bb50fcf0 2024-09-10T05:36:39.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.859+0000 7f284b9e6640 1 --2- 172.21.15.62:0/2991528240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7bb50fcf0 0x55f7bb510110 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f284401d4c0 tx=0x7f2844010910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.859+0000 7f27317fa640 1 -- 172.21.15.62:0/2991528240 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2844046020 con 0x55f7bb50fcf0 2024-09-10T05:36:39.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.859+0000 7f27317fa640 1 -- 172.21.15.62:0/2991528240 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f284404ee00 con 0x55f7bb50fcf0 2024-09-10T05:36:39.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.859+0000 7f27317fa640 1 -- 172.21.15.62:0/2991528240 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2844011ab0 con 0x55f7bb50fcf0 2024-09-10T05:36:39.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.859+0000 7f284dee09c0 1 -- 172.21.15.62:0/2991528240 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f7bb510fb0 con 0x55f7bb50fcf0 2024-09-10T05:36:39.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.859+0000 7f284dee09c0 1 -- 172.21.15.62:0/2991528240 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7bb510fb0 con 0x55f7bb50fcf0 2024-09-10T05:36:39.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.859+0000 7f27317fa640 1 -- 172.21.15.62:0/2991528240 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2844049020 con 0x55f7bb50fcf0 2024-09-10T05:36:39.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.859+0000 7f27317fa640 1 --2- 172.21.15.62:0/2991528240 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2724039ac0 0x7f272403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.859+0000 7f27317fa640 1 -- 172.21.15.62:0/2991528240 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f2844051b80 con 0x55f7bb50fcf0 2024-09-10T05:36:39.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.859+0000 7f284b1e5640 1 --2- 172.21.15.62:0/2991528240 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2724039ac0 0x7f272403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.859+0000 7f284dee09c0 1 Processor -- start 2024-09-10T05:36:39.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.859+0000 7f284dee09c0 1 -- start start 2024-09-10T05:36:39.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.859+0000 7f284dee09c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7bb51d2c0 0x55f7bb51d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.859+0000 7f284dee09c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f7bb4e9190 con 0x55f7bb51d2c0 2024-09-10T05:36:39.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.859+0000 7f284b1e5640 1 --2- 172.21.15.62:0/2991528240 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2724039ac0 0x7f272403bf80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2840017f20 tx=0x7f2840005a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.859+0000 7f284b9e6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7bb51d2c0 0x55f7bb51d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.859+0000 7f284b9e6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7bb51d2c0 0x55f7bb51d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:48182/0 (socket says 172.21.15.62:48182) 2024-09-10T05:36:39.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.859+0000 7f284b9e6640 1 -- 172.21.15.62:0/658549170 learned_addr learned my addr 172.21.15.62:0/658549170 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:39.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.863+0000 7f284b9e6640 1 -- 172.21.15.62:0/658549170 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7bb51dcb0 con 0x55f7bb51d2c0 2024-09-10T05:36:39.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.863+0000 7f284b9e6640 1 --2- 172.21.15.62:0/658549170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7bb51d2c0 0x55f7bb51d6c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f284401dc20 tx=0x7f284404e220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=852982fd3c09a844 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.863+0000 7f272affd640 1 -- 172.21.15.62:0/658549170 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2844042b20 con 0x55f7bb51d2c0 2024-09-10T05:36:39.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.863+0000 7f272affd640 1 -- 172.21.15.62:0/658549170 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2844061070 con 0x55f7bb51d2c0 2024-09-10T05:36:39.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.863+0000 7f272affd640 1 -- 172.21.15.62:0/658549170 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2844028ab0 con 0x55f7bb51d2c0 2024-09-10T05:36:39.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.863+0000 7f284dee09c0 1 -- 172.21.15.62:0/658549170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7bb51d2c0 msgr2=0x55f7bb51d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.863+0000 7f284dee09c0 1 --2- 172.21.15.62:0/658549170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7bb51d2c0 0x55f7bb51d6c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f284401dc20 tx=0x7f284404e220 comp rx=0 tx=0).stop 2024-09-10T05:36:39.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.863+0000 7f284dee09c0 1 -- 172.21.15.62:0/658549170 shutdown_connections 2024-09-10T05:36:39.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.863+0000 7f284dee09c0 1 --2- 172.21.15.62:0/658549170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7bb51d2c0 0x55f7bb51d6c0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.863+0000 7f284dee09c0 1 -- 172.21.15.62:0/658549170 >> 172.21.15.62:0/658549170 conn(0x55f7bb518680 msgr2=0x55f7bb5168c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:39.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.863+0000 7f284dee09c0 1 -- 172.21.15.62:0/658549170 shutdown_connections 2024-09-10T05:36:39.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.863+0000 7f284dee09c0 1 -- 172.21.15.62:0/658549170 wait complete. 2024-09-10T05:36:39.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.863+0000 7f284dee09c0 1 Processor -- start 2024-09-10T05:36:39.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.863+0000 7f284dee09c0 1 -- start start 2024-09-10T05:36:39.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.863+0000 7f284dee09c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7bb51d2c0 0x55f7bb523500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.863+0000 7f284dee09c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f7bb51c030 con 0x55f7bb51d2c0 2024-09-10T05:36:39.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.863+0000 7f284b9e6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7bb51d2c0 0x55f7bb523500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.863+0000 7f284b9e6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7bb51d2c0 0x55f7bb523500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:48188/0 (socket says 172.21.15.62:48188) 2024-09-10T05:36:39.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.863+0000 7f284b9e6640 1 -- 172.21.15.62:0/50501071 learned_addr learned my addr 172.21.15.62:0/50501071 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:39.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.863+0000 7f284b9e6640 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7bb523a60 con 0x55f7bb51d2c0 2024-09-10T05:36:39.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.863+0000 7f284b9e6640 1 --2- 172.21.15.62:0/50501071 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7bb51d2c0 0x55f7bb523500 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f28440357e0 tx=0x7f284401dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.863+0000 7f27297fa640 1 -- 172.21.15.62:0/50501071 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2844042430 con 0x55f7bb51d2c0 2024-09-10T05:36:39.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.863+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f7bb523a60 con 0x55f7bb51d2c0 2024-09-10T05:36:39.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.863+0000 7f27297fa640 1 -- 172.21.15.62:0/50501071 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2844061070 con 0x55f7bb51d2c0 2024-09-10T05:36:39.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.863+0000 7f27297fa640 1 -- 172.21.15.62:0/50501071 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f284404a3b0 con 0x55f7bb51d2c0 2024-09-10T05:36:39.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.863+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7bb524090 con 0x55f7bb51d2c0 2024-09-10T05:36:39.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.867+0000 7f27297fa640 1 -- 172.21.15.62:0/50501071 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2844029820 con 0x55f7bb51d2c0 2024-09-10T05:36:39.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.867+0000 7f284dee09c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.867+0000 7f27297fa640 1 --2- 172.21.15.62:0/50501071 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2714039a70 0x7f271403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.867+0000 7f27297fa640 1 -- 172.21.15.62:0/50501071 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f2844053160 con 0x55f7bb51d2c0 2024-09-10T05:36:39.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.867+0000 7f284b1e5640 1 --2- 172.21.15.62:0/50501071 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2714039a70 0x7f271403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.867+0000 7f284dee09c0 1 --2- 172.21.15.62:0/50501071 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55f7bb52e490 0x55f7bb530920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.867+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb531070 con 0x55f7bb52e490 2024-09-10T05:36:39.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.867+0000 7f284c1e7640 1 --2- 172.21.15.62:0/50501071 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55f7bb52e490 0x55f7bb530920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.867+0000 7f284b1e5640 1 --2- 172.21.15.62:0/50501071 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2714039a70 0x7f271403bf30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f28400cd040 tx=0x7f28400a8000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.867+0000 7f284c1e7640 1 --2- 172.21.15.62:0/50501071 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55f7bb52e490 0x55f7bb530920 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.867+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f283c0083f0 con 0x55f7bb52e490 2024-09-10T05:36:39.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.867+0000 7f284dee09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:39.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.867+0000 7f284dee09c0 20 realm 2024-09-10T05:36:39.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.867+0000 7f284dee09c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.867+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb52d8d0 con 0x55f7bb52e490 2024-09-10T05:36:39.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.867+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f283c0083f0 con 0x55f7bb52e490 2024-09-10T05:36:39.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.867+0000 7f284dee09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:39.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.867+0000 7f284dee09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:39.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.867+0000 7f284dee09c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.867+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb531b90 con 0x55f7bb52e490 2024-09-10T05:36:39.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.867+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f283c0083f0 con 0x55f7bb52e490 2024-09-10T05:36:39.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.867+0000 7f284dee09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:39.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.867+0000 7f284dee09c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.867+0000 7f284dee09c0 1 --2- 172.21.15.62:0/50501071 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55f7bb532970 0x55f7bb534d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.867+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb535410 con 0x55f7bb532970 2024-09-10T05:36:39.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.867+0000 7f284b9e6640 1 --2- 172.21.15.62:0/50501071 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55f7bb532970 0x55f7bb534d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.867+0000 7f284b9e6640 1 --2- 172.21.15.62:0/50501071 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55f7bb532970 0x55f7bb534d60 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.871+0000 7f284b9e6640 1 -- 172.21.15.62:0/50501071 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2844058040 con 0x55f7bb532970 2024-09-10T05:36:39.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.871+0000 7f284dee09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:39.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.871+0000 7f284dee09c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.871+0000 7f284dee09c0 1 --2- 172.21.15.62:0/50501071 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55f7bb536170 0x55f7bb538560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.871+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb538cd0 con 0x55f7bb536170 2024-09-10T05:36:39.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.871+0000 7f284b1e5640 1 --2- 172.21.15.62:0/50501071 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55f7bb536170 0x55f7bb538560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.871+0000 7f284b1e5640 1 --2- 172.21.15.62:0/50501071 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55f7bb536170 0x55f7bb538560 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.871+0000 7f284b1e5640 1 -- 172.21.15.62:0/50501071 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f28400a8070 con 0x55f7bb536170 2024-09-10T05:36:39.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.871+0000 7f284dee09c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:39.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.871+0000 7f284dee09c0 20 searching for the correct realm 2024-09-10T05:36:39.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.871+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb53a5a0 con 0x55f7bb536170 2024-09-10T05:36:39.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.871+0000 7f284b1e5640 1 -- 172.21.15.62:0/50501071 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28400a8070 con 0x55f7bb536170 2024-09-10T05:36:39.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.871+0000 7f284b1e5640 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb53a5a0 con 0x55f7bb532970 2024-09-10T05:36:39.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.871+0000 7f284b9e6640 1 -- 172.21.15.62:0/50501071 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2844058040 con 0x55f7bb532970 2024-09-10T05:36:39.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.871+0000 7f284b9e6640 1 --2- 172.21.15.62:0/50501071 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f284404b020 0x7f284406b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:39.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.871+0000 7f284b9e6640 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb53a5a0 con 0x7f284404b020 2024-09-10T05:36:39.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.871+0000 7f284c1e7640 1 --2- 172.21.15.62:0/50501071 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f284404b020 0x7f284406b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:39.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.871+0000 7f284c1e7640 1 --2- 172.21.15.62:0/50501071 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f284404b020 0x7f284406b960 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:39.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.871+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f283c0083f0 con 0x7f284404b020 2024-09-10T05:36:39.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.871+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb53a5a0 con 0x55f7bb52e490 2024-09-10T05:36:39.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.871+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f283c0083f0 con 0x55f7bb52e490 2024-09-10T05:36:39.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.871+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb53a5a0 con 0x55f7bb52e490 2024-09-10T05:36:39.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.871+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f283c0083f0 con 0x55f7bb52e490 2024-09-10T05:36:39.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.871+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb53a5a0 con 0x55f7bb536170 2024-09-10T05:36:39.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.871+0000 7f284b1e5640 1 -- 172.21.15.62:0/50501071 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28400a8070 con 0x55f7bb536170 2024-09-10T05:36:39.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.871+0000 7f284b1e5640 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb53a5a0 con 0x55f7bb52e490 2024-09-10T05:36:39.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.875+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f283c0083f0 con 0x55f7bb52e490 2024-09-10T05:36:39.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.875+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb53a5a0 con 0x55f7bb532970 2024-09-10T05:36:39.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.875+0000 7f284b9e6640 1 -- 172.21.15.62:0/50501071 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2844058040 con 0x55f7bb532970 2024-09-10T05:36:39.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.875+0000 7f284b9e6640 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb53a5a0 con 0x55f7bb532970 2024-09-10T05:36:39.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.875+0000 7f284b9e6640 1 -- 172.21.15.62:0/50501071 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2844058040 con 0x55f7bb532970 2024-09-10T05:36:39.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.875+0000 7f284b9e6640 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb53a5a0 con 0x55f7bb52e490 2024-09-10T05:36:39.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.875+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f283c0083f0 con 0x55f7bb52e490 2024-09-10T05:36:39.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.875+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb53a5a0 con 0x7f284404b020 2024-09-10T05:36:39.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.875+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f283c0083f0 con 0x7f284404b020 2024-09-10T05:36:39.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.875+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb53a5a0 con 0x55f7bb52e490 2024-09-10T05:36:39.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.875+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f283c0083f0 con 0x55f7bb52e490 2024-09-10T05:36:39.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.875+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb53a5a0 con 0x7f284404b020 2024-09-10T05:36:39.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.875+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f283c0083f0 con 0x7f284404b020 2024-09-10T05:36:39.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.875+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb53a5a0 con 0x55f7bb532970 2024-09-10T05:36:39.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.875+0000 7f284b9e6640 1 -- 172.21.15.62:0/50501071 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2844058040 con 0x55f7bb532970 2024-09-10T05:36:39.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.875+0000 7f284b9e6640 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb53a5a0 con 0x55f7bb536170 2024-09-10T05:36:39.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.875+0000 7f284b1e5640 1 -- 172.21.15.62:0/50501071 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28400a8070 con 0x55f7bb536170 2024-09-10T05:36:39.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.875+0000 7f284b1e5640 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb53a5a0 con 0x55f7bb52e490 2024-09-10T05:36:39.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.875+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f283c0083f0 con 0x55f7bb52e490 2024-09-10T05:36:39.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.875+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb53a5a0 con 0x55f7bb532970 2024-09-10T05:36:39.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.879+0000 7f284b9e6640 1 -- 172.21.15.62:0/50501071 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2844058040 con 0x55f7bb532970 2024-09-10T05:36:39.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.879+0000 7f284b9e6640 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb53a5a0 con 0x55f7bb536170 2024-09-10T05:36:39.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.879+0000 7f284b1e5640 1 -- 172.21.15.62:0/50501071 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 30 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f28400a8070 con 0x55f7bb536170 2024-09-10T05:36:39.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.879+0000 7f284b1e5640 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb53a5a0 con 0x55f7bb52e490 2024-09-10T05:36:39.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.879+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f283c0083f0 con 0x55f7bb52e490 2024-09-10T05:36:39.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.879+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb53a5a0 con 0x55f7bb52e490 2024-09-10T05:36:39.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.879+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f283c0083f0 con 0x55f7bb52e490 2024-09-10T05:36:39.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.879+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb53a5a0 con 0x55f7bb52e490 2024-09-10T05:36:39.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.879+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f283c0083f0 con 0x55f7bb52e490 2024-09-10T05:36:39.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.879+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb53a5a0 con 0x55f7bb536170 2024-09-10T05:36:39.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.879+0000 7f284b1e5640 1 -- 172.21.15.62:0/50501071 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28400a8070 con 0x55f7bb536170 2024-09-10T05:36:39.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.879+0000 7f284b1e5640 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb53a5a0 con 0x7f284404b020 2024-09-10T05:36:39.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.879+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f283c0083f0 con 0x7f284404b020 2024-09-10T05:36:39.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.879+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb53a5a0 con 0x55f7bb52e490 2024-09-10T05:36:39.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.879+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f283c0083f0 con 0x55f7bb52e490 2024-09-10T05:36:39.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.879+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb53a5a0 con 0x7f284404b020 2024-09-10T05:36:39.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.879+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f283c0083f0 con 0x7f284404b020 2024-09-10T05:36:39.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.879+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb53a5a0 con 0x55f7bb536170 2024-09-10T05:36:39.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.879+0000 7f284b1e5640 1 -- 172.21.15.62:0/50501071 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28400a8070 con 0x55f7bb536170 2024-09-10T05:36:39.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.879+0000 7f284b1e5640 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb53a5a0 con 0x7f284404b020 2024-09-10T05:36:39.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.879+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f283c0083f0 con 0x7f284404b020 2024-09-10T05:36:39.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.879+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb53a5a0 con 0x55f7bb532970 2024-09-10T05:36:39.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.879+0000 7f284b9e6640 1 -- 172.21.15.62:0/50501071 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2844058040 con 0x55f7bb532970 2024-09-10T05:36:39.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.879+0000 7f284b9e6640 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2844092040 con 0x55f7bb532970 2024-09-10T05:36:39.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.883+0000 7f284b9e6640 1 -- 172.21.15.62:0/50501071 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2844058040 con 0x55f7bb532970 2024-09-10T05:36:39.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.883+0000 7f284b9e6640 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2844092040 con 0x55f7bb536170 2024-09-10T05:36:39.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.883+0000 7f284b1e5640 1 -- 172.21.15.62:0/50501071 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28400a8070 con 0x55f7bb536170 2024-09-10T05:36:39.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.883+0000 7f284b1e5640 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2844092040 con 0x55f7bb532970 2024-09-10T05:36:39.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.883+0000 7f284b9e6640 1 -- 172.21.15.62:0/50501071 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2844058040 con 0x55f7bb532970 2024-09-10T05:36:39.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.883+0000 7f284b9e6640 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2844092040 con 0x55f7bb532970 2024-09-10T05:36:39.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.883+0000 7f284b9e6640 1 -- 172.21.15.62:0/50501071 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2844058040 con 0x55f7bb532970 2024-09-10T05:36:39.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.883+0000 7f284dee09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:39.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.883+0000 7f284dee09c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:39.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.883+0000 7f284dee09c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:39.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.883+0000 7f284dee09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:39.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.883+0000 7f284dee09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:39.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.883+0000 7f284dee09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:39.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.883+0000 7f284dee09c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.883+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb539690 con 0x55f7bb52e490 2024-09-10T05:36:39.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.883+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f283c0083f0 con 0x55f7bb52e490 2024-09-10T05:36:39.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.883+0000 7f284dee09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:39.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.883+0000 7f284dee09c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.883+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb539f30 con 0x55f7bb532970 2024-09-10T05:36:39.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.883+0000 7f284b9e6640 1 -- 172.21.15.62:0/50501071 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2844058040 con 0x55f7bb532970 2024-09-10T05:36:39.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.883+0000 7f284dee09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:39.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.883+0000 7f284dee09c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.883+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb5392d0 con 0x55f7bb536170 2024-09-10T05:36:39.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.883+0000 7f284b1e5640 1 -- 172.21.15.62:0/50501071 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f28400a8070 con 0x55f7bb536170 2024-09-10T05:36:39.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.883+0000 7f284dee09c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:39.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.883+0000 7f284dee09c0 20 zone default found 2024-09-10T05:36:39.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.883+0000 7f284dee09c0 4 Realm: () 2024-09-10T05:36:39.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.883+0000 7f284dee09c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:39.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.883+0000 7f284dee09c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:39.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.883+0000 7f284dee09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:39.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.883+0000 7f284dee09c0 20 zonegroup default 2024-09-10T05:36:39.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.883+0000 7f284dee09c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.883+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb53a9d0 con 0x7f284404b020 2024-09-10T05:36:39.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.887+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f283c0083f0 con 0x7f284404b020 2024-09-10T05:36:39.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.887+0000 7f284dee09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:39.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.887+0000 7f284dee09c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.887+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb53cc90 con 0x55f7bb536170 2024-09-10T05:36:39.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.887+0000 7f284b1e5640 1 -- 172.21.15.62:0/50501071 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f28400a8070 con 0x55f7bb536170 2024-09-10T05:36:39.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.887+0000 7f284dee09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:39.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.887+0000 7f284dee09c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.887+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb53d030 con 0x55f7bb536170 2024-09-10T05:36:39.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.887+0000 7f284b1e5640 1 -- 172.21.15.62:0/50501071 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f28400a8070 con 0x55f7bb536170 2024-09-10T05:36:39.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.887+0000 7f284dee09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:39.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.887+0000 7f284dee09c0 20 started sync module instance, tier type = 2024-09-10T05:36:39.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.887+0000 7f284dee09c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:39.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.887+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb53c120 con 0x55f7bb532970 2024-09-10T05:36:39.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.887+0000 7f284b9e6640 1 -- 172.21.15.62:0/50501071 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2844058040 con 0x55f7bb532970 2024-09-10T05:36:39.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.887+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94522488112672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb53c120 con 0x55f7bb532970 2024-09-10T05:36:39.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.887+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb53da40 con 0x55f7bb52e490 2024-09-10T05:36:39.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.891+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f283c0083f0 con 0x55f7bb52e490 2024-09-10T05:36:39.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.891+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94522488116624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb53e310 con 0x55f7bb52e490 2024-09-10T05:36:39.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.891+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb53ed30 con 0x55f7bb532970 2024-09-10T05:36:39.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.891+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94522488116624] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f283c0083f0 con 0x55f7bb52e490 2024-09-10T05:36:39.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.891+0000 7f284b9e6640 1 -- 172.21.15.62:0/50501071 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94522488112672] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2844058040 con 0x55f7bb532970 2024-09-10T05:36:39.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.891+0000 7f284b9e6640 1 -- 172.21.15.62:0/50501071 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2844058040 con 0x55f7bb532970 2024-09-10T05:36:39.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.891+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94522488121376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb53de60 con 0x55f7bb532970 2024-09-10T05:36:39.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.891+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb53f5d0 con 0x7f284404b020 2024-09-10T05:36:39.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.891+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f283c0083f0 con 0x7f284404b020 2024-09-10T05:36:39.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.891+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94522488123680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb53de60 con 0x7f284404b020 2024-09-10T05:36:39.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.891+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb540070 con 0x55f7bb532970 2024-09-10T05:36:39.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.895+0000 7f284b9e6640 1 -- 172.21.15.62:0/50501071 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94522488121376] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2844058040 con 0x55f7bb532970 2024-09-10T05:36:39.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.895+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94522488123680] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f283c0083f0 con 0x7f284404b020 2024-09-10T05:36:39.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.895+0000 7f284b9e6640 1 -- 172.21.15.62:0/50501071 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2844058040 con 0x55f7bb532970 2024-09-10T05:36:39.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.895+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94522488124736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb540030 con 0x55f7bb532970 2024-09-10T05:36:39.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.895+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb540460 con 0x55f7bb536170 2024-09-10T05:36:39.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.895+0000 7f284b1e5640 1 -- 172.21.15.62:0/50501071 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28400a8070 con 0x55f7bb536170 2024-09-10T05:36:39.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.895+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94522488110192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb540460 con 0x55f7bb536170 2024-09-10T05:36:39.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.895+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb541360 con 0x55f7bb536170 2024-09-10T05:36:39.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.895+0000 7f284b9e6640 1 -- 172.21.15.62:0/50501071 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94522488124736] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2844058040 con 0x55f7bb532970 2024-09-10T05:36:39.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.895+0000 7f284b1e5640 1 -- 172.21.15.62:0/50501071 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94522488110192] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28400a8070 con 0x55f7bb536170 2024-09-10T05:36:39.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.895+0000 7f284b1e5640 1 -- 172.21.15.62:0/50501071 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28400a8070 con 0x55f7bb536170 2024-09-10T05:36:39.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.895+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94522488129616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb540e70 con 0x55f7bb536170 2024-09-10T05:36:39.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.899+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb541c00 con 0x7f284404b020 2024-09-10T05:36:39.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.899+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f283c0083f0 con 0x7f284404b020 2024-09-10T05:36:39.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.899+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94522488133456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb542020 con 0x7f284404b020 2024-09-10T05:36:39.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.899+0000 7f284dee09c0 20 add_watcher() i=0 2024-09-10T05:36:39.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.899+0000 7f284dee09c0 20 add_watcher() i=1 2024-09-10T05:36:39.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.899+0000 7f284dee09c0 20 add_watcher() i=2 2024-09-10T05:36:39.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.899+0000 7f284dee09c0 20 add_watcher() i=3 2024-09-10T05:36:39.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.899+0000 7f284dee09c0 20 add_watcher() i=4 2024-09-10T05:36:39.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.899+0000 7f284dee09c0 20 add_watcher() i=5 2024-09-10T05:36:39.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.899+0000 7f284b1e5640 1 -- 172.21.15.62:0/50501071 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94522488129616] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28400a8070 con 0x55f7bb536170 2024-09-10T05:36:39.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.899+0000 7f284dee09c0 20 add_watcher() i=6 2024-09-10T05:36:39.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.899+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94522488133456] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f283c0083f0 con 0x7f284404b020 2024-09-10T05:36:39.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.899+0000 7f284dee09c0 20 add_watcher() i=7 2024-09-10T05:36:39.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.899+0000 7f284dee09c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:39.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.899+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb544c90 con 0x55f7bb52e490 2024-09-10T05:36:39.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.899+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f283c0083f0 con 0x55f7bb52e490 2024-09-10T05:36:39.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.899+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94522488126304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb542020 con 0x55f7bb52e490 2024-09-10T05:36:39.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.903+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94522488126304] v30'156 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f283c0083f0 con 0x55f7bb52e490 2024-09-10T05:36:39.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.903+0000 7f2701fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:39.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.903+0000 7f284dee09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:39.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.903+0000 7f284dee09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:39.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.903+0000 7f284dee09c0 5 note: GC not initialized 2024-09-10T05:36:39.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.903+0000 7f2700fe1640 20 reqs_thread_entry: start 2024-09-10T05:36:39.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.903+0000 7f284dee09c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:39.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.903+0000 7f284dee09c0 20 Filter name: none 2024-09-10T05:36:39.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.903+0000 7f267a7fc640 20 reqs_thread_entry: start 2024-09-10T05:36:39.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.903+0000 7f284dee09c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T05:36:39.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.903+0000 7f284dee09c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.903+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb567f00 con 0x55f7bb52e490 2024-09-10T05:36:39.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.903+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f283c0083f0 con 0x55f7bb52e490 2024-09-10T05:36:39.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.903+0000 7f284dee09c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:36:39.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.903+0000 7f284dee09c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T05:36:39.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.903+0000 7f284dee09c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:36:39.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.903+0000 7f284dee09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:36:39.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.903+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb56a990 con 0x7f284404b020 2024-09-10T05:36:39.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.903+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f283c0083f0 con 0x7f284404b020 2024-09-10T05:36:39.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.903+0000 7f284dee09c0 20 enabling bucket name=myfoo 2024-09-10T05:36:39.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.903+0000 7f284dee09c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T05:36:39.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.903+0000 7f284dee09c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.903+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb568970 con 0x7f284404b020 2024-09-10T05:36:39.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.903+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7f283c0083f0 con 0x7f284404b020 2024-09-10T05:36:39.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.903+0000 7f284dee09c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T05:36:39.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.903+0000 7f284dee09c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-10T05:36:39.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.903+0000 7f284dee09c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T05:36:39.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.903+0000 7f284dee09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 : miss 2024-09-10T05:36:39.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.903+0000 7f284dee09c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:39.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.903+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:65 8.1f 8:fcc5c255:root::.bucket.meta.myfoo%3a475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb56b270 con 0x7f284404b020 2024-09-10T05:36:39.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.903+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(65 .bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv6 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f283c0083f0 con 0x7f284404b020 2024-09-10T05:36:39.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.903+0000 7f284dee09c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T05:36:39.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.903+0000 7f284dee09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 info.flags=0x17 2024-09-10T05:36:39.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.903+0000 7f284dee09c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 to cache LRU end 2024-09-10T05:36:39.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.903+0000 7f284dee09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:36:39.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.903+0000 7f284dee09c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T05:36:39.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.903+0000 7f284dee09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 2024-09-10T05:36:39.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.903+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:66 8.1f 8:fcc5c255:root::.bucket.meta.myfoo%3a475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb572ac0 con 0x7f284404b020 2024-09-10T05:36:39.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.907+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 <== osd.2 v2:172.21.15.62:6800/2677868286 15 ==== osd_op_reply(66 .bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v30'7 uv7 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f283c0083f0 con 0x7f284404b020 2024-09-10T05:36:39.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.907+0000 7f284dee09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 info.flags=0x17 2024-09-10T05:36:39.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.907+0000 7f284dee09c0 10 moving default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 to cache LRU end 2024-09-10T05:36:39.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.907+0000 7f284dee09c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T05:36:39.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.907+0000 7f284dee09c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1, ofs0, ns] 2024-09-10T05:36:39.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.907+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94522488305904 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb571880 con 0x55f7bb536170 2024-09-10T05:36:39.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.907+0000 7f284b1e5640 1 -- 172.21.15.62:0/50501071 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== watch-notify(notify (1) cookie 94522488110192 notify 128849018896 ret 0) ==== 802+0+0 (crc 0 0 0) 0x7f28400e6040 con 0x55f7bb536170 2024-09-10T05:36:39.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.907+0000 7f272affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018896 cookie 94522488110192 notifier 4598 bl.length()=760 2024-09-10T05:36:39.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.907+0000 7f272affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 info.flags=0x17 2024-09-10T05:36:39.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.907+0000 7f272affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1 to cache LRU end 2024-09-10T05:36:39.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.907+0000 7f272affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T05:36:39.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.907+0000 7f284b1e5640 1 -- 172.21.15.62:0/50501071 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(67 notify.5 [notify cookie 94522488305904 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f28400a8070 con 0x55f7bb536170 2024-09-10T05:36:39.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.907+0000 7f272affd640 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f2710003eb0 con 0x55f7bb536170 2024-09-10T05:36:39.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.907+0000 7f284b1e5640 1 -- 172.21.15.62:0/50501071 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28400a8070 con 0x55f7bb536170 2024-09-10T05:36:39.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.907+0000 7f284b1e5640 1 -- 172.21.15.62:0/50501071 <== osd.3 v2:172.21.15.62:6816/2708991149 19 ==== watch-notify(notify_complete (2) cookie 94522488305904 notify 128849018896 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f7bb2a5ca0 con 0x55f7bb536170 2024-09-10T05:36:39.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.907+0000 7f284dee09c0 20 handle_bi_update(): bucket=:myfoo[475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1]): orig_sources= new_sources= 2024-09-10T05:36:39.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.907+0000 7f284dee09c0 20 handle_bi_update(): bucket=:myfoo[475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1]): potential sources added=[] removed=[] 2024-09-10T05:36:39.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.907+0000 7f284dee09c0 20 handle_bi_update(): bucket=:myfoo[475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1]): orig_dests= new_dests= 2024-09-10T05:36:39.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.907+0000 7f284dee09c0 20 handle_bi_update(): bucket=:myfoo[475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1]): potential dests added=[] removed=[] 2024-09-10T05:36:39.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.907+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb56b8f0 con 0x55f7bb52e490 2024-09-10T05:36:39.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.907+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v30'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f283c0083f0 con 0x55f7bb52e490 2024-09-10T05:36:39.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.907+0000 7f284dee09c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:36:39.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.907+0000 7f284dee09c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:36:39.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.907+0000 7f284dee09c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T05:36:39.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.907+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94522488305904 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb571880 con 0x55f7bb532970 2024-09-10T05:36:39.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.911+0000 7f284b9e6640 1 -- 172.21.15.62:0/50501071 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== watch-notify(notify (1) cookie 94522488124736 notify 128849018913 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55f7bb510750 con 0x55f7bb532970 2024-09-10T05:36:39.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.911+0000 7f272affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018913 cookie 94522488124736 notifier 4598 bl.length()=567 2024-09-10T05:36:39.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.911+0000 7f272affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:36:39.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.911+0000 7f272affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:36:39.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.911+0000 7f284b9e6640 1 -- 172.21.15.62:0/50501071 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(70 notify.4 [notify cookie 94522488305904 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2844058040 con 0x55f7bb532970 2024-09-10T05:36:39.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.911+0000 7f272affd640 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f2710003eb0 con 0x55f7bb532970 2024-09-10T05:36:39.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.911+0000 7f284b9e6640 1 -- 172.21.15.62:0/50501071 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== watch-notify(notify_complete (2) cookie 94522488305904 notify 128849018913 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f284403b040 con 0x55f7bb532970 2024-09-10T05:36:39.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.911+0000 7f284b9e6640 1 -- 172.21.15.62:0/50501071 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2844058040 con 0x55f7bb532970 2024-09-10T05:36:39.915 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T05:36:30.893777Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:36:30.893760Z","tags":[],"group_ids":[]} 2024-09-10T05:36:39.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.911+0000 7f2701fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:39.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.911+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94522488126304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb565ce0 con 0x55f7bb52e490 2024-09-10T05:36:39.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.915+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94522488126304] v30'157 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f283c0083f0 con 0x55f7bb52e490 2024-09-10T05:36:39.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.915+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94522488112672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb565ce0 con 0x55f7bb532970 2024-09-10T05:36:39.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.915+0000 7f284b9e6640 1 -- 172.21.15.62:0/50501071 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94522488112672] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2844058040 con 0x55f7bb532970 2024-09-10T05:36:39.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.915+0000 7f284dee09c0 20 remove_watcher() i=0 2024-09-10T05:36:39.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.915+0000 7f284dee09c0 2 removed watcher, disabling cache 2024-09-10T05:36:39.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.915+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94522488116624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb53c620 con 0x55f7bb52e490 2024-09-10T05:36:39.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.915+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94522488116624] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f283c0083f0 con 0x55f7bb52e490 2024-09-10T05:36:39.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.915+0000 7f284dee09c0 20 remove_watcher() i=1 2024-09-10T05:36:39.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.915+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94522488121376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb565ce0 con 0x55f7bb532970 2024-09-10T05:36:39.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.919+0000 7f284b9e6640 1 -- 172.21.15.62:0/50501071 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94522488121376] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2844058040 con 0x55f7bb532970 2024-09-10T05:36:39.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.919+0000 7f284dee09c0 20 remove_watcher() i=2 2024-09-10T05:36:39.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.919+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94522488123680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb53c620 con 0x7f284404b020 2024-09-10T05:36:39.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.919+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 <== osd.2 v2:172.21.15.62:6800/2677868286 16 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94522488123680] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f283c0083f0 con 0x7f284404b020 2024-09-10T05:36:39.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.919+0000 7f284dee09c0 20 remove_watcher() i=3 2024-09-10T05:36:39.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.919+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94522488124736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb53e820 con 0x55f7bb532970 2024-09-10T05:36:39.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.923+0000 7f284b9e6640 1 -- 172.21.15.62:0/50501071 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94522488124736] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2844058040 con 0x55f7bb532970 2024-09-10T05:36:39.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.923+0000 7f284dee09c0 20 remove_watcher() i=4 2024-09-10T05:36:39.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.923+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94522488110192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb53f5d0 con 0x55f7bb536170 2024-09-10T05:36:39.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.923+0000 7f284b1e5640 1 -- 172.21.15.62:0/50501071 <== osd.3 v2:172.21.15.62:6816/2708991149 20 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94522488110192] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28400a8070 con 0x55f7bb536170 2024-09-10T05:36:39.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.923+0000 7f284dee09c0 20 remove_watcher() i=5 2024-09-10T05:36:39.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.923+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94522488129616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb565ce0 con 0x55f7bb536170 2024-09-10T05:36:39.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.923+0000 7f284b1e5640 1 -- 172.21.15.62:0/50501071 <== osd.3 v2:172.21.15.62:6816/2708991149 21 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94522488129616] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28400a8070 con 0x55f7bb536170 2024-09-10T05:36:39.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.923+0000 7f284dee09c0 20 remove_watcher() i=6 2024-09-10T05:36:39.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.923+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94522488133456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7bb53c620 con 0x7f284404b020 2024-09-10T05:36:39.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.923+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 <== osd.2 v2:172.21.15.62:6800/2677868286 17 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94522488133456] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f283c0083f0 con 0x7f284404b020 2024-09-10T05:36:39.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.923+0000 7f284dee09c0 20 remove_watcher() i=7 2024-09-10T05:36:39.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.923+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55f7bb532970 msgr2=0x55f7bb534d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.923+0000 7f284dee09c0 1 --2- 172.21.15.62:0/50501071 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55f7bb532970 0x55f7bb534d60 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.923+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55f7bb52e490 msgr2=0x55f7bb530920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.923+0000 7f284dee09c0 1 --2- 172.21.15.62:0/50501071 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55f7bb52e490 0x55f7bb530920 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.923+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f284404b020 msgr2=0x7f284406b960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.923+0000 7f284dee09c0 1 --2- 172.21.15.62:0/50501071 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f284404b020 0x7f284406b960 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.923+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55f7bb536170 msgr2=0x55f7bb538560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.923+0000 7f284dee09c0 1 --2- 172.21.15.62:0/50501071 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55f7bb536170 0x55f7bb538560 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.927+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2714039a70 msgr2=0x7f271403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.927+0000 7f284dee09c0 1 --2- 172.21.15.62:0/50501071 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2714039a70 0x7f271403bf30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f28400cd040 tx=0x7f28400a8000 comp rx=0 tx=0).stop 2024-09-10T05:36:39.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.927+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7bb51d2c0 msgr2=0x55f7bb523500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.927+0000 7f284c1e7640 1 -- 172.21.15.62:0/50501071 reap_dead start 2024-09-10T05:36:39.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.927+0000 7f284dee09c0 1 --2- 172.21.15.62:0/50501071 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7bb51d2c0 0x55f7bb523500 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f28440357e0 tx=0x7f284401dbb0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.927+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 shutdown_connections 2024-09-10T05:36:39.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.927+0000 7f284dee09c0 1 --2- 172.21.15.62:0/50501071 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7bb51d2c0 0x55f7bb523500 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.927+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 >> 172.21.15.62:0/50501071 conn(0x55f7bb518680 msgr2=0x55f7bb516890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:39.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.927+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 shutdown_connections 2024-09-10T05:36:39.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.927+0000 7f284dee09c0 1 -- 172.21.15.62:0/50501071 wait complete. 2024-09-10T05:36:39.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.927+0000 7f284dee09c0 1 -- 172.21.15.62:0/2991528240 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2724039ac0 msgr2=0x7f272403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.927+0000 7f284dee09c0 1 --2- 172.21.15.62:0/2991528240 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2724039ac0 0x7f272403bf80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2840017f20 tx=0x7f2840005a10 comp rx=0 tx=0).stop 2024-09-10T05:36:39.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.927+0000 7f284dee09c0 1 -- 172.21.15.62:0/2991528240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7bb50fcf0 msgr2=0x55f7bb510110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.927+0000 7f284dee09c0 1 --2- 172.21.15.62:0/2991528240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7bb50fcf0 0x55f7bb510110 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f284401d4c0 tx=0x7f2844010910 comp rx=0 tx=0).stop 2024-09-10T05:36:39.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.927+0000 7f284dee09c0 1 -- 172.21.15.62:0/2991528240 shutdown_connections 2024-09-10T05:36:39.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.927+0000 7f284dee09c0 1 --2- 172.21.15.62:0/2991528240 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2724039ac0 0x7f272403bf80 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.927+0000 7f284dee09c0 1 --2- 172.21.15.62:0/2991528240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7bb50fcf0 0x55f7bb510110 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.927+0000 7f284dee09c0 1 -- 172.21.15.62:0/2991528240 >> 172.21.15.62:0/2991528240 conn(0x55f7bb5056a0 msgr2=0x55f7bb505a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:39.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.927+0000 7f284dee09c0 1 -- 172.21.15.62:0/2991528240 shutdown_connections 2024-09-10T05:36:39.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.927+0000 7f284dee09c0 1 -- 172.21.15.62:0/2991528240 wait complete. 2024-09-10T05:36:39.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.927+0000 7f284dee09c0 1 -- 172.21.15.62:0/266784557 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55f7bb4fa440 msgr2=0x55f7bb4fc830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.927+0000 7f284dee09c0 1 --2- 172.21.15.62:0/266784557 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55f7bb4fa440 0x55f7bb4fc830 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.927+0000 7f284dee09c0 1 -- 172.21.15.62:0/266784557 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55f7bb3ffff0 msgr2=0x55f7bb4f9150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.927+0000 7f284dee09c0 1 --2- 172.21.15.62:0/266784557 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55f7bb3ffff0 0x55f7bb4f9150 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.927+0000 7f284dee09c0 1 -- 172.21.15.62:0/266784557 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55f7bb4fec20 msgr2=0x55f7bb501010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.927+0000 7f284dee09c0 1 --2- 172.21.15.62:0/266784557 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55f7bb4fec20 0x55f7bb501010 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:39.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.927+0000 7f284dee09c0 1 -- 172.21.15.62:0/266784557 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2734039a70 msgr2=0x7f273403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.927+0000 7f284dee09c0 1 --2- 172.21.15.62:0/266784557 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2734039a70 0x7f273403bf30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f28400ae000 tx=0x7f28400a6000 comp rx=0 tx=0).stop 2024-09-10T05:36:39.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.927+0000 7f284dee09c0 1 -- 172.21.15.62:0/266784557 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7bb3fbe00 msgr2=0x55f7bb4f2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:39.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.927+0000 7f284dee09c0 1 --2- 172.21.15.62:0/266784557 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f7bb3fbe00 0x55f7bb4f2030 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f28440012f0 tx=0x7f2844000f50 comp rx=0 tx=0).stop 2024-09-10T05:36:39.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.927+0000 7f284c1e7640 1 -- 172.21.15.62:0/266784557 reap_dead start 2024-09-10T05:36:39.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.927+0000 7f284dee09c0 1 -- 172.21.15.62:0/266784557 shutdown_connections 2024-09-10T05:36:39.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.927+0000 7f284dee09c0 1 -- 172.21.15.62:0/266784557 >> 172.21.15.62:0/266784557 conn(0x55f7bb3f7920 msgr2=0x55f7bb4e7980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:39.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.927+0000 7f284dee09c0 1 -- 172.21.15.62:0/266784557 shutdown_connections 2024-09-10T05:36:39.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:39.927+0000 7f284dee09c0 1 -- 172.21.15.62:0/266784557 wait complete. 2024-09-10T05:36:39.939 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T05:36:30.893777Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:36:30.893760Z', 'tags': [], 'group_ids': []} 2024-09-10T05:36:39.948 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-10T05:36:40.285 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2024-09-10T05:36:40.301 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T05:36:55.302 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-10T05:36:55.302 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-10T05:36:55.302 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-10T05:36:55.343 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:55.343 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:55.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.339+0000 7fc7ca2d49c0 1 Processor -- start 2024-09-10T05:36:55.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.339+0000 7fc7ca2d49c0 1 -- start start 2024-09-10T05:36:55.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.343+0000 7fc7ca2d49c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55a28d471350 0x55a28d473740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:55.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.343+0000 7fc7ca2d49c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a28d31f9c0 con 0x55a28d46d200 2024-09-10T05:36:55.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.343+0000 7fc7ca2d49c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x55a28d36f6d0 con 0x55a28d471350 2024-09-10T05:36:55.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.343+0000 7fc7c75d9640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55a28d471350 0x55a28d473740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:55.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.343+0000 7fc7c75d9640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55a28d471350 0x55a28d473740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47736/0 (socket says 172.21.15.62:47736) 2024-09-10T05:36:55.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.343+0000 7fc7c7dda640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x55a28d46d200 0x55a28d46d5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:58324/0 (socket says 172.21.15.62:58324) 2024-09-10T05:36:55.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.343+0000 7fc7c75d9640 1 -- 172.21.15.62:0/2045035101 learned_addr learned my addr 172.21.15.62:0/2045035101 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:55.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.343+0000 7fc7c75d9640 1 -- 172.21.15.62:0/2045035101 >> v1:172.21.15.2:6789/0 conn(0x55a28d46d200 legacy=0x55a28d46d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:55.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.343+0000 7fc7c75d9640 1 -- 172.21.15.62:0/2045035101 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a28d313ca0 con 0x55a28d471350 2024-09-10T05:36:55.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.347+0000 7fc7c75d9640 1 --2- 172.21.15.62:0/2045035101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a28d471350 0x55a28d473740 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc00a4e0 tx=0x7fc7bc01b120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf9251735ffd0b4b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:55.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.347+0000 7fc7c6dd8640 1 -- 172.21.15.62:0/2045035101 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7bc0aa540 con 0x55a28d471350 2024-09-10T05:36:55.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.347+0000 7fc7c6dd8640 1 -- 172.21.15.62:0/2045035101 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7bc0aa6e0 con 0x55a28d471350 2024-09-10T05:36:55.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.347+0000 7fc7c6dd8640 1 -- 172.21.15.62:0/2045035101 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7bc0aaa40 con 0x55a28d471350 2024-09-10T05:36:55.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.347+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/2045035101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a28d471350 msgr2=0x55a28d473740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:55.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.347+0000 7fc7ca2d49c0 1 --2- 172.21.15.62:0/2045035101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a28d471350 0x55a28d473740 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc00a4e0 tx=0x7fc7bc01b120 comp rx=0 tx=0).stop 2024-09-10T05:36:55.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.347+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/2045035101 shutdown_connections 2024-09-10T05:36:55.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.347+0000 7fc7ca2d49c0 1 --2- 172.21.15.62:0/2045035101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a28d471350 0x55a28d473740 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:55.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.347+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/2045035101 >> 172.21.15.62:0/2045035101 conn(0x55a28d3e0b10 msgr2=0x55a28d3e0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:55.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.347+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/2045035101 shutdown_connections 2024-09-10T05:36:55.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.347+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/2045035101 wait complete. 2024-09-10T05:36:55.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.363+0000 7fc7ca2d49c0 1 Processor -- start 2024-09-10T05:36:55.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.363+0000 7fc7ca2d49c0 1 -- start start 2024-09-10T05:36:55.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.363+0000 7fc7ca2d49c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a28d46d200 0x55a28d558a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:55.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.363+0000 7fc7ca2d49c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a28d373680 con 0x55a28d46d200 2024-09-10T05:36:55.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.363+0000 7fc7c7dda640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a28d46d200 0x55a28d558a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:55.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.363+0000 7fc7c7dda640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a28d46d200 0x55a28d558a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47742/0 (socket says 172.21.15.62:47742) 2024-09-10T05:36:55.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.363+0000 7fc7c7dda640 1 -- 172.21.15.62:0/2318420719 learned_addr learned my addr 172.21.15.62:0/2318420719 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:55.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.363+0000 7fc7c7dda640 1 -- 172.21.15.62:0/2318420719 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a28d2eeda0 con 0x55a28d46d200 2024-09-10T05:36:55.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.367+0000 7fc7c7dda640 1 --2- 172.21.15.62:0/2318420719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a28d46d200 0x55a28d558a50 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8001ec0 tx=0x7fc7b800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70bfe2704858c1eb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:55.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.367+0000 7fc6b5e0b640 1 -- 172.21.15.62:0/2318420719 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7b800e5d0 con 0x55a28d46d200 2024-09-10T05:36:55.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.367+0000 7fc6b5e0b640 1 -- 172.21.15.62:0/2318420719 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7b800e770 con 0x55a28d46d200 2024-09-10T05:36:55.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.367+0000 7fc6b5e0b640 1 -- 172.21.15.62:0/2318420719 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7b800ea70 con 0x55a28d46d200 2024-09-10T05:36:55.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.367+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/2318420719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a28d46d200 msgr2=0x55a28d558a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:55.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.367+0000 7fc7ca2d49c0 1 --2- 172.21.15.62:0/2318420719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a28d46d200 0x55a28d558a50 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8001ec0 tx=0x7fc7b800b6d0 comp rx=0 tx=0).stop 2024-09-10T05:36:55.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.367+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/2318420719 shutdown_connections 2024-09-10T05:36:55.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.367+0000 7fc7ca2d49c0 1 --2- 172.21.15.62:0/2318420719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a28d46d200 0x55a28d558a50 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:55.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.367+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/2318420719 >> 172.21.15.62:0/2318420719 conn(0x55a28d3e0b10 msgr2=0x55a28d5545f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:55.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.367+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/2318420719 shutdown_connections 2024-09-10T05:36:55.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.367+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/2318420719 wait complete. 2024-09-10T05:36:55.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.367+0000 7fc7ca2d49c0 1 Processor -- start 2024-09-10T05:36:55.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.367+0000 7fc7ca2d49c0 1 -- start start 2024-09-10T05:36:55.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.367+0000 7fc7ca2d49c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a28d46d200 0x55a28d5600f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:55.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.367+0000 7fc7ca2d49c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a28d315a50 con 0x55a28d46d200 2024-09-10T05:36:55.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.367+0000 7fc7c7dda640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a28d46d200 0x55a28d5600f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:55.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.367+0000 7fc7c7dda640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a28d46d200 0x55a28d5600f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47750/0 (socket says 172.21.15.62:47750) 2024-09-10T05:36:55.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.367+0000 7fc7c7dda640 1 -- 172.21.15.62:0/2917629625 learned_addr learned my addr 172.21.15.62:0/2917629625 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:55.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.367+0000 7fc7c7dda640 1 -- 172.21.15.62:0/2917629625 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a28d560650 con 0x55a28d46d200 2024-09-10T05:36:55.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.367+0000 7fc7c7dda640 1 --2- 172.21.15.62:0/2917629625 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a28d46d200 0x55a28d5600f0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x55a28d5599e0 tx=0x7fc7b8000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:55.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.367+0000 7fc6affff640 1 -- 172.21.15.62:0/2917629625 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7b800f8e0 con 0x55a28d46d200 2024-09-10T05:36:55.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.367+0000 7fc6affff640 1 -- 172.21.15.62:0/2917629625 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7b800fa80 con 0x55a28d46d200 2024-09-10T05:36:55.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.367+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/2917629625 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a28d5608e0 con 0x55a28d46d200 2024-09-10T05:36:55.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.367+0000 7fc6affff640 1 -- 172.21.15.62:0/2917629625 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7b800fda0 con 0x55a28d46d200 2024-09-10T05:36:55.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.367+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/2917629625 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a28d561290 con 0x55a28d46d200 2024-09-10T05:36:55.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.371+0000 7fc6affff640 1 -- 172.21.15.62:0/2917629625 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc7b8017070 con 0x55a28d46d200 2024-09-10T05:36:55.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.371+0000 7fc6affff640 1 --2- 172.21.15.62:0/2917629625 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc6b0039a70 0x7fc6b003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:55.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.371+0000 7fc6affff640 1 -- 172.21.15.62:0/2917629625 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7fc7b8015020 con 0x55a28d46d200 2024-09-10T05:36:55.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.371+0000 7fc7c75d9640 1 --2- 172.21.15.62:0/2917629625 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc6b0039a70 0x7fc6b003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:55.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.371+0000 7fc7ca2d49c0 1 --2- 172.21.15.62:0/2917629625 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55a28d565250 0x55a28d567640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:55.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.371+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/2917629625 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d567b80 con 0x55a28d565250 2024-09-10T05:36:55.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.371+0000 7fc7c85db640 1 --2- 172.21.15.62:0/2917629625 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55a28d565250 0x55a28d567640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:55.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.371+0000 7fc7c75d9640 1 --2- 172.21.15.62:0/2917629625 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc6b0039a70 0x7fc6b003bf30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc0ab000 tx=0x7fc7bc0a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:55.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.371+0000 7fc7c85db640 1 --2- 172.21.15.62:0/2917629625 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55a28d565250 0x55a28d567640 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:55.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.371+0000 7fc7c85db640 1 -- 172.21.15.62:0/2917629625 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc7c00083f0 con 0x55a28d565250 2024-09-10T05:36:55.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.371+0000 7fc7ca2d49c0 1 --2- 172.21.15.62:0/2917629625 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55a28d568930 0x55a28d56ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:55.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.371+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/2917629625 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d56b330 con 0x55a28d568930 2024-09-10T05:36:55.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.371+0000 7fc7c7dda640 1 --2- 172.21.15.62:0/2917629625 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55a28d568930 0x55a28d56ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:55.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.371+0000 7fc7c7dda640 1 --2- 172.21.15.62:0/2917629625 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55a28d568930 0x55a28d56ad20 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:55.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.375+0000 7fc7c7dda640 1 -- 172.21.15.62:0/2917629625 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc7b802e070 con 0x55a28d568930 2024-09-10T05:36:55.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.375+0000 7fc7ca2d49c0 1 --2- 172.21.15.62:0/2917629625 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55a28d56d0f0 0x55a28d56f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:55.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.375+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/2917629625 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d56fbd0 con 0x55a28d56d0f0 2024-09-10T05:36:55.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.375+0000 7fc7c75d9640 1 --2- 172.21.15.62:0/2917629625 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55a28d56d0f0 0x55a28d56f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:55.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.375+0000 7fc7c75d9640 1 --2- 172.21.15.62:0/2917629625 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55a28d56d0f0 0x55a28d56f4e0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:55.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.375+0000 7fc7c75d9640 1 -- 172.21.15.62:0/2917629625 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc7bc0bc040 con 0x55a28d56d0f0 2024-09-10T05:36:55.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.375+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/2917629625 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d56bfc0 con 0x55a28d568930 2024-09-10T05:36:55.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.375+0000 7fc7c7dda640 1 -- 172.21.15.62:0/2917629625 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc7b802e070 con 0x55a28d568930 2024-09-10T05:36:55.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.375+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/2917629625 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d56c3e0 con 0x55a28d56d0f0 2024-09-10T05:36:55.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.375+0000 7fc7c75d9640 1 -- 172.21.15.62:0/2917629625 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc7bc0bc040 con 0x55a28d56d0f0 2024-09-10T05:36:55.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.375+0000 7fc7ca2d49c0 1 Processor -- start 2024-09-10T05:36:55.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.375+0000 7fc7ca2d49c0 1 -- start start 2024-09-10T05:36:55.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.375+0000 7fc7ca2d49c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a28d57e150 0x55a28d57e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:55.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.375+0000 7fc7ca2d49c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a28d380450 con 0x55a28d57e150 2024-09-10T05:36:55.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.375+0000 7fc7c7dda640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a28d57e150 0x55a28d57e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:55.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.379+0000 7fc7c7dda640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a28d57e150 0x55a28d57e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47762/0 (socket says 172.21.15.62:47762) 2024-09-10T05:36:55.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.379+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3338610623 learned_addr learned my addr 172.21.15.62:0/3338610623 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:55.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.379+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3338610623 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a28d57ebb0 con 0x55a28d57e150 2024-09-10T05:36:55.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.379+0000 7fc7c7dda640 1 --2- 172.21.15.62:0/3338610623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a28d57e150 0x55a28d57e570 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8017cd0 tx=0x7fc7b8019e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:55.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.379+0000 7fc6ad7fa640 1 -- 172.21.15.62:0/3338610623 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7b801be20 con 0x55a28d57e150 2024-09-10T05:36:55.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.379+0000 7fc6ad7fa640 1 -- 172.21.15.62:0/3338610623 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7b801b3d0 con 0x55a28d57e150 2024-09-10T05:36:55.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.379+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3338610623 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a28d57f410 con 0x55a28d57e150 2024-09-10T05:36:55.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.379+0000 7fc6ad7fa640 1 -- 172.21.15.62:0/3338610623 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7b80193e0 con 0x55a28d57e150 2024-09-10T05:36:55.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.379+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3338610623 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a28d57f410 con 0x55a28d57e150 2024-09-10T05:36:55.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.379+0000 7fc6ad7fa640 1 -- 172.21.15.62:0/3338610623 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc7b8019580 con 0x55a28d57e150 2024-09-10T05:36:55.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.379+0000 7fc6ad7fa640 1 --2- 172.21.15.62:0/3338610623 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc6a0039a70 0x7fc6a003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:55.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.379+0000 7fc6ad7fa640 1 -- 172.21.15.62:0/3338610623 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7fc7b8037070 con 0x55a28d57e150 2024-09-10T05:36:55.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.379+0000 7fc7c75d9640 1 --2- 172.21.15.62:0/3338610623 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc6a0039a70 0x7fc6a003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:55.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.379+0000 7fc7ca2d49c0 1 Processor -- start 2024-09-10T05:36:55.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.379+0000 7fc7ca2d49c0 1 -- start start 2024-09-10T05:36:55.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.379+0000 7fc7c75d9640 1 --2- 172.21.15.62:0/3338610623 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc6a0039a70 0x7fc6a003bf30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x55a28d561540 tx=0x7fc7bc005e50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:55.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.379+0000 7fc7ca2d49c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a28d58a780 0x55a28d58ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:55.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.379+0000 7fc7ca2d49c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a28d5592a0 con 0x55a28d58a780 2024-09-10T05:36:55.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.383+0000 7fc7c7dda640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a28d58a780 0x55a28d58ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:55.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.383+0000 7fc7c7dda640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a28d58a780 0x55a28d58ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47778/0 (socket says 172.21.15.62:47778) 2024-09-10T05:36:55.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.383+0000 7fc7c7dda640 1 -- 172.21.15.62:0/1181527419 learned_addr learned my addr 172.21.15.62:0/1181527419 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:55.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.383+0000 7fc7c7dda640 1 -- 172.21.15.62:0/1181527419 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a28d58b130 con 0x55a28d58a780 2024-09-10T05:36:55.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.383+0000 7fc7c7dda640 1 --2- 172.21.15.62:0/1181527419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a28d58a780 0x55a28d58ab60 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc7b804ffd0 tx=0x7fc7b804f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=390d83f968719071 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:55.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.383+0000 7fc6a6ffd640 1 -- 172.21.15.62:0/1181527419 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7b805d020 con 0x55a28d58a780 2024-09-10T05:36:55.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.383+0000 7fc6a6ffd640 1 -- 172.21.15.62:0/1181527419 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7b8019870 con 0x55a28d58a780 2024-09-10T05:36:55.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.383+0000 7fc6a6ffd640 1 -- 172.21.15.62:0/1181527419 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7b8027e00 con 0x55a28d58a780 2024-09-10T05:36:55.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.383+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/1181527419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a28d58a780 msgr2=0x55a28d58ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:55.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.383+0000 7fc7ca2d49c0 1 --2- 172.21.15.62:0/1181527419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a28d58a780 0x55a28d58ab60 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc7b804ffd0 tx=0x7fc7b804f110 comp rx=0 tx=0).stop 2024-09-10T05:36:55.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.383+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/1181527419 shutdown_connections 2024-09-10T05:36:55.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.383+0000 7fc7ca2d49c0 1 --2- 172.21.15.62:0/1181527419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a28d58a780 0x55a28d58ab60 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:55.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.383+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/1181527419 >> 172.21.15.62:0/1181527419 conn(0x55a28d586bb0 msgr2=0x55a28d584df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:55.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.383+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/1181527419 shutdown_connections 2024-09-10T05:36:55.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.383+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/1181527419 wait complete. 2024-09-10T05:36:55.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.383+0000 7fc7ca2d49c0 1 Processor -- start 2024-09-10T05:36:55.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.383+0000 7fc7ca2d49c0 1 -- start start 2024-09-10T05:36:55.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.383+0000 7fc7ca2d49c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a28d58a780 0x55a28d591ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:55.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.383+0000 7fc7ca2d49c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a28d58b610 con 0x55a28d58a780 2024-09-10T05:36:55.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.383+0000 7fc7c7dda640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a28d58a780 0x55a28d591ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:55.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.383+0000 7fc7c7dda640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a28d58a780 0x55a28d591ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47788/0 (socket says 172.21.15.62:47788) 2024-09-10T05:36:55.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.383+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 learned_addr learned my addr 172.21.15.62:0/3970579277 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:55.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.383+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a28d592040 con 0x55a28d58a780 2024-09-10T05:36:55.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.383+0000 7fc7c7dda640 1 --2- 172.21.15.62:0/3970579277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a28d58a780 0x55a28d591ae0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8048230 tx=0x7fc7b8033ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:55.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.383+0000 7fc6a57fa640 1 -- 172.21.15.62:0/3970579277 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7b8072070 con 0x55a28d58a780 2024-09-10T05:36:55.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.383+0000 7fc6a57fa640 1 -- 172.21.15.62:0/3970579277 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7b8019870 con 0x55a28d58a780 2024-09-10T05:36:55.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.383+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a28d592040 con 0x55a28d58a780 2024-09-10T05:36:55.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.383+0000 7fc6a57fa640 1 -- 172.21.15.62:0/3970579277 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7b8027e00 con 0x55a28d58a780 2024-09-10T05:36:55.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.383+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a28d592040 con 0x55a28d58a780 2024-09-10T05:36:55.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.387+0000 7fc7ca2d49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:55.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.387+0000 7fc6a57fa640 1 -- 172.21.15.62:0/3970579277 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc7b8075070 con 0x55a28d58a780 2024-09-10T05:36:55.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.387+0000 7fc6a57fa640 1 --2- 172.21.15.62:0/3970579277 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc6900399d0 0x7fc69003be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:55.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.387+0000 7fc6a57fa640 1 -- 172.21.15.62:0/3970579277 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7fc7b8069030 con 0x55a28d58a780 2024-09-10T05:36:55.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.387+0000 7fc7c75d9640 1 --2- 172.21.15.62:0/3970579277 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc6900399d0 0x7fc69003be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:55.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.387+0000 7fc7ca2d49c0 1 --2- 172.21.15.62:0/3970579277 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55a28d59ca10 0x55a28d59eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:55.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.387+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d59f5f0 con 0x55a28d59ca10 2024-09-10T05:36:55.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.387+0000 7fc7c85db640 1 --2- 172.21.15.62:0/3970579277 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55a28d59ca10 0x55a28d59eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:55.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.387+0000 7fc7c75d9640 1 --2- 172.21.15.62:0/3970579277 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc6900399d0 0x7fc69003be90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc0aa620 tx=0x7fc7bc0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:55.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.387+0000 7fc7c85db640 1 --2- 172.21.15.62:0/3970579277 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55a28d59ca10 0x55a28d59eea0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:55.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.387+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc7c00083f0 con 0x55a28d59ca10 2024-09-10T05:36:55.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.387+0000 7fc7ca2d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:55.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.387+0000 7fc7ca2d49c0 20 realm 2024-09-10T05:36:55.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.387+0000 7fc7ca2d49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:55.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.387+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d59be00 con 0x55a28d59ca10 2024-09-10T05:36:55.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.387+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc7c00083f0 con 0x55a28d59ca10 2024-09-10T05:36:55.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.387+0000 7fc7ca2d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:55.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.387+0000 7fc7ca2d49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:55.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.387+0000 7fc7ca2d49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:55.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.387+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5a00b0 con 0x55a28d59ca10 2024-09-10T05:36:55.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.387+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc7c00083f0 con 0x55a28d59ca10 2024-09-10T05:36:55.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.387+0000 7fc7ca2d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:55.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.387+0000 7fc7ca2d49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:55.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.387+0000 7fc7ca2d49c0 1 --2- 172.21.15.62:0/3970579277 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55a28d5a0e90 0x55a28d5a3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:55.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.387+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5a3910 con 0x55a28d5a0e90 2024-09-10T05:36:55.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.387+0000 7fc7c7dda640 1 --2- 172.21.15.62:0/3970579277 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55a28d5a0e90 0x55a28d5a3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:55.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.391+0000 7fc7c7dda640 1 --2- 172.21.15.62:0/3970579277 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55a28d5a0e90 0x55a28d5a3280 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:55.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.391+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.391+0000 7fc7ca2d49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:55.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.391+0000 7fc7ca2d49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:55.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.391+0000 7fc7ca2d49c0 1 --2- 172.21.15.62:0/3970579277 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55a28d5a46c0 0x55a28d5a6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:55.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.391+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5a7150 con 0x55a28d5a46c0 2024-09-10T05:36:55.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.391+0000 7fc7c75d9640 1 --2- 172.21.15.62:0/3970579277 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55a28d5a46c0 0x55a28d5a6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:55.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.391+0000 7fc7c75d9640 1 --2- 172.21.15.62:0/3970579277 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55a28d5a46c0 0x55a28d5a6ab0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:55.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.391+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc7bc0c3050 con 0x55a28d5a46c0 2024-09-10T05:36:55.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.391+0000 7fc7ca2d49c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:55.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.391+0000 7fc7ca2d49c0 20 searching for the correct realm 2024-09-10T05:36:55.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.391+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5a8a20 con 0x55a28d5a46c0 2024-09-10T05:36:55.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.391+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7bc0c3050 con 0x55a28d5a46c0 2024-09-10T05:36:55.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.391+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5a8a20 con 0x55a28d5a0e90 2024-09-10T05:36:55.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.391+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.391+0000 7fc7c7dda640 1 --2- 172.21.15.62:0/3970579277 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fc7b8077060 0x7fc7b801d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:55.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.391+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5a8a20 con 0x7fc7b8077060 2024-09-10T05:36:55.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.391+0000 7fc7c85db640 1 --2- 172.21.15.62:0/3970579277 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fc7b8077060 0x7fc7b801d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:55.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.391+0000 7fc7c85db640 1 --2- 172.21.15.62:0/3970579277 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fc7b8077060 0x7fc7b801d950 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:55.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.391+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c00083f0 con 0x7fc7b8077060 2024-09-10T05:36:55.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.391+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5a8a20 con 0x55a28d59ca10 2024-09-10T05:36:55.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.395+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c00083f0 con 0x55a28d59ca10 2024-09-10T05:36:55.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.395+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5a8a20 con 0x55a28d59ca10 2024-09-10T05:36:55.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.395+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c00083f0 con 0x55a28d59ca10 2024-09-10T05:36:55.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.395+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5a8a20 con 0x55a28d5a46c0 2024-09-10T05:36:55.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.395+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7bc0c3050 con 0x55a28d5a46c0 2024-09-10T05:36:55.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.395+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5a8a20 con 0x55a28d59ca10 2024-09-10T05:36:55.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.395+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c00083f0 con 0x55a28d59ca10 2024-09-10T05:36:55.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.395+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5a8a20 con 0x55a28d5a0e90 2024-09-10T05:36:55.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.395+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.395+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5a8a20 con 0x55a28d5a0e90 2024-09-10T05:36:55.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.395+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.395+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5a8a20 con 0x55a28d59ca10 2024-09-10T05:36:55.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.395+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c00083f0 con 0x55a28d59ca10 2024-09-10T05:36:55.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.395+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5a8a20 con 0x7fc7b8077060 2024-09-10T05:36:55.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.395+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c00083f0 con 0x7fc7b8077060 2024-09-10T05:36:55.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.395+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5a8a20 con 0x55a28d59ca10 2024-09-10T05:36:55.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.395+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c00083f0 con 0x55a28d59ca10 2024-09-10T05:36:55.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.395+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5a8a20 con 0x7fc7b8077060 2024-09-10T05:36:55.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.395+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc7c00083f0 con 0x7fc7b8077060 2024-09-10T05:36:55.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.395+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5a8a20 con 0x55a28d5a0e90 2024-09-10T05:36:55.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.399+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.399+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5a8a20 con 0x55a28d5a46c0 2024-09-10T05:36:55.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.399+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7bc0c3050 con 0x55a28d5a46c0 2024-09-10T05:36:55.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.399+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5a8a20 con 0x55a28d59ca10 2024-09-10T05:36:55.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.399+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c00083f0 con 0x55a28d59ca10 2024-09-10T05:36:55.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.399+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5a8a20 con 0x55a28d5a0e90 2024-09-10T05:36:55.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.399+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.399+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5a8a20 con 0x55a28d5a46c0 2024-09-10T05:36:55.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.399+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 32 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7fc7bc0c3050 con 0x55a28d5a46c0 2024-09-10T05:36:55.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.399+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5a8a20 con 0x55a28d59ca10 2024-09-10T05:36:55.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.399+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c00083f0 con 0x55a28d59ca10 2024-09-10T05:36:55.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.399+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5a8a20 con 0x55a28d59ca10 2024-09-10T05:36:55.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.399+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc7c00083f0 con 0x55a28d59ca10 2024-09-10T05:36:55.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.399+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5a8a20 con 0x55a28d59ca10 2024-09-10T05:36:55.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.399+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c00083f0 con 0x55a28d59ca10 2024-09-10T05:36:55.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.399+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5a8a20 con 0x55a28d5a46c0 2024-09-10T05:36:55.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.399+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7bc0c3050 con 0x55a28d5a46c0 2024-09-10T05:36:55.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.399+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5a8a20 con 0x7fc7b8077060 2024-09-10T05:36:55.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.399+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c00083f0 con 0x7fc7b8077060 2024-09-10T05:36:55.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.399+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5a8a20 con 0x55a28d59ca10 2024-09-10T05:36:55.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.399+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c00083f0 con 0x55a28d59ca10 2024-09-10T05:36:55.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.399+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5a8a20 con 0x7fc7b8077060 2024-09-10T05:36:55.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.403+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c00083f0 con 0x7fc7b8077060 2024-09-10T05:36:55.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.403+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5a8a20 con 0x55a28d5a46c0 2024-09-10T05:36:55.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.403+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7bc0c3050 con 0x55a28d5a46c0 2024-09-10T05:36:55.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.403+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5a8a20 con 0x7fc7b8077060 2024-09-10T05:36:55.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.403+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c00083f0 con 0x7fc7b8077060 2024-09-10T05:36:55.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.403+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5a8a20 con 0x55a28d5a0e90 2024-09-10T05:36:55.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.403+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.403+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5a8a20 con 0x55a28d5a0e90 2024-09-10T05:36:55.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.403+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.403+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5a8a20 con 0x55a28d5a46c0 2024-09-10T05:36:55.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.403+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7bc0c3050 con 0x55a28d5a46c0 2024-09-10T05:36:55.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.403+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5a8a20 con 0x55a28d5a0e90 2024-09-10T05:36:55.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.403+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.403+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5a8a20 con 0x55a28d5a0e90 2024-09-10T05:36:55.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.407+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.407+0000 7fc7ca2d49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:55.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.407+0000 7fc7ca2d49c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:55.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.407+0000 7fc7ca2d49c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:55.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.407+0000 7fc7ca2d49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:55.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.407+0000 7fc7ca2d49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:55.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.407+0000 7fc7ca2d49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:55.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.407+0000 7fc7ca2d49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:55.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.407+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5a7b10 con 0x55a28d59ca10 2024-09-10T05:36:55.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.407+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc7c00083f0 con 0x55a28d59ca10 2024-09-10T05:36:55.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.407+0000 7fc7ca2d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:55.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.407+0000 7fc7ca2d49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:55.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.407+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5a7f60 con 0x55a28d5a0e90 2024-09-10T05:36:55.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.407+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.407+0000 7fc7ca2d49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:55.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.407+0000 7fc7ca2d49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:55.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.407+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5a8380 con 0x55a28d5a46c0 2024-09-10T05:36:55.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.407+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc7bc0c3050 con 0x55a28d5a46c0 2024-09-10T05:36:55.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.407+0000 7fc7ca2d49c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:55.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.407+0000 7fc7ca2d49c0 20 zone default found 2024-09-10T05:36:55.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.407+0000 7fc7ca2d49c0 4 Realm: () 2024-09-10T05:36:55.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.407+0000 7fc7ca2d49c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:55.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.407+0000 7fc7ca2d49c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:55.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.407+0000 7fc7ca2d49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:55.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.407+0000 7fc7ca2d49c0 20 zonegroup default 2024-09-10T05:36:55.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.407+0000 7fc7ca2d49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:55.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.407+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5a8ed0 con 0x7fc7b8077060 2024-09-10T05:36:55.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.407+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc7c00083f0 con 0x7fc7b8077060 2024-09-10T05:36:55.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.407+0000 7fc7ca2d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:55.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.407+0000 7fc7ca2d49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:55.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.407+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5ab190 con 0x55a28d5a46c0 2024-09-10T05:36:55.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.407+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc7bc0c3050 con 0x55a28d5a46c0 2024-09-10T05:36:55.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.407+0000 7fc7ca2d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:55.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.407+0000 7fc7ca2d49c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:55.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.407+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5ab560 con 0x55a28d5a46c0 2024-09-10T05:36:55.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.407+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc7bc0c3050 con 0x55a28d5a46c0 2024-09-10T05:36:55.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.407+0000 7fc7ca2d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:55.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.407+0000 7fc7ca2d49c0 20 started sync module instance, tier type = 2024-09-10T05:36:55.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.407+0000 7fc7ca2d49c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:55.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.407+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5aa620 con 0x55a28d5a0e90 2024-09-10T05:36:55.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.411+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.411+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94156644592448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5aa620 con 0x55a28d5a0e90 2024-09-10T05:36:55.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.411+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5ac0b0 con 0x55a28d59ca10 2024-09-10T05:36:55.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.411+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c00083f0 con 0x55a28d59ca10 2024-09-10T05:36:55.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.411+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94156644596608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5ac950 con 0x55a28d59ca10 2024-09-10T05:36:55.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.411+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5ad390 con 0x55a28d5a0e90 2024-09-10T05:36:55.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.415+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94156644592448] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.415+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94156644596608] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c00083f0 con 0x55a28d59ca10 2024-09-10T05:36:55.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.415+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.415+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94156644601440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5ac4a0 con 0x55a28d5a0e90 2024-09-10T05:36:55.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.415+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5adc30 con 0x7fc7b8077060 2024-09-10T05:36:55.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.415+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c00083f0 con 0x7fc7b8077060 2024-09-10T05:36:55.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.415+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94156644603776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5ac4a0 con 0x7fc7b8077060 2024-09-10T05:36:55.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.415+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5ae6e0 con 0x55a28d5a0e90 2024-09-10T05:36:55.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.415+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94156644601440] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.419+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94156644603776] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c00083f0 con 0x7fc7b8077060 2024-09-10T05:36:55.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.419+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.419+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94156644604832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5ae1f0 con 0x55a28d5a0e90 2024-09-10T05:36:55.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.419+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5aefb0 con 0x55a28d5a46c0 2024-09-10T05:36:55.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.419+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7bc0c3050 con 0x55a28d5a46c0 2024-09-10T05:36:55.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.419+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94156644608768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5ae1f0 con 0x55a28d5a46c0 2024-09-10T05:36:55.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.419+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5afe20 con 0x55a28d5a46c0 2024-09-10T05:36:55.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.419+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94156644604832] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.423+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94156644608768] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7bc0c3050 con 0x55a28d5a46c0 2024-09-10T05:36:55.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.423+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7bc0c3050 con 0x55a28d5a46c0 2024-09-10T05:36:55.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.423+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94156644610896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5af970 con 0x55a28d5a46c0 2024-09-10T05:36:55.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.423+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5b01e0 con 0x7fc7b8077060 2024-09-10T05:36:55.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.423+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c00083f0 con 0x7fc7b8077060 2024-09-10T05:36:55.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.423+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94156644613072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5b0690 con 0x7fc7b8077060 2024-09-10T05:36:55.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.423+0000 7fc7ca2d49c0 20 add_watcher() i=0 2024-09-10T05:36:55.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.423+0000 7fc7ca2d49c0 20 add_watcher() i=1 2024-09-10T05:36:55.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.423+0000 7fc7ca2d49c0 20 add_watcher() i=2 2024-09-10T05:36:55.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.423+0000 7fc7ca2d49c0 20 add_watcher() i=3 2024-09-10T05:36:55.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.423+0000 7fc7ca2d49c0 20 add_watcher() i=4 2024-09-10T05:36:55.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.423+0000 7fc7ca2d49c0 20 add_watcher() i=5 2024-09-10T05:36:55.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.423+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94156644610896] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7bc0c3050 con 0x55a28d5a46c0 2024-09-10T05:36:55.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.423+0000 7fc7ca2d49c0 20 add_watcher() i=6 2024-09-10T05:36:55.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.423+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94156644613072] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c00083f0 con 0x7fc7b8077060 2024-09-10T05:36:55.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.423+0000 7fc7ca2d49c0 20 add_watcher() i=7 2024-09-10T05:36:55.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.423+0000 7fc7ca2d49c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:55.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.423+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5b0690 con 0x55a28d59ca10 2024-09-10T05:36:55.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.423+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc7c00083f0 con 0x55a28d59ca10 2024-09-10T05:36:55.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.423+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94156644614624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5b0630 con 0x55a28d59ca10 2024-09-10T05:36:55.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.427+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94156644614624] v32'158 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc7c00083f0 con 0x55a28d59ca10 2024-09-10T05:36:55.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.427+0000 7fc67dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:55.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.427+0000 7fc7ca2d49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:55.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.427+0000 7fc7ca2d49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:55.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.427+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5b5c00 con 0x55a28d5a0e90 2024-09-10T05:36:55.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.431+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'48 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.431+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5b5c00 con 0x7fc7b8077060 2024-09-10T05:36:55.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.431+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'24 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc7c00083f0 con 0x7fc7b8077060 2024-09-10T05:36:55.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.431+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5bc280 con 0x55a28d5a46c0 2024-09-10T05:36:55.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.435+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc7bc0c3050 con 0x55a28d5a46c0 2024-09-10T05:36:55.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.435+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5bc7f0 con 0x55a28d59ca10 2024-09-10T05:36:55.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.435+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'159 uv12 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc7c00083f0 con 0x55a28d59ca10 2024-09-10T05:36:55.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.435+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5bcca0 con 0x55a28d5a0e90 2024-09-10T05:36:55.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.439+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'50 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.439+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5bcca0 con 0x55a28d5a46c0 2024-09-10T05:36:55.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.439+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'41 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc7bc0c3050 con 0x55a28d5a46c0 2024-09-10T05:36:55.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.439+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5bb860 con 0x55a28d5a0e90 2024-09-10T05:36:55.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.443+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'28 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.443+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5bb860 con 0x55a28d59ca10 2024-09-10T05:36:55.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.443+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'35 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc7c00083f0 con 0x55a28d59ca10 2024-09-10T05:36:55.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.443+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5bd800 con 0x55a28d5a0e90 2024-09-10T05:36:55.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.447+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.447+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5bd800 con 0x55a28d5a0e90 2024-09-10T05:36:55.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.451+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'24 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.451+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5bd800 con 0x55a28d5a0e90 2024-09-10T05:36:55.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.451+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'51 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.451+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5bd800 con 0x55a28d5a46c0 2024-09-10T05:36:55.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.455+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7bc0c3050 con 0x55a28d5a46c0 2024-09-10T05:36:55.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.455+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5bdbc0 con 0x55a28d5a0e90 2024-09-10T05:36:55.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.455+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'24 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.455+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5bdb00 con 0x55a28d59ca10 2024-09-10T05:36:55.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.459+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'47 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7c00083f0 con 0x55a28d59ca10 2024-09-10T05:36:55.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.459+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5bdec0 con 0x55a28d59ca10 2024-09-10T05:36:55.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.463+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'160 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7c00083f0 con 0x55a28d59ca10 2024-09-10T05:36:55.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.463+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5bddb0 con 0x55a28d5a0e90 2024-09-10T05:36:55.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.463+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 25 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'45 uv16 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.463+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5bdd60 con 0x55a28d5a0e90 2024-09-10T05:36:55.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.467+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 26 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'52 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.467+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5bdcd0 con 0x55a28d5a46c0 2024-09-10T05:36:55.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.467+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 <== osd.3 v2:172.21.15.62:6816/2708991149 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'30 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7bc0c3050 con 0x55a28d5a46c0 2024-09-10T05:36:55.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.467+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5bde00 con 0x55a28d5a0e90 2024-09-10T05:36:55.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.471+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.471+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5bde00 con 0x55a28d59ca10 2024-09-10T05:36:55.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.475+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.1 v2:172.21.15.62:6808/3442097179 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'161 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7c00083f0 con 0x55a28d59ca10 2024-09-10T05:36:55.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.475+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5bde00 con 0x55a28d5a0e90 2024-09-10T05:36:55.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.479+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 28 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'46 uv18 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.479+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5bde00 con 0x7fc7b8077060 2024-09-10T05:36:55.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.479+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'34 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7c00083f0 con 0x7fc7b8077060 2024-09-10T05:36:55.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.479+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5bde00 con 0x55a28d5a46c0 2024-09-10T05:36:55.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.483+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 <== osd.3 v2:172.21.15.62:6816/2708991149 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'26 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7bc0c3050 con 0x55a28d5a46c0 2024-09-10T05:36:55.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.483+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5bde00 con 0x55a28d5a0e90 2024-09-10T05:36:55.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.483+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 29 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'37 uv18 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.487+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5bde40 con 0x55a28d5a46c0 2024-09-10T05:36:55.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.487+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 <== osd.3 v2:172.21.15.62:6816/2708991149 21 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7bc0c3050 con 0x55a28d5a46c0 2024-09-10T05:36:55.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.487+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5bde40 con 0x55a28d5a46c0 2024-09-10T05:36:55.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.491+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 <== osd.3 v2:172.21.15.62:6816/2708991149 22 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'42 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7bc0c3050 con 0x55a28d5a46c0 2024-09-10T05:36:55.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.491+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5bde80 con 0x55a28d5a46c0 2024-09-10T05:36:55.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.491+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 <== osd.3 v2:172.21.15.62:6816/2708991149 23 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'26 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7bc0c3050 con 0x55a28d5a46c0 2024-09-10T05:36:55.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.491+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5bde80 con 0x55a28d5a0e90 2024-09-10T05:36:55.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.495+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 30 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'31 uv30 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.495+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5bdeb0 con 0x55a28d59ca10 2024-09-10T05:36:55.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.495+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.1 v2:172.21.15.62:6808/3442097179 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'36 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7c00083f0 con 0x55a28d59ca10 2024-09-10T05:36:55.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.495+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5bdeb0 con 0x55a28d5a0e90 2024-09-10T05:36:55.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.499+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 31 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'47 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.499+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5bdeb0 con 0x55a28d59ca10 2024-09-10T05:36:55.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.503+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.1 v2:172.21.15.62:6808/3442097179 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'48 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7c00083f0 con 0x55a28d59ca10 2024-09-10T05:36:55.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.503+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5bde80 con 0x7fc7b8077060 2024-09-10T05:36:55.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.503+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7c00083f0 con 0x7fc7b8077060 2024-09-10T05:36:55.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.503+0000 7fc67cfe1640 20 reqs_thread_entry: start 2024-09-10T05:36:55.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.503+0000 7fc7ca2d49c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:55.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.503+0000 7fc7ca2d49c0 20 Filter name: none 2024-09-10T05:36:55.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.507+0000 7fc5f67fc640 20 reqs_thread_entry: start 2024-09-10T05:36:55.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.507+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x55a28d5a0e90 2024-09-10T05:36:55.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.507+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 32 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv11 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.507+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5ba690 con 0x55a28d5a0e90 2024-09-10T05:36:55.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.507+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 33 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv11 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.507+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x55a28d5a0e90 2024-09-10T05:36:55.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.507+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 34 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv11 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.507+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x7fc7b8077060 2024-09-10T05:36:55.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.507+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.2 v2:172.21.15.62:6800/2677868286 15 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc7c00083f0 con 0x7fc7b8077060 2024-09-10T05:36:55.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.507+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5ba690 con 0x7fc7b8077060 2024-09-10T05:36:55.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.507+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.2 v2:172.21.15.62:6800/2677868286 16 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv7 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc7c00083f0 con 0x7fc7b8077060 2024-09-10T05:36:55.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.507+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x7fc7b8077060 2024-09-10T05:36:55.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.511+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.2 v2:172.21.15.62:6800/2677868286 17 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc7c00083f0 con 0x7fc7b8077060 2024-09-10T05:36:55.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.511+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x55a28d5a46c0 2024-09-10T05:36:55.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.511+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 <== osd.3 v2:172.21.15.62:6816/2708991149 24 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc7bc0c3050 con 0x55a28d5a46c0 2024-09-10T05:36:55.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.511+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5ba690 con 0x55a28d5a46c0 2024-09-10T05:36:55.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.511+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 <== osd.3 v2:172.21.15.62:6816/2708991149 25 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc7bc0c3050 con 0x55a28d5a46c0 2024-09-10T05:36:55.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.511+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x55a28d5a46c0 2024-09-10T05:36:55.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.511+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 <== osd.3 v2:172.21.15.62:6816/2708991149 26 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc7bc0c3050 con 0x55a28d5a46c0 2024-09-10T05:36:55.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.511+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x55a28d59ca10 2024-09-10T05:36:55.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.511+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.1 v2:172.21.15.62:6808/3442097179 26 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv12 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc7c00083f0 con 0x55a28d59ca10 2024-09-10T05:36:55.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.511+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5ba690 con 0x55a28d59ca10 2024-09-10T05:36:55.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.511+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.1 v2:172.21.15.62:6808/3442097179 27 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv12 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc7c00083f0 con 0x55a28d59ca10 2024-09-10T05:36:55.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.511+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x55a28d59ca10 2024-09-10T05:36:55.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.511+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.1 v2:172.21.15.62:6808/3442097179 28 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv12 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc7c00083f0 con 0x55a28d59ca10 2024-09-10T05:36:55.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.511+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x55a28d5a0e90 2024-09-10T05:36:55.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.511+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 35 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.511+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5ba690 con 0x55a28d5a0e90 2024-09-10T05:36:55.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.515+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 36 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv9 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.515+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x55a28d5a0e90 2024-09-10T05:36:55.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.515+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 37 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.515+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x55a28d5a46c0 2024-09-10T05:36:55.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.515+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 <== osd.3 v2:172.21.15.62:6816/2708991149 27 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv8 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc7bc0c3050 con 0x55a28d5a46c0 2024-09-10T05:36:55.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.515+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5ba690 con 0x55a28d5a46c0 2024-09-10T05:36:55.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.515+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 <== osd.3 v2:172.21.15.62:6816/2708991149 28 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv8 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc7bc0c3050 con 0x55a28d5a46c0 2024-09-10T05:36:55.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.515+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x55a28d5a46c0 2024-09-10T05:36:55.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.515+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 <== osd.3 v2:172.21.15.62:6816/2708991149 29 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv8 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc7bc0c3050 con 0x55a28d5a46c0 2024-09-10T05:36:55.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.515+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x55a28d5a0e90 2024-09-10T05:36:55.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.515+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 38 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.515+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5ba690 con 0x55a28d5a0e90 2024-09-10T05:36:55.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.515+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 39 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.515+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x55a28d5a0e90 2024-09-10T05:36:55.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.519+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 40 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.519+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x55a28d59ca10 2024-09-10T05:36:55.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.519+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.1 v2:172.21.15.62:6808/3442097179 29 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv10 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc7c00083f0 con 0x55a28d59ca10 2024-09-10T05:36:55.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.519+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5ba690 con 0x55a28d59ca10 2024-09-10T05:36:55.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.519+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.1 v2:172.21.15.62:6808/3442097179 30 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv10 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc7c00083f0 con 0x55a28d59ca10 2024-09-10T05:36:55.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.519+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x55a28d59ca10 2024-09-10T05:36:55.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.519+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.1 v2:172.21.15.62:6808/3442097179 31 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv10 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc7c00083f0 con 0x55a28d59ca10 2024-09-10T05:36:55.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.519+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x55a28d5a0e90 2024-09-10T05:36:55.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.519+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 41 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.519+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5ba690 con 0x55a28d5a0e90 2024-09-10T05:36:55.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.519+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 42 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.519+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x55a28d5a0e90 2024-09-10T05:36:55.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.523+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 43 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.523+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x55a28d5a0e90 2024-09-10T05:36:55.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.523+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 44 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv6 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.523+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5ba690 con 0x55a28d5a0e90 2024-09-10T05:36:55.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.523+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 45 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv6 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.523+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x55a28d5a0e90 2024-09-10T05:36:55.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.523+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 46 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv6 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.523+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x55a28d5a0e90 2024-09-10T05:36:55.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.523+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 47 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.523+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5ba690 con 0x55a28d5a0e90 2024-09-10T05:36:55.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.527+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 48 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv17 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.527+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x55a28d5a0e90 2024-09-10T05:36:55.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.527+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 49 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.527+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x55a28d5a46c0 2024-09-10T05:36:55.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.527+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 <== osd.3 v2:172.21.15.62:6816/2708991149 30 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc7bc0c3050 con 0x55a28d5a46c0 2024-09-10T05:36:55.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.527+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5ba690 con 0x55a28d5a46c0 2024-09-10T05:36:55.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.527+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 <== osd.3 v2:172.21.15.62:6816/2708991149 31 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc7bc0c3050 con 0x55a28d5a46c0 2024-09-10T05:36:55.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.527+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x55a28d5a46c0 2024-09-10T05:36:55.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.527+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 <== osd.3 v2:172.21.15.62:6816/2708991149 32 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc7bc0c3050 con 0x55a28d5a46c0 2024-09-10T05:36:55.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.527+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x55a28d5a0e90 2024-09-10T05:36:55.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.527+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 50 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.527+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5ba690 con 0x55a28d5a0e90 2024-09-10T05:36:55.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.531+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 51 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.531+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x55a28d5a0e90 2024-09-10T05:36:55.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.531+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 52 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.531+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x55a28d59ca10 2024-09-10T05:36:55.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.531+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.1 v2:172.21.15.62:6808/3442097179 32 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv14 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc7c003f040 con 0x55a28d59ca10 2024-09-10T05:36:55.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.531+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5ba690 con 0x55a28d59ca10 2024-09-10T05:36:55.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.531+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.1 v2:172.21.15.62:6808/3442097179 33 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv14 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc7c003f040 con 0x55a28d59ca10 2024-09-10T05:36:55.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.531+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x55a28d59ca10 2024-09-10T05:36:55.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.531+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.1 v2:172.21.15.62:6808/3442097179 34 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv14 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc7c003f040 con 0x55a28d59ca10 2024-09-10T05:36:55.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.531+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x55a28d59ca10 2024-09-10T05:36:55.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.531+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.1 v2:172.21.15.62:6808/3442097179 35 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc7c003f040 con 0x55a28d59ca10 2024-09-10T05:36:55.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.531+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5ba690 con 0x55a28d59ca10 2024-09-10T05:36:55.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.531+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.1 v2:172.21.15.62:6808/3442097179 36 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv15 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc7c003f040 con 0x55a28d59ca10 2024-09-10T05:36:55.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.531+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x55a28d59ca10 2024-09-10T05:36:55.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.535+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.1 v2:172.21.15.62:6808/3442097179 37 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc7c003f040 con 0x55a28d59ca10 2024-09-10T05:36:55.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.535+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x55a28d5a0e90 2024-09-10T05:36:55.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.535+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 53 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.535+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5ba690 con 0x55a28d5a0e90 2024-09-10T05:36:55.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.535+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 54 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv16 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.535+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x55a28d5a0e90 2024-09-10T05:36:55.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.535+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 55 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.535+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x55a28d5a0e90 2024-09-10T05:36:55.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.539+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 56 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv19 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.539+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5ba690 con 0x55a28d5a0e90 2024-09-10T05:36:55.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.539+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 57 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv19 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.539+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x55a28d5a0e90 2024-09-10T05:36:55.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.539+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 58 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv19 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.539+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x55a28d5a46c0 2024-09-10T05:36:55.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.539+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 <== osd.3 v2:172.21.15.62:6816/2708991149 33 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc7bc0c3050 con 0x55a28d5a46c0 2024-09-10T05:36:55.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.539+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5ba690 con 0x55a28d5a46c0 2024-09-10T05:36:55.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.539+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 <== osd.3 v2:172.21.15.62:6816/2708991149 34 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv17 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc7bc0c3050 con 0x55a28d5a46c0 2024-09-10T05:36:55.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.539+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x55a28d5a46c0 2024-09-10T05:36:55.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.539+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 <== osd.3 v2:172.21.15.62:6816/2708991149 35 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc7bc0c3050 con 0x55a28d5a46c0 2024-09-10T05:36:55.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.539+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x55a28d5a0e90 2024-09-10T05:36:55.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.543+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 59 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.543+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5ba690 con 0x55a28d5a0e90 2024-09-10T05:36:55.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.543+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 60 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.543+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x55a28d5a0e90 2024-09-10T05:36:55.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.543+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 61 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.543+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x55a28d59ca10 2024-09-10T05:36:55.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.543+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.1 v2:172.21.15.62:6808/3442097179 38 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc7c003f040 con 0x55a28d59ca10 2024-09-10T05:36:55.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.543+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5ba690 con 0x55a28d59ca10 2024-09-10T05:36:55.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.543+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.1 v2:172.21.15.62:6808/3442097179 39 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv17 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc7c003f040 con 0x55a28d59ca10 2024-09-10T05:36:55.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.543+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x55a28d59ca10 2024-09-10T05:36:55.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.543+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.1 v2:172.21.15.62:6808/3442097179 40 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc7c003f040 con 0x55a28d59ca10 2024-09-10T05:36:55.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.543+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x55a28d5a0e90 2024-09-10T05:36:55.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.547+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 62 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv18 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.547+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5ba690 con 0x55a28d5a0e90 2024-09-10T05:36:55.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.547+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 63 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv18 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.547+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x55a28d5a0e90 2024-09-10T05:36:55.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.547+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 64 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv18 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.547+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x7fc7b8077060 2024-09-10T05:36:55.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.547+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.2 v2:172.21.15.62:6800/2677868286 18 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc7c003f040 con 0x7fc7b8077060 2024-09-10T05:36:55.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.547+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5ba690 con 0x7fc7b8077060 2024-09-10T05:36:55.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.551+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.2 v2:172.21.15.62:6800/2677868286 19 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc7c003f040 con 0x7fc7b8077060 2024-09-10T05:36:55.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.551+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x7fc7b8077060 2024-09-10T05:36:55.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.551+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.2 v2:172.21.15.62:6800/2677868286 20 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc7c003f040 con 0x7fc7b8077060 2024-09-10T05:36:55.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.551+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x55a28d5a46c0 2024-09-10T05:36:55.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.551+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 <== osd.3 v2:172.21.15.62:6816/2708991149 36 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc7bc0c3050 con 0x55a28d5a46c0 2024-09-10T05:36:55.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.551+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5ba690 con 0x55a28d5a46c0 2024-09-10T05:36:55.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.551+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 <== osd.3 v2:172.21.15.62:6816/2708991149 37 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc7bc0c3050 con 0x55a28d5a46c0 2024-09-10T05:36:55.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.551+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x55a28d5a46c0 2024-09-10T05:36:55.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.551+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 <== osd.3 v2:172.21.15.62:6816/2708991149 38 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc7bc0c3050 con 0x55a28d5a46c0 2024-09-10T05:36:55.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.551+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x55a28d5a0e90 2024-09-10T05:36:55.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.551+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 65 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv18 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.551+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5ba690 con 0x55a28d5a0e90 2024-09-10T05:36:55.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.555+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 66 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv18 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.555+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x55a28d5a0e90 2024-09-10T05:36:55.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.555+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 67 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv18 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.555+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x55a28d5a46c0 2024-09-10T05:36:55.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.555+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 <== osd.3 v2:172.21.15.62:6816/2708991149 39 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc7bc0c3050 con 0x55a28d5a46c0 2024-09-10T05:36:55.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.555+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5ba690 con 0x55a28d5a46c0 2024-09-10T05:36:55.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.555+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 <== osd.3 v2:172.21.15.62:6816/2708991149 40 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc7bc0c3050 con 0x55a28d5a46c0 2024-09-10T05:36:55.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.555+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x55a28d5a46c0 2024-09-10T05:36:55.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.555+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 <== osd.3 v2:172.21.15.62:6816/2708991149 41 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc7bc0c3050 con 0x55a28d5a46c0 2024-09-10T05:36:55.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.555+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x55a28d5a46c0 2024-09-10T05:36:55.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.555+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 <== osd.3 v2:172.21.15.62:6816/2708991149 42 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc7bc0c3050 con 0x55a28d5a46c0 2024-09-10T05:36:55.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.555+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5ba690 con 0x55a28d5a46c0 2024-09-10T05:36:55.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.555+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 <== osd.3 v2:172.21.15.62:6816/2708991149 43 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc7bc0c3050 con 0x55a28d5a46c0 2024-09-10T05:36:55.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.555+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x55a28d5a46c0 2024-09-10T05:36:55.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.559+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 <== osd.3 v2:172.21.15.62:6816/2708991149 44 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc7bc0c3050 con 0x55a28d5a46c0 2024-09-10T05:36:55.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.559+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x55a28d5a46c0 2024-09-10T05:36:55.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.559+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 <== osd.3 v2:172.21.15.62:6816/2708991149 45 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc7bc0c3050 con 0x55a28d5a46c0 2024-09-10T05:36:55.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.559+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5ba690 con 0x55a28d5a46c0 2024-09-10T05:36:55.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.559+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 <== osd.3 v2:172.21.15.62:6816/2708991149 46 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc7bc0c3050 con 0x55a28d5a46c0 2024-09-10T05:36:55.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.559+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x55a28d5a46c0 2024-09-10T05:36:55.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.559+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 <== osd.3 v2:172.21.15.62:6816/2708991149 47 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc7bc0c3050 con 0x55a28d5a46c0 2024-09-10T05:36:55.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.559+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x55a28d5a0e90 2024-09-10T05:36:55.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.559+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 68 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.559+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5ba690 con 0x55a28d5a0e90 2024-09-10T05:36:55.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.559+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 69 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv30 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.559+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9a10 con 0x55a28d5a0e90 2024-09-10T05:36:55.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.563+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 70 ==== osd_op_reply(177 gc.27 [call out=1701b] v0'0 uv30 ondisk = 0) ==== 149+0+1701 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.563+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5da570 con 0x55a28d59ca10 2024-09-10T05:36:55.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.563+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.1 v2:172.21.15.62:6808/3442097179 41 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc7c003f040 con 0x55a28d59ca10 2024-09-10T05:36:55.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.563+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9560 con 0x55a28d59ca10 2024-09-10T05:36:55.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.563+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.1 v2:172.21.15.62:6808/3442097179 42 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc7c003f040 con 0x55a28d59ca10 2024-09-10T05:36:55.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.563+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5da570 con 0x55a28d59ca10 2024-09-10T05:36:55.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.563+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.1 v2:172.21.15.62:6808/3442097179 43 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc7c003f040 con 0x55a28d59ca10 2024-09-10T05:36:55.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.563+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5da570 con 0x55a28d5a0e90 2024-09-10T05:36:55.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.563+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 71 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.563+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9560 con 0x55a28d5a0e90 2024-09-10T05:36:55.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.563+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 72 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.567+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5da570 con 0x55a28d5a0e90 2024-09-10T05:36:55.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.567+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 73 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.567+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5da570 con 0x55a28d59ca10 2024-09-10T05:36:55.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.567+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.1 v2:172.21.15.62:6808/3442097179 44 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv8 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc7c003f040 con 0x55a28d59ca10 2024-09-10T05:36:55.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.567+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9560 con 0x55a28d59ca10 2024-09-10T05:36:55.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.567+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.1 v2:172.21.15.62:6808/3442097179 45 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv8 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc7c003f040 con 0x55a28d59ca10 2024-09-10T05:36:55.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.567+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5da570 con 0x55a28d59ca10 2024-09-10T05:36:55.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.567+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.1 v2:172.21.15.62:6808/3442097179 46 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv8 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc7c003f040 con 0x55a28d59ca10 2024-09-10T05:36:55.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.567+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5da570 con 0x7fc7b8077060 2024-09-10T05:36:55.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.567+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.2 v2:172.21.15.62:6800/2677868286 21 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc7c003f040 con 0x7fc7b8077060 2024-09-10T05:36:55.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.567+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5d9560 con 0x7fc7b8077060 2024-09-10T05:36:55.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.567+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.2 v2:172.21.15.62:6800/2677868286 22 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc7c003f040 con 0x7fc7b8077060 2024-09-10T05:36:55.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.567+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5da570 con 0x7fc7b8077060 2024-09-10T05:36:55.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.571+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.2 v2:172.21.15.62:6800/2677868286 23 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc7c003f040 con 0x7fc7b8077060 2024-09-10T05:36:55.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.571+0000 7fc67dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:55.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.571+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94156644614624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5bac90 con 0x55a28d59ca10 2024-09-10T05:36:55.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.575+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.1 v2:172.21.15.62:6808/3442097179 47 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94156644614624] v32'162 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc7c003f040 con 0x55a28d59ca10 2024-09-10T05:36:55.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.575+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94156644592448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5b01e0 con 0x55a28d5a0e90 2024-09-10T05:36:55.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.575+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 74 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94156644592448] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.575+0000 7fc7ca2d49c0 20 remove_watcher() i=0 2024-09-10T05:36:55.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.575+0000 7fc7ca2d49c0 2 removed watcher, disabling cache 2024-09-10T05:36:55.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.575+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94156644596608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5b01e0 con 0x55a28d59ca10 2024-09-10T05:36:55.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.579+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.1 v2:172.21.15.62:6808/3442097179 48 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94156644596608] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c003f040 con 0x55a28d59ca10 2024-09-10T05:36:55.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.579+0000 7fc7ca2d49c0 20 remove_watcher() i=1 2024-09-10T05:36:55.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.579+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94156644601440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5b01e0 con 0x55a28d5a0e90 2024-09-10T05:36:55.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.579+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 75 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94156644601440] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.579+0000 7fc7ca2d49c0 20 remove_watcher() i=2 2024-09-10T05:36:55.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.579+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94156644603776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5b01e0 con 0x7fc7b8077060 2024-09-10T05:36:55.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.583+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.2 v2:172.21.15.62:6800/2677868286 24 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94156644603776] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c003f040 con 0x7fc7b8077060 2024-09-10T05:36:55.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.583+0000 7fc7ca2d49c0 20 remove_watcher() i=3 2024-09-10T05:36:55.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.583+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94156644604832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5ad780 con 0x55a28d5a0e90 2024-09-10T05:36:55.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.583+0000 7fc7c7dda640 1 -- 172.21.15.62:0/3970579277 <== osd.0 v2:172.21.15.2:6800/945139080 76 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94156644604832] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b8074030 con 0x55a28d5a0e90 2024-09-10T05:36:55.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.583+0000 7fc7ca2d49c0 20 remove_watcher() i=4 2024-09-10T05:36:55.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.583+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94156644608768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5b01e0 con 0x55a28d5a46c0 2024-09-10T05:36:55.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.587+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 <== osd.3 v2:172.21.15.62:6816/2708991149 48 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94156644608768] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7bc0c3050 con 0x55a28d5a46c0 2024-09-10T05:36:55.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.587+0000 7fc7ca2d49c0 20 remove_watcher() i=5 2024-09-10T05:36:55.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.587+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94156644610896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5b01e0 con 0x55a28d5a46c0 2024-09-10T05:36:55.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.587+0000 7fc7c75d9640 1 -- 172.21.15.62:0/3970579277 <== osd.3 v2:172.21.15.62:6816/2708991149 49 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94156644610896] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7bc0c3050 con 0x55a28d5a46c0 2024-09-10T05:36:55.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.587+0000 7fc7ca2d49c0 20 remove_watcher() i=6 2024-09-10T05:36:55.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.587+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94156644613072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a28d5af350 con 0x7fc7b8077060 2024-09-10T05:36:55.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.591+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 <== osd.2 v2:172.21.15.62:6800/2677868286 25 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94156644613072] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c003f040 con 0x7fc7b8077060 2024-09-10T05:36:55.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.591+0000 7fc7ca2d49c0 20 remove_watcher() i=7 2024-09-10T05:36:55.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.591+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55a28d5a0e90 msgr2=0x55a28d5a3280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:55.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.591+0000 7fc7ca2d49c0 1 --2- 172.21.15.62:0/3970579277 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55a28d5a0e90 0x55a28d5a3280 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:55.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.591+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55a28d59ca10 msgr2=0x55a28d59eea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:55.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.591+0000 7fc7ca2d49c0 1 --2- 172.21.15.62:0/3970579277 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55a28d59ca10 0x55a28d59eea0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:55.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.591+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fc7b8077060 msgr2=0x7fc7b801d950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:55.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.591+0000 7fc7ca2d49c0 1 --2- 172.21.15.62:0/3970579277 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fc7b8077060 0x7fc7b801d950 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:55.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.591+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55a28d5a46c0 msgr2=0x55a28d5a6ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:55.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.591+0000 7fc7ca2d49c0 1 --2- 172.21.15.62:0/3970579277 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55a28d5a46c0 0x55a28d5a6ab0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:55.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.591+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc6900399d0 msgr2=0x7fc69003be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:55.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.591+0000 7fc7ca2d49c0 1 --2- 172.21.15.62:0/3970579277 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc6900399d0 0x7fc69003be90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc0aa620 tx=0x7fc7bc0a6000 comp rx=0 tx=0).stop 2024-09-10T05:36:55.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.591+0000 7fc7c85db640 1 -- 172.21.15.62:0/3970579277 reap_dead start 2024-09-10T05:36:55.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.591+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a28d58a780 msgr2=0x55a28d591ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:55.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.591+0000 7fc7ca2d49c0 1 --2- 172.21.15.62:0/3970579277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a28d58a780 0x55a28d591ae0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8048230 tx=0x7fc7b8033ed0 comp rx=0 tx=0).stop 2024-09-10T05:36:55.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.591+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 shutdown_connections 2024-09-10T05:36:55.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.591+0000 7fc7ca2d49c0 1 --2- 172.21.15.62:0/3970579277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a28d58a780 0x55a28d591ae0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:55.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.591+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 >> 172.21.15.62:0/3970579277 conn(0x55a28d586bb0 msgr2=0x55a28d584dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:55.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.591+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 shutdown_connections 2024-09-10T05:36:55.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.591+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3970579277 wait complete. 2024-09-10T05:36:55.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.591+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3338610623 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc6a0039a70 msgr2=0x7fc6a003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:55.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.591+0000 7fc7ca2d49c0 1 --2- 172.21.15.62:0/3338610623 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc6a0039a70 0x7fc6a003bf30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x55a28d561540 tx=0x7fc7bc005e50 comp rx=0 tx=0).stop 2024-09-10T05:36:55.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.591+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3338610623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a28d57e150 msgr2=0x55a28d57e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:55.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.591+0000 7fc7ca2d49c0 1 --2- 172.21.15.62:0/3338610623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a28d57e150 0x55a28d57e570 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8017cd0 tx=0x7fc7b8019e60 comp rx=0 tx=0).stop 2024-09-10T05:36:55.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.591+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3338610623 shutdown_connections 2024-09-10T05:36:55.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.591+0000 7fc7ca2d49c0 1 --2- 172.21.15.62:0/3338610623 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc6a0039a70 0x7fc6a003bf30 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:55.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.591+0000 7fc7ca2d49c0 1 --2- 172.21.15.62:0/3338610623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a28d57e150 0x55a28d57e570 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:55.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.591+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3338610623 >> 172.21.15.62:0/3338610623 conn(0x55a28d573b00 msgr2=0x55a28d573ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:55.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.595+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3338610623 shutdown_connections 2024-09-10T05:36:55.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.595+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/3338610623 wait complete. 2024-09-10T05:36:55.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.595+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/2917629625 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55a28d568930 msgr2=0x55a28d56ad20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:55.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.595+0000 7fc7ca2d49c0 1 --2- 172.21.15.62:0/2917629625 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55a28d568930 0x55a28d56ad20 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:55.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.595+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/2917629625 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55a28d565250 msgr2=0x55a28d567640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:55.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.595+0000 7fc7ca2d49c0 1 --2- 172.21.15.62:0/2917629625 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55a28d565250 0x55a28d567640 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:55.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.595+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/2917629625 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55a28d56d0f0 msgr2=0x55a28d56f4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:55.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.595+0000 7fc7ca2d49c0 1 --2- 172.21.15.62:0/2917629625 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55a28d56d0f0 0x55a28d56f4e0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:55.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.595+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/2917629625 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc6b0039a70 msgr2=0x7fc6b003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:55.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.595+0000 7fc7ca2d49c0 1 --2- 172.21.15.62:0/2917629625 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc6b0039a70 0x7fc6b003bf30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc0ab000 tx=0x7fc7bc0a5000 comp rx=0 tx=0).stop 2024-09-10T05:36:55.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.595+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/2917629625 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a28d46d200 msgr2=0x55a28d5600f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:55.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.595+0000 7fc7ca2d49c0 1 --2- 172.21.15.62:0/2917629625 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a28d46d200 0x55a28d5600f0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x55a28d5599e0 tx=0x7fc7b8000bd0 comp rx=0 tx=0).stop 2024-09-10T05:36:55.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.595+0000 7fc7c85db640 1 -- 172.21.15.62:0/2917629625 reap_dead start 2024-09-10T05:36:55.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.595+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/2917629625 shutdown_connections 2024-09-10T05:36:55.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.595+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/2917629625 >> 172.21.15.62:0/2917629625 conn(0x55a28d3e0b10 msgr2=0x55a28d553080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:55.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.595+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/2917629625 shutdown_connections 2024-09-10T05:36:55.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.595+0000 7fc7ca2d49c0 1 -- 172.21.15.62:0/2917629625 wait complete. 2024-09-10T05:36:55.621 INFO:teuthology.orchestra.run.smithi062.stdout:[{"tag":"475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1622150448642997087\u0000","time":"2024-09-10T05:36:55.300457+0000","objs":[{"pool":"default.rgw.buckets.data","oid":"475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1__shadow_.R3fgt7NCc9bMK5zA1G4esuEOca8qSpK_1","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1__shadow_.R3fgt7NCc9bMK5zA1G4esuEOca8qSpK_2","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1__shadow_.R3fgt7NCc9bMK5zA1G4esuEOca8qSpK_3","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1__shadow_.R3fgt7NCc9bMK5zA1G4esuEOca8qSpK_4","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1__shadow_.R3fgt7NCc9bMK5zA1G4esuEOca8qSpK_5","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1__shadow_.R3fgt7NCc9bMK5zA1G4esuEOca8qSpK_6","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1__shadow_.R3fgt7NCc9bMK5zA1G4esuEOca8qSpK_7","key":"","instance":""}]}] 2024-09-10T05:36:55.621 DEBUG:tasks.util.rgw: json result: [{'tag': '475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1622150448642997087\x00', 'time': '2024-09-10T05:36:55.300457+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': '475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1__shadow_.R3fgt7NCc9bMK5zA1G4esuEOca8qSpK_1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1__shadow_.R3fgt7NCc9bMK5zA1G4esuEOca8qSpK_2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1__shadow_.R3fgt7NCc9bMK5zA1G4esuEOca8qSpK_3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1__shadow_.R3fgt7NCc9bMK5zA1G4esuEOca8qSpK_4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1__shadow_.R3fgt7NCc9bMK5zA1G4esuEOca8qSpK_5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1__shadow_.R3fgt7NCc9bMK5zA1G4esuEOca8qSpK_6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1__shadow_.R3fgt7NCc9bMK5zA1G4esuEOca8qSpK_7', 'key': '', 'instance': ''}]}] 2024-09-10T05:36:55.621 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2024-09-10T05:36:55.621 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2024-09-10T05:36:55.622 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2024-09-10T05:36:55.700 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:55.700 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:55.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.699+0000 7f7311d8b9c0 1 Processor -- start 2024-09-10T05:36:55.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.699+0000 7f7311d8b9c0 1 -- start start 2024-09-10T05:36:55.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.699+0000 7f7311d8b9c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5573b65a3fc0 0x5573b65a63b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:55.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.699+0000 7f7311d8b9c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5573b64559c0 con 0x5573b659fdd0 2024-09-10T05:36:55.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.699+0000 7f7311d8b9c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x5573b64a56d0 con 0x5573b65a3fc0 2024-09-10T05:36:55.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.699+0000 7f730f090640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5573b65a3fc0 0x5573b65a63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:55.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.699+0000 7f730f090640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5573b65a3fc0 0x5573b65a63b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47800/0 (socket says 172.21.15.62:47800) 2024-09-10T05:36:55.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.699+0000 7f730f891640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x5573b659fdd0 0x5573b65a01b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:58340/0 (socket says 172.21.15.62:58340) 2024-09-10T05:36:55.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.699+0000 7f730f090640 1 -- 172.21.15.62:0/1116541153 learned_addr learned my addr 172.21.15.62:0/1116541153 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:55.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.699+0000 7f730f090640 1 -- 172.21.15.62:0/1116541153 >> v1:172.21.15.2:6789/0 conn(0x5573b659fdd0 legacy=0x5573b65a01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:55.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.699+0000 7f730e88f640 1 -- 172.21.15.62:0/1116541153 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4236267332 0 0) 0x5573b64559c0 con 0x5573b659fdd0 2024-09-10T05:36:55.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.699+0000 7f730f090640 1 -- 172.21.15.62:0/1116541153 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573b6449ca0 con 0x5573b65a3fc0 2024-09-10T05:36:55.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.703+0000 7f730f090640 1 --2- 172.21.15.62:0/1116541153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573b65a3fc0 0x5573b65a63b0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f730400a750 tx=0x7f730401d290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95f5f0e3335e71a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:55.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.703+0000 7f730e88f640 1 -- 172.21.15.62:0/1116541153 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f730400a200 con 0x5573b65a3fc0 2024-09-10T05:36:55.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.703+0000 7f730e88f640 1 -- 172.21.15.62:0/1116541153 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f730400a3a0 con 0x5573b65a3fc0 2024-09-10T05:36:55.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.703+0000 7f730e88f640 1 -- 172.21.15.62:0/1116541153 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73040086f0 con 0x5573b65a3fc0 2024-09-10T05:36:55.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.703+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/1116541153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573b65a3fc0 msgr2=0x5573b65a63b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:55.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.703+0000 7f7311d8b9c0 1 --2- 172.21.15.62:0/1116541153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573b65a3fc0 0x5573b65a63b0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f730400a750 tx=0x7f730401d290 comp rx=0 tx=0).stop 2024-09-10T05:36:55.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.703+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/1116541153 shutdown_connections 2024-09-10T05:36:55.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.703+0000 7f7311d8b9c0 1 --2- 172.21.15.62:0/1116541153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573b65a3fc0 0x5573b65a63b0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:55.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.703+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/1116541153 >> 172.21.15.62:0/1116541153 conn(0x5573b659b8f0 msgr2=0x5573b659dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:55.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.703+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/1116541153 shutdown_connections 2024-09-10T05:36:55.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.703+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/1116541153 wait complete. 2024-09-10T05:36:55.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.723+0000 7f7311d8b9c0 1 Processor -- start 2024-09-10T05:36:55.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.723+0000 7f7311d8b9c0 1 -- start start 2024-09-10T05:36:55.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.723+0000 7f7311d8b9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573b659fdd0 0x5573b668a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:55.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.723+0000 7f7311d8b9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5573b64a9680 con 0x5573b659fdd0 2024-09-10T05:36:55.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.723+0000 7f730f891640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573b659fdd0 0x5573b668a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:55.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.723+0000 7f730f891640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573b659fdd0 0x5573b668a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47816/0 (socket says 172.21.15.62:47816) 2024-09-10T05:36:55.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.723+0000 7f730f891640 1 -- 172.21.15.62:0/2363360879 learned_addr learned my addr 172.21.15.62:0/2363360879 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:55.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.723+0000 7f730f891640 1 -- 172.21.15.62:0/2363360879 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573b6424da0 con 0x5573b659fdd0 2024-09-10T05:36:55.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.723+0000 7f730f891640 1 --2- 172.21.15.62:0/2363360879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573b659fdd0 0x5573b668a2d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f7300001eb0 tx=0x7f730000b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bc17672458a9bc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:55.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.723+0000 7f71fde0b640 1 -- 172.21.15.62:0/2363360879 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f730000d640 con 0x5573b659fdd0 2024-09-10T05:36:55.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.723+0000 7f71fde0b640 1 -- 172.21.15.62:0/2363360879 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7300008070 con 0x5573b659fdd0 2024-09-10T05:36:55.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.723+0000 7f71fde0b640 1 -- 172.21.15.62:0/2363360879 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f730000d970 con 0x5573b659fdd0 2024-09-10T05:36:55.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.723+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/2363360879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573b659fdd0 msgr2=0x5573b668a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:55.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.723+0000 7f7311d8b9c0 1 --2- 172.21.15.62:0/2363360879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573b659fdd0 0x5573b668a2d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f7300001eb0 tx=0x7f730000b6b0 comp rx=0 tx=0).stop 2024-09-10T05:36:55.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.723+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/2363360879 shutdown_connections 2024-09-10T05:36:55.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.723+0000 7f7311d8b9c0 1 --2- 172.21.15.62:0/2363360879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573b659fdd0 0x5573b668a2d0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:55.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.723+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/2363360879 >> 172.21.15.62:0/2363360879 conn(0x5573b659b8f0 msgr2=0x5573b6685f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:55.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.723+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/2363360879 shutdown_connections 2024-09-10T05:36:55.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.723+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/2363360879 wait complete. 2024-09-10T05:36:55.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.723+0000 7f7311d8b9c0 1 Processor -- start 2024-09-10T05:36:55.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.723+0000 7f7311d8b9c0 1 -- start start 2024-09-10T05:36:55.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.723+0000 7f7311d8b9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573b659fdd0 0x5573b6691980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:55.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.723+0000 7f7311d8b9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5573b644ba50 con 0x5573b659fdd0 2024-09-10T05:36:55.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.727+0000 7f730f891640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573b659fdd0 0x5573b6691980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:55.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.727+0000 7f730f891640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573b659fdd0 0x5573b6691980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47830/0 (socket says 172.21.15.62:47830) 2024-09-10T05:36:55.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.727+0000 7f730f891640 1 -- 172.21.15.62:0/371763722 learned_addr learned my addr 172.21.15.62:0/371763722 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:55.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.727+0000 7f730f891640 1 -- 172.21.15.62:0/371763722 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573b6691ee0 con 0x5573b659fdd0 2024-09-10T05:36:55.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.727+0000 7f730f891640 1 --2- 172.21.15.62:0/371763722 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573b659fdd0 0x5573b6691980 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f7300001300 tx=0x7f7300000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:55.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.727+0000 7f71f7fff640 1 -- 172.21.15.62:0/371763722 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f730001a7c0 con 0x5573b659fdd0 2024-09-10T05:36:55.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.727+0000 7f71f7fff640 1 -- 172.21.15.62:0/371763722 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f730001a960 con 0x5573b659fdd0 2024-09-10T05:36:55.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.727+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/371763722 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5573b6692170 con 0x5573b659fdd0 2024-09-10T05:36:55.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.727+0000 7f71f7fff640 1 -- 172.21.15.62:0/371763722 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f730001ac40 con 0x5573b659fdd0 2024-09-10T05:36:55.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.727+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/371763722 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573b6692b20 con 0x5573b659fdd0 2024-09-10T05:36:55.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.727+0000 7f71f7fff640 1 -- 172.21.15.62:0/371763722 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f7300017070 con 0x5573b659fdd0 2024-09-10T05:36:55.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.727+0000 7f71f7fff640 1 --2- 172.21.15.62:0/371763722 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f71f8039a70 0x7f71f803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:55.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.727+0000 7f71f7fff640 1 -- 172.21.15.62:0/371763722 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7f7300015020 con 0x5573b659fdd0 2024-09-10T05:36:55.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.727+0000 7f730f090640 1 --2- 172.21.15.62:0/371763722 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f71f8039a70 0x7f71f803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:55.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.727+0000 7f7311d8b9c0 1 --2- 172.21.15.62:0/371763722 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5573b65a3fc0 0x5573b6698af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:55.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.727+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/371763722 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b6699030 con 0x5573b65a3fc0 2024-09-10T05:36:55.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.727+0000 7f7310092640 1 --2- 172.21.15.62:0/371763722 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5573b65a3fc0 0x5573b6698af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:55.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.727+0000 7f730f090640 1 --2- 172.21.15.62:0/371763722 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f71f8039a70 0x7f71f803bf30 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f73040ad000 tx=0x7f73040a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:55.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.727+0000 7f7310092640 1 --2- 172.21.15.62:0/371763722 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5573b65a3fc0 0x5573b6698af0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:55.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.731+0000 7f7310092640 1 -- 172.21.15.62:0/371763722 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b65a3fc0 2024-09-10T05:36:55.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.731+0000 7f7311d8b9c0 1 --2- 172.21.15.62:0/371763722 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5573b6699d90 0x5573b669c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:55.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.731+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/371763722 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b669c770 con 0x5573b6699d90 2024-09-10T05:36:55.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.731+0000 7f730f891640 1 --2- 172.21.15.62:0/371763722 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5573b6699d90 0x5573b669c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:55.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.731+0000 7f730f891640 1 --2- 172.21.15.62:0/371763722 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5573b6699d90 0x5573b669c180 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:55.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.731+0000 7f730f891640 1 -- 172.21.15.62:0/371763722 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f730002e070 con 0x5573b6699d90 2024-09-10T05:36:55.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.731+0000 7f7311d8b9c0 1 --2- 172.21.15.62:0/371763722 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5573b669e530 0x5573b66a0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:55.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.731+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/371763722 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66a0ff0 con 0x5573b669e530 2024-09-10T05:36:55.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.731+0000 7f730f090640 1 --2- 172.21.15.62:0/371763722 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5573b669e530 0x5573b66a0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:55.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.731+0000 7f730f090640 1 --2- 172.21.15.62:0/371763722 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5573b669e530 0x5573b66a0920 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:55.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.731+0000 7f730f090640 1 -- 172.21.15.62:0/371763722 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f73040aa070 con 0x5573b669e530 2024-09-10T05:36:55.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.731+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/371763722 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b669d400 con 0x5573b6699d90 2024-09-10T05:36:55.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.731+0000 7f730f891640 1 -- 172.21.15.62:0/371763722 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f730002e070 con 0x5573b6699d90 2024-09-10T05:36:55.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.731+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/371763722 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b669d7c0 con 0x5573b669e530 2024-09-10T05:36:55.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.735+0000 7f730f090640 1 -- 172.21.15.62:0/371763722 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f73040aa070 con 0x5573b669e530 2024-09-10T05:36:55.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.735+0000 7f7311d8b9c0 1 Processor -- start 2024-09-10T05:36:55.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.735+0000 7f7311d8b9c0 1 -- start start 2024-09-10T05:36:55.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.735+0000 7f7311d8b9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573b66af600 0x5573b66afa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:55.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.735+0000 7f7311d8b9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5573b64b6450 con 0x5573b66af600 2024-09-10T05:36:55.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.735+0000 7f730f891640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573b66af600 0x5573b66afa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:55.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.735+0000 7f730f891640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573b66af600 0x5573b66afa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47838/0 (socket says 172.21.15.62:47838) 2024-09-10T05:36:55.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.735+0000 7f730f891640 1 -- 172.21.15.62:0/4173424574 learned_addr learned my addr 172.21.15.62:0/4173424574 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:55.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.735+0000 7f730f891640 1 -- 172.21.15.62:0/4173424574 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573b66b0060 con 0x5573b66af600 2024-09-10T05:36:55.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.735+0000 7f730f891640 1 --2- 172.21.15.62:0/4173424574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573b66af600 0x5573b66afa20 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f730000eb10 tx=0x7f730000ea60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:55.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.735+0000 7f71f57fa640 1 -- 172.21.15.62:0/4173424574 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f730001c850 con 0x5573b66af600 2024-09-10T05:36:55.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.735+0000 7f71f57fa640 1 -- 172.21.15.62:0/4173424574 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73000480c0 con 0x5573b66af600 2024-09-10T05:36:55.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.735+0000 7f71f57fa640 1 -- 172.21.15.62:0/4173424574 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73000483a0 con 0x5573b66af600 2024-09-10T05:36:55.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.735+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/4173424574 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5573b66b08c0 con 0x5573b66af600 2024-09-10T05:36:55.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.735+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/4173424574 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573b66b0e30 con 0x5573b66af600 2024-09-10T05:36:55.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.739+0000 7f71f57fa640 1 -- 172.21.15.62:0/4173424574 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f730003b070 con 0x5573b66af600 2024-09-10T05:36:55.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.739+0000 7f71f57fa640 1 --2- 172.21.15.62:0/4173424574 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f71e8039ac0 0x7f71e803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:55.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.739+0000 7f71f57fa640 1 -- 172.21.15.62:0/4173424574 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7f730003ebe0 con 0x5573b66af600 2024-09-10T05:36:55.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.739+0000 7f730f090640 1 --2- 172.21.15.62:0/4173424574 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f71e8039ac0 0x7f71e803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:55.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.739+0000 7f7311d8b9c0 1 Processor -- start 2024-09-10T05:36:55.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.739+0000 7f7311d8b9c0 1 -- start start 2024-09-10T05:36:55.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.739+0000 7f7311d8b9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573b66bbdb0 0x5573b66bc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:55.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.739+0000 7f7311d8b9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5573b668ab20 con 0x5573b66bbdb0 2024-09-10T05:36:55.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.739+0000 7f730f090640 1 --2- 172.21.15.62:0/4173424574 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f71e8039ac0 0x7f71e803bf80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x5573b6692dd0 tx=0x7f7304005ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:55.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.739+0000 7f730f891640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573b66bbdb0 0x5573b66bc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:55.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.739+0000 7f730f891640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573b66bbdb0 0x5573b66bc190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47852/0 (socket says 172.21.15.62:47852) 2024-09-10T05:36:55.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.739+0000 7f730f891640 1 -- 172.21.15.62:0/3874606268 learned_addr learned my addr 172.21.15.62:0/3874606268 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:55.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.739+0000 7f730f891640 1 -- 172.21.15.62:0/3874606268 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573b66bc760 con 0x5573b66bbdb0 2024-09-10T05:36:55.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.739+0000 7f730f891640 1 --2- 172.21.15.62:0/3874606268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573b66bbdb0 0x5573b66bc190 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f7300042320 tx=0x7f7300031ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5a8dbcc4b4caaad server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:55.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.739+0000 7f71eeffd640 1 -- 172.21.15.62:0/3874606268 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7300043d60 con 0x5573b66bbdb0 2024-09-10T05:36:55.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.739+0000 7f71eeffd640 1 -- 172.21.15.62:0/3874606268 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f730000f7a0 con 0x5573b66bbdb0 2024-09-10T05:36:55.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.739+0000 7f71eeffd640 1 -- 172.21.15.62:0/3874606268 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f730001ea40 con 0x5573b66bbdb0 2024-09-10T05:36:55.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.739+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/3874606268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573b66bbdb0 msgr2=0x5573b66bc190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:55.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.739+0000 7f7311d8b9c0 1 --2- 172.21.15.62:0/3874606268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573b66bbdb0 0x5573b66bc190 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f7300042320 tx=0x7f7300031ef0 comp rx=0 tx=0).stop 2024-09-10T05:36:55.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.739+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/3874606268 shutdown_connections 2024-09-10T05:36:55.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.739+0000 7f7311d8b9c0 1 --2- 172.21.15.62:0/3874606268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573b66bbdb0 0x5573b66bc190 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:55.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.739+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/3874606268 >> 172.21.15.62:0/3874606268 conn(0x5573b66b81e0 msgr2=0x5573b66b6420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:55.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.739+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/3874606268 shutdown_connections 2024-09-10T05:36:55.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.739+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/3874606268 wait complete. 2024-09-10T05:36:55.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.739+0000 7f7311d8b9c0 1 Processor -- start 2024-09-10T05:36:55.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.739+0000 7f7311d8b9c0 1 -- start start 2024-09-10T05:36:55.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.743+0000 7f7311d8b9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573b66bbdb0 0x5573b66c3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:55.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.743+0000 7f7311d8b9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5573b66bcc40 con 0x5573b66bbdb0 2024-09-10T05:36:55.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.743+0000 7f730f891640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573b66bbdb0 0x5573b66c3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:55.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.743+0000 7f730f891640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573b66bbdb0 0x5573b66c3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47858/0 (socket says 172.21.15.62:47858) 2024-09-10T05:36:55.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.743+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 learned_addr learned my addr 172.21.15.62:0/904842470 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:55.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.743+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573b66c3660 con 0x5573b66bbdb0 2024-09-10T05:36:55.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.743+0000 7f730f891640 1 --2- 172.21.15.62:0/904842470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573b66bbdb0 0x5573b66c3100 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f7300043ac0 tx=0x7f730001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:55.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.743+0000 7f71ed7fa640 1 -- 172.21.15.62:0/904842470 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7300073070 con 0x5573b66bbdb0 2024-09-10T05:36:55.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.743+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5573b66c3660 con 0x5573b66bbdb0 2024-09-10T05:36:55.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.743+0000 7f71ed7fa640 1 -- 172.21.15.62:0/904842470 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7300048a30 con 0x5573b66bbdb0 2024-09-10T05:36:55.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.743+0000 7f71ed7fa640 1 -- 172.21.15.62:0/904842470 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7300031460 con 0x5573b66bbdb0 2024-09-10T05:36:55.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.743+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573b66c3660 con 0x5573b66bbdb0 2024-09-10T05:36:55.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.743+0000 7f71ed7fa640 1 -- 172.21.15.62:0/904842470 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f7300076070 con 0x5573b66bbdb0 2024-09-10T05:36:55.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.743+0000 7f71ed7fa640 1 --2- 172.21.15.62:0/904842470 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f71d8039a70 0x7f71d803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:55.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.743+0000 7f71ed7fa640 1 -- 172.21.15.62:0/904842470 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7f7300079c10 con 0x5573b66bbdb0 2024-09-10T05:36:55.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.743+0000 7f730f090640 1 --2- 172.21.15.62:0/904842470 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f71d8039a70 0x7f71d803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:55.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.743+0000 7f7311d8b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:55.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.743+0000 7f7311d8b9c0 1 --2- 172.21.15.62:0/904842470 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5573b66ce030 0x5573b66d04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:55.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.743+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66d0c40 con 0x5573b66ce030 2024-09-10T05:36:55.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.743+0000 7f7310092640 1 --2- 172.21.15.62:0/904842470 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5573b66ce030 0x5573b66d04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:55.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.743+0000 7f730f090640 1 --2- 172.21.15.62:0/904842470 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f71d8039a70 0x7f71d803bf30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f730401d2d0 tx=0x7f73040a9000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:55.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.747+0000 7f7310092640 1 --2- 172.21.15.62:0/904842470 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5573b66ce030 0x5573b66d04f0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:55.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.747+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:55.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.747+0000 7f7311d8b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:55.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.747+0000 7f7311d8b9c0 20 realm 2024-09-10T05:36:55.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.747+0000 7f7311d8b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:55.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.747+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66cd3b0 con 0x5573b66ce030 2024-09-10T05:36:55.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.747+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:55.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.747+0000 7f7311d8b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:55.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.747+0000 7f7311d8b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:55.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.747+0000 7f7311d8b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:55.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.747+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66d1700 con 0x5573b66ce030 2024-09-10T05:36:55.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.747+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:55.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.747+0000 7f7311d8b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:55.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.747+0000 7f7311d8b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:55.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.747+0000 7f7311d8b9c0 1 --2- 172.21.15.62:0/904842470 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5573b66d24e0 0x5573b66d48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:55.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.747+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66d4fa0 con 0x5573b66d24e0 2024-09-10T05:36:55.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.747+0000 7f730f891640 1 --2- 172.21.15.62:0/904842470 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5573b66d24e0 0x5573b66d48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:55.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.747+0000 7f730f891640 1 --2- 172.21.15.62:0/904842470 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5573b66d24e0 0x5573b66d48d0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:55.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.747+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.747+0000 7f7311d8b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:55.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.747+0000 7f7311d8b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:55.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.747+0000 7f7311d8b9c0 1 --2- 172.21.15.62:0/904842470 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5573b66d5d00 0x5573b66d8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:55.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.747+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66d8890 con 0x5573b66d5d00 2024-09-10T05:36:55.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.747+0000 7f730f090640 1 --2- 172.21.15.62:0/904842470 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5573b66d5d00 0x5573b66d8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:55.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.747+0000 7f730f090640 1 --2- 172.21.15.62:0/904842470 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5573b66d5d00 0x5573b66d8130 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:55.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.747+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.747+0000 7f7311d8b9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:55.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.747+0000 7f7311d8b9c0 20 searching for the correct realm 2024-09-10T05:36:55.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.747+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573b66da160 con 0x5573b66d5d00 2024-09-10T05:36:55.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.751+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.751+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573b66da160 con 0x5573b66d24e0 2024-09-10T05:36:55.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.751+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.751+0000 7f730f891640 1 --2- 172.21.15.62:0/904842470 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f7300078060 0x7f730003d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:55.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.751+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573b66da160 con 0x7f7300078060 2024-09-10T05:36:55.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.751+0000 7f7310092640 1 --2- 172.21.15.62:0/904842470 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f7300078060 0x7f730003d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:55.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.751+0000 7f7310092640 1 --2- 172.21.15.62:0/904842470 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f7300078060 0x7f730003d410 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:55.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.751+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730800a4d0 con 0x7f7300078060 2024-09-10T05:36:55.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.751+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573b66da160 con 0x5573b66ce030 2024-09-10T05:36:55.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.751+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:55.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.751+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573b66da160 con 0x5573b66ce030 2024-09-10T05:36:55.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.751+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:55.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.751+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573b66da160 con 0x5573b66d5d00 2024-09-10T05:36:55.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.751+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.751+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573b66da160 con 0x5573b66ce030 2024-09-10T05:36:55.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.751+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:55.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.751+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573b66da160 con 0x5573b66d24e0 2024-09-10T05:36:55.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.751+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.751+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573b66da160 con 0x5573b66d24e0 2024-09-10T05:36:55.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.755+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.755+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573b66da160 con 0x5573b66ce030 2024-09-10T05:36:55.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.755+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:55.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.755+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573b66da160 con 0x7f7300078060 2024-09-10T05:36:55.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.755+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730800a4d0 con 0x7f7300078060 2024-09-10T05:36:55.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.755+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573b66da160 con 0x5573b66ce030 2024-09-10T05:36:55.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.755+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:55.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.755+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573b66da160 con 0x7f7300078060 2024-09-10T05:36:55.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.755+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f730800a4d0 con 0x7f7300078060 2024-09-10T05:36:55.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.755+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573b66da160 con 0x5573b66d24e0 2024-09-10T05:36:55.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.755+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.755+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573b66da160 con 0x5573b66d5d00 2024-09-10T05:36:55.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.755+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.755+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573b66da160 con 0x5573b66ce030 2024-09-10T05:36:55.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.755+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:55.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.755+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573b66da160 con 0x5573b66d24e0 2024-09-10T05:36:55.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.755+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.755+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573b66da160 con 0x5573b66d5d00 2024-09-10T05:36:55.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.759+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 32 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.759+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573b66da160 con 0x5573b66ce030 2024-09-10T05:36:55.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.759+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:55.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.759+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573b66da160 con 0x5573b66ce030 2024-09-10T05:36:55.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.759+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:55.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.759+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573b66da160 con 0x5573b66ce030 2024-09-10T05:36:55.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.759+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:55.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.759+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573b66da160 con 0x5573b66d5d00 2024-09-10T05:36:55.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.759+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.759+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573b66da160 con 0x7f7300078060 2024-09-10T05:36:55.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.759+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730800a4d0 con 0x7f7300078060 2024-09-10T05:36:55.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.759+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573b66da160 con 0x5573b66ce030 2024-09-10T05:36:55.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.759+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:55.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.759+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573b66da160 con 0x7f7300078060 2024-09-10T05:36:55.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.759+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730800a4d0 con 0x7f7300078060 2024-09-10T05:36:55.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.759+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573b66da160 con 0x5573b66d5d00 2024-09-10T05:36:55.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.759+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.759+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573b66da160 con 0x7f7300078060 2024-09-10T05:36:55.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.759+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730800a4d0 con 0x7f7300078060 2024-09-10T05:36:55.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.759+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573b66da160 con 0x5573b66d24e0 2024-09-10T05:36:55.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.759+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.759+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573b66da160 con 0x5573b66d24e0 2024-09-10T05:36:55.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.763+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.763+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573b66da160 con 0x5573b66d5d00 2024-09-10T05:36:55.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.763+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.763+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573b66da160 con 0x5573b66d24e0 2024-09-10T05:36:55.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.763+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.763+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573b66da160 con 0x5573b66d24e0 2024-09-10T05:36:55.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.763+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.763+0000 7f7311d8b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:55.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.763+0000 7f7311d8b9c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:55.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.763+0000 7f7311d8b9c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:55.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.763+0000 7f7311d8b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:55.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.763+0000 7f7311d8b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:55.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.763+0000 7f7311d8b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:55.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.763+0000 7f7311d8b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:55.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.763+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66d9250 con 0x5573b66ce030 2024-09-10T05:36:55.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.763+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:55.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.763+0000 7f7311d8b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:55.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.763+0000 7f7311d8b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:55.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.763+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66d8e90 con 0x5573b66d24e0 2024-09-10T05:36:55.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.763+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.763+0000 7f7311d8b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:55.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.763+0000 7f7311d8b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:55.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.763+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66d9bf0 con 0x5573b66d5d00 2024-09-10T05:36:55.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.767+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.767+0000 7f7311d8b9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:55.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.767+0000 7f7311d8b9c0 20 zone default found 2024-09-10T05:36:55.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.767+0000 7f7311d8b9c0 4 Realm: () 2024-09-10T05:36:55.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.767+0000 7f7311d8b9c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:55.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.767+0000 7f7311d8b9c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:55.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.767+0000 7f7311d8b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:55.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.767+0000 7f7311d8b9c0 20 zonegroup default 2024-09-10T05:36:55.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.767+0000 7f7311d8b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:55.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.767+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66daa40 con 0x7f7300078060 2024-09-10T05:36:55.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.767+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f730800a4d0 con 0x7f7300078060 2024-09-10T05:36:55.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.767+0000 7f7311d8b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:55.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.767+0000 7f7311d8b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:55.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.767+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66dcc80 con 0x5573b66d5d00 2024-09-10T05:36:55.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.767+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.767+0000 7f7311d8b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:55.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.767+0000 7f7311d8b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:55.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.767+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66dd020 con 0x5573b66d5d00 2024-09-10T05:36:55.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.767+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.767+0000 7f7311d8b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:55.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.767+0000 7f7311d8b9c0 20 started sync module instance, tier type = 2024-09-10T05:36:55.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.767+0000 7f7311d8b9c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:55.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.767+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66dc0c0 con 0x5573b66d24e0 2024-09-10T05:36:55.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.767+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.767+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93955470247136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66dbd20 con 0x5573b66d24e0 2024-09-10T05:36:55.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.767+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ddd60 con 0x5573b66ce030 2024-09-10T05:36:55.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.771+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:55.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.771+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93955470254416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66dea20 con 0x5573b66ce030 2024-09-10T05:36:55.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.771+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66df3e0 con 0x5573b66d24e0 2024-09-10T05:36:55.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.771+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 93955470247136] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.771+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93955470254416] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:55.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.771+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.771+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93955470257968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66dea20 con 0x5573b66d24e0 2024-09-10T05:36:55.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.771+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66df350 con 0x7f7300078060 2024-09-10T05:36:55.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.775+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f730800a4d0 con 0x7f7300078060 2024-09-10T05:36:55.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.775+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93955470260176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66df350 con 0x7f7300078060 2024-09-10T05:36:55.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.775+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66e06c0 con 0x5573b66d24e0 2024-09-10T05:36:55.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.775+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93955470257968] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.775+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93955470260176] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f730800a4d0 con 0x7f7300078060 2024-09-10T05:36:55.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.775+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.775+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93955470261232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66e0210 con 0x5573b66d24e0 2024-09-10T05:36:55.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.775+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66e0f60 con 0x5573b66d5d00 2024-09-10T05:36:55.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.779+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.779+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93955470265008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66e0210 con 0x5573b66d5d00 2024-09-10T05:36:55.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.779+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66e19a0 con 0x5573b66d5d00 2024-09-10T05:36:55.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.779+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 93955470261232] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.779+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93955470265008] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.779+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.779+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93955470266064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66e14f0 con 0x5573b66d5d00 2024-09-10T05:36:55.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.779+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66e2240 con 0x7f7300078060 2024-09-10T05:36:55.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.779+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93955470266064] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.779+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f730800a4d0 con 0x7f7300078060 2024-09-10T05:36:55.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.779+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93955470255472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66e14f0 con 0x7f7300078060 2024-09-10T05:36:55.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.779+0000 7f7311d8b9c0 20 add_watcher() i=0 2024-09-10T05:36:55.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.779+0000 7f7311d8b9c0 20 add_watcher() i=1 2024-09-10T05:36:55.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.779+0000 7f7311d8b9c0 20 add_watcher() i=2 2024-09-10T05:36:55.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.779+0000 7f7311d8b9c0 20 add_watcher() i=3 2024-09-10T05:36:55.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.779+0000 7f7311d8b9c0 20 add_watcher() i=4 2024-09-10T05:36:55.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.779+0000 7f7311d8b9c0 20 add_watcher() i=5 2024-09-10T05:36:55.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.779+0000 7f7311d8b9c0 20 add_watcher() i=6 2024-09-10T05:36:55.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.783+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93955470255472] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f730800a4d0 con 0x7f7300078060 2024-09-10T05:36:55.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.783+0000 7f7311d8b9c0 20 add_watcher() i=7 2024-09-10T05:36:55.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.783+0000 7f7311d8b9c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:55.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.783+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66e52a0 con 0x5573b66ce030 2024-09-10T05:36:55.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.783+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:55.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.783+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93955470269840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66e2760 con 0x5573b66ce030 2024-09-10T05:36:55.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.783+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93955470269840] v32'163 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:55.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.783+0000 7f71c5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:55.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.783+0000 7f7311d8b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:55.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.783+0000 7f7311d8b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:55.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.783+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66edb40 con 0x5573b66d24e0 2024-09-10T05:36:55.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.787+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'49 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.787+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66edc30 con 0x7f7300078060 2024-09-10T05:36:55.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.787+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'25 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f730800a4d0 con 0x7f7300078060 2024-09-10T05:36:55.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.787+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ee320 con 0x5573b66d5d00 2024-09-10T05:36:55.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.791+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.791+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ee7d0 con 0x5573b66ce030 2024-09-10T05:36:55.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.791+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'164 uv12 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:55.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.791+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66eba70 con 0x5573b66d24e0 2024-09-10T05:36:55.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.795+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'53 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.795+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66eba70 con 0x5573b66d5d00 2024-09-10T05:36:55.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.795+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'43 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.795+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66eca80 con 0x5573b66d24e0 2024-09-10T05:36:55.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.799+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'29 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.799+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ecae0 con 0x5573b66ce030 2024-09-10T05:36:55.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.803+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'37 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:55.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.803+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ef330 con 0x5573b66d24e0 2024-09-10T05:36:55.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.803+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.803+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ef330 con 0x5573b66d24e0 2024-09-10T05:36:55.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.807+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'25 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.807+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ef330 con 0x5573b66d24e0 2024-09-10T05:36:55.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.807+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'54 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.807+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ef330 con 0x5573b66d5d00 2024-09-10T05:36:55.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.811+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.811+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ef330 con 0x5573b66d24e0 2024-09-10T05:36:55.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.811+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'25 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.811+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ef8e0 con 0x5573b66ce030 2024-09-10T05:36:55.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.815+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'49 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:55.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.815+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ef610 con 0x5573b66ce030 2024-09-10T05:36:55.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.815+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'165 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:55.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.815+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ef740 con 0x5573b66d24e0 2024-09-10T05:36:55.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.819+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 25 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'48 uv16 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.819+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ef740 con 0x5573b66d24e0 2024-09-10T05:36:55.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.823+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 26 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'55 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.823+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ef740 con 0x5573b66d5d00 2024-09-10T05:36:55.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.823+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'31 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.823+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ef840 con 0x5573b66d24e0 2024-09-10T05:36:55.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.827+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'27 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.827+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ef840 con 0x5573b66ce030 2024-09-10T05:36:55.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.827+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'166 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:55.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.827+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66efa10 con 0x5573b66d24e0 2024-09-10T05:36:55.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.831+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 28 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'49 uv18 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.831+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66efa10 con 0x7f7300078060 2024-09-10T05:36:55.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.835+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'35 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f730800a4d0 con 0x7f7300078060 2024-09-10T05:36:55.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.835+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66efa10 con 0x5573b66d5d00 2024-09-10T05:36:55.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.835+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'27 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.835+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66efa10 con 0x5573b66d24e0 2024-09-10T05:36:55.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.839+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 29 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'38 uv18 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.839+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66efe50 con 0x5573b66d5d00 2024-09-10T05:36:55.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.839+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 21 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.839+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66efcf0 con 0x5573b66d5d00 2024-09-10T05:36:55.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.843+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 22 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'44 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.843+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66efcf0 con 0x5573b66d5d00 2024-09-10T05:36:55.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.843+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 23 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'27 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.843+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66efcf0 con 0x5573b66d24e0 2024-09-10T05:36:55.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.847+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 30 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'32 uv30 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.847+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66efcf0 con 0x5573b66ce030 2024-09-10T05:36:55.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.851+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'38 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:55.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.851+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66efcf0 con 0x5573b66d24e0 2024-09-10T05:36:55.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.855+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 31 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'50 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.855+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66efcf0 con 0x5573b66ce030 2024-09-10T05:36:55.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.855+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'50 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:55.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.855+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66efcf0 con 0x7f7300078060 2024-09-10T05:36:55.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.859+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f730800a4d0 con 0x7f7300078060 2024-09-10T05:36:55.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.859+0000 7f71c4fe1640 20 reqs_thread_entry: start 2024-09-10T05:36:55.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.859+0000 7f7311d8b9c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:55.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.859+0000 7f7311d8b9c0 20 Filter name: none 2024-09-10T05:36:55.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.859+0000 7f713e7fc640 20 reqs_thread_entry: start 2024-09-10T05:36:55.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.859+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2024-09-10T05:36:55.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.859+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:94 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d24e0 2024-09-10T05:36:55.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.863+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 32 ==== osd_op_reply(94 gc.10 [call] v32'56 uv56 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.863+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:95 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d24e0 2024-09-10T05:36:55.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.863+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 33 ==== osd_op_reply(95 gc.10 [call out=15b] v0'0 uv56 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.863+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:55.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.863+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:96 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d24e0 2024-09-10T05:36:55.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.863+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 34 ==== osd_op_reply(96 gc.10 [call out=24b] v0'0 uv56 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.863+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:97 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d24e0 2024-09-10T05:36:55.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.867+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 35 ==== osd_op_reply(97 gc.10 [call out=15b] v0'0 uv56 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.867+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:36:55.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.867+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:98 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d24e0 2024-09-10T05:36:55.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.867+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 36 ==== osd_op_reply(98 gc.10 [call out=15b] v0'0 uv56 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.867+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:55.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.867+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:99 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d24e0 2024-09-10T05:36:55.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.871+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 37 ==== osd_op_reply(99 gc.10 [call] v32'57 uv57 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.871+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2024-09-10T05:36:55.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.871+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:100 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d5d00 2024-09-10T05:36:55.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.871+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 24 ==== osd_op_reply(100 gc.11 [call] v32'24 uv24 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.871+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:101 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d5d00 2024-09-10T05:36:55.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.871+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 25 ==== osd_op_reply(101 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.871+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:55.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.871+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:102 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d5d00 2024-09-10T05:36:55.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.875+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 26 ==== osd_op_reply(102 gc.11 [call out=24b] v0'0 uv24 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.875+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:103 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d5d00 2024-09-10T05:36:55.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.875+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 27 ==== osd_op_reply(103 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.875+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:36:55.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.875+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:104 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d5d00 2024-09-10T05:36:55.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.875+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 28 ==== osd_op_reply(104 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.875+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:55.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.875+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:105 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d5d00 2024-09-10T05:36:55.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.875+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 29 ==== osd_op_reply(105 gc.11 [call] v32'25 uv25 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.875+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2024-09-10T05:36:55.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.875+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:106 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d24e0 2024-09-10T05:36:55.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.879+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 38 ==== osd_op_reply(106 gc.12 [call] v32'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.879+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:107 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d24e0 2024-09-10T05:36:55.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.879+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 39 ==== osd_op_reply(107 gc.12 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.879+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:55.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.879+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:108 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d24e0 2024-09-10T05:36:55.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.879+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 40 ==== osd_op_reply(108 gc.12 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.879+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:109 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d24e0 2024-09-10T05:36:55.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.883+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 41 ==== osd_op_reply(109 gc.12 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.883+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:36:55.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.883+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:110 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d24e0 2024-09-10T05:36:55.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.883+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 42 ==== osd_op_reply(110 gc.12 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.883+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:55.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.883+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:111 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d24e0 2024-09-10T05:36:55.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.883+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 43 ==== osd_op_reply(111 gc.12 [call] v32'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.883+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2024-09-10T05:36:55.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.883+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:112 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66ce030 2024-09-10T05:36:55.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.887+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 26 ==== osd_op_reply(112 gc.13 [call] v32'51 uv51 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:55.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.887+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:113 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66ce030 2024-09-10T05:36:55.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.887+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 27 ==== osd_op_reply(113 gc.13 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:55.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.887+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:55.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.887+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:114 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66ce030 2024-09-10T05:36:55.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.887+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 28 ==== osd_op_reply(114 gc.13 [call out=24b] v0'0 uv51 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:55.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.887+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:115 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66ce030 2024-09-10T05:36:55.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.887+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 29 ==== osd_op_reply(115 gc.13 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:55.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.887+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:36:55.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.887+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:116 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66ce030 2024-09-10T05:36:55.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.887+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 30 ==== osd_op_reply(116 gc.13 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:55.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.887+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:55.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.887+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:117 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66ce030 2024-09-10T05:36:55.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.891+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 31 ==== osd_op_reply(117 gc.13 [call] v32'52 uv52 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:55.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.891+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2024-09-10T05:36:55.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.891+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:118 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66ce030 2024-09-10T05:36:55.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.895+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 32 ==== osd_op_reply(118 gc.14 [call] v32'167 uv167 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:55.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.895+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:119 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66ce030 2024-09-10T05:36:55.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.895+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 33 ==== osd_op_reply(119 gc.14 [call out=15b] v0'0 uv167 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:55.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.895+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:55.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.895+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:120 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66ce030 2024-09-10T05:36:55.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.895+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 34 ==== osd_op_reply(120 gc.14 [call out=24b] v0'0 uv167 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:55.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.895+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:121 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66ce030 2024-09-10T05:36:55.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.895+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 35 ==== osd_op_reply(121 gc.14 [call out=15b] v0'0 uv167 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:55.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.895+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:36:55.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.895+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:122 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66ce030 2024-09-10T05:36:55.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.895+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 36 ==== osd_op_reply(122 gc.14 [call out=15b] v0'0 uv167 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:55.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.895+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:55.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.895+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:123 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66ce030 2024-09-10T05:36:55.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.895+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 37 ==== osd_op_reply(123 gc.14 [call] v32'168 uv168 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:55.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.895+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2024-09-10T05:36:55.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.895+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:124 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d24e0 2024-09-10T05:36:55.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.899+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 44 ==== osd_op_reply(124 gc.15 [call] v32'51 uv51 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.899+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:125 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d24e0 2024-09-10T05:36:55.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.899+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 45 ==== osd_op_reply(125 gc.15 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.899+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:55.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.899+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:126 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d24e0 2024-09-10T05:36:55.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.903+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 46 ==== osd_op_reply(126 gc.15 [call out=24b] v0'0 uv51 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.903+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:127 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d24e0 2024-09-10T05:36:55.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.903+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 47 ==== osd_op_reply(127 gc.15 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.903+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:36:55.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.903+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:128 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d24e0 2024-09-10T05:36:55.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.903+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 48 ==== osd_op_reply(128 gc.15 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.903+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:55.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.903+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:129 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d24e0 2024-09-10T05:36:55.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.907+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 49 ==== osd_op_reply(129 gc.15 [call] v32'52 uv52 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.907+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2024-09-10T05:36:55.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.907+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:130 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d24e0 2024-09-10T05:36:55.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.911+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 50 ==== osd_op_reply(130 gc.16 [call] v32'58 uv58 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.911+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:131 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d24e0 2024-09-10T05:36:55.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.911+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 51 ==== osd_op_reply(131 gc.16 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.911+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:55.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.911+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:132 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d24e0 2024-09-10T05:36:55.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.915+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 52 ==== osd_op_reply(132 gc.16 [call out=24b] v0'0 uv58 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.915+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:133 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d24e0 2024-09-10T05:36:55.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.915+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 53 ==== osd_op_reply(133 gc.16 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.915+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:36:55.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.915+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:134 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d24e0 2024-09-10T05:36:55.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.915+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 54 ==== osd_op_reply(134 gc.16 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.915+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:55.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.915+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:135 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d24e0 2024-09-10T05:36:55.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.919+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 55 ==== osd_op_reply(135 gc.16 [call] v32'59 uv59 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.919+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2024-09-10T05:36:55.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.919+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:136 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d5d00 2024-09-10T05:36:55.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.923+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 30 ==== osd_op_reply(136 gc.17 [call] v32'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.923+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:137 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d5d00 2024-09-10T05:36:55.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.923+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 31 ==== osd_op_reply(137 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.923+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:55.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.923+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:138 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d5d00 2024-09-10T05:36:55.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.923+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 32 ==== osd_op_reply(138 gc.17 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.923+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:139 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d5d00 2024-09-10T05:36:55.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.923+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 33 ==== osd_op_reply(139 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.923+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:36:55.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.923+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:140 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d5d00 2024-09-10T05:36:55.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.923+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 34 ==== osd_op_reply(140 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.923+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:55.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.923+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:141 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d5d00 2024-09-10T05:36:55.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.927+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 35 ==== osd_op_reply(141 gc.17 [call] v32'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.927+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2024-09-10T05:36:55.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.927+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:142 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d24e0 2024-09-10T05:36:55.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.927+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 56 ==== osd_op_reply(142 gc.18 [call] v32'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.927+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:143 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d24e0 2024-09-10T05:36:55.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.931+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 57 ==== osd_op_reply(143 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.931+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:55.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.931+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:144 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d24e0 2024-09-10T05:36:55.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.931+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 58 ==== osd_op_reply(144 gc.18 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.931+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:145 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d24e0 2024-09-10T05:36:55.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.931+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 59 ==== osd_op_reply(145 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.931+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:36:55.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.931+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:146 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d24e0 2024-09-10T05:36:55.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.931+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 60 ==== osd_op_reply(146 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.931+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:55.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.931+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:147 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d24e0 2024-09-10T05:36:55.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.935+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 61 ==== osd_op_reply(147 gc.18 [call] v32'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.935+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2024-09-10T05:36:55.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.935+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:148 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66ce030 2024-09-10T05:36:55.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.935+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 38 ==== osd_op_reply(148 gc.19 [call] v32'169 uv169 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:55.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.939+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:149 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66ce030 2024-09-10T05:36:55.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.939+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 39 ==== osd_op_reply(149 gc.19 [call out=15b] v0'0 uv169 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:55.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.939+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:55.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.939+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:150 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66ce030 2024-09-10T05:36:55.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.939+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 40 ==== osd_op_reply(150 gc.19 [call out=24b] v0'0 uv169 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:55.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.939+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66ce030 2024-09-10T05:36:55.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.939+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 41 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv169 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:55.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.939+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:36:55.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.939+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66ce030 2024-09-10T05:36:55.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.939+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 42 ==== osd_op_reply(152 gc.19 [call out=15b] v0'0 uv169 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:55.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.939+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:55.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.939+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66ce030 2024-09-10T05:36:55.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.943+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 43 ==== osd_op_reply(153 gc.19 [call] v32'170 uv170 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:55.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.943+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2024-09-10T05:36:55.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.943+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d24e0 2024-09-10T05:36:55.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.943+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 62 ==== osd_op_reply(154 gc.20 [call] v32'53 uv53 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.943+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d24e0 2024-09-10T05:36:55.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.947+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 63 ==== osd_op_reply(155 gc.20 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.947+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:55.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.947+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d24e0 2024-09-10T05:36:55.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.947+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 64 ==== osd_op_reply(156 gc.20 [call out=24b] v0'0 uv53 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.947+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:157 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d24e0 2024-09-10T05:36:55.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.947+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 65 ==== osd_op_reply(157 gc.20 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.947+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:36:55.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.947+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:158 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d24e0 2024-09-10T05:36:55.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.951+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 66 ==== osd_op_reply(158 gc.20 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.951+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:55.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.951+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:159 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d24e0 2024-09-10T05:36:55.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.951+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 67 ==== osd_op_reply(159 gc.20 [call] v32'54 uv54 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.951+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2024-09-10T05:36:55.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.951+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:160 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x7f7300078060 2024-09-10T05:36:55.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.955+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.2 v2:172.21.15.62:6800/2677868286 15 ==== osd_op_reply(160 gc.21 [call] v32'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f730800a4d0 con 0x7f7300078060 2024-09-10T05:36:55.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.955+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:161 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x7f7300078060 2024-09-10T05:36:55.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.955+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.2 v2:172.21.15.62:6800/2677868286 16 ==== osd_op_reply(161 gc.21 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f730800a4d0 con 0x7f7300078060 2024-09-10T05:36:55.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.955+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:55.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.955+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:162 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x7f7300078060 2024-09-10T05:36:55.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.955+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.2 v2:172.21.15.62:6800/2677868286 17 ==== osd_op_reply(162 gc.21 [call out=24b] v0'0 uv36 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f730800a4d0 con 0x7f7300078060 2024-09-10T05:36:55.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.955+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:163 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x7f7300078060 2024-09-10T05:36:55.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.955+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.2 v2:172.21.15.62:6800/2677868286 18 ==== osd_op_reply(163 gc.21 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f730800a4d0 con 0x7f7300078060 2024-09-10T05:36:55.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.955+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:36:55.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.955+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:164 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x7f7300078060 2024-09-10T05:36:55.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.959+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.2 v2:172.21.15.62:6800/2677868286 19 ==== osd_op_reply(164 gc.21 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f730800a4d0 con 0x7f7300078060 2024-09-10T05:36:55.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.959+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:55.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.959+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:165 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x7f7300078060 2024-09-10T05:36:55.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.959+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.2 v2:172.21.15.62:6800/2677868286 20 ==== osd_op_reply(165 gc.21 [call] v32'37 uv37 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f730800a4d0 con 0x7f7300078060 2024-09-10T05:36:55.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.959+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2024-09-10T05:36:55.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.959+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:166 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d5d00 2024-09-10T05:36:55.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.963+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 36 ==== osd_op_reply(166 gc.22 [call] v32'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.963+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:167 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d5d00 2024-09-10T05:36:55.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.963+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 37 ==== osd_op_reply(167 gc.22 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.963+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:55.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.963+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:168 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d5d00 2024-09-10T05:36:55.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.963+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 38 ==== osd_op_reply(168 gc.22 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.963+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:169 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d5d00 2024-09-10T05:36:55.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.963+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 39 ==== osd_op_reply(169 gc.22 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.963+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:36:55.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.963+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:170 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d5d00 2024-09-10T05:36:55.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.963+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 40 ==== osd_op_reply(170 gc.22 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.963+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:55.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.963+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:171 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d5d00 2024-09-10T05:36:55.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.967+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 41 ==== osd_op_reply(171 gc.22 [call] v32'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.967+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2024-09-10T05:36:55.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.967+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:172 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d24e0 2024-09-10T05:36:55.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.967+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 68 ==== osd_op_reply(172 gc.23 [call] v32'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.967+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:173 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d24e0 2024-09-10T05:36:55.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.971+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 69 ==== osd_op_reply(173 gc.23 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.971+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:55.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.971+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:174 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d24e0 2024-09-10T05:36:55.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.971+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 70 ==== osd_op_reply(174 gc.23 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.971+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:175 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d24e0 2024-09-10T05:36:55.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.971+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 71 ==== osd_op_reply(175 gc.23 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.971+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:36:55.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.971+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:176 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d24e0 2024-09-10T05:36:55.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.971+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 72 ==== osd_op_reply(176 gc.23 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.971+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:55.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.975+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:177 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d24e0 2024-09-10T05:36:55.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.975+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 73 ==== osd_op_reply(177 gc.23 [call] v32'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:55.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.975+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2024-09-10T05:36:55.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.975+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:178 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d5d00 2024-09-10T05:36:55.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.979+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 42 ==== osd_op_reply(178 gc.24 [call] v32'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.979+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:179 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d5d00 2024-09-10T05:36:55.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.979+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 43 ==== osd_op_reply(179 gc.24 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.979+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:55.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.979+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:180 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d5d00 2024-09-10T05:36:55.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.979+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 44 ==== osd_op_reply(180 gc.24 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.979+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:181 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d5d00 2024-09-10T05:36:55.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.979+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 45 ==== osd_op_reply(181 gc.24 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.979+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:36:55.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.979+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:182 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d5d00 2024-09-10T05:36:55.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.983+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 46 ==== osd_op_reply(182 gc.24 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.983+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:55.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.983+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:183 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d5d00 2024-09-10T05:36:55.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.983+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 47 ==== osd_op_reply(183 gc.24 [call] v32'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.983+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2024-09-10T05:36:55.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.983+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:184 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d5d00 2024-09-10T05:36:55.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.987+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 48 ==== osd_op_reply(184 gc.25 [call] v32'45 uv45 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.987+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:185 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d5d00 2024-09-10T05:36:55.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.987+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 49 ==== osd_op_reply(185 gc.25 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.987+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:55.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.987+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:186 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d5d00 2024-09-10T05:36:55.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.987+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 50 ==== osd_op_reply(186 gc.25 [call out=24b] v0'0 uv45 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.987+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:187 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d5d00 2024-09-10T05:36:55.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.987+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 51 ==== osd_op_reply(187 gc.25 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.987+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:36:55.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.987+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:188 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d5d00 2024-09-10T05:36:55.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.987+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 52 ==== osd_op_reply(188 gc.25 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.987+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:55.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.987+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:189 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d5d00 2024-09-10T05:36:55.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.991+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 53 ==== osd_op_reply(189 gc.25 [call] v32'46 uv46 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.991+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2024-09-10T05:36:55.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.991+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:190 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d5d00 2024-09-10T05:36:55.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.991+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 54 ==== osd_op_reply(190 gc.26 [call] v32'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.991+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:191 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d5d00 2024-09-10T05:36:55.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.991+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 55 ==== osd_op_reply(191 gc.26 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.995+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:55.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.995+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:192 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d5d00 2024-09-10T05:36:55.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.995+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 56 ==== osd_op_reply(192 gc.26 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.995+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:193 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d5d00 2024-09-10T05:36:55.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.995+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 57 ==== osd_op_reply(193 gc.26 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.995+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:36:55.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.995+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:194 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d5d00 2024-09-10T05:36:55.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.995+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 58 ==== osd_op_reply(194 gc.26 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:55.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.995+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:55.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.995+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:195 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d5d00 2024-09-10T05:36:56.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.999+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 59 ==== osd_op_reply(195 gc.26 [call] v32'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:56.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.999+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2024-09-10T05:36:56.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.999+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:196 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d24e0 2024-09-10T05:36:56.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.999+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 74 ==== osd_op_reply(196 gc.27 [call] v32'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:56.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:55.999+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:197 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d24e0 2024-09-10T05:36:56.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.003+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 75 ==== osd_op_reply(197 gc.27 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:56.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.003+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:56.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.003+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:198 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d24e0 2024-09-10T05:36:56.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.003+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 76 ==== osd_op_reply(198 gc.27 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:56.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.003+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:199 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d24e0 2024-09-10T05:36:56.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.003+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 77 ==== osd_op_reply(199 gc.27 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:56.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.003+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:36:56.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.003+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:200 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ebce0 con 0x5573b66d24e0 2024-09-10T05:36:56.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.007+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 78 ==== osd_op_reply(200 gc.27 [call out=1701b] v0'0 uv33 ondisk = 0) ==== 149+0+1701 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:56.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.007+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-10T05:36:56.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.007+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process iterating over entry tag='475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1622150448642997087', time=2024-09-10T05:36:55.300457+0000, chain.objs.size()=7 2024-09-10T05:36:56.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.007+0000 7f7311d8b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1__shadow_.R3fgt7NCc9bMK5zA1G4esuEOca8qSpK_1 2024-09-10T05:36:56.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.007+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:201 3.34 3:2fad48de:::475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1__shadow_.R3fgt7NCc9bMK5zA1G4esuEOca8qSpK_1:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c180 con 0x5573b66d24e0 2024-09-10T05:36:56.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.007+0000 7f7311d8b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1__shadow_.R3fgt7NCc9bMK5zA1G4esuEOca8qSpK_2 2024-09-10T05:36:56.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.007+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:202 3.2e 3:746eb043:::475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1__shadow_.R3fgt7NCc9bMK5zA1G4esuEOca8qSpK_2:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b670ecf0 con 0x7f7300078060 2024-09-10T05:36:56.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.007+0000 7f7311d8b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1__shadow_.R3fgt7NCc9bMK5zA1G4esuEOca8qSpK_3 2024-09-10T05:36:56.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.007+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:203 3.1b 3:dbf0b07a:::475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1__shadow_.R3fgt7NCc9bMK5zA1G4esuEOca8qSpK_3:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b6711620 con 0x5573b66d5d00 2024-09-10T05:36:56.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.007+0000 7f7311d8b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1__shadow_.R3fgt7NCc9bMK5zA1G4esuEOca8qSpK_4 2024-09-10T05:36:56.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.007+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:204 3.27 3:e6429a1f:::475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1__shadow_.R3fgt7NCc9bMK5zA1G4esuEOca8qSpK_4:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b67140e0 con 0x5573b66d5d00 2024-09-10T05:36:56.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.007+0000 7f7311d8b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1__shadow_.R3fgt7NCc9bMK5zA1G4esuEOca8qSpK_5 2024-09-10T05:36:56.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.007+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:205 3.7 3:e11eff01:::475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1__shadow_.R3fgt7NCc9bMK5zA1G4esuEOca8qSpK_5:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b6716bb0 con 0x5573b66d5d00 2024-09-10T05:36:56.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.007+0000 7f7311d8b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1__shadow_.R3fgt7NCc9bMK5zA1G4esuEOca8qSpK_6 2024-09-10T05:36:56.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.007+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:206 3.27 3:e48ab94d:::475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1__shadow_.R3fgt7NCc9bMK5zA1G4esuEOca8qSpK_6:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b6711620 con 0x5573b66d5d00 2024-09-10T05:36:56.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.007+0000 7f7311d8b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1__shadow_.R3fgt7NCc9bMK5zA1G4esuEOca8qSpK_7 2024-09-10T05:36:56.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.007+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:207 3.33 3:cdc9d3a8:::475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1__shadow_.R3fgt7NCc9bMK5zA1G4esuEOca8qSpK_7:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b6716bb0 con 0x7f7300078060 2024-09-10T05:36:56.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.011+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.2 v2:172.21.15.62:6800/2677868286 21 ==== osd_op_reply(207 475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1__shadow_.R3fgt7NCc9bMK5zA1G4esuEOca8qSpK_7 [call] v32'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f730800a4d0 con 0x7f7300078060 2024-09-10T05:36:56.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.011+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 60 ==== osd_op_reply(203 475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1__shadow_.R3fgt7NCc9bMK5zA1G4esuEOca8qSpK_3 [call] v32'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:56.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.011+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.2 v2:172.21.15.62:6800/2677868286 22 ==== osd_op_reply(202 475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1__shadow_.R3fgt7NCc9bMK5zA1G4esuEOca8qSpK_2 [call] v32'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f730800a4d0 con 0x7f7300078060 2024-09-10T05:36:56.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.011+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 79 ==== osd_op_reply(201 475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1__shadow_.R3fgt7NCc9bMK5zA1G4esuEOca8qSpK_1 [call] v32'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:56.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.011+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 61 ==== osd_op_reply(204 475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1__shadow_.R3fgt7NCc9bMK5zA1G4esuEOca8qSpK_4 [call] v32'3 uv3 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:56.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.011+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 62 ==== osd_op_reply(205 475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1__shadow_.R3fgt7NCc9bMK5zA1G4esuEOca8qSpK_5 [call] v32'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:56.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.015+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 63 ==== osd_op_reply(206 475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.1__shadow_.R3fgt7NCc9bMK5zA1G4esuEOca8qSpK_6 [call] v32'4 uv4 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:56.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.015+0000 7f7311d8b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-10T05:36:56.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.015+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:208 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b670e660 con 0x5573b66d24e0 2024-09-10T05:36:56.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.015+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 80 ==== osd_op_reply(208 gc.27 [call] v32'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:56.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.015+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:209 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b670e660 con 0x5573b66d24e0 2024-09-10T05:36:56.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.019+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 81 ==== osd_op_reply(209 gc.27 [call] v32'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:56.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.019+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2024-09-10T05:36:56.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.019+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:210 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b670e660 con 0x5573b66ce030 2024-09-10T05:36:56.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.023+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 44 ==== osd_op_reply(210 gc.28 [call] v32'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:56.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.023+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:211 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b670e660 con 0x5573b66ce030 2024-09-10T05:36:56.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.023+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 45 ==== osd_op_reply(211 gc.28 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:56.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.023+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:56.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.023+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:212 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ea990 con 0x5573b66ce030 2024-09-10T05:36:56.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.023+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 46 ==== osd_op_reply(212 gc.28 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:56.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.023+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:213 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b670e660 con 0x5573b66ce030 2024-09-10T05:36:56.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.023+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 47 ==== osd_op_reply(213 gc.28 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:56.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.023+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:36:56.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.023+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:214 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b670e660 con 0x5573b66ce030 2024-09-10T05:36:56.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.023+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 48 ==== osd_op_reply(214 gc.28 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:56.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.023+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:56.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.023+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:215 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b670e660 con 0x5573b66ce030 2024-09-10T05:36:56.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.027+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 49 ==== osd_op_reply(215 gc.28 [call] v32'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:56.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.027+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2024-09-10T05:36:56.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.027+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:216 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b670e660 con 0x5573b66d24e0 2024-09-10T05:36:56.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.027+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 82 ==== osd_op_reply(216 gc.29 [call] v32'55 uv55 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:56.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.027+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:217 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b670e660 con 0x5573b66d24e0 2024-09-10T05:36:56.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.031+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 83 ==== osd_op_reply(217 gc.29 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:56.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.031+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:56.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.031+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:218 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ea990 con 0x5573b66d24e0 2024-09-10T05:36:56.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.031+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 84 ==== osd_op_reply(218 gc.29 [call out=24b] v0'0 uv55 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:56.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.031+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:219 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b670e660 con 0x5573b66d24e0 2024-09-10T05:36:56.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.031+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 85 ==== osd_op_reply(219 gc.29 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:56.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.031+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:36:56.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.031+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:220 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b670e660 con 0x5573b66d24e0 2024-09-10T05:36:56.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.035+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 86 ==== osd_op_reply(220 gc.29 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:56.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.035+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:56.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.035+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:221 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b670e660 con 0x5573b66d24e0 2024-09-10T05:36:56.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.035+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 87 ==== osd_op_reply(221 gc.29 [call] v32'56 uv56 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:56.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.035+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2024-09-10T05:36:56.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.035+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:222 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b670e660 con 0x5573b66ce030 2024-09-10T05:36:56.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.039+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 50 ==== osd_op_reply(222 gc.30 [call] v32'53 uv53 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:56.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.039+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:223 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b670e660 con 0x5573b66ce030 2024-09-10T05:36:56.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.039+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 51 ==== osd_op_reply(223 gc.30 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:56.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.039+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:56.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.039+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:224 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66ea990 con 0x5573b66ce030 2024-09-10T05:36:56.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.039+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 52 ==== osd_op_reply(224 gc.30 [call out=24b] v0'0 uv53 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:56.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.039+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:225 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b670e660 con 0x5573b66ce030 2024-09-10T05:36:56.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.039+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 53 ==== osd_op_reply(225 gc.30 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:56.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.039+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:36:56.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.039+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:226 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b670e660 con 0x5573b66ce030 2024-09-10T05:36:56.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.039+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 54 ==== osd_op_reply(226 gc.30 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:56.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.039+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:56.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.039+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:227 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b670e660 con 0x5573b66ce030 2024-09-10T05:36:56.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.043+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 55 ==== osd_op_reply(227 gc.30 [call] v32'54 uv54 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:56.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.043+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2024-09-10T05:36:56.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.043+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:228 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b670e660 con 0x7f7300078060 2024-09-10T05:36:56.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.043+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.2 v2:172.21.15.62:6800/2677868286 23 ==== osd_op_reply(228 gc.31 [call] v32'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f730800a4d0 con 0x7f7300078060 2024-09-10T05:36:56.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.043+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:229 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c470 con 0x7f7300078060 2024-09-10T05:36:56.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.043+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.2 v2:172.21.15.62:6800/2677868286 24 ==== osd_op_reply(229 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f730800a4d0 con 0x7f7300078060 2024-09-10T05:36:56.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.043+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:56.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.043+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:230 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66eae40 con 0x7f7300078060 2024-09-10T05:36:56.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.047+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.2 v2:172.21.15.62:6800/2677868286 25 ==== osd_op_reply(230 gc.31 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f730800a4d0 con 0x7f7300078060 2024-09-10T05:36:56.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.047+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:231 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c470 con 0x7f7300078060 2024-09-10T05:36:56.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.047+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.2 v2:172.21.15.62:6800/2677868286 26 ==== osd_op_reply(231 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f730800a4d0 con 0x7f7300078060 2024-09-10T05:36:56.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.047+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:36:56.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.047+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:232 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c470 con 0x7f7300078060 2024-09-10T05:36:56.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.047+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.2 v2:172.21.15.62:6800/2677868286 27 ==== osd_op_reply(232 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f730800a4d0 con 0x7f7300078060 2024-09-10T05:36:56.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.047+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:56.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.047+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:233 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c470 con 0x7f7300078060 2024-09-10T05:36:56.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.047+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.2 v2:172.21.15.62:6800/2677868286 28 ==== osd_op_reply(233 gc.31 [call] v32'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f730800a4d0 con 0x7f7300078060 2024-09-10T05:36:56.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.047+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2024-09-10T05:36:56.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.047+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:234 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c470 con 0x5573b66d24e0 2024-09-10T05:36:56.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.051+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 88 ==== osd_op_reply(234 gc.0 [call] v32'50 uv50 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:56.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.051+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:235 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c470 con 0x5573b66d24e0 2024-09-10T05:36:56.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.051+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 89 ==== osd_op_reply(235 gc.0 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:56.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.051+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:56.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.051+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:236 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66eae40 con 0x5573b66d24e0 2024-09-10T05:36:56.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.055+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 90 ==== osd_op_reply(236 gc.0 [call out=24b] v0'0 uv50 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:56.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.055+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:237 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c470 con 0x5573b66d24e0 2024-09-10T05:36:56.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.055+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 91 ==== osd_op_reply(237 gc.0 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:56.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.055+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:36:56.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.055+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:238 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c470 con 0x5573b66d24e0 2024-09-10T05:36:56.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.055+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 92 ==== osd_op_reply(238 gc.0 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:56.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.055+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:56.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.055+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:239 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c470 con 0x5573b66d24e0 2024-09-10T05:36:56.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.059+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 93 ==== osd_op_reply(239 gc.0 [call] v32'51 uv51 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:56.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.059+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2024-09-10T05:36:56.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.059+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:240 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c470 con 0x7f7300078060 2024-09-10T05:36:56.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.063+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.2 v2:172.21.15.62:6800/2677868286 29 ==== osd_op_reply(240 gc.1 [call] v32'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f730800a4d0 con 0x7f7300078060 2024-09-10T05:36:56.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.063+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:241 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c470 con 0x7f7300078060 2024-09-10T05:36:56.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.063+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.2 v2:172.21.15.62:6800/2677868286 30 ==== osd_op_reply(241 gc.1 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f730800a4d0 con 0x7f7300078060 2024-09-10T05:36:56.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.063+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:56.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.063+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:242 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66eae40 con 0x7f7300078060 2024-09-10T05:36:56.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.063+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.2 v2:172.21.15.62:6800/2677868286 31 ==== osd_op_reply(242 gc.1 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f730800a4d0 con 0x7f7300078060 2024-09-10T05:36:56.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.063+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:243 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c470 con 0x7f7300078060 2024-09-10T05:36:56.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.063+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.2 v2:172.21.15.62:6800/2677868286 32 ==== osd_op_reply(243 gc.1 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f730800a4d0 con 0x7f7300078060 2024-09-10T05:36:56.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.063+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:36:56.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.063+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:244 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c470 con 0x7f7300078060 2024-09-10T05:36:56.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.063+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.2 v2:172.21.15.62:6800/2677868286 33 ==== osd_op_reply(244 gc.1 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f730800a4d0 con 0x7f7300078060 2024-09-10T05:36:56.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.063+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:56.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.063+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:245 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c470 con 0x7f7300078060 2024-09-10T05:36:56.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.067+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.2 v2:172.21.15.62:6800/2677868286 34 ==== osd_op_reply(245 gc.1 [call] v32'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f730800a4d0 con 0x7f7300078060 2024-09-10T05:36:56.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.067+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2024-09-10T05:36:56.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.067+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:246 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c470 con 0x5573b66d5d00 2024-09-10T05:36:56.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.067+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 64 ==== osd_op_reply(246 gc.2 [call] v32'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:56.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.067+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:247 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c430 con 0x5573b66d5d00 2024-09-10T05:36:56.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.071+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 65 ==== osd_op_reply(247 gc.2 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:56.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.071+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:56.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.071+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:248 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66eae40 con 0x5573b66d5d00 2024-09-10T05:36:56.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.071+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 66 ==== osd_op_reply(248 gc.2 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:56.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.071+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:249 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c430 con 0x5573b66d5d00 2024-09-10T05:36:56.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.071+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 67 ==== osd_op_reply(249 gc.2 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:56.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.071+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:36:56.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.071+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:250 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c430 con 0x5573b66d5d00 2024-09-10T05:36:56.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.071+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 68 ==== osd_op_reply(250 gc.2 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:56.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.071+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:56.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.071+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:251 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c430 con 0x5573b66d5d00 2024-09-10T05:36:56.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.071+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 69 ==== osd_op_reply(251 gc.2 [call] v32'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:56.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.071+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2024-09-10T05:36:56.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.071+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:252 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c430 con 0x5573b66ce030 2024-09-10T05:36:56.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.075+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 56 ==== osd_op_reply(252 gc.3 [call] v32'171 uv171 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:56.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.075+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:253 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c430 con 0x5573b66ce030 2024-09-10T05:36:56.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.075+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 57 ==== osd_op_reply(253 gc.3 [call out=15b] v0'0 uv171 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:56.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.075+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:56.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.075+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:254 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c430 con 0x5573b66ce030 2024-09-10T05:36:56.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.079+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 58 ==== osd_op_reply(254 gc.3 [call out=24b] v0'0 uv171 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:56.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.079+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:255 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c430 con 0x5573b66ce030 2024-09-10T05:36:56.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.079+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 59 ==== osd_op_reply(255 gc.3 [call out=15b] v0'0 uv171 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:56.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.079+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:36:56.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.079+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:256 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c430 con 0x5573b66ce030 2024-09-10T05:36:56.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.079+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 60 ==== osd_op_reply(256 gc.3 [call out=15b] v0'0 uv171 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:56.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.079+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:56.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.079+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:257 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c430 con 0x5573b66ce030 2024-09-10T05:36:56.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.083+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 61 ==== osd_op_reply(257 gc.3 [call] v32'172 uv172 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:56.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.083+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2024-09-10T05:36:56.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.083+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:258 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c430 con 0x5573b66d24e0 2024-09-10T05:36:56.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.083+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 94 ==== osd_op_reply(258 gc.4 [call] v32'60 uv60 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:56.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.083+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:259 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c430 con 0x5573b66d24e0 2024-09-10T05:36:56.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.087+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 95 ==== osd_op_reply(259 gc.4 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:56.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.087+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:56.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.087+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:260 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c430 con 0x5573b66d24e0 2024-09-10T05:36:56.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.087+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 96 ==== osd_op_reply(260 gc.4 [call out=24b] v0'0 uv60 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:56.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.087+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:261 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c430 con 0x5573b66d24e0 2024-09-10T05:36:56.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.087+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 97 ==== osd_op_reply(261 gc.4 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:56.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.087+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:36:56.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.087+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:262 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c430 con 0x5573b66d24e0 2024-09-10T05:36:56.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.087+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 98 ==== osd_op_reply(262 gc.4 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:56.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.087+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:56.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.087+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:263 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c430 con 0x5573b66d24e0 2024-09-10T05:36:56.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.091+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 99 ==== osd_op_reply(263 gc.4 [call] v32'61 uv61 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:56.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.091+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2024-09-10T05:36:56.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.091+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:264 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c430 con 0x5573b66d5d00 2024-09-10T05:36:56.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.095+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 70 ==== osd_op_reply(264 gc.5 [call] v32'47 uv47 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:56.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.095+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:265 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c430 con 0x5573b66d5d00 2024-09-10T05:36:56.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.095+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 71 ==== osd_op_reply(265 gc.5 [call out=15b] v0'0 uv47 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:56.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.095+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:56.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.095+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:266 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c430 con 0x5573b66d5d00 2024-09-10T05:36:56.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.095+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 72 ==== osd_op_reply(266 gc.5 [call out=24b] v0'0 uv47 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:56.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.095+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:267 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c3d0 con 0x5573b66d5d00 2024-09-10T05:36:56.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.095+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 73 ==== osd_op_reply(267 gc.5 [call out=15b] v0'0 uv47 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:56.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.095+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:36:56.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.095+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:268 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c3d0 con 0x5573b66d5d00 2024-09-10T05:36:56.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.099+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 74 ==== osd_op_reply(268 gc.5 [call out=15b] v0'0 uv47 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:56.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.099+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:56.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.099+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:269 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c3d0 con 0x5573b66d5d00 2024-09-10T05:36:56.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.099+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 75 ==== osd_op_reply(269 gc.5 [call] v32'48 uv48 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:56.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.099+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2024-09-10T05:36:56.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.099+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:270 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c3d0 con 0x5573b66d24e0 2024-09-10T05:36:56.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.103+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 100 ==== osd_op_reply(270 gc.6 [call] v32'30 uv30 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:56.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.103+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:271 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c3d0 con 0x5573b66d24e0 2024-09-10T05:36:56.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.103+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 101 ==== osd_op_reply(271 gc.6 [call out=15b] v0'0 uv30 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:56.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.103+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:56.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.103+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:272 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66eae40 con 0x5573b66d24e0 2024-09-10T05:36:56.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.107+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 102 ==== osd_op_reply(272 gc.6 [call out=24b] v0'0 uv30 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:56.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.107+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:273 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c3d0 con 0x5573b66d24e0 2024-09-10T05:36:56.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.107+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 103 ==== osd_op_reply(273 gc.6 [call out=15b] v0'0 uv30 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:56.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.107+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:36:56.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.107+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:274 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c3d0 con 0x5573b66d24e0 2024-09-10T05:36:56.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.107+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 104 ==== osd_op_reply(274 gc.6 [call out=15b] v0'0 uv30 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:56.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.107+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:56.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.107+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:275 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c3d0 con 0x5573b66d24e0 2024-09-10T05:36:56.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.111+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 105 ==== osd_op_reply(275 gc.6 [call] v32'31 uv31 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:56.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.111+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2024-09-10T05:36:56.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.111+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:276 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c3d0 con 0x5573b66ce030 2024-09-10T05:36:56.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.111+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 62 ==== osd_op_reply(276 gc.7 [call] v32'41 uv41 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:56.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.111+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:277 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c3d0 con 0x5573b66ce030 2024-09-10T05:36:56.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.115+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 63 ==== osd_op_reply(277 gc.7 [call out=15b] v0'0 uv41 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:56.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.115+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:56.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.115+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:278 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b66eae40 con 0x5573b66ce030 2024-09-10T05:36:56.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.115+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 64 ==== osd_op_reply(278 gc.7 [call out=24b] v0'0 uv41 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:56.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.115+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:279 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c3d0 con 0x5573b66ce030 2024-09-10T05:36:56.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.115+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 65 ==== osd_op_reply(279 gc.7 [call out=15b] v0'0 uv41 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:56.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.115+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:36:56.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.115+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:280 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c3d0 con 0x5573b66ce030 2024-09-10T05:36:56.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.115+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 66 ==== osd_op_reply(280 gc.7 [call out=15b] v0'0 uv41 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:56.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.115+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:56.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.115+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:281 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c3d0 con 0x5573b66ce030 2024-09-10T05:36:56.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.119+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 67 ==== osd_op_reply(281 gc.7 [call] v32'42 uv42 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:56.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.119+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2024-09-10T05:36:56.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.119+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:282 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c3d0 con 0x5573b66d24e0 2024-09-10T05:36:56.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.123+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 106 ==== osd_op_reply(282 gc.8 [call] v32'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:56.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.123+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:283 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c3d0 con 0x5573b66d24e0 2024-09-10T05:36:56.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.123+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 107 ==== osd_op_reply(283 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:56.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.123+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:56.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.123+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:284 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c3d0 con 0x5573b66d24e0 2024-09-10T05:36:56.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.123+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 108 ==== osd_op_reply(284 gc.8 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:56.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.123+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:285 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c3d0 con 0x5573b66d24e0 2024-09-10T05:36:56.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.127+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 109 ==== osd_op_reply(285 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:56.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.127+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:36:56.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.127+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:286 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c3d0 con 0x5573b66d24e0 2024-09-10T05:36:56.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.127+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 110 ==== osd_op_reply(286 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:56.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.127+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:56.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.127+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:287 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c3d0 con 0x5573b66d24e0 2024-09-10T05:36:56.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.131+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 111 ==== osd_op_reply(287 gc.8 [call] v32'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:56.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.131+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2024-09-10T05:36:56.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.131+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:288 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c3d0 con 0x5573b66d24e0 2024-09-10T05:36:56.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.135+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 112 ==== osd_op_reply(288 gc.9 [call] v32'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:56.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.135+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:289 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c3d0 con 0x5573b66d24e0 2024-09-10T05:36:56.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.135+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 113 ==== osd_op_reply(289 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:56.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.135+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:56.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.135+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:290 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c3d0 con 0x5573b66d24e0 2024-09-10T05:36:56.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.135+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 114 ==== osd_op_reply(290 gc.9 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:56.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.135+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:291 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c3d0 con 0x5573b66d24e0 2024-09-10T05:36:56.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.139+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 115 ==== osd_op_reply(291 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:56.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.139+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:36:56.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.139+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:292 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c3d0 con 0x5573b66d24e0 2024-09-10T05:36:56.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.139+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 116 ==== osd_op_reply(292 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:56.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.139+0000 7f7311d8b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:36:56.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.139+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:293 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b670c3d0 con 0x5573b66d24e0 2024-09-10T05:36:56.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.143+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 117 ==== osd_op_reply(293 gc.9 [call] v32'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:56.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.143+0000 7f71c5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:56.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.143+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93955470269840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b670b170 con 0x5573b66ce030 2024-09-10T05:36:56.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.147+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 68 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 93955470269840] v32'173 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:56.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.147+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93955470247136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66e1d40 con 0x5573b66d24e0 2024-09-10T05:36:56.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.151+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 118 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 93955470247136] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:56.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.151+0000 7f7311d8b9c0 20 remove_watcher() i=0 2024-09-10T05:36:56.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.151+0000 7f7311d8b9c0 2 removed watcher, disabling cache 2024-09-10T05:36:56.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.151+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93955470254416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66dc4e0 con 0x5573b66ce030 2024-09-10T05:36:56.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.155+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.1 v2:172.21.15.62:6808/3442097179 69 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 93955470254416] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f730800a4d0 con 0x5573b66ce030 2024-09-10T05:36:56.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.155+0000 7f7311d8b9c0 20 remove_watcher() i=1 2024-09-10T05:36:56.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.155+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93955470257968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66dc4e0 con 0x5573b66d24e0 2024-09-10T05:36:56.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.155+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 119 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 93955470257968] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:56.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.155+0000 7f7311d8b9c0 20 remove_watcher() i=2 2024-09-10T05:36:56.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.155+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93955470260176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66def30 con 0x7f7300078060 2024-09-10T05:36:56.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.159+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.2 v2:172.21.15.62:6800/2677868286 35 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 93955470260176] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f730800a4d0 con 0x7f7300078060 2024-09-10T05:36:56.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.159+0000 7f7311d8b9c0 20 remove_watcher() i=3 2024-09-10T05:36:56.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.159+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93955470261232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66df7d0 con 0x5573b66d24e0 2024-09-10T05:36:56.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.163+0000 7f730f891640 1 -- 172.21.15.62:0/904842470 <== osd.0 v2:172.21.15.2:6800/945139080 120 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 93955470261232] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7300075030 con 0x5573b66d24e0 2024-09-10T05:36:56.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.163+0000 7f7311d8b9c0 20 remove_watcher() i=4 2024-09-10T05:36:56.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.163+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93955470265008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66def30 con 0x5573b66d5d00 2024-09-10T05:36:56.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.163+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 76 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 93955470265008] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:56.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.163+0000 7f7311d8b9c0 20 remove_watcher() i=5 2024-09-10T05:36:56.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.163+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93955470266064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66e0ab0 con 0x5573b66d5d00 2024-09-10T05:36:56.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.167+0000 7f730f090640 1 -- 172.21.15.62:0/904842470 <== osd.3 v2:172.21.15.62:6816/2708991149 77 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 93955470266064] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73040aa070 con 0x5573b66d5d00 2024-09-10T05:36:56.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.167+0000 7f7311d8b9c0 20 remove_watcher() i=6 2024-09-10T05:36:56.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.167+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93955470255472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573b66def30 con 0x7f7300078060 2024-09-10T05:36:56.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.171+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 <== osd.2 v2:172.21.15.62:6800/2677868286 36 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 93955470255472] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f730800a4d0 con 0x7f7300078060 2024-09-10T05:36:56.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.171+0000 7f7311d8b9c0 20 remove_watcher() i=7 2024-09-10T05:36:56.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.171+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5573b66d24e0 msgr2=0x5573b66d48d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:56.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.171+0000 7f7311d8b9c0 1 --2- 172.21.15.62:0/904842470 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5573b66d24e0 0x5573b66d48d0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:56.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.171+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5573b66ce030 msgr2=0x5573b66d04f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:56.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.171+0000 7f7311d8b9c0 1 --2- 172.21.15.62:0/904842470 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5573b66ce030 0x5573b66d04f0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:56.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.171+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f7300078060 msgr2=0x7f730003d410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:56.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.171+0000 7f7311d8b9c0 1 --2- 172.21.15.62:0/904842470 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f7300078060 0x7f730003d410 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:56.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.171+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5573b66d5d00 msgr2=0x5573b66d8130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:56.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.171+0000 7f7311d8b9c0 1 --2- 172.21.15.62:0/904842470 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5573b66d5d00 0x5573b66d8130 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:56.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.171+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f71d8039a70 msgr2=0x7f71d803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:56.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.171+0000 7f7311d8b9c0 1 --2- 172.21.15.62:0/904842470 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f71d8039a70 0x7f71d803bf30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f730401d2d0 tx=0x7f73040a9000 comp rx=0 tx=0).stop 2024-09-10T05:36:56.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.171+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573b66bbdb0 msgr2=0x5573b66c3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:56.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.171+0000 7f7311d8b9c0 1 --2- 172.21.15.62:0/904842470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573b66bbdb0 0x5573b66c3100 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f7300043ac0 tx=0x7f730001c9f0 comp rx=0 tx=0).stop 2024-09-10T05:36:56.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.171+0000 7f7310092640 1 -- 172.21.15.62:0/904842470 reap_dead start 2024-09-10T05:36:56.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.171+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 shutdown_connections 2024-09-10T05:36:56.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.171+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 >> 172.21.15.62:0/904842470 conn(0x5573b66b81e0 msgr2=0x5573b66b63f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:56.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.171+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 shutdown_connections 2024-09-10T05:36:56.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.171+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/904842470 wait complete. 2024-09-10T05:36:56.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.171+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/4173424574 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f71e8039ac0 msgr2=0x7f71e803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:56.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.171+0000 7f7311d8b9c0 1 --2- 172.21.15.62:0/4173424574 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f71e8039ac0 0x7f71e803bf80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x5573b6692dd0 tx=0x7f7304005ad0 comp rx=0 tx=0).stop 2024-09-10T05:36:56.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.171+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/4173424574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573b66af600 msgr2=0x5573b66afa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:56.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.171+0000 7f7311d8b9c0 1 --2- 172.21.15.62:0/4173424574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573b66af600 0x5573b66afa20 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f730000eb10 tx=0x7f730000ea60 comp rx=0 tx=0).stop 2024-09-10T05:36:56.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.171+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/4173424574 shutdown_connections 2024-09-10T05:36:56.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.171+0000 7f7311d8b9c0 1 --2- 172.21.15.62:0/4173424574 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f71e8039ac0 0x7f71e803bf80 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:56.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.171+0000 7f7311d8b9c0 1 --2- 172.21.15.62:0/4173424574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573b66af600 0x5573b66afa20 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:56.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.171+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/4173424574 >> 172.21.15.62:0/4173424574 conn(0x5573b66a4fb0 msgr2=0x5573b66a5390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:56.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.171+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/4173424574 shutdown_connections 2024-09-10T05:36:56.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.171+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/4173424574 wait complete. 2024-09-10T05:36:56.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.171+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/371763722 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5573b6699d90 msgr2=0x5573b669c180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:56.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.171+0000 7f7311d8b9c0 1 --2- 172.21.15.62:0/371763722 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5573b6699d90 0x5573b669c180 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:56.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.171+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/371763722 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5573b65a3fc0 msgr2=0x5573b6698af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:56.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.171+0000 7f7311d8b9c0 1 --2- 172.21.15.62:0/371763722 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5573b65a3fc0 0x5573b6698af0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:56.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.171+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/371763722 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5573b669e530 msgr2=0x5573b66a0920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:56.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.171+0000 7f7311d8b9c0 1 --2- 172.21.15.62:0/371763722 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5573b669e530 0x5573b66a0920 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:56.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.171+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/371763722 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f71f8039a70 msgr2=0x7f71f803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:56.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.171+0000 7f7311d8b9c0 1 --2- 172.21.15.62:0/371763722 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f71f8039a70 0x7f71f803bf30 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f73040ad000 tx=0x7f73040a7000 comp rx=0 tx=0).stop 2024-09-10T05:36:56.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.171+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/371763722 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573b659fdd0 msgr2=0x5573b6691980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:56.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.171+0000 7f7311d8b9c0 1 --2- 172.21.15.62:0/371763722 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573b659fdd0 0x5573b6691980 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f7300001300 tx=0x7f7300000ee0 comp rx=0 tx=0).stop 2024-09-10T05:36:56.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.171+0000 7f7310092640 1 -- 172.21.15.62:0/371763722 reap_dead start 2024-09-10T05:36:56.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.171+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/371763722 shutdown_connections 2024-09-10T05:36:56.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.171+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/371763722 >> 172.21.15.62:0/371763722 conn(0x5573b659b8f0 msgr2=0x5573b66849a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:56.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.171+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/371763722 shutdown_connections 2024-09-10T05:36:56.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.171+0000 7f7311d8b9c0 1 -- 172.21.15.62:0/371763722 wait complete. 2024-09-10T05:36:56.192 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-10T05:36:56.192 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-10T05:36:56.192 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-10T05:36:56.274 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:56.274 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:56.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.271+0000 7f5c258c29c0 1 Processor -- start 2024-09-10T05:36:56.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.271+0000 7f5c258c29c0 1 -- start start 2024-09-10T05:36:56.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.271+0000 7f5c258c29c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x559701527ff0 0x55970152a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:56.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.271+0000 7f5c258c29c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5597013d99c0 con 0x559701523e00 2024-09-10T05:36:56.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.271+0000 7f5c258c29c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x5597014296d0 con 0x559701527ff0 2024-09-10T05:36:56.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.271+0000 7f5c22bc7640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x559701527ff0 0x55970152a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:56.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.271+0000 7f5c233c8640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x559701523e00 0x5597015241e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:58346/0 (socket says 172.21.15.62:58346) 2024-09-10T05:36:56.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.271+0000 7f5c233c8640 1 -- 172.21.15.62:0/2920008531 learned_addr learned my addr 172.21.15.62:0/2920008531 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-10T05:36:56.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.275+0000 7f5c22bc7640 1 -- 172.21.15.62:0/2920008531 >> v1:172.21.15.2:6789/0 conn(0x559701523e00 legacy=0x5597015241e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:56.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.275+0000 7f5c22bc7640 1 -- 172.21.15.62:0/2920008531 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597013cdca0 con 0x559701527ff0 2024-09-10T05:36:56.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.275+0000 7f5c22bc7640 1 --2- 172.21.15.62:0/2920008531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559701527ff0 0x55970152a3e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c00a480 tx=0x7f5c0c01b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7cd1c2a56b751a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:56.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.275+0000 7f5c223c6640 1 -- 172.21.15.62:0/2920008531 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c0c0aa570 con 0x559701527ff0 2024-09-10T05:36:56.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.275+0000 7f5c223c6640 1 -- 172.21.15.62:0/2920008531 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c0c0af070 con 0x559701527ff0 2024-09-10T05:36:56.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.275+0000 7f5c223c6640 1 -- 172.21.15.62:0/2920008531 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c0c0aa860 con 0x559701527ff0 2024-09-10T05:36:56.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.275+0000 7f5c258c29c0 1 -- 172.21.15.62:0/2920008531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559701527ff0 msgr2=0x55970152a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:56.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.275+0000 7f5c258c29c0 1 --2- 172.21.15.62:0/2920008531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559701527ff0 0x55970152a3e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c00a480 tx=0x7f5c0c01b310 comp rx=0 tx=0).stop 2024-09-10T05:36:56.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.275+0000 7f5c258c29c0 1 -- 172.21.15.62:0/2920008531 shutdown_connections 2024-09-10T05:36:56.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.275+0000 7f5c258c29c0 1 --2- 172.21.15.62:0/2920008531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559701527ff0 0x55970152a3e0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:56.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.275+0000 7f5c258c29c0 1 -- 172.21.15.62:0/2920008531 >> 172.21.15.62:0/2920008531 conn(0x55970151f920 msgr2=0x559701521d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:56.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.275+0000 7f5c258c29c0 1 -- 172.21.15.62:0/2920008531 shutdown_connections 2024-09-10T05:36:56.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.275+0000 7f5c258c29c0 1 -- 172.21.15.62:0/2920008531 wait complete. 2024-09-10T05:36:56.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.295+0000 7f5c258c29c0 1 Processor -- start 2024-09-10T05:36:56.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.295+0000 7f5c258c29c0 1 -- start start 2024-09-10T05:36:56.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.295+0000 7f5c258c29c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559701523e00 0x55970160c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:56.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.295+0000 7f5c258c29c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55970142d680 con 0x559701523e00 2024-09-10T05:36:56.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.295+0000 7f5c233c8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559701523e00 0x55970160c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:56.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.295+0000 7f5c233c8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559701523e00 0x55970160c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47884/0 (socket says 172.21.15.62:47884) 2024-09-10T05:36:56.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.295+0000 7f5c233c8640 1 -- 172.21.15.62:0/2201805946 learned_addr learned my addr 172.21.15.62:0/2201805946 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:56.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.295+0000 7f5c233c8640 1 -- 172.21.15.62:0/2201805946 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597013a8da0 con 0x559701523e00 2024-09-10T05:36:56.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.295+0000 7f5c233c8640 1 --2- 172.21.15.62:0/2201805946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559701523e00 0x55970160c3a0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f5c14001e00 tx=0x7f5c1400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e0631cfd94a43c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:56.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.295+0000 7f5b1160a640 1 -- 172.21.15.62:0/2201805946 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c14012020 con 0x559701523e00 2024-09-10T05:36:56.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.295+0000 7f5b1160a640 1 -- 172.21.15.62:0/2201805946 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c1400e690 con 0x559701523e00 2024-09-10T05:36:56.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.295+0000 7f5b1160a640 1 -- 172.21.15.62:0/2201805946 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c1400ea10 con 0x559701523e00 2024-09-10T05:36:56.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.295+0000 7f5c258c29c0 1 -- 172.21.15.62:0/2201805946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559701523e00 msgr2=0x55970160c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:56.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.295+0000 7f5c258c29c0 1 --2- 172.21.15.62:0/2201805946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559701523e00 0x55970160c3a0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f5c14001e00 tx=0x7f5c1400b6d0 comp rx=0 tx=0).stop 2024-09-10T05:36:56.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.295+0000 7f5c258c29c0 1 -- 172.21.15.62:0/2201805946 shutdown_connections 2024-09-10T05:36:56.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.295+0000 7f5c258c29c0 1 --2- 172.21.15.62:0/2201805946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559701523e00 0x55970160c3a0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:56.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.295+0000 7f5c258c29c0 1 -- 172.21.15.62:0/2201805946 >> 172.21.15.62:0/2201805946 conn(0x55970151f920 msgr2=0x559701499030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:56.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.295+0000 7f5c258c29c0 1 -- 172.21.15.62:0/2201805946 shutdown_connections 2024-09-10T05:36:56.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.295+0000 7f5c258c29c0 1 -- 172.21.15.62:0/2201805946 wait complete. 2024-09-10T05:36:56.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.295+0000 7f5c258c29c0 1 Processor -- start 2024-09-10T05:36:56.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.295+0000 7f5c258c29c0 1 -- start start 2024-09-10T05:36:56.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.295+0000 7f5c258c29c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559701523e00 0x559701619fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:56.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.295+0000 7f5c258c29c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5597013cfa50 con 0x559701523e00 2024-09-10T05:36:56.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.299+0000 7f5c233c8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559701523e00 0x559701619fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:56.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.299+0000 7f5c233c8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559701523e00 0x559701619fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47888/0 (socket says 172.21.15.62:47888) 2024-09-10T05:36:56.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.299+0000 7f5c233c8640 1 -- 172.21.15.62:0/660712500 learned_addr learned my addr 172.21.15.62:0/660712500 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:56.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.299+0000 7f5c233c8640 1 -- 172.21.15.62:0/660712500 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55970161a530 con 0x559701523e00 2024-09-10T05:36:56.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.299+0000 7f5c233c8640 1 --2- 172.21.15.62:0/660712500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559701523e00 0x559701619fd0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x55970160bea0 tx=0x7f5c14000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:56.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.299+0000 7f5b0fe07640 1 -- 172.21.15.62:0/660712500 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c14012030 con 0x559701523e00 2024-09-10T05:36:56.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.299+0000 7f5b0fe07640 1 -- 172.21.15.62:0/660712500 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c14001460 con 0x559701523e00 2024-09-10T05:36:56.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.299+0000 7f5c258c29c0 1 -- 172.21.15.62:0/660712500 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55970161a7c0 con 0x559701523e00 2024-09-10T05:36:56.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.299+0000 7f5b0fe07640 1 -- 172.21.15.62:0/660712500 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c1401a7a0 con 0x559701523e00 2024-09-10T05:36:56.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.299+0000 7f5c258c29c0 1 -- 172.21.15.62:0/660712500 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55970161b170 con 0x559701523e00 2024-09-10T05:36:56.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.299+0000 7f5b0fe07640 1 -- 172.21.15.62:0/660712500 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f5c14015020 con 0x559701523e00 2024-09-10T05:36:56.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.299+0000 7f5b0fe07640 1 --2- 172.21.15.62:0/660712500 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5b08039a70 0x7f5b0803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:56.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.299+0000 7f5b0fe07640 1 -- 172.21.15.62:0/660712500 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7f5c14020030 con 0x559701523e00 2024-09-10T05:36:56.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.299+0000 7f5c22bc7640 1 --2- 172.21.15.62:0/660712500 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5b08039a70 0x7f5b0803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:56.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.299+0000 7f5c258c29c0 1 --2- 172.21.15.62:0/660712500 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x559701527ff0 0x559701621140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:56.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.299+0000 7f5c258c29c0 1 -- 172.21.15.62:0/660712500 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701621680 con 0x559701527ff0 2024-09-10T05:36:56.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.299+0000 7f5c23bc9640 1 --2- 172.21.15.62:0/660712500 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x559701527ff0 0x559701621140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:56.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.303+0000 7f5c22bc7640 1 --2- 172.21.15.62:0/660712500 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5b08039a70 0x7f5b0803bf30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c0ae000 tx=0x7f5c0c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:56.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.303+0000 7f5c23bc9640 1 --2- 172.21.15.62:0/660712500 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x559701527ff0 0x559701621140 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:56.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.303+0000 7f5c23bc9640 1 -- 172.21.15.62:0/660712500 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5c1c00a4d0 con 0x559701527ff0 2024-09-10T05:36:56.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.303+0000 7f5c258c29c0 1 --2- 172.21.15.62:0/660712500 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x559701622430 0x559701624820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:56.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.303+0000 7f5c258c29c0 1 -- 172.21.15.62:0/660712500 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701624e50 con 0x559701622430 2024-09-10T05:36:56.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.303+0000 7f5c233c8640 1 --2- 172.21.15.62:0/660712500 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x559701622430 0x559701624820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:56.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.303+0000 7f5c233c8640 1 --2- 172.21.15.62:0/660712500 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x559701622430 0x559701624820 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:56.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.303+0000 7f5c233c8640 1 -- 172.21.15.62:0/660712500 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5c14008030 con 0x559701622430 2024-09-10T05:36:56.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.303+0000 7f5c258c29c0 1 --2- 172.21.15.62:0/660712500 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x559701626c10 0x559701629000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:56.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.303+0000 7f5c258c29c0 1 -- 172.21.15.62:0/660712500 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5597016296d0 con 0x559701626c10 2024-09-10T05:36:56.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.303+0000 7f5c22bc7640 1 --2- 172.21.15.62:0/660712500 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x559701626c10 0x559701629000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:56.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.303+0000 7f5c22bc7640 1 --2- 172.21.15.62:0/660712500 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x559701626c10 0x559701629000 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:56.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.303+0000 7f5c22bc7640 1 -- 172.21.15.62:0/660712500 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5c0c0a8070 con 0x559701626c10 2024-09-10T05:36:56.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.303+0000 7f5c258c29c0 1 -- 172.21.15.62:0/660712500 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701625ab0 con 0x559701622430 2024-09-10T05:36:56.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.307+0000 7f5c233c8640 1 -- 172.21.15.62:0/660712500 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5c14008030 con 0x559701622430 2024-09-10T05:36:56.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.307+0000 7f5c258c29c0 1 -- 172.21.15.62:0/660712500 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701625f10 con 0x559701626c10 2024-09-10T05:36:56.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.307+0000 7f5c22bc7640 1 -- 172.21.15.62:0/660712500 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5c0c0a8070 con 0x559701626c10 2024-09-10T05:36:56.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.307+0000 7f5c258c29c0 1 Processor -- start 2024-09-10T05:36:56.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.307+0000 7f5c258c29c0 1 -- start start 2024-09-10T05:36:56.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.307+0000 7f5c258c29c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559701637d00 0x559701638120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:56.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.307+0000 7f5c258c29c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55970143a450 con 0x559701637d00 2024-09-10T05:36:56.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.307+0000 7f5c233c8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559701637d00 0x559701638120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:56.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.307+0000 7f5c233c8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559701637d00 0x559701638120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47904/0 (socket says 172.21.15.62:47904) 2024-09-10T05:36:56.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.307+0000 7f5c233c8640 1 -- 172.21.15.62:0/1423264730 learned_addr learned my addr 172.21.15.62:0/1423264730 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:56.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.307+0000 7f5c233c8640 1 -- 172.21.15.62:0/1423264730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559701638760 con 0x559701637d00 2024-09-10T05:36:56.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.307+0000 7f5c233c8640 1 --2- 172.21.15.62:0/1423264730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559701637d00 0x559701638120 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f5c1404e9d0 tx=0x7f5c14016b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:56.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.307+0000 7f5b0d602640 1 -- 172.21.15.62:0/1423264730 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c1404d630 con 0x559701637d00 2024-09-10T05:36:56.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.307+0000 7f5b0d602640 1 -- 172.21.15.62:0/1423264730 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c1404b040 con 0x559701637d00 2024-09-10T05:36:56.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.307+0000 7f5b0d602640 1 -- 172.21.15.62:0/1423264730 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c140473a0 con 0x559701637d00 2024-09-10T05:36:56.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.307+0000 7f5c258c29c0 1 -- 172.21.15.62:0/1423264730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559701638fc0 con 0x559701637d00 2024-09-10T05:36:56.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.307+0000 7f5c258c29c0 1 -- 172.21.15.62:0/1423264730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559701639530 con 0x559701637d00 2024-09-10T05:36:56.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.311+0000 7f5b0d602640 1 -- 172.21.15.62:0/1423264730 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f5c14009070 con 0x559701637d00 2024-09-10T05:36:56.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.311+0000 7f5b0d602640 1 --2- 172.21.15.62:0/1423264730 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5afc039ac0 0x7f5afc03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:56.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.311+0000 7f5b0d602640 1 -- 172.21.15.62:0/1423264730 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7f5c14047050 con 0x559701637d00 2024-09-10T05:36:56.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.311+0000 7f5c22bc7640 1 --2- 172.21.15.62:0/1423264730 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5afc039ac0 0x7f5afc03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:56.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.311+0000 7f5c258c29c0 1 Processor -- start 2024-09-10T05:36:56.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.311+0000 7f5c258c29c0 1 -- start start 2024-09-10T05:36:56.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.311+0000 7f5c258c29c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559701644490 0x559701644870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:56.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.311+0000 7f5c258c29c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55970160cbf0 con 0x559701644490 2024-09-10T05:36:56.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.311+0000 7f5c22bc7640 1 --2- 172.21.15.62:0/1423264730 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5afc039ac0 0x7f5afc03bf80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x559701625a80 tx=0x7f5c0c005a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:56.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.311+0000 7f5c233c8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559701644490 0x559701644870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:56.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.311+0000 7f5c233c8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559701644490 0x559701644870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47908/0 (socket says 172.21.15.62:47908) 2024-09-10T05:36:56.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.311+0000 7f5c233c8640 1 -- 172.21.15.62:0/2796029001 learned_addr learned my addr 172.21.15.62:0/2796029001 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:56.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.311+0000 7f5c233c8640 1 -- 172.21.15.62:0/2796029001 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559701644e40 con 0x559701644490 2024-09-10T05:36:56.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.311+0000 7f5c233c8640 1 --2- 172.21.15.62:0/2796029001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559701644490 0x559701644870 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f5c1404d7f0 tx=0x7f5c1403bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e796f0cf2f02edb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:56.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.311+0000 7f5b06ffd640 1 -- 172.21.15.62:0/2796029001 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c1403b030 con 0x559701644490 2024-09-10T05:36:56.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.311+0000 7f5b06ffd640 1 -- 172.21.15.62:0/2796029001 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c14047e60 con 0x559701644490 2024-09-10T05:36:56.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.311+0000 7f5b06ffd640 1 -- 172.21.15.62:0/2796029001 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c1402d3f0 con 0x559701644490 2024-09-10T05:36:56.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.311+0000 7f5c258c29c0 1 -- 172.21.15.62:0/2796029001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559701644490 msgr2=0x559701644870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:56.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.311+0000 7f5c258c29c0 1 --2- 172.21.15.62:0/2796029001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559701644490 0x559701644870 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f5c1404d7f0 tx=0x7f5c1403bf80 comp rx=0 tx=0).stop 2024-09-10T05:36:56.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.311+0000 7f5c258c29c0 1 -- 172.21.15.62:0/2796029001 shutdown_connections 2024-09-10T05:36:56.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.311+0000 7f5c258c29c0 1 --2- 172.21.15.62:0/2796029001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559701644490 0x559701644870 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:56.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.311+0000 7f5c258c29c0 1 -- 172.21.15.62:0/2796029001 >> 172.21.15.62:0/2796029001 conn(0x5597016408c0 msgr2=0x55970163eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:56.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.311+0000 7f5c258c29c0 1 -- 172.21.15.62:0/2796029001 shutdown_connections 2024-09-10T05:36:56.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.311+0000 7f5c258c29c0 1 -- 172.21.15.62:0/2796029001 wait complete. 2024-09-10T05:36:56.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.315+0000 7f5c258c29c0 1 Processor -- start 2024-09-10T05:36:56.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.315+0000 7f5c258c29c0 1 -- start start 2024-09-10T05:36:56.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.315+0000 7f5c258c29c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559701644490 0x55970164b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:56.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.315+0000 7f5c258c29c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559701645320 con 0x559701644490 2024-09-10T05:36:56.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.315+0000 7f5c233c8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559701644490 0x55970164b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:56.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.315+0000 7f5c233c8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559701644490 0x55970164b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47918/0 (socket says 172.21.15.62:47918) 2024-09-10T05:36:56.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.315+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 learned_addr learned my addr 172.21.15.62:0/311042805 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:56.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.315+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55970164bc90 con 0x559701644490 2024-09-10T05:36:56.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.315+0000 7f5c233c8640 1 --2- 172.21.15.62:0/311042805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559701644490 0x55970164b730 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f5c1403fec0 tx=0x7f5c1403cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:56.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.315+0000 7f5b057fa640 1 -- 172.21.15.62:0/311042805 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c1402dae0 con 0x559701644490 2024-09-10T05:36:56.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.315+0000 7f5b057fa640 1 -- 172.21.15.62:0/311042805 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c14069070 con 0x559701644490 2024-09-10T05:36:56.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.315+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55970164bc90 con 0x559701644490 2024-09-10T05:36:56.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.315+0000 7f5b057fa640 1 -- 172.21.15.62:0/311042805 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c1402d7e0 con 0x559701644490 2024-09-10T05:36:56.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.315+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55970164bc90 con 0x559701644490 2024-09-10T05:36:56.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.315+0000 7f5c258c29c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:56.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.315+0000 7f5b057fa640 1 -- 172.21.15.62:0/311042805 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f5c14060040 con 0x559701644490 2024-09-10T05:36:56.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.315+0000 7f5b057fa640 1 --2- 172.21.15.62:0/311042805 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5aec039a70 0x7f5aec03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:56.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.315+0000 7f5b057fa640 1 -- 172.21.15.62:0/311042805 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7f5c1405e020 con 0x559701644490 2024-09-10T05:36:56.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.315+0000 7f5c22bc7640 1 --2- 172.21.15.62:0/311042805 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5aec039a70 0x7f5aec03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:56.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.319+0000 7f5c258c29c0 1 --2- 172.21.15.62:0/311042805 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x559701656690 0x559701658b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:56.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.319+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701659270 con 0x559701656690 2024-09-10T05:36:56.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.319+0000 7f5c23bc9640 1 --2- 172.21.15.62:0/311042805 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x559701656690 0x559701658b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:56.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.319+0000 7f5c22bc7640 1 --2- 172.21.15.62:0/311042805 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5aec039a70 0x7f5aec03bf30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c0aa750 tx=0x7f5c0c0a8000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:56.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.319+0000 7f5c23bc9640 1 --2- 172.21.15.62:0/311042805 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x559701656690 0x559701658b20 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:56.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.319+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5c1c00a4d0 con 0x559701656690 2024-09-10T05:36:56.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.319+0000 7f5c258c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:56.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.319+0000 7f5c258c29c0 20 realm 2024-09-10T05:36:56.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.319+0000 7f5c258c29c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:56.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.319+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701655a80 con 0x559701656690 2024-09-10T05:36:56.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.319+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5c1c00a4d0 con 0x559701656690 2024-09-10T05:36:56.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.319+0000 7f5c258c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:56.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.319+0000 7f5c258c29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:56.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.319+0000 7f5c258c29c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:56.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.319+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701659d30 con 0x559701656690 2024-09-10T05:36:56.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.319+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5c1c00a4d0 con 0x559701656690 2024-09-10T05:36:56.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.319+0000 7f5c258c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:56.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.319+0000 7f5c258c29c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:56.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.319+0000 7f5c258c29c0 1 --2- 172.21.15.62:0/311042805 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55970165ab10 0x55970165cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:56.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.319+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55970165d590 con 0x55970165ab10 2024-09-10T05:36:56.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.319+0000 7f5c233c8640 1 --2- 172.21.15.62:0/311042805 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55970165ab10 0x55970165cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:56.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.319+0000 7f5c233c8640 1 --2- 172.21.15.62:0/311042805 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55970165ab10 0x55970165cf00 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:56.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.319+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.319+0000 7f5c258c29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:56.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.319+0000 7f5c258c29c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:56.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.319+0000 7f5c258c29c0 1 --2- 172.21.15.62:0/311042805 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55970165e340 0x559701660730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:56.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.319+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701660dd0 con 0x55970165e340 2024-09-10T05:36:56.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.319+0000 7f5c22bc7640 1 --2- 172.21.15.62:0/311042805 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55970165e340 0x559701660730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:56.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.319+0000 7f5c22bc7640 1 --2- 172.21.15.62:0/311042805 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55970165e340 0x559701660730 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:56.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.323+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5c0c0a8070 con 0x55970165e340 2024-09-10T05:36:56.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.323+0000 7f5c258c29c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:56.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.323+0000 7f5c258c29c0 20 searching for the correct realm 2024-09-10T05:36:56.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.323+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5597016626a0 con 0x55970165e340 2024-09-10T05:36:56.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.323+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c0c0a8070 con 0x55970165e340 2024-09-10T05:36:56.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.323+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5597016626a0 con 0x55970165ab10 2024-09-10T05:36:56.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.323+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.323+0000 7f5c233c8640 1 --2- 172.21.15.62:0/311042805 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f5c14017050 0x7f5c1402f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:56.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.323+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5597016626a0 con 0x7f5c14017050 2024-09-10T05:36:56.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.323+0000 7f5c23bc9640 1 --2- 172.21.15.62:0/311042805 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f5c14017050 0x7f5c1402f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:56.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.323+0000 7f5c23bc9640 1 --2- 172.21.15.62:0/311042805 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f5c14017050 0x7f5c1402f3c0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:56.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.323+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c1c00a4d0 con 0x7f5c14017050 2024-09-10T05:36:56.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.323+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5597016626a0 con 0x559701656690 2024-09-10T05:36:56.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.323+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c1c00a4d0 con 0x559701656690 2024-09-10T05:36:56.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.323+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5597016626a0 con 0x559701656690 2024-09-10T05:36:56.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.323+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c1c00a4d0 con 0x559701656690 2024-09-10T05:36:56.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.323+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5597016626a0 con 0x55970165e340 2024-09-10T05:36:56.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.323+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c0c0a8070 con 0x55970165e340 2024-09-10T05:36:56.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.323+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5597016626a0 con 0x559701656690 2024-09-10T05:36:56.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.323+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c1c00a4d0 con 0x559701656690 2024-09-10T05:36:56.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.323+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5597016626a0 con 0x55970165ab10 2024-09-10T05:36:56.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.327+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.327+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5597016626a0 con 0x55970165ab10 2024-09-10T05:36:56.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.327+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.327+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5597016626a0 con 0x559701656690 2024-09-10T05:36:56.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.327+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c1c00a4d0 con 0x559701656690 2024-09-10T05:36:56.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.327+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5597016626a0 con 0x7f5c14017050 2024-09-10T05:36:56.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.327+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c1c00a4d0 con 0x7f5c14017050 2024-09-10T05:36:56.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.327+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5597016626a0 con 0x559701656690 2024-09-10T05:36:56.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.327+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c1c00a4d0 con 0x559701656690 2024-09-10T05:36:56.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.327+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5597016626a0 con 0x7f5c14017050 2024-09-10T05:36:56.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.327+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5c1c00a4d0 con 0x7f5c14017050 2024-09-10T05:36:56.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.327+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5597016626a0 con 0x55970165ab10 2024-09-10T05:36:56.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.327+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.327+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5597016626a0 con 0x55970165e340 2024-09-10T05:36:56.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.327+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c0c0a8070 con 0x55970165e340 2024-09-10T05:36:56.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.327+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5597016626a0 con 0x559701656690 2024-09-10T05:36:56.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.327+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c1c00a4d0 con 0x559701656690 2024-09-10T05:36:56.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.327+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5597016626a0 con 0x55970165ab10 2024-09-10T05:36:56.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.331+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.331+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5597016626a0 con 0x55970165e340 2024-09-10T05:36:56.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.331+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 32 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f5c0c0a8070 con 0x55970165e340 2024-09-10T05:36:56.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.331+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5597016626a0 con 0x559701656690 2024-09-10T05:36:56.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.331+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c1c00a4d0 con 0x559701656690 2024-09-10T05:36:56.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.331+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5597016626a0 con 0x559701656690 2024-09-10T05:36:56.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.331+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5c1c00a4d0 con 0x559701656690 2024-09-10T05:36:56.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.331+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5597016626a0 con 0x559701656690 2024-09-10T05:36:56.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.331+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c1c00a4d0 con 0x559701656690 2024-09-10T05:36:56.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.331+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5597016626a0 con 0x55970165e340 2024-09-10T05:36:56.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.331+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c0c0a8070 con 0x55970165e340 2024-09-10T05:36:56.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.331+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5597016626a0 con 0x7f5c14017050 2024-09-10T05:36:56.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.331+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c1c00a4d0 con 0x7f5c14017050 2024-09-10T05:36:56.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.331+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5597016626a0 con 0x559701656690 2024-09-10T05:36:56.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.331+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c1c00a4d0 con 0x559701656690 2024-09-10T05:36:56.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.331+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5597016626a0 con 0x7f5c14017050 2024-09-10T05:36:56.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.331+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c1c00a4d0 con 0x7f5c14017050 2024-09-10T05:36:56.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.331+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5597016626a0 con 0x55970165e340 2024-09-10T05:36:56.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.331+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c0c0a8070 con 0x55970165e340 2024-09-10T05:36:56.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.331+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5597016626a0 con 0x7f5c14017050 2024-09-10T05:36:56.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.331+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c1c00a4d0 con 0x7f5c14017050 2024-09-10T05:36:56.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.331+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5597016626a0 con 0x55970165ab10 2024-09-10T05:36:56.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.335+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.335+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5597016626a0 con 0x55970165ab10 2024-09-10T05:36:56.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.335+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.335+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5597016626a0 con 0x55970165e340 2024-09-10T05:36:56.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.335+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c0c0a8070 con 0x55970165e340 2024-09-10T05:36:56.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.335+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5597016626a0 con 0x55970165ab10 2024-09-10T05:36:56.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.335+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.335+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5597016626a0 con 0x55970165ab10 2024-09-10T05:36:56.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.335+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.335+0000 7f5c258c29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:56.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.335+0000 7f5c258c29c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:56.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.335+0000 7f5c258c29c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:56.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.335+0000 7f5c258c29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:56.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.335+0000 7f5c258c29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:56.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.335+0000 7f5c258c29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:56.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.335+0000 7f5c258c29c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:56.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.335+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701661790 con 0x559701656690 2024-09-10T05:36:56.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.335+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5c1c00a4d0 con 0x559701656690 2024-09-10T05:36:56.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.335+0000 7f5c258c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:56.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.335+0000 7f5c258c29c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:56.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.335+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701661bb0 con 0x55970165ab10 2024-09-10T05:36:56.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.339+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.339+0000 7f5c258c29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:56.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.339+0000 7f5c258c29c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:56.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.339+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701661b80 con 0x55970165e340 2024-09-10T05:36:56.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.339+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5c0c0a8070 con 0x55970165e340 2024-09-10T05:36:56.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.339+0000 7f5c258c29c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:56.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.339+0000 7f5c258c29c0 20 zone default found 2024-09-10T05:36:56.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.339+0000 7f5c258c29c0 4 Realm: () 2024-09-10T05:36:56.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.339+0000 7f5c258c29c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:56.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.339+0000 7f5c258c29c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:56.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.339+0000 7f5c258c29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:56.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.339+0000 7f5c258c29c0 20 zonegroup default 2024-09-10T05:36:56.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.339+0000 7f5c258c29c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:56.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.339+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701662b50 con 0x7f5c14017050 2024-09-10T05:36:56.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.339+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5c1c00a4d0 con 0x7f5c14017050 2024-09-10T05:36:56.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.339+0000 7f5c258c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:56.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.339+0000 7f5c258c29c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:56.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.339+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5597016649e0 con 0x55970165e340 2024-09-10T05:36:56.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.339+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5c0c0a8070 con 0x55970165e340 2024-09-10T05:36:56.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.339+0000 7f5c258c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:56.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.339+0000 7f5c258c29c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:56.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.339+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701664e50 con 0x55970165e340 2024-09-10T05:36:56.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.339+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5c0c0a8070 con 0x55970165e340 2024-09-10T05:36:56.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.339+0000 7f5c258c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:56.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.339+0000 7f5c258c29c0 20 started sync module instance, tier type = 2024-09-10T05:36:56.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.339+0000 7f5c258c29c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:56.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.339+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559701663d80 con 0x55970165ab10 2024-09-10T05:36:56.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.343+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.343+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94107051901600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559701663d80 con 0x55970165ab10 2024-09-10T05:36:56.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.343+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559701665940 con 0x559701656690 2024-09-10T05:36:56.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.343+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c1c00a4d0 con 0x559701656690 2024-09-10T05:36:56.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.343+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94107051906128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5597016661e0 con 0x559701656690 2024-09-10T05:36:56.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.343+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559701666c20 con 0x55970165ab10 2024-09-10T05:36:56.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.343+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94107051901600] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.343+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94107051906128] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c1c00a4d0 con 0x559701656690 2024-09-10T05:36:56.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.347+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.347+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94107051910896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559701665d30 con 0x55970165ab10 2024-09-10T05:36:56.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.347+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5597016674c0 con 0x7f5c14017050 2024-09-10T05:36:56.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.347+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c1c00a4d0 con 0x7f5c14017050 2024-09-10T05:36:56.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.347+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94107051913232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559701665d30 con 0x7f5c14017050 2024-09-10T05:36:56.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.347+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559701667f80 con 0x55970165ab10 2024-09-10T05:36:56.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.347+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94107051910896] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.347+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94107051913232] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c1c00a4d0 con 0x7f5c14017050 2024-09-10T05:36:56.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.347+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.347+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94107051914288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559701667f40 con 0x55970165ab10 2024-09-10T05:36:56.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.347+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559701668370 con 0x55970165e340 2024-09-10T05:36:56.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.351+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c0c0a8070 con 0x55970165e340 2024-09-10T05:36:56.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.351+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94107051899088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559701668370 con 0x55970165e340 2024-09-10T05:36:56.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.351+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559701669270 con 0x55970165e340 2024-09-10T05:36:56.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.351+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94107051914288] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.351+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94107051899088] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c0c0a8070 con 0x55970165e340 2024-09-10T05:36:56.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.351+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c0c0a8070 con 0x55970165e340 2024-09-10T05:36:56.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.351+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94107051919200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559701668d80 con 0x55970165e340 2024-09-10T05:36:56.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.351+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559701669b10 con 0x7f5c14017050 2024-09-10T05:36:56.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.355+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c1c00a4d0 con 0x7f5c14017050 2024-09-10T05:36:56.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.355+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94107051923040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559701669f30 con 0x7f5c14017050 2024-09-10T05:36:56.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.355+0000 7f5c258c29c0 20 add_watcher() i=0 2024-09-10T05:36:56.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.355+0000 7f5c258c29c0 20 add_watcher() i=1 2024-09-10T05:36:56.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.355+0000 7f5c258c29c0 20 add_watcher() i=2 2024-09-10T05:36:56.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.355+0000 7f5c258c29c0 20 add_watcher() i=3 2024-09-10T05:36:56.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.355+0000 7f5c258c29c0 20 add_watcher() i=4 2024-09-10T05:36:56.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.355+0000 7f5c258c29c0 20 add_watcher() i=5 2024-09-10T05:36:56.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.355+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94107051919200] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c0c0a8070 con 0x55970165e340 2024-09-10T05:36:56.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.355+0000 7f5c258c29c0 20 add_watcher() i=6 2024-09-10T05:36:56.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.355+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94107051923040] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c1c00a4d0 con 0x7f5c14017050 2024-09-10T05:36:56.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.355+0000 7f5c258c29c0 20 add_watcher() i=7 2024-09-10T05:36:56.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.355+0000 7f5c258c29c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:56.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.355+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55970166cbe0 con 0x559701656690 2024-09-10T05:36:56.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.355+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5c1c00a4d0 con 0x559701656690 2024-09-10T05:36:56.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.355+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94107051915856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559701669f30 con 0x559701656690 2024-09-10T05:36:56.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.359+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94107051915856] v32'174 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5c1c00a4d0 con 0x559701656690 2024-09-10T05:36:56.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.359+0000 7f5ad9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:56.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.359+0000 7f5c258c29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:56.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.359+0000 7f5c258c29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:56.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.359+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559701675140 con 0x55970165ab10 2024-09-10T05:36:56.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.359+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'52 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.359+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5597016751a0 con 0x7f5c14017050 2024-09-10T05:36:56.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.363+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5c1c00a4d0 con 0x7f5c14017050 2024-09-10T05:36:56.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.363+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5597016758a0 con 0x55970165e340 2024-09-10T05:36:56.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.363+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5c0c0a8070 con 0x55970165e340 2024-09-10T05:36:56.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.363+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559701675d50 con 0x559701656690 2024-09-10T05:36:56.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.367+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'175 uv172 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5c1c00a4d0 con 0x559701656690 2024-09-10T05:36:56.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.367+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559701673320 con 0x55970165ab10 2024-09-10T05:36:56.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.367+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'62 uv61 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.367+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5597016732f0 con 0x55970165e340 2024-09-10T05:36:56.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.371+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'49 uv48 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5c0c0a8070 con 0x55970165e340 2024-09-10T05:36:56.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.371+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5597016732f0 con 0x55970165ab10 2024-09-10T05:36:56.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.371+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'32 uv31 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.371+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5597016732f0 con 0x559701656690 2024-09-10T05:36:56.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.375+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'43 uv42 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5c1c00a4d0 con 0x559701656690 2024-09-10T05:36:56.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.375+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559701676a80 con 0x55970165ab10 2024-09-10T05:36:56.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.375+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.375+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559701676a80 con 0x55970165ab10 2024-09-10T05:36:56.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.379+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.379+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559701673070 con 0x55970165ab10 2024-09-10T05:36:56.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.383+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'63 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.383+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559701676a80 con 0x55970165e340 2024-09-10T05:36:56.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.383+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'26 uv25 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c0c0a8070 con 0x55970165e340 2024-09-10T05:36:56.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.383+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559701676f30 con 0x55970165ab10 2024-09-10T05:36:56.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.387+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.387+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559701676f30 con 0x559701656690 2024-09-10T05:36:56.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.387+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'55 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c1c00a4d0 con 0x559701656690 2024-09-10T05:36:56.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.387+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5597016722e0 con 0x559701656690 2024-09-10T05:36:56.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.391+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'176 uv168 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c1c00a4d0 con 0x559701656690 2024-09-10T05:36:56.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.391+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5597016722e0 con 0x55970165ab10 2024-09-10T05:36:56.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.391+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 25 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'57 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.391+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5597016722e0 con 0x55970165ab10 2024-09-10T05:36:56.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.395+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 26 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'64 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.395+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5597016722e0 con 0x55970165e340 2024-09-10T05:36:56.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.395+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 <== osd.3 v2:172.21.15.62:6816/2708991149 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'34 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c0c0a8070 con 0x55970165e340 2024-09-10T05:36:56.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.395+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5597016722e0 con 0x55970165ab10 2024-09-10T05:36:56.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.399+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.399+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5597016722e0 con 0x559701656690 2024-09-10T05:36:56.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.399+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.1 v2:172.21.15.62:6808/3442097179 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'177 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c1c00a4d0 con 0x559701656690 2024-09-10T05:36:56.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.399+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559701672110 con 0x55970165ab10 2024-09-10T05:36:56.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.403+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 28 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'58 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.403+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559701672110 con 0x7f5c14017050 2024-09-10T05:36:56.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.403+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'38 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c1c00a4d0 con 0x7f5c14017050 2024-09-10T05:36:56.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.403+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559701672110 con 0x55970165e340 2024-09-10T05:36:56.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.407+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 <== osd.3 v2:172.21.15.62:6816/2708991149 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c0c0a8070 con 0x55970165e340 2024-09-10T05:36:56.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.407+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559701672110 con 0x55970165ab10 2024-09-10T05:36:56.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.407+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 29 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'41 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.407+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559701672110 con 0x55970165e340 2024-09-10T05:36:56.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.411+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 <== osd.3 v2:172.21.15.62:6816/2708991149 21 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c0c0a8070 con 0x55970165e340 2024-09-10T05:36:56.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.411+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559701672110 con 0x55970165e340 2024-09-10T05:36:56.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.411+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 <== osd.3 v2:172.21.15.62:6816/2708991149 22 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'50 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c0c0a8070 con 0x55970165e340 2024-09-10T05:36:56.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.411+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559701672110 con 0x55970165e340 2024-09-10T05:36:56.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.415+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 <== osd.3 v2:172.21.15.62:6816/2708991149 23 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c0c0a8070 con 0x55970165e340 2024-09-10T05:36:56.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.415+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559701672110 con 0x55970165ab10 2024-09-10T05:36:56.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.419+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 30 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'36 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.419+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559701672110 con 0x559701656690 2024-09-10T05:36:56.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.419+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.1 v2:172.21.15.62:6808/3442097179 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'44 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c1c00a4d0 con 0x559701656690 2024-09-10T05:36:56.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.419+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559701672110 con 0x55970165ab10 2024-09-10T05:36:56.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.423+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 31 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'59 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.423+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559701672110 con 0x559701656690 2024-09-10T05:36:56.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.423+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.1 v2:172.21.15.62:6808/3442097179 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'56 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c1c00a4d0 con 0x559701656690 2024-09-10T05:36:56.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.423+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559701672110 con 0x7f5c14017050 2024-09-10T05:36:56.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.427+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c1c00a4d0 con 0x7f5c14017050 2024-09-10T05:36:56.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.427+0000 7f5ad8fe1640 20 reqs_thread_entry: start 2024-09-10T05:36:56.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.427+0000 7f5c258c29c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:56.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.427+0000 7f5c258c29c0 20 Filter name: none 2024-09-10T05:36:56.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.427+0000 7f5a527fc640 20 reqs_thread_entry: start 2024-09-10T05:36:56.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.427+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x55970165ab10 2024-09-10T05:36:56.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.427+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 32 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.427+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701691ab0 con 0x55970165ab10 2024-09-10T05:36:56.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.427+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 33 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv51 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.427+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x55970165ab10 2024-09-10T05:36:56.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.431+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 34 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.431+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x7f5c14017050 2024-09-10T05:36:56.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.431+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.2 v2:172.21.15.62:6800/2677868286 15 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5c1c00a4d0 con 0x7f5c14017050 2024-09-10T05:36:56.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.431+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701691ab0 con 0x7f5c14017050 2024-09-10T05:36:56.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.431+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.2 v2:172.21.15.62:6800/2677868286 16 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5c1c00a4d0 con 0x7f5c14017050 2024-09-10T05:36:56.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.431+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x7f5c14017050 2024-09-10T05:36:56.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.431+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.2 v2:172.21.15.62:6800/2677868286 17 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5c1c00a4d0 con 0x7f5c14017050 2024-09-10T05:36:56.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.431+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x55970165e340 2024-09-10T05:36:56.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.431+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 <== osd.3 v2:172.21.15.62:6816/2708991149 24 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5c0c0a8070 con 0x55970165e340 2024-09-10T05:36:56.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.431+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701691ab0 con 0x55970165e340 2024-09-10T05:36:56.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.431+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 <== osd.3 v2:172.21.15.62:6816/2708991149 25 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5c0c0a8070 con 0x55970165e340 2024-09-10T05:36:56.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.431+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x55970165e340 2024-09-10T05:36:56.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.431+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 <== osd.3 v2:172.21.15.62:6816/2708991149 26 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5c0c0a8070 con 0x55970165e340 2024-09-10T05:36:56.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.431+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x559701656690 2024-09-10T05:36:56.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.431+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.1 v2:172.21.15.62:6808/3442097179 26 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv172 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5c1c00a4d0 con 0x559701656690 2024-09-10T05:36:56.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.431+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701691ab0 con 0x559701656690 2024-09-10T05:36:56.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.435+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.1 v2:172.21.15.62:6808/3442097179 27 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv172 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5c1c00a4d0 con 0x559701656690 2024-09-10T05:36:56.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.435+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x559701656690 2024-09-10T05:36:56.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.435+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.1 v2:172.21.15.62:6808/3442097179 28 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv172 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5c1c00a4d0 con 0x559701656690 2024-09-10T05:36:56.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.435+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x55970165ab10 2024-09-10T05:36:56.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.435+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 35 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv61 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.435+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701691ab0 con 0x55970165ab10 2024-09-10T05:36:56.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.435+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 36 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv61 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.435+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x55970165ab10 2024-09-10T05:36:56.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.435+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 37 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv61 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.435+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x55970165e340 2024-09-10T05:36:56.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.435+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 <== osd.3 v2:172.21.15.62:6816/2708991149 27 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv48 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5c0c0a8070 con 0x55970165e340 2024-09-10T05:36:56.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.435+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701691ab0 con 0x55970165e340 2024-09-10T05:36:56.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.435+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 <== osd.3 v2:172.21.15.62:6816/2708991149 28 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv48 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5c0c0a8070 con 0x55970165e340 2024-09-10T05:36:56.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.435+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x55970165e340 2024-09-10T05:36:56.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.435+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 <== osd.3 v2:172.21.15.62:6816/2708991149 29 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv48 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5c0c0a8070 con 0x55970165e340 2024-09-10T05:36:56.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.435+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x55970165ab10 2024-09-10T05:36:56.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.439+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 38 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv31 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.439+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701691ab0 con 0x55970165ab10 2024-09-10T05:36:56.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.439+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 39 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv31 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.439+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x55970165ab10 2024-09-10T05:36:56.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.439+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 40 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv31 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.439+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x559701656690 2024-09-10T05:36:56.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.439+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.1 v2:172.21.15.62:6808/3442097179 29 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv42 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5c1c00a4d0 con 0x559701656690 2024-09-10T05:36:56.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.439+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701691ab0 con 0x559701656690 2024-09-10T05:36:56.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.439+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.1 v2:172.21.15.62:6808/3442097179 30 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv42 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5c1c00a4d0 con 0x559701656690 2024-09-10T05:36:56.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.439+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x559701656690 2024-09-10T05:36:56.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.439+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.1 v2:172.21.15.62:6808/3442097179 31 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv42 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5c1c00a4d0 con 0x559701656690 2024-09-10T05:36:56.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.439+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x55970165ab10 2024-09-10T05:36:56.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.443+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 41 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.443+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701691ab0 con 0x55970165ab10 2024-09-10T05:36:56.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.443+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 42 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.443+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x55970165ab10 2024-09-10T05:36:56.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.443+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 43 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.443+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x55970165ab10 2024-09-10T05:36:56.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.443+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 44 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.443+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701691ab0 con 0x55970165ab10 2024-09-10T05:36:56.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.447+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 45 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.447+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x55970165ab10 2024-09-10T05:36:56.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.447+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 46 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.447+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x55970165ab10 2024-09-10T05:36:56.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.447+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 47 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.447+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701691ab0 con 0x55970165ab10 2024-09-10T05:36:56.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.447+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 48 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv57 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.447+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x55970165ab10 2024-09-10T05:36:56.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.451+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 49 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.451+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x55970165e340 2024-09-10T05:36:56.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.451+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 <== osd.3 v2:172.21.15.62:6816/2708991149 30 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv25 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5c0c0a8070 con 0x55970165e340 2024-09-10T05:36:56.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.451+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701691ab0 con 0x55970165e340 2024-09-10T05:36:56.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.451+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 <== osd.3 v2:172.21.15.62:6816/2708991149 31 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv25 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5c0c0a8070 con 0x55970165e340 2024-09-10T05:36:56.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.451+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x55970165e340 2024-09-10T05:36:56.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.451+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 <== osd.3 v2:172.21.15.62:6816/2708991149 32 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv25 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5c0c0a8070 con 0x55970165e340 2024-09-10T05:36:56.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.451+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x55970165ab10 2024-09-10T05:36:56.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.451+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 50 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.451+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701691ab0 con 0x55970165ab10 2024-09-10T05:36:56.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.451+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 51 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.451+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x55970165ab10 2024-09-10T05:36:56.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.455+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 52 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.455+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x559701656690 2024-09-10T05:36:56.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.455+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.1 v2:172.21.15.62:6808/3442097179 32 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5c1c00a4d0 con 0x559701656690 2024-09-10T05:36:56.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.455+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701691ab0 con 0x559701656690 2024-09-10T05:36:56.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.455+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.1 v2:172.21.15.62:6808/3442097179 33 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv52 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5c1c00a4d0 con 0x559701656690 2024-09-10T05:36:56.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.455+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x559701656690 2024-09-10T05:36:56.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.455+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.1 v2:172.21.15.62:6808/3442097179 34 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5c1c03e040 con 0x559701656690 2024-09-10T05:36:56.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.455+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x559701656690 2024-09-10T05:36:56.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.455+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.1 v2:172.21.15.62:6808/3442097179 35 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv168 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5c1c03e040 con 0x559701656690 2024-09-10T05:36:56.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.455+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701691ab0 con 0x559701656690 2024-09-10T05:36:56.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.455+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.1 v2:172.21.15.62:6808/3442097179 36 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv168 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5c1c03e040 con 0x559701656690 2024-09-10T05:36:56.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.455+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x559701656690 2024-09-10T05:36:56.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.455+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.1 v2:172.21.15.62:6808/3442097179 37 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv168 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5c1c03e040 con 0x559701656690 2024-09-10T05:36:56.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.455+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x55970165ab10 2024-09-10T05:36:56.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.455+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 53 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.455+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701691ab0 con 0x55970165ab10 2024-09-10T05:36:56.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.459+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 54 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv52 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.459+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x55970165ab10 2024-09-10T05:36:56.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.459+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 55 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.459+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x55970165ab10 2024-09-10T05:36:56.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.459+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 56 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.459+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701691ab0 con 0x55970165ab10 2024-09-10T05:36:56.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.459+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 57 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv59 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.459+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x55970165ab10 2024-09-10T05:36:56.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.463+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 58 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.463+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x55970165e340 2024-09-10T05:36:56.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.463+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 <== osd.3 v2:172.21.15.62:6816/2708991149 33 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5c0c0a8070 con 0x55970165e340 2024-09-10T05:36:56.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.463+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701691ab0 con 0x55970165e340 2024-09-10T05:36:56.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.463+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 <== osd.3 v2:172.21.15.62:6816/2708991149 34 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5c0c0a8070 con 0x55970165e340 2024-09-10T05:36:56.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.463+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x55970165e340 2024-09-10T05:36:56.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.463+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 <== osd.3 v2:172.21.15.62:6816/2708991149 35 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5c0c0a8070 con 0x55970165e340 2024-09-10T05:36:56.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.463+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x55970165ab10 2024-09-10T05:36:56.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.463+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 59 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.463+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701691ab0 con 0x55970165ab10 2024-09-10T05:36:56.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.463+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 60 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.463+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x55970165ab10 2024-09-10T05:36:56.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.467+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 61 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.467+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x559701656690 2024-09-10T05:36:56.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.467+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.1 v2:172.21.15.62:6808/3442097179 38 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv170 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5c1c03e040 con 0x559701656690 2024-09-10T05:36:56.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.467+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701691ab0 con 0x559701656690 2024-09-10T05:36:56.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.467+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.1 v2:172.21.15.62:6808/3442097179 39 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv170 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5c1c03e040 con 0x559701656690 2024-09-10T05:36:56.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.467+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x559701656690 2024-09-10T05:36:56.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.467+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.1 v2:172.21.15.62:6808/3442097179 40 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv170 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5c1c03e040 con 0x559701656690 2024-09-10T05:36:56.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.467+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x55970165ab10 2024-09-10T05:36:56.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.467+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 62 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.467+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701691ab0 con 0x55970165ab10 2024-09-10T05:36:56.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.471+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 63 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv54 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.471+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x55970165ab10 2024-09-10T05:36:56.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.471+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 64 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.471+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x7f5c14017050 2024-09-10T05:36:56.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.471+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.2 v2:172.21.15.62:6800/2677868286 18 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv37 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5c1c03e040 con 0x7f5c14017050 2024-09-10T05:36:56.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.471+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701691ab0 con 0x7f5c14017050 2024-09-10T05:36:56.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.471+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.2 v2:172.21.15.62:6800/2677868286 19 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv37 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5c1c03e040 con 0x7f5c14017050 2024-09-10T05:36:56.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.471+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x7f5c14017050 2024-09-10T05:36:56.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.471+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.2 v2:172.21.15.62:6800/2677868286 20 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv37 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5c1c03e040 con 0x7f5c14017050 2024-09-10T05:36:56.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.471+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x55970165e340 2024-09-10T05:36:56.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.475+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 <== osd.3 v2:172.21.15.62:6816/2708991149 36 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5c0c0a8070 con 0x55970165e340 2024-09-10T05:36:56.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.475+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701691ab0 con 0x55970165e340 2024-09-10T05:36:56.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.475+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 <== osd.3 v2:172.21.15.62:6816/2708991149 37 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5c0c0a8070 con 0x55970165e340 2024-09-10T05:36:56.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.475+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x55970165e340 2024-09-10T05:36:56.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.475+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 <== osd.3 v2:172.21.15.62:6816/2708991149 38 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5c0c0a8070 con 0x55970165e340 2024-09-10T05:36:56.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.475+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x55970165ab10 2024-09-10T05:36:56.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.475+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 65 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.475+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701691ab0 con 0x55970165ab10 2024-09-10T05:36:56.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.475+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 66 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.479+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x55970165ab10 2024-09-10T05:36:56.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.479+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 67 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.479+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x55970165e340 2024-09-10T05:36:56.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.479+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 <== osd.3 v2:172.21.15.62:6816/2708991149 39 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5c0c0a8070 con 0x55970165e340 2024-09-10T05:36:56.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.479+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701691ab0 con 0x55970165e340 2024-09-10T05:36:56.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.479+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 <== osd.3 v2:172.21.15.62:6816/2708991149 40 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5c0c0a8070 con 0x55970165e340 2024-09-10T05:36:56.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.479+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x55970165e340 2024-09-10T05:36:56.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.479+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 <== osd.3 v2:172.21.15.62:6816/2708991149 41 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5c0c0a8070 con 0x55970165e340 2024-09-10T05:36:56.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.479+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x55970165e340 2024-09-10T05:36:56.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.479+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 <== osd.3 v2:172.21.15.62:6816/2708991149 42 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5c0c0a8070 con 0x55970165e340 2024-09-10T05:36:56.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.479+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701691ab0 con 0x55970165e340 2024-09-10T05:36:56.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.483+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 <== osd.3 v2:172.21.15.62:6816/2708991149 43 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv46 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5c0c0a8070 con 0x55970165e340 2024-09-10T05:36:56.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.483+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x55970165e340 2024-09-10T05:36:56.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.483+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 <== osd.3 v2:172.21.15.62:6816/2708991149 44 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5c0c0a8070 con 0x55970165e340 2024-09-10T05:36:56.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.483+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x55970165e340 2024-09-10T05:36:56.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.483+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 <== osd.3 v2:172.21.15.62:6816/2708991149 45 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5c0c0a8070 con 0x55970165e340 2024-09-10T05:36:56.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.483+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701691ab0 con 0x55970165e340 2024-09-10T05:36:56.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.483+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 <== osd.3 v2:172.21.15.62:6816/2708991149 46 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5c0c0a8070 con 0x55970165e340 2024-09-10T05:36:56.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.483+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x55970165e340 2024-09-10T05:36:56.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.483+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 <== osd.3 v2:172.21.15.62:6816/2708991149 47 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5c0c0a8070 con 0x55970165e340 2024-09-10T05:36:56.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.483+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x55970165ab10 2024-09-10T05:36:56.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.483+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 68 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.483+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701691ab0 con 0x55970165ab10 2024-09-10T05:36:56.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.487+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 69 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.487+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x55970165ab10 2024-09-10T05:36:56.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.487+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 70 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.487+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x559701656690 2024-09-10T05:36:56.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.487+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.1 v2:172.21.15.62:6808/3442097179 41 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5c1c03e040 con 0x559701656690 2024-09-10T05:36:56.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.487+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701691ab0 con 0x559701656690 2024-09-10T05:36:56.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.487+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.1 v2:172.21.15.62:6808/3442097179 42 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5c1c03e040 con 0x559701656690 2024-09-10T05:36:56.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.487+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x559701656690 2024-09-10T05:36:56.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.487+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.1 v2:172.21.15.62:6808/3442097179 43 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5c1c03e040 con 0x559701656690 2024-09-10T05:36:56.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.487+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x55970165ab10 2024-09-10T05:36:56.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.491+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 71 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv56 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.491+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701691ab0 con 0x55970165ab10 2024-09-10T05:36:56.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.491+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 72 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv56 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.491+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x55970165ab10 2024-09-10T05:36:56.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.491+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 73 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv56 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.491+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x559701656690 2024-09-10T05:36:56.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.495+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.1 v2:172.21.15.62:6808/3442097179 44 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5c1c03e040 con 0x559701656690 2024-09-10T05:36:56.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.495+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701691ab0 con 0x559701656690 2024-09-10T05:36:56.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.495+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.1 v2:172.21.15.62:6808/3442097179 45 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv54 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5c1c03e040 con 0x559701656690 2024-09-10T05:36:56.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.495+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x559701656690 2024-09-10T05:36:56.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.495+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.1 v2:172.21.15.62:6808/3442097179 46 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5c1c03e040 con 0x559701656690 2024-09-10T05:36:56.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.495+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x7f5c14017050 2024-09-10T05:36:56.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.495+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.2 v2:172.21.15.62:6800/2677868286 21 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5c1c03e040 con 0x7f5c14017050 2024-09-10T05:36:56.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.495+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701691ab0 con 0x7f5c14017050 2024-09-10T05:36:56.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.495+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.2 v2:172.21.15.62:6800/2677868286 22 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5c1c03e040 con 0x7f5c14017050 2024-09-10T05:36:56.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.495+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559701692ac0 con 0x7f5c14017050 2024-09-10T05:36:56.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.495+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.2 v2:172.21.15.62:6800/2677868286 23 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5c1c03e040 con 0x7f5c14017050 2024-09-10T05:36:56.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.499+0000 7f5ad9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:56.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.499+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94107051915856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559701650830 con 0x559701656690 2024-09-10T05:36:56.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.503+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.1 v2:172.21.15.62:6808/3442097179 47 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94107051915856] v32'178 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5c1c03e040 con 0x559701656690 2024-09-10T05:36:56.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.503+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94107051901600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559701667a50 con 0x55970165ab10 2024-09-10T05:36:56.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.503+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 74 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94107051901600] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.503+0000 7f5c258c29c0 20 remove_watcher() i=0 2024-09-10T05:36:56.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.503+0000 7f5c258c29c0 2 removed watcher, disabling cache 2024-09-10T05:36:56.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.503+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94107051906128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559701667a50 con 0x559701656690 2024-09-10T05:36:56.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.507+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.1 v2:172.21.15.62:6808/3442097179 48 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94107051906128] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c1c03e040 con 0x559701656690 2024-09-10T05:36:56.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.507+0000 7f5c258c29c0 20 remove_watcher() i=1 2024-09-10T05:36:56.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.507+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94107051910896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559701667a50 con 0x55970165ab10 2024-09-10T05:36:56.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.511+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 75 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94107051910896] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.511+0000 7f5c258c29c0 20 remove_watcher() i=2 2024-09-10T05:36:56.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.511+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94107051913232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5597016666f0 con 0x7f5c14017050 2024-09-10T05:36:56.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.511+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.2 v2:172.21.15.62:6800/2677868286 24 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94107051913232] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c1c03e040 con 0x7f5c14017050 2024-09-10T05:36:56.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.511+0000 7f5c258c29c0 20 remove_watcher() i=3 2024-09-10T05:36:56.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.511+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94107051914288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559701667a50 con 0x55970165ab10 2024-09-10T05:36:56.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.515+0000 7f5c233c8640 1 -- 172.21.15.62:0/311042805 <== osd.0 v2:172.21.15.2:6800/945139080 76 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94107051914288] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c14034070 con 0x55970165ab10 2024-09-10T05:36:56.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.515+0000 7f5c258c29c0 20 remove_watcher() i=4 2024-09-10T05:36:56.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.515+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94107051899088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559701667a50 con 0x55970165e340 2024-09-10T05:36:56.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.515+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 <== osd.3 v2:172.21.15.62:6816/2708991149 48 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94107051899088] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c0c0a8070 con 0x55970165e340 2024-09-10T05:36:56.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.515+0000 7f5c258c29c0 20 remove_watcher() i=5 2024-09-10T05:36:56.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.515+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94107051919200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559701667a50 con 0x55970165e340 2024-09-10T05:36:56.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.519+0000 7f5c22bc7640 1 -- 172.21.15.62:0/311042805 <== osd.3 v2:172.21.15.62:6816/2708991149 49 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94107051919200] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c0c0a8070 con 0x55970165e340 2024-09-10T05:36:56.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.519+0000 7f5c258c29c0 20 remove_watcher() i=6 2024-09-10T05:36:56.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.519+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94107051923040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559701668760 con 0x7f5c14017050 2024-09-10T05:36:56.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.519+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 <== osd.2 v2:172.21.15.62:6800/2677868286 25 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94107051923040] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c1c03e040 con 0x7f5c14017050 2024-09-10T05:36:56.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.519+0000 7f5c258c29c0 20 remove_watcher() i=7 2024-09-10T05:36:56.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.523+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55970165ab10 msgr2=0x55970165cf00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:56.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.523+0000 7f5c258c29c0 1 --2- 172.21.15.62:0/311042805 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55970165ab10 0x55970165cf00 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:56.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.523+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x559701656690 msgr2=0x559701658b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:56.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.523+0000 7f5c258c29c0 1 --2- 172.21.15.62:0/311042805 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x559701656690 0x559701658b20 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:56.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.523+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f5c14017050 msgr2=0x7f5c1402f3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:56.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.523+0000 7f5c258c29c0 1 --2- 172.21.15.62:0/311042805 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f5c14017050 0x7f5c1402f3c0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:56.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.523+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55970165e340 msgr2=0x559701660730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:56.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.523+0000 7f5c258c29c0 1 --2- 172.21.15.62:0/311042805 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55970165e340 0x559701660730 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:56.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.523+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5aec039a70 msgr2=0x7f5aec03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:56.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.523+0000 7f5c258c29c0 1 --2- 172.21.15.62:0/311042805 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5aec039a70 0x7f5aec03bf30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c0aa750 tx=0x7f5c0c0a8000 comp rx=0 tx=0).stop 2024-09-10T05:36:56.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.523+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559701644490 msgr2=0x55970164b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:56.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.523+0000 7f5c23bc9640 1 -- 172.21.15.62:0/311042805 reap_dead start 2024-09-10T05:36:56.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.523+0000 7f5c258c29c0 1 --2- 172.21.15.62:0/311042805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559701644490 0x55970164b730 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f5c1403fec0 tx=0x7f5c1403cf60 comp rx=0 tx=0).stop 2024-09-10T05:36:56.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.523+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 shutdown_connections 2024-09-10T05:36:56.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.523+0000 7f5c258c29c0 1 --2- 172.21.15.62:0/311042805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559701644490 0x55970164b730 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:56.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.523+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 >> 172.21.15.62:0/311042805 conn(0x5597016408c0 msgr2=0x55970163ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:56.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.523+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 shutdown_connections 2024-09-10T05:36:56.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.523+0000 7f5c258c29c0 1 -- 172.21.15.62:0/311042805 wait complete. 2024-09-10T05:36:56.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.523+0000 7f5c258c29c0 1 -- 172.21.15.62:0/1423264730 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5afc039ac0 msgr2=0x7f5afc03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:56.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.523+0000 7f5c258c29c0 1 --2- 172.21.15.62:0/1423264730 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5afc039ac0 0x7f5afc03bf80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x559701625a80 tx=0x7f5c0c005a10 comp rx=0 tx=0).stop 2024-09-10T05:36:56.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.523+0000 7f5c258c29c0 1 -- 172.21.15.62:0/1423264730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559701637d00 msgr2=0x559701638120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:56.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.523+0000 7f5c258c29c0 1 --2- 172.21.15.62:0/1423264730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559701637d00 0x559701638120 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f5c1404e9d0 tx=0x7f5c14016b00 comp rx=0 tx=0).stop 2024-09-10T05:36:56.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.523+0000 7f5c258c29c0 1 -- 172.21.15.62:0/1423264730 shutdown_connections 2024-09-10T05:36:56.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.523+0000 7f5c258c29c0 1 --2- 172.21.15.62:0/1423264730 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5afc039ac0 0x7f5afc03bf80 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:56.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.523+0000 7f5c258c29c0 1 --2- 172.21.15.62:0/1423264730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559701637d00 0x559701638120 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:56.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.523+0000 7f5c258c29c0 1 -- 172.21.15.62:0/1423264730 >> 172.21.15.62:0/1423264730 conn(0x55970162d6b0 msgr2=0x55970162da90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:56.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.523+0000 7f5c258c29c0 1 -- 172.21.15.62:0/1423264730 shutdown_connections 2024-09-10T05:36:56.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.523+0000 7f5c258c29c0 1 -- 172.21.15.62:0/1423264730 wait complete. 2024-09-10T05:36:56.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.523+0000 7f5c258c29c0 1 -- 172.21.15.62:0/660712500 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x559701622430 msgr2=0x559701624820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:56.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.523+0000 7f5c258c29c0 1 --2- 172.21.15.62:0/660712500 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x559701622430 0x559701624820 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:56.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.523+0000 7f5c258c29c0 1 -- 172.21.15.62:0/660712500 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x559701527ff0 msgr2=0x559701621140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:56.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.523+0000 7f5c258c29c0 1 --2- 172.21.15.62:0/660712500 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x559701527ff0 0x559701621140 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:56.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.523+0000 7f5c258c29c0 1 -- 172.21.15.62:0/660712500 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x559701626c10 msgr2=0x559701629000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:56.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.523+0000 7f5c258c29c0 1 --2- 172.21.15.62:0/660712500 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x559701626c10 0x559701629000 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:56.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.523+0000 7f5c258c29c0 1 -- 172.21.15.62:0/660712500 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5b08039a70 msgr2=0x7f5b0803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:56.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.523+0000 7f5c258c29c0 1 --2- 172.21.15.62:0/660712500 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5b08039a70 0x7f5b0803bf30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c0ae000 tx=0x7f5c0c0a6000 comp rx=0 tx=0).stop 2024-09-10T05:36:56.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.523+0000 7f5c258c29c0 1 -- 172.21.15.62:0/660712500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559701523e00 msgr2=0x559701619fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:56.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.523+0000 7f5c258c29c0 1 --2- 172.21.15.62:0/660712500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559701523e00 0x559701619fd0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x55970160bea0 tx=0x7f5c14000bd0 comp rx=0 tx=0).stop 2024-09-10T05:36:56.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.523+0000 7f5c23bc9640 1 -- 172.21.15.62:0/660712500 reap_dead start 2024-09-10T05:36:56.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.523+0000 7f5c258c29c0 1 -- 172.21.15.62:0/660712500 shutdown_connections 2024-09-10T05:36:56.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.523+0000 7f5c258c29c0 1 -- 172.21.15.62:0/660712500 >> 172.21.15.62:0/660712500 conn(0x55970151f920 msgr2=0x55970160aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:56.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.523+0000 7f5c258c29c0 1 -- 172.21.15.62:0/660712500 shutdown_connections 2024-09-10T05:36:56.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.523+0000 7f5c258c29c0 1 -- 172.21.15.62:0/660712500 wait complete. 2024-09-10T05:36:56.543 INFO:teuthology.orchestra.run.smithi062.stdout:[] 2024-09-10T05:36:56.544 DEBUG:tasks.util.rgw: json result: [] 2024-09-10T05:36:56.544 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-10T05:36:56.544 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-10T05:36:56.544 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-10T05:36:56.623 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:56.623 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:56.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.619+0000 7f40ca6db9c0 1 Processor -- start 2024-09-10T05:36:56.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.619+0000 7f40ca6db9c0 1 -- start start 2024-09-10T05:36:56.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.623+0000 7f40ca6db9c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55df4d567150 0x55df4d569540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:56.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.623+0000 7f40ca6db9c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55df4d4179c0 con 0x55df4d562fb0 2024-09-10T05:36:56.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.623+0000 7f40ca6db9c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x55df4d4676d0 con 0x55df4d567150 2024-09-10T05:36:56.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.623+0000 7f40c79e0640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55df4d567150 0x55df4d569540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:56.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.623+0000 7f40c79e0640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55df4d567150 0x55df4d569540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47924/0 (socket says 172.21.15.62:47924) 2024-09-10T05:36:56.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.623+0000 7f40c79e0640 1 -- 172.21.15.62:0/4294295304 learned_addr learned my addr 172.21.15.62:0/4294295304 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:56.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.623+0000 7f40c79e0640 1 -- 172.21.15.62:0/4294295304 >> v1:172.21.15.2:6789/0 conn(0x55df4d562fb0 legacy=0x55df4d563390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:56.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.623+0000 7f40c79e0640 1 -- 172.21.15.62:0/4294295304 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df4d40bca0 con 0x55df4d567150 2024-09-10T05:36:56.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.623+0000 7f40c79e0640 1 --2- 172.21.15.62:0/4294295304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55df4d567150 0x55df4d569540 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f40bc00a5c0 tx=0x7f40bc01b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e30db673a65c30a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:56.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.623+0000 7f40c71df640 1 -- 172.21.15.62:0/4294295304 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40bc0a9590 con 0x55df4d567150 2024-09-10T05:36:56.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.623+0000 7f40c71df640 1 -- 172.21.15.62:0/4294295304 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40bc0ae070 con 0x55df4d567150 2024-09-10T05:36:56.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.623+0000 7f40c71df640 1 -- 172.21.15.62:0/4294295304 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40bc0a9880 con 0x55df4d567150 2024-09-10T05:36:56.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.627+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/4294295304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55df4d567150 msgr2=0x55df4d569540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:56.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.627+0000 7f40ca6db9c0 1 --2- 172.21.15.62:0/4294295304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55df4d567150 0x55df4d569540 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f40bc00a5c0 tx=0x7f40bc01b3d0 comp rx=0 tx=0).stop 2024-09-10T05:36:56.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.627+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/4294295304 shutdown_connections 2024-09-10T05:36:56.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.627+0000 7f40ca6db9c0 1 --2- 172.21.15.62:0/4294295304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55df4d567150 0x55df4d569540 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:56.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.627+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/4294295304 >> 172.21.15.62:0/4294295304 conn(0x55df4d55ead0 msgr2=0x55df4d560ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:56.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.627+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/4294295304 shutdown_connections 2024-09-10T05:36:56.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.627+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/4294295304 wait complete. 2024-09-10T05:36:56.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.643+0000 7f40ca6db9c0 1 Processor -- start 2024-09-10T05:36:56.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.643+0000 7f40ca6db9c0 1 -- start start 2024-09-10T05:36:56.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.643+0000 7f40ca6db9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55df4d562fb0 0x55df4d64e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:56.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.643+0000 7f40ca6db9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55df4d46b680 con 0x55df4d562fb0 2024-09-10T05:36:56.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.643+0000 7f40c81e1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55df4d562fb0 0x55df4d64e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:56.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.643+0000 7f40c81e1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55df4d562fb0 0x55df4d64e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47932/0 (socket says 172.21.15.62:47932) 2024-09-10T05:36:56.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.643+0000 7f40c81e1640 1 -- 172.21.15.62:0/1481448049 learned_addr learned my addr 172.21.15.62:0/1481448049 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:56.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.643+0000 7f40c81e1640 1 -- 172.21.15.62:0/1481448049 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df4d3e6da0 con 0x55df4d562fb0 2024-09-10T05:36:56.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.643+0000 7f40c81e1640 1 --2- 172.21.15.62:0/1481448049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55df4d562fb0 0x55df4d64e6e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f40b800b220 tx=0x7f40b800b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c28ecb35cf467605 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:56.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.643+0000 7f3fb660c640 1 -- 172.21.15.62:0/1481448049 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40b800a040 con 0x55df4d562fb0 2024-09-10T05:36:56.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.643+0000 7f3fb660c640 1 -- 172.21.15.62:0/1481448049 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40b800f750 con 0x55df4d562fb0 2024-09-10T05:36:56.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.643+0000 7f3fb660c640 1 -- 172.21.15.62:0/1481448049 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40b800fa70 con 0x55df4d562fb0 2024-09-10T05:36:56.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.643+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/1481448049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55df4d562fb0 msgr2=0x55df4d64e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:56.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.643+0000 7f40ca6db9c0 1 --2- 172.21.15.62:0/1481448049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55df4d562fb0 0x55df4d64e6e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f40b800b220 tx=0x7f40b800b6e0 comp rx=0 tx=0).stop 2024-09-10T05:36:56.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.643+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/1481448049 shutdown_connections 2024-09-10T05:36:56.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.643+0000 7f40ca6db9c0 1 --2- 172.21.15.62:0/1481448049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55df4d562fb0 0x55df4d64e6e0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:56.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.643+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/1481448049 >> 172.21.15.62:0/1481448049 conn(0x55df4d55ead0 msgr2=0x55df4d64a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:56.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.643+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/1481448049 shutdown_connections 2024-09-10T05:36:56.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.643+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/1481448049 wait complete. 2024-09-10T05:36:56.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.647+0000 7f40ca6db9c0 1 Processor -- start 2024-09-10T05:36:56.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.647+0000 7f40ca6db9c0 1 -- start start 2024-09-10T05:36:56.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.647+0000 7f40ca6db9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55df4d562fb0 0x55df4d655d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:56.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.647+0000 7f40ca6db9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55df4d40da50 con 0x55df4d562fb0 2024-09-10T05:36:56.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.647+0000 7f40c81e1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55df4d562fb0 0x55df4d655d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:56.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.647+0000 7f40c81e1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55df4d562fb0 0x55df4d655d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47942/0 (socket says 172.21.15.62:47942) 2024-09-10T05:36:56.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.647+0000 7f40c81e1640 1 -- 172.21.15.62:0/2390218895 learned_addr learned my addr 172.21.15.62:0/2390218895 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:56.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.647+0000 7f40c81e1640 1 -- 172.21.15.62:0/2390218895 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df4d656270 con 0x55df4d562fb0 2024-09-10T05:36:56.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.647+0000 7f40c81e1640 1 --2- 172.21.15.62:0/2390218895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55df4d562fb0 0x55df4d655d10 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x55df4d64f6d0 tx=0x7f40b8000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:56.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.647+0000 7f3fb4e09640 1 -- 172.21.15.62:0/2390218895 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40b801a880 con 0x55df4d562fb0 2024-09-10T05:36:56.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.647+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/2390218895 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55df4d656500 con 0x55df4d562fb0 2024-09-10T05:36:56.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.647+0000 7f3fb4e09640 1 -- 172.21.15.62:0/2390218895 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40b801aa20 con 0x55df4d562fb0 2024-09-10T05:36:56.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.647+0000 7f3fb4e09640 1 -- 172.21.15.62:0/2390218895 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40b801ad00 con 0x55df4d562fb0 2024-09-10T05:36:56.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.647+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/2390218895 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df4d656eb0 con 0x55df4d562fb0 2024-09-10T05:36:56.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.647+0000 7f3fb4e09640 1 -- 172.21.15.62:0/2390218895 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f40b8017050 con 0x55df4d562fb0 2024-09-10T05:36:56.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.647+0000 7f3fb4e09640 1 --2- 172.21.15.62:0/2390218895 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3fb0039a70 0x7f3fb003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:56.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.647+0000 7f3fb4e09640 1 -- 172.21.15.62:0/2390218895 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7f40b8015020 con 0x55df4d562fb0 2024-09-10T05:36:56.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.647+0000 7f40c79e0640 1 --2- 172.21.15.62:0/2390218895 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3fb0039a70 0x7f3fb003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:56.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.651+0000 7f40ca6db9c0 1 --2- 172.21.15.62:0/2390218895 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55df4d567150 0x55df4d65ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:56.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.651+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/2390218895 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df4d65d3c0 con 0x55df4d567150 2024-09-10T05:36:56.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.651+0000 7f40c89e2640 1 --2- 172.21.15.62:0/2390218895 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55df4d567150 0x55df4d65ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:56.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.651+0000 7f40c79e0640 1 --2- 172.21.15.62:0/2390218895 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3fb0039a70 0x7f3fb003bf30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f40bc0ad000 tx=0x7f40bc0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:56.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.651+0000 7f40c89e2640 1 --2- 172.21.15.62:0/2390218895 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55df4d567150 0x55df4d65ce80 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:56.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.651+0000 7f40c89e2640 1 -- 172.21.15.62:0/2390218895 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40c000a4d0 con 0x55df4d567150 2024-09-10T05:36:56.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.651+0000 7f40ca6db9c0 1 --2- 172.21.15.62:0/2390218895 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55df4d65de90 0x55df4d660350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:56.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.651+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/2390218895 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df4d660ac0 con 0x55df4d65de90 2024-09-10T05:36:56.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.651+0000 7f40c81e1640 1 --2- 172.21.15.62:0/2390218895 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55df4d65de90 0x55df4d660350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:56.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.651+0000 7f40c81e1640 1 --2- 172.21.15.62:0/2390218895 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55df4d65de90 0x55df4d660350 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:56.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.651+0000 7f40c81e1640 1 -- 172.21.15.62:0/2390218895 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f40b802e070 con 0x55df4d65de90 2024-09-10T05:36:56.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.651+0000 7f40ca6db9c0 1 --2- 172.21.15.62:0/2390218895 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55df4d662880 0x55df4d664c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:56.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.651+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/2390218895 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df4d665360 con 0x55df4d662880 2024-09-10T05:36:56.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.651+0000 7f40c79e0640 1 --2- 172.21.15.62:0/2390218895 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55df4d662880 0x55df4d664c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:56.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.651+0000 7f40c79e0640 1 --2- 172.21.15.62:0/2390218895 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55df4d662880 0x55df4d664c70 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:56.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.651+0000 7f40c79e0640 1 -- 172.21.15.62:0/2390218895 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f40bc0a9a70 con 0x55df4d662880 2024-09-10T05:36:56.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.651+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/2390218895 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df4d661720 con 0x55df4d65de90 2024-09-10T05:36:56.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.655+0000 7f40c81e1640 1 -- 172.21.15.62:0/2390218895 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f40b802e070 con 0x55df4d65de90 2024-09-10T05:36:56.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.655+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/2390218895 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df4d661b80 con 0x55df4d662880 2024-09-10T05:36:56.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.655+0000 7f40c79e0640 1 -- 172.21.15.62:0/2390218895 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f40bc0a9a70 con 0x55df4d662880 2024-09-10T05:36:56.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.655+0000 7f40ca6db9c0 1 Processor -- start 2024-09-10T05:36:56.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.655+0000 7f40ca6db9c0 1 -- start start 2024-09-10T05:36:56.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.655+0000 7f40ca6db9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55df4d4d9c90 0x55df4d4d8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:56.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.655+0000 7f40ca6db9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55df4d478450 con 0x55df4d4d9c90 2024-09-10T05:36:56.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.655+0000 7f40c81e1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55df4d4d9c90 0x55df4d4d8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:56.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.655+0000 7f40c81e1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55df4d4d9c90 0x55df4d4d8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47946/0 (socket says 172.21.15.62:47946) 2024-09-10T05:36:56.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.655+0000 7f40c81e1640 1 -- 172.21.15.62:0/2797987266 learned_addr learned my addr 172.21.15.62:0/2797987266 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:56.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.655+0000 7f40c81e1640 1 -- 172.21.15.62:0/2797987266 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df4d4da1b0 con 0x55df4d4d9c90 2024-09-10T05:36:56.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.655+0000 7f40c81e1640 1 --2- 172.21.15.62:0/2797987266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55df4d4d9c90 0x55df4d4d8530 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f40b8018ce0 tx=0x7f40b800e740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:56.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.655+0000 7f3fadffb640 1 -- 172.21.15.62:0/2797987266 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40b802f350 con 0x55df4d4d9c90 2024-09-10T05:36:56.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.655+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/2797987266 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55df4d4d8a70 con 0x55df4d4d9c90 2024-09-10T05:36:56.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.655+0000 7f3fadffb640 1 -- 172.21.15.62:0/2797987266 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40b802f4f0 con 0x55df4d4d9c90 2024-09-10T05:36:56.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.655+0000 7f3fadffb640 1 -- 172.21.15.62:0/2797987266 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40b801c590 con 0x55df4d4d9c90 2024-09-10T05:36:56.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.655+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/2797987266 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df4d4d8a70 con 0x55df4d4d9c90 2024-09-10T05:36:56.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.659+0000 7f3fadffb640 1 -- 172.21.15.62:0/2797987266 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f40b803a030 con 0x55df4d4d9c90 2024-09-10T05:36:56.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.659+0000 7f3fadffb640 1 --2- 172.21.15.62:0/2797987266 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3fa0039a70 0x7f3fa003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:56.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.659+0000 7f3fadffb640 1 -- 172.21.15.62:0/2797987266 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7f40b8038070 con 0x55df4d4d9c90 2024-09-10T05:36:56.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.659+0000 7f40c79e0640 1 --2- 172.21.15.62:0/2797987266 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3fa0039a70 0x7f3fa003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:56.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.659+0000 7f40ca6db9c0 1 Processor -- start 2024-09-10T05:36:56.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.659+0000 7f40ca6db9c0 1 -- start start 2024-09-10T05:36:56.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.659+0000 7f40ca6db9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55df4d683140 0x55df4d683520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:56.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.659+0000 7f40c79e0640 1 --2- 172.21.15.62:0/2797987266 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3fa0039a70 0x7f3fa003bf30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f40bc0ab040 tx=0x7f40bc005ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:56.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.659+0000 7f40ca6db9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55df4d64ef10 con 0x55df4d683140 2024-09-10T05:36:56.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.659+0000 7f40c81e1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55df4d683140 0x55df4d683520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:56.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.659+0000 7f40c81e1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55df4d683140 0x55df4d683520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47958/0 (socket says 172.21.15.62:47958) 2024-09-10T05:36:56.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.659+0000 7f40c81e1640 1 -- 172.21.15.62:0/717888504 learned_addr learned my addr 172.21.15.62:0/717888504 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:56.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.659+0000 7f40c81e1640 1 -- 172.21.15.62:0/717888504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df4d683b10 con 0x55df4d683140 2024-09-10T05:36:56.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.659+0000 7f40c81e1640 1 --2- 172.21.15.62:0/717888504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55df4d683140 0x55df4d683520 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f40b801afd0 tx=0x7f40b801d550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc2ac5634761c777 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:56.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.659+0000 7f3fa77fe640 1 -- 172.21.15.62:0/717888504 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40b8041050 con 0x55df4d683140 2024-09-10T05:36:56.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.659+0000 7f3fa77fe640 1 -- 172.21.15.62:0/717888504 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40b80411f0 con 0x55df4d683140 2024-09-10T05:36:56.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.659+0000 7f3fa77fe640 1 -- 172.21.15.62:0/717888504 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40b801c980 con 0x55df4d683140 2024-09-10T05:36:56.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.659+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/717888504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55df4d683140 msgr2=0x55df4d683520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:56.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.659+0000 7f40ca6db9c0 1 --2- 172.21.15.62:0/717888504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55df4d683140 0x55df4d683520 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f40b801afd0 tx=0x7f40b801d550 comp rx=0 tx=0).stop 2024-09-10T05:36:56.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.659+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/717888504 shutdown_connections 2024-09-10T05:36:56.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.659+0000 7f40ca6db9c0 1 --2- 172.21.15.62:0/717888504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55df4d683140 0x55df4d683520 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:56.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.659+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/717888504 >> 172.21.15.62:0/717888504 conn(0x55df4d67e560 msgr2=0x55df4d67c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:56.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.659+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/717888504 shutdown_connections 2024-09-10T05:36:56.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.659+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/717888504 wait complete. 2024-09-10T05:36:56.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.663+0000 7f40ca6db9c0 1 Processor -- start 2024-09-10T05:36:56.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.663+0000 7f40ca6db9c0 1 -- start start 2024-09-10T05:36:56.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.663+0000 7f40ca6db9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55df4d683140 0x55df4d689440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:56.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.663+0000 7f40ca6db9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55df4d681f10 con 0x55df4d683140 2024-09-10T05:36:56.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.663+0000 7f40c81e1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55df4d683140 0x55df4d689440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:56.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.663+0000 7f40c81e1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55df4d683140 0x55df4d689440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47962/0 (socket says 172.21.15.62:47962) 2024-09-10T05:36:56.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.663+0000 7f40c81e1640 1 -- 172.21.15.62:0/3408064695 learned_addr learned my addr 172.21.15.62:0/3408064695 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:56.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.663+0000 7f40c81e1640 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df4d6899a0 con 0x55df4d683140 2024-09-10T05:36:56.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.663+0000 7f40c81e1640 1 --2- 172.21.15.62:0/3408064695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55df4d683140 0x55df4d689440 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f40b8050210 tx=0x7f40b800cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:56.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.663+0000 7f3fa5ffb640 1 -- 172.21.15.62:0/3408064695 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40b801c980 con 0x55df4d683140 2024-09-10T05:36:56.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.663+0000 7f3fa5ffb640 1 -- 172.21.15.62:0/3408064695 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40b806b030 con 0x55df4d683140 2024-09-10T05:36:56.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.663+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55df4d6899a0 con 0x55df4d683140 2024-09-10T05:36:56.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.663+0000 7f3fa5ffb640 1 -- 172.21.15.62:0/3408064695 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40b8020d80 con 0x55df4d683140 2024-09-10T05:36:56.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.663+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df4d6899a0 con 0x55df4d683140 2024-09-10T05:36:56.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.663+0000 7f3fa5ffb640 1 -- 172.21.15.62:0/3408064695 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f40b8062040 con 0x55df4d683140 2024-09-10T05:36:56.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.663+0000 7f3fa5ffb640 1 --2- 172.21.15.62:0/3408064695 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3f98039a20 0x7f3f9803bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:56.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.663+0000 7f3fa5ffb640 1 -- 172.21.15.62:0/3408064695 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7f40b8041e00 con 0x55df4d683140 2024-09-10T05:36:56.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.663+0000 7f40ca6db9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:56.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.663+0000 7f40c79e0640 1 --2- 172.21.15.62:0/3408064695 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3f98039a20 0x7f3f9803bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:56.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.663+0000 7f40ca6db9c0 1 --2- 172.21.15.62:0/3408064695 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55df4d6943b0 0x55df4d696840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:56.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.667+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df4d696f90 con 0x55df4d6943b0 2024-09-10T05:36:56.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.667+0000 7f40c89e2640 1 --2- 172.21.15.62:0/3408064695 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55df4d6943b0 0x55df4d696840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:56.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.667+0000 7f40c79e0640 1 --2- 172.21.15.62:0/3408064695 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3f98039a20 0x7f3f9803bee0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f40bc0ce040 tx=0x7f40bc0c1040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:56.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.667+0000 7f40c89e2640 1 --2- 172.21.15.62:0/3408064695 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55df4d6943b0 0x55df4d696840 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:56.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.667+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40c000a4d0 con 0x55df4d6943b0 2024-09-10T05:36:56.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.667+0000 7f40ca6db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:56.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.667+0000 7f40ca6db9c0 20 realm 2024-09-10T05:36:56.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.667+0000 7f40ca6db9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:56.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.667+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df4d693740 con 0x55df4d6943b0 2024-09-10T05:36:56.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.667+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40c000a4d0 con 0x55df4d6943b0 2024-09-10T05:36:56.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.667+0000 7f40ca6db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:56.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.667+0000 7f40ca6db9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:56.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.667+0000 7f40ca6db9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:56.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.667+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df4d697a50 con 0x55df4d6943b0 2024-09-10T05:36:56.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.667+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40c000a4d0 con 0x55df4d6943b0 2024-09-10T05:36:56.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.667+0000 7f40ca6db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:56.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.667+0000 7f40ca6db9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:56.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.667+0000 7f40ca6db9c0 1 --2- 172.21.15.62:0/3408064695 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55df4d698830 0x55df4d69ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:56.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.667+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df4d69b2f0 con 0x55df4d698830 2024-09-10T05:36:56.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.667+0000 7f40c81e1640 1 --2- 172.21.15.62:0/3408064695 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55df4d698830 0x55df4d69ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:56.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.667+0000 7f40c81e1640 1 --2- 172.21.15.62:0/3408064695 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55df4d698830 0x55df4d69ac20 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:56.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.667+0000 7f40c81e1640 1 -- 172.21.15.62:0/3408064695 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f40b8077070 con 0x55df4d698830 2024-09-10T05:36:56.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.667+0000 7f40ca6db9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:56.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.667+0000 7f40ca6db9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:56.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.667+0000 7f40ca6db9c0 1 --2- 172.21.15.62:0/3408064695 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55df4d69c050 0x55df4d69e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:56.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.667+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df4d69ebf0 con 0x55df4d69c050 2024-09-10T05:36:56.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.667+0000 7f40c79e0640 1 --2- 172.21.15.62:0/3408064695 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55df4d69c050 0x55df4d69e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:56.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.671+0000 7f40c79e0640 1 --2- 172.21.15.62:0/3408064695 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55df4d69c050 0x55df4d69e460 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:56.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.671+0000 7f40c79e0640 1 -- 172.21.15.62:0/3408064695 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f40bc0a9a70 con 0x55df4d69c050 2024-09-10T05:36:56.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.671+0000 7f40ca6db9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:56.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.671+0000 7f40ca6db9c0 20 searching for the correct realm 2024-09-10T05:36:56.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.671+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6a04c0 con 0x55df4d69c050 2024-09-10T05:36:56.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.671+0000 7f40c79e0640 1 -- 172.21.15.62:0/3408064695 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40bc0a9a70 con 0x55df4d69c050 2024-09-10T05:36:56.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.671+0000 7f40c79e0640 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6a04c0 con 0x55df4d698830 2024-09-10T05:36:56.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.671+0000 7f40c81e1640 1 -- 172.21.15.62:0/3408064695 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40b8077070 con 0x55df4d698830 2024-09-10T05:36:56.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.671+0000 7f40c81e1640 1 --2- 172.21.15.62:0/3408064695 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f40b805a030 0x7f40b802f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:56.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.671+0000 7f40c81e1640 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6a04c0 con 0x7f40b805a030 2024-09-10T05:36:56.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.671+0000 7f40c89e2640 1 --2- 172.21.15.62:0/3408064695 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f40b805a030 0x7f40b802f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:56.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.671+0000 7f40c89e2640 1 --2- 172.21.15.62:0/3408064695 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f40b805a030 0x7f40b802f900 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:56.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.671+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c000a4d0 con 0x7f40b805a030 2024-09-10T05:36:56.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.671+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6a04c0 con 0x55df4d6943b0 2024-09-10T05:36:56.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.671+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c000a4d0 con 0x55df4d6943b0 2024-09-10T05:36:56.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.671+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6a04c0 con 0x55df4d6943b0 2024-09-10T05:36:56.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.671+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c000a4d0 con 0x55df4d6943b0 2024-09-10T05:36:56.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.671+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6a04c0 con 0x55df4d69c050 2024-09-10T05:36:56.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.671+0000 7f40c79e0640 1 -- 172.21.15.62:0/3408064695 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40bc0a9a70 con 0x55df4d69c050 2024-09-10T05:36:56.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.671+0000 7f40c79e0640 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6a04c0 con 0x55df4d6943b0 2024-09-10T05:36:56.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.671+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c000a4d0 con 0x55df4d6943b0 2024-09-10T05:36:56.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.671+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6a04c0 con 0x55df4d698830 2024-09-10T05:36:56.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.675+0000 7f40c81e1640 1 -- 172.21.15.62:0/3408064695 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40b8077070 con 0x55df4d698830 2024-09-10T05:36:56.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.675+0000 7f40c81e1640 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6a04c0 con 0x55df4d698830 2024-09-10T05:36:56.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.675+0000 7f40c81e1640 1 -- 172.21.15.62:0/3408064695 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40b8077070 con 0x55df4d698830 2024-09-10T05:36:56.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.675+0000 7f40c81e1640 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6a04c0 con 0x55df4d6943b0 2024-09-10T05:36:56.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.675+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c000a4d0 con 0x55df4d6943b0 2024-09-10T05:36:56.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.675+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6a04c0 con 0x7f40b805a030 2024-09-10T05:36:56.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.675+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c000a4d0 con 0x7f40b805a030 2024-09-10T05:36:56.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.675+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6a04c0 con 0x55df4d6943b0 2024-09-10T05:36:56.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.675+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c000a4d0 con 0x55df4d6943b0 2024-09-10T05:36:56.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.675+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6a04c0 con 0x7f40b805a030 2024-09-10T05:36:56.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.675+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f40c000a4d0 con 0x7f40b805a030 2024-09-10T05:36:56.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.675+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6a04c0 con 0x55df4d698830 2024-09-10T05:36:56.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.675+0000 7f40c81e1640 1 -- 172.21.15.62:0/3408064695 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40b8077070 con 0x55df4d698830 2024-09-10T05:36:56.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.675+0000 7f40c81e1640 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6a04c0 con 0x55df4d69c050 2024-09-10T05:36:56.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.675+0000 7f40c79e0640 1 -- 172.21.15.62:0/3408064695 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40bc0a9a70 con 0x55df4d69c050 2024-09-10T05:36:56.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.675+0000 7f40c79e0640 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6a04c0 con 0x55df4d6943b0 2024-09-10T05:36:56.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.675+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c000a4d0 con 0x55df4d6943b0 2024-09-10T05:36:56.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.675+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6a04c0 con 0x55df4d698830 2024-09-10T05:36:56.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.679+0000 7f40c81e1640 1 -- 172.21.15.62:0/3408064695 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40b8077070 con 0x55df4d698830 2024-09-10T05:36:56.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.679+0000 7f40c81e1640 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6a04c0 con 0x55df4d69c050 2024-09-10T05:36:56.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.679+0000 7f40c79e0640 1 -- 172.21.15.62:0/3408064695 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 32 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f40bc0a9a70 con 0x55df4d69c050 2024-09-10T05:36:56.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.679+0000 7f40c79e0640 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6a04c0 con 0x55df4d6943b0 2024-09-10T05:36:56.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.679+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c000a4d0 con 0x55df4d6943b0 2024-09-10T05:36:56.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.679+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6a04c0 con 0x55df4d6943b0 2024-09-10T05:36:56.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.679+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f40c000a4d0 con 0x55df4d6943b0 2024-09-10T05:36:56.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.679+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6a04c0 con 0x55df4d6943b0 2024-09-10T05:36:56.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.679+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c000a4d0 con 0x55df4d6943b0 2024-09-10T05:36:56.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.679+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6a04c0 con 0x55df4d69c050 2024-09-10T05:36:56.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.679+0000 7f40c79e0640 1 -- 172.21.15.62:0/3408064695 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40bc0a9a70 con 0x55df4d69c050 2024-09-10T05:36:56.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.679+0000 7f40c79e0640 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6a04c0 con 0x7f40b805a030 2024-09-10T05:36:56.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.679+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c000a4d0 con 0x7f40b805a030 2024-09-10T05:36:56.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.679+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6a04c0 con 0x55df4d6943b0 2024-09-10T05:36:56.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.679+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c000a4d0 con 0x55df4d6943b0 2024-09-10T05:36:56.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.679+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6a04c0 con 0x7f40b805a030 2024-09-10T05:36:56.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.679+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c000a4d0 con 0x7f40b805a030 2024-09-10T05:36:56.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.679+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6a04c0 con 0x55df4d69c050 2024-09-10T05:36:56.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.679+0000 7f40c79e0640 1 -- 172.21.15.62:0/3408064695 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40bc0a9a70 con 0x55df4d69c050 2024-09-10T05:36:56.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.679+0000 7f40c79e0640 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6a04c0 con 0x7f40b805a030 2024-09-10T05:36:56.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.679+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c000a4d0 con 0x7f40b805a030 2024-09-10T05:36:56.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.679+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6a04c0 con 0x55df4d698830 2024-09-10T05:36:56.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.683+0000 7f40c81e1640 1 -- 172.21.15.62:0/3408064695 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40b8077070 con 0x55df4d698830 2024-09-10T05:36:56.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.683+0000 7f40c81e1640 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6a04c0 con 0x55df4d698830 2024-09-10T05:36:56.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.683+0000 7f40c81e1640 1 -- 172.21.15.62:0/3408064695 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40b8077070 con 0x55df4d698830 2024-09-10T05:36:56.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.683+0000 7f40c81e1640 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6a04c0 con 0x55df4d69c050 2024-09-10T05:36:56.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.683+0000 7f40c79e0640 1 -- 172.21.15.62:0/3408064695 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40bc0a9a70 con 0x55df4d69c050 2024-09-10T05:36:56.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.683+0000 7f40c79e0640 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6a04c0 con 0x55df4d698830 2024-09-10T05:36:56.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.683+0000 7f40c81e1640 1 -- 172.21.15.62:0/3408064695 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f40b8077070 con 0x55df4d698830 2024-09-10T05:36:56.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.683+0000 7f40c81e1640 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6a04c0 con 0x55df4d698830 2024-09-10T05:36:56.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.683+0000 7f40c81e1640 1 -- 172.21.15.62:0/3408064695 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40b8077070 con 0x55df4d698830 2024-09-10T05:36:56.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.683+0000 7f40ca6db9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:56.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.683+0000 7f40ca6db9c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:56.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.683+0000 7f40ca6db9c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:56.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.683+0000 7f40ca6db9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:56.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.683+0000 7f40ca6db9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:56.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.683+0000 7f40ca6db9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:56.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.683+0000 7f40ca6db9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:56.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.683+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df4d69f5b0 con 0x55df4d6943b0 2024-09-10T05:36:56.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.683+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40c000a4d0 con 0x55df4d6943b0 2024-09-10T05:36:56.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.683+0000 7f40ca6db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:56.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.683+0000 7f40ca6db9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:56.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.683+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df4d69fa30 con 0x55df4d698830 2024-09-10T05:36:56.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.687+0000 7f40c81e1640 1 -- 172.21.15.62:0/3408064695 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f40b8077070 con 0x55df4d698830 2024-09-10T05:36:56.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.687+0000 7f40ca6db9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:56.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.687+0000 7f40ca6db9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:56.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.687+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df4d69f150 con 0x55df4d69c050 2024-09-10T05:36:56.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.687+0000 7f40c79e0640 1 -- 172.21.15.62:0/3408064695 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f40bc0a9a70 con 0x55df4d69c050 2024-09-10T05:36:56.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.687+0000 7f40ca6db9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:56.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.687+0000 7f40ca6db9c0 20 zone default found 2024-09-10T05:36:56.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.687+0000 7f40ca6db9c0 4 Realm: () 2024-09-10T05:36:56.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.687+0000 7f40ca6db9c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:56.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.687+0000 7f40ca6db9c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:56.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.687+0000 7f40ca6db9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:56.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.687+0000 7f40ca6db9c0 20 zonegroup default 2024-09-10T05:36:56.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.687+0000 7f40ca6db9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:56.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.687+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6a0da0 con 0x7f40b805a030 2024-09-10T05:36:56.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.687+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f40c000a4d0 con 0x7f40b805a030 2024-09-10T05:36:56.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.687+0000 7f40ca6db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:56.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.687+0000 7f40ca6db9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:56.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.687+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6a2fe0 con 0x55df4d69c050 2024-09-10T05:36:56.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.687+0000 7f40c79e0640 1 -- 172.21.15.62:0/3408064695 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f40bc0a9a70 con 0x55df4d69c050 2024-09-10T05:36:56.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.687+0000 7f40ca6db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:56.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.687+0000 7f40ca6db9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:56.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.687+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6a3380 con 0x55df4d69c050 2024-09-10T05:36:56.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.687+0000 7f40c79e0640 1 -- 172.21.15.62:0/3408064695 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f40bc0a9a70 con 0x55df4d69c050 2024-09-10T05:36:56.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.687+0000 7f40ca6db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:56.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.687+0000 7f40ca6db9c0 20 started sync module instance, tier type = 2024-09-10T05:36:56.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.687+0000 7f40ca6db9c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:56.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.687+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6a2420 con 0x55df4d698830 2024-09-10T05:36:56.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.691+0000 7f40c81e1640 1 -- 172.21.15.62:0/3408064695 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40b8077070 con 0x55df4d698830 2024-09-10T05:36:56.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.691+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94417564870720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6a3bd0 con 0x55df4d698830 2024-09-10T05:36:56.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.691+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6a4420 con 0x55df4d6943b0 2024-09-10T05:36:56.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.691+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c000a4d0 con 0x55df4d6943b0 2024-09-10T05:36:56.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.691+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94417564875728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6a3ff0 con 0x55df4d6943b0 2024-09-10T05:36:56.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.691+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6a5330 con 0x55df4d698830 2024-09-10T05:36:56.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.691+0000 7f40c81e1640 1 -- 172.21.15.62:0/3408064695 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94417564870720] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40b8077070 con 0x55df4d698830 2024-09-10T05:36:56.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.691+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94417564875728] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c000a4d0 con 0x55df4d6943b0 2024-09-10T05:36:56.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.695+0000 7f40c81e1640 1 -- 172.21.15.62:0/3408064695 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40b8077070 con 0x55df4d698830 2024-09-10T05:36:56.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.695+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94417564878784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6a5330 con 0x55df4d698830 2024-09-10T05:36:56.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.695+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6a5bd0 con 0x7f40b805a030 2024-09-10T05:36:56.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.695+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c000a4d0 con 0x7f40b805a030 2024-09-10T05:36:56.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.695+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94417564882720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6a5330 con 0x7f40b805a030 2024-09-10T05:36:56.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.695+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6a6680 con 0x55df4d698830 2024-09-10T05:36:56.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.695+0000 7f40c81e1640 1 -- 172.21.15.62:0/3408064695 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94417564878784] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40b8077070 con 0x55df4d698830 2024-09-10T05:36:56.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.695+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94417564882720] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c000a4d0 con 0x7f40b805a030 2024-09-10T05:36:56.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.699+0000 7f40c81e1640 1 -- 172.21.15.62:0/3408064695 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40b8077070 con 0x55df4d698830 2024-09-10T05:36:56.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.699+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94417564883776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6a3720 con 0x55df4d698830 2024-09-10T05:36:56.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.699+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6a6b30 con 0x55df4d69c050 2024-09-10T05:36:56.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.699+0000 7f40c79e0640 1 -- 172.21.15.62:0/3408064695 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40bc0a9a70 con 0x55df4d69c050 2024-09-10T05:36:56.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.699+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94417564886656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6a6f50 con 0x55df4d69c050 2024-09-10T05:36:56.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.699+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6a7950 con 0x55df4d69c050 2024-09-10T05:36:56.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.699+0000 7f40c81e1640 1 -- 172.21.15.62:0/3408064695 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94417564883776] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40b8077070 con 0x55df4d698830 2024-09-10T05:36:56.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.699+0000 7f40c79e0640 1 -- 172.21.15.62:0/3408064695 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94417564886656] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40bc0a9a70 con 0x55df4d69c050 2024-09-10T05:36:56.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.699+0000 7f40c79e0640 1 -- 172.21.15.62:0/3408064695 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40bc0a9a70 con 0x55df4d69c050 2024-09-10T05:36:56.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.699+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94417564885392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6a6aa0 con 0x55df4d69c050 2024-09-10T05:36:56.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.699+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6a81f0 con 0x7f40b805a030 2024-09-10T05:36:56.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.703+0000 7f40c79e0640 1 -- 172.21.15.62:0/3408064695 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94417564885392] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40bc0a9a70 con 0x55df4d69c050 2024-09-10T05:36:56.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.703+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c000a4d0 con 0x7f40b805a030 2024-09-10T05:36:56.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.703+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94417564890208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6a6aa0 con 0x7f40b805a030 2024-09-10T05:36:56.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.703+0000 7f40ca6db9c0 20 add_watcher() i=0 2024-09-10T05:36:56.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.703+0000 7f40ca6db9c0 20 add_watcher() i=1 2024-09-10T05:36:56.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.703+0000 7f40ca6db9c0 20 add_watcher() i=2 2024-09-10T05:36:56.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.703+0000 7f40ca6db9c0 20 add_watcher() i=3 2024-09-10T05:36:56.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.703+0000 7f40ca6db9c0 20 add_watcher() i=4 2024-09-10T05:36:56.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.703+0000 7f40ca6db9c0 20 add_watcher() i=5 2024-09-10T05:36:56.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.703+0000 7f40ca6db9c0 20 add_watcher() i=6 2024-09-10T05:36:56.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.703+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94417564890208] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c000a4d0 con 0x7f40b805a030 2024-09-10T05:36:56.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.703+0000 7f40ca6db9c0 20 add_watcher() i=7 2024-09-10T05:36:56.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.703+0000 7f40ca6db9c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:56.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.703+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6ab2e0 con 0x55df4d6943b0 2024-09-10T05:36:56.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.703+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f40c000a4d0 con 0x55df4d6943b0 2024-09-10T05:36:56.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.703+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94417564892480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6a8830 con 0x55df4d6943b0 2024-09-10T05:36:56.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.707+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94417564892480] v32'179 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f40c000a4d0 con 0x55df4d6943b0 2024-09-10T05:36:56.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.707+0000 7f3f7e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:56.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.707+0000 7f40ca6db9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:56.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.707+0000 7f40ca6db9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:56.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.707+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6b3b30 con 0x55df4d698830 2024-09-10T05:36:56.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.707+0000 7f40c81e1640 1 -- 172.21.15.62:0/3408064695 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'53 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f40b8077070 con 0x55df4d698830 2024-09-10T05:36:56.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.707+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6b3c00 con 0x7f40b805a030 2024-09-10T05:36:56.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.711+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f40c000a4d0 con 0x7f40b805a030 2024-09-10T05:36:56.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.711+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6b4330 con 0x55df4d69c050 2024-09-10T05:36:56.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.711+0000 7f40c79e0640 1 -- 172.21.15.62:0/3408064695 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f40bc0a9a70 con 0x55df4d69c050 2024-09-10T05:36:56.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.711+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6b47e0 con 0x55df4d6943b0 2024-09-10T05:36:56.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.715+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'180 uv172 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f40c000a4d0 con 0x55df4d6943b0 2024-09-10T05:36:56.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.715+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6b1a30 con 0x55df4d698830 2024-09-10T05:36:56.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.715+0000 7f40c81e1640 1 -- 172.21.15.62:0/3408064695 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'65 uv61 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f40b8077070 con 0x55df4d698830 2024-09-10T05:36:56.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.719+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6b1a30 con 0x55df4d69c050 2024-09-10T05:36:56.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.719+0000 7f40c79e0640 1 -- 172.21.15.62:0/3408064695 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'51 uv48 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f40bc0a9a70 con 0x55df4d69c050 2024-09-10T05:36:56.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.719+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6b1a30 con 0x55df4d698830 2024-09-10T05:36:56.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.719+0000 7f40c81e1640 1 -- 172.21.15.62:0/3408064695 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'33 uv31 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f40b8077070 con 0x55df4d698830 2024-09-10T05:36:56.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.719+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6b1a30 con 0x55df4d6943b0 2024-09-10T05:36:56.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.723+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'45 uv42 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f40c000a4d0 con 0x55df4d6943b0 2024-09-10T05:36:56.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.723+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6b5700 con 0x55df4d698830 2024-09-10T05:36:56.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.723+0000 7f40c81e1640 1 -- 172.21.15.62:0/3408064695 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f40b8077070 con 0x55df4d698830 2024-09-10T05:36:56.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.723+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6b5700 con 0x55df4d698830 2024-09-10T05:36:56.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.727+0000 7f40c81e1640 1 -- 172.21.15.62:0/3408064695 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f40b8077070 con 0x55df4d698830 2024-09-10T05:36:56.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.727+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6b5700 con 0x55df4d698830 2024-09-10T05:36:56.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.731+0000 7f40c81e1640 1 -- 172.21.15.62:0/3408064695 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'66 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f40b8077070 con 0x55df4d698830 2024-09-10T05:36:56.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.731+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6b5700 con 0x55df4d69c050 2024-09-10T05:36:56.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.731+0000 7f40c79e0640 1 -- 172.21.15.62:0/3408064695 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'27 uv25 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f40bc0a9a70 con 0x55df4d69c050 2024-09-10T05:36:56.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.731+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6b5bb0 con 0x55df4d698830 2024-09-10T05:36:56.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.735+0000 7f40c81e1640 1 -- 172.21.15.62:0/3408064695 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f40b8077070 con 0x55df4d698830 2024-09-10T05:36:56.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.735+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6b5bb0 con 0x55df4d6943b0 2024-09-10T05:36:56.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.735+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'57 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f40c000a4d0 con 0x55df4d6943b0 2024-09-10T05:36:56.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.735+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6b5bb0 con 0x55df4d6943b0 2024-09-10T05:36:56.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.735+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'181 uv168 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f40c000a4d0 con 0x55df4d6943b0 2024-09-10T05:36:56.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.735+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6b5c90 con 0x55df4d698830 2024-09-10T05:36:56.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.739+0000 7f40c81e1640 1 -- 172.21.15.62:0/3408064695 <== osd.0 v2:172.21.15.2:6800/945139080 25 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'60 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f40b8077070 con 0x55df4d698830 2024-09-10T05:36:56.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.739+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6b5c90 con 0x55df4d698830 2024-09-10T05:36:56.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.743+0000 7f40c81e1640 1 -- 172.21.15.62:0/3408064695 <== osd.0 v2:172.21.15.2:6800/945139080 26 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'67 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f40b8077070 con 0x55df4d698830 2024-09-10T05:36:56.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.743+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6b5c90 con 0x55df4d69c050 2024-09-10T05:36:56.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.743+0000 7f40c79e0640 1 -- 172.21.15.62:0/3408064695 <== osd.3 v2:172.21.15.62:6816/2708991149 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'35 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f40bc0a9a70 con 0x55df4d69c050 2024-09-10T05:36:56.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.743+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6b5ce0 con 0x55df4d698830 2024-09-10T05:36:56.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.747+0000 7f40c81e1640 1 -- 172.21.15.62:0/3408064695 <== osd.0 v2:172.21.15.2:6800/945139080 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f40b8077070 con 0x55df4d698830 2024-09-10T05:36:56.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.747+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6b5ce0 con 0x55df4d6943b0 2024-09-10T05:36:56.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.747+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 <== osd.1 v2:172.21.15.62:6808/3442097179 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'182 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f40c000a4d0 con 0x55df4d6943b0 2024-09-10T05:36:56.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.747+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6b5ce0 con 0x55df4d698830 2024-09-10T05:36:56.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.751+0000 7f40c81e1640 1 -- 172.21.15.62:0/3408064695 <== osd.0 v2:172.21.15.2:6800/945139080 28 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'61 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f40b8077070 con 0x55df4d698830 2024-09-10T05:36:56.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.751+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6b5ce0 con 0x7f40b805a030 2024-09-10T05:36:56.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.751+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'39 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f40c000a4d0 con 0x7f40b805a030 2024-09-10T05:36:56.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.751+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6b5ce0 con 0x55df4d69c050 2024-09-10T05:36:56.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.755+0000 7f40c79e0640 1 -- 172.21.15.62:0/3408064695 <== osd.3 v2:172.21.15.62:6816/2708991149 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f40bc0a9a70 con 0x55df4d69c050 2024-09-10T05:36:56.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.755+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6b5ce0 con 0x55df4d698830 2024-09-10T05:36:56.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.759+0000 7f40c81e1640 1 -- 172.21.15.62:0/3408064695 <== osd.0 v2:172.21.15.2:6800/945139080 29 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'42 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f40b8077070 con 0x55df4d698830 2024-09-10T05:36:56.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.759+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6b5ce0 con 0x55df4d69c050 2024-09-10T05:36:56.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.759+0000 7f40c79e0640 1 -- 172.21.15.62:0/3408064695 <== osd.3 v2:172.21.15.62:6816/2708991149 21 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f40bc0a9a70 con 0x55df4d69c050 2024-09-10T05:36:56.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.759+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6b5ce0 con 0x55df4d69c050 2024-09-10T05:36:56.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.763+0000 7f40c79e0640 1 -- 172.21.15.62:0/3408064695 <== osd.3 v2:172.21.15.62:6816/2708991149 22 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'52 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f40bc0a9a70 con 0x55df4d69c050 2024-09-10T05:36:56.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.763+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6b5ce0 con 0x55df4d69c050 2024-09-10T05:36:56.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.763+0000 7f40c79e0640 1 -- 172.21.15.62:0/3408064695 <== osd.3 v2:172.21.15.62:6816/2708991149 23 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f40bc0a9a70 con 0x55df4d69c050 2024-09-10T05:36:56.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.763+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6b5ce0 con 0x55df4d698830 2024-09-10T05:36:56.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.767+0000 7f40c81e1640 1 -- 172.21.15.62:0/3408064695 <== osd.0 v2:172.21.15.2:6800/945139080 30 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'37 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f40b8077070 con 0x55df4d698830 2024-09-10T05:36:56.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.767+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6b5ce0 con 0x55df4d6943b0 2024-09-10T05:36:56.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.767+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 <== osd.1 v2:172.21.15.62:6808/3442097179 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'46 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f40c000a4d0 con 0x55df4d6943b0 2024-09-10T05:36:56.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.767+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6b5ce0 con 0x55df4d698830 2024-09-10T05:36:56.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.771+0000 7f40c81e1640 1 -- 172.21.15.62:0/3408064695 <== osd.0 v2:172.21.15.2:6800/945139080 31 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'62 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f40b8077070 con 0x55df4d698830 2024-09-10T05:36:56.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.771+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6b5ce0 con 0x55df4d6943b0 2024-09-10T05:36:56.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.771+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 <== osd.1 v2:172.21.15.62:6808/3442097179 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'58 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f40c000a4d0 con 0x55df4d6943b0 2024-09-10T05:36:56.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.771+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6b5ce0 con 0x7f40b805a030 2024-09-10T05:36:56.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.775+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f40c000a4d0 con 0x7f40b805a030 2024-09-10T05:36:56.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.775+0000 7f3f7d7e2640 20 reqs_thread_entry: start 2024-09-10T05:36:56.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.775+0000 7f40ca6db9c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:56.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.775+0000 7f40ca6db9c0 20 Filter name: none 2024-09-10T05:36:56.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.775+0000 7f3eeeffd640 20 reqs_thread_entry: start 2024-09-10T05:36:56.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.775+0000 7f40ca6db9c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T05:36:56.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.775+0000 7f40ca6db9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:56.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.775+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6b0e40 con 0x55df4d6943b0 2024-09-10T05:36:56.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.775+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 <== osd.1 v2:172.21.15.62:6808/3442097179 26 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f40c000a4d0 con 0x55df4d6943b0 2024-09-10T05:36:56.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.775+0000 7f40ca6db9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:36:56.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.775+0000 7f40ca6db9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T05:36:56.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.775+0000 7f40ca6db9c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:36:56.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.775+0000 7f40ca6db9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:36:56.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.775+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6d3d80 con 0x7f40b805a030 2024-09-10T05:36:56.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.775+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 <== osd.2 v2:172.21.15.62:6800/2677868286 15 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f40c000a4d0 con 0x7f40b805a030 2024-09-10T05:36:56.779 INFO:teuthology.orchestra.run.smithi062.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-10T05:36:56.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.775+0000 7f3f7e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:56.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.775+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94417564892480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d68e920 con 0x55df4d6943b0 2024-09-10T05:36:56.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.779+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 <== osd.1 v2:172.21.15.62:6808/3442097179 27 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94417564892480] v32'183 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f40c000a4d0 con 0x55df4d6943b0 2024-09-10T05:36:56.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.779+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94417564870720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6a7d40 con 0x55df4d698830 2024-09-10T05:36:56.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.783+0000 7f40c81e1640 1 -- 172.21.15.62:0/3408064695 <== osd.0 v2:172.21.15.2:6800/945139080 32 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94417564870720] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40b8077070 con 0x55df4d698830 2024-09-10T05:36:56.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.783+0000 7f40ca6db9c0 20 remove_watcher() i=0 2024-09-10T05:36:56.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.783+0000 7f40ca6db9c0 2 removed watcher, disabling cache 2024-09-10T05:36:56.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.783+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94417564875728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6b0e70 con 0x55df4d6943b0 2024-09-10T05:36:56.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.783+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 <== osd.1 v2:172.21.15.62:6808/3442097179 28 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94417564875728] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c000a4d0 con 0x55df4d6943b0 2024-09-10T05:36:56.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.783+0000 7f40ca6db9c0 20 remove_watcher() i=1 2024-09-10T05:36:56.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.783+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94417564878784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6b0e70 con 0x55df4d698830 2024-09-10T05:36:56.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.783+0000 7f40c81e1640 1 -- 172.21.15.62:0/3408064695 <== osd.0 v2:172.21.15.2:6800/945139080 33 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94417564878784] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40b8077070 con 0x55df4d698830 2024-09-10T05:36:56.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.783+0000 7f40ca6db9c0 20 remove_watcher() i=2 2024-09-10T05:36:56.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.783+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94417564882720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6b0e70 con 0x7f40b805a030 2024-09-10T05:36:56.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.787+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 <== osd.2 v2:172.21.15.62:6800/2677868286 16 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94417564882720] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c000a4d0 con 0x7f40b805a030 2024-09-10T05:36:56.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.787+0000 7f40ca6db9c0 20 remove_watcher() i=3 2024-09-10T05:36:56.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.787+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94417564883776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6b0e70 con 0x55df4d698830 2024-09-10T05:36:56.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.787+0000 7f40c81e1640 1 -- 172.21.15.62:0/3408064695 <== osd.0 v2:172.21.15.2:6800/945139080 34 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94417564883776] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40b8077070 con 0x55df4d698830 2024-09-10T05:36:56.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.787+0000 7f40ca6db9c0 20 remove_watcher() i=4 2024-09-10T05:36:56.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.787+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94417564886656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6b0e70 con 0x55df4d69c050 2024-09-10T05:36:56.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.791+0000 7f40c79e0640 1 -- 172.21.15.62:0/3408064695 <== osd.3 v2:172.21.15.62:6816/2708991149 24 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94417564886656] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40bc0a9a70 con 0x55df4d69c050 2024-09-10T05:36:56.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.791+0000 7f40ca6db9c0 20 remove_watcher() i=5 2024-09-10T05:36:56.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.791+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94417564885392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6b0e70 con 0x55df4d69c050 2024-09-10T05:36:56.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.791+0000 7f40c79e0640 1 -- 172.21.15.62:0/3408064695 <== osd.3 v2:172.21.15.62:6816/2708991149 25 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94417564885392] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40bc0a9a70 con 0x55df4d69c050 2024-09-10T05:36:56.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.791+0000 7f40ca6db9c0 20 remove_watcher() i=6 2024-09-10T05:36:56.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.791+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94417564890208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df4d6b0e70 con 0x7f40b805a030 2024-09-10T05:36:56.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.795+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 <== osd.2 v2:172.21.15.62:6800/2677868286 17 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94417564890208] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c000a4d0 con 0x7f40b805a030 2024-09-10T05:36:56.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.795+0000 7f40ca6db9c0 20 remove_watcher() i=7 2024-09-10T05:36:56.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.795+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55df4d698830 msgr2=0x55df4d69ac20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:56.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.795+0000 7f40ca6db9c0 1 --2- 172.21.15.62:0/3408064695 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55df4d698830 0x55df4d69ac20 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:56.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.795+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55df4d6943b0 msgr2=0x55df4d696840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:56.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.795+0000 7f40ca6db9c0 1 --2- 172.21.15.62:0/3408064695 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55df4d6943b0 0x55df4d696840 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:56.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.795+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f40b805a030 msgr2=0x7f40b802f900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:56.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.795+0000 7f40ca6db9c0 1 --2- 172.21.15.62:0/3408064695 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f40b805a030 0x7f40b802f900 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:56.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.795+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55df4d69c050 msgr2=0x55df4d69e460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:56.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.795+0000 7f40ca6db9c0 1 --2- 172.21.15.62:0/3408064695 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55df4d69c050 0x55df4d69e460 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:56.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.795+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3f98039a20 msgr2=0x7f3f9803bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:56.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.795+0000 7f40ca6db9c0 1 --2- 172.21.15.62:0/3408064695 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3f98039a20 0x7f3f9803bee0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f40bc0ce040 tx=0x7f40bc0c1040 comp rx=0 tx=0).stop 2024-09-10T05:36:56.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.795+0000 7f40c89e2640 1 -- 172.21.15.62:0/3408064695 reap_dead start 2024-09-10T05:36:56.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.795+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55df4d683140 msgr2=0x55df4d689440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:56.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.795+0000 7f40ca6db9c0 1 --2- 172.21.15.62:0/3408064695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55df4d683140 0x55df4d689440 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f40b8050210 tx=0x7f40b800cf70 comp rx=0 tx=0).stop 2024-09-10T05:36:56.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.795+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 shutdown_connections 2024-09-10T05:36:56.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.795+0000 7f40ca6db9c0 1 --2- 172.21.15.62:0/3408064695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55df4d683140 0x55df4d689440 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:56.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.795+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 >> 172.21.15.62:0/3408064695 conn(0x55df4d67e560 msgr2=0x55df4d67c770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:56.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.795+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 shutdown_connections 2024-09-10T05:36:56.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.795+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/3408064695 wait complete. 2024-09-10T05:36:56.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.795+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/2797987266 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3fa0039a70 msgr2=0x7f3fa003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:56.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.795+0000 7f40ca6db9c0 1 --2- 172.21.15.62:0/2797987266 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3fa0039a70 0x7f3fa003bf30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f40bc0ab040 tx=0x7f40bc005ad0 comp rx=0 tx=0).stop 2024-09-10T05:36:56.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.795+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/2797987266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55df4d4d9c90 msgr2=0x55df4d4d8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:56.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.795+0000 7f40ca6db9c0 1 --2- 172.21.15.62:0/2797987266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55df4d4d9c90 0x55df4d4d8530 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f40b8018ce0 tx=0x7f40b800e740 comp rx=0 tx=0).stop 2024-09-10T05:36:56.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.795+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/2797987266 shutdown_connections 2024-09-10T05:36:56.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.795+0000 7f40ca6db9c0 1 --2- 172.21.15.62:0/2797987266 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3fa0039a70 0x7f3fa003bf30 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:56.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.795+0000 7f40ca6db9c0 1 --2- 172.21.15.62:0/2797987266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55df4d4d9c90 0x55df4d4d8530 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:56.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.795+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/2797987266 >> 172.21.15.62:0/2797987266 conn(0x55df4d669320 msgr2=0x55df4d669700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:56.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.795+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/2797987266 shutdown_connections 2024-09-10T05:36:56.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.795+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/2797987266 wait complete. 2024-09-10T05:36:56.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.795+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/2390218895 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55df4d65de90 msgr2=0x55df4d660350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:56.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.795+0000 7f40ca6db9c0 1 --2- 172.21.15.62:0/2390218895 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55df4d65de90 0x55df4d660350 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:56.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.795+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/2390218895 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55df4d567150 msgr2=0x55df4d65ce80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:56.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.795+0000 7f40ca6db9c0 1 --2- 172.21.15.62:0/2390218895 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55df4d567150 0x55df4d65ce80 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:56.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.795+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/2390218895 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55df4d662880 msgr2=0x55df4d664c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:56.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.795+0000 7f40ca6db9c0 1 --2- 172.21.15.62:0/2390218895 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55df4d662880 0x55df4d664c70 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:56.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.795+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/2390218895 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3fb0039a70 msgr2=0x7f3fb003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:56.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.795+0000 7f40ca6db9c0 1 --2- 172.21.15.62:0/2390218895 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3fb0039a70 0x7f3fb003bf30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f40bc0ad000 tx=0x7f40bc0a6000 comp rx=0 tx=0).stop 2024-09-10T05:36:56.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.795+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/2390218895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55df4d562fb0 msgr2=0x55df4d655d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:56.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.795+0000 7f40ca6db9c0 1 --2- 172.21.15.62:0/2390218895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55df4d562fb0 0x55df4d655d10 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x55df4d64f6d0 tx=0x7f40b8000bd0 comp rx=0 tx=0).stop 2024-09-10T05:36:56.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.795+0000 7f40c89e2640 1 -- 172.21.15.62:0/2390218895 reap_dead start 2024-09-10T05:36:56.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.795+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/2390218895 shutdown_connections 2024-09-10T05:36:56.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.795+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/2390218895 >> 172.21.15.62:0/2390218895 conn(0x55df4d55ead0 msgr2=0x55df4d648e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:56.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.795+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/2390218895 shutdown_connections 2024-09-10T05:36:56.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.795+0000 7f40ca6db9c0 1 -- 172.21.15.62:0/2390218895 wait complete. 2024-09-10T05:36:56.810 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-10T05:36:56.824 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=236 failed=True 2024-09-10T05:36:56.831 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T05:36:56.883 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T05:36:56.900 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T05:36:56.949 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-10T05:36:56.959 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T05:36:56.960 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-10T05:36:56.960 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-10T05:36:56.960 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-10T05:36:57.001 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:57.001 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:57.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.999+0000 7f34dc6c29c0 1 Processor -- start 2024-09-10T05:36:57.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.999+0000 7f34dc6c29c0 1 -- start start 2024-09-10T05:36:57.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.999+0000 7f34dc6c29c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x558dbd8f2610 0x558dbd986710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.999+0000 7f34dc6c29c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558dbd8329c0 con 0x558dbd8f2230 2024-09-10T05:36:57.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.999+0000 7f34dc6c29c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x558dbd8826d0 con 0x558dbd8f2610 2024-09-10T05:36:57.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.999+0000 7f34d99c7640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x558dbd8f2610 0x558dbd986710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.999+0000 7f34d99c7640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x558dbd8f2610 0x558dbd986710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47966/0 (socket says 172.21.15.62:47966) 2024-09-10T05:36:57.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.999+0000 7f34d99c7640 1 -- 172.21.15.62:0/15353742 learned_addr learned my addr 172.21.15.62:0/15353742 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:57.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.999+0000 7f34da1c8640 1 --1- 172.21.15.62:0/15353742 >> v1:172.21.15.2:6789/0 conn(0x558dbd8f2230 0x558dbd982fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:58370/0 (socket says 172.21.15.62:58370) 2024-09-10T05:36:57.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.999+0000 7f34d99c7640 1 -- 172.21.15.62:0/15353742 >> v1:172.21.15.2:6789/0 conn(0x558dbd8f2230 legacy=0x558dbd982fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:56.999+0000 7f34d99c7640 1 -- 172.21.15.62:0/15353742 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558dbd826ca0 con 0x558dbd8f2610 2024-09-10T05:36:57.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.003+0000 7f34d99c7640 1 --2- 172.21.15.62:0/15353742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dbd8f2610 0x558dbd986710 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f34d000a5c0 tx=0x7f34d001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c38ec78297610e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.003+0000 7f34d91c6640 1 -- 172.21.15.62:0/15353742 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34d00a6070 con 0x558dbd8f2610 2024-09-10T05:36:57.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.003+0000 7f34d91c6640 1 -- 172.21.15.62:0/15353742 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34d00af070 con 0x558dbd8f2610 2024-09-10T05:36:57.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.003+0000 7f34d91c6640 1 -- 172.21.15.62:0/15353742 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34d00aa5c0 con 0x558dbd8f2610 2024-09-10T05:36:57.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.003+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/15353742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dbd8f2610 msgr2=0x558dbd986710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.003+0000 7f34dc6c29c0 1 --2- 172.21.15.62:0/15353742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dbd8f2610 0x558dbd986710 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f34d000a5c0 tx=0x7f34d001b340 comp rx=0 tx=0).stop 2024-09-10T05:36:57.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.003+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/15353742 shutdown_connections 2024-09-10T05:36:57.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.003+0000 7f34dc6c29c0 1 --2- 172.21.15.62:0/15353742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dbd8f2610 0x558dbd986710 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.003+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/15353742 >> 172.21.15.62:0/15353742 conn(0x558dbd978910 msgr2=0x558dbd97ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:57.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.003+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/15353742 shutdown_connections 2024-09-10T05:36:57.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.003+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/15353742 wait complete. 2024-09-10T05:36:57.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.019+0000 7f34dc6c29c0 1 Processor -- start 2024-09-10T05:36:57.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.019+0000 7f34dc6c29c0 1 -- start start 2024-09-10T05:36:57.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.019+0000 7f34dc6c29c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dbd8f2230 0x558dbda6b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.019+0000 7f34dc6c29c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558dbd886680 con 0x558dbd8f2230 2024-09-10T05:36:57.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.023+0000 7f34da1c8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dbd8f2230 0x558dbda6b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.023+0000 7f34da1c8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dbd8f2230 0x558dbda6b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47982/0 (socket says 172.21.15.62:47982) 2024-09-10T05:36:57.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.023+0000 7f34da1c8640 1 -- 172.21.15.62:0/3467662531 learned_addr learned my addr 172.21.15.62:0/3467662531 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:57.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.023+0000 7f34da1c8640 1 -- 172.21.15.62:0/3467662531 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558dbd801da0 con 0x558dbd8f2230 2024-09-10T05:36:57.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.023+0000 7f34da1c8640 1 --2- 172.21.15.62:0/3467662531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dbd8f2230 0x558dbda6b930 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f34d40016f0 tx=0x7f34d4001bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee7de1ea5b02140e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.023+0000 7f33c8608640 1 -- 172.21.15.62:0/3467662531 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34d4003460 con 0x558dbd8f2230 2024-09-10T05:36:57.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.023+0000 7f33c8608640 1 -- 172.21.15.62:0/3467662531 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34d4003620 con 0x558dbd8f2230 2024-09-10T05:36:57.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.023+0000 7f33c8608640 1 -- 172.21.15.62:0/3467662531 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34d4003940 con 0x558dbd8f2230 2024-09-10T05:36:57.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.023+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3467662531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dbd8f2230 msgr2=0x558dbda6b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.023+0000 7f34dc6c29c0 1 --2- 172.21.15.62:0/3467662531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dbd8f2230 0x558dbda6b930 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f34d40016f0 tx=0x7f34d4001bb0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.023+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3467662531 shutdown_connections 2024-09-10T05:36:57.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.023+0000 7f34dc6c29c0 1 --2- 172.21.15.62:0/3467662531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dbd8f2230 0x558dbda6b930 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.023+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3467662531 >> 172.21.15.62:0/3467662531 conn(0x558dbd978910 msgr2=0x558dbda67570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:57.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.023+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3467662531 shutdown_connections 2024-09-10T05:36:57.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.023+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3467662531 wait complete. 2024-09-10T05:36:57.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.023+0000 7f34dc6c29c0 1 Processor -- start 2024-09-10T05:36:57.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.023+0000 7f34dc6c29c0 1 -- start start 2024-09-10T05:36:57.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.023+0000 7f34dc6c29c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dbd8f2230 0x558dbda72ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.023+0000 7f34dc6c29c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558dbd828a50 con 0x558dbd8f2230 2024-09-10T05:36:57.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.023+0000 7f34da1c8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dbd8f2230 0x558dbda72ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.023+0000 7f34da1c8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dbd8f2230 0x558dbda72ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:47992/0 (socket says 172.21.15.62:47992) 2024-09-10T05:36:57.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.023+0000 7f34da1c8640 1 -- 172.21.15.62:0/1429836634 learned_addr learned my addr 172.21.15.62:0/1429836634 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:57.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.027+0000 7f34da1c8640 1 -- 172.21.15.62:0/1429836634 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558dbda73550 con 0x558dbd8f2230 2024-09-10T05:36:57.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.027+0000 7f34da1c8640 1 --2- 172.21.15.62:0/1429836634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dbd8f2230 0x558dbda72ff0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f34d4001bf0 tx=0x7f34d4001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.027+0000 7f33c6e05640 1 -- 172.21.15.62:0/1429836634 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34d4022020 con 0x558dbd8f2230 2024-09-10T05:36:57.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.027+0000 7f33c6e05640 1 -- 172.21.15.62:0/1429836634 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34d4006820 con 0x558dbd8f2230 2024-09-10T05:36:57.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.027+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/1429836634 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558dbda737e0 con 0x558dbd8f2230 2024-09-10T05:36:57.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.027+0000 7f33c6e05640 1 -- 172.21.15.62:0/1429836634 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34d401e690 con 0x558dbd8f2230 2024-09-10T05:36:57.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.027+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/1429836634 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558dbda74210 con 0x558dbd8f2230 2024-09-10T05:36:57.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.027+0000 7f33c6e05640 1 -- 172.21.15.62:0/1429836634 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f34d4025020 con 0x558dbd8f2230 2024-09-10T05:36:57.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.027+0000 7f33c6e05640 1 --2- 172.21.15.62:0/1429836634 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f33c0039ac0 0x7f33c003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.027+0000 7f33c6e05640 1 -- 172.21.15.62:0/1429836634 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7f34d404fff0 con 0x558dbd8f2230 2024-09-10T05:36:57.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.027+0000 7f34d99c7640 1 --2- 172.21.15.62:0/1429836634 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f33c0039ac0 0x7f33c003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.027+0000 7f34dc6c29c0 1 --2- 172.21.15.62:0/1429836634 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x558dbd8f2610 0x558dbda7a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.027+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/1429836634 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558dbda7a6a0 con 0x558dbd8f2610 2024-09-10T05:36:57.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.027+0000 7f34da9c9640 1 --2- 172.21.15.62:0/1429836634 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x558dbd8f2610 0x558dbda7a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.027+0000 7f34d99c7640 1 --2- 172.21.15.62:0/1429836634 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f33c0039ac0 0x7f33c003bf80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f34d00ae000 tx=0x7f34d00a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.027+0000 7f34da9c9640 1 --2- 172.21.15.62:0/1429836634 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x558dbd8f2610 0x558dbda7a160 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.027+0000 7f34da9c9640 1 -- 172.21.15.62:0/1429836634 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f34cc0083f0 con 0x558dbd8f2610 2024-09-10T05:36:57.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.027+0000 7f34dc6c29c0 1 --2- 172.21.15.62:0/1429836634 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x558dbda7b400 0x558dbda7d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.027+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/1429836634 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558dbda7dde0 con 0x558dbda7b400 2024-09-10T05:36:57.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.031+0000 7f34da1c8640 1 --2- 172.21.15.62:0/1429836634 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x558dbda7b400 0x558dbda7d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.031+0000 7f34da1c8640 1 --2- 172.21.15.62:0/1429836634 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x558dbda7b400 0x558dbda7d7f0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.031+0000 7f34da1c8640 1 -- 172.21.15.62:0/1429836634 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f34d401b040 con 0x558dbda7b400 2024-09-10T05:36:57.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.031+0000 7f34dc6c29c0 1 --2- 172.21.15.62:0/1429836634 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x558dbda7fba0 0x558dbda81f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.031+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/1429836634 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558dbda82680 con 0x558dbda7fba0 2024-09-10T05:36:57.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.031+0000 7f34d99c7640 1 --2- 172.21.15.62:0/1429836634 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x558dbda7fba0 0x558dbda81f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.031+0000 7f34d99c7640 1 --2- 172.21.15.62:0/1429836634 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x558dbda7fba0 0x558dbda81f90 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.031+0000 7f34d99c7640 1 -- 172.21.15.62:0/1429836634 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f34d00aaaf0 con 0x558dbda7fba0 2024-09-10T05:36:57.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.031+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/1429836634 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558dbda7ea40 con 0x558dbda7b400 2024-09-10T05:36:57.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.031+0000 7f34da1c8640 1 -- 172.21.15.62:0/1429836634 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f34d401b040 con 0x558dbda7b400 2024-09-10T05:36:57.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.031+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/1429836634 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558dbda7eea0 con 0x558dbda7fba0 2024-09-10T05:36:57.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.031+0000 7f34d99c7640 1 -- 172.21.15.62:0/1429836634 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f34d00aaaf0 con 0x558dbda7fba0 2024-09-10T05:36:57.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.035+0000 7f34dc6c29c0 1 Processor -- start 2024-09-10T05:36:57.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.035+0000 7f34dc6c29c0 1 -- start start 2024-09-10T05:36:57.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.035+0000 7f34dc6c29c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dbda90ca0 0x558dbda910c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.035+0000 7f34dc6c29c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558dbd893450 con 0x558dbda90ca0 2024-09-10T05:36:57.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.035+0000 7f34da1c8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dbda90ca0 0x558dbda910c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.035+0000 7f34da1c8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dbda90ca0 0x558dbda910c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:48002/0 (socket says 172.21.15.62:48002) 2024-09-10T05:36:57.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.035+0000 7f34da1c8640 1 -- 172.21.15.62:0/2069698752 learned_addr learned my addr 172.21.15.62:0/2069698752 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:57.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.035+0000 7f34da1c8640 1 -- 172.21.15.62:0/2069698752 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558dbda91700 con 0x558dbda90ca0 2024-09-10T05:36:57.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.035+0000 7f34da1c8640 1 --2- 172.21.15.62:0/2069698752 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dbda90ca0 0x558dbda910c0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f34d401c700 tx=0x7f34d40129b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.035+0000 7f33bffff640 1 -- 172.21.15.62:0/2069698752 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34d4034070 con 0x558dbda90ca0 2024-09-10T05:36:57.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.035+0000 7f33bffff640 1 -- 172.21.15.62:0/2069698752 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34d401ea40 con 0x558dbda90ca0 2024-09-10T05:36:57.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.035+0000 7f33bffff640 1 -- 172.21.15.62:0/2069698752 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34d401ed20 con 0x558dbda90ca0 2024-09-10T05:36:57.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.035+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/2069698752 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558dbda91f60 con 0x558dbda90ca0 2024-09-10T05:36:57.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.035+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/2069698752 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558dbda924d0 con 0x558dbda90ca0 2024-09-10T05:36:57.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.035+0000 7f33bffff640 1 -- 172.21.15.62:0/2069698752 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f34d4037070 con 0x558dbda90ca0 2024-09-10T05:36:57.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.035+0000 7f33bffff640 1 --2- 172.21.15.62:0/2069698752 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f33b4039ac0 0x7f33b403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.039+0000 7f33bffff640 1 -- 172.21.15.62:0/2069698752 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7f34d403ac20 con 0x558dbda90ca0 2024-09-10T05:36:57.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.039+0000 7f34d99c7640 1 --2- 172.21.15.62:0/2069698752 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f33b4039ac0 0x7f33b403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.039+0000 7f34dc6c29c0 1 Processor -- start 2024-09-10T05:36:57.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.039+0000 7f34dc6c29c0 1 -- start start 2024-09-10T05:36:57.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.039+0000 7f34dc6c29c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dbda9d450 0x558dbda9d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.039+0000 7f34d99c7640 1 --2- 172.21.15.62:0/2069698752 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f33b4039ac0 0x7f33b403bf80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x558dbda74410 tx=0x7f34d0005ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.039+0000 7f34dc6c29c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558dbda6c120 con 0x558dbda9d450 2024-09-10T05:36:57.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.039+0000 7f34da1c8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dbda9d450 0x558dbda9d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.039+0000 7f34da1c8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dbda9d450 0x558dbda9d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:48012/0 (socket says 172.21.15.62:48012) 2024-09-10T05:36:57.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.039+0000 7f34da1c8640 1 -- 172.21.15.62:0/1660313382 learned_addr learned my addr 172.21.15.62:0/1660313382 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:57.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.039+0000 7f34da1c8640 1 -- 172.21.15.62:0/1660313382 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558dbda9de00 con 0x558dbda9d450 2024-09-10T05:36:57.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.039+0000 7f34da1c8640 1 --2- 172.21.15.62:0/1660313382 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dbda9d450 0x558dbda9d830 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f34d4000f90 tx=0x7f34d40279b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ce0a7890ead9296 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.039+0000 7f33bdffb640 1 -- 172.21.15.62:0/1660313382 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34d4027af0 con 0x558dbda9d450 2024-09-10T05:36:57.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.039+0000 7f33bdffb640 1 -- 172.21.15.62:0/1660313382 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34d4047800 con 0x558dbda9d450 2024-09-10T05:36:57.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.039+0000 7f33bdffb640 1 -- 172.21.15.62:0/1660313382 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34d400b140 con 0x558dbda9d450 2024-09-10T05:36:57.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.039+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/1660313382 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dbda9d450 msgr2=0x558dbda9d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.039+0000 7f34dc6c29c0 1 --2- 172.21.15.62:0/1660313382 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dbda9d450 0x558dbda9d830 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f34d4000f90 tx=0x7f34d40279b0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.039+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/1660313382 shutdown_connections 2024-09-10T05:36:57.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.039+0000 7f34dc6c29c0 1 --2- 172.21.15.62:0/1660313382 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dbda9d450 0x558dbda9d830 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.039+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/1660313382 >> 172.21.15.62:0/1660313382 conn(0x558dbda99880 msgr2=0x558dbda97ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:57.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.039+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/1660313382 shutdown_connections 2024-09-10T05:36:57.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.039+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/1660313382 wait complete. 2024-09-10T05:36:57.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.039+0000 7f34dc6c29c0 1 Processor -- start 2024-09-10T05:36:57.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.039+0000 7f34dc6c29c0 1 -- start start 2024-09-10T05:36:57.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.039+0000 7f34dc6c29c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dbda9d450 0x558dbdaa4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.039+0000 7f34dc6c29c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558dbda9e2e0 con 0x558dbda9d450 2024-09-10T05:36:57.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.039+0000 7f34da1c8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dbda9d450 0x558dbdaa4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.039+0000 7f34da1c8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dbda9d450 0x558dbdaa4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:48022/0 (socket says 172.21.15.62:48022) 2024-09-10T05:36:57.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.039+0000 7f34da1c8640 1 -- 172.21.15.62:0/3471955893 learned_addr learned my addr 172.21.15.62:0/3471955893 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:57.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.043+0000 7f34da1c8640 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558dbdaa4ca0 con 0x558dbda9d450 2024-09-10T05:36:57.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.043+0000 7f34da1c8640 1 --2- 172.21.15.62:0/3471955893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dbda9d450 0x558dbdaa4740 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f34d4000f90 tx=0x7f34d4041f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.043+0000 7f33abfff640 1 -- 172.21.15.62:0/3471955893 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34d4027400 con 0x558dbda9d450 2024-09-10T05:36:57.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.043+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558dbdaa4ca0 con 0x558dbda9d450 2024-09-10T05:36:57.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.043+0000 7f33abfff640 1 -- 172.21.15.62:0/3471955893 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34d4047800 con 0x558dbda9d450 2024-09-10T05:36:57.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.043+0000 7f33abfff640 1 -- 172.21.15.62:0/3471955893 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34d4030400 con 0x558dbda9d450 2024-09-10T05:36:57.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.043+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558dbdaa4ca0 con 0x558dbda9d450 2024-09-10T05:36:57.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.043+0000 7f33abfff640 1 -- 172.21.15.62:0/3471955893 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f34d4030660 con 0x558dbda9d450 2024-09-10T05:36:57.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.043+0000 7f33abfff640 1 --2- 172.21.15.62:0/3471955893 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f33a4039a20 0x7f33a403bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.043+0000 7f33abfff640 1 -- 172.21.15.62:0/3471955893 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7f34d4066070 con 0x558dbda9d450 2024-09-10T05:36:57.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.043+0000 7f34d99c7640 1 --2- 172.21.15.62:0/3471955893 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f33a4039a20 0x7f33a403bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.043+0000 7f34dc6c29c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:57.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.043+0000 7f34dc6c29c0 1 --2- 172.21.15.62:0/3471955893 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x558dbdaaf610 0x558dbdab1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.043+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558dbdab2220 con 0x558dbdaaf610 2024-09-10T05:36:57.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.043+0000 7f34da9c9640 1 --2- 172.21.15.62:0/3471955893 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x558dbdaaf610 0x558dbdab1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.043+0000 7f34d99c7640 1 --2- 172.21.15.62:0/3471955893 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f33a4039a20 0x7f33a403bee0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f34d0018f70 tx=0x7f34d00c1040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.043+0000 7f34da9c9640 1 --2- 172.21.15.62:0/3471955893 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x558dbdaaf610 0x558dbdab1ad0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.043+0000 7f34da9c9640 1 -- 172.21.15.62:0/3471955893 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f34cc0083f0 con 0x558dbdaaf610 2024-09-10T05:36:57.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.043+0000 7f34dc6c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:57.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.043+0000 7f34dc6c29c0 20 realm 2024-09-10T05:36:57.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.043+0000 7f34dc6c29c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:57.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.043+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558dbdaae990 con 0x558dbdaaf610 2024-09-10T05:36:57.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.047+0000 7f34da9c9640 1 -- 172.21.15.62:0/3471955893 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f34cc0083f0 con 0x558dbdaaf610 2024-09-10T05:36:57.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.047+0000 7f34dc6c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:57.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.047+0000 7f34dc6c29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:57.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.047+0000 7f34dc6c29c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:57.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.047+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558dbdab2ce0 con 0x558dbdaaf610 2024-09-10T05:36:57.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.047+0000 7f34da9c9640 1 -- 172.21.15.62:0/3471955893 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f34cc0083f0 con 0x558dbdaaf610 2024-09-10T05:36:57.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.047+0000 7f34dc6c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:57.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.047+0000 7f34dc6c29c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:57.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.047+0000 7f34dc6c29c0 1 --2- 172.21.15.62:0/3471955893 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x558dbdab3ac0 0x558dbdab5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.047+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558dbdab6580 con 0x558dbdab3ac0 2024-09-10T05:36:57.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.047+0000 7f34da1c8640 1 --2- 172.21.15.62:0/3471955893 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x558dbdab3ac0 0x558dbdab5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.047+0000 7f34da1c8640 1 --2- 172.21.15.62:0/3471955893 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x558dbdab3ac0 0x558dbdab5eb0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.047+0000 7f34da1c8640 1 -- 172.21.15.62:0/3471955893 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f34d406f020 con 0x558dbdab3ac0 2024-09-10T05:36:57.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.047+0000 7f34dc6c29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:57.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.047+0000 7f34dc6c29c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:57.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.047+0000 7f34dc6c29c0 1 --2- 172.21.15.62:0/3471955893 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x558dbdab72e0 0x558dbdab96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.047+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558dbdab9e80 con 0x558dbdab72e0 2024-09-10T05:36:57.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.047+0000 7f34d99c7640 1 --2- 172.21.15.62:0/3471955893 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x558dbdab72e0 0x558dbdab96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.047+0000 7f34d99c7640 1 --2- 172.21.15.62:0/3471955893 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x558dbdab72e0 0x558dbdab96f0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.047+0000 7f34d99c7640 1 -- 172.21.15.62:0/3471955893 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f34d00aaaf0 con 0x558dbdab72e0 2024-09-10T05:36:57.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.047+0000 7f34dc6c29c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:57.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.047+0000 7f34dc6c29c0 20 searching for the correct realm 2024-09-10T05:36:57.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.047+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558dbdabb750 con 0x558dbdab72e0 2024-09-10T05:36:57.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.047+0000 7f34d99c7640 1 -- 172.21.15.62:0/3471955893 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34d00aaaf0 con 0x558dbdab72e0 2024-09-10T05:36:57.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.047+0000 7f34d99c7640 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558dbdabb750 con 0x558dbdab3ac0 2024-09-10T05:36:57.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.051+0000 7f34da1c8640 1 -- 172.21.15.62:0/3471955893 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34d406f020 con 0x558dbdab3ac0 2024-09-10T05:36:57.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.051+0000 7f34da1c8640 1 --2- 172.21.15.62:0/3471955893 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f34d4069030 0x7f34d400f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.051+0000 7f34da1c8640 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558dbdabb750 con 0x7f34d4069030 2024-09-10T05:36:57.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.051+0000 7f34da9c9640 1 --2- 172.21.15.62:0/3471955893 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f34d4069030 0x7f34d400f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.051+0000 7f34da9c9640 1 --2- 172.21.15.62:0/3471955893 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f34d4069030 0x7f34d400f300 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.051+0000 7f34da9c9640 1 -- 172.21.15.62:0/3471955893 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34cc0083f0 con 0x7f34d4069030 2024-09-10T05:36:57.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.051+0000 7f34da9c9640 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558dbdabb750 con 0x558dbdaaf610 2024-09-10T05:36:57.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.051+0000 7f34da9c9640 1 -- 172.21.15.62:0/3471955893 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34cc0083f0 con 0x558dbdaaf610 2024-09-10T05:36:57.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.051+0000 7f34da9c9640 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558dbdabb750 con 0x558dbdaaf610 2024-09-10T05:36:57.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.051+0000 7f34da9c9640 1 -- 172.21.15.62:0/3471955893 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34cc0083f0 con 0x558dbdaaf610 2024-09-10T05:36:57.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.051+0000 7f34da9c9640 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558dbdabb750 con 0x558dbdab72e0 2024-09-10T05:36:57.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.051+0000 7f34d99c7640 1 -- 172.21.15.62:0/3471955893 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34d00aaaf0 con 0x558dbdab72e0 2024-09-10T05:36:57.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.051+0000 7f34d99c7640 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558dbdabb750 con 0x558dbdaaf610 2024-09-10T05:36:57.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.051+0000 7f34da9c9640 1 -- 172.21.15.62:0/3471955893 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34cc0083f0 con 0x558dbdaaf610 2024-09-10T05:36:57.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.051+0000 7f34da9c9640 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558dbdabb750 con 0x558dbdab3ac0 2024-09-10T05:36:57.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.051+0000 7f34da1c8640 1 -- 172.21.15.62:0/3471955893 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34d406f020 con 0x558dbdab3ac0 2024-09-10T05:36:57.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.051+0000 7f34da1c8640 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558dbdabb750 con 0x558dbdab3ac0 2024-09-10T05:36:57.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.051+0000 7f34da1c8640 1 -- 172.21.15.62:0/3471955893 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34d406f020 con 0x558dbdab3ac0 2024-09-10T05:36:57.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.051+0000 7f34da1c8640 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558dbdabb750 con 0x558dbdaaf610 2024-09-10T05:36:57.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.055+0000 7f34da9c9640 1 -- 172.21.15.62:0/3471955893 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34cc0083f0 con 0x558dbdaaf610 2024-09-10T05:36:57.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.055+0000 7f34da9c9640 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558dbdabb750 con 0x7f34d4069030 2024-09-10T05:36:57.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.055+0000 7f34da9c9640 1 -- 172.21.15.62:0/3471955893 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34cc0083f0 con 0x7f34d4069030 2024-09-10T05:36:57.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.055+0000 7f34da9c9640 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558dbdabb750 con 0x558dbdaaf610 2024-09-10T05:36:57.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.055+0000 7f34da9c9640 1 -- 172.21.15.62:0/3471955893 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34cc0083f0 con 0x558dbdaaf610 2024-09-10T05:36:57.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.055+0000 7f34da9c9640 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558dbdabb750 con 0x7f34d4069030 2024-09-10T05:36:57.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.055+0000 7f34da9c9640 1 -- 172.21.15.62:0/3471955893 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f34cc0083f0 con 0x7f34d4069030 2024-09-10T05:36:57.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.055+0000 7f34da9c9640 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558dbdabb750 con 0x558dbdab3ac0 2024-09-10T05:36:57.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.055+0000 7f34da1c8640 1 -- 172.21.15.62:0/3471955893 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34d406f020 con 0x558dbdab3ac0 2024-09-10T05:36:57.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.055+0000 7f34da1c8640 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558dbdabb750 con 0x558dbdab72e0 2024-09-10T05:36:57.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.055+0000 7f34d99c7640 1 -- 172.21.15.62:0/3471955893 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34d00aaaf0 con 0x558dbdab72e0 2024-09-10T05:36:57.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.055+0000 7f34d99c7640 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558dbdabb750 con 0x558dbdaaf610 2024-09-10T05:36:57.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.055+0000 7f34da9c9640 1 -- 172.21.15.62:0/3471955893 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34cc0083f0 con 0x558dbdaaf610 2024-09-10T05:36:57.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.055+0000 7f34da9c9640 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558dbdabb750 con 0x558dbdab3ac0 2024-09-10T05:36:57.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.055+0000 7f34da1c8640 1 -- 172.21.15.62:0/3471955893 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34d406f020 con 0x558dbdab3ac0 2024-09-10T05:36:57.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.055+0000 7f34da1c8640 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558dbdabb750 con 0x558dbdab72e0 2024-09-10T05:36:57.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.055+0000 7f34d99c7640 1 -- 172.21.15.62:0/3471955893 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 32 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f34d00aaaf0 con 0x558dbdab72e0 2024-09-10T05:36:57.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.055+0000 7f34d99c7640 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558dbdabb750 con 0x558dbdaaf610 2024-09-10T05:36:57.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.059+0000 7f34da9c9640 1 -- 172.21.15.62:0/3471955893 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34cc0083f0 con 0x558dbdaaf610 2024-09-10T05:36:57.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.059+0000 7f34da9c9640 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558dbdabb750 con 0x558dbdaaf610 2024-09-10T05:36:57.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.059+0000 7f34da9c9640 1 -- 172.21.15.62:0/3471955893 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f34cc0083f0 con 0x558dbdaaf610 2024-09-10T05:36:57.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.059+0000 7f34da9c9640 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558dbdabb750 con 0x558dbdaaf610 2024-09-10T05:36:57.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.059+0000 7f34da9c9640 1 -- 172.21.15.62:0/3471955893 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34cc0083f0 con 0x558dbdaaf610 2024-09-10T05:36:57.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.059+0000 7f34da9c9640 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558dbdabb750 con 0x558dbdab72e0 2024-09-10T05:36:57.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.059+0000 7f34d99c7640 1 -- 172.21.15.62:0/3471955893 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34d00aaaf0 con 0x558dbdab72e0 2024-09-10T05:36:57.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.059+0000 7f34d99c7640 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558dbdabb750 con 0x7f34d4069030 2024-09-10T05:36:57.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.059+0000 7f34da9c9640 1 -- 172.21.15.62:0/3471955893 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34cc0083f0 con 0x7f34d4069030 2024-09-10T05:36:57.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.059+0000 7f34da9c9640 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558dbdabb750 con 0x558dbdaaf610 2024-09-10T05:36:57.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.059+0000 7f34da9c9640 1 -- 172.21.15.62:0/3471955893 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34cc0083f0 con 0x558dbdaaf610 2024-09-10T05:36:57.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.059+0000 7f34da9c9640 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558dbdabb750 con 0x7f34d4069030 2024-09-10T05:36:57.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.059+0000 7f34da9c9640 1 -- 172.21.15.62:0/3471955893 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34cc0083f0 con 0x7f34d4069030 2024-09-10T05:36:57.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.059+0000 7f34da9c9640 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558dbdabb750 con 0x558dbdab72e0 2024-09-10T05:36:57.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.059+0000 7f34d99c7640 1 -- 172.21.15.62:0/3471955893 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34d00aaaf0 con 0x558dbdab72e0 2024-09-10T05:36:57.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.059+0000 7f34d99c7640 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558dbdabb750 con 0x7f34d4069030 2024-09-10T05:36:57.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.059+0000 7f34da9c9640 1 -- 172.21.15.62:0/3471955893 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34cc0083f0 con 0x7f34d4069030 2024-09-10T05:36:57.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.059+0000 7f34da9c9640 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558dbdabb750 con 0x558dbdab3ac0 2024-09-10T05:36:57.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.059+0000 7f34da1c8640 1 -- 172.21.15.62:0/3471955893 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34d406f020 con 0x558dbdab3ac0 2024-09-10T05:36:57.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.059+0000 7f34da1c8640 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558dbdabb750 con 0x558dbdab3ac0 2024-09-10T05:36:57.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.063+0000 7f34da1c8640 1 -- 172.21.15.62:0/3471955893 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34d406f020 con 0x558dbdab3ac0 2024-09-10T05:36:57.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.063+0000 7f34da1c8640 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558dbdabb750 con 0x558dbdab72e0 2024-09-10T05:36:57.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.063+0000 7f34d99c7640 1 -- 172.21.15.62:0/3471955893 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34d00aaaf0 con 0x558dbdab72e0 2024-09-10T05:36:57.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.063+0000 7f34d99c7640 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558dbdabb750 con 0x558dbdab3ac0 2024-09-10T05:36:57.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.063+0000 7f34da1c8640 1 -- 172.21.15.62:0/3471955893 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f34d406f020 con 0x558dbdab3ac0 2024-09-10T05:36:57.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.063+0000 7f34da1c8640 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558dbdabb750 con 0x558dbdab3ac0 2024-09-10T05:36:57.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.063+0000 7f34da1c8640 1 -- 172.21.15.62:0/3471955893 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34d406f020 con 0x558dbdab3ac0 2024-09-10T05:36:57.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.063+0000 7f34dc6c29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:57.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.063+0000 7f34dc6c29c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:57.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.063+0000 7f34dc6c29c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:57.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.063+0000 7f34dc6c29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:57.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.063+0000 7f34dc6c29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:57.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.063+0000 7f34dc6c29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:57.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.063+0000 7f34dc6c29c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:57.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.063+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558dbdaba840 con 0x558dbdaaf610 2024-09-10T05:36:57.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.063+0000 7f34da9c9640 1 -- 172.21.15.62:0/3471955893 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f34cc0083f0 con 0x558dbdaaf610 2024-09-10T05:36:57.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.063+0000 7f34dc6c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:57.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.063+0000 7f34dc6c29c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:57.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.063+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558dbdaba450 con 0x558dbdab3ac0 2024-09-10T05:36:57.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.063+0000 7f34da1c8640 1 -- 172.21.15.62:0/3471955893 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f34d406f020 con 0x558dbdab3ac0 2024-09-10T05:36:57.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.063+0000 7f34dc6c29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:57.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.063+0000 7f34dc6c29c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:57.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.063+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558dbdabb130 con 0x558dbdab72e0 2024-09-10T05:36:57.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.063+0000 7f34d99c7640 1 -- 172.21.15.62:0/3471955893 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f34d00aaaf0 con 0x558dbdab72e0 2024-09-10T05:36:57.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.063+0000 7f34dc6c29c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:57.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.063+0000 7f34dc6c29c0 20 zone default found 2024-09-10T05:36:57.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.063+0000 7f34dc6c29c0 4 Realm: () 2024-09-10T05:36:57.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.063+0000 7f34dc6c29c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:57.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.063+0000 7f34dc6c29c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:57.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.063+0000 7f34dc6c29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:57.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.063+0000 7f34dc6c29c0 20 zonegroup default 2024-09-10T05:36:57.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.063+0000 7f34dc6c29c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:57.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.063+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558dbdabc030 con 0x7f34d4069030 2024-09-10T05:36:57.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.063+0000 7f34da9c9640 1 -- 172.21.15.62:0/3471955893 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f34cc0083f0 con 0x7f34d4069030 2024-09-10T05:36:57.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.063+0000 7f34dc6c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:57.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.063+0000 7f34dc6c29c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:57.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.067+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558dbdabe270 con 0x558dbdab72e0 2024-09-10T05:36:57.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.067+0000 7f34d99c7640 1 -- 172.21.15.62:0/3471955893 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f34d00aaaf0 con 0x558dbdab72e0 2024-09-10T05:36:57.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.067+0000 7f34dc6c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:57.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.067+0000 7f34dc6c29c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:57.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.067+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558dbdabe610 con 0x558dbdab72e0 2024-09-10T05:36:57.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.067+0000 7f34d99c7640 1 -- 172.21.15.62:0/3471955893 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f34d00aaaf0 con 0x558dbdab72e0 2024-09-10T05:36:57.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.067+0000 7f34dc6c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:57.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.067+0000 7f34dc6c29c0 20 started sync module instance, tier type = 2024-09-10T05:36:57.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.067+0000 7f34dc6c29c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:57.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.067+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558dbdabd6b0 con 0x558dbdab3ac0 2024-09-10T05:36:57.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.067+0000 7f34da1c8640 1 -- 172.21.15.62:0/3471955893 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34d406f020 con 0x558dbdab3ac0 2024-09-10T05:36:57.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.067+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94067260906144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558dbdabdec0 con 0x558dbdab3ac0 2024-09-10T05:36:57.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.067+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558dbdabf310 con 0x558dbdaaf610 2024-09-10T05:36:57.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.071+0000 7f34da9c9640 1 -- 172.21.15.62:0/3471955893 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34cc0083f0 con 0x558dbdaaf610 2024-09-10T05:36:57.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.071+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94067260913328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558dbdabff80 con 0x558dbdaaf610 2024-09-10T05:36:57.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.071+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558dbdac0940 con 0x558dbdab3ac0 2024-09-10T05:36:57.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.071+0000 7f34da1c8640 1 -- 172.21.15.62:0/3471955893 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94067260906144] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34d406f020 con 0x558dbdab3ac0 2024-09-10T05:36:57.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.071+0000 7f34da9c9640 1 -- 172.21.15.62:0/3471955893 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94067260913328] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34cc0083f0 con 0x558dbdaaf610 2024-09-10T05:36:57.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.071+0000 7f34da1c8640 1 -- 172.21.15.62:0/3471955893 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34d406f020 con 0x558dbdab3ac0 2024-09-10T05:36:57.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.071+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94067260910000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558dbdabff80 con 0x558dbdab3ac0 2024-09-10T05:36:57.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.071+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558dbdac11e0 con 0x7f34d4069030 2024-09-10T05:36:57.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.075+0000 7f34da9c9640 1 -- 172.21.15.62:0/3471955893 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34cc0083f0 con 0x7f34d4069030 2024-09-10T05:36:57.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.075+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94067260919088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558dbdac1600 con 0x7f34d4069030 2024-09-10T05:36:57.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.075+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558dbdac2020 con 0x558dbdab3ac0 2024-09-10T05:36:57.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.075+0000 7f34da1c8640 1 -- 172.21.15.62:0/3471955893 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94067260910000] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34d406f020 con 0x558dbdab3ac0 2024-09-10T05:36:57.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.075+0000 7f34da9c9640 1 -- 172.21.15.62:0/3471955893 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94067260919088] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34cc0083f0 con 0x7f34d4069030 2024-09-10T05:36:57.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.075+0000 7f34da1c8640 1 -- 172.21.15.62:0/3471955893 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34d406f020 con 0x558dbdab3ac0 2024-09-10T05:36:57.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.075+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94067260922640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558dbdac1150 con 0x558dbdab3ac0 2024-09-10T05:36:57.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.075+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558dbdac2490 con 0x558dbdab72e0 2024-09-10T05:36:57.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.079+0000 7f34d99c7640 1 -- 172.21.15.62:0/3471955893 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34d00aaaf0 con 0x558dbdab72e0 2024-09-10T05:36:57.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.079+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94067260923872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558dbdac28b0 con 0x558dbdab72e0 2024-09-10T05:36:57.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.079+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558dbdac32d0 con 0x558dbdab72e0 2024-09-10T05:36:57.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.079+0000 7f34da1c8640 1 -- 172.21.15.62:0/3471955893 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94067260922640] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34d406f020 con 0x558dbdab3ac0 2024-09-10T05:36:57.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.079+0000 7f34d99c7640 1 -- 172.21.15.62:0/3471955893 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94067260923872] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34d00aaaf0 con 0x558dbdab72e0 2024-09-10T05:36:57.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.079+0000 7f34d99c7640 1 -- 172.21.15.62:0/3471955893 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34d00aaaf0 con 0x558dbdab72e0 2024-09-10T05:36:57.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.079+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94067260927424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558dbdac2400 con 0x558dbdab72e0 2024-09-10T05:36:57.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.079+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558dbdac3b70 con 0x7f34d4069030 2024-09-10T05:36:57.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.079+0000 7f34da9c9640 1 -- 172.21.15.62:0/3471955893 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34cc0083f0 con 0x7f34d4069030 2024-09-10T05:36:57.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.079+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94067260929728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558dbdac3f90 con 0x7f34d4069030 2024-09-10T05:36:57.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.079+0000 7f34dc6c29c0 20 add_watcher() i=0 2024-09-10T05:36:57.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.079+0000 7f34dc6c29c0 20 add_watcher() i=1 2024-09-10T05:36:57.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.079+0000 7f34dc6c29c0 20 add_watcher() i=2 2024-09-10T05:36:57.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.079+0000 7f34dc6c29c0 20 add_watcher() i=3 2024-09-10T05:36:57.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.079+0000 7f34dc6c29c0 20 add_watcher() i=4 2024-09-10T05:36:57.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.079+0000 7f34dc6c29c0 20 add_watcher() i=5 2024-09-10T05:36:57.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.079+0000 7f34d99c7640 1 -- 172.21.15.62:0/3471955893 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94067260927424] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34d00aaaf0 con 0x558dbdab72e0 2024-09-10T05:36:57.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.079+0000 7f34dc6c29c0 20 add_watcher() i=6 2024-09-10T05:36:57.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.083+0000 7f34da9c9640 1 -- 172.21.15.62:0/3471955893 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94067260929728] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34cc0083f0 con 0x7f34d4069030 2024-09-10T05:36:57.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.083+0000 7f34dc6c29c0 20 add_watcher() i=7 2024-09-10T05:36:57.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.083+0000 7f34dc6c29c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:57.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.083+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558dbdac6bd0 con 0x558dbdaaf610 2024-09-10T05:36:57.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.083+0000 7f34da9c9640 1 -- 172.21.15.62:0/3471955893 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f34cc0083f0 con 0x558dbdaaf610 2024-09-10T05:36:57.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.083+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94067260914384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558dbdac3f90 con 0x558dbdaaf610 2024-09-10T05:36:57.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.083+0000 7f34da9c9640 1 -- 172.21.15.62:0/3471955893 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94067260914384] v32'184 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f34cc0083f0 con 0x558dbdaaf610 2024-09-10T05:36:57.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.083+0000 7f3390fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:57.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.083+0000 7f34dc6c29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:57.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.083+0000 7f34dc6c29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:57.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.083+0000 7f34dc6c29c0 5 note: GC not initialized 2024-09-10T05:36:57.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.083+0000 7f330b7fe640 20 reqs_thread_entry: start 2024-09-10T05:36:57.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.087+0000 7f34dc6c29c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:57.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.087+0000 7f34dc6c29c0 20 Filter name: none 2024-09-10T05:36:57.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.087+0000 7f33097fa640 20 reqs_thread_entry: start 2024-09-10T05:36:57.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.087+0000 7f34dc6c29c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T05:36:57.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.087+0000 7f34dc6c29c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:57.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.087+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558dbdaea4e0 con 0x7f34d4069030 2024-09-10T05:36:57.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.087+0000 7f34da9c9640 1 -- 172.21.15.62:0/3471955893 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f34cc0083f0 con 0x7f34d4069030 2024-09-10T05:36:57.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.087+0000 7f34dc6c29c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T05:36:57.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.087+0000 7f34dc6c29c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-10T05:36:57.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.087+0000 7f34dc6c29c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T05:36:57.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.087+0000 7f34dc6c29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5 : miss 2024-09-10T05:36:57.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.087+0000 7f34dc6c29c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:57.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.087+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:63 8.a 8:5373608a:root::.bucket.meta.myfoo%3a475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558dbdaebf40 con 0x558dbdaaf610 2024-09-10T05:36:57.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.087+0000 7f34da9c9640 1 -- 172.21.15.62:0/3471955893 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(63 .bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f34cc0083f0 con 0x558dbdaaf610 2024-09-10T05:36:57.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.087+0000 7f34dc6c29c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T05:36:57.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.087+0000 7f34dc6c29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5 info.flags=0x17 2024-09-10T05:36:57.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.087+0000 7f34dc6c29c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5 to cache LRU end 2024-09-10T05:36:57.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.087+0000 7f34dc6c29c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:36:57.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.087+0000 7f34dc6c29c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T05:36:57.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.087+0000 7f34dc6c29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5 2024-09-10T05:36:57.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.087+0000 7f34dc6c29c0 20 get_obj_state: octx=0x7f34cc008b20 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x558dbdaee638 s->prefetch_data=0 2024-09-10T05:36:57.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.087+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:64 3.14 3:2b16d606:::475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558dbdaef5e0 con 0x558dbdab3ac0 2024-09-10T05:36:57.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.087+0000 7f34da1c8640 1 -- 172.21.15.62:0/3471955893 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(64 475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=848b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 262+0+864 (crc 0 0 0) 0x7f34d406f020 con 0x558dbdab3ac0 2024-09-10T05:36:57.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.087+0000 7f34dc6c29c0 10 manifest: total_size = 5 2024-09-10T05:36:57.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.087+0000 7f34dc6c29c0 20 get_obj_state: setting s->obj_tag to _7UcE_iKs7e9RoSD-LWUB1DLRBlfnZTy 2024-09-10T05:36:57.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.087+0000 7f3390fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:57.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.087+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94067260914384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558dbdae7cd0 con 0x558dbdaaf610 2024-09-10T05:36:57.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.091+0000 7f34da9c9640 1 -- 172.21.15.62:0/3471955893 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94067260914384] v32'185 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f34cc0083f0 con 0x558dbdaaf610 2024-09-10T05:36:57.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.091+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94067260906144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558dbdabfad0 con 0x558dbdab3ac0 2024-09-10T05:36:57.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.095+0000 7f34da1c8640 1 -- 172.21.15.62:0/3471955893 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94067260906144] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34d406f020 con 0x558dbdab3ac0 2024-09-10T05:36:57.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.095+0000 7f34dc6c29c0 20 remove_watcher() i=0 2024-09-10T05:36:57.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.095+0000 7f34dc6c29c0 2 removed watcher, disabling cache 2024-09-10T05:36:57.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.095+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94067260913328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558dbdabdaa0 con 0x558dbdaaf610 2024-09-10T05:36:57.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.095+0000 7f34da9c9640 1 -- 172.21.15.62:0/3471955893 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94067260913328] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34cc0083f0 con 0x558dbdaaf610 2024-09-10T05:36:57.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.095+0000 7f34dc6c29c0 20 remove_watcher() i=1 2024-09-10T05:36:57.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.095+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94067260910000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558dbdaef5e0 con 0x558dbdab3ac0 2024-09-10T05:36:57.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.095+0000 7f34da1c8640 1 -- 172.21.15.62:0/3471955893 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94067260910000] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34d406f020 con 0x558dbdab3ac0 2024-09-10T05:36:57.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.095+0000 7f34dc6c29c0 20 remove_watcher() i=2 2024-09-10T05:36:57.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.095+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94067260919088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558dbdaef5e0 con 0x7f34d4069030 2024-09-10T05:36:57.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.099+0000 7f34da9c9640 1 -- 172.21.15.62:0/3471955893 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94067260919088] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34cc0083f0 con 0x7f34d4069030 2024-09-10T05:36:57.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.099+0000 7f34dc6c29c0 20 remove_watcher() i=3 2024-09-10T05:36:57.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.099+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94067260922640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558dbdaef5e0 con 0x558dbdab3ac0 2024-09-10T05:36:57.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.099+0000 7f34da1c8640 1 -- 172.21.15.62:0/3471955893 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94067260922640] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34d406f020 con 0x558dbdab3ac0 2024-09-10T05:36:57.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.099+0000 7f34dc6c29c0 20 remove_watcher() i=4 2024-09-10T05:36:57.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.099+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94067260923872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558dbdaef5e0 con 0x558dbdab72e0 2024-09-10T05:36:57.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.103+0000 7f34d99c7640 1 -- 172.21.15.62:0/3471955893 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94067260923872] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34d00aaaf0 con 0x558dbdab72e0 2024-09-10T05:36:57.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.103+0000 7f34dc6c29c0 20 remove_watcher() i=5 2024-09-10T05:36:57.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.103+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94067260927424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558dbdaef5e0 con 0x558dbdab72e0 2024-09-10T05:36:57.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.103+0000 7f34d99c7640 1 -- 172.21.15.62:0/3471955893 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94067260927424] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34d00aaaf0 con 0x558dbdab72e0 2024-09-10T05:36:57.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.103+0000 7f34dc6c29c0 20 remove_watcher() i=6 2024-09-10T05:36:57.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.103+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94067260929728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558dbdaef5e0 con 0x7f34d4069030 2024-09-10T05:36:57.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.103+0000 7f34da9c9640 1 -- 172.21.15.62:0/3471955893 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94067260929728] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34cc0083f0 con 0x7f34d4069030 2024-09-10T05:36:57.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.103+0000 7f34dc6c29c0 20 remove_watcher() i=7 2024-09-10T05:36:57.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.103+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x558dbdab3ac0 msgr2=0x558dbdab5eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.103+0000 7f34dc6c29c0 1 --2- 172.21.15.62:0/3471955893 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x558dbdab3ac0 0x558dbdab5eb0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.103+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x558dbdaaf610 msgr2=0x558dbdab1ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.103+0000 7f34dc6c29c0 1 --2- 172.21.15.62:0/3471955893 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x558dbdaaf610 0x558dbdab1ad0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.103+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f34d4069030 msgr2=0x7f34d400f300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.103+0000 7f34dc6c29c0 1 --2- 172.21.15.62:0/3471955893 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f34d4069030 0x7f34d400f300 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.103+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x558dbdab72e0 msgr2=0x558dbdab96f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.103+0000 7f34dc6c29c0 1 --2- 172.21.15.62:0/3471955893 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x558dbdab72e0 0x558dbdab96f0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.103+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f33a4039a20 msgr2=0x7f33a403bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.103+0000 7f34dc6c29c0 1 --2- 172.21.15.62:0/3471955893 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f33a4039a20 0x7f33a403bee0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f34d0018f70 tx=0x7f34d00c1040 comp rx=0 tx=0).stop 2024-09-10T05:36:57.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.103+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dbda9d450 msgr2=0x558dbdaa4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.103+0000 7f34da9c9640 1 -- 172.21.15.62:0/3471955893 reap_dead start 2024-09-10T05:36:57.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.103+0000 7f34dc6c29c0 1 --2- 172.21.15.62:0/3471955893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dbda9d450 0x558dbdaa4740 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f34d4000f90 tx=0x7f34d4041f30 comp rx=0 tx=0).stop 2024-09-10T05:36:57.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.103+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 shutdown_connections 2024-09-10T05:36:57.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.103+0000 7f34dc6c29c0 1 --2- 172.21.15.62:0/3471955893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dbda9d450 0x558dbdaa4740 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.103+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 >> 172.21.15.62:0/3471955893 conn(0x558dbda99880 msgr2=0x558dbda97a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:57.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.103+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 shutdown_connections 2024-09-10T05:36:57.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.103+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/3471955893 wait complete. 2024-09-10T05:36:57.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.103+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/2069698752 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f33b4039ac0 msgr2=0x7f33b403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.103+0000 7f34dc6c29c0 1 --2- 172.21.15.62:0/2069698752 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f33b4039ac0 0x7f33b403bf80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x558dbda74410 tx=0x7f34d0005ad0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.103+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/2069698752 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dbda90ca0 msgr2=0x558dbda910c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.103+0000 7f34dc6c29c0 1 --2- 172.21.15.62:0/2069698752 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dbda90ca0 0x558dbda910c0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f34d401c700 tx=0x7f34d40129b0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.103+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/2069698752 shutdown_connections 2024-09-10T05:36:57.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.103+0000 7f34dc6c29c0 1 --2- 172.21.15.62:0/2069698752 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f33b4039ac0 0x7f33b403bf80 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.103+0000 7f34dc6c29c0 1 --2- 172.21.15.62:0/2069698752 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dbda90ca0 0x558dbda910c0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.103+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/2069698752 >> 172.21.15.62:0/2069698752 conn(0x558dbda86650 msgr2=0x558dbda86a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:57.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.103+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/2069698752 shutdown_connections 2024-09-10T05:36:57.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.107+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/2069698752 wait complete. 2024-09-10T05:36:57.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.107+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/1429836634 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x558dbda7b400 msgr2=0x558dbda7d7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.107+0000 7f34dc6c29c0 1 --2- 172.21.15.62:0/1429836634 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x558dbda7b400 0x558dbda7d7f0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.107+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/1429836634 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x558dbd8f2610 msgr2=0x558dbda7a160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.107+0000 7f34dc6c29c0 1 --2- 172.21.15.62:0/1429836634 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x558dbd8f2610 0x558dbda7a160 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.107+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/1429836634 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x558dbda7fba0 msgr2=0x558dbda81f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.107+0000 7f34dc6c29c0 1 --2- 172.21.15.62:0/1429836634 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x558dbda7fba0 0x558dbda81f90 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.107+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/1429836634 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f33c0039ac0 msgr2=0x7f33c003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.107+0000 7f34dc6c29c0 1 --2- 172.21.15.62:0/1429836634 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f33c0039ac0 0x7f33c003bf80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f34d00ae000 tx=0x7f34d00a6000 comp rx=0 tx=0).stop 2024-09-10T05:36:57.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.107+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/1429836634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dbd8f2230 msgr2=0x558dbda72ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.107+0000 7f34dc6c29c0 1 --2- 172.21.15.62:0/1429836634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dbd8f2230 0x558dbda72ff0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f34d4001bf0 tx=0x7f34d4001260 comp rx=0 tx=0).stop 2024-09-10T05:36:57.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.107+0000 7f34da9c9640 1 -- 172.21.15.62:0/1429836634 reap_dead start 2024-09-10T05:36:57.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.107+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/1429836634 shutdown_connections 2024-09-10T05:36:57.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.107+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/1429836634 >> 172.21.15.62:0/1429836634 conn(0x558dbd978910 msgr2=0x558dbda66000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:57.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.107+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/1429836634 shutdown_connections 2024-09-10T05:36:57.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.107+0000 7f34dc6c29c0 1 -- 172.21.15.62:0/1429836634 wait complete. 2024-09-10T05:36:57.120 INFO:teuthology.orchestra.run.smithi062.stdout:fooFoofooFooFULL_CONTROL 2024-09-10T05:36:57.120 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2024-09-10T05:36:57.123 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2024-09-10T05:36:57.130 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T05:36:57.130 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-10T05:36:57.130 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-10T05:36:57.130 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-10T05:36:57.202 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:57.202 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:57.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.199+0000 7f24c68b69c0 1 Processor -- start 2024-09-10T05:36:57.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.199+0000 7f24c68b69c0 1 -- start start 2024-09-10T05:36:57.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.199+0000 7f24c68b69c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5646883c31f0 0x5646883c35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.199+0000 7f24c68b69c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5646882759c0 con 0x5646883c6330 2024-09-10T05:36:57.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.199+0000 7f24c68b69c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x5646882c56d0 con 0x5646883c31f0 2024-09-10T05:36:57.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.199+0000 7f24c43bc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5646883c31f0 0x5646883c35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.203+0000 7f24c43bc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5646883c31f0 0x5646883c35d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:48032/0 (socket says 172.21.15.62:48032) 2024-09-10T05:36:57.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.203+0000 7f24c43bc640 1 -- 172.21.15.62:0/2026196826 learned_addr learned my addr 172.21.15.62:0/2026196826 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:57.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.203+0000 7f24c43bc640 1 -- 172.21.15.62:0/2026196826 >> v1:172.21.15.2:6789/0 conn(0x5646883c6330 legacy=0x5646883c8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.203+0000 7f24c43bc640 1 -- 172.21.15.62:0/2026196826 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564688269ca0 con 0x5646883c31f0 2024-09-10T05:36:57.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.203+0000 7f24c43bc640 1 --2- 172.21.15.62:0/2026196826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646883c31f0 0x5646883c35d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f24b400a4e0 tx=0x7f24b401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa4c2b91345286c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.203+0000 7f24c33ba640 1 -- 172.21.15.62:0/2026196826 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24b40aa540 con 0x5646883c31f0 2024-09-10T05:36:57.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.203+0000 7f24c33ba640 1 -- 172.21.15.62:0/2026196826 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24b40aa6e0 con 0x5646883c31f0 2024-09-10T05:36:57.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.203+0000 7f24c33ba640 1 -- 172.21.15.62:0/2026196826 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24b40aaa40 con 0x5646883c31f0 2024-09-10T05:36:57.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.203+0000 7f24c68b69c0 1 -- 172.21.15.62:0/2026196826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646883c31f0 msgr2=0x5646883c35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.203+0000 7f24c68b69c0 1 --2- 172.21.15.62:0/2026196826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646883c31f0 0x5646883c35d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f24b400a4e0 tx=0x7f24b401b090 comp rx=0 tx=0).stop 2024-09-10T05:36:57.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.203+0000 7f24c68b69c0 1 -- 172.21.15.62:0/2026196826 shutdown_connections 2024-09-10T05:36:57.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.203+0000 7f24c68b69c0 1 --2- 172.21.15.62:0/2026196826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646883c31f0 0x5646883c35d0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.203+0000 7f24c68b69c0 1 -- 172.21.15.62:0/2026196826 >> 172.21.15.62:0/2026196826 conn(0x564688336b00 msgr2=0x564688336f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:57.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.203+0000 7f24c68b69c0 1 -- 172.21.15.62:0/2026196826 shutdown_connections 2024-09-10T05:36:57.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.203+0000 7f24c68b69c0 1 -- 172.21.15.62:0/2026196826 wait complete. 2024-09-10T05:36:57.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.219+0000 7f24c68b69c0 1 Processor -- start 2024-09-10T05:36:57.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.219+0000 7f24c68b69c0 1 -- start start 2024-09-10T05:36:57.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.219+0000 7f24c68b69c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646883c31f0 0x5646884ae880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.219+0000 7f24c68b69c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5646882c9680 con 0x5646883c31f0 2024-09-10T05:36:57.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.219+0000 7f24c43bc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646883c31f0 0x5646884ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.219+0000 7f24c43bc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646883c31f0 0x5646884ae880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:48034/0 (socket says 172.21.15.62:48034) 2024-09-10T05:36:57.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.219+0000 7f24c43bc640 1 -- 172.21.15.62:0/4261102471 learned_addr learned my addr 172.21.15.62:0/4261102471 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:57.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.223+0000 7f24c43bc640 1 -- 172.21.15.62:0/4261102471 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564688244da0 con 0x5646883c31f0 2024-09-10T05:36:57.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.223+0000 7f24c43bc640 1 --2- 172.21.15.62:0/4261102471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646883c31f0 0x5646884ae880 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f24b4019740 tx=0x7f24b40033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=630061ad501970cd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.223+0000 7f23b260c640 1 -- 172.21.15.62:0/4261102471 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24b40b9070 con 0x5646883c31f0 2024-09-10T05:36:57.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.223+0000 7f23b260c640 1 -- 172.21.15.62:0/4261102471 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24b40aaa90 con 0x5646883c31f0 2024-09-10T05:36:57.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.223+0000 7f23b260c640 1 -- 172.21.15.62:0/4261102471 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24b40aad70 con 0x5646883c31f0 2024-09-10T05:36:57.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.223+0000 7f24c68b69c0 1 -- 172.21.15.62:0/4261102471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646883c31f0 msgr2=0x5646884ae880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.223+0000 7f24c68b69c0 1 --2- 172.21.15.62:0/4261102471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646883c31f0 0x5646884ae880 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f24b4019740 tx=0x7f24b40033b0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.223+0000 7f24c68b69c0 1 -- 172.21.15.62:0/4261102471 shutdown_connections 2024-09-10T05:36:57.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.223+0000 7f24c68b69c0 1 --2- 172.21.15.62:0/4261102471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646883c31f0 0x5646884ae880 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.223+0000 7f24c68b69c0 1 -- 172.21.15.62:0/4261102471 >> 172.21.15.62:0/4261102471 conn(0x564688336b00 msgr2=0x5646884aa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:57.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.223+0000 7f24c68b69c0 1 -- 172.21.15.62:0/4261102471 shutdown_connections 2024-09-10T05:36:57.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.223+0000 7f24c68b69c0 1 -- 172.21.15.62:0/4261102471 wait complete. 2024-09-10T05:36:57.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.223+0000 7f24c68b69c0 1 Processor -- start 2024-09-10T05:36:57.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.223+0000 7f24c68b69c0 1 -- start start 2024-09-10T05:36:57.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.223+0000 7f24c68b69c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646883c31f0 0x5646884b5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.223+0000 7f24c68b69c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56468826ba50 con 0x5646883c31f0 2024-09-10T05:36:57.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.223+0000 7f24c43bc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646883c31f0 0x5646884b5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.223+0000 7f24c43bc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646883c31f0 0x5646884b5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:48050/0 (socket says 172.21.15.62:48050) 2024-09-10T05:36:57.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.223+0000 7f24c43bc640 1 -- 172.21.15.62:0/369211272 learned_addr learned my addr 172.21.15.62:0/369211272 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:57.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.223+0000 7f24c43bc640 1 -- 172.21.15.62:0/369211272 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646884b62f0 con 0x5646883c31f0 2024-09-10T05:36:57.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.223+0000 7f24c43bc640 1 --2- 172.21.15.62:0/369211272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646883c31f0 0x5646884b5d90 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f24b4018cc0 tx=0x7f24b4017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.227+0000 7f23b0e09640 1 -- 172.21.15.62:0/369211272 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24b40b9070 con 0x5646883c31f0 2024-09-10T05:36:57.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.227+0000 7f23b0e09640 1 -- 172.21.15.62:0/369211272 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24b40b5ad0 con 0x5646883c31f0 2024-09-10T05:36:57.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.227+0000 7f24c68b69c0 1 -- 172.21.15.62:0/369211272 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5646884b6580 con 0x5646883c31f0 2024-09-10T05:36:57.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.227+0000 7f23b0e09640 1 -- 172.21.15.62:0/369211272 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24b40b5dd0 con 0x5646883c31f0 2024-09-10T05:36:57.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.227+0000 7f24c68b69c0 1 -- 172.21.15.62:0/369211272 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646884b6f30 con 0x5646883c31f0 2024-09-10T05:36:57.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.227+0000 7f23b0e09640 1 -- 172.21.15.62:0/369211272 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f24b40b3040 con 0x5646883c31f0 2024-09-10T05:36:57.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.227+0000 7f23b0e09640 1 --2- 172.21.15.62:0/369211272 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f23ac039ac0 0x7f23ac03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.227+0000 7f23b0e09640 1 -- 172.21.15.62:0/369211272 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7f24b40c4070 con 0x5646883c31f0 2024-09-10T05:36:57.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.227+0000 7f24c3bbb640 1 --2- 172.21.15.62:0/369211272 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f23ac039ac0 0x7f23ac03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.227+0000 7f24c68b69c0 1 --2- 172.21.15.62:0/369211272 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5646883c6330 0x5646884bcf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.227+0000 7f24c68b69c0 1 -- 172.21.15.62:0/369211272 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646884bd440 con 0x5646883c6330 2024-09-10T05:36:57.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.227+0000 7f24c4bbd640 1 --2- 172.21.15.62:0/369211272 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5646883c6330 0x5646884bcf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.227+0000 7f24c3bbb640 1 --2- 172.21.15.62:0/369211272 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f23ac039ac0 0x7f23ac03bf80 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f24b8001ec0 tx=0x7f24b8001440 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.227+0000 7f24c4bbd640 1 --2- 172.21.15.62:0/369211272 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5646883c6330 0x5646884bcf00 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.227+0000 7f24c4bbd640 1 -- 172.21.15.62:0/369211272 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24bc0083f0 con 0x5646883c6330 2024-09-10T05:36:57.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.227+0000 7f24c68b69c0 1 --2- 172.21.15.62:0/369211272 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5646884be1f0 0x5646884c05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.227+0000 7f24c68b69c0 1 -- 172.21.15.62:0/369211272 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646884c0c10 con 0x5646884be1f0 2024-09-10T05:36:57.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.227+0000 7f24c43bc640 1 --2- 172.21.15.62:0/369211272 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5646884be1f0 0x5646884c05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.231+0000 7f24c43bc640 1 --2- 172.21.15.62:0/369211272 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5646884be1f0 0x5646884c05e0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.231+0000 7f24c43bc640 1 -- 172.21.15.62:0/369211272 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f24b40c6d80 con 0x5646884be1f0 2024-09-10T05:36:57.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.231+0000 7f24c68b69c0 1 --2- 172.21.15.62:0/369211272 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5646884c29d0 0x5646884c4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.231+0000 7f24c68b69c0 1 -- 172.21.15.62:0/369211272 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646884c54b0 con 0x5646884c29d0 2024-09-10T05:36:57.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.231+0000 7f24c3bbb640 1 --2- 172.21.15.62:0/369211272 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5646884c29d0 0x5646884c4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.231+0000 7f24c3bbb640 1 --2- 172.21.15.62:0/369211272 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5646884c29d0 0x5646884c4dc0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.231+0000 7f24c3bbb640 1 -- 172.21.15.62:0/369211272 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f24b800d040 con 0x5646884c29d0 2024-09-10T05:36:57.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.231+0000 7f24c68b69c0 1 -- 172.21.15.62:0/369211272 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646884c18a0 con 0x5646884be1f0 2024-09-10T05:36:57.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.231+0000 7f24c43bc640 1 -- 172.21.15.62:0/369211272 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f24b40c6d80 con 0x5646884be1f0 2024-09-10T05:36:57.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.231+0000 7f24c68b69c0 1 -- 172.21.15.62:0/369211272 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646884c1cc0 con 0x5646884c29d0 2024-09-10T05:36:57.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.231+0000 7f24c3bbb640 1 -- 172.21.15.62:0/369211272 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f24b800d040 con 0x5646884c29d0 2024-09-10T05:36:57.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.231+0000 7f24c68b69c0 1 Processor -- start 2024-09-10T05:36:57.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.231+0000 7f24c68b69c0 1 -- start start 2024-09-10T05:36:57.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.231+0000 7f24c68b69c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646884d3b80 0x5646884d3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.231+0000 7f24c68b69c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5646882d6450 con 0x5646884d3b80 2024-09-10T05:36:57.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.231+0000 7f24c43bc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646884d3b80 0x5646884d3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.231+0000 7f24c43bc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646884d3b80 0x5646884d3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:48060/0 (socket says 172.21.15.62:48060) 2024-09-10T05:36:57.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.231+0000 7f24c43bc640 1 -- 172.21.15.62:0/1345156723 learned_addr learned my addr 172.21.15.62:0/1345156723 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:57.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.235+0000 7f24c43bc640 1 -- 172.21.15.62:0/1345156723 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646884d45e0 con 0x5646884d3b80 2024-09-10T05:36:57.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.235+0000 7f24c43bc640 1 --2- 172.21.15.62:0/1345156723 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646884d3b80 0x5646884d3fa0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f24b40e95f0 tx=0x7f24b40c6a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.235+0000 7f23a9ffb640 1 -- 172.21.15.62:0/1345156723 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24b40e2300 con 0x5646884d3b80 2024-09-10T05:36:57.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.235+0000 7f23a9ffb640 1 -- 172.21.15.62:0/1345156723 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24b40b3540 con 0x5646884d3b80 2024-09-10T05:36:57.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.235+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1345156723 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5646884d45e0 con 0x5646884d3b80 2024-09-10T05:36:57.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.235+0000 7f23a9ffb640 1 -- 172.21.15.62:0/1345156723 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24b40b39a0 con 0x5646884d3b80 2024-09-10T05:36:57.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.235+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1345156723 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646884d45e0 con 0x5646884d3b80 2024-09-10T05:36:57.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.235+0000 7f23a9ffb640 1 -- 172.21.15.62:0/1345156723 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f24b40b3b40 con 0x5646884d3b80 2024-09-10T05:36:57.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.235+0000 7f23a9ffb640 1 --2- 172.21.15.62:0/1345156723 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f239c039a70 0x7f239c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.235+0000 7f23a9ffb640 1 -- 172.21.15.62:0/1345156723 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7f24b40ee080 con 0x5646884d3b80 2024-09-10T05:36:57.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.235+0000 7f24c3bbb640 1 --2- 172.21.15.62:0/1345156723 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f239c039a70 0x7f239c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.235+0000 7f24c68b69c0 1 Processor -- start 2024-09-10T05:36:57.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.235+0000 7f24c68b69c0 1 -- start start 2024-09-10T05:36:57.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.235+0000 7f24c3bbb640 1 --2- 172.21.15.62:0/1345156723 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f239c039a70 0x7f239c03bf30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x5646884c1c40 tx=0x7f24b8006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.235+0000 7f24c68b69c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646884dfea0 0x5646884e0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.235+0000 7f24c68b69c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5646884af010 con 0x5646884dfea0 2024-09-10T05:36:57.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.235+0000 7f24c43bc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646884dfea0 0x5646884e0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.235+0000 7f24c43bc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646884dfea0 0x5646884e0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:48068/0 (socket says 172.21.15.62:48068) 2024-09-10T05:36:57.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.235+0000 7f24c43bc640 1 -- 172.21.15.62:0/563415693 learned_addr learned my addr 172.21.15.62:0/563415693 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:57.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.239+0000 7f24c43bc640 1 -- 172.21.15.62:0/563415693 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646884e0870 con 0x5646884dfea0 2024-09-10T05:36:57.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.239+0000 7f24c43bc640 1 --2- 172.21.15.62:0/563415693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646884dfea0 0x5646884e0280 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f24b40e2c50 tx=0x7f24b40b4940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b15d94db283bdb6d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.239+0000 7f23a37fe640 1 -- 172.21.15.62:0/563415693 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24b4105070 con 0x5646884dfea0 2024-09-10T05:36:57.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.239+0000 7f23a37fe640 1 -- 172.21.15.62:0/563415693 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24b40e2560 con 0x5646884dfea0 2024-09-10T05:36:57.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.239+0000 7f23a37fe640 1 -- 172.21.15.62:0/563415693 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24b40f1040 con 0x5646884dfea0 2024-09-10T05:36:57.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.239+0000 7f24c68b69c0 1 -- 172.21.15.62:0/563415693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646884dfea0 msgr2=0x5646884e0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.239+0000 7f24c68b69c0 1 --2- 172.21.15.62:0/563415693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646884dfea0 0x5646884e0280 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f24b40e2c50 tx=0x7f24b40b4940 comp rx=0 tx=0).stop 2024-09-10T05:36:57.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.239+0000 7f24c68b69c0 1 -- 172.21.15.62:0/563415693 shutdown_connections 2024-09-10T05:36:57.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.239+0000 7f24c68b69c0 1 --2- 172.21.15.62:0/563415693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646884dfea0 0x5646884e0280 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.239+0000 7f24c68b69c0 1 -- 172.21.15.62:0/563415693 >> 172.21.15.62:0/563415693 conn(0x5646884dc2d0 msgr2=0x5646884da510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:57.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.239+0000 7f24c68b69c0 1 -- 172.21.15.62:0/563415693 shutdown_connections 2024-09-10T05:36:57.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.239+0000 7f24c68b69c0 1 -- 172.21.15.62:0/563415693 wait complete. 2024-09-10T05:36:57.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.239+0000 7f24c68b69c0 1 Processor -- start 2024-09-10T05:36:57.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.239+0000 7f24c68b69c0 1 -- start start 2024-09-10T05:36:57.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.239+0000 7f24c68b69c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646884dfea0 0x5646884e7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.239+0000 7f24c68b69c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5646884e0d30 con 0x5646884dfea0 2024-09-10T05:36:57.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.239+0000 7f24c43bc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646884dfea0 0x5646884e7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.239+0000 7f24c43bc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646884dfea0 0x5646884e7240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:48084/0 (socket says 172.21.15.62:48084) 2024-09-10T05:36:57.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.239+0000 7f24c43bc640 1 -- 172.21.15.62:0/1514772676 learned_addr learned my addr 172.21.15.62:0/1514772676 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:57.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.239+0000 7f24c43bc640 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646884e77a0 con 0x5646884dfea0 2024-09-10T05:36:57.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.239+0000 7f24c43bc640 1 --2- 172.21.15.62:0/1514772676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646884dfea0 0x5646884e7240 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f24b40e84c0 tx=0x7f24b40baf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.239+0000 7f23a1ffb640 1 -- 172.21.15.62:0/1514772676 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24b410f020 con 0x5646884dfea0 2024-09-10T05:36:57.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.239+0000 7f23a1ffb640 1 -- 172.21.15.62:0/1514772676 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24b40e97d0 con 0x5646884dfea0 2024-09-10T05:36:57.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.239+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5646884e77a0 con 0x5646884dfea0 2024-09-10T05:36:57.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.239+0000 7f23a1ffb640 1 -- 172.21.15.62:0/1514772676 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24b4105040 con 0x5646884dfea0 2024-09-10T05:36:57.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.239+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646884e77a0 con 0x5646884dfea0 2024-09-10T05:36:57.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.243+0000 7f23a1ffb640 1 -- 172.21.15.62:0/1514772676 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f24b4112020 con 0x5646884dfea0 2024-09-10T05:36:57.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.243+0000 7f23a1ffb640 1 --2- 172.21.15.62:0/1514772676 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f23940399f0 0x7f239403beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.243+0000 7f23a1ffb640 1 -- 172.21.15.62:0/1514772676 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7f24b40fd070 con 0x5646884dfea0 2024-09-10T05:36:57.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.243+0000 7f24c3bbb640 1 --2- 172.21.15.62:0/1514772676 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f23940399f0 0x7f239403beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.243+0000 7f24c68b69c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:57.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.243+0000 7f24c68b69c0 1 --2- 172.21.15.62:0/1514772676 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5646884f21c0 0x5646884f4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.243+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646884f4dd0 con 0x5646884f21c0 2024-09-10T05:36:57.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.243+0000 7f24c4bbd640 1 --2- 172.21.15.62:0/1514772676 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5646884f21c0 0x5646884f4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.243+0000 7f24c3bbb640 1 --2- 172.21.15.62:0/1514772676 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f23940399f0 0x7f239403beb0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x5646884c1870 tx=0x7f24b8011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.243+0000 7f24c4bbd640 1 --2- 172.21.15.62:0/1514772676 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5646884f21c0 0x5646884f4680 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.243+0000 7f24c4bbd640 1 -- 172.21.15.62:0/1514772676 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24bc0083f0 con 0x5646884f21c0 2024-09-10T05:36:57.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.243+0000 7f24c68b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:57.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.243+0000 7f24c68b69c0 20 realm 2024-09-10T05:36:57.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.243+0000 7f24c68b69c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:57.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.243+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646884f1540 con 0x5646884f21c0 2024-09-10T05:36:57.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.243+0000 7f24c4bbd640 1 -- 172.21.15.62:0/1514772676 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24bc0083f0 con 0x5646884f21c0 2024-09-10T05:36:57.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.243+0000 7f24c68b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:57.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.243+0000 7f24c68b69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:57.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.243+0000 7f24c68b69c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:57.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.243+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646884f5890 con 0x5646884f21c0 2024-09-10T05:36:57.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.243+0000 7f24c4bbd640 1 -- 172.21.15.62:0/1514772676 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24bc0083f0 con 0x5646884f21c0 2024-09-10T05:36:57.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.243+0000 7f24c68b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:57.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.243+0000 7f24c68b69c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:57.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.243+0000 7f24c68b69c0 1 --2- 172.21.15.62:0/1514772676 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5646884f6670 0x5646884f8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.243+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646884f9130 con 0x5646884f6670 2024-09-10T05:36:57.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.243+0000 7f24c43bc640 1 --2- 172.21.15.62:0/1514772676 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5646884f6670 0x5646884f8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.243+0000 7f24c43bc640 1 --2- 172.21.15.62:0/1514772676 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5646884f6670 0x5646884f8a60 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.247+0000 7f24c43bc640 1 -- 172.21.15.62:0/1514772676 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f24b40e2070 con 0x5646884f6670 2024-09-10T05:36:57.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.247+0000 7f24c68b69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:57.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.247+0000 7f24c68b69c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:57.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.247+0000 7f24c68b69c0 1 --2- 172.21.15.62:0/1514772676 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5646884f9e90 0x5646884fc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.247+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646884fca30 con 0x5646884f9e90 2024-09-10T05:36:57.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.247+0000 7f24c3bbb640 1 --2- 172.21.15.62:0/1514772676 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5646884f9e90 0x5646884fc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.247+0000 7f24c3bbb640 1 --2- 172.21.15.62:0/1514772676 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5646884f9e90 0x5646884fc2a0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.247+0000 7f24c3bbb640 1 -- 172.21.15.62:0/1514772676 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f24b800d040 con 0x5646884f9e90 2024-09-10T05:36:57.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.247+0000 7f24c68b69c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:57.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.247+0000 7f24c68b69c0 20 searching for the correct realm 2024-09-10T05:36:57.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.247+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646884fe300 con 0x5646884f9e90 2024-09-10T05:36:57.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.247+0000 7f24c3bbb640 1 -- 172.21.15.62:0/1514772676 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24b800d040 con 0x5646884f9e90 2024-09-10T05:36:57.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.247+0000 7f24c3bbb640 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646884fe300 con 0x5646884f6670 2024-09-10T05:36:57.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.247+0000 7f24c43bc640 1 -- 172.21.15.62:0/1514772676 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24b40e2070 con 0x5646884f6670 2024-09-10T05:36:57.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.247+0000 7f24c43bc640 1 --2- 172.21.15.62:0/1514772676 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f24b4114020 0x7f24b4100410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.247+0000 7f24c43bc640 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646884fe300 con 0x7f24b4114020 2024-09-10T05:36:57.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.247+0000 7f24c4bbd640 1 --2- 172.21.15.62:0/1514772676 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f24b4114020 0x7f24b4100410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.247+0000 7f24c4bbd640 1 --2- 172.21.15.62:0/1514772676 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f24b4114020 0x7f24b4100410 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.247+0000 7f24c4bbd640 1 -- 172.21.15.62:0/1514772676 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24bc0083f0 con 0x7f24b4114020 2024-09-10T05:36:57.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.247+0000 7f24c4bbd640 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646884fe300 con 0x5646884f21c0 2024-09-10T05:36:57.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.247+0000 7f24c4bbd640 1 -- 172.21.15.62:0/1514772676 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24bc0083f0 con 0x5646884f21c0 2024-09-10T05:36:57.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.247+0000 7f24c4bbd640 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646884fe300 con 0x5646884f21c0 2024-09-10T05:36:57.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.251+0000 7f24c4bbd640 1 -- 172.21.15.62:0/1514772676 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24bc0083f0 con 0x5646884f21c0 2024-09-10T05:36:57.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.251+0000 7f24c4bbd640 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646884fe300 con 0x5646884f9e90 2024-09-10T05:36:57.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.251+0000 7f24c3bbb640 1 -- 172.21.15.62:0/1514772676 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24b800d040 con 0x5646884f9e90 2024-09-10T05:36:57.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.251+0000 7f24c3bbb640 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646884fe300 con 0x5646884f21c0 2024-09-10T05:36:57.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.251+0000 7f24c4bbd640 1 -- 172.21.15.62:0/1514772676 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24bc0083f0 con 0x5646884f21c0 2024-09-10T05:36:57.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.251+0000 7f24c4bbd640 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646884fe300 con 0x5646884f6670 2024-09-10T05:36:57.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.251+0000 7f24c43bc640 1 -- 172.21.15.62:0/1514772676 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24b40e2070 con 0x5646884f6670 2024-09-10T05:36:57.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.251+0000 7f24c43bc640 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646884fe300 con 0x5646884f6670 2024-09-10T05:36:57.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.251+0000 7f24c43bc640 1 -- 172.21.15.62:0/1514772676 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24b40e2070 con 0x5646884f6670 2024-09-10T05:36:57.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.251+0000 7f24c43bc640 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646884fe300 con 0x5646884f21c0 2024-09-10T05:36:57.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.251+0000 7f24c4bbd640 1 -- 172.21.15.62:0/1514772676 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24bc0083f0 con 0x5646884f21c0 2024-09-10T05:36:57.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.251+0000 7f24c4bbd640 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646884fe300 con 0x7f24b4114020 2024-09-10T05:36:57.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.251+0000 7f24c4bbd640 1 -- 172.21.15.62:0/1514772676 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24bc0083f0 con 0x7f24b4114020 2024-09-10T05:36:57.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.251+0000 7f24c4bbd640 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646884fe300 con 0x5646884f21c0 2024-09-10T05:36:57.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.251+0000 7f24c4bbd640 1 -- 172.21.15.62:0/1514772676 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24bc0083f0 con 0x5646884f21c0 2024-09-10T05:36:57.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.251+0000 7f24c4bbd640 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646884fe300 con 0x7f24b4114020 2024-09-10T05:36:57.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.251+0000 7f24c4bbd640 1 -- 172.21.15.62:0/1514772676 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f24bc0083f0 con 0x7f24b4114020 2024-09-10T05:36:57.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.251+0000 7f24c4bbd640 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646884fe300 con 0x5646884f6670 2024-09-10T05:36:57.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.251+0000 7f24c43bc640 1 -- 172.21.15.62:0/1514772676 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24b40e2070 con 0x5646884f6670 2024-09-10T05:36:57.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.251+0000 7f24c43bc640 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646884fe300 con 0x5646884f9e90 2024-09-10T05:36:57.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.255+0000 7f24c3bbb640 1 -- 172.21.15.62:0/1514772676 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24b800d040 con 0x5646884f9e90 2024-09-10T05:36:57.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.255+0000 7f24c3bbb640 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646884fe300 con 0x5646884f21c0 2024-09-10T05:36:57.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.255+0000 7f24c4bbd640 1 -- 172.21.15.62:0/1514772676 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24bc0083f0 con 0x5646884f21c0 2024-09-10T05:36:57.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.255+0000 7f24c4bbd640 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646884fe300 con 0x5646884f6670 2024-09-10T05:36:57.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.255+0000 7f24c43bc640 1 -- 172.21.15.62:0/1514772676 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24b40e2070 con 0x5646884f6670 2024-09-10T05:36:57.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.255+0000 7f24c43bc640 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646884fe300 con 0x5646884f9e90 2024-09-10T05:36:57.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.255+0000 7f24c3bbb640 1 -- 172.21.15.62:0/1514772676 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 32 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f24b800d040 con 0x5646884f9e90 2024-09-10T05:36:57.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.255+0000 7f24c3bbb640 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646884fe300 con 0x5646884f21c0 2024-09-10T05:36:57.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.255+0000 7f24c4bbd640 1 -- 172.21.15.62:0/1514772676 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24bc0083f0 con 0x5646884f21c0 2024-09-10T05:36:57.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.255+0000 7f24c4bbd640 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646884fe300 con 0x5646884f21c0 2024-09-10T05:36:57.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.255+0000 7f24c4bbd640 1 -- 172.21.15.62:0/1514772676 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f24bc0083f0 con 0x5646884f21c0 2024-09-10T05:36:57.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.255+0000 7f24c4bbd640 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646884fe300 con 0x5646884f21c0 2024-09-10T05:36:57.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.255+0000 7f24c4bbd640 1 -- 172.21.15.62:0/1514772676 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24bc0083f0 con 0x5646884f21c0 2024-09-10T05:36:57.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.255+0000 7f24c4bbd640 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646884fe300 con 0x5646884f9e90 2024-09-10T05:36:57.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.255+0000 7f24c3bbb640 1 -- 172.21.15.62:0/1514772676 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24b800d040 con 0x5646884f9e90 2024-09-10T05:36:57.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.255+0000 7f24c3bbb640 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646884fe300 con 0x7f24b4114020 2024-09-10T05:36:57.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.255+0000 7f24c4bbd640 1 -- 172.21.15.62:0/1514772676 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24bc0083f0 con 0x7f24b4114020 2024-09-10T05:36:57.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.255+0000 7f24c4bbd640 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646884fe300 con 0x5646884f21c0 2024-09-10T05:36:57.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.255+0000 7f24c4bbd640 1 -- 172.21.15.62:0/1514772676 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24bc0083f0 con 0x5646884f21c0 2024-09-10T05:36:57.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.255+0000 7f24c4bbd640 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646884fe300 con 0x7f24b4114020 2024-09-10T05:36:57.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.255+0000 7f24c4bbd640 1 -- 172.21.15.62:0/1514772676 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24bc0083f0 con 0x7f24b4114020 2024-09-10T05:36:57.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.255+0000 7f24c4bbd640 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646884fe300 con 0x5646884f9e90 2024-09-10T05:36:57.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.255+0000 7f24c3bbb640 1 -- 172.21.15.62:0/1514772676 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24b800d040 con 0x5646884f9e90 2024-09-10T05:36:57.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.255+0000 7f24c3bbb640 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646884fe300 con 0x7f24b4114020 2024-09-10T05:36:57.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.259+0000 7f24c4bbd640 1 -- 172.21.15.62:0/1514772676 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24bc0083f0 con 0x7f24b4114020 2024-09-10T05:36:57.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.259+0000 7f24c4bbd640 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646884fe300 con 0x5646884f6670 2024-09-10T05:36:57.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.259+0000 7f24c43bc640 1 -- 172.21.15.62:0/1514772676 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24b40e2070 con 0x5646884f6670 2024-09-10T05:36:57.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.259+0000 7f24c43bc640 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646884fe300 con 0x5646884f6670 2024-09-10T05:36:57.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.259+0000 7f24c43bc640 1 -- 172.21.15.62:0/1514772676 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24b40e2070 con 0x5646884f6670 2024-09-10T05:36:57.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.259+0000 7f24c43bc640 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646884fe300 con 0x5646884f9e90 2024-09-10T05:36:57.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.259+0000 7f24c3bbb640 1 -- 172.21.15.62:0/1514772676 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24b800d040 con 0x5646884f9e90 2024-09-10T05:36:57.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.259+0000 7f24c3bbb640 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646884fe300 con 0x5646884f6670 2024-09-10T05:36:57.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.259+0000 7f24c43bc640 1 -- 172.21.15.62:0/1514772676 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f24b40e2070 con 0x5646884f6670 2024-09-10T05:36:57.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.259+0000 7f24c43bc640 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646884fe300 con 0x5646884f6670 2024-09-10T05:36:57.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.259+0000 7f24c43bc640 1 -- 172.21.15.62:0/1514772676 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24b40e2070 con 0x5646884f6670 2024-09-10T05:36:57.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.259+0000 7f24c68b69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:57.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.259+0000 7f24c68b69c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:57.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.259+0000 7f24c68b69c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:57.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.259+0000 7f24c68b69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:57.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.259+0000 7f24c68b69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:57.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.259+0000 7f24c68b69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:57.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.259+0000 7f24c68b69c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:57.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.259+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646884fd420 con 0x5646884f21c0 2024-09-10T05:36:57.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.259+0000 7f24c4bbd640 1 -- 172.21.15.62:0/1514772676 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24bc0083f0 con 0x5646884f21c0 2024-09-10T05:36:57.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.259+0000 7f24c68b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:57.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.259+0000 7f24c68b69c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:57.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.259+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646884fdcc0 con 0x5646884f6670 2024-09-10T05:36:57.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.263+0000 7f24c43bc640 1 -- 172.21.15.62:0/1514772676 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f24b40e2070 con 0x5646884f6670 2024-09-10T05:36:57.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.263+0000 7f24c68b69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:57.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.263+0000 7f24c68b69c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:57.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.263+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646884fd060 con 0x5646884f9e90 2024-09-10T05:36:57.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.263+0000 7f24c3bbb640 1 -- 172.21.15.62:0/1514772676 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f24b800d040 con 0x5646884f9e90 2024-09-10T05:36:57.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.263+0000 7f24c68b69c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:57.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.263+0000 7f24c68b69c0 20 zone default found 2024-09-10T05:36:57.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.263+0000 7f24c68b69c0 4 Realm: () 2024-09-10T05:36:57.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.263+0000 7f24c68b69c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:57.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.263+0000 7f24c68b69c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:57.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.263+0000 7f24c68b69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:57.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.263+0000 7f24c68b69c0 20 zonegroup default 2024-09-10T05:36:57.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.263+0000 7f24c68b69c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:57.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.263+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646884febe0 con 0x7f24b4114020 2024-09-10T05:36:57.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.263+0000 7f24c4bbd640 1 -- 172.21.15.62:0/1514772676 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f24bc0083f0 con 0x7f24b4114020 2024-09-10T05:36:57.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.263+0000 7f24c68b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:57.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.263+0000 7f24c68b69c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:57.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.263+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564688500e20 con 0x5646884f9e90 2024-09-10T05:36:57.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.263+0000 7f24c3bbb640 1 -- 172.21.15.62:0/1514772676 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f24b800d040 con 0x5646884f9e90 2024-09-10T05:36:57.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.263+0000 7f24c68b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:57.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.263+0000 7f24c68b69c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:57.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.263+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646885011c0 con 0x5646884f9e90 2024-09-10T05:36:57.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.263+0000 7f24c3bbb640 1 -- 172.21.15.62:0/1514772676 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f24b800d040 con 0x5646884f9e90 2024-09-10T05:36:57.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.263+0000 7f24c68b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:57.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.263+0000 7f24c68b69c0 20 started sync module instance, tier type = 2024-09-10T05:36:57.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.263+0000 7f24c68b69c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:57.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.263+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564688500260 con 0x5646884f6670 2024-09-10T05:36:57.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.267+0000 7f24c43bc640 1 -- 172.21.15.62:0/1514772676 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24b40e2070 con 0x5646884f6670 2024-09-10T05:36:57.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.267+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94860934645600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564688500260 con 0x5646884f6670 2024-09-10T05:36:57.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.267+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646885017e0 con 0x5646884f21c0 2024-09-10T05:36:57.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.267+0000 7f24c4bbd640 1 -- 172.21.15.62:0/1514772676 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24bc0083f0 con 0x5646884f21c0 2024-09-10T05:36:57.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.267+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94860934648624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564688502080 con 0x5646884f21c0 2024-09-10T05:36:57.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.267+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564688502aa0 con 0x5646884f6670 2024-09-10T05:36:57.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.267+0000 7f24c43bc640 1 -- 172.21.15.62:0/1514772676 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94860934645600] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24b40e2070 con 0x5646884f6670 2024-09-10T05:36:57.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.267+0000 7f24c4bbd640 1 -- 172.21.15.62:0/1514772676 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94860934648624] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24bc0083f0 con 0x5646884f21c0 2024-09-10T05:36:57.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.267+0000 7f24c43bc640 1 -- 172.21.15.62:0/1514772676 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24b40e2070 con 0x5646884f6670 2024-09-10T05:36:57.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.267+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94860934653328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564688501bd0 con 0x5646884f6670 2024-09-10T05:36:57.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.267+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564688501bd0 con 0x7f24b4114020 2024-09-10T05:36:57.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.271+0000 7f24c4bbd640 1 -- 172.21.15.62:0/1514772676 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24bc0083f0 con 0x7f24b4114020 2024-09-10T05:36:57.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.271+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94860934655632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564688501bd0 con 0x7f24b4114020 2024-09-10T05:36:57.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.271+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564688503dc0 con 0x5646884f6670 2024-09-10T05:36:57.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.271+0000 7f24c43bc640 1 -- 172.21.15.62:0/1514772676 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94860934653328] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24b40e2070 con 0x5646884f6670 2024-09-10T05:36:57.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.271+0000 7f24c4bbd640 1 -- 172.21.15.62:0/1514772676 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94860934655632] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24bc0083f0 con 0x7f24b4114020 2024-09-10T05:36:57.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.271+0000 7f24c43bc640 1 -- 172.21.15.62:0/1514772676 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24b40e2070 con 0x5646884f6670 2024-09-10T05:36:57.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.271+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94860934656688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646885038d0 con 0x5646884f6670 2024-09-10T05:36:57.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.271+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564688504660 con 0x5646884f9e90 2024-09-10T05:36:57.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.275+0000 7f24c3bbb640 1 -- 172.21.15.62:0/1514772676 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24b800d040 con 0x5646884f9e90 2024-09-10T05:36:57.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.275+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94860934660528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646885038d0 con 0x5646884f9e90 2024-09-10T05:36:57.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.275+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646885050a0 con 0x5646884f9e90 2024-09-10T05:36:57.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.275+0000 7f24c43bc640 1 -- 172.21.15.62:0/1514772676 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94860934656688] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24b40e2070 con 0x5646884f6670 2024-09-10T05:36:57.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.275+0000 7f24c3bbb640 1 -- 172.21.15.62:0/1514772676 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94860934660528] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24b800d040 con 0x5646884f9e90 2024-09-10T05:36:57.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.275+0000 7f24c3bbb640 1 -- 172.21.15.62:0/1514772676 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24b800d040 con 0x5646884f9e90 2024-09-10T05:36:57.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.275+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94860934661584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564688504bf0 con 0x5646884f9e90 2024-09-10T05:36:57.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.275+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646885055b0 con 0x7f24b4114020 2024-09-10T05:36:57.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.275+0000 7f24c4bbd640 1 -- 172.21.15.62:0/1514772676 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24bc0083f0 con 0x7f24b4114020 2024-09-10T05:36:57.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.275+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94860934664448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646885059d0 con 0x7f24b4114020 2024-09-10T05:36:57.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.275+0000 7f24c68b69c0 20 add_watcher() i=0 2024-09-10T05:36:57.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.275+0000 7f24c68b69c0 20 add_watcher() i=1 2024-09-10T05:36:57.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.275+0000 7f24c68b69c0 20 add_watcher() i=2 2024-09-10T05:36:57.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.275+0000 7f24c68b69c0 20 add_watcher() i=3 2024-09-10T05:36:57.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.275+0000 7f24c68b69c0 20 add_watcher() i=4 2024-09-10T05:36:57.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.275+0000 7f24c68b69c0 20 add_watcher() i=5 2024-09-10T05:36:57.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.275+0000 7f24c3bbb640 1 -- 172.21.15.62:0/1514772676 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94860934661584] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24b800d040 con 0x5646884f9e90 2024-09-10T05:36:57.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.275+0000 7f24c68b69c0 20 add_watcher() i=6 2024-09-10T05:36:57.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.279+0000 7f24c4bbd640 1 -- 172.21.15.62:0/1514772676 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94860934664448] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24bc0083f0 con 0x7f24b4114020 2024-09-10T05:36:57.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.279+0000 7f24c68b69c0 20 add_watcher() i=7 2024-09-10T05:36:57.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.279+0000 7f24c68b69c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:57.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.279+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646885059d0 con 0x5646884f21c0 2024-09-10T05:36:57.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.279+0000 7f24c4bbd640 1 -- 172.21.15.62:0/1514772676 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f24bc0083f0 con 0x5646884f21c0 2024-09-10T05:36:57.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.279+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94860934665504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564688505940 con 0x5646884f21c0 2024-09-10T05:36:57.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.279+0000 7f24c4bbd640 1 -- 172.21.15.62:0/1514772676 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94860934665504] v32'186 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f24bc0083f0 con 0x5646884f21c0 2024-09-10T05:36:57.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.279+0000 7f237a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:57.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.279+0000 7f24c68b69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:57.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.279+0000 7f24c68b69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:57.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.283+0000 7f24c68b69c0 5 note: GC not initialized 2024-09-10T05:36:57.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.283+0000 7f23797e2640 20 reqs_thread_entry: start 2024-09-10T05:36:57.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.283+0000 7f24c68b69c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:57.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.283+0000 7f24c68b69c0 20 Filter name: none 2024-09-10T05:36:57.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.283+0000 7f22eaffd640 20 reqs_thread_entry: start 2024-09-10T05:36:57.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.283+0000 7f24c68b69c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T05:36:57.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.283+0000 7f24c68b69c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:57.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.283+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56468852c2f0 con 0x7f24b4114020 2024-09-10T05:36:57.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.283+0000 7f24c4bbd640 1 -- 172.21.15.62:0/1514772676 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f24bc0083f0 con 0x7f24b4114020 2024-09-10T05:36:57.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.283+0000 7f24c68b69c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T05:36:57.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.283+0000 7f24c68b69c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-10T05:36:57.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.283+0000 7f24c68b69c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T05:36:57.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.283+0000 7f24c68b69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5 : miss 2024-09-10T05:36:57.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.283+0000 7f24c68b69c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:57.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.283+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:63 8.a 8:5373608a:root::.bucket.meta.myfoo%3a475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56468852dd50 con 0x5646884f21c0 2024-09-10T05:36:57.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.283+0000 7f24c4bbd640 1 -- 172.21.15.62:0/1514772676 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(63 .bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f24bc0083f0 con 0x5646884f21c0 2024-09-10T05:36:57.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.283+0000 7f24c68b69c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T05:36:57.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.283+0000 7f24c68b69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5 info.flags=0x17 2024-09-10T05:36:57.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.283+0000 7f24c68b69c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5 to cache LRU end 2024-09-10T05:36:57.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.283+0000 7f24c68b69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:36:57.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.283+0000 7f24c68b69c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T05:36:57.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.283+0000 7f24c68b69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5 2024-09-10T05:36:57.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.283+0000 7f24c68b69c0 20 get_obj_state: octx=0x7f24bc008b20 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x564688530448 s->prefetch_data=0 2024-09-10T05:36:57.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.283+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:64 3.14 3:2b16d606:::475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564688531350 con 0x5646884f6670 2024-09-10T05:36:57.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.283+0000 7f24c43bc640 1 -- 172.21.15.62:0/1514772676 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(64 475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=910b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+926 (crc 0 0 0) 0x7f24b40e2070 con 0x5646884f6670 2024-09-10T05:36:57.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.283+0000 7f24c68b69c0 10 manifest: total_size = 5 2024-09-10T05:36:57.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.283+0000 7f24c68b69c0 20 get_obj_state: setting s->obj_tag to _JF8CBAPq8PcszEZWN9_ZryYkR-cPuBN 2024-09-10T05:36:57.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.283+0000 7f237a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:57.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.283+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94860934665504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564688529ac0 con 0x5646884f21c0 2024-09-10T05:36:57.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.287+0000 7f24c4bbd640 1 -- 172.21.15.62:0/1514772676 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94860934665504] v32'187 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f24bc0083f0 con 0x5646884f21c0 2024-09-10T05:36:57.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.287+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94860934645600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564688505520 con 0x5646884f6670 2024-09-10T05:36:57.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.287+0000 7f24c43bc640 1 -- 172.21.15.62:0/1514772676 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94860934645600] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24b40e2070 con 0x5646884f6670 2024-09-10T05:36:57.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.287+0000 7f24c68b69c0 20 remove_watcher() i=0 2024-09-10T05:36:57.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.287+0000 7f24c68b69c0 2 removed watcher, disabling cache 2024-09-10T05:36:57.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.287+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94860934648624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564688500760 con 0x5646884f21c0 2024-09-10T05:36:57.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.291+0000 7f24c4bbd640 1 -- 172.21.15.62:0/1514772676 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94860934648624] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24bc0083f0 con 0x5646884f21c0 2024-09-10T05:36:57.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.291+0000 7f24c68b69c0 20 remove_watcher() i=1 2024-09-10T05:36:57.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.291+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94860934653328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564688531350 con 0x5646884f6670 2024-09-10T05:36:57.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.291+0000 7f24c43bc640 1 -- 172.21.15.62:0/1514772676 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94860934653328] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24b40e2070 con 0x5646884f6670 2024-09-10T05:36:57.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.291+0000 7f24c68b69c0 20 remove_watcher() i=2 2024-09-10T05:36:57.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.291+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94860934655632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564688531350 con 0x7f24b4114020 2024-09-10T05:36:57.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.295+0000 7f24c4bbd640 1 -- 172.21.15.62:0/1514772676 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94860934655632] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24bc0083f0 con 0x7f24b4114020 2024-09-10T05:36:57.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.295+0000 7f24c68b69c0 20 remove_watcher() i=3 2024-09-10T05:36:57.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.295+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94860934656688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564688531350 con 0x5646884f6670 2024-09-10T05:36:57.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.295+0000 7f24c43bc640 1 -- 172.21.15.62:0/1514772676 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94860934656688] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24b40e2070 con 0x5646884f6670 2024-09-10T05:36:57.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.295+0000 7f24c68b69c0 20 remove_watcher() i=4 2024-09-10T05:36:57.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.295+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94860934660528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564688531350 con 0x5646884f9e90 2024-09-10T05:36:57.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.295+0000 7f24c3bbb640 1 -- 172.21.15.62:0/1514772676 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94860934660528] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24b800d040 con 0x5646884f9e90 2024-09-10T05:36:57.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.299+0000 7f24c68b69c0 20 remove_watcher() i=5 2024-09-10T05:36:57.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.299+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94860934661584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564688531350 con 0x5646884f9e90 2024-09-10T05:36:57.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.299+0000 7f24c3bbb640 1 -- 172.21.15.62:0/1514772676 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94860934661584] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24b800d040 con 0x5646884f9e90 2024-09-10T05:36:57.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.299+0000 7f24c68b69c0 20 remove_watcher() i=6 2024-09-10T05:36:57.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.299+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94860934664448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564688531350 con 0x7f24b4114020 2024-09-10T05:36:57.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.299+0000 7f24c4bbd640 1 -- 172.21.15.62:0/1514772676 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94860934664448] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24bc0083f0 con 0x7f24b4114020 2024-09-10T05:36:57.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.299+0000 7f24c68b69c0 20 remove_watcher() i=7 2024-09-10T05:36:57.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.299+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5646884f6670 msgr2=0x5646884f8a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.299+0000 7f24c68b69c0 1 --2- 172.21.15.62:0/1514772676 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5646884f6670 0x5646884f8a60 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.299+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5646884f21c0 msgr2=0x5646884f4680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.299+0000 7f24c68b69c0 1 --2- 172.21.15.62:0/1514772676 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5646884f21c0 0x5646884f4680 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.299+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f24b4114020 msgr2=0x7f24b4100410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.299+0000 7f24c68b69c0 1 --2- 172.21.15.62:0/1514772676 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f24b4114020 0x7f24b4100410 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.299+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5646884f9e90 msgr2=0x5646884fc2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.299+0000 7f24c68b69c0 1 --2- 172.21.15.62:0/1514772676 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5646884f9e90 0x5646884fc2a0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.299+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f23940399f0 msgr2=0x7f239403beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.299+0000 7f24c68b69c0 1 --2- 172.21.15.62:0/1514772676 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f23940399f0 0x7f239403beb0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x5646884c1870 tx=0x7f24b8011000 comp rx=0 tx=0).stop 2024-09-10T05:36:57.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.299+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646884dfea0 msgr2=0x5646884e7240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.299+0000 7f24c4bbd640 1 -- 172.21.15.62:0/1514772676 reap_dead start 2024-09-10T05:36:57.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.299+0000 7f24c68b69c0 1 --2- 172.21.15.62:0/1514772676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646884dfea0 0x5646884e7240 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f24b40e84c0 tx=0x7f24b40baf20 comp rx=0 tx=0).stop 2024-09-10T05:36:57.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.299+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 shutdown_connections 2024-09-10T05:36:57.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.299+0000 7f24c68b69c0 1 --2- 172.21.15.62:0/1514772676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646884dfea0 0x5646884e7240 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.299+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 >> 172.21.15.62:0/1514772676 conn(0x5646884dc2d0 msgr2=0x5646884da4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:57.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.299+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 shutdown_connections 2024-09-10T05:36:57.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.299+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1514772676 wait complete. 2024-09-10T05:36:57.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.299+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1345156723 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f239c039a70 msgr2=0x7f239c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.299+0000 7f24c68b69c0 1 --2- 172.21.15.62:0/1345156723 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f239c039a70 0x7f239c03bf30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x5646884c1c40 tx=0x7f24b8006000 comp rx=0 tx=0).stop 2024-09-10T05:36:57.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.299+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1345156723 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646884d3b80 msgr2=0x5646884d3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.299+0000 7f24c68b69c0 1 --2- 172.21.15.62:0/1345156723 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646884d3b80 0x5646884d3fa0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f24b40e95f0 tx=0x7f24b40c6a50 comp rx=0 tx=0).stop 2024-09-10T05:36:57.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.299+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1345156723 shutdown_connections 2024-09-10T05:36:57.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.299+0000 7f24c68b69c0 1 --2- 172.21.15.62:0/1345156723 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f239c039a70 0x7f239c03bf30 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.299+0000 7f24c68b69c0 1 --2- 172.21.15.62:0/1345156723 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646884d3b80 0x5646884d3fa0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.299+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1345156723 >> 172.21.15.62:0/1345156723 conn(0x5646884c9530 msgr2=0x5646884c9910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:57.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.299+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1345156723 shutdown_connections 2024-09-10T05:36:57.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.299+0000 7f24c68b69c0 1 -- 172.21.15.62:0/1345156723 wait complete. 2024-09-10T05:36:57.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.303+0000 7f24c68b69c0 1 -- 172.21.15.62:0/369211272 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5646884be1f0 msgr2=0x5646884c05e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.303+0000 7f24c68b69c0 1 --2- 172.21.15.62:0/369211272 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5646884be1f0 0x5646884c05e0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.303+0000 7f24c68b69c0 1 -- 172.21.15.62:0/369211272 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5646883c6330 msgr2=0x5646884bcf00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.303+0000 7f24c68b69c0 1 --2- 172.21.15.62:0/369211272 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5646883c6330 0x5646884bcf00 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.303+0000 7f24c68b69c0 1 -- 172.21.15.62:0/369211272 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5646884c29d0 msgr2=0x5646884c4dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.303+0000 7f24c68b69c0 1 --2- 172.21.15.62:0/369211272 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5646884c29d0 0x5646884c4dc0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.303+0000 7f24c68b69c0 1 -- 172.21.15.62:0/369211272 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f23ac039ac0 msgr2=0x7f23ac03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.303+0000 7f24c68b69c0 1 --2- 172.21.15.62:0/369211272 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f23ac039ac0 0x7f23ac03bf80 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f24b8001ec0 tx=0x7f24b8001440 comp rx=0 tx=0).stop 2024-09-10T05:36:57.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.303+0000 7f24c68b69c0 1 -- 172.21.15.62:0/369211272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646883c31f0 msgr2=0x5646884b5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.303+0000 7f24c68b69c0 1 --2- 172.21.15.62:0/369211272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646883c31f0 0x5646884b5d90 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f24b4018cc0 tx=0x7f24b4017e30 comp rx=0 tx=0).stop 2024-09-10T05:36:57.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.303+0000 7f24c4bbd640 1 -- 172.21.15.62:0/369211272 reap_dead start 2024-09-10T05:36:57.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.303+0000 7f24c68b69c0 1 -- 172.21.15.62:0/369211272 shutdown_connections 2024-09-10T05:36:57.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.303+0000 7f24c68b69c0 1 -- 172.21.15.62:0/369211272 >> 172.21.15.62:0/369211272 conn(0x564688336b00 msgr2=0x5646884a8f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:57.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.303+0000 7f24c68b69c0 1 -- 172.21.15.62:0/369211272 shutdown_connections 2024-09-10T05:36:57.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.303+0000 7f24c68b69c0 1 -- 172.21.15.62:0/369211272 wait complete. 2024-09-10T05:36:57.316 INFO:teuthology.orchestra.run.smithi062.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-10T05:36:57.316 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-10T05:36:57.319 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2024-09-10T05:36:57.336 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T05:36:57.404 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-10T05:36:57.404 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-10T05:36:57.404 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-10T05:36:57.404 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-10T05:36:57.404 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-10T05:36:57.404 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-10T05:36:57.405 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2024-09-10T05:36:57.443 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:57.443 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:57.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.443+0000 7f1ffba3b9c0 1 Processor -- start 2024-09-10T05:36:57.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.443+0000 7f1ffba3b9c0 1 -- start start 2024-09-10T05:36:57.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.443+0000 7f1ffba3b9c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x556a6201b340 0x556a6201d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.443+0000 7f1ffba3b9c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556a61ec99c0 con 0x556a620171f0 2024-09-10T05:36:57.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.443+0000 7f1ffba3b9c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x556a61f196d0 con 0x556a6201b340 2024-09-10T05:36:57.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.443+0000 7f1ff8d40640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x556a6201b340 0x556a6201d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.443+0000 7f1ff8d40640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x556a6201b340 0x556a6201d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:48090/0 (socket says 172.21.15.62:48090) 2024-09-10T05:36:57.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.443+0000 7f1ff8d40640 1 -- 172.21.15.62:0/3521929168 learned_addr learned my addr 172.21.15.62:0/3521929168 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:57.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.443+0000 7f1ff9541640 1 --1- 172.21.15.62:0/3521929168 >> v1:172.21.15.2:6789/0 conn(0x556a620171f0 0x556a620175d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:58386/0 (socket says 172.21.15.62:58386) 2024-09-10T05:36:57.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.443+0000 7f1ff8d40640 1 -- 172.21.15.62:0/3521929168 >> v1:172.21.15.2:6789/0 conn(0x556a620171f0 legacy=0x556a620175d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.443+0000 7f1ff8d40640 1 -- 172.21.15.62:0/3521929168 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a61ebdca0 con 0x556a6201b340 2024-09-10T05:36:57.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.447+0000 7f1ff8d40640 1 --2- 172.21.15.62:0/3521929168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556a6201b340 0x556a6201d730 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f1ff000a5c0 tx=0x7f1ff001b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90a151fc5b984863 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.447+0000 7f1febfff640 1 -- 172.21.15.62:0/3521929168 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ff00a9590 con 0x556a6201b340 2024-09-10T05:36:57.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.447+0000 7f1febfff640 1 -- 172.21.15.62:0/3521929168 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ff00ae070 con 0x556a6201b340 2024-09-10T05:36:57.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.447+0000 7f1febfff640 1 -- 172.21.15.62:0/3521929168 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ff00a9880 con 0x556a6201b340 2024-09-10T05:36:57.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.447+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/3521929168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556a6201b340 msgr2=0x556a6201d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.447+0000 7f1ffba3b9c0 1 --2- 172.21.15.62:0/3521929168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556a6201b340 0x556a6201d730 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f1ff000a5c0 tx=0x7f1ff001b3d0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.447+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/3521929168 shutdown_connections 2024-09-10T05:36:57.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.447+0000 7f1ffba3b9c0 1 --2- 172.21.15.62:0/3521929168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556a6201b340 0x556a6201d730 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.447+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/3521929168 >> 172.21.15.62:0/3521929168 conn(0x556a61f8ab00 msgr2=0x556a61f8af10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:57.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.447+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/3521929168 shutdown_connections 2024-09-10T05:36:57.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.447+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/3521929168 wait complete. 2024-09-10T05:36:57.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.463+0000 7f1ffba3b9c0 1 Processor -- start 2024-09-10T05:36:57.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.463+0000 7f1ffba3b9c0 1 -- start start 2024-09-10T05:36:57.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.463+0000 7f1ffba3b9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556a620171f0 0x556a621028e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.463+0000 7f1ffba3b9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556a61f1d680 con 0x556a620171f0 2024-09-10T05:36:57.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.463+0000 7f1ff9541640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556a620171f0 0x556a621028e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.463+0000 7f1ff9541640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556a620171f0 0x556a621028e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:48094/0 (socket says 172.21.15.62:48094) 2024-09-10T05:36:57.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.463+0000 7f1ff9541640 1 -- 172.21.15.62:0/4182441516 learned_addr learned my addr 172.21.15.62:0/4182441516 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:57.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.463+0000 7f1ff9541640 1 -- 172.21.15.62:0/4182441516 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a61e98da0 con 0x556a620171f0 2024-09-10T05:36:57.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.463+0000 7f1ff9541640 1 --2- 172.21.15.62:0/4182441516 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556a620171f0 0x556a621028e0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4001680 tx=0x7f1ff4001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d2d83211943204d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.463+0000 7f1ee7606640 1 -- 172.21.15.62:0/4182441516 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ff4013420 con 0x556a620171f0 2024-09-10T05:36:57.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.463+0000 7f1ee7606640 1 -- 172.21.15.62:0/4182441516 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ff40135c0 con 0x556a620171f0 2024-09-10T05:36:57.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.463+0000 7f1ee7606640 1 -- 172.21.15.62:0/4182441516 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ff40138e0 con 0x556a620171f0 2024-09-10T05:36:57.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.463+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/4182441516 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556a620171f0 msgr2=0x556a621028e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.463+0000 7f1ffba3b9c0 1 --2- 172.21.15.62:0/4182441516 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556a620171f0 0x556a621028e0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4001680 tx=0x7f1ff4001b40 comp rx=0 tx=0).stop 2024-09-10T05:36:57.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.463+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/4182441516 shutdown_connections 2024-09-10T05:36:57.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.463+0000 7f1ffba3b9c0 1 --2- 172.21.15.62:0/4182441516 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556a620171f0 0x556a621028e0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.463+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/4182441516 >> 172.21.15.62:0/4182441516 conn(0x556a61f8ab00 msgr2=0x556a620fe520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:57.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.463+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/4182441516 shutdown_connections 2024-09-10T05:36:57.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.463+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/4182441516 wait complete. 2024-09-10T05:36:57.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.467+0000 7f1ffba3b9c0 1 Processor -- start 2024-09-10T05:36:57.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.467+0000 7f1ffba3b9c0 1 -- start start 2024-09-10T05:36:57.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.467+0000 7f1ffba3b9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556a620171f0 0x556a62109fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.467+0000 7f1ffba3b9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556a61ebfa50 con 0x556a620171f0 2024-09-10T05:36:57.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.467+0000 7f1ff9541640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556a620171f0 0x556a62109fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.467+0000 7f1ff9541640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556a620171f0 0x556a62109fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:48098/0 (socket says 172.21.15.62:48098) 2024-09-10T05:36:57.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.467+0000 7f1ff9541640 1 -- 172.21.15.62:0/3097235689 learned_addr learned my addr 172.21.15.62:0/3097235689 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:57.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.467+0000 7f1ff9541640 1 -- 172.21.15.62:0/3097235689 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a6210a510 con 0x556a620171f0 2024-09-10T05:36:57.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.467+0000 7f1ff9541640 1 --2- 172.21.15.62:0/3097235689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556a620171f0 0x556a62109fb0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x556a62103870 tx=0x7f1ff4000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.467+0000 7f1ee5e03640 1 -- 172.21.15.62:0/3097235689 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ff40037a0 con 0x556a620171f0 2024-09-10T05:36:57.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.467+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/3097235689 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556a6210a7a0 con 0x556a620171f0 2024-09-10T05:36:57.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.467+0000 7f1ee5e03640 1 -- 172.21.15.62:0/3097235689 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ff4023070 con 0x556a620171f0 2024-09-10T05:36:57.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.467+0000 7f1ee5e03640 1 -- 172.21.15.62:0/3097235689 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ff4003ad0 con 0x556a620171f0 2024-09-10T05:36:57.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.467+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/3097235689 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a6210b150 con 0x556a620171f0 2024-09-10T05:36:57.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.467+0000 7f1ee5e03640 1 -- 172.21.15.62:0/3097235689 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1ff4010070 con 0x556a620171f0 2024-09-10T05:36:57.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.467+0000 7f1ee5e03640 1 --2- 172.21.15.62:0/3097235689 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1ee0039ac0 0x7f1ee003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.467+0000 7f1ee5e03640 1 -- 172.21.15.62:0/3097235689 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7f1ff40501b0 con 0x556a620171f0 2024-09-10T05:36:57.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.467+0000 7f1ff8d40640 1 --2- 172.21.15.62:0/3097235689 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1ee0039ac0 0x7f1ee003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.471+0000 7f1ffba3b9c0 1 --2- 172.21.15.62:0/3097235689 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x556a6201b340 0x556a62111120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.471+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/3097235689 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a62111660 con 0x556a6201b340 2024-09-10T05:36:57.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.471+0000 7f1ff9d42640 1 --2- 172.21.15.62:0/3097235689 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x556a6201b340 0x556a62111120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.471+0000 7f1ff8d40640 1 --2- 172.21.15.62:0/3097235689 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1ee0039ac0 0x7f1ee003bf80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1ff00ad000 tx=0x7f1ff00a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.471+0000 7f1ff9d42640 1 --2- 172.21.15.62:0/3097235689 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x556a6201b340 0x556a62111120 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.471+0000 7f1ff9d42640 1 -- 172.21.15.62:0/3097235689 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a6201b340 2024-09-10T05:36:57.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.471+0000 7f1ffba3b9c0 1 --2- 172.21.15.62:0/3097235689 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x556a62112160 0x556a62114620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.471+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/3097235689 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a62114d90 con 0x556a62112160 2024-09-10T05:36:57.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.471+0000 7f1ff9541640 1 --2- 172.21.15.62:0/3097235689 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x556a62112160 0x556a62114620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.471+0000 7f1ff9541640 1 --2- 172.21.15.62:0/3097235689 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x556a62112160 0x556a62114620 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.471+0000 7f1ff9541640 1 -- 172.21.15.62:0/3097235689 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1ff400f030 con 0x556a62112160 2024-09-10T05:36:57.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.471+0000 7f1ffba3b9c0 1 --2- 172.21.15.62:0/3097235689 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x556a62116b50 0x556a62118f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.471+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/3097235689 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a62119610 con 0x556a62116b50 2024-09-10T05:36:57.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.471+0000 7f1ff8d40640 1 --2- 172.21.15.62:0/3097235689 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x556a62116b50 0x556a62118f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.471+0000 7f1ff8d40640 1 --2- 172.21.15.62:0/3097235689 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x556a62116b50 0x556a62118f40 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.471+0000 7f1ff8d40640 1 -- 172.21.15.62:0/3097235689 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1ff00a9a10 con 0x556a62116b50 2024-09-10T05:36:57.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.471+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/3097235689 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a621159f0 con 0x556a62112160 2024-09-10T05:36:57.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.475+0000 7f1ff9541640 1 -- 172.21.15.62:0/3097235689 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1ff400f030 con 0x556a62112160 2024-09-10T05:36:57.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.475+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/3097235689 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a62115e30 con 0x556a62116b50 2024-09-10T05:36:57.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.475+0000 7f1ff8d40640 1 -- 172.21.15.62:0/3097235689 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1ff00a9a10 con 0x556a62116b50 2024-09-10T05:36:57.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.475+0000 7f1ffba3b9c0 1 Processor -- start 2024-09-10T05:36:57.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.475+0000 7f1ffba3b9c0 1 -- start start 2024-09-10T05:36:57.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.475+0000 7f1ffba3b9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556a62127c60 0x556a62128080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.475+0000 7f1ffba3b9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556a61f2a450 con 0x556a62127c60 2024-09-10T05:36:57.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.475+0000 7f1ff9541640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556a62127c60 0x556a62128080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.475+0000 7f1ff9541640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556a62127c60 0x556a62128080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:48106/0 (socket says 172.21.15.62:48106) 2024-09-10T05:36:57.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.475+0000 7f1ff9541640 1 -- 172.21.15.62:0/883825845 learned_addr learned my addr 172.21.15.62:0/883825845 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:57.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.475+0000 7f1ff9541640 1 -- 172.21.15.62:0/883825845 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a621286c0 con 0x556a62127c60 2024-09-10T05:36:57.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.475+0000 7f1ff9541640 1 --2- 172.21.15.62:0/883825845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556a62127c60 0x556a62128080 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f1ff404e890 tx=0x7f1ff4003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.475+0000 7f1edeffd640 1 -- 172.21.15.62:0/883825845 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ff4038070 con 0x556a62127c60 2024-09-10T05:36:57.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.475+0000 7f1edeffd640 1 -- 172.21.15.62:0/883825845 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ff4019040 con 0x556a62127c60 2024-09-10T05:36:57.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.475+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/883825845 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556a62128f20 con 0x556a62127c60 2024-09-10T05:36:57.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.475+0000 7f1edeffd640 1 -- 172.21.15.62:0/883825845 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ff4047db0 con 0x556a62127c60 2024-09-10T05:36:57.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.475+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/883825845 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a62129490 con 0x556a62127c60 2024-09-10T05:36:57.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.479+0000 7f1edeffd640 1 -- 172.21.15.62:0/883825845 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1ff403b070 con 0x556a62127c60 2024-09-10T05:36:57.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.479+0000 7f1edeffd640 1 --2- 172.21.15.62:0/883825845 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1ed0039a70 0x7f1ed003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.479+0000 7f1edeffd640 1 -- 172.21.15.62:0/883825845 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7f1ff403ec10 con 0x556a62127c60 2024-09-10T05:36:57.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.479+0000 7f1ff8d40640 1 --2- 172.21.15.62:0/883825845 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1ed0039a70 0x7f1ed003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.479+0000 7f1ffba3b9c0 1 Processor -- start 2024-09-10T05:36:57.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.479+0000 7f1ffba3b9c0 1 -- start start 2024-09-10T05:36:57.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.479+0000 7f1ff8d40640 1 --2- 172.21.15.62:0/883825845 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1ed0039a70 0x7f1ed003bf30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x556a62111a00 tx=0x7f1ff0005ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.479+0000 7f1ffba3b9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556a62135450 0x556a62135830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.479+0000 7f1ffba3b9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556a62103130 con 0x556a62135450 2024-09-10T05:36:57.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.479+0000 7f1ff9541640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556a62135450 0x556a62135830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.479+0000 7f1ff9541640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556a62135450 0x556a62135830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:48116/0 (socket says 172.21.15.62:48116) 2024-09-10T05:36:57.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.479+0000 7f1ff9541640 1 -- 172.21.15.62:0/3859131178 learned_addr learned my addr 172.21.15.62:0/3859131178 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:57.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.479+0000 7f1ff9541640 1 -- 172.21.15.62:0/3859131178 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a62135e00 con 0x556a62135450 2024-09-10T05:36:57.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.479+0000 7f1ff9541640 1 --2- 172.21.15.62:0/3859131178 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556a62135450 0x556a62135830 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4033dc0 tx=0x7f1ff401df30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fde31ead1c5d7d37 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.479+0000 7f1edcff9640 1 -- 172.21.15.62:0/3859131178 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ff4060070 con 0x556a62135450 2024-09-10T05:36:57.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.479+0000 7f1edcff9640 1 -- 172.21.15.62:0/3859131178 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ff4033e30 con 0x556a62135450 2024-09-10T05:36:57.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.479+0000 7f1edcff9640 1 -- 172.21.15.62:0/3859131178 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ff4057040 con 0x556a62135450 2024-09-10T05:36:57.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.479+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/3859131178 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556a62135450 msgr2=0x556a62135830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.479+0000 7f1ffba3b9c0 1 --2- 172.21.15.62:0/3859131178 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556a62135450 0x556a62135830 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4033dc0 tx=0x7f1ff401df30 comp rx=0 tx=0).stop 2024-09-10T05:36:57.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.479+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/3859131178 shutdown_connections 2024-09-10T05:36:57.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.479+0000 7f1ffba3b9c0 1 --2- 172.21.15.62:0/3859131178 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556a62135450 0x556a62135830 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.479+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/3859131178 >> 172.21.15.62:0/3859131178 conn(0x556a62130810 msgr2=0x556a6212ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:57.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.479+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/3859131178 shutdown_connections 2024-09-10T05:36:57.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.479+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/3859131178 wait complete. 2024-09-10T05:36:57.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.479+0000 7f1ffba3b9c0 1 Processor -- start 2024-09-10T05:36:57.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.479+0000 7f1ffba3b9c0 1 -- start start 2024-09-10T05:36:57.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.483+0000 7f1ffba3b9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556a62135450 0x556a6213b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.483+0000 7f1ffba3b9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556a621341c0 con 0x556a62135450 2024-09-10T05:36:57.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.483+0000 7f1ff9541640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556a62135450 0x556a6213b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.483+0000 7f1ff9541640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556a62135450 0x556a6213b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:48132/0 (socket says 172.21.15.62:48132) 2024-09-10T05:36:57.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.483+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 learned_addr learned my addr 172.21.15.62:0/1742700786 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:57.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.483+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a6213bc90 con 0x556a62135450 2024-09-10T05:36:57.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.483+0000 7f1ff9541640 1 --2- 172.21.15.62:0/1742700786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556a62135450 0x556a6213b730 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4012fd0 tx=0x7f1ff404f6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.483+0000 7f1eceffd640 1 -- 172.21.15.62:0/1742700786 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ff406a020 con 0x556a62135450 2024-09-10T05:36:57.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.483+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556a6213bc90 con 0x556a62135450 2024-09-10T05:36:57.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.483+0000 7f1eceffd640 1 -- 172.21.15.62:0/1742700786 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ff4033e30 con 0x556a62135450 2024-09-10T05:36:57.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.483+0000 7f1eceffd640 1 -- 172.21.15.62:0/1742700786 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ff4060040 con 0x556a62135450 2024-09-10T05:36:57.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.483+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a6213bc90 con 0x556a62135450 2024-09-10T05:36:57.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.483+0000 7f1eceffd640 1 -- 172.21.15.62:0/1742700786 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1ff406d020 con 0x556a62135450 2024-09-10T05:36:57.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.483+0000 7f1eceffd640 1 --2- 172.21.15.62:0/1742700786 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1ec4039a20 0x7f1ec403bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.483+0000 7f1eceffd640 1 -- 172.21.15.62:0/1742700786 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7f1ff4070bd0 con 0x556a62135450 2024-09-10T05:36:57.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.483+0000 7f1ff8d40640 1 --2- 172.21.15.62:0/1742700786 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1ec4039a20 0x7f1ec403bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.483+0000 7f1ffba3b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:57.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.483+0000 7f1ffba3b9c0 1 --2- 172.21.15.62:0/1742700786 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x556a62146660 0x556a62148b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.483+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a62149270 con 0x556a62146660 2024-09-10T05:36:57.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.483+0000 7f1ff9d42640 1 --2- 172.21.15.62:0/1742700786 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x556a62146660 0x556a62148b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.487+0000 7f1ff8d40640 1 --2- 172.21.15.62:0/1742700786 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1ec4039a20 0x7f1ec403bee0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1ff00a9fd0 tx=0x7f1ff00c1040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.487+0000 7f1ff9d42640 1 --2- 172.21.15.62:0/1742700786 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x556a62146660 0x556a62148b20 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.487+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a62146660 2024-09-10T05:36:57.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.487+0000 7f1ffba3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:57.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.487+0000 7f1ffba3b9c0 20 realm 2024-09-10T05:36:57.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.487+0000 7f1ffba3b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:57.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.487+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a621459e0 con 0x556a62146660 2024-09-10T05:36:57.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.487+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a62146660 2024-09-10T05:36:57.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.487+0000 7f1ffba3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:57.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.487+0000 7f1ffba3b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:57.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.487+0000 7f1ffba3b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:57.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.487+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a62149d30 con 0x556a62146660 2024-09-10T05:36:57.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.487+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a62146660 2024-09-10T05:36:57.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.487+0000 7f1ffba3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:57.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.487+0000 7f1ffba3b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:57.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.487+0000 7f1ffba3b9c0 1 --2- 172.21.15.62:0/1742700786 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x556a6214ab10 0x556a6214cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.487+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a6214d5d0 con 0x556a6214ab10 2024-09-10T05:36:57.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.487+0000 7f1ff9541640 1 --2- 172.21.15.62:0/1742700786 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x556a6214ab10 0x556a6214cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.487+0000 7f1ff9541640 1 --2- 172.21.15.62:0/1742700786 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x556a6214ab10 0x556a6214cf00 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.487+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1ff4063040 con 0x556a6214ab10 2024-09-10T05:36:57.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.487+0000 7f1ffba3b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:57.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.487+0000 7f1ffba3b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:57.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.487+0000 7f1ffba3b9c0 1 --2- 172.21.15.62:0/1742700786 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x556a6214e330 0x556a62150720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.487+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a62150e90 con 0x556a6214e330 2024-09-10T05:36:57.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.487+0000 7f1ff8d40640 1 --2- 172.21.15.62:0/1742700786 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x556a6214e330 0x556a62150720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.487+0000 7f1ff8d40640 1 --2- 172.21.15.62:0/1742700786 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x556a6214e330 0x556a62150720 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.487+0000 7f1ff8d40640 1 -- 172.21.15.62:0/1742700786 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1ff00a9a10 con 0x556a6214e330 2024-09-10T05:36:57.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.487+0000 7f1ffba3b9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:57.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.487+0000 7f1ffba3b9c0 20 searching for the correct realm 2024-09-10T05:36:57.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.487+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a62152760 con 0x556a6214e330 2024-09-10T05:36:57.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.491+0000 7f1ff8d40640 1 -- 172.21.15.62:0/1742700786 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ff00a9a10 con 0x556a6214e330 2024-09-10T05:36:57.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.491+0000 7f1ff8d40640 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a62152760 con 0x556a6214ab10 2024-09-10T05:36:57.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.491+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ff4063040 con 0x556a6214ab10 2024-09-10T05:36:57.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.491+0000 7f1ff9541640 1 --2- 172.21.15.62:0/1742700786 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f1ff406f020 0x7f1ff404f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.491+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a62152760 con 0x7f1ff406f020 2024-09-10T05:36:57.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.491+0000 7f1ff9d42640 1 --2- 172.21.15.62:0/1742700786 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f1ff406f020 0x7f1ff404f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.491+0000 7f1ff9d42640 1 --2- 172.21.15.62:0/1742700786 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f1ff406f020 0x7f1ff404f830 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.491+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fec0083f0 con 0x7f1ff406f020 2024-09-10T05:36:57.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.491+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a62152760 con 0x556a62146660 2024-09-10T05:36:57.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.491+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a62146660 2024-09-10T05:36:57.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.491+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a62152760 con 0x556a62146660 2024-09-10T05:36:57.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.491+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a62146660 2024-09-10T05:36:57.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.491+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a62152760 con 0x556a6214e330 2024-09-10T05:36:57.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.491+0000 7f1ff8d40640 1 -- 172.21.15.62:0/1742700786 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ff00a9a10 con 0x556a6214e330 2024-09-10T05:36:57.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.491+0000 7f1ff8d40640 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a62152760 con 0x556a62146660 2024-09-10T05:36:57.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.491+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a62146660 2024-09-10T05:36:57.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.491+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a62152760 con 0x556a6214ab10 2024-09-10T05:36:57.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.491+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ff4063040 con 0x556a6214ab10 2024-09-10T05:36:57.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.491+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a62152760 con 0x556a6214ab10 2024-09-10T05:36:57.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.495+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ff4063040 con 0x556a6214ab10 2024-09-10T05:36:57.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.495+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a62152760 con 0x556a62146660 2024-09-10T05:36:57.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.495+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a62146660 2024-09-10T05:36:57.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.495+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a62152760 con 0x7f1ff406f020 2024-09-10T05:36:57.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.495+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fec0083f0 con 0x7f1ff406f020 2024-09-10T05:36:57.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.495+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a62152760 con 0x556a62146660 2024-09-10T05:36:57.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.495+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a62146660 2024-09-10T05:36:57.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.495+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a62152760 con 0x7f1ff406f020 2024-09-10T05:36:57.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.495+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1fec0083f0 con 0x7f1ff406f020 2024-09-10T05:36:57.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.495+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a62152760 con 0x556a6214ab10 2024-09-10T05:36:57.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.495+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ff4063040 con 0x556a6214ab10 2024-09-10T05:36:57.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.495+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a62152760 con 0x556a6214e330 2024-09-10T05:36:57.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.495+0000 7f1ff8d40640 1 -- 172.21.15.62:0/1742700786 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ff00a9a10 con 0x556a6214e330 2024-09-10T05:36:57.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.495+0000 7f1ff8d40640 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a62152760 con 0x556a62146660 2024-09-10T05:36:57.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.495+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a62146660 2024-09-10T05:36:57.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.495+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a62152760 con 0x556a6214ab10 2024-09-10T05:36:57.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.495+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ff4063040 con 0x556a6214ab10 2024-09-10T05:36:57.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.495+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a62152760 con 0x556a6214e330 2024-09-10T05:36:57.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.499+0000 7f1ff8d40640 1 -- 172.21.15.62:0/1742700786 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 32 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f1ff00a9a10 con 0x556a6214e330 2024-09-10T05:36:57.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.499+0000 7f1ff8d40640 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a62152760 con 0x556a62146660 2024-09-10T05:36:57.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.499+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a62146660 2024-09-10T05:36:57.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.499+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a62152760 con 0x556a62146660 2024-09-10T05:36:57.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.499+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a62146660 2024-09-10T05:36:57.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.499+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a62152760 con 0x556a62146660 2024-09-10T05:36:57.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.499+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a62146660 2024-09-10T05:36:57.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.499+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a62152760 con 0x556a6214e330 2024-09-10T05:36:57.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.499+0000 7f1ff8d40640 1 -- 172.21.15.62:0/1742700786 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ff00a9a10 con 0x556a6214e330 2024-09-10T05:36:57.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.499+0000 7f1ff8d40640 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a62152760 con 0x7f1ff406f020 2024-09-10T05:36:57.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.499+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fec0083f0 con 0x7f1ff406f020 2024-09-10T05:36:57.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.499+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a62152760 con 0x556a62146660 2024-09-10T05:36:57.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.499+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a62146660 2024-09-10T05:36:57.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.499+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a62152760 con 0x7f1ff406f020 2024-09-10T05:36:57.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.499+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fec0083f0 con 0x7f1ff406f020 2024-09-10T05:36:57.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.499+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a62152760 con 0x556a6214e330 2024-09-10T05:36:57.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.499+0000 7f1ff8d40640 1 -- 172.21.15.62:0/1742700786 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ff00a9a10 con 0x556a6214e330 2024-09-10T05:36:57.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.499+0000 7f1ff8d40640 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a62152760 con 0x7f1ff406f020 2024-09-10T05:36:57.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.499+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fec0083f0 con 0x7f1ff406f020 2024-09-10T05:36:57.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.499+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a62152760 con 0x556a6214ab10 2024-09-10T05:36:57.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.499+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ff4063040 con 0x556a6214ab10 2024-09-10T05:36:57.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.499+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a62152760 con 0x556a6214ab10 2024-09-10T05:36:57.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.503+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ff4063040 con 0x556a6214ab10 2024-09-10T05:36:57.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.503+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a62152760 con 0x556a6214e330 2024-09-10T05:36:57.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.503+0000 7f1ff8d40640 1 -- 172.21.15.62:0/1742700786 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ff00a9a10 con 0x556a6214e330 2024-09-10T05:36:57.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.503+0000 7f1ff8d40640 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a62152760 con 0x556a6214ab10 2024-09-10T05:36:57.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.503+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1ff4063040 con 0x556a6214ab10 2024-09-10T05:36:57.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.503+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a62152760 con 0x556a6214ab10 2024-09-10T05:36:57.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.503+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ff4063040 con 0x556a6214ab10 2024-09-10T05:36:57.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.503+0000 7f1ffba3b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:57.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.503+0000 7f1ffba3b9c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:57.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.503+0000 7f1ffba3b9c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:57.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.503+0000 7f1ffba3b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:57.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.503+0000 7f1ffba3b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:57.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.503+0000 7f1ffba3b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:57.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.503+0000 7f1ffba3b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:57.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.503+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a62151850 con 0x556a62146660 2024-09-10T05:36:57.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.503+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a62146660 2024-09-10T05:36:57.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.503+0000 7f1ffba3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:57.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.503+0000 7f1ffba3b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:57.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.503+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a62151490 con 0x556a6214ab10 2024-09-10T05:36:57.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.503+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1ff4063040 con 0x556a6214ab10 2024-09-10T05:36:57.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.503+0000 7f1ffba3b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:57.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.503+0000 7f1ffba3b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:57.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.503+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a621521b0 con 0x556a6214e330 2024-09-10T05:36:57.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.503+0000 7f1ff8d40640 1 -- 172.21.15.62:0/1742700786 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1ff00a9a10 con 0x556a6214e330 2024-09-10T05:36:57.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.503+0000 7f1ffba3b9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:57.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.503+0000 7f1ffba3b9c0 20 zone default found 2024-09-10T05:36:57.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.503+0000 7f1ffba3b9c0 4 Realm: () 2024-09-10T05:36:57.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.503+0000 7f1ffba3b9c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:57.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.503+0000 7f1ffba3b9c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:57.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.503+0000 7f1ffba3b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:57.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.503+0000 7f1ffba3b9c0 20 zonegroup default 2024-09-10T05:36:57.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.503+0000 7f1ffba3b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:57.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.503+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a62153040 con 0x7f1ff406f020 2024-09-10T05:36:57.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.503+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1fec0083f0 con 0x7f1ff406f020 2024-09-10T05:36:57.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.503+0000 7f1ffba3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:57.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.503+0000 7f1ffba3b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:57.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.503+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a62155280 con 0x556a6214e330 2024-09-10T05:36:57.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.507+0000 7f1ff8d40640 1 -- 172.21.15.62:0/1742700786 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1ff00a9a10 con 0x556a6214e330 2024-09-10T05:36:57.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.507+0000 7f1ffba3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:57.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.507+0000 7f1ffba3b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:57.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.507+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a62155620 con 0x556a6214e330 2024-09-10T05:36:57.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.507+0000 7f1ff8d40640 1 -- 172.21.15.62:0/1742700786 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1ff00a9a10 con 0x556a6214e330 2024-09-10T05:36:57.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.507+0000 7f1ffba3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:57.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.507+0000 7f1ffba3b9c0 20 started sync module instance, tier type = 2024-09-10T05:36:57.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.507+0000 7f1ffba3b9c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:57.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.507+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a621546c0 con 0x556a6214ab10 2024-09-10T05:36:57.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.507+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff4063040 con 0x556a6214ab10 2024-09-10T05:36:57.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.507+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93915400457200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a621546c0 con 0x556a6214ab10 2024-09-10T05:36:57.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.507+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a62155fe0 con 0x556a62146660 2024-09-10T05:36:57.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.511+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a62146660 2024-09-10T05:36:57.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.511+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93915400461104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a62156830 con 0x556a62146660 2024-09-10T05:36:57.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.511+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a62157230 con 0x556a6214ab10 2024-09-10T05:36:57.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.511+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 93915400457200] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff4063040 con 0x556a6214ab10 2024-09-10T05:36:57.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.511+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93915400461104] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a62146660 2024-09-10T05:36:57.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.511+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff4063040 con 0x556a6214ab10 2024-09-10T05:36:57.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.511+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93915400454672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a62156380 con 0x556a6214ab10 2024-09-10T05:36:57.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.511+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a62157ad0 con 0x7f1ff406f020 2024-09-10T05:36:57.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.511+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fec0083f0 con 0x7f1ff406f020 2024-09-10T05:36:57.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.511+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93915400468000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a62156380 con 0x7f1ff406f020 2024-09-10T05:36:57.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.511+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a62158580 con 0x556a6214ab10 2024-09-10T05:36:57.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.515+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93915400454672] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff4063040 con 0x556a6214ab10 2024-09-10T05:36:57.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.515+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93915400468000] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fec0083f0 con 0x7f1ff406f020 2024-09-10T05:36:57.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.515+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff4063040 con 0x556a6214ab10 2024-09-10T05:36:57.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.515+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93915400469056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a62158090 con 0x556a6214ab10 2024-09-10T05:36:57.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.515+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a62158e50 con 0x556a6214e330 2024-09-10T05:36:57.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.515+0000 7f1ff8d40640 1 -- 172.21.15.62:0/1742700786 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff00a9a10 con 0x556a6214e330 2024-09-10T05:36:57.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.515+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93915400472992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a62158090 con 0x556a6214e330 2024-09-10T05:36:57.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.515+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a62159890 con 0x556a6214e330 2024-09-10T05:36:57.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.515+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 93915400469056] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff4063040 con 0x556a6214ab10 2024-09-10T05:36:57.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.519+0000 7f1ff8d40640 1 -- 172.21.15.62:0/1742700786 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93915400472992] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff00a9a10 con 0x556a6214e330 2024-09-10T05:36:57.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.519+0000 7f1ff8d40640 1 -- 172.21.15.62:0/1742700786 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff00a9a10 con 0x556a6214e330 2024-09-10T05:36:57.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.519+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93915400474048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a621593e0 con 0x556a6214e330 2024-09-10T05:36:57.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.519+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a6215a130 con 0x7f1ff406f020 2024-09-10T05:36:57.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.519+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fec0083f0 con 0x7f1ff406f020 2024-09-10T05:36:57.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.519+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93915400477824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a621593e0 con 0x7f1ff406f020 2024-09-10T05:36:57.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.519+0000 7f1ffba3b9c0 20 add_watcher() i=0 2024-09-10T05:36:57.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.519+0000 7f1ffba3b9c0 20 add_watcher() i=1 2024-09-10T05:36:57.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.519+0000 7f1ffba3b9c0 20 add_watcher() i=2 2024-09-10T05:36:57.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.519+0000 7f1ffba3b9c0 20 add_watcher() i=3 2024-09-10T05:36:57.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.519+0000 7f1ffba3b9c0 20 add_watcher() i=4 2024-09-10T05:36:57.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.519+0000 7f1ffba3b9c0 20 add_watcher() i=5 2024-09-10T05:36:57.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.519+0000 7f1ff8d40640 1 -- 172.21.15.62:0/1742700786 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93915400474048] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff00a9a10 con 0x556a6214e330 2024-09-10T05:36:57.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.519+0000 7f1ffba3b9c0 20 add_watcher() i=6 2024-09-10T05:36:57.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.519+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93915400477824] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fec0083f0 con 0x7f1ff406f020 2024-09-10T05:36:57.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.519+0000 7f1ffba3b9c0 20 add_watcher() i=7 2024-09-10T05:36:57.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.519+0000 7f1ffba3b9c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:57.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.519+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a62156d40 con 0x556a62146660 2024-09-10T05:36:57.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.519+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a62146660 2024-09-10T05:36:57.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.519+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93915400465728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a6215a730 con 0x556a62146660 2024-09-10T05:36:57.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.523+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93915400465728] v32'188 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a62146660 2024-09-10T05:36:57.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.523+0000 7f1eaffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:57.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.523+0000 7f1ffba3b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:57.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.523+0000 7f1ffba3b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:57.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.523+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a62165b90 con 0x556a6214ab10 2024-09-10T05:36:57.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.527+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'54 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1ff4063040 con 0x556a6214ab10 2024-09-10T05:36:57.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.527+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a62165b90 con 0x7f1ff406f020 2024-09-10T05:36:57.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.527+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1fec0083f0 con 0x7f1ff406f020 2024-09-10T05:36:57.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.527+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a62165b90 con 0x556a6214e330 2024-09-10T05:36:57.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.527+0000 7f1ff8d40640 1 -- 172.21.15.62:0/1742700786 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1ff00a9a10 con 0x556a6214e330 2024-09-10T05:36:57.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.527+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a621665f0 con 0x556a62146660 2024-09-10T05:36:57.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.531+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'189 uv172 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a62146660 2024-09-10T05:36:57.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.531+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a621669b0 con 0x556a6214ab10 2024-09-10T05:36:57.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.531+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'68 uv61 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1ff4063040 con 0x556a6214ab10 2024-09-10T05:36:57.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.531+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a62166910 con 0x556a6214e330 2024-09-10T05:36:57.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.535+0000 7f1ff8d40640 1 -- 172.21.15.62:0/1742700786 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'53 uv48 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1ff00a9a10 con 0x556a6214e330 2024-09-10T05:36:57.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.535+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a62166ea0 con 0x556a6214ab10 2024-09-10T05:36:57.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.535+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'34 uv31 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1ff4063040 con 0x556a6214ab10 2024-09-10T05:36:57.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.535+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a62166e80 con 0x556a62146660 2024-09-10T05:36:57.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.539+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'47 uv42 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a62146660 2024-09-10T05:36:57.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.539+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a62167470 con 0x556a6214ab10 2024-09-10T05:36:57.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.539+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1ff4063040 con 0x556a6214ab10 2024-09-10T05:36:57.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.539+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a62167450 con 0x556a6214ab10 2024-09-10T05:36:57.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.543+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1ff4063040 con 0x556a6214ab10 2024-09-10T05:36:57.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.543+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a621673f0 con 0x556a6214ab10 2024-09-10T05:36:57.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.547+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'69 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1ff4063040 con 0x556a6214ab10 2024-09-10T05:36:57.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.547+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a621673f0 con 0x556a6214e330 2024-09-10T05:36:57.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.547+0000 7f1ff8d40640 1 -- 172.21.15.62:0/1742700786 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'28 uv25 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1ff00a9a10 con 0x556a6214e330 2024-09-10T05:36:57.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.547+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a621678a0 con 0x556a6214ab10 2024-09-10T05:36:57.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.551+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1ff4063040 con 0x556a6214ab10 2024-09-10T05:36:57.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.551+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a621678a0 con 0x556a62146660 2024-09-10T05:36:57.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.551+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'59 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a62146660 2024-09-10T05:36:57.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.551+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a621678a0 con 0x556a62146660 2024-09-10T05:36:57.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.555+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'190 uv168 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a62146660 2024-09-10T05:36:57.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.555+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a62167950 con 0x556a6214ab10 2024-09-10T05:36:57.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.555+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 <== osd.0 v2:172.21.15.2:6800/945139080 25 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'63 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1ff4063040 con 0x556a6214ab10 2024-09-10T05:36:57.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.555+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a62167950 con 0x556a6214ab10 2024-09-10T05:36:57.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.559+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 <== osd.0 v2:172.21.15.2:6800/945139080 26 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'70 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1ff4063040 con 0x556a6214ab10 2024-09-10T05:36:57.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.559+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a62167950 con 0x556a6214e330 2024-09-10T05:36:57.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.559+0000 7f1ff8d40640 1 -- 172.21.15.62:0/1742700786 <== osd.3 v2:172.21.15.62:6816/2708991149 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'36 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1ff00a9a10 con 0x556a6214e330 2024-09-10T05:36:57.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.559+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a62167a60 con 0x556a6214ab10 2024-09-10T05:36:57.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.563+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 <== osd.0 v2:172.21.15.2:6800/945139080 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1ff4063040 con 0x556a6214ab10 2024-09-10T05:36:57.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.563+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a62167a20 con 0x556a62146660 2024-09-10T05:36:57.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.567+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.1 v2:172.21.15.62:6808/3442097179 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'191 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a62146660 2024-09-10T05:36:57.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.567+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a62167a20 con 0x556a6214ab10 2024-09-10T05:36:57.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.567+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 <== osd.0 v2:172.21.15.2:6800/945139080 28 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'64 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1ff4063040 con 0x556a6214ab10 2024-09-10T05:36:57.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.567+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a62167a20 con 0x7f1ff406f020 2024-09-10T05:36:57.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.571+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'41 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1fec0083f0 con 0x7f1ff406f020 2024-09-10T05:36:57.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.571+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a62167a20 con 0x556a6214e330 2024-09-10T05:36:57.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.571+0000 7f1ff8d40640 1 -- 172.21.15.62:0/1742700786 <== osd.3 v2:172.21.15.62:6816/2708991149 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1ff00a9a10 con 0x556a6214e330 2024-09-10T05:36:57.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.571+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a62167b30 con 0x556a6214ab10 2024-09-10T05:36:57.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.575+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 <== osd.0 v2:172.21.15.2:6800/945139080 29 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'43 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1ff4063040 con 0x556a6214ab10 2024-09-10T05:36:57.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.575+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a62167b30 con 0x556a6214e330 2024-09-10T05:36:57.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.575+0000 7f1ff8d40640 1 -- 172.21.15.62:0/1742700786 <== osd.3 v2:172.21.15.62:6816/2708991149 21 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1ff00a9a10 con 0x556a6214e330 2024-09-10T05:36:57.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.575+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a62167bc0 con 0x556a6214e330 2024-09-10T05:36:57.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.579+0000 7f1ff8d40640 1 -- 172.21.15.62:0/1742700786 <== osd.3 v2:172.21.15.62:6816/2708991149 22 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'54 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1ff00a9a10 con 0x556a6214e330 2024-09-10T05:36:57.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.579+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a62167c00 con 0x556a6214e330 2024-09-10T05:36:57.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.579+0000 7f1ff8d40640 1 -- 172.21.15.62:0/1742700786 <== osd.3 v2:172.21.15.62:6816/2708991149 23 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1ff00a9a10 con 0x556a6214e330 2024-09-10T05:36:57.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.579+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a62167c40 con 0x556a6214ab10 2024-09-10T05:36:57.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.583+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 <== osd.0 v2:172.21.15.2:6800/945139080 30 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'38 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1ff4063040 con 0x556a6214ab10 2024-09-10T05:36:57.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.583+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a62167c40 con 0x556a62146660 2024-09-10T05:36:57.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.587+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.1 v2:172.21.15.62:6808/3442097179 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'48 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a62146660 2024-09-10T05:36:57.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.587+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a62167c40 con 0x556a6214ab10 2024-09-10T05:36:57.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.587+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 <== osd.0 v2:172.21.15.2:6800/945139080 31 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'65 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1ff4063040 con 0x556a6214ab10 2024-09-10T05:36:57.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.587+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a62167c40 con 0x556a62146660 2024-09-10T05:36:57.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.591+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.1 v2:172.21.15.62:6808/3442097179 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'60 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a62146660 2024-09-10T05:36:57.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.591+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a62167c80 con 0x7f1ff406f020 2024-09-10T05:36:57.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.591+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1fec0083f0 con 0x7f1ff406f020 2024-09-10T05:36:57.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.591+0000 7f1eaefe5640 20 reqs_thread_entry: start 2024-09-10T05:36:57.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.591+0000 7f1ffba3b9c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:57.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.591+0000 7f1ffba3b9c0 20 Filter name: none 2024-09-10T05:36:57.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.591+0000 7f1eacfe1640 20 reqs_thread_entry: start 2024-09-10T05:36:57.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.591+0000 7f1ffba3b9c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T05:36:57.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.591+0000 7f1ffba3b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:57.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.591+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a621645d0 con 0x7f1ff406f020 2024-09-10T05:36:57.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.591+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.2 v2:172.21.15.62:6800/2677868286 15 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f1fec0083f0 con 0x7f1ff406f020 2024-09-10T05:36:57.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.591+0000 7f1ffba3b9c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T05:36:57.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.591+0000 7f1ffba3b9c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-10T05:36:57.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.591+0000 7f1ffba3b9c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T05:36:57.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.591+0000 7f1ffba3b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5 : miss 2024-09-10T05:36:57.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.591+0000 7f1ffba3b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:57.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.591+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:95 8.a 8:5373608a:root::.bucket.meta.myfoo%3a475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a62184850 con 0x556a62146660 2024-09-10T05:36:57.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.595+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.1 v2:172.21.15.62:6808/3442097179 26 ==== osd_op_reply(95 .bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a62146660 2024-09-10T05:36:57.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.595+0000 7f1ffba3b9c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T05:36:57.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.595+0000 7f1ffba3b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5 info.flags=0x17 2024-09-10T05:36:57.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.595+0000 7f1ffba3b9c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5 to cache LRU end 2024-09-10T05:36:57.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.595+0000 7f1ffba3b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:36:57.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.595+0000 7f1ffba3b9c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T05:36:57.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.595+0000 7f1ffba3b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5 2024-09-10T05:36:57.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.595+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:96 4.11 4:8810721d:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a62201d50 con 0x556a6214e330 2024-09-10T05:36:57.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.595+0000 7f1ff8d40640 1 -- 172.21.15.62:0/1742700786 <== osd.3 v2:172.21.15.62:6816/2708991149 24 ==== osd_op_reply(96 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f1ff00a9a10 con 0x556a6214e330 2024-09-10T05:36:57.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.595+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:97 4.1f 4:fa475d23:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a62201d50 con 0x556a6214ab10 2024-09-10T05:36:57.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.595+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 <== osd.0 v2:172.21.15.2:6800/945139080 32 ==== osd_op_reply(97 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.1 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f1ff4063040 con 0x556a6214ab10 2024-09-10T05:36:57.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.595+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:98 4.24 4:254c81ab:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a62201d50 con 0x556a62146660 2024-09-10T05:36:57.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.595+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.1 v2:172.21.15.62:6808/3442097179 27 ==== osd_op_reply(98 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.2 [call out=429b] v0'0 uv5 ondisk = 0) ==== 194+0+429 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a62146660 2024-09-10T05:36:57.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.595+0000 7f1ffba3b9c0 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2024-09-10T05:36:57.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.595+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:99 4.3b 4:dd1ca53c:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a622022a0 con 0x7f1ff406f020 2024-09-10T05:36:57.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.595+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.2 v2:172.21.15.62:6800/2677868286 16 ==== osd_op_reply(99 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f1fec0083f0 con 0x7f1ff406f020 2024-09-10T05:36:57.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.595+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:100 4.25 4:a7bdbd98:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a622022a0 con 0x556a6214ab10 2024-09-10T05:36:57.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.599+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 <== osd.0 v2:172.21.15.2:6800/945139080 33 ==== osd_op_reply(100 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.4 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f1ff4063040 con 0x556a6214ab10 2024-09-10T05:36:57.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.599+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:101 4.36 4:6d9fa226:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a622022a0 con 0x556a62146660 2024-09-10T05:36:57.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.599+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.1 v2:172.21.15.62:6808/3442097179 28 ==== osd_op_reply(101 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a62146660 2024-09-10T05:36:57.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.599+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:102 4.33 4:cd2ae51e:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a622022a0 con 0x7f1ff406f020 2024-09-10T05:36:57.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.599+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.2 v2:172.21.15.62:6800/2677868286 17 ==== osd_op_reply(102 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.6 [call out=429b] v0'0 uv14 ondisk = 0) ==== 194+0+429 (crc 0 0 0) 0x7f1fec0083f0 con 0x7f1ff406f020 2024-09-10T05:36:57.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.599+0000 7f1ffba3b9c0 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2024-09-10T05:36:57.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.599+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:103 4.36 4:6e3528e2:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a62202280 con 0x556a62146660 2024-09-10T05:36:57.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.599+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.1 v2:172.21.15.62:6808/3442097179 29 ==== osd_op_reply(103 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.7 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a62146660 2024-09-10T05:36:57.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.599+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:104 4.2a 4:56a29d61:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a62202260 con 0x556a62146660 2024-09-10T05:36:57.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.599+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.1 v2:172.21.15.62:6808/3442097179 30 ==== osd_op_reply(104 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.8 [call out=430b] v0'0 uv3 ondisk = 0) ==== 194+0+430 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a62146660 2024-09-10T05:36:57.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.599+0000 7f1ffba3b9c0 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2024-09-10T05:36:57.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.599+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:105 4.39 4:9c74e037:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a62202260 con 0x556a6214e330 2024-09-10T05:36:57.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.599+0000 7f1ff8d40640 1 -- 172.21.15.62:0/1742700786 <== osd.3 v2:172.21.15.62:6816/2708991149 25 ==== osd_op_reply(105 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.9 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f1ff00a9a10 con 0x556a6214e330 2024-09-10T05:36:57.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.599+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:106 4.33 4:cc33a53a:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a62202260 con 0x7f1ff406f020 2024-09-10T05:36:57.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.599+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.2 v2:172.21.15.62:6800/2677868286 18 ==== osd_op_reply(106 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.10 [call out=702b] v0'0 uv12 ondisk = 0) ==== 195+0+702 (crc 0 0 0) 0x7f1fec0083f0 con 0x7f1ff406f020 2024-09-10T05:36:57.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.599+0000 7f1ffba3b9c0 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2024-09-10T05:36:57.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.599+0000 7f1ffba3b9c0 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2024-09-10T05:36:57.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.599+0000 7f1ffba3b9c0 20 get_obj_state: octx=0x7f1fec008b20 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x556a622011e8 s->prefetch_data=0 2024-09-10T05:36:57.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.599+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:107 3.0 3:0236eba1:::475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5_9c8454ddf7aa50116496bac348d7550d:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a621ff6e0 con 0x556a62146660 2024-09-10T05:36:57.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.599+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.1 v2:172.21.15.62:6808/3442097179 31 ==== osd_op_reply(107 475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5_9c8454ddf7aa50116496bac348d7550d [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a62146660 2024-09-10T05:36:57.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.603+0000 7f1ffba3b9c0 10 manifest: total_size = 6 2024-09-10T05:36:57.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.603+0000 7f1ffba3b9c0 20 get_obj_state: setting s->obj_tag to 475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.6397003884361962000 2024-09-10T05:36:57.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.603+0000 7f1ffba3b9c0 20 get_obj_state: octx=0x7f1fec008b20 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x556a622011e8 s->prefetch_data=0 2024-09-10T05:36:57.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.603+0000 7f1ffba3b9c0 20 prepare_atomic_modification: state is not atomic. state=0x556a622011e8 2024-09-10T05:36:57.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.603+0000 7f1ffba3b9c0 20 bucket index object: :.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.2 2024-09-10T05:36:57.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.603+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:108 4.24 4:254c81ab:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a621899e0 con 0x556a62146660 2024-09-10T05:36:57.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.603+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.1 v2:172.21.15.62:6808/3442097179 32 ==== osd_op_reply(108 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.2 [stat,call,call] v32'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a62146660 2024-09-10T05:36:57.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.603+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:109 3.0 3:0236eba1:::475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a621899e0 con 0x556a62146660 2024-09-10T05:36:57.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.603+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.1 v2:172.21.15.62:6808/3442097179 33 ==== osd_op_reply(109 475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5_9c8454ddf7aa50116496bac348d7550d [call] v32'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a62146660 2024-09-10T05:36:57.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.603+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:110 4.24 4:254c81ab:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a6218a470 con 0x556a62146660 2024-09-10T05:36:57.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.603+0000 7f1ffba3b9c0 20 get_obj_state: octx=0x7f1fec008b20 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x556a622011e8 s->prefetch_data=0 2024-09-10T05:36:57.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.603+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:111 3.29 3:96102bb2:::475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5_b1b9a972ccd8c962a473909b97007eb4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a6218a470 con 0x556a62146660 2024-09-10T05:36:57.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.603+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.1 v2:172.21.15.62:6808/3442097179 34 ==== osd_op_reply(111 475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5_b1b9a972ccd8c962a473909b97007eb4 [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a62146660 2024-09-10T05:36:57.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.603+0000 7f1ffba3b9c0 10 manifest: total_size = 3 2024-09-10T05:36:57.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.603+0000 7f1ffba3b9c0 20 get_obj_state: setting s->obj_tag to 475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.8115948588716453810 2024-09-10T05:36:57.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.603+0000 7f1ffba3b9c0 20 get_obj_state: octx=0x7f1fec008b20 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x556a622011e8 s->prefetch_data=0 2024-09-10T05:36:57.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.603+0000 7f1ffba3b9c0 20 prepare_atomic_modification: state is not atomic. state=0x556a622011e8 2024-09-10T05:36:57.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.603+0000 7f1ffba3b9c0 20 bucket index object: :.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.6 2024-09-10T05:36:57.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.603+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:112 4.33 4:cd2ae51e:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a6218a470 con 0x7f1ff406f020 2024-09-10T05:36:57.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.607+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.1 v2:172.21.15.62:6808/3442097179 35 ==== osd_op_reply(110 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.2 [stat,call,call] v32'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a62146660 2024-09-10T05:36:57.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.607+0000 7f1edcff9640 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2024-09-10T05:36:57.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.607+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.2 v2:172.21.15.62:6800/2677868286 19 ==== osd_op_reply(112 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.6 [stat,call,call] v32'15 uv15 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f1fec0083f0 con 0x7f1ff406f020 2024-09-10T05:36:57.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.607+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:113 3.29 3:96102bb2:::475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a6218a470 con 0x556a62146660 2024-09-10T05:36:57.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.607+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.1 v2:172.21.15.62:6808/3442097179 36 ==== osd_op_reply(113 475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5_b1b9a972ccd8c962a473909b97007eb4 [call] v32'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a62146660 2024-09-10T05:36:57.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.607+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:114 4.33 4:cd2ae51e:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a6218a410 con 0x7f1ff406f020 2024-09-10T05:36:57.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.607+0000 7f1ffba3b9c0 20 get_obj_state: octx=0x7f1fec008b20 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x556a622011e8 s->prefetch_data=0 2024-09-10T05:36:57.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.607+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:115 3.8 3:1164b92c:::475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5_c785e1ed2950e3e36b1e2ca01f299a54:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a6218a410 con 0x556a6214e330 2024-09-10T05:36:57.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.607+0000 7f1ff8d40640 1 -- 172.21.15.62:0/1742700786 <== osd.3 v2:172.21.15.62:6816/2708991149 26 ==== osd_op_reply(115 475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5_c785e1ed2950e3e36b1e2ca01f299a54 [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7f1ff00a9a10 con 0x556a6214e330 2024-09-10T05:36:57.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.607+0000 7f1ffba3b9c0 10 manifest: total_size = 4 2024-09-10T05:36:57.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.607+0000 7f1ffba3b9c0 20 get_obj_state: setting s->obj_tag to 475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10656171817109129745 2024-09-10T05:36:57.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.607+0000 7f1ffba3b9c0 20 get_obj_state: octx=0x7f1fec008b20 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x556a622011e8 s->prefetch_data=0 2024-09-10T05:36:57.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.607+0000 7f1ffba3b9c0 20 prepare_atomic_modification: state is not atomic. state=0x556a622011e8 2024-09-10T05:36:57.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.607+0000 7f1ffba3b9c0 20 bucket index object: :.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.8 2024-09-10T05:36:57.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.607+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:116 4.2a 4:56a29d61:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a6218e900 con 0x556a62146660 2024-09-10T05:36:57.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.611+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.2 v2:172.21.15.62:6800/2677868286 20 ==== osd_op_reply(114 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.6 [stat,call,call] v32'16 uv16 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f1fec0083f0 con 0x7f1ff406f020 2024-09-10T05:36:57.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.611+0000 7f1ecffff640 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2024-09-10T05:36:57.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.611+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.1 v2:172.21.15.62:6808/3442097179 37 ==== osd_op_reply(116 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.8 [stat,call,call] v32'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a62146660 2024-09-10T05:36:57.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.611+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:117 3.8 3:1164b92c:::475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a6218eec0 con 0x556a6214e330 2024-09-10T05:36:57.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.611+0000 7f1ff8d40640 1 -- 172.21.15.62:0/1742700786 <== osd.3 v2:172.21.15.62:6816/2708991149 27 ==== osd_op_reply(117 475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v32'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f1ff00a9a10 con 0x556a6214e330 2024-09-10T05:36:57.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.611+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:118 4.2a 4:56a29d61:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a6218b420 con 0x556a62146660 2024-09-10T05:36:57.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.611+0000 7f1ffba3b9c0 20 get_obj_state: octx=0x7f1fec008b20 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x556a622011e8 s->prefetch_data=0 2024-09-10T05:36:57.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.611+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:119 3.c 3:30109404:::475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5_24d27c169c2c881eb09a065116f2aa5c:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a6218c040 con 0x556a6214ab10 2024-09-10T05:36:57.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.615+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 <== osd.0 v2:172.21.15.2:6800/945139080 34 ==== osd_op_reply(119 475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5_24d27c169c2c881eb09a065116f2aa5c [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7f1ff4063040 con 0x556a6214ab10 2024-09-10T05:36:57.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.615+0000 7f1ffba3b9c0 10 manifest: total_size = 5 2024-09-10T05:36:57.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.615+0000 7f1ffba3b9c0 20 get_obj_state: setting s->obj_tag to 475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.12213789711777992541 2024-09-10T05:36:57.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.615+0000 7f1ffba3b9c0 20 get_obj_state: octx=0x7f1fec008b20 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x556a622011e8 s->prefetch_data=0 2024-09-10T05:36:57.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.615+0000 7f1ffba3b9c0 20 prepare_atomic_modification: state is not atomic. state=0x556a622011e8 2024-09-10T05:36:57.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.615+0000 7f1ffba3b9c0 20 bucket index object: :.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.10 2024-09-10T05:36:57.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.615+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:120 4.33 4:cc33a53a:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a6218bb90 con 0x7f1ff406f020 2024-09-10T05:36:57.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.615+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.1 v2:172.21.15.62:6808/3442097179 38 ==== osd_op_reply(118 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.8 [stat,call,call] v32'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a62146660 2024-09-10T05:36:57.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.615+0000 7f1edcff9640 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2024-09-10T05:36:57.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.615+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.2 v2:172.21.15.62:6800/2677868286 21 ==== osd_op_reply(120 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.10 [stat,call,call] v32'17 uv17 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f1fec0083f0 con 0x7f1ff406f020 2024-09-10T05:36:57.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.615+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:121 3.c 3:30109404:::475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a6218ac30 con 0x556a6214ab10 2024-09-10T05:36:57.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.619+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 <== osd.0 v2:172.21.15.2:6800/945139080 35 ==== osd_op_reply(121 475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5_24d27c169c2c881eb09a065116f2aa5c [call] v32'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f1ff4063040 con 0x556a6214ab10 2024-09-10T05:36:57.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.619+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:122 4.33 4:cc33a53a:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a6218bb90 con 0x7f1ff406f020 2024-09-10T05:36:57.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.619+0000 7f1ffba3b9c0 20 get_obj_state: octx=0x7f1fec008b20 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x556a622011e8 s->prefetch_data=0 2024-09-10T05:36:57.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.619+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:123 3.14 3:2b16d606:::475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a6218c8f0 con 0x556a6214ab10 2024-09-10T05:36:57.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.619+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 <== osd.0 v2:172.21.15.2:6800/945139080 36 ==== osd_op_reply(123 475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=910b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+926 (crc 0 0 0) 0x7f1ff4063040 con 0x556a6214ab10 2024-09-10T05:36:57.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.619+0000 7f1ffba3b9c0 10 manifest: total_size = 5 2024-09-10T05:36:57.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.619+0000 7f1ffba3b9c0 20 get_obj_state: setting s->obj_tag to _JF8CBAPq8PcszEZWN9_ZryYkR-cPuBN 2024-09-10T05:36:57.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.619+0000 7f1ffba3b9c0 20 get_obj_state: octx=0x7f1fec008b20 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x556a622011e8 s->prefetch_data=0 2024-09-10T05:36:57.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.619+0000 7f1ffba3b9c0 20 prepare_atomic_modification: state is not atomic. state=0x556a622011e8 2024-09-10T05:36:57.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.619+0000 7f1ffba3b9c0 20 bucket index object: :.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.10 2024-09-10T05:36:57.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.619+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:124 4.33 4:cc33a53a:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a6218bb90 con 0x7f1ff406f020 2024-09-10T05:36:57.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.619+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.2 v2:172.21.15.62:6800/2677868286 22 ==== osd_op_reply(122 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.10 [stat,call,call] v32'18 uv18 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f1fec0083f0 con 0x7f1ff406f020 2024-09-10T05:36:57.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.619+0000 7f1ecffff640 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2024-09-10T05:36:57.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.619+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.2 v2:172.21.15.62:6800/2677868286 23 ==== osd_op_reply(124 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.10 [stat,call,call] v32'19 uv19 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f1fec0083f0 con 0x7f1ff406f020 2024-09-10T05:36:57.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.619+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:125 3.14 3:2b16d606:::475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a6218bb90 con 0x556a6214ab10 2024-09-10T05:36:57.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.623+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 <== osd.0 v2:172.21.15.2:6800/945139080 37 ==== osd_op_reply(125 475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5_bb3aec0fdcdbc2974890f805c585d432 [call] v32'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f1ff4063040 con 0x556a6214ab10 2024-09-10T05:36:57.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.623+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:126 4.33 4:cc33a53a:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a6218bb90 con 0x7f1ff406f020 2024-09-10T05:36:57.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.623+0000 7f1ffba3b9c0 20 list_objects_ordered: starting attempt 1 2024-09-10T05:36:57.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.623+0000 7f1ffba3b9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-10T05:36:57.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.623+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:127 4.11 4:8810721d:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a6218bb90 con 0x556a6214e330 2024-09-10T05:36:57.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.623+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:128 4.1f 4:fa475d23:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a62201000 con 0x556a6214ab10 2024-09-10T05:36:57.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.623+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:129 4.24 4:254c81ab:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a621932d0 con 0x556a62146660 2024-09-10T05:36:57.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.623+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:130 4.3b 4:dd1ca53c:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a6218bb90 con 0x7f1ff406f020 2024-09-10T05:36:57.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.623+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:131 4.25 4:a7bdbd98:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a62198100 con 0x556a6214ab10 2024-09-10T05:36:57.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.623+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:132 4.36 4:6d9fa226:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a6219ad50 con 0x556a62146660 2024-09-10T05:36:57.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.623+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.1 v2:172.21.15.62:6808/3442097179 39 ==== osd_op_reply(129 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.2 [call out=128b] v0'0 uv7 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a62146660 2024-09-10T05:36:57.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.623+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:133 4.33 4:cd2ae51e:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a6218bb90 con 0x7f1ff406f020 2024-09-10T05:36:57.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.623+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:134 4.36 4:6e3528e2:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a621932d0 con 0x556a62146660 2024-09-10T05:36:57.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.623+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.2 v2:172.21.15.62:6800/2677868286 24 ==== osd_op_reply(130 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f1fec0083f0 con 0x7f1ff406f020 2024-09-10T05:36:57.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.623+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:135 4.2a 4:56a29d61:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a6219d220 con 0x556a62146660 2024-09-10T05:36:57.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.623+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:136 4.39 4:9c74e037:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a6219fe70 con 0x556a6214e330 2024-09-10T05:36:57.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.623+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:137 4.33 4:cc33a53a:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a621a2c80 con 0x7f1ff406f020 2024-09-10T05:36:57.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.623+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.1 v2:172.21.15.62:6808/3442097179 40 ==== osd_op_reply(132 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a62146660 2024-09-10T05:36:57.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.623+0000 7f1ff8d40640 1 -- 172.21.15.62:0/1742700786 <== osd.3 v2:172.21.15.62:6816/2708991149 28 ==== osd_op_reply(127 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f1ff00a9a10 con 0x556a6214e330 2024-09-10T05:36:57.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.623+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.2 v2:172.21.15.62:6800/2677868286 25 ==== osd_op_reply(133 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.6 [call out=128b] v0'0 uv16 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f1fec0083f0 con 0x7f1ff406f020 2024-09-10T05:36:57.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.623+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 <== osd.0 v2:172.21.15.2:6800/945139080 38 ==== osd_op_reply(131 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.4 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f1ff4063040 con 0x556a6214ab10 2024-09-10T05:36:57.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.623+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.1 v2:172.21.15.62:6808/3442097179 41 ==== osd_op_reply(134 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.7 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a62146660 2024-09-10T05:36:57.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.623+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 <== osd.0 v2:172.21.15.2:6800/945139080 39 ==== osd_op_reply(128 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.1 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f1ff4063040 con 0x556a6214ab10 2024-09-10T05:36:57.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.623+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.1 v2:172.21.15.62:6808/3442097179 42 ==== osd_op_reply(135 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.8 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a62146660 2024-09-10T05:36:57.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.623+0000 7f1ff8d40640 1 -- 172.21.15.62:0/1742700786 <== osd.3 v2:172.21.15.62:6816/2708991149 29 ==== osd_op_reply(136 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.9 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f1ff00a9a10 con 0x556a6214e330 2024-09-10T05:36:57.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.623+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.2 v2:172.21.15.62:6800/2677868286 26 ==== osd_op_reply(126 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.10 [stat,call,call] v32'20 uv20 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f1fec0083f0 con 0x7f1ff406f020 2024-09-10T05:36:57.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.623+0000 7f1edcff9640 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2024-09-10T05:36:57.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.627+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.2 v2:172.21.15.62:6800/2677868286 27 ==== osd_op_reply(137 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.10 [call out=128b] v0'0 uv20 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7f1fec0083f0 con 0x7f1ff406f020 2024-09-10T05:36:57.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.627+0000 7f1ffba3b9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-10T05:36:57.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.627+0000 7f1ffba3b9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-10T05:36:57.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.627+0000 7f1ffba3b9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-10T05:36:57.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.627+0000 7f1ffba3b9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-10T05:36:57.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.627+0000 7f1ffba3b9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5])"; uploads.size()=0; is_truncated=0 2024-09-10T05:36:57.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.627+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:138 4.11 4:8810721d:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a6219fdf0 con 0x556a6214e330 2024-09-10T05:36:57.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.627+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:139 4.1f 4:fa475d23:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a6219f880 con 0x556a6214ab10 2024-09-10T05:36:57.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.627+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:140 4.24 4:254c81ab:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a621a24b0 con 0x556a62146660 2024-09-10T05:36:57.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.627+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:141 4.3b 4:dd1ca53c:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a6219b200 con 0x7f1ff406f020 2024-09-10T05:36:57.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.627+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:142 4.25 4:a7bdbd98:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a6219caf0 con 0x556a6214ab10 2024-09-10T05:36:57.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.627+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:143 4.36 4:6d9fa226:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a6219f880 con 0x556a62146660 2024-09-10T05:36:57.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.627+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:144 4.33 4:cd2ae51e:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a6219caf0 con 0x7f1ff406f020 2024-09-10T05:36:57.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.627+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:145 4.36 4:6e3528e2:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a6219b200 con 0x556a62146660 2024-09-10T05:36:57.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.627+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:146 4.2a 4:56a29d61:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a6219caf0 con 0x556a62146660 2024-09-10T05:36:57.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.627+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:147 4.39 4:9c74e037:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a6219f880 con 0x556a6214e330 2024-09-10T05:36:57.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.627+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:148 4.33 4:cc33a53a:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a6219b200 con 0x7f1ff406f020 2024-09-10T05:36:57.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.627+0000 7f1ff8d40640 1 -- 172.21.15.62:0/1742700786 <== osd.3 v2:172.21.15.62:6816/2708991149 30 ==== osd_op_reply(138 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f1ff00a9a10 con 0x556a6214e330 2024-09-10T05:36:57.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.627+0000 7f1ff8d40640 1 -- 172.21.15.62:0/1742700786 <== osd.3 v2:172.21.15.62:6816/2708991149 31 ==== osd_op_reply(147 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.9 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f1ff00a9a10 con 0x556a6214e330 2024-09-10T05:36:57.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.627+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 <== osd.0 v2:172.21.15.2:6800/945139080 40 ==== osd_op_reply(142 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.4 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f1ff4063040 con 0x556a6214ab10 2024-09-10T05:36:57.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.627+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 <== osd.0 v2:172.21.15.2:6800/945139080 41 ==== osd_op_reply(139 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.1 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f1ff4063040 con 0x556a6214ab10 2024-09-10T05:36:57.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.627+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.2 v2:172.21.15.62:6800/2677868286 28 ==== osd_op_reply(141 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f1fec0083f0 con 0x7f1ff406f020 2024-09-10T05:36:57.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.627+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.2 v2:172.21.15.62:6800/2677868286 29 ==== osd_op_reply(144 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.6 [call out=128b] v0'0 uv16 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f1fec0083f0 con 0x7f1ff406f020 2024-09-10T05:36:57.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.627+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.2 v2:172.21.15.62:6800/2677868286 30 ==== osd_op_reply(148 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.10 [call out=128b] v0'0 uv20 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7f1fec0083f0 con 0x7f1ff406f020 2024-09-10T05:36:57.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.627+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.1 v2:172.21.15.62:6808/3442097179 43 ==== osd_op_reply(140 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.2 [call out=128b] v0'0 uv7 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a62146660 2024-09-10T05:36:57.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.627+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.1 v2:172.21.15.62:6808/3442097179 44 ==== osd_op_reply(143 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a62146660 2024-09-10T05:36:57.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.627+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.1 v2:172.21.15.62:6808/3442097179 45 ==== osd_op_reply(146 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.8 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a62146660 2024-09-10T05:36:57.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.627+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.1 v2:172.21.15.62:6808/3442097179 46 ==== osd_op_reply(145 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.7 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a62146660 2024-09-10T05:36:57.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.627+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:149 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a621a2490 con 0x7f1ff406f020 2024-09-10T05:36:57.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.627+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.2 v2:172.21.15.62:6800/2677868286 31 ==== osd_op_reply(149 foo.buckets [call] v32'37 uv37 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f1fec0083f0 con 0x7f1ff406f020 2024-09-10T05:36:57.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.627+0000 7f1ffba3b9c0 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x11) 2024-09-10T05:36:57.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.627+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:150 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a621a2490 con 0x7f1ff406f020 2024-09-10T05:36:57.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.631+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.2 v2:172.21.15.62:6800/2677868286 32 ==== osd_op_reply(150 myfoo [call,call,delete] v32'38 uv38 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7f1fec0083f0 con 0x7f1ff406f020 2024-09-10T05:36:57.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.631+0000 7f1ffba3b9c0 10 removing default.rgw.meta+root+myfoo from cache 2024-09-10T05:36:57.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.631+0000 7f1ffba3b9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-10T05:36:57.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.631+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:151 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93915401156544 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a62201260 con 0x556a6214e330 2024-09-10T05:36:57.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.631+0000 7f1ff8d40640 1 -- 172.21.15.62:0/1742700786 <== osd.3 v2:172.21.15.62:6816/2708991149 32 ==== watch-notify(notify (1) cookie 93915400474048 notify 137438953495 ret 0) ==== 191+0+0 (crc 0 0 0) 0x556a62166580 con 0x556a6214e330 2024-09-10T05:36:57.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.631+0000 7f1edcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953495 cookie 93915400474048 notifier 4647 bl.length()=149 2024-09-10T05:36:57.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.631+0000 7f1edcff9640 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:152 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f1ebc003d70 con 0x556a6214e330 2024-09-10T05:36:57.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.631+0000 7f1ff8d40640 1 -- 172.21.15.62:0/1742700786 <== osd.3 v2:172.21.15.62:6816/2708991149 33 ==== osd_op_reply(151 notify.6 [notify cookie 93915401156544 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1ff00a9a10 con 0x556a6214e330 2024-09-10T05:36:57.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.631+0000 7f1ff8d40640 1 -- 172.21.15.62:0/1742700786 <== osd.3 v2:172.21.15.62:6816/2708991149 34 ==== watch-notify(notify_complete (2) cookie 93915401156544 notify 137438953495 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556a62166cb0 con 0x556a6214e330 2024-09-10T05:36:57.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.631+0000 7f1ff8d40640 1 -- 172.21.15.62:0/1742700786 <== osd.3 v2:172.21.15.62:6816/2708991149 35 ==== osd_op_reply(152 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff00a9a10 con 0x556a6214e330 2024-09-10T05:36:57.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.631+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:153 8.a 8:5373608a:root::.bucket.meta.myfoo%3a475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a621a2490 con 0x556a62146660 2024-09-10T05:36:57.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.631+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.1 v2:172.21.15.62:6808/3442097179 47 ==== osd_op_reply(153 .bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5 [call,call,delete] v32'2 uv2 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a62146660 2024-09-10T05:36:57.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.631+0000 7f1ffba3b9c0 10 removing default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5 from cache 2024-09-10T05:36:57.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.631+0000 7f1ffba3b9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5, ofs0, ns] 2024-09-10T05:36:57.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.631+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:154 7.3 7:c609908c:::notify.5:head [notify cookie 93915401156544 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a6218bb90 con 0x556a6214e330 2024-09-10T05:36:57.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.635+0000 7f1ff8d40640 1 -- 172.21.15.62:0/1742700786 <== osd.3 v2:172.21.15.62:6816/2708991149 36 ==== watch-notify(notify (1) cookie 93915400472992 notify 137438953496 ret 0) ==== 248+0+0 (crc 0 0 0) 0x556a62166cb0 con 0x556a6214e330 2024-09-10T05:36:57.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.635+0000 7f1ecffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953496 cookie 93915400472992 notifier 4647 bl.length()=206 2024-09-10T05:36:57.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.635+0000 7f1ff8d40640 1 -- 172.21.15.62:0/1742700786 <== osd.3 v2:172.21.15.62:6816/2708991149 37 ==== osd_op_reply(154 notify.5 [notify cookie 93915401156544 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1ff00a9a10 con 0x556a6214e330 2024-09-10T05:36:57.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.635+0000 7f1ecffff640 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:155 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f1e200032d0 con 0x556a6214e330 2024-09-10T05:36:57.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.635+0000 7f1ff8d40640 1 -- 172.21.15.62:0/1742700786 <== osd.3 v2:172.21.15.62:6816/2708991149 38 ==== osd_op_reply(155 notify.5 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff00a9a10 con 0x556a6214e330 2024-09-10T05:36:57.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.635+0000 7f1ff8d40640 1 -- 172.21.15.62:0/1742700786 <== osd.3 v2:172.21.15.62:6816/2708991149 39 ==== watch-notify(notify_complete (2) cookie 93915401156544 notify 137438953496 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556a6215f1b0 con 0x556a6214e330 2024-09-10T05:36:57.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.635+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:156 4.11 4:8810721d:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a62184480 con 0x556a6214e330 2024-09-10T05:36:57.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.635+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:157 4.1f 4:fa475d23:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a62201260 con 0x556a6214ab10 2024-09-10T05:36:57.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.635+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:158 4.24 4:254c81ab:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a6219fcd0 con 0x556a62146660 2024-09-10T05:36:57.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.635+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:159 4.3b 4:dd1ca53c:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a621a0790 con 0x7f1ff406f020 2024-09-10T05:36:57.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.635+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:160 4.25 4:a7bdbd98:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a621a0b30 con 0x556a6214ab10 2024-09-10T05:36:57.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.635+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:161 4.36 4:6d9fa226:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a62201260 con 0x556a62146660 2024-09-10T05:36:57.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.635+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:162 4.33 4:cd2ae51e:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a6219fcd0 con 0x7f1ff406f020 2024-09-10T05:36:57.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.635+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:163 4.36 4:6e3528e2:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a621a0790 con 0x556a62146660 2024-09-10T05:36:57.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.635+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:164 4.2a 4:56a29d61:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a621633c0 con 0x556a62146660 2024-09-10T05:36:57.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.635+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:165 4.39 4:9c74e037:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a6219fcd0 con 0x556a6214e330 2024-09-10T05:36:57.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.635+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:166 4.33 4:cc33a53a:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a62201260 con 0x7f1ff406f020 2024-09-10T05:36:57.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.635+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.1 v2:172.21.15.62:6808/3442097179 48 ==== osd_op_reply(158 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.2 [delete] v32'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a62146660 2024-09-10T05:36:57.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.639+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.2 v2:172.21.15.62:6800/2677868286 33 ==== osd_op_reply(162 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.6 [delete] v32'21 uv21 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f1fec0083f0 con 0x7f1ff406f020 2024-09-10T05:36:57.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.639+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.1 v2:172.21.15.62:6808/3442097179 49 ==== osd_op_reply(161 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.5 [delete] v32'3 uv3 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a62146660 2024-09-10T05:36:57.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.639+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.2 v2:172.21.15.62:6800/2677868286 34 ==== osd_op_reply(166 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.10 [delete] v32'22 uv22 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f1fec0083f0 con 0x7f1ff406f020 2024-09-10T05:36:57.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.639+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 <== osd.0 v2:172.21.15.2:6800/945139080 42 ==== osd_op_reply(160 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.4 [delete] v32'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f1ff4063040 con 0x556a6214ab10 2024-09-10T05:36:57.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.639+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 <== osd.0 v2:172.21.15.2:6800/945139080 43 ==== osd_op_reply(157 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.1 [delete] v32'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f1ff4063040 con 0x556a6214ab10 2024-09-10T05:36:57.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.639+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.2 v2:172.21.15.62:6800/2677868286 35 ==== osd_op_reply(159 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.3 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f1fec0083f0 con 0x7f1ff406f020 2024-09-10T05:36:57.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.639+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.1 v2:172.21.15.62:6808/3442097179 50 ==== osd_op_reply(164 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.8 [delete] v32'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a62146660 2024-09-10T05:36:57.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.639+0000 7f1ff8d40640 1 -- 172.21.15.62:0/1742700786 <== osd.3 v2:172.21.15.62:6816/2708991149 40 ==== osd_op_reply(156 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.0 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f1ff00a9a10 con 0x556a6214e330 2024-09-10T05:36:57.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.639+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.1 v2:172.21.15.62:6808/3442097179 51 ==== osd_op_reply(163 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.7 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a62146660 2024-09-10T05:36:57.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.639+0000 7f1ff8d40640 1 -- 172.21.15.62:0/1742700786 <== osd.3 v2:172.21.15.62:6816/2708991149 41 ==== osd_op_reply(165 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5.9 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f1ff00a9a10 con 0x556a6214e330 2024-09-10T05:36:57.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.639+0000 7f1ffba3b9c0 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5 : miss 2024-09-10T05:36:57.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.639+0000 7f1ffba3b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:57.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.639+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:167 6.e 6:75fb10a8:::pubsub..bucket.myfoo%2f475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a621a0790 con 0x556a6214ab10 2024-09-10T05:36:57.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.639+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 <== osd.0 v2:172.21.15.2:6800/945139080 44 ==== osd_op_reply(167 pubsub..bucket.myfoo/475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f1ff4063040 con 0x556a6214ab10 2024-09-10T05:36:57.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.639+0000 7f1ffba3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:57.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.639+0000 7f1ffba3b9c0 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5 info.flags=0x0 2024-09-10T05:36:57.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.639+0000 7f1ffba3b9c0 10 adding default.rgw.log++pubsub..bucket.myfoo/475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5 to cache LRU end 2024-09-10T05:36:57.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.639+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:168 6.e 6:75fb10a8:::pubsub..bucket.myfoo%2f475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a621ff7c0 con 0x556a6214ab10 2024-09-10T05:36:57.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.639+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 <== osd.0 v2:172.21.15.2:6800/945139080 45 ==== osd_op_reply(168 pubsub..bucket.myfoo/475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5 [delete] v32'35 uv31 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f1ff4063040 con 0x556a6214ab10 2024-09-10T05:36:57.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.643+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:169 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a621ff7c0 con 0x7f1ff406f020 2024-09-10T05:36:57.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.643+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.2 v2:172.21.15.62:6800/2677868286 36 ==== osd_op_reply(169 foo.buckets [call] v32'39 uv39 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f1fec0083f0 con 0x7f1ff406f020 2024-09-10T05:36:57.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.643+0000 7f1eaffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:57.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.643+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:170 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93915400465728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a621ff7c0 con 0x556a62146660 2024-09-10T05:36:57.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.647+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.1 v2:172.21.15.62:6808/3442097179 52 ==== osd_op_reply(170 data_loggenerations_metadata [watch unwatch cookie 93915400465728] v32'192 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a62146660 2024-09-10T05:36:57.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.647+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:171 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93915400457200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a62156d40 con 0x556a6214ab10 2024-09-10T05:36:57.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.647+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 <== osd.0 v2:172.21.15.2:6800/945139080 46 ==== osd_op_reply(171 notify.0 [watch unwatch cookie 93915400457200] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff4063040 con 0x556a6214ab10 2024-09-10T05:36:57.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.647+0000 7f1ffba3b9c0 20 remove_watcher() i=0 2024-09-10T05:36:57.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.647+0000 7f1ffba3b9c0 2 removed watcher, disabling cache 2024-09-10T05:36:57.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.647+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93915400461104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a62156d40 con 0x556a62146660 2024-09-10T05:36:57.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.651+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.1 v2:172.21.15.62:6808/3442097179 53 ==== osd_op_reply(172 notify.1 [watch unwatch cookie 93915400461104] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fec0083f0 con 0x556a62146660 2024-09-10T05:36:57.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.651+0000 7f1ffba3b9c0 20 remove_watcher() i=1 2024-09-10T05:36:57.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.651+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:173 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93915400454672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a62156d40 con 0x556a6214ab10 2024-09-10T05:36:57.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.651+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 <== osd.0 v2:172.21.15.2:6800/945139080 47 ==== osd_op_reply(173 notify.2 [watch unwatch cookie 93915400454672] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff4063040 con 0x556a6214ab10 2024-09-10T05:36:57.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.651+0000 7f1ffba3b9c0 20 remove_watcher() i=2 2024-09-10T05:36:57.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.651+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:174 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93915400468000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a62154210 con 0x7f1ff406f020 2024-09-10T05:36:57.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.655+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.2 v2:172.21.15.62:6800/2677868286 37 ==== osd_op_reply(174 notify.3 [watch unwatch cookie 93915400468000] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fec0083f0 con 0x7f1ff406f020 2024-09-10T05:36:57.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.655+0000 7f1ffba3b9c0 20 remove_watcher() i=3 2024-09-10T05:36:57.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.655+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:175 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93915400469056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a62157620 con 0x556a6214ab10 2024-09-10T05:36:57.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.655+0000 7f1ff9541640 1 -- 172.21.15.62:0/1742700786 <== osd.0 v2:172.21.15.2:6800/945139080 48 ==== osd_op_reply(175 notify.4 [watch unwatch cookie 93915400469056] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff4063040 con 0x556a6214ab10 2024-09-10T05:36:57.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.655+0000 7f1ffba3b9c0 20 remove_watcher() i=4 2024-09-10T05:36:57.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.655+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:176 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93915400472992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a62156d40 con 0x556a6214e330 2024-09-10T05:36:57.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.659+0000 7f1ff8d40640 1 -- 172.21.15.62:0/1742700786 <== osd.3 v2:172.21.15.62:6816/2708991149 42 ==== osd_op_reply(176 notify.5 [watch unwatch cookie 93915400472992] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff00a9a10 con 0x556a6214e330 2024-09-10T05:36:57.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.659+0000 7f1ffba3b9c0 20 remove_watcher() i=5 2024-09-10T05:36:57.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.659+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:177 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93915400474048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a621589a0 con 0x556a6214e330 2024-09-10T05:36:57.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.659+0000 7f1ff8d40640 1 -- 172.21.15.62:0/1742700786 <== osd.3 v2:172.21.15.62:6816/2708991149 43 ==== osd_op_reply(177 notify.6 [watch unwatch cookie 93915400474048] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff00a9a10 con 0x556a6214e330 2024-09-10T05:36:57.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.659+0000 7f1ffba3b9c0 20 remove_watcher() i=6 2024-09-10T05:36:57.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.659+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:178 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93915400477824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a62156d40 con 0x7f1ff406f020 2024-09-10T05:36:57.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.659+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 <== osd.2 v2:172.21.15.62:6800/2677868286 38 ==== osd_op_reply(178 notify.7 [watch unwatch cookie 93915400477824] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fec0083f0 con 0x7f1ff406f020 2024-09-10T05:36:57.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.659+0000 7f1ffba3b9c0 20 remove_watcher() i=7 2024-09-10T05:36:57.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.659+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x556a6214ab10 msgr2=0x556a6214cf00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.659+0000 7f1ffba3b9c0 1 --2- 172.21.15.62:0/1742700786 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x556a6214ab10 0x556a6214cf00 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.659+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x556a62146660 msgr2=0x556a62148b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.659+0000 7f1ffba3b9c0 1 --2- 172.21.15.62:0/1742700786 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x556a62146660 0x556a62148b20 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.659+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f1ff406f020 msgr2=0x7f1ff404f830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.659+0000 7f1ffba3b9c0 1 --2- 172.21.15.62:0/1742700786 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f1ff406f020 0x7f1ff404f830 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.659+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x556a6214e330 msgr2=0x556a62150720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.659+0000 7f1ffba3b9c0 1 --2- 172.21.15.62:0/1742700786 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x556a6214e330 0x556a62150720 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.659+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1ec4039a20 msgr2=0x7f1ec403bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.659+0000 7f1ffba3b9c0 1 --2- 172.21.15.62:0/1742700786 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1ec4039a20 0x7f1ec403bee0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1ff00a9fd0 tx=0x7f1ff00c1040 comp rx=0 tx=0).stop 2024-09-10T05:36:57.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.659+0000 7f1ff9d42640 1 -- 172.21.15.62:0/1742700786 reap_dead start 2024-09-10T05:36:57.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.659+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556a62135450 msgr2=0x556a6213b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.659+0000 7f1ffba3b9c0 1 --2- 172.21.15.62:0/1742700786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556a62135450 0x556a6213b730 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4012fd0 tx=0x7f1ff404f6e0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.659+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 shutdown_connections 2024-09-10T05:36:57.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.659+0000 7f1ffba3b9c0 1 --2- 172.21.15.62:0/1742700786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556a62135450 0x556a6213b730 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.659+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 >> 172.21.15.62:0/1742700786 conn(0x556a62130810 msgr2=0x556a6212ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:57.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.659+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 shutdown_connections 2024-09-10T05:36:57.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.659+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/1742700786 wait complete. 2024-09-10T05:36:57.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.663+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/883825845 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1ed0039a70 msgr2=0x7f1ed003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.663+0000 7f1ffba3b9c0 1 --2- 172.21.15.62:0/883825845 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1ed0039a70 0x7f1ed003bf30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x556a62111a00 tx=0x7f1ff0005ad0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.663+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/883825845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556a62127c60 msgr2=0x556a62128080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.663+0000 7f1ffba3b9c0 1 --2- 172.21.15.62:0/883825845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556a62127c60 0x556a62128080 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f1ff404e890 tx=0x7f1ff4003f60 comp rx=0 tx=0).stop 2024-09-10T05:36:57.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.663+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/883825845 shutdown_connections 2024-09-10T05:36:57.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.663+0000 7f1ffba3b9c0 1 --2- 172.21.15.62:0/883825845 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1ed0039a70 0x7f1ed003bf30 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.663+0000 7f1ffba3b9c0 1 --2- 172.21.15.62:0/883825845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556a62127c60 0x556a62128080 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.663+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/883825845 >> 172.21.15.62:0/883825845 conn(0x556a6211d610 msgr2=0x556a6211d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:57.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.663+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/883825845 shutdown_connections 2024-09-10T05:36:57.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.663+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/883825845 wait complete. 2024-09-10T05:36:57.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.663+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/3097235689 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x556a62112160 msgr2=0x556a62114620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.663+0000 7f1ffba3b9c0 1 --2- 172.21.15.62:0/3097235689 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x556a62112160 0x556a62114620 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.663+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/3097235689 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x556a6201b340 msgr2=0x556a62111120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.663+0000 7f1ffba3b9c0 1 --2- 172.21.15.62:0/3097235689 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x556a6201b340 0x556a62111120 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.663+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/3097235689 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x556a62116b50 msgr2=0x556a62118f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.663+0000 7f1ffba3b9c0 1 --2- 172.21.15.62:0/3097235689 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x556a62116b50 0x556a62118f40 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.663+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/3097235689 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1ee0039ac0 msgr2=0x7f1ee003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.663+0000 7f1ffba3b9c0 1 --2- 172.21.15.62:0/3097235689 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1ee0039ac0 0x7f1ee003bf80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1ff00ad000 tx=0x7f1ff00a6000 comp rx=0 tx=0).stop 2024-09-10T05:36:57.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.663+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/3097235689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556a620171f0 msgr2=0x556a62109fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.663+0000 7f1ffba3b9c0 1 --2- 172.21.15.62:0/3097235689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556a620171f0 0x556a62109fb0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x556a62103870 tx=0x7f1ff4000f50 comp rx=0 tx=0).stop 2024-09-10T05:36:57.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.663+0000 7f1ff9d42640 1 -- 172.21.15.62:0/3097235689 reap_dead start 2024-09-10T05:36:57.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.663+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/3097235689 shutdown_connections 2024-09-10T05:36:57.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.663+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/3097235689 >> 172.21.15.62:0/3097235689 conn(0x556a61f8ab00 msgr2=0x556a620fcfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:57.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.663+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/3097235689 shutdown_connections 2024-09-10T05:36:57.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.663+0000 7f1ffba3b9c0 1 -- 172.21.15.62:0/3097235689 wait complete. 2024-09-10T05:36:57.680 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-10T05:36:57.680 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-10T05:36:57.680 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2024-09-10T05:36:57.759 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:57.759 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:57.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.755+0000 7f380ef1c9c0 1 Processor -- start 2024-09-10T05:36:57.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.755+0000 7f380ef1c9c0 1 -- start start 2024-09-10T05:36:57.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.759+0000 7f380ef1c9c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5581bbd131f0 0x5581bbd135d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.759+0000 7f380ef1c9c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5581bbbc59c0 con 0x5581bbd16330 2024-09-10T05:36:57.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.759+0000 7f380ef1c9c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x5581bbc156d0 con 0x5581bbd131f0 2024-09-10T05:36:57.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.759+0000 7f380ca22640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5581bbd131f0 0x5581bbd135d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.759+0000 7f380c221640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x5581bbd16330 0x5581bbd18720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:58388/0 (socket says 172.21.15.62:58388) 2024-09-10T05:36:57.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.759+0000 7f380c221640 1 -- 172.21.15.62:0/896911983 learned_addr learned my addr 172.21.15.62:0/896911983 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-10T05:36:57.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.759+0000 7f380ca22640 1 -- 172.21.15.62:0/896911983 >> v1:172.21.15.2:6789/0 conn(0x5581bbd16330 legacy=0x5581bbd18720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.759+0000 7f380ba20640 1 -- 172.21.15.62:0/896911983 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3105916341 0 0) 0x5581bbbc59c0 con 0x5581bbd16330 2024-09-10T05:36:57.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.759+0000 7f380ca22640 1 -- 172.21.15.62:0/896911983 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581bbbb9ca0 con 0x5581bbd131f0 2024-09-10T05:36:57.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.763+0000 7f380ca22640 1 --2- 172.21.15.62:0/896911983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5581bbd131f0 0x5581bbd135d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f37f400a480 tx=0x7f37f401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cc9a7c38342af server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.763+0000 7f380ba20640 1 -- 172.21.15.62:0/896911983 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37f40b0070 con 0x5581bbd131f0 2024-09-10T05:36:57.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.763+0000 7f380ba20640 1 -- 172.21.15.62:0/896911983 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37f40ab540 con 0x5581bbd131f0 2024-09-10T05:36:57.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.763+0000 7f380ba20640 1 -- 172.21.15.62:0/896911983 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37f40ab840 con 0x5581bbd131f0 2024-09-10T05:36:57.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.763+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/896911983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5581bbd131f0 msgr2=0x5581bbd135d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.763+0000 7f380ef1c9c0 1 --2- 172.21.15.62:0/896911983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5581bbd131f0 0x5581bbd135d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f37f400a480 tx=0x7f37f401b280 comp rx=0 tx=0).stop 2024-09-10T05:36:57.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.763+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/896911983 shutdown_connections 2024-09-10T05:36:57.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.763+0000 7f380ef1c9c0 1 --2- 172.21.15.62:0/896911983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5581bbd131f0 0x5581bbd135d0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.763+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/896911983 >> 172.21.15.62:0/896911983 conn(0x5581bbc86b00 msgr2=0x5581bbc86f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:57.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.763+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/896911983 shutdown_connections 2024-09-10T05:36:57.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.763+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/896911983 wait complete. 2024-09-10T05:36:57.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.779+0000 7f380ef1c9c0 1 Processor -- start 2024-09-10T05:36:57.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.779+0000 7f380ef1c9c0 1 -- start start 2024-09-10T05:36:57.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.779+0000 7f380ef1c9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5581bbd131f0 0x5581bbdfe700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.779+0000 7f380ef1c9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5581bbc19680 con 0x5581bbd131f0 2024-09-10T05:36:57.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.779+0000 7f380ca22640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5581bbd131f0 0x5581bbdfe700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.779+0000 7f380ca22640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5581bbd131f0 0x5581bbdfe700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:48150/0 (socket says 172.21.15.62:48150) 2024-09-10T05:36:57.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.779+0000 7f380ca22640 1 -- 172.21.15.62:0/2827863711 learned_addr learned my addr 172.21.15.62:0/2827863711 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:57.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.779+0000 7f380ca22640 1 -- 172.21.15.62:0/2827863711 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581bbb94da0 con 0x5581bbd131f0 2024-09-10T05:36:57.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.783+0000 7f380ca22640 1 --2- 172.21.15.62:0/2827863711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5581bbd131f0 0x5581bbdfe700 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f37f4017e90 tx=0x7f37f4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f30287a88a2a3b9c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.783+0000 7f36fae0d640 1 -- 172.21.15.62:0/2827863711 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37f40bb070 con 0x5581bbd131f0 2024-09-10T05:36:57.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.783+0000 7f36fae0d640 1 -- 172.21.15.62:0/2827863711 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37f400a1f0 con 0x5581bbd131f0 2024-09-10T05:36:57.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.783+0000 7f36fae0d640 1 -- 172.21.15.62:0/2827863711 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37f40b0040 con 0x5581bbd131f0 2024-09-10T05:36:57.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.783+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/2827863711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5581bbd131f0 msgr2=0x5581bbdfe700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.783+0000 7f380ef1c9c0 1 --2- 172.21.15.62:0/2827863711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5581bbd131f0 0x5581bbdfe700 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f37f4017e90 tx=0x7f37f4003030 comp rx=0 tx=0).stop 2024-09-10T05:36:57.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.783+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/2827863711 shutdown_connections 2024-09-10T05:36:57.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.783+0000 7f380ef1c9c0 1 --2- 172.21.15.62:0/2827863711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5581bbd131f0 0x5581bbdfe700 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.783+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/2827863711 >> 172.21.15.62:0/2827863711 conn(0x5581bbc86b00 msgr2=0x5581bbdfa340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:57.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.783+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/2827863711 shutdown_connections 2024-09-10T05:36:57.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.783+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/2827863711 wait complete. 2024-09-10T05:36:57.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.783+0000 7f380ef1c9c0 1 Processor -- start 2024-09-10T05:36:57.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.783+0000 7f380ef1c9c0 1 -- start start 2024-09-10T05:36:57.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.783+0000 7f380ef1c9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5581bbd131f0 0x5581bbe05c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.783+0000 7f380ef1c9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5581bbbbba50 con 0x5581bbd131f0 2024-09-10T05:36:57.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.783+0000 7f380ca22640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5581bbd131f0 0x5581bbe05c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.783+0000 7f380ca22640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5581bbd131f0 0x5581bbe05c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:48160/0 (socket says 172.21.15.62:48160) 2024-09-10T05:36:57.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.783+0000 7f380ca22640 1 -- 172.21.15.62:0/4166473472 learned_addr learned my addr 172.21.15.62:0/4166473472 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:57.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.783+0000 7f380ca22640 1 -- 172.21.15.62:0/4166473472 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581bbe06170 con 0x5581bbd131f0 2024-09-10T05:36:57.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.783+0000 7f380ca22640 1 --2- 172.21.15.62:0/4166473472 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5581bbd131f0 0x5581bbe05c10 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f37f4000c10 tx=0x7f37f4018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.783+0000 7f36f960a640 1 -- 172.21.15.62:0/4166473472 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37f40c4020 con 0x5581bbd131f0 2024-09-10T05:36:57.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.783+0000 7f36f960a640 1 -- 172.21.15.62:0/4166473472 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37f40b6470 con 0x5581bbd131f0 2024-09-10T05:36:57.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.783+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/4166473472 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5581bbe06400 con 0x5581bbd131f0 2024-09-10T05:36:57.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.783+0000 7f36f960a640 1 -- 172.21.15.62:0/4166473472 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37f40b0070 con 0x5581bbd131f0 2024-09-10T05:36:57.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.783+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/4166473472 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581bbe06e30 con 0x5581bbd131f0 2024-09-10T05:36:57.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.787+0000 7f36f960a640 1 -- 172.21.15.62:0/4166473472 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f37f40c0410 con 0x5581bbd131f0 2024-09-10T05:36:57.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.787+0000 7f36f960a640 1 --2- 172.21.15.62:0/4166473472 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f36f4039a70 0x7f36f403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.787+0000 7f36f960a640 1 -- 172.21.15.62:0/4166473472 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7f37f40a8070 con 0x5581bbd131f0 2024-09-10T05:36:57.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.787+0000 7f380c221640 1 --2- 172.21.15.62:0/4166473472 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f36f4039a70 0x7f36f403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.787+0000 7f380ef1c9c0 1 --2- 172.21.15.62:0/4166473472 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5581bbd16330 0x5581bbe0cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.787+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/4166473472 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe0d2c0 con 0x5581bbd16330 2024-09-10T05:36:57.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.787+0000 7f380d223640 1 --2- 172.21.15.62:0/4166473472 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5581bbd16330 0x5581bbe0cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.787+0000 7f380c221640 1 --2- 172.21.15.62:0/4166473472 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f36f4039a70 0x7f36f403bf30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f37fc000f90 tx=0x7f37fc006550 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.787+0000 7f380d223640 1 --2- 172.21.15.62:0/4166473472 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5581bbd16330 0x5581bbe0cd80 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.787+0000 7f380d223640 1 -- 172.21.15.62:0/4166473472 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f38040083f0 con 0x5581bbd16330 2024-09-10T05:36:57.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.787+0000 7f380ef1c9c0 1 --2- 172.21.15.62:0/4166473472 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5581bbe0e070 0x5581bbe10460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.787+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/4166473472 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe10a50 con 0x5581bbe0e070 2024-09-10T05:36:57.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.787+0000 7f380ca22640 1 --2- 172.21.15.62:0/4166473472 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5581bbe0e070 0x5581bbe10460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.787+0000 7f380ca22640 1 --2- 172.21.15.62:0/4166473472 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5581bbe0e070 0x5581bbe10460 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.791+0000 7f380ca22640 1 -- 172.21.15.62:0/4166473472 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f37f40c6020 con 0x5581bbe0e070 2024-09-10T05:36:57.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.791+0000 7f380ef1c9c0 1 --2- 172.21.15.62:0/4166473472 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5581bbe12810 0x5581bbe14c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.791+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/4166473472 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe152d0 con 0x5581bbe12810 2024-09-10T05:36:57.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.791+0000 7f380c221640 1 --2- 172.21.15.62:0/4166473472 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5581bbe12810 0x5581bbe14c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.791+0000 7f380c221640 1 --2- 172.21.15.62:0/4166473472 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5581bbe12810 0x5581bbe14c00 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.791+0000 7f380c221640 1 -- 172.21.15.62:0/4166473472 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f37fc00f070 con 0x5581bbe12810 2024-09-10T05:36:57.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.791+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/4166473472 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe116b0 con 0x5581bbe0e070 2024-09-10T05:36:57.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.791+0000 7f380ca22640 1 -- 172.21.15.62:0/4166473472 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f37f40c6020 con 0x5581bbe0e070 2024-09-10T05:36:57.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.791+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/4166473472 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe11b10 con 0x5581bbe12810 2024-09-10T05:36:57.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.791+0000 7f380c221640 1 -- 172.21.15.62:0/4166473472 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f37fc00f070 con 0x5581bbe12810 2024-09-10T05:36:57.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.791+0000 7f380ef1c9c0 1 Processor -- start 2024-09-10T05:36:57.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.791+0000 7f380ef1c9c0 1 -- start start 2024-09-10T05:36:57.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.791+0000 7f380ef1c9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5581bbe23980 0x5581bbe23da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.791+0000 7f380ef1c9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5581bbc26450 con 0x5581bbe23980 2024-09-10T05:36:57.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.791+0000 7f380ca22640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5581bbe23980 0x5581bbe23da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.791+0000 7f380ca22640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5581bbe23980 0x5581bbe23da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:48164/0 (socket says 172.21.15.62:48164) 2024-09-10T05:36:57.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.791+0000 7f380ca22640 1 -- 172.21.15.62:0/4066343877 learned_addr learned my addr 172.21.15.62:0/4066343877 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:57.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.791+0000 7f380ca22640 1 -- 172.21.15.62:0/4066343877 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581bbe243e0 con 0x5581bbe23980 2024-09-10T05:36:57.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.795+0000 7f380ca22640 1 --2- 172.21.15.62:0/4066343877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5581bbe23980 0x5581bbe23da0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f37f40c9fd0 tx=0x7f37f40bf740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.795+0000 7f36f27fc640 1 -- 172.21.15.62:0/4066343877 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37f40e3040 con 0x5581bbe23980 2024-09-10T05:36:57.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.795+0000 7f36f27fc640 1 -- 172.21.15.62:0/4066343877 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37f40e4040 con 0x5581bbe23980 2024-09-10T05:36:57.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.795+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/4066343877 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5581bbe24c40 con 0x5581bbe23980 2024-09-10T05:36:57.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.795+0000 7f36f27fc640 1 -- 172.21.15.62:0/4066343877 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37f40aa3b0 con 0x5581bbe23980 2024-09-10T05:36:57.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.795+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/4066343877 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581bbe251b0 con 0x5581bbe23980 2024-09-10T05:36:57.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.795+0000 7f36f27fc640 1 -- 172.21.15.62:0/4066343877 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f37f40aa550 con 0x5581bbe23980 2024-09-10T05:36:57.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.795+0000 7f36f27fc640 1 --2- 172.21.15.62:0/4066343877 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f36e4039ac0 0x7f36e403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.795+0000 7f36f27fc640 1 -- 172.21.15.62:0/4066343877 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7f37f40dfbc0 con 0x5581bbe23980 2024-09-10T05:36:57.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.795+0000 7f380c221640 1 --2- 172.21.15.62:0/4066343877 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f36e4039ac0 0x7f36e403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.795+0000 7f380ef1c9c0 1 Processor -- start 2024-09-10T05:36:57.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.795+0000 7f380ef1c9c0 1 -- start start 2024-09-10T05:36:57.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.795+0000 7f380c221640 1 --2- 172.21.15.62:0/4066343877 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f36e4039ac0 0x7f36e403bf80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x5581bbe070d0 tx=0x7f37fc00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.795+0000 7f380ef1c9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5581bbe300a0 0x5581bbe30480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.795+0000 7f380ef1c9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5581bbdfee90 con 0x5581bbe300a0 2024-09-10T05:36:57.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.795+0000 7f380ca22640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5581bbe300a0 0x5581bbe30480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.795+0000 7f380ca22640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5581bbe300a0 0x5581bbe30480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:48170/0 (socket says 172.21.15.62:48170) 2024-09-10T05:36:57.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.795+0000 7f380ca22640 1 -- 172.21.15.62:0/3705850426 learned_addr learned my addr 172.21.15.62:0/3705850426 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:57.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.795+0000 7f380ca22640 1 -- 172.21.15.62:0/3705850426 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581bbe30a50 con 0x5581bbe300a0 2024-09-10T05:36:57.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.795+0000 7f380ca22640 1 --2- 172.21.15.62:0/3705850426 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5581bbe300a0 0x5581bbe30480 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f37f40c8ff0 tx=0x7f37f40c7310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a24ffb5fd8e7644 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.799+0000 7f36e3fff640 1 -- 172.21.15.62:0/3705850426 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37f40aedf0 con 0x5581bbe300a0 2024-09-10T05:36:57.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.799+0000 7f36e3fff640 1 -- 172.21.15.62:0/3705850426 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37f40aa840 con 0x5581bbe300a0 2024-09-10T05:36:57.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.799+0000 7f36e3fff640 1 -- 172.21.15.62:0/3705850426 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37f40e1b40 con 0x5581bbe300a0 2024-09-10T05:36:57.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.799+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3705850426 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5581bbe300a0 msgr2=0x5581bbe30480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.799+0000 7f380ef1c9c0 1 --2- 172.21.15.62:0/3705850426 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5581bbe300a0 0x5581bbe30480 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f37f40c8ff0 tx=0x7f37f40c7310 comp rx=0 tx=0).stop 2024-09-10T05:36:57.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.799+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3705850426 shutdown_connections 2024-09-10T05:36:57.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.799+0000 7f380ef1c9c0 1 --2- 172.21.15.62:0/3705850426 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5581bbe300a0 0x5581bbe30480 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.799+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3705850426 >> 172.21.15.62:0/3705850426 conn(0x5581bbe2c4d0 msgr2=0x5581bbe2a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:57.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.799+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3705850426 shutdown_connections 2024-09-10T05:36:57.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.799+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3705850426 wait complete. 2024-09-10T05:36:57.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.799+0000 7f380ef1c9c0 1 Processor -- start 2024-09-10T05:36:57.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.799+0000 7f380ef1c9c0 1 -- start start 2024-09-10T05:36:57.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.799+0000 7f380ef1c9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5581bbe300a0 0x5581bbe373e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.799+0000 7f380ef1c9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5581bbe30f30 con 0x5581bbe300a0 2024-09-10T05:36:57.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.799+0000 7f380ca22640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5581bbe300a0 0x5581bbe373e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.799+0000 7f380ca22640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5581bbe300a0 0x5581bbe373e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:48184/0 (socket says 172.21.15.62:48184) 2024-09-10T05:36:57.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.799+0000 7f380ca22640 1 -- 172.21.15.62:0/3362651513 learned_addr learned my addr 172.21.15.62:0/3362651513 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:57.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.799+0000 7f380ca22640 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581bbe37940 con 0x5581bbe300a0 2024-09-10T05:36:57.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.799+0000 7f380ca22640 1 --2- 172.21.15.62:0/3362651513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5581bbe300a0 0x5581bbe373e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f37f40c8ff0 tx=0x7f37f40e0ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.799+0000 7f36e27fc640 1 -- 172.21.15.62:0/3362651513 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37f40b5750 con 0x5581bbe300a0 2024-09-10T05:36:57.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.799+0000 7f36e27fc640 1 -- 172.21.15.62:0/3362651513 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37f4109030 con 0x5581bbe300a0 2024-09-10T05:36:57.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.799+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5581bbe37940 con 0x5581bbe300a0 2024-09-10T05:36:57.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.799+0000 7f36e27fc640 1 -- 172.21.15.62:0/3362651513 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37f40b5a20 con 0x5581bbe300a0 2024-09-10T05:36:57.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.799+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581bbe37940 con 0x5581bbe300a0 2024-09-10T05:36:57.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.803+0000 7f36e27fc640 1 -- 172.21.15.62:0/3362651513 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f37f40c8710 con 0x5581bbe300a0 2024-09-10T05:36:57.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.803+0000 7f36e27fc640 1 --2- 172.21.15.62:0/3362651513 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f36d8039a70 0x7f36d803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.803+0000 7f36e27fc640 1 -- 172.21.15.62:0/3362651513 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7f37f410fbf0 con 0x5581bbe300a0 2024-09-10T05:36:57.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.803+0000 7f380c221640 1 --2- 172.21.15.62:0/3362651513 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f36d8039a70 0x7f36d803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.803+0000 7f380ef1c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:57.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.803+0000 7f380ef1c9c0 1 --2- 172.21.15.62:0/3362651513 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5581bbe42190 0x5581bbe44650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.803+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe44da0 con 0x5581bbe42190 2024-09-10T05:36:57.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.803+0000 7f380d223640 1 --2- 172.21.15.62:0/3362651513 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5581bbe42190 0x5581bbe44650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.803+0000 7f380c221640 1 --2- 172.21.15.62:0/3362651513 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f36d8039a70 0x7f36d803bf30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f37fc006300 tx=0x7f37fc025000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.803+0000 7f380d223640 1 --2- 172.21.15.62:0/3362651513 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5581bbe42190 0x5581bbe44650 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.803+0000 7f380d223640 1 -- 172.21.15.62:0/3362651513 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f38040083f0 con 0x5581bbe42190 2024-09-10T05:36:57.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.803+0000 7f380ef1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:57.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.803+0000 7f380ef1c9c0 20 realm 2024-09-10T05:36:57.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.803+0000 7f380ef1c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:57.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.803+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe414c0 con 0x5581bbe42190 2024-09-10T05:36:57.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.803+0000 7f380d223640 1 -- 172.21.15.62:0/3362651513 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f38040083f0 con 0x5581bbe42190 2024-09-10T05:36:57.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.803+0000 7f380ef1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:57.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.803+0000 7f380ef1c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:57.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.803+0000 7f380ef1c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:57.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.803+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe45860 con 0x5581bbe42190 2024-09-10T05:36:57.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.803+0000 7f380d223640 1 -- 172.21.15.62:0/3362651513 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f38040083f0 con 0x5581bbe42190 2024-09-10T05:36:57.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.803+0000 7f380ef1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:57.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.803+0000 7f380ef1c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:57.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.803+0000 7f380ef1c9c0 1 --2- 172.21.15.62:0/3362651513 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5581bbe46640 0x5581bbe48a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.803+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe49100 con 0x5581bbe46640 2024-09-10T05:36:57.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.803+0000 7f380ca22640 1 --2- 172.21.15.62:0/3362651513 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5581bbe46640 0x5581bbe48a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.803+0000 7f380ca22640 1 --2- 172.21.15.62:0/3362651513 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5581bbe46640 0x5581bbe48a30 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.807+0000 7f380ca22640 1 -- 172.21.15.62:0/3362651513 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f37f4115070 con 0x5581bbe46640 2024-09-10T05:36:57.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.807+0000 7f380ef1c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:57.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.807+0000 7f380ef1c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:57.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.807+0000 7f380ef1c9c0 1 --2- 172.21.15.62:0/3362651513 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5581bbe49e60 0x5581bbe4c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.807+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe4ca00 con 0x5581bbe49e60 2024-09-10T05:36:57.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.807+0000 7f380c221640 1 --2- 172.21.15.62:0/3362651513 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5581bbe49e60 0x5581bbe4c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.807+0000 7f380c221640 1 --2- 172.21.15.62:0/3362651513 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5581bbe49e60 0x5581bbe4c270 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.807+0000 7f380c221640 1 -- 172.21.15.62:0/3362651513 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f37fc02d040 con 0x5581bbe49e60 2024-09-10T05:36:57.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.807+0000 7f380ef1c9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:57.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.807+0000 7f380ef1c9c0 20 searching for the correct realm 2024-09-10T05:36:57.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.807+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe4e2d0 con 0x5581bbe49e60 2024-09-10T05:36:57.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.807+0000 7f380c221640 1 -- 172.21.15.62:0/3362651513 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37fc02d040 con 0x5581bbe49e60 2024-09-10T05:36:57.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.807+0000 7f380c221640 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe4e2d0 con 0x5581bbe46640 2024-09-10T05:36:57.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.807+0000 7f380ca22640 1 -- 172.21.15.62:0/3362651513 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37f4115070 con 0x5581bbe46640 2024-09-10T05:36:57.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.807+0000 7f380ca22640 1 --2- 172.21.15.62:0/3362651513 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f37f40c9020 0x7f37f40ea8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.807+0000 7f380ca22640 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe4e2d0 con 0x7f37f40c9020 2024-09-10T05:36:57.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.807+0000 7f380d223640 1 --2- 172.21.15.62:0/3362651513 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f37f40c9020 0x7f37f40ea8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.807+0000 7f380d223640 1 --2- 172.21.15.62:0/3362651513 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f37f40c9020 0x7f37f40ea8a0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.807+0000 7f380d223640 1 -- 172.21.15.62:0/3362651513 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38040083f0 con 0x7f37f40c9020 2024-09-10T05:36:57.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.807+0000 7f380d223640 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe4e2d0 con 0x5581bbe42190 2024-09-10T05:36:57.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.807+0000 7f380d223640 1 -- 172.21.15.62:0/3362651513 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38040083f0 con 0x5581bbe42190 2024-09-10T05:36:57.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.807+0000 7f380d223640 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe4e2d0 con 0x5581bbe42190 2024-09-10T05:36:57.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.807+0000 7f380d223640 1 -- 172.21.15.62:0/3362651513 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38040083f0 con 0x5581bbe42190 2024-09-10T05:36:57.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.807+0000 7f380d223640 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe4e2d0 con 0x5581bbe49e60 2024-09-10T05:36:57.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.811+0000 7f380c221640 1 -- 172.21.15.62:0/3362651513 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37fc02d040 con 0x5581bbe49e60 2024-09-10T05:36:57.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.811+0000 7f380c221640 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe4e2d0 con 0x5581bbe42190 2024-09-10T05:36:57.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.811+0000 7f380d223640 1 -- 172.21.15.62:0/3362651513 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38040083f0 con 0x5581bbe42190 2024-09-10T05:36:57.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.811+0000 7f380d223640 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe4e2d0 con 0x5581bbe46640 2024-09-10T05:36:57.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.811+0000 7f380ca22640 1 -- 172.21.15.62:0/3362651513 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37f4115070 con 0x5581bbe46640 2024-09-10T05:36:57.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.811+0000 7f380ca22640 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe4e2d0 con 0x5581bbe46640 2024-09-10T05:36:57.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.811+0000 7f380ca22640 1 -- 172.21.15.62:0/3362651513 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37f4115070 con 0x5581bbe46640 2024-09-10T05:36:57.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.811+0000 7f380ca22640 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe4e2d0 con 0x5581bbe42190 2024-09-10T05:36:57.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.811+0000 7f380d223640 1 -- 172.21.15.62:0/3362651513 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38040083f0 con 0x5581bbe42190 2024-09-10T05:36:57.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.811+0000 7f380d223640 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe4e2d0 con 0x7f37f40c9020 2024-09-10T05:36:57.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.811+0000 7f380d223640 1 -- 172.21.15.62:0/3362651513 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38040083f0 con 0x7f37f40c9020 2024-09-10T05:36:57.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.811+0000 7f380d223640 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe4e2d0 con 0x5581bbe42190 2024-09-10T05:36:57.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.811+0000 7f380d223640 1 -- 172.21.15.62:0/3362651513 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38040083f0 con 0x5581bbe42190 2024-09-10T05:36:57.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.811+0000 7f380d223640 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe4e2d0 con 0x7f37f40c9020 2024-09-10T05:36:57.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.811+0000 7f380d223640 1 -- 172.21.15.62:0/3362651513 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f38040083f0 con 0x7f37f40c9020 2024-09-10T05:36:57.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.811+0000 7f380d223640 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe4e2d0 con 0x5581bbe46640 2024-09-10T05:36:57.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.811+0000 7f380ca22640 1 -- 172.21.15.62:0/3362651513 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37f4115070 con 0x5581bbe46640 2024-09-10T05:36:57.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.811+0000 7f380ca22640 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe4e2d0 con 0x5581bbe49e60 2024-09-10T05:36:57.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.815+0000 7f380c221640 1 -- 172.21.15.62:0/3362651513 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37fc02d040 con 0x5581bbe49e60 2024-09-10T05:36:57.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.815+0000 7f380c221640 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe4e2d0 con 0x5581bbe42190 2024-09-10T05:36:57.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.815+0000 7f380d223640 1 -- 172.21.15.62:0/3362651513 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38040083f0 con 0x5581bbe42190 2024-09-10T05:36:57.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.815+0000 7f380d223640 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe4e2d0 con 0x5581bbe46640 2024-09-10T05:36:57.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.815+0000 7f380ca22640 1 -- 172.21.15.62:0/3362651513 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37f4115070 con 0x5581bbe46640 2024-09-10T05:36:57.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.815+0000 7f380ca22640 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe4e2d0 con 0x5581bbe49e60 2024-09-10T05:36:57.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.815+0000 7f380c221640 1 -- 172.21.15.62:0/3362651513 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 32 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f37fc02d040 con 0x5581bbe49e60 2024-09-10T05:36:57.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.815+0000 7f380c221640 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe4e2d0 con 0x5581bbe42190 2024-09-10T05:36:57.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.815+0000 7f380d223640 1 -- 172.21.15.62:0/3362651513 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38040083f0 con 0x5581bbe42190 2024-09-10T05:36:57.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.815+0000 7f380d223640 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe4e2d0 con 0x5581bbe42190 2024-09-10T05:36:57.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.815+0000 7f380d223640 1 -- 172.21.15.62:0/3362651513 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f38040083f0 con 0x5581bbe42190 2024-09-10T05:36:57.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.815+0000 7f380d223640 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe4e2d0 con 0x5581bbe42190 2024-09-10T05:36:57.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.815+0000 7f380d223640 1 -- 172.21.15.62:0/3362651513 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38040083f0 con 0x5581bbe42190 2024-09-10T05:36:57.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.815+0000 7f380d223640 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe4e2d0 con 0x5581bbe49e60 2024-09-10T05:36:57.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.815+0000 7f380c221640 1 -- 172.21.15.62:0/3362651513 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37fc02d040 con 0x5581bbe49e60 2024-09-10T05:36:57.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.815+0000 7f380c221640 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe4e2d0 con 0x7f37f40c9020 2024-09-10T05:36:57.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.815+0000 7f380d223640 1 -- 172.21.15.62:0/3362651513 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38040083f0 con 0x7f37f40c9020 2024-09-10T05:36:57.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.815+0000 7f380d223640 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe4e2d0 con 0x5581bbe42190 2024-09-10T05:36:57.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.815+0000 7f380d223640 1 -- 172.21.15.62:0/3362651513 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38040083f0 con 0x5581bbe42190 2024-09-10T05:36:57.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.815+0000 7f380d223640 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe4e2d0 con 0x7f37f40c9020 2024-09-10T05:36:57.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.815+0000 7f380d223640 1 -- 172.21.15.62:0/3362651513 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38040083f0 con 0x7f37f40c9020 2024-09-10T05:36:57.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.815+0000 7f380d223640 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe4e2d0 con 0x5581bbe49e60 2024-09-10T05:36:57.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.815+0000 7f380c221640 1 -- 172.21.15.62:0/3362651513 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37fc02d040 con 0x5581bbe49e60 2024-09-10T05:36:57.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.815+0000 7f380c221640 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe4e2d0 con 0x7f37f40c9020 2024-09-10T05:36:57.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.819+0000 7f380d223640 1 -- 172.21.15.62:0/3362651513 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38040083f0 con 0x7f37f40c9020 2024-09-10T05:36:57.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.819+0000 7f380d223640 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe4e2d0 con 0x5581bbe46640 2024-09-10T05:36:57.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.819+0000 7f380ca22640 1 -- 172.21.15.62:0/3362651513 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37f4115070 con 0x5581bbe46640 2024-09-10T05:36:57.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.819+0000 7f380ca22640 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe4e2d0 con 0x5581bbe46640 2024-09-10T05:36:57.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.819+0000 7f380ca22640 1 -- 172.21.15.62:0/3362651513 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37f4115070 con 0x5581bbe46640 2024-09-10T05:36:57.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.819+0000 7f380ca22640 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe4e2d0 con 0x5581bbe49e60 2024-09-10T05:36:57.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.819+0000 7f380c221640 1 -- 172.21.15.62:0/3362651513 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37fc02d040 con 0x5581bbe49e60 2024-09-10T05:36:57.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.819+0000 7f380c221640 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe4e2d0 con 0x5581bbe46640 2024-09-10T05:36:57.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.819+0000 7f380ca22640 1 -- 172.21.15.62:0/3362651513 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f37f4115070 con 0x5581bbe46640 2024-09-10T05:36:57.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.819+0000 7f380ca22640 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe4e2d0 con 0x5581bbe46640 2024-09-10T05:36:57.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.819+0000 7f380ca22640 1 -- 172.21.15.62:0/3362651513 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37f4115070 con 0x5581bbe46640 2024-09-10T05:36:57.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.819+0000 7f380ef1c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:57.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.819+0000 7f380ef1c9c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:57.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.819+0000 7f380ef1c9c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:57.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.819+0000 7f380ef1c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:57.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.819+0000 7f380ef1c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:57.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.819+0000 7f380ef1c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:57.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.819+0000 7f380ef1c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:57.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.819+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe4d3f0 con 0x5581bbe42190 2024-09-10T05:36:57.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.823+0000 7f380d223640 1 -- 172.21.15.62:0/3362651513 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f38040083f0 con 0x5581bbe42190 2024-09-10T05:36:57.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.823+0000 7f380ef1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:57.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.823+0000 7f380ef1c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:57.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.823+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe4dc90 con 0x5581bbe46640 2024-09-10T05:36:57.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.823+0000 7f380ca22640 1 -- 172.21.15.62:0/3362651513 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f37f4115070 con 0x5581bbe46640 2024-09-10T05:36:57.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.823+0000 7f380ef1c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:57.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.823+0000 7f380ef1c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:57.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.823+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe4d030 con 0x5581bbe49e60 2024-09-10T05:36:57.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.823+0000 7f380c221640 1 -- 172.21.15.62:0/3362651513 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f37fc049040 con 0x5581bbe49e60 2024-09-10T05:36:57.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.823+0000 7f380ef1c9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:57.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.823+0000 7f380ef1c9c0 20 zone default found 2024-09-10T05:36:57.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.823+0000 7f380ef1c9c0 4 Realm: () 2024-09-10T05:36:57.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.823+0000 7f380ef1c9c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:57.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.823+0000 7f380ef1c9c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:57.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.823+0000 7f380ef1c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:57.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.823+0000 7f380ef1c9c0 20 zonegroup default 2024-09-10T05:36:57.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.823+0000 7f380ef1c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:57.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.823+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe4e730 con 0x7f37f40c9020 2024-09-10T05:36:57.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.823+0000 7f380d223640 1 -- 172.21.15.62:0/3362651513 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f38040083f0 con 0x7f37f40c9020 2024-09-10T05:36:57.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.823+0000 7f380ef1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:57.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.823+0000 7f380ef1c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:57.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.823+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe509f0 con 0x5581bbe49e60 2024-09-10T05:36:57.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.823+0000 7f380c221640 1 -- 172.21.15.62:0/3362651513 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f37fc049040 con 0x5581bbe49e60 2024-09-10T05:36:57.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.823+0000 7f380ef1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:57.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.823+0000 7f380ef1c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:57.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.823+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe50d90 con 0x5581bbe49e60 2024-09-10T05:36:57.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.823+0000 7f380c221640 1 -- 172.21.15.62:0/3362651513 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f37fc049040 con 0x5581bbe49e60 2024-09-10T05:36:57.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.823+0000 7f380ef1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:57.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.823+0000 7f380ef1c9c0 20 started sync module instance, tier type = 2024-09-10T05:36:57.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.823+0000 7f380ef1c9c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:57.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.823+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe4fe80 con 0x5581bbe46640 2024-09-10T05:36:57.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.827+0000 7f380ca22640 1 -- 172.21.15.62:0/3362651513 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37f4115070 con 0x5581bbe46640 2024-09-10T05:36:57.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.827+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94015691490208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe4fe80 con 0x5581bbe46640 2024-09-10T05:36:57.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.827+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe517e0 con 0x5581bbe42190 2024-09-10T05:36:57.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.827+0000 7f380d223640 1 -- 172.21.15.62:0/3362651513 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38040083f0 con 0x5581bbe42190 2024-09-10T05:36:57.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.827+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94015691494192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe52080 con 0x5581bbe42190 2024-09-10T05:36:57.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.827+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe52af0 con 0x5581bbe46640 2024-09-10T05:36:57.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.827+0000 7f380ca22640 1 -- 172.21.15.62:0/3362651513 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94015691490208] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37f4115070 con 0x5581bbe46640 2024-09-10T05:36:57.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.827+0000 7f380d223640 1 -- 172.21.15.62:0/3362651513 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94015691494192] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38040083f0 con 0x5581bbe42190 2024-09-10T05:36:57.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.831+0000 7f380ca22640 1 -- 172.21.15.62:0/3362651513 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37f4115070 con 0x5581bbe46640 2024-09-10T05:36:57.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.831+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94015691498944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe51bd0 con 0x5581bbe46640 2024-09-10T05:36:57.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.831+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe53390 con 0x7f37f40c9020 2024-09-10T05:36:57.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.831+0000 7f380d223640 1 -- 172.21.15.62:0/3362651513 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38040083f0 con 0x7f37f40c9020 2024-09-10T05:36:57.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.831+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94015691501280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe51bd0 con 0x7f37f40c9020 2024-09-10T05:36:57.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.831+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe53e50 con 0x5581bbe46640 2024-09-10T05:36:57.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.831+0000 7f380ca22640 1 -- 172.21.15.62:0/3362651513 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94015691498944] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37f4115070 con 0x5581bbe46640 2024-09-10T05:36:57.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.831+0000 7f380d223640 1 -- 172.21.15.62:0/3362651513 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94015691501280] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38040083f0 con 0x7f37f40c9020 2024-09-10T05:36:57.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.835+0000 7f380ca22640 1 -- 172.21.15.62:0/3362651513 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37f4115070 con 0x5581bbe46640 2024-09-10T05:36:57.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.835+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94015691502336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe53e10 con 0x5581bbe46640 2024-09-10T05:36:57.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.835+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe54240 con 0x5581bbe49e60 2024-09-10T05:36:57.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.835+0000 7f380c221640 1 -- 172.21.15.62:0/3362651513 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37fc049040 con 0x5581bbe49e60 2024-09-10T05:36:57.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.835+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94015691487696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe54ae0 con 0x5581bbe49e60 2024-09-10T05:36:57.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.835+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe554e0 con 0x5581bbe49e60 2024-09-10T05:36:57.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.835+0000 7f380ca22640 1 -- 172.21.15.62:0/3362651513 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94015691502336] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37f4115070 con 0x5581bbe46640 2024-09-10T05:36:57.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.835+0000 7f380c221640 1 -- 172.21.15.62:0/3362651513 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94015691487696] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37fc049040 con 0x5581bbe49e60 2024-09-10T05:36:57.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.835+0000 7f380c221640 1 -- 172.21.15.62:0/3362651513 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37fc049040 con 0x5581bbe49e60 2024-09-10T05:36:57.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.839+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94015691503904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe54630 con 0x5581bbe49e60 2024-09-10T05:36:57.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.839+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe55d80 con 0x7f37f40c9020 2024-09-10T05:36:57.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.839+0000 7f380c221640 1 -- 172.21.15.62:0/3362651513 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94015691503904] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37fc049040 con 0x5581bbe49e60 2024-09-10T05:36:57.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.839+0000 7f380d223640 1 -- 172.21.15.62:0/3362651513 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38040083f0 con 0x7f37f40c9020 2024-09-10T05:36:57.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.839+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94015691509744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe54630 con 0x7f37f40c9020 2024-09-10T05:36:57.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.839+0000 7f380ef1c9c0 20 add_watcher() i=0 2024-09-10T05:36:57.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.839+0000 7f380ef1c9c0 20 add_watcher() i=1 2024-09-10T05:36:57.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.839+0000 7f380ef1c9c0 20 add_watcher() i=2 2024-09-10T05:36:57.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.839+0000 7f380ef1c9c0 20 add_watcher() i=3 2024-09-10T05:36:57.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.839+0000 7f380ef1c9c0 20 add_watcher() i=4 2024-09-10T05:36:57.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.839+0000 7f380ef1c9c0 20 add_watcher() i=5 2024-09-10T05:36:57.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.839+0000 7f380ef1c9c0 20 add_watcher() i=6 2024-09-10T05:36:57.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.839+0000 7f380d223640 1 -- 172.21.15.62:0/3362651513 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94015691509744] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38040083f0 con 0x7f37f40c9020 2024-09-10T05:36:57.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.839+0000 7f380ef1c9c0 20 add_watcher() i=7 2024-09-10T05:36:57.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.839+0000 7f380ef1c9c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:57.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.839+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe58e40 con 0x5581bbe42190 2024-09-10T05:36:57.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.839+0000 7f380d223640 1 -- 172.21.15.62:0/3362651513 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f38040083f0 con 0x5581bbe42190 2024-09-10T05:36:57.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.839+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94015691512016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe56390 con 0x5581bbe42190 2024-09-10T05:36:57.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.843+0000 7f380d223640 1 -- 172.21.15.62:0/3362651513 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94015691512016] v32'193 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f38040083f0 con 0x5581bbe42190 2024-09-10T05:36:57.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.843+0000 7f36c37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:57.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.843+0000 7f380ef1c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:57.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.843+0000 7f380ef1c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:57.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.843+0000 7f380ef1c9c0 5 note: GC not initialized 2024-09-10T05:36:57.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.843+0000 7f36c27e4640 20 reqs_thread_entry: start 2024-09-10T05:36:57.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.843+0000 7f380ef1c9c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:57.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.843+0000 7f380ef1c9c0 20 Filter name: none 2024-09-10T05:36:57.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.843+0000 7f36bb7fe640 20 reqs_thread_entry: start 2024-09-10T05:36:57.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.843+0000 7f380ef1c9c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T05:36:57.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.843+0000 7f380ef1c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:57.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.843+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe7c000 con 0x5581bbe42190 2024-09-10T05:36:57.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.843+0000 7f380d223640 1 -- 172.21.15.62:0/3362651513 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f38040083f0 con 0x5581bbe42190 2024-09-10T05:36:57.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.843+0000 7f380ef1c9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:36:57.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.843+0000 7f380ef1c9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T05:36:57.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.843+0000 7f380ef1c9c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:36:57.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.843+0000 7f380ef1c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:36:57.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.843+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~403 in=403b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe820b0 con 0x5581bbe42190 2024-09-10T05:36:57.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.843+0000 7f380d223640 1 -- 172.21.15.62:0/3362651513 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~403] v32'14 uv14 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f38040083f0 con 0x5581bbe42190 2024-09-10T05:36:57.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.847+0000 7f380ef1c9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:36:57.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.847+0000 7f380ef1c9c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:36:57.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.847+0000 7f380ef1c9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T05:36:57.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.847+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94015691692896 in=591b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe7da80 con 0x5581bbe46640 2024-09-10T05:36:57.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.847+0000 7f380ca22640 1 -- 172.21.15.62:0/3362651513 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== watch-notify(notify (1) cookie 94015691502336 notify 137438953506 ret 0) ==== 621+0+0 (crc 0 0 0) 0x5581bbe24c40 con 0x5581bbe46640 2024-09-10T05:36:57.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.847+0000 7f36e3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953506 cookie 94015691502336 notifier 4654 bl.length()=579 2024-09-10T05:36:57.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.847+0000 7f36e3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:36:57.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.847+0000 7f36e3fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:36:57.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.847+0000 7f36e3fff640 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f36d0003eb0 con 0x5581bbe46640 2024-09-10T05:36:57.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.847+0000 7f380ca22640 1 -- 172.21.15.62:0/3362651513 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(64 notify.4 [notify cookie 94015691692896 out=8b] v0'0 uv180 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f37f4115070 con 0x5581bbe46640 2024-09-10T05:36:57.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.847+0000 7f380ca22640 1 -- 172.21.15.62:0/3362651513 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37f4115070 con 0x5581bbe46640 2024-09-10T05:36:57.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.847+0000 7f380ca22640 1 -- 172.21.15.62:0/3362651513 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== watch-notify(notify_complete (2) cookie 94015691692896 notify 137438953506 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5581bbe243e0 con 0x5581bbe46640 2024-09-10T05:36:57.851 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T05:36:30.893777Z"}],"swift_keys":[],"caps":[{"type":"user","perm":"read"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:36:30.893760Z","tags":[],"group_ids":[]} 2024-09-10T05:36:57.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.847+0000 7f36c37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:57.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.847+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94015691512016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe79e30 con 0x5581bbe42190 2024-09-10T05:36:57.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.851+0000 7f380d223640 1 -- 172.21.15.62:0/3362651513 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94015691512016] v32'194 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f38040083f0 con 0x5581bbe42190 2024-09-10T05:36:57.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.851+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94015691490208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe79e30 con 0x5581bbe46640 2024-09-10T05:36:57.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.851+0000 7f380ca22640 1 -- 172.21.15.62:0/3362651513 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94015691490208] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37f4115070 con 0x5581bbe46640 2024-09-10T05:36:57.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.851+0000 7f380ef1c9c0 20 remove_watcher() i=0 2024-09-10T05:36:57.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.851+0000 7f380ef1c9c0 2 removed watcher, disabling cache 2024-09-10T05:36:57.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.851+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94015691494192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe79e30 con 0x5581bbe42190 2024-09-10T05:36:57.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.855+0000 7f380d223640 1 -- 172.21.15.62:0/3362651513 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94015691494192] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38040083f0 con 0x5581bbe42190 2024-09-10T05:36:57.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.855+0000 7f380ef1c9c0 20 remove_watcher() i=1 2024-09-10T05:36:57.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.855+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94015691498944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe79e30 con 0x5581bbe46640 2024-09-10T05:36:57.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.855+0000 7f380ca22640 1 -- 172.21.15.62:0/3362651513 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94015691498944] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37f4115070 con 0x5581bbe46640 2024-09-10T05:36:57.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.855+0000 7f380ef1c9c0 20 remove_watcher() i=2 2024-09-10T05:36:57.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.855+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94015691501280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe79e30 con 0x7f37f40c9020 2024-09-10T05:36:57.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.859+0000 7f380d223640 1 -- 172.21.15.62:0/3362651513 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94015691501280] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38040083f0 con 0x7f37f40c9020 2024-09-10T05:36:57.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.859+0000 7f380ef1c9c0 20 remove_watcher() i=3 2024-09-10T05:36:57.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.859+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94015691502336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe79e30 con 0x5581bbe46640 2024-09-10T05:36:57.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.859+0000 7f380ca22640 1 -- 172.21.15.62:0/3362651513 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94015691502336] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37f4115070 con 0x5581bbe46640 2024-09-10T05:36:57.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.859+0000 7f380ef1c9c0 20 remove_watcher() i=4 2024-09-10T05:36:57.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.859+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94015691487696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe79e30 con 0x5581bbe49e60 2024-09-10T05:36:57.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.863+0000 7f380c221640 1 -- 172.21.15.62:0/3362651513 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94015691487696] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37fc049040 con 0x5581bbe49e60 2024-09-10T05:36:57.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.863+0000 7f380ef1c9c0 20 remove_watcher() i=5 2024-09-10T05:36:57.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.863+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94015691503904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe79e30 con 0x5581bbe49e60 2024-09-10T05:36:57.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.863+0000 7f380c221640 1 -- 172.21.15.62:0/3362651513 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94015691503904] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37fc049040 con 0x5581bbe49e60 2024-09-10T05:36:57.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.863+0000 7f380ef1c9c0 20 remove_watcher() i=6 2024-09-10T05:36:57.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.863+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94015691509744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5581bbe79e30 con 0x7f37f40c9020 2024-09-10T05:36:57.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.863+0000 7f380d223640 1 -- 172.21.15.62:0/3362651513 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94015691509744] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38040083f0 con 0x7f37f40c9020 2024-09-10T05:36:57.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.863+0000 7f380ef1c9c0 20 remove_watcher() i=7 2024-09-10T05:36:57.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.863+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5581bbe46640 msgr2=0x5581bbe48a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.863+0000 7f380ef1c9c0 1 --2- 172.21.15.62:0/3362651513 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5581bbe46640 0x5581bbe48a30 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.863+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5581bbe42190 msgr2=0x5581bbe44650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.863+0000 7f380ef1c9c0 1 --2- 172.21.15.62:0/3362651513 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5581bbe42190 0x5581bbe44650 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.863+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f37f40c9020 msgr2=0x7f37f40ea8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.863+0000 7f380ef1c9c0 1 --2- 172.21.15.62:0/3362651513 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f37f40c9020 0x7f37f40ea8a0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.863+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5581bbe49e60 msgr2=0x5581bbe4c270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.863+0000 7f380ef1c9c0 1 --2- 172.21.15.62:0/3362651513 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5581bbe49e60 0x5581bbe4c270 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.863+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f36d8039a70 msgr2=0x7f36d803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.863+0000 7f380ef1c9c0 1 --2- 172.21.15.62:0/3362651513 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f36d8039a70 0x7f36d803bf30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f37fc006300 tx=0x7f37fc025000 comp rx=0 tx=0).stop 2024-09-10T05:36:57.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.863+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5581bbe300a0 msgr2=0x5581bbe373e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.863+0000 7f380d223640 1 -- 172.21.15.62:0/3362651513 reap_dead start 2024-09-10T05:36:57.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.863+0000 7f380ef1c9c0 1 --2- 172.21.15.62:0/3362651513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5581bbe300a0 0x5581bbe373e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f37f40c8ff0 tx=0x7f37f40e0ea0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.863+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 shutdown_connections 2024-09-10T05:36:57.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.863+0000 7f380ef1c9c0 1 --2- 172.21.15.62:0/3362651513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5581bbe300a0 0x5581bbe373e0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.863+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 >> 172.21.15.62:0/3362651513 conn(0x5581bbe2c4d0 msgr2=0x5581bbe2a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:57.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.863+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 shutdown_connections 2024-09-10T05:36:57.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.863+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/3362651513 wait complete. 2024-09-10T05:36:57.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.863+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/4066343877 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f36e4039ac0 msgr2=0x7f36e403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.863+0000 7f380ef1c9c0 1 --2- 172.21.15.62:0/4066343877 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f36e4039ac0 0x7f36e403bf80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x5581bbe070d0 tx=0x7f37fc00f000 comp rx=0 tx=0).stop 2024-09-10T05:36:57.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.863+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/4066343877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5581bbe23980 msgr2=0x5581bbe23da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.863+0000 7f380ef1c9c0 1 --2- 172.21.15.62:0/4066343877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5581bbe23980 0x5581bbe23da0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f37f40c9fd0 tx=0x7f37f40bf740 comp rx=0 tx=0).stop 2024-09-10T05:36:57.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.867+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/4066343877 shutdown_connections 2024-09-10T05:36:57.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.867+0000 7f380ef1c9c0 1 --2- 172.21.15.62:0/4066343877 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f36e4039ac0 0x7f36e403bf80 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.867+0000 7f380ef1c9c0 1 --2- 172.21.15.62:0/4066343877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5581bbe23980 0x5581bbe23da0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.867+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/4066343877 >> 172.21.15.62:0/4066343877 conn(0x5581bbe19330 msgr2=0x5581bbe19710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:57.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.867+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/4066343877 shutdown_connections 2024-09-10T05:36:57.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.867+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/4066343877 wait complete. 2024-09-10T05:36:57.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.867+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/4166473472 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5581bbe0e070 msgr2=0x5581bbe10460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.867+0000 7f380ef1c9c0 1 --2- 172.21.15.62:0/4166473472 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5581bbe0e070 0x5581bbe10460 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.867+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/4166473472 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5581bbd16330 msgr2=0x5581bbe0cd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.867+0000 7f380ef1c9c0 1 --2- 172.21.15.62:0/4166473472 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5581bbd16330 0x5581bbe0cd80 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.867+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/4166473472 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5581bbe12810 msgr2=0x5581bbe14c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.867+0000 7f380ef1c9c0 1 --2- 172.21.15.62:0/4166473472 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5581bbe12810 0x5581bbe14c00 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.867+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/4166473472 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f36f4039a70 msgr2=0x7f36f403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.867+0000 7f380ef1c9c0 1 --2- 172.21.15.62:0/4166473472 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f36f4039a70 0x7f36f403bf30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f37fc000f90 tx=0x7f37fc006550 comp rx=0 tx=0).stop 2024-09-10T05:36:57.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.867+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/4166473472 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5581bbd131f0 msgr2=0x5581bbe05c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.867+0000 7f380ef1c9c0 1 --2- 172.21.15.62:0/4166473472 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5581bbd131f0 0x5581bbe05c10 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f37f4000c10 tx=0x7f37f4018020 comp rx=0 tx=0).stop 2024-09-10T05:36:57.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.867+0000 7f380d223640 1 -- 172.21.15.62:0/4166473472 reap_dead start 2024-09-10T05:36:57.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.867+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/4166473472 shutdown_connections 2024-09-10T05:36:57.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.867+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/4166473472 >> 172.21.15.62:0/4166473472 conn(0x5581bbc86b00 msgr2=0x5581bbdf8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:57.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.867+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/4166473472 shutdown_connections 2024-09-10T05:36:57.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.867+0000 7f380ef1c9c0 1 -- 172.21.15.62:0/4166473472 wait complete. 2024-09-10T05:36:57.880 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T05:36:30.893777Z'}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:36:30.893760Z', 'tags': [], 'group_ids': []} 2024-09-10T05:36:57.881 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-10T05:36:57.881 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-10T05:36:57.881 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2024-09-10T05:36:57.963 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:57.963 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:57.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.963+0000 7fbd4d60c9c0 1 Processor -- start 2024-09-10T05:36:57.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.963+0000 7fbd4d60c9c0 1 -- start start 2024-09-10T05:36:57.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.963+0000 7fbd4d60c9c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x56531d4e7230 0x56531d575be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.963+0000 7fbd4d60c9c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56531d4279c0 con 0x56531d576120 2024-09-10T05:36:57.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.963+0000 7fbd4d60c9c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x56531d4776d0 con 0x56531d4e7230 2024-09-10T05:36:57.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.963+0000 7fbd4b112640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x56531d4e7230 0x56531d575be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.963+0000 7fbd4b112640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x56531d4e7230 0x56531d575be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:48200/0 (socket says 172.21.15.62:48200) 2024-09-10T05:36:57.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.963+0000 7fbd42911640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x56531d576120 0x56531d578510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:58400/0 (socket says 172.21.15.62:58400) 2024-09-10T05:36:57.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.963+0000 7fbd4b112640 1 -- 172.21.15.62:0/1120767831 learned_addr learned my addr 172.21.15.62:0/1120767831 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:57.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.963+0000 7fbd4b112640 1 -- 172.21.15.62:0/1120767831 >> v1:172.21.15.2:6789/0 conn(0x56531d576120 legacy=0x56531d578510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.963+0000 7fbd4b112640 1 -- 172.21.15.62:0/1120767831 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56531d41bca0 con 0x56531d4e7230 2024-09-10T05:36:57.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.967+0000 7fbd4b112640 1 --2- 172.21.15.62:0/1120767831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56531d4e7230 0x56531d575be0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c00a5c0 tx=0x7fbd3c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=849703f49aaf95b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.967+0000 7fbd4a911640 1 -- 172.21.15.62:0/1120767831 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd3c0b1070 con 0x56531d4e7230 2024-09-10T05:36:57.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.967+0000 7fbd4a911640 1 -- 172.21.15.62:0/1120767831 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd3c0a8070 con 0x56531d4e7230 2024-09-10T05:36:57.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.967+0000 7fbd4a911640 1 -- 172.21.15.62:0/1120767831 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd3c0ac5b0 con 0x56531d4e7230 2024-09-10T05:36:57.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.967+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/1120767831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56531d4e7230 msgr2=0x56531d575be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.967+0000 7fbd4d60c9c0 1 --2- 172.21.15.62:0/1120767831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56531d4e7230 0x56531d575be0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c00a5c0 tx=0x7fbd3c01b340 comp rx=0 tx=0).stop 2024-09-10T05:36:57.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.967+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/1120767831 shutdown_connections 2024-09-10T05:36:57.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.967+0000 7fbd4d60c9c0 1 --2- 172.21.15.62:0/1120767831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56531d4e7230 0x56531d575be0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.967+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/1120767831 >> 172.21.15.62:0/1120767831 conn(0x56531d56d910 msgr2=0x56531d56fd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:57.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.967+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/1120767831 shutdown_connections 2024-09-10T05:36:57.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.967+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/1120767831 wait complete. 2024-09-10T05:36:57.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.983+0000 7fbd4d60c9c0 1 Processor -- start 2024-09-10T05:36:57.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.983+0000 7fbd4d60c9c0 1 -- start start 2024-09-10T05:36:57.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.983+0000 7fbd4d60c9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56531d4e7230 0x56531d65e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.983+0000 7fbd4d60c9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56531d47b680 con 0x56531d4e7230 2024-09-10T05:36:57.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.983+0000 7fbd4b112640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56531d4e7230 0x56531d65e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.983+0000 7fbd4b112640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56531d4e7230 0x56531d65e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:48214/0 (socket says 172.21.15.62:48214) 2024-09-10T05:36:57.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.983+0000 7fbd4b112640 1 -- 172.21.15.62:0/1057700824 learned_addr learned my addr 172.21.15.62:0/1057700824 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:57.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.983+0000 7fbd4b112640 1 -- 172.21.15.62:0/1057700824 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56531d3f6da0 con 0x56531d4e7230 2024-09-10T05:36:57.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.983+0000 7fbd4b112640 1 --2- 172.21.15.62:0/1057700824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56531d4e7230 0x56531d65e770 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c0af040 tx=0x7fbd3c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4346c4c8a95cd5c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.983+0000 7fbc3960a640 1 -- 172.21.15.62:0/1057700824 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd3c0b1040 con 0x56531d4e7230 2024-09-10T05:36:57.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.983+0000 7fbc3960a640 1 -- 172.21.15.62:0/1057700824 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd3c0ac820 con 0x56531d4e7230 2024-09-10T05:36:57.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.983+0000 7fbc3960a640 1 -- 172.21.15.62:0/1057700824 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd3c0acb00 con 0x56531d4e7230 2024-09-10T05:36:57.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.983+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/1057700824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56531d4e7230 msgr2=0x56531d65e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:57.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.983+0000 7fbd4d60c9c0 1 --2- 172.21.15.62:0/1057700824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56531d4e7230 0x56531d65e770 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c0af040 tx=0x7fbd3c003030 comp rx=0 tx=0).stop 2024-09-10T05:36:57.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.983+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/1057700824 shutdown_connections 2024-09-10T05:36:57.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.983+0000 7fbd4d60c9c0 1 --2- 172.21.15.62:0/1057700824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56531d4e7230 0x56531d65e770 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:57.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.983+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/1057700824 >> 172.21.15.62:0/1057700824 conn(0x56531d56d910 msgr2=0x56531d65a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:57.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.987+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/1057700824 shutdown_connections 2024-09-10T05:36:57.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.987+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/1057700824 wait complete. 2024-09-10T05:36:57.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.987+0000 7fbd4d60c9c0 1 Processor -- start 2024-09-10T05:36:57.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.987+0000 7fbd4d60c9c0 1 -- start start 2024-09-10T05:36:57.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.987+0000 7fbd4d60c9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56531d4e7230 0x56531d665dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.987+0000 7fbd4d60c9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56531d41da50 con 0x56531d4e7230 2024-09-10T05:36:57.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.987+0000 7fbd4b112640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56531d4e7230 0x56531d665dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.987+0000 7fbd4b112640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56531d4e7230 0x56531d665dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:48228/0 (socket says 172.21.15.62:48228) 2024-09-10T05:36:57.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.987+0000 7fbd4b112640 1 -- 172.21.15.62:0/2765488899 learned_addr learned my addr 172.21.15.62:0/2765488899 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:57.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.987+0000 7fbd4b112640 1 -- 172.21.15.62:0/2765488899 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56531d666320 con 0x56531d4e7230 2024-09-10T05:36:57.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.987+0000 7fbd4b112640 1 --2- 172.21.15.62:0/2765488899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56531d4e7230 0x56531d665dc0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c01b820 tx=0x7fbd3c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.987+0000 7fbc37e07640 1 -- 172.21.15.62:0/2765488899 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd3c0b1050 con 0x56531d4e7230 2024-09-10T05:36:57.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.987+0000 7fbc37e07640 1 -- 172.21.15.62:0/2765488899 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd3c0b7750 con 0x56531d4e7230 2024-09-10T05:36:57.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.987+0000 7fbc37e07640 1 -- 172.21.15.62:0/2765488899 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd3c0b7a50 con 0x56531d4e7230 2024-09-10T05:36:57.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.987+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/2765488899 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56531d6665b0 con 0x56531d4e7230 2024-09-10T05:36:57.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.987+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/2765488899 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56531d666fe0 con 0x56531d4e7230 2024-09-10T05:36:57.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.987+0000 7fbc37e07640 1 -- 172.21.15.62:0/2765488899 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fbd3c0aa070 con 0x56531d4e7230 2024-09-10T05:36:57.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.987+0000 7fbc37e07640 1 --2- 172.21.15.62:0/2765488899 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fbc30039a70 0x7fbc3003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.987+0000 7fbc37e07640 1 -- 172.21.15.62:0/2765488899 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7fbd3c0eb000 con 0x56531d4e7230 2024-09-10T05:36:57.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.987+0000 7fbd42911640 1 --2- 172.21.15.62:0/2765488899 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fbc30039a70 0x7fbc3003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.987+0000 7fbd4d60c9c0 1 --2- 172.21.15.62:0/2765488899 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56531d576120 0x56531d66cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.987+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/2765488899 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56531d66d470 con 0x56531d576120 2024-09-10T05:36:57.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.991+0000 7fbd4b913640 1 --2- 172.21.15.62:0/2765488899 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56531d576120 0x56531d66cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.991+0000 7fbd42911640 1 --2- 172.21.15.62:0/2765488899 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fbc30039a70 0x7fbc3003bf30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbd34001e90 tx=0x7fbd340013f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.991+0000 7fbd4b913640 1 --2- 172.21.15.62:0/2765488899 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56531d576120 0x56531d66cf30 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.991+0000 7fbd4b913640 1 -- 172.21.15.62:0/2765488899 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd4400a4d0 con 0x56531d576120 2024-09-10T05:36:57.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.991+0000 7fbd4d60c9c0 1 --2- 172.21.15.62:0/2765488899 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x56531d66df90 0x56531d670450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.991+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/2765488899 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56531d670bc0 con 0x56531d66df90 2024-09-10T05:36:57.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.991+0000 7fbd4b112640 1 --2- 172.21.15.62:0/2765488899 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x56531d66df90 0x56531d670450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.991+0000 7fbd4b112640 1 --2- 172.21.15.62:0/2765488899 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x56531d66df90 0x56531d670450 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.991+0000 7fbd4b112640 1 -- 172.21.15.62:0/2765488899 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbd3c0be070 con 0x56531d66df90 2024-09-10T05:36:57.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.991+0000 7fbd4d60c9c0 1 --2- 172.21.15.62:0/2765488899 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56531d672980 0x56531d674d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.991+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/2765488899 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56531d675440 con 0x56531d672980 2024-09-10T05:36:57.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.991+0000 7fbd42911640 1 --2- 172.21.15.62:0/2765488899 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56531d672980 0x56531d674d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.991+0000 7fbd42911640 1 --2- 172.21.15.62:0/2765488899 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56531d672980 0x56531d674d70 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:57.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.991+0000 7fbd42911640 1 -- 172.21.15.62:0/2765488899 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbd3400f6e0 con 0x56531d672980 2024-09-10T05:36:57.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.991+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/2765488899 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56531d671820 con 0x56531d66df90 2024-09-10T05:36:57.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.995+0000 7fbd4b112640 1 -- 172.21.15.62:0/2765488899 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbd3c0be070 con 0x56531d66df90 2024-09-10T05:36:57.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.995+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/2765488899 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56531d671c40 con 0x56531d672980 2024-09-10T05:36:57.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.995+0000 7fbd42911640 1 -- 172.21.15.62:0/2765488899 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbd3400f6e0 con 0x56531d672980 2024-09-10T05:36:57.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.995+0000 7fbd4d60c9c0 1 Processor -- start 2024-09-10T05:36:57.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.995+0000 7fbd4d60c9c0 1 -- start start 2024-09-10T05:36:57.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.995+0000 7fbd4d60c9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56531d683ad0 0x56531d683ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:57.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.995+0000 7fbd4d60c9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56531d488450 con 0x56531d683ad0 2024-09-10T05:36:57.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.995+0000 7fbd4b112640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56531d683ad0 0x56531d683ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:57.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.995+0000 7fbd4b112640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56531d683ad0 0x56531d683ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:48244/0 (socket says 172.21.15.62:48244) 2024-09-10T05:36:57.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.995+0000 7fbd4b112640 1 -- 172.21.15.62:0/620336597 learned_addr learned my addr 172.21.15.62:0/620336597 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:57.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.995+0000 7fbd4b112640 1 -- 172.21.15.62:0/620336597 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56531d684530 con 0x56531d683ad0 2024-09-10T05:36:58.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.995+0000 7fbd4b112640 1 --2- 172.21.15.62:0/620336597 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56531d683ad0 0x56531d683ef0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c0ab7b0 tx=0x7fbd3c0e2f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:58.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.995+0000 7fbc35602640 1 -- 172.21.15.62:0/620336597 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd3c0da040 con 0x56531d683ad0 2024-09-10T05:36:58.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.995+0000 7fbc35602640 1 -- 172.21.15.62:0/620336597 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd3c0d34b0 con 0x56531d683ad0 2024-09-10T05:36:58.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.995+0000 7fbc35602640 1 -- 172.21.15.62:0/620336597 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd3c0019d0 con 0x56531d683ad0 2024-09-10T05:36:58.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.995+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/620336597 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56531d684d90 con 0x56531d683ad0 2024-09-10T05:36:58.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.995+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/620336597 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56531d685300 con 0x56531d683ad0 2024-09-10T05:36:58.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.999+0000 7fbc35602640 1 -- 172.21.15.62:0/620336597 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fbd3c001b70 con 0x56531d683ad0 2024-09-10T05:36:58.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.999+0000 7fbc35602640 1 --2- 172.21.15.62:0/620336597 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fbc24039a70 0x7fbc2403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:58.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.999+0000 7fbc35602640 1 -- 172.21.15.62:0/620336597 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7fbd3c0edc50 con 0x56531d683ad0 2024-09-10T05:36:58.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.999+0000 7fbd42911640 1 --2- 172.21.15.62:0/620336597 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fbc24039a70 0x7fbc2403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:58.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.999+0000 7fbd4d60c9c0 1 Processor -- start 2024-09-10T05:36:58.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.999+0000 7fbd4d60c9c0 1 -- start start 2024-09-10T05:36:58.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.999+0000 7fbd4d60c9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56531d571ba0 0x56531d571f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:58.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.999+0000 7fbd4d60c9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56531d65ef60 con 0x56531d571ba0 2024-09-10T05:36:58.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.999+0000 7fbd42911640 1 --2- 172.21.15.62:0/620336597 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fbc24039a70 0x7fbc2403bf30 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x56531d667290 tx=0x7fbd3400f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:58.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.999+0000 7fbd4b112640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56531d571ba0 0x56531d571f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:58.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.999+0000 7fbd4b112640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56531d571ba0 0x56531d571f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:48254/0 (socket says 172.21.15.62:48254) 2024-09-10T05:36:58.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.999+0000 7fbd4b112640 1 -- 172.21.15.62:0/1004010616 learned_addr learned my addr 172.21.15.62:0/1004010616 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:58.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.999+0000 7fbd4b112640 1 -- 172.21.15.62:0/1004010616 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56531d5724c0 con 0x56531d571ba0 2024-09-10T05:36:58.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.999+0000 7fbd4b112640 1 --2- 172.21.15.62:0/1004010616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56531d571ba0 0x56531d571f80 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c0e4010 tx=0x7fbd3c0e9e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f2e882bb322f6e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:58.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.999+0000 7fbc2effd640 1 -- 172.21.15.62:0/1004010616 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd3c104070 con 0x56531d571ba0 2024-09-10T05:36:58.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.999+0000 7fbc2effd640 1 -- 172.21.15.62:0/1004010616 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd3c0bb1b0 con 0x56531d571ba0 2024-09-10T05:36:58.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.999+0000 7fbc2effd640 1 -- 172.21.15.62:0/1004010616 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd3c0b8030 con 0x56531d571ba0 2024-09-10T05:36:58.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.999+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/1004010616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56531d571ba0 msgr2=0x56531d571f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:58.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.999+0000 7fbd4d60c9c0 1 --2- 172.21.15.62:0/1004010616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56531d571ba0 0x56531d571f80 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c0e4010 tx=0x7fbd3c0e9e60 comp rx=0 tx=0).stop 2024-09-10T05:36:58.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.999+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/1004010616 shutdown_connections 2024-09-10T05:36:58.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.999+0000 7fbd4d60c9c0 1 --2- 172.21.15.62:0/1004010616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56531d571ba0 0x56531d571f80 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:58.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.999+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/1004010616 >> 172.21.15.62:0/1004010616 conn(0x56531d68c6c0 msgr2=0x56531d68a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:58.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.999+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/1004010616 shutdown_connections 2024-09-10T05:36:58.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:57.999+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/1004010616 wait complete. 2024-09-10T05:36:58.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.003+0000 7fbd4d60c9c0 1 Processor -- start 2024-09-10T05:36:58.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.003+0000 7fbd4d60c9c0 1 -- start start 2024-09-10T05:36:58.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.003+0000 7fbd4d60c9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56531d571ba0 0x56531d6997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:58.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.003+0000 7fbd4d60c9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56531d572ab0 con 0x56531d571ba0 2024-09-10T05:36:58.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.003+0000 7fbd4b112640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56531d571ba0 0x56531d6997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:58.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.003+0000 7fbd4b112640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56531d571ba0 0x56531d6997b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:48266/0 (socket says 172.21.15.62:48266) 2024-09-10T05:36:58.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.003+0000 7fbd4b112640 1 -- 172.21.15.62:0/3079192114 learned_addr learned my addr 172.21.15.62:0/3079192114 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:58.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.003+0000 7fbd4b112640 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56531d699d10 con 0x56531d571ba0 2024-09-10T05:36:58.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.003+0000 7fbd4b112640 1 --2- 172.21.15.62:0/3079192114 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56531d571ba0 0x56531d6997b0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c0e8300 tx=0x7fbd3c0d5f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:58.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.003+0000 7fbc2d7fa640 1 -- 172.21.15.62:0/3079192114 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd3c10e070 con 0x56531d571ba0 2024-09-10T05:36:58.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.003+0000 7fbc2d7fa640 1 -- 172.21.15.62:0/3079192114 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd3c0e9b40 con 0x56531d571ba0 2024-09-10T05:36:58.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.003+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56531d699d10 con 0x56531d571ba0 2024-09-10T05:36:58.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.003+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56531d699d10 con 0x56531d571ba0 2024-09-10T05:36:58.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.003+0000 7fbc2d7fa640 1 -- 172.21.15.62:0/3079192114 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd3c104040 con 0x56531d571ba0 2024-09-10T05:36:58.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.003+0000 7fbc2d7fa640 1 -- 172.21.15.62:0/3079192114 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fbd3c001410 con 0x56531d571ba0 2024-09-10T05:36:58.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.003+0000 7fbc2d7fa640 1 --2- 172.21.15.62:0/3079192114 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fbc14039a20 0x7fbc1403bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:58.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.003+0000 7fbc2d7fa640 1 -- 172.21.15.62:0/3079192114 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7fbd3c0fc070 con 0x56531d571ba0 2024-09-10T05:36:58.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.007+0000 7fbd42911640 1 --2- 172.21.15.62:0/3079192114 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fbc14039a20 0x7fbc1403bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:58.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.007+0000 7fbd4d60c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:58.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.007+0000 7fbd4d60c9c0 1 --2- 172.21.15.62:0/3079192114 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56531d6a4780 0x56531d6a6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:58.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.007+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56531d6a7390 con 0x56531d6a4780 2024-09-10T05:36:58.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.007+0000 7fbd4b913640 1 --2- 172.21.15.62:0/3079192114 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56531d6a4780 0x56531d6a6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:58.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.007+0000 7fbd42911640 1 --2- 172.21.15.62:0/3079192114 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fbc14039a20 0x7fbc1403bee0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x56531d66d830 tx=0x7fbd34010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:58.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.007+0000 7fbd4b913640 1 --2- 172.21.15.62:0/3079192114 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56531d6a4780 0x56531d6a6c40 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:58.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.007+0000 7fbd4b913640 1 -- 172.21.15.62:0/3079192114 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd4400a4d0 con 0x56531d6a4780 2024-09-10T05:36:58.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.007+0000 7fbd4d60c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:58.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.007+0000 7fbd4d60c9c0 20 realm 2024-09-10T05:36:58.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.007+0000 7fbd4d60c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:58.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.007+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56531d6a3ab0 con 0x56531d6a4780 2024-09-10T05:36:58.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.007+0000 7fbd4b913640 1 -- 172.21.15.62:0/3079192114 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd4400a4d0 con 0x56531d6a4780 2024-09-10T05:36:58.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.007+0000 7fbd4d60c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:58.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.007+0000 7fbd4d60c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:58.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.007+0000 7fbd4d60c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:58.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.007+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56531d6a7e60 con 0x56531d6a4780 2024-09-10T05:36:58.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.007+0000 7fbd4b913640 1 -- 172.21.15.62:0/3079192114 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd4400a4d0 con 0x56531d6a4780 2024-09-10T05:36:58.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.007+0000 7fbd4d60c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:58.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.007+0000 7fbd4d60c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:58.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.007+0000 7fbd4d60c9c0 1 --2- 172.21.15.62:0/3079192114 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x56531d6a8c40 0x56531d6ab030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:58.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.007+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56531d6ab6e0 con 0x56531d6a8c40 2024-09-10T05:36:58.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.007+0000 7fbd4b112640 1 --2- 172.21.15.62:0/3079192114 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x56531d6a8c40 0x56531d6ab030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:58.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.007+0000 7fbd4b112640 1 --2- 172.21.15.62:0/3079192114 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x56531d6a8c40 0x56531d6ab030 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:58.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.007+0000 7fbd4b112640 1 -- 172.21.15.62:0/3079192114 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbd3c107050 con 0x56531d6a8c40 2024-09-10T05:36:58.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.007+0000 7fbd4d60c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:58.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.007+0000 7fbd4d60c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:58.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.007+0000 7fbd4d60c9c0 1 --2- 172.21.15.62:0/3079192114 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56531d6ac440 0x56531d6ae850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:58.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.007+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56531d6aefe0 con 0x56531d6ac440 2024-09-10T05:36:58.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.007+0000 7fbd42911640 1 --2- 172.21.15.62:0/3079192114 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56531d6ac440 0x56531d6ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:58.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.011+0000 7fbd42911640 1 --2- 172.21.15.62:0/3079192114 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56531d6ac440 0x56531d6ae850 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:58.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.011+0000 7fbd42911640 1 -- 172.21.15.62:0/3079192114 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbd3400f6e0 con 0x56531d6ac440 2024-09-10T05:36:58.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.011+0000 7fbd4d60c9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:58.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.011+0000 7fbd4d60c9c0 20 searching for the correct realm 2024-09-10T05:36:58.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.011+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b08b0 con 0x56531d6ac440 2024-09-10T05:36:58.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.011+0000 7fbd42911640 1 -- 172.21.15.62:0/3079192114 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd3400f6e0 con 0x56531d6ac440 2024-09-10T05:36:58.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.011+0000 7fbd42911640 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b08b0 con 0x56531d6a8c40 2024-09-10T05:36:58.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.011+0000 7fbd4b112640 1 -- 172.21.15.62:0/3079192114 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd3c107050 con 0x56531d6a8c40 2024-09-10T05:36:58.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.011+0000 7fbd4b112640 1 --2- 172.21.15.62:0/3079192114 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fbd3c0ff030 0x7fbd3c0d25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:58.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.011+0000 7fbd4b112640 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b08b0 con 0x7fbd3c0ff030 2024-09-10T05:36:58.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.011+0000 7fbd4b913640 1 --2- 172.21.15.62:0/3079192114 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fbd3c0ff030 0x7fbd3c0d25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:58.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.011+0000 7fbd4b913640 1 --2- 172.21.15.62:0/3079192114 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fbd3c0ff030 0x7fbd3c0d25c0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:58.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.011+0000 7fbd4b913640 1 -- 172.21.15.62:0/3079192114 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd4400a4d0 con 0x7fbd3c0ff030 2024-09-10T05:36:58.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.011+0000 7fbd4b913640 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b08b0 con 0x56531d6a4780 2024-09-10T05:36:58.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.011+0000 7fbd4b913640 1 -- 172.21.15.62:0/3079192114 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd4400a4d0 con 0x56531d6a4780 2024-09-10T05:36:58.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.011+0000 7fbd4b913640 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b08b0 con 0x56531d6a4780 2024-09-10T05:36:58.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.011+0000 7fbd4b913640 1 -- 172.21.15.62:0/3079192114 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd4400a4d0 con 0x56531d6a4780 2024-09-10T05:36:58.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.011+0000 7fbd4b913640 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b08b0 con 0x56531d6ac440 2024-09-10T05:36:58.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.011+0000 7fbd42911640 1 -- 172.21.15.62:0/3079192114 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd3400f6e0 con 0x56531d6ac440 2024-09-10T05:36:58.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.011+0000 7fbd42911640 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b08b0 con 0x56531d6a4780 2024-09-10T05:36:58.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.011+0000 7fbd4b913640 1 -- 172.21.15.62:0/3079192114 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd4400a4d0 con 0x56531d6a4780 2024-09-10T05:36:58.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.015+0000 7fbd4b913640 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b08b0 con 0x56531d6a8c40 2024-09-10T05:36:58.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.015+0000 7fbd4b112640 1 -- 172.21.15.62:0/3079192114 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd3c107050 con 0x56531d6a8c40 2024-09-10T05:36:58.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.015+0000 7fbd4b112640 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b08b0 con 0x56531d6a8c40 2024-09-10T05:36:58.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.015+0000 7fbd4b112640 1 -- 172.21.15.62:0/3079192114 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd3c107050 con 0x56531d6a8c40 2024-09-10T05:36:58.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.015+0000 7fbd4b112640 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b08b0 con 0x56531d6a4780 2024-09-10T05:36:58.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.015+0000 7fbd4b913640 1 -- 172.21.15.62:0/3079192114 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd4400a4d0 con 0x56531d6a4780 2024-09-10T05:36:58.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.015+0000 7fbd4b913640 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b08b0 con 0x7fbd3c0ff030 2024-09-10T05:36:58.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.015+0000 7fbd4b913640 1 -- 172.21.15.62:0/3079192114 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd4400a4d0 con 0x7fbd3c0ff030 2024-09-10T05:36:58.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.015+0000 7fbd4b913640 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b08b0 con 0x56531d6a4780 2024-09-10T05:36:58.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.015+0000 7fbd4b913640 1 -- 172.21.15.62:0/3079192114 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd4400a4d0 con 0x56531d6a4780 2024-09-10T05:36:58.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.015+0000 7fbd4b913640 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b08b0 con 0x7fbd3c0ff030 2024-09-10T05:36:58.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.015+0000 7fbd4b913640 1 -- 172.21.15.62:0/3079192114 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbd4400a4d0 con 0x7fbd3c0ff030 2024-09-10T05:36:58.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.015+0000 7fbd4b913640 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b08b0 con 0x56531d6a8c40 2024-09-10T05:36:58.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.015+0000 7fbd4b112640 1 -- 172.21.15.62:0/3079192114 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd3c107050 con 0x56531d6a8c40 2024-09-10T05:36:58.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.015+0000 7fbd4b112640 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b08b0 con 0x56531d6ac440 2024-09-10T05:36:58.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.015+0000 7fbd42911640 1 -- 172.21.15.62:0/3079192114 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd3400f6e0 con 0x56531d6ac440 2024-09-10T05:36:58.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.015+0000 7fbd42911640 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b08b0 con 0x56531d6a4780 2024-09-10T05:36:58.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.015+0000 7fbd4b913640 1 -- 172.21.15.62:0/3079192114 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd4400a4d0 con 0x56531d6a4780 2024-09-10T05:36:58.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.015+0000 7fbd4b913640 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b08b0 con 0x56531d6a8c40 2024-09-10T05:36:58.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.019+0000 7fbd4b112640 1 -- 172.21.15.62:0/3079192114 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd3c107050 con 0x56531d6a8c40 2024-09-10T05:36:58.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.019+0000 7fbd4b112640 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b08b0 con 0x56531d6ac440 2024-09-10T05:36:58.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.019+0000 7fbd42911640 1 -- 172.21.15.62:0/3079192114 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 32 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7fbd3400f6e0 con 0x56531d6ac440 2024-09-10T05:36:58.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.019+0000 7fbd42911640 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b08b0 con 0x56531d6a4780 2024-09-10T05:36:58.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.019+0000 7fbd4b913640 1 -- 172.21.15.62:0/3079192114 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd4400a4d0 con 0x56531d6a4780 2024-09-10T05:36:58.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.019+0000 7fbd4b913640 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b08b0 con 0x56531d6a4780 2024-09-10T05:36:58.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.019+0000 7fbd4b913640 1 -- 172.21.15.62:0/3079192114 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbd4400a4d0 con 0x56531d6a4780 2024-09-10T05:36:58.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.019+0000 7fbd4b913640 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b08b0 con 0x56531d6a4780 2024-09-10T05:36:58.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.019+0000 7fbd4b913640 1 -- 172.21.15.62:0/3079192114 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd4400a4d0 con 0x56531d6a4780 2024-09-10T05:36:58.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.019+0000 7fbd4b913640 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b08b0 con 0x56531d6ac440 2024-09-10T05:36:58.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.019+0000 7fbd42911640 1 -- 172.21.15.62:0/3079192114 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd3400f6e0 con 0x56531d6ac440 2024-09-10T05:36:58.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.019+0000 7fbd42911640 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b08b0 con 0x7fbd3c0ff030 2024-09-10T05:36:58.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.019+0000 7fbd4b913640 1 -- 172.21.15.62:0/3079192114 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd4400a4d0 con 0x7fbd3c0ff030 2024-09-10T05:36:58.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.019+0000 7fbd4b913640 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b08b0 con 0x56531d6a4780 2024-09-10T05:36:58.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.019+0000 7fbd4b913640 1 -- 172.21.15.62:0/3079192114 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd4400a4d0 con 0x56531d6a4780 2024-09-10T05:36:58.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.019+0000 7fbd4b913640 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b08b0 con 0x7fbd3c0ff030 2024-09-10T05:36:58.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.019+0000 7fbd4b913640 1 -- 172.21.15.62:0/3079192114 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd4400a4d0 con 0x7fbd3c0ff030 2024-09-10T05:36:58.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.019+0000 7fbd4b913640 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b08b0 con 0x56531d6ac440 2024-09-10T05:36:58.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.019+0000 7fbd42911640 1 -- 172.21.15.62:0/3079192114 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd3400f6e0 con 0x56531d6ac440 2024-09-10T05:36:58.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.019+0000 7fbd42911640 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b08b0 con 0x7fbd3c0ff030 2024-09-10T05:36:58.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.019+0000 7fbd4b913640 1 -- 172.21.15.62:0/3079192114 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd4400a4d0 con 0x7fbd3c0ff030 2024-09-10T05:36:58.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.019+0000 7fbd4b913640 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b08b0 con 0x56531d6a8c40 2024-09-10T05:36:58.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.023+0000 7fbd4b112640 1 -- 172.21.15.62:0/3079192114 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd3c107050 con 0x56531d6a8c40 2024-09-10T05:36:58.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.023+0000 7fbd4b112640 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b08b0 con 0x56531d6a8c40 2024-09-10T05:36:58.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.023+0000 7fbd4b112640 1 -- 172.21.15.62:0/3079192114 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd3c107050 con 0x56531d6a8c40 2024-09-10T05:36:58.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.023+0000 7fbd4b112640 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b08b0 con 0x56531d6ac440 2024-09-10T05:36:58.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.023+0000 7fbd42911640 1 -- 172.21.15.62:0/3079192114 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd3400f6e0 con 0x56531d6ac440 2024-09-10T05:36:58.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.023+0000 7fbd42911640 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b08b0 con 0x56531d6a8c40 2024-09-10T05:36:58.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.023+0000 7fbd4b112640 1 -- 172.21.15.62:0/3079192114 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbd3c107050 con 0x56531d6a8c40 2024-09-10T05:36:58.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.023+0000 7fbd4b112640 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b08b0 con 0x56531d6a8c40 2024-09-10T05:36:58.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.023+0000 7fbd4b112640 1 -- 172.21.15.62:0/3079192114 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd3c107050 con 0x56531d6a8c40 2024-09-10T05:36:58.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.023+0000 7fbd4d60c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:58.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.023+0000 7fbd4d60c9c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:58.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.023+0000 7fbd4d60c9c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:58.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.023+0000 7fbd4d60c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:58.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.023+0000 7fbd4d60c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:58.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.023+0000 7fbd4d60c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:58.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.023+0000 7fbd4d60c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:58.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.023+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56531d6af9d0 con 0x56531d6a4780 2024-09-10T05:36:58.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.023+0000 7fbd4b913640 1 -- 172.21.15.62:0/3079192114 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd4400a4d0 con 0x56531d6a4780 2024-09-10T05:36:58.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.023+0000 7fbd4d60c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:58.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.023+0000 7fbd4d60c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:58.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.023+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56531d6af610 con 0x56531d6a8c40 2024-09-10T05:36:58.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.027+0000 7fbd4b112640 1 -- 172.21.15.62:0/3079192114 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbd3c107050 con 0x56531d6a8c40 2024-09-10T05:36:58.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.027+0000 7fbd4d60c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:58.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.027+0000 7fbd4d60c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:58.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.027+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b0370 con 0x56531d6ac440 2024-09-10T05:36:58.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.027+0000 7fbd42911640 1 -- 172.21.15.62:0/3079192114 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbd3400f6e0 con 0x56531d6ac440 2024-09-10T05:36:58.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.027+0000 7fbd4d60c9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:58.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.027+0000 7fbd4d60c9c0 20 zone default found 2024-09-10T05:36:58.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.027+0000 7fbd4d60c9c0 4 Realm: () 2024-09-10T05:36:58.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.027+0000 7fbd4d60c9c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:58.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.027+0000 7fbd4d60c9c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:58.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.027+0000 7fbd4d60c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:58.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.027+0000 7fbd4d60c9c0 20 zonegroup default 2024-09-10T05:36:58.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.027+0000 7fbd4d60c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:58.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.027+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b1190 con 0x7fbd3c0ff030 2024-09-10T05:36:58.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.027+0000 7fbd4b913640 1 -- 172.21.15.62:0/3079192114 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbd4400a4d0 con 0x7fbd3c0ff030 2024-09-10T05:36:58.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.027+0000 7fbd4d60c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:58.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.027+0000 7fbd4d60c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:58.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.027+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b33d0 con 0x56531d6ac440 2024-09-10T05:36:58.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.027+0000 7fbd42911640 1 -- 172.21.15.62:0/3079192114 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbd3400f6e0 con 0x56531d6ac440 2024-09-10T05:36:58.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.027+0000 7fbd4d60c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:58.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.027+0000 7fbd4d60c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:58.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.027+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b3770 con 0x56531d6ac440 2024-09-10T05:36:58.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.027+0000 7fbd42911640 1 -- 172.21.15.62:0/3079192114 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbd3400f6e0 con 0x56531d6ac440 2024-09-10T05:36:58.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.027+0000 7fbd4d60c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:58.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.027+0000 7fbd4d60c9c0 20 started sync module instance, tier type = 2024-09-10T05:36:58.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.027+0000 7fbd4d60c9c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:58.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.027+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b2860 con 0x56531d6a8c40 2024-09-10T05:36:58.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.031+0000 7fbd4b112640 1 -- 172.21.15.62:0/3079192114 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3c107050 con 0x56531d6a8c40 2024-09-10T05:36:58.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.031+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94914975837264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b4010 con 0x56531d6a8c40 2024-09-10T05:36:58.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.031+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b4860 con 0x56531d6a4780 2024-09-10T05:36:58.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.031+0000 7fbd4b913640 1 -- 172.21.15.62:0/3079192114 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd4400a4d0 con 0x56531d6a4780 2024-09-10T05:36:58.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.031+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94914975843248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b50b0 con 0x56531d6a4780 2024-09-10T05:36:58.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.031+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b5b30 con 0x56531d6a8c40 2024-09-10T05:36:58.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.031+0000 7fbd4b112640 1 -- 172.21.15.62:0/3079192114 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94914975837264] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3c107050 con 0x56531d6a8c40 2024-09-10T05:36:58.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.031+0000 7fbd4b913640 1 -- 172.21.15.62:0/3079192114 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94914975843248] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd4400a4d0 con 0x56531d6a4780 2024-09-10T05:36:58.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.035+0000 7fbd4b112640 1 -- 172.21.15.62:0/3079192114 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3c107050 con 0x56531d6a8c40 2024-09-10T05:36:58.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.035+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94914975847968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b4c00 con 0x56531d6a8c40 2024-09-10T05:36:58.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.035+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b63d0 con 0x7fbd3c0ff030 2024-09-10T05:36:58.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.035+0000 7fbd4b913640 1 -- 172.21.15.62:0/3079192114 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd4400a4d0 con 0x7fbd3c0ff030 2024-09-10T05:36:58.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.035+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94914975850272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b4c00 con 0x7fbd3c0ff030 2024-09-10T05:36:58.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.035+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b6e50 con 0x56531d6a8c40 2024-09-10T05:36:58.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.035+0000 7fbd4b112640 1 -- 172.21.15.62:0/3079192114 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94914975847968] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3c107050 con 0x56531d6a8c40 2024-09-10T05:36:58.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.035+0000 7fbd4b913640 1 -- 172.21.15.62:0/3079192114 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94914975850272] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd4400a4d0 con 0x7fbd3c0ff030 2024-09-10T05:36:58.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.039+0000 7fbd4b112640 1 -- 172.21.15.62:0/3079192114 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3c107050 con 0x56531d6a8c40 2024-09-10T05:36:58.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.039+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94914975851328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b6960 con 0x56531d6a8c40 2024-09-10T05:36:58.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.039+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b76f0 con 0x56531d6ac440 2024-09-10T05:36:58.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.039+0000 7fbd42911640 1 -- 172.21.15.62:0/3079192114 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3400f6e0 con 0x56531d6ac440 2024-09-10T05:36:58.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.039+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94914975855168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b6960 con 0x56531d6ac440 2024-09-10T05:36:58.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.039+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b8130 con 0x56531d6ac440 2024-09-10T05:36:58.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.039+0000 7fbd4b112640 1 -- 172.21.15.62:0/3079192114 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94914975851328] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3c107050 con 0x56531d6a8c40 2024-09-10T05:36:58.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.039+0000 7fbd42911640 1 -- 172.21.15.62:0/3079192114 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(56 notify.6 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3400f6e0 con 0x56531d6ac440 2024-09-10T05:36:58.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.039+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94914975841120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b8130 con 0x56531d6ac440 2024-09-10T05:36:58.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.039+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b8af0 con 0x7fbd3c0ff030 2024-09-10T05:36:58.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.039+0000 7fbd42911640 1 -- 172.21.15.62:0/3079192114 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94914975855168] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3400f6e0 con 0x56531d6ac440 2024-09-10T05:36:58.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.043+0000 7fbd4b913640 1 -- 172.21.15.62:0/3079192114 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd4400a4d0 con 0x7fbd3c0ff030 2024-09-10T05:36:58.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.043+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94914975856224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b8af0 con 0x7fbd3c0ff030 2024-09-10T05:36:58.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.043+0000 7fbd4d60c9c0 20 add_watcher() i=0 2024-09-10T05:36:58.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.043+0000 7fbd4d60c9c0 20 add_watcher() i=1 2024-09-10T05:36:58.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.043+0000 7fbd4d60c9c0 20 add_watcher() i=2 2024-09-10T05:36:58.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.043+0000 7fbd4d60c9c0 20 add_watcher() i=3 2024-09-10T05:36:58.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.043+0000 7fbd4d60c9c0 20 add_watcher() i=4 2024-09-10T05:36:58.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.043+0000 7fbd4d60c9c0 20 add_watcher() i=5 2024-09-10T05:36:58.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.043+0000 7fbd42911640 1 -- 172.21.15.62:0/3079192114 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94914975841120] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3400f6e0 con 0x56531d6ac440 2024-09-10T05:36:58.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.043+0000 7fbd4d60c9c0 20 add_watcher() i=6 2024-09-10T05:36:58.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.043+0000 7fbd4b913640 1 -- 172.21.15.62:0/3079192114 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94914975856224] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd4400a4d0 con 0x7fbd3c0ff030 2024-09-10T05:36:58.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.043+0000 7fbd4d60c9c0 20 add_watcher() i=7 2024-09-10T05:36:58.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.043+0000 7fbd4d60c9c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:58.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.043+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b7c80 con 0x56531d6a4780 2024-09-10T05:36:58.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.043+0000 7fbd4b913640 1 -- 172.21.15.62:0/3079192114 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbd4400a4d0 con 0x56531d6a4780 2024-09-10T05:36:58.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.043+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94914975860288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b7c80 con 0x56531d6a4780 2024-09-10T05:36:58.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.047+0000 7fbd4b913640 1 -- 172.21.15.62:0/3079192114 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94914975860288] v32'195 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbd4400a4d0 con 0x56531d6a4780 2024-09-10T05:36:58.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.047+0000 7fbc01fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:58.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.047+0000 7fbd4d60c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:58.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.047+0000 7fbd4d60c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:58.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.047+0000 7fbd4d60c9c0 5 note: GC not initialized 2024-09-10T05:36:58.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.047+0000 7fbc00fe1640 20 reqs_thread_entry: start 2024-09-10T05:36:58.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.047+0000 7fbd4d60c9c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:58.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.047+0000 7fbd4d60c9c0 20 Filter name: none 2024-09-10T05:36:58.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.047+0000 7fbb7a7fc640 20 reqs_thread_entry: start 2024-09-10T05:36:58.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.047+0000 7fbd4d60c9c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T05:36:58.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.047+0000 7fbd4d60c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:58.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.047+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56531d6ded20 con 0x56531d6a4780 2024-09-10T05:36:58.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.047+0000 7fbd4b913640 1 -- 172.21.15.62:0/3079192114 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(62 foo [call out=48b,read 0~403 out=403b,getxattrs out=75b] v0'0 uv14 ondisk = 0) ==== 231+0+526 (crc 0 0 0) 0x7fbd4400a4d0 con 0x56531d6a4780 2024-09-10T05:36:58.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.047+0000 7fbd4d60c9c0 20 rados_obj.operate() r=0 bl.length=403 2024-09-10T05:36:58.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.047+0000 7fbd4d60c9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T05:36:58.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.047+0000 7fbd4d60c9c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:36:58.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.047+0000 7fbd4d60c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:36:58.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.047+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56531d6e4e00 con 0x56531d6a4780 2024-09-10T05:36:58.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.047+0000 7fbd4b913640 1 -- 172.21.15.62:0/3079192114 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v32'15 uv15 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fbd4400a4d0 con 0x56531d6a4780 2024-09-10T05:36:58.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.047+0000 7fbd4d60c9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:36:58.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.047+0000 7fbd4d60c9c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:36:58.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.047+0000 7fbd4d60c9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T05:36:58.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.047+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94914976041088 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56531d6e07a0 con 0x56531d6a8c40 2024-09-10T05:36:58.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.047+0000 7fbd4b112640 1 -- 172.21.15.62:0/3079192114 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== watch-notify(notify (1) cookie 94914975851328 notify 137438953507 ret 0) ==== 609+0+0 (crc 0 0 0) 0x56531d684d90 con 0x56531d6a8c40 2024-09-10T05:36:58.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.051+0000 7fbc2effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953507 cookie 94914975851328 notifier 4661 bl.length()=567 2024-09-10T05:36:58.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.051+0000 7fbc2effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:36:58.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.051+0000 7fbc2effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:36:58.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.051+0000 7fbd4b112640 1 -- 172.21.15.62:0/3079192114 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(64 notify.4 [notify cookie 94914976041088 out=8b] v0'0 uv183 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbd3c107050 con 0x56531d6a8c40 2024-09-10T05:36:58.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.051+0000 7fbc2effd640 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fbc10003eb0 con 0x56531d6a8c40 2024-09-10T05:36:58.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.051+0000 7fbd4b112640 1 -- 172.21.15.62:0/3079192114 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3c107050 con 0x56531d6a8c40 2024-09-10T05:36:58.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.051+0000 7fbd4b112640 1 -- 172.21.15.62:0/3079192114 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== watch-notify(notify_complete (2) cookie 94914976041088 notify 137438953507 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56531d684530 con 0x56531d6a8c40 2024-09-10T05:36:58.054 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T05:36:30.893777Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:36:30.893760Z","tags":[],"group_ids":[]} 2024-09-10T05:36:58.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.051+0000 7fbc01fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:58.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.051+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94914975860288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56531d6dcb00 con 0x56531d6a4780 2024-09-10T05:36:58.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.055+0000 7fbd4b913640 1 -- 172.21.15.62:0/3079192114 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94914975860288] v32'196 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbd4400a4d0 con 0x56531d6a4780 2024-09-10T05:36:58.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.055+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94914975837264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56531d6dcb00 con 0x56531d6a8c40 2024-09-10T05:36:58.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.055+0000 7fbd4b112640 1 -- 172.21.15.62:0/3079192114 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94914975837264] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3c107050 con 0x56531d6a8c40 2024-09-10T05:36:58.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.055+0000 7fbd4d60c9c0 20 remove_watcher() i=0 2024-09-10T05:36:58.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.055+0000 7fbd4d60c9c0 2 removed watcher, disabling cache 2024-09-10T05:36:58.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.055+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94914975843248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b2c50 con 0x56531d6a4780 2024-09-10T05:36:58.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.059+0000 7fbd4b913640 1 -- 172.21.15.62:0/3079192114 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94914975843248] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd4400a4d0 con 0x56531d6a4780 2024-09-10T05:36:58.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.059+0000 7fbd4d60c9c0 20 remove_watcher() i=1 2024-09-10T05:36:58.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.059+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94914975847968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56531d6dcb00 con 0x56531d6a8c40 2024-09-10T05:36:58.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.059+0000 7fbd4b112640 1 -- 172.21.15.62:0/3079192114 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94914975847968] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3c107050 con 0x56531d6a8c40 2024-09-10T05:36:58.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.059+0000 7fbd4d60c9c0 20 remove_watcher() i=2 2024-09-10T05:36:58.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.059+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94914975850272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b43b0 con 0x7fbd3c0ff030 2024-09-10T05:36:58.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.063+0000 7fbd4b913640 1 -- 172.21.15.62:0/3079192114 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94914975850272] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd4400a4d0 con 0x7fbd3c0ff030 2024-09-10T05:36:58.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.063+0000 7fbd4d60c9c0 20 remove_watcher() i=3 2024-09-10T05:36:58.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.063+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94914975851328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b5620 con 0x56531d6a8c40 2024-09-10T05:36:58.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.063+0000 7fbd4b112640 1 -- 172.21.15.62:0/3079192114 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94914975851328] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3c107050 con 0x56531d6a8c40 2024-09-10T05:36:58.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.063+0000 7fbd4d60c9c0 20 remove_watcher() i=4 2024-09-10T05:36:58.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.063+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94914975855168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56531d6dcb00 con 0x56531d6ac440 2024-09-10T05:36:58.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.067+0000 7fbd42911640 1 -- 172.21.15.62:0/3079192114 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94914975855168] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3400f6e0 con 0x56531d6ac440 2024-09-10T05:36:58.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.067+0000 7fbd4d60c9c0 20 remove_watcher() i=5 2024-09-10T05:36:58.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.067+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94914975841120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b63a0 con 0x56531d6ac440 2024-09-10T05:36:58.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.067+0000 7fbd42911640 1 -- 172.21.15.62:0/3079192114 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94914975841120] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3400f6e0 con 0x56531d6ac440 2024-09-10T05:36:58.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.067+0000 7fbd4d60c9c0 20 remove_watcher() i=6 2024-09-10T05:36:58.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.067+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94914975856224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56531d6b43b0 con 0x7fbd3c0ff030 2024-09-10T05:36:58.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.067+0000 7fbd4b913640 1 -- 172.21.15.62:0/3079192114 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94914975856224] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd4400a4d0 con 0x7fbd3c0ff030 2024-09-10T05:36:58.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.067+0000 7fbd4d60c9c0 20 remove_watcher() i=7 2024-09-10T05:36:58.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.067+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x56531d6a8c40 msgr2=0x56531d6ab030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:58.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.067+0000 7fbd4d60c9c0 1 --2- 172.21.15.62:0/3079192114 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x56531d6a8c40 0x56531d6ab030 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:58.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.067+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56531d6a4780 msgr2=0x56531d6a6c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:58.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.067+0000 7fbd4d60c9c0 1 --2- 172.21.15.62:0/3079192114 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56531d6a4780 0x56531d6a6c40 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:58.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.067+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fbd3c0ff030 msgr2=0x7fbd3c0d25c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:58.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.067+0000 7fbd4d60c9c0 1 --2- 172.21.15.62:0/3079192114 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fbd3c0ff030 0x7fbd3c0d25c0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:58.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.067+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56531d6ac440 msgr2=0x56531d6ae850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:58.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.067+0000 7fbd4d60c9c0 1 --2- 172.21.15.62:0/3079192114 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56531d6ac440 0x56531d6ae850 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:58.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.067+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fbc14039a20 msgr2=0x7fbc1403bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:58.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.067+0000 7fbd4d60c9c0 1 --2- 172.21.15.62:0/3079192114 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fbc14039a20 0x7fbc1403bee0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x56531d66d830 tx=0x7fbd34010000 comp rx=0 tx=0).stop 2024-09-10T05:36:58.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.067+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56531d571ba0 msgr2=0x56531d6997b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:58.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.067+0000 7fbd4b913640 1 -- 172.21.15.62:0/3079192114 reap_dead start 2024-09-10T05:36:58.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.067+0000 7fbd4d60c9c0 1 --2- 172.21.15.62:0/3079192114 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56531d571ba0 0x56531d6997b0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c0e8300 tx=0x7fbd3c0d5f90 comp rx=0 tx=0).stop 2024-09-10T05:36:58.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.067+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 shutdown_connections 2024-09-10T05:36:58.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.067+0000 7fbd4d60c9c0 1 --2- 172.21.15.62:0/3079192114 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56531d571ba0 0x56531d6997b0 secure :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c0e8300 tx=0x7fbd3c0d5f90 comp rx=0 tx=0).stop 2024-09-10T05:36:58.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.067+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 >> 172.21.15.62:0/3079192114 conn(0x56531d68c6c0 msgr2=0x56531d68a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:58.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.067+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 shutdown_connections 2024-09-10T05:36:58.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.067+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/3079192114 wait complete. 2024-09-10T05:36:58.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.067+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/620336597 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fbc24039a70 msgr2=0x7fbc2403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:58.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.067+0000 7fbd4d60c9c0 1 --2- 172.21.15.62:0/620336597 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fbc24039a70 0x7fbc2403bf30 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x56531d667290 tx=0x7fbd3400f000 comp rx=0 tx=0).stop 2024-09-10T05:36:58.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.067+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/620336597 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56531d683ad0 msgr2=0x56531d683ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:58.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.067+0000 7fbd4d60c9c0 1 --2- 172.21.15.62:0/620336597 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56531d683ad0 0x56531d683ef0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c0ab7b0 tx=0x7fbd3c0e2f80 comp rx=0 tx=0).stop 2024-09-10T05:36:58.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.071+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/620336597 shutdown_connections 2024-09-10T05:36:58.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.071+0000 7fbd4d60c9c0 1 --2- 172.21.15.62:0/620336597 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fbc24039a70 0x7fbc2403bf30 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:58.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.071+0000 7fbd4d60c9c0 1 --2- 172.21.15.62:0/620336597 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56531d683ad0 0x56531d683ef0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:58.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.071+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/620336597 >> 172.21.15.62:0/620336597 conn(0x56531d679480 msgr2=0x56531d679860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:58.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.071+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/620336597 shutdown_connections 2024-09-10T05:36:58.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.071+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/620336597 wait complete. 2024-09-10T05:36:58.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.071+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/2765488899 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x56531d66df90 msgr2=0x56531d670450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:58.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.071+0000 7fbd4d60c9c0 1 --2- 172.21.15.62:0/2765488899 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x56531d66df90 0x56531d670450 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:58.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.071+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/2765488899 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56531d576120 msgr2=0x56531d66cf30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:58.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.071+0000 7fbd4d60c9c0 1 --2- 172.21.15.62:0/2765488899 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56531d576120 0x56531d66cf30 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:58.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.071+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/2765488899 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56531d672980 msgr2=0x56531d674d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:58.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.071+0000 7fbd4d60c9c0 1 --2- 172.21.15.62:0/2765488899 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56531d672980 0x56531d674d70 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:58.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.071+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/2765488899 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fbc30039a70 msgr2=0x7fbc3003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:58.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.071+0000 7fbd4d60c9c0 1 --2- 172.21.15.62:0/2765488899 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fbc30039a70 0x7fbc3003bf30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbd34001e90 tx=0x7fbd340013f0 comp rx=0 tx=0).stop 2024-09-10T05:36:58.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.071+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/2765488899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56531d4e7230 msgr2=0x56531d665dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:58.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.071+0000 7fbd4d60c9c0 1 --2- 172.21.15.62:0/2765488899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56531d4e7230 0x56531d665dc0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c01b820 tx=0x7fbd3c0180e0 comp rx=0 tx=0).stop 2024-09-10T05:36:58.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.071+0000 7fbd4b913640 1 -- 172.21.15.62:0/2765488899 reap_dead start 2024-09-10T05:36:58.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.071+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/2765488899 shutdown_connections 2024-09-10T05:36:58.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.071+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/2765488899 >> 172.21.15.62:0/2765488899 conn(0x56531d56d910 msgr2=0x56531d658e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:58.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.071+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/2765488899 shutdown_connections 2024-09-10T05:36:58.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.071+0000 7fbd4d60c9c0 1 -- 172.21.15.62:0/2765488899 wait complete. 2024-09-10T05:36:58.084 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T05:36:30.893777Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:36:30.893760Z', 'tags': [], 'group_ids': []} 2024-09-10T05:36:58.097 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T05:36:58.098 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-10T05:36:58.098 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-10T05:36:58.098 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-10T05:36:58.165 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:36:58.165 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:36:58.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.163+0000 7f2e266919c0 1 Processor -- start 2024-09-10T05:36:58.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.163+0000 7f2e266919c0 1 -- start start 2024-09-10T05:36:58.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.163+0000 7f2e266919c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x555910591350 0x555910593740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:58.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.163+0000 7f2e266919c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5559104419c0 con 0x555910501200 2024-09-10T05:36:58.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.163+0000 7f2e266919c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x5559104916d0 con 0x555910591350 2024-09-10T05:36:58.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.163+0000 7f2e23996640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x555910591350 0x555910593740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:58.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.163+0000 7f2e23996640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x555910591350 0x555910593740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:48274/0 (socket says 172.21.15.62:48274) 2024-09-10T05:36:58.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.163+0000 7f2e23996640 1 -- 172.21.15.62:0/2335849339 learned_addr learned my addr 172.21.15.62:0/2335849339 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:58.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.163+0000 7f2e24197640 1 --1- 172.21.15.62:0/2335849339 >> v1:172.21.15.2:6789/0 conn(0x555910501200 0x55591058fc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:58410/0 (socket says 172.21.15.62:58410) 2024-09-10T05:36:58.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.163+0000 7f2e23996640 1 -- 172.21.15.62:0/2335849339 >> v1:172.21.15.2:6789/0 conn(0x555910501200 legacy=0x55591058fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:58.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.163+0000 7f2e23996640 1 -- 172.21.15.62:0/2335849339 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555910435ca0 con 0x555910591350 2024-09-10T05:36:58.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.167+0000 7f2e23996640 1 --2- 172.21.15.62:0/2335849339 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555910591350 0x555910593740 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f2e1800a5c0 tx=0x7f2e1801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf85b63bc8ea32fd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:58.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.167+0000 7f2e23195640 1 -- 172.21.15.62:0/2335849339 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e180b1070 con 0x555910591350 2024-09-10T05:36:58.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.167+0000 7f2e23195640 1 -- 172.21.15.62:0/2335849339 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e180a8070 con 0x555910591350 2024-09-10T05:36:58.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.167+0000 7f2e23195640 1 -- 172.21.15.62:0/2335849339 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e180ac5b0 con 0x555910591350 2024-09-10T05:36:58.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.167+0000 7f2e266919c0 1 -- 172.21.15.62:0/2335849339 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555910591350 msgr2=0x555910593740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:58.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.167+0000 7f2e266919c0 1 --2- 172.21.15.62:0/2335849339 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555910591350 0x555910593740 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f2e1800a5c0 tx=0x7f2e1801b340 comp rx=0 tx=0).stop 2024-09-10T05:36:58.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.167+0000 7f2e266919c0 1 -- 172.21.15.62:0/2335849339 shutdown_connections 2024-09-10T05:36:58.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.167+0000 7f2e266919c0 1 --2- 172.21.15.62:0/2335849339 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555910591350 0x555910593740 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:58.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.167+0000 7f2e266919c0 1 -- 172.21.15.62:0/2335849339 >> 172.21.15.62:0/2335849339 conn(0x555910587920 msgr2=0x555910589d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:58.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.167+0000 7f2e266919c0 1 -- 172.21.15.62:0/2335849339 shutdown_connections 2024-09-10T05:36:58.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.167+0000 7f2e266919c0 1 -- 172.21.15.62:0/2335849339 wait complete. 2024-09-10T05:36:58.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.183+0000 7f2e266919c0 1 Processor -- start 2024-09-10T05:36:58.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.183+0000 7f2e266919c0 1 -- start start 2024-09-10T05:36:58.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.183+0000 7f2e266919c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555910501200 0x555910678800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:58.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.183+0000 7f2e266919c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555910495680 con 0x555910501200 2024-09-10T05:36:58.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.183+0000 7f2e24197640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555910501200 0x555910678800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:58.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.183+0000 7f2e24197640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555910501200 0x555910678800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:48280/0 (socket says 172.21.15.62:48280) 2024-09-10T05:36:58.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.183+0000 7f2e24197640 1 -- 172.21.15.62:0/1332944997 learned_addr learned my addr 172.21.15.62:0/1332944997 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:58.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.183+0000 7f2e24197640 1 -- 172.21.15.62:0/1332944997 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555910410da0 con 0x555910501200 2024-09-10T05:36:58.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.183+0000 7f2e24197640 1 --2- 172.21.15.62:0/1332944997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555910501200 0x555910678800 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c0016f0 tx=0x7f2e1c001bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de6dc1ad75d9394c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:58.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.187+0000 7f2d1260c640 1 -- 172.21.15.62:0/1332944997 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e1c003460 con 0x555910501200 2024-09-10T05:36:58.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.187+0000 7f2d1260c640 1 -- 172.21.15.62:0/1332944997 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e1c003620 con 0x555910501200 2024-09-10T05:36:58.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.187+0000 7f2d1260c640 1 -- 172.21.15.62:0/1332944997 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e1c003940 con 0x555910501200 2024-09-10T05:36:58.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.187+0000 7f2e266919c0 1 -- 172.21.15.62:0/1332944997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555910501200 msgr2=0x555910678800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:58.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.187+0000 7f2e266919c0 1 --2- 172.21.15.62:0/1332944997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555910501200 0x555910678800 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c0016f0 tx=0x7f2e1c001bb0 comp rx=0 tx=0).stop 2024-09-10T05:36:58.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.187+0000 7f2e266919c0 1 -- 172.21.15.62:0/1332944997 shutdown_connections 2024-09-10T05:36:58.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.187+0000 7f2e266919c0 1 --2- 172.21.15.62:0/1332944997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555910501200 0x555910678800 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:58.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.187+0000 7f2e266919c0 1 -- 172.21.15.62:0/1332944997 >> 172.21.15.62:0/1332944997 conn(0x555910587920 msgr2=0x555910674440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:58.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.187+0000 7f2e266919c0 1 -- 172.21.15.62:0/1332944997 shutdown_connections 2024-09-10T05:36:58.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.187+0000 7f2e266919c0 1 -- 172.21.15.62:0/1332944997 wait complete. 2024-09-10T05:36:58.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.187+0000 7f2e266919c0 1 Processor -- start 2024-09-10T05:36:58.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.187+0000 7f2e266919c0 1 -- start start 2024-09-10T05:36:58.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.187+0000 7f2e266919c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555910501200 0x55591058d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:58.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.187+0000 7f2e266919c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555910437a50 con 0x555910501200 2024-09-10T05:36:58.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.187+0000 7f2e24197640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555910501200 0x55591058d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:58.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.187+0000 7f2e24197640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555910501200 0x55591058d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:48284/0 (socket says 172.21.15.62:48284) 2024-09-10T05:36:58.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.187+0000 7f2e24197640 1 -- 172.21.15.62:0/891703845 learned_addr learned my addr 172.21.15.62:0/891703845 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:58.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.187+0000 7f2e24197640 1 -- 172.21.15.62:0/891703845 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55591058d870 con 0x555910501200 2024-09-10T05:36:58.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.187+0000 7f2e24197640 1 --2- 172.21.15.62:0/891703845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555910501200 0x55591058d310 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x555910679790 tx=0x7f2e1c001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:58.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.187+0000 7f2d10e09640 1 -- 172.21.15.62:0/891703845 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e1c022020 con 0x555910501200 2024-09-10T05:36:58.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.187+0000 7f2d10e09640 1 -- 172.21.15.62:0/891703845 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e1c01e480 con 0x555910501200 2024-09-10T05:36:58.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.187+0000 7f2e266919c0 1 -- 172.21.15.62:0/891703845 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55591058bc50 con 0x555910501200 2024-09-10T05:36:58.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.187+0000 7f2d10e09640 1 -- 172.21.15.62:0/891703845 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e1c01e780 con 0x555910501200 2024-09-10T05:36:58.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.187+0000 7f2e266919c0 1 -- 172.21.15.62:0/891703845 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55591058c240 con 0x555910501200 2024-09-10T05:36:58.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.191+0000 7f2d10e09640 1 -- 172.21.15.62:0/891703845 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2e1c025020 con 0x555910501200 2024-09-10T05:36:58.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.191+0000 7f2d10e09640 1 --2- 172.21.15.62:0/891703845 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2d0c039ac0 0x7f2d0c03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:58.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.191+0000 7f2d10e09640 1 -- 172.21.15.62:0/891703845 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7f2e1c050150 con 0x555910501200 2024-09-10T05:36:58.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.191+0000 7f2e23996640 1 --2- 172.21.15.62:0/891703845 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2d0c039ac0 0x7f2d0c03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:58.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.191+0000 7f2e266919c0 1 --2- 172.21.15.62:0/891703845 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x555910591350 0x555910689220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:58.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.191+0000 7f2e266919c0 1 -- 172.21.15.62:0/891703845 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555910689760 con 0x555910591350 2024-09-10T05:36:58.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.191+0000 7f2e24998640 1 --2- 172.21.15.62:0/891703845 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x555910591350 0x555910689220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:58.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.191+0000 7f2e23996640 1 --2- 172.21.15.62:0/891703845 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2d0c039ac0 0x7f2d0c03bf80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2e180ae000 tx=0x7f2e180a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:58.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.191+0000 7f2e24998640 1 --2- 172.21.15.62:0/891703845 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x555910591350 0x555910689220 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:58.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.191+0000 7f2e24998640 1 -- 172.21.15.62:0/891703845 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e140083f0 con 0x555910591350 2024-09-10T05:36:58.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.191+0000 7f2e266919c0 1 --2- 172.21.15.62:0/891703845 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55591068a1d0 0x55591068c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:58.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.191+0000 7f2e266919c0 1 -- 172.21.15.62:0/891703845 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55591068ce00 con 0x55591068a1d0 2024-09-10T05:36:58.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.191+0000 7f2e24197640 1 --2- 172.21.15.62:0/891703845 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55591068a1d0 0x55591068c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:58.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.191+0000 7f2e24197640 1 --2- 172.21.15.62:0/891703845 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55591068a1d0 0x55591068c690 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:58.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.191+0000 7f2e24197640 1 -- 172.21.15.62:0/891703845 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2e1c01b040 con 0x55591068a1d0 2024-09-10T05:36:58.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.191+0000 7f2e266919c0 1 --2- 172.21.15.62:0/891703845 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55591068ebc0 0x555910690fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:58.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.191+0000 7f2e266919c0 1 -- 172.21.15.62:0/891703845 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559106916a0 con 0x55591068ebc0 2024-09-10T05:36:58.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.191+0000 7f2e23996640 1 --2- 172.21.15.62:0/891703845 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55591068ebc0 0x555910690fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:58.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.195+0000 7f2e23996640 1 --2- 172.21.15.62:0/891703845 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55591068ebc0 0x555910690fb0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:58.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.195+0000 7f2e23996640 1 -- 172.21.15.62:0/891703845 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2e180b4040 con 0x55591068ebc0 2024-09-10T05:36:58.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.195+0000 7f2e266919c0 1 -- 172.21.15.62:0/891703845 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55591068da60 con 0x55591068a1d0 2024-09-10T05:36:58.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.195+0000 7f2e24197640 1 -- 172.21.15.62:0/891703845 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2e1c01b040 con 0x55591068a1d0 2024-09-10T05:36:58.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.195+0000 7f2e266919c0 1 -- 172.21.15.62:0/891703845 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55591068df00 con 0x55591068ebc0 2024-09-10T05:36:58.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.195+0000 7f2e23996640 1 -- 172.21.15.62:0/891703845 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2e180b4040 con 0x55591068ebc0 2024-09-10T05:36:58.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.195+0000 7f2e266919c0 1 Processor -- start 2024-09-10T05:36:58.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.195+0000 7f2e266919c0 1 -- start start 2024-09-10T05:36:58.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.195+0000 7f2e266919c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55591069fcd0 0x5559106a00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:58.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.195+0000 7f2e266919c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5559104a2450 con 0x55591069fcd0 2024-09-10T05:36:58.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.195+0000 7f2e24197640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55591069fcd0 0x5559106a00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:58.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.195+0000 7f2e24197640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55591069fcd0 0x5559106a00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:48290/0 (socket says 172.21.15.62:48290) 2024-09-10T05:36:58.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.195+0000 7f2e24197640 1 -- 172.21.15.62:0/1007251095 learned_addr learned my addr 172.21.15.62:0/1007251095 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:58.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.195+0000 7f2e24197640 1 -- 172.21.15.62:0/1007251095 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559106a0730 con 0x55591069fcd0 2024-09-10T05:36:58.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.199+0000 7f2e24197640 1 --2- 172.21.15.62:0/1007251095 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55591069fcd0 0x5559106a00f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c04e540 tx=0x7f2e1c01eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:58.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.199+0000 7f2d09ffb640 1 -- 172.21.15.62:0/1007251095 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e1c010c20 con 0x55591069fcd0 2024-09-10T05:36:58.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.199+0000 7f2d09ffb640 1 -- 172.21.15.62:0/1007251095 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e1c010dc0 con 0x55591069fcd0 2024-09-10T05:36:58.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.199+0000 7f2e266919c0 1 -- 172.21.15.62:0/1007251095 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5559106a0f90 con 0x55591069fcd0 2024-09-10T05:36:58.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.199+0000 7f2d09ffb640 1 -- 172.21.15.62:0/1007251095 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e1c010690 con 0x55591069fcd0 2024-09-10T05:36:58.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.199+0000 7f2e266919c0 1 -- 172.21.15.62:0/1007251095 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559106a1500 con 0x55591069fcd0 2024-09-10T05:36:58.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.199+0000 7f2d09ffb640 1 -- 172.21.15.62:0/1007251095 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2e1c0473e0 con 0x55591069fcd0 2024-09-10T05:36:58.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.199+0000 7f2d09ffb640 1 --2- 172.21.15.62:0/1007251095 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2cfc039ac0 0x7f2cfc03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:58.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.199+0000 7f2d09ffb640 1 -- 172.21.15.62:0/1007251095 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7f2e1c039bc0 con 0x55591069fcd0 2024-09-10T05:36:58.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.199+0000 7f2e23996640 1 --2- 172.21.15.62:0/1007251095 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2cfc039ac0 0x7f2cfc03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:58.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.199+0000 7f2e266919c0 1 Processor -- start 2024-09-10T05:36:58.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.199+0000 7f2e266919c0 1 -- start start 2024-09-10T05:36:58.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.199+0000 7f2e266919c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559106ac3f0 0x5559106ac7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:58.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.199+0000 7f2e266919c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555910678ff0 con 0x5559106ac3f0 2024-09-10T05:36:58.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.199+0000 7f2e23996640 1 --2- 172.21.15.62:0/1007251095 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2cfc039ac0 0x7f2cfc03bf80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x55591068da30 tx=0x7f2e18005ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:58.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.199+0000 7f2e24197640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559106ac3f0 0x5559106ac7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:58.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.199+0000 7f2e24197640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559106ac3f0 0x5559106ac7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:48300/0 (socket says 172.21.15.62:48300) 2024-09-10T05:36:58.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.199+0000 7f2e24197640 1 -- 172.21.15.62:0/3988127282 learned_addr learned my addr 172.21.15.62:0/3988127282 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:58.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.199+0000 7f2e24197640 1 -- 172.21.15.62:0/3988127282 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559106acda0 con 0x5559106ac3f0 2024-09-10T05:36:58.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.199+0000 7f2e24197640 1 --2- 172.21.15.62:0/3988127282 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559106ac3f0 0x5559106ac7d0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c04d340 tx=0x7f2e1c030cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e50a139e5d09fb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:58.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.199+0000 7f2d037fe640 1 -- 172.21.15.62:0/3988127282 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e1c061070 con 0x5559106ac3f0 2024-09-10T05:36:58.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.203+0000 7f2d037fe640 1 -- 172.21.15.62:0/3988127282 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e1c01d860 con 0x5559106ac3f0 2024-09-10T05:36:58.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.203+0000 7f2d037fe640 1 -- 172.21.15.62:0/3988127282 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e1c0476d0 con 0x5559106ac3f0 2024-09-10T05:36:58.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.203+0000 7f2e266919c0 1 -- 172.21.15.62:0/3988127282 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559106ac3f0 msgr2=0x5559106ac7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:58.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.203+0000 7f2e266919c0 1 --2- 172.21.15.62:0/3988127282 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559106ac3f0 0x5559106ac7d0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c04d340 tx=0x7f2e1c030cd0 comp rx=0 tx=0).stop 2024-09-10T05:36:58.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.203+0000 7f2e266919c0 1 -- 172.21.15.62:0/3988127282 shutdown_connections 2024-09-10T05:36:58.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.203+0000 7f2e266919c0 1 --2- 172.21.15.62:0/3988127282 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559106ac3f0 0x5559106ac7d0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:58.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.203+0000 7f2e266919c0 1 -- 172.21.15.62:0/3988127282 >> 172.21.15.62:0/3988127282 conn(0x5559106a8820 msgr2=0x5559106a6a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:58.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.203+0000 7f2e266919c0 1 -- 172.21.15.62:0/3988127282 shutdown_connections 2024-09-10T05:36:58.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.203+0000 7f2e266919c0 1 -- 172.21.15.62:0/3988127282 wait complete. 2024-09-10T05:36:58.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.203+0000 7f2e266919c0 1 Processor -- start 2024-09-10T05:36:58.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.203+0000 7f2e266919c0 1 -- start start 2024-09-10T05:36:58.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.203+0000 7f2e266919c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559106ac3f0 0x5559106b36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:58.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.203+0000 7f2e266919c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5559106ad280 con 0x5559106ac3f0 2024-09-10T05:36:58.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.203+0000 7f2e24197640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559106ac3f0 0x5559106b36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:58.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.203+0000 7f2e24197640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559106ac3f0 0x5559106b36d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:48304/0 (socket says 172.21.15.62:48304) 2024-09-10T05:36:58.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.203+0000 7f2e24197640 1 -- 172.21.15.62:0/4198260416 learned_addr learned my addr 172.21.15.62:0/4198260416 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:36:58.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.203+0000 7f2e24197640 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559106b3c30 con 0x5559106ac3f0 2024-09-10T05:36:58.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.203+0000 7f2e24197640 1 --2- 172.21.15.62:0/4198260416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559106ac3f0 0x5559106b36d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c01df30 tx=0x7f2e1c011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:58.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.203+0000 7f2d01ffb640 1 -- 172.21.15.62:0/4198260416 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e1c06b070 con 0x5559106ac3f0 2024-09-10T05:36:58.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.203+0000 7f2d01ffb640 1 -- 172.21.15.62:0/4198260416 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e1c010900 con 0x5559106ac3f0 2024-09-10T05:36:58.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.203+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5559106b3c30 con 0x5559106ac3f0 2024-09-10T05:36:58.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.203+0000 7f2d01ffb640 1 -- 172.21.15.62:0/4198260416 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e1c061040 con 0x5559106ac3f0 2024-09-10T05:36:58.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.203+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559106b3c30 con 0x5559106ac3f0 2024-09-10T05:36:58.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.203+0000 7f2d01ffb640 1 -- 172.21.15.62:0/4198260416 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2e1c015120 con 0x5559106ac3f0 2024-09-10T05:36:58.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.207+0000 7f2d01ffb640 1 --2- 172.21.15.62:0/4198260416 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2cf4039a20 0x7f2cf403bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:58.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.207+0000 7f2d01ffb640 1 -- 172.21.15.62:0/4198260416 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7f2e1c068bc0 con 0x5559106ac3f0 2024-09-10T05:36:58.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.207+0000 7f2e23996640 1 --2- 172.21.15.62:0/4198260416 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2cf4039a20 0x7f2cf403bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:58.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.207+0000 7f2e266919c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:58.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.207+0000 7f2e266919c0 1 --2- 172.21.15.62:0/4198260416 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5559106be650 0x5559106c0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:58.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.207+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559106c1260 con 0x5559106be650 2024-09-10T05:36:58.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.207+0000 7f2e24998640 1 --2- 172.21.15.62:0/4198260416 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5559106be650 0x5559106c0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:58.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.207+0000 7f2e23996640 1 --2- 172.21.15.62:0/4198260416 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2cf4039a20 0x7f2cf403bee0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2e180c13f0 tx=0x7f2e180a8000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:58.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.207+0000 7f2e24998640 1 --2- 172.21.15.62:0/4198260416 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5559106be650 0x5559106c0b10 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:58.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.207+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e140083f0 con 0x5559106be650 2024-09-10T05:36:58.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.207+0000 7f2e266919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:58.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.207+0000 7f2e266919c0 20 realm 2024-09-10T05:36:58.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.207+0000 7f2e266919c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:58.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.207+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559106bd980 con 0x5559106be650 2024-09-10T05:36:58.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.207+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e140083f0 con 0x5559106be650 2024-09-10T05:36:58.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.207+0000 7f2e266919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:58.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.207+0000 7f2e266919c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:36:58.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.207+0000 7f2e266919c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:58.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.207+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559106c1d30 con 0x5559106be650 2024-09-10T05:36:58.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.207+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e140083f0 con 0x5559106be650 2024-09-10T05:36:58.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.207+0000 7f2e266919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:58.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.207+0000 7f2e266919c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:58.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.207+0000 7f2e266919c0 1 --2- 172.21.15.62:0/4198260416 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5559106c2b10 0x5559106c4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:58.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.207+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559106c5590 con 0x5559106c2b10 2024-09-10T05:36:58.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.207+0000 7f2e24197640 1 --2- 172.21.15.62:0/4198260416 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5559106c2b10 0x5559106c4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:58.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.207+0000 7f2e24197640 1 --2- 172.21.15.62:0/4198260416 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5559106c2b10 0x5559106c4f00 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:58.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.207+0000 7f2e24197640 1 -- 172.21.15.62:0/4198260416 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2e1c064050 con 0x5559106c2b10 2024-09-10T05:36:58.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.207+0000 7f2e266919c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:58.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.207+0000 7f2e266919c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:58.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.207+0000 7f2e266919c0 1 --2- 172.21.15.62:0/4198260416 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5559106c62f0 0x5559106c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:58.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.207+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559106c8e90 con 0x5559106c62f0 2024-09-10T05:36:58.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.211+0000 7f2e23996640 1 --2- 172.21.15.62:0/4198260416 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5559106c62f0 0x5559106c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:58.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.211+0000 7f2e23996640 1 --2- 172.21.15.62:0/4198260416 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5559106c62f0 0x5559106c8700 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:58.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.211+0000 7f2e23996640 1 -- 172.21.15.62:0/4198260416 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2e180b4040 con 0x5559106c62f0 2024-09-10T05:36:58.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.211+0000 7f2e266919c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:36:58.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.211+0000 7f2e266919c0 20 searching for the correct realm 2024-09-10T05:36:58.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.211+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559106ca760 con 0x5559106c62f0 2024-09-10T05:36:58.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.211+0000 7f2e23996640 1 -- 172.21.15.62:0/4198260416 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e180b4040 con 0x5559106c62f0 2024-09-10T05:36:58.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.211+0000 7f2e23996640 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559106ca760 con 0x5559106c2b10 2024-09-10T05:36:58.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.211+0000 7f2e24197640 1 -- 172.21.15.62:0/4198260416 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e1c064050 con 0x5559106c2b10 2024-09-10T05:36:58.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.211+0000 7f2e24197640 1 --2- 172.21.15.62:0/4198260416 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f2e1c027020 0x7f2e1c0394a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:36:58.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.211+0000 7f2e24197640 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559106ca760 con 0x7f2e1c027020 2024-09-10T05:36:58.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.211+0000 7f2e24998640 1 --2- 172.21.15.62:0/4198260416 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f2e1c027020 0x7f2e1c0394a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:36:58.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.211+0000 7f2e24998640 1 --2- 172.21.15.62:0/4198260416 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f2e1c027020 0x7f2e1c0394a0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:36:58.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.211+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e140083f0 con 0x7f2e1c027020 2024-09-10T05:36:58.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.211+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559106ca760 con 0x5559106be650 2024-09-10T05:36:58.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.211+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e140083f0 con 0x5559106be650 2024-09-10T05:36:58.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.211+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559106ca760 con 0x5559106be650 2024-09-10T05:36:58.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.211+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e140083f0 con 0x5559106be650 2024-09-10T05:36:58.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.211+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559106ca760 con 0x5559106c62f0 2024-09-10T05:36:58.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.211+0000 7f2e23996640 1 -- 172.21.15.62:0/4198260416 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e180b4040 con 0x5559106c62f0 2024-09-10T05:36:58.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.211+0000 7f2e23996640 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559106ca760 con 0x5559106be650 2024-09-10T05:36:58.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.211+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e140083f0 con 0x5559106be650 2024-09-10T05:36:58.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.211+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559106ca760 con 0x5559106c2b10 2024-09-10T05:36:58.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.215+0000 7f2e24197640 1 -- 172.21.15.62:0/4198260416 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e1c064050 con 0x5559106c2b10 2024-09-10T05:36:58.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.215+0000 7f2e24197640 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559106ca760 con 0x5559106c2b10 2024-09-10T05:36:58.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.215+0000 7f2e24197640 1 -- 172.21.15.62:0/4198260416 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e1c064050 con 0x5559106c2b10 2024-09-10T05:36:58.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.215+0000 7f2e24197640 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559106ca760 con 0x5559106be650 2024-09-10T05:36:58.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.215+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e140083f0 con 0x5559106be650 2024-09-10T05:36:58.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.215+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559106ca760 con 0x7f2e1c027020 2024-09-10T05:36:58.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.215+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e140083f0 con 0x7f2e1c027020 2024-09-10T05:36:58.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.215+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559106ca760 con 0x5559106be650 2024-09-10T05:36:58.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.215+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e140083f0 con 0x5559106be650 2024-09-10T05:36:58.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.215+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559106ca760 con 0x7f2e1c027020 2024-09-10T05:36:58.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.215+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2e140083f0 con 0x7f2e1c027020 2024-09-10T05:36:58.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.215+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559106ca760 con 0x5559106c2b10 2024-09-10T05:36:58.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.215+0000 7f2e24197640 1 -- 172.21.15.62:0/4198260416 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e1c064050 con 0x5559106c2b10 2024-09-10T05:36:58.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.215+0000 7f2e24197640 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559106ca760 con 0x5559106c62f0 2024-09-10T05:36:58.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.215+0000 7f2e23996640 1 -- 172.21.15.62:0/4198260416 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e180b4040 con 0x5559106c62f0 2024-09-10T05:36:58.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.215+0000 7f2e23996640 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559106ca760 con 0x5559106be650 2024-09-10T05:36:58.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.215+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e140083f0 con 0x5559106be650 2024-09-10T05:36:58.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.215+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559106ca760 con 0x5559106c2b10 2024-09-10T05:36:58.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.219+0000 7f2e24197640 1 -- 172.21.15.62:0/4198260416 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e1c064050 con 0x5559106c2b10 2024-09-10T05:36:58.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.219+0000 7f2e24197640 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559106ca760 con 0x5559106c62f0 2024-09-10T05:36:58.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.219+0000 7f2e23996640 1 -- 172.21.15.62:0/4198260416 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 32 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f2e180b4040 con 0x5559106c62f0 2024-09-10T05:36:58.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.219+0000 7f2e23996640 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559106ca760 con 0x5559106be650 2024-09-10T05:36:58.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.219+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e140083f0 con 0x5559106be650 2024-09-10T05:36:58.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.219+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559106ca760 con 0x5559106be650 2024-09-10T05:36:58.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.219+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2e140083f0 con 0x5559106be650 2024-09-10T05:36:58.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.219+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559106ca760 con 0x5559106be650 2024-09-10T05:36:58.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.219+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e140083f0 con 0x5559106be650 2024-09-10T05:36:58.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.219+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559106ca760 con 0x5559106c62f0 2024-09-10T05:36:58.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.219+0000 7f2e23996640 1 -- 172.21.15.62:0/4198260416 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e180b4040 con 0x5559106c62f0 2024-09-10T05:36:58.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.219+0000 7f2e23996640 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559106ca760 con 0x7f2e1c027020 2024-09-10T05:36:58.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.219+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e140083f0 con 0x7f2e1c027020 2024-09-10T05:36:58.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.219+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559106ca760 con 0x5559106be650 2024-09-10T05:36:58.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.219+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e140083f0 con 0x5559106be650 2024-09-10T05:36:58.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.219+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559106ca760 con 0x7f2e1c027020 2024-09-10T05:36:58.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.219+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e140083f0 con 0x7f2e1c027020 2024-09-10T05:36:58.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.219+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559106ca760 con 0x5559106c62f0 2024-09-10T05:36:58.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.219+0000 7f2e23996640 1 -- 172.21.15.62:0/4198260416 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e180b4040 con 0x5559106c62f0 2024-09-10T05:36:58.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.219+0000 7f2e23996640 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559106ca760 con 0x7f2e1c027020 2024-09-10T05:36:58.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.219+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e140083f0 con 0x7f2e1c027020 2024-09-10T05:36:58.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.219+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559106ca760 con 0x5559106c2b10 2024-09-10T05:36:58.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.223+0000 7f2e24197640 1 -- 172.21.15.62:0/4198260416 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e1c064050 con 0x5559106c2b10 2024-09-10T05:36:58.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.223+0000 7f2e24197640 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559106ca760 con 0x5559106c2b10 2024-09-10T05:36:58.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.223+0000 7f2e24197640 1 -- 172.21.15.62:0/4198260416 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e1c064050 con 0x5559106c2b10 2024-09-10T05:36:58.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.223+0000 7f2e24197640 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559106ca760 con 0x5559106c62f0 2024-09-10T05:36:58.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.223+0000 7f2e23996640 1 -- 172.21.15.62:0/4198260416 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e180b4040 con 0x5559106c62f0 2024-09-10T05:36:58.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.223+0000 7f2e23996640 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559106ca760 con 0x5559106c2b10 2024-09-10T05:36:58.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.223+0000 7f2e24197640 1 -- 172.21.15.62:0/4198260416 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2e1c064050 con 0x5559106c2b10 2024-09-10T05:36:58.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.223+0000 7f2e24197640 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559106ca760 con 0x5559106c2b10 2024-09-10T05:36:58.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.223+0000 7f2e24197640 1 -- 172.21.15.62:0/4198260416 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e1c064050 con 0x5559106c2b10 2024-09-10T05:36:58.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.223+0000 7f2e266919c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:36:58.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.223+0000 7f2e266919c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:36:58.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.223+0000 7f2e266919c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:36:58.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.223+0000 7f2e266919c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:36:58.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.223+0000 7f2e266919c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:36:58.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.223+0000 7f2e266919c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:36:58.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.223+0000 7f2e266919c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:58.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.223+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559106c9850 con 0x5559106be650 2024-09-10T05:36:58.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.223+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e140083f0 con 0x5559106be650 2024-09-10T05:36:58.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.223+0000 7f2e266919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:58.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.223+0000 7f2e266919c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:58.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.223+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559106c9460 con 0x5559106c2b10 2024-09-10T05:36:58.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.227+0000 7f2e24197640 1 -- 172.21.15.62:0/4198260416 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2e1c064050 con 0x5559106c2b10 2024-09-10T05:36:58.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.227+0000 7f2e266919c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:36:58.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.227+0000 7f2e266919c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:58.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.227+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559106ca180 con 0x5559106c62f0 2024-09-10T05:36:58.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.227+0000 7f2e23996640 1 -- 172.21.15.62:0/4198260416 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2e180b4040 con 0x5559106c62f0 2024-09-10T05:36:58.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.227+0000 7f2e266919c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:36:58.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.227+0000 7f2e266919c0 20 zone default found 2024-09-10T05:36:58.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.227+0000 7f2e266919c0 4 Realm: () 2024-09-10T05:36:58.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.227+0000 7f2e266919c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:36:58.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.227+0000 7f2e266919c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:36:58.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.227+0000 7f2e266919c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:36:58.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.227+0000 7f2e266919c0 20 zonegroup default 2024-09-10T05:36:58.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.227+0000 7f2e266919c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:58.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.227+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559106cb040 con 0x7f2e1c027020 2024-09-10T05:36:58.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.227+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2e140083f0 con 0x7f2e1c027020 2024-09-10T05:36:58.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.227+0000 7f2e266919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:58.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.227+0000 7f2e266919c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:58.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.227+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559106cd280 con 0x5559106c62f0 2024-09-10T05:36:58.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.227+0000 7f2e23996640 1 -- 172.21.15.62:0/4198260416 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2e180b4040 con 0x5559106c62f0 2024-09-10T05:36:58.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.227+0000 7f2e266919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:58.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.227+0000 7f2e266919c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:58.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.227+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559106cd620 con 0x5559106c62f0 2024-09-10T05:36:58.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.227+0000 7f2e23996640 1 -- 172.21.15.62:0/4198260416 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2e180b4040 con 0x5559106c62f0 2024-09-10T05:36:58.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.227+0000 7f2e266919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:36:58.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.227+0000 7f2e266919c0 20 started sync module instance, tier type = 2024-09-10T05:36:58.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.227+0000 7f2e266919c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:36:58.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.227+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106cc6c0 con 0x5559106c2b10 2024-09-10T05:36:58.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.231+0000 7f2e24197640 1 -- 172.21.15.62:0/4198260416 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e1c064050 con 0x5559106c2b10 2024-09-10T05:36:58.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.231+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93841016015536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106cced0 con 0x5559106c2b10 2024-09-10T05:36:58.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.231+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106ce320 con 0x5559106be650 2024-09-10T05:36:58.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.231+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e140083f0 con 0x5559106be650 2024-09-10T05:36:58.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.231+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93841016022720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106cef90 con 0x5559106be650 2024-09-10T05:36:58.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.231+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106cf950 con 0x5559106c2b10 2024-09-10T05:36:58.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.231+0000 7f2e24197640 1 -- 172.21.15.62:0/4198260416 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 93841016015536] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e1c064050 con 0x5559106c2b10 2024-09-10T05:36:58.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.231+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93841016022720] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e140083f0 con 0x5559106be650 2024-09-10T05:36:58.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.235+0000 7f2e24197640 1 -- 172.21.15.62:0/4198260416 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e1c064050 con 0x5559106c2b10 2024-09-10T05:36:58.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.235+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93841016023776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106cef00 con 0x5559106c2b10 2024-09-10T05:36:58.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.235+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106cfe00 con 0x7f2e1c027020 2024-09-10T05:36:58.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.235+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e140083f0 con 0x7f2e1c027020 2024-09-10T05:36:58.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.235+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93841016027472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106d0220 con 0x7f2e1c027020 2024-09-10T05:36:58.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.235+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106d0c20 con 0x5559106c2b10 2024-09-10T05:36:58.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.235+0000 7f2e24197640 1 -- 172.21.15.62:0/4198260416 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93841016023776] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e1c064050 con 0x5559106c2b10 2024-09-10T05:36:58.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.239+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93841016027472] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e140083f0 con 0x7f2e1c027020 2024-09-10T05:36:58.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.239+0000 7f2e24197640 1 -- 172.21.15.62:0/4198260416 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e1c064050 con 0x5559106c2b10 2024-09-10T05:36:58.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.239+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93841016026272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106cfd70 con 0x5559106c2b10 2024-09-10T05:36:58.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.239+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106d14c0 con 0x5559106c62f0 2024-09-10T05:36:58.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.239+0000 7f2e23996640 1 -- 172.21.15.62:0/4198260416 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e180b4040 con 0x5559106c62f0 2024-09-10T05:36:58.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.239+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93841016033296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106cfd70 con 0x5559106c62f0 2024-09-10T05:36:58.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.239+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106d1f00 con 0x5559106c62f0 2024-09-10T05:36:58.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.239+0000 7f2e24197640 1 -- 172.21.15.62:0/4198260416 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 93841016026272] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e1c064050 con 0x5559106c2b10 2024-09-10T05:36:58.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.243+0000 7f2e23996640 1 -- 172.21.15.62:0/4198260416 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93841016033296] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e180b4040 con 0x5559106c62f0 2024-09-10T05:36:58.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.243+0000 7f2e23996640 1 -- 172.21.15.62:0/4198260416 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e180b4040 con 0x5559106c62f0 2024-09-10T05:36:58.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.243+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93841016034352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106d1a50 con 0x5559106c62f0 2024-09-10T05:36:58.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.243+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106d27a0 con 0x7f2e1c027020 2024-09-10T05:36:58.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.243+0000 7f2e23996640 1 -- 172.21.15.62:0/4198260416 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93841016034352] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e180b4040 con 0x5559106c62f0 2024-09-10T05:36:58.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.243+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e140083f0 con 0x7f2e1c027020 2024-09-10T05:36:58.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.243+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93841016031024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106d1a50 con 0x7f2e1c027020 2024-09-10T05:36:58.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.243+0000 7f2e266919c0 20 add_watcher() i=0 2024-09-10T05:36:58.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.243+0000 7f2e266919c0 20 add_watcher() i=1 2024-09-10T05:36:58.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.243+0000 7f2e266919c0 20 add_watcher() i=2 2024-09-10T05:36:58.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.243+0000 7f2e266919c0 20 add_watcher() i=3 2024-09-10T05:36:58.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.243+0000 7f2e266919c0 20 add_watcher() i=4 2024-09-10T05:36:58.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.243+0000 7f2e266919c0 20 add_watcher() i=5 2024-09-10T05:36:58.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.243+0000 7f2e266919c0 20 add_watcher() i=6 2024-09-10T05:36:58.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.243+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93841016031024] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e140083f0 con 0x7f2e1c027020 2024-09-10T05:36:58.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.243+0000 7f2e266919c0 20 add_watcher() i=7 2024-09-10T05:36:58.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.243+0000 7f2e266919c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:36:58.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.243+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559106d5830 con 0x5559106be650 2024-09-10T05:36:58.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.243+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2e140083f0 con 0x5559106be650 2024-09-10T05:36:58.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.243+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93841016038128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106d2d80 con 0x5559106be650 2024-09-10T05:36:58.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.247+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93841016038128] v32'197 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2e140083f0 con 0x5559106be650 2024-09-10T05:36:58.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.247+0000 7f2cda7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:58.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.247+0000 7f2e266919c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:36:58.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.247+0000 7f2e266919c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:36:58.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.247+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106de0a0 con 0x5559106c2b10 2024-09-10T05:36:58.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.251+0000 7f2e24197640 1 -- 172.21.15.62:0/4198260416 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'55 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2e1c064050 con 0x5559106c2b10 2024-09-10T05:36:58.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.251+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106de160 con 0x7f2e1c027020 2024-09-10T05:36:58.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.251+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2e140083f0 con 0x7f2e1c027020 2024-09-10T05:36:58.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.251+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106de920 con 0x5559106c62f0 2024-09-10T05:36:58.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.251+0000 7f2e23996640 1 -- 172.21.15.62:0/4198260416 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2e180b4040 con 0x5559106c62f0 2024-09-10T05:36:58.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.251+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106dedd0 con 0x5559106be650 2024-09-10T05:36:58.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.255+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'198 uv172 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2e140083f0 con 0x5559106be650 2024-09-10T05:36:58.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.255+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106dbf10 con 0x5559106c2b10 2024-09-10T05:36:58.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.255+0000 7f2e24197640 1 -- 172.21.15.62:0/4198260416 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'71 uv61 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2e1c064050 con 0x5559106c2b10 2024-09-10T05:36:58.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.255+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106dbf10 con 0x5559106c62f0 2024-09-10T05:36:58.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.259+0000 7f2e23996640 1 -- 172.21.15.62:0/4198260416 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'55 uv48 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2e180b4040 con 0x5559106c62f0 2024-09-10T05:36:58.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.259+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106dbf10 con 0x5559106c2b10 2024-09-10T05:36:58.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.259+0000 7f2e24197640 1 -- 172.21.15.62:0/4198260416 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'36 uv31 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2e1c064050 con 0x5559106c2b10 2024-09-10T05:36:58.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.259+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106df930 con 0x5559106be650 2024-09-10T05:36:58.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.263+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'49 uv42 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2e140083f0 con 0x5559106be650 2024-09-10T05:36:58.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.263+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106dfde0 con 0x5559106c2b10 2024-09-10T05:36:58.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.263+0000 7f2e24197640 1 -- 172.21.15.62:0/4198260416 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2e1c064050 con 0x5559106c2b10 2024-09-10T05:36:58.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.263+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106dfde0 con 0x5559106c2b10 2024-09-10T05:36:58.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.267+0000 7f2e24197640 1 -- 172.21.15.62:0/4198260416 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2e1c064050 con 0x5559106c2b10 2024-09-10T05:36:58.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.267+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106dfde0 con 0x5559106c2b10 2024-09-10T05:36:58.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.271+0000 7f2e24197640 1 -- 172.21.15.62:0/4198260416 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'72 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e1c064050 con 0x5559106c2b10 2024-09-10T05:36:58.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.271+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106dfde0 con 0x5559106c62f0 2024-09-10T05:36:58.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.271+0000 7f2e23996640 1 -- 172.21.15.62:0/4198260416 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'29 uv25 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e180b4040 con 0x5559106c62f0 2024-09-10T05:36:58.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.271+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106e0040 con 0x5559106c2b10 2024-09-10T05:36:58.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.271+0000 7f2e24197640 1 -- 172.21.15.62:0/4198260416 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e1c064050 con 0x5559106c2b10 2024-09-10T05:36:58.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.271+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106e0040 con 0x5559106be650 2024-09-10T05:36:58.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.275+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'61 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e140083f0 con 0x5559106be650 2024-09-10T05:36:58.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.275+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106e04f0 con 0x5559106be650 2024-09-10T05:36:58.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.275+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'199 uv168 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e140083f0 con 0x5559106be650 2024-09-10T05:36:58.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.275+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106e04f0 con 0x5559106c2b10 2024-09-10T05:36:58.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.279+0000 7f2e24197640 1 -- 172.21.15.62:0/4198260416 <== osd.0 v2:172.21.15.2:6800/945139080 25 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'66 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e1c064050 con 0x5559106c2b10 2024-09-10T05:36:58.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.279+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106e04f0 con 0x5559106c2b10 2024-09-10T05:36:58.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.283+0000 7f2e24197640 1 -- 172.21.15.62:0/4198260416 <== osd.0 v2:172.21.15.2:6800/945139080 26 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'73 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e1c064050 con 0x5559106c2b10 2024-09-10T05:36:58.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.283+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106e04f0 con 0x5559106c62f0 2024-09-10T05:36:58.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.283+0000 7f2e23996640 1 -- 172.21.15.62:0/4198260416 <== osd.3 v2:172.21.15.62:6816/2708991149 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'37 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e180b4040 con 0x5559106c62f0 2024-09-10T05:36:58.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.283+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106e04f0 con 0x5559106c2b10 2024-09-10T05:36:58.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.287+0000 7f2e24197640 1 -- 172.21.15.62:0/4198260416 <== osd.0 v2:172.21.15.2:6800/945139080 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e1c064050 con 0x5559106c2b10 2024-09-10T05:36:58.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.287+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106e04f0 con 0x5559106be650 2024-09-10T05:36:58.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.287+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 <== osd.1 v2:172.21.15.62:6808/3442097179 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'200 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e140083f0 con 0x5559106be650 2024-09-10T05:36:58.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.287+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106e04f0 con 0x5559106c2b10 2024-09-10T05:36:58.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.291+0000 7f2e24197640 1 -- 172.21.15.62:0/4198260416 <== osd.0 v2:172.21.15.2:6800/945139080 28 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'67 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e1c064050 con 0x5559106c2b10 2024-09-10T05:36:58.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.291+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106e04f0 con 0x7f2e1c027020 2024-09-10T05:36:58.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.291+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'42 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e140083f0 con 0x7f2e1c027020 2024-09-10T05:36:58.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.291+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106e04f0 con 0x5559106c62f0 2024-09-10T05:36:58.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.295+0000 7f2e23996640 1 -- 172.21.15.62:0/4198260416 <== osd.3 v2:172.21.15.62:6816/2708991149 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e180b4040 con 0x5559106c62f0 2024-09-10T05:36:58.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.295+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106e04f0 con 0x5559106c2b10 2024-09-10T05:36:58.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.295+0000 7f2e24197640 1 -- 172.21.15.62:0/4198260416 <== osd.0 v2:172.21.15.2:6800/945139080 29 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'44 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e1c064050 con 0x5559106c2b10 2024-09-10T05:36:58.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.295+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106e04f0 con 0x5559106c62f0 2024-09-10T05:36:58.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.299+0000 7f2e23996640 1 -- 172.21.15.62:0/4198260416 <== osd.3 v2:172.21.15.62:6816/2708991149 21 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e180b4040 con 0x5559106c62f0 2024-09-10T05:36:58.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.299+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106e04f0 con 0x5559106c62f0 2024-09-10T05:36:58.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.299+0000 7f2e23996640 1 -- 172.21.15.62:0/4198260416 <== osd.3 v2:172.21.15.62:6816/2708991149 22 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'56 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e180b4040 con 0x5559106c62f0 2024-09-10T05:36:58.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.299+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106e04f0 con 0x5559106c62f0 2024-09-10T05:36:58.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.303+0000 7f2e23996640 1 -- 172.21.15.62:0/4198260416 <== osd.3 v2:172.21.15.62:6816/2708991149 23 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e180b4040 con 0x5559106c62f0 2024-09-10T05:36:58.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.303+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106e04f0 con 0x5559106c2b10 2024-09-10T05:36:58.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.303+0000 7f2e24197640 1 -- 172.21.15.62:0/4198260416 <== osd.0 v2:172.21.15.2:6800/945139080 30 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'39 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e1c064050 con 0x5559106c2b10 2024-09-10T05:36:58.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.303+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106e04f0 con 0x5559106be650 2024-09-10T05:36:58.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.307+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 <== osd.1 v2:172.21.15.62:6808/3442097179 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'50 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e140083f0 con 0x5559106be650 2024-09-10T05:36:58.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.307+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106e04f0 con 0x5559106c2b10 2024-09-10T05:36:58.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.311+0000 7f2e24197640 1 -- 172.21.15.62:0/4198260416 <== osd.0 v2:172.21.15.2:6800/945139080 31 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'68 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e1c064050 con 0x5559106c2b10 2024-09-10T05:36:58.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.311+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106e0530 con 0x5559106be650 2024-09-10T05:36:58.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.311+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 <== osd.1 v2:172.21.15.62:6808/3442097179 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'62 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e140083f0 con 0x5559106be650 2024-09-10T05:36:58.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.311+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106e0570 con 0x7f2e1c027020 2024-09-10T05:36:58.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.311+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e140083f0 con 0x7f2e1c027020 2024-09-10T05:36:58.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.315+0000 7f2cd97e2640 20 reqs_thread_entry: start 2024-09-10T05:36:58.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.315+0000 7f2e266919c0 20 init_complete bucket index max shards: 11 2024-09-10T05:36:58.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.315+0000 7f2e266919c0 20 Filter name: none 2024-09-10T05:36:58.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.315+0000 7f2c4affd640 20 reqs_thread_entry: start 2024-09-10T05:36:58.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.315+0000 7f2e266919c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T05:36:58.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.315+0000 7f2e266919c0 20 rados->read ofs=0 len=0 2024-09-10T05:36:58.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.315+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559106db240 con 0x5559106be650 2024-09-10T05:36:58.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.315+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 <== osd.1 v2:172.21.15.62:6808/3442097179 26 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f2e140083f0 con 0x5559106be650 2024-09-10T05:36:58.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.315+0000 7f2e266919c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:36:58.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.315+0000 7f2e266919c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T05:36:58.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.315+0000 7f2e266919c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:36:58.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.315+0000 7f2e266919c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:36:58.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.315+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559106fe0c0 con 0x7f2e1c027020 2024-09-10T05:36:58.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.315+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 <== osd.2 v2:172.21.15.62:6800/2677868286 15 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv41 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f2e140083f0 con 0x7f2e1c027020 2024-09-10T05:36:58.318 INFO:teuthology.orchestra.run.smithi062.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-10T05:36:58.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.315+0000 7f2cda7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:36:58.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.315+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93841016038128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106b8e40 con 0x5559106be650 2024-09-10T05:36:58.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.319+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 <== osd.1 v2:172.21.15.62:6808/3442097179 27 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 93841016038128] v32'201 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2e140083f0 con 0x5559106be650 2024-09-10T05:36:58.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.319+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93841016015536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106d22f0 con 0x5559106c2b10 2024-09-10T05:36:58.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.319+0000 7f2e24197640 1 -- 172.21.15.62:0/4198260416 <== osd.0 v2:172.21.15.2:6800/945139080 32 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 93841016015536] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e1c064050 con 0x5559106c2b10 2024-09-10T05:36:58.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.319+0000 7f2e266919c0 20 remove_watcher() i=0 2024-09-10T05:36:58.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.319+0000 7f2e266919c0 2 removed watcher, disabling cache 2024-09-10T05:36:58.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.319+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93841016022720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106ccab0 con 0x5559106be650 2024-09-10T05:36:58.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.323+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 <== osd.1 v2:172.21.15.62:6808/3442097179 28 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 93841016022720] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e140083f0 con 0x5559106be650 2024-09-10T05:36:58.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.323+0000 7f2e266919c0 20 remove_watcher() i=1 2024-09-10T05:36:58.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.323+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93841016023776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106ccab0 con 0x5559106c2b10 2024-09-10T05:36:58.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.323+0000 7f2e24197640 1 -- 172.21.15.62:0/4198260416 <== osd.0 v2:172.21.15.2:6800/945139080 33 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 93841016023776] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e1c064050 con 0x5559106c2b10 2024-09-10T05:36:58.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.323+0000 7f2e266919c0 20 remove_watcher() i=2 2024-09-10T05:36:58.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.323+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93841016027472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106ccab0 con 0x7f2e1c027020 2024-09-10T05:36:58.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.327+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 <== osd.2 v2:172.21.15.62:6800/2677868286 16 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 93841016027472] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e140083f0 con 0x7f2e1c027020 2024-09-10T05:36:58.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.327+0000 7f2e266919c0 20 remove_watcher() i=3 2024-09-10T05:36:58.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.327+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93841016026272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106ccab0 con 0x5559106c2b10 2024-09-10T05:36:58.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.327+0000 7f2e24197640 1 -- 172.21.15.62:0/4198260416 <== osd.0 v2:172.21.15.2:6800/945139080 34 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 93841016026272] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e1c064050 con 0x5559106c2b10 2024-09-10T05:36:58.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.327+0000 7f2e266919c0 20 remove_watcher() i=4 2024-09-10T05:36:58.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.327+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93841016033296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106cf4a0 con 0x5559106c62f0 2024-09-10T05:36:58.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.331+0000 7f2e23996640 1 -- 172.21.15.62:0/4198260416 <== osd.3 v2:172.21.15.62:6816/2708991149 24 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 93841016033296] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e180b4040 con 0x5559106c62f0 2024-09-10T05:36:58.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.331+0000 7f2e266919c0 20 remove_watcher() i=5 2024-09-10T05:36:58.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.331+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93841016034352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106cf4a0 con 0x5559106c62f0 2024-09-10T05:36:58.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.331+0000 7f2e23996640 1 -- 172.21.15.62:0/4198260416 <== osd.3 v2:172.21.15.62:6816/2708991149 25 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 93841016034352] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e180b4040 con 0x5559106c62f0 2024-09-10T05:36:58.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.331+0000 7f2e266919c0 20 remove_watcher() i=6 2024-09-10T05:36:58.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.331+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93841016031024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559106cf4a0 con 0x7f2e1c027020 2024-09-10T05:36:58.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.331+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 <== osd.2 v2:172.21.15.62:6800/2677868286 17 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 93841016031024] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e140083f0 con 0x7f2e1c027020 2024-09-10T05:36:58.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.331+0000 7f2e266919c0 20 remove_watcher() i=7 2024-09-10T05:36:58.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.331+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5559106c2b10 msgr2=0x5559106c4f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:58.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.331+0000 7f2e266919c0 1 --2- 172.21.15.62:0/4198260416 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5559106c2b10 0x5559106c4f00 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:58.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.331+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5559106be650 msgr2=0x5559106c0b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:58.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.331+0000 7f2e266919c0 1 --2- 172.21.15.62:0/4198260416 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5559106be650 0x5559106c0b10 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:58.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.331+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f2e1c027020 msgr2=0x7f2e1c0394a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:58.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.331+0000 7f2e266919c0 1 --2- 172.21.15.62:0/4198260416 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f2e1c027020 0x7f2e1c0394a0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:58.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.331+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5559106c62f0 msgr2=0x5559106c8700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:58.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.331+0000 7f2e266919c0 1 --2- 172.21.15.62:0/4198260416 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5559106c62f0 0x5559106c8700 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:58.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.331+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2cf4039a20 msgr2=0x7f2cf403bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:58.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.331+0000 7f2e266919c0 1 --2- 172.21.15.62:0/4198260416 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2cf4039a20 0x7f2cf403bee0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2e180c13f0 tx=0x7f2e180a8000 comp rx=0 tx=0).stop 2024-09-10T05:36:58.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.331+0000 7f2e24998640 1 -- 172.21.15.62:0/4198260416 reap_dead start 2024-09-10T05:36:58.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.331+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559106ac3f0 msgr2=0x5559106b36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:58.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.331+0000 7f2e266919c0 1 --2- 172.21.15.62:0/4198260416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559106ac3f0 0x5559106b36d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c01df30 tx=0x7f2e1c011f10 comp rx=0 tx=0).stop 2024-09-10T05:36:58.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.331+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 shutdown_connections 2024-09-10T05:36:58.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.331+0000 7f2e266919c0 1 --2- 172.21.15.62:0/4198260416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5559106ac3f0 0x5559106b36d0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:58.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.331+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 >> 172.21.15.62:0/4198260416 conn(0x5559106a8820 msgr2=0x5559106a6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:58.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.331+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 shutdown_connections 2024-09-10T05:36:58.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.331+0000 7f2e266919c0 1 -- 172.21.15.62:0/4198260416 wait complete. 2024-09-10T05:36:58.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.335+0000 7f2e266919c0 1 -- 172.21.15.62:0/1007251095 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2cfc039ac0 msgr2=0x7f2cfc03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:58.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.335+0000 7f2e266919c0 1 --2- 172.21.15.62:0/1007251095 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2cfc039ac0 0x7f2cfc03bf80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x55591068da30 tx=0x7f2e18005ad0 comp rx=0 tx=0).stop 2024-09-10T05:36:58.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.335+0000 7f2e266919c0 1 -- 172.21.15.62:0/1007251095 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55591069fcd0 msgr2=0x5559106a00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:58.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.335+0000 7f2e266919c0 1 --2- 172.21.15.62:0/1007251095 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55591069fcd0 0x5559106a00f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c04e540 tx=0x7f2e1c01eea0 comp rx=0 tx=0).stop 2024-09-10T05:36:58.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.335+0000 7f2e266919c0 1 -- 172.21.15.62:0/1007251095 shutdown_connections 2024-09-10T05:36:58.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.335+0000 7f2e266919c0 1 --2- 172.21.15.62:0/1007251095 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2cfc039ac0 0x7f2cfc03bf80 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:58.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.335+0000 7f2e266919c0 1 --2- 172.21.15.62:0/1007251095 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55591069fcd0 0x5559106a00f0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:58.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.335+0000 7f2e266919c0 1 -- 172.21.15.62:0/1007251095 >> 172.21.15.62:0/1007251095 conn(0x555910695680 msgr2=0x555910695a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:58.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.335+0000 7f2e266919c0 1 -- 172.21.15.62:0/1007251095 shutdown_connections 2024-09-10T05:36:58.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.335+0000 7f2e266919c0 1 -- 172.21.15.62:0/1007251095 wait complete. 2024-09-10T05:36:58.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.335+0000 7f2e266919c0 1 -- 172.21.15.62:0/891703845 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55591068a1d0 msgr2=0x55591068c690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:58.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.335+0000 7f2e266919c0 1 --2- 172.21.15.62:0/891703845 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55591068a1d0 0x55591068c690 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:58.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.335+0000 7f2e266919c0 1 -- 172.21.15.62:0/891703845 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x555910591350 msgr2=0x555910689220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:58.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.335+0000 7f2e266919c0 1 --2- 172.21.15.62:0/891703845 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x555910591350 0x555910689220 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:58.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.335+0000 7f2e266919c0 1 -- 172.21.15.62:0/891703845 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55591068ebc0 msgr2=0x555910690fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:58.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.335+0000 7f2e266919c0 1 --2- 172.21.15.62:0/891703845 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55591068ebc0 0x555910690fb0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:36:58.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.335+0000 7f2e266919c0 1 -- 172.21.15.62:0/891703845 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2d0c039ac0 msgr2=0x7f2d0c03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:58.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.335+0000 7f2e266919c0 1 --2- 172.21.15.62:0/891703845 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2d0c039ac0 0x7f2d0c03bf80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2e180ae000 tx=0x7f2e180a6000 comp rx=0 tx=0).stop 2024-09-10T05:36:58.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.335+0000 7f2e266919c0 1 -- 172.21.15.62:0/891703845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555910501200 msgr2=0x55591058d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:36:58.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.335+0000 7f2e266919c0 1 --2- 172.21.15.62:0/891703845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555910501200 0x55591058d310 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x555910679790 tx=0x7f2e1c001260 comp rx=0 tx=0).stop 2024-09-10T05:36:58.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.335+0000 7f2e24998640 1 -- 172.21.15.62:0/891703845 reap_dead start 2024-09-10T05:36:58.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.335+0000 7f2e266919c0 1 -- 172.21.15.62:0/891703845 shutdown_connections 2024-09-10T05:36:58.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.335+0000 7f2e266919c0 1 -- 172.21.15.62:0/891703845 >> 172.21.15.62:0/891703845 conn(0x555910587920 msgr2=0x555910672ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:36:58.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.335+0000 7f2e266919c0 1 -- 172.21.15.62:0/891703845 shutdown_connections 2024-09-10T05:36:58.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:36:58.335+0000 7f2e266919c0 1 -- 172.21.15.62:0/891703845 wait complete. 2024-09-10T05:36:58.350 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-10T05:36:58.370 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T05:36:58.413 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-10T05:37:33.415 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2024-09-10T05:37:33.415 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2024-09-10T05:37:33.416 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2024-09-10T05:37:33.458 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:37:33.458 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:37:33.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.454+0000 7fb291df09c0 1 Processor -- start 2024-09-10T05:37:33.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.454+0000 7fb291df09c0 1 -- start start 2024-09-10T05:37:33.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.454+0000 7fb291df09c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x561d3f906200 0x561d3f9065e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:33.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.454+0000 7fb291df09c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561d3f7b89c0 con 0x561d3f909340 2024-09-10T05:37:33.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.454+0000 7fb291df09c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x561d3f8086d0 con 0x561d3f906200 2024-09-10T05:37:33.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.454+0000 7fb28f8f6640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x561d3f906200 0x561d3f9065e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:33.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.454+0000 7fb28f0f5640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x561d3f909340 0x561d3f90b730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:45966/0 (socket says 172.21.15.62:45966) 2024-09-10T05:37:33.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.454+0000 7fb28f8f6640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x561d3f906200 0x561d3f9065e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:57454/0 (socket says 172.21.15.62:57454) 2024-09-10T05:37:33.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.454+0000 7fb28f0f5640 1 -- 172.21.15.62:0/4093381997 learned_addr learned my addr 172.21.15.62:0/4093381997 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-10T05:37:33.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.454+0000 7fb28f8f6640 1 -- 172.21.15.62:0/4093381997 >> v1:172.21.15.2:6789/0 conn(0x561d3f909340 legacy=0x561d3f90b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:33.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.454+0000 7fb28f8f6640 1 -- 172.21.15.62:0/4093381997 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d3f7acca0 con 0x561d3f906200 2024-09-10T05:37:33.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.458+0000 7fb28f8f6640 1 --2- 172.21.15.62:0/4093381997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3f906200 0x561d3f9065e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fb28000a480 tx=0x7fb28001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1d1d4934671b0ba server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:33.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.458+0000 7fb28e8f4640 1 -- 172.21.15.62:0/4093381997 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2800b0070 con 0x561d3f906200 2024-09-10T05:37:33.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.458+0000 7fb28e8f4640 1 -- 172.21.15.62:0/4093381997 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2800ab540 con 0x561d3f906200 2024-09-10T05:37:33.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.458+0000 7fb28e8f4640 1 -- 172.21.15.62:0/4093381997 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2800ab840 con 0x561d3f906200 2024-09-10T05:37:33.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.462+0000 7fb291df09c0 1 -- 172.21.15.62:0/4093381997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3f906200 msgr2=0x561d3f9065e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:33.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.462+0000 7fb291df09c0 1 --2- 172.21.15.62:0/4093381997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3f906200 0x561d3f9065e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fb28000a480 tx=0x7fb28001b280 comp rx=0 tx=0).stop 2024-09-10T05:37:33.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.462+0000 7fb291df09c0 1 -- 172.21.15.62:0/4093381997 shutdown_connections 2024-09-10T05:37:33.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.462+0000 7fb291df09c0 1 --2- 172.21.15.62:0/4093381997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3f906200 0x561d3f9065e0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:33.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.462+0000 7fb291df09c0 1 -- 172.21.15.62:0/4093381997 >> 172.21.15.62:0/4093381997 conn(0x561d3f879b10 msgr2=0x561d3f879f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:33.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.462+0000 7fb291df09c0 1 -- 172.21.15.62:0/4093381997 shutdown_connections 2024-09-10T05:37:33.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.462+0000 7fb291df09c0 1 -- 172.21.15.62:0/4093381997 wait complete. 2024-09-10T05:37:33.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.478+0000 7fb291df09c0 1 Processor -- start 2024-09-10T05:37:33.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.478+0000 7fb291df09c0 1 -- start start 2024-09-10T05:37:33.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.478+0000 7fb291df09c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3f906200 0x561d3f9f1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:33.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.478+0000 7fb291df09c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561d3f80c680 con 0x561d3f906200 2024-09-10T05:37:33.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.478+0000 7fb28f8f6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3f906200 0x561d3f9f1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:33.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.478+0000 7fb28f8f6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3f906200 0x561d3f9f1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:57470/0 (socket says 172.21.15.62:57470) 2024-09-10T05:37:33.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.478+0000 7fb28f8f6640 1 -- 172.21.15.62:0/3480745394 learned_addr learned my addr 172.21.15.62:0/3480745394 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:33.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.478+0000 7fb28f8f6640 1 -- 172.21.15.62:0/3480745394 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d3f787da0 con 0x561d3f906200 2024-09-10T05:37:33.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.478+0000 7fb28f8f6640 1 --2- 172.21.15.62:0/3480745394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3f906200 0x561d3f9f1900 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fb280018eb0 tx=0x7fb280003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=102b1165b65a4a13 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:33.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.482+0000 7fb17de0b640 1 -- 172.21.15.62:0/3480745394 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2800b0070 con 0x561d3f906200 2024-09-10T05:37:33.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.482+0000 7fb17de0b640 1 -- 172.21.15.62:0/3480745394 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2800b1040 con 0x561d3f906200 2024-09-10T05:37:33.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.482+0000 7fb17de0b640 1 -- 172.21.15.62:0/3480745394 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2800ab6f0 con 0x561d3f906200 2024-09-10T05:37:33.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.482+0000 7fb291df09c0 1 -- 172.21.15.62:0/3480745394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3f906200 msgr2=0x561d3f9f1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:33.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.482+0000 7fb291df09c0 1 --2- 172.21.15.62:0/3480745394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3f906200 0x561d3f9f1900 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fb280018eb0 tx=0x7fb280003030 comp rx=0 tx=0).stop 2024-09-10T05:37:33.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.482+0000 7fb291df09c0 1 -- 172.21.15.62:0/3480745394 shutdown_connections 2024-09-10T05:37:33.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.482+0000 7fb291df09c0 1 --2- 172.21.15.62:0/3480745394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3f906200 0x561d3f9f1900 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:33.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.482+0000 7fb291df09c0 1 -- 172.21.15.62:0/3480745394 >> 172.21.15.62:0/3480745394 conn(0x561d3f879b10 msgr2=0x561d3f9ed5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:33.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.482+0000 7fb291df09c0 1 -- 172.21.15.62:0/3480745394 shutdown_connections 2024-09-10T05:37:33.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.482+0000 7fb291df09c0 1 -- 172.21.15.62:0/3480745394 wait complete. 2024-09-10T05:37:33.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.482+0000 7fb291df09c0 1 Processor -- start 2024-09-10T05:37:33.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.482+0000 7fb291df09c0 1 -- start start 2024-09-10T05:37:33.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.482+0000 7fb291df09c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3f906200 0x561d3f9f8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:33.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.482+0000 7fb291df09c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561d3f7aea50 con 0x561d3f906200 2024-09-10T05:37:33.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.482+0000 7fb28f8f6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3f906200 0x561d3f9f8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:33.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.482+0000 7fb28f8f6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3f906200 0x561d3f9f8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:57482/0 (socket says 172.21.15.62:57482) 2024-09-10T05:37:33.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.482+0000 7fb28f8f6640 1 -- 172.21.15.62:0/1910888046 learned_addr learned my addr 172.21.15.62:0/1910888046 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:33.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.482+0000 7fb28f8f6640 1 -- 172.21.15.62:0/1910888046 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d3f9f9420 con 0x561d3f906200 2024-09-10T05:37:33.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.482+0000 7fb28f8f6640 1 --2- 172.21.15.62:0/1910888046 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3f906200 0x561d3f9f8ec0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fb2800ab510 tx=0x7fb280018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:33.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.482+0000 7fb177fff640 1 -- 172.21.15.62:0/1910888046 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2800c4070 con 0x561d3f906200 2024-09-10T05:37:33.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.482+0000 7fb177fff640 1 -- 172.21.15.62:0/1910888046 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2800b75b0 con 0x561d3f906200 2024-09-10T05:37:33.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.482+0000 7fb291df09c0 1 -- 172.21.15.62:0/1910888046 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561d3f9f96b0 con 0x561d3f906200 2024-09-10T05:37:33.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.482+0000 7fb177fff640 1 -- 172.21.15.62:0/1910888046 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2800b7890 con 0x561d3f906200 2024-09-10T05:37:33.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.482+0000 7fb291df09c0 1 -- 172.21.15.62:0/1910888046 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d3f9fa060 con 0x561d3f906200 2024-09-10T05:37:33.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.486+0000 7fb177fff640 1 -- 172.21.15.62:0/1910888046 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb2800c7070 con 0x561d3f906200 2024-09-10T05:37:33.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.486+0000 7fb177fff640 1 --2- 172.21.15.62:0/1910888046 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb178039ac0 0x7fb17803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:33.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.486+0000 7fb177fff640 1 -- 172.21.15.62:0/1910888046 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7fb2800bc070 con 0x561d3f906200 2024-09-10T05:37:33.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.486+0000 7fb28f0f5640 1 --2- 172.21.15.62:0/1910888046 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb178039ac0 0x7fb17803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:33.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.486+0000 7fb291df09c0 1 --2- 172.21.15.62:0/1910888046 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x561d3f909340 0x561d3fa00030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:33.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.486+0000 7fb291df09c0 1 -- 172.21.15.62:0/1910888046 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa00570 con 0x561d3f909340 2024-09-10T05:37:33.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.486+0000 7fb2900f7640 1 --2- 172.21.15.62:0/1910888046 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x561d3f909340 0x561d3fa00030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:33.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.486+0000 7fb28f0f5640 1 --2- 172.21.15.62:0/1910888046 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb178039ac0 0x7fb17803bf80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb284004180 tx=0x7fb284001340 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:33.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.486+0000 7fb2900f7640 1 --2- 172.21.15.62:0/1910888046 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x561d3f909340 0x561d3fa00030 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:33.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.486+0000 7fb2900f7640 1 -- 172.21.15.62:0/1910888046 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb28800a4d0 con 0x561d3f909340 2024-09-10T05:37:33.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.486+0000 7fb291df09c0 1 --2- 172.21.15.62:0/1910888046 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561d3fa01070 0x561d3fa03530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:33.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.486+0000 7fb291df09c0 1 -- 172.21.15.62:0/1910888046 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa03ca0 con 0x561d3fa01070 2024-09-10T05:37:33.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.486+0000 7fb28f8f6640 1 --2- 172.21.15.62:0/1910888046 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561d3fa01070 0x561d3fa03530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:33.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.486+0000 7fb28f8f6640 1 --2- 172.21.15.62:0/1910888046 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561d3fa01070 0x561d3fa03530 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:33.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.490+0000 7fb28f8f6640 1 -- 172.21.15.62:0/1910888046 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb2800d0070 con 0x561d3fa01070 2024-09-10T05:37:33.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.490+0000 7fb291df09c0 1 --2- 172.21.15.62:0/1910888046 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x561d3fa05a60 0x561d3fa07e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:33.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.490+0000 7fb291df09c0 1 -- 172.21.15.62:0/1910888046 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa08540 con 0x561d3fa05a60 2024-09-10T05:37:33.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.490+0000 7fb28f0f5640 1 --2- 172.21.15.62:0/1910888046 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x561d3fa05a60 0x561d3fa07e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:33.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.490+0000 7fb28f0f5640 1 --2- 172.21.15.62:0/1910888046 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x561d3fa05a60 0x561d3fa07e50 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:33.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.490+0000 7fb28f0f5640 1 -- 172.21.15.62:0/1910888046 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb28400e6c0 con 0x561d3fa05a60 2024-09-10T05:37:33.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.490+0000 7fb291df09c0 1 -- 172.21.15.62:0/1910888046 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa04900 con 0x561d3fa01070 2024-09-10T05:37:33.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.490+0000 7fb28f8f6640 1 -- 172.21.15.62:0/1910888046 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb2800d0070 con 0x561d3fa01070 2024-09-10T05:37:33.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.490+0000 7fb291df09c0 1 -- 172.21.15.62:0/1910888046 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa04d60 con 0x561d3fa05a60 2024-09-10T05:37:33.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.490+0000 7fb28f0f5640 1 -- 172.21.15.62:0/1910888046 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb28400e6c0 con 0x561d3fa05a60 2024-09-10T05:37:33.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.490+0000 7fb291df09c0 1 Processor -- start 2024-09-10T05:37:33.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.490+0000 7fb291df09c0 1 -- start start 2024-09-10T05:37:33.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.490+0000 7fb291df09c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3fa16b90 0x561d3fa16fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:33.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.490+0000 7fb291df09c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561d3f819450 con 0x561d3fa16b90 2024-09-10T05:37:33.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.490+0000 7fb28f8f6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3fa16b90 0x561d3fa16fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:33.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.490+0000 7fb28f8f6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3fa16b90 0x561d3fa16fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:57498/0 (socket says 172.21.15.62:57498) 2024-09-10T05:37:33.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.490+0000 7fb28f8f6640 1 -- 172.21.15.62:0/879719928 learned_addr learned my addr 172.21.15.62:0/879719928 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:33.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.490+0000 7fb28f8f6640 1 -- 172.21.15.62:0/879719928 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d3fa175f0 con 0x561d3fa16b90 2024-09-10T05:37:33.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.494+0000 7fb28f8f6640 1 --2- 172.21.15.62:0/879719928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3fa16b90 0x561d3fa16fb0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fb2800b67d0 tx=0x7fb280001c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:33.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.494+0000 7fb1757fa640 1 -- 172.21.15.62:0/879719928 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2800ec020 con 0x561d3fa16b90 2024-09-10T05:37:33.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.494+0000 7fb1757fa640 1 -- 172.21.15.62:0/879719928 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2800c0460 con 0x561d3fa16b90 2024-09-10T05:37:33.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.494+0000 7fb1757fa640 1 -- 172.21.15.62:0/879719928 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2800e2e50 con 0x561d3fa16b90 2024-09-10T05:37:33.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.494+0000 7fb291df09c0 1 -- 172.21.15.62:0/879719928 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561d3fa17e50 con 0x561d3fa16b90 2024-09-10T05:37:33.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.494+0000 7fb291df09c0 1 -- 172.21.15.62:0/879719928 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d3fa183c0 con 0x561d3fa16b90 2024-09-10T05:37:33.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.494+0000 7fb1757fa640 1 -- 172.21.15.62:0/879719928 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb2800b5380 con 0x561d3fa16b90 2024-09-10T05:37:33.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.494+0000 7fb1757fa640 1 --2- 172.21.15.62:0/879719928 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb168039a70 0x7fb16803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:33.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.494+0000 7fb1757fa640 1 -- 172.21.15.62:0/879719928 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7fb2800a8070 con 0x561d3fa16b90 2024-09-10T05:37:33.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.494+0000 7fb28f0f5640 1 --2- 172.21.15.62:0/879719928 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb168039a70 0x7fb16803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:33.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.494+0000 7fb291df09c0 1 Processor -- start 2024-09-10T05:37:33.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.494+0000 7fb291df09c0 1 -- start start 2024-09-10T05:37:33.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.494+0000 7fb291df09c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3f87af20 0x561d3f87b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:33.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.494+0000 7fb291df09c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561d3f9f2090 con 0x561d3f87af20 2024-09-10T05:37:33.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.494+0000 7fb28f0f5640 1 --2- 172.21.15.62:0/879719928 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb168039a70 0x7fb16803bf30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x561d3fa00910 tx=0x7fb28400f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:33.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.494+0000 7fb28f8f6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3f87af20 0x561d3f87b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:33.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.494+0000 7fb28f8f6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3f87af20 0x561d3f87b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:57514/0 (socket says 172.21.15.62:57514) 2024-09-10T05:37:33.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.494+0000 7fb28f8f6640 1 -- 172.21.15.62:0/2745023318 learned_addr learned my addr 172.21.15.62:0/2745023318 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:33.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.494+0000 7fb28f8f6640 1 -- 172.21.15.62:0/2745023318 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d3f87b860 con 0x561d3f87af20 2024-09-10T05:37:33.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.498+0000 7fb28f8f6640 1 --2- 172.21.15.62:0/2745023318 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3f87af20 0x561d3f87b320 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fb2800b6780 tx=0x7fb2800c9da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc17490f89217f3a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:33.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.498+0000 7fb16effd640 1 -- 172.21.15.62:0/2745023318 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2800fa070 con 0x561d3f87af20 2024-09-10T05:37:33.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.498+0000 7fb16effd640 1 -- 172.21.15.62:0/2745023318 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2800b6bc0 con 0x561d3f87af20 2024-09-10T05:37:33.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.498+0000 7fb16effd640 1 -- 172.21.15.62:0/2745023318 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2800fd040 con 0x561d3f87af20 2024-09-10T05:37:33.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.498+0000 7fb291df09c0 1 -- 172.21.15.62:0/2745023318 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3f87af20 msgr2=0x561d3f87b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:33.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.498+0000 7fb291df09c0 1 --2- 172.21.15.62:0/2745023318 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3f87af20 0x561d3f87b320 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fb2800b6780 tx=0x7fb2800c9da0 comp rx=0 tx=0).stop 2024-09-10T05:37:33.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.498+0000 7fb291df09c0 1 -- 172.21.15.62:0/2745023318 shutdown_connections 2024-09-10T05:37:33.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.498+0000 7fb291df09c0 1 --2- 172.21.15.62:0/2745023318 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3f87af20 0x561d3f87b320 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:33.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.498+0000 7fb291df09c0 1 -- 172.21.15.62:0/2745023318 >> 172.21.15.62:0/2745023318 conn(0x561d3fa1f7a0 msgr2=0x561d3fa1d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:33.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.498+0000 7fb291df09c0 1 -- 172.21.15.62:0/2745023318 shutdown_connections 2024-09-10T05:37:33.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.498+0000 7fb291df09c0 1 -- 172.21.15.62:0/2745023318 wait complete. 2024-09-10T05:37:33.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.498+0000 7fb291df09c0 1 Processor -- start 2024-09-10T05:37:33.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.498+0000 7fb291df09c0 1 -- start start 2024-09-10T05:37:33.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.498+0000 7fb291df09c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3f87af20 0x561d3fa2ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:33.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.498+0000 7fb291df09c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561d3f87bdb0 con 0x561d3f87af20 2024-09-10T05:37:33.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.498+0000 7fb28f8f6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3f87af20 0x561d3fa2ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:33.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.498+0000 7fb28f8f6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3f87af20 0x561d3fa2ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:57528/0 (socket says 172.21.15.62:57528) 2024-09-10T05:37:33.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.498+0000 7fb28f8f6640 1 -- 172.21.15.62:0/2879844081 learned_addr learned my addr 172.21.15.62:0/2879844081 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:33.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.498+0000 7fb28f8f6640 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d3fa2efe0 con 0x561d3f87af20 2024-09-10T05:37:33.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.498+0000 7fb28f8f6640 1 --2- 172.21.15.62:0/2879844081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3f87af20 0x561d3fa2ea80 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fb2800e3010 tx=0x7fb2800b9ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:33.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.498+0000 7fb16d7fa640 1 -- 172.21.15.62:0/2879844081 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb280113070 con 0x561d3f87af20 2024-09-10T05:37:33.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.498+0000 7fb16d7fa640 1 -- 172.21.15.62:0/2879844081 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb280108040 con 0x561d3f87af20 2024-09-10T05:37:33.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.498+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561d3fa2efe0 con 0x561d3f87af20 2024-09-10T05:37:33.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.498+0000 7fb16d7fa640 1 -- 172.21.15.62:0/2879844081 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2800a4300 con 0x561d3f87af20 2024-09-10T05:37:33.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.498+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d3fa2efe0 con 0x561d3f87af20 2024-09-10T05:37:33.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.502+0000 7fb16d7fa640 1 -- 172.21.15.62:0/2879844081 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb2800b5670 con 0x561d3f87af20 2024-09-10T05:37:33.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.502+0000 7fb291df09c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:33.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.502+0000 7fb16d7fa640 1 --2- 172.21.15.62:0/2879844081 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb158039a70 0x7fb15803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:33.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.502+0000 7fb16d7fa640 1 -- 172.21.15.62:0/2879844081 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7fb280118bc0 con 0x561d3f87af20 2024-09-10T05:37:33.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.502+0000 7fb28f0f5640 1 --2- 172.21.15.62:0/2879844081 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb158039a70 0x7fb15803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:33.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.502+0000 7fb291df09c0 1 --2- 172.21.15.62:0/2879844081 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x561d3fa398b0 0x561d3fa3bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:33.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.502+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa3c490 con 0x561d3fa398b0 2024-09-10T05:37:33.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.502+0000 7fb2900f7640 1 --2- 172.21.15.62:0/2879844081 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x561d3fa398b0 0x561d3fa3bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:33.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.502+0000 7fb28f0f5640 1 --2- 172.21.15.62:0/2879844081 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb158039a70 0x7fb15803bf30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb28400c010 tx=0x7fb284010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:33.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.502+0000 7fb2900f7640 1 --2- 172.21.15.62:0/2879844081 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x561d3fa398b0 0x561d3fa3bd40 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:33.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.502+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb28800a4d0 con 0x561d3fa398b0 2024-09-10T05:37:33.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.502+0000 7fb291df09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:33.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.502+0000 7fb291df09c0 20 realm 2024-09-10T05:37:33.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.502+0000 7fb291df09c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:33.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.502+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa38c40 con 0x561d3fa398b0 2024-09-10T05:37:33.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.502+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb28800a4d0 con 0x561d3fa398b0 2024-09-10T05:37:33.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.502+0000 7fb291df09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:33.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.502+0000 7fb291df09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:37:33.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.502+0000 7fb291df09c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:33.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.502+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa3cf50 con 0x561d3fa398b0 2024-09-10T05:37:33.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.502+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb28800a4d0 con 0x561d3fa398b0 2024-09-10T05:37:33.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.502+0000 7fb291df09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:33.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.502+0000 7fb291df09c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:33.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.502+0000 7fb291df09c0 1 --2- 172.21.15.62:0/2879844081 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561d3fa3dd30 0x561d3fa40120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:33.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.502+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa407b0 con 0x561d3fa3dd30 2024-09-10T05:37:33.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.502+0000 7fb28f8f6640 1 --2- 172.21.15.62:0/2879844081 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561d3fa3dd30 0x561d3fa40120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:33.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.502+0000 7fb28f8f6640 1 --2- 172.21.15.62:0/2879844081 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561d3fa3dd30 0x561d3fa40120 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:33.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.506+0000 7fb28f8f6640 1 -- 172.21.15.62:0/2879844081 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb2800ee020 con 0x561d3fa3dd30 2024-09-10T05:37:33.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.506+0000 7fb291df09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:37:33.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.506+0000 7fb291df09c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:33.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.506+0000 7fb291df09c0 1 --2- 172.21.15.62:0/2879844081 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x561d3fa41560 0x561d3fa43950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:33.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.506+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa43ff0 con 0x561d3fa41560 2024-09-10T05:37:33.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.506+0000 7fb28f0f5640 1 --2- 172.21.15.62:0/2879844081 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x561d3fa41560 0x561d3fa43950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:33.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.506+0000 7fb28f0f5640 1 --2- 172.21.15.62:0/2879844081 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x561d3fa41560 0x561d3fa43950 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:33.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.506+0000 7fb28f0f5640 1 -- 172.21.15.62:0/2879844081 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb284026070 con 0x561d3fa41560 2024-09-10T05:37:33.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.506+0000 7fb291df09c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:37:33.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.506+0000 7fb291df09c0 20 searching for the correct realm 2024-09-10T05:37:33.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.506+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa458e0 con 0x561d3fa41560 2024-09-10T05:37:33.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.506+0000 7fb28f0f5640 1 -- 172.21.15.62:0/2879844081 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb284026070 con 0x561d3fa41560 2024-09-10T05:37:33.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.506+0000 7fb28f0f5640 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa458e0 con 0x561d3fa3dd30 2024-09-10T05:37:33.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.506+0000 7fb28f8f6640 1 -- 172.21.15.62:0/2879844081 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2800ee020 con 0x561d3fa3dd30 2024-09-10T05:37:33.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.506+0000 7fb28f8f6640 1 --2- 172.21.15.62:0/2879844081 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fb280124040 0x7fb2800d9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:33.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.506+0000 7fb28f8f6640 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa458e0 con 0x7fb280124040 2024-09-10T05:37:33.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.506+0000 7fb2900f7640 1 --2- 172.21.15.62:0/2879844081 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fb280124040 0x7fb2800d9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:33.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.506+0000 7fb2900f7640 1 --2- 172.21.15.62:0/2879844081 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fb280124040 0x7fb2800d9a30 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:33.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.506+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb28800a4d0 con 0x7fb280124040 2024-09-10T05:37:33.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.506+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa458e0 con 0x561d3fa398b0 2024-09-10T05:37:33.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.506+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb28800a4d0 con 0x561d3fa398b0 2024-09-10T05:37:33.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.506+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa458e0 con 0x561d3fa398b0 2024-09-10T05:37:33.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.510+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb28800a4d0 con 0x561d3fa398b0 2024-09-10T05:37:33.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.510+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa458e0 con 0x561d3fa41560 2024-09-10T05:37:33.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.510+0000 7fb28f0f5640 1 -- 172.21.15.62:0/2879844081 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb284026070 con 0x561d3fa41560 2024-09-10T05:37:33.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.510+0000 7fb28f0f5640 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa458e0 con 0x561d3fa398b0 2024-09-10T05:37:33.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.510+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb28800a4d0 con 0x561d3fa398b0 2024-09-10T05:37:33.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.510+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa458e0 con 0x561d3fa3dd30 2024-09-10T05:37:33.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.510+0000 7fb28f8f6640 1 -- 172.21.15.62:0/2879844081 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2800ee020 con 0x561d3fa3dd30 2024-09-10T05:37:33.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.510+0000 7fb28f8f6640 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa458e0 con 0x561d3fa3dd30 2024-09-10T05:37:33.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.510+0000 7fb28f8f6640 1 -- 172.21.15.62:0/2879844081 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2800ee020 con 0x561d3fa3dd30 2024-09-10T05:37:33.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.510+0000 7fb28f8f6640 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa458e0 con 0x561d3fa398b0 2024-09-10T05:37:33.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.510+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb28800a4d0 con 0x561d3fa398b0 2024-09-10T05:37:33.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.510+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa458e0 con 0x7fb280124040 2024-09-10T05:37:33.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.510+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb28800a4d0 con 0x7fb280124040 2024-09-10T05:37:33.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.510+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa458e0 con 0x561d3fa398b0 2024-09-10T05:37:33.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.510+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb28800a4d0 con 0x561d3fa398b0 2024-09-10T05:37:33.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.510+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa458e0 con 0x7fb280124040 2024-09-10T05:37:33.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.510+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb28800a4d0 con 0x7fb280124040 2024-09-10T05:37:33.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.510+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa458e0 con 0x561d3fa3dd30 2024-09-10T05:37:33.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.514+0000 7fb28f8f6640 1 -- 172.21.15.62:0/2879844081 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2800ee020 con 0x561d3fa3dd30 2024-09-10T05:37:33.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.514+0000 7fb28f8f6640 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa458e0 con 0x561d3fa41560 2024-09-10T05:37:33.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.514+0000 7fb28f0f5640 1 -- 172.21.15.62:0/2879844081 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb284026070 con 0x561d3fa41560 2024-09-10T05:37:33.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.514+0000 7fb28f0f5640 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa458e0 con 0x561d3fa398b0 2024-09-10T05:37:33.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.514+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb28800a4d0 con 0x561d3fa398b0 2024-09-10T05:37:33.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.514+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa458e0 con 0x561d3fa3dd30 2024-09-10T05:37:33.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.514+0000 7fb28f8f6640 1 -- 172.21.15.62:0/2879844081 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2800ee020 con 0x561d3fa3dd30 2024-09-10T05:37:33.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.514+0000 7fb28f8f6640 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa458e0 con 0x561d3fa41560 2024-09-10T05:37:33.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.514+0000 7fb28f0f5640 1 -- 172.21.15.62:0/2879844081 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 32 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7fb284026070 con 0x561d3fa41560 2024-09-10T05:37:33.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.514+0000 7fb28f0f5640 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa458e0 con 0x561d3fa398b0 2024-09-10T05:37:33.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.514+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb28800a4d0 con 0x561d3fa398b0 2024-09-10T05:37:33.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.514+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa458e0 con 0x561d3fa398b0 2024-09-10T05:37:33.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.514+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb28800a4d0 con 0x561d3fa398b0 2024-09-10T05:37:33.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.514+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa458e0 con 0x561d3fa398b0 2024-09-10T05:37:33.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.514+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb28800a4d0 con 0x561d3fa398b0 2024-09-10T05:37:33.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.514+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa458e0 con 0x561d3fa41560 2024-09-10T05:37:33.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.514+0000 7fb28f0f5640 1 -- 172.21.15.62:0/2879844081 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb284026070 con 0x561d3fa41560 2024-09-10T05:37:33.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.514+0000 7fb28f0f5640 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa458e0 con 0x7fb280124040 2024-09-10T05:37:33.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.514+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb28800a4d0 con 0x7fb280124040 2024-09-10T05:37:33.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.514+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa458e0 con 0x561d3fa398b0 2024-09-10T05:37:33.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.514+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb28800a4d0 con 0x561d3fa398b0 2024-09-10T05:37:33.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.514+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa458e0 con 0x7fb280124040 2024-09-10T05:37:33.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.514+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb28800a4d0 con 0x7fb280124040 2024-09-10T05:37:33.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.514+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa458e0 con 0x561d3fa41560 2024-09-10T05:37:33.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.518+0000 7fb28f0f5640 1 -- 172.21.15.62:0/2879844081 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb284026070 con 0x561d3fa41560 2024-09-10T05:37:33.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.518+0000 7fb28f0f5640 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa458e0 con 0x7fb280124040 2024-09-10T05:37:33.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.518+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb28800a4d0 con 0x7fb280124040 2024-09-10T05:37:33.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.518+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa458e0 con 0x561d3fa3dd30 2024-09-10T05:37:33.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.518+0000 7fb28f8f6640 1 -- 172.21.15.62:0/2879844081 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2800ee020 con 0x561d3fa3dd30 2024-09-10T05:37:33.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.518+0000 7fb28f8f6640 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa458e0 con 0x561d3fa3dd30 2024-09-10T05:37:33.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.518+0000 7fb28f8f6640 1 -- 172.21.15.62:0/2879844081 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2800ee020 con 0x561d3fa3dd30 2024-09-10T05:37:33.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.518+0000 7fb28f8f6640 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa458e0 con 0x561d3fa41560 2024-09-10T05:37:33.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.518+0000 7fb28f0f5640 1 -- 172.21.15.62:0/2879844081 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb284026070 con 0x561d3fa41560 2024-09-10T05:37:33.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.518+0000 7fb28f0f5640 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa458e0 con 0x561d3fa3dd30 2024-09-10T05:37:33.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.518+0000 7fb28f8f6640 1 -- 172.21.15.62:0/2879844081 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb2800ee020 con 0x561d3fa3dd30 2024-09-10T05:37:33.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.518+0000 7fb28f8f6640 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa458e0 con 0x561d3fa3dd30 2024-09-10T05:37:33.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.518+0000 7fb28f8f6640 1 -- 172.21.15.62:0/2879844081 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2800ee020 con 0x561d3fa3dd30 2024-09-10T05:37:33.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.518+0000 7fb291df09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:37:33.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.518+0000 7fb291df09c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:37:33.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.518+0000 7fb291df09c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:37:33.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.518+0000 7fb291df09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:37:33.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.518+0000 7fb291df09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:37:33.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.518+0000 7fb291df09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:37:33.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.518+0000 7fb291df09c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:33.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.518+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa449e0 con 0x561d3fa398b0 2024-09-10T05:37:33.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.518+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb28800a4d0 con 0x561d3fa398b0 2024-09-10T05:37:33.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.518+0000 7fb291df09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:33.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.518+0000 7fb291df09c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:33.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.518+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa44e30 con 0x561d3fa3dd30 2024-09-10T05:37:33.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.522+0000 7fb28f8f6640 1 -- 172.21.15.62:0/2879844081 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb2800ee020 con 0x561d3fa3dd30 2024-09-10T05:37:33.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.522+0000 7fb291df09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:37:33.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.522+0000 7fb291df09c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:33.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.522+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa45290 con 0x561d3fa41560 2024-09-10T05:37:33.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.522+0000 7fb28f0f5640 1 -- 172.21.15.62:0/2879844081 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb284026070 con 0x561d3fa41560 2024-09-10T05:37:33.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.522+0000 7fb291df09c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:37:33.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.522+0000 7fb291df09c0 20 zone default found 2024-09-10T05:37:33.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.522+0000 7fb291df09c0 4 Realm: () 2024-09-10T05:37:33.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.522+0000 7fb291df09c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:37:33.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.522+0000 7fb291df09c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:37:33.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.522+0000 7fb291df09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:37:33.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.522+0000 7fb291df09c0 20 zonegroup default 2024-09-10T05:37:33.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.522+0000 7fb291df09c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:33.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.522+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa44560 con 0x7fb280124040 2024-09-10T05:37:33.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.522+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb28800a4d0 con 0x7fb280124040 2024-09-10T05:37:33.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.522+0000 7fb291df09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:33.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.522+0000 7fb291df09c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:33.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.522+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa47ff0 con 0x561d3fa41560 2024-09-10T05:37:33.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.522+0000 7fb28f0f5640 1 -- 172.21.15.62:0/2879844081 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb284026070 con 0x561d3fa41560 2024-09-10T05:37:33.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.522+0000 7fb291df09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:33.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.522+0000 7fb291df09c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:33.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.522+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa484a0 con 0x561d3fa41560 2024-09-10T05:37:33.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.522+0000 7fb28f0f5640 1 -- 172.21.15.62:0/2879844081 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb284026070 con 0x561d3fa41560 2024-09-10T05:37:33.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.522+0000 7fb291df09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:33.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.522+0000 7fb291df09c0 20 started sync module instance, tier type = 2024-09-10T05:37:33.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.522+0000 7fb291df09c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:37:33.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.522+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa47a20 con 0x561d3fa3dd30 2024-09-10T05:37:33.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.526+0000 7fb28f8f6640 1 -- 172.21.15.62:0/2879844081 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2800ee020 con 0x561d3fa3dd30 2024-09-10T05:37:33.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.526+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94683621781152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa48900 con 0x561d3fa3dd30 2024-09-10T05:37:33.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.526+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa493a0 con 0x561d3fa398b0 2024-09-10T05:37:33.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.526+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb28800a4d0 con 0x561d3fa398b0 2024-09-10T05:37:33.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.526+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94683621791632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa4a060 con 0x561d3fa398b0 2024-09-10T05:37:33.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.526+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa4aa20 con 0x561d3fa3dd30 2024-09-10T05:37:33.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.526+0000 7fb28f8f6640 1 -- 172.21.15.62:0/2879844081 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94683621781152] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2800ee020 con 0x561d3fa3dd30 2024-09-10T05:37:33.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.526+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94683621791632] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb28800a4d0 con 0x561d3fa398b0 2024-09-10T05:37:33.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.530+0000 7fb28f8f6640 1 -- 172.21.15.62:0/2879844081 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2800ee020 con 0x561d3fa3dd30 2024-09-10T05:37:33.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.530+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94683621795184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa4a060 con 0x561d3fa3dd30 2024-09-10T05:37:33.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.530+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa4a990 con 0x7fb280124040 2024-09-10T05:37:33.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.530+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb28800a4d0 con 0x7fb280124040 2024-09-10T05:37:33.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.530+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94683621797392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa4a990 con 0x7fb280124040 2024-09-10T05:37:33.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.530+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa4bd60 con 0x561d3fa3dd30 2024-09-10T05:37:33.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.530+0000 7fb28f8f6640 1 -- 172.21.15.62:0/2879844081 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94683621795184] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2800ee020 con 0x561d3fa3dd30 2024-09-10T05:37:33.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.530+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94683621797392] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb28800a4d0 con 0x7fb280124040 2024-09-10T05:37:33.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.530+0000 7fb28f8f6640 1 -- 172.21.15.62:0/2879844081 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2800ee020 con 0x561d3fa3dd30 2024-09-10T05:37:33.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.530+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94683621798448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa4bd20 con 0x561d3fa3dd30 2024-09-10T05:37:33.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.530+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa4c150 con 0x561d3fa41560 2024-09-10T05:37:33.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.534+0000 7fb28f0f5640 1 -- 172.21.15.62:0/2879844081 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb284026070 con 0x561d3fa41560 2024-09-10T05:37:33.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.534+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94683621792688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa4c150 con 0x561d3fa41560 2024-09-10T05:37:33.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.534+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa4d010 con 0x561d3fa41560 2024-09-10T05:37:33.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.534+0000 7fb28f8f6640 1 -- 172.21.15.62:0/2879844081 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94683621798448] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2800ee020 con 0x561d3fa3dd30 2024-09-10T05:37:33.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.534+0000 7fb28f0f5640 1 -- 172.21.15.62:0/2879844081 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94683621792688] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb284026070 con 0x561d3fa41560 2024-09-10T05:37:33.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.534+0000 7fb28f0f5640 1 -- 172.21.15.62:0/2879844081 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb284026070 con 0x561d3fa41560 2024-09-10T05:37:33.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.534+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94683621803328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa4cb60 con 0x561d3fa41560 2024-09-10T05:37:33.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.534+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa4d8b0 con 0x7fb280124040 2024-09-10T05:37:33.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.538+0000 7fb28f0f5640 1 -- 172.21.15.62:0/2879844081 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94683621803328] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb284026070 con 0x561d3fa41560 2024-09-10T05:37:33.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.538+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb28800a4d0 con 0x7fb280124040 2024-09-10T05:37:33.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.538+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94683621800016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa4cb60 con 0x7fb280124040 2024-09-10T05:37:33.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.538+0000 7fb291df09c0 20 add_watcher() i=0 2024-09-10T05:37:33.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.538+0000 7fb291df09c0 20 add_watcher() i=1 2024-09-10T05:37:33.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.538+0000 7fb291df09c0 20 add_watcher() i=2 2024-09-10T05:37:33.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.538+0000 7fb291df09c0 20 add_watcher() i=3 2024-09-10T05:37:33.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.538+0000 7fb291df09c0 20 add_watcher() i=4 2024-09-10T05:37:33.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.538+0000 7fb291df09c0 20 add_watcher() i=5 2024-09-10T05:37:33.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.538+0000 7fb291df09c0 20 add_watcher() i=6 2024-09-10T05:37:33.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.538+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94683621800016] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb28800a4d0 con 0x7fb280124040 2024-09-10T05:37:33.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.538+0000 7fb291df09c0 20 add_watcher() i=7 2024-09-10T05:37:33.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.538+0000 7fb291df09c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:37:33.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.538+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa50940 con 0x561d3fa398b0 2024-09-10T05:37:33.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.538+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb28800a4d0 con 0x561d3fa398b0 2024-09-10T05:37:33.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.538+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94683621807104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa4ded0 con 0x561d3fa398b0 2024-09-10T05:37:33.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.542+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94683621807104] v32'202 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb28800a4d0 con 0x561d3fa398b0 2024-09-10T05:37:33.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.542+0000 7fb145fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:37:33.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.542+0000 7fb291df09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:37:33.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.542+0000 7fb291df09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:37:33.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.542+0000 7fb291df09c0 5 note: GC not initialized 2024-09-10T05:37:33.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.542+0000 7fb144fe1640 20 reqs_thread_entry: start 2024-09-10T05:37:33.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.542+0000 7fb291df09c0 20 init_complete bucket index max shards: 11 2024-09-10T05:37:33.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.542+0000 7fb291df09c0 20 Filter name: none 2024-09-10T05:37:33.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.542+0000 7fb0be7fc640 20 reqs_thread_entry: start 2024-09-10T05:37:33.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.542+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa74290 con 0x561d3fa3dd30 2024-09-10T05:37:33.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.542+0000 7fb28f8f6640 1 -- 172.21.15.62:0/2879844081 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fb2800ee020 con 0x561d3fa3dd30 2024-09-10T05:37:33.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.542+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa74290 con 0x561d3fa3dd30 2024-09-10T05:37:33.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.542+0000 7fb28f8f6640 1 -- 172.21.15.62:0/2879844081 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fb2800ee020 con 0x561d3fa3dd30 2024-09-10T05:37:33.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.542+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa74250 con 0x561d3fa3dd30 2024-09-10T05:37:33.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.542+0000 7fb28f8f6640 1 -- 172.21.15.62:0/2879844081 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fb2800ee020 con 0x561d3fa3dd30 2024-09-10T05:37:33.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.542+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa74250 con 0x561d3fa41560 2024-09-10T05:37:33.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.542+0000 7fb28f0f5640 1 -- 172.21.15.62:0/2879844081 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fb284026070 con 0x561d3fa41560 2024-09-10T05:37:33.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.542+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa74250 con 0x561d3fa3dd30 2024-09-10T05:37:33.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.546+0000 7fb28f8f6640 1 -- 172.21.15.62:0/2879844081 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fb2800ee020 con 0x561d3fa3dd30 2024-09-10T05:37:33.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.546+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa74250 con 0x561d3fa41560 2024-09-10T05:37:33.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.546+0000 7fb28f0f5640 1 -- 172.21.15.62:0/2879844081 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fb284026070 con 0x561d3fa41560 2024-09-10T05:37:33.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.546+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa74250 con 0x561d3fa398b0 2024-09-10T05:37:33.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.546+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fb28800a4d0 con 0x561d3fa398b0 2024-09-10T05:37:33.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.546+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa74250 con 0x561d3fa398b0 2024-09-10T05:37:33.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.546+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fb28800a4d0 con 0x561d3fa398b0 2024-09-10T05:37:33.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.546+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa74250 con 0x561d3fa41560 2024-09-10T05:37:33.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.546+0000 7fb28f0f5640 1 -- 172.21.15.62:0/2879844081 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fb284026070 con 0x561d3fa41560 2024-09-10T05:37:33.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.546+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa74250 con 0x561d3fa41560 2024-09-10T05:37:33.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.546+0000 7fb28f0f5640 1 -- 172.21.15.62:0/2879844081 <== osd.3 v2:172.21.15.62:6816/2708991149 19 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fb284026070 con 0x561d3fa41560 2024-09-10T05:37:33.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.546+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa74250 con 0x561d3fa41560 2024-09-10T05:37:33.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.546+0000 7fb28f0f5640 1 -- 172.21.15.62:0/2879844081 <== osd.3 v2:172.21.15.62:6816/2708991149 20 ==== osd_op_reply(72 usage.10 [call out=1378b] v0'0 uv30 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7fb284026070 con 0x561d3fa41560 2024-09-10T05:37:33.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.546+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa75830 con 0x561d3fa398b0 2024-09-10T05:37:33.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.546+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb28800a4d0 con 0x561d3fa398b0 2024-09-10T05:37:33.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.546+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa75830 con 0x7fb280124040 2024-09-10T05:37:33.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.546+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb28800a4d0 con 0x7fb280124040 2024-09-10T05:37:33.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.546+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa75830 con 0x561d3fa41560 2024-09-10T05:37:33.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.546+0000 7fb28f0f5640 1 -- 172.21.15.62:0/2879844081 <== osd.3 v2:172.21.15.62:6816/2708991149 21 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb284026070 con 0x561d3fa41560 2024-09-10T05:37:33.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.546+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa75830 con 0x7fb280124040 2024-09-10T05:37:33.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.546+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb28800a4d0 con 0x7fb280124040 2024-09-10T05:37:33.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.546+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa75830 con 0x561d3fa398b0 2024-09-10T05:37:33.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.546+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb28800a4d0 con 0x561d3fa398b0 2024-09-10T05:37:33.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.546+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa75830 con 0x561d3fa41560 2024-09-10T05:37:33.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.546+0000 7fb28f0f5640 1 -- 172.21.15.62:0/2879844081 <== osd.3 v2:172.21.15.62:6816/2708991149 22 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb284026070 con 0x561d3fa41560 2024-09-10T05:37:33.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.546+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa757e0 con 0x561d3fa398b0 2024-09-10T05:37:33.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.550+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 <== osd.1 v2:172.21.15.62:6808/3442097179 23 ==== osd_op_reply(79 usage.17 [call out=185b] v0'0 uv5 ondisk = 0) ==== 152+0+185 (crc 0 0 0) 0x7fb28800a4d0 con 0x561d3fa398b0 2024-09-10T05:37:33.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.550+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa757e0 con 0x561d3fa3dd30 2024-09-10T05:37:33.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.550+0000 7fb28f8f6640 1 -- 172.21.15.62:0/2879844081 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb2800ee020 con 0x561d3fa3dd30 2024-09-10T05:37:33.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.550+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa757e0 con 0x561d3fa3dd30 2024-09-10T05:37:33.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.550+0000 7fb28f8f6640 1 -- 172.21.15.62:0/2879844081 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb2800ee020 con 0x561d3fa3dd30 2024-09-10T05:37:33.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.550+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa75740 con 0x561d3fa41560 2024-09-10T05:37:33.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.550+0000 7fb28f0f5640 1 -- 172.21.15.62:0/2879844081 <== osd.3 v2:172.21.15.62:6816/2708991149 23 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb284026070 con 0x561d3fa41560 2024-09-10T05:37:33.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.550+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa75720 con 0x561d3fa3dd30 2024-09-10T05:37:33.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.550+0000 7fb28f8f6640 1 -- 172.21.15.62:0/2879844081 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb2800ee020 con 0x561d3fa3dd30 2024-09-10T05:37:33.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.550+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa75720 con 0x561d3fa41560 2024-09-10T05:37:33.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.550+0000 7fb28f0f5640 1 -- 172.21.15.62:0/2879844081 <== osd.3 v2:172.21.15.62:6816/2708991149 24 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb284026070 con 0x561d3fa41560 2024-09-10T05:37:33.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.550+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa75720 con 0x561d3fa398b0 2024-09-10T05:37:33.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.550+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 <== osd.1 v2:172.21.15.62:6808/3442097179 24 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb28800a4d0 con 0x561d3fa398b0 2024-09-10T05:37:33.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.550+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa75720 con 0x561d3fa3dd30 2024-09-10T05:37:33.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.554+0000 7fb28f8f6640 1 -- 172.21.15.62:0/2879844081 <== osd.0 v2:172.21.15.2:6800/945139080 25 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb2800ee020 con 0x561d3fa3dd30 2024-09-10T05:37:33.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.554+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa75720 con 0x561d3fa3dd30 2024-09-10T05:37:33.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.554+0000 7fb28f8f6640 1 -- 172.21.15.62:0/2879844081 <== osd.0 v2:172.21.15.2:6800/945139080 26 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb2800ee020 con 0x561d3fa3dd30 2024-09-10T05:37:33.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.554+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa75720 con 0x561d3fa3dd30 2024-09-10T05:37:33.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.554+0000 7fb28f8f6640 1 -- 172.21.15.62:0/2879844081 <== osd.0 v2:172.21.15.2:6800/945139080 27 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb2800ee020 con 0x561d3fa3dd30 2024-09-10T05:37:33.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.554+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa75720 con 0x561d3fa398b0 2024-09-10T05:37:33.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.554+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 <== osd.1 v2:172.21.15.62:6808/3442097179 25 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb28800a4d0 con 0x561d3fa398b0 2024-09-10T05:37:33.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.554+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa75720 con 0x561d3fa41560 2024-09-10T05:37:33.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.554+0000 7fb28f0f5640 1 -- 172.21.15.62:0/2879844081 <== osd.3 v2:172.21.15.62:6816/2708991149 25 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb284026070 con 0x561d3fa41560 2024-09-10T05:37:33.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.554+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa75720 con 0x561d3fa41560 2024-09-10T05:37:33.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.554+0000 7fb28f0f5640 1 -- 172.21.15.62:0/2879844081 <== osd.3 v2:172.21.15.62:6816/2708991149 26 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb284026070 con 0x561d3fa41560 2024-09-10T05:37:33.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.554+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa75720 con 0x561d3fa3dd30 2024-09-10T05:37:33.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.554+0000 7fb28f8f6640 1 -- 172.21.15.62:0/2879844081 <== osd.0 v2:172.21.15.2:6800/945139080 28 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb2800ee020 con 0x561d3fa3dd30 2024-09-10T05:37:33.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.554+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa75720 con 0x561d3fa398b0 2024-09-10T05:37:33.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.554+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 <== osd.1 v2:172.21.15.62:6808/3442097179 26 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb28800a4d0 con 0x561d3fa398b0 2024-09-10T05:37:33.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.558+0000 7fb145fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:37:33.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.558+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94683621807104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa33ef0 con 0x561d3fa398b0 2024-09-10T05:37:33.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.558+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 <== osd.1 v2:172.21.15.62:6808/3442097179 27 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94683621807104] v32'203 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb28800a4d0 con 0x561d3fa398b0 2024-09-10T05:37:33.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.558+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94683621781152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa4d400 con 0x561d3fa3dd30 2024-09-10T05:37:33.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.562+0000 7fb28f8f6640 1 -- 172.21.15.62:0/2879844081 <== osd.0 v2:172.21.15.2:6800/945139080 29 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94683621781152] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2800ee020 con 0x561d3fa3dd30 2024-09-10T05:37:33.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.562+0000 7fb291df09c0 20 remove_watcher() i=0 2024-09-10T05:37:33.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.562+0000 7fb291df09c0 2 removed watcher, disabling cache 2024-09-10T05:37:33.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.562+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94683621791632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa4d400 con 0x561d3fa398b0 2024-09-10T05:37:33.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.562+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 <== osd.1 v2:172.21.15.62:6808/3442097179 28 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94683621791632] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb28800a4d0 con 0x561d3fa398b0 2024-09-10T05:37:33.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.562+0000 7fb291df09c0 20 remove_watcher() i=1 2024-09-10T05:37:33.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.562+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94683621795184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa4d400 con 0x561d3fa3dd30 2024-09-10T05:37:33.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.562+0000 7fb28f8f6640 1 -- 172.21.15.62:0/2879844081 <== osd.0 v2:172.21.15.2:6800/945139080 30 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94683621795184] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2800ee020 con 0x561d3fa3dd30 2024-09-10T05:37:33.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.562+0000 7fb291df09c0 20 remove_watcher() i=2 2024-09-10T05:37:33.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.562+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94683621797392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa74250 con 0x7fb280124040 2024-09-10T05:37:33.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.566+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94683621797392] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb28800a4d0 con 0x7fb280124040 2024-09-10T05:37:33.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.566+0000 7fb291df09c0 20 remove_watcher() i=3 2024-09-10T05:37:33.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.566+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94683621798448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa74250 con 0x561d3fa3dd30 2024-09-10T05:37:33.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.566+0000 7fb28f8f6640 1 -- 172.21.15.62:0/2879844081 <== osd.0 v2:172.21.15.2:6800/945139080 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94683621798448] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2800ee020 con 0x561d3fa3dd30 2024-09-10T05:37:33.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.566+0000 7fb291df09c0 20 remove_watcher() i=4 2024-09-10T05:37:33.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.566+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94683621792688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa74250 con 0x561d3fa41560 2024-09-10T05:37:33.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.570+0000 7fb28f0f5640 1 -- 172.21.15.62:0/2879844081 <== osd.3 v2:172.21.15.62:6816/2708991149 27 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94683621792688] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb284026070 con 0x561d3fa41560 2024-09-10T05:37:33.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.570+0000 7fb291df09c0 20 remove_watcher() i=5 2024-09-10T05:37:33.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.570+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94683621803328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa74250 con 0x561d3fa41560 2024-09-10T05:37:33.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.570+0000 7fb28f0f5640 1 -- 172.21.15.62:0/2879844081 <== osd.3 v2:172.21.15.62:6816/2708991149 28 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94683621803328] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb284026070 con 0x561d3fa41560 2024-09-10T05:37:33.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.570+0000 7fb291df09c0 20 remove_watcher() i=6 2024-09-10T05:37:33.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.570+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94683621800016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d3fa74250 con 0x7fb280124040 2024-09-10T05:37:33.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.570+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 <== osd.2 v2:172.21.15.62:6800/2677868286 15 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94683621800016] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb28800a4d0 con 0x7fb280124040 2024-09-10T05:37:33.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.570+0000 7fb291df09c0 20 remove_watcher() i=7 2024-09-10T05:37:33.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.570+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561d3fa3dd30 msgr2=0x561d3fa40120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:33.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.570+0000 7fb291df09c0 1 --2- 172.21.15.62:0/2879844081 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561d3fa3dd30 0x561d3fa40120 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:33.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.570+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x561d3fa398b0 msgr2=0x561d3fa3bd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:33.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.570+0000 7fb291df09c0 1 --2- 172.21.15.62:0/2879844081 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x561d3fa398b0 0x561d3fa3bd40 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:33.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.570+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fb280124040 msgr2=0x7fb2800d9a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:33.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.570+0000 7fb291df09c0 1 --2- 172.21.15.62:0/2879844081 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fb280124040 0x7fb2800d9a30 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:33.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.570+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x561d3fa41560 msgr2=0x561d3fa43950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:33.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.570+0000 7fb291df09c0 1 --2- 172.21.15.62:0/2879844081 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x561d3fa41560 0x561d3fa43950 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:33.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.574+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb158039a70 msgr2=0x7fb15803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:33.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.574+0000 7fb291df09c0 1 --2- 172.21.15.62:0/2879844081 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb158039a70 0x7fb15803bf30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb28400c010 tx=0x7fb284010000 comp rx=0 tx=0).stop 2024-09-10T05:37:33.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.574+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3f87af20 msgr2=0x561d3fa2ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:33.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.574+0000 7fb291df09c0 1 --2- 172.21.15.62:0/2879844081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3f87af20 0x561d3fa2ea80 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fb2800e3010 tx=0x7fb2800b9ef0 comp rx=0 tx=0).stop 2024-09-10T05:37:33.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.574+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 reap_dead start 2024-09-10T05:37:33.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.574+0000 7fb2900f7640 1 -- 172.21.15.62:0/2879844081 reap_dead start 2024-09-10T05:37:33.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.574+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 shutdown_connections 2024-09-10T05:37:33.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.574+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 >> 172.21.15.62:0/2879844081 conn(0x561d3fa1f7a0 msgr2=0x561d3fa1d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:33.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.574+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 shutdown_connections 2024-09-10T05:37:33.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.574+0000 7fb291df09c0 1 -- 172.21.15.62:0/2879844081 wait complete. 2024-09-10T05:37:33.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.574+0000 7fb291df09c0 1 -- 172.21.15.62:0/879719928 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb168039a70 msgr2=0x7fb16803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:33.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.574+0000 7fb291df09c0 1 --2- 172.21.15.62:0/879719928 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb168039a70 0x7fb16803bf30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x561d3fa00910 tx=0x7fb28400f000 comp rx=0 tx=0).stop 2024-09-10T05:37:33.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.574+0000 7fb291df09c0 1 -- 172.21.15.62:0/879719928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3fa16b90 msgr2=0x561d3fa16fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:33.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.574+0000 7fb291df09c0 1 --2- 172.21.15.62:0/879719928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3fa16b90 0x561d3fa16fb0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fb2800b67d0 tx=0x7fb280001c50 comp rx=0 tx=0).stop 2024-09-10T05:37:33.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.574+0000 7fb291df09c0 1 -- 172.21.15.62:0/879719928 shutdown_connections 2024-09-10T05:37:33.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.574+0000 7fb291df09c0 1 --2- 172.21.15.62:0/879719928 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb168039a70 0x7fb16803bf30 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:33.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.574+0000 7fb291df09c0 1 --2- 172.21.15.62:0/879719928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3fa16b90 0x561d3fa16fb0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:33.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.574+0000 7fb291df09c0 1 -- 172.21.15.62:0/879719928 >> 172.21.15.62:0/879719928 conn(0x561d3fa0c540 msgr2=0x561d3fa0c920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:33.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.574+0000 7fb291df09c0 1 -- 172.21.15.62:0/879719928 shutdown_connections 2024-09-10T05:37:33.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.574+0000 7fb291df09c0 1 -- 172.21.15.62:0/879719928 wait complete. 2024-09-10T05:37:33.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.574+0000 7fb291df09c0 1 -- 172.21.15.62:0/1910888046 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561d3fa01070 msgr2=0x561d3fa03530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:33.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.574+0000 7fb291df09c0 1 --2- 172.21.15.62:0/1910888046 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561d3fa01070 0x561d3fa03530 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:33.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.574+0000 7fb291df09c0 1 -- 172.21.15.62:0/1910888046 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x561d3f909340 msgr2=0x561d3fa00030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:33.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.574+0000 7fb291df09c0 1 --2- 172.21.15.62:0/1910888046 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x561d3f909340 0x561d3fa00030 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:33.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.574+0000 7fb291df09c0 1 -- 172.21.15.62:0/1910888046 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x561d3fa05a60 msgr2=0x561d3fa07e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:33.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.574+0000 7fb291df09c0 1 --2- 172.21.15.62:0/1910888046 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x561d3fa05a60 0x561d3fa07e50 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:33.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.574+0000 7fb291df09c0 1 -- 172.21.15.62:0/1910888046 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb178039ac0 msgr2=0x7fb17803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:33.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.574+0000 7fb291df09c0 1 --2- 172.21.15.62:0/1910888046 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb178039ac0 0x7fb17803bf80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb284004180 tx=0x7fb284001340 comp rx=0 tx=0).stop 2024-09-10T05:37:33.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.574+0000 7fb291df09c0 1 -- 172.21.15.62:0/1910888046 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3f906200 msgr2=0x561d3f9f8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:33.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.574+0000 7fb291df09c0 1 --2- 172.21.15.62:0/1910888046 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3f906200 0x561d3f9f8ec0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fb2800ab510 tx=0x7fb280018020 comp rx=0 tx=0).stop 2024-09-10T05:37:33.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.574+0000 7fb2900f7640 1 -- 172.21.15.62:0/1910888046 reap_dead start 2024-09-10T05:37:33.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.574+0000 7fb291df09c0 1 -- 172.21.15.62:0/1910888046 shutdown_connections 2024-09-10T05:37:33.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.574+0000 7fb291df09c0 1 -- 172.21.15.62:0/1910888046 >> 172.21.15.62:0/1910888046 conn(0x561d3f879b10 msgr2=0x561d3f9ec030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:33.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.574+0000 7fb291df09c0 1 -- 172.21.15.62:0/1910888046 shutdown_connections 2024-09-10T05:37:33.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.574+0000 7fb291df09c0 1 -- 172.21.15.62:0/1910888046 wait complete. 2024-09-10T05:37:33.590 INFO:teuthology.orchestra.run.smithi062.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"anonymous","categories":[],"s3select":{}}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"anonymous","categories":[],"total":{"bytes_sent":0,"bytes_received":0,"ops":0,"successful_ops":0,"bytes_processed":0,"bytes_returned":0}},{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-10T05:37:33.591 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'anonymous', 'categories': [], 's3select': {}}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T05:37:33.591 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-10T05:37:33.591 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-10T05:37:33.591 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-10T05:37:33.663 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:37:33.663 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:37:33.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.658+0000 7f85a56cc9c0 1 Processor -- start 2024-09-10T05:37:33.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.658+0000 7f85a56cc9c0 1 -- start start 2024-09-10T05:37:33.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.658+0000 7f85a56cc9c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55b1d4a5fff0 0x55b1d4a5eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:33.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.658+0000 7f85a56cc9c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b1d499d9c0 con 0x55b1d4a5fac0 2024-09-10T05:37:33.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.658+0000 7f85a56cc9c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x55b1d49ed6d0 con 0x55b1d4a5fff0 2024-09-10T05:37:33.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.658+0000 7f85a29d1640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55b1d4a5fff0 0x55b1d4a5eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:33.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.658+0000 7f85a31d2640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x55b1d4a5fac0 0x55b1d4a5e460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:45978/0 (socket says 172.21.15.62:45978) 2024-09-10T05:37:33.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.662+0000 7f85a31d2640 1 -- 172.21.15.62:0/2109684711 learned_addr learned my addr 172.21.15.62:0/2109684711 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-10T05:37:33.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.662+0000 7f85a29d1640 1 -- 172.21.15.62:0/2109684711 >> v1:172.21.15.2:6789/0 conn(0x55b1d4a5fac0 legacy=0x55b1d4a5e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:33.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.662+0000 7f85a29d1640 1 -- 172.21.15.62:0/2109684711 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1d4991ca0 con 0x55b1d4a5fff0 2024-09-10T05:37:33.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.662+0000 7f85a29d1640 1 --2- 172.21.15.62:0/2109684711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1d4a5fff0 0x55b1d4a5eb70 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f859800a480 tx=0x7f859801b220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8fe68c24928ecbc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:33.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.662+0000 7f85a21d0640 1 -- 172.21.15.62:0/2109684711 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85980af070 con 0x55b1d4a5fff0 2024-09-10T05:37:33.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.662+0000 7f85a21d0640 1 -- 172.21.15.62:0/2109684711 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85980aa570 con 0x55b1d4a5fff0 2024-09-10T05:37:33.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.662+0000 7f85a21d0640 1 -- 172.21.15.62:0/2109684711 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85980aa8b0 con 0x55b1d4a5fff0 2024-09-10T05:37:33.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.666+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/2109684711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1d4a5fff0 msgr2=0x55b1d4a5eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:33.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.666+0000 7f85a56cc9c0 1 --2- 172.21.15.62:0/2109684711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1d4a5fff0 0x55b1d4a5eb70 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f859800a480 tx=0x7f859801b220 comp rx=0 tx=0).stop 2024-09-10T05:37:33.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.666+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/2109684711 shutdown_connections 2024-09-10T05:37:33.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.666+0000 7f85a56cc9c0 1 --2- 172.21.15.62:0/2109684711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1d4a5fff0 0x55b1d4a5eb70 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:33.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.666+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/2109684711 >> 172.21.15.62:0/2109684711 conn(0x55b1d4ae4aa0 msgr2=0x55b1d4ae6ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:33.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.666+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/2109684711 shutdown_connections 2024-09-10T05:37:33.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.666+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/2109684711 wait complete. 2024-09-10T05:37:33.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.682+0000 7f85a56cc9c0 1 Processor -- start 2024-09-10T05:37:33.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.682+0000 7f85a56cc9c0 1 -- start start 2024-09-10T05:37:33.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.682+0000 7f85a56cc9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1d4a5fac0 0x55b1d4bd6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:33.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.682+0000 7f85a56cc9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b1d49f1680 con 0x55b1d4a5fac0 2024-09-10T05:37:33.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.682+0000 7f85a31d2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1d4a5fac0 0x55b1d4bd6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:33.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.682+0000 7f85a31d2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1d4a5fac0 0x55b1d4bd6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:57548/0 (socket says 172.21.15.62:57548) 2024-09-10T05:37:33.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.682+0000 7f85a31d2640 1 -- 172.21.15.62:0/491853946 learned_addr learned my addr 172.21.15.62:0/491853946 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:33.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.682+0000 7f85a31d2640 1 -- 172.21.15.62:0/491853946 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1d496cda0 con 0x55b1d4a5fac0 2024-09-10T05:37:33.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.682+0000 7f85a31d2640 1 --2- 172.21.15.62:0/491853946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1d4a5fac0 0x55b1d4bd6b20 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f8594001e00 tx=0x7f859400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce31de859f4c0715 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:33.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.682+0000 7f849160a640 1 -- 172.21.15.62:0/491853946 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8594012020 con 0x55b1d4a5fac0 2024-09-10T05:37:33.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.682+0000 7f849160a640 1 -- 172.21.15.62:0/491853946 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f859400e690 con 0x55b1d4a5fac0 2024-09-10T05:37:33.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.682+0000 7f849160a640 1 -- 172.21.15.62:0/491853946 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f859400ea10 con 0x55b1d4a5fac0 2024-09-10T05:37:33.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.682+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/491853946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1d4a5fac0 msgr2=0x55b1d4bd6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:33.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.682+0000 7f85a56cc9c0 1 --2- 172.21.15.62:0/491853946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1d4a5fac0 0x55b1d4bd6b20 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f8594001e00 tx=0x7f859400b6d0 comp rx=0 tx=0).stop 2024-09-10T05:37:33.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.682+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/491853946 shutdown_connections 2024-09-10T05:37:33.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.686+0000 7f85a56cc9c0 1 --2- 172.21.15.62:0/491853946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1d4a5fac0 0x55b1d4bd6b20 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:33.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.686+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/491853946 >> 172.21.15.62:0/491853946 conn(0x55b1d4ae4aa0 msgr2=0x55b1d4bd27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:33.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.686+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/491853946 shutdown_connections 2024-09-10T05:37:33.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.686+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/491853946 wait complete. 2024-09-10T05:37:33.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.686+0000 7f85a56cc9c0 1 Processor -- start 2024-09-10T05:37:33.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.686+0000 7f85a56cc9c0 1 -- start start 2024-09-10T05:37:33.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.686+0000 7f85a56cc9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1d4a5fac0 0x55b1d4bde1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:33.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.686+0000 7f85a56cc9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b1d4993a50 con 0x55b1d4a5fac0 2024-09-10T05:37:33.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.686+0000 7f85a31d2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1d4a5fac0 0x55b1d4bde1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:33.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.686+0000 7f85a31d2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1d4a5fac0 0x55b1d4bde1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:57556/0 (socket says 172.21.15.62:57556) 2024-09-10T05:37:33.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.686+0000 7f85a31d2640 1 -- 172.21.15.62:0/1159169963 learned_addr learned my addr 172.21.15.62:0/1159169963 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:33.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.686+0000 7f85a31d2640 1 -- 172.21.15.62:0/1159169963 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1d4bde710 con 0x55b1d4a5fac0 2024-09-10T05:37:33.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.686+0000 7f85a31d2640 1 --2- 172.21.15.62:0/1159169963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1d4a5fac0 0x55b1d4bde1b0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f859400b710 tx=0x7f8594000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:33.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.686+0000 7f848fe07640 1 -- 172.21.15.62:0/1159169963 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8594012030 con 0x55b1d4a5fac0 2024-09-10T05:37:33.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.686+0000 7f848fe07640 1 -- 172.21.15.62:0/1159169963 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f859401a750 con 0x55b1d4a5fac0 2024-09-10T05:37:33.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.686+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1159169963 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b1d4bde9a0 con 0x55b1d4a5fac0 2024-09-10T05:37:33.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.686+0000 7f848fe07640 1 -- 172.21.15.62:0/1159169963 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f859401aa70 con 0x55b1d4a5fac0 2024-09-10T05:37:33.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.686+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1159169963 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1d4bdf350 con 0x55b1d4a5fac0 2024-09-10T05:37:33.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.686+0000 7f848fe07640 1 -- 172.21.15.62:0/1159169963 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8594015020 con 0x55b1d4a5fac0 2024-09-10T05:37:33.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.690+0000 7f848fe07640 1 --2- 172.21.15.62:0/1159169963 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8488039a70 0x7f848803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:33.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.690+0000 7f848fe07640 1 -- 172.21.15.62:0/1159169963 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7f8594020030 con 0x55b1d4a5fac0 2024-09-10T05:37:33.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.690+0000 7f85a29d1640 1 --2- 172.21.15.62:0/1159169963 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8488039a70 0x7f848803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:33.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.690+0000 7f85a56cc9c0 1 --2- 172.21.15.62:0/1159169963 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55b1d4a5fff0 0x55b1d4be5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:33.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.690+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1159169963 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4be5860 con 0x55b1d4a5fff0 2024-09-10T05:37:33.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.690+0000 7f85a39d3640 1 --2- 172.21.15.62:0/1159169963 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55b1d4a5fff0 0x55b1d4be5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:33.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.690+0000 7f85a29d1640 1 --2- 172.21.15.62:0/1159169963 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8488039a70 0x7f848803bf30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f85980ac000 tx=0x7f85980a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:33.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.690+0000 7f85a39d3640 1 --2- 172.21.15.62:0/1159169963 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55b1d4a5fff0 0x55b1d4be5320 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:33.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.690+0000 7f85a39d3640 1 -- 172.21.15.62:0/1159169963 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f859c00a4d0 con 0x55b1d4a5fff0 2024-09-10T05:37:33.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.690+0000 7f85a56cc9c0 1 --2- 172.21.15.62:0/1159169963 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55b1d4be65c0 0x55b1d4be89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:33.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.690+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1159169963 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4be8fa0 con 0x55b1d4be65c0 2024-09-10T05:37:33.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.690+0000 7f85a31d2640 1 --2- 172.21.15.62:0/1159169963 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55b1d4be65c0 0x55b1d4be89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:33.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.690+0000 7f85a31d2640 1 --2- 172.21.15.62:0/1159169963 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55b1d4be65c0 0x55b1d4be89b0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:33.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.690+0000 7f85a31d2640 1 -- 172.21.15.62:0/1159169963 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8594008030 con 0x55b1d4be65c0 2024-09-10T05:37:33.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.690+0000 7f85a56cc9c0 1 --2- 172.21.15.62:0/1159169963 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55b1d4bead60 0x55b1d4bed150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:33.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.690+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1159169963 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4bed820 con 0x55b1d4bead60 2024-09-10T05:37:33.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.690+0000 7f85a29d1640 1 --2- 172.21.15.62:0/1159169963 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55b1d4bead60 0x55b1d4bed150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:33.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.694+0000 7f85a29d1640 1 --2- 172.21.15.62:0/1159169963 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55b1d4bead60 0x55b1d4bed150 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:33.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.694+0000 7f85a29d1640 1 -- 172.21.15.62:0/1159169963 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f85980a8070 con 0x55b1d4bead60 2024-09-10T05:37:33.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.694+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1159169963 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4be9c00 con 0x55b1d4be65c0 2024-09-10T05:37:33.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.694+0000 7f85a31d2640 1 -- 172.21.15.62:0/1159169963 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8594008030 con 0x55b1d4be65c0 2024-09-10T05:37:33.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.694+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1159169963 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4bea060 con 0x55b1d4bead60 2024-09-10T05:37:33.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.694+0000 7f85a29d1640 1 -- 172.21.15.62:0/1159169963 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f85980a8070 con 0x55b1d4bead60 2024-09-10T05:37:33.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.694+0000 7f85a56cc9c0 1 Processor -- start 2024-09-10T05:37:33.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.694+0000 7f85a56cc9c0 1 -- start start 2024-09-10T05:37:33.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.694+0000 7f85a56cc9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1d4bfbe00 0x55b1d4bfc220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:33.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.694+0000 7f85a56cc9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b1d49fe450 con 0x55b1d4bfbe00 2024-09-10T05:37:33.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.694+0000 7f85a31d2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1d4bfbe00 0x55b1d4bfc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:33.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.694+0000 7f85a31d2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1d4bfbe00 0x55b1d4bfc220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:57558/0 (socket says 172.21.15.62:57558) 2024-09-10T05:37:33.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.694+0000 7f85a31d2640 1 -- 172.21.15.62:0/3946619288 learned_addr learned my addr 172.21.15.62:0/3946619288 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:33.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.694+0000 7f85a31d2640 1 -- 172.21.15.62:0/3946619288 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1d4bfc860 con 0x55b1d4bfbe00 2024-09-10T05:37:33.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.694+0000 7f85a31d2640 1 --2- 172.21.15.62:0/3946619288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1d4bfbe00 0x55b1d4bfc220 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f8594001430 tx=0x7f859402d7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:33.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.698+0000 7f848d602640 1 -- 172.21.15.62:0/3946619288 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f859403a070 con 0x55b1d4bfbe00 2024-09-10T05:37:33.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.698+0000 7f848d602640 1 -- 172.21.15.62:0/3946619288 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f859400d7b0 con 0x55b1d4bfbe00 2024-09-10T05:37:33.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.698+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/3946619288 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b1d4bfd0c0 con 0x55b1d4bfbe00 2024-09-10T05:37:33.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.698+0000 7f848d602640 1 -- 172.21.15.62:0/3946619288 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f859400dae0 con 0x55b1d4bfbe00 2024-09-10T05:37:33.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.698+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/3946619288 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1d4bfd0c0 con 0x55b1d4bfbe00 2024-09-10T05:37:33.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.698+0000 7f848d602640 1 -- 172.21.15.62:0/3946619288 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f859403d070 con 0x55b1d4bfbe00 2024-09-10T05:37:33.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.698+0000 7f848d602640 1 --2- 172.21.15.62:0/3946619288 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f847c039a00 0x7f847c03bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:33.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.698+0000 7f848d602640 1 -- 172.21.15.62:0/3946619288 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7f8594005050 con 0x55b1d4bfbe00 2024-09-10T05:37:33.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.698+0000 7f85a29d1640 1 --2- 172.21.15.62:0/3946619288 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f847c039a00 0x7f847c03bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:33.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.698+0000 7f85a56cc9c0 1 Processor -- start 2024-09-10T05:37:33.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.698+0000 7f85a56cc9c0 1 -- start start 2024-09-10T05:37:33.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.698+0000 7f85a29d1640 1 --2- 172.21.15.62:0/3946619288 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f847c039a00 0x7f847c03bec0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x55b1d4bdf600 tx=0x7f8598005a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:33.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.698+0000 7f85a56cc9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1d4c09420 0x55b1d4c09800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:33.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.698+0000 7f85a56cc9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b1d4bd7350 con 0x55b1d4c09420 2024-09-10T05:37:33.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.698+0000 7f85a31d2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1d4c09420 0x55b1d4c09800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:33.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.698+0000 7f85a31d2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1d4c09420 0x55b1d4c09800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:57566/0 (socket says 172.21.15.62:57566) 2024-09-10T05:37:33.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.698+0000 7f85a31d2640 1 -- 172.21.15.62:0/3437450196 learned_addr learned my addr 172.21.15.62:0/3437450196 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:33.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.698+0000 7f85a31d2640 1 -- 172.21.15.62:0/3437450196 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1d4c09df0 con 0x55b1d4c09420 2024-09-10T05:37:33.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.698+0000 7f85a31d2640 1 --2- 172.21.15.62:0/3437450196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1d4c09420 0x55b1d4c09800 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f8594016fd0 tx=0x7f8594024f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c845a94a89c76cf4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:33.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.698+0000 7f8486ffd640 1 -- 172.21.15.62:0/3437450196 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8594035400 con 0x55b1d4c09420 2024-09-10T05:37:33.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.698+0000 7f8486ffd640 1 -- 172.21.15.62:0/3437450196 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f859405f070 con 0x55b1d4c09420 2024-09-10T05:37:33.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.698+0000 7f8486ffd640 1 -- 172.21.15.62:0/3437450196 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8594024420 con 0x55b1d4c09420 2024-09-10T05:37:33.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.702+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/3437450196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1d4c09420 msgr2=0x55b1d4c09800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:33.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.702+0000 7f85a56cc9c0 1 --2- 172.21.15.62:0/3437450196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1d4c09420 0x55b1d4c09800 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f8594016fd0 tx=0x7f8594024f40 comp rx=0 tx=0).stop 2024-09-10T05:37:33.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.702+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/3437450196 shutdown_connections 2024-09-10T05:37:33.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.702+0000 7f85a56cc9c0 1 --2- 172.21.15.62:0/3437450196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1d4c09420 0x55b1d4c09800 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:33.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.702+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/3437450196 >> 172.21.15.62:0/3437450196 conn(0x55b1d4c047e0 msgr2=0x55b1d4c02a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:33.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.702+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/3437450196 shutdown_connections 2024-09-10T05:37:33.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.702+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/3437450196 wait complete. 2024-09-10T05:37:33.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.702+0000 7f85a56cc9c0 1 Processor -- start 2024-09-10T05:37:33.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.702+0000 7f85a56cc9c0 1 -- start start 2024-09-10T05:37:33.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.702+0000 7f85a56cc9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1d4c09420 0x55b1d4c0f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:33.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.702+0000 7f85a56cc9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b1d4c08190 con 0x55b1d4c09420 2024-09-10T05:37:33.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.702+0000 7f85a31d2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1d4c09420 0x55b1d4c0f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:33.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.702+0000 7f85a31d2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1d4c09420 0x55b1d4c0f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:57574/0 (socket says 172.21.15.62:57574) 2024-09-10T05:37:33.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.702+0000 7f85a31d2640 1 -- 172.21.15.62:0/1445967448 learned_addr learned my addr 172.21.15.62:0/1445967448 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:33.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.702+0000 7f85a31d2640 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1d4c0fc40 con 0x55b1d4c09420 2024-09-10T05:37:33.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.702+0000 7f85a31d2640 1 --2- 172.21.15.62:0/1445967448 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1d4c09420 0x55b1d4c0f6e0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f859404d9a0 tx=0x7f8594021ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:33.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.702+0000 7f84857fa640 1 -- 172.21.15.62:0/1445967448 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8594024420 con 0x55b1d4c09420 2024-09-10T05:37:33.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.702+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b1d4c0fc40 con 0x55b1d4c09420 2024-09-10T05:37:33.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.702+0000 7f84857fa640 1 -- 172.21.15.62:0/1445967448 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8594069070 con 0x55b1d4c09420 2024-09-10T05:37:33.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.702+0000 7f84857fa640 1 -- 172.21.15.62:0/1445967448 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8594035400 con 0x55b1d4c09420 2024-09-10T05:37:33.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.702+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1d4c0fc40 con 0x55b1d4c09420 2024-09-10T05:37:33.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.706+0000 7f84857fa640 1 -- 172.21.15.62:0/1445967448 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8594041d10 con 0x55b1d4c09420 2024-09-10T05:37:33.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.706+0000 7f85a56cc9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:33.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.706+0000 7f84857fa640 1 --2- 172.21.15.62:0/1445967448 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f846c039a20 0x7f846c03bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:33.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.706+0000 7f84857fa640 1 -- 172.21.15.62:0/1445967448 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7f85940481a0 con 0x55b1d4c09420 2024-09-10T05:37:33.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.706+0000 7f85a29d1640 1 --2- 172.21.15.62:0/1445967448 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f846c039a20 0x7f846c03bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:33.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.706+0000 7f85a56cc9c0 1 --2- 172.21.15.62:0/1445967448 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55b1d4c1a670 0x55b1d4c1cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:33.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.706+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c1d230 con 0x55b1d4c1a670 2024-09-10T05:37:33.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.706+0000 7f85a39d3640 1 --2- 172.21.15.62:0/1445967448 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55b1d4c1a670 0x55b1d4c1cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:33.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.706+0000 7f85a29d1640 1 --2- 172.21.15.62:0/1445967448 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f846c039a20 0x7f846c03bee0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x55b1d4bdf5d0 tx=0x7f85980a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:33.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.706+0000 7f85a39d3640 1 --2- 172.21.15.62:0/1445967448 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55b1d4c1a670 0x55b1d4c1cae0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:33.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.706+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f859c00a4d0 con 0x55b1d4c1a670 2024-09-10T05:37:33.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.706+0000 7f85a56cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:33.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.706+0000 7f85a56cc9c0 20 realm 2024-09-10T05:37:33.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.706+0000 7f85a56cc9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:33.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.706+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c19a20 con 0x55b1d4c1a670 2024-09-10T05:37:33.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.706+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f859c00a4d0 con 0x55b1d4c1a670 2024-09-10T05:37:33.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.706+0000 7f85a56cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:33.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.706+0000 7f85a56cc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:37:33.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.706+0000 7f85a56cc9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:33.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.706+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c1dcf0 con 0x55b1d4c1a670 2024-09-10T05:37:33.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.706+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f859c00a4d0 con 0x55b1d4c1a670 2024-09-10T05:37:33.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.706+0000 7f85a56cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:33.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.706+0000 7f85a56cc9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:33.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.706+0000 7f85a56cc9c0 1 --2- 172.21.15.62:0/1445967448 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55b1d4c1ead0 0x55b1d4c20ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:33.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.706+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c21550 con 0x55b1d4c1ead0 2024-09-10T05:37:33.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.706+0000 7f85a31d2640 1 --2- 172.21.15.62:0/1445967448 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55b1d4c1ead0 0x55b1d4c20ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:33.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.706+0000 7f85a31d2640 1 --2- 172.21.15.62:0/1445967448 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55b1d4c1ead0 0x55b1d4c20ec0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:33.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.710+0000 7f85a31d2640 1 -- 172.21.15.62:0/1445967448 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f859403c030 con 0x55b1d4c1ead0 2024-09-10T05:37:33.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.710+0000 7f85a56cc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:37:33.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.710+0000 7f85a56cc9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:33.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.710+0000 7f85a56cc9c0 1 --2- 172.21.15.62:0/1445967448 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55b1d4c22300 0x55b1d4c246f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:33.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.710+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c24d90 con 0x55b1d4c22300 2024-09-10T05:37:33.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.710+0000 7f85a29d1640 1 --2- 172.21.15.62:0/1445967448 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55b1d4c22300 0x55b1d4c246f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:33.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.710+0000 7f85a29d1640 1 --2- 172.21.15.62:0/1445967448 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55b1d4c22300 0x55b1d4c246f0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:33.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.710+0000 7f85a29d1640 1 -- 172.21.15.62:0/1445967448 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f85980a8070 con 0x55b1d4c22300 2024-09-10T05:37:33.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.710+0000 7f85a56cc9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:37:33.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.710+0000 7f85a56cc9c0 20 searching for the correct realm 2024-09-10T05:37:33.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.710+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c26680 con 0x55b1d4c22300 2024-09-10T05:37:33.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.710+0000 7f85a29d1640 1 -- 172.21.15.62:0/1445967448 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85980a8070 con 0x55b1d4c22300 2024-09-10T05:37:33.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.710+0000 7f85a29d1640 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c26680 con 0x55b1d4c1ead0 2024-09-10T05:37:33.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.710+0000 7f85a31d2640 1 -- 172.21.15.62:0/1445967448 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f859403c030 con 0x55b1d4c1ead0 2024-09-10T05:37:33.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.710+0000 7f85a31d2640 1 --2- 172.21.15.62:0/1445967448 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f859405a070 0x7f8594011170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:33.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.710+0000 7f85a31d2640 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c26680 con 0x7f859405a070 2024-09-10T05:37:33.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.710+0000 7f85a39d3640 1 --2- 172.21.15.62:0/1445967448 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f859405a070 0x7f8594011170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:33.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.710+0000 7f85a39d3640 1 --2- 172.21.15.62:0/1445967448 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f859405a070 0x7f8594011170 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:33.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.710+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f859c00a4d0 con 0x7f859405a070 2024-09-10T05:37:33.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.710+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c26680 con 0x55b1d4c1a670 2024-09-10T05:37:33.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.710+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f859c00a4d0 con 0x55b1d4c1a670 2024-09-10T05:37:33.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.710+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c26680 con 0x55b1d4c1a670 2024-09-10T05:37:33.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.714+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f859c00a4d0 con 0x55b1d4c1a670 2024-09-10T05:37:33.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.714+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c26680 con 0x55b1d4c22300 2024-09-10T05:37:33.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.714+0000 7f85a29d1640 1 -- 172.21.15.62:0/1445967448 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85980a8070 con 0x55b1d4c22300 2024-09-10T05:37:33.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.714+0000 7f85a29d1640 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c26680 con 0x55b1d4c1a670 2024-09-10T05:37:33.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.714+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f859c00a4d0 con 0x55b1d4c1a670 2024-09-10T05:37:33.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.714+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c26680 con 0x55b1d4c1ead0 2024-09-10T05:37:33.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.714+0000 7f85a31d2640 1 -- 172.21.15.62:0/1445967448 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f859403c030 con 0x55b1d4c1ead0 2024-09-10T05:37:33.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.714+0000 7f85a31d2640 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c26680 con 0x55b1d4c1ead0 2024-09-10T05:37:33.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.714+0000 7f85a31d2640 1 -- 172.21.15.62:0/1445967448 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f859403c030 con 0x55b1d4c1ead0 2024-09-10T05:37:33.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.714+0000 7f85a31d2640 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c26680 con 0x55b1d4c1a670 2024-09-10T05:37:33.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.714+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f859c00a4d0 con 0x55b1d4c1a670 2024-09-10T05:37:33.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.714+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c26680 con 0x7f859405a070 2024-09-10T05:37:33.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.714+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f859c00a4d0 con 0x7f859405a070 2024-09-10T05:37:33.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.714+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c26680 con 0x55b1d4c1a670 2024-09-10T05:37:33.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.714+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f859c00a4d0 con 0x55b1d4c1a670 2024-09-10T05:37:33.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.714+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c26680 con 0x7f859405a070 2024-09-10T05:37:33.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.714+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f859c00a4d0 con 0x7f859405a070 2024-09-10T05:37:33.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.714+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c26680 con 0x55b1d4c1ead0 2024-09-10T05:37:33.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.718+0000 7f85a31d2640 1 -- 172.21.15.62:0/1445967448 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f859403c030 con 0x55b1d4c1ead0 2024-09-10T05:37:33.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.718+0000 7f85a31d2640 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c26680 con 0x55b1d4c22300 2024-09-10T05:37:33.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.718+0000 7f85a29d1640 1 -- 172.21.15.62:0/1445967448 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85980a8070 con 0x55b1d4c22300 2024-09-10T05:37:33.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.718+0000 7f85a29d1640 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c26680 con 0x55b1d4c1a670 2024-09-10T05:37:33.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.718+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f859c00a4d0 con 0x55b1d4c1a670 2024-09-10T05:37:33.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.718+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c26680 con 0x55b1d4c1ead0 2024-09-10T05:37:33.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.718+0000 7f85a31d2640 1 -- 172.21.15.62:0/1445967448 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f859403c030 con 0x55b1d4c1ead0 2024-09-10T05:37:33.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.718+0000 7f85a31d2640 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c26680 con 0x55b1d4c22300 2024-09-10T05:37:33.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.718+0000 7f85a29d1640 1 -- 172.21.15.62:0/1445967448 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 32 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f85980a8070 con 0x55b1d4c22300 2024-09-10T05:37:33.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.718+0000 7f85a29d1640 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c26680 con 0x55b1d4c1a670 2024-09-10T05:37:33.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.718+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f859c00a4d0 con 0x55b1d4c1a670 2024-09-10T05:37:33.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.718+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c26680 con 0x55b1d4c1a670 2024-09-10T05:37:33.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.718+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f859c00a4d0 con 0x55b1d4c1a670 2024-09-10T05:37:33.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.718+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c26680 con 0x55b1d4c1a670 2024-09-10T05:37:33.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.718+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f859c00a4d0 con 0x55b1d4c1a670 2024-09-10T05:37:33.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.718+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c26680 con 0x55b1d4c22300 2024-09-10T05:37:33.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.718+0000 7f85a29d1640 1 -- 172.21.15.62:0/1445967448 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85980a8070 con 0x55b1d4c22300 2024-09-10T05:37:33.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.718+0000 7f85a29d1640 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c26680 con 0x7f859405a070 2024-09-10T05:37:33.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.718+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f859c00a4d0 con 0x7f859405a070 2024-09-10T05:37:33.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.718+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c26680 con 0x55b1d4c1a670 2024-09-10T05:37:33.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.718+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f859c00a4d0 con 0x55b1d4c1a670 2024-09-10T05:37:33.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.718+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c26680 con 0x7f859405a070 2024-09-10T05:37:33.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.722+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f859c00a4d0 con 0x7f859405a070 2024-09-10T05:37:33.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.722+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c26680 con 0x55b1d4c22300 2024-09-10T05:37:33.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.722+0000 7f85a29d1640 1 -- 172.21.15.62:0/1445967448 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85980a8070 con 0x55b1d4c22300 2024-09-10T05:37:33.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.722+0000 7f85a29d1640 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c26680 con 0x7f859405a070 2024-09-10T05:37:33.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.722+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f859c00a4d0 con 0x7f859405a070 2024-09-10T05:37:33.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.722+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c26680 con 0x55b1d4c1ead0 2024-09-10T05:37:33.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.722+0000 7f85a31d2640 1 -- 172.21.15.62:0/1445967448 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f859403c030 con 0x55b1d4c1ead0 2024-09-10T05:37:33.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.722+0000 7f85a31d2640 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c26680 con 0x55b1d4c1ead0 2024-09-10T05:37:33.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.722+0000 7f85a31d2640 1 -- 172.21.15.62:0/1445967448 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f859403c030 con 0x55b1d4c1ead0 2024-09-10T05:37:33.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.722+0000 7f85a31d2640 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c26680 con 0x55b1d4c22300 2024-09-10T05:37:33.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.722+0000 7f85a29d1640 1 -- 172.21.15.62:0/1445967448 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85980a8070 con 0x55b1d4c22300 2024-09-10T05:37:33.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.722+0000 7f85a29d1640 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c26680 con 0x55b1d4c1ead0 2024-09-10T05:37:33.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.722+0000 7f85a31d2640 1 -- 172.21.15.62:0/1445967448 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f859403c030 con 0x55b1d4c1ead0 2024-09-10T05:37:33.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.722+0000 7f85a31d2640 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c26680 con 0x55b1d4c1ead0 2024-09-10T05:37:33.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.722+0000 7f85a31d2640 1 -- 172.21.15.62:0/1445967448 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f859403c030 con 0x55b1d4c1ead0 2024-09-10T05:37:33.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.722+0000 7f85a56cc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:37:33.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.722+0000 7f85a56cc9c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:37:33.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.722+0000 7f85a56cc9c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:37:33.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.722+0000 7f85a56cc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:37:33.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.722+0000 7f85a56cc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:37:33.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.722+0000 7f85a56cc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:37:33.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.722+0000 7f85a56cc9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:33.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.722+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c25750 con 0x55b1d4c1a670 2024-09-10T05:37:33.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.726+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f859c00a4d0 con 0x55b1d4c1a670 2024-09-10T05:37:33.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.726+0000 7f85a56cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:33.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.726+0000 7f85a56cc9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:33.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.726+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c25b70 con 0x55b1d4c1ead0 2024-09-10T05:37:33.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.726+0000 7f85a31d2640 1 -- 172.21.15.62:0/1445967448 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f859403c030 con 0x55b1d4c1ead0 2024-09-10T05:37:33.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.726+0000 7f85a56cc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:37:33.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.726+0000 7f85a56cc9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:33.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.726+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c25f90 con 0x55b1d4c22300 2024-09-10T05:37:33.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.726+0000 7f85a29d1640 1 -- 172.21.15.62:0/1445967448 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f85980a8070 con 0x55b1d4c22300 2024-09-10T05:37:33.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.726+0000 7f85a56cc9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:37:33.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.726+0000 7f85a56cc9c0 20 zone default found 2024-09-10T05:37:33.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.726+0000 7f85a56cc9c0 4 Realm: () 2024-09-10T05:37:33.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.726+0000 7f85a56cc9c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:37:33.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.726+0000 7f85a56cc9c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:37:33.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.726+0000 7f85a56cc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:37:33.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.726+0000 7f85a56cc9c0 20 zonegroup default 2024-09-10T05:37:33.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.726+0000 7f85a56cc9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:33.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.726+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c26b50 con 0x7f859405a070 2024-09-10T05:37:33.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.726+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f859c00a4d0 con 0x7f859405a070 2024-09-10T05:37:33.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.726+0000 7f85a56cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:33.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.726+0000 7f85a56cc9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:33.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.726+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c28e10 con 0x55b1d4c22300 2024-09-10T05:37:33.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.726+0000 7f85a29d1640 1 -- 172.21.15.62:0/1445967448 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f85980a8070 con 0x55b1d4c22300 2024-09-10T05:37:33.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.726+0000 7f85a56cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:33.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.726+0000 7f85a56cc9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:33.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.726+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c29200 con 0x55b1d4c22300 2024-09-10T05:37:33.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.726+0000 7f85a29d1640 1 -- 172.21.15.62:0/1445967448 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f85980a8070 con 0x55b1d4c22300 2024-09-10T05:37:33.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.726+0000 7f85a56cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:33.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.726+0000 7f85a56cc9c0 20 started sync module instance, tier type = 2024-09-10T05:37:33.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.726+0000 7f85a56cc9c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:37:33.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.726+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c282a0 con 0x55b1d4c1ead0 2024-09-10T05:37:33.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.730+0000 7f85a31d2640 1 -- 172.21.15.62:0/1445967448 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f859403c030 con 0x55b1d4c1ead0 2024-09-10T05:37:33.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.730+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94222267090848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c282a0 con 0x55b1d4c1ead0 2024-09-10T05:37:33.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.730+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c29cc0 con 0x55b1d4c1a670 2024-09-10T05:37:33.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.730+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f859c00a4d0 con 0x55b1d4c1a670 2024-09-10T05:37:33.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.730+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94222267094992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c2a590 con 0x55b1d4c1a670 2024-09-10T05:37:33.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.730+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c2af90 con 0x55b1d4c1ead0 2024-09-10T05:37:33.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.730+0000 7f85a31d2640 1 -- 172.21.15.62:0/1445967448 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94222267090848] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f859403c030 con 0x55b1d4c1ead0 2024-09-10T05:37:33.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.730+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94222267094992] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f859c00a4d0 con 0x55b1d4c1a670 2024-09-10T05:37:33.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.734+0000 7f85a31d2640 1 -- 172.21.15.62:0/1445967448 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f859403c030 con 0x55b1d4c1ead0 2024-09-10T05:37:33.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.734+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94222267088368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c2a0e0 con 0x55b1d4c1ead0 2024-09-10T05:37:33.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.734+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c2b830 con 0x7f859405a070 2024-09-10T05:37:33.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.734+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f859c00a4d0 con 0x7f859405a070 2024-09-10T05:37:33.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.734+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94222267102080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c2a0e0 con 0x7f859405a070 2024-09-10T05:37:33.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.734+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c2c2f0 con 0x55b1d4c1ead0 2024-09-10T05:37:33.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.734+0000 7f85a31d2640 1 -- 172.21.15.62:0/1445967448 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94222267088368] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f859403c030 con 0x55b1d4c1ead0 2024-09-10T05:37:33.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.734+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94222267102080] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f859c00a4d0 con 0x7f859405a070 2024-09-10T05:37:33.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.738+0000 7f85a31d2640 1 -- 172.21.15.62:0/1445967448 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f859403c030 con 0x55b1d4c1ead0 2024-09-10T05:37:33.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.738+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94222267103136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c2c2b0 con 0x55b1d4c1ead0 2024-09-10T05:37:33.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.738+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c2c6e0 con 0x55b1d4c22300 2024-09-10T05:37:33.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.738+0000 7f85a29d1640 1 -- 172.21.15.62:0/1445967448 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85980a8070 con 0x55b1d4c22300 2024-09-10T05:37:33.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.738+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94222267099808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c2c6e0 con 0x55b1d4c22300 2024-09-10T05:37:33.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.738+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c2d5a0 con 0x55b1d4c22300 2024-09-10T05:37:33.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.738+0000 7f85a31d2640 1 -- 172.21.15.62:0/1445967448 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94222267103136] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f859403c030 con 0x55b1d4c1ead0 2024-09-10T05:37:33.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.738+0000 7f85a29d1640 1 -- 172.21.15.62:0/1445967448 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94222267099808] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85980a8070 con 0x55b1d4c22300 2024-09-10T05:37:33.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.738+0000 7f85a29d1640 1 -- 172.21.15.62:0/1445967448 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85980a8070 con 0x55b1d4c22300 2024-09-10T05:37:33.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.738+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94222267108048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c2d0f0 con 0x55b1d4c22300 2024-09-10T05:37:33.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.738+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c2de40 con 0x7f859405a070 2024-09-10T05:37:33.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.742+0000 7f85a29d1640 1 -- 172.21.15.62:0/1445967448 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94222267108048] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85980a8070 con 0x55b1d4c22300 2024-09-10T05:37:33.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.742+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f859c00a4d0 con 0x7f859405a070 2024-09-10T05:37:33.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.742+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94222267104704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c2d0f0 con 0x7f859405a070 2024-09-10T05:37:33.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.742+0000 7f85a56cc9c0 20 add_watcher() i=0 2024-09-10T05:37:33.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.742+0000 7f85a56cc9c0 20 add_watcher() i=1 2024-09-10T05:37:33.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.742+0000 7f85a56cc9c0 20 add_watcher() i=2 2024-09-10T05:37:33.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.742+0000 7f85a56cc9c0 20 add_watcher() i=3 2024-09-10T05:37:33.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.742+0000 7f85a56cc9c0 20 add_watcher() i=4 2024-09-10T05:37:33.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.742+0000 7f85a56cc9c0 20 add_watcher() i=5 2024-09-10T05:37:33.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.742+0000 7f85a56cc9c0 20 add_watcher() i=6 2024-09-10T05:37:33.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.742+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94222267104704] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f859c00a4d0 con 0x7f859405a070 2024-09-10T05:37:33.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.742+0000 7f85a56cc9c0 20 add_watcher() i=7 2024-09-10T05:37:33.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.742+0000 7f85a56cc9c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:37:33.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.742+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c30f00 con 0x55b1d4c1a670 2024-09-10T05:37:33.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.742+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f859c00a4d0 con 0x55b1d4c1a670 2024-09-10T05:37:33.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.742+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94222267111824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c2e490 con 0x55b1d4c1a670 2024-09-10T05:37:33.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.746+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94222267111824] v32'204 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f859c00a4d0 con 0x55b1d4c1a670 2024-09-10T05:37:33.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.746+0000 7f8459fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:37:33.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.746+0000 7f85a56cc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:37:33.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.746+0000 7f85a56cc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:37:33.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.746+0000 7f85a56cc9c0 5 note: GC not initialized 2024-09-10T05:37:33.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.746+0000 7f8458fe1640 20 reqs_thread_entry: start 2024-09-10T05:37:33.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.746+0000 7f85a56cc9c0 20 init_complete bucket index max shards: 11 2024-09-10T05:37:33.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.746+0000 7f85a56cc9c0 20 Filter name: none 2024-09-10T05:37:33.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.746+0000 7f83d27fc640 20 reqs_thread_entry: start 2024-09-10T05:37:33.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.746+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c54860 con 0x55b1d4c1ead0 2024-09-10T05:37:33.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.746+0000 7f85a31d2640 1 -- 172.21.15.62:0/1445967448 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f859403c030 con 0x55b1d4c1ead0 2024-09-10T05:37:33.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.746+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c54860 con 0x55b1d4c1ead0 2024-09-10T05:37:33.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.746+0000 7f85a31d2640 1 -- 172.21.15.62:0/1445967448 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f859403c030 con 0x55b1d4c1ead0 2024-09-10T05:37:33.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.746+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c54820 con 0x55b1d4c1ead0 2024-09-10T05:37:33.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.750+0000 7f85a31d2640 1 -- 172.21.15.62:0/1445967448 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f859403c030 con 0x55b1d4c1ead0 2024-09-10T05:37:33.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.750+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c54820 con 0x55b1d4c22300 2024-09-10T05:37:33.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.750+0000 7f85a29d1640 1 -- 172.21.15.62:0/1445967448 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f85980a8070 con 0x55b1d4c22300 2024-09-10T05:37:33.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.750+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c54820 con 0x55b1d4c1ead0 2024-09-10T05:37:33.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.750+0000 7f85a31d2640 1 -- 172.21.15.62:0/1445967448 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f859403c030 con 0x55b1d4c1ead0 2024-09-10T05:37:33.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.750+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c54820 con 0x55b1d4c22300 2024-09-10T05:37:33.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.750+0000 7f85a29d1640 1 -- 172.21.15.62:0/1445967448 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f85980a8070 con 0x55b1d4c22300 2024-09-10T05:37:33.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.750+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c54820 con 0x55b1d4c1a670 2024-09-10T05:37:33.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.750+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f859c00a4d0 con 0x55b1d4c1a670 2024-09-10T05:37:33.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.750+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c54820 con 0x55b1d4c1a670 2024-09-10T05:37:33.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.750+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f859c00a4d0 con 0x55b1d4c1a670 2024-09-10T05:37:33.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.750+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c54820 con 0x55b1d4c22300 2024-09-10T05:37:33.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.750+0000 7f85a29d1640 1 -- 172.21.15.62:0/1445967448 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f85980a8070 con 0x55b1d4c22300 2024-09-10T05:37:33.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.750+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c54820 con 0x55b1d4c22300 2024-09-10T05:37:33.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.750+0000 7f85a29d1640 1 -- 172.21.15.62:0/1445967448 <== osd.3 v2:172.21.15.62:6816/2708991149 19 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f85980a8070 con 0x55b1d4c22300 2024-09-10T05:37:33.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.750+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c54820 con 0x55b1d4c22300 2024-09-10T05:37:33.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.750+0000 7f85a29d1640 1 -- 172.21.15.62:0/1445967448 <== osd.3 v2:172.21.15.62:6816/2708991149 20 ==== osd_op_reply(72 usage.10 [call out=1378b] v0'0 uv30 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f85980a8070 con 0x55b1d4c22300 2024-09-10T05:37:33.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.750+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c55ec0 con 0x55b1d4c1a670 2024-09-10T05:37:33.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.750+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f859c00a4d0 con 0x55b1d4c1a670 2024-09-10T05:37:33.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.750+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c55ec0 con 0x7f859405a070 2024-09-10T05:37:33.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.750+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f859c00a4d0 con 0x7f859405a070 2024-09-10T05:37:33.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.750+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c55ec0 con 0x55b1d4c22300 2024-09-10T05:37:33.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.754+0000 7f85a29d1640 1 -- 172.21.15.62:0/1445967448 <== osd.3 v2:172.21.15.62:6816/2708991149 21 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f85980a8070 con 0x55b1d4c22300 2024-09-10T05:37:33.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.754+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c55ec0 con 0x7f859405a070 2024-09-10T05:37:33.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.754+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f859c00a4d0 con 0x7f859405a070 2024-09-10T05:37:33.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.754+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c55ec0 con 0x55b1d4c1a670 2024-09-10T05:37:33.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.754+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f859c00a4d0 con 0x55b1d4c1a670 2024-09-10T05:37:33.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.754+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c55ec0 con 0x55b1d4c22300 2024-09-10T05:37:33.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.754+0000 7f85a29d1640 1 -- 172.21.15.62:0/1445967448 <== osd.3 v2:172.21.15.62:6816/2708991149 22 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f85980a8070 con 0x55b1d4c22300 2024-09-10T05:37:33.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.754+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c55e50 con 0x55b1d4c1a670 2024-09-10T05:37:33.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.754+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 <== osd.1 v2:172.21.15.62:6808/3442097179 23 ==== osd_op_reply(79 usage.17 [call out=185b] v0'0 uv5 ondisk = 0) ==== 152+0+185 (crc 0 0 0) 0x7f859c00a4d0 con 0x55b1d4c1a670 2024-09-10T05:37:33.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.754+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c55e50 con 0x55b1d4c1ead0 2024-09-10T05:37:33.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.754+0000 7f85a31d2640 1 -- 172.21.15.62:0/1445967448 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f859403c030 con 0x55b1d4c1ead0 2024-09-10T05:37:33.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.754+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c55e50 con 0x55b1d4c1ead0 2024-09-10T05:37:33.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.754+0000 7f85a31d2640 1 -- 172.21.15.62:0/1445967448 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f859403c030 con 0x55b1d4c1ead0 2024-09-10T05:37:33.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.754+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c55e50 con 0x55b1d4c22300 2024-09-10T05:37:33.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.754+0000 7f85a29d1640 1 -- 172.21.15.62:0/1445967448 <== osd.3 v2:172.21.15.62:6816/2708991149 23 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f85980a8070 con 0x55b1d4c22300 2024-09-10T05:37:33.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.754+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c55e50 con 0x55b1d4c1ead0 2024-09-10T05:37:33.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.754+0000 7f85a31d2640 1 -- 172.21.15.62:0/1445967448 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f859403c030 con 0x55b1d4c1ead0 2024-09-10T05:37:33.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.754+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c55e50 con 0x55b1d4c22300 2024-09-10T05:37:33.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.758+0000 7f85a29d1640 1 -- 172.21.15.62:0/1445967448 <== osd.3 v2:172.21.15.62:6816/2708991149 24 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f85980a8070 con 0x55b1d4c22300 2024-09-10T05:37:33.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.758+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c55e30 con 0x55b1d4c1a670 2024-09-10T05:37:33.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.758+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 <== osd.1 v2:172.21.15.62:6808/3442097179 24 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f859c00a4d0 con 0x55b1d4c1a670 2024-09-10T05:37:33.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.758+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c55e30 con 0x55b1d4c1ead0 2024-09-10T05:37:33.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.758+0000 7f85a31d2640 1 -- 172.21.15.62:0/1445967448 <== osd.0 v2:172.21.15.2:6800/945139080 25 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f859403c030 con 0x55b1d4c1ead0 2024-09-10T05:37:33.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.758+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c55e30 con 0x55b1d4c1ead0 2024-09-10T05:37:33.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.758+0000 7f85a31d2640 1 -- 172.21.15.62:0/1445967448 <== osd.0 v2:172.21.15.2:6800/945139080 26 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f859403c030 con 0x55b1d4c1ead0 2024-09-10T05:37:33.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.758+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c55e30 con 0x55b1d4c1ead0 2024-09-10T05:37:33.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.758+0000 7f85a31d2640 1 -- 172.21.15.62:0/1445967448 <== osd.0 v2:172.21.15.2:6800/945139080 27 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f859403c030 con 0x55b1d4c1ead0 2024-09-10T05:37:33.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.758+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c55e30 con 0x55b1d4c1a670 2024-09-10T05:37:33.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.758+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 <== osd.1 v2:172.21.15.62:6808/3442097179 25 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f859c00a4d0 con 0x55b1d4c1a670 2024-09-10T05:37:33.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.758+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c55e30 con 0x55b1d4c22300 2024-09-10T05:37:33.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.758+0000 7f85a29d1640 1 -- 172.21.15.62:0/1445967448 <== osd.3 v2:172.21.15.62:6816/2708991149 25 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f85980a8070 con 0x55b1d4c22300 2024-09-10T05:37:33.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.758+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c55e30 con 0x55b1d4c22300 2024-09-10T05:37:33.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.758+0000 7f85a29d1640 1 -- 172.21.15.62:0/1445967448 <== osd.3 v2:172.21.15.62:6816/2708991149 26 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f85980a8070 con 0x55b1d4c22300 2024-09-10T05:37:33.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.758+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c55e30 con 0x55b1d4c1ead0 2024-09-10T05:37:33.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.758+0000 7f85a31d2640 1 -- 172.21.15.62:0/1445967448 <== osd.0 v2:172.21.15.2:6800/945139080 28 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f859403c030 con 0x55b1d4c1ead0 2024-09-10T05:37:33.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.758+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c55e30 con 0x55b1d4c1a670 2024-09-10T05:37:33.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.762+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 <== osd.1 v2:172.21.15.62:6808/3442097179 26 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f859c00a4d0 con 0x55b1d4c1a670 2024-09-10T05:37:33.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.762+0000 7f8459fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:37:33.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.762+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94222267111824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c14c30 con 0x55b1d4c1a670 2024-09-10T05:37:33.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.762+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 <== osd.1 v2:172.21.15.62:6808/3442097179 27 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94222267111824] v32'205 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f859c00a4d0 con 0x55b1d4c1a670 2024-09-10T05:37:33.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.762+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94222267090848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c54820 con 0x55b1d4c1ead0 2024-09-10T05:37:33.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.766+0000 7f85a31d2640 1 -- 172.21.15.62:0/1445967448 <== osd.0 v2:172.21.15.2:6800/945139080 29 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94222267090848] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f859403c030 con 0x55b1d4c1ead0 2024-09-10T05:37:33.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.766+0000 7f85a56cc9c0 20 remove_watcher() i=0 2024-09-10T05:37:33.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.766+0000 7f85a56cc9c0 2 removed watcher, disabling cache 2024-09-10T05:37:33.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.766+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94222267094992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c54820 con 0x55b1d4c1a670 2024-09-10T05:37:33.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.766+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 <== osd.1 v2:172.21.15.62:6808/3442097179 28 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94222267094992] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f859c00a4d0 con 0x55b1d4c1a670 2024-09-10T05:37:33.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.766+0000 7f85a56cc9c0 20 remove_watcher() i=1 2024-09-10T05:37:33.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.766+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94222267088368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c54820 con 0x55b1d4c1ead0 2024-09-10T05:37:33.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.770+0000 7f85a31d2640 1 -- 172.21.15.62:0/1445967448 <== osd.0 v2:172.21.15.2:6800/945139080 30 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94222267088368] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f859403c030 con 0x55b1d4c1ead0 2024-09-10T05:37:33.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.770+0000 7f85a56cc9c0 20 remove_watcher() i=2 2024-09-10T05:37:33.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.770+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94222267102080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c54820 con 0x7f859405a070 2024-09-10T05:37:33.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.770+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94222267102080] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f859c00a4d0 con 0x7f859405a070 2024-09-10T05:37:33.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.770+0000 7f85a56cc9c0 20 remove_watcher() i=3 2024-09-10T05:37:33.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.770+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94222267103136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c54820 con 0x55b1d4c1ead0 2024-09-10T05:37:33.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.774+0000 7f85a31d2640 1 -- 172.21.15.62:0/1445967448 <== osd.0 v2:172.21.15.2:6800/945139080 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94222267103136] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f859403c030 con 0x55b1d4c1ead0 2024-09-10T05:37:33.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.774+0000 7f85a56cc9c0 20 remove_watcher() i=4 2024-09-10T05:37:33.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.774+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94222267099808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c54820 con 0x55b1d4c22300 2024-09-10T05:37:33.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.774+0000 7f85a29d1640 1 -- 172.21.15.62:0/1445967448 <== osd.3 v2:172.21.15.62:6816/2708991149 27 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94222267099808] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85980a8070 con 0x55b1d4c22300 2024-09-10T05:37:33.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.774+0000 7f85a56cc9c0 20 remove_watcher() i=5 2024-09-10T05:37:33.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.774+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94222267108048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c54820 con 0x55b1d4c22300 2024-09-10T05:37:33.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.778+0000 7f85a29d1640 1 -- 172.21.15.62:0/1445967448 <== osd.3 v2:172.21.15.62:6816/2708991149 28 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94222267108048] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85980a8070 con 0x55b1d4c22300 2024-09-10T05:37:33.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.778+0000 7f85a56cc9c0 20 remove_watcher() i=6 2024-09-10T05:37:33.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.778+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94222267104704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b1d4c54820 con 0x7f859405a070 2024-09-10T05:37:33.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.778+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 <== osd.2 v2:172.21.15.62:6800/2677868286 15 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94222267104704] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f859c00a4d0 con 0x7f859405a070 2024-09-10T05:37:33.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.778+0000 7f85a56cc9c0 20 remove_watcher() i=7 2024-09-10T05:37:33.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.778+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55b1d4c1ead0 msgr2=0x55b1d4c20ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:33.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.778+0000 7f85a56cc9c0 1 --2- 172.21.15.62:0/1445967448 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55b1d4c1ead0 0x55b1d4c20ec0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:33.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.778+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55b1d4c1a670 msgr2=0x55b1d4c1cae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:33.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.778+0000 7f85a56cc9c0 1 --2- 172.21.15.62:0/1445967448 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55b1d4c1a670 0x55b1d4c1cae0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:33.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.778+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f859405a070 msgr2=0x7f8594011170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:33.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.778+0000 7f85a56cc9c0 1 --2- 172.21.15.62:0/1445967448 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f859405a070 0x7f8594011170 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:33.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.778+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55b1d4c22300 msgr2=0x55b1d4c246f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:33.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.778+0000 7f85a56cc9c0 1 --2- 172.21.15.62:0/1445967448 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55b1d4c22300 0x55b1d4c246f0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:33.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.778+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f846c039a20 msgr2=0x7f846c03bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:33.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.778+0000 7f85a56cc9c0 1 --2- 172.21.15.62:0/1445967448 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f846c039a20 0x7f846c03bee0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x55b1d4bdf5d0 tx=0x7f85980a7000 comp rx=0 tx=0).stop 2024-09-10T05:37:33.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.778+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1d4c09420 msgr2=0x55b1d4c0f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:33.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.778+0000 7f85a39d3640 1 -- 172.21.15.62:0/1445967448 reap_dead start 2024-09-10T05:37:33.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.778+0000 7f85a56cc9c0 1 --2- 172.21.15.62:0/1445967448 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1d4c09420 0x55b1d4c0f6e0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f859404d9a0 tx=0x7f8594021ef0 comp rx=0 tx=0).stop 2024-09-10T05:37:33.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.778+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 shutdown_connections 2024-09-10T05:37:33.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.778+0000 7f85a56cc9c0 1 --2- 172.21.15.62:0/1445967448 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1d4c09420 0x55b1d4c0f6e0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:33.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.778+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 >> 172.21.15.62:0/1445967448 conn(0x55b1d4c047e0 msgr2=0x55b1d4c029f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:33.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.778+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 shutdown_connections 2024-09-10T05:37:33.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.778+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1445967448 wait complete. 2024-09-10T05:37:33.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.778+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/3946619288 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f847c039a00 msgr2=0x7f847c03bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:33.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.778+0000 7f85a56cc9c0 1 --2- 172.21.15.62:0/3946619288 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f847c039a00 0x7f847c03bec0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x55b1d4bdf600 tx=0x7f8598005a10 comp rx=0 tx=0).stop 2024-09-10T05:37:33.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.778+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/3946619288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1d4bfbe00 msgr2=0x55b1d4bfc220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:33.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.778+0000 7f85a56cc9c0 1 --2- 172.21.15.62:0/3946619288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1d4bfbe00 0x55b1d4bfc220 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f8594001430 tx=0x7f859402d7c0 comp rx=0 tx=0).stop 2024-09-10T05:37:33.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.778+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/3946619288 shutdown_connections 2024-09-10T05:37:33.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.778+0000 7f85a56cc9c0 1 --2- 172.21.15.62:0/3946619288 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f847c039a00 0x7f847c03bec0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:33.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.778+0000 7f85a56cc9c0 1 --2- 172.21.15.62:0/3946619288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1d4bfbe00 0x55b1d4bfc220 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:33.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.778+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/3946619288 >> 172.21.15.62:0/3946619288 conn(0x55b1d4bf17b0 msgr2=0x55b1d4bf1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:33.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.778+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/3946619288 shutdown_connections 2024-09-10T05:37:33.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.778+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/3946619288 wait complete. 2024-09-10T05:37:33.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.778+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1159169963 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55b1d4be65c0 msgr2=0x55b1d4be89b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:33.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.778+0000 7f85a56cc9c0 1 --2- 172.21.15.62:0/1159169963 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55b1d4be65c0 0x55b1d4be89b0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:33.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.778+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1159169963 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55b1d4a5fff0 msgr2=0x55b1d4be5320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:33.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.778+0000 7f85a56cc9c0 1 --2- 172.21.15.62:0/1159169963 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55b1d4a5fff0 0x55b1d4be5320 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:33.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.778+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1159169963 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55b1d4bead60 msgr2=0x55b1d4bed150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:33.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.778+0000 7f85a56cc9c0 1 --2- 172.21.15.62:0/1159169963 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55b1d4bead60 0x55b1d4bed150 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:33.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.778+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1159169963 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8488039a70 msgr2=0x7f848803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:33.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.778+0000 7f85a56cc9c0 1 --2- 172.21.15.62:0/1159169963 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8488039a70 0x7f848803bf30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f85980ac000 tx=0x7f85980a5000 comp rx=0 tx=0).stop 2024-09-10T05:37:33.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.778+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1159169963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1d4a5fac0 msgr2=0x55b1d4bde1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:33.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.778+0000 7f85a56cc9c0 1 --2- 172.21.15.62:0/1159169963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b1d4a5fac0 0x55b1d4bde1b0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f859400b710 tx=0x7f8594000bd0 comp rx=0 tx=0).stop 2024-09-10T05:37:33.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.778+0000 7f85a39d3640 1 -- 172.21.15.62:0/1159169963 reap_dead start 2024-09-10T05:37:33.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.778+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1159169963 shutdown_connections 2024-09-10T05:37:33.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.778+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1159169963 >> 172.21.15.62:0/1159169963 conn(0x55b1d4ae4aa0 msgr2=0x55b1d4bd1250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:33.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.782+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1159169963 shutdown_connections 2024-09-10T05:37:33.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.782+0000 7f85a56cc9c0 1 -- 172.21.15.62:0/1159169963 wait complete. 2024-09-10T05:37:33.796 INFO:teuthology.orchestra.run.smithi062.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo2","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo3","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo4","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]}],"summary":[{"user":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"total":{"bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1,"bytes_processed":0,"bytes_returned":0}},{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-10T05:37:33.796 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo2', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo3', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo4', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T05:37:33.797 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-10T05:37:33.797 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-10T05:37:33.797 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-10T05:37:33.876 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:37:33.876 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:37:33.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.874+0000 7f90f48739c0 1 Processor -- start 2024-09-10T05:37:33.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.874+0000 7f90f48739c0 1 -- start start 2024-09-10T05:37:33.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.874+0000 7f90f48739c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x558ee5e39ff0 0x558ee5e3c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:33.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.874+0000 7f90f48739c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558ee5ceb9c0 con 0x558ee5e35e00 2024-09-10T05:37:33.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.874+0000 7f90f48739c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x558ee5d3b6d0 con 0x558ee5e39ff0 2024-09-10T05:37:33.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.874+0000 7f90f1b78640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x558ee5e39ff0 0x558ee5e3c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:33.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.874+0000 7f90f1b78640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x558ee5e39ff0 0x558ee5e3c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:57582/0 (socket says 172.21.15.62:57582) 2024-09-10T05:37:33.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.874+0000 7f90f2379640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x558ee5e35e00 0x558ee5e361e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:45994/0 (socket says 172.21.15.62:45994) 2024-09-10T05:37:33.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.874+0000 7f90f1b78640 1 -- 172.21.15.62:0/1030666091 learned_addr learned my addr 172.21.15.62:0/1030666091 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:33.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.874+0000 7f90f1b78640 1 -- 172.21.15.62:0/1030666091 >> v1:172.21.15.2:6789/0 conn(0x558ee5e35e00 legacy=0x558ee5e361e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:33.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.874+0000 7f90f1b78640 1 -- 172.21.15.62:0/1030666091 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ee5cdfca0 con 0x558ee5e39ff0 2024-09-10T05:37:33.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.878+0000 7f90f1b78640 1 --2- 172.21.15.62:0/1030666091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ee5e39ff0 0x558ee5e3c3e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f90e800a750 tx=0x7f90e801d290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7a0b47ef0d486f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:33.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.878+0000 7f90f1377640 1 -- 172.21.15.62:0/1030666091 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90e800a200 con 0x558ee5e39ff0 2024-09-10T05:37:33.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.878+0000 7f90f1377640 1 -- 172.21.15.62:0/1030666091 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90e800a3a0 con 0x558ee5e39ff0 2024-09-10T05:37:33.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.878+0000 7f90f1377640 1 -- 172.21.15.62:0/1030666091 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90e80086f0 con 0x558ee5e39ff0 2024-09-10T05:37:33.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.878+0000 7f90f48739c0 1 -- 172.21.15.62:0/1030666091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ee5e39ff0 msgr2=0x558ee5e3c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:33.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.878+0000 7f90f48739c0 1 --2- 172.21.15.62:0/1030666091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ee5e39ff0 0x558ee5e3c3e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f90e800a750 tx=0x7f90e801d290 comp rx=0 tx=0).stop 2024-09-10T05:37:33.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.878+0000 7f90f48739c0 1 -- 172.21.15.62:0/1030666091 shutdown_connections 2024-09-10T05:37:33.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.878+0000 7f90f48739c0 1 --2- 172.21.15.62:0/1030666091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ee5e39ff0 0x558ee5e3c3e0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:33.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.878+0000 7f90f48739c0 1 -- 172.21.15.62:0/1030666091 >> 172.21.15.62:0/1030666091 conn(0x558ee5e31920 msgr2=0x558ee5e33d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:33.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.878+0000 7f90f48739c0 1 -- 172.21.15.62:0/1030666091 shutdown_connections 2024-09-10T05:37:33.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.878+0000 7f90f48739c0 1 -- 172.21.15.62:0/1030666091 wait complete. 2024-09-10T05:37:33.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.894+0000 7f90f48739c0 1 Processor -- start 2024-09-10T05:37:33.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.894+0000 7f90f48739c0 1 -- start start 2024-09-10T05:37:33.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.894+0000 7f90f48739c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ee5e35e00 0x558ee5f20490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:33.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.894+0000 7f90f48739c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558ee5d3f680 con 0x558ee5e35e00 2024-09-10T05:37:33.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.894+0000 7f90f2379640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ee5e35e00 0x558ee5f20490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:33.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.894+0000 7f90f2379640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ee5e35e00 0x558ee5f20490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:57584/0 (socket says 172.21.15.62:57584) 2024-09-10T05:37:33.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.894+0000 7f90f2379640 1 -- 172.21.15.62:0/546190548 learned_addr learned my addr 172.21.15.62:0/546190548 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:33.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.894+0000 7f90f2379640 1 -- 172.21.15.62:0/546190548 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ee5cbada0 con 0x558ee5e35e00 2024-09-10T05:37:33.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.894+0000 7f90f2379640 1 --2- 172.21.15.62:0/546190548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ee5e35e00 0x558ee5f20490 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f90e4001ec0 tx=0x7f90e400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=799510746c842422 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:33.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.894+0000 7f8fe0608640 1 -- 172.21.15.62:0/546190548 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90e400e5d0 con 0x558ee5e35e00 2024-09-10T05:37:33.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.894+0000 7f8fe0608640 1 -- 172.21.15.62:0/546190548 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90e400e770 con 0x558ee5e35e00 2024-09-10T05:37:33.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.894+0000 7f8fe0608640 1 -- 172.21.15.62:0/546190548 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90e400ea70 con 0x558ee5e35e00 2024-09-10T05:37:33.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.898+0000 7f90f48739c0 1 -- 172.21.15.62:0/546190548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ee5e35e00 msgr2=0x558ee5f20490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:33.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.898+0000 7f90f48739c0 1 --2- 172.21.15.62:0/546190548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ee5e35e00 0x558ee5f20490 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f90e4001ec0 tx=0x7f90e400b6d0 comp rx=0 tx=0).stop 2024-09-10T05:37:33.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.898+0000 7f90f48739c0 1 -- 172.21.15.62:0/546190548 shutdown_connections 2024-09-10T05:37:33.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.898+0000 7f90f48739c0 1 --2- 172.21.15.62:0/546190548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ee5e35e00 0x558ee5f20490 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:33.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.898+0000 7f90f48739c0 1 -- 172.21.15.62:0/546190548 >> 172.21.15.62:0/546190548 conn(0x558ee5e31920 msgr2=0x558ee5f1c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:33.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.898+0000 7f90f48739c0 1 -- 172.21.15.62:0/546190548 shutdown_connections 2024-09-10T05:37:33.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.898+0000 7f90f48739c0 1 -- 172.21.15.62:0/546190548 wait complete. 2024-09-10T05:37:33.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.898+0000 7f90f48739c0 1 Processor -- start 2024-09-10T05:37:33.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.898+0000 7f90f48739c0 1 -- start start 2024-09-10T05:37:33.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.898+0000 7f90f48739c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ee5e35e00 0x558ee5f27b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:33.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.898+0000 7f90f48739c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558ee5ce1a50 con 0x558ee5e35e00 2024-09-10T05:37:33.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.898+0000 7f90f2379640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ee5e35e00 0x558ee5f27b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:33.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.898+0000 7f90f2379640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ee5e35e00 0x558ee5f27b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:57586/0 (socket says 172.21.15.62:57586) 2024-09-10T05:37:33.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.898+0000 7f90f2379640 1 -- 172.21.15.62:0/2627221093 learned_addr learned my addr 172.21.15.62:0/2627221093 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:33.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.898+0000 7f90f2379640 1 -- 172.21.15.62:0/2627221093 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ee5f28070 con 0x558ee5e35e00 2024-09-10T05:37:33.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.898+0000 7f90f2379640 1 --2- 172.21.15.62:0/2627221093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ee5e35e00 0x558ee5f27b10 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x558ee5f21420 tx=0x7f90e4000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:33.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.898+0000 7f8fdee05640 1 -- 172.21.15.62:0/2627221093 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90e400f8e0 con 0x558ee5e35e00 2024-09-10T05:37:33.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.898+0000 7f90f48739c0 1 -- 172.21.15.62:0/2627221093 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558ee5f28300 con 0x558ee5e35e00 2024-09-10T05:37:33.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.898+0000 7f8fdee05640 1 -- 172.21.15.62:0/2627221093 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90e400fa80 con 0x558ee5e35e00 2024-09-10T05:37:33.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.898+0000 7f8fdee05640 1 -- 172.21.15.62:0/2627221093 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90e400fda0 con 0x558ee5e35e00 2024-09-10T05:37:33.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.898+0000 7f90f48739c0 1 -- 172.21.15.62:0/2627221093 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ee5f28cb0 con 0x558ee5e35e00 2024-09-10T05:37:33.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.902+0000 7f8fdee05640 1 -- 172.21.15.62:0/2627221093 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f90e4017070 con 0x558ee5e35e00 2024-09-10T05:37:33.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.902+0000 7f8fdee05640 1 --2- 172.21.15.62:0/2627221093 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8fd8039ac0 0x7f8fd803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:33.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.902+0000 7f8fdee05640 1 -- 172.21.15.62:0/2627221093 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7f90e4015020 con 0x558ee5e35e00 2024-09-10T05:37:33.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.902+0000 7f90f1b78640 1 --2- 172.21.15.62:0/2627221093 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8fd8039ac0 0x7f8fd803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:33.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.902+0000 7f90f48739c0 1 --2- 172.21.15.62:0/2627221093 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x558ee5e39ff0 0x558ee5f2ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:33.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.902+0000 7f90f48739c0 1 -- 172.21.15.62:0/2627221093 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f2f1c0 con 0x558ee5e39ff0 2024-09-10T05:37:33.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.902+0000 7f90f2b7a640 1 --2- 172.21.15.62:0/2627221093 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x558ee5e39ff0 0x558ee5f2ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:33.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.902+0000 7f90f1b78640 1 --2- 172.21.15.62:0/2627221093 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8fd8039ac0 0x7f8fd803bf80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f90e80ad000 tx=0x7f90e80a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:33.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.902+0000 7f90f2b7a640 1 --2- 172.21.15.62:0/2627221093 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x558ee5e39ff0 0x558ee5f2ec80 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:33.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.902+0000 7f90f2b7a640 1 -- 172.21.15.62:0/2627221093 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90ec00a4d0 con 0x558ee5e39ff0 2024-09-10T05:37:33.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.902+0000 7f90f48739c0 1 --2- 172.21.15.62:0/2627221093 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x558ee5f2ff20 0x558ee5f32310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:33.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.902+0000 7f90f48739c0 1 -- 172.21.15.62:0/2627221093 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f32900 con 0x558ee5f2ff20 2024-09-10T05:37:33.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.902+0000 7f90f2379640 1 --2- 172.21.15.62:0/2627221093 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x558ee5f2ff20 0x558ee5f32310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:33.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.902+0000 7f90f2379640 1 --2- 172.21.15.62:0/2627221093 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x558ee5f2ff20 0x558ee5f32310 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:33.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.902+0000 7f90f2379640 1 -- 172.21.15.62:0/2627221093 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f90e402e070 con 0x558ee5f2ff20 2024-09-10T05:37:33.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.902+0000 7f90f48739c0 1 --2- 172.21.15.62:0/2627221093 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x558ee5f346c0 0x558ee5f36ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:33.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.902+0000 7f90f48739c0 1 -- 172.21.15.62:0/2627221093 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f37180 con 0x558ee5f346c0 2024-09-10T05:37:33.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.902+0000 7f90f1b78640 1 --2- 172.21.15.62:0/2627221093 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x558ee5f346c0 0x558ee5f36ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:33.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.906+0000 7f90f1b78640 1 --2- 172.21.15.62:0/2627221093 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x558ee5f346c0 0x558ee5f36ab0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:33.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.906+0000 7f90f1b78640 1 -- 172.21.15.62:0/2627221093 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f90e80aa070 con 0x558ee5f346c0 2024-09-10T05:37:33.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.906+0000 7f90f48739c0 1 -- 172.21.15.62:0/2627221093 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f33560 con 0x558ee5f2ff20 2024-09-10T05:37:33.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.906+0000 7f90f2379640 1 -- 172.21.15.62:0/2627221093 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f90e402e070 con 0x558ee5f2ff20 2024-09-10T05:37:33.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.906+0000 7f90f48739c0 1 -- 172.21.15.62:0/2627221093 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f339a0 con 0x558ee5f346c0 2024-09-10T05:37:33.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.906+0000 7f90f1b78640 1 -- 172.21.15.62:0/2627221093 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f90e80aa070 con 0x558ee5f346c0 2024-09-10T05:37:33.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.906+0000 7f90f48739c0 1 Processor -- start 2024-09-10T05:37:33.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.906+0000 7f90f48739c0 1 -- start start 2024-09-10T05:37:33.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.906+0000 7f90f48739c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ee5f457b0 0x558ee5f45bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:33.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.906+0000 7f90f48739c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558ee5d4c450 con 0x558ee5f457b0 2024-09-10T05:37:33.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.906+0000 7f90f2379640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ee5f457b0 0x558ee5f45bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:33.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.906+0000 7f90f2379640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ee5f457b0 0x558ee5f45bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:57596/0 (socket says 172.21.15.62:57596) 2024-09-10T05:37:33.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.906+0000 7f90f2379640 1 -- 172.21.15.62:0/2855827669 learned_addr learned my addr 172.21.15.62:0/2855827669 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:33.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.906+0000 7f90f2379640 1 -- 172.21.15.62:0/2855827669 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ee5f46210 con 0x558ee5f457b0 2024-09-10T05:37:33.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.906+0000 7f90f2379640 1 --2- 172.21.15.62:0/2855827669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ee5f457b0 0x558ee5f45bd0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f90e400b710 tx=0x7f90e4048da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:33.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.906+0000 7f8fd7fff640 1 -- 172.21.15.62:0/2855827669 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90e401a480 con 0x558ee5f457b0 2024-09-10T05:37:33.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.906+0000 7f90f48739c0 1 -- 172.21.15.62:0/2855827669 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558ee5f46210 con 0x558ee5f457b0 2024-09-10T05:37:33.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.906+0000 7f8fd7fff640 1 -- 172.21.15.62:0/2855827669 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90e401a620 con 0x558ee5f457b0 2024-09-10T05:37:33.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.906+0000 7f8fd7fff640 1 -- 172.21.15.62:0/2855827669 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90e401a900 con 0x558ee5f457b0 2024-09-10T05:37:33.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.906+0000 7f90f48739c0 1 -- 172.21.15.62:0/2855827669 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ee5f46db0 con 0x558ee5f457b0 2024-09-10T05:37:33.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.910+0000 7f8fd7fff640 1 -- 172.21.15.62:0/2855827669 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f90e4048270 con 0x558ee5f457b0 2024-09-10T05:37:33.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.910+0000 7f8fd7fff640 1 --2- 172.21.15.62:0/2855827669 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8fcc039a70 0x7f8fcc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:33.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.910+0000 7f8fd7fff640 1 -- 172.21.15.62:0/2855827669 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7f90e4038070 con 0x558ee5f457b0 2024-09-10T05:37:33.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.910+0000 7f90f1b78640 1 --2- 172.21.15.62:0/2855827669 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8fcc039a70 0x7f8fcc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:33.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.910+0000 7f90f48739c0 1 Processor -- start 2024-09-10T05:37:33.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.910+0000 7f90f48739c0 1 -- start start 2024-09-10T05:37:33.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.910+0000 7f90f48739c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ee5f51bc0 0x558ee5f51fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:33.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.910+0000 7f90f48739c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558ee5f20ce0 con 0x558ee5f51bc0 2024-09-10T05:37:33.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.910+0000 7f90f1b78640 1 --2- 172.21.15.62:0/2855827669 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8fcc039a70 0x7f8fcc03bf30 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x558ee5f29020 tx=0x7f90e8005ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:33.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.910+0000 7f90f2379640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ee5f51bc0 0x558ee5f51fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:33.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.910+0000 7f90f2379640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ee5f51bc0 0x558ee5f51fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:57602/0 (socket says 172.21.15.62:57602) 2024-09-10T05:37:33.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.910+0000 7f90f2379640 1 -- 172.21.15.62:0/1304157952 learned_addr learned my addr 172.21.15.62:0/1304157952 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:33.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.910+0000 7f90f2379640 1 -- 172.21.15.62:0/1304157952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ee5f52590 con 0x558ee5f51bc0 2024-09-10T05:37:33.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.910+0000 7f90f2379640 1 --2- 172.21.15.62:0/1304157952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ee5f51bc0 0x558ee5f51fa0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f90e4030b30 tx=0x7f90e401e610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a227ea284c5edb15 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:33.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.910+0000 7f8fd5ffb640 1 -- 172.21.15.62:0/1304157952 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90e4042250 con 0x558ee5f51bc0 2024-09-10T05:37:33.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.910+0000 7f8fd5ffb640 1 -- 172.21.15.62:0/1304157952 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90e405e030 con 0x558ee5f51bc0 2024-09-10T05:37:33.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.910+0000 7f8fd5ffb640 1 -- 172.21.15.62:0/1304157952 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90e40193e0 con 0x558ee5f51bc0 2024-09-10T05:37:33.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.910+0000 7f90f48739c0 1 -- 172.21.15.62:0/1304157952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ee5f51bc0 msgr2=0x558ee5f51fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:33.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.910+0000 7f90f48739c0 1 --2- 172.21.15.62:0/1304157952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ee5f51bc0 0x558ee5f51fa0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f90e4030b30 tx=0x7f90e401e610 comp rx=0 tx=0).stop 2024-09-10T05:37:33.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.910+0000 7f90f48739c0 1 -- 172.21.15.62:0/1304157952 shutdown_connections 2024-09-10T05:37:33.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.914+0000 7f90f48739c0 1 --2- 172.21.15.62:0/1304157952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ee5f51bc0 0x558ee5f51fa0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:33.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.914+0000 7f90f48739c0 1 -- 172.21.15.62:0/1304157952 >> 172.21.15.62:0/1304157952 conn(0x558ee5f4dff0 msgr2=0x558ee5f4c230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:33.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.914+0000 7f90f48739c0 1 -- 172.21.15.62:0/1304157952 shutdown_connections 2024-09-10T05:37:33.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.914+0000 7f90f48739c0 1 -- 172.21.15.62:0/1304157952 wait complete. 2024-09-10T05:37:33.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.914+0000 7f90f48739c0 1 Processor -- start 2024-09-10T05:37:33.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.914+0000 7f90f48739c0 1 -- start start 2024-09-10T05:37:33.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.914+0000 7f90f48739c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ee5f51bc0 0x558ee5f58e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:33.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.914+0000 7f90f48739c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558ee5f52a50 con 0x558ee5f51bc0 2024-09-10T05:37:33.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.914+0000 7f90f2379640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ee5f51bc0 0x558ee5f58e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:33.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.914+0000 7f90f2379640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ee5f51bc0 0x558ee5f58e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:57618/0 (socket says 172.21.15.62:57618) 2024-09-10T05:37:33.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.914+0000 7f90f2379640 1 -- 172.21.15.62:0/2630533099 learned_addr learned my addr 172.21.15.62:0/2630533099 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:33.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.914+0000 7f90f2379640 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ee5f593e0 con 0x558ee5f51bc0 2024-09-10T05:37:33.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.914+0000 7f90f2379640 1 --2- 172.21.15.62:0/2630533099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ee5f51bc0 0x558ee5f58e80 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f90e401b6e0 tx=0x7f90e401e4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:33.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.914+0000 7f8fc3fff640 1 -- 172.21.15.62:0/2630533099 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90e40193e0 con 0x558ee5f51bc0 2024-09-10T05:37:33.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.914+0000 7f90f48739c0 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558ee5f593e0 con 0x558ee5f51bc0 2024-09-10T05:37:33.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.914+0000 7f90f48739c0 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ee5f593e0 con 0x558ee5f51bc0 2024-09-10T05:37:33.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.914+0000 7f8fc3fff640 1 -- 172.21.15.62:0/2630533099 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90e405e040 con 0x558ee5f51bc0 2024-09-10T05:37:33.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.914+0000 7f8fc3fff640 1 -- 172.21.15.62:0/2630533099 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90e4031480 con 0x558ee5f51bc0 2024-09-10T05:37:33.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.914+0000 7f90f48739c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:33.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.914+0000 7f8fc3fff640 1 -- 172.21.15.62:0/2630533099 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f90e40307a0 con 0x558ee5f51bc0 2024-09-10T05:37:33.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.914+0000 7f8fc3fff640 1 --2- 172.21.15.62:0/2630533099 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8fbc039a70 0x7f8fbc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:33.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.914+0000 7f8fc3fff640 1 -- 172.21.15.62:0/2630533099 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7f90e406b070 con 0x558ee5f51bc0 2024-09-10T05:37:33.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.914+0000 7f90f1b78640 1 --2- 172.21.15.62:0/2630533099 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8fbc039a70 0x7f8fbc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:33.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.918+0000 7f90f48739c0 1 --2- 172.21.15.62:0/2630533099 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x558ee5f63dd0 0x558ee5f66260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:33.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.918+0000 7f90f48739c0 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f669b0 con 0x558ee5f63dd0 2024-09-10T05:37:33.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.918+0000 7f90f2b7a640 1 --2- 172.21.15.62:0/2630533099 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x558ee5f63dd0 0x558ee5f66260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:33.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.918+0000 7f90f1b78640 1 --2- 172.21.15.62:0/2630533099 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8fbc039a70 0x7f8fbc03bf30 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f90e801d2d0 tx=0x7f90e80a9000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:33.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.918+0000 7f90f2b7a640 1 --2- 172.21.15.62:0/2630533099 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x558ee5f63dd0 0x558ee5f66260 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:33.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.918+0000 7f90f2b7a640 1 -- 172.21.15.62:0/2630533099 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90ec00a4d0 con 0x558ee5f63dd0 2024-09-10T05:37:33.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.918+0000 7f90f48739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:33.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.918+0000 7f90f48739c0 20 realm 2024-09-10T05:37:33.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.918+0000 7f90f48739c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:33.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.918+0000 7f90f48739c0 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f631c0 con 0x558ee5f63dd0 2024-09-10T05:37:33.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.918+0000 7f90f2b7a640 1 -- 172.21.15.62:0/2630533099 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90ec00a4d0 con 0x558ee5f63dd0 2024-09-10T05:37:33.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.918+0000 7f90f48739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:33.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.918+0000 7f90f48739c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:37:33.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.918+0000 7f90f48739c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:33.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.918+0000 7f90f48739c0 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f67470 con 0x558ee5f63dd0 2024-09-10T05:37:33.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.918+0000 7f90f2b7a640 1 -- 172.21.15.62:0/2630533099 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90ec00a4d0 con 0x558ee5f63dd0 2024-09-10T05:37:33.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.918+0000 7f90f48739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:33.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.918+0000 7f90f48739c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:33.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.918+0000 7f90f48739c0 1 --2- 172.21.15.62:0/2630533099 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x558ee5f68250 0x558ee5f6a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:33.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.918+0000 7f90f48739c0 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f6acd0 con 0x558ee5f68250 2024-09-10T05:37:33.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.918+0000 7f90f2379640 1 --2- 172.21.15.62:0/2630533099 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x558ee5f68250 0x558ee5f6a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:33.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.918+0000 7f90f2379640 1 --2- 172.21.15.62:0/2630533099 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x558ee5f68250 0x558ee5f6a640 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:33.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.918+0000 7f90f2379640 1 -- 172.21.15.62:0/2630533099 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f90e402e070 con 0x558ee5f68250 2024-09-10T05:37:33.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.918+0000 7f90f48739c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:37:33.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.918+0000 7f90f48739c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:33.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.918+0000 7f90f48739c0 1 --2- 172.21.15.62:0/2630533099 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x558ee5f6ba80 0x558ee5f6de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:33.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.918+0000 7f90f48739c0 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f6e4c0 con 0x558ee5f6ba80 2024-09-10T05:37:33.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.918+0000 7f90f1b78640 1 --2- 172.21.15.62:0/2630533099 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x558ee5f6ba80 0x558ee5f6de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:33.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.918+0000 7f90f1b78640 1 --2- 172.21.15.62:0/2630533099 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x558ee5f6ba80 0x558ee5f6de70 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:33.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.922+0000 7f90f1b78640 1 -- 172.21.15.62:0/2630533099 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f90e80aa070 con 0x558ee5f6ba80 2024-09-10T05:37:33.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.922+0000 7f90f48739c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:37:33.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.922+0000 7f90f48739c0 20 searching for the correct realm 2024-09-10T05:37:33.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.922+0000 7f90f48739c0 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f6fd90 con 0x558ee5f6ba80 2024-09-10T05:37:33.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.922+0000 7f90f1b78640 1 -- 172.21.15.62:0/2630533099 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90e80aa070 con 0x558ee5f6ba80 2024-09-10T05:37:33.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.922+0000 7f90f1b78640 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f6fd90 con 0x558ee5f68250 2024-09-10T05:37:33.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.922+0000 7f90f2379640 1 -- 172.21.15.62:0/2630533099 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90e402e070 con 0x558ee5f68250 2024-09-10T05:37:33.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.922+0000 7f90f2379640 1 --2- 172.21.15.62:0/2630533099 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f90e4042540 0x7f90e40047b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:33.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.922+0000 7f90f2379640 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f6fd90 con 0x7f90e4042540 2024-09-10T05:37:33.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.922+0000 7f90f2b7a640 1 --2- 172.21.15.62:0/2630533099 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f90e4042540 0x7f90e40047b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:33.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.922+0000 7f90f2b7a640 1 --2- 172.21.15.62:0/2630533099 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f90e4042540 0x7f90e40047b0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:33.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.922+0000 7f90f2b7a640 1 -- 172.21.15.62:0/2630533099 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90ec00a4d0 con 0x7f90e4042540 2024-09-10T05:37:33.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.922+0000 7f90f2b7a640 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f6fd90 con 0x558ee5f63dd0 2024-09-10T05:37:33.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.922+0000 7f90f2b7a640 1 -- 172.21.15.62:0/2630533099 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90ec00a4d0 con 0x558ee5f63dd0 2024-09-10T05:37:33.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.922+0000 7f90f2b7a640 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f6fd90 con 0x558ee5f63dd0 2024-09-10T05:37:33.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.922+0000 7f90f2b7a640 1 -- 172.21.15.62:0/2630533099 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90ec00a4d0 con 0x558ee5f63dd0 2024-09-10T05:37:33.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.922+0000 7f90f2b7a640 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f6fd90 con 0x558ee5f6ba80 2024-09-10T05:37:33.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.922+0000 7f90f1b78640 1 -- 172.21.15.62:0/2630533099 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90e80aa070 con 0x558ee5f6ba80 2024-09-10T05:37:33.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.922+0000 7f90f1b78640 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f6fd90 con 0x558ee5f63dd0 2024-09-10T05:37:33.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.922+0000 7f90f2b7a640 1 -- 172.21.15.62:0/2630533099 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90ec00a4d0 con 0x558ee5f63dd0 2024-09-10T05:37:33.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.922+0000 7f90f2b7a640 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f6fd90 con 0x558ee5f68250 2024-09-10T05:37:33.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.926+0000 7f90f2379640 1 -- 172.21.15.62:0/2630533099 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90e402e070 con 0x558ee5f68250 2024-09-10T05:37:33.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.926+0000 7f90f2379640 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f6fd90 con 0x558ee5f68250 2024-09-10T05:37:33.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.926+0000 7f90f2379640 1 -- 172.21.15.62:0/2630533099 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90e402e070 con 0x558ee5f68250 2024-09-10T05:37:33.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.926+0000 7f90f2379640 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f6fd90 con 0x558ee5f63dd0 2024-09-10T05:37:33.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.926+0000 7f90f2b7a640 1 -- 172.21.15.62:0/2630533099 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90ec00a4d0 con 0x558ee5f63dd0 2024-09-10T05:37:33.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.926+0000 7f90f2b7a640 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f6fd90 con 0x7f90e4042540 2024-09-10T05:37:33.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.926+0000 7f90f2b7a640 1 -- 172.21.15.62:0/2630533099 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90ec00a4d0 con 0x7f90e4042540 2024-09-10T05:37:33.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.926+0000 7f90f2b7a640 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f6fd90 con 0x558ee5f63dd0 2024-09-10T05:37:33.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.926+0000 7f90f2b7a640 1 -- 172.21.15.62:0/2630533099 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90ec00a4d0 con 0x558ee5f63dd0 2024-09-10T05:37:33.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.926+0000 7f90f2b7a640 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f6fd90 con 0x7f90e4042540 2024-09-10T05:37:33.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.926+0000 7f90f2b7a640 1 -- 172.21.15.62:0/2630533099 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f90ec00a4d0 con 0x7f90e4042540 2024-09-10T05:37:33.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.926+0000 7f90f2b7a640 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f6fd90 con 0x558ee5f68250 2024-09-10T05:37:33.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.926+0000 7f90f2379640 1 -- 172.21.15.62:0/2630533099 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90e402e070 con 0x558ee5f68250 2024-09-10T05:37:33.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.926+0000 7f90f2379640 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f6fd90 con 0x558ee5f6ba80 2024-09-10T05:37:33.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.926+0000 7f90f1b78640 1 -- 172.21.15.62:0/2630533099 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90e80aa070 con 0x558ee5f6ba80 2024-09-10T05:37:33.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.926+0000 7f90f1b78640 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f6fd90 con 0x558ee5f63dd0 2024-09-10T05:37:33.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.926+0000 7f90f2b7a640 1 -- 172.21.15.62:0/2630533099 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90ec00a4d0 con 0x558ee5f63dd0 2024-09-10T05:37:33.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.926+0000 7f90f2b7a640 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f6fd90 con 0x558ee5f68250 2024-09-10T05:37:33.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.930+0000 7f90f2379640 1 -- 172.21.15.62:0/2630533099 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90e402e070 con 0x558ee5f68250 2024-09-10T05:37:33.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.930+0000 7f90f2379640 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f6fd90 con 0x558ee5f6ba80 2024-09-10T05:37:33.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.930+0000 7f90f1b78640 1 -- 172.21.15.62:0/2630533099 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 32 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f90e80aa070 con 0x558ee5f6ba80 2024-09-10T05:37:33.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.930+0000 7f90f1b78640 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f6fd90 con 0x558ee5f63dd0 2024-09-10T05:37:33.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.930+0000 7f90f2b7a640 1 -- 172.21.15.62:0/2630533099 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90ec00a4d0 con 0x558ee5f63dd0 2024-09-10T05:37:33.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.930+0000 7f90f2b7a640 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f6fd90 con 0x558ee5f63dd0 2024-09-10T05:37:33.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.930+0000 7f90f2b7a640 1 -- 172.21.15.62:0/2630533099 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f90ec00a4d0 con 0x558ee5f63dd0 2024-09-10T05:37:33.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.930+0000 7f90f2b7a640 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f6fd90 con 0x558ee5f63dd0 2024-09-10T05:37:33.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.930+0000 7f90f2b7a640 1 -- 172.21.15.62:0/2630533099 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90ec00a4d0 con 0x558ee5f63dd0 2024-09-10T05:37:33.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.930+0000 7f90f2b7a640 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f6fd90 con 0x558ee5f6ba80 2024-09-10T05:37:33.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.930+0000 7f90f1b78640 1 -- 172.21.15.62:0/2630533099 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90e80aa070 con 0x558ee5f6ba80 2024-09-10T05:37:33.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.930+0000 7f90f1b78640 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f6fd90 con 0x7f90e4042540 2024-09-10T05:37:33.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.930+0000 7f90f2b7a640 1 -- 172.21.15.62:0/2630533099 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90ec00a4d0 con 0x7f90e4042540 2024-09-10T05:37:33.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.930+0000 7f90f2b7a640 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f6fd90 con 0x558ee5f63dd0 2024-09-10T05:37:33.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.930+0000 7f90f2b7a640 1 -- 172.21.15.62:0/2630533099 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90ec00a4d0 con 0x558ee5f63dd0 2024-09-10T05:37:33.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.930+0000 7f90f2b7a640 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f6fd90 con 0x7f90e4042540 2024-09-10T05:37:33.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.930+0000 7f90f2b7a640 1 -- 172.21.15.62:0/2630533099 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90ec00a4d0 con 0x7f90e4042540 2024-09-10T05:37:33.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.930+0000 7f90f2b7a640 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f6fd90 con 0x558ee5f6ba80 2024-09-10T05:37:33.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.930+0000 7f90f1b78640 1 -- 172.21.15.62:0/2630533099 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90e80aa070 con 0x558ee5f6ba80 2024-09-10T05:37:33.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.930+0000 7f90f1b78640 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f6fd90 con 0x7f90e4042540 2024-09-10T05:37:33.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.930+0000 7f90f2b7a640 1 -- 172.21.15.62:0/2630533099 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90ec00a4d0 con 0x7f90e4042540 2024-09-10T05:37:33.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.930+0000 7f90f2b7a640 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f6fd90 con 0x558ee5f68250 2024-09-10T05:37:33.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.930+0000 7f90f2379640 1 -- 172.21.15.62:0/2630533099 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90e402e070 con 0x558ee5f68250 2024-09-10T05:37:33.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.930+0000 7f90f2379640 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f6fd90 con 0x558ee5f68250 2024-09-10T05:37:33.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.934+0000 7f90f2379640 1 -- 172.21.15.62:0/2630533099 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90e402e070 con 0x558ee5f68250 2024-09-10T05:37:33.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.934+0000 7f90f2379640 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f6fd90 con 0x558ee5f6ba80 2024-09-10T05:37:33.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.934+0000 7f90f1b78640 1 -- 172.21.15.62:0/2630533099 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90e80aa070 con 0x558ee5f6ba80 2024-09-10T05:37:33.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.934+0000 7f90f1b78640 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f6fd90 con 0x558ee5f68250 2024-09-10T05:37:33.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.934+0000 7f90f2379640 1 -- 172.21.15.62:0/2630533099 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f90e402e070 con 0x558ee5f68250 2024-09-10T05:37:33.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.934+0000 7f90f2379640 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f6fd90 con 0x558ee5f68250 2024-09-10T05:37:33.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.934+0000 7f90f2379640 1 -- 172.21.15.62:0/2630533099 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90e402e070 con 0x558ee5f68250 2024-09-10T05:37:33.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.934+0000 7f90f48739c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:37:33.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.934+0000 7f90f48739c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:37:33.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.934+0000 7f90f48739c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:37:33.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.934+0000 7f90f48739c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:37:33.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.934+0000 7f90f48739c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:37:33.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.934+0000 7f90f48739c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:37:33.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.934+0000 7f90f48739c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:33.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.934+0000 7f90f48739c0 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f6ee80 con 0x558ee5f63dd0 2024-09-10T05:37:33.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.934+0000 7f90f2b7a640 1 -- 172.21.15.62:0/2630533099 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90ec00a4d0 con 0x558ee5f63dd0 2024-09-10T05:37:33.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.934+0000 7f90f48739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:33.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.934+0000 7f90f48739c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:33.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.934+0000 7f90f48739c0 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f6f300 con 0x558ee5f68250 2024-09-10T05:37:33.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.934+0000 7f90f2379640 1 -- 172.21.15.62:0/2630533099 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f90e402e070 con 0x558ee5f68250 2024-09-10T05:37:33.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.934+0000 7f90f48739c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:37:33.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.934+0000 7f90f48739c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:33.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.934+0000 7f90f48739c0 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f6f300 con 0x558ee5f6ba80 2024-09-10T05:37:33.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.934+0000 7f90f1b78640 1 -- 172.21.15.62:0/2630533099 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f90e80aa070 con 0x558ee5f6ba80 2024-09-10T05:37:33.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.934+0000 7f90f48739c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:37:33.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.934+0000 7f90f48739c0 20 zone default found 2024-09-10T05:37:33.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.934+0000 7f90f48739c0 4 Realm: () 2024-09-10T05:37:33.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.934+0000 7f90f48739c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:37:33.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.934+0000 7f90f48739c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:37:33.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.934+0000 7f90f48739c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:37:33.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.934+0000 7f90f48739c0 20 zonegroup default 2024-09-10T05:37:33.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.934+0000 7f90f48739c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:33.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.934+0000 7f90f48739c0 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f70260 con 0x7f90e4042540 2024-09-10T05:37:33.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.934+0000 7f90f2b7a640 1 -- 172.21.15.62:0/2630533099 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f90ec00a4d0 con 0x7f90e4042540 2024-09-10T05:37:33.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.938+0000 7f90f48739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:33.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.938+0000 7f90f48739c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:33.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.938+0000 7f90f48739c0 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f720f0 con 0x558ee5f6ba80 2024-09-10T05:37:33.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.938+0000 7f90f1b78640 1 -- 172.21.15.62:0/2630533099 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f90e80aa070 con 0x558ee5f6ba80 2024-09-10T05:37:33.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.938+0000 7f90f48739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:33.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.938+0000 7f90f48739c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:33.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.938+0000 7f90f48739c0 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f72520 con 0x558ee5f6ba80 2024-09-10T05:37:33.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.938+0000 7f90f1b78640 1 -- 172.21.15.62:0/2630533099 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f90e80aa070 con 0x558ee5f6ba80 2024-09-10T05:37:33.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.938+0000 7f90f48739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:33.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.938+0000 7f90f48739c0 20 started sync module instance, tier type = 2024-09-10T05:37:33.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.938+0000 7f90f48739c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:37:33.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.938+0000 7f90f48739c0 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f71490 con 0x558ee5f68250 2024-09-10T05:37:33.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.938+0000 7f90f2379640 1 -- 172.21.15.62:0/2630533099 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90e402e070 con 0x558ee5f68250 2024-09-10T05:37:33.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.938+0000 7f90f48739c0 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94072231893392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f71490 con 0x558ee5f68250 2024-09-10T05:37:33.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.938+0000 7f90f48739c0 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f73030 con 0x558ee5f63dd0 2024-09-10T05:37:33.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.942+0000 7f90f2b7a640 1 -- 172.21.15.62:0/2630533099 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90ec00a4d0 con 0x558ee5f63dd0 2024-09-10T05:37:33.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.942+0000 7f90f48739c0 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94072231897856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f738d0 con 0x558ee5f63dd0 2024-09-10T05:37:33.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.942+0000 7f90f48739c0 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f742d0 con 0x558ee5f68250 2024-09-10T05:37:33.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.942+0000 7f90f2379640 1 -- 172.21.15.62:0/2630533099 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94072231893392] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90e402e070 con 0x558ee5f68250 2024-09-10T05:37:33.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.942+0000 7f90f2b7a640 1 -- 172.21.15.62:0/2630533099 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94072231897856] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90ec00a4d0 con 0x558ee5f63dd0 2024-09-10T05:37:33.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.942+0000 7f90f2379640 1 -- 172.21.15.62:0/2630533099 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90e402e070 con 0x558ee5f68250 2024-09-10T05:37:33.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.942+0000 7f90f48739c0 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94072231890912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f73420 con 0x558ee5f68250 2024-09-10T05:37:33.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.942+0000 7f90f48739c0 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f74b70 con 0x7f90e4042540 2024-09-10T05:37:33.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.946+0000 7f90f2b7a640 1 -- 172.21.15.62:0/2630533099 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90ec00a4d0 con 0x7f90e4042540 2024-09-10T05:37:33.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.946+0000 7f90f48739c0 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94072231904960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f73420 con 0x7f90e4042540 2024-09-10T05:37:33.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.946+0000 7f90f48739c0 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f75620 con 0x558ee5f68250 2024-09-10T05:37:33.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.946+0000 7f90f2379640 1 -- 172.21.15.62:0/2630533099 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94072231890912] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90e402e070 con 0x558ee5f68250 2024-09-10T05:37:33.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.946+0000 7f90f2b7a640 1 -- 172.21.15.62:0/2630533099 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94072231904960] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90ec00a4d0 con 0x7f90e4042540 2024-09-10T05:37:33.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.946+0000 7f90f2379640 1 -- 172.21.15.62:0/2630533099 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90e402e070 con 0x558ee5f68250 2024-09-10T05:37:33.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.946+0000 7f90f48739c0 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94072231906016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f75130 con 0x558ee5f68250 2024-09-10T05:37:33.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.946+0000 7f90f48739c0 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f75ef0 con 0x558ee5f6ba80 2024-09-10T05:37:33.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.946+0000 7f90f1b78640 1 -- 172.21.15.62:0/2630533099 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90e80aa070 con 0x558ee5f6ba80 2024-09-10T05:37:33.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.946+0000 7f90f48739c0 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94072231909952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f75130 con 0x558ee5f6ba80 2024-09-10T05:37:33.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.946+0000 7f90f48739c0 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f76930 con 0x558ee5f6ba80 2024-09-10T05:37:33.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.950+0000 7f90f2379640 1 -- 172.21.15.62:0/2630533099 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94072231906016] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90e402e070 con 0x558ee5f68250 2024-09-10T05:37:33.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.950+0000 7f90f1b78640 1 -- 172.21.15.62:0/2630533099 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94072231909952] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90e80aa070 con 0x558ee5f6ba80 2024-09-10T05:37:33.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.950+0000 7f90f1b78640 1 -- 172.21.15.62:0/2630533099 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90e80aa070 con 0x558ee5f6ba80 2024-09-10T05:37:33.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.950+0000 7f90f48739c0 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94072231911008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f76480 con 0x558ee5f6ba80 2024-09-10T05:37:33.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.950+0000 7f90f48739c0 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f771d0 con 0x7f90e4042540 2024-09-10T05:37:33.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.950+0000 7f90f2b7a640 1 -- 172.21.15.62:0/2630533099 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90ec00a4d0 con 0x7f90e4042540 2024-09-10T05:37:33.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.950+0000 7f90f48739c0 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94072231914784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f76480 con 0x7f90e4042540 2024-09-10T05:37:33.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.950+0000 7f90f48739c0 20 add_watcher() i=0 2024-09-10T05:37:33.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.950+0000 7f90f48739c0 20 add_watcher() i=1 2024-09-10T05:37:33.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.950+0000 7f90f48739c0 20 add_watcher() i=2 2024-09-10T05:37:33.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.950+0000 7f90f48739c0 20 add_watcher() i=3 2024-09-10T05:37:33.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.950+0000 7f90f48739c0 20 add_watcher() i=4 2024-09-10T05:37:33.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.950+0000 7f90f48739c0 20 add_watcher() i=5 2024-09-10T05:37:33.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.950+0000 7f90f1b78640 1 -- 172.21.15.62:0/2630533099 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94072231911008] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90e80aa070 con 0x558ee5f6ba80 2024-09-10T05:37:33.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.950+0000 7f90f48739c0 20 add_watcher() i=6 2024-09-10T05:37:33.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.950+0000 7f90f2b7a640 1 -- 172.21.15.62:0/2630533099 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94072231914784] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90ec00a4d0 con 0x7f90e4042540 2024-09-10T05:37:33.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.950+0000 7f90f48739c0 20 add_watcher() i=7 2024-09-10T05:37:33.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.950+0000 7f90f48739c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:37:33.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.950+0000 7f90f48739c0 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f73de0 con 0x558ee5f63dd0 2024-09-10T05:37:33.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.954+0000 7f90f2b7a640 1 -- 172.21.15.62:0/2630533099 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f90ec00a4d0 con 0x558ee5f63dd0 2024-09-10T05:37:33.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.954+0000 7f90f48739c0 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94072231902688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f77790 con 0x558ee5f63dd0 2024-09-10T05:37:33.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.954+0000 7f90f2b7a640 1 -- 172.21.15.62:0/2630533099 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94072231902688] v32'206 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f90ec00a4d0 con 0x558ee5f63dd0 2024-09-10T05:37:33.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.954+0000 7f8fa8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:37:33.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.954+0000 7f90f48739c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:37:33.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.954+0000 7f90f48739c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:37:33.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.954+0000 7f90f48739c0 5 note: GC not initialized 2024-09-10T05:37:33.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.954+0000 7f8f237fe640 20 reqs_thread_entry: start 2024-09-10T05:37:33.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.954+0000 7f90f48739c0 20 init_complete bucket index max shards: 11 2024-09-10T05:37:33.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.954+0000 7f90f48739c0 20 Filter name: none 2024-09-10T05:37:33.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.954+0000 7f8f217fa640 20 reqs_thread_entry: start 2024-09-10T05:37:33.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.954+0000 7f90f48739c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:33.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.954+0000 7f90f48739c0 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f9d0b0 con 0x558ee5f63dd0 2024-09-10T05:37:33.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.954+0000 7f90f2b7a640 1 -- 172.21.15.62:0/2630533099 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f90ec00a4d0 con 0x558ee5f63dd0 2024-09-10T05:37:33.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.954+0000 7f90f48739c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:37:33.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.954+0000 7f90f48739c0 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f9e630 con 0x558ee5f6ba80 2024-09-10T05:37:33.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.958+0000 7f90f1b78640 1 -- 172.21.15.62:0/2630533099 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv30 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f90e80aa070 con 0x558ee5f6ba80 2024-09-10T05:37:33.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.958+0000 7f8fa8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:37:33.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.958+0000 7f90f48739c0 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94072231902688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f9c9d0 con 0x558ee5f63dd0 2024-09-10T05:37:33.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.958+0000 7f90f2b7a640 1 -- 172.21.15.62:0/2630533099 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94072231902688] v32'207 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f90ec00a4d0 con 0x558ee5f63dd0 2024-09-10T05:37:33.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.958+0000 7f90f48739c0 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94072231893392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f73de0 con 0x558ee5f68250 2024-09-10T05:37:33.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.962+0000 7f90f2379640 1 -- 172.21.15.62:0/2630533099 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94072231893392] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90e402e070 con 0x558ee5f68250 2024-09-10T05:37:33.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.962+0000 7f90f48739c0 20 remove_watcher() i=0 2024-09-10T05:37:33.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.962+0000 7f90f48739c0 2 removed watcher, disabling cache 2024-09-10T05:37:33.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.962+0000 7f90f48739c0 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94072231897856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f71990 con 0x558ee5f63dd0 2024-09-10T05:37:33.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.962+0000 7f90f2b7a640 1 -- 172.21.15.62:0/2630533099 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94072231897856] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90ec00a4d0 con 0x558ee5f63dd0 2024-09-10T05:37:33.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.962+0000 7f90f48739c0 20 remove_watcher() i=1 2024-09-10T05:37:33.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.962+0000 7f90f48739c0 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94072231890912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f71990 con 0x558ee5f68250 2024-09-10T05:37:33.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.966+0000 7f90f2379640 1 -- 172.21.15.62:0/2630533099 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94072231890912] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90e402e070 con 0x558ee5f68250 2024-09-10T05:37:33.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.966+0000 7f90f48739c0 20 remove_watcher() i=2 2024-09-10T05:37:33.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.966+0000 7f90f48739c0 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94072231904960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f70fe0 con 0x7f90e4042540 2024-09-10T05:37:33.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.966+0000 7f90f2b7a640 1 -- 172.21.15.62:0/2630533099 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94072231904960] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90ec00a4d0 con 0x7f90e4042540 2024-09-10T05:37:33.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.966+0000 7f90f48739c0 20 remove_watcher() i=3 2024-09-10T05:37:33.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.966+0000 7f90f48739c0 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94072231906016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f71990 con 0x558ee5f68250 2024-09-10T05:37:33.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.970+0000 7f90f2379640 1 -- 172.21.15.62:0/2630533099 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94072231906016] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90e402e070 con 0x558ee5f68250 2024-09-10T05:37:33.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.970+0000 7f90f48739c0 20 remove_watcher() i=4 2024-09-10T05:37:33.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.970+0000 7f90f48739c0 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94072231909952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f71990 con 0x558ee5f6ba80 2024-09-10T05:37:33.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.970+0000 7f90f1b78640 1 -- 172.21.15.62:0/2630533099 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94072231909952] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90e80aa070 con 0x558ee5f6ba80 2024-09-10T05:37:33.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.970+0000 7f90f48739c0 20 remove_watcher() i=5 2024-09-10T05:37:33.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.970+0000 7f90f48739c0 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94072231911008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f75a40 con 0x558ee5f6ba80 2024-09-10T05:37:33.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.970+0000 7f90f1b78640 1 -- 172.21.15.62:0/2630533099 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94072231911008] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90e80aa070 con 0x558ee5f6ba80 2024-09-10T05:37:33.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.970+0000 7f90f48739c0 20 remove_watcher() i=6 2024-09-10T05:37:33.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.970+0000 7f90f48739c0 1 -- 172.21.15.62:0/2630533099 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94072231914784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ee5f71990 con 0x7f90e4042540 2024-09-10T05:37:33.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.974+0000 7f90f2b7a640 1 -- 172.21.15.62:0/2630533099 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94072231914784] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90ec00a4d0 con 0x7f90e4042540 2024-09-10T05:37:33.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.974+0000 7f90f48739c0 20 remove_watcher() i=7 2024-09-10T05:37:33.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.974+0000 7f90f48739c0 1 -- 172.21.15.62:0/2630533099 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x558ee5f68250 msgr2=0x558ee5f6a640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:33.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.974+0000 7f90f48739c0 1 --2- 172.21.15.62:0/2630533099 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x558ee5f68250 0x558ee5f6a640 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:33.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.974+0000 7f90f48739c0 1 -- 172.21.15.62:0/2630533099 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x558ee5f63dd0 msgr2=0x558ee5f66260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:33.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.974+0000 7f90f48739c0 1 --2- 172.21.15.62:0/2630533099 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x558ee5f63dd0 0x558ee5f66260 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:33.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.974+0000 7f90f48739c0 1 -- 172.21.15.62:0/2630533099 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f90e4042540 msgr2=0x7f90e40047b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:33.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.974+0000 7f90f48739c0 1 --2- 172.21.15.62:0/2630533099 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f90e4042540 0x7f90e40047b0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:33.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.974+0000 7f90f48739c0 1 -- 172.21.15.62:0/2630533099 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x558ee5f6ba80 msgr2=0x558ee5f6de70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:33.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.974+0000 7f90f48739c0 1 --2- 172.21.15.62:0/2630533099 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x558ee5f6ba80 0x558ee5f6de70 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:33.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.974+0000 7f90f48739c0 1 -- 172.21.15.62:0/2630533099 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8fbc039a70 msgr2=0x7f8fbc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:33.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.974+0000 7f90f48739c0 1 --2- 172.21.15.62:0/2630533099 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8fbc039a70 0x7f8fbc03bf30 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f90e801d2d0 tx=0x7f90e80a9000 comp rx=0 tx=0).stop 2024-09-10T05:37:33.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.974+0000 7f90f48739c0 1 -- 172.21.15.62:0/2630533099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ee5f51bc0 msgr2=0x558ee5f58e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:33.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.974+0000 7f90f2b7a640 1 -- 172.21.15.62:0/2630533099 reap_dead start 2024-09-10T05:37:33.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.974+0000 7f90f48739c0 1 --2- 172.21.15.62:0/2630533099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ee5f51bc0 0x558ee5f58e80 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f90e401b6e0 tx=0x7f90e401e4c0 comp rx=0 tx=0).stop 2024-09-10T05:37:33.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.974+0000 7f90f48739c0 1 -- 172.21.15.62:0/2630533099 shutdown_connections 2024-09-10T05:37:33.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.974+0000 7f90f48739c0 1 --2- 172.21.15.62:0/2630533099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ee5f51bc0 0x558ee5f58e80 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:33.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.974+0000 7f90f48739c0 1 -- 172.21.15.62:0/2630533099 >> 172.21.15.62:0/2630533099 conn(0x558ee5f4dff0 msgr2=0x558ee5f4c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:33.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.974+0000 7f90f48739c0 1 -- 172.21.15.62:0/2630533099 shutdown_connections 2024-09-10T05:37:33.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.974+0000 7f90f48739c0 1 -- 172.21.15.62:0/2630533099 wait complete. 2024-09-10T05:37:33.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.974+0000 7f90f48739c0 1 -- 172.21.15.62:0/2855827669 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8fcc039a70 msgr2=0x7f8fcc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:33.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.974+0000 7f90f48739c0 1 --2- 172.21.15.62:0/2855827669 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8fcc039a70 0x7f8fcc03bf30 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x558ee5f29020 tx=0x7f90e8005ad0 comp rx=0 tx=0).stop 2024-09-10T05:37:33.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.974+0000 7f90f48739c0 1 -- 172.21.15.62:0/2855827669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ee5f457b0 msgr2=0x558ee5f45bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:33.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.974+0000 7f90f48739c0 1 --2- 172.21.15.62:0/2855827669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ee5f457b0 0x558ee5f45bd0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f90e400b710 tx=0x7f90e4048da0 comp rx=0 tx=0).stop 2024-09-10T05:37:33.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.974+0000 7f90f48739c0 1 -- 172.21.15.62:0/2855827669 shutdown_connections 2024-09-10T05:37:33.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.974+0000 7f90f48739c0 1 --2- 172.21.15.62:0/2855827669 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8fcc039a70 0x7f8fcc03bf30 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:33.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.974+0000 7f90f48739c0 1 --2- 172.21.15.62:0/2855827669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ee5f457b0 0x558ee5f45bd0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:33.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.974+0000 7f90f48739c0 1 -- 172.21.15.62:0/2855827669 >> 172.21.15.62:0/2855827669 conn(0x558ee5f3b160 msgr2=0x558ee5f3b540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:33.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.974+0000 7f90f48739c0 1 -- 172.21.15.62:0/2855827669 shutdown_connections 2024-09-10T05:37:33.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.974+0000 7f90f48739c0 1 -- 172.21.15.62:0/2855827669 wait complete. 2024-09-10T05:37:33.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.974+0000 7f90f48739c0 1 -- 172.21.15.62:0/2627221093 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x558ee5f2ff20 msgr2=0x558ee5f32310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:33.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.974+0000 7f90f48739c0 1 --2- 172.21.15.62:0/2627221093 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x558ee5f2ff20 0x558ee5f32310 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:33.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.974+0000 7f90f48739c0 1 -- 172.21.15.62:0/2627221093 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x558ee5e39ff0 msgr2=0x558ee5f2ec80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:33.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.974+0000 7f90f48739c0 1 --2- 172.21.15.62:0/2627221093 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x558ee5e39ff0 0x558ee5f2ec80 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:33.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.974+0000 7f90f48739c0 1 -- 172.21.15.62:0/2627221093 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x558ee5f346c0 msgr2=0x558ee5f36ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:33.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.974+0000 7f90f48739c0 1 --2- 172.21.15.62:0/2627221093 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x558ee5f346c0 0x558ee5f36ab0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:33.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.974+0000 7f90f48739c0 1 -- 172.21.15.62:0/2627221093 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8fd8039ac0 msgr2=0x7f8fd803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:33.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.974+0000 7f90f48739c0 1 --2- 172.21.15.62:0/2627221093 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8fd8039ac0 0x7f8fd803bf80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f90e80ad000 tx=0x7f90e80a7000 comp rx=0 tx=0).stop 2024-09-10T05:37:33.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.974+0000 7f90f48739c0 1 -- 172.21.15.62:0/2627221093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ee5e35e00 msgr2=0x558ee5f27b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:33.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.974+0000 7f90f48739c0 1 --2- 172.21.15.62:0/2627221093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ee5e35e00 0x558ee5f27b10 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x558ee5f21420 tx=0x7f90e4000bd0 comp rx=0 tx=0).stop 2024-09-10T05:37:33.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.974+0000 7f90f2b7a640 1 -- 172.21.15.62:0/2627221093 reap_dead start 2024-09-10T05:37:33.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.974+0000 7f90f48739c0 1 -- 172.21.15.62:0/2627221093 shutdown_connections 2024-09-10T05:37:33.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.974+0000 7f90f48739c0 1 -- 172.21.15.62:0/2627221093 >> 172.21.15.62:0/2627221093 conn(0x558ee5e31920 msgr2=0x558ee5f1ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:33.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.974+0000 7f90f48739c0 1 -- 172.21.15.62:0/2627221093 shutdown_connections 2024-09-10T05:37:33.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:33.974+0000 7f90f48739c0 1 -- 172.21.15.62:0/2627221093 wait complete. 2024-09-10T05:37:33.990 INFO:teuthology.orchestra.run.smithi062.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo2","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo3","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo4","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-10T05:37:33.991 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo2', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo3', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo4', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T05:37:33.991 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-10T05:37:33.991 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-10T05:37:33.991 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2024-09-10T05:37:34.068 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:37:34.068 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:37:34.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.062+0000 7f07aa1b99c0 1 Processor -- start 2024-09-10T05:37:34.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.062+0000 7f07aa1b99c0 1 -- start start 2024-09-10T05:37:34.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.066+0000 7f07aa1b99c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x559d90dd71f0 0x559d90dd75d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.066+0000 7f07aa1b99c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559d90c899c0 con 0x559d90dda330 2024-09-10T05:37:34.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.066+0000 7f07aa1b99c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x559d90cd96d0 con 0x559d90dd71f0 2024-09-10T05:37:34.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.066+0000 7f07a7cbf640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x559d90dd71f0 0x559d90dd75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.066+0000 7f07a7cbf640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x559d90dd71f0 0x559d90dd75d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:57624/0 (socket says 172.21.15.62:57624) 2024-09-10T05:37:34.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.066+0000 7f07a7cbf640 1 -- 172.21.15.62:0/1300573394 learned_addr learned my addr 172.21.15.62:0/1300573394 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:34.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.066+0000 7f07a74be640 1 --1- 172.21.15.62:0/1300573394 >> v1:172.21.15.2:6789/0 conn(0x559d90dda330 0x559d90ddc720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:46002/0 (socket says 172.21.15.62:46002) 2024-09-10T05:37:34.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.066+0000 7f07a7cbf640 1 -- 172.21.15.62:0/1300573394 >> v1:172.21.15.2:6789/0 conn(0x559d90dda330 legacy=0x559d90ddc720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.066+0000 7f07a7cbf640 1 -- 172.21.15.62:0/1300573394 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d90c7dca0 con 0x559d90dd71f0 2024-09-10T05:37:34.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.066+0000 7f07a7cbf640 1 --2- 172.21.15.62:0/1300573394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d90dd71f0 0x559d90dd75d0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f079800a4e0 tx=0x7f079801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e314eda459ab5878 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.066+0000 7f07a6cbd640 1 -- 172.21.15.62:0/1300573394 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07980aa540 con 0x559d90dd71f0 2024-09-10T05:37:34.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.066+0000 7f07a6cbd640 1 -- 172.21.15.62:0/1300573394 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07980aa6e0 con 0x559d90dd71f0 2024-09-10T05:37:34.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.066+0000 7f07a6cbd640 1 -- 172.21.15.62:0/1300573394 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07980aaa40 con 0x559d90dd71f0 2024-09-10T05:37:34.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.070+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/1300573394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d90dd71f0 msgr2=0x559d90dd75d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.070+0000 7f07aa1b99c0 1 --2- 172.21.15.62:0/1300573394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d90dd71f0 0x559d90dd75d0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f079800a4e0 tx=0x7f079801b090 comp rx=0 tx=0).stop 2024-09-10T05:37:34.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.070+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/1300573394 shutdown_connections 2024-09-10T05:37:34.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.070+0000 7f07aa1b99c0 1 --2- 172.21.15.62:0/1300573394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d90dd71f0 0x559d90dd75d0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.070+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/1300573394 >> 172.21.15.62:0/1300573394 conn(0x559d90d4ab00 msgr2=0x559d90d4af10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:34.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.070+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/1300573394 shutdown_connections 2024-09-10T05:37:34.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.070+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/1300573394 wait complete. 2024-09-10T05:37:34.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.082+0000 7f07aa1b99c0 1 Processor -- start 2024-09-10T05:37:34.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.082+0000 7f07aa1b99c0 1 -- start start 2024-09-10T05:37:34.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.082+0000 7f07aa1b99c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d90dd71f0 0x559d90ec28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.082+0000 7f07aa1b99c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559d90cdd680 con 0x559d90dd71f0 2024-09-10T05:37:34.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.086+0000 7f07a7cbf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d90dd71f0 0x559d90ec28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.086+0000 7f07a7cbf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d90dd71f0 0x559d90ec28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:57634/0 (socket says 172.21.15.62:57634) 2024-09-10T05:37:34.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.086+0000 7f07a7cbf640 1 -- 172.21.15.62:0/1815646586 learned_addr learned my addr 172.21.15.62:0/1815646586 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:34.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.086+0000 7f07a7cbf640 1 -- 172.21.15.62:0/1815646586 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d90c58da0 con 0x559d90dd71f0 2024-09-10T05:37:34.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.086+0000 7f07a7cbf640 1 --2- 172.21.15.62:0/1815646586 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d90dd71f0 0x559d90ec28d0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f0798019740 tx=0x7f07980033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86dc086993ec4ad server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.086+0000 7f0695e0b640 1 -- 172.21.15.62:0/1815646586 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07980b9070 con 0x559d90dd71f0 2024-09-10T05:37:34.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.086+0000 7f0695e0b640 1 -- 172.21.15.62:0/1815646586 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07980aaa90 con 0x559d90dd71f0 2024-09-10T05:37:34.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.086+0000 7f0695e0b640 1 -- 172.21.15.62:0/1815646586 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07980aad70 con 0x559d90dd71f0 2024-09-10T05:37:34.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.086+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/1815646586 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d90dd71f0 msgr2=0x559d90ec28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.086+0000 7f07aa1b99c0 1 --2- 172.21.15.62:0/1815646586 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d90dd71f0 0x559d90ec28d0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f0798019740 tx=0x7f07980033b0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.086+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/1815646586 shutdown_connections 2024-09-10T05:37:34.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.086+0000 7f07aa1b99c0 1 --2- 172.21.15.62:0/1815646586 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d90dd71f0 0x559d90ec28d0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.086+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/1815646586 >> 172.21.15.62:0/1815646586 conn(0x559d90d4ab00 msgr2=0x559d90ebe550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:34.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.086+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/1815646586 shutdown_connections 2024-09-10T05:37:34.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.086+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/1815646586 wait complete. 2024-09-10T05:37:34.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.086+0000 7f07aa1b99c0 1 Processor -- start 2024-09-10T05:37:34.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.086+0000 7f07aa1b99c0 1 -- start start 2024-09-10T05:37:34.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.086+0000 7f07aa1b99c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d90dd71f0 0x559d90ec9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.086+0000 7f07aa1b99c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559d90c7fa50 con 0x559d90dd71f0 2024-09-10T05:37:34.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.086+0000 7f07a7cbf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d90dd71f0 0x559d90ec9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.086+0000 7f07a7cbf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d90dd71f0 0x559d90ec9de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:57636/0 (socket says 172.21.15.62:57636) 2024-09-10T05:37:34.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.086+0000 7f07a7cbf640 1 -- 172.21.15.62:0/2352850651 learned_addr learned my addr 172.21.15.62:0/2352850651 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:34.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.090+0000 7f07a7cbf640 1 -- 172.21.15.62:0/2352850651 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d90eca340 con 0x559d90dd71f0 2024-09-10T05:37:34.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.090+0000 7f07a7cbf640 1 --2- 172.21.15.62:0/2352850651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d90dd71f0 0x559d90ec9de0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f0798018cc0 tx=0x7f0798017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.090+0000 7f068ffff640 1 -- 172.21.15.62:0/2352850651 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07980b9070 con 0x559d90dd71f0 2024-09-10T05:37:34.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.090+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/2352850651 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559d90eca5d0 con 0x559d90dd71f0 2024-09-10T05:37:34.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.090+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/2352850651 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d90ecaf80 con 0x559d90dd71f0 2024-09-10T05:37:34.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.090+0000 7f068ffff640 1 -- 172.21.15.62:0/2352850651 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07980b5ad0 con 0x559d90dd71f0 2024-09-10T05:37:34.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.090+0000 7f068ffff640 1 -- 172.21.15.62:0/2352850651 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07980b5db0 con 0x559d90dd71f0 2024-09-10T05:37:34.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.090+0000 7f068ffff640 1 -- 172.21.15.62:0/2352850651 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f07980b3040 con 0x559d90dd71f0 2024-09-10T05:37:34.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.090+0000 7f068ffff640 1 --2- 172.21.15.62:0/2352850651 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0690039a70 0x7f069003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.090+0000 7f068ffff640 1 -- 172.21.15.62:0/2352850651 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7f07980c4070 con 0x559d90dd71f0 2024-09-10T05:37:34.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.090+0000 7f07a74be640 1 --2- 172.21.15.62:0/2352850651 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0690039a70 0x7f069003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.090+0000 7f07aa1b99c0 1 --2- 172.21.15.62:0/2352850651 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x559d90dda330 0x559d90ed0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.090+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/2352850651 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d90ed1490 con 0x559d90dda330 2024-09-10T05:37:34.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.090+0000 7f07a84c0640 1 --2- 172.21.15.62:0/2352850651 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x559d90dda330 0x559d90ed0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.090+0000 7f07a74be640 1 --2- 172.21.15.62:0/2352850651 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0690039a70 0x7f069003bf30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0790001e40 tx=0x7f07900013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.090+0000 7f07a84c0640 1 --2- 172.21.15.62:0/2352850651 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x559d90dda330 0x559d90ed0f50 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.090+0000 7f07a84c0640 1 -- 172.21.15.62:0/2352850651 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07a00083f0 con 0x559d90dda330 2024-09-10T05:37:34.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.090+0000 7f07aa1b99c0 1 --2- 172.21.15.62:0/2352850651 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x559d90ed1f90 0x559d90ed4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.090+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/2352850651 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d90ed4bc0 con 0x559d90ed1f90 2024-09-10T05:37:34.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.094+0000 7f07a7cbf640 1 --2- 172.21.15.62:0/2352850651 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x559d90ed1f90 0x559d90ed4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.094+0000 7f07a7cbf640 1 --2- 172.21.15.62:0/2352850651 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x559d90ed1f90 0x559d90ed4450 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.094+0000 7f07a7cbf640 1 -- 172.21.15.62:0/2352850651 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f07980c73d0 con 0x559d90ed1f90 2024-09-10T05:37:34.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.094+0000 7f07aa1b99c0 1 --2- 172.21.15.62:0/2352850651 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x559d90ed6980 0x559d90ed8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.094+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/2352850651 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d90ed9440 con 0x559d90ed6980 2024-09-10T05:37:34.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.094+0000 7f07a74be640 1 --2- 172.21.15.62:0/2352850651 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x559d90ed6980 0x559d90ed8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.094+0000 7f07a74be640 1 --2- 172.21.15.62:0/2352850651 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x559d90ed6980 0x559d90ed8d70 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.094+0000 7f07a74be640 1 -- 172.21.15.62:0/2352850651 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f079000bd60 con 0x559d90ed6980 2024-09-10T05:37:34.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.094+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/2352850651 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d90ed5820 con 0x559d90ed1f90 2024-09-10T05:37:34.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.094+0000 7f07a7cbf640 1 -- 172.21.15.62:0/2352850651 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f07980c73d0 con 0x559d90ed1f90 2024-09-10T05:37:34.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.094+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/2352850651 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d90ed5c60 con 0x559d90ed6980 2024-09-10T05:37:34.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.094+0000 7f07a74be640 1 -- 172.21.15.62:0/2352850651 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f079000bd60 con 0x559d90ed6980 2024-09-10T05:37:34.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.094+0000 7f07aa1b99c0 1 Processor -- start 2024-09-10T05:37:34.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.094+0000 7f07aa1b99c0 1 -- start start 2024-09-10T05:37:34.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.098+0000 7f07aa1b99c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d90ee7ab0 0x559d90ee7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.098+0000 7f07aa1b99c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559d90cea450 con 0x559d90ee7ab0 2024-09-10T05:37:34.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.098+0000 7f07a7cbf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d90ee7ab0 0x559d90ee7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.098+0000 7f07a7cbf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d90ee7ab0 0x559d90ee7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:57644/0 (socket says 172.21.15.62:57644) 2024-09-10T05:37:34.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.098+0000 7f07a7cbf640 1 -- 172.21.15.62:0/3633578293 learned_addr learned my addr 172.21.15.62:0/3633578293 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:34.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.098+0000 7f07a7cbf640 1 -- 172.21.15.62:0/3633578293 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d90ee8510 con 0x559d90ee7ab0 2024-09-10T05:37:34.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.098+0000 7f07a7cbf640 1 --2- 172.21.15.62:0/3633578293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d90ee7ab0 0x559d90ee7ed0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f079801b0d0 tx=0x7f07980e84f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.098+0000 7f068d7fa640 1 -- 172.21.15.62:0/3633578293 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07980e1070 con 0x559d90ee7ab0 2024-09-10T05:37:34.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.098+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3633578293 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559d90ee8d70 con 0x559d90ee7ab0 2024-09-10T05:37:34.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.098+0000 7f068d7fa640 1 -- 172.21.15.62:0/3633578293 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07980b43a0 con 0x559d90ee7ab0 2024-09-10T05:37:34.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.098+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3633578293 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d90ee92e0 con 0x559d90ee7ab0 2024-09-10T05:37:34.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.098+0000 7f068d7fa640 1 -- 172.21.15.62:0/3633578293 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07980f0060 con 0x559d90ee7ab0 2024-09-10T05:37:34.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.098+0000 7f068d7fa640 1 -- 172.21.15.62:0/3633578293 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f07980b4680 con 0x559d90ee7ab0 2024-09-10T05:37:34.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.098+0000 7f068d7fa640 1 --2- 172.21.15.62:0/3633578293 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0680039a70 0x7f068003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.098+0000 7f068d7fa640 1 -- 172.21.15.62:0/3633578293 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7f07980070a0 con 0x559d90ee7ab0 2024-09-10T05:37:34.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.098+0000 7f07a74be640 1 --2- 172.21.15.62:0/3633578293 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0680039a70 0x7f068003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.098+0000 7f07aa1b99c0 1 Processor -- start 2024-09-10T05:37:34.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.098+0000 7f07aa1b99c0 1 -- start start 2024-09-10T05:37:34.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.098+0000 7f07a74be640 1 --2- 172.21.15.62:0/3633578293 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0680039a70 0x7f068003bf30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f079000c010 tx=0x7f079000f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.102+0000 7f07aa1b99c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d90ef4260 0x559d90ef4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.102+0000 7f07aa1b99c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559d90ec3060 con 0x559d90ef4260 2024-09-10T05:37:34.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.102+0000 7f07a7cbf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d90ef4260 0x559d90ef4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.102+0000 7f07a7cbf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d90ef4260 0x559d90ef4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:57646/0 (socket says 172.21.15.62:57646) 2024-09-10T05:37:34.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.102+0000 7f07a7cbf640 1 -- 172.21.15.62:0/1676588928 learned_addr learned my addr 172.21.15.62:0/1676588928 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:34.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.102+0000 7f07a7cbf640 1 -- 172.21.15.62:0/1676588928 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d90ef4c10 con 0x559d90ef4260 2024-09-10T05:37:34.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.102+0000 7f07a7cbf640 1 --2- 172.21.15.62:0/1676588928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d90ef4260 0x559d90ef4640 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f07980b49f0 tx=0x7f07980e99b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9d60d4020ab567e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.102+0000 7f0686ffd640 1 -- 172.21.15.62:0/1676588928 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07980dd440 con 0x559d90ef4260 2024-09-10T05:37:34.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.102+0000 7f0686ffd640 1 -- 172.21.15.62:0/1676588928 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07980bd400 con 0x559d90ef4260 2024-09-10T05:37:34.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.102+0000 7f0686ffd640 1 -- 172.21.15.62:0/1676588928 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07980ca1e0 con 0x559d90ef4260 2024-09-10T05:37:34.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.102+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/1676588928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d90ef4260 msgr2=0x559d90ef4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.102+0000 7f07aa1b99c0 1 --2- 172.21.15.62:0/1676588928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d90ef4260 0x559d90ef4640 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f07980b49f0 tx=0x7f07980e99b0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.102+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/1676588928 shutdown_connections 2024-09-10T05:37:34.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.102+0000 7f07aa1b99c0 1 --2- 172.21.15.62:0/1676588928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d90ef4260 0x559d90ef4640 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.102+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/1676588928 >> 172.21.15.62:0/1676588928 conn(0x559d90ef0690 msgr2=0x559d90eee8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:34.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.102+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/1676588928 shutdown_connections 2024-09-10T05:37:34.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.102+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/1676588928 wait complete. 2024-09-10T05:37:34.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.102+0000 7f07aa1b99c0 1 Processor -- start 2024-09-10T05:37:34.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.102+0000 7f07aa1b99c0 1 -- start start 2024-09-10T05:37:34.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.102+0000 7f07aa1b99c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d90ef4260 0x559d90efb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.102+0000 7f07aa1b99c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559d90ef50f0 con 0x559d90ef4260 2024-09-10T05:37:34.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.102+0000 7f07a7cbf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d90ef4260 0x559d90efb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.102+0000 7f07a7cbf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d90ef4260 0x559d90efb5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:57648/0 (socket says 172.21.15.62:57648) 2024-09-10T05:37:34.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.102+0000 7f07a7cbf640 1 -- 172.21.15.62:0/3476464047 learned_addr learned my addr 172.21.15.62:0/3476464047 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:34.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.102+0000 7f07a7cbf640 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d90efbb50 con 0x559d90ef4260 2024-09-10T05:37:34.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.106+0000 7f07a7cbf640 1 --2- 172.21.15.62:0/3476464047 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d90ef4260 0x559d90efb5f0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f07980d06a0 tx=0x7f07980edea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.106+0000 7f06857fa640 1 -- 172.21.15.62:0/3476464047 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0798110020 con 0x559d90ef4260 2024-09-10T05:37:34.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.106+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559d90efbb50 con 0x559d90ef4260 2024-09-10T05:37:34.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.106+0000 7f06857fa640 1 -- 172.21.15.62:0/3476464047 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07980dd920 con 0x559d90ef4260 2024-09-10T05:37:34.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.106+0000 7f06857fa640 1 -- 172.21.15.62:0/3476464047 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07980bd400 con 0x559d90ef4260 2024-09-10T05:37:34.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.106+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d90efc180 con 0x559d90ef4260 2024-09-10T05:37:34.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.106+0000 7f06857fa640 1 -- 172.21.15.62:0/3476464047 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0798113020 con 0x559d90ef4260 2024-09-10T05:37:34.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.106+0000 7f07aa1b99c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.106+0000 7f06857fa640 1 --2- 172.21.15.62:0/3476464047 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f06700399d0 0x7f067003be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.106+0000 7f06857fa640 1 -- 172.21.15.62:0/3476464047 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7f07980fb050 con 0x559d90ef4260 2024-09-10T05:37:34.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.106+0000 7f07a74be640 1 --2- 172.21.15.62:0/3476464047 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f06700399d0 0x7f067003be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.106+0000 7f07aa1b99c0 1 --2- 172.21.15.62:0/3476464047 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x559d90f06570 0x559d90f08a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.106+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d90f09150 con 0x559d90f06570 2024-09-10T05:37:34.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.106+0000 7f07a84c0640 1 --2- 172.21.15.62:0/3476464047 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x559d90f06570 0x559d90f08a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.106+0000 7f07a74be640 1 --2- 172.21.15.62:0/3476464047 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f06700399d0 0x7f067003be90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x559d90ed1830 tx=0x7f0790010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.106+0000 7f07a84c0640 1 --2- 172.21.15.62:0/3476464047 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x559d90f06570 0x559d90f08a00 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.106+0000 7f07a84c0640 1 -- 172.21.15.62:0/3476464047 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07a00083f0 con 0x559d90f06570 2024-09-10T05:37:34.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.106+0000 7f07aa1b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:34.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.106+0000 7f07aa1b99c0 20 realm 2024-09-10T05:37:34.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.106+0000 7f07aa1b99c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.106+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d90f05900 con 0x559d90f06570 2024-09-10T05:37:34.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.106+0000 7f07a84c0640 1 -- 172.21.15.62:0/3476464047 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07a00083f0 con 0x559d90f06570 2024-09-10T05:37:34.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.106+0000 7f07aa1b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:34.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.106+0000 7f07aa1b99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:37:34.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.106+0000 7f07aa1b99c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.106+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d90f09c10 con 0x559d90f06570 2024-09-10T05:37:34.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.106+0000 7f07a84c0640 1 -- 172.21.15.62:0/3476464047 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07a00083f0 con 0x559d90f06570 2024-09-10T05:37:34.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.106+0000 7f07aa1b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:34.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.106+0000 7f07aa1b99c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.106+0000 7f07aa1b99c0 1 --2- 172.21.15.62:0/3476464047 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x559d90f0a9f0 0x559d90f0cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.106+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d90f0d470 con 0x559d90f0a9f0 2024-09-10T05:37:34.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.110+0000 7f07a7cbf640 1 --2- 172.21.15.62:0/3476464047 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x559d90f0a9f0 0x559d90f0cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.110+0000 7f07a7cbf640 1 --2- 172.21.15.62:0/3476464047 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x559d90f0a9f0 0x559d90f0cde0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.110+0000 7f07a7cbf640 1 -- 172.21.15.62:0/3476464047 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f07980c73d0 con 0x559d90f0a9f0 2024-09-10T05:37:34.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.110+0000 7f07aa1b99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:37:34.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.110+0000 7f07aa1b99c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.110+0000 7f07aa1b99c0 1 --2- 172.21.15.62:0/3476464047 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x559d90f0e220 0x559d90f10610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.110+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d90f10c70 con 0x559d90f0e220 2024-09-10T05:37:34.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.110+0000 7f07a74be640 1 --2- 172.21.15.62:0/3476464047 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x559d90f0e220 0x559d90f10610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.110+0000 7f07a74be640 1 --2- 172.21.15.62:0/3476464047 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x559d90f0e220 0x559d90f10610 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.110+0000 7f07a74be640 1 -- 172.21.15.62:0/3476464047 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f079000bd60 con 0x559d90f0e220 2024-09-10T05:37:34.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.110+0000 7f07aa1b99c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:37:34.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.110+0000 7f07aa1b99c0 20 searching for the correct realm 2024-09-10T05:37:34.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.110+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d90f12570 con 0x559d90f0e220 2024-09-10T05:37:34.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.110+0000 7f07a74be640 1 -- 172.21.15.62:0/3476464047 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f079000bd60 con 0x559d90f0e220 2024-09-10T05:37:34.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.110+0000 7f07a74be640 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d90f12570 con 0x559d90f0a9f0 2024-09-10T05:37:34.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.110+0000 7f07a7cbf640 1 -- 172.21.15.62:0/3476464047 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07980c73d0 con 0x559d90f0a9f0 2024-09-10T05:37:34.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.110+0000 7f07a7cbf640 1 --2- 172.21.15.62:0/3476464047 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f0798115020 0x7f07980f5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.110+0000 7f07a7cbf640 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d90f12570 con 0x7f0798115020 2024-09-10T05:37:34.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.110+0000 7f07a84c0640 1 --2- 172.21.15.62:0/3476464047 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f0798115020 0x7f07980f5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.110+0000 7f07a84c0640 1 --2- 172.21.15.62:0/3476464047 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f0798115020 0x7f07980f5430 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.114+0000 7f07a84c0640 1 -- 172.21.15.62:0/3476464047 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a00083f0 con 0x7f0798115020 2024-09-10T05:37:34.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.114+0000 7f07a84c0640 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d90f12570 con 0x559d90f06570 2024-09-10T05:37:34.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.114+0000 7f07a84c0640 1 -- 172.21.15.62:0/3476464047 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a00083f0 con 0x559d90f06570 2024-09-10T05:37:34.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.114+0000 7f07a84c0640 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d90f12570 con 0x559d90f06570 2024-09-10T05:37:34.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.114+0000 7f07a84c0640 1 -- 172.21.15.62:0/3476464047 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a00083f0 con 0x559d90f06570 2024-09-10T05:37:34.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.114+0000 7f07a84c0640 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d90f12570 con 0x559d90f0e220 2024-09-10T05:37:34.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.114+0000 7f07a74be640 1 -- 172.21.15.62:0/3476464047 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f079000bd60 con 0x559d90f0e220 2024-09-10T05:37:34.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.114+0000 7f07a74be640 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d90f12570 con 0x559d90f06570 2024-09-10T05:37:34.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.114+0000 7f07a84c0640 1 -- 172.21.15.62:0/3476464047 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a00083f0 con 0x559d90f06570 2024-09-10T05:37:34.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.114+0000 7f07a84c0640 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d90f12570 con 0x559d90f0a9f0 2024-09-10T05:37:34.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.114+0000 7f07a7cbf640 1 -- 172.21.15.62:0/3476464047 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07980c73d0 con 0x559d90f0a9f0 2024-09-10T05:37:34.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.114+0000 7f07a7cbf640 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d90f12570 con 0x559d90f0a9f0 2024-09-10T05:37:34.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.114+0000 7f07a7cbf640 1 -- 172.21.15.62:0/3476464047 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07980c73d0 con 0x559d90f0a9f0 2024-09-10T05:37:34.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.114+0000 7f07a7cbf640 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d90f12570 con 0x559d90f06570 2024-09-10T05:37:34.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.114+0000 7f07a84c0640 1 -- 172.21.15.62:0/3476464047 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a00083f0 con 0x559d90f06570 2024-09-10T05:37:34.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.114+0000 7f07a84c0640 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d90f12570 con 0x7f0798115020 2024-09-10T05:37:34.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.114+0000 7f07a84c0640 1 -- 172.21.15.62:0/3476464047 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a00083f0 con 0x7f0798115020 2024-09-10T05:37:34.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.114+0000 7f07a84c0640 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d90f12570 con 0x559d90f06570 2024-09-10T05:37:34.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.114+0000 7f07a84c0640 1 -- 172.21.15.62:0/3476464047 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a00083f0 con 0x559d90f06570 2024-09-10T05:37:34.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.114+0000 7f07a84c0640 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d90f12570 con 0x7f0798115020 2024-09-10T05:37:34.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.114+0000 7f07a84c0640 1 -- 172.21.15.62:0/3476464047 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f07a00083f0 con 0x7f0798115020 2024-09-10T05:37:34.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.114+0000 7f07a84c0640 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d90f12570 con 0x559d90f0a9f0 2024-09-10T05:37:34.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.118+0000 7f07a7cbf640 1 -- 172.21.15.62:0/3476464047 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07980c73d0 con 0x559d90f0a9f0 2024-09-10T05:37:34.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.118+0000 7f07a7cbf640 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d90f12570 con 0x559d90f0e220 2024-09-10T05:37:34.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.118+0000 7f07a74be640 1 -- 172.21.15.62:0/3476464047 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f079000bd60 con 0x559d90f0e220 2024-09-10T05:37:34.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.118+0000 7f07a74be640 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d90f12570 con 0x559d90f06570 2024-09-10T05:37:34.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.118+0000 7f07a84c0640 1 -- 172.21.15.62:0/3476464047 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a00083f0 con 0x559d90f06570 2024-09-10T05:37:34.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.118+0000 7f07a84c0640 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d90f12570 con 0x559d90f0a9f0 2024-09-10T05:37:34.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.118+0000 7f07a7cbf640 1 -- 172.21.15.62:0/3476464047 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07980c73d0 con 0x559d90f0a9f0 2024-09-10T05:37:34.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.118+0000 7f07a7cbf640 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d90f12570 con 0x559d90f0e220 2024-09-10T05:37:34.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.118+0000 7f07a74be640 1 -- 172.21.15.62:0/3476464047 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 32 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f079000bd60 con 0x559d90f0e220 2024-09-10T05:37:34.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.118+0000 7f07a74be640 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d90f12570 con 0x559d90f06570 2024-09-10T05:37:34.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.118+0000 7f07a84c0640 1 -- 172.21.15.62:0/3476464047 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a00083f0 con 0x559d90f06570 2024-09-10T05:37:34.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.118+0000 7f07a84c0640 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d90f12570 con 0x559d90f06570 2024-09-10T05:37:34.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.118+0000 7f07a84c0640 1 -- 172.21.15.62:0/3476464047 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f07a00083f0 con 0x559d90f06570 2024-09-10T05:37:34.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.118+0000 7f07a84c0640 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d90f12570 con 0x559d90f06570 2024-09-10T05:37:34.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.118+0000 7f07a84c0640 1 -- 172.21.15.62:0/3476464047 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a00083f0 con 0x559d90f06570 2024-09-10T05:37:34.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.118+0000 7f07a84c0640 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d90f12570 con 0x559d90f0e220 2024-09-10T05:37:34.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.118+0000 7f07a74be640 1 -- 172.21.15.62:0/3476464047 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f079000bd60 con 0x559d90f0e220 2024-09-10T05:37:34.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.118+0000 7f07a74be640 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d90f12570 con 0x7f0798115020 2024-09-10T05:37:34.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.118+0000 7f07a84c0640 1 -- 172.21.15.62:0/3476464047 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a00083f0 con 0x7f0798115020 2024-09-10T05:37:34.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.118+0000 7f07a84c0640 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d90f12570 con 0x559d90f06570 2024-09-10T05:37:34.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.122+0000 7f07a84c0640 1 -- 172.21.15.62:0/3476464047 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a00083f0 con 0x559d90f06570 2024-09-10T05:37:34.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.122+0000 7f07a84c0640 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d90f12570 con 0x7f0798115020 2024-09-10T05:37:34.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.122+0000 7f07a84c0640 1 -- 172.21.15.62:0/3476464047 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a00083f0 con 0x7f0798115020 2024-09-10T05:37:34.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.122+0000 7f07a84c0640 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d90f12570 con 0x559d90f0e220 2024-09-10T05:37:34.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.122+0000 7f07a74be640 1 -- 172.21.15.62:0/3476464047 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f079000bd60 con 0x559d90f0e220 2024-09-10T05:37:34.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.122+0000 7f07a74be640 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d90f12570 con 0x7f0798115020 2024-09-10T05:37:34.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.122+0000 7f07a84c0640 1 -- 172.21.15.62:0/3476464047 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a00083f0 con 0x7f0798115020 2024-09-10T05:37:34.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.122+0000 7f07a84c0640 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d90f12570 con 0x559d90f0a9f0 2024-09-10T05:37:34.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.122+0000 7f07a7cbf640 1 -- 172.21.15.62:0/3476464047 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07980c73d0 con 0x559d90f0a9f0 2024-09-10T05:37:34.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.122+0000 7f07a7cbf640 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d90f12570 con 0x559d90f0a9f0 2024-09-10T05:37:34.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.122+0000 7f07a7cbf640 1 -- 172.21.15.62:0/3476464047 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07980c73d0 con 0x559d90f0a9f0 2024-09-10T05:37:34.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.122+0000 7f07a7cbf640 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d90f12570 con 0x559d90f0e220 2024-09-10T05:37:34.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.122+0000 7f07a74be640 1 -- 172.21.15.62:0/3476464047 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f079000bd60 con 0x559d90f0e220 2024-09-10T05:37:34.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.122+0000 7f07a74be640 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d90f12570 con 0x559d90f0a9f0 2024-09-10T05:37:34.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.122+0000 7f07a7cbf640 1 -- 172.21.15.62:0/3476464047 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f07980c73d0 con 0x559d90f0a9f0 2024-09-10T05:37:34.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.122+0000 7f07a7cbf640 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d90f12570 con 0x559d90f0a9f0 2024-09-10T05:37:34.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.126+0000 7f07a7cbf640 1 -- 172.21.15.62:0/3476464047 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07980c73d0 con 0x559d90f0a9f0 2024-09-10T05:37:34.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.126+0000 7f07aa1b99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:37:34.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.126+0000 7f07aa1b99c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:37:34.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.126+0000 7f07aa1b99c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:37:34.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.126+0000 7f07aa1b99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:37:34.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.126+0000 7f07aa1b99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:37:34.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.126+0000 7f07aa1b99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:37:34.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.126+0000 7f07aa1b99c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.126+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d90f11690 con 0x559d90f06570 2024-09-10T05:37:34.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.126+0000 7f07a84c0640 1 -- 172.21.15.62:0/3476464047 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07a00083f0 con 0x559d90f06570 2024-09-10T05:37:34.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.126+0000 7f07aa1b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:34.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.126+0000 7f07aa1b99c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.126+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d90f11b10 con 0x559d90f0a9f0 2024-09-10T05:37:34.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.126+0000 7f07a7cbf640 1 -- 172.21.15.62:0/3476464047 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f07980c73d0 con 0x559d90f0a9f0 2024-09-10T05:37:34.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.126+0000 7f07aa1b99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:37:34.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.126+0000 7f07aa1b99c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.126+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d90f11f30 con 0x559d90f0e220 2024-09-10T05:37:34.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.126+0000 7f07a74be640 1 -- 172.21.15.62:0/3476464047 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f079000bd60 con 0x559d90f0e220 2024-09-10T05:37:34.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.126+0000 7f07aa1b99c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:37:34.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.126+0000 7f07aa1b99c0 20 zone default found 2024-09-10T05:37:34.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.126+0000 7f07aa1b99c0 4 Realm: () 2024-09-10T05:37:34.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.126+0000 7f07aa1b99c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:37:34.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.126+0000 7f07aa1b99c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:37:34.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.126+0000 7f07aa1b99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:37:34.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.126+0000 7f07aa1b99c0 20 zonegroup default 2024-09-10T05:37:34.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.126+0000 7f07aa1b99c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.126+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d90f11270 con 0x7f0798115020 2024-09-10T05:37:34.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.126+0000 7f07a84c0640 1 -- 172.21.15.62:0/3476464047 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f07a00083f0 con 0x7f0798115020 2024-09-10T05:37:34.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.126+0000 7f07aa1b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:34.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.126+0000 7f07aa1b99c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.126+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d90f14ca0 con 0x559d90f0e220 2024-09-10T05:37:34.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.126+0000 7f07a74be640 1 -- 172.21.15.62:0/3476464047 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f079000bd60 con 0x559d90f0e220 2024-09-10T05:37:34.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.126+0000 7f07aa1b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:34.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.126+0000 7f07aa1b99c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.126+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d90f15190 con 0x559d90f0e220 2024-09-10T05:37:34.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.126+0000 7f07a74be640 1 -- 172.21.15.62:0/3476464047 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f079000bd60 con 0x559d90f0e220 2024-09-10T05:37:34.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.126+0000 7f07aa1b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:34.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.126+0000 7f07aa1b99c0 20 started sync module instance, tier type = 2024-09-10T05:37:34.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.126+0000 7f07aa1b99c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:37:34.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.126+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d90f13aa0 con 0x559d90f0a9f0 2024-09-10T05:37:34.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.130+0000 7f07a7cbf640 1 -- 172.21.15.62:0/3476464047 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07980c73d0 con 0x559d90f0a9f0 2024-09-10T05:37:34.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.130+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94135229955728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d90f15aa0 con 0x559d90f0a9f0 2024-09-10T05:37:34.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.130+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d90f162f0 con 0x559d90f06570 2024-09-10T05:37:34.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.130+0000 7f07a84c0640 1 -- 172.21.15.62:0/3476464047 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a00083f0 con 0x559d90f06570 2024-09-10T05:37:34.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.130+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94135229962912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d90f16b40 con 0x559d90f06570 2024-09-10T05:37:34.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.130+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d90f17390 con 0x559d90f0a9f0 2024-09-10T05:37:34.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.130+0000 7f07a7cbf640 1 -- 172.21.15.62:0/3476464047 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94135229955728] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07980c73d0 con 0x559d90f0a9f0 2024-09-10T05:37:34.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.130+0000 7f07a84c0640 1 -- 172.21.15.62:0/3476464047 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94135229962912] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a00083f0 con 0x559d90f06570 2024-09-10T05:37:34.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.134+0000 7f07a7cbf640 1 -- 172.21.15.62:0/3476464047 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07980c73d0 con 0x559d90f0a9f0 2024-09-10T05:37:34.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.134+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94135229965968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d90f16f60 con 0x559d90f0a9f0 2024-09-10T05:37:34.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.134+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d90f17c30 con 0x7f0798115020 2024-09-10T05:37:34.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.134+0000 7f07a84c0640 1 -- 172.21.15.62:0/3476464047 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a00083f0 con 0x7f0798115020 2024-09-10T05:37:34.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.134+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94135229970304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d90f16f60 con 0x7f0798115020 2024-09-10T05:37:34.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.134+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d90f186f0 con 0x559d90f0a9f0 2024-09-10T05:37:34.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.134+0000 7f07a7cbf640 1 -- 172.21.15.62:0/3476464047 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94135229965968] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07980c73d0 con 0x559d90f0a9f0 2024-09-10T05:37:34.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.134+0000 7f07a84c0640 1 -- 172.21.15.62:0/3476464047 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94135229970304] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a00083f0 con 0x7f0798115020 2024-09-10T05:37:34.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.138+0000 7f07a7cbf640 1 -- 172.21.15.62:0/3476464047 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07980c73d0 con 0x559d90f0a9f0 2024-09-10T05:37:34.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.138+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94135229972928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d90f16ab0 con 0x559d90f0a9f0 2024-09-10T05:37:34.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.138+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d90f18f90 con 0x559d90f0e220 2024-09-10T05:37:34.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.138+0000 7f07a74be640 1 -- 172.21.15.62:0/3476464047 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f079000bd60 con 0x559d90f0e220 2024-09-10T05:37:34.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.138+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94135229975264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d90f16ab0 con 0x559d90f0e220 2024-09-10T05:37:34.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.138+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d90f199d0 con 0x559d90f0e220 2024-09-10T05:37:34.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.138+0000 7f07a7cbf640 1 -- 172.21.15.62:0/3476464047 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94135229972928] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07980c73d0 con 0x559d90f0a9f0 2024-09-10T05:37:34.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.138+0000 7f07a74be640 1 -- 172.21.15.62:0/3476464047 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94135229975264] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f079000bd60 con 0x559d90f0e220 2024-09-10T05:37:34.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.138+0000 7f07a74be640 1 -- 172.21.15.62:0/3476464047 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f079000bd60 con 0x559d90f0e220 2024-09-10T05:37:34.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.138+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94135229976320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d90f19520 con 0x559d90f0e220 2024-09-10T05:37:34.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.138+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d90f1a270 con 0x7f0798115020 2024-09-10T05:37:34.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.142+0000 7f07a74be640 1 -- 172.21.15.62:0/3476464047 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94135229976320] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f079000bd60 con 0x559d90f0e220 2024-09-10T05:37:34.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.142+0000 7f07a84c0640 1 -- 172.21.15.62:0/3476464047 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a00083f0 con 0x7f0798115020 2024-09-10T05:37:34.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.142+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94135229971360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d90f19520 con 0x7f0798115020 2024-09-10T05:37:34.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.142+0000 7f07aa1b99c0 20 add_watcher() i=0 2024-09-10T05:37:34.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.142+0000 7f07aa1b99c0 20 add_watcher() i=1 2024-09-10T05:37:34.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.142+0000 7f07aa1b99c0 20 add_watcher() i=2 2024-09-10T05:37:34.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.142+0000 7f07aa1b99c0 20 add_watcher() i=3 2024-09-10T05:37:34.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.142+0000 7f07aa1b99c0 20 add_watcher() i=4 2024-09-10T05:37:34.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.142+0000 7f07aa1b99c0 20 add_watcher() i=5 2024-09-10T05:37:34.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.142+0000 7f07aa1b99c0 20 add_watcher() i=6 2024-09-10T05:37:34.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.142+0000 7f07a84c0640 1 -- 172.21.15.62:0/3476464047 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94135229971360] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a00083f0 con 0x7f0798115020 2024-09-10T05:37:34.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.142+0000 7f07aa1b99c0 20 add_watcher() i=7 2024-09-10T05:37:34.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.142+0000 7f07aa1b99c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:37:34.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.142+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d90f1d2a0 con 0x559d90f06570 2024-09-10T05:37:34.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.142+0000 7f07a84c0640 1 -- 172.21.15.62:0/3476464047 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f07a00083f0 con 0x559d90f06570 2024-09-10T05:37:34.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.142+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94135229980096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d90f1a7a0 con 0x559d90f06570 2024-09-10T05:37:34.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.146+0000 7f07a84c0640 1 -- 172.21.15.62:0/3476464047 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94135229980096] v32'208 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f07a00083f0 con 0x559d90f06570 2024-09-10T05:37:34.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.146+0000 7f065dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:37:34.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.146+0000 7f07aa1b99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:37:34.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.146+0000 7f07aa1b99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:37:34.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.146+0000 7f07aa1b99c0 5 note: GC not initialized 2024-09-10T05:37:34.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.146+0000 7f065cfe1640 20 reqs_thread_entry: start 2024-09-10T05:37:34.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.146+0000 7f07aa1b99c0 20 init_complete bucket index max shards: 11 2024-09-10T05:37:34.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.146+0000 7f07aa1b99c0 20 Filter name: none 2024-09-10T05:37:34.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.146+0000 7f05d67fc640 20 reqs_thread_entry: start 2024-09-10T05:37:34.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.146+0000 7f07aa1b99c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.146+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d90f400c0 con 0x559d90f06570 2024-09-10T05:37:34.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.146+0000 7f07a84c0640 1 -- 172.21.15.62:0/3476464047 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f07a00083f0 con 0x559d90f06570 2024-09-10T05:37:34.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.146+0000 7f07aa1b99c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:37:34.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.146+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d90f41640 con 0x559d90f0e220 2024-09-10T05:37:34.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.146+0000 7f07a74be640 1 -- 172.21.15.62:0/3476464047 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv30 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f079000bd60 con 0x559d90f0e220 2024-09-10T05:37:34.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.146+0000 7f065dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:37:34.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.146+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94135229980096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d90f3f9e0 con 0x559d90f06570 2024-09-10T05:37:34.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.150+0000 7f07a84c0640 1 -- 172.21.15.62:0/3476464047 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94135229980096] v32'209 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f07a00083f0 con 0x559d90f06570 2024-09-10T05:37:34.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.150+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94135229955728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d90f19dc0 con 0x559d90f0a9f0 2024-09-10T05:37:34.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.150+0000 7f07a7cbf640 1 -- 172.21.15.62:0/3476464047 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94135229955728] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07980c73d0 con 0x559d90f0a9f0 2024-09-10T05:37:34.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.150+0000 7f07aa1b99c0 20 remove_watcher() i=0 2024-09-10T05:37:34.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.150+0000 7f07aa1b99c0 2 removed watcher, disabling cache 2024-09-10T05:37:34.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.150+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94135229962912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d90f19dc0 con 0x559d90f06570 2024-09-10T05:37:34.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.154+0000 7f07a84c0640 1 -- 172.21.15.62:0/3476464047 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94135229962912] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a00083f0 con 0x559d90f06570 2024-09-10T05:37:34.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.154+0000 7f07aa1b99c0 20 remove_watcher() i=1 2024-09-10T05:37:34.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.154+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94135229965968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d90f15aa0 con 0x559d90f0a9f0 2024-09-10T05:37:34.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.154+0000 7f07a7cbf640 1 -- 172.21.15.62:0/3476464047 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94135229965968] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07980c73d0 con 0x559d90f0a9f0 2024-09-10T05:37:34.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.154+0000 7f07aa1b99c0 20 remove_watcher() i=2 2024-09-10T05:37:34.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.154+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94135229970304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d90f19dc0 con 0x7f0798115020 2024-09-10T05:37:34.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.158+0000 7f07a84c0640 1 -- 172.21.15.62:0/3476464047 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94135229970304] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a00083f0 con 0x7f0798115020 2024-09-10T05:37:34.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.158+0000 7f07aa1b99c0 20 remove_watcher() i=3 2024-09-10T05:37:34.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.158+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94135229972928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d90f17780 con 0x559d90f0a9f0 2024-09-10T05:37:34.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.158+0000 7f07a7cbf640 1 -- 172.21.15.62:0/3476464047 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94135229972928] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07980c73d0 con 0x559d90f0a9f0 2024-09-10T05:37:34.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.158+0000 7f07aa1b99c0 20 remove_watcher() i=4 2024-09-10T05:37:34.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.158+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94135229975264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d90f19dc0 con 0x559d90f0e220 2024-09-10T05:37:34.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.162+0000 7f07a74be640 1 -- 172.21.15.62:0/3476464047 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94135229975264] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f079000bd60 con 0x559d90f0e220 2024-09-10T05:37:34.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.162+0000 7f07aa1b99c0 20 remove_watcher() i=5 2024-09-10T05:37:34.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.162+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94135229976320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d90f181c0 con 0x559d90f0e220 2024-09-10T05:37:34.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.162+0000 7f07a74be640 1 -- 172.21.15.62:0/3476464047 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94135229976320] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f079000bd60 con 0x559d90f0e220 2024-09-10T05:37:34.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.162+0000 7f07aa1b99c0 20 remove_watcher() i=6 2024-09-10T05:37:34.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.162+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3476464047 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94135229971360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d90f17780 con 0x7f0798115020 2024-09-10T05:37:34.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.162+0000 7f07a84c0640 1 -- 172.21.15.62:0/3476464047 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94135229971360] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a00083f0 con 0x7f0798115020 2024-09-10T05:37:34.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.162+0000 7f07aa1b99c0 20 remove_watcher() i=7 2024-09-10T05:37:34.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.162+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3476464047 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x559d90f0a9f0 msgr2=0x559d90f0cde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.162+0000 7f07aa1b99c0 1 --2- 172.21.15.62:0/3476464047 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x559d90f0a9f0 0x559d90f0cde0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.162+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3476464047 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x559d90f06570 msgr2=0x559d90f08a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.162+0000 7f07aa1b99c0 1 --2- 172.21.15.62:0/3476464047 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x559d90f06570 0x559d90f08a00 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.162+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3476464047 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f0798115020 msgr2=0x7f07980f5430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.162+0000 7f07aa1b99c0 1 --2- 172.21.15.62:0/3476464047 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f0798115020 0x7f07980f5430 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.162+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3476464047 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x559d90f0e220 msgr2=0x559d90f10610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.162+0000 7f07aa1b99c0 1 --2- 172.21.15.62:0/3476464047 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x559d90f0e220 0x559d90f10610 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.162+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3476464047 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f06700399d0 msgr2=0x7f067003be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.162+0000 7f07aa1b99c0 1 --2- 172.21.15.62:0/3476464047 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f06700399d0 0x7f067003be90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x559d90ed1830 tx=0x7f0790010000 comp rx=0 tx=0).stop 2024-09-10T05:37:34.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.162+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3476464047 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d90ef4260 msgr2=0x559d90efb5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.162+0000 7f07a84c0640 1 -- 172.21.15.62:0/3476464047 reap_dead start 2024-09-10T05:37:34.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.162+0000 7f07aa1b99c0 1 --2- 172.21.15.62:0/3476464047 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d90ef4260 0x559d90efb5f0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f07980d06a0 tx=0x7f07980edea0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.162+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3476464047 shutdown_connections 2024-09-10T05:37:34.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.162+0000 7f07aa1b99c0 1 --2- 172.21.15.62:0/3476464047 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d90ef4260 0x559d90efb5f0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.162+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3476464047 >> 172.21.15.62:0/3476464047 conn(0x559d90ef0690 msgr2=0x559d90eee8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:34.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.162+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3476464047 shutdown_connections 2024-09-10T05:37:34.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.162+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3476464047 wait complete. 2024-09-10T05:37:34.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.166+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3633578293 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0680039a70 msgr2=0x7f068003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.166+0000 7f07aa1b99c0 1 --2- 172.21.15.62:0/3633578293 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0680039a70 0x7f068003bf30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f079000c010 tx=0x7f079000f000 comp rx=0 tx=0).stop 2024-09-10T05:37:34.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.166+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3633578293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d90ee7ab0 msgr2=0x559d90ee7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.166+0000 7f07aa1b99c0 1 --2- 172.21.15.62:0/3633578293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d90ee7ab0 0x559d90ee7ed0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f079801b0d0 tx=0x7f07980e84f0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.166+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3633578293 shutdown_connections 2024-09-10T05:37:34.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.166+0000 7f07aa1b99c0 1 --2- 172.21.15.62:0/3633578293 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0680039a70 0x7f068003bf30 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.166+0000 7f07aa1b99c0 1 --2- 172.21.15.62:0/3633578293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d90ee7ab0 0x559d90ee7ed0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.166+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3633578293 >> 172.21.15.62:0/3633578293 conn(0x559d90edd460 msgr2=0x559d90edd840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:34.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.166+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3633578293 shutdown_connections 2024-09-10T05:37:34.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.166+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/3633578293 wait complete. 2024-09-10T05:37:34.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.166+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/2352850651 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x559d90ed1f90 msgr2=0x559d90ed4450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.166+0000 7f07aa1b99c0 1 --2- 172.21.15.62:0/2352850651 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x559d90ed1f90 0x559d90ed4450 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.166+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/2352850651 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x559d90dda330 msgr2=0x559d90ed0f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.166+0000 7f07aa1b99c0 1 --2- 172.21.15.62:0/2352850651 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x559d90dda330 0x559d90ed0f50 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.166+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/2352850651 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x559d90ed6980 msgr2=0x559d90ed8d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.166+0000 7f07aa1b99c0 1 --2- 172.21.15.62:0/2352850651 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x559d90ed6980 0x559d90ed8d70 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.166+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/2352850651 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0690039a70 msgr2=0x7f069003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.166+0000 7f07aa1b99c0 1 --2- 172.21.15.62:0/2352850651 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0690039a70 0x7f069003bf30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0790001e40 tx=0x7f07900013a0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.166+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/2352850651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d90dd71f0 msgr2=0x559d90ec9de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.166+0000 7f07aa1b99c0 1 --2- 172.21.15.62:0/2352850651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d90dd71f0 0x559d90ec9de0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f0798018cc0 tx=0x7f0798017e30 comp rx=0 tx=0).stop 2024-09-10T05:37:34.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.166+0000 7f07a84c0640 1 -- 172.21.15.62:0/2352850651 reap_dead start 2024-09-10T05:37:34.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.166+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/2352850651 shutdown_connections 2024-09-10T05:37:34.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.166+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/2352850651 >> 172.21.15.62:0/2352850651 conn(0x559d90d4ab00 msgr2=0x559d90ebcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:34.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.166+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/2352850651 shutdown_connections 2024-09-10T05:37:34.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.166+0000 7f07aa1b99c0 1 -- 172.21.15.62:0/2352850651 wait complete. 2024-09-10T05:37:34.181 INFO:teuthology.orchestra.run.smithi062.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}],"total":{"bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-10T05:37:34.181 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T05:37:34.182 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-10T05:37:34.182 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-10T05:37:34.182 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2024-09-10T05:37:34.264 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:37:34.264 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:37:34.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.262+0000 7efd7a09d9c0 1 Processor -- start 2024-09-10T05:37:34.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.262+0000 7efd7a09d9c0 1 -- start start 2024-09-10T05:37:34.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.262+0000 7efd7a09d9c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x56165db611f0 0x56165dbf2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.262+0000 7efd7a09d9c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56165daa19c0 con 0x56165db615d0 2024-09-10T05:37:34.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.262+0000 7efd7a09d9c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x56165daf16d0 con 0x56165db611f0 2024-09-10T05:37:34.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.262+0000 7efd77ba3640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x56165db611f0 0x56165dbf2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.262+0000 7efd773a2640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x56165db615d0 0x56165dbf4570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:46008/0 (socket says 172.21.15.62:46008) 2024-09-10T05:37:34.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.262+0000 7efd77ba3640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x56165db611f0 0x56165dbf2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:57664/0 (socket says 172.21.15.62:57664) 2024-09-10T05:37:34.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.262+0000 7efd773a2640 1 -- 172.21.15.62:0/1326648226 learned_addr learned my addr 172.21.15.62:0/1326648226 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-10T05:37:34.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.262+0000 7efd77ba3640 1 -- 172.21.15.62:0/1326648226 >> v1:172.21.15.2:6789/0 conn(0x56165db615d0 legacy=0x56165dbf4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.262+0000 7efd77ba3640 1 -- 172.21.15.62:0/1326648226 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56165da95ca0 con 0x56165db611f0 2024-09-10T05:37:34.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.266+0000 7efd77ba3640 1 --2- 172.21.15.62:0/1326648226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56165db611f0 0x56165dbf2020 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7efd6800a420 tx=0x7efd6801afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ff4141a62d92aa7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.266+0000 7efd76ba1640 1 -- 172.21.15.62:0/1326648226 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd680af070 con 0x56165db611f0 2024-09-10T05:37:34.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.266+0000 7efd76ba1640 1 -- 172.21.15.62:0/1326648226 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd680aa530 con 0x56165db611f0 2024-09-10T05:37:34.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.266+0000 7efd76ba1640 1 -- 172.21.15.62:0/1326648226 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd680aa850 con 0x56165db611f0 2024-09-10T05:37:34.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.266+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/1326648226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56165db611f0 msgr2=0x56165dbf2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.266+0000 7efd7a09d9c0 1 --2- 172.21.15.62:0/1326648226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56165db611f0 0x56165dbf2020 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7efd6800a420 tx=0x7efd6801afd0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.266+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/1326648226 shutdown_connections 2024-09-10T05:37:34.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.266+0000 7efd7a09d9c0 1 --2- 172.21.15.62:0/1326648226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56165db611f0 0x56165dbf2020 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.266+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/1326648226 >> 172.21.15.62:0/1326648226 conn(0x56165dbe7910 msgr2=0x56165dbe9d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:34.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.266+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/1326648226 shutdown_connections 2024-09-10T05:37:34.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.266+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/1326648226 wait complete. 2024-09-10T05:37:34.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.282+0000 7efd7a09d9c0 1 Processor -- start 2024-09-10T05:37:34.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.282+0000 7efd7a09d9c0 1 -- start start 2024-09-10T05:37:34.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.282+0000 7efd7a09d9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56165db611f0 0x56165dcda910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.282+0000 7efd7a09d9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56165daf5680 con 0x56165db611f0 2024-09-10T05:37:34.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.282+0000 7efd77ba3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56165db611f0 0x56165dcda910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.282+0000 7efd77ba3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56165db611f0 0x56165dcda910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:57680/0 (socket says 172.21.15.62:57680) 2024-09-10T05:37:34.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.282+0000 7efd77ba3640 1 -- 172.21.15.62:0/3552806539 learned_addr learned my addr 172.21.15.62:0/3552806539 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:34.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.282+0000 7efd77ba3640 1 -- 172.21.15.62:0/3552806539 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56165da70da0 con 0x56165db611f0 2024-09-10T05:37:34.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.282+0000 7efd77ba3640 1 --2- 172.21.15.62:0/3552806539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56165db611f0 0x56165dcda910 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7efd680ad040 tx=0x7efd680033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1082a732a1537eaf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.282+0000 7efc65e0b640 1 -- 172.21.15.62:0/3552806539 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd680af050 con 0x56165db611f0 2024-09-10T05:37:34.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.282+0000 7efc65e0b640 1 -- 172.21.15.62:0/3552806539 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd680b0040 con 0x56165db611f0 2024-09-10T05:37:34.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.282+0000 7efc65e0b640 1 -- 172.21.15.62:0/3552806539 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd680aaad0 con 0x56165db611f0 2024-09-10T05:37:34.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.282+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/3552806539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56165db611f0 msgr2=0x56165dcda910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.282+0000 7efd7a09d9c0 1 --2- 172.21.15.62:0/3552806539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56165db611f0 0x56165dcda910 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7efd680ad040 tx=0x7efd680033b0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.282+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/3552806539 shutdown_connections 2024-09-10T05:37:34.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.282+0000 7efd7a09d9c0 1 --2- 172.21.15.62:0/3552806539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56165db611f0 0x56165dcda910 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.282+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/3552806539 >> 172.21.15.62:0/3552806539 conn(0x56165dbe7910 msgr2=0x56165dcd6550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:34.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.282+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/3552806539 shutdown_connections 2024-09-10T05:37:34.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.282+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/3552806539 wait complete. 2024-09-10T05:37:34.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.282+0000 7efd7a09d9c0 1 Processor -- start 2024-09-10T05:37:34.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.282+0000 7efd7a09d9c0 1 -- start start 2024-09-10T05:37:34.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.282+0000 7efd7a09d9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56165db611f0 0x56165dce1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.282+0000 7efd7a09d9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56165da97a50 con 0x56165db611f0 2024-09-10T05:37:34.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.286+0000 7efd77ba3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56165db611f0 0x56165dce1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.286+0000 7efd77ba3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56165db611f0 0x56165dce1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:57682/0 (socket says 172.21.15.62:57682) 2024-09-10T05:37:34.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.286+0000 7efd77ba3640 1 -- 172.21.15.62:0/1235435738 learned_addr learned my addr 172.21.15.62:0/1235435738 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:34.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.286+0000 7efd77ba3640 1 -- 172.21.15.62:0/1235435738 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56165dce23e0 con 0x56165db611f0 2024-09-10T05:37:34.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.286+0000 7efd77ba3640 1 --2- 172.21.15.62:0/1235435738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56165db611f0 0x56165dce1e80 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7efd680aa500 tx=0x7efd68017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.286+0000 7efc5ffff640 1 -- 172.21.15.62:0/1235435738 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd680b6c40 con 0x56165db611f0 2024-09-10T05:37:34.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.286+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/1235435738 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56165dce2670 con 0x56165db611f0 2024-09-10T05:37:34.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.286+0000 7efc5ffff640 1 -- 172.21.15.62:0/1235435738 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd680b6de0 con 0x56165db611f0 2024-09-10T05:37:34.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.286+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/1235435738 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56165dce3020 con 0x56165db611f0 2024-09-10T05:37:34.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.286+0000 7efc5ffff640 1 -- 172.21.15.62:0/1235435738 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd680cd060 con 0x56165db611f0 2024-09-10T05:37:34.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.286+0000 7efc5ffff640 1 -- 172.21.15.62:0/1235435738 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7efd680bf590 con 0x56165db611f0 2024-09-10T05:37:34.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.286+0000 7efc5ffff640 1 --2- 172.21.15.62:0/1235435738 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7efc60039a70 0x7efc6003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.286+0000 7efc5ffff640 1 -- 172.21.15.62:0/1235435738 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7efd680bb070 con 0x56165db611f0 2024-09-10T05:37:34.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.286+0000 7efd773a2640 1 --2- 172.21.15.62:0/1235435738 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7efc60039a70 0x7efc6003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.286+0000 7efd7a09d9c0 1 --2- 172.21.15.62:0/1235435738 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56165db615d0 0x56165dce8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.286+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/1235435738 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56165dce9530 con 0x56165db615d0 2024-09-10T05:37:34.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.286+0000 7efd783a4640 1 --2- 172.21.15.62:0/1235435738 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56165db615d0 0x56165dce8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.286+0000 7efd773a2640 1 --2- 172.21.15.62:0/1235435738 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7efc60039a70 0x7efc6003bf30 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7efd6c001d80 tx=0x7efd6c0012e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.286+0000 7efd783a4640 1 --2- 172.21.15.62:0/1235435738 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56165db615d0 0x56165dce8ff0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.290+0000 7efd783a4640 1 -- 172.21.15.62:0/1235435738 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efd700083f0 con 0x56165db615d0 2024-09-10T05:37:34.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.290+0000 7efd7a09d9c0 1 --2- 172.21.15.62:0/1235435738 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x56165dcea020 0x56165dcec4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.290+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/1235435738 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56165dcecc50 con 0x56165dcea020 2024-09-10T05:37:34.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.290+0000 7efd77ba3640 1 --2- 172.21.15.62:0/1235435738 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x56165dcea020 0x56165dcec4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.290+0000 7efd77ba3640 1 --2- 172.21.15.62:0/1235435738 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x56165dcea020 0x56165dcec4e0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.290+0000 7efd77ba3640 1 -- 172.21.15.62:0/1235435738 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efd680b2070 con 0x56165dcea020 2024-09-10T05:37:34.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.290+0000 7efd7a09d9c0 1 --2- 172.21.15.62:0/1235435738 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56165dceea10 0x56165dcf0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.290+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/1235435738 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56165dcf14f0 con 0x56165dceea10 2024-09-10T05:37:34.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.290+0000 7efd773a2640 1 --2- 172.21.15.62:0/1235435738 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56165dceea10 0x56165dcf0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.290+0000 7efd773a2640 1 --2- 172.21.15.62:0/1235435738 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56165dceea10 0x56165dcf0e00 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.290+0000 7efd773a2640 1 -- 172.21.15.62:0/1235435738 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7efd6c00e620 con 0x56165dceea10 2024-09-10T05:37:34.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.290+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/1235435738 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56165dced8b0 con 0x56165dcea020 2024-09-10T05:37:34.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.290+0000 7efd77ba3640 1 -- 172.21.15.62:0/1235435738 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efd680b2070 con 0x56165dcea020 2024-09-10T05:37:34.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.290+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/1235435738 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56165dcedd10 con 0x56165dceea10 2024-09-10T05:37:34.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.294+0000 7efd773a2640 1 -- 172.21.15.62:0/1235435738 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7efd6c00e620 con 0x56165dceea10 2024-09-10T05:37:34.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.294+0000 7efd7a09d9c0 1 Processor -- start 2024-09-10T05:37:34.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.294+0000 7efd7a09d9c0 1 -- start start 2024-09-10T05:37:34.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.294+0000 7efd7a09d9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56165dcffb40 0x56165dcfff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.294+0000 7efd7a09d9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56165db02450 con 0x56165dcffb40 2024-09-10T05:37:34.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.294+0000 7efd77ba3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56165dcffb40 0x56165dcfff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.294+0000 7efd77ba3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56165dcffb40 0x56165dcfff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:57694/0 (socket says 172.21.15.62:57694) 2024-09-10T05:37:34.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.294+0000 7efd77ba3640 1 -- 172.21.15.62:0/181939209 learned_addr learned my addr 172.21.15.62:0/181939209 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:34.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.294+0000 7efd77ba3640 1 -- 172.21.15.62:0/181939209 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56165dd005a0 con 0x56165dcffb40 2024-09-10T05:37:34.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.294+0000 7efd77ba3640 1 --2- 172.21.15.62:0/181939209 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56165dcffb40 0x56165dcfff60 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7efd680b6fd0 tx=0x7efd680c77e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.294+0000 7efc5d7fa640 1 -- 172.21.15.62:0/181939209 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd680bfdf0 con 0x56165dcffb40 2024-09-10T05:37:34.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.294+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/181939209 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56165dd00e00 con 0x56165dcffb40 2024-09-10T05:37:34.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.294+0000 7efc5d7fa640 1 -- 172.21.15.62:0/181939209 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd680eb9f0 con 0x56165dcffb40 2024-09-10T05:37:34.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.294+0000 7efc5d7fa640 1 -- 172.21.15.62:0/181939209 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd680ebcd0 con 0x56165dcffb40 2024-09-10T05:37:34.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.294+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/181939209 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56165dd00e00 con 0x56165dcffb40 2024-09-10T05:37:34.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.294+0000 7efc5d7fa640 1 -- 172.21.15.62:0/181939209 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7efd680e8480 con 0x56165dcffb40 2024-09-10T05:37:34.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.294+0000 7efc5d7fa640 1 --2- 172.21.15.62:0/181939209 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7efc50039a70 0x7efc5003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.294+0000 7efc5d7fa640 1 -- 172.21.15.62:0/181939209 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7efd680ea0a0 con 0x56165dcffb40 2024-09-10T05:37:34.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.294+0000 7efd773a2640 1 --2- 172.21.15.62:0/181939209 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7efc50039a70 0x7efc5003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.298+0000 7efd7a09d9c0 1 Processor -- start 2024-09-10T05:37:34.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.298+0000 7efd7a09d9c0 1 -- start start 2024-09-10T05:37:34.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.298+0000 7efd7a09d9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56165dd0c090 0x56165dd0c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.298+0000 7efd773a2640 1 --2- 172.21.15.62:0/181939209 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7efc50039a70 0x7efc5003bf30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efd6c00bf50 tx=0x7efd6c00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.298+0000 7efd7a09d9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56165dcdb0a0 con 0x56165dd0c090 2024-09-10T05:37:34.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.298+0000 7efd77ba3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56165dd0c090 0x56165dd0c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.298+0000 7efd77ba3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56165dd0c090 0x56165dd0c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:57702/0 (socket says 172.21.15.62:57702) 2024-09-10T05:37:34.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.298+0000 7efd77ba3640 1 -- 172.21.15.62:0/1843245097 learned_addr learned my addr 172.21.15.62:0/1843245097 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:34.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.298+0000 7efd77ba3640 1 -- 172.21.15.62:0/1843245097 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56165dd0ca40 con 0x56165dd0c090 2024-09-10T05:37:34.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.298+0000 7efd77ba3640 1 --2- 172.21.15.62:0/1843245097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56165dd0c090 0x56165dd0c470 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7efd680bf8a0 tx=0x7efd680d2610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae765bd3ff36c76d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.298+0000 7efc56ffd640 1 -- 172.21.15.62:0/1843245097 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd680d2e40 con 0x56165dd0c090 2024-09-10T05:37:34.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.298+0000 7efc56ffd640 1 -- 172.21.15.62:0/1843245097 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd68104070 con 0x56165dd0c090 2024-09-10T05:37:34.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.298+0000 7efc56ffd640 1 -- 172.21.15.62:0/1843245097 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd680a9800 con 0x56165dd0c090 2024-09-10T05:37:34.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.298+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/1843245097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56165dd0c090 msgr2=0x56165dd0c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.298+0000 7efd7a09d9c0 1 --2- 172.21.15.62:0/1843245097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56165dd0c090 0x56165dd0c470 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7efd680bf8a0 tx=0x7efd680d2610 comp rx=0 tx=0).stop 2024-09-10T05:37:34.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.298+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/1843245097 shutdown_connections 2024-09-10T05:37:34.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.298+0000 7efd7a09d9c0 1 --2- 172.21.15.62:0/1843245097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56165dd0c090 0x56165dd0c470 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.298+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/1843245097 >> 172.21.15.62:0/1843245097 conn(0x56165dd084c0 msgr2=0x56165dd06700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:34.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.298+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/1843245097 shutdown_connections 2024-09-10T05:37:34.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.298+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/1843245097 wait complete. 2024-09-10T05:37:34.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.298+0000 7efd7a09d9c0 1 Processor -- start 2024-09-10T05:37:34.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.298+0000 7efd7a09d9c0 1 -- start start 2024-09-10T05:37:34.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.298+0000 7efd7a09d9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56165dd0c090 0x56165dd13430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.298+0000 7efd7a09d9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56165dd0cf20 con 0x56165dd0c090 2024-09-10T05:37:34.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.298+0000 7efd77ba3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56165dd0c090 0x56165dd13430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.298+0000 7efd77ba3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56165dd0c090 0x56165dd13430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:57714/0 (socket says 172.21.15.62:57714) 2024-09-10T05:37:34.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.298+0000 7efd77ba3640 1 -- 172.21.15.62:0/2295703925 learned_addr learned my addr 172.21.15.62:0/2295703925 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:34.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.302+0000 7efd77ba3640 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56165dd13990 con 0x56165dd0c090 2024-09-10T05:37:34.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.302+0000 7efd77ba3640 1 --2- 172.21.15.62:0/2295703925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56165dd0c090 0x56165dd13430 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7efd680e8b10 tx=0x7efd680e4f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.302+0000 7efc557fa640 1 -- 172.21.15.62:0/2295703925 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd680bdc40 con 0x56165dd0c090 2024-09-10T05:37:34.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.302+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56165dd13990 con 0x56165dd0c090 2024-09-10T05:37:34.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.302+0000 7efc557fa640 1 -- 172.21.15.62:0/2295703925 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd680f4ab0 con 0x56165dd0c090 2024-09-10T05:37:34.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.302+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56165dd13990 con 0x56165dd0c090 2024-09-10T05:37:34.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.302+0000 7efc557fa640 1 -- 172.21.15.62:0/2295703925 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd680f4d90 con 0x56165dd0c090 2024-09-10T05:37:34.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.302+0000 7efc557fa640 1 -- 172.21.15.62:0/2295703925 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7efd680c1aa0 con 0x56165dd0c090 2024-09-10T05:37:34.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.302+0000 7efd7a09d9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.302+0000 7efc557fa640 1 --2- 172.21.15.62:0/2295703925 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7efc40039a70 0x7efc4003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.302+0000 7efc557fa640 1 -- 172.21.15.62:0/2295703925 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7efd680f91c0 con 0x56165dd0c090 2024-09-10T05:37:34.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.302+0000 7efd773a2640 1 --2- 172.21.15.62:0/2295703925 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7efc40039a70 0x7efc4003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.302+0000 7efd7a09d9c0 1 --2- 172.21.15.62:0/2295703925 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56165dd1e180 0x56165dd205d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.302+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56165dd20d20 con 0x56165dd1e180 2024-09-10T05:37:34.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.302+0000 7efd783a4640 1 --2- 172.21.15.62:0/2295703925 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56165dd1e180 0x56165dd205d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.302+0000 7efd773a2640 1 --2- 172.21.15.62:0/2295703925 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7efc40039a70 0x7efc4003bf30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7efd6c01d040 tx=0x7efd6c010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.302+0000 7efd783a4640 1 --2- 172.21.15.62:0/2295703925 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56165dd1e180 0x56165dd205d0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.302+0000 7efd783a4640 1 -- 172.21.15.62:0/2295703925 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efd700083f0 con 0x56165dd1e180 2024-09-10T05:37:34.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.302+0000 7efd7a09d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:34.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.302+0000 7efd7a09d9c0 20 realm 2024-09-10T05:37:34.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.302+0000 7efd7a09d9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.302+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56165dd1d5c0 con 0x56165dd1e180 2024-09-10T05:37:34.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.302+0000 7efd783a4640 1 -- 172.21.15.62:0/2295703925 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efd700083f0 con 0x56165dd1e180 2024-09-10T05:37:34.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.302+0000 7efd7a09d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:34.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.302+0000 7efd7a09d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:37:34.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.302+0000 7efd7a09d9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.302+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56165dd217e0 con 0x56165dd1e180 2024-09-10T05:37:34.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.306+0000 7efd783a4640 1 -- 172.21.15.62:0/2295703925 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efd700083f0 con 0x56165dd1e180 2024-09-10T05:37:34.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.306+0000 7efd7a09d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:34.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.306+0000 7efd7a09d9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.306+0000 7efd7a09d9c0 1 --2- 172.21.15.62:0/2295703925 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x56165dd225c0 0x56165dd249b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.306+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56165dd25060 con 0x56165dd225c0 2024-09-10T05:37:34.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.306+0000 7efd77ba3640 1 --2- 172.21.15.62:0/2295703925 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x56165dd225c0 0x56165dd249b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.306+0000 7efd77ba3640 1 --2- 172.21.15.62:0/2295703925 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x56165dd225c0 0x56165dd249b0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.306+0000 7efd77ba3640 1 -- 172.21.15.62:0/2295703925 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efd680b2070 con 0x56165dd225c0 2024-09-10T05:37:34.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.306+0000 7efd7a09d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:37:34.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.306+0000 7efd7a09d9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.306+0000 7efd7a09d9c0 1 --2- 172.21.15.62:0/2295703925 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56165dd25e10 0x56165dd28200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.306+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56165dd288a0 con 0x56165dd25e10 2024-09-10T05:37:34.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.306+0000 7efd773a2640 1 --2- 172.21.15.62:0/2295703925 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56165dd25e10 0x56165dd28200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.306+0000 7efd773a2640 1 --2- 172.21.15.62:0/2295703925 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56165dd25e10 0x56165dd28200 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.306+0000 7efd773a2640 1 -- 172.21.15.62:0/2295703925 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7efd6c026070 con 0x56165dd25e10 2024-09-10T05:37:34.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.306+0000 7efd7a09d9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:37:34.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.306+0000 7efd7a09d9c0 20 searching for the correct realm 2024-09-10T05:37:34.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.306+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56165dd2a190 con 0x56165dd25e10 2024-09-10T05:37:34.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.306+0000 7efd773a2640 1 -- 172.21.15.62:0/2295703925 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd6c026070 con 0x56165dd25e10 2024-09-10T05:37:34.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.306+0000 7efd773a2640 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56165dd2a190 con 0x56165dd225c0 2024-09-10T05:37:34.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.310+0000 7efd77ba3640 1 -- 172.21.15.62:0/2295703925 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd680b2070 con 0x56165dd225c0 2024-09-10T05:37:34.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.310+0000 7efd77ba3640 1 --2- 172.21.15.62:0/2295703925 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7efd680b6070 0x7efd680ba3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.310+0000 7efd77ba3640 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56165dd2a190 con 0x7efd680b6070 2024-09-10T05:37:34.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.310+0000 7efd783a4640 1 --2- 172.21.15.62:0/2295703925 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7efd680b6070 0x7efd680ba3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.310+0000 7efd783a4640 1 --2- 172.21.15.62:0/2295703925 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7efd680b6070 0x7efd680ba3f0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.310+0000 7efd783a4640 1 -- 172.21.15.62:0/2295703925 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd700083f0 con 0x7efd680b6070 2024-09-10T05:37:34.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.310+0000 7efd783a4640 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56165dd2a190 con 0x56165dd1e180 2024-09-10T05:37:34.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.310+0000 7efd783a4640 1 -- 172.21.15.62:0/2295703925 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd700083f0 con 0x56165dd1e180 2024-09-10T05:37:34.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.310+0000 7efd783a4640 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56165dd2a190 con 0x56165dd1e180 2024-09-10T05:37:34.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.310+0000 7efd783a4640 1 -- 172.21.15.62:0/2295703925 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd700083f0 con 0x56165dd1e180 2024-09-10T05:37:34.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.310+0000 7efd783a4640 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56165dd2a190 con 0x56165dd25e10 2024-09-10T05:37:34.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.310+0000 7efd773a2640 1 -- 172.21.15.62:0/2295703925 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd6c026070 con 0x56165dd25e10 2024-09-10T05:37:34.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.310+0000 7efd773a2640 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56165dd2a190 con 0x56165dd1e180 2024-09-10T05:37:34.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.310+0000 7efd783a4640 1 -- 172.21.15.62:0/2295703925 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd700083f0 con 0x56165dd1e180 2024-09-10T05:37:34.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.310+0000 7efd783a4640 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56165dd2a190 con 0x56165dd225c0 2024-09-10T05:37:34.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.310+0000 7efd77ba3640 1 -- 172.21.15.62:0/2295703925 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd680b2070 con 0x56165dd225c0 2024-09-10T05:37:34.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.310+0000 7efd77ba3640 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56165dd2a190 con 0x56165dd225c0 2024-09-10T05:37:34.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.310+0000 7efd77ba3640 1 -- 172.21.15.62:0/2295703925 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd680b2070 con 0x56165dd225c0 2024-09-10T05:37:34.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.310+0000 7efd77ba3640 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56165dd2a190 con 0x56165dd1e180 2024-09-10T05:37:34.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.310+0000 7efd783a4640 1 -- 172.21.15.62:0/2295703925 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd700083f0 con 0x56165dd1e180 2024-09-10T05:37:34.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.310+0000 7efd783a4640 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56165dd2a190 con 0x7efd680b6070 2024-09-10T05:37:34.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.314+0000 7efd783a4640 1 -- 172.21.15.62:0/2295703925 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd700083f0 con 0x7efd680b6070 2024-09-10T05:37:34.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.314+0000 7efd783a4640 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56165dd2a190 con 0x56165dd1e180 2024-09-10T05:37:34.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.314+0000 7efd783a4640 1 -- 172.21.15.62:0/2295703925 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd700083f0 con 0x56165dd1e180 2024-09-10T05:37:34.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.314+0000 7efd783a4640 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56165dd2a190 con 0x7efd680b6070 2024-09-10T05:37:34.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.314+0000 7efd783a4640 1 -- 172.21.15.62:0/2295703925 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7efd700083f0 con 0x7efd680b6070 2024-09-10T05:37:34.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.314+0000 7efd783a4640 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56165dd2a190 con 0x56165dd225c0 2024-09-10T05:37:34.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.314+0000 7efd77ba3640 1 -- 172.21.15.62:0/2295703925 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd680b2070 con 0x56165dd225c0 2024-09-10T05:37:34.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.314+0000 7efd77ba3640 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56165dd2a190 con 0x56165dd25e10 2024-09-10T05:37:34.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.314+0000 7efd773a2640 1 -- 172.21.15.62:0/2295703925 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd6c026070 con 0x56165dd25e10 2024-09-10T05:37:34.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.314+0000 7efd773a2640 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56165dd2a190 con 0x56165dd1e180 2024-09-10T05:37:34.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.314+0000 7efd783a4640 1 -- 172.21.15.62:0/2295703925 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd700083f0 con 0x56165dd1e180 2024-09-10T05:37:34.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.314+0000 7efd783a4640 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56165dd2a190 con 0x56165dd225c0 2024-09-10T05:37:34.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.314+0000 7efd77ba3640 1 -- 172.21.15.62:0/2295703925 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd680b2070 con 0x56165dd225c0 2024-09-10T05:37:34.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.314+0000 7efd77ba3640 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56165dd2a190 con 0x56165dd25e10 2024-09-10T05:37:34.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.314+0000 7efd773a2640 1 -- 172.21.15.62:0/2295703925 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 32 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7efd6c026070 con 0x56165dd25e10 2024-09-10T05:37:34.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.314+0000 7efd773a2640 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56165dd2a190 con 0x56165dd1e180 2024-09-10T05:37:34.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.314+0000 7efd783a4640 1 -- 172.21.15.62:0/2295703925 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd700083f0 con 0x56165dd1e180 2024-09-10T05:37:34.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.314+0000 7efd783a4640 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56165dd2a190 con 0x56165dd1e180 2024-09-10T05:37:34.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.314+0000 7efd783a4640 1 -- 172.21.15.62:0/2295703925 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7efd700083f0 con 0x56165dd1e180 2024-09-10T05:37:34.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.314+0000 7efd783a4640 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56165dd2a190 con 0x56165dd1e180 2024-09-10T05:37:34.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.318+0000 7efd783a4640 1 -- 172.21.15.62:0/2295703925 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd700083f0 con 0x56165dd1e180 2024-09-10T05:37:34.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.318+0000 7efd783a4640 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56165dd2a190 con 0x56165dd25e10 2024-09-10T05:37:34.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.318+0000 7efd773a2640 1 -- 172.21.15.62:0/2295703925 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd6c026070 con 0x56165dd25e10 2024-09-10T05:37:34.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.318+0000 7efd773a2640 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56165dd2a190 con 0x7efd680b6070 2024-09-10T05:37:34.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.318+0000 7efd783a4640 1 -- 172.21.15.62:0/2295703925 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd700083f0 con 0x7efd680b6070 2024-09-10T05:37:34.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.318+0000 7efd783a4640 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56165dd2a190 con 0x56165dd1e180 2024-09-10T05:37:34.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.318+0000 7efd783a4640 1 -- 172.21.15.62:0/2295703925 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd700083f0 con 0x56165dd1e180 2024-09-10T05:37:34.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.318+0000 7efd783a4640 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56165dd2a190 con 0x7efd680b6070 2024-09-10T05:37:34.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.318+0000 7efd783a4640 1 -- 172.21.15.62:0/2295703925 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd700083f0 con 0x7efd680b6070 2024-09-10T05:37:34.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.318+0000 7efd783a4640 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56165dd2a190 con 0x56165dd25e10 2024-09-10T05:37:34.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.318+0000 7efd773a2640 1 -- 172.21.15.62:0/2295703925 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd6c026070 con 0x56165dd25e10 2024-09-10T05:37:34.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.318+0000 7efd773a2640 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56165dd2a190 con 0x7efd680b6070 2024-09-10T05:37:34.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.318+0000 7efd783a4640 1 -- 172.21.15.62:0/2295703925 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd700083f0 con 0x7efd680b6070 2024-09-10T05:37:34.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.318+0000 7efd783a4640 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56165dd2a190 con 0x56165dd225c0 2024-09-10T05:37:34.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.318+0000 7efd77ba3640 1 -- 172.21.15.62:0/2295703925 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd680b2070 con 0x56165dd225c0 2024-09-10T05:37:34.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.318+0000 7efd77ba3640 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56165dd2a190 con 0x56165dd225c0 2024-09-10T05:37:34.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.318+0000 7efd77ba3640 1 -- 172.21.15.62:0/2295703925 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd680b2070 con 0x56165dd225c0 2024-09-10T05:37:34.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.318+0000 7efd77ba3640 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56165dd2a190 con 0x56165dd25e10 2024-09-10T05:37:34.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.318+0000 7efd773a2640 1 -- 172.21.15.62:0/2295703925 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd6c026070 con 0x56165dd25e10 2024-09-10T05:37:34.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.318+0000 7efd773a2640 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56165dd2a190 con 0x56165dd225c0 2024-09-10T05:37:34.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.322+0000 7efd77ba3640 1 -- 172.21.15.62:0/2295703925 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7efd680b2070 con 0x56165dd225c0 2024-09-10T05:37:34.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.322+0000 7efd77ba3640 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56165dd2a190 con 0x56165dd225c0 2024-09-10T05:37:34.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.322+0000 7efd77ba3640 1 -- 172.21.15.62:0/2295703925 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd680b2070 con 0x56165dd225c0 2024-09-10T05:37:34.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.322+0000 7efd7a09d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:37:34.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.322+0000 7efd7a09d9c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:37:34.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.322+0000 7efd7a09d9c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:37:34.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.322+0000 7efd7a09d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:37:34.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.322+0000 7efd7a09d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:37:34.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.322+0000 7efd7a09d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:37:34.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.322+0000 7efd7a09d9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.322+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56165dd29260 con 0x56165dd1e180 2024-09-10T05:37:34.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.322+0000 7efd783a4640 1 -- 172.21.15.62:0/2295703925 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efd700083f0 con 0x56165dd1e180 2024-09-10T05:37:34.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.322+0000 7efd7a09d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:34.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.322+0000 7efd7a09d9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.322+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56165dd29680 con 0x56165dd225c0 2024-09-10T05:37:34.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.322+0000 7efd77ba3640 1 -- 172.21.15.62:0/2295703925 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efd680b2070 con 0x56165dd225c0 2024-09-10T05:37:34.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.322+0000 7efd7a09d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:37:34.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.322+0000 7efd7a09d9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.322+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56165dd29aa0 con 0x56165dd25e10 2024-09-10T05:37:34.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.322+0000 7efd773a2640 1 -- 172.21.15.62:0/2295703925 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7efd6c026070 con 0x56165dd25e10 2024-09-10T05:37:34.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.322+0000 7efd7a09d9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:37:34.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.322+0000 7efd7a09d9c0 20 zone default found 2024-09-10T05:37:34.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.322+0000 7efd7a09d9c0 4 Realm: () 2024-09-10T05:37:34.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.322+0000 7efd7a09d9c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:37:34.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.322+0000 7efd7a09d9c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:37:34.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.322+0000 7efd7a09d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:37:34.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.322+0000 7efd7a09d9c0 20 zonegroup default 2024-09-10T05:37:34.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.322+0000 7efd7a09d9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.322+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56165dd2a660 con 0x7efd680b6070 2024-09-10T05:37:34.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.322+0000 7efd783a4640 1 -- 172.21.15.62:0/2295703925 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7efd700083f0 con 0x7efd680b6070 2024-09-10T05:37:34.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.322+0000 7efd7a09d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:34.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.322+0000 7efd7a09d9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.322+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56165dd2c920 con 0x56165dd25e10 2024-09-10T05:37:34.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.322+0000 7efd773a2640 1 -- 172.21.15.62:0/2295703925 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efd6c026070 con 0x56165dd25e10 2024-09-10T05:37:34.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.322+0000 7efd7a09d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:34.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.322+0000 7efd7a09d9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.322+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56165dd2cd10 con 0x56165dd25e10 2024-09-10T05:37:34.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.322+0000 7efd773a2640 1 -- 172.21.15.62:0/2295703925 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efd6c026070 con 0x56165dd25e10 2024-09-10T05:37:34.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.322+0000 7efd7a09d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:34.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.322+0000 7efd7a09d9c0 20 started sync module instance, tier type = 2024-09-10T05:37:34.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.322+0000 7efd7a09d9c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:37:34.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.322+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56165dd2bdb0 con 0x56165dd225c0 2024-09-10T05:37:34.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.326+0000 7efd77ba3640 1 -- 172.21.15.62:0/2295703925 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd680b2070 con 0x56165dd225c0 2024-09-10T05:37:34.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.326+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94654063362464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56165dd2d620 con 0x56165dd225c0 2024-09-10T05:37:34.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.326+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56165dd2de70 con 0x56165dd1e180 2024-09-10T05:37:34.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.326+0000 7efd783a4640 1 -- 172.21.15.62:0/2295703925 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd700083f0 con 0x56165dd1e180 2024-09-10T05:37:34.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.326+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94654063367712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56165dd2e6c0 con 0x56165dd1e180 2024-09-10T05:37:34.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.326+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56165dd2ef10 con 0x56165dd225c0 2024-09-10T05:37:34.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.330+0000 7efd77ba3640 1 -- 172.21.15.62:0/2295703925 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94654063362464] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd680b2070 con 0x56165dd225c0 2024-09-10T05:37:34.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.330+0000 7efd783a4640 1 -- 172.21.15.62:0/2295703925 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94654063367712] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd700083f0 con 0x56165dd1e180 2024-09-10T05:37:34.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.330+0000 7efd77ba3640 1 -- 172.21.15.62:0/2295703925 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd680b2070 con 0x56165dd225c0 2024-09-10T05:37:34.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.330+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94654063370768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56165dd2eae0 con 0x56165dd225c0 2024-09-10T05:37:34.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.330+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56165dd2f330 con 0x7efd680b6070 2024-09-10T05:37:34.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.330+0000 7efd783a4640 1 -- 172.21.15.62:0/2295703925 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd700083f0 con 0x7efd680b6070 2024-09-10T05:37:34.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.330+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94654063373328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56165dd2f720 con 0x7efd680b6070 2024-09-10T05:37:34.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.330+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56165dd301f0 con 0x56165dd225c0 2024-09-10T05:37:34.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.334+0000 7efd783a4640 1 -- 172.21.15.62:0/2295703925 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94654063373328] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd700083f0 con 0x7efd680b6070 2024-09-10T05:37:34.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.334+0000 7efd77ba3640 1 -- 172.21.15.62:0/2295703925 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94654063370768] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd680b2070 con 0x56165dd225c0 2024-09-10T05:37:34.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.334+0000 7efd77ba3640 1 -- 172.21.15.62:0/2295703925 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd680b2070 con 0x56165dd225c0 2024-09-10T05:37:34.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.334+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94654063371824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56165dd301b0 con 0x56165dd225c0 2024-09-10T05:37:34.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.334+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56165dd30a90 con 0x56165dd25e10 2024-09-10T05:37:34.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.334+0000 7efd773a2640 1 -- 172.21.15.62:0/2295703925 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd6c026070 con 0x56165dd25e10 2024-09-10T05:37:34.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.334+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94654063379936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56165dd301b0 con 0x56165dd25e10 2024-09-10T05:37:34.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.334+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56165dd314d0 con 0x56165dd25e10 2024-09-10T05:37:34.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.334+0000 7efd77ba3640 1 -- 172.21.15.62:0/2295703925 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94654063371824] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd680b2070 con 0x56165dd225c0 2024-09-10T05:37:34.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.338+0000 7efd773a2640 1 -- 172.21.15.62:0/2295703925 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94654063379936] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd6c026070 con 0x56165dd25e10 2024-09-10T05:37:34.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.338+0000 7efd773a2640 1 -- 172.21.15.62:0/2295703925 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd6c026070 con 0x56165dd25e10 2024-09-10T05:37:34.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.338+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94654063380992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56165dd31020 con 0x56165dd25e10 2024-09-10T05:37:34.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.338+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56165dd31da0 con 0x7efd680b6070 2024-09-10T05:37:34.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.338+0000 7efd783a4640 1 -- 172.21.15.62:0/2295703925 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd700083f0 con 0x7efd680b6070 2024-09-10T05:37:34.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.338+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94654063384816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56165dd321c0 con 0x7efd680b6070 2024-09-10T05:37:34.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.338+0000 7efd7a09d9c0 20 add_watcher() i=0 2024-09-10T05:37:34.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.338+0000 7efd7a09d9c0 20 add_watcher() i=1 2024-09-10T05:37:34.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.338+0000 7efd7a09d9c0 20 add_watcher() i=2 2024-09-10T05:37:34.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.338+0000 7efd7a09d9c0 20 add_watcher() i=3 2024-09-10T05:37:34.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.338+0000 7efd7a09d9c0 20 add_watcher() i=4 2024-09-10T05:37:34.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.338+0000 7efd7a09d9c0 20 add_watcher() i=5 2024-09-10T05:37:34.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.338+0000 7efd773a2640 1 -- 172.21.15.62:0/2295703925 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94654063380992] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd6c026070 con 0x56165dd25e10 2024-09-10T05:37:34.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.338+0000 7efd7a09d9c0 20 add_watcher() i=6 2024-09-10T05:37:34.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.338+0000 7efd783a4640 1 -- 172.21.15.62:0/2295703925 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94654063384816] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd700083f0 con 0x7efd680b6070 2024-09-10T05:37:34.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.338+0000 7efd7a09d9c0 20 add_watcher() i=7 2024-09-10T05:37:34.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.338+0000 7efd7a09d9c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:37:34.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.338+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56165dd34dd0 con 0x56165dd1e180 2024-09-10T05:37:34.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.338+0000 7efd783a4640 1 -- 172.21.15.62:0/2295703925 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7efd700083f0 con 0x56165dd1e180 2024-09-10T05:37:34.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.338+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94654063377632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56165dd321c0 con 0x56165dd1e180 2024-09-10T05:37:34.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.342+0000 7efd783a4640 1 -- 172.21.15.62:0/2295703925 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94654063377632] v32'210 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efd700083f0 con 0x56165dd1e180 2024-09-10T05:37:34.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.342+0000 7efc2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:37:34.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.342+0000 7efd7a09d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:37:34.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.342+0000 7efd7a09d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:37:34.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.342+0000 7efd7a09d9c0 5 note: GC not initialized 2024-09-10T05:37:34.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.342+0000 7efc2cfe1640 20 reqs_thread_entry: start 2024-09-10T05:37:34.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.342+0000 7efd7a09d9c0 20 init_complete bucket index max shards: 11 2024-09-10T05:37:34.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.342+0000 7efd7a09d9c0 20 Filter name: none 2024-09-10T05:37:34.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.342+0000 7efba67fc640 20 reqs_thread_entry: start 2024-09-10T05:37:34.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.342+0000 7efd7a09d9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.342+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56165dd57c40 con 0x56165dd1e180 2024-09-10T05:37:34.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.342+0000 7efd783a4640 1 -- 172.21.15.62:0/2295703925 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7efd700083f0 con 0x56165dd1e180 2024-09-10T05:37:34.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.342+0000 7efd7a09d9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:37:34.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.342+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56165dd59190 con 0x56165dd25e10 2024-09-10T05:37:34.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.342+0000 7efd773a2640 1 -- 172.21.15.62:0/2295703925 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv30 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7efd6c026070 con 0x56165dd25e10 2024-09-10T05:37:34.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.346+0000 7efc2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:37:34.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.346+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94654063377632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56165dd57560 con 0x56165dd1e180 2024-09-10T05:37:34.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.346+0000 7efd783a4640 1 -- 172.21.15.62:0/2295703925 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94654063377632] v32'211 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efd700083f0 con 0x56165dd1e180 2024-09-10T05:37:34.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.346+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94654063362464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56165dd2fce0 con 0x56165dd225c0 2024-09-10T05:37:34.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.350+0000 7efd77ba3640 1 -- 172.21.15.62:0/2295703925 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94654063362464] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd680b2070 con 0x56165dd225c0 2024-09-10T05:37:34.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.350+0000 7efd7a09d9c0 20 remove_watcher() i=0 2024-09-10T05:37:34.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.350+0000 7efd7a09d9c0 2 removed watcher, disabling cache 2024-09-10T05:37:34.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.350+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94654063367712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56165dd2fce0 con 0x56165dd1e180 2024-09-10T05:37:34.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.350+0000 7efd783a4640 1 -- 172.21.15.62:0/2295703925 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94654063367712] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd700083f0 con 0x56165dd1e180 2024-09-10T05:37:34.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.350+0000 7efd7a09d9c0 20 remove_watcher() i=1 2024-09-10T05:37:34.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.350+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94654063370768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56165dd2d620 con 0x56165dd225c0 2024-09-10T05:37:34.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.354+0000 7efd77ba3640 1 -- 172.21.15.62:0/2295703925 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94654063370768] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd680b2070 con 0x56165dd225c0 2024-09-10T05:37:34.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.354+0000 7efd7a09d9c0 20 remove_watcher() i=2 2024-09-10T05:37:34.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.354+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94654063373328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56165dd2fce0 con 0x7efd680b6070 2024-09-10T05:37:34.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.354+0000 7efd783a4640 1 -- 172.21.15.62:0/2295703925 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94654063373328] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd700083f0 con 0x7efd680b6070 2024-09-10T05:37:34.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.354+0000 7efd7a09d9c0 20 remove_watcher() i=3 2024-09-10T05:37:34.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.354+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94654063371824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56165dd2e210 con 0x56165dd225c0 2024-09-10T05:37:34.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.358+0000 7efd77ba3640 1 -- 172.21.15.62:0/2295703925 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94654063371824] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd680b2070 con 0x56165dd225c0 2024-09-10T05:37:34.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.358+0000 7efd7a09d9c0 20 remove_watcher() i=4 2024-09-10T05:37:34.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.358+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94654063379936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56165dd2fce0 con 0x56165dd25e10 2024-09-10T05:37:34.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.358+0000 7efd773a2640 1 -- 172.21.15.62:0/2295703925 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94654063379936] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd6c026070 con 0x56165dd25e10 2024-09-10T05:37:34.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.358+0000 7efd7a09d9c0 20 remove_watcher() i=5 2024-09-10T05:37:34.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.358+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94654063380992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56165dd305e0 con 0x56165dd25e10 2024-09-10T05:37:34.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.358+0000 7efd773a2640 1 -- 172.21.15.62:0/2295703925 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94654063380992] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd6c026070 con 0x56165dd25e10 2024-09-10T05:37:34.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.358+0000 7efd7a09d9c0 20 remove_watcher() i=6 2024-09-10T05:37:34.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.358+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/2295703925 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94654063384816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56165dd2fce0 con 0x7efd680b6070 2024-09-10T05:37:34.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.362+0000 7efd783a4640 1 -- 172.21.15.62:0/2295703925 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94654063384816] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd700083f0 con 0x7efd680b6070 2024-09-10T05:37:34.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.362+0000 7efd7a09d9c0 20 remove_watcher() i=7 2024-09-10T05:37:34.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.362+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/2295703925 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x56165dd225c0 msgr2=0x56165dd249b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.362+0000 7efd7a09d9c0 1 --2- 172.21.15.62:0/2295703925 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x56165dd225c0 0x56165dd249b0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.362+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/2295703925 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56165dd1e180 msgr2=0x56165dd205d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.362+0000 7efd7a09d9c0 1 --2- 172.21.15.62:0/2295703925 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56165dd1e180 0x56165dd205d0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.362+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/2295703925 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7efd680b6070 msgr2=0x7efd680ba3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.362+0000 7efd7a09d9c0 1 --2- 172.21.15.62:0/2295703925 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7efd680b6070 0x7efd680ba3f0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.362+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/2295703925 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56165dd25e10 msgr2=0x56165dd28200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.362+0000 7efd7a09d9c0 1 --2- 172.21.15.62:0/2295703925 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56165dd25e10 0x56165dd28200 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.362+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/2295703925 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7efc40039a70 msgr2=0x7efc4003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.362+0000 7efd7a09d9c0 1 --2- 172.21.15.62:0/2295703925 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7efc40039a70 0x7efc4003bf30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7efd6c01d040 tx=0x7efd6c010000 comp rx=0 tx=0).stop 2024-09-10T05:37:34.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.362+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/2295703925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56165dd0c090 msgr2=0x56165dd13430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.362+0000 7efd783a4640 1 -- 172.21.15.62:0/2295703925 reap_dead start 2024-09-10T05:37:34.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.362+0000 7efd7a09d9c0 1 --2- 172.21.15.62:0/2295703925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56165dd0c090 0x56165dd13430 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7efd680e8b10 tx=0x7efd680e4f50 comp rx=0 tx=0).stop 2024-09-10T05:37:34.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.362+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/2295703925 shutdown_connections 2024-09-10T05:37:34.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.362+0000 7efd7a09d9c0 1 --2- 172.21.15.62:0/2295703925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56165dd0c090 0x56165dd13430 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.362+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/2295703925 >> 172.21.15.62:0/2295703925 conn(0x56165dd084c0 msgr2=0x56165dd066d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:34.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.362+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/2295703925 shutdown_connections 2024-09-10T05:37:34.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.362+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/2295703925 wait complete. 2024-09-10T05:37:34.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.362+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/181939209 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7efc50039a70 msgr2=0x7efc5003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.362+0000 7efd7a09d9c0 1 --2- 172.21.15.62:0/181939209 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7efc50039a70 0x7efc5003bf30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efd6c00bf50 tx=0x7efd6c00f000 comp rx=0 tx=0).stop 2024-09-10T05:37:34.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.362+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/181939209 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56165dcffb40 msgr2=0x56165dcfff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.362+0000 7efd7a09d9c0 1 --2- 172.21.15.62:0/181939209 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56165dcffb40 0x56165dcfff60 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7efd680b6fd0 tx=0x7efd680c77e0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.362+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/181939209 shutdown_connections 2024-09-10T05:37:34.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.362+0000 7efd7a09d9c0 1 --2- 172.21.15.62:0/181939209 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7efc50039a70 0x7efc5003bf30 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.362+0000 7efd7a09d9c0 1 --2- 172.21.15.62:0/181939209 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56165dcffb40 0x56165dcfff60 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.362+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/181939209 >> 172.21.15.62:0/181939209 conn(0x56165dcf54f0 msgr2=0x56165dcf58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:34.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.362+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/181939209 shutdown_connections 2024-09-10T05:37:34.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.362+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/181939209 wait complete. 2024-09-10T05:37:34.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.362+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/1235435738 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x56165dcea020 msgr2=0x56165dcec4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.362+0000 7efd7a09d9c0 1 --2- 172.21.15.62:0/1235435738 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x56165dcea020 0x56165dcec4e0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.362+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/1235435738 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56165db615d0 msgr2=0x56165dce8ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.362+0000 7efd7a09d9c0 1 --2- 172.21.15.62:0/1235435738 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56165db615d0 0x56165dce8ff0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.362+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/1235435738 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56165dceea10 msgr2=0x56165dcf0e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.362+0000 7efd7a09d9c0 1 --2- 172.21.15.62:0/1235435738 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56165dceea10 0x56165dcf0e00 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.362+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/1235435738 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7efc60039a70 msgr2=0x7efc6003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.362+0000 7efd7a09d9c0 1 --2- 172.21.15.62:0/1235435738 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7efc60039a70 0x7efc6003bf30 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7efd6c001d80 tx=0x7efd6c0012e0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.362+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/1235435738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56165db611f0 msgr2=0x56165dce1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.362+0000 7efd7a09d9c0 1 --2- 172.21.15.62:0/1235435738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56165db611f0 0x56165dce1e80 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7efd680aa500 tx=0x7efd68017d70 comp rx=0 tx=0).stop 2024-09-10T05:37:34.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.362+0000 7efd783a4640 1 -- 172.21.15.62:0/1235435738 reap_dead start 2024-09-10T05:37:34.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.362+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/1235435738 shutdown_connections 2024-09-10T05:37:34.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.362+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/1235435738 >> 172.21.15.62:0/1235435738 conn(0x56165dbe7910 msgr2=0x56165dcd4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:34.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.362+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/1235435738 shutdown_connections 2024-09-10T05:37:34.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.362+0000 7efd7a09d9c0 1 -- 172.21.15.62:0/1235435738 wait complete. 2024-09-10T05:37:34.378 INFO:teuthology.orchestra.run.smithi062.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-10T05:37:34.379 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T05:37:34.379 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-10T05:37:34.379 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-10T05:37:34.379 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2024-09-10T05:37:34.458 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:37:34.458 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:37:34.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.454+0000 7fc1df7149c0 1 Processor -- start 2024-09-10T05:37:34.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.454+0000 7fc1df7149c0 1 -- start start 2024-09-10T05:37:34.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.454+0000 7fc1df7149c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x555faefdcf70 0x555faefdd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.454+0000 7fc1df7149c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555faee919c0 con 0x555faefe00b0 2024-09-10T05:37:34.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.454+0000 7fc1df7149c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x555faeee16d0 con 0x555faefdcf70 2024-09-10T05:37:34.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.454+0000 7fc1dd21a640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x555faefdcf70 0x555faefdd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.454+0000 7fc1dd21a640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x555faefdcf70 0x555faefdd350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:57728/0 (socket says 172.21.15.62:57728) 2024-09-10T05:37:34.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.454+0000 7fc1dd21a640 1 -- 172.21.15.62:0/2445727360 learned_addr learned my addr 172.21.15.62:0/2445727360 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:34.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.454+0000 7fc1dd21a640 1 -- 172.21.15.62:0/2445727360 >> v1:172.21.15.2:6789/0 conn(0x555faefe00b0 legacy=0x555faefe24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.454+0000 7fc1dd21a640 1 -- 172.21.15.62:0/2445727360 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555faee85ca0 con 0x555faefdcf70 2024-09-10T05:37:34.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.458+0000 7fc1dd21a640 1 --2- 172.21.15.62:0/2445727360 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555faefdcf70 0x555faefdd350 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fc1d000a5c0 tx=0x7fc1d001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5af47a4ee5432bbb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.458+0000 7fc1cffff640 1 -- 172.21.15.62:0/2445727360 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1d00a6070 con 0x555faefdcf70 2024-09-10T05:37:34.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.458+0000 7fc1cffff640 1 -- 172.21.15.62:0/2445727360 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1d00af070 con 0x555faefdcf70 2024-09-10T05:37:34.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.458+0000 7fc1cffff640 1 -- 172.21.15.62:0/2445727360 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1d00aa5c0 con 0x555faefdcf70 2024-09-10T05:37:34.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.458+0000 7fc1df7149c0 1 -- 172.21.15.62:0/2445727360 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555faefdcf70 msgr2=0x555faefdd350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.458+0000 7fc1df7149c0 1 --2- 172.21.15.62:0/2445727360 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555faefdcf70 0x555faefdd350 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fc1d000a5c0 tx=0x7fc1d001b340 comp rx=0 tx=0).stop 2024-09-10T05:37:34.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.458+0000 7fc1df7149c0 1 -- 172.21.15.62:0/2445727360 shutdown_connections 2024-09-10T05:37:34.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.458+0000 7fc1df7149c0 1 --2- 172.21.15.62:0/2445727360 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555faefdcf70 0x555faefdd350 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.458+0000 7fc1df7149c0 1 -- 172.21.15.62:0/2445727360 >> 172.21.15.62:0/2445727360 conn(0x555faefd8a90 msgr2=0x555faefdaeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:34.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.458+0000 7fc1df7149c0 1 -- 172.21.15.62:0/2445727360 shutdown_connections 2024-09-10T05:37:34.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.458+0000 7fc1df7149c0 1 -- 172.21.15.62:0/2445727360 wait complete. 2024-09-10T05:37:34.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.474+0000 7fc1df7149c0 1 Processor -- start 2024-09-10T05:37:34.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.474+0000 7fc1df7149c0 1 -- start start 2024-09-10T05:37:34.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.474+0000 7fc1df7149c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555faefdcf70 0x555faf0c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.474+0000 7fc1df7149c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555faeee5680 con 0x555faefdcf70 2024-09-10T05:37:34.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.474+0000 7fc1dd21a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555faefdcf70 0x555faf0c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.474+0000 7fc1dd21a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555faefdcf70 0x555faf0c86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:57730/0 (socket says 172.21.15.62:57730) 2024-09-10T05:37:34.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.474+0000 7fc1dd21a640 1 -- 172.21.15.62:0/3312170284 learned_addr learned my addr 172.21.15.62:0/3312170284 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:34.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.474+0000 7fc1dd21a640 1 -- 172.21.15.62:0/3312170284 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555faee60da0 con 0x555faefdcf70 2024-09-10T05:37:34.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.474+0000 7fc1dd21a640 1 --2- 172.21.15.62:0/3312170284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555faefdcf70 0x555faf0c86f0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0018f70 tx=0x7fc1d0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cf8e2f39c158a70 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.474+0000 7fc0cb606640 1 -- 172.21.15.62:0/3312170284 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1d00aa8b0 con 0x555faefdcf70 2024-09-10T05:37:34.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.474+0000 7fc0cb606640 1 -- 172.21.15.62:0/3312170284 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1d00aaa50 con 0x555faefdcf70 2024-09-10T05:37:34.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.474+0000 7fc0cb606640 1 -- 172.21.15.62:0/3312170284 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1d00aad30 con 0x555faefdcf70 2024-09-10T05:37:34.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.478+0000 7fc1df7149c0 1 -- 172.21.15.62:0/3312170284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555faefdcf70 msgr2=0x555faf0c86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.478+0000 7fc1df7149c0 1 --2- 172.21.15.62:0/3312170284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555faefdcf70 0x555faf0c86f0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0018f70 tx=0x7fc1d0003030 comp rx=0 tx=0).stop 2024-09-10T05:37:34.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.478+0000 7fc1df7149c0 1 -- 172.21.15.62:0/3312170284 shutdown_connections 2024-09-10T05:37:34.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.478+0000 7fc1df7149c0 1 --2- 172.21.15.62:0/3312170284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555faefdcf70 0x555faf0c86f0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.478+0000 7fc1df7149c0 1 -- 172.21.15.62:0/3312170284 >> 172.21.15.62:0/3312170284 conn(0x555faefd8a90 msgr2=0x555faf0c4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:34.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.478+0000 7fc1df7149c0 1 -- 172.21.15.62:0/3312170284 shutdown_connections 2024-09-10T05:37:34.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.478+0000 7fc1df7149c0 1 -- 172.21.15.62:0/3312170284 wait complete. 2024-09-10T05:37:34.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.478+0000 7fc1df7149c0 1 Processor -- start 2024-09-10T05:37:34.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.478+0000 7fc1df7149c0 1 -- start start 2024-09-10T05:37:34.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.478+0000 7fc1df7149c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555faefdcf70 0x555faf0cfc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.478+0000 7fc1df7149c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555faee87a50 con 0x555faefdcf70 2024-09-10T05:37:34.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.478+0000 7fc1dd21a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555faefdcf70 0x555faf0cfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.478+0000 7fc1dd21a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555faefdcf70 0x555faf0cfc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:57746/0 (socket says 172.21.15.62:57746) 2024-09-10T05:37:34.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.478+0000 7fc1dd21a640 1 -- 172.21.15.62:0/681605852 learned_addr learned my addr 172.21.15.62:0/681605852 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:34.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.478+0000 7fc1dd21a640 1 -- 172.21.15.62:0/681605852 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555faf0d01c0 con 0x555faefdcf70 2024-09-10T05:37:34.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.478+0000 7fc1dd21a640 1 --2- 172.21.15.62:0/681605852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555faefdcf70 0x555faf0cfc60 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0018f70 tx=0x7fc1d00180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.478+0000 7fc0c9e03640 1 -- 172.21.15.62:0/681605852 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1d00c6690 con 0x555faefdcf70 2024-09-10T05:37:34.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.478+0000 7fc1df7149c0 1 -- 172.21.15.62:0/681605852 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555faf0d0450 con 0x555faefdcf70 2024-09-10T05:37:34.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.478+0000 7fc0c9e03640 1 -- 172.21.15.62:0/681605852 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1d00c6830 con 0x555faefdcf70 2024-09-10T05:37:34.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.478+0000 7fc0c9e03640 1 -- 172.21.15.62:0/681605852 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1d00c6b10 con 0x555faefdcf70 2024-09-10T05:37:34.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.478+0000 7fc1df7149c0 1 -- 172.21.15.62:0/681605852 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555faf0d0e00 con 0x555faefdcf70 2024-09-10T05:37:34.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.482+0000 7fc0c9e03640 1 -- 172.21.15.62:0/681605852 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc1d00ce030 con 0x555faefdcf70 2024-09-10T05:37:34.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.482+0000 7fc0c9e03640 1 --2- 172.21.15.62:0/681605852 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc0c4039a70 0x7fc0c403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.482+0000 7fc0c9e03640 1 -- 172.21.15.62:0/681605852 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7fc1d00cc020 con 0x555faefdcf70 2024-09-10T05:37:34.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.482+0000 7fc1dca19640 1 --2- 172.21.15.62:0/681605852 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc0c4039a70 0x7fc0c403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.482+0000 7fc1df7149c0 1 --2- 172.21.15.62:0/681605852 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x555faefe00b0 0x555faf0d6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.482+0000 7fc1df7149c0 1 -- 172.21.15.62:0/681605852 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555faf0d7310 con 0x555faefe00b0 2024-09-10T05:37:34.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.482+0000 7fc1dda1b640 1 --2- 172.21.15.62:0/681605852 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x555faefe00b0 0x555faf0d6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.482+0000 7fc1dca19640 1 --2- 172.21.15.62:0/681605852 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc0c4039a70 0x7fc0c403bf30 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc1d4001e60 tx=0x7fc1d40013e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.482+0000 7fc1dda1b640 1 --2- 172.21.15.62:0/681605852 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x555faefe00b0 0x555faf0d6dd0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.482+0000 7fc1dda1b640 1 -- 172.21.15.62:0/681605852 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc1d800a4d0 con 0x555faefe00b0 2024-09-10T05:37:34.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.482+0000 7fc1df7149c0 1 --2- 172.21.15.62:0/681605852 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x555faf0d80a0 0x555faf0da490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.482+0000 7fc1df7149c0 1 -- 172.21.15.62:0/681605852 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555faf0daac0 con 0x555faf0d80a0 2024-09-10T05:37:34.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.482+0000 7fc1dd21a640 1 --2- 172.21.15.62:0/681605852 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x555faf0d80a0 0x555faf0da490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.482+0000 7fc1dd21a640 1 --2- 172.21.15.62:0/681605852 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x555faf0d80a0 0x555faf0da490 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.482+0000 7fc1dd21a640 1 -- 172.21.15.62:0/681605852 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc1d00bc580 con 0x555faf0d80a0 2024-09-10T05:37:34.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.482+0000 7fc1df7149c0 1 --2- 172.21.15.62:0/681605852 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x555faf0dc850 0x555faf0dec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.482+0000 7fc1df7149c0 1 -- 172.21.15.62:0/681605852 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555faf0df3b0 con 0x555faf0dc850 2024-09-10T05:37:34.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.482+0000 7fc1dca19640 1 --2- 172.21.15.62:0/681605852 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x555faf0dc850 0x555faf0dec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.482+0000 7fc1dca19640 1 --2- 172.21.15.62:0/681605852 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x555faf0dc850 0x555faf0dec40 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.486+0000 7fc1dca19640 1 -- 172.21.15.62:0/681605852 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc1d400d040 con 0x555faf0dc850 2024-09-10T05:37:34.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.486+0000 7fc1df7149c0 1 -- 172.21.15.62:0/681605852 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555faf0db6f0 con 0x555faf0d80a0 2024-09-10T05:37:34.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.486+0000 7fc1dd21a640 1 -- 172.21.15.62:0/681605852 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc1d00bc580 con 0x555faf0d80a0 2024-09-10T05:37:34.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.486+0000 7fc1df7149c0 1 -- 172.21.15.62:0/681605852 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555faf0dbb50 con 0x555faf0dc850 2024-09-10T05:37:34.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.486+0000 7fc1dca19640 1 -- 172.21.15.62:0/681605852 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc1d400d040 con 0x555faf0dc850 2024-09-10T05:37:34.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.486+0000 7fc1df7149c0 1 Processor -- start 2024-09-10T05:37:34.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.486+0000 7fc1df7149c0 1 -- start start 2024-09-10T05:37:34.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.486+0000 7fc1df7149c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555faf0edaa0 0x555faf0edec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.486+0000 7fc1df7149c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555faeef2450 con 0x555faf0edaa0 2024-09-10T05:37:34.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.486+0000 7fc1dd21a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555faf0edaa0 0x555faf0edec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.486+0000 7fc1dd21a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555faf0edaa0 0x555faf0edec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:57762/0 (socket says 172.21.15.62:57762) 2024-09-10T05:37:34.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.486+0000 7fc1dd21a640 1 -- 172.21.15.62:0/1786718470 learned_addr learned my addr 172.21.15.62:0/1786718470 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:34.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.486+0000 7fc1dd21a640 1 -- 172.21.15.62:0/1786718470 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555faf0ee500 con 0x555faf0edaa0 2024-09-10T05:37:34.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.486+0000 7fc1dd21a640 1 --2- 172.21.15.62:0/1786718470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555faf0edaa0 0x555faf0edec0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fc1d00aa780 tx=0x7fc1d00bcea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.486+0000 7fc0c2ffd640 1 -- 172.21.15.62:0/1786718470 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1d00cf6b0 con 0x555faf0edaa0 2024-09-10T05:37:34.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.486+0000 7fc1df7149c0 1 -- 172.21.15.62:0/1786718470 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555faf0eed60 con 0x555faf0edaa0 2024-09-10T05:37:34.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.486+0000 7fc0c2ffd640 1 -- 172.21.15.62:0/1786718470 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1d00cf850 con 0x555faf0edaa0 2024-09-10T05:37:34.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.486+0000 7fc0c2ffd640 1 -- 172.21.15.62:0/1786718470 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1d00ab3c0 con 0x555faf0edaa0 2024-09-10T05:37:34.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.486+0000 7fc1df7149c0 1 -- 172.21.15.62:0/1786718470 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555faf0ef2d0 con 0x555faf0edaa0 2024-09-10T05:37:34.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.490+0000 7fc0c2ffd640 1 -- 172.21.15.62:0/1786718470 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc1d00ab560 con 0x555faf0edaa0 2024-09-10T05:37:34.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.490+0000 7fc0c2ffd640 1 --2- 172.21.15.62:0/1786718470 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc0b4039a70 0x7fc0b403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.490+0000 7fc0c2ffd640 1 -- 172.21.15.62:0/1786718470 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7fc1d00e4070 con 0x555faf0edaa0 2024-09-10T05:37:34.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.490+0000 7fc1dca19640 1 --2- 172.21.15.62:0/1786718470 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc0b4039a70 0x7fc0b403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.490+0000 7fc1df7149c0 1 Processor -- start 2024-09-10T05:37:34.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.490+0000 7fc1df7149c0 1 -- start start 2024-09-10T05:37:34.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.490+0000 7fc1df7149c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555faf0fa200 0x555faf0fa5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.490+0000 7fc1df7149c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555faf0c8e80 con 0x555faf0fa200 2024-09-10T05:37:34.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.490+0000 7fc1dca19640 1 --2- 172.21.15.62:0/1786718470 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc0b4039a70 0x7fc0b403bf30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x555faf0d10e0 tx=0x7fc1d4006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.490+0000 7fc1dd21a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555faf0fa200 0x555faf0fa5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.490+0000 7fc1dd21a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555faf0fa200 0x555faf0fa5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:57774/0 (socket says 172.21.15.62:57774) 2024-09-10T05:37:34.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.490+0000 7fc1dd21a640 1 -- 172.21.15.62:0/3618415820 learned_addr learned my addr 172.21.15.62:0/3618415820 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:34.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.490+0000 7fc1dd21a640 1 -- 172.21.15.62:0/3618415820 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555faf0fabb0 con 0x555faf0fa200 2024-09-10T05:37:34.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.490+0000 7fc1dd21a640 1 --2- 172.21.15.62:0/3618415820 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555faf0fa200 0x555faf0fa5e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fc1d00066f0 tx=0x7fc1d00dc790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79a6df390e787681 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.490+0000 7fc0c0ff9640 1 -- 172.21.15.62:0/3618415820 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1d00c5930 con 0x555faf0fa200 2024-09-10T05:37:34.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.490+0000 7fc0c0ff9640 1 -- 172.21.15.62:0/3618415820 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1d00dc410 con 0x555faf0fa200 2024-09-10T05:37:34.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.490+0000 7fc0c0ff9640 1 -- 172.21.15.62:0/3618415820 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1d00ea450 con 0x555faf0fa200 2024-09-10T05:37:34.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.490+0000 7fc1df7149c0 1 -- 172.21.15.62:0/3618415820 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555faf0fa200 msgr2=0x555faf0fa5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.490+0000 7fc1df7149c0 1 --2- 172.21.15.62:0/3618415820 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555faf0fa200 0x555faf0fa5e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fc1d00066f0 tx=0x7fc1d00dc790 comp rx=0 tx=0).stop 2024-09-10T05:37:34.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.490+0000 7fc1df7149c0 1 -- 172.21.15.62:0/3618415820 shutdown_connections 2024-09-10T05:37:34.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.490+0000 7fc1df7149c0 1 --2- 172.21.15.62:0/3618415820 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555faf0fa200 0x555faf0fa5e0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.490+0000 7fc1df7149c0 1 -- 172.21.15.62:0/3618415820 >> 172.21.15.62:0/3618415820 conn(0x555faf0f6630 msgr2=0x555faf0f4870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:34.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.490+0000 7fc1df7149c0 1 -- 172.21.15.62:0/3618415820 shutdown_connections 2024-09-10T05:37:34.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.490+0000 7fc1df7149c0 1 -- 172.21.15.62:0/3618415820 wait complete. 2024-09-10T05:37:34.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.490+0000 7fc1df7149c0 1 Processor -- start 2024-09-10T05:37:34.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.494+0000 7fc1df7149c0 1 -- start start 2024-09-10T05:37:34.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.494+0000 7fc1df7149c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555faf0fa200 0x555faf101520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.494+0000 7fc1df7149c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555faf0fb090 con 0x555faf0fa200 2024-09-10T05:37:34.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.494+0000 7fc1dd21a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555faf0fa200 0x555faf101520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.494+0000 7fc1dd21a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555faf0fa200 0x555faf101520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:57788/0 (socket says 172.21.15.62:57788) 2024-09-10T05:37:34.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.494+0000 7fc1dd21a640 1 -- 172.21.15.62:0/4084979036 learned_addr learned my addr 172.21.15.62:0/4084979036 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:34.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.494+0000 7fc1dd21a640 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555faf101a80 con 0x555faf0fa200 2024-09-10T05:37:34.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.494+0000 7fc1dd21a640 1 --2- 172.21.15.62:0/4084979036 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555faf0fa200 0x555faf101520 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fc1d00caec0 tx=0x7fc1d00cadf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.494+0000 7fc0b2ffd640 1 -- 172.21.15.62:0/4084979036 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1d010e020 con 0x555faf0fa200 2024-09-10T05:37:34.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.494+0000 7fc1df7149c0 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555faf101a80 con 0x555faf0fa200 2024-09-10T05:37:34.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.494+0000 7fc0b2ffd640 1 -- 172.21.15.62:0/4084979036 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1d00d0540 con 0x555faf0fa200 2024-09-10T05:37:34.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.494+0000 7fc1df7149c0 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555faf1020b0 con 0x555faf0fa200 2024-09-10T05:37:34.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.494+0000 7fc0b2ffd640 1 -- 172.21.15.62:0/4084979036 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1d00d0820 con 0x555faf0fa200 2024-09-10T05:37:34.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.494+0000 7fc0b2ffd640 1 -- 172.21.15.62:0/4084979036 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc1d0111020 con 0x555faf0fa200 2024-09-10T05:37:34.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.494+0000 7fc1df7149c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.494+0000 7fc0b2ffd640 1 --2- 172.21.15.62:0/4084979036 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc0a8039a20 0x7fc0a803bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.494+0000 7fc0b2ffd640 1 -- 172.21.15.62:0/4084979036 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7fc1d0105040 con 0x555faf0fa200 2024-09-10T05:37:34.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.494+0000 7fc1dca19640 1 --2- 172.21.15.62:0/4084979036 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc0a8039a20 0x7fc0a803bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.494+0000 7fc1df7149c0 1 --2- 172.21.15.62:0/4084979036 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x555faf10c4a0 0x555faf10e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.494+0000 7fc1df7149c0 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555faf10f080 con 0x555faf10c4a0 2024-09-10T05:37:34.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.494+0000 7fc1dda1b640 1 --2- 172.21.15.62:0/4084979036 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x555faf10c4a0 0x555faf10e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.494+0000 7fc1dca19640 1 --2- 172.21.15.62:0/4084979036 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc0a8039a20 0x7fc0a803bee0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x555faf0db6c0 tx=0x7fc1d4011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.498+0000 7fc1dda1b640 1 --2- 172.21.15.62:0/4084979036 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x555faf10c4a0 0x555faf10e930 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.498+0000 7fc1dda1b640 1 -- 172.21.15.62:0/4084979036 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc1d800a4d0 con 0x555faf10c4a0 2024-09-10T05:37:34.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.498+0000 7fc1df7149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:34.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.498+0000 7fc1df7149c0 20 realm 2024-09-10T05:37:34.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.498+0000 7fc1df7149c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.498+0000 7fc1df7149c0 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555faf10b830 con 0x555faf10c4a0 2024-09-10T05:37:34.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.498+0000 7fc1dda1b640 1 -- 172.21.15.62:0/4084979036 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc1d800a4d0 con 0x555faf10c4a0 2024-09-10T05:37:34.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.498+0000 7fc1df7149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:34.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.498+0000 7fc1df7149c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:37:34.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.498+0000 7fc1df7149c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.498+0000 7fc1df7149c0 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555faf10fb40 con 0x555faf10c4a0 2024-09-10T05:37:34.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.498+0000 7fc1dda1b640 1 -- 172.21.15.62:0/4084979036 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc1d800a4d0 con 0x555faf10c4a0 2024-09-10T05:37:34.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.498+0000 7fc1df7149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:34.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.498+0000 7fc1df7149c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.498+0000 7fc1df7149c0 1 --2- 172.21.15.62:0/4084979036 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x555faf110920 0x555faf112d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.498+0000 7fc1df7149c0 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555faf1133a0 con 0x555faf110920 2024-09-10T05:37:34.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.498+0000 7fc1dd21a640 1 --2- 172.21.15.62:0/4084979036 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x555faf110920 0x555faf112d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.498+0000 7fc1dd21a640 1 --2- 172.21.15.62:0/4084979036 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x555faf110920 0x555faf112d10 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.498+0000 7fc1dd21a640 1 -- 172.21.15.62:0/4084979036 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc1d00bc580 con 0x555faf110920 2024-09-10T05:37:34.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.498+0000 7fc1df7149c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:37:34.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.498+0000 7fc1df7149c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.498+0000 7fc1df7149c0 1 --2- 172.21.15.62:0/4084979036 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x555faf114150 0x555faf116540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.498+0000 7fc1df7149c0 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555faf116be0 con 0x555faf114150 2024-09-10T05:37:34.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.498+0000 7fc1dca19640 1 --2- 172.21.15.62:0/4084979036 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x555faf114150 0x555faf116540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.498+0000 7fc1dca19640 1 --2- 172.21.15.62:0/4084979036 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x555faf114150 0x555faf116540 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.498+0000 7fc1dca19640 1 -- 172.21.15.62:0/4084979036 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc1d400d040 con 0x555faf114150 2024-09-10T05:37:34.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.498+0000 7fc1df7149c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:37:34.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.498+0000 7fc1df7149c0 20 searching for the correct realm 2024-09-10T05:37:34.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.498+0000 7fc1df7149c0 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555faf1184d0 con 0x555faf114150 2024-09-10T05:37:34.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.502+0000 7fc1dca19640 1 -- 172.21.15.62:0/4084979036 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1d400d040 con 0x555faf114150 2024-09-10T05:37:34.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.502+0000 7fc1dca19640 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555faf1184d0 con 0x555faf110920 2024-09-10T05:37:34.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.502+0000 7fc1dd21a640 1 -- 172.21.15.62:0/4084979036 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1d00bc580 con 0x555faf110920 2024-09-10T05:37:34.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.502+0000 7fc1dd21a640 1 --2- 172.21.15.62:0/4084979036 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fc1d0113020 0x7fc1d0109ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.502+0000 7fc1dd21a640 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555faf1184d0 con 0x7fc1d0113020 2024-09-10T05:37:34.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.502+0000 7fc1dda1b640 1 --2- 172.21.15.62:0/4084979036 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fc1d0113020 0x7fc1d0109ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.502+0000 7fc1dda1b640 1 --2- 172.21.15.62:0/4084979036 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fc1d0113020 0x7fc1d0109ab0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.502+0000 7fc1dda1b640 1 -- 172.21.15.62:0/4084979036 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1d800a4d0 con 0x7fc1d0113020 2024-09-10T05:37:34.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.502+0000 7fc1dda1b640 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555faf1184d0 con 0x555faf10c4a0 2024-09-10T05:37:34.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.502+0000 7fc1dda1b640 1 -- 172.21.15.62:0/4084979036 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1d800a4d0 con 0x555faf10c4a0 2024-09-10T05:37:34.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.502+0000 7fc1dda1b640 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555faf1184d0 con 0x555faf10c4a0 2024-09-10T05:37:34.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.502+0000 7fc1dda1b640 1 -- 172.21.15.62:0/4084979036 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1d800a4d0 con 0x555faf10c4a0 2024-09-10T05:37:34.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.502+0000 7fc1dda1b640 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555faf1184d0 con 0x555faf114150 2024-09-10T05:37:34.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.502+0000 7fc1dca19640 1 -- 172.21.15.62:0/4084979036 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1d400d040 con 0x555faf114150 2024-09-10T05:37:34.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.502+0000 7fc1dca19640 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555faf1184d0 con 0x555faf10c4a0 2024-09-10T05:37:34.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.502+0000 7fc1dda1b640 1 -- 172.21.15.62:0/4084979036 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1d800a4d0 con 0x555faf10c4a0 2024-09-10T05:37:34.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.502+0000 7fc1dda1b640 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555faf1184d0 con 0x555faf110920 2024-09-10T05:37:34.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.502+0000 7fc1dd21a640 1 -- 172.21.15.62:0/4084979036 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1d00bc580 con 0x555faf110920 2024-09-10T05:37:34.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.502+0000 7fc1dd21a640 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555faf1184d0 con 0x555faf110920 2024-09-10T05:37:34.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.506+0000 7fc1dd21a640 1 -- 172.21.15.62:0/4084979036 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1d00bc580 con 0x555faf110920 2024-09-10T05:37:34.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.506+0000 7fc1dd21a640 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555faf1184d0 con 0x555faf10c4a0 2024-09-10T05:37:34.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.506+0000 7fc1dda1b640 1 -- 172.21.15.62:0/4084979036 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1d800a4d0 con 0x555faf10c4a0 2024-09-10T05:37:34.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.506+0000 7fc1dda1b640 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555faf1184d0 con 0x7fc1d0113020 2024-09-10T05:37:34.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.506+0000 7fc1dda1b640 1 -- 172.21.15.62:0/4084979036 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1d800a4d0 con 0x7fc1d0113020 2024-09-10T05:37:34.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.506+0000 7fc1dda1b640 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555faf1184d0 con 0x555faf10c4a0 2024-09-10T05:37:34.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.506+0000 7fc1dda1b640 1 -- 172.21.15.62:0/4084979036 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1d800a4d0 con 0x555faf10c4a0 2024-09-10T05:37:34.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.506+0000 7fc1dda1b640 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555faf1184d0 con 0x7fc1d0113020 2024-09-10T05:37:34.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.506+0000 7fc1dda1b640 1 -- 172.21.15.62:0/4084979036 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc1d800a4d0 con 0x7fc1d0113020 2024-09-10T05:37:34.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.506+0000 7fc1dda1b640 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555faf1184d0 con 0x555faf110920 2024-09-10T05:37:34.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.506+0000 7fc1dd21a640 1 -- 172.21.15.62:0/4084979036 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1d00bc580 con 0x555faf110920 2024-09-10T05:37:34.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.506+0000 7fc1dd21a640 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555faf1184d0 con 0x555faf114150 2024-09-10T05:37:34.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.506+0000 7fc1dca19640 1 -- 172.21.15.62:0/4084979036 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1d400d040 con 0x555faf114150 2024-09-10T05:37:34.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.506+0000 7fc1dca19640 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555faf1184d0 con 0x555faf10c4a0 2024-09-10T05:37:34.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.506+0000 7fc1dda1b640 1 -- 172.21.15.62:0/4084979036 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1d800a4d0 con 0x555faf10c4a0 2024-09-10T05:37:34.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.506+0000 7fc1dda1b640 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555faf1184d0 con 0x555faf110920 2024-09-10T05:37:34.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.506+0000 7fc1dd21a640 1 -- 172.21.15.62:0/4084979036 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1d00bc580 con 0x555faf110920 2024-09-10T05:37:34.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.506+0000 7fc1dd21a640 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555faf1184d0 con 0x555faf114150 2024-09-10T05:37:34.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.506+0000 7fc1dca19640 1 -- 172.21.15.62:0/4084979036 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 32 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7fc1d400d040 con 0x555faf114150 2024-09-10T05:37:34.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.506+0000 7fc1dca19640 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555faf1184d0 con 0x555faf10c4a0 2024-09-10T05:37:34.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.510+0000 7fc1dda1b640 1 -- 172.21.15.62:0/4084979036 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1d800a4d0 con 0x555faf10c4a0 2024-09-10T05:37:34.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.510+0000 7fc1dda1b640 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555faf1184d0 con 0x555faf10c4a0 2024-09-10T05:37:34.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.510+0000 7fc1dda1b640 1 -- 172.21.15.62:0/4084979036 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc1d800a4d0 con 0x555faf10c4a0 2024-09-10T05:37:34.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.510+0000 7fc1dda1b640 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555faf1184d0 con 0x555faf10c4a0 2024-09-10T05:37:34.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.510+0000 7fc1dda1b640 1 -- 172.21.15.62:0/4084979036 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1d800a4d0 con 0x555faf10c4a0 2024-09-10T05:37:34.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.510+0000 7fc1dda1b640 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555faf1184d0 con 0x555faf114150 2024-09-10T05:37:34.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.510+0000 7fc1dca19640 1 -- 172.21.15.62:0/4084979036 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1d400d040 con 0x555faf114150 2024-09-10T05:37:34.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.510+0000 7fc1dca19640 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555faf1184d0 con 0x7fc1d0113020 2024-09-10T05:37:34.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.510+0000 7fc1dda1b640 1 -- 172.21.15.62:0/4084979036 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1d800a4d0 con 0x7fc1d0113020 2024-09-10T05:37:34.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.510+0000 7fc1dda1b640 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555faf1184d0 con 0x555faf10c4a0 2024-09-10T05:37:34.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.510+0000 7fc1dda1b640 1 -- 172.21.15.62:0/4084979036 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1d800a4d0 con 0x555faf10c4a0 2024-09-10T05:37:34.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.510+0000 7fc1dda1b640 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555faf1184d0 con 0x7fc1d0113020 2024-09-10T05:37:34.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.510+0000 7fc1dda1b640 1 -- 172.21.15.62:0/4084979036 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1d800a4d0 con 0x7fc1d0113020 2024-09-10T05:37:34.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.510+0000 7fc1dda1b640 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555faf1184d0 con 0x555faf114150 2024-09-10T05:37:34.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.510+0000 7fc1dca19640 1 -- 172.21.15.62:0/4084979036 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1d400d040 con 0x555faf114150 2024-09-10T05:37:34.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.510+0000 7fc1dca19640 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555faf1184d0 con 0x7fc1d0113020 2024-09-10T05:37:34.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.510+0000 7fc1dda1b640 1 -- 172.21.15.62:0/4084979036 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1d800a4d0 con 0x7fc1d0113020 2024-09-10T05:37:34.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.510+0000 7fc1dda1b640 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555faf1184d0 con 0x555faf110920 2024-09-10T05:37:34.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.510+0000 7fc1dd21a640 1 -- 172.21.15.62:0/4084979036 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1d00bc580 con 0x555faf110920 2024-09-10T05:37:34.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.510+0000 7fc1dd21a640 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555faf1184d0 con 0x555faf110920 2024-09-10T05:37:34.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.510+0000 7fc1dd21a640 1 -- 172.21.15.62:0/4084979036 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1d00bc580 con 0x555faf110920 2024-09-10T05:37:34.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.510+0000 7fc1dd21a640 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555faf1184d0 con 0x555faf114150 2024-09-10T05:37:34.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.514+0000 7fc1dca19640 1 -- 172.21.15.62:0/4084979036 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1d400d040 con 0x555faf114150 2024-09-10T05:37:34.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.514+0000 7fc1dca19640 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555faf1184d0 con 0x555faf110920 2024-09-10T05:37:34.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.514+0000 7fc1dd21a640 1 -- 172.21.15.62:0/4084979036 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc1d00bc580 con 0x555faf110920 2024-09-10T05:37:34.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.514+0000 7fc1dd21a640 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555faf1184d0 con 0x555faf110920 2024-09-10T05:37:34.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.514+0000 7fc1dd21a640 1 -- 172.21.15.62:0/4084979036 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1d00bc580 con 0x555faf110920 2024-09-10T05:37:34.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.514+0000 7fc1df7149c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:37:34.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.514+0000 7fc1df7149c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:37:34.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.514+0000 7fc1df7149c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:37:34.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.514+0000 7fc1df7149c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:37:34.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.514+0000 7fc1df7149c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:37:34.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.514+0000 7fc1df7149c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:37:34.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.514+0000 7fc1df7149c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.514+0000 7fc1df7149c0 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555faf1175d0 con 0x555faf10c4a0 2024-09-10T05:37:34.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.514+0000 7fc1dda1b640 1 -- 172.21.15.62:0/4084979036 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc1d800a4d0 con 0x555faf10c4a0 2024-09-10T05:37:34.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.514+0000 7fc1df7149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:34.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.514+0000 7fc1df7149c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.514+0000 7fc1df7149c0 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555faf117a20 con 0x555faf110920 2024-09-10T05:37:34.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.514+0000 7fc1dd21a640 1 -- 172.21.15.62:0/4084979036 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc1d00bc580 con 0x555faf110920 2024-09-10T05:37:34.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.514+0000 7fc1df7149c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:37:34.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.514+0000 7fc1df7149c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.514+0000 7fc1df7149c0 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555faf117e80 con 0x555faf114150 2024-09-10T05:37:34.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.514+0000 7fc1dca19640 1 -- 172.21.15.62:0/4084979036 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc1d400d040 con 0x555faf114150 2024-09-10T05:37:34.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.514+0000 7fc1df7149c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:37:34.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.514+0000 7fc1df7149c0 20 zone default found 2024-09-10T05:37:34.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.514+0000 7fc1df7149c0 4 Realm: () 2024-09-10T05:37:34.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.514+0000 7fc1df7149c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:37:34.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.514+0000 7fc1df7149c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:37:34.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.514+0000 7fc1df7149c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:37:34.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.514+0000 7fc1df7149c0 20 zonegroup default 2024-09-10T05:37:34.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.514+0000 7fc1df7149c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.514+0000 7fc1df7149c0 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555faf117150 con 0x7fc1d0113020 2024-09-10T05:37:34.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.514+0000 7fc1dda1b640 1 -- 172.21.15.62:0/4084979036 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc1d800a4d0 con 0x7fc1d0113020 2024-09-10T05:37:34.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.514+0000 7fc1df7149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:34.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.514+0000 7fc1df7149c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.514+0000 7fc1df7149c0 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555faf11abd0 con 0x555faf114150 2024-09-10T05:37:34.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.514+0000 7fc1dca19640 1 -- 172.21.15.62:0/4084979036 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc1d400d040 con 0x555faf114150 2024-09-10T05:37:34.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.518+0000 7fc1df7149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:34.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.518+0000 7fc1df7149c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.518+0000 7fc1df7149c0 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555faf11b080 con 0x555faf114150 2024-09-10T05:37:34.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.518+0000 7fc1dca19640 1 -- 172.21.15.62:0/4084979036 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc1d400d040 con 0x555faf114150 2024-09-10T05:37:34.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.518+0000 7fc1df7149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:34.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.518+0000 7fc1df7149c0 20 started sync module instance, tier type = 2024-09-10T05:37:34.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.518+0000 7fc1df7149c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:37:34.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.518+0000 7fc1df7149c0 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555faf1199d0 con 0x555faf110920 2024-09-10T05:37:34.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.518+0000 7fc1dd21a640 1 -- 172.21.15.62:0/4084979036 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1d00bc580 con 0x555faf110920 2024-09-10T05:37:34.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.518+0000 7fc1df7149c0 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93869447421376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555faf1199d0 con 0x555faf110920 2024-09-10T05:37:34.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.518+0000 7fc1df7149c0 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555faf11b990 con 0x555faf10c4a0 2024-09-10T05:37:34.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.522+0000 7fc1dda1b640 1 -- 172.21.15.62:0/4084979036 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1d800a4d0 con 0x555faf10c4a0 2024-09-10T05:37:34.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.522+0000 7fc1df7149c0 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93869447427296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555faf11c1e0 con 0x555faf10c4a0 2024-09-10T05:37:34.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.522+0000 7fc1df7149c0 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555faf11ca70 con 0x555faf110920 2024-09-10T05:37:34.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.522+0000 7fc1dd21a640 1 -- 172.21.15.62:0/4084979036 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 93869447421376] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1d00bc580 con 0x555faf110920 2024-09-10T05:37:34.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.522+0000 7fc1dda1b640 1 -- 172.21.15.62:0/4084979036 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93869447427296] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1d800a4d0 con 0x555faf10c4a0 2024-09-10T05:37:34.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.522+0000 7fc1dd21a640 1 -- 172.21.15.62:0/4084979036 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1d00bc580 con 0x555faf110920 2024-09-10T05:37:34.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.522+0000 7fc1df7149c0 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93869447419168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555faf11c1e0 con 0x555faf110920 2024-09-10T05:37:34.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.522+0000 7fc1df7149c0 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555faf11d310 con 0x7fc1d0113020 2024-09-10T05:37:34.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.522+0000 7fc1dda1b640 1 -- 172.21.15.62:0/4084979036 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1d800a4d0 con 0x7fc1d0113020 2024-09-10T05:37:34.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.522+0000 7fc1df7149c0 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93869447433824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555faf11c1e0 con 0x7fc1d0113020 2024-09-10T05:37:34.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.522+0000 7fc1df7149c0 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555faf11dd90 con 0x555faf110920 2024-09-10T05:37:34.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.526+0000 7fc1dd21a640 1 -- 172.21.15.62:0/4084979036 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93869447419168] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1d00bc580 con 0x555faf110920 2024-09-10T05:37:34.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.526+0000 7fc1dda1b640 1 -- 172.21.15.62:0/4084979036 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93869447433824] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1d800a4d0 con 0x7fc1d0113020 2024-09-10T05:37:34.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.526+0000 7fc1dd21a640 1 -- 172.21.15.62:0/4084979036 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1d00bc580 con 0x555faf110920 2024-09-10T05:37:34.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.526+0000 7fc1df7149c0 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93869447434880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555faf11bd30 con 0x555faf110920 2024-09-10T05:37:34.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.526+0000 7fc1df7149c0 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555faf11e660 con 0x555faf114150 2024-09-10T05:37:34.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.526+0000 7fc1dca19640 1 -- 172.21.15.62:0/4084979036 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1d400d040 con 0x555faf114150 2024-09-10T05:37:34.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.526+0000 7fc1df7149c0 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93869447438768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555faf11bd30 con 0x555faf114150 2024-09-10T05:37:34.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.526+0000 7fc1df7149c0 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555faf11f0a0 con 0x555faf114150 2024-09-10T05:37:34.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.530+0000 7fc1dca19640 1 -- 172.21.15.62:0/4084979036 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93869447438768] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1d400d040 con 0x555faf114150 2024-09-10T05:37:34.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.530+0000 7fc1dd21a640 1 -- 172.21.15.62:0/4084979036 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 93869447434880] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1d00bc580 con 0x555faf110920 2024-09-10T05:37:34.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.530+0000 7fc1dca19640 1 -- 172.21.15.62:0/4084979036 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1d400d040 con 0x555faf114150 2024-09-10T05:37:34.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.530+0000 7fc1df7149c0 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93869447436448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555faf11ebf0 con 0x555faf114150 2024-09-10T05:37:34.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.530+0000 7fc1df7149c0 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555faf11f940 con 0x7fc1d0113020 2024-09-10T05:37:34.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.530+0000 7fc1dca19640 1 -- 172.21.15.62:0/4084979036 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93869447436448] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1d400d040 con 0x555faf114150 2024-09-10T05:37:34.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.530+0000 7fc1dda1b640 1 -- 172.21.15.62:0/4084979036 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1d800a4d0 con 0x7fc1d0113020 2024-09-10T05:37:34.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.530+0000 7fc1df7149c0 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93869447439824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555faf11ebf0 con 0x7fc1d0113020 2024-09-10T05:37:34.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.530+0000 7fc1df7149c0 20 add_watcher() i=0 2024-09-10T05:37:34.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.530+0000 7fc1df7149c0 20 add_watcher() i=1 2024-09-10T05:37:34.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.530+0000 7fc1df7149c0 20 add_watcher() i=2 2024-09-10T05:37:34.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.530+0000 7fc1df7149c0 20 add_watcher() i=3 2024-09-10T05:37:34.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.530+0000 7fc1df7149c0 20 add_watcher() i=4 2024-09-10T05:37:34.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.530+0000 7fc1df7149c0 20 add_watcher() i=5 2024-09-10T05:37:34.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.530+0000 7fc1df7149c0 20 add_watcher() i=6 2024-09-10T05:37:34.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.530+0000 7fc1dda1b640 1 -- 172.21.15.62:0/4084979036 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93869447439824] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1d800a4d0 con 0x7fc1d0113020 2024-09-10T05:37:34.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.530+0000 7fc1df7149c0 20 add_watcher() i=7 2024-09-10T05:37:34.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.530+0000 7fc1df7149c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:37:34.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.530+0000 7fc1df7149c0 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555faf122a30 con 0x555faf10c4a0 2024-09-10T05:37:34.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.530+0000 7fc1dda1b640 1 -- 172.21.15.62:0/4084979036 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc1d800a4d0 con 0x555faf10c4a0 2024-09-10T05:37:34.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.530+0000 7fc1df7149c0 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93869447443600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555faf11ff50 con 0x555faf10c4a0 2024-09-10T05:37:34.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.534+0000 7fc1dda1b640 1 -- 172.21.15.62:0/4084979036 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93869447443600] v32'212 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc1d800a4d0 con 0x555faf10c4a0 2024-09-10T05:37:34.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.534+0000 7fc093fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:37:34.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.534+0000 7fc1df7149c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:37:34.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.534+0000 7fc1df7149c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:37:34.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.534+0000 7fc1df7149c0 5 note: GC not initialized 2024-09-10T05:37:34.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.534+0000 7fc092fe5640 20 reqs_thread_entry: start 2024-09-10T05:37:34.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.534+0000 7fc1df7149c0 20 init_complete bucket index max shards: 11 2024-09-10T05:37:34.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.534+0000 7fc1df7149c0 20 Filter name: none 2024-09-10T05:37:34.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.534+0000 7fc090fe1640 20 reqs_thread_entry: start 2024-09-10T05:37:34.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.534+0000 7fc1df7149c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.534+0000 7fc1df7149c0 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555faf145820 con 0x555faf10c4a0 2024-09-10T05:37:34.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.534+0000 7fc1dda1b640 1 -- 172.21.15.62:0/4084979036 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc1d800a4d0 con 0x555faf10c4a0 2024-09-10T05:37:34.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.534+0000 7fc1df7149c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:37:34.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.534+0000 7fc1df7149c0 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555faf146da0 con 0x555faf114150 2024-09-10T05:37:34.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.534+0000 7fc1dca19640 1 -- 172.21.15.62:0/4084979036 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv30 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7fc1d400d040 con 0x555faf114150 2024-09-10T05:37:34.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.538+0000 7fc093fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:37:34.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.538+0000 7fc1df7149c0 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93869447443600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555faf145140 con 0x555faf10c4a0 2024-09-10T05:37:34.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.538+0000 7fc1dda1b640 1 -- 172.21.15.62:0/4084979036 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93869447443600] v32'213 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc1d800a4d0 con 0x555faf10c4a0 2024-09-10T05:37:34.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.538+0000 7fc1df7149c0 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93869447421376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555faf11f490 con 0x555faf110920 2024-09-10T05:37:34.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.542+0000 7fc1dd21a640 1 -- 172.21.15.62:0/4084979036 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93869447421376] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1d00bc580 con 0x555faf110920 2024-09-10T05:37:34.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.542+0000 7fc1df7149c0 20 remove_watcher() i=0 2024-09-10T05:37:34.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.542+0000 7fc1df7149c0 2 removed watcher, disabling cache 2024-09-10T05:37:34.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.542+0000 7fc1df7149c0 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93869447427296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555faf119dc0 con 0x555faf10c4a0 2024-09-10T05:37:34.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.542+0000 7fc1dda1b640 1 -- 172.21.15.62:0/4084979036 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93869447427296] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1d800a4d0 con 0x555faf10c4a0 2024-09-10T05:37:34.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.542+0000 7fc1df7149c0 20 remove_watcher() i=1 2024-09-10T05:37:34.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.542+0000 7fc1df7149c0 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93869447419168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555faf119dc0 con 0x555faf110920 2024-09-10T05:37:34.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.546+0000 7fc1dd21a640 1 -- 172.21.15.62:0/4084979036 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93869447419168] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1d00bc580 con 0x555faf110920 2024-09-10T05:37:34.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.546+0000 7fc1df7149c0 20 remove_watcher() i=2 2024-09-10T05:37:34.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.546+0000 7fc1df7149c0 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93869447433824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555faf119520 con 0x7fc1d0113020 2024-09-10T05:37:34.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.546+0000 7fc1dda1b640 1 -- 172.21.15.62:0/4084979036 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93869447433824] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1d800a4d0 con 0x7fc1d0113020 2024-09-10T05:37:34.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.546+0000 7fc1df7149c0 20 remove_watcher() i=3 2024-09-10T05:37:34.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.546+0000 7fc1df7149c0 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93869447434880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555faf119dc0 con 0x555faf110920 2024-09-10T05:37:34.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.550+0000 7fc1dd21a640 1 -- 172.21.15.62:0/4084979036 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93869447434880] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1d00bc580 con 0x555faf110920 2024-09-10T05:37:34.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.550+0000 7fc1df7149c0 20 remove_watcher() i=4 2024-09-10T05:37:34.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.550+0000 7fc1df7149c0 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93869447438768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555faf119520 con 0x555faf114150 2024-09-10T05:37:34.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.550+0000 7fc1dca19640 1 -- 172.21.15.62:0/4084979036 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93869447438768] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1d400d040 con 0x555faf114150 2024-09-10T05:37:34.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.550+0000 7fc1df7149c0 20 remove_watcher() i=5 2024-09-10T05:37:34.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.550+0000 7fc1df7149c0 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93869447436448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555faf119dc0 con 0x555faf114150 2024-09-10T05:37:34.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.550+0000 7fc1dca19640 1 -- 172.21.15.62:0/4084979036 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93869447436448] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1d400d040 con 0x555faf114150 2024-09-10T05:37:34.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.550+0000 7fc1df7149c0 20 remove_watcher() i=6 2024-09-10T05:37:34.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.550+0000 7fc1df7149c0 1 -- 172.21.15.62:0/4084979036 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93869447439824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555faf11e1b0 con 0x7fc1d0113020 2024-09-10T05:37:34.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.554+0000 7fc1dda1b640 1 -- 172.21.15.62:0/4084979036 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93869447439824] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1d800a4d0 con 0x7fc1d0113020 2024-09-10T05:37:34.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.554+0000 7fc1df7149c0 20 remove_watcher() i=7 2024-09-10T05:37:34.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.554+0000 7fc1df7149c0 1 -- 172.21.15.62:0/4084979036 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x555faf110920 msgr2=0x555faf112d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.554+0000 7fc1df7149c0 1 --2- 172.21.15.62:0/4084979036 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x555faf110920 0x555faf112d10 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.554+0000 7fc1df7149c0 1 -- 172.21.15.62:0/4084979036 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x555faf10c4a0 msgr2=0x555faf10e930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.554+0000 7fc1df7149c0 1 --2- 172.21.15.62:0/4084979036 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x555faf10c4a0 0x555faf10e930 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.554+0000 7fc1df7149c0 1 -- 172.21.15.62:0/4084979036 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fc1d0113020 msgr2=0x7fc1d0109ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.554+0000 7fc1df7149c0 1 --2- 172.21.15.62:0/4084979036 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fc1d0113020 0x7fc1d0109ab0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.554+0000 7fc1df7149c0 1 -- 172.21.15.62:0/4084979036 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x555faf114150 msgr2=0x555faf116540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.554+0000 7fc1df7149c0 1 --2- 172.21.15.62:0/4084979036 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x555faf114150 0x555faf116540 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.554+0000 7fc1df7149c0 1 -- 172.21.15.62:0/4084979036 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc0a8039a20 msgr2=0x7fc0a803bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.554+0000 7fc1df7149c0 1 --2- 172.21.15.62:0/4084979036 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc0a8039a20 0x7fc0a803bee0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x555faf0db6c0 tx=0x7fc1d4011000 comp rx=0 tx=0).stop 2024-09-10T05:37:34.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.554+0000 7fc1df7149c0 1 -- 172.21.15.62:0/4084979036 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555faf0fa200 msgr2=0x555faf101520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.554+0000 7fc1df7149c0 1 --2- 172.21.15.62:0/4084979036 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555faf0fa200 0x555faf101520 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fc1d00caec0 tx=0x7fc1d00cadf0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.554+0000 7fc1dda1b640 1 -- 172.21.15.62:0/4084979036 reap_dead start 2024-09-10T05:37:34.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.554+0000 7fc1dda1b640 1 -- 172.21.15.62:0/4084979036 reap_dead start 2024-09-10T05:37:34.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.554+0000 7fc1df7149c0 1 -- 172.21.15.62:0/4084979036 shutdown_connections 2024-09-10T05:37:34.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.554+0000 7fc1df7149c0 1 -- 172.21.15.62:0/4084979036 >> 172.21.15.62:0/4084979036 conn(0x555faf0f6630 msgr2=0x555faf0f4840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:34.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.554+0000 7fc1df7149c0 1 -- 172.21.15.62:0/4084979036 shutdown_connections 2024-09-10T05:37:34.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.554+0000 7fc1df7149c0 1 -- 172.21.15.62:0/4084979036 wait complete. 2024-09-10T05:37:34.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.554+0000 7fc1df7149c0 1 -- 172.21.15.62:0/1786718470 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc0b4039a70 msgr2=0x7fc0b403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.554+0000 7fc1df7149c0 1 --2- 172.21.15.62:0/1786718470 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc0b4039a70 0x7fc0b403bf30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x555faf0d10e0 tx=0x7fc1d4006000 comp rx=0 tx=0).stop 2024-09-10T05:37:34.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.554+0000 7fc1df7149c0 1 -- 172.21.15.62:0/1786718470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555faf0edaa0 msgr2=0x555faf0edec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.554+0000 7fc1df7149c0 1 --2- 172.21.15.62:0/1786718470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555faf0edaa0 0x555faf0edec0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fc1d00aa780 tx=0x7fc1d00bcea0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.554+0000 7fc1df7149c0 1 -- 172.21.15.62:0/1786718470 shutdown_connections 2024-09-10T05:37:34.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.554+0000 7fc1df7149c0 1 --2- 172.21.15.62:0/1786718470 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc0b4039a70 0x7fc0b403bf30 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.554+0000 7fc1df7149c0 1 --2- 172.21.15.62:0/1786718470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555faf0edaa0 0x555faf0edec0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.554+0000 7fc1df7149c0 1 -- 172.21.15.62:0/1786718470 >> 172.21.15.62:0/1786718470 conn(0x555faf0e3450 msgr2=0x555faf0e3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:34.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.554+0000 7fc1df7149c0 1 -- 172.21.15.62:0/1786718470 shutdown_connections 2024-09-10T05:37:34.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.554+0000 7fc1df7149c0 1 -- 172.21.15.62:0/1786718470 wait complete. 2024-09-10T05:37:34.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.554+0000 7fc1df7149c0 1 -- 172.21.15.62:0/681605852 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x555faf0d80a0 msgr2=0x555faf0da490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.554+0000 7fc1df7149c0 1 --2- 172.21.15.62:0/681605852 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x555faf0d80a0 0x555faf0da490 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.554+0000 7fc1df7149c0 1 -- 172.21.15.62:0/681605852 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x555faefe00b0 msgr2=0x555faf0d6dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.554+0000 7fc1df7149c0 1 --2- 172.21.15.62:0/681605852 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x555faefe00b0 0x555faf0d6dd0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.554+0000 7fc1df7149c0 1 -- 172.21.15.62:0/681605852 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x555faf0dc850 msgr2=0x555faf0dec40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.554+0000 7fc1df7149c0 1 --2- 172.21.15.62:0/681605852 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x555faf0dc850 0x555faf0dec40 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.554+0000 7fc1df7149c0 1 -- 172.21.15.62:0/681605852 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc0c4039a70 msgr2=0x7fc0c403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.554+0000 7fc1df7149c0 1 --2- 172.21.15.62:0/681605852 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc0c4039a70 0x7fc0c403bf30 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc1d4001e60 tx=0x7fc1d40013e0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.554+0000 7fc1df7149c0 1 -- 172.21.15.62:0/681605852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555faefdcf70 msgr2=0x555faf0cfc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.554+0000 7fc1df7149c0 1 --2- 172.21.15.62:0/681605852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555faefdcf70 0x555faf0cfc60 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0018f70 tx=0x7fc1d00180e0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.554+0000 7fc1dda1b640 1 -- 172.21.15.62:0/681605852 reap_dead start 2024-09-10T05:37:34.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.554+0000 7fc1df7149c0 1 -- 172.21.15.62:0/681605852 shutdown_connections 2024-09-10T05:37:34.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.554+0000 7fc1df7149c0 1 -- 172.21.15.62:0/681605852 >> 172.21.15.62:0/681605852 conn(0x555faefd8a90 msgr2=0x555faf0c2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:34.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.554+0000 7fc1df7149c0 1 -- 172.21.15.62:0/681605852 shutdown_connections 2024-09-10T05:37:34.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.554+0000 7fc1df7149c0 1 -- 172.21.15.62:0/681605852 wait complete. 2024-09-10T05:37:34.570 INFO:teuthology.orchestra.run.smithi062.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-10T05:37:34.570 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T05:37:34.570 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-10T05:37:34.570 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-10T05:37:34.571 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2024-09-10T05:37:34.646 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:37:34.646 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:37:34.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.642+0000 7fb5886469c0 1 Processor -- start 2024-09-10T05:37:34.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.642+0000 7fb5886469c0 1 -- start start 2024-09-10T05:37:34.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.642+0000 7fb5886469c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5614366ff1f0 0x5614366ff5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.642+0000 7fb5886469c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5614365b19c0 con 0x561436702330 2024-09-10T05:37:34.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.642+0000 7fb5886469c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x5614366016d0 con 0x5614366ff1f0 2024-09-10T05:37:34.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.642+0000 7fb58614c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5614366ff1f0 0x5614366ff5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.642+0000 7fb58614c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5614366ff1f0 0x5614366ff5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:58240/0 (socket says 172.21.15.62:58240) 2024-09-10T05:37:34.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.642+0000 7fb58614c640 1 -- 172.21.15.62:0/542456609 learned_addr learned my addr 172.21.15.62:0/542456609 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:34.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.642+0000 7fb58614c640 1 -- 172.21.15.62:0/542456609 >> v1:172.21.15.2:6789/0 conn(0x561436702330 legacy=0x561436704720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.642+0000 7fb58614c640 1 -- 172.21.15.62:0/542456609 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614365a5ca0 con 0x5614366ff1f0 2024-09-10T05:37:34.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.646+0000 7fb58614c640 1 --2- 172.21.15.62:0/542456609 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614366ff1f0 0x5614366ff5d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fb57800a5c0 tx=0x7fb57801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d23af13aee83753 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.646+0000 7fb58514a640 1 -- 172.21.15.62:0/542456609 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5780a6070 con 0x5614366ff1f0 2024-09-10T05:37:34.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.646+0000 7fb58514a640 1 -- 172.21.15.62:0/542456609 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5780af070 con 0x5614366ff1f0 2024-09-10T05:37:34.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.646+0000 7fb58514a640 1 -- 172.21.15.62:0/542456609 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5780aa5c0 con 0x5614366ff1f0 2024-09-10T05:37:34.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.646+0000 7fb5886469c0 1 -- 172.21.15.62:0/542456609 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614366ff1f0 msgr2=0x5614366ff5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.646+0000 7fb5886469c0 1 --2- 172.21.15.62:0/542456609 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614366ff1f0 0x5614366ff5d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fb57800a5c0 tx=0x7fb57801b340 comp rx=0 tx=0).stop 2024-09-10T05:37:34.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.646+0000 7fb5886469c0 1 -- 172.21.15.62:0/542456609 shutdown_connections 2024-09-10T05:37:34.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.646+0000 7fb5886469c0 1 --2- 172.21.15.62:0/542456609 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614366ff1f0 0x5614366ff5d0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.646+0000 7fb5886469c0 1 -- 172.21.15.62:0/542456609 >> 172.21.15.62:0/542456609 conn(0x561436672b00 msgr2=0x561436672f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:34.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.646+0000 7fb5886469c0 1 -- 172.21.15.62:0/542456609 shutdown_connections 2024-09-10T05:37:34.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.646+0000 7fb5886469c0 1 -- 172.21.15.62:0/542456609 wait complete. 2024-09-10T05:37:34.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.662+0000 7fb5886469c0 1 Processor -- start 2024-09-10T05:37:34.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.662+0000 7fb5886469c0 1 -- start start 2024-09-10T05:37:34.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.662+0000 7fb5886469c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614366ff1f0 0x5614367ea8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.662+0000 7fb5886469c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561436605680 con 0x5614366ff1f0 2024-09-10T05:37:34.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.662+0000 7fb58614c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614366ff1f0 0x5614367ea8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.662+0000 7fb58614c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614366ff1f0 0x5614367ea8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:58244/0 (socket says 172.21.15.62:58244) 2024-09-10T05:37:34.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.662+0000 7fb58614c640 1 -- 172.21.15.62:0/4289385929 learned_addr learned my addr 172.21.15.62:0/4289385929 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:34.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.662+0000 7fb58614c640 1 -- 172.21.15.62:0/4289385929 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561436580da0 con 0x5614366ff1f0 2024-09-10T05:37:34.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.662+0000 7fb58614c640 1 --2- 172.21.15.62:0/4289385929 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614366ff1f0 0x5614367ea8d0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fb5780ac040 tx=0x7fb578003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45d49ac87aaaa5af server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.662+0000 7fb474608640 1 -- 172.21.15.62:0/4289385929 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5780aa970 con 0x5614366ff1f0 2024-09-10T05:37:34.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.662+0000 7fb474608640 1 -- 172.21.15.62:0/4289385929 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5780aab10 con 0x5614366ff1f0 2024-09-10T05:37:34.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.662+0000 7fb474608640 1 -- 172.21.15.62:0/4289385929 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5780aae30 con 0x5614366ff1f0 2024-09-10T05:37:34.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.666+0000 7fb5886469c0 1 -- 172.21.15.62:0/4289385929 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614366ff1f0 msgr2=0x5614367ea8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.666+0000 7fb5886469c0 1 --2- 172.21.15.62:0/4289385929 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614366ff1f0 0x5614367ea8d0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fb5780ac040 tx=0x7fb578003030 comp rx=0 tx=0).stop 2024-09-10T05:37:34.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.666+0000 7fb5886469c0 1 -- 172.21.15.62:0/4289385929 shutdown_connections 2024-09-10T05:37:34.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.666+0000 7fb5886469c0 1 --2- 172.21.15.62:0/4289385929 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614366ff1f0 0x5614367ea8d0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.666+0000 7fb5886469c0 1 -- 172.21.15.62:0/4289385929 >> 172.21.15.62:0/4289385929 conn(0x561436672b00 msgr2=0x5614367e6550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:34.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.666+0000 7fb5886469c0 1 -- 172.21.15.62:0/4289385929 shutdown_connections 2024-09-10T05:37:34.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.666+0000 7fb5886469c0 1 -- 172.21.15.62:0/4289385929 wait complete. 2024-09-10T05:37:34.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.666+0000 7fb5886469c0 1 Processor -- start 2024-09-10T05:37:34.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.666+0000 7fb5886469c0 1 -- start start 2024-09-10T05:37:34.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.666+0000 7fb5886469c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614366ff1f0 0x5614367f1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.666+0000 7fb5886469c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5614365a7a50 con 0x5614366ff1f0 2024-09-10T05:37:34.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.666+0000 7fb58614c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614366ff1f0 0x5614367f1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.666+0000 7fb58614c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614366ff1f0 0x5614367f1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:58260/0 (socket says 172.21.15.62:58260) 2024-09-10T05:37:34.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.666+0000 7fb58614c640 1 -- 172.21.15.62:0/1886490576 learned_addr learned my addr 172.21.15.62:0/1886490576 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:34.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.666+0000 7fb58614c640 1 -- 172.21.15.62:0/1886490576 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614367f2390 con 0x5614366ff1f0 2024-09-10T05:37:34.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.666+0000 7fb58614c640 1 --2- 172.21.15.62:0/1886490576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614366ff1f0 0x5614367f1e30 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fb57801b170 tx=0x7fb5780180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.666+0000 7fb472e05640 1 -- 172.21.15.62:0/1886490576 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5780c6690 con 0x5614366ff1f0 2024-09-10T05:37:34.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.666+0000 7fb472e05640 1 -- 172.21.15.62:0/1886490576 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5780cc070 con 0x5614366ff1f0 2024-09-10T05:37:34.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.666+0000 7fb5886469c0 1 -- 172.21.15.62:0/1886490576 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5614367f2620 con 0x5614366ff1f0 2024-09-10T05:37:34.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.666+0000 7fb472e05640 1 -- 172.21.15.62:0/1886490576 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5780c6960 con 0x5614366ff1f0 2024-09-10T05:37:34.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.666+0000 7fb5886469c0 1 -- 172.21.15.62:0/1886490576 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614367f2fd0 con 0x5614366ff1f0 2024-09-10T05:37:34.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.670+0000 7fb472e05640 1 -- 172.21.15.62:0/1886490576 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb5780c6b00 con 0x5614366ff1f0 2024-09-10T05:37:34.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.670+0000 7fb472e05640 1 --2- 172.21.15.62:0/1886490576 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb46c039ac0 0x7fb46c03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.670+0000 7fb472e05640 1 -- 172.21.15.62:0/1886490576 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7fb5780ebbc0 con 0x5614366ff1f0 2024-09-10T05:37:34.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.670+0000 7fb58594b640 1 --2- 172.21.15.62:0/1886490576 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb46c039ac0 0x7fb46c03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.670+0000 7fb5886469c0 1 --2- 172.21.15.62:0/1886490576 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x561436702330 0x5614367f8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.670+0000 7fb5886469c0 1 -- 172.21.15.62:0/1886490576 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5614367f94e0 con 0x561436702330 2024-09-10T05:37:34.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.670+0000 7fb58694d640 1 --2- 172.21.15.62:0/1886490576 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x561436702330 0x5614367f8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.670+0000 7fb58594b640 1 --2- 172.21.15.62:0/1886490576 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb46c039ac0 0x7fb46c03bf80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb57c001e60 tx=0x7fb57c0013e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.670+0000 7fb58694d640 1 --2- 172.21.15.62:0/1886490576 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x561436702330 0x5614367f8fa0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.670+0000 7fb58694d640 1 -- 172.21.15.62:0/1886490576 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb58000a4d0 con 0x561436702330 2024-09-10T05:37:34.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.670+0000 7fb5886469c0 1 --2- 172.21.15.62:0/1886490576 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5614367fa240 0x5614367fc630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.670+0000 7fb5886469c0 1 -- 172.21.15.62:0/1886490576 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5614367fcc40 con 0x5614367fa240 2024-09-10T05:37:34.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.670+0000 7fb58614c640 1 --2- 172.21.15.62:0/1886490576 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5614367fa240 0x5614367fc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.670+0000 7fb58614c640 1 --2- 172.21.15.62:0/1886490576 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5614367fa240 0x5614367fc630 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.670+0000 7fb58614c640 1 -- 172.21.15.62:0/1886490576 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb5780cf370 con 0x5614367fa240 2024-09-10T05:37:34.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.670+0000 7fb5886469c0 1 --2- 172.21.15.62:0/1886490576 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5614367fea00 0x561436800df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.670+0000 7fb5886469c0 1 -- 172.21.15.62:0/1886490576 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5614368014e0 con 0x5614367fea00 2024-09-10T05:37:34.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.674+0000 7fb58594b640 1 --2- 172.21.15.62:0/1886490576 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5614367fea00 0x561436800df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.674+0000 7fb58594b640 1 --2- 172.21.15.62:0/1886490576 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5614367fea00 0x561436800df0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.674+0000 7fb58594b640 1 -- 172.21.15.62:0/1886490576 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb57c00d040 con 0x5614367fea00 2024-09-10T05:37:34.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.674+0000 7fb5886469c0 1 -- 172.21.15.62:0/1886490576 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5614367fd8a0 con 0x5614367fa240 2024-09-10T05:37:34.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.674+0000 7fb58614c640 1 -- 172.21.15.62:0/1886490576 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb5780cf370 con 0x5614367fa240 2024-09-10T05:37:34.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.674+0000 7fb5886469c0 1 -- 172.21.15.62:0/1886490576 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5614367fdd40 con 0x5614367fea00 2024-09-10T05:37:34.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.674+0000 7fb58594b640 1 -- 172.21.15.62:0/1886490576 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb57c00d040 con 0x5614367fea00 2024-09-10T05:37:34.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.674+0000 7fb5886469c0 1 Processor -- start 2024-09-10T05:37:34.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.674+0000 7fb5886469c0 1 -- start start 2024-09-10T05:37:34.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.674+0000 7fb5886469c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56143680fb90 0x56143680ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.674+0000 7fb5886469c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561436612450 con 0x56143680fb90 2024-09-10T05:37:34.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.674+0000 7fb58614c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56143680fb90 0x56143680ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.674+0000 7fb58614c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56143680fb90 0x56143680ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:58274/0 (socket says 172.21.15.62:58274) 2024-09-10T05:37:34.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.674+0000 7fb58614c640 1 -- 172.21.15.62:0/4263105462 learned_addr learned my addr 172.21.15.62:0/4263105462 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:34.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.674+0000 7fb58614c640 1 -- 172.21.15.62:0/4263105462 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614368105f0 con 0x56143680fb90 2024-09-10T05:37:34.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.674+0000 7fb58614c640 1 --2- 172.21.15.62:0/4263105462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56143680fb90 0x56143680ffb0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fb578004ff0 tx=0x7fb5780c5e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.674+0000 7fb46bfff640 1 -- 172.21.15.62:0/4263105462 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5780d06e0 con 0x56143680fb90 2024-09-10T05:37:34.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.678+0000 7fb46bfff640 1 -- 172.21.15.62:0/4263105462 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5780d0880 con 0x56143680fb90 2024-09-10T05:37:34.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.678+0000 7fb5886469c0 1 -- 172.21.15.62:0/4263105462 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561436810e50 con 0x56143680fb90 2024-09-10T05:37:34.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.678+0000 7fb46bfff640 1 -- 172.21.15.62:0/4263105462 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5780b3940 con 0x56143680fb90 2024-09-10T05:37:34.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.678+0000 7fb5886469c0 1 -- 172.21.15.62:0/4263105462 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614368113c0 con 0x56143680fb90 2024-09-10T05:37:34.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.678+0000 7fb46bfff640 1 -- 172.21.15.62:0/4263105462 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb5780f2060 con 0x56143680fb90 2024-09-10T05:37:34.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.678+0000 7fb46bfff640 1 --2- 172.21.15.62:0/4263105462 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb460039ac0 0x7fb46003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.678+0000 7fb46bfff640 1 -- 172.21.15.62:0/4263105462 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7fb5780f5bd0 con 0x56143680fb90 2024-09-10T05:37:34.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.678+0000 7fb58594b640 1 --2- 172.21.15.62:0/4263105462 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb460039ac0 0x7fb46003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.678+0000 7fb5886469c0 1 Processor -- start 2024-09-10T05:37:34.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.678+0000 7fb5886469c0 1 -- start start 2024-09-10T05:37:34.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.678+0000 7fb58594b640 1 --2- 172.21.15.62:0/4263105462 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb460039ac0 0x7fb46003bf80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x5614367f3280 tx=0x7fb57c006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.678+0000 7fb5886469c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56143681c2f0 0x56143681c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.678+0000 7fb5886469c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5614367eb060 con 0x56143681c2f0 2024-09-10T05:37:34.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.678+0000 7fb58614c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56143681c2f0 0x56143681c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.678+0000 7fb58614c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56143681c2f0 0x56143681c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:58282/0 (socket says 172.21.15.62:58282) 2024-09-10T05:37:34.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.678+0000 7fb58614c640 1 -- 172.21.15.62:0/4053317782 learned_addr learned my addr 172.21.15.62:0/4053317782 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:34.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.678+0000 7fb58614c640 1 -- 172.21.15.62:0/4053317782 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56143681cca0 con 0x56143681c2f0 2024-09-10T05:37:34.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.678+0000 7fb58614c640 1 --2- 172.21.15.62:0/4053317782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56143681c2f0 0x56143681c6d0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fb5780ce040 tx=0x7fb5780b3ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fff3ea6b4d7a9e41 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.678+0000 7fb469ffb640 1 -- 172.21.15.62:0/4053317782 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb578102020 con 0x56143681c2f0 2024-09-10T05:37:34.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.678+0000 7fb469ffb640 1 -- 172.21.15.62:0/4053317782 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5780e7440 con 0x56143681c2f0 2024-09-10T05:37:34.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.678+0000 7fb469ffb640 1 -- 172.21.15.62:0/4053317782 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5780c7e00 con 0x56143681c2f0 2024-09-10T05:37:34.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.682+0000 7fb5886469c0 1 -- 172.21.15.62:0/4053317782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56143681c2f0 msgr2=0x56143681c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.682+0000 7fb5886469c0 1 --2- 172.21.15.62:0/4053317782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56143681c2f0 0x56143681c6d0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fb5780ce040 tx=0x7fb5780b3ae0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.682+0000 7fb5886469c0 1 -- 172.21.15.62:0/4053317782 shutdown_connections 2024-09-10T05:37:34.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.682+0000 7fb5886469c0 1 --2- 172.21.15.62:0/4053317782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56143681c2f0 0x56143681c6d0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.682+0000 7fb5886469c0 1 -- 172.21.15.62:0/4053317782 >> 172.21.15.62:0/4053317782 conn(0x561436818720 msgr2=0x561436816960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:34.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.682+0000 7fb5886469c0 1 -- 172.21.15.62:0/4053317782 shutdown_connections 2024-09-10T05:37:34.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.682+0000 7fb5886469c0 1 -- 172.21.15.62:0/4053317782 wait complete. 2024-09-10T05:37:34.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.682+0000 7fb5886469c0 1 Processor -- start 2024-09-10T05:37:34.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.682+0000 7fb5886469c0 1 -- start start 2024-09-10T05:37:34.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.682+0000 7fb5886469c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56143681c2f0 0x561436823610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.682+0000 7fb5886469c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56143681d180 con 0x56143681c2f0 2024-09-10T05:37:34.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.682+0000 7fb58614c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56143681c2f0 0x561436823610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.682+0000 7fb58614c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56143681c2f0 0x561436823610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:58298/0 (socket says 172.21.15.62:58298) 2024-09-10T05:37:34.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.682+0000 7fb58614c640 1 -- 172.21.15.62:0/3397587302 learned_addr learned my addr 172.21.15.62:0/3397587302 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:34.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.682+0000 7fb58614c640 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561436823b70 con 0x56143681c2f0 2024-09-10T05:37:34.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.682+0000 7fb58614c640 1 --2- 172.21.15.62:0/3397587302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56143681c2f0 0x561436823610 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fb5780c6fd0 tx=0x7fb5780fc000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.682+0000 7fb457fff640 1 -- 172.21.15.62:0/3397587302 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb578116070 con 0x56143681c2f0 2024-09-10T05:37:34.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.682+0000 7fb457fff640 1 -- 172.21.15.62:0/3397587302 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5780e7440 con 0x56143681c2f0 2024-09-10T05:37:34.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.682+0000 7fb457fff640 1 -- 172.21.15.62:0/3397587302 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5780c7e00 con 0x56143681c2f0 2024-09-10T05:37:34.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.682+0000 7fb5886469c0 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561436823b70 con 0x56143681c2f0 2024-09-10T05:37:34.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.682+0000 7fb5886469c0 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561436823b70 con 0x56143681c2f0 2024-09-10T05:37:34.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.682+0000 7fb5886469c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.682+0000 7fb457fff640 1 -- 172.21.15.62:0/3397587302 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb578119070 con 0x56143681c2f0 2024-09-10T05:37:34.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.686+0000 7fb457fff640 1 --2- 172.21.15.62:0/3397587302 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb4500399d0 0x7fb45003be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.686+0000 7fb457fff640 1 -- 172.21.15.62:0/3397587302 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7fb57810e050 con 0x56143681c2f0 2024-09-10T05:37:34.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.686+0000 7fb58594b640 1 --2- 172.21.15.62:0/3397587302 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb4500399d0 0x7fb45003be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.686+0000 7fb5886469c0 1 --2- 172.21.15.62:0/3397587302 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56143682e3b0 0x561436830840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.686+0000 7fb5886469c0 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561436830f90 con 0x56143682e3b0 2024-09-10T05:37:34.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.686+0000 7fb58694d640 1 --2- 172.21.15.62:0/3397587302 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56143682e3b0 0x561436830840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.686+0000 7fb58594b640 1 --2- 172.21.15.62:0/3397587302 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb4500399d0 0x7fb45003be90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x5614367fd870 tx=0x7fb57c011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.686+0000 7fb58694d640 1 --2- 172.21.15.62:0/3397587302 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56143682e3b0 0x561436830840 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.686+0000 7fb58694d640 1 -- 172.21.15.62:0/3397587302 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb58000a4d0 con 0x56143682e3b0 2024-09-10T05:37:34.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.686+0000 7fb5886469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:34.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.686+0000 7fb5886469c0 20 realm 2024-09-10T05:37:34.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.686+0000 7fb5886469c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.686+0000 7fb5886469c0 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56143682d7f0 con 0x56143682e3b0 2024-09-10T05:37:34.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.686+0000 7fb58694d640 1 -- 172.21.15.62:0/3397587302 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb58000a4d0 con 0x56143682e3b0 2024-09-10T05:37:34.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.686+0000 7fb5886469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:34.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.686+0000 7fb5886469c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:37:34.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.686+0000 7fb5886469c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.686+0000 7fb5886469c0 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561436831aa0 con 0x56143682e3b0 2024-09-10T05:37:34.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.686+0000 7fb58694d640 1 -- 172.21.15.62:0/3397587302 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb58000a4d0 con 0x56143682e3b0 2024-09-10T05:37:34.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.686+0000 7fb5886469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:34.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.686+0000 7fb5886469c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.686+0000 7fb5886469c0 1 --2- 172.21.15.62:0/3397587302 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561436832880 0x561436834c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.686+0000 7fb5886469c0 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561436835300 con 0x561436832880 2024-09-10T05:37:34.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.686+0000 7fb58614c640 1 --2- 172.21.15.62:0/3397587302 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561436832880 0x561436834c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.686+0000 7fb58614c640 1 --2- 172.21.15.62:0/3397587302 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561436832880 0x561436834c70 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.686+0000 7fb58614c640 1 -- 172.21.15.62:0/3397587302 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb578118030 con 0x561436832880 2024-09-10T05:37:34.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.686+0000 7fb5886469c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:37:34.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.686+0000 7fb5886469c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.686+0000 7fb5886469c0 1 --2- 172.21.15.62:0/3397587302 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5614368360b0 0x5614368384a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.686+0000 7fb5886469c0 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561436838af0 con 0x5614368360b0 2024-09-10T05:37:34.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.686+0000 7fb58594b640 1 --2- 172.21.15.62:0/3397587302 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5614368360b0 0x5614368384a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.690+0000 7fb58594b640 1 --2- 172.21.15.62:0/3397587302 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5614368360b0 0x5614368384a0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.690+0000 7fb58594b640 1 -- 172.21.15.62:0/3397587302 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb57c00d040 con 0x5614368360b0 2024-09-10T05:37:34.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.690+0000 7fb5886469c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:37:34.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.690+0000 7fb5886469c0 20 searching for the correct realm 2024-09-10T05:37:34.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.690+0000 7fb5886469c0 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56143683a3f0 con 0x5614368360b0 2024-09-10T05:37:34.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.690+0000 7fb58594b640 1 -- 172.21.15.62:0/3397587302 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb57c00d040 con 0x5614368360b0 2024-09-10T05:37:34.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.690+0000 7fb58594b640 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56143683a3f0 con 0x561436832880 2024-09-10T05:37:34.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.690+0000 7fb58614c640 1 -- 172.21.15.62:0/3397587302 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb578118030 con 0x561436832880 2024-09-10T05:37:34.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.690+0000 7fb58614c640 1 --2- 172.21.15.62:0/3397587302 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fb57811b060 0x7fb57810b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.690+0000 7fb58614c640 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56143683a3f0 con 0x7fb57811b060 2024-09-10T05:37:34.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.690+0000 7fb58694d640 1 --2- 172.21.15.62:0/3397587302 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fb57811b060 0x7fb57810b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.690+0000 7fb58694d640 1 --2- 172.21.15.62:0/3397587302 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fb57811b060 0x7fb57810b9d0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.690+0000 7fb58694d640 1 -- 172.21.15.62:0/3397587302 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb58000a4d0 con 0x7fb57811b060 2024-09-10T05:37:34.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.690+0000 7fb58694d640 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56143683a3f0 con 0x56143682e3b0 2024-09-10T05:37:34.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.690+0000 7fb58694d640 1 -- 172.21.15.62:0/3397587302 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb58000a4d0 con 0x56143682e3b0 2024-09-10T05:37:34.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.690+0000 7fb58694d640 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56143683a3f0 con 0x56143682e3b0 2024-09-10T05:37:34.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.690+0000 7fb58694d640 1 -- 172.21.15.62:0/3397587302 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb58000a4d0 con 0x56143682e3b0 2024-09-10T05:37:34.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.690+0000 7fb58694d640 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56143683a3f0 con 0x5614368360b0 2024-09-10T05:37:34.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.690+0000 7fb58594b640 1 -- 172.21.15.62:0/3397587302 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb57c00d040 con 0x5614368360b0 2024-09-10T05:37:34.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.690+0000 7fb58594b640 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56143683a3f0 con 0x56143682e3b0 2024-09-10T05:37:34.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.690+0000 7fb58694d640 1 -- 172.21.15.62:0/3397587302 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb58000a4d0 con 0x56143682e3b0 2024-09-10T05:37:34.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.690+0000 7fb58694d640 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56143683a3f0 con 0x561436832880 2024-09-10T05:37:34.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.694+0000 7fb58614c640 1 -- 172.21.15.62:0/3397587302 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb578118030 con 0x561436832880 2024-09-10T05:37:34.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.694+0000 7fb58614c640 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56143683a3f0 con 0x561436832880 2024-09-10T05:37:34.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.694+0000 7fb58614c640 1 -- 172.21.15.62:0/3397587302 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb578118030 con 0x561436832880 2024-09-10T05:37:34.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.694+0000 7fb58614c640 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56143683a3f0 con 0x56143682e3b0 2024-09-10T05:37:34.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.694+0000 7fb58694d640 1 -- 172.21.15.62:0/3397587302 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb58000a4d0 con 0x56143682e3b0 2024-09-10T05:37:34.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.694+0000 7fb58694d640 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56143683a3f0 con 0x7fb57811b060 2024-09-10T05:37:34.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.694+0000 7fb58694d640 1 -- 172.21.15.62:0/3397587302 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb58000a4d0 con 0x7fb57811b060 2024-09-10T05:37:34.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.694+0000 7fb58694d640 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56143683a3f0 con 0x56143682e3b0 2024-09-10T05:37:34.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.694+0000 7fb58694d640 1 -- 172.21.15.62:0/3397587302 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb58000a4d0 con 0x56143682e3b0 2024-09-10T05:37:34.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.694+0000 7fb58694d640 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56143683a3f0 con 0x7fb57811b060 2024-09-10T05:37:34.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.694+0000 7fb58694d640 1 -- 172.21.15.62:0/3397587302 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb58000a4d0 con 0x7fb57811b060 2024-09-10T05:37:34.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.694+0000 7fb58694d640 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56143683a3f0 con 0x561436832880 2024-09-10T05:37:34.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.694+0000 7fb58614c640 1 -- 172.21.15.62:0/3397587302 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb578118030 con 0x561436832880 2024-09-10T05:37:34.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.694+0000 7fb58614c640 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56143683a3f0 con 0x5614368360b0 2024-09-10T05:37:34.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.694+0000 7fb58594b640 1 -- 172.21.15.62:0/3397587302 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb57c00d040 con 0x5614368360b0 2024-09-10T05:37:34.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.694+0000 7fb58594b640 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56143683a3f0 con 0x56143682e3b0 2024-09-10T05:37:34.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.698+0000 7fb58694d640 1 -- 172.21.15.62:0/3397587302 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb58000a4d0 con 0x56143682e3b0 2024-09-10T05:37:34.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.698+0000 7fb58694d640 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56143683a3f0 con 0x561436832880 2024-09-10T05:37:34.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.698+0000 7fb58614c640 1 -- 172.21.15.62:0/3397587302 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb578118030 con 0x561436832880 2024-09-10T05:37:34.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.698+0000 7fb58614c640 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56143683a3f0 con 0x5614368360b0 2024-09-10T05:37:34.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.698+0000 7fb58594b640 1 -- 172.21.15.62:0/3397587302 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 32 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7fb57c00d040 con 0x5614368360b0 2024-09-10T05:37:34.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.698+0000 7fb58594b640 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56143683a3f0 con 0x56143682e3b0 2024-09-10T05:37:34.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.698+0000 7fb58694d640 1 -- 172.21.15.62:0/3397587302 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb58000a4d0 con 0x56143682e3b0 2024-09-10T05:37:34.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.698+0000 7fb58694d640 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56143683a3f0 con 0x56143682e3b0 2024-09-10T05:37:34.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.698+0000 7fb58694d640 1 -- 172.21.15.62:0/3397587302 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb58000a4d0 con 0x56143682e3b0 2024-09-10T05:37:34.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.698+0000 7fb58694d640 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56143683a3f0 con 0x56143682e3b0 2024-09-10T05:37:34.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.698+0000 7fb58694d640 1 -- 172.21.15.62:0/3397587302 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb58000a4d0 con 0x56143682e3b0 2024-09-10T05:37:34.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.698+0000 7fb58694d640 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56143683a3f0 con 0x5614368360b0 2024-09-10T05:37:34.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.698+0000 7fb58594b640 1 -- 172.21.15.62:0/3397587302 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb57c00d040 con 0x5614368360b0 2024-09-10T05:37:34.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.698+0000 7fb58594b640 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56143683a3f0 con 0x7fb57811b060 2024-09-10T05:37:34.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.698+0000 7fb58694d640 1 -- 172.21.15.62:0/3397587302 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb58000a4d0 con 0x7fb57811b060 2024-09-10T05:37:34.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.698+0000 7fb58694d640 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56143683a3f0 con 0x56143682e3b0 2024-09-10T05:37:34.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.698+0000 7fb58694d640 1 -- 172.21.15.62:0/3397587302 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb58000a4d0 con 0x56143682e3b0 2024-09-10T05:37:34.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.698+0000 7fb58694d640 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56143683a3f0 con 0x7fb57811b060 2024-09-10T05:37:34.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.698+0000 7fb58694d640 1 -- 172.21.15.62:0/3397587302 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb58000a4d0 con 0x7fb57811b060 2024-09-10T05:37:34.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.698+0000 7fb58694d640 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56143683a3f0 con 0x5614368360b0 2024-09-10T05:37:34.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.698+0000 7fb58594b640 1 -- 172.21.15.62:0/3397587302 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb57c00d040 con 0x5614368360b0 2024-09-10T05:37:34.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.698+0000 7fb58594b640 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56143683a3f0 con 0x7fb57811b060 2024-09-10T05:37:34.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.698+0000 7fb58694d640 1 -- 172.21.15.62:0/3397587302 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb58000a4d0 con 0x7fb57811b060 2024-09-10T05:37:34.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.698+0000 7fb58694d640 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56143683a3f0 con 0x561436832880 2024-09-10T05:37:34.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.702+0000 7fb58614c640 1 -- 172.21.15.62:0/3397587302 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb578118030 con 0x561436832880 2024-09-10T05:37:34.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.702+0000 7fb58614c640 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56143683a3f0 con 0x561436832880 2024-09-10T05:37:34.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.702+0000 7fb58614c640 1 -- 172.21.15.62:0/3397587302 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb578118030 con 0x561436832880 2024-09-10T05:37:34.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.702+0000 7fb58614c640 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56143683a3f0 con 0x5614368360b0 2024-09-10T05:37:34.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.702+0000 7fb58594b640 1 -- 172.21.15.62:0/3397587302 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb57c00d040 con 0x5614368360b0 2024-09-10T05:37:34.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.702+0000 7fb58594b640 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56143683a3f0 con 0x561436832880 2024-09-10T05:37:34.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.702+0000 7fb58614c640 1 -- 172.21.15.62:0/3397587302 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb578118030 con 0x561436832880 2024-09-10T05:37:34.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.702+0000 7fb58614c640 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56143683a3f0 con 0x561436832880 2024-09-10T05:37:34.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.702+0000 7fb58614c640 1 -- 172.21.15.62:0/3397587302 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb578118030 con 0x561436832880 2024-09-10T05:37:34.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.702+0000 7fb5886469c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:37:34.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.702+0000 7fb5886469c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:37:34.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.702+0000 7fb5886469c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:37:34.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.702+0000 7fb5886469c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:37:34.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.702+0000 7fb5886469c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:37:34.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.702+0000 7fb5886469c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:37:34.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.702+0000 7fb5886469c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.702+0000 7fb5886469c0 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5614368394e0 con 0x56143682e3b0 2024-09-10T05:37:34.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.702+0000 7fb58694d640 1 -- 172.21.15.62:0/3397587302 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb58000a4d0 con 0x56143682e3b0 2024-09-10T05:37:34.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.702+0000 7fb5886469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:34.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.702+0000 7fb5886469c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.702+0000 7fb5886469c0 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561436839960 con 0x561436832880 2024-09-10T05:37:34.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.706+0000 7fb58614c640 1 -- 172.21.15.62:0/3397587302 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb578118030 con 0x561436832880 2024-09-10T05:37:34.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.706+0000 7fb5886469c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:37:34.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.706+0000 7fb5886469c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.706+0000 7fb5886469c0 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561436839d80 con 0x5614368360b0 2024-09-10T05:37:34.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.706+0000 7fb58594b640 1 -- 172.21.15.62:0/3397587302 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb57c00d040 con 0x5614368360b0 2024-09-10T05:37:34.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.706+0000 7fb5886469c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:37:34.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.706+0000 7fb5886469c0 20 zone default found 2024-09-10T05:37:34.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.706+0000 7fb5886469c0 4 Realm: () 2024-09-10T05:37:34.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.706+0000 7fb5886469c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:37:34.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.706+0000 7fb5886469c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:37:34.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.706+0000 7fb5886469c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:37:34.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.706+0000 7fb5886469c0 20 zonegroup default 2024-09-10T05:37:34.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.706+0000 7fb5886469c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.706+0000 7fb5886469c0 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561436839060 con 0x7fb57811b060 2024-09-10T05:37:34.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.706+0000 7fb58694d640 1 -- 172.21.15.62:0/3397587302 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb58000a4d0 con 0x7fb57811b060 2024-09-10T05:37:34.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.706+0000 7fb5886469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:34.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.706+0000 7fb5886469c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.706+0000 7fb5886469c0 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56143683cad0 con 0x5614368360b0 2024-09-10T05:37:34.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.706+0000 7fb58594b640 1 -- 172.21.15.62:0/3397587302 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb57c00d040 con 0x5614368360b0 2024-09-10T05:37:34.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.706+0000 7fb5886469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:34.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.706+0000 7fb5886469c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.706+0000 7fb5886469c0 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56143683cfb0 con 0x5614368360b0 2024-09-10T05:37:34.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.706+0000 7fb58594b640 1 -- 172.21.15.62:0/3397587302 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb57c00d040 con 0x5614368360b0 2024-09-10T05:37:34.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.706+0000 7fb5886469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:34.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.706+0000 7fb5886469c0 20 started sync module instance, tier type = 2024-09-10T05:37:34.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.706+0000 7fb5886469c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:37:34.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.706+0000 7fb5886469c0 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56143683b8d0 con 0x561436832880 2024-09-10T05:37:34.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.706+0000 7fb58614c640 1 -- 172.21.15.62:0/3397587302 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb578118030 con 0x561436832880 2024-09-10T05:37:34.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.706+0000 7fb5886469c0 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94644813935648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56143683d410 con 0x561436832880 2024-09-10T05:37:34.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.706+0000 7fb5886469c0 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56143683dc60 con 0x56143682e3b0 2024-09-10T05:37:34.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.710+0000 7fb58694d640 1 -- 172.21.15.62:0/3397587302 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb58000a4d0 con 0x56143682e3b0 2024-09-10T05:37:34.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.710+0000 7fb5886469c0 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94644813943824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56143683e4b0 con 0x56143682e3b0 2024-09-10T05:37:34.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.710+0000 7fb5886469c0 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56143683ed80 con 0x561436832880 2024-09-10T05:37:34.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.710+0000 7fb58614c640 1 -- 172.21.15.62:0/3397587302 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94644813935648] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb578118030 con 0x561436832880 2024-09-10T05:37:34.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.710+0000 7fb58694d640 1 -- 172.21.15.62:0/3397587302 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94644813943824] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb58000a4d0 con 0x56143682e3b0 2024-09-10T05:37:34.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.710+0000 7fb58614c640 1 -- 172.21.15.62:0/3397587302 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb578118030 con 0x561436832880 2024-09-10T05:37:34.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.710+0000 7fb5886469c0 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94644813937904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56143683e4b0 con 0x561436832880 2024-09-10T05:37:34.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.710+0000 7fb5886469c0 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56143683f620 con 0x7fb57811b060 2024-09-10T05:37:34.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.714+0000 7fb58694d640 1 -- 172.21.15.62:0/3397587302 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb58000a4d0 con 0x7fb57811b060 2024-09-10T05:37:34.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.714+0000 7fb5886469c0 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94644813951344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56143683e4b0 con 0x7fb57811b060 2024-09-10T05:37:34.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.714+0000 7fb5886469c0 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5614368400c0 con 0x561436832880 2024-09-10T05:37:34.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.714+0000 7fb58614c640 1 -- 172.21.15.62:0/3397587302 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94644813937904] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb578118030 con 0x561436832880 2024-09-10T05:37:34.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.714+0000 7fb58694d640 1 -- 172.21.15.62:0/3397587302 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94644813951344] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb58000a4d0 con 0x7fb57811b060 2024-09-10T05:37:34.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.714+0000 7fb58614c640 1 -- 172.21.15.62:0/3397587302 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb578118030 con 0x561436832880 2024-09-10T05:37:34.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.714+0000 7fb5886469c0 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94644813953968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56143683e000 con 0x561436832880 2024-09-10T05:37:34.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.714+0000 7fb5886469c0 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561436840960 con 0x5614368360b0 2024-09-10T05:37:34.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.714+0000 7fb58594b640 1 -- 172.21.15.62:0/3397587302 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb57c00d040 con 0x5614368360b0 2024-09-10T05:37:34.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.714+0000 7fb5886469c0 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94644813956272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56143683e000 con 0x5614368360b0 2024-09-10T05:37:34.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.718+0000 7fb5886469c0 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5614368413a0 con 0x5614368360b0 2024-09-10T05:37:34.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.718+0000 7fb58614c640 1 -- 172.21.15.62:0/3397587302 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94644813953968] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb578118030 con 0x561436832880 2024-09-10T05:37:34.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.718+0000 7fb58594b640 1 -- 172.21.15.62:0/3397587302 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94644813956272] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb57c00d040 con 0x5614368360b0 2024-09-10T05:37:34.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.718+0000 7fb58594b640 1 -- 172.21.15.62:0/3397587302 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb57c00d040 con 0x5614368360b0 2024-09-10T05:37:34.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.718+0000 7fb5886469c0 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94644813957328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561436840ef0 con 0x5614368360b0 2024-09-10T05:37:34.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.718+0000 7fb5886469c0 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561436841c70 con 0x7fb57811b060 2024-09-10T05:37:34.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.718+0000 7fb58594b640 1 -- 172.21.15.62:0/3397587302 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94644813957328] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb57c00d040 con 0x5614368360b0 2024-09-10T05:37:34.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.718+0000 7fb58694d640 1 -- 172.21.15.62:0/3397587302 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb58000a4d0 con 0x7fb57811b060 2024-09-10T05:37:34.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.718+0000 7fb5886469c0 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94644813952400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561436840ef0 con 0x7fb57811b060 2024-09-10T05:37:34.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.718+0000 7fb5886469c0 20 add_watcher() i=0 2024-09-10T05:37:34.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.718+0000 7fb5886469c0 20 add_watcher() i=1 2024-09-10T05:37:34.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.718+0000 7fb5886469c0 20 add_watcher() i=2 2024-09-10T05:37:34.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.718+0000 7fb5886469c0 20 add_watcher() i=3 2024-09-10T05:37:34.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.718+0000 7fb5886469c0 20 add_watcher() i=4 2024-09-10T05:37:34.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.718+0000 7fb5886469c0 20 add_watcher() i=5 2024-09-10T05:37:34.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.718+0000 7fb5886469c0 20 add_watcher() i=6 2024-09-10T05:37:34.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.722+0000 7fb58694d640 1 -- 172.21.15.62:0/3397587302 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94644813952400] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb58000a4d0 con 0x7fb57811b060 2024-09-10T05:37:34.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.722+0000 7fb5886469c0 20 add_watcher() i=7 2024-09-10T05:37:34.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.722+0000 7fb5886469c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:37:34.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.722+0000 7fb5886469c0 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561436844cd0 con 0x56143682e3b0 2024-09-10T05:37:34.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.722+0000 7fb58694d640 1 -- 172.21.15.62:0/3397587302 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb58000a4d0 con 0x56143682e3b0 2024-09-10T05:37:34.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.722+0000 7fb5886469c0 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94644813961152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561436842260 con 0x56143682e3b0 2024-09-10T05:37:34.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.722+0000 7fb58694d640 1 -- 172.21.15.62:0/3397587302 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94644813961152] v32'214 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb58000a4d0 con 0x56143682e3b0 2024-09-10T05:37:34.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.722+0000 7fb43d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:37:34.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.722+0000 7fb5886469c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:37:34.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.722+0000 7fb5886469c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:37:34.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.722+0000 7fb5886469c0 5 note: GC not initialized 2024-09-10T05:37:34.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.722+0000 7fb4377fe640 20 reqs_thread_entry: start 2024-09-10T05:37:34.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.722+0000 7fb5886469c0 20 init_complete bucket index max shards: 11 2024-09-10T05:37:34.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.722+0000 7fb5886469c0 20 Filter name: none 2024-09-10T05:37:34.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.722+0000 7fb4357fa640 20 reqs_thread_entry: start 2024-09-10T05:37:34.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.722+0000 7fb5886469c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.722+0000 7fb5886469c0 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561436867ad0 con 0x56143682e3b0 2024-09-10T05:37:34.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.726+0000 7fb58694d640 1 -- 172.21.15.62:0/3397587302 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb58000a4d0 con 0x56143682e3b0 2024-09-10T05:37:34.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.726+0000 7fb5886469c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:37:34.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.726+0000 7fb5886469c0 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561436869050 con 0x5614368360b0 2024-09-10T05:37:34.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.726+0000 7fb58594b640 1 -- 172.21.15.62:0/3397587302 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv30 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7fb57c00d040 con 0x5614368360b0 2024-09-10T05:37:34.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.726+0000 7fb43d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:37:34.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.726+0000 7fb5886469c0 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94644813961152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5614368673f0 con 0x56143682e3b0 2024-09-10T05:37:34.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.726+0000 7fb58694d640 1 -- 172.21.15.62:0/3397587302 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94644813961152] v32'215 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb58000a4d0 con 0x56143682e3b0 2024-09-10T05:37:34.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.730+0000 7fb5886469c0 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94644813935648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5614368417c0 con 0x561436832880 2024-09-10T05:37:34.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.730+0000 7fb58614c640 1 -- 172.21.15.62:0/3397587302 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94644813935648] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb578118030 con 0x561436832880 2024-09-10T05:37:34.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.730+0000 7fb5886469c0 20 remove_watcher() i=0 2024-09-10T05:37:34.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.730+0000 7fb5886469c0 2 removed watcher, disabling cache 2024-09-10T05:37:34.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.730+0000 7fb5886469c0 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94644813943824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5614368417c0 con 0x56143682e3b0 2024-09-10T05:37:34.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.730+0000 7fb58694d640 1 -- 172.21.15.62:0/3397587302 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94644813943824] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb58000a4d0 con 0x56143682e3b0 2024-09-10T05:37:34.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.730+0000 7fb5886469c0 20 remove_watcher() i=1 2024-09-10T05:37:34.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.730+0000 7fb5886469c0 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94644813937904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5614368417c0 con 0x561436832880 2024-09-10T05:37:34.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.734+0000 7fb58614c640 1 -- 172.21.15.62:0/3397587302 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94644813937904] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb578118030 con 0x561436832880 2024-09-10T05:37:34.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.734+0000 7fb5886469c0 20 remove_watcher() i=2 2024-09-10T05:37:34.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.734+0000 7fb5886469c0 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94644813951344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56143683bcf0 con 0x7fb57811b060 2024-09-10T05:37:34.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.734+0000 7fb58694d640 1 -- 172.21.15.62:0/3397587302 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94644813951344] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb58000a4d0 con 0x7fb57811b060 2024-09-10T05:37:34.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.734+0000 7fb5886469c0 20 remove_watcher() i=3 2024-09-10T05:37:34.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.734+0000 7fb5886469c0 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94644813953968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5614368417c0 con 0x561436832880 2024-09-10T05:37:34.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.738+0000 7fb58614c640 1 -- 172.21.15.62:0/3397587302 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94644813953968] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb578118030 con 0x561436832880 2024-09-10T05:37:34.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.738+0000 7fb5886469c0 20 remove_watcher() i=4 2024-09-10T05:37:34.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.738+0000 7fb5886469c0 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94644813956272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56143683f170 con 0x5614368360b0 2024-09-10T05:37:34.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.738+0000 7fb58594b640 1 -- 172.21.15.62:0/3397587302 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94644813956272] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb57c00d040 con 0x5614368360b0 2024-09-10T05:37:34.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.738+0000 7fb5886469c0 20 remove_watcher() i=5 2024-09-10T05:37:34.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.738+0000 7fb5886469c0 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94644813957328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56143683bcf0 con 0x5614368360b0 2024-09-10T05:37:34.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.738+0000 7fb58594b640 1 -- 172.21.15.62:0/3397587302 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94644813957328] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb57c00d040 con 0x5614368360b0 2024-09-10T05:37:34.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.738+0000 7fb5886469c0 20 remove_watcher() i=6 2024-09-10T05:37:34.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.738+0000 7fb5886469c0 1 -- 172.21.15.62:0/3397587302 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94644813952400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561436840960 con 0x7fb57811b060 2024-09-10T05:37:34.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.742+0000 7fb58694d640 1 -- 172.21.15.62:0/3397587302 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94644813952400] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb58000a4d0 con 0x7fb57811b060 2024-09-10T05:37:34.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.742+0000 7fb5886469c0 20 remove_watcher() i=7 2024-09-10T05:37:34.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.742+0000 7fb5886469c0 1 -- 172.21.15.62:0/3397587302 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561436832880 msgr2=0x561436834c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.742+0000 7fb5886469c0 1 --2- 172.21.15.62:0/3397587302 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x561436832880 0x561436834c70 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.742+0000 7fb5886469c0 1 -- 172.21.15.62:0/3397587302 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56143682e3b0 msgr2=0x561436830840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.742+0000 7fb5886469c0 1 --2- 172.21.15.62:0/3397587302 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56143682e3b0 0x561436830840 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.742+0000 7fb5886469c0 1 -- 172.21.15.62:0/3397587302 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fb57811b060 msgr2=0x7fb57810b9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.742+0000 7fb5886469c0 1 --2- 172.21.15.62:0/3397587302 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fb57811b060 0x7fb57810b9d0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.742+0000 7fb5886469c0 1 -- 172.21.15.62:0/3397587302 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5614368360b0 msgr2=0x5614368384a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.742+0000 7fb5886469c0 1 --2- 172.21.15.62:0/3397587302 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5614368360b0 0x5614368384a0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.742+0000 7fb5886469c0 1 -- 172.21.15.62:0/3397587302 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb4500399d0 msgr2=0x7fb45003be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.742+0000 7fb5886469c0 1 --2- 172.21.15.62:0/3397587302 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb4500399d0 0x7fb45003be90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x5614367fd870 tx=0x7fb57c011000 comp rx=0 tx=0).stop 2024-09-10T05:37:34.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.742+0000 7fb5886469c0 1 -- 172.21.15.62:0/3397587302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56143681c2f0 msgr2=0x561436823610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.742+0000 7fb5886469c0 1 --2- 172.21.15.62:0/3397587302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56143681c2f0 0x561436823610 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fb5780c6fd0 tx=0x7fb5780fc000 comp rx=0 tx=0).stop 2024-09-10T05:37:34.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.742+0000 7fb58694d640 1 -- 172.21.15.62:0/3397587302 reap_dead start 2024-09-10T05:37:34.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.742+0000 7fb5886469c0 1 -- 172.21.15.62:0/3397587302 shutdown_connections 2024-09-10T05:37:34.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.742+0000 7fb5886469c0 1 --2- 172.21.15.62:0/3397587302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56143681c2f0 0x561436823610 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.742+0000 7fb5886469c0 1 -- 172.21.15.62:0/3397587302 >> 172.21.15.62:0/3397587302 conn(0x561436818720 msgr2=0x561436816930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:34.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.742+0000 7fb5886469c0 1 -- 172.21.15.62:0/3397587302 shutdown_connections 2024-09-10T05:37:34.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.742+0000 7fb5886469c0 1 -- 172.21.15.62:0/3397587302 wait complete. 2024-09-10T05:37:34.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.742+0000 7fb5886469c0 1 -- 172.21.15.62:0/4263105462 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb460039ac0 msgr2=0x7fb46003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.742+0000 7fb5886469c0 1 --2- 172.21.15.62:0/4263105462 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb460039ac0 0x7fb46003bf80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x5614367f3280 tx=0x7fb57c006000 comp rx=0 tx=0).stop 2024-09-10T05:37:34.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.742+0000 7fb5886469c0 1 -- 172.21.15.62:0/4263105462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56143680fb90 msgr2=0x56143680ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.742+0000 7fb5886469c0 1 --2- 172.21.15.62:0/4263105462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56143680fb90 0x56143680ffb0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fb578004ff0 tx=0x7fb5780c5e20 comp rx=0 tx=0).stop 2024-09-10T05:37:34.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.742+0000 7fb5886469c0 1 -- 172.21.15.62:0/4263105462 shutdown_connections 2024-09-10T05:37:34.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.742+0000 7fb5886469c0 1 --2- 172.21.15.62:0/4263105462 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb460039ac0 0x7fb46003bf80 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.742+0000 7fb5886469c0 1 --2- 172.21.15.62:0/4263105462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56143680fb90 0x56143680ffb0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.742+0000 7fb5886469c0 1 -- 172.21.15.62:0/4263105462 >> 172.21.15.62:0/4263105462 conn(0x561436805540 msgr2=0x561436805920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:34.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.742+0000 7fb5886469c0 1 -- 172.21.15.62:0/4263105462 shutdown_connections 2024-09-10T05:37:34.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.742+0000 7fb5886469c0 1 -- 172.21.15.62:0/4263105462 wait complete. 2024-09-10T05:37:34.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.742+0000 7fb5886469c0 1 -- 172.21.15.62:0/1886490576 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5614367fa240 msgr2=0x5614367fc630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.742+0000 7fb5886469c0 1 --2- 172.21.15.62:0/1886490576 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5614367fa240 0x5614367fc630 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.742+0000 7fb5886469c0 1 -- 172.21.15.62:0/1886490576 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x561436702330 msgr2=0x5614367f8fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.742+0000 7fb5886469c0 1 --2- 172.21.15.62:0/1886490576 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x561436702330 0x5614367f8fa0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.742+0000 7fb5886469c0 1 -- 172.21.15.62:0/1886490576 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5614367fea00 msgr2=0x561436800df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.742+0000 7fb5886469c0 1 --2- 172.21.15.62:0/1886490576 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5614367fea00 0x561436800df0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.742+0000 7fb5886469c0 1 -- 172.21.15.62:0/1886490576 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb46c039ac0 msgr2=0x7fb46c03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.742+0000 7fb5886469c0 1 --2- 172.21.15.62:0/1886490576 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb46c039ac0 0x7fb46c03bf80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb57c001e60 tx=0x7fb57c0013e0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.742+0000 7fb5886469c0 1 -- 172.21.15.62:0/1886490576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614366ff1f0 msgr2=0x5614367f1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.742+0000 7fb5886469c0 1 --2- 172.21.15.62:0/1886490576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614366ff1f0 0x5614367f1e30 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fb57801b170 tx=0x7fb5780180e0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.742+0000 7fb58694d640 1 -- 172.21.15.62:0/1886490576 reap_dead start 2024-09-10T05:37:34.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.742+0000 7fb5886469c0 1 -- 172.21.15.62:0/1886490576 shutdown_connections 2024-09-10T05:37:34.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.742+0000 7fb5886469c0 1 -- 172.21.15.62:0/1886490576 >> 172.21.15.62:0/1886490576 conn(0x561436672b00 msgr2=0x5614367e4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:34.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.742+0000 7fb5886469c0 1 -- 172.21.15.62:0/1886490576 shutdown_connections 2024-09-10T05:37:34.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.742+0000 7fb5886469c0 1 -- 172.21.15.62:0/1886490576 wait complete. 2024-09-10T05:37:34.759 INFO:teuthology.orchestra.run.smithi062.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}],"total":{"bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-10T05:37:34.759 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T05:37:34.759 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-10T05:37:34.759 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-10T05:37:34.760 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2024-09-10T05:37:34.842 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:37:34.842 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:37:34.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.838+0000 7faecdef99c0 1 Processor -- start 2024-09-10T05:37:34.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.838+0000 7faecdef99c0 1 -- start start 2024-09-10T05:37:34.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.838+0000 7faecdef99c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5596ec037730 0x5596ec039b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.838+0000 7faecdef99c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5596ebee99c0 con 0x5596ec03a060 2024-09-10T05:37:34.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.838+0000 7faecdef99c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x5596ebf396d0 con 0x5596ec037730 2024-09-10T05:37:34.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.838+0000 7faecb9ff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5596ec037730 0x5596ec039b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.838+0000 7faecb9ff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5596ec037730 0x5596ec039b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:58314/0 (socket says 172.21.15.62:58314) 2024-09-10T05:37:34.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.838+0000 7faecb1fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x5596ec03a060 0x5596ec03c450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:50572/0 (socket says 172.21.15.62:50572) 2024-09-10T05:37:34.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.838+0000 7faecb9ff640 1 -- 172.21.15.62:0/3709935571 learned_addr learned my addr 172.21.15.62:0/3709935571 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:34.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.838+0000 7faecb9ff640 1 -- 172.21.15.62:0/3709935571 >> v1:172.21.15.2:6789/0 conn(0x5596ec03a060 legacy=0x5596ec03c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.838+0000 7faecb9ff640 1 -- 172.21.15.62:0/3709935571 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596ebeddca0 con 0x5596ec037730 2024-09-10T05:37:34.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.842+0000 7faecb9ff640 1 --2- 172.21.15.62:0/3709935571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596ec037730 0x5596ec039b20 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7faec400a4e0 tx=0x7faec401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb2bb4d4f82e11c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.842+0000 7faeca9fd640 1 -- 172.21.15.62:0/3709935571 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faec40aa540 con 0x5596ec037730 2024-09-10T05:37:34.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.842+0000 7faeca9fd640 1 -- 172.21.15.62:0/3709935571 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faec40aa6e0 con 0x5596ec037730 2024-09-10T05:37:34.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.842+0000 7faeca9fd640 1 -- 172.21.15.62:0/3709935571 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faec40aaa40 con 0x5596ec037730 2024-09-10T05:37:34.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.842+0000 7faecdef99c0 1 -- 172.21.15.62:0/3709935571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596ec037730 msgr2=0x5596ec039b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.842+0000 7faecdef99c0 1 --2- 172.21.15.62:0/3709935571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596ec037730 0x5596ec039b20 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7faec400a4e0 tx=0x7faec401b090 comp rx=0 tx=0).stop 2024-09-10T05:37:34.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.842+0000 7faecdef99c0 1 -- 172.21.15.62:0/3709935571 shutdown_connections 2024-09-10T05:37:34.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.842+0000 7faecdef99c0 1 --2- 172.21.15.62:0/3709935571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596ec037730 0x5596ec039b20 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.842+0000 7faecdef99c0 1 -- 172.21.15.62:0/3709935571 >> 172.21.15.62:0/3709935571 conn(0x5596ebfaaac0 msgr2=0x5596ebfaaed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:34.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.842+0000 7faecdef99c0 1 -- 172.21.15.62:0/3709935571 shutdown_connections 2024-09-10T05:37:34.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.842+0000 7faecdef99c0 1 -- 172.21.15.62:0/3709935571 wait complete. 2024-09-10T05:37:34.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.858+0000 7faecdef99c0 1 Processor -- start 2024-09-10T05:37:34.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.858+0000 7faecdef99c0 1 -- start start 2024-09-10T05:37:34.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.858+0000 7faecdef99c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596ec037730 0x5596ec122970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.858+0000 7faecdef99c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5596ebf3d680 con 0x5596ec037730 2024-09-10T05:37:34.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.862+0000 7faecb9ff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596ec037730 0x5596ec122970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.862+0000 7faecb9ff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596ec037730 0x5596ec122970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:58326/0 (socket says 172.21.15.62:58326) 2024-09-10T05:37:34.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.862+0000 7faecb9ff640 1 -- 172.21.15.62:0/914502231 learned_addr learned my addr 172.21.15.62:0/914502231 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:34.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.862+0000 7faecb9ff640 1 -- 172.21.15.62:0/914502231 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596ebeb8da0 con 0x5596ec037730 2024-09-10T05:37:34.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.862+0000 7faecb9ff640 1 --2- 172.21.15.62:0/914502231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596ec037730 0x5596ec122970 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7faec40ac040 tx=0x7faec40033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d437a9085399a021 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.862+0000 7fadb9e0b640 1 -- 172.21.15.62:0/914502231 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faec40b9030 con 0x5596ec037730 2024-09-10T05:37:34.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.862+0000 7fadb9e0b640 1 -- 172.21.15.62:0/914502231 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faec40aaa40 con 0x5596ec037730 2024-09-10T05:37:34.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.862+0000 7fadb9e0b640 1 -- 172.21.15.62:0/914502231 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faec40aad20 con 0x5596ec037730 2024-09-10T05:37:34.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.862+0000 7faecdef99c0 1 -- 172.21.15.62:0/914502231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596ec037730 msgr2=0x5596ec122970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.862+0000 7faecdef99c0 1 --2- 172.21.15.62:0/914502231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596ec037730 0x5596ec122970 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7faec40ac040 tx=0x7faec40033b0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.862+0000 7faecdef99c0 1 -- 172.21.15.62:0/914502231 shutdown_connections 2024-09-10T05:37:34.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.862+0000 7faecdef99c0 1 --2- 172.21.15.62:0/914502231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596ec037730 0x5596ec122970 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.862+0000 7faecdef99c0 1 -- 172.21.15.62:0/914502231 >> 172.21.15.62:0/914502231 conn(0x5596ebfaaac0 msgr2=0x5596ec11e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:34.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.862+0000 7faecdef99c0 1 -- 172.21.15.62:0/914502231 shutdown_connections 2024-09-10T05:37:34.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.862+0000 7faecdef99c0 1 -- 172.21.15.62:0/914502231 wait complete. 2024-09-10T05:37:34.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.862+0000 7faecdef99c0 1 Processor -- start 2024-09-10T05:37:34.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.862+0000 7faecdef99c0 1 -- start start 2024-09-10T05:37:34.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.862+0000 7faecdef99c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596ec037730 0x5596ec129ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.862+0000 7faecdef99c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5596ebedfa50 con 0x5596ec037730 2024-09-10T05:37:34.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.862+0000 7faecb9ff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596ec037730 0x5596ec129ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.862+0000 7faecb9ff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596ec037730 0x5596ec129ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:58342/0 (socket says 172.21.15.62:58342) 2024-09-10T05:37:34.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.862+0000 7faecb9ff640 1 -- 172.21.15.62:0/2319201854 learned_addr learned my addr 172.21.15.62:0/2319201854 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:34.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.862+0000 7faecb9ff640 1 -- 172.21.15.62:0/2319201854 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596ec12a430 con 0x5596ec037730 2024-09-10T05:37:34.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.866+0000 7faecb9ff640 1 --2- 172.21.15.62:0/2319201854 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596ec037730 0x5596ec129ed0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7faec4003430 tx=0x7faec4017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.866+0000 7fadb3fff640 1 -- 172.21.15.62:0/2319201854 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faec40b9070 con 0x5596ec037730 2024-09-10T05:37:34.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.866+0000 7faecdef99c0 1 -- 172.21.15.62:0/2319201854 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5596ec12a6c0 con 0x5596ec037730 2024-09-10T05:37:34.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.866+0000 7fadb3fff640 1 -- 172.21.15.62:0/2319201854 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faec40c2070 con 0x5596ec037730 2024-09-10T05:37:34.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.866+0000 7fadb3fff640 1 -- 172.21.15.62:0/2319201854 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faec40b5ca0 con 0x5596ec037730 2024-09-10T05:37:34.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.866+0000 7faecdef99c0 1 -- 172.21.15.62:0/2319201854 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596ec12b070 con 0x5596ec037730 2024-09-10T05:37:34.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.866+0000 7fadb3fff640 1 -- 172.21.15.62:0/2319201854 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7faec40b3040 con 0x5596ec037730 2024-09-10T05:37:34.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.866+0000 7fadb3fff640 1 --2- 172.21.15.62:0/2319201854 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fadb4039a70 0x7fadb403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.866+0000 7fadb3fff640 1 -- 172.21.15.62:0/2319201854 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7faec40ba070 con 0x5596ec037730 2024-09-10T05:37:34.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.866+0000 7faecb1fe640 1 --2- 172.21.15.62:0/2319201854 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fadb4039a70 0x7fadb403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.866+0000 7faecdef99c0 1 --2- 172.21.15.62:0/2319201854 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5596ec03a060 0x5596ec131040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.866+0000 7faecdef99c0 1 -- 172.21.15.62:0/2319201854 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5596ec131580 con 0x5596ec03a060 2024-09-10T05:37:34.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.866+0000 7faecc200640 1 --2- 172.21.15.62:0/2319201854 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5596ec03a060 0x5596ec131040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.866+0000 7faecb1fe640 1 --2- 172.21.15.62:0/2319201854 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fadb4039a70 0x7fadb403bf30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7faec0001e40 tx=0x7faec00013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.866+0000 7faecc200640 1 --2- 172.21.15.62:0/2319201854 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5596ec03a060 0x5596ec131040 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.866+0000 7faecc200640 1 -- 172.21.15.62:0/2319201854 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faebc0083f0 con 0x5596ec03a060 2024-09-10T05:37:34.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.866+0000 7faecdef99c0 1 --2- 172.21.15.62:0/2319201854 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5596ec1320a0 0x5596ec134560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.866+0000 7faecdef99c0 1 -- 172.21.15.62:0/2319201854 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5596ec134cd0 con 0x5596ec1320a0 2024-09-10T05:37:34.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.866+0000 7faecb9ff640 1 --2- 172.21.15.62:0/2319201854 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5596ec1320a0 0x5596ec134560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.870+0000 7faecb9ff640 1 --2- 172.21.15.62:0/2319201854 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5596ec1320a0 0x5596ec134560 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.870+0000 7faecb9ff640 1 -- 172.21.15.62:0/2319201854 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faec40beca0 con 0x5596ec1320a0 2024-09-10T05:37:34.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.870+0000 7faecdef99c0 1 --2- 172.21.15.62:0/2319201854 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5596ec136a90 0x5596ec138e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.870+0000 7faecdef99c0 1 -- 172.21.15.62:0/2319201854 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5596ec139570 con 0x5596ec136a90 2024-09-10T05:37:34.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.870+0000 7faecb1fe640 1 --2- 172.21.15.62:0/2319201854 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5596ec136a90 0x5596ec138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.870+0000 7faecb1fe640 1 --2- 172.21.15.62:0/2319201854 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5596ec136a90 0x5596ec138e80 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.870+0000 7faecb1fe640 1 -- 172.21.15.62:0/2319201854 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7faec000bd60 con 0x5596ec136a90 2024-09-10T05:37:34.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.870+0000 7faecdef99c0 1 -- 172.21.15.62:0/2319201854 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5596ec135930 con 0x5596ec1320a0 2024-09-10T05:37:34.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.870+0000 7faecb9ff640 1 -- 172.21.15.62:0/2319201854 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faec40beca0 con 0x5596ec1320a0 2024-09-10T05:37:34.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.870+0000 7faecdef99c0 1 -- 172.21.15.62:0/2319201854 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5596ec135d50 con 0x5596ec136a90 2024-09-10T05:37:34.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.870+0000 7faecb1fe640 1 -- 172.21.15.62:0/2319201854 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7faec000bd60 con 0x5596ec136a90 2024-09-10T05:37:34.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.870+0000 7faecdef99c0 1 Processor -- start 2024-09-10T05:37:34.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.870+0000 7faecdef99c0 1 -- start start 2024-09-10T05:37:34.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.874+0000 7faecdef99c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596ec147c20 0x5596ec148040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.874+0000 7faecdef99c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5596ebf4a450 con 0x5596ec147c20 2024-09-10T05:37:34.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.874+0000 7faecb9ff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596ec147c20 0x5596ec148040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.874+0000 7faecb9ff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596ec147c20 0x5596ec148040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:58354/0 (socket says 172.21.15.62:58354) 2024-09-10T05:37:34.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.874+0000 7faecb9ff640 1 -- 172.21.15.62:0/1045244853 learned_addr learned my addr 172.21.15.62:0/1045244853 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:34.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.874+0000 7faecb9ff640 1 -- 172.21.15.62:0/1045244853 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596ec148680 con 0x5596ec147c20 2024-09-10T05:37:34.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.874+0000 7faecb9ff640 1 --2- 172.21.15.62:0/1045244853 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596ec147c20 0x5596ec148040 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7faec40ea010 tx=0x7faec40c4e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.874+0000 7fadb17fa640 1 -- 172.21.15.62:0/1045244853 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faec4005150 con 0x5596ec147c20 2024-09-10T05:37:34.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.874+0000 7faecdef99c0 1 -- 172.21.15.62:0/1045244853 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5596ec148ee0 con 0x5596ec147c20 2024-09-10T05:37:34.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.874+0000 7fadb17fa640 1 -- 172.21.15.62:0/1045244853 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faec40052f0 con 0x5596ec147c20 2024-09-10T05:37:34.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.874+0000 7fadb17fa640 1 -- 172.21.15.62:0/1045244853 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faec40be400 con 0x5596ec147c20 2024-09-10T05:37:34.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.874+0000 7faecdef99c0 1 -- 172.21.15.62:0/1045244853 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596ec149450 con 0x5596ec147c20 2024-09-10T05:37:34.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.874+0000 7fadb17fa640 1 -- 172.21.15.62:0/1045244853 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7faec40be5a0 con 0x5596ec147c20 2024-09-10T05:37:34.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.874+0000 7fadb17fa640 1 --2- 172.21.15.62:0/1045244853 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fada4039ac0 0x7fada403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.874+0000 7fadb17fa640 1 -- 172.21.15.62:0/1045244853 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7faec40d9bf0 con 0x5596ec147c20 2024-09-10T05:37:34.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.874+0000 7faecb1fe640 1 --2- 172.21.15.62:0/1045244853 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fada4039ac0 0x7fada403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.874+0000 7faecdef99c0 1 Processor -- start 2024-09-10T05:37:34.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.874+0000 7faecdef99c0 1 -- start start 2024-09-10T05:37:34.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.874+0000 7faecdef99c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596ec154330 0x5596ec154710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.874+0000 7faecdef99c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5596ec123100 con 0x5596ec154330 2024-09-10T05:37:34.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.874+0000 7faecb1fe640 1 --2- 172.21.15.62:0/1045244853 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fada4039ac0 0x7fada403bf80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x5596ec135cd0 tx=0x7faec000f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.878+0000 7faecb9ff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596ec154330 0x5596ec154710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.878+0000 7faecb9ff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596ec154330 0x5596ec154710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:58366/0 (socket says 172.21.15.62:58366) 2024-09-10T05:37:34.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.878+0000 7faecb9ff640 1 -- 172.21.15.62:0/216672414 learned_addr learned my addr 172.21.15.62:0/216672414 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:34.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.878+0000 7faecb9ff640 1 -- 172.21.15.62:0/216672414 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596ec154ce0 con 0x5596ec154330 2024-09-10T05:37:34.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.878+0000 7faecb9ff640 1 --2- 172.21.15.62:0/216672414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596ec154330 0x5596ec154710 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7faec40ea990 tx=0x7faec40bdfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5ca03318c0a9c2e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.878+0000 7fadaaffd640 1 -- 172.21.15.62:0/216672414 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faec40f9070 con 0x5596ec154330 2024-09-10T05:37:34.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.878+0000 7fadaaffd640 1 -- 172.21.15.62:0/216672414 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faec40a97e0 con 0x5596ec154330 2024-09-10T05:37:34.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.878+0000 7fadaaffd640 1 -- 172.21.15.62:0/216672414 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faec40e1fb0 con 0x5596ec154330 2024-09-10T05:37:34.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.878+0000 7faecdef99c0 1 -- 172.21.15.62:0/216672414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596ec154330 msgr2=0x5596ec154710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.878+0000 7faecdef99c0 1 --2- 172.21.15.62:0/216672414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596ec154330 0x5596ec154710 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7faec40ea990 tx=0x7faec40bdfb0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.878+0000 7faecdef99c0 1 -- 172.21.15.62:0/216672414 shutdown_connections 2024-09-10T05:37:34.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.878+0000 7faecdef99c0 1 --2- 172.21.15.62:0/216672414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596ec154330 0x5596ec154710 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.878+0000 7faecdef99c0 1 -- 172.21.15.62:0/216672414 >> 172.21.15.62:0/216672414 conn(0x5596ec150760 msgr2=0x5596ec14e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:34.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.878+0000 7faecdef99c0 1 -- 172.21.15.62:0/216672414 shutdown_connections 2024-09-10T05:37:34.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.878+0000 7faecdef99c0 1 -- 172.21.15.62:0/216672414 wait complete. 2024-09-10T05:37:34.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.878+0000 7faecdef99c0 1 Processor -- start 2024-09-10T05:37:34.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.878+0000 7faecdef99c0 1 -- start start 2024-09-10T05:37:34.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.878+0000 7faecdef99c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596ec154330 0x5596ec15b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.878+0000 7faecdef99c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5596ec1551c0 con 0x5596ec154330 2024-09-10T05:37:34.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.878+0000 7faecb9ff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596ec154330 0x5596ec15b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.878+0000 7faecb9ff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596ec154330 0x5596ec15b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:58372/0 (socket says 172.21.15.62:58372) 2024-09-10T05:37:34.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.878+0000 7faecb9ff640 1 -- 172.21.15.62:0/1460364020 learned_addr learned my addr 172.21.15.62:0/1460364020 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:34.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.878+0000 7faecb9ff640 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596ec15bbc0 con 0x5596ec154330 2024-09-10T05:37:34.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.878+0000 7faecb9ff640 1 --2- 172.21.15.62:0/1460364020 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596ec154330 0x5596ec15b660 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7faec40d1fd0 tx=0x7faec40d1f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.878+0000 7fada97fa640 1 -- 172.21.15.62:0/1460364020 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faec4104020 con 0x5596ec154330 2024-09-10T05:37:34.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.878+0000 7fada97fa640 1 -- 172.21.15.62:0/1460364020 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faec40e7260 con 0x5596ec154330 2024-09-10T05:37:34.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.878+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5596ec15bbc0 con 0x5596ec154330 2024-09-10T05:37:34.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.878+0000 7fada97fa640 1 -- 172.21.15.62:0/1460364020 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faec40f9030 con 0x5596ec154330 2024-09-10T05:37:34.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.878+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596ec15bbc0 con 0x5596ec154330 2024-09-10T05:37:34.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.882+0000 7fada97fa640 1 -- 172.21.15.62:0/1460364020 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7faec4107020 con 0x5596ec154330 2024-09-10T05:37:34.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.882+0000 7fada97fa640 1 --2- 172.21.15.62:0/1460364020 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fad94039a70 0x7fad9403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.882+0000 7faecdef99c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.882+0000 7fada97fa640 1 -- 172.21.15.62:0/1460364020 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7faec40fa070 con 0x5596ec154330 2024-09-10T05:37:34.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.882+0000 7faecb1fe640 1 --2- 172.21.15.62:0/1460364020 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fad94039a70 0x7fad9403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.882+0000 7faecdef99c0 1 --2- 172.21.15.62:0/1460364020 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5596ec166590 0x5596ec168a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.882+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5596ec169170 con 0x5596ec166590 2024-09-10T05:37:34.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.882+0000 7faecc200640 1 --2- 172.21.15.62:0/1460364020 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5596ec166590 0x5596ec168a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.882+0000 7faecb1fe640 1 --2- 172.21.15.62:0/1460364020 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fad94039a70 0x7fad9403bf30 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x5596ec135900 tx=0x7faec0010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.882+0000 7faecc200640 1 --2- 172.21.15.62:0/1460364020 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5596ec166590 0x5596ec168a20 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.882+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faebc0083f0 con 0x5596ec166590 2024-09-10T05:37:34.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.882+0000 7faecdef99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:34.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.882+0000 7faecdef99c0 20 realm 2024-09-10T05:37:34.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.882+0000 7faecdef99c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.882+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5596ec165980 con 0x5596ec166590 2024-09-10T05:37:34.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.882+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faebc0083f0 con 0x5596ec166590 2024-09-10T05:37:34.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.882+0000 7faecdef99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:34.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.882+0000 7faecdef99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:37:34.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.882+0000 7faecdef99c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.882+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5596ec169c30 con 0x5596ec166590 2024-09-10T05:37:34.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.882+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faebc0083f0 con 0x5596ec166590 2024-09-10T05:37:34.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.882+0000 7faecdef99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:34.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.882+0000 7faecdef99c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.882+0000 7faecdef99c0 1 --2- 172.21.15.62:0/1460364020 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5596ec16aa10 0x5596ec16ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.882+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5596ec16d4d0 con 0x5596ec16aa10 2024-09-10T05:37:34.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.882+0000 7faecb9ff640 1 --2- 172.21.15.62:0/1460364020 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5596ec16aa10 0x5596ec16ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.886+0000 7faecb9ff640 1 --2- 172.21.15.62:0/1460364020 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5596ec16aa10 0x5596ec16ce00 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.886+0000 7faecb9ff640 1 -- 172.21.15.62:0/1460364020 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faec40beca0 con 0x5596ec16aa10 2024-09-10T05:37:34.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.886+0000 7faecdef99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:37:34.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.886+0000 7faecdef99c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.886+0000 7faecdef99c0 1 --2- 172.21.15.62:0/1460364020 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5596ec16e230 0x5596ec170620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.886+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5596ec170d90 con 0x5596ec16e230 2024-09-10T05:37:34.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.886+0000 7faecb1fe640 1 --2- 172.21.15.62:0/1460364020 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5596ec16e230 0x5596ec170620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.886+0000 7faecb1fe640 1 --2- 172.21.15.62:0/1460364020 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5596ec16e230 0x5596ec170620 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.886+0000 7faecb1fe640 1 -- 172.21.15.62:0/1460364020 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7faec000bd60 con 0x5596ec16e230 2024-09-10T05:37:34.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.886+0000 7faecdef99c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:37:34.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.886+0000 7faecdef99c0 20 searching for the correct realm 2024-09-10T05:37:34.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.886+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5596ec172660 con 0x5596ec16e230 2024-09-10T05:37:34.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.886+0000 7faecb1fe640 1 -- 172.21.15.62:0/1460364020 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faec000bd60 con 0x5596ec16e230 2024-09-10T05:37:34.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.886+0000 7faecb1fe640 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5596ec172660 con 0x5596ec16aa10 2024-09-10T05:37:34.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.886+0000 7faecb9ff640 1 -- 172.21.15.62:0/1460364020 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faec40beca0 con 0x5596ec16aa10 2024-09-10T05:37:34.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.886+0000 7faecb9ff640 1 --2- 172.21.15.62:0/1460364020 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7faec4114040 0x7faec4004830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:34.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.886+0000 7faecb9ff640 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5596ec172660 con 0x7faec4114040 2024-09-10T05:37:34.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.886+0000 7faecc200640 1 --2- 172.21.15.62:0/1460364020 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7faec4114040 0x7faec4004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:34.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.886+0000 7faecc200640 1 --2- 172.21.15.62:0/1460364020 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7faec4114040 0x7faec4004830 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:34.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.886+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faebc0083f0 con 0x7faec4114040 2024-09-10T05:37:34.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.886+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5596ec172660 con 0x5596ec166590 2024-09-10T05:37:34.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.890+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faebc0083f0 con 0x5596ec166590 2024-09-10T05:37:34.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.890+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5596ec172660 con 0x5596ec166590 2024-09-10T05:37:34.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.890+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faebc0083f0 con 0x5596ec166590 2024-09-10T05:37:34.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.890+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5596ec172660 con 0x5596ec16e230 2024-09-10T05:37:34.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.890+0000 7faecb1fe640 1 -- 172.21.15.62:0/1460364020 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faec000bd60 con 0x5596ec16e230 2024-09-10T05:37:34.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.890+0000 7faecb1fe640 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5596ec172660 con 0x5596ec166590 2024-09-10T05:37:34.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.890+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faebc0083f0 con 0x5596ec166590 2024-09-10T05:37:34.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.890+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5596ec172660 con 0x5596ec16aa10 2024-09-10T05:37:34.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.890+0000 7faecb9ff640 1 -- 172.21.15.62:0/1460364020 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faec40beca0 con 0x5596ec16aa10 2024-09-10T05:37:34.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.890+0000 7faecb9ff640 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5596ec172660 con 0x5596ec16aa10 2024-09-10T05:37:34.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.890+0000 7faecb9ff640 1 -- 172.21.15.62:0/1460364020 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faec40beca0 con 0x5596ec16aa10 2024-09-10T05:37:34.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.890+0000 7faecb9ff640 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5596ec172660 con 0x5596ec166590 2024-09-10T05:37:34.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.890+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faebc0083f0 con 0x5596ec166590 2024-09-10T05:37:34.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.890+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5596ec172660 con 0x7faec4114040 2024-09-10T05:37:34.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.890+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faebc0083f0 con 0x7faec4114040 2024-09-10T05:37:34.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.890+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5596ec172660 con 0x5596ec166590 2024-09-10T05:37:34.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.890+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faebc0083f0 con 0x5596ec166590 2024-09-10T05:37:34.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.890+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5596ec172660 con 0x7faec4114040 2024-09-10T05:37:34.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.890+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7faebc0083f0 con 0x7faec4114040 2024-09-10T05:37:34.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.890+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5596ec172660 con 0x5596ec16aa10 2024-09-10T05:37:34.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.894+0000 7faecb9ff640 1 -- 172.21.15.62:0/1460364020 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faec40beca0 con 0x5596ec16aa10 2024-09-10T05:37:34.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.894+0000 7faecb9ff640 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5596ec172660 con 0x5596ec16e230 2024-09-10T05:37:34.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.894+0000 7faecb1fe640 1 -- 172.21.15.62:0/1460364020 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faec000bd60 con 0x5596ec16e230 2024-09-10T05:37:34.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.894+0000 7faecb1fe640 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5596ec172660 con 0x5596ec166590 2024-09-10T05:37:34.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.894+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faebc0083f0 con 0x5596ec166590 2024-09-10T05:37:34.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.894+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5596ec172660 con 0x5596ec16aa10 2024-09-10T05:37:34.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.894+0000 7faecb9ff640 1 -- 172.21.15.62:0/1460364020 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faec40beca0 con 0x5596ec16aa10 2024-09-10T05:37:34.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.894+0000 7faecb9ff640 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5596ec172660 con 0x5596ec16e230 2024-09-10T05:37:34.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.894+0000 7faecb1fe640 1 -- 172.21.15.62:0/1460364020 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 32 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7faec000bd60 con 0x5596ec16e230 2024-09-10T05:37:34.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.894+0000 7faecb1fe640 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5596ec172660 con 0x5596ec166590 2024-09-10T05:37:34.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.894+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faebc0083f0 con 0x5596ec166590 2024-09-10T05:37:34.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.894+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5596ec172660 con 0x5596ec166590 2024-09-10T05:37:34.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.894+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7faebc0083f0 con 0x5596ec166590 2024-09-10T05:37:34.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.894+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5596ec172660 con 0x5596ec166590 2024-09-10T05:37:34.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.894+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faebc0083f0 con 0x5596ec166590 2024-09-10T05:37:34.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.894+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5596ec172660 con 0x5596ec16e230 2024-09-10T05:37:34.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.894+0000 7faecb1fe640 1 -- 172.21.15.62:0/1460364020 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faec000bd60 con 0x5596ec16e230 2024-09-10T05:37:34.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.894+0000 7faecb1fe640 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5596ec172660 con 0x7faec4114040 2024-09-10T05:37:34.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.894+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faebc0083f0 con 0x7faec4114040 2024-09-10T05:37:34.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.894+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5596ec172660 con 0x5596ec166590 2024-09-10T05:37:34.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.894+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faebc0083f0 con 0x5596ec166590 2024-09-10T05:37:34.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.894+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5596ec172660 con 0x7faec4114040 2024-09-10T05:37:34.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.898+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faebc0083f0 con 0x7faec4114040 2024-09-10T05:37:34.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.898+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5596ec172660 con 0x5596ec16e230 2024-09-10T05:37:34.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.898+0000 7faecb1fe640 1 -- 172.21.15.62:0/1460364020 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faec000bd60 con 0x5596ec16e230 2024-09-10T05:37:34.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.898+0000 7faecb1fe640 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5596ec172660 con 0x7faec4114040 2024-09-10T05:37:34.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.898+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faebc0083f0 con 0x7faec4114040 2024-09-10T05:37:34.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.898+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5596ec172660 con 0x5596ec16aa10 2024-09-10T05:37:34.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.898+0000 7faecb9ff640 1 -- 172.21.15.62:0/1460364020 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faec40beca0 con 0x5596ec16aa10 2024-09-10T05:37:34.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.898+0000 7faecb9ff640 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5596ec172660 con 0x5596ec16aa10 2024-09-10T05:37:34.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.898+0000 7faecb9ff640 1 -- 172.21.15.62:0/1460364020 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faec40beca0 con 0x5596ec16aa10 2024-09-10T05:37:34.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.898+0000 7faecb9ff640 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5596ec172660 con 0x5596ec16e230 2024-09-10T05:37:34.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.898+0000 7faecb1fe640 1 -- 172.21.15.62:0/1460364020 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faec000bd60 con 0x5596ec16e230 2024-09-10T05:37:34.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.898+0000 7faecb1fe640 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5596ec172660 con 0x5596ec16aa10 2024-09-10T05:37:34.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.898+0000 7faecb9ff640 1 -- 172.21.15.62:0/1460364020 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7faec40beca0 con 0x5596ec16aa10 2024-09-10T05:37:34.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.898+0000 7faecb9ff640 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5596ec172660 con 0x5596ec16aa10 2024-09-10T05:37:34.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.898+0000 7faecb9ff640 1 -- 172.21.15.62:0/1460364020 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faec40beca0 con 0x5596ec16aa10 2024-09-10T05:37:34.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.898+0000 7faecdef99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:37:34.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.898+0000 7faecdef99c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:37:34.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.898+0000 7faecdef99c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:37:34.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.898+0000 7faecdef99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:37:34.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.898+0000 7faecdef99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:37:34.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.898+0000 7faecdef99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:37:34.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.898+0000 7faecdef99c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.898+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5596ec171780 con 0x5596ec166590 2024-09-10T05:37:34.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.898+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faebc0083f0 con 0x5596ec166590 2024-09-10T05:37:34.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.898+0000 7faecdef99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:34.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.898+0000 7faecdef99c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.898+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5596ec172020 con 0x5596ec16aa10 2024-09-10T05:37:34.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.902+0000 7faecb9ff640 1 -- 172.21.15.62:0/1460364020 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faec40beca0 con 0x5596ec16aa10 2024-09-10T05:37:34.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.902+0000 7faecdef99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:37:34.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.902+0000 7faecdef99c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.902+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5596ec1713c0 con 0x5596ec16e230 2024-09-10T05:37:34.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.902+0000 7faecb1fe640 1 -- 172.21.15.62:0/1460364020 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7faec000bd60 con 0x5596ec16e230 2024-09-10T05:37:34.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.902+0000 7faecdef99c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:37:34.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.902+0000 7faecdef99c0 20 zone default found 2024-09-10T05:37:34.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.902+0000 7faecdef99c0 4 Realm: () 2024-09-10T05:37:34.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.902+0000 7faecdef99c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:37:34.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.902+0000 7faecdef99c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:37:34.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.902+0000 7faecdef99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:37:34.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.902+0000 7faecdef99c0 20 zonegroup default 2024-09-10T05:37:34.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.902+0000 7faecdef99c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.902+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5596ec172f40 con 0x7faec4114040 2024-09-10T05:37:34.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.902+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7faebc0083f0 con 0x7faec4114040 2024-09-10T05:37:34.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.902+0000 7faecdef99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:34.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.902+0000 7faecdef99c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.902+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5596ec175180 con 0x5596ec16e230 2024-09-10T05:37:34.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.902+0000 7faecb1fe640 1 -- 172.21.15.62:0/1460364020 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faec000bd60 con 0x5596ec16e230 2024-09-10T05:37:34.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.902+0000 7faecdef99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:34.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.902+0000 7faecdef99c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.902+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5596ec175520 con 0x5596ec16e230 2024-09-10T05:37:34.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.902+0000 7faecb1fe640 1 -- 172.21.15.62:0/1460364020 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faec000bd60 con 0x5596ec16e230 2024-09-10T05:37:34.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.902+0000 7faecdef99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:34.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.902+0000 7faecdef99c0 20 started sync module instance, tier type = 2024-09-10T05:37:34.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.902+0000 7faecdef99c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:37:34.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.902+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5596ec174660 con 0x5596ec16aa10 2024-09-10T05:37:34.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.906+0000 7faecb9ff640 1 -- 172.21.15.62:0/1460364020 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faec40beca0 con 0x5596ec16aa10 2024-09-10T05:37:34.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.906+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94106694404960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5596ec174660 con 0x5596ec16aa10 2024-09-10T05:37:34.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.906+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5596ec175f90 con 0x5596ec166590 2024-09-10T05:37:34.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.906+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faebc0083f0 con 0x5596ec166590 2024-09-10T05:37:34.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.906+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94106694408864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5596ec176830 con 0x5596ec166590 2024-09-10T05:37:34.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.906+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5596ec177270 con 0x5596ec16aa10 2024-09-10T05:37:34.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.906+0000 7faecb9ff640 1 -- 172.21.15.62:0/1460364020 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94106694404960] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faec40beca0 con 0x5596ec16aa10 2024-09-10T05:37:34.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.906+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94106694408864] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faebc0083f0 con 0x5596ec166590 2024-09-10T05:37:34.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.906+0000 7faecb9ff640 1 -- 172.21.15.62:0/1460364020 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faec40beca0 con 0x5596ec16aa10 2024-09-10T05:37:34.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.906+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94106694413632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5596ec176380 con 0x5596ec16aa10 2024-09-10T05:37:34.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.906+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5596ec177b10 con 0x7faec4114040 2024-09-10T05:37:34.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.910+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faebc0083f0 con 0x7faec4114040 2024-09-10T05:37:34.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.910+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94106694415968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5596ec176380 con 0x7faec4114040 2024-09-10T05:37:34.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.910+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5596ec1785b0 con 0x5596ec16aa10 2024-09-10T05:37:34.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.910+0000 7faecb9ff640 1 -- 172.21.15.62:0/1460364020 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94106694413632] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faec40beca0 con 0x5596ec16aa10 2024-09-10T05:37:34.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.910+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94106694415968] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faebc0083f0 con 0x7faec4114040 2024-09-10T05:37:34.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.910+0000 7faecb9ff640 1 -- 172.21.15.62:0/1460364020 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faec40beca0 con 0x5596ec16aa10 2024-09-10T05:37:34.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.910+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94106694417024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5596ec178570 con 0x5596ec16aa10 2024-09-10T05:37:34.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.910+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5596ec1789d0 con 0x5596ec16e230 2024-09-10T05:37:34.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.914+0000 7faecb1fe640 1 -- 172.21.15.62:0/1460364020 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faec000bd60 con 0x5596ec16e230 2024-09-10T05:37:34.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.914+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94106694402480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5596ec178e80 con 0x5596ec16e230 2024-09-10T05:37:34.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.914+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5596ec179880 con 0x5596ec16e230 2024-09-10T05:37:34.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.914+0000 7faecb9ff640 1 -- 172.21.15.62:0/1460364020 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94106694417024] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faec40beca0 con 0x5596ec16aa10 2024-09-10T05:37:34.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.914+0000 7faecb1fe640 1 -- 172.21.15.62:0/1460364020 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(56 notify.6 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faec000bd60 con 0x5596ec16e230 2024-09-10T05:37:34.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.914+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94106694418592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5596ec179840 con 0x5596ec16e230 2024-09-10T05:37:34.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.914+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5596ec17a2b0 con 0x7faec4114040 2024-09-10T05:37:34.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.914+0000 7faecb1fe640 1 -- 172.21.15.62:0/1460364020 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94106694402480] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faec000bd60 con 0x5596ec16e230 2024-09-10T05:37:34.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.914+0000 7faecb1fe640 1 -- 172.21.15.62:0/1460364020 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94106694418592] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faec000bd60 con 0x5596ec16e230 2024-09-10T05:37:34.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.918+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faebc0083f0 con 0x7faec4114040 2024-09-10T05:37:34.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.918+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94106694426080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5596ec179390 con 0x7faec4114040 2024-09-10T05:37:34.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.918+0000 7faecdef99c0 20 add_watcher() i=0 2024-09-10T05:37:34.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.918+0000 7faecdef99c0 20 add_watcher() i=1 2024-09-10T05:37:34.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.918+0000 7faecdef99c0 20 add_watcher() i=2 2024-09-10T05:37:34.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.918+0000 7faecdef99c0 20 add_watcher() i=3 2024-09-10T05:37:34.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.918+0000 7faecdef99c0 20 add_watcher() i=4 2024-09-10T05:37:34.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.918+0000 7faecdef99c0 20 add_watcher() i=5 2024-09-10T05:37:34.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.918+0000 7faecdef99c0 20 add_watcher() i=6 2024-09-10T05:37:34.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.918+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94106694426080] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faebc0083f0 con 0x7faec4114040 2024-09-10T05:37:34.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.918+0000 7faecdef99c0 20 add_watcher() i=7 2024-09-10T05:37:34.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.918+0000 7faecdef99c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:37:34.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.918+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5596ec179390 con 0x5596ec166590 2024-09-10T05:37:34.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.918+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7faebc0083f0 con 0x5596ec166590 2024-09-10T05:37:34.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.918+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94106694420944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5596ec17ab00 con 0x5596ec166590 2024-09-10T05:37:34.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.918+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94106694420944] v32'216 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faebc0083f0 con 0x5596ec166590 2024-09-10T05:37:34.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.922+0000 7fad81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:37:34.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.922+0000 7faecdef99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:37:34.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.922+0000 7faecdef99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:37:34.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.922+0000 7faecdef99c0 5 note: GC not initialized 2024-09-10T05:37:34.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.922+0000 7fad80fe1640 20 reqs_thread_entry: start 2024-09-10T05:37:34.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.922+0000 7faecdef99c0 20 init_complete bucket index max shards: 11 2024-09-10T05:37:34.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.922+0000 7faecdef99c0 20 Filter name: none 2024-09-10T05:37:34.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.922+0000 7facfa7fc640 20 reqs_thread_entry: start 2024-09-10T05:37:34.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.922+0000 7faecdef99c0 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-10T05:37:34.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.922+0000 7faecdef99c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.922+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5596ec1a05a0 con 0x7faec4114040 2024-09-10T05:37:34.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.922+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7faebc0083f0 con 0x7faec4114040 2024-09-10T05:37:34.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.922+0000 7faecdef99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:34.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.922+0000 7faecdef99c0 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-10T05:37:34.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.922+0000 7faecdef99c0 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-10T05:37:34.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.922+0000 7faecdef99c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-10T05:37:34.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.922+0000 7faecdef99c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:34.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.922+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:63 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5596ec19ec40 con 0x5596ec166590 2024-09-10T05:37:34.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.922+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(63 NX5QOQKC6BH2IDN8HC7A [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7faebc0083f0 con 0x5596ec166590 2024-09-10T05:37:34.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.922+0000 7faecdef99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:34.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.922+0000 7faecdef99c0 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-09-10T05:37:34.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.922+0000 7faecdef99c0 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-10T05:37:34.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.922+0000 7faecdef99c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-10T05:37:34.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.922+0000 7faecdef99c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-10T05:37:34.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.922+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:64 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5596ec19f510 con 0x7faec4114040 2024-09-10T05:37:34.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.926+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(64 bar [delete,create,call,writefull 0~380] v32'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7faebc0083f0 con 0x7faec4114040 2024-09-10T05:37:34.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.926+0000 7faecdef99c0 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-10T05:37:34.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.926+0000 7faecdef99c0 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-10T05:37:34.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.926+0000 7faecdef99c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-10T05:37:34.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.926+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:65 7.9 7:93e5b521:::notify.7:head [notify cookie 94106694578272 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5596ec1a4040 con 0x7faec4114040 2024-09-10T05:37:34.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.926+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== watch-notify(notify (1) cookie 94106694426080 notify 137438953482 ret 0) ==== 598+0+0 (crc 0 0 0) 0x5596ec19f8b0 con 0x7faec4114040 2024-09-10T05:37:34.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.926+0000 7fadaaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953482 cookie 94106694426080 notifier 4724 bl.length()=556 2024-09-10T05:37:34.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.926+0000 7fadaaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-10T05:37:34.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.926+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 <== osd.2 v2:172.21.15.62:6800/2677868286 15 ==== osd_op_reply(65 notify.7 [notify cookie 94106694578272 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7faebc0083f0 con 0x7faec4114040 2024-09-10T05:37:34.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.926+0000 7fadaaffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-10T05:37:34.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.926+0000 7fadaaffd640 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:66 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fad90003eb0 con 0x7faec4114040 2024-09-10T05:37:34.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.926+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 <== osd.2 v2:172.21.15.62:6800/2677868286 16 ==== osd_op_reply(66 notify.7 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faebc0083f0 con 0x7faec4114040 2024-09-10T05:37:34.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.926+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 <== osd.2 v2:172.21.15.62:6800/2677868286 17 ==== watch-notify(notify_complete (2) cookie 94106694578272 notify 137438953482 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5596ec19fef0 con 0x7faec4114040 2024-09-10T05:37:34.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.926+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:67 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5596ec1a1b40 con 0x5596ec166590 2024-09-10T05:37:34.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.926+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(67 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v32'3 uv3 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7faebc0083f0 con 0x5596ec166590 2024-09-10T05:37:34.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.926+0000 7faecdef99c0 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-10T05:37:34.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.926+0000 7faecdef99c0 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-10T05:37:34.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.926+0000 7faecdef99c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-10T05:37:34.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.926+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94106694578128 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5596ec1a4010 con 0x5596ec16e230 2024-09-10T05:37:34.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.926+0000 7faecb1fe640 1 -- 172.21.15.62:0/1460364020 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== watch-notify(notify (1) cookie 94106694402480 notify 137438953501 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7faec0018040 con 0x5596ec16e230 2024-09-10T05:37:34.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.926+0000 7fadaaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953501 cookie 94106694402480 notifier 4724 bl.length()=177 2024-09-10T05:37:34.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.926+0000 7fadaaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-10T05:37:34.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.926+0000 7fadaaffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-10T05:37:34.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.926+0000 7faecb1fe640 1 -- 172.21.15.62:0/1460364020 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(68 notify.5 [notify cookie 94106694578128 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7faec000bd60 con 0x5596ec16e230 2024-09-10T05:37:34.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.926+0000 7fadaaffd640 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fad90003eb0 con 0x5596ec16e230 2024-09-10T05:37:34.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.926+0000 7faecb1fe640 1 -- 172.21.15.62:0/1460364020 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faec000bd60 con 0x5596ec16e230 2024-09-10T05:37:34.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.926+0000 7faecb1fe640 1 -- 172.21.15.62:0/1460364020 <== osd.3 v2:172.21.15.62:6816/2708991149 19 ==== watch-notify(notify_complete (2) cookie 94106694578128 notify 137438953501 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5596ebee99c0 con 0x5596ec16e230 2024-09-10T05:37:34.934 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"bar","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bar","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-10T05:37:34.927483Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:37:34.927459Z","tags":[],"group_ids":[]} 2024-09-10T05:37:34.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.930+0000 7fad81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:37:34.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.930+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94106694420944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5596ec19e320 con 0x5596ec166590 2024-09-10T05:37:34.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.930+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94106694420944] v32'217 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faebc0083f0 con 0x5596ec166590 2024-09-10T05:37:34.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.930+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94106694404960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5596ec19e320 con 0x5596ec16aa10 2024-09-10T05:37:34.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.934+0000 7faecb9ff640 1 -- 172.21.15.62:0/1460364020 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94106694404960] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faec40beca0 con 0x5596ec16aa10 2024-09-10T05:37:34.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.934+0000 7faecdef99c0 20 remove_watcher() i=0 2024-09-10T05:37:34.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.934+0000 7faecdef99c0 2 removed watcher, disabling cache 2024-09-10T05:37:34.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.934+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94106694408864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5596ec19e320 con 0x5596ec166590 2024-09-10T05:37:34.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.934+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94106694408864] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faebc0083f0 con 0x5596ec166590 2024-09-10T05:37:34.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.934+0000 7faecdef99c0 20 remove_watcher() i=1 2024-09-10T05:37:34.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.934+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94106694413632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5596ec19e320 con 0x5596ec16aa10 2024-09-10T05:37:34.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.938+0000 7faecb9ff640 1 -- 172.21.15.62:0/1460364020 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94106694413632] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faec40beca0 con 0x5596ec16aa10 2024-09-10T05:37:34.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.938+0000 7faecdef99c0 20 remove_watcher() i=2 2024-09-10T05:37:34.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.938+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94106694415968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5596ec19e320 con 0x7faec4114040 2024-09-10T05:37:34.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.938+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 <== osd.2 v2:172.21.15.62:6800/2677868286 18 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94106694415968] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faebc0083f0 con 0x7faec4114040 2024-09-10T05:37:34.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.938+0000 7faecdef99c0 20 remove_watcher() i=3 2024-09-10T05:37:34.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.938+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94106694417024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5596ec19e320 con 0x5596ec16aa10 2024-09-10T05:37:34.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.942+0000 7faecb9ff640 1 -- 172.21.15.62:0/1460364020 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94106694417024] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faec40beca0 con 0x5596ec16aa10 2024-09-10T05:37:34.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.942+0000 7faecdef99c0 20 remove_watcher() i=4 2024-09-10T05:37:34.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.942+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94106694402480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5596ec19e320 con 0x5596ec16e230 2024-09-10T05:37:34.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.942+0000 7faecb1fe640 1 -- 172.21.15.62:0/1460364020 <== osd.3 v2:172.21.15.62:6816/2708991149 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94106694402480] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faec000bd60 con 0x5596ec16e230 2024-09-10T05:37:34.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.942+0000 7faecdef99c0 20 remove_watcher() i=5 2024-09-10T05:37:34.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.942+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94106694418592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5596ec19e320 con 0x5596ec16e230 2024-09-10T05:37:34.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.942+0000 7faecb1fe640 1 -- 172.21.15.62:0/1460364020 <== osd.3 v2:172.21.15.62:6816/2708991149 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94106694418592] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faec000bd60 con 0x5596ec16e230 2024-09-10T05:37:34.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.942+0000 7faecdef99c0 20 remove_watcher() i=6 2024-09-10T05:37:34.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.942+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94106694426080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5596ec19e320 con 0x7faec4114040 2024-09-10T05:37:34.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.946+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 <== osd.2 v2:172.21.15.62:6800/2677868286 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94106694426080] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faebc0083f0 con 0x7faec4114040 2024-09-10T05:37:34.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.946+0000 7faecdef99c0 20 remove_watcher() i=7 2024-09-10T05:37:34.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.946+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5596ec16aa10 msgr2=0x5596ec16ce00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.946+0000 7faecdef99c0 1 --2- 172.21.15.62:0/1460364020 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5596ec16aa10 0x5596ec16ce00 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.946+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5596ec166590 msgr2=0x5596ec168a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.946+0000 7faecdef99c0 1 --2- 172.21.15.62:0/1460364020 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5596ec166590 0x5596ec168a20 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.946+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7faec4114040 msgr2=0x7faec4004830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.946+0000 7faecdef99c0 1 --2- 172.21.15.62:0/1460364020 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7faec4114040 0x7faec4004830 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.946+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5596ec16e230 msgr2=0x5596ec170620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.946+0000 7faecdef99c0 1 --2- 172.21.15.62:0/1460364020 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5596ec16e230 0x5596ec170620 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.946+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fad94039a70 msgr2=0x7fad9403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.946+0000 7faecdef99c0 1 --2- 172.21.15.62:0/1460364020 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fad94039a70 0x7fad9403bf30 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x5596ec135900 tx=0x7faec0010000 comp rx=0 tx=0).stop 2024-09-10T05:37:34.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.946+0000 7faecc200640 1 -- 172.21.15.62:0/1460364020 reap_dead start 2024-09-10T05:37:34.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.946+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596ec154330 msgr2=0x5596ec15b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.946+0000 7faecdef99c0 1 --2- 172.21.15.62:0/1460364020 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596ec154330 0x5596ec15b660 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7faec40d1fd0 tx=0x7faec40d1f60 comp rx=0 tx=0).stop 2024-09-10T05:37:34.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.946+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 shutdown_connections 2024-09-10T05:37:34.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.946+0000 7faecdef99c0 1 --2- 172.21.15.62:0/1460364020 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596ec154330 0x5596ec15b660 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.946+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 >> 172.21.15.62:0/1460364020 conn(0x5596ec150760 msgr2=0x5596ec14e970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:34.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.946+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 shutdown_connections 2024-09-10T05:37:34.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.946+0000 7faecdef99c0 1 -- 172.21.15.62:0/1460364020 wait complete. 2024-09-10T05:37:34.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.946+0000 7faecdef99c0 1 -- 172.21.15.62:0/1045244853 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fada4039ac0 msgr2=0x7fada403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.946+0000 7faecdef99c0 1 --2- 172.21.15.62:0/1045244853 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fada4039ac0 0x7fada403bf80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x5596ec135cd0 tx=0x7faec000f000 comp rx=0 tx=0).stop 2024-09-10T05:37:34.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.946+0000 7faecdef99c0 1 -- 172.21.15.62:0/1045244853 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596ec147c20 msgr2=0x5596ec148040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.946+0000 7faecdef99c0 1 --2- 172.21.15.62:0/1045244853 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596ec147c20 0x5596ec148040 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7faec40ea010 tx=0x7faec40c4e40 comp rx=0 tx=0).stop 2024-09-10T05:37:34.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.946+0000 7faecdef99c0 1 -- 172.21.15.62:0/1045244853 shutdown_connections 2024-09-10T05:37:34.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.946+0000 7faecdef99c0 1 --2- 172.21.15.62:0/1045244853 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fada4039ac0 0x7fada403bf80 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.946+0000 7faecdef99c0 1 --2- 172.21.15.62:0/1045244853 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596ec147c20 0x5596ec148040 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.946+0000 7faecdef99c0 1 -- 172.21.15.62:0/1045244853 >> 172.21.15.62:0/1045244853 conn(0x5596ec13d5d0 msgr2=0x5596ec13d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:34.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.946+0000 7faecdef99c0 1 -- 172.21.15.62:0/1045244853 shutdown_connections 2024-09-10T05:37:34.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.946+0000 7faecdef99c0 1 -- 172.21.15.62:0/1045244853 wait complete. 2024-09-10T05:37:34.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.946+0000 7faecdef99c0 1 -- 172.21.15.62:0/2319201854 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5596ec1320a0 msgr2=0x5596ec134560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.946+0000 7faecdef99c0 1 --2- 172.21.15.62:0/2319201854 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5596ec1320a0 0x5596ec134560 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.946+0000 7faecdef99c0 1 -- 172.21.15.62:0/2319201854 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5596ec03a060 msgr2=0x5596ec131040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.946+0000 7faecdef99c0 1 --2- 172.21.15.62:0/2319201854 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5596ec03a060 0x5596ec131040 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.946+0000 7faecdef99c0 1 -- 172.21.15.62:0/2319201854 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5596ec136a90 msgr2=0x5596ec138e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.946+0000 7faecdef99c0 1 --2- 172.21.15.62:0/2319201854 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5596ec136a90 0x5596ec138e80 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.946+0000 7faecdef99c0 1 -- 172.21.15.62:0/2319201854 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fadb4039a70 msgr2=0x7fadb403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.946+0000 7faecdef99c0 1 --2- 172.21.15.62:0/2319201854 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fadb4039a70 0x7fadb403bf30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7faec0001e40 tx=0x7faec00013a0 comp rx=0 tx=0).stop 2024-09-10T05:37:34.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.946+0000 7faecdef99c0 1 -- 172.21.15.62:0/2319201854 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596ec037730 msgr2=0x5596ec129ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:34.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.946+0000 7faecdef99c0 1 --2- 172.21.15.62:0/2319201854 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596ec037730 0x5596ec129ed0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7faec4003430 tx=0x7faec4017e30 comp rx=0 tx=0).stop 2024-09-10T05:37:34.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.946+0000 7faecc200640 1 -- 172.21.15.62:0/2319201854 reap_dead start 2024-09-10T05:37:34.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.946+0000 7faecdef99c0 1 -- 172.21.15.62:0/2319201854 shutdown_connections 2024-09-10T05:37:34.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.946+0000 7faecdef99c0 1 -- 172.21.15.62:0/2319201854 >> 172.21.15.62:0/2319201854 conn(0x5596ebfaaac0 msgr2=0x5596ec11d080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:34.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.946+0000 7faecdef99c0 1 -- 172.21.15.62:0/2319201854 shutdown_connections 2024-09-10T05:37:34.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:34.946+0000 7faecdef99c0 1 -- 172.21.15.62:0/2319201854 wait complete. 2024-09-10T05:37:34.962 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-10T05:37:34.927483Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:37:34.927459Z', 'tags': [], 'group_ids': []} 2024-09-10T05:37:34.981 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2024-09-10T05:37:34.988 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2024-09-10T05:37:34.988 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-10T05:37:34.988 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-10T05:37:34.988 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2024-09-10T05:37:35.035 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:37:35.035 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:37:35.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.030+0000 7f101f6ea9c0 1 Processor -- start 2024-09-10T05:37:35.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.030+0000 7f101f6ea9c0 1 -- start start 2024-09-10T05:37:35.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.030+0000 7f101f6ea9c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x560c321b5fa0 0x560c321b6380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:35.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.030+0000 7f101f6ea9c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560c3206a9c0 con 0x560c321b9130 2024-09-10T05:37:35.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.030+0000 7f101f6ea9c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x560c320ba6d0 con 0x560c321b5fa0 2024-09-10T05:37:35.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.034+0000 7f101d1f0640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x560c321b5fa0 0x560c321b6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:35.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.034+0000 7f101d1f0640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x560c321b5fa0 0x560c321b6380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:58380/0 (socket says 172.21.15.62:58380) 2024-09-10T05:37:35.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.034+0000 7f101d1f0640 1 -- 172.21.15.62:0/3366865092 learned_addr learned my addr 172.21.15.62:0/3366865092 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:35.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.034+0000 7f101d1f0640 1 -- 172.21.15.62:0/3366865092 >> v1:172.21.15.2:6789/0 conn(0x560c321b9130 legacy=0x560c321bb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:35.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.034+0000 7f101d1f0640 1 -- 172.21.15.62:0/3366865092 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c3205eca0 con 0x560c321b5fa0 2024-09-10T05:37:35.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.034+0000 7f101d1f0640 1 --2- 172.21.15.62:0/3366865092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c321b5fa0 0x560c321b6380 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f101800a4e0 tx=0x7f101801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cdc2489de5789ec server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:35.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.034+0000 7f1017fff640 1 -- 172.21.15.62:0/3366865092 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10180aa540 con 0x560c321b5fa0 2024-09-10T05:37:35.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.034+0000 7f1017fff640 1 -- 172.21.15.62:0/3366865092 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10180aa6e0 con 0x560c321b5fa0 2024-09-10T05:37:35.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.034+0000 7f1017fff640 1 -- 172.21.15.62:0/3366865092 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10180aaa40 con 0x560c321b5fa0 2024-09-10T05:37:35.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.034+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/3366865092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c321b5fa0 msgr2=0x560c321b6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:35.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.034+0000 7f101f6ea9c0 1 --2- 172.21.15.62:0/3366865092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c321b5fa0 0x560c321b6380 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f101800a4e0 tx=0x7f101801b090 comp rx=0 tx=0).stop 2024-09-10T05:37:35.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.034+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/3366865092 shutdown_connections 2024-09-10T05:37:35.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.034+0000 7f101f6ea9c0 1 --2- 172.21.15.62:0/3366865092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c321b5fa0 0x560c321b6380 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:35.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.034+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/3366865092 >> 172.21.15.62:0/3366865092 conn(0x560c321b1ac0 msgr2=0x560c321b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:35.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.034+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/3366865092 shutdown_connections 2024-09-10T05:37:35.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.034+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/3366865092 wait complete. 2024-09-10T05:37:35.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.050+0000 7f101f6ea9c0 1 Processor -- start 2024-09-10T05:37:35.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.050+0000 7f101f6ea9c0 1 -- start start 2024-09-10T05:37:35.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.050+0000 7f101f6ea9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c321b5fa0 0x560c322a1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:35.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.050+0000 7f101f6ea9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560c320be680 con 0x560c321b5fa0 2024-09-10T05:37:35.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.050+0000 7f101d1f0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c321b5fa0 0x560c322a1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:35.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.050+0000 7f101d1f0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c321b5fa0 0x560c322a1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:58392/0 (socket says 172.21.15.62:58392) 2024-09-10T05:37:35.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.050+0000 7f101d1f0640 1 -- 172.21.15.62:0/679059350 learned_addr learned my addr 172.21.15.62:0/679059350 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:35.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.050+0000 7f101d1f0640 1 -- 172.21.15.62:0/679059350 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c32039da0 con 0x560c321b5fa0 2024-09-10T05:37:35.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.050+0000 7f101d1f0640 1 --2- 172.21.15.62:0/679059350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c321b5fa0 0x560c322a1680 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f1018017ca0 tx=0x7f10180033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ae8b34c5b0456de server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:35.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.050+0000 7f0f0a614640 1 -- 172.21.15.62:0/679059350 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10180b9030 con 0x560c321b5fa0 2024-09-10T05:37:35.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.050+0000 7f0f0a614640 1 -- 172.21.15.62:0/679059350 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10180aaa80 con 0x560c321b5fa0 2024-09-10T05:37:35.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.050+0000 7f0f0a614640 1 -- 172.21.15.62:0/679059350 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10180aada0 con 0x560c321b5fa0 2024-09-10T05:37:35.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.054+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/679059350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c321b5fa0 msgr2=0x560c322a1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:35.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.054+0000 7f101f6ea9c0 1 --2- 172.21.15.62:0/679059350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c321b5fa0 0x560c322a1680 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f1018017ca0 tx=0x7f10180033b0 comp rx=0 tx=0).stop 2024-09-10T05:37:35.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.054+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/679059350 shutdown_connections 2024-09-10T05:37:35.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.054+0000 7f101f6ea9c0 1 --2- 172.21.15.62:0/679059350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c321b5fa0 0x560c322a1680 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:35.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.054+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/679059350 >> 172.21.15.62:0/679059350 conn(0x560c321b1ac0 msgr2=0x560c3229d320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:35.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.054+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/679059350 shutdown_connections 2024-09-10T05:37:35.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.054+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/679059350 wait complete. 2024-09-10T05:37:35.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.054+0000 7f101f6ea9c0 1 Processor -- start 2024-09-10T05:37:35.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.054+0000 7f101f6ea9c0 1 -- start start 2024-09-10T05:37:35.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.054+0000 7f101f6ea9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c321b5fa0 0x560c322a8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:35.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.054+0000 7f101f6ea9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560c32060a50 con 0x560c321b5fa0 2024-09-10T05:37:35.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.054+0000 7f101d1f0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c321b5fa0 0x560c322a8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:35.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.054+0000 7f101d1f0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c321b5fa0 0x560c322a8c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:58396/0 (socket says 172.21.15.62:58396) 2024-09-10T05:37:35.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.054+0000 7f101d1f0640 1 -- 172.21.15.62:0/1314732448 learned_addr learned my addr 172.21.15.62:0/1314732448 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:35.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.054+0000 7f101d1f0640 1 -- 172.21.15.62:0/1314732448 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c322a91e0 con 0x560c321b5fa0 2024-09-10T05:37:35.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.054+0000 7f101d1f0640 1 --2- 172.21.15.62:0/1314732448 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c321b5fa0 0x560c322a8c80 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f1018017ca0 tx=0x7f1018017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:35.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.054+0000 7f0f08e11640 1 -- 172.21.15.62:0/1314732448 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10180b9070 con 0x560c321b5fa0 2024-09-10T05:37:35.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.054+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/1314732448 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560c322a9470 con 0x560c321b5fa0 2024-09-10T05:37:35.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.054+0000 7f0f08e11640 1 -- 172.21.15.62:0/1314732448 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10180c3030 con 0x560c321b5fa0 2024-09-10T05:37:35.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.054+0000 7f0f08e11640 1 -- 172.21.15.62:0/1314732448 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10180b5bf0 con 0x560c321b5fa0 2024-09-10T05:37:35.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.054+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/1314732448 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c322a9e20 con 0x560c321b5fa0 2024-09-10T05:37:35.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.054+0000 7f0f08e11640 1 -- 172.21.15.62:0/1314732448 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f10180b3040 con 0x560c321b5fa0 2024-09-10T05:37:35.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.054+0000 7f0f08e11640 1 --2- 172.21.15.62:0/1314732448 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0f04039a70 0x7f0f0403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:35.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.058+0000 7f0f08e11640 1 -- 172.21.15.62:0/1314732448 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7f10180ba070 con 0x560c321b5fa0 2024-09-10T05:37:35.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.058+0000 7f101c9ef640 1 --2- 172.21.15.62:0/1314732448 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0f04039a70 0x7f0f0403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:35.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.058+0000 7f101f6ea9c0 1 --2- 172.21.15.62:0/1314732448 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560c321b9130 0x560c322afdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:35.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.058+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/1314732448 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c322b0330 con 0x560c321b9130 2024-09-10T05:37:35.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.058+0000 7f101d9f1640 1 --2- 172.21.15.62:0/1314732448 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560c321b9130 0x560c322afdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:35.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.058+0000 7f101c9ef640 1 --2- 172.21.15.62:0/1314732448 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0f04039a70 0x7f0f0403bf30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1008001e60 tx=0x7f10080013e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:35.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.058+0000 7f101d9f1640 1 --2- 172.21.15.62:0/1314732448 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560c321b9130 0x560c322afdf0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:35.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.058+0000 7f101d9f1640 1 -- 172.21.15.62:0/1314732448 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f10100083f0 con 0x560c321b9130 2024-09-10T05:37:35.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.058+0000 7f101f6ea9c0 1 --2- 172.21.15.62:0/1314732448 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x560c322b0de0 0x560c322b3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:35.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.058+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/1314732448 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c322b39f0 con 0x560c322b0de0 2024-09-10T05:37:35.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.058+0000 7f101d1f0640 1 --2- 172.21.15.62:0/1314732448 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x560c322b0de0 0x560c322b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:35.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.058+0000 7f101d1f0640 1 --2- 172.21.15.62:0/1314732448 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x560c322b0de0 0x560c322b3280 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:35.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.058+0000 7f101d1f0640 1 -- 172.21.15.62:0/1314732448 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f10180cf070 con 0x560c322b0de0 2024-09-10T05:37:35.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.058+0000 7f101f6ea9c0 1 --2- 172.21.15.62:0/1314732448 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x560c322b57b0 0x560c322b7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:35.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.058+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/1314732448 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c322b8290 con 0x560c322b57b0 2024-09-10T05:37:35.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.058+0000 7f101c9ef640 1 --2- 172.21.15.62:0/1314732448 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x560c322b57b0 0x560c322b7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:35.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.058+0000 7f101c9ef640 1 --2- 172.21.15.62:0/1314732448 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x560c322b57b0 0x560c322b7ba0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:35.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.058+0000 7f101c9ef640 1 -- 172.21.15.62:0/1314732448 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f100800d040 con 0x560c322b57b0 2024-09-10T05:37:35.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.058+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/1314732448 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c322b4650 con 0x560c322b0de0 2024-09-10T05:37:35.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.062+0000 7f101d1f0640 1 -- 172.21.15.62:0/1314732448 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f10180cf070 con 0x560c322b0de0 2024-09-10T05:37:35.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.062+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/1314732448 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c322b4a70 con 0x560c322b57b0 2024-09-10T05:37:35.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.062+0000 7f101c9ef640 1 -- 172.21.15.62:0/1314732448 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f100800d040 con 0x560c322b57b0 2024-09-10T05:37:35.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.062+0000 7f101f6ea9c0 1 Processor -- start 2024-09-10T05:37:35.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.062+0000 7f101f6ea9c0 1 -- start start 2024-09-10T05:37:35.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.062+0000 7f101f6ea9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c322c6960 0x560c322c6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:35.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.062+0000 7f101f6ea9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560c320cb450 con 0x560c322c6960 2024-09-10T05:37:35.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.062+0000 7f101d1f0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c322c6960 0x560c322c6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:35.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.062+0000 7f101d1f0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c322c6960 0x560c322c6d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:58402/0 (socket says 172.21.15.62:58402) 2024-09-10T05:37:35.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.062+0000 7f101d1f0640 1 -- 172.21.15.62:0/2892236581 learned_addr learned my addr 172.21.15.62:0/2892236581 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:35.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.062+0000 7f101d1f0640 1 -- 172.21.15.62:0/2892236581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c322c73c0 con 0x560c322c6960 2024-09-10T05:37:35.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.062+0000 7f101d1f0640 1 --2- 172.21.15.62:0/2892236581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c322c6960 0x560c322c6d80 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f10180033d0 tx=0x7f10180e82d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:35.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.062+0000 7f0f01ffb640 1 -- 172.21.15.62:0/2892236581 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10180beab0 con 0x560c322c6960 2024-09-10T05:37:35.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.062+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2892236581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560c322c7c20 con 0x560c322c6960 2024-09-10T05:37:35.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.062+0000 7f0f01ffb640 1 -- 172.21.15.62:0/2892236581 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10180e9b10 con 0x560c322c6960 2024-09-10T05:37:35.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.062+0000 7f0f01ffb640 1 -- 172.21.15.62:0/2892236581 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10180e9df0 con 0x560c322c6960 2024-09-10T05:37:35.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.062+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2892236581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c322c7c20 con 0x560c322c6960 2024-09-10T05:37:35.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.066+0000 7f0f01ffb640 1 -- 172.21.15.62:0/2892236581 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f10180e2210 con 0x560c322c6960 2024-09-10T05:37:35.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.066+0000 7f0f01ffb640 1 --2- 172.21.15.62:0/2892236581 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0ef4039ac0 0x7f0ef403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:35.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.066+0000 7f0f01ffb640 1 -- 172.21.15.62:0/2892236581 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7f10180dec10 con 0x560c322c6960 2024-09-10T05:37:35.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.066+0000 7f101c9ef640 1 --2- 172.21.15.62:0/2892236581 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0ef4039ac0 0x7f0ef403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:35.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.066+0000 7f101f6ea9c0 1 Processor -- start 2024-09-10T05:37:35.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.066+0000 7f101f6ea9c0 1 -- start start 2024-09-10T05:37:35.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.066+0000 7f101f6ea9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c322d2f30 0x560c322d3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:35.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.066+0000 7f101f6ea9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560c322a1df0 con 0x560c322d2f30 2024-09-10T05:37:35.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.066+0000 7f101c9ef640 1 --2- 172.21.15.62:0/2892236581 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0ef4039ac0 0x7f0ef403bf80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x560c322b49f0 tx=0x7f1008006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:35.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.066+0000 7f101d1f0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c322d2f30 0x560c322d3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:35.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.066+0000 7f101d1f0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c322d2f30 0x560c322d3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:58418/0 (socket says 172.21.15.62:58418) 2024-09-10T05:37:35.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.066+0000 7f101d1f0640 1 -- 172.21.15.62:0/728228409 learned_addr learned my addr 172.21.15.62:0/728228409 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:35.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.066+0000 7f101d1f0640 1 -- 172.21.15.62:0/728228409 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c322d38e0 con 0x560c322d2f30 2024-09-10T05:37:35.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.066+0000 7f101d1f0640 1 --2- 172.21.15.62:0/728228409 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c322d2f30 0x560c322d3310 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f1018003000 tx=0x7f10180d29a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9efb7ce6a59ebe65 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:35.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.066+0000 7f0efb7fe640 1 -- 172.21.15.62:0/728228409 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10180c8d70 con 0x560c322d2f30 2024-09-10T05:37:35.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.066+0000 7f0efb7fe640 1 -- 172.21.15.62:0/728228409 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10180fa030 con 0x560c322d2f30 2024-09-10T05:37:35.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.066+0000 7f0efb7fe640 1 -- 172.21.15.62:0/728228409 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10180b4850 con 0x560c322d2f30 2024-09-10T05:37:35.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.066+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/728228409 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c322d2f30 msgr2=0x560c322d3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:35.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.066+0000 7f101f6ea9c0 1 --2- 172.21.15.62:0/728228409 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c322d2f30 0x560c322d3310 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f1018003000 tx=0x7f10180d29a0 comp rx=0 tx=0).stop 2024-09-10T05:37:35.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.066+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/728228409 shutdown_connections 2024-09-10T05:37:35.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.066+0000 7f101f6ea9c0 1 --2- 172.21.15.62:0/728228409 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c322d2f30 0x560c322d3310 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:35.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.066+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/728228409 >> 172.21.15.62:0/728228409 conn(0x560c322cf360 msgr2=0x560c322cd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:35.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.066+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/728228409 shutdown_connections 2024-09-10T05:37:35.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.066+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/728228409 wait complete. 2024-09-10T05:37:35.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.066+0000 7f101f6ea9c0 1 Processor -- start 2024-09-10T05:37:35.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.066+0000 7f101f6ea9c0 1 -- start start 2024-09-10T05:37:35.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.066+0000 7f101f6ea9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c322d2f30 0x560c322da220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:35.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.066+0000 7f101f6ea9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560c322d3dc0 con 0x560c322d2f30 2024-09-10T05:37:35.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.066+0000 7f101d1f0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c322d2f30 0x560c322da220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:35.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.066+0000 7f101d1f0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c322d2f30 0x560c322da220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:58434/0 (socket says 172.21.15.62:58434) 2024-09-10T05:37:35.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.066+0000 7f101d1f0640 1 -- 172.21.15.62:0/2223820088 learned_addr learned my addr 172.21.15.62:0/2223820088 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:35.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.070+0000 7f101d1f0640 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c322da780 con 0x560c322d2f30 2024-09-10T05:37:35.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.070+0000 7f101d1f0640 1 --2- 172.21.15.62:0/2223820088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c322d2f30 0x560c322da220 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f10180079b0 tx=0x7f10180acf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:35.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.070+0000 7f0ef9ffb640 1 -- 172.21.15.62:0/2223820088 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f101810e070 con 0x560c322d2f30 2024-09-10T05:37:35.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.070+0000 7f0ef9ffb640 1 -- 172.21.15.62:0/2223820088 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10180fa070 con 0x560c322d2f30 2024-09-10T05:37:35.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.070+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560c322da780 con 0x560c322d2f30 2024-09-10T05:37:35.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.070+0000 7f0ef9ffb640 1 -- 172.21.15.62:0/2223820088 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10180d2aa0 con 0x560c322d2f30 2024-09-10T05:37:35.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.070+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c322dabf0 con 0x560c322d2f30 2024-09-10T05:37:35.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.070+0000 7f0ef9ffb640 1 -- 172.21.15.62:0/2223820088 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1018111070 con 0x560c322d2f30 2024-09-10T05:37:35.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.070+0000 7f0ef9ffb640 1 --2- 172.21.15.62:0/2223820088 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0eec039a20 0x7f0eec03bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:35.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.070+0000 7f101f6ea9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:35.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.070+0000 7f0ef9ffb640 1 -- 172.21.15.62:0/2223820088 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7f1018106070 con 0x560c322d2f30 2024-09-10T05:37:35.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.070+0000 7f101c9ef640 1 --2- 172.21.15.62:0/2223820088 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0eec039a20 0x7f0eec03bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:35.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.070+0000 7f101f6ea9c0 1 --2- 172.21.15.62:0/2223820088 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560c322e5040 0x560c322e74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:35.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.070+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c322e7c20 con 0x560c322e5040 2024-09-10T05:37:35.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.070+0000 7f101d9f1640 1 --2- 172.21.15.62:0/2223820088 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560c322e5040 0x560c322e74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:35.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.070+0000 7f101c9ef640 1 --2- 172.21.15.62:0/2223820088 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0eec039a20 0x7f0eec03bee0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x560c322b4620 tx=0x7f1008011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:35.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.070+0000 7f101d9f1640 1 --2- 172.21.15.62:0/2223820088 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560c322e5040 0x560c322e74d0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:35.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.070+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f10100083f0 con 0x560c322e5040 2024-09-10T05:37:35.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.070+0000 7f101f6ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:35.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.070+0000 7f101f6ea9c0 20 realm 2024-09-10T05:37:35.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.070+0000 7f101f6ea9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:35.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.070+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c322e4430 con 0x560c322e5040 2024-09-10T05:37:35.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.070+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f10100083f0 con 0x560c322e5040 2024-09-10T05:37:35.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.070+0000 7f101f6ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:35.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.070+0000 7f101f6ea9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:37:35.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.070+0000 7f101f6ea9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:35.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.070+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c322e86e0 con 0x560c322e5040 2024-09-10T05:37:35.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.070+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f10100083f0 con 0x560c322e5040 2024-09-10T05:37:35.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.070+0000 7f101f6ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:35.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.070+0000 7f101f6ea9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:35.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.070+0000 7f101f6ea9c0 1 --2- 172.21.15.62:0/2223820088 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x560c322e94c0 0x560c322eb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:35.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.070+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c322ebf80 con 0x560c322e94c0 2024-09-10T05:37:35.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.074+0000 7f101d1f0640 1 --2- 172.21.15.62:0/2223820088 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x560c322e94c0 0x560c322eb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:35.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.074+0000 7f101d1f0640 1 --2- 172.21.15.62:0/2223820088 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x560c322e94c0 0x560c322eb8b0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:35.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.074+0000 7f101d1f0640 1 -- 172.21.15.62:0/2223820088 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1018110030 con 0x560c322e94c0 2024-09-10T05:37:35.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.074+0000 7f101f6ea9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:37:35.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.074+0000 7f101f6ea9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:35.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.074+0000 7f101f6ea9c0 1 --2- 172.21.15.62:0/2223820088 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x560c322ecce0 0x560c322ef0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:35.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.074+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c322ef880 con 0x560c322ecce0 2024-09-10T05:37:35.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.074+0000 7f101c9ef640 1 --2- 172.21.15.62:0/2223820088 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x560c322ecce0 0x560c322ef0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:35.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.074+0000 7f101c9ef640 1 --2- 172.21.15.62:0/2223820088 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x560c322ecce0 0x560c322ef0f0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:35.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.074+0000 7f101c9ef640 1 -- 172.21.15.62:0/2223820088 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f100800d040 con 0x560c322ecce0 2024-09-10T05:37:35.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.074+0000 7f101f6ea9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:37:35.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.074+0000 7f101f6ea9c0 20 searching for the correct realm 2024-09-10T05:37:35.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.074+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c322f1150 con 0x560c322ecce0 2024-09-10T05:37:35.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.074+0000 7f101c9ef640 1 -- 172.21.15.62:0/2223820088 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f100800d040 con 0x560c322ecce0 2024-09-10T05:37:35.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.074+0000 7f101c9ef640 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c322f1150 con 0x560c322e94c0 2024-09-10T05:37:35.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.074+0000 7f101d1f0640 1 -- 172.21.15.62:0/2223820088 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1018110030 con 0x560c322e94c0 2024-09-10T05:37:35.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.074+0000 7f101d1f0640 1 --2- 172.21.15.62:0/2223820088 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f1018113060 0x7f10180a59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:35.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.074+0000 7f101d1f0640 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c322f1150 con 0x7f1018113060 2024-09-10T05:37:35.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.074+0000 7f101d9f1640 1 --2- 172.21.15.62:0/2223820088 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f1018113060 0x7f10180a59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:35.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.074+0000 7f101d9f1640 1 --2- 172.21.15.62:0/2223820088 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f1018113060 0x7f10180a59f0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:35.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.074+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10100083f0 con 0x7f1018113060 2024-09-10T05:37:35.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.078+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c322f1150 con 0x560c322e5040 2024-09-10T05:37:35.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.078+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10100083f0 con 0x560c322e5040 2024-09-10T05:37:35.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.078+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c322f1150 con 0x560c322e5040 2024-09-10T05:37:35.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.078+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10100083f0 con 0x560c322e5040 2024-09-10T05:37:35.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.078+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c322f1150 con 0x560c322ecce0 2024-09-10T05:37:35.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.078+0000 7f101c9ef640 1 -- 172.21.15.62:0/2223820088 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f100800d040 con 0x560c322ecce0 2024-09-10T05:37:35.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.078+0000 7f101c9ef640 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c322f1150 con 0x560c322e5040 2024-09-10T05:37:35.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.078+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10100083f0 con 0x560c322e5040 2024-09-10T05:37:35.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.078+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c322f1150 con 0x560c322e94c0 2024-09-10T05:37:35.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.078+0000 7f101d1f0640 1 -- 172.21.15.62:0/2223820088 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1018110030 con 0x560c322e94c0 2024-09-10T05:37:35.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.078+0000 7f101d1f0640 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c322f1150 con 0x560c322e94c0 2024-09-10T05:37:35.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.078+0000 7f101d1f0640 1 -- 172.21.15.62:0/2223820088 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1018110030 con 0x560c322e94c0 2024-09-10T05:37:35.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.078+0000 7f101d1f0640 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c322f1150 con 0x560c322e5040 2024-09-10T05:37:35.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.078+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10100083f0 con 0x560c322e5040 2024-09-10T05:37:35.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.078+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c322f1150 con 0x7f1018113060 2024-09-10T05:37:35.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.078+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10100083f0 con 0x7f1018113060 2024-09-10T05:37:35.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.078+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c322f1150 con 0x560c322e5040 2024-09-10T05:37:35.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.078+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10100083f0 con 0x560c322e5040 2024-09-10T05:37:35.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.078+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c322f1150 con 0x7f1018113060 2024-09-10T05:37:35.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.078+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f10100083f0 con 0x7f1018113060 2024-09-10T05:37:35.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.078+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c322f1150 con 0x560c322e94c0 2024-09-10T05:37:35.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.082+0000 7f101d1f0640 1 -- 172.21.15.62:0/2223820088 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1018110030 con 0x560c322e94c0 2024-09-10T05:37:35.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.082+0000 7f101d1f0640 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c322f1150 con 0x560c322ecce0 2024-09-10T05:37:35.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.082+0000 7f101c9ef640 1 -- 172.21.15.62:0/2223820088 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f100800d040 con 0x560c322ecce0 2024-09-10T05:37:35.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.082+0000 7f101c9ef640 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c322f1150 con 0x560c322e5040 2024-09-10T05:37:35.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.082+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10100083f0 con 0x560c322e5040 2024-09-10T05:37:35.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.082+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c322f1150 con 0x560c322e94c0 2024-09-10T05:37:35.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.082+0000 7f101d1f0640 1 -- 172.21.15.62:0/2223820088 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1018110030 con 0x560c322e94c0 2024-09-10T05:37:35.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.082+0000 7f101d1f0640 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c322f1150 con 0x560c322ecce0 2024-09-10T05:37:35.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.082+0000 7f101c9ef640 1 -- 172.21.15.62:0/2223820088 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 32 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f100800d040 con 0x560c322ecce0 2024-09-10T05:37:35.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.082+0000 7f101c9ef640 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c322f1150 con 0x560c322e5040 2024-09-10T05:37:35.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.082+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10100083f0 con 0x560c322e5040 2024-09-10T05:37:35.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.082+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c322f1150 con 0x560c322e5040 2024-09-10T05:37:35.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.082+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f10100083f0 con 0x560c322e5040 2024-09-10T05:37:35.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.082+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c322f1150 con 0x560c322e5040 2024-09-10T05:37:35.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.082+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10100083f0 con 0x560c322e5040 2024-09-10T05:37:35.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.082+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c322f1150 con 0x560c322ecce0 2024-09-10T05:37:35.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.082+0000 7f101c9ef640 1 -- 172.21.15.62:0/2223820088 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f100800d040 con 0x560c322ecce0 2024-09-10T05:37:35.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.082+0000 7f101c9ef640 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c322f1150 con 0x7f1018113060 2024-09-10T05:37:35.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.082+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10100083f0 con 0x7f1018113060 2024-09-10T05:37:35.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.082+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c322f1150 con 0x560c322e5040 2024-09-10T05:37:35.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.082+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10100083f0 con 0x560c322e5040 2024-09-10T05:37:35.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.082+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c322f1150 con 0x7f1018113060 2024-09-10T05:37:35.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.082+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10100083f0 con 0x7f1018113060 2024-09-10T05:37:35.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.082+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c322f1150 con 0x560c322ecce0 2024-09-10T05:37:35.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.082+0000 7f101c9ef640 1 -- 172.21.15.62:0/2223820088 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f100800d040 con 0x560c322ecce0 2024-09-10T05:37:35.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.082+0000 7f101c9ef640 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c322f1150 con 0x7f1018113060 2024-09-10T05:37:35.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.086+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10100083f0 con 0x7f1018113060 2024-09-10T05:37:35.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.086+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c322f1150 con 0x560c322e94c0 2024-09-10T05:37:35.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.086+0000 7f101d1f0640 1 -- 172.21.15.62:0/2223820088 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1018110030 con 0x560c322e94c0 2024-09-10T05:37:35.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.086+0000 7f101d1f0640 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c322f1150 con 0x560c322e94c0 2024-09-10T05:37:35.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.086+0000 7f101d1f0640 1 -- 172.21.15.62:0/2223820088 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1018110030 con 0x560c322e94c0 2024-09-10T05:37:35.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.086+0000 7f101d1f0640 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c322f1150 con 0x560c322ecce0 2024-09-10T05:37:35.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.086+0000 7f101c9ef640 1 -- 172.21.15.62:0/2223820088 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f100800d040 con 0x560c322ecce0 2024-09-10T05:37:35.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.086+0000 7f101c9ef640 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c322f1150 con 0x560c322e94c0 2024-09-10T05:37:35.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.086+0000 7f101d1f0640 1 -- 172.21.15.62:0/2223820088 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1018110030 con 0x560c322e94c0 2024-09-10T05:37:35.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.086+0000 7f101d1f0640 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c322f1150 con 0x560c322e94c0 2024-09-10T05:37:35.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.086+0000 7f101d1f0640 1 -- 172.21.15.62:0/2223820088 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1018110030 con 0x560c322e94c0 2024-09-10T05:37:35.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.086+0000 7f101f6ea9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:37:35.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.086+0000 7f101f6ea9c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:37:35.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.086+0000 7f101f6ea9c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:37:35.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.086+0000 7f101f6ea9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:37:35.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.086+0000 7f101f6ea9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:37:35.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.086+0000 7f101f6ea9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:37:35.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.086+0000 7f101f6ea9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:35.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.086+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c322f0270 con 0x560c322e5040 2024-09-10T05:37:35.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.086+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f10100083f0 con 0x560c322e5040 2024-09-10T05:37:35.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.086+0000 7f101f6ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:35.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.086+0000 7f101f6ea9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:35.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.086+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c322f0b10 con 0x560c322e94c0 2024-09-10T05:37:35.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.090+0000 7f101d1f0640 1 -- 172.21.15.62:0/2223820088 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1018110030 con 0x560c322e94c0 2024-09-10T05:37:35.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.090+0000 7f101f6ea9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:37:35.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.090+0000 7f101f6ea9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:35.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.090+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c322efeb0 con 0x560c322ecce0 2024-09-10T05:37:35.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.090+0000 7f101c9ef640 1 -- 172.21.15.62:0/2223820088 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f100800d040 con 0x560c322ecce0 2024-09-10T05:37:35.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.090+0000 7f101f6ea9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:37:35.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.090+0000 7f101f6ea9c0 20 zone default found 2024-09-10T05:37:35.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.090+0000 7f101f6ea9c0 4 Realm: () 2024-09-10T05:37:35.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.090+0000 7f101f6ea9c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:37:35.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.090+0000 7f101f6ea9c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:37:35.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.090+0000 7f101f6ea9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:37:35.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.090+0000 7f101f6ea9c0 20 zonegroup default 2024-09-10T05:37:35.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.090+0000 7f101f6ea9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:35.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.090+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c322f1a30 con 0x7f1018113060 2024-09-10T05:37:35.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.090+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f10100083f0 con 0x7f1018113060 2024-09-10T05:37:35.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.090+0000 7f101f6ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:35.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.090+0000 7f101f6ea9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:35.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.090+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c322f3c70 con 0x560c322ecce0 2024-09-10T05:37:35.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.090+0000 7f101c9ef640 1 -- 172.21.15.62:0/2223820088 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f100800d040 con 0x560c322ecce0 2024-09-10T05:37:35.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.090+0000 7f101f6ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:35.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.090+0000 7f101f6ea9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:35.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.090+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c322f4010 con 0x560c322ecce0 2024-09-10T05:37:35.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.090+0000 7f101c9ef640 1 -- 172.21.15.62:0/2223820088 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f100800d040 con 0x560c322ecce0 2024-09-10T05:37:35.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.090+0000 7f101f6ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:35.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.090+0000 7f101f6ea9c0 20 started sync module instance, tier type = 2024-09-10T05:37:35.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.090+0000 7f101f6ea9c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:37:35.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.090+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c322f30b0 con 0x560c322e94c0 2024-09-10T05:37:35.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.094+0000 7f101d1f0640 1 -- 172.21.15.62:0/2223820088 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1018110030 con 0x560c322e94c0 2024-09-10T05:37:35.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.094+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94610381550752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c322f30b0 con 0x560c322e94c0 2024-09-10T05:37:35.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.094+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c322f48d0 con 0x560c322e5040 2024-09-10T05:37:35.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.094+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10100083f0 con 0x560c322e5040 2024-09-10T05:37:35.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.094+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94610381554720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c322f5120 con 0x560c322e5040 2024-09-10T05:37:35.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.094+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c322f5970 con 0x560c322e94c0 2024-09-10T05:37:35.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.094+0000 7f101d1f0640 1 -- 172.21.15.62:0/2223820088 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94610381550752] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1018110030 con 0x560c322e94c0 2024-09-10T05:37:35.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.094+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94610381554720] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10100083f0 con 0x560c322e5040 2024-09-10T05:37:35.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.094+0000 7f101d1f0640 1 -- 172.21.15.62:0/2223820088 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1018110030 con 0x560c322e94c0 2024-09-10T05:37:35.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.094+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94610381556848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c322f5540 con 0x560c322e94c0 2024-09-10T05:37:35.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.094+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c322f5d90 con 0x7f1018113060 2024-09-10T05:37:35.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.098+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10100083f0 con 0x7f1018113060 2024-09-10T05:37:35.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.098+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94610381559408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c322f6180 con 0x7f1018113060 2024-09-10T05:37:35.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.098+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c322f6c50 con 0x560c322e94c0 2024-09-10T05:37:35.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.098+0000 7f101d1f0640 1 -- 172.21.15.62:0/2223820088 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94610381556848] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1018110030 con 0x560c322e94c0 2024-09-10T05:37:35.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.098+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94610381559408] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10100083f0 con 0x7f1018113060 2024-09-10T05:37:35.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.098+0000 7f101d1f0640 1 -- 172.21.15.62:0/2223820088 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1018110030 con 0x560c322e94c0 2024-09-10T05:37:35.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.098+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94610381563712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c322f6c10 con 0x560c322e94c0 2024-09-10T05:37:35.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.098+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c322f7070 con 0x560c322ecce0 2024-09-10T05:37:35.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.102+0000 7f101c9ef640 1 -- 172.21.15.62:0/2223820088 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f100800d040 con 0x560c322ecce0 2024-09-10T05:37:35.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.102+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94610381560656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c322f7070 con 0x560c322ecce0 2024-09-10T05:37:35.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.102+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c322f7f30 con 0x560c322ecce0 2024-09-10T05:37:35.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.102+0000 7f101d1f0640 1 -- 172.21.15.62:0/2223820088 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94610381563712] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1018110030 con 0x560c322e94c0 2024-09-10T05:37:35.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.102+0000 7f101c9ef640 1 -- 172.21.15.62:0/2223820088 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94610381560656] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f100800d040 con 0x560c322ecce0 2024-09-10T05:37:35.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.102+0000 7f101c9ef640 1 -- 172.21.15.62:0/2223820088 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f100800d040 con 0x560c322ecce0 2024-09-10T05:37:35.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.102+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94610381567072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c322f7a80 con 0x560c322ecce0 2024-09-10T05:37:35.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.102+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c322f7f10 con 0x7f1018113060 2024-09-10T05:37:35.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.102+0000 7f101c9ef640 1 -- 172.21.15.62:0/2223820088 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94610381567072] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f100800d040 con 0x560c322ecce0 2024-09-10T05:37:35.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.102+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10100083f0 con 0x7f1018113060 2024-09-10T05:37:35.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.102+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94610381557904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c322f7ed0 con 0x7f1018113060 2024-09-10T05:37:35.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.102+0000 7f101f6ea9c0 20 add_watcher() i=0 2024-09-10T05:37:35.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.102+0000 7f101f6ea9c0 20 add_watcher() i=1 2024-09-10T05:37:35.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.102+0000 7f101f6ea9c0 20 add_watcher() i=2 2024-09-10T05:37:35.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.102+0000 7f101f6ea9c0 20 add_watcher() i=3 2024-09-10T05:37:35.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.102+0000 7f101f6ea9c0 20 add_watcher() i=4 2024-09-10T05:37:35.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.102+0000 7f101f6ea9c0 20 add_watcher() i=5 2024-09-10T05:37:35.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.102+0000 7f101f6ea9c0 20 add_watcher() i=6 2024-09-10T05:37:35.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.102+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94610381557904] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10100083f0 con 0x7f1018113060 2024-09-10T05:37:35.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.102+0000 7f101f6ea9c0 20 add_watcher() i=7 2024-09-10T05:37:35.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.102+0000 7f101f6ea9c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:37:35.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.102+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c322fb860 con 0x560c322e5040 2024-09-10T05:37:35.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.106+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f10100083f0 con 0x560c322e5040 2024-09-10T05:37:35.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.106+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94610381570848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c322f8df0 con 0x560c322e5040 2024-09-10T05:37:35.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.106+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94610381570848] v32'218 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f10100083f0 con 0x560c322e5040 2024-09-10T05:37:35.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.106+0000 7f0ed27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:37:35.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.106+0000 7f101f6ea9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:37:35.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.106+0000 7f101f6ea9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:37:35.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.106+0000 7f101f6ea9c0 5 note: GC not initialized 2024-09-10T05:37:35.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.106+0000 7f0ed17e2640 20 reqs_thread_entry: start 2024-09-10T05:37:35.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.106+0000 7f101f6ea9c0 20 init_complete bucket index max shards: 11 2024-09-10T05:37:35.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.106+0000 7f101f6ea9c0 20 Filter name: none 2024-09-10T05:37:35.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.106+0000 7f0e42ffd640 20 reqs_thread_entry: start 2024-09-10T05:37:35.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.106+0000 7f101f6ea9c0 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-10T05:37:35.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.106+0000 7f101f6ea9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:35.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.106+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c3231eb00 con 0x7f1018113060 2024-09-10T05:37:35.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.106+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(62 bar [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f10100083f0 con 0x7f1018113060 2024-09-10T05:37:35.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.106+0000 7f101f6ea9c0 20 rados_obj.operate() r=0 bl.length=380 2024-09-10T05:37:35.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.106+0000 7f101f6ea9c0 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2024-09-10T05:37:35.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.106+0000 7f101f6ea9c0 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-10T05:37:35.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.106+0000 7f101f6ea9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:37:35.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.106+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:63 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c32322df0 con 0x7f1018113060 2024-09-10T05:37:35.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.110+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(63 bud [create,call,writefull 0~206] v32'1 uv1 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f10100083f0 con 0x7f1018113060 2024-09-10T05:37:35.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.110+0000 7f101f6ea9c0 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-10T05:37:35.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.110+0000 7f101f6ea9c0 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-10T05:37:35.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.110+0000 7f101f6ea9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-10T05:37:35.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.110+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:64 7.3 7:c609908c:::notify.5:head [notify cookie 94610381740032 in=394b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c32323a40 con 0x560c322ecce0 2024-09-10T05:37:35.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.110+0000 7f101c9ef640 1 -- 172.21.15.62:0/2223820088 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== watch-notify(notify (1) cookie 94610381560656 notify 137438953502 ret 0) ==== 424+0+0 (crc 0 0 0) 0x560c3206a9c0 con 0x560c322ecce0 2024-09-10T05:37:35.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.110+0000 7f0efb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953502 cookie 94610381560656 notifier 4731 bl.length()=382 2024-09-10T05:37:35.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.110+0000 7f101c9ef640 1 -- 172.21.15.62:0/2223820088 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(64 notify.5 [notify cookie 94610381740032 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f100800d040 con 0x560c322ecce0 2024-09-10T05:37:35.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.110+0000 7f0efb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-10T05:37:35.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.110+0000 7f0efb7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-10T05:37:35.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.110+0000 7f0efb7fe640 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0ee0003eb0 con 0x560c322ecce0 2024-09-10T05:37:35.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.110+0000 7f101c9ef640 1 -- 172.21.15.62:0/2223820088 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== osd_op_reply(65 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f100800d040 con 0x560c322ecce0 2024-09-10T05:37:35.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.110+0000 7f101c9ef640 1 -- 172.21.15.62:0/2223820088 <== osd.3 v2:172.21.15.62:6816/2708991149 19 ==== watch-notify(notify_complete (2) cookie 94610381740032 notify 137438953502 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f100802dbc0 con 0x560c322ecce0 2024-09-10T05:37:35.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.110+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:66 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c32323900 con 0x560c322e5040 2024-09-10T05:37:35.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.110+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(66 bar.buckets [call out=184b] v0'0 uv3 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7f10100083f0 con 0x560c322e5040 2024-09-10T05:37:35.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.110+0000 7f101f6ea9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9 : miss 2024-09-10T05:37:35.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.110+0000 7f101f6ea9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:35.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.110+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:67 8.14 8:2c490d8a:root::.bucket.meta.myfoo6%3a475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c32320fe0 con 0x560c322e94c0 2024-09-10T05:37:35.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.110+0000 7f101d1f0640 1 -- 172.21.15.62:0/2223820088 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(67 .bucket.meta.myfoo6:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9 [call out=48b,stat out=16b,read 0~388 out=388b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 333+0+670 (crc 0 0 0) 0x7f1018110030 con 0x560c322e94c0 2024-09-10T05:37:35.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.110+0000 7f101f6ea9c0 20 rados_obj.operate() r=0 bl.length=388 2024-09-10T05:37:35.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.110+0000 7f101f6ea9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9 info.flags=0x17 2024-09-10T05:37:35.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.110+0000 7f101f6ea9c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9 to cache LRU end 2024-09-10T05:37:35.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.110+0000 7f101f6ea9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:37:35.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.110+0000 7f101f6ea9c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T05:37:35.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.110+0000 7f101f6ea9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9 2024-09-10T05:37:35.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.110+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 8.14 8:2c490d8a:root::.bucket.meta.myfoo6%3a475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~388 in=388b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3232a730 con 0x560c322e94c0 2024-09-10T05:37:35.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.114+0000 7f101d1f0640 1 -- 172.21.15.62:0/2223820088 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(68 .bucket.meta.myfoo6:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9 [delete,create,call,call,writefull 0~388,setxattr (117)] v32'4 uv4 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7f1018110030 con 0x560c322e94c0 2024-09-10T05:37:35.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.114+0000 7f101f6ea9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9 info.flags=0x17 2024-09-10T05:37:35.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.114+0000 7f101f6ea9c0 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9 to cache LRU end 2024-09-10T05:37:35.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.114+0000 7f101f6ea9c0 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-10T05:37:35.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.114+0000 7f101f6ea9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9, ofs0, ns] 2024-09-10T05:37:35.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.114+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94610381737024 in=768b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c32324e80 con 0x560c322e94c0 2024-09-10T05:37:35.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.114+0000 7f101d1f0640 1 -- 172.21.15.62:0/2223820088 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== watch-notify(notify (1) cookie 94610381550752 notify 137438953509 ret 0) ==== 798+0+0 (crc 0 0 0) 0x560c323207f0 con 0x560c322e94c0 2024-09-10T05:37:35.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.114+0000 7f0efb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953509 cookie 94610381550752 notifier 4731 bl.length()=756 2024-09-10T05:37:35.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.114+0000 7f0efb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9 info.flags=0x17 2024-09-10T05:37:35.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.114+0000 7f0efb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9 to cache LRU end 2024-09-10T05:37:35.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.114+0000 7f0efb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-10T05:37:35.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.114+0000 7f0efb7fe640 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0ee0003eb0 con 0x560c322e94c0 2024-09-10T05:37:35.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.114+0000 7f101d1f0640 1 -- 172.21.15.62:0/2223820088 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== osd_op_reply(69 notify.0 [notify cookie 94610381737024 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1018110030 con 0x560c322e94c0 2024-09-10T05:37:35.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.118+0000 7f101d1f0640 1 -- 172.21.15.62:0/2223820088 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== watch-notify(notify_complete (2) cookie 94610381737024 notify 137438953509 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f10180e8040 con 0x560c322e94c0 2024-09-10T05:37:35.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.118+0000 7f101d1f0640 1 -- 172.21.15.62:0/2223820088 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(70 notify.0 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1018110030 con 0x560c322e94c0 2024-09-10T05:37:35.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.118+0000 7f101f6ea9c0 20 handle_bi_update(): bucket=:myfoo6[475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9]): orig_sources= new_sources= 2024-09-10T05:37:35.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.118+0000 7f101f6ea9c0 20 handle_bi_update(): bucket=:myfoo6[475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9]): potential sources added=[] removed=[] 2024-09-10T05:37:35.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.118+0000 7f101f6ea9c0 20 handle_bi_update(): bucket=:myfoo6[475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9]): orig_dests= new_dests= 2024-09-10T05:37:35.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.118+0000 7f101f6ea9c0 20 handle_bi_update(): bucket=:myfoo6[475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9]): potential dests added=[] removed=[] 2024-09-10T05:37:35.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.118+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c32329fa0 con 0x560c322e94c0 2024-09-10T05:37:35.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.118+0000 7f101d1f0640 1 -- 172.21.15.62:0/2223820088 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(71 bud.buckets [call] v32'5 uv0 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f1018110030 con 0x560c322e94c0 2024-09-10T05:37:35.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.118+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:72 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c32320c40 con 0x560c322e94c0 2024-09-10T05:37:35.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.122+0000 7f101d1f0640 1 -- 172.21.15.62:0/2223820088 <== osd.0 v2:172.21.15.2:6800/945139080 25 ==== osd_op_reply(72 bud.buckets [call] v32'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f1018110030 con 0x560c322e94c0 2024-09-10T05:37:35.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.122+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:73 8.18 8:1944a257:root::myfoo6:head [delete,create,call version.inc in=38b,writefull 0~166 in=166b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c32320c40 con 0x560c322e5040 2024-09-10T05:37:35.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.122+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(73 myfoo6 [delete,create,call,writefull 0~166] v32'17 uv17 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7f10100083f0 con 0x560c322e5040 2024-09-10T05:37:35.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.122+0000 7f101f6ea9c0 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-10T05:37:35.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.122+0000 7f101f6ea9c0 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-10T05:37:35.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.122+0000 7f101f6ea9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-10T05:37:35.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.122+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [notify cookie 94610381774752 in=328b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c32320c40 con 0x7f1018113060 2024-09-10T05:37:35.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.122+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== watch-notify(notify (1) cookie 94610381559408 notify 137438953484 ret 0) ==== 358+0+0 (crc 0 0 0) 0x560c32322790 con 0x7f1018113060 2024-09-10T05:37:35.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.122+0000 7f0efaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953484 cookie 94610381559408 notifier 4731 bl.length()=316 2024-09-10T05:37:35.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.122+0000 7f0efaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-10T05:37:35.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.122+0000 7f0efaffd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-10T05:37:35.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.122+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.2 v2:172.21.15.62:6800/2677868286 15 ==== osd_op_reply(74 notify.3 [notify cookie 94610381774752 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f10100083f0 con 0x7f1018113060 2024-09-10T05:37:35.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.122+0000 7f0efaffd640 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:75 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0e50003410 con 0x7f1018113060 2024-09-10T05:37:35.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.122+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.2 v2:172.21.15.62:6800/2677868286 16 ==== watch-notify(notify_complete (2) cookie 94610381774752 notify 137438953484 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f101002a9e0 con 0x7f1018113060 2024-09-10T05:37:35.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.122+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.2 v2:172.21.15.62:6800/2677868286 17 ==== osd_op_reply(75 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10100083f0 con 0x7f1018113060 2024-09-10T05:37:35.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.122+0000 7f101f6ea9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9 : hit (requested=0x17, cached=0x17) 2024-09-10T05:37:35.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.122+0000 7f101f6ea9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9 2024-09-10T05:37:35.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.122+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:76 8.14 8:2c490d8a:root::.bucket.meta.myfoo6%3a475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~388 in=388b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c32328360 con 0x560c322e94c0 2024-09-10T05:37:35.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.126+0000 7f101d1f0640 1 -- 172.21.15.62:0/2223820088 <== osd.0 v2:172.21.15.2:6800/945139080 26 ==== osd_op_reply(76 .bucket.meta.myfoo6:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9 [delete,create,call,call,writefull 0~388,setxattr (117)] v32'5 uv5 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7f1018110030 con 0x560c322e94c0 2024-09-10T05:37:35.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.126+0000 7f101f6ea9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9 info.flags=0x17 2024-09-10T05:37:35.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.126+0000 7f101f6ea9c0 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9 to cache LRU end 2024-09-10T05:37:35.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.126+0000 7f101f6ea9c0 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-10T05:37:35.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.126+0000 7f101f6ea9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9, ofs0, ns] 2024-09-10T05:37:35.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.126+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:77 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94610381774752 in=768b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c32325330 con 0x560c322e94c0 2024-09-10T05:37:35.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.126+0000 7f101d1f0640 1 -- 172.21.15.62:0/2223820088 <== osd.0 v2:172.21.15.2:6800/945139080 27 ==== watch-notify(notify (1) cookie 94610381550752 notify 137438953510 ret 0) ==== 798+0+0 (crc 0 0 0) 0x7f10180e8040 con 0x560c322e94c0 2024-09-10T05:37:35.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.126+0000 7f0efaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953510 cookie 94610381550752 notifier 4731 bl.length()=756 2024-09-10T05:37:35.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.130+0000 7f101d1f0640 1 -- 172.21.15.62:0/2223820088 <== osd.0 v2:172.21.15.2:6800/945139080 28 ==== osd_op_reply(77 notify.0 [notify cookie 94610381774752 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1018110030 con 0x560c322e94c0 2024-09-10T05:37:35.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.130+0000 7f0efaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9 info.flags=0x17 2024-09-10T05:37:35.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.130+0000 7f0efaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9 to cache LRU end 2024-09-10T05:37:35.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.130+0000 7f0efaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-10T05:37:35.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.130+0000 7f0efaffd640 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0e500034e0 con 0x560c322e94c0 2024-09-10T05:37:35.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.130+0000 7f101d1f0640 1 -- 172.21.15.62:0/2223820088 <== osd.0 v2:172.21.15.2:6800/945139080 29 ==== watch-notify(notify_complete (2) cookie 94610381774752 notify 137438953510 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560c322a9e20 con 0x560c322e94c0 2024-09-10T05:37:35.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.130+0000 7f101f6ea9c0 20 handle_bi_update(): bucket=:myfoo6[475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9]): orig_sources= new_sources= 2024-09-10T05:37:35.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.130+0000 7f101f6ea9c0 20 handle_bi_update(): bucket=:myfoo6[475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9]): potential sources added=[] removed=[] 2024-09-10T05:37:35.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.130+0000 7f101f6ea9c0 20 handle_bi_update(): bucket=:myfoo6[475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9]): orig_dests= new_dests= 2024-09-10T05:37:35.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.130+0000 7f101f6ea9c0 20 handle_bi_update(): bucket=:myfoo6[475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9]): potential dests added=[] removed=[] 2024-09-10T05:37:35.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.130+0000 7f101d1f0640 1 -- 172.21.15.62:0/2223820088 <== osd.0 v2:172.21.15.2:6800/945139080 30 ==== osd_op_reply(78 notify.0 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1018110030 con 0x560c322e94c0 2024-09-10T05:37:35.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.130+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:79 4.36 4:6e8b42e8:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c32329fa0 con 0x560c322e5040 2024-09-10T05:37:35.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.130+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(79 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.0 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f10100083f0 con 0x560c322e5040 2024-09-10T05:37:35.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.130+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:80 4.10 4:08e659ec:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c32329fa0 con 0x560c322ecce0 2024-09-10T05:37:35.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.130+0000 7f101c9ef640 1 -- 172.21.15.62:0/2223820088 <== osd.3 v2:172.21.15.62:6816/2708991149 20 ==== osd_op_reply(80 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f100800d040 con 0x560c322ecce0 2024-09-10T05:37:35.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.130+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:81 4.1 4:80b79060:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c32329fa0 con 0x7f1018113060 2024-09-10T05:37:35.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.130+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.2 v2:172.21.15.62:6800/2677868286 18 ==== osd_op_reply(81 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.2 [call out=89b] v0'0 uv8 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f10100083f0 con 0x7f1018113060 2024-09-10T05:37:35.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.130+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:82 4.2f 4:f656784c:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c32329fa0 con 0x560c322e5040 2024-09-10T05:37:35.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.130+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(82 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.3 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f10100083f0 con 0x560c322e5040 2024-09-10T05:37:35.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.130+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:83 4.3a 4:5f845990:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c32329fa0 con 0x560c322ecce0 2024-09-10T05:37:35.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.130+0000 7f101c9ef640 1 -- 172.21.15.62:0/2223820088 <== osd.3 v2:172.21.15.62:6816/2708991149 21 ==== osd_op_reply(83 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.4 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f100800d040 con 0x560c322ecce0 2024-09-10T05:37:35.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.130+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:84 4.15 4:a8cf8440:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c32329fa0 con 0x560c322ecce0 2024-09-10T05:37:35.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.130+0000 7f101c9ef640 1 -- 172.21.15.62:0/2223820088 <== osd.3 v2:172.21.15.62:6816/2708991149 22 ==== osd_op_reply(84 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.5 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f100800d040 con 0x560c322ecce0 2024-09-10T05:37:35.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.130+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:85 4.3b 4:de5b2d61:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c32329fa0 con 0x7f1018113060 2024-09-10T05:37:35.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.130+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.2 v2:172.21.15.62:6800/2677868286 19 ==== osd_op_reply(85 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f10100083f0 con 0x7f1018113060 2024-09-10T05:37:35.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.130+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:86 4.31 4:8c900c14:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c32329fa0 con 0x560c322e94c0 2024-09-10T05:37:35.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.134+0000 7f101d1f0640 1 -- 172.21.15.62:0/2223820088 <== osd.0 v2:172.21.15.2:6800/945139080 31 ==== osd_op_reply(86 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.7 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f1018110030 con 0x560c322e94c0 2024-09-10T05:37:35.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.134+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:87 4.33 4:cc3b23f8:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c32329fa0 con 0x7f1018113060 2024-09-10T05:37:35.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.134+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.2 v2:172.21.15.62:6800/2677868286 20 ==== osd_op_reply(87 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.8 [call out=89b] v0'0 uv23 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f10100083f0 con 0x7f1018113060 2024-09-10T05:37:35.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.134+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:88 4.2f 4:f4a045df:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c32329fa0 con 0x560c322e5040 2024-09-10T05:37:35.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.134+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.1 v2:172.21.15.62:6808/3442097179 23 ==== osd_op_reply(88 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.9 [call out=382b] v0'0 uv8 ondisk = 0) ==== 194+0+382 (crc 0 0 0) 0x7f1010048040 con 0x560c322e5040 2024-09-10T05:37:35.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.134+0000 7f101f6ea9c0 10 cls_bucket_list_unordered: got thirteen 2024-09-10T05:37:35.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.134+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:89 4.37 4:efeaefdd:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c32329fa0 con 0x7f1018113060 2024-09-10T05:37:35.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.134+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.2 v2:172.21.15.62:6800/2677868286 21 ==== osd_op_reply(89 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f1010048040 con 0x7f1018113060 2024-09-10T05:37:35.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.134+0000 7f101f6ea9c0 20 get_obj_state: octx=0x7f1010008b20 obj=myfoo6:thirteen state=0x560c32329178 s->prefetch_data=0 2024-09-10T05:37:35.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.134+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:90 3.1f 3:f9774cdb:::475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c32329fa0 con 0x560c322e5040 2024-09-10T05:37:35.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.134+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.1 v2:172.21.15.62:6808/3442097179 24 ==== osd_op_reply(90 475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9_thirteen [getxattrs out=856b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 238+0+872 (crc 0 0 0) 0x7f1010048040 con 0x560c322e5040 2024-09-10T05:37:35.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.134+0000 7f101f6ea9c0 10 manifest: total_size = 8 2024-09-10T05:37:35.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.134+0000 7f101f6ea9c0 20 get_obj_state: setting s->obj_tag to 475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.17681654890437807999 2024-09-10T05:37:35.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.134+0000 7f101f6ea9c0 20 Read xattr rgw_rados: user.rgw.acl 2024-09-10T05:37:35.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.134+0000 7f101f6ea9c0 20 Read xattr rgw_rados: user.rgw.content_type 2024-09-10T05:37:35.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.134+0000 7f101f6ea9c0 20 Read xattr rgw_rados: user.rgw.etag 2024-09-10T05:37:35.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.134+0000 7f101f6ea9c0 20 Read xattr rgw_rados: user.rgw.idtag 2024-09-10T05:37:35.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.134+0000 7f101f6ea9c0 20 Read xattr rgw_rados: user.rgw.manifest 2024-09-10T05:37:35.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.134+0000 7f101f6ea9c0 20 Read xattr rgw_rados: user.rgw.pg_ver 2024-09-10T05:37:35.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.134+0000 7f101f6ea9c0 20 Read xattr rgw_rados: user.rgw.source_zone 2024-09-10T05:37:35.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.134+0000 7f101f6ea9c0 20 Read xattr rgw_rados: user.rgw.tail_tag 2024-09-10T05:37:35.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.134+0000 7f101f6ea9c0 20 get_obj_state: octx=0x7f1010008b20 obj=myfoo6:thirteen state=0x560c32329178 s->prefetch_data=0 2024-09-10T05:37:35.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.134+0000 7f101f6ea9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9 : hit (requested=0x17, cached=0x17) 2024-09-10T05:37:35.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.134+0000 7f101f6ea9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9 2024-09-10T05:37:35.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.134+0000 7f101f6ea9c0 20 bucket index object: :.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.9 2024-09-10T05:37:35.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.134+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:91 4.2f 4:f4a045df:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c32328360 con 0x560c322e5040 2024-09-10T05:37:35.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.134+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.1 v2:172.21.15.62:6808/3442097179 25 ==== osd_op_reply(91 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.9 [stat,call,call] v32'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f1010048040 con 0x560c322e5040 2024-09-10T05:37:35.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.134+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:92 3.1f 3:f9774cdb:::475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9_thirteen:head [cmpxattr user.rgw.idtag (63) op 1 mode 1 in=77b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c32328360 con 0x560c322e5040 2024-09-10T05:37:35.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.138+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.1 v2:172.21.15.62:6808/3442097179 26 ==== osd_op_reply(92 475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9_thirteen [cmpxattr (63) op 1 mode 1,setxattr (117),setxattr (33)] v32'2 uv2 ondisk = 0) ==== 280+0+0 (crc 0 0 0) 0x7f1010048040 con 0x560c322e5040 2024-09-10T05:37:35.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.138+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:93 4.2f 4:f4a045df:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=323b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3232d2a0 con 0x560c322e5040 2024-09-10T05:37:35.143 INFO:teuthology.orchestra.run.smithi062.stderr:1 objects processed in :myfoo6[475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9]). Next marker thirteen 2024-09-10T05:37:35.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.138+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3232d2a0 con 0x7f1018113060 2024-09-10T05:37:35.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.138+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.2 v2:172.21.15.62:6800/2677868286 22 ==== osd_op_reply(94 bud [delete,create,call,writefull 0~380] v32'2 uv2 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f1010048040 con 0x7f1018113060 2024-09-10T05:37:35.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.138+0000 7f101f6ea9c0 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-10T05:37:35.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.138+0000 7f101f6ea9c0 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-10T05:37:35.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.138+0000 7f101f6ea9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-10T05:37:35.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.138+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [notify cookie 94610381739616 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c3232d880 con 0x560c322ecce0 2024-09-10T05:37:35.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.138+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.1 v2:172.21.15.62:6808/3442097179 27 ==== osd_op_reply(93 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.9 [stat,call,call] v32'10 uv10 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f1010048040 con 0x560c322e5040 2024-09-10T05:37:35.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.138+0000 7f0efaffd640 20 handle_completion(): completion ok for obj=thirteen 2024-09-10T05:37:35.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.138+0000 7f101c9ef640 1 -- 172.21.15.62:0/2223820088 <== osd.3 v2:172.21.15.62:6816/2708991149 23 ==== watch-notify(notify (1) cookie 94610381560656 notify 137438953503 ret 0) ==== 598+0+0 (crc 0 0 0) 0x7f100802dbc0 con 0x560c322ecce0 2024-09-10T05:37:35.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.138+0000 7f0efb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953503 cookie 94610381560656 notifier 4731 bl.length()=556 2024-09-10T05:37:35.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.138+0000 7f0efb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-10T05:37:35.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.138+0000 7f0efb7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-10T05:37:35.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.138+0000 7f0efb7fe640 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:96 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0ee0003eb0 con 0x560c322ecce0 2024-09-10T05:37:35.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.138+0000 7f101c9ef640 1 -- 172.21.15.62:0/2223820088 <== osd.3 v2:172.21.15.62:6816/2708991149 24 ==== osd_op_reply(95 notify.5 [notify cookie 94610381739616 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f100800d040 con 0x560c322ecce0 2024-09-10T05:37:35.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.138+0000 7f101c9ef640 1 -- 172.21.15.62:0/2223820088 <== osd.3 v2:172.21.15.62:6816/2708991149 25 ==== watch-notify(notify_complete (2) cookie 94610381739616 notify 137438953503 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f100802e040 con 0x560c322ecce0 2024-09-10T05:37:35.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.138+0000 7f101c9ef640 1 -- 172.21.15.62:0/2223820088 <== osd.3 v2:172.21.15.62:6816/2708991149 26 ==== osd_op_reply(96 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f100800d040 con 0x560c322ecce0 2024-09-10T05:37:35.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.138+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:97 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c32323330 con 0x560c322e5040 2024-09-10T05:37:35.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.138+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.1 v2:172.21.15.62:6808/3442097179 28 ==== osd_op_reply(97 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v32'4 uv4 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f1010048040 con 0x560c322e5040 2024-09-10T05:37:35.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.138+0000 7f101f6ea9c0 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-10T05:37:35.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.138+0000 7f101f6ea9c0 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-10T05:37:35.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.138+0000 7f101f6ea9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-10T05:37:35.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.138+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify cookie 94610381739616 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c3232cdf0 con 0x560c322ecce0 2024-09-10T05:37:35.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.138+0000 7f101c9ef640 1 -- 172.21.15.62:0/2223820088 <== osd.3 v2:172.21.15.62:6816/2708991149 27 ==== watch-notify(notify (1) cookie 94610381560656 notify 137438953504 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7f100802e040 con 0x560c322ecce0 2024-09-10T05:37:35.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.138+0000 7f0efaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953504 cookie 94610381560656 notifier 4731 bl.length()=177 2024-09-10T05:37:35.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.138+0000 7f101c9ef640 1 -- 172.21.15.62:0/2223820088 <== osd.3 v2:172.21.15.62:6816/2708991149 28 ==== osd_op_reply(98 notify.5 [notify cookie 94610381739616 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f100800d040 con 0x560c322ecce0 2024-09-10T05:37:35.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.138+0000 7f0efaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-10T05:37:35.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.138+0000 7f0efaffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-10T05:37:35.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.138+0000 7f0efaffd640 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:99 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0e500034e0 con 0x560c322ecce0 2024-09-10T05:37:35.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.142+0000 7f101c9ef640 1 -- 172.21.15.62:0/2223820088 <== osd.3 v2:172.21.15.62:6816/2708991149 29 ==== watch-notify(notify_complete (2) cookie 94610381739616 notify 137438953504 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f100802e210 con 0x560c322ecce0 2024-09-10T05:37:35.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.142+0000 7f101c9ef640 1 -- 172.21.15.62:0/2223820088 <== osd.3 v2:172.21.15.62:6816/2708991149 30 ==== osd_op_reply(99 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f100800d040 con 0x560c322ecce0 2024-09-10T05:37:35.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.142+0000 7f101f6ea9c0 10 removing user index: bar 2024-09-10T05:37:35.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.142+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:100 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c32323330 con 0x7f1018113060 2024-09-10T05:37:35.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.142+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.2 v2:172.21.15.62:6800/2677868286 23 ==== osd_op_reply(100 bar [delete] v32'4 uv4 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7f1010048040 con 0x7f1018113060 2024-09-10T05:37:35.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.142+0000 7f101f6ea9c0 10 removing default.rgw.meta+users.uid+bar from cache 2024-09-10T05:37:35.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.142+0000 7f101f6ea9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-10T05:37:35.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.142+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:101 7.9 7:93e5b521:::notify.7:head [notify cookie 94610381739616 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c32328f90 con 0x7f1018113060 2024-09-10T05:37:35.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.142+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.2 v2:172.21.15.62:6800/2677868286 24 ==== watch-notify(notify (1) cookie 94610381557904 notify 137438953485 ret 0) ==== 194+0+0 (crc 0 0 0) 0x560c323284a0 con 0x7f1018113060 2024-09-10T05:37:35.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.142+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.2 v2:172.21.15.62:6800/2677868286 25 ==== osd_op_reply(101 notify.7 [notify cookie 94610381739616 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1010048040 con 0x7f1018113060 2024-09-10T05:37:35.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.142+0000 7f0efaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953485 cookie 94610381557904 notifier 4731 bl.length()=152 2024-09-10T05:37:35.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.142+0000 7f0efaffd640 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0e500034e0 con 0x7f1018113060 2024-09-10T05:37:35.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.142+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.2 v2:172.21.15.62:6800/2677868286 26 ==== watch-notify(notify_complete (2) cookie 94610381739616 notify 137438953485 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560c32320c40 con 0x7f1018113060 2024-09-10T05:37:35.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.142+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.2 v2:172.21.15.62:6800/2677868286 27 ==== osd_op_reply(102 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1010048040 con 0x7f1018113060 2024-09-10T05:37:35.149 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"bud","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bud","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-10T05:37:34.927483Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:37:34.927459Z","tags":[],"group_ids":[]} 2024-09-10T05:37:35.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.142+0000 7f0ed27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:37:35.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.142+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94610381570848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c32328f90 con 0x560c322e5040 2024-09-10T05:37:35.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.146+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.1 v2:172.21.15.62:6808/3442097179 29 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94610381570848] v32'219 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1010048040 con 0x560c322e5040 2024-09-10T05:37:35.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.146+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94610381550752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c322f8320 con 0x560c322e94c0 2024-09-10T05:37:35.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.150+0000 7f101d1f0640 1 -- 172.21.15.62:0/2223820088 <== osd.0 v2:172.21.15.2:6800/945139080 32 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94610381550752] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1018110030 con 0x560c322e94c0 2024-09-10T05:37:35.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.150+0000 7f101f6ea9c0 20 remove_watcher() i=0 2024-09-10T05:37:35.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.150+0000 7f101f6ea9c0 2 removed watcher, disabling cache 2024-09-10T05:37:35.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.150+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94610381554720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c322f8320 con 0x560c322e5040 2024-09-10T05:37:35.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.150+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.1 v2:172.21.15.62:6808/3442097179 30 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94610381554720] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1010048040 con 0x560c322e5040 2024-09-10T05:37:35.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.150+0000 7f101f6ea9c0 20 remove_watcher() i=1 2024-09-10T05:37:35.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.150+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94610381556848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c322f4420 con 0x560c322e94c0 2024-09-10T05:37:35.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.150+0000 7f101d1f0640 1 -- 172.21.15.62:0/2223820088 <== osd.0 v2:172.21.15.2:6800/945139080 33 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94610381556848] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1018110030 con 0x560c322e94c0 2024-09-10T05:37:35.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.150+0000 7f101f6ea9c0 20 remove_watcher() i=2 2024-09-10T05:37:35.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.150+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94610381559408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c322f4c70 con 0x7f1018113060 2024-09-10T05:37:35.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.154+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.2 v2:172.21.15.62:6800/2677868286 28 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94610381559408] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1010048040 con 0x7f1018113060 2024-09-10T05:37:35.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.154+0000 7f101f6ea9c0 20 remove_watcher() i=3 2024-09-10T05:37:35.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.154+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94610381563712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c322f4420 con 0x560c322e94c0 2024-09-10T05:37:35.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.154+0000 7f101d1f0640 1 -- 172.21.15.62:0/2223820088 <== osd.0 v2:172.21.15.2:6800/945139080 34 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94610381563712] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1018110030 con 0x560c322e94c0 2024-09-10T05:37:35.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.154+0000 7f101f6ea9c0 20 remove_watcher() i=4 2024-09-10T05:37:35.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.154+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94610381560656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c322f4c70 con 0x560c322ecce0 2024-09-10T05:37:35.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.154+0000 7f101c9ef640 1 -- 172.21.15.62:0/2223820088 <== osd.3 v2:172.21.15.62:6816/2708991149 31 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94610381560656] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f100800d040 con 0x560c322ecce0 2024-09-10T05:37:35.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.154+0000 7f101f6ea9c0 20 remove_watcher() i=5 2024-09-10T05:37:35.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.154+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94610381567072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c322f6740 con 0x560c322ecce0 2024-09-10T05:37:35.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.158+0000 7f101c9ef640 1 -- 172.21.15.62:0/2223820088 <== osd.3 v2:172.21.15.62:6816/2708991149 32 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94610381567072] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f100800d040 con 0x560c322ecce0 2024-09-10T05:37:35.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.158+0000 7f101f6ea9c0 20 remove_watcher() i=6 2024-09-10T05:37:35.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.158+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94610381557904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c322f4420 con 0x7f1018113060 2024-09-10T05:37:35.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.158+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 <== osd.2 v2:172.21.15.62:6800/2677868286 29 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94610381557904] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1010048040 con 0x7f1018113060 2024-09-10T05:37:35.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.158+0000 7f101f6ea9c0 20 remove_watcher() i=7 2024-09-10T05:37:35.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.158+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x560c322e94c0 msgr2=0x560c322eb8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:35.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.158+0000 7f101f6ea9c0 1 --2- 172.21.15.62:0/2223820088 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x560c322e94c0 0x560c322eb8b0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:35.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.158+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560c322e5040 msgr2=0x560c322e74d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:35.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.158+0000 7f101f6ea9c0 1 --2- 172.21.15.62:0/2223820088 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560c322e5040 0x560c322e74d0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:35.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.158+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f1018113060 msgr2=0x7f10180a59f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:35.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.158+0000 7f101f6ea9c0 1 --2- 172.21.15.62:0/2223820088 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f1018113060 0x7f10180a59f0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:35.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.158+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x560c322ecce0 msgr2=0x560c322ef0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:35.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.158+0000 7f101f6ea9c0 1 --2- 172.21.15.62:0/2223820088 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x560c322ecce0 0x560c322ef0f0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:35.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.158+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0eec039a20 msgr2=0x7f0eec03bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:35.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.158+0000 7f101f6ea9c0 1 --2- 172.21.15.62:0/2223820088 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0eec039a20 0x7f0eec03bee0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x560c322b4620 tx=0x7f1008011000 comp rx=0 tx=0).stop 2024-09-10T05:37:35.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.158+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c322d2f30 msgr2=0x560c322da220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:35.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.158+0000 7f101d9f1640 1 -- 172.21.15.62:0/2223820088 reap_dead start 2024-09-10T05:37:35.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.158+0000 7f101f6ea9c0 1 --2- 172.21.15.62:0/2223820088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c322d2f30 0x560c322da220 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f10180079b0 tx=0x7f10180acf80 comp rx=0 tx=0).stop 2024-09-10T05:37:35.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.158+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 shutdown_connections 2024-09-10T05:37:35.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.158+0000 7f101f6ea9c0 1 --2- 172.21.15.62:0/2223820088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c322d2f30 0x560c322da220 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:35.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.158+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 >> 172.21.15.62:0/2223820088 conn(0x560c322cf360 msgr2=0x560c322cd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:35.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.158+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 shutdown_connections 2024-09-10T05:37:35.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.158+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2223820088 wait complete. 2024-09-10T05:37:35.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.158+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2892236581 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0ef4039ac0 msgr2=0x7f0ef403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:35.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.158+0000 7f101f6ea9c0 1 --2- 172.21.15.62:0/2892236581 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0ef4039ac0 0x7f0ef403bf80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x560c322b49f0 tx=0x7f1008006000 comp rx=0 tx=0).stop 2024-09-10T05:37:35.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.158+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2892236581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c322c6960 msgr2=0x560c322c6d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:35.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.158+0000 7f101f6ea9c0 1 --2- 172.21.15.62:0/2892236581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c322c6960 0x560c322c6d80 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f10180033d0 tx=0x7f10180e82d0 comp rx=0 tx=0).stop 2024-09-10T05:37:35.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.158+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2892236581 shutdown_connections 2024-09-10T05:37:35.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.158+0000 7f101f6ea9c0 1 --2- 172.21.15.62:0/2892236581 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0ef4039ac0 0x7f0ef403bf80 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:35.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.158+0000 7f101f6ea9c0 1 --2- 172.21.15.62:0/2892236581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c322c6960 0x560c322c6d80 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:35.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.158+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2892236581 >> 172.21.15.62:0/2892236581 conn(0x560c322bc310 msgr2=0x560c322bc6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:35.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.158+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2892236581 shutdown_connections 2024-09-10T05:37:35.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.158+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/2892236581 wait complete. 2024-09-10T05:37:35.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.158+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/1314732448 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x560c322b0de0 msgr2=0x560c322b3280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:35.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.158+0000 7f101f6ea9c0 1 --2- 172.21.15.62:0/1314732448 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x560c322b0de0 0x560c322b3280 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:35.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.158+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/1314732448 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560c321b9130 msgr2=0x560c322afdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:35.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.158+0000 7f101f6ea9c0 1 --2- 172.21.15.62:0/1314732448 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560c321b9130 0x560c322afdf0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:35.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.158+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/1314732448 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x560c322b57b0 msgr2=0x560c322b7ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:35.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.158+0000 7f101f6ea9c0 1 --2- 172.21.15.62:0/1314732448 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x560c322b57b0 0x560c322b7ba0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:35.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.158+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/1314732448 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0f04039a70 msgr2=0x7f0f0403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:35.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.158+0000 7f101f6ea9c0 1 --2- 172.21.15.62:0/1314732448 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0f04039a70 0x7f0f0403bf30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1008001e60 tx=0x7f10080013e0 comp rx=0 tx=0).stop 2024-09-10T05:37:35.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.158+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/1314732448 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c321b5fa0 msgr2=0x560c322a8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:35.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.158+0000 7f101f6ea9c0 1 --2- 172.21.15.62:0/1314732448 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c321b5fa0 0x560c322a8c80 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f1018017ca0 tx=0x7f1018017e30 comp rx=0 tx=0).stop 2024-09-10T05:37:35.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.158+0000 7f101d9f1640 1 -- 172.21.15.62:0/1314732448 reap_dead start 2024-09-10T05:37:35.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.158+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/1314732448 shutdown_connections 2024-09-10T05:37:35.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.158+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/1314732448 >> 172.21.15.62:0/1314732448 conn(0x560c321b1ac0 msgr2=0x560c3229bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:35.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.158+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/1314732448 shutdown_connections 2024-09-10T05:37:35.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:35.158+0000 7f101f6ea9c0 1 -- 172.21.15.62:0/1314732448 wait complete. 2024-09-10T05:37:35.173 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-10T05:37:34.927483Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:37:34.927459Z', 'tags': [], 'group_ids': []} 2024-09-10T05:37:40.185 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-10T05:37:40.185 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-10T05:37:40.185 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-10T05:37:40.186 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-10T05:37:40.186 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2024-09-10T05:37:40.237 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:37:40.237 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:37:40.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.233+0000 7f605923e9c0 1 Processor -- start 2024-09-10T05:37:40.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.233+0000 7f605923e9c0 1 -- start start 2024-09-10T05:37:40.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.233+0000 7f605923e9c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5561d01307d0 0x5561d012f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.233+0000 7f605923e9c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5561d006e9c0 con 0x5561d01302a0 2024-09-10T05:37:40.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.233+0000 7f605923e9c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x5561d00be6d0 con 0x5561d01307d0 2024-09-10T05:37:40.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.233+0000 7f6056543640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5561d01307d0 0x5561d012f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.233+0000 7f6056543640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5561d01307d0 0x5561d012f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:58438/0 (socket says 172.21.15.62:58438) 2024-09-10T05:37:40.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.233+0000 7f6056543640 1 -- 172.21.15.62:0/3249221111 learned_addr learned my addr 172.21.15.62:0/3249221111 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:40.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.233+0000 7f6056d44640 1 --1- 172.21.15.62:0/3249221111 >> v1:172.21.15.2:6789/0 conn(0x5561d01302a0 0x5561d012ec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:50590/0 (socket says 172.21.15.62:50590) 2024-09-10T05:37:40.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.233+0000 7f6056543640 1 -- 172.21.15.62:0/3249221111 >> v1:172.21.15.2:6789/0 conn(0x5561d01302a0 legacy=0x5561d012ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.233+0000 7f6056543640 1 -- 172.21.15.62:0/3249221111 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561d0062ca0 con 0x5561d01307d0 2024-09-10T05:37:40.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.237+0000 7f6056543640 1 --2- 172.21.15.62:0/3249221111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561d01307d0 0x5561d012f3a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f604000a5c0 tx=0x7f604001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=547ac090bc073a2b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.237+0000 7f6055d42640 1 -- 172.21.15.62:0/3249221111 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60400b0070 con 0x5561d01307d0 2024-09-10T05:37:40.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.237+0000 7f6055d42640 1 -- 172.21.15.62:0/3249221111 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60400ab540 con 0x5561d01307d0 2024-09-10T05:37:40.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.237+0000 7f6055d42640 1 -- 172.21.15.62:0/3249221111 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60400ab840 con 0x5561d01307d0 2024-09-10T05:37:40.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.237+0000 7f605923e9c0 1 -- 172.21.15.62:0/3249221111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561d01307d0 msgr2=0x5561d012f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.237+0000 7f605923e9c0 1 --2- 172.21.15.62:0/3249221111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561d01307d0 0x5561d012f3a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f604000a5c0 tx=0x7f604001b280 comp rx=0 tx=0).stop 2024-09-10T05:37:40.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.237+0000 7f605923e9c0 1 -- 172.21.15.62:0/3249221111 shutdown_connections 2024-09-10T05:37:40.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.237+0000 7f605923e9c0 1 --2- 172.21.15.62:0/3249221111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561d01307d0 0x5561d012f3a0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:40.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.237+0000 7f605923e9c0 1 -- 172.21.15.62:0/3249221111 >> 172.21.15.62:0/3249221111 conn(0x5561d01b5ac0 msgr2=0x5561d01b7ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:40.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.237+0000 7f605923e9c0 1 -- 172.21.15.62:0/3249221111 shutdown_connections 2024-09-10T05:37:40.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.237+0000 7f605923e9c0 1 -- 172.21.15.62:0/3249221111 wait complete. 2024-09-10T05:37:40.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.253+0000 7f605923e9c0 1 Processor -- start 2024-09-10T05:37:40.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.253+0000 7f605923e9c0 1 -- start start 2024-09-10T05:37:40.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.253+0000 7f605923e9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561d01302a0 0x5561d02a7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.253+0000 7f605923e9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5561d00c2680 con 0x5561d01302a0 2024-09-10T05:37:40.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.253+0000 7f6056d44640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561d01302a0 0x5561d02a7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.253+0000 7f6056d44640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561d01302a0 0x5561d02a7ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:58442/0 (socket says 172.21.15.62:58442) 2024-09-10T05:37:40.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.253+0000 7f6056d44640 1 -- 172.21.15.62:0/2466170829 learned_addr learned my addr 172.21.15.62:0/2466170829 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:40.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.253+0000 7f6056d44640 1 -- 172.21.15.62:0/2466170829 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561d003dda0 con 0x5561d01302a0 2024-09-10T05:37:40.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.253+0000 7f6056d44640 1 --2- 172.21.15.62:0/2466170829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561d01302a0 0x5561d02a7ce0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f605000b270 tx=0x7f605000b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad2658ba2c7f9290 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.253+0000 7f5f44e09640 1 -- 172.21.15.62:0/2466170829 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f605000e5d0 con 0x5561d01302a0 2024-09-10T05:37:40.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.253+0000 7f5f44e09640 1 -- 172.21.15.62:0/2466170829 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f605000e770 con 0x5561d01302a0 2024-09-10T05:37:40.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.253+0000 7f5f44e09640 1 -- 172.21.15.62:0/2466170829 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f605000ea70 con 0x5561d01302a0 2024-09-10T05:37:40.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.257+0000 7f605923e9c0 1 -- 172.21.15.62:0/2466170829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561d01302a0 msgr2=0x5561d02a7ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.257+0000 7f605923e9c0 1 --2- 172.21.15.62:0/2466170829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561d01302a0 0x5561d02a7ce0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f605000b270 tx=0x7f605000b670 comp rx=0 tx=0).stop 2024-09-10T05:37:40.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.257+0000 7f605923e9c0 1 -- 172.21.15.62:0/2466170829 shutdown_connections 2024-09-10T05:37:40.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.257+0000 7f605923e9c0 1 --2- 172.21.15.62:0/2466170829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561d01302a0 0x5561d02a7ce0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:40.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.257+0000 7f605923e9c0 1 -- 172.21.15.62:0/2466170829 >> 172.21.15.62:0/2466170829 conn(0x5561d01b5ac0 msgr2=0x5561d02a3920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:40.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.257+0000 7f605923e9c0 1 -- 172.21.15.62:0/2466170829 shutdown_connections 2024-09-10T05:37:40.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.257+0000 7f605923e9c0 1 -- 172.21.15.62:0/2466170829 wait complete. 2024-09-10T05:37:40.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.257+0000 7f605923e9c0 1 Processor -- start 2024-09-10T05:37:40.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.257+0000 7f605923e9c0 1 -- start start 2024-09-10T05:37:40.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.257+0000 7f605923e9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561d01302a0 0x5561d02af3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.257+0000 7f605923e9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5561d0064a50 con 0x5561d01302a0 2024-09-10T05:37:40.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.257+0000 7f6056d44640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561d01302a0 0x5561d02af3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.257+0000 7f6056d44640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561d01302a0 0x5561d02af3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:58448/0 (socket says 172.21.15.62:58448) 2024-09-10T05:37:40.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.257+0000 7f6056d44640 1 -- 172.21.15.62:0/202009196 learned_addr learned my addr 172.21.15.62:0/202009196 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:40.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.257+0000 7f6056d44640 1 -- 172.21.15.62:0/202009196 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561d02af910 con 0x5561d01302a0 2024-09-10T05:37:40.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.257+0000 7f6056d44640 1 --2- 172.21.15.62:0/202009196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561d01302a0 0x5561d02af3b0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x5561d02a8c70 tx=0x7f6050000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.257+0000 7f5f43606640 1 -- 172.21.15.62:0/202009196 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f605000be70 con 0x5561d01302a0 2024-09-10T05:37:40.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.257+0000 7f5f43606640 1 -- 172.21.15.62:0/202009196 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f605000f9f0 con 0x5561d01302a0 2024-09-10T05:37:40.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.257+0000 7f605923e9c0 1 -- 172.21.15.62:0/202009196 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5561d02afba0 con 0x5561d01302a0 2024-09-10T05:37:40.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.257+0000 7f5f43606640 1 -- 172.21.15.62:0/202009196 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f605000fcf0 con 0x5561d01302a0 2024-09-10T05:37:40.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.257+0000 7f605923e9c0 1 -- 172.21.15.62:0/202009196 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561d02b0550 con 0x5561d01302a0 2024-09-10T05:37:40.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.261+0000 7f5f43606640 1 -- 172.21.15.62:0/202009196 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6050017070 con 0x5561d01302a0 2024-09-10T05:37:40.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.261+0000 7f5f43606640 1 --2- 172.21.15.62:0/202009196 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5f3c039ac0 0x7f5f3c03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.261+0000 7f5f43606640 1 -- 172.21.15.62:0/202009196 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7f6050015020 con 0x5561d01302a0 2024-09-10T05:37:40.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.261+0000 7f6056543640 1 --2- 172.21.15.62:0/202009196 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5f3c039ac0 0x7f5f3c03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.261+0000 7f605923e9c0 1 --2- 172.21.15.62:0/202009196 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5561d01307d0 0x5561d02b6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.261+0000 7f605923e9c0 1 -- 172.21.15.62:0/202009196 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561d02b6a60 con 0x5561d01307d0 2024-09-10T05:37:40.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.261+0000 7f6057545640 1 --2- 172.21.15.62:0/202009196 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5561d01307d0 0x5561d02b6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.261+0000 7f6056543640 1 --2- 172.21.15.62:0/202009196 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5f3c039ac0 0x7f5f3c03bf80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f60400ad000 tx=0x7f60400a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.261+0000 7f6057545640 1 --2- 172.21.15.62:0/202009196 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5561d01307d0 0x5561d02b6520 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.261+0000 7f6057545640 1 -- 172.21.15.62:0/202009196 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f604800a4d0 con 0x5561d01307d0 2024-09-10T05:37:40.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.261+0000 7f605923e9c0 1 --2- 172.21.15.62:0/202009196 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5561d02b7810 0x5561d02b9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.261+0000 7f605923e9c0 1 -- 172.21.15.62:0/202009196 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561d02ba210 con 0x5561d02b7810 2024-09-10T05:37:40.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.261+0000 7f6056d44640 1 --2- 172.21.15.62:0/202009196 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5561d02b7810 0x5561d02b9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.261+0000 7f6056d44640 1 --2- 172.21.15.62:0/202009196 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5561d02b7810 0x5561d02b9c00 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.261+0000 7f6056d44640 1 -- 172.21.15.62:0/202009196 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f605002e070 con 0x5561d02b7810 2024-09-10T05:37:40.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.261+0000 7f605923e9c0 1 --2- 172.21.15.62:0/202009196 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5561d02bbfd0 0x5561d02be3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.261+0000 7f605923e9c0 1 -- 172.21.15.62:0/202009196 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561d02bea90 con 0x5561d02bbfd0 2024-09-10T05:37:40.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.265+0000 7f6056543640 1 --2- 172.21.15.62:0/202009196 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5561d02bbfd0 0x5561d02be3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.265+0000 7f6056543640 1 --2- 172.21.15.62:0/202009196 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5561d02bbfd0 0x5561d02be3c0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.265+0000 7f6056543640 1 -- 172.21.15.62:0/202009196 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f60400b3040 con 0x5561d02bbfd0 2024-09-10T05:37:40.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.265+0000 7f605923e9c0 1 -- 172.21.15.62:0/202009196 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561d02baea0 con 0x5561d02b7810 2024-09-10T05:37:40.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.265+0000 7f6056d44640 1 -- 172.21.15.62:0/202009196 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f605002e070 con 0x5561d02b7810 2024-09-10T05:37:40.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.265+0000 7f605923e9c0 1 -- 172.21.15.62:0/202009196 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561d02bb260 con 0x5561d02bbfd0 2024-09-10T05:37:40.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.265+0000 7f6056543640 1 -- 172.21.15.62:0/202009196 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f60400b3040 con 0x5561d02bbfd0 2024-09-10T05:37:40.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.265+0000 7f605923e9c0 1 Processor -- start 2024-09-10T05:37:40.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.265+0000 7f605923e9c0 1 -- start start 2024-09-10T05:37:40.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.265+0000 7f605923e9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561d02cd060 0x5561d02cd480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.265+0000 7f605923e9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5561d00cf450 con 0x5561d02cd060 2024-09-10T05:37:40.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.265+0000 7f6056d44640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561d02cd060 0x5561d02cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.265+0000 7f6056d44640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561d02cd060 0x5561d02cd480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:58452/0 (socket says 172.21.15.62:58452) 2024-09-10T05:37:40.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.265+0000 7f6056d44640 1 -- 172.21.15.62:0/2306153479 learned_addr learned my addr 172.21.15.62:0/2306153479 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:40.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.265+0000 7f6056d44640 1 -- 172.21.15.62:0/2306153479 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561d02cdac0 con 0x5561d02cd060 2024-09-10T05:37:40.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.265+0000 7f6056d44640 1 --2- 172.21.15.62:0/2306153479 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561d02cd060 0x5561d02cd480 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f605004f4f0 tx=0x7f605001beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.269+0000 7f5f40e01640 1 -- 172.21.15.62:0/2306153479 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f605001db90 con 0x5561d02cd060 2024-09-10T05:37:40.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.269+0000 7f5f40e01640 1 -- 172.21.15.62:0/2306153479 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f605001dd30 con 0x5561d02cd060 2024-09-10T05:37:40.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.269+0000 7f605923e9c0 1 -- 172.21.15.62:0/2306153479 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5561d02ce320 con 0x5561d02cd060 2024-09-10T05:37:40.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.269+0000 7f5f40e01640 1 -- 172.21.15.62:0/2306153479 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f605001b500 con 0x5561d02cd060 2024-09-10T05:37:40.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.269+0000 7f605923e9c0 1 -- 172.21.15.62:0/2306153479 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561d02ce320 con 0x5561d02cd060 2024-09-10T05:37:40.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.269+0000 7f5f40e01640 1 -- 172.21.15.62:0/2306153479 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f605001b6a0 con 0x5561d02cd060 2024-09-10T05:37:40.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.269+0000 7f5f40e01640 1 --2- 172.21.15.62:0/2306153479 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5f30039a70 0x7f5f3003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.269+0000 7f5f40e01640 1 -- 172.21.15.62:0/2306153479 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7f6050037030 con 0x5561d02cd060 2024-09-10T05:37:40.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.269+0000 7f6056543640 1 --2- 172.21.15.62:0/2306153479 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5f30039a70 0x7f5f3003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.269+0000 7f605923e9c0 1 Processor -- start 2024-09-10T05:37:40.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.269+0000 7f605923e9c0 1 -- start start 2024-09-10T05:37:40.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.269+0000 7f605923e9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561d02d9620 0x5561d02d9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.269+0000 7f605923e9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5561d02a8530 con 0x5561d02d9620 2024-09-10T05:37:40.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.269+0000 7f6056543640 1 --2- 172.21.15.62:0/2306153479 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5f30039a70 0x7f5f3003bf30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x5561d02b0800 tx=0x7f6040005ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.269+0000 7f6056d44640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561d02d9620 0x5561d02d9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.269+0000 7f6056d44640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561d02d9620 0x5561d02d9a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:58454/0 (socket says 172.21.15.62:58454) 2024-09-10T05:37:40.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.269+0000 7f6056d44640 1 -- 172.21.15.62:0/4289297645 learned_addr learned my addr 172.21.15.62:0/4289297645 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:40.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.269+0000 7f6056d44640 1 -- 172.21.15.62:0/4289297645 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561d02d9ff0 con 0x5561d02d9620 2024-09-10T05:37:40.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.269+0000 7f6056d44640 1 --2- 172.21.15.62:0/4289297645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561d02d9620 0x5561d02d9a00 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f6050020f80 tx=0x7f6050018400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c7fd399063bca4b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.269+0000 7f5f3a7fc640 1 -- 172.21.15.62:0/4289297645 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6050041030 con 0x5561d02d9620 2024-09-10T05:37:40.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.269+0000 7f5f3a7fc640 1 -- 172.21.15.62:0/4289297645 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6050042040 con 0x5561d02d9620 2024-09-10T05:37:40.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.269+0000 7f5f3a7fc640 1 -- 172.21.15.62:0/4289297645 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f605001a7b0 con 0x5561d02d9620 2024-09-10T05:37:40.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.273+0000 7f605923e9c0 1 -- 172.21.15.62:0/4289297645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561d02d9620 msgr2=0x5561d02d9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.273+0000 7f605923e9c0 1 --2- 172.21.15.62:0/4289297645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561d02d9620 0x5561d02d9a00 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f6050020f80 tx=0x7f6050018400 comp rx=0 tx=0).stop 2024-09-10T05:37:40.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.273+0000 7f605923e9c0 1 -- 172.21.15.62:0/4289297645 shutdown_connections 2024-09-10T05:37:40.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.273+0000 7f605923e9c0 1 --2- 172.21.15.62:0/4289297645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561d02d9620 0x5561d02d9a00 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:40.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.273+0000 7f605923e9c0 1 -- 172.21.15.62:0/4289297645 >> 172.21.15.62:0/4289297645 conn(0x5561d02d5a50 msgr2=0x5561d02d3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:40.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.273+0000 7f605923e9c0 1 -- 172.21.15.62:0/4289297645 shutdown_connections 2024-09-10T05:37:40.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.273+0000 7f605923e9c0 1 -- 172.21.15.62:0/4289297645 wait complete. 2024-09-10T05:37:40.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.273+0000 7f605923e9c0 1 Processor -- start 2024-09-10T05:37:40.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.273+0000 7f605923e9c0 1 -- start start 2024-09-10T05:37:40.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.273+0000 7f605923e9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561d02d9620 0x5561d02e0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.273+0000 7f605923e9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5561d02da4b0 con 0x5561d02d9620 2024-09-10T05:37:40.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.273+0000 7f6056d44640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561d02d9620 0x5561d02e0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.273+0000 7f6056d44640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561d02d9620 0x5561d02e0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:58462/0 (socket says 172.21.15.62:58462) 2024-09-10T05:37:40.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.273+0000 7f6056d44640 1 -- 172.21.15.62:0/2138420581 learned_addr learned my addr 172.21.15.62:0/2138420581 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:40.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.273+0000 7f6056d44640 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561d02e0eb0 con 0x5561d02d9620 2024-09-10T05:37:40.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.273+0000 7f6056d44640 1 --2- 172.21.15.62:0/2138420581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561d02d9620 0x5561d02e0950 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f6050018bf0 tx=0x7f6050020f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.273+0000 7f5f38ff9640 1 -- 172.21.15.62:0/2138420581 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f605001a550 con 0x5561d02d9620 2024-09-10T05:37:40.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.273+0000 7f5f38ff9640 1 -- 172.21.15.62:0/2138420581 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6050052070 con 0x5561d02d9620 2024-09-10T05:37:40.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.273+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5561d02e0eb0 con 0x5561d02d9620 2024-09-10T05:37:40.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.273+0000 7f5f38ff9640 1 -- 172.21.15.62:0/2138420581 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f605004fd80 con 0x5561d02d9620 2024-09-10T05:37:40.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.273+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561d02e0eb0 con 0x5561d02d9620 2024-09-10T05:37:40.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.277+0000 7f5f38ff9640 1 -- 172.21.15.62:0/2138420581 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6050042050 con 0x5561d02d9620 2024-09-10T05:37:40.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.277+0000 7f5f38ff9640 1 --2- 172.21.15.62:0/2138420581 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5f20039a70 0x7f5f2003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.277+0000 7f5f38ff9640 1 -- 172.21.15.62:0/2138420581 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7f605006b030 con 0x5561d02d9620 2024-09-10T05:37:40.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.277+0000 7f6056543640 1 --2- 172.21.15.62:0/2138420581 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5f20039a70 0x7f5f2003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.277+0000 7f605923e9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:40.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.277+0000 7f605923e9c0 1 --2- 172.21.15.62:0/2138420581 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5561d02eb890 0x5561d02edd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.277+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561d02ee4a0 con 0x5561d02eb890 2024-09-10T05:37:40.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.277+0000 7f6057545640 1 --2- 172.21.15.62:0/2138420581 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5561d02eb890 0x5561d02edd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.277+0000 7f6056543640 1 --2- 172.21.15.62:0/2138420581 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5f20039a70 0x7f5f2003bf30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f60400ae040 tx=0x7f60400b9040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.277+0000 7f6057545640 1 --2- 172.21.15.62:0/2138420581 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5561d02eb890 0x5561d02edd50 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.277+0000 7f6057545640 1 -- 172.21.15.62:0/2138420581 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f604800a4d0 con 0x5561d02eb890 2024-09-10T05:37:40.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.277+0000 7f605923e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:40.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.277+0000 7f605923e9c0 20 realm 2024-09-10T05:37:40.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.277+0000 7f605923e9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:40.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.277+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561d02eabc0 con 0x5561d02eb890 2024-09-10T05:37:40.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.277+0000 7f6057545640 1 -- 172.21.15.62:0/2138420581 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f604800a4d0 con 0x5561d02eb890 2024-09-10T05:37:40.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.277+0000 7f605923e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:40.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.277+0000 7f605923e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:37:40.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.277+0000 7f605923e9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:40.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.277+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561d02eef60 con 0x5561d02eb890 2024-09-10T05:37:40.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.277+0000 7f6057545640 1 -- 172.21.15.62:0/2138420581 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f604800a4d0 con 0x5561d02eb890 2024-09-10T05:37:40.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.277+0000 7f605923e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:40.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.277+0000 7f605923e9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:40.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.277+0000 7f605923e9c0 1 --2- 172.21.15.62:0/2138420581 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5561d02efd40 0x5561d02f2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.277+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561d02f2800 con 0x5561d02efd40 2024-09-10T05:37:40.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.277+0000 7f6056d44640 1 --2- 172.21.15.62:0/2138420581 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5561d02efd40 0x5561d02f2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.277+0000 7f6056d44640 1 --2- 172.21.15.62:0/2138420581 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5561d02efd40 0x5561d02f2130 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.277+0000 7f6056d44640 1 -- 172.21.15.62:0/2138420581 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f605002e070 con 0x5561d02efd40 2024-09-10T05:37:40.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.277+0000 7f605923e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:37:40.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.277+0000 7f605923e9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:40.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.277+0000 7f605923e9c0 1 --2- 172.21.15.62:0/2138420581 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5561d02f3560 0x5561d02f5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.277+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561d02f60c0 con 0x5561d02f3560 2024-09-10T05:37:40.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.281+0000 7f6056543640 1 --2- 172.21.15.62:0/2138420581 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5561d02f3560 0x5561d02f5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.281+0000 7f6056543640 1 --2- 172.21.15.62:0/2138420581 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5561d02f3560 0x5561d02f5950 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.281+0000 7f6056543640 1 -- 172.21.15.62:0/2138420581 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f60400b3040 con 0x5561d02f3560 2024-09-10T05:37:40.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.281+0000 7f605923e9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:37:40.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.281+0000 7f605923e9c0 20 searching for the correct realm 2024-09-10T05:37:40.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.281+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561d02f7990 con 0x5561d02f3560 2024-09-10T05:37:40.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.281+0000 7f6056543640 1 -- 172.21.15.62:0/2138420581 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60400b3040 con 0x5561d02f3560 2024-09-10T05:37:40.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.281+0000 7f6056543640 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561d02f7990 con 0x5561d02efd40 2024-09-10T05:37:40.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.281+0000 7f6056d44640 1 -- 172.21.15.62:0/2138420581 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f605002e070 con 0x5561d02efd40 2024-09-10T05:37:40.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.281+0000 7f6056d44640 1 --2- 172.21.15.62:0/2138420581 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f6050042b00 0x7f605003c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.281+0000 7f6056d44640 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561d02f7990 con 0x7f6050042b00 2024-09-10T05:37:40.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.281+0000 7f6057545640 1 --2- 172.21.15.62:0/2138420581 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f6050042b00 0x7f605003c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.281+0000 7f6057545640 1 --2- 172.21.15.62:0/2138420581 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f6050042b00 0x7f605003c6b0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.281+0000 7f6057545640 1 -- 172.21.15.62:0/2138420581 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f604800a4d0 con 0x7f6050042b00 2024-09-10T05:37:40.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.281+0000 7f6057545640 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561d02f7990 con 0x5561d02eb890 2024-09-10T05:37:40.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.281+0000 7f6057545640 1 -- 172.21.15.62:0/2138420581 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f604800a4d0 con 0x5561d02eb890 2024-09-10T05:37:40.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.281+0000 7f6057545640 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561d02f7990 con 0x5561d02eb890 2024-09-10T05:37:40.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.281+0000 7f6057545640 1 -- 172.21.15.62:0/2138420581 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f604800a4d0 con 0x5561d02eb890 2024-09-10T05:37:40.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.281+0000 7f6057545640 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561d02f7990 con 0x5561d02f3560 2024-09-10T05:37:40.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.281+0000 7f6056543640 1 -- 172.21.15.62:0/2138420581 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60400b3040 con 0x5561d02f3560 2024-09-10T05:37:40.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.281+0000 7f6056543640 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561d02f7990 con 0x5561d02eb890 2024-09-10T05:37:40.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.285+0000 7f6057545640 1 -- 172.21.15.62:0/2138420581 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f604800a4d0 con 0x5561d02eb890 2024-09-10T05:37:40.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.285+0000 7f6057545640 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561d02f7990 con 0x5561d02efd40 2024-09-10T05:37:40.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.285+0000 7f6056d44640 1 -- 172.21.15.62:0/2138420581 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f605002e070 con 0x5561d02efd40 2024-09-10T05:37:40.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.285+0000 7f6056d44640 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561d02f7990 con 0x5561d02efd40 2024-09-10T05:37:40.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.285+0000 7f6056d44640 1 -- 172.21.15.62:0/2138420581 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f605002e070 con 0x5561d02efd40 2024-09-10T05:37:40.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.285+0000 7f6056d44640 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561d02f7990 con 0x5561d02eb890 2024-09-10T05:37:40.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.285+0000 7f6057545640 1 -- 172.21.15.62:0/2138420581 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f604800a4d0 con 0x5561d02eb890 2024-09-10T05:37:40.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.285+0000 7f6057545640 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561d02f7990 con 0x7f6050042b00 2024-09-10T05:37:40.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.285+0000 7f6057545640 1 -- 172.21.15.62:0/2138420581 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f604800a4d0 con 0x7f6050042b00 2024-09-10T05:37:40.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.285+0000 7f6057545640 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561d02f7990 con 0x5561d02eb890 2024-09-10T05:37:40.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.285+0000 7f6057545640 1 -- 172.21.15.62:0/2138420581 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f604800a4d0 con 0x5561d02eb890 2024-09-10T05:37:40.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.285+0000 7f6057545640 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561d02f7990 con 0x7f6050042b00 2024-09-10T05:37:40.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.285+0000 7f6057545640 1 -- 172.21.15.62:0/2138420581 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f604800a4d0 con 0x7f6050042b00 2024-09-10T05:37:40.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.285+0000 7f6057545640 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561d02f7990 con 0x5561d02efd40 2024-09-10T05:37:40.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.285+0000 7f6056d44640 1 -- 172.21.15.62:0/2138420581 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f605002e070 con 0x5561d02efd40 2024-09-10T05:37:40.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.285+0000 7f6056d44640 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561d02f7990 con 0x5561d02f3560 2024-09-10T05:37:40.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.285+0000 7f6056543640 1 -- 172.21.15.62:0/2138420581 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60400b3040 con 0x5561d02f3560 2024-09-10T05:37:40.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.285+0000 7f6056543640 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561d02f7990 con 0x5561d02eb890 2024-09-10T05:37:40.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.289+0000 7f6057545640 1 -- 172.21.15.62:0/2138420581 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f604800a4d0 con 0x5561d02eb890 2024-09-10T05:37:40.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.289+0000 7f6057545640 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561d02f7990 con 0x5561d02efd40 2024-09-10T05:37:40.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.289+0000 7f6056d44640 1 -- 172.21.15.62:0/2138420581 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f605002e070 con 0x5561d02efd40 2024-09-10T05:37:40.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.289+0000 7f6056d44640 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561d02f7990 con 0x5561d02f3560 2024-09-10T05:37:40.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.289+0000 7f6056543640 1 -- 172.21.15.62:0/2138420581 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 32 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f60400b3040 con 0x5561d02f3560 2024-09-10T05:37:40.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.289+0000 7f6056543640 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561d02f7990 con 0x5561d02eb890 2024-09-10T05:37:40.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.289+0000 7f6057545640 1 -- 172.21.15.62:0/2138420581 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f604800a4d0 con 0x5561d02eb890 2024-09-10T05:37:40.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.289+0000 7f6057545640 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561d02f7990 con 0x5561d02eb890 2024-09-10T05:37:40.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.289+0000 7f6057545640 1 -- 172.21.15.62:0/2138420581 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f604800a4d0 con 0x5561d02eb890 2024-09-10T05:37:40.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.289+0000 7f6057545640 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561d02f7990 con 0x5561d02eb890 2024-09-10T05:37:40.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.289+0000 7f6057545640 1 -- 172.21.15.62:0/2138420581 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f604800a4d0 con 0x5561d02eb890 2024-09-10T05:37:40.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.289+0000 7f6057545640 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561d02f7990 con 0x5561d02f3560 2024-09-10T05:37:40.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.289+0000 7f6056543640 1 -- 172.21.15.62:0/2138420581 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60400b3040 con 0x5561d02f3560 2024-09-10T05:37:40.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.289+0000 7f6056543640 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561d02f7990 con 0x7f6050042b00 2024-09-10T05:37:40.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.289+0000 7f6057545640 1 -- 172.21.15.62:0/2138420581 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f604800a4d0 con 0x7f6050042b00 2024-09-10T05:37:40.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.289+0000 7f6057545640 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561d02f7990 con 0x5561d02eb890 2024-09-10T05:37:40.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.289+0000 7f6057545640 1 -- 172.21.15.62:0/2138420581 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f604800a4d0 con 0x5561d02eb890 2024-09-10T05:37:40.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.289+0000 7f6057545640 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561d02f7990 con 0x7f6050042b00 2024-09-10T05:37:40.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.289+0000 7f6057545640 1 -- 172.21.15.62:0/2138420581 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f604800a4d0 con 0x7f6050042b00 2024-09-10T05:37:40.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.289+0000 7f6057545640 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561d02f7990 con 0x5561d02f3560 2024-09-10T05:37:40.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.289+0000 7f6056543640 1 -- 172.21.15.62:0/2138420581 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60400b3040 con 0x5561d02f3560 2024-09-10T05:37:40.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.289+0000 7f6056543640 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561d02f7990 con 0x7f6050042b00 2024-09-10T05:37:40.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.293+0000 7f6057545640 1 -- 172.21.15.62:0/2138420581 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f604800a4d0 con 0x7f6050042b00 2024-09-10T05:37:40.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.293+0000 7f6057545640 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561d02f7990 con 0x5561d02efd40 2024-09-10T05:37:40.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.293+0000 7f6056d44640 1 -- 172.21.15.62:0/2138420581 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f605002e070 con 0x5561d02efd40 2024-09-10T05:37:40.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.293+0000 7f6056d44640 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561d02f7990 con 0x5561d02efd40 2024-09-10T05:37:40.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.293+0000 7f6056d44640 1 -- 172.21.15.62:0/2138420581 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f605002e070 con 0x5561d02efd40 2024-09-10T05:37:40.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.293+0000 7f6056d44640 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561d02f7990 con 0x5561d02f3560 2024-09-10T05:37:40.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.293+0000 7f6056543640 1 -- 172.21.15.62:0/2138420581 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60400b3040 con 0x5561d02f3560 2024-09-10T05:37:40.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.293+0000 7f6056543640 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561d02f7990 con 0x5561d02efd40 2024-09-10T05:37:40.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.293+0000 7f6056d44640 1 -- 172.21.15.62:0/2138420581 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f605002e070 con 0x5561d02efd40 2024-09-10T05:37:40.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.293+0000 7f6056d44640 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561d02f7990 con 0x5561d02efd40 2024-09-10T05:37:40.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.293+0000 7f6056d44640 1 -- 172.21.15.62:0/2138420581 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f605002e070 con 0x5561d02efd40 2024-09-10T05:37:40.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.293+0000 7f605923e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:37:40.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.293+0000 7f605923e9c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:37:40.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.293+0000 7f605923e9c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:37:40.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.293+0000 7f605923e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:37:40.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.293+0000 7f605923e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:37:40.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.293+0000 7f605923e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:37:40.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.293+0000 7f605923e9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:40.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.293+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561d02f6a80 con 0x5561d02eb890 2024-09-10T05:37:40.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.293+0000 7f6057545640 1 -- 172.21.15.62:0/2138420581 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f604800a4d0 con 0x5561d02eb890 2024-09-10T05:37:40.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.293+0000 7f605923e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:40.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.293+0000 7f605923e9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:40.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.293+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561d02f6690 con 0x5561d02efd40 2024-09-10T05:37:40.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.297+0000 7f6056d44640 1 -- 172.21.15.62:0/2138420581 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f605002e070 con 0x5561d02efd40 2024-09-10T05:37:40.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.297+0000 7f605923e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:37:40.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.297+0000 7f605923e9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:40.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.297+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561d02f73b0 con 0x5561d02f3560 2024-09-10T05:37:40.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.297+0000 7f6056543640 1 -- 172.21.15.62:0/2138420581 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f60400b3040 con 0x5561d02f3560 2024-09-10T05:37:40.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.297+0000 7f605923e9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:37:40.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.297+0000 7f605923e9c0 20 zone default found 2024-09-10T05:37:40.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.297+0000 7f605923e9c0 4 Realm: () 2024-09-10T05:37:40.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.297+0000 7f605923e9c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:37:40.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.297+0000 7f605923e9c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:37:40.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.297+0000 7f605923e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:37:40.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.297+0000 7f605923e9c0 20 zonegroup default 2024-09-10T05:37:40.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.297+0000 7f605923e9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:40.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.297+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561d02f8270 con 0x7f6050042b00 2024-09-10T05:37:40.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.297+0000 7f6057545640 1 -- 172.21.15.62:0/2138420581 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f604800a4d0 con 0x7f6050042b00 2024-09-10T05:37:40.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.297+0000 7f605923e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:40.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.297+0000 7f605923e9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:40.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.297+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561d02fa4b0 con 0x5561d02f3560 2024-09-10T05:37:40.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.297+0000 7f6056543640 1 -- 172.21.15.62:0/2138420581 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f60400b3040 con 0x5561d02f3560 2024-09-10T05:37:40.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.297+0000 7f605923e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:40.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.297+0000 7f605923e9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:40.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.297+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561d02fa850 con 0x5561d02f3560 2024-09-10T05:37:40.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.297+0000 7f6056543640 1 -- 172.21.15.62:0/2138420581 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f60400b3040 con 0x5561d02f3560 2024-09-10T05:37:40.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.297+0000 7f605923e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:40.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.297+0000 7f605923e9c0 20 started sync module instance, tier type = 2024-09-10T05:37:40.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.297+0000 7f605923e9c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:37:40.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.297+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561d02f98f0 con 0x5561d02efd40 2024-09-10T05:37:40.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.301+0000 7f6056d44640 1 -- 172.21.15.62:0/2138420581 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f605002e070 con 0x5561d02efd40 2024-09-10T05:37:40.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.301+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93878592967744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561d02fa850 con 0x5561d02efd40 2024-09-10T05:37:40.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.301+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561d02fb120 con 0x5561d02eb890 2024-09-10T05:37:40.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.301+0000 7f6057545640 1 -- 172.21.15.62:0/2138420581 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f604800a4d0 con 0x5561d02eb890 2024-09-10T05:37:40.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.301+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93878592976144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561d02fbde0 con 0x5561d02eb890 2024-09-10T05:37:40.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.301+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561d02fc7a0 con 0x5561d02efd40 2024-09-10T05:37:40.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.301+0000 7f6056d44640 1 -- 172.21.15.62:0/2138420581 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 93878592967744] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f605002e070 con 0x5561d02efd40 2024-09-10T05:37:40.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.301+0000 7f6057545640 1 -- 172.21.15.62:0/2138420581 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93878592976144] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f604800a4d0 con 0x5561d02eb890 2024-09-10T05:37:40.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.301+0000 7f6056d44640 1 -- 172.21.15.62:0/2138420581 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f605002e070 con 0x5561d02efd40 2024-09-10T05:37:40.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.301+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93878592979696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561d02fbde0 con 0x5561d02efd40 2024-09-10T05:37:40.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.301+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561d02fc710 con 0x7f6050042b00 2024-09-10T05:37:40.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.305+0000 7f6057545640 1 -- 172.21.15.62:0/2138420581 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f604800a4d0 con 0x7f6050042b00 2024-09-10T05:37:40.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.305+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93878592981904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561d02fc710 con 0x7f6050042b00 2024-09-10T05:37:40.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.305+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561d02fdae0 con 0x5561d02efd40 2024-09-10T05:37:40.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.305+0000 7f6056d44640 1 -- 172.21.15.62:0/2138420581 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93878592979696] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f605002e070 con 0x5561d02efd40 2024-09-10T05:37:40.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.305+0000 7f6057545640 1 -- 172.21.15.62:0/2138420581 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93878592981904] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f604800a4d0 con 0x7f6050042b00 2024-09-10T05:37:40.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.305+0000 7f6056d44640 1 -- 172.21.15.62:0/2138420581 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f605002e070 con 0x5561d02efd40 2024-09-10T05:37:40.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.305+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93878592982960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561d02fdaa0 con 0x5561d02efd40 2024-09-10T05:37:40.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.305+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561d02fded0 con 0x5561d02f3560 2024-09-10T05:37:40.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.309+0000 7f6056543640 1 -- 172.21.15.62:0/2138420581 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60400b3040 con 0x5561d02f3560 2024-09-10T05:37:40.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.309+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93878592977200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561d02fe380 con 0x5561d02f3560 2024-09-10T05:37:40.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.309+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561d02fed80 con 0x5561d02f3560 2024-09-10T05:37:40.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.309+0000 7f6056d44640 1 -- 172.21.15.62:0/2138420581 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 93878592982960] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f605002e070 con 0x5561d02efd40 2024-09-10T05:37:40.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.309+0000 7f6056543640 1 -- 172.21.15.62:0/2138420581 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(56 notify.6 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60400b3040 con 0x5561d02f3560 2024-09-10T05:37:40.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.309+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93878592984528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561d02fed40 con 0x5561d02f3560 2024-09-10T05:37:40.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.309+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561d02ff7d0 con 0x7f6050042b00 2024-09-10T05:37:40.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.309+0000 7f6056543640 1 -- 172.21.15.62:0/2138420581 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93878592977200] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60400b3040 con 0x5561d02f3560 2024-09-10T05:37:40.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.309+0000 7f6057545640 1 -- 172.21.15.62:0/2138420581 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f604800a4d0 con 0x7f6050042b00 2024-09-10T05:37:40.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.309+0000 7f6056543640 1 -- 172.21.15.62:0/2138420581 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93878592984528] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60400b3040 con 0x5561d02f3560 2024-09-10T05:37:40.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.309+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93878592991968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561d02ff7d0 con 0x7f6050042b00 2024-09-10T05:37:40.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.309+0000 7f605923e9c0 20 add_watcher() i=0 2024-09-10T05:37:40.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.309+0000 7f605923e9c0 20 add_watcher() i=1 2024-09-10T05:37:40.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.309+0000 7f605923e9c0 20 add_watcher() i=2 2024-09-10T05:37:40.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.309+0000 7f605923e9c0 20 add_watcher() i=3 2024-09-10T05:37:40.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.309+0000 7f605923e9c0 20 add_watcher() i=4 2024-09-10T05:37:40.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.309+0000 7f605923e9c0 20 add_watcher() i=5 2024-09-10T05:37:40.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.309+0000 7f605923e9c0 20 add_watcher() i=6 2024-09-10T05:37:40.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.313+0000 7f6057545640 1 -- 172.21.15.62:0/2138420581 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93878592991968] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f604800a4d0 con 0x7f6050042b00 2024-09-10T05:37:40.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.313+0000 7f605923e9c0 20 add_watcher() i=7 2024-09-10T05:37:40.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.313+0000 7f605923e9c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:37:40.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.313+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561d02fded0 con 0x5561d02eb890 2024-09-10T05:37:40.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.313+0000 7f6057545640 1 -- 172.21.15.62:0/2138420581 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f604800a4d0 con 0x5561d02eb890 2024-09-10T05:37:40.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.313+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93878592986832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561d02fff20 con 0x5561d02eb890 2024-09-10T05:37:40.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.313+0000 7f6057545640 1 -- 172.21.15.62:0/2138420581 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93878592986832] v32'220 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f604800a4d0 con 0x5561d02eb890 2024-09-10T05:37:40.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.313+0000 7f5f0dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:37:40.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.317+0000 7f605923e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:37:40.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.317+0000 7f605923e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:37:40.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.317+0000 7f605923e9c0 5 note: GC not initialized 2024-09-10T05:37:40.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.317+0000 7f5f0cfe1640 20 reqs_thread_entry: start 2024-09-10T05:37:40.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.317+0000 7f605923e9c0 20 init_complete bucket index max shards: 11 2024-09-10T05:37:40.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.317+0000 7f605923e9c0 20 Filter name: none 2024-09-10T05:37:40.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.317+0000 7f5f05ffb640 20 reqs_thread_entry: start 2024-09-10T05:37:40.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.317+0000 7f605923e9c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-10T05:37:40.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.317+0000 7f605923e9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:40.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.317+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561d03259e0 con 0x7f6050042b00 2024-09-10T05:37:40.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.317+0000 7f6057545640 1 -- 172.21.15.62:0/2138420581 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f604800a4d0 con 0x7f6050042b00 2024-09-10T05:37:40.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.317+0000 7f605923e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:40.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.317+0000 7f605923e9c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-10T05:37:40.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.317+0000 7f605923e9c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T05:37:40.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.317+0000 7f605923e9c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-10T05:37:40.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.317+0000 7f605923e9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:40.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.317+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561d0324080 con 0x5561d02f3560 2024-09-10T05:37:40.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.317+0000 7f6056543640 1 -- 172.21.15.62:0/2138420581 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f60400b3040 con 0x5561d02f3560 2024-09-10T05:37:40.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.317+0000 7f605923e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:40.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.317+0000 7f605923e9c0 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-10T05:37:40.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.317+0000 7f605923e9c0 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T05:37:40.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.317+0000 7f605923e9c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-10T05:37:40.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.317+0000 7f605923e9c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-10T05:37:40.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.317+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561d0324950 con 0x7f6050042b00 2024-09-10T05:37:40.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.317+0000 7f6057545640 1 -- 172.21.15.62:0/2138420581 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v32'5 uv5 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f604800a4d0 con 0x7f6050042b00 2024-09-10T05:37:40.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.317+0000 7f605923e9c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-10T05:37:40.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.317+0000 7f605923e9c0 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T05:37:40.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.317+0000 7f605923e9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-10T05:37:40.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.317+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 93878593143968 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561d0329480 con 0x5561d02f3560 2024-09-10T05:37:40.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.321+0000 7f6056543640 1 -- 172.21.15.62:0/2138420581 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== watch-notify(notify (1) cookie 93878592977200 notify 137438953505 ret 0) ==== 598+0+0 (crc 0 0 0) 0x7f60400e3040 con 0x5561d02f3560 2024-09-10T05:37:40.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.321+0000 7f5f3a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953505 cookie 93878592977200 notifier 4738 bl.length()=556 2024-09-10T05:37:40.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.321+0000 7f5f3a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-10T05:37:40.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.321+0000 7f5f3a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T05:37:40.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.321+0000 7f6056543640 1 -- 172.21.15.62:0/2138420581 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== osd_op_reply(65 notify.5 [notify cookie 93878593143968 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f60400b3040 con 0x5561d02f3560 2024-09-10T05:37:40.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.321+0000 7f5f3a7fc640 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f5f1c003eb0 con 0x5561d02f3560 2024-09-10T05:37:40.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.321+0000 7f6056543640 1 -- 172.21.15.62:0/2138420581 <== osd.3 v2:172.21.15.62:6816/2708991149 19 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60400b3040 con 0x5561d02f3560 2024-09-10T05:37:40.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.321+0000 7f6056543640 1 -- 172.21.15.62:0/2138420581 <== osd.3 v2:172.21.15.62:6816/2708991149 20 ==== watch-notify(notify_complete (2) cookie 93878593143968 notify 137438953505 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5561d0062ca0 con 0x5561d02f3560 2024-09-10T05:37:40.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.321+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561d03244a0 con 0x5561d02f3560 2024-09-10T05:37:40.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.321+0000 7f6056543640 1 -- 172.21.15.62:0/2138420581 <== osd.3 v2:172.21.15.62:6816/2708991149 21 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v32'9 uv9 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f60400b3040 con 0x5561d02f3560 2024-09-10T05:37:40.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.321+0000 7f605923e9c0 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-10T05:37:40.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.321+0000 7f605923e9c0 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T05:37:40.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.321+0000 7f605923e9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-10T05:37:40.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.321+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 93878593143968 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561d03294c0 con 0x5561d02efd40 2024-09-10T05:37:40.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.321+0000 7f6056d44640 1 -- 172.21.15.62:0/2138420581 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== watch-notify(notify (1) cookie 93878592979696 notify 137438953511 ret 0) ==== 219+0+0 (crc 0 0 0) 0x5561d02cdac0 con 0x5561d02efd40 2024-09-10T05:37:40.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.321+0000 7f5f3a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953511 cookie 93878592979696 notifier 4738 bl.length()=177 2024-09-10T05:37:40.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.321+0000 7f5f3a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-10T05:37:40.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.321+0000 7f5f3a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T05:37:40.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.321+0000 7f6056d44640 1 -- 172.21.15.62:0/2138420581 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(68 notify.2 [notify cookie 93878593143968 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f605002e070 con 0x5561d02efd40 2024-09-10T05:37:40.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.321+0000 7f5f3a7fc640 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f5f1c003eb0 con 0x5561d02efd40 2024-09-10T05:37:40.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.321+0000 7f6056d44640 1 -- 172.21.15.62:0/2138420581 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f605002e070 con 0x5561d02efd40 2024-09-10T05:37:40.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.321+0000 7f6056d44640 1 -- 172.21.15.62:0/2138420581 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== watch-notify(notify_complete (2) cookie 93878593143968 notify 137438953511 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5561d02b0550 con 0x5561d02efd40 2024-09-10T05:37:40.329 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-10T05:37:40.323287Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:37:40.323269Z","tags":[],"group_ids":[]} 2024-09-10T05:37:40.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.325+0000 7f5f0dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:37:40.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.325+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93878592986832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561d0323780 con 0x5561d02eb890 2024-09-10T05:37:40.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.325+0000 7f6057545640 1 -- 172.21.15.62:0/2138420581 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93878592986832] v32'221 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f604800a4d0 con 0x5561d02eb890 2024-09-10T05:37:40.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.325+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93878592967744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561d0323780 con 0x5561d02efd40 2024-09-10T05:37:40.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.329+0000 7f6056d44640 1 -- 172.21.15.62:0/2138420581 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93878592967744] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f605002e070 con 0x5561d02efd40 2024-09-10T05:37:40.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.329+0000 7f605923e9c0 20 remove_watcher() i=0 2024-09-10T05:37:40.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.329+0000 7f605923e9c0 2 removed watcher, disabling cache 2024-09-10T05:37:40.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.329+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93878592976144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561d0323780 con 0x5561d02eb890 2024-09-10T05:37:40.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.329+0000 7f6057545640 1 -- 172.21.15.62:0/2138420581 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93878592976144] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f604800a4d0 con 0x5561d02eb890 2024-09-10T05:37:40.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.329+0000 7f605923e9c0 20 remove_watcher() i=1 2024-09-10T05:37:40.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.329+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93878592979696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561d0323780 con 0x5561d02efd40 2024-09-10T05:37:40.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.333+0000 7f6056d44640 1 -- 172.21.15.62:0/2138420581 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93878592979696] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f605002e070 con 0x5561d02efd40 2024-09-10T05:37:40.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.333+0000 7f605923e9c0 20 remove_watcher() i=2 2024-09-10T05:37:40.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.333+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93878592981904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561d0323780 con 0x7f6050042b00 2024-09-10T05:37:40.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.333+0000 7f6057545640 1 -- 172.21.15.62:0/2138420581 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93878592981904] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f604800a4d0 con 0x7f6050042b00 2024-09-10T05:37:40.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.333+0000 7f605923e9c0 20 remove_watcher() i=3 2024-09-10T05:37:40.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.333+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93878592982960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561d0323780 con 0x5561d02efd40 2024-09-10T05:37:40.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.337+0000 7f6056d44640 1 -- 172.21.15.62:0/2138420581 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93878592982960] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f605002e070 con 0x5561d02efd40 2024-09-10T05:37:40.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.337+0000 7f605923e9c0 20 remove_watcher() i=4 2024-09-10T05:37:40.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.337+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93878592977200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561d02fd040 con 0x5561d02f3560 2024-09-10T05:37:40.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.337+0000 7f6056543640 1 -- 172.21.15.62:0/2138420581 <== osd.3 v2:172.21.15.62:6816/2708991149 22 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93878592977200] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60400b3040 con 0x5561d02f3560 2024-09-10T05:37:40.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.337+0000 7f605923e9c0 20 remove_watcher() i=5 2024-09-10T05:37:40.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.337+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93878592984528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561d02fb9c0 con 0x5561d02f3560 2024-09-10T05:37:40.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.337+0000 7f6056543640 1 -- 172.21.15.62:0/2138420581 <== osd.3 v2:172.21.15.62:6816/2708991149 23 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93878592984528] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60400b3040 con 0x5561d02f3560 2024-09-10T05:37:40.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.337+0000 7f605923e9c0 20 remove_watcher() i=6 2024-09-10T05:37:40.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.337+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93878592991968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561d02fb9c0 con 0x7f6050042b00 2024-09-10T05:37:40.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.341+0000 7f6057545640 1 -- 172.21.15.62:0/2138420581 <== osd.2 v2:172.21.15.62:6800/2677868286 15 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93878592991968] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f604800a4d0 con 0x7f6050042b00 2024-09-10T05:37:40.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.341+0000 7f605923e9c0 20 remove_watcher() i=7 2024-09-10T05:37:40.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.341+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5561d02efd40 msgr2=0x5561d02f2130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.341+0000 7f605923e9c0 1 --2- 172.21.15.62:0/2138420581 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5561d02efd40 0x5561d02f2130 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:40.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.341+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5561d02eb890 msgr2=0x5561d02edd50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.341+0000 7f605923e9c0 1 --2- 172.21.15.62:0/2138420581 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5561d02eb890 0x5561d02edd50 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:40.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.341+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f6050042b00 msgr2=0x7f605003c6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.341+0000 7f605923e9c0 1 --2- 172.21.15.62:0/2138420581 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f6050042b00 0x7f605003c6b0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:40.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.341+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5561d02f3560 msgr2=0x5561d02f5950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.341+0000 7f605923e9c0 1 --2- 172.21.15.62:0/2138420581 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5561d02f3560 0x5561d02f5950 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:40.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.341+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5f20039a70 msgr2=0x7f5f2003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.341+0000 7f605923e9c0 1 --2- 172.21.15.62:0/2138420581 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5f20039a70 0x7f5f2003bf30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f60400ae040 tx=0x7f60400b9040 comp rx=0 tx=0).stop 2024-09-10T05:37:40.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.341+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561d02d9620 msgr2=0x5561d02e0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.341+0000 7f6057545640 1 -- 172.21.15.62:0/2138420581 reap_dead start 2024-09-10T05:37:40.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.341+0000 7f605923e9c0 1 --2- 172.21.15.62:0/2138420581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561d02d9620 0x5561d02e0950 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f6050018bf0 tx=0x7f6050020f10 comp rx=0 tx=0).stop 2024-09-10T05:37:40.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.341+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 shutdown_connections 2024-09-10T05:37:40.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.341+0000 7f605923e9c0 1 --2- 172.21.15.62:0/2138420581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561d02d9620 0x5561d02e0950 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:40.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.341+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 >> 172.21.15.62:0/2138420581 conn(0x5561d02d5a50 msgr2=0x5561d02d3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:40.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.341+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 shutdown_connections 2024-09-10T05:37:40.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.341+0000 7f605923e9c0 1 -- 172.21.15.62:0/2138420581 wait complete. 2024-09-10T05:37:40.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.341+0000 7f605923e9c0 1 -- 172.21.15.62:0/2306153479 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5f30039a70 msgr2=0x7f5f3003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.341+0000 7f605923e9c0 1 --2- 172.21.15.62:0/2306153479 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5f30039a70 0x7f5f3003bf30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x5561d02b0800 tx=0x7f6040005ad0 comp rx=0 tx=0).stop 2024-09-10T05:37:40.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.341+0000 7f605923e9c0 1 -- 172.21.15.62:0/2306153479 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561d02cd060 msgr2=0x5561d02cd480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.341+0000 7f605923e9c0 1 --2- 172.21.15.62:0/2306153479 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561d02cd060 0x5561d02cd480 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f605004f4f0 tx=0x7f605001beb0 comp rx=0 tx=0).stop 2024-09-10T05:37:40.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.341+0000 7f605923e9c0 1 -- 172.21.15.62:0/2306153479 shutdown_connections 2024-09-10T05:37:40.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.341+0000 7f605923e9c0 1 --2- 172.21.15.62:0/2306153479 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5f30039a70 0x7f5f3003bf30 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:40.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.341+0000 7f605923e9c0 1 --2- 172.21.15.62:0/2306153479 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561d02cd060 0x5561d02cd480 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:40.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.341+0000 7f605923e9c0 1 -- 172.21.15.62:0/2306153479 >> 172.21.15.62:0/2306153479 conn(0x5561d02c2a10 msgr2=0x5561d02c2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:40.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.341+0000 7f605923e9c0 1 -- 172.21.15.62:0/2306153479 shutdown_connections 2024-09-10T05:37:40.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.341+0000 7f605923e9c0 1 -- 172.21.15.62:0/2306153479 wait complete. 2024-09-10T05:37:40.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.341+0000 7f605923e9c0 1 -- 172.21.15.62:0/202009196 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5561d02b7810 msgr2=0x5561d02b9c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.341+0000 7f605923e9c0 1 --2- 172.21.15.62:0/202009196 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5561d02b7810 0x5561d02b9c00 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:40.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.341+0000 7f605923e9c0 1 -- 172.21.15.62:0/202009196 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5561d01307d0 msgr2=0x5561d02b6520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.341+0000 7f605923e9c0 1 --2- 172.21.15.62:0/202009196 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5561d01307d0 0x5561d02b6520 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:40.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.341+0000 7f605923e9c0 1 -- 172.21.15.62:0/202009196 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5561d02bbfd0 msgr2=0x5561d02be3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.341+0000 7f605923e9c0 1 --2- 172.21.15.62:0/202009196 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5561d02bbfd0 0x5561d02be3c0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:40.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.341+0000 7f605923e9c0 1 -- 172.21.15.62:0/202009196 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5f3c039ac0 msgr2=0x7f5f3c03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.341+0000 7f605923e9c0 1 --2- 172.21.15.62:0/202009196 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f5f3c039ac0 0x7f5f3c03bf80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f60400ad000 tx=0x7f60400a5040 comp rx=0 tx=0).stop 2024-09-10T05:37:40.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.341+0000 7f605923e9c0 1 -- 172.21.15.62:0/202009196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561d01302a0 msgr2=0x5561d02af3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.341+0000 7f605923e9c0 1 --2- 172.21.15.62:0/202009196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5561d01302a0 0x5561d02af3b0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x5561d02a8c70 tx=0x7f6050000ee0 comp rx=0 tx=0).stop 2024-09-10T05:37:40.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.341+0000 7f6057545640 1 -- 172.21.15.62:0/202009196 reap_dead start 2024-09-10T05:37:40.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.341+0000 7f605923e9c0 1 -- 172.21.15.62:0/202009196 shutdown_connections 2024-09-10T05:37:40.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.341+0000 7f605923e9c0 1 -- 172.21.15.62:0/202009196 >> 172.21.15.62:0/202009196 conn(0x5561d01b5ac0 msgr2=0x5561d02a23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:40.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.341+0000 7f605923e9c0 1 -- 172.21.15.62:0/202009196 shutdown_connections 2024-09-10T05:37:40.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.341+0000 7f605923e9c0 1 -- 172.21.15.62:0/202009196 wait complete. 2024-09-10T05:37:40.359 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-10T05:37:40.323287Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:37:40.323269Z', 'tags': [], 'group_ids': []} 2024-09-10T05:37:40.379 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-10T05:37:40.386 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2024-09-10T05:37:40.386 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-10T05:37:40.386 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-10T05:37:40.387 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2024-09-10T05:37:40.420 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:37:40.420 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:37:40.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.413+0000 7fd57baaa9c0 1 Processor -- start 2024-09-10T05:37:40.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.413+0000 7fd57baaa9c0 1 -- start start 2024-09-10T05:37:40.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.417+0000 7fd57baaa9c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x563e5f4ec140 0x563e5f4ee530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.417+0000 7fd57baaa9c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563e5f39c9c0 con 0x563e5f4e7fa0 2024-09-10T05:37:40.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.417+0000 7fd57baaa9c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x563e5f3ec6d0 con 0x563e5f4ec140 2024-09-10T05:37:40.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.417+0000 7fd578daf640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x563e5f4ec140 0x563e5f4ee530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.417+0000 7fd578daf640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x563e5f4ec140 0x563e5f4ee530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:58468/0 (socket says 172.21.15.62:58468) 2024-09-10T05:37:40.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.417+0000 7fd578daf640 1 -- 172.21.15.62:0/1595096901 learned_addr learned my addr 172.21.15.62:0/1595096901 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:40.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.417+0000 7fd578daf640 1 -- 172.21.15.62:0/1595096901 >> v1:172.21.15.2:6789/0 conn(0x563e5f4e7fa0 legacy=0x563e5f4e8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.417+0000 7fd578daf640 1 -- 172.21.15.62:0/1595096901 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e5f390ca0 con 0x563e5f4ec140 2024-09-10T05:37:40.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.417+0000 7fd578daf640 1 --2- 172.21.15.62:0/1595096901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e5f4ec140 0x563e5f4ee530 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fd57000a5c0 tx=0x7fd57001b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cb1bc4e5ebd4b56 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.417+0000 7fd56bfff640 1 -- 172.21.15.62:0/1595096901 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5700a9590 con 0x563e5f4ec140 2024-09-10T05:37:40.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.417+0000 7fd56bfff640 1 -- 172.21.15.62:0/1595096901 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5700ae070 con 0x563e5f4ec140 2024-09-10T05:37:40.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.417+0000 7fd56bfff640 1 -- 172.21.15.62:0/1595096901 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5700a9880 con 0x563e5f4ec140 2024-09-10T05:37:40.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.421+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/1595096901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e5f4ec140 msgr2=0x563e5f4ee530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.421+0000 7fd57baaa9c0 1 --2- 172.21.15.62:0/1595096901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e5f4ec140 0x563e5f4ee530 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fd57000a5c0 tx=0x7fd57001b3d0 comp rx=0 tx=0).stop 2024-09-10T05:37:40.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.421+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/1595096901 shutdown_connections 2024-09-10T05:37:40.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.421+0000 7fd57baaa9c0 1 --2- 172.21.15.62:0/1595096901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e5f4ec140 0x563e5f4ee530 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:40.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.421+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/1595096901 >> 172.21.15.62:0/1595096901 conn(0x563e5f4e3ac0 msgr2=0x563e5f4e5ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:40.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.421+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/1595096901 shutdown_connections 2024-09-10T05:37:40.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.421+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/1595096901 wait complete. 2024-09-10T05:37:40.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.433+0000 7fd57baaa9c0 1 Processor -- start 2024-09-10T05:37:40.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.433+0000 7fd57baaa9c0 1 -- start start 2024-09-10T05:37:40.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.433+0000 7fd57baaa9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e5f4e7fa0 0x563e5f5d36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.437+0000 7fd57baaa9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563e5f3f0680 con 0x563e5f4e7fa0 2024-09-10T05:37:40.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.437+0000 7fd5795b0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e5f4e7fa0 0x563e5f5d36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.437+0000 7fd5795b0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e5f4e7fa0 0x563e5f5d36d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:58472/0 (socket says 172.21.15.62:58472) 2024-09-10T05:37:40.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.437+0000 7fd5795b0640 1 -- 172.21.15.62:0/2649843442 learned_addr learned my addr 172.21.15.62:0/2649843442 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:40.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.437+0000 7fd5795b0640 1 -- 172.21.15.62:0/2649843442 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e5f36bda0 con 0x563e5f4e7fa0 2024-09-10T05:37:40.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.437+0000 7fd5795b0640 1 --2- 172.21.15.62:0/2649843442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e5f4e7fa0 0x563e5f5d36d0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fd56c00b2d0 tx=0x7fd56c00b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d8c5dd79e996adf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.437+0000 7fd467606640 1 -- 172.21.15.62:0/2649843442 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd56c00a040 con 0x563e5f4e7fa0 2024-09-10T05:37:40.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.437+0000 7fd467606640 1 -- 172.21.15.62:0/2649843442 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd56c00f750 con 0x563e5f4e7fa0 2024-09-10T05:37:40.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.437+0000 7fd467606640 1 -- 172.21.15.62:0/2649843442 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd56c00fa70 con 0x563e5f4e7fa0 2024-09-10T05:37:40.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.437+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/2649843442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e5f4e7fa0 msgr2=0x563e5f5d36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.437+0000 7fd57baaa9c0 1 --2- 172.21.15.62:0/2649843442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e5f4e7fa0 0x563e5f5d36d0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fd56c00b2d0 tx=0x7fd56c00b790 comp rx=0 tx=0).stop 2024-09-10T05:37:40.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.437+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/2649843442 shutdown_connections 2024-09-10T05:37:40.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.437+0000 7fd57baaa9c0 1 --2- 172.21.15.62:0/2649843442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e5f4e7fa0 0x563e5f5d36d0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:40.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.437+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/2649843442 >> 172.21.15.62:0/2649843442 conn(0x563e5f4e3ac0 msgr2=0x563e5f5cf370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:40.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.437+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/2649843442 shutdown_connections 2024-09-10T05:37:40.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.437+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/2649843442 wait complete. 2024-09-10T05:37:40.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.437+0000 7fd57baaa9c0 1 Processor -- start 2024-09-10T05:37:40.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.437+0000 7fd57baaa9c0 1 -- start start 2024-09-10T05:37:40.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.437+0000 7fd57baaa9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e5f4ec140 0x563e5f5db080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.437+0000 7fd57baaa9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563e5f392a50 con 0x563e5f4ec140 2024-09-10T05:37:40.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.437+0000 7fd5795b0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e5f4ec140 0x563e5f5db080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.437+0000 7fd5795b0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e5f4ec140 0x563e5f5db080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:58474/0 (socket says 172.21.15.62:58474) 2024-09-10T05:37:40.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.437+0000 7fd5795b0640 1 -- 172.21.15.62:0/3204023861 learned_addr learned my addr 172.21.15.62:0/3204023861 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:40.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.437+0000 7fd5795b0640 1 -- 172.21.15.62:0/3204023861 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e5f5db5e0 con 0x563e5f4ec140 2024-09-10T05:37:40.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.441+0000 7fd5795b0640 1 --2- 172.21.15.62:0/3204023861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e5f4ec140 0x563e5f5db080 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x563e5f5d46c0 tx=0x7fd56c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.441+0000 7fd465e03640 1 -- 172.21.15.62:0/3204023861 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd56c01a690 con 0x563e5f4ec140 2024-09-10T05:37:40.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.441+0000 7fd465e03640 1 -- 172.21.15.62:0/3204023861 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd56c01a850 con 0x563e5f4ec140 2024-09-10T05:37:40.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.441+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/3204023861 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563e5f5db870 con 0x563e5f4ec140 2024-09-10T05:37:40.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.441+0000 7fd465e03640 1 -- 172.21.15.62:0/3204023861 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd56c01ab70 con 0x563e5f4ec140 2024-09-10T05:37:40.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.441+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/3204023861 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e5f5dc200 con 0x563e5f4ec140 2024-09-10T05:37:40.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.441+0000 7fd465e03640 1 -- 172.21.15.62:0/3204023861 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd56c017070 con 0x563e5f4ec140 2024-09-10T05:37:40.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.441+0000 7fd465e03640 1 --2- 172.21.15.62:0/3204023861 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fd460039a70 0x7fd46003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.441+0000 7fd465e03640 1 -- 172.21.15.62:0/3204023861 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7fd56c015020 con 0x563e5f4ec140 2024-09-10T05:37:40.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.441+0000 7fd578daf640 1 --2- 172.21.15.62:0/3204023861 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fd460039a70 0x7fd46003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.441+0000 7fd57baaa9c0 1 --2- 172.21.15.62:0/3204023861 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x563e5f5e0140 0x563e5f5e2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.441+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/3204023861 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e5f5e2a70 con 0x563e5f5e0140 2024-09-10T05:37:40.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.441+0000 7fd579db1640 1 --2- 172.21.15.62:0/3204023861 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x563e5f5e0140 0x563e5f5e2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.441+0000 7fd578daf640 1 --2- 172.21.15.62:0/3204023861 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fd460039a70 0x7fd46003bf30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd5700ad000 tx=0x7fd5700a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.441+0000 7fd579db1640 1 --2- 172.21.15.62:0/3204023861 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x563e5f5e0140 0x563e5f5e2530 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.441+0000 7fd579db1640 1 -- 172.21.15.62:0/3204023861 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd57400a4d0 con 0x563e5f5e0140 2024-09-10T05:37:40.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.441+0000 7fd57baaa9c0 1 --2- 172.21.15.62:0/3204023861 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x563e5f5e3520 0x563e5f5e59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.441+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/3204023861 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e5f5e6150 con 0x563e5f5e3520 2024-09-10T05:37:40.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.441+0000 7fd5795b0640 1 --2- 172.21.15.62:0/3204023861 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x563e5f5e3520 0x563e5f5e59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.445+0000 7fd5795b0640 1 --2- 172.21.15.62:0/3204023861 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x563e5f5e3520 0x563e5f5e59e0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.445+0000 7fd5795b0640 1 -- 172.21.15.62:0/3204023861 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd56c02e070 con 0x563e5f5e3520 2024-09-10T05:37:40.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.445+0000 7fd57baaa9c0 1 --2- 172.21.15.62:0/3204023861 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x563e5f5e7f10 0x563e5f5ea300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.445+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/3204023861 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e5f5ea9f0 con 0x563e5f5e7f10 2024-09-10T05:37:40.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.445+0000 7fd578daf640 1 --2- 172.21.15.62:0/3204023861 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x563e5f5e7f10 0x563e5f5ea300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.445+0000 7fd578daf640 1 --2- 172.21.15.62:0/3204023861 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x563e5f5e7f10 0x563e5f5ea300 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.445+0000 7fd578daf640 1 -- 172.21.15.62:0/3204023861 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd5700a9ac0 con 0x563e5f5e7f10 2024-09-10T05:37:40.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.445+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/3204023861 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e5f5e6db0 con 0x563e5f5e3520 2024-09-10T05:37:40.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.445+0000 7fd5795b0640 1 -- 172.21.15.62:0/3204023861 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd56c02e070 con 0x563e5f5e3520 2024-09-10T05:37:40.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.445+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/3204023861 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e5f5e7210 con 0x563e5f5e7f10 2024-09-10T05:37:40.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.445+0000 7fd578daf640 1 -- 172.21.15.62:0/3204023861 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd5700a9ac0 con 0x563e5f5e7f10 2024-09-10T05:37:40.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.445+0000 7fd57baaa9c0 1 Processor -- start 2024-09-10T05:37:40.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.445+0000 7fd57baaa9c0 1 -- start start 2024-09-10T05:37:40.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.445+0000 7fd57baaa9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e5f5f9010 0x563e5f5f9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.445+0000 7fd57baaa9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563e5f3fd450 con 0x563e5f5f9010 2024-09-10T05:37:40.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.449+0000 7fd5795b0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e5f5f9010 0x563e5f5f9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.449+0000 7fd5795b0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e5f5f9010 0x563e5f5f9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:58486/0 (socket says 172.21.15.62:58486) 2024-09-10T05:37:40.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.449+0000 7fd5795b0640 1 -- 172.21.15.62:0/2792305808 learned_addr learned my addr 172.21.15.62:0/2792305808 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:40.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.449+0000 7fd5795b0640 1 -- 172.21.15.62:0/2792305808 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e5f5f9a70 con 0x563e5f5f9010 2024-09-10T05:37:40.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.449+0000 7fd5795b0640 1 --2- 172.21.15.62:0/2792305808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e5f5f9010 0x563e5f5f9430 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fd56c017550 tx=0x7fd56c00eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.449+0000 7fd45effd640 1 -- 172.21.15.62:0/2792305808 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd56c047b20 con 0x563e5f5f9010 2024-09-10T05:37:40.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.449+0000 7fd45effd640 1 -- 172.21.15.62:0/2792305808 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd56c047cc0 con 0x563e5f5f9010 2024-09-10T05:37:40.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.449+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/2792305808 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563e5f5fa2d0 con 0x563e5f5f9010 2024-09-10T05:37:40.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.449+0000 7fd45effd640 1 -- 172.21.15.62:0/2792305808 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd56c047fa0 con 0x563e5f5f9010 2024-09-10T05:37:40.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.449+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/2792305808 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e5f5fa2d0 con 0x563e5f5f9010 2024-09-10T05:37:40.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.449+0000 7fd45effd640 1 -- 172.21.15.62:0/2792305808 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd56c0509b0 con 0x563e5f5f9010 2024-09-10T05:37:40.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.449+0000 7fd45effd640 1 --2- 172.21.15.62:0/2792305808 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fd450039a70 0x7fd45003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.449+0000 7fd45effd640 1 -- 172.21.15.62:0/2792305808 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7fd56c039070 con 0x563e5f5f9010 2024-09-10T05:37:40.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.449+0000 7fd578daf640 1 --2- 172.21.15.62:0/2792305808 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fd450039a70 0x7fd45003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.449+0000 7fd57baaa9c0 1 Processor -- start 2024-09-10T05:37:40.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.449+0000 7fd57baaa9c0 1 -- start start 2024-09-10T05:37:40.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.449+0000 7fd578daf640 1 --2- 172.21.15.62:0/2792305808 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fd450039a70 0x7fd45003bf30 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x563e5f5dd140 tx=0x7fd570005ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.449+0000 7fd57baaa9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e5f6055c0 0x563e5f6059a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.449+0000 7fd57baaa9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563e5f5d3f00 con 0x563e5f6055c0 2024-09-10T05:37:40.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.449+0000 7fd5795b0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e5f6055c0 0x563e5f6059a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.449+0000 7fd5795b0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e5f6055c0 0x563e5f6059a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:58496/0 (socket says 172.21.15.62:58496) 2024-09-10T05:37:40.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.453+0000 7fd5795b0640 1 -- 172.21.15.62:0/305861982 learned_addr learned my addr 172.21.15.62:0/305861982 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:40.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.453+0000 7fd5795b0640 1 -- 172.21.15.62:0/305861982 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e5f605f70 con 0x563e5f6055c0 2024-09-10T05:37:40.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.453+0000 7fd5795b0640 1 --2- 172.21.15.62:0/305861982 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e5f6055c0 0x563e5f6059a0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fd56c017960 tx=0x7fd56c031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cae226be5f49ce2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.453+0000 7fd45cff9640 1 -- 172.21.15.62:0/305861982 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd56c035040 con 0x563e5f6055c0 2024-09-10T05:37:40.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.453+0000 7fd45cff9640 1 -- 172.21.15.62:0/305861982 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd56c061020 con 0x563e5f6055c0 2024-09-10T05:37:40.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.453+0000 7fd45cff9640 1 -- 172.21.15.62:0/305861982 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd56c031450 con 0x563e5f6055c0 2024-09-10T05:37:40.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.453+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/305861982 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e5f6055c0 msgr2=0x563e5f6059a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.453+0000 7fd57baaa9c0 1 --2- 172.21.15.62:0/305861982 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e5f6055c0 0x563e5f6059a0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fd56c017960 tx=0x7fd56c031a50 comp rx=0 tx=0).stop 2024-09-10T05:37:40.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.453+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/305861982 shutdown_connections 2024-09-10T05:37:40.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.453+0000 7fd57baaa9c0 1 --2- 172.21.15.62:0/305861982 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e5f6055c0 0x563e5f6059a0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:40.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.453+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/305861982 >> 172.21.15.62:0/305861982 conn(0x563e5f6019f0 msgr2=0x563e5f5ffc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:40.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.453+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/305861982 shutdown_connections 2024-09-10T05:37:40.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.453+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/305861982 wait complete. 2024-09-10T05:37:40.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.453+0000 7fd57baaa9c0 1 Processor -- start 2024-09-10T05:37:40.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.453+0000 7fd57baaa9c0 1 -- start start 2024-09-10T05:37:40.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.453+0000 7fd57baaa9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e5f6055c0 0x563e5f60c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.453+0000 7fd57baaa9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563e5f606450 con 0x563e5f6055c0 2024-09-10T05:37:40.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.453+0000 7fd5795b0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e5f6055c0 0x563e5f60c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.453+0000 7fd5795b0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e5f6055c0 0x563e5f60c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:58502/0 (socket says 172.21.15.62:58502) 2024-09-10T05:37:40.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.453+0000 7fd5795b0640 1 -- 172.21.15.62:0/544551480 learned_addr learned my addr 172.21.15.62:0/544551480 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:40.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.453+0000 7fd5795b0640 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e5f60ce20 con 0x563e5f6055c0 2024-09-10T05:37:40.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.453+0000 7fd5795b0640 1 --2- 172.21.15.62:0/544551480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e5f6055c0 0x563e5f60c8c0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fd56c04dad0 tx=0x7fd56c025000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.457+0000 7fd44effd640 1 -- 172.21.15.62:0/544551480 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd56c060030 con 0x563e5f6055c0 2024-09-10T05:37:40.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.457+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563e5f60ce20 con 0x563e5f6055c0 2024-09-10T05:37:40.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.457+0000 7fd44effd640 1 -- 172.21.15.62:0/544551480 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd56c0500d0 con 0x563e5f6055c0 2024-09-10T05:37:40.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.457+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e5f60ce20 con 0x563e5f6055c0 2024-09-10T05:37:40.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.457+0000 7fd44effd640 1 -- 172.21.15.62:0/544551480 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd56c078060 con 0x563e5f6055c0 2024-09-10T05:37:40.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.457+0000 7fd44effd640 1 -- 172.21.15.62:0/544551480 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd56c02ca10 con 0x563e5f6055c0 2024-09-10T05:37:40.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.457+0000 7fd44effd640 1 --2- 172.21.15.62:0/544551480 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fd444039ac0 0x7fd44403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.457+0000 7fd44effd640 1 -- 172.21.15.62:0/544551480 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7fd56c062030 con 0x563e5f6055c0 2024-09-10T05:37:40.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.457+0000 7fd578daf640 1 --2- 172.21.15.62:0/544551480 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fd444039ac0 0x7fd44403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.457+0000 7fd57baaa9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:40.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.457+0000 7fd57baaa9c0 1 --2- 172.21.15.62:0/544551480 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x563e5f617760 0x563e5f619c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.457+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e5f61a370 con 0x563e5f617760 2024-09-10T05:37:40.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.457+0000 7fd579db1640 1 --2- 172.21.15.62:0/544551480 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x563e5f617760 0x563e5f619c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.457+0000 7fd578daf640 1 --2- 172.21.15.62:0/544551480 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fd444039ac0 0x7fd44403bf80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd5700ce040 tx=0x7fd5700c1040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.457+0000 7fd579db1640 1 --2- 172.21.15.62:0/544551480 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x563e5f617760 0x563e5f619c20 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.457+0000 7fd579db1640 1 -- 172.21.15.62:0/544551480 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd57400a4d0 con 0x563e5f617760 2024-09-10T05:37:40.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.457+0000 7fd57baaa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:40.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.457+0000 7fd57baaa9c0 20 realm 2024-09-10T05:37:40.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.457+0000 7fd57baaa9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:40.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.457+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e5f616a90 con 0x563e5f617760 2024-09-10T05:37:40.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.457+0000 7fd579db1640 1 -- 172.21.15.62:0/544551480 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd57400a4d0 con 0x563e5f617760 2024-09-10T05:37:40.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.457+0000 7fd57baaa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:40.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.457+0000 7fd57baaa9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:37:40.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.457+0000 7fd57baaa9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:40.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.457+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e5f61ae30 con 0x563e5f617760 2024-09-10T05:37:40.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.457+0000 7fd579db1640 1 -- 172.21.15.62:0/544551480 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd57400a4d0 con 0x563e5f617760 2024-09-10T05:37:40.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.457+0000 7fd57baaa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:40.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.457+0000 7fd57baaa9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:40.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.457+0000 7fd57baaa9c0 1 --2- 172.21.15.62:0/544551480 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x563e5f61bc10 0x563e5f61e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.457+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e5f61e6d0 con 0x563e5f61bc10 2024-09-10T05:37:40.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.461+0000 7fd5795b0640 1 --2- 172.21.15.62:0/544551480 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x563e5f61bc10 0x563e5f61e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.461+0000 7fd5795b0640 1 --2- 172.21.15.62:0/544551480 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x563e5f61bc10 0x563e5f61e000 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.461+0000 7fd5795b0640 1 -- 172.21.15.62:0/544551480 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd56c07a070 con 0x563e5f61bc10 2024-09-10T05:37:40.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.461+0000 7fd57baaa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:37:40.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.461+0000 7fd57baaa9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:40.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.461+0000 7fd57baaa9c0 1 --2- 172.21.15.62:0/544551480 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x563e5f61f430 0x563e5f621820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.461+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e5f621f90 con 0x563e5f61f430 2024-09-10T05:37:40.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.461+0000 7fd578daf640 1 --2- 172.21.15.62:0/544551480 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x563e5f61f430 0x563e5f621820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.461+0000 7fd578daf640 1 --2- 172.21.15.62:0/544551480 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x563e5f61f430 0x563e5f621820 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.461+0000 7fd578daf640 1 -- 172.21.15.62:0/544551480 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd5700a9ac0 con 0x563e5f61f430 2024-09-10T05:37:40.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.461+0000 7fd57baaa9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:37:40.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.461+0000 7fd57baaa9c0 20 searching for the correct realm 2024-09-10T05:37:40.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.461+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e5f623860 con 0x563e5f61f430 2024-09-10T05:37:40.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.461+0000 7fd578daf640 1 -- 172.21.15.62:0/544551480 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5700a9ac0 con 0x563e5f61f430 2024-09-10T05:37:40.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.461+0000 7fd578daf640 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e5f623860 con 0x563e5f61bc10 2024-09-10T05:37:40.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.461+0000 7fd5795b0640 1 -- 172.21.15.62:0/544551480 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd56c07a070 con 0x563e5f61bc10 2024-09-10T05:37:40.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.461+0000 7fd5795b0640 1 --2- 172.21.15.62:0/544551480 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fd56c073020 0x7fd56c027a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.461+0000 7fd5795b0640 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e5f623860 con 0x7fd56c073020 2024-09-10T05:37:40.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.461+0000 7fd579db1640 1 --2- 172.21.15.62:0/544551480 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fd56c073020 0x7fd56c027a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.465+0000 7fd579db1640 1 --2- 172.21.15.62:0/544551480 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fd56c073020 0x7fd56c027a50 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.465+0000 7fd579db1640 1 -- 172.21.15.62:0/544551480 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd57400a4d0 con 0x7fd56c073020 2024-09-10T05:37:40.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.465+0000 7fd579db1640 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e5f623860 con 0x563e5f617760 2024-09-10T05:37:40.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.465+0000 7fd579db1640 1 -- 172.21.15.62:0/544551480 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd57400a4d0 con 0x563e5f617760 2024-09-10T05:37:40.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.465+0000 7fd579db1640 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e5f623860 con 0x563e5f617760 2024-09-10T05:37:40.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.465+0000 7fd579db1640 1 -- 172.21.15.62:0/544551480 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd57400a4d0 con 0x563e5f617760 2024-09-10T05:37:40.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.465+0000 7fd579db1640 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e5f623860 con 0x563e5f61f430 2024-09-10T05:37:40.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.465+0000 7fd578daf640 1 -- 172.21.15.62:0/544551480 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5700a9ac0 con 0x563e5f61f430 2024-09-10T05:37:40.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.465+0000 7fd578daf640 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e5f623860 con 0x563e5f617760 2024-09-10T05:37:40.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.465+0000 7fd579db1640 1 -- 172.21.15.62:0/544551480 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd57400a4d0 con 0x563e5f617760 2024-09-10T05:37:40.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.465+0000 7fd579db1640 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e5f623860 con 0x563e5f61bc10 2024-09-10T05:37:40.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.465+0000 7fd5795b0640 1 -- 172.21.15.62:0/544551480 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd56c07a070 con 0x563e5f61bc10 2024-09-10T05:37:40.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.465+0000 7fd5795b0640 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e5f623860 con 0x563e5f61bc10 2024-09-10T05:37:40.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.465+0000 7fd5795b0640 1 -- 172.21.15.62:0/544551480 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd56c07a070 con 0x563e5f61bc10 2024-09-10T05:37:40.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.465+0000 7fd5795b0640 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e5f623860 con 0x563e5f617760 2024-09-10T05:37:40.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.465+0000 7fd579db1640 1 -- 172.21.15.62:0/544551480 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd57400a4d0 con 0x563e5f617760 2024-09-10T05:37:40.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.465+0000 7fd579db1640 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e5f623860 con 0x7fd56c073020 2024-09-10T05:37:40.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.465+0000 7fd579db1640 1 -- 172.21.15.62:0/544551480 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd57400a4d0 con 0x7fd56c073020 2024-09-10T05:37:40.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.469+0000 7fd579db1640 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e5f623860 con 0x563e5f617760 2024-09-10T05:37:40.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.469+0000 7fd579db1640 1 -- 172.21.15.62:0/544551480 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd57400a4d0 con 0x563e5f617760 2024-09-10T05:37:40.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.469+0000 7fd579db1640 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e5f623860 con 0x7fd56c073020 2024-09-10T05:37:40.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.469+0000 7fd579db1640 1 -- 172.21.15.62:0/544551480 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd57400a4d0 con 0x7fd56c073020 2024-09-10T05:37:40.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.469+0000 7fd579db1640 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e5f623860 con 0x563e5f61bc10 2024-09-10T05:37:40.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.469+0000 7fd5795b0640 1 -- 172.21.15.62:0/544551480 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd56c07a070 con 0x563e5f61bc10 2024-09-10T05:37:40.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.469+0000 7fd5795b0640 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e5f623860 con 0x563e5f61f430 2024-09-10T05:37:40.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.469+0000 7fd578daf640 1 -- 172.21.15.62:0/544551480 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5700a9ac0 con 0x563e5f61f430 2024-09-10T05:37:40.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.469+0000 7fd578daf640 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e5f623860 con 0x563e5f617760 2024-09-10T05:37:40.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.469+0000 7fd579db1640 1 -- 172.21.15.62:0/544551480 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd57400a4d0 con 0x563e5f617760 2024-09-10T05:37:40.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.469+0000 7fd579db1640 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e5f623860 con 0x563e5f61bc10 2024-09-10T05:37:40.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.469+0000 7fd5795b0640 1 -- 172.21.15.62:0/544551480 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd56c07a070 con 0x563e5f61bc10 2024-09-10T05:37:40.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.469+0000 7fd5795b0640 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e5f623860 con 0x563e5f61f430 2024-09-10T05:37:40.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.469+0000 7fd578daf640 1 -- 172.21.15.62:0/544551480 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 32 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7fd5700a9ac0 con 0x563e5f61f430 2024-09-10T05:37:40.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.469+0000 7fd578daf640 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e5f623860 con 0x563e5f617760 2024-09-10T05:37:40.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.469+0000 7fd579db1640 1 -- 172.21.15.62:0/544551480 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd57400a4d0 con 0x563e5f617760 2024-09-10T05:37:40.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.469+0000 7fd579db1640 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e5f623860 con 0x563e5f617760 2024-09-10T05:37:40.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.469+0000 7fd579db1640 1 -- 172.21.15.62:0/544551480 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd57400a4d0 con 0x563e5f617760 2024-09-10T05:37:40.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.469+0000 7fd579db1640 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e5f623860 con 0x563e5f617760 2024-09-10T05:37:40.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.469+0000 7fd579db1640 1 -- 172.21.15.62:0/544551480 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd57400a4d0 con 0x563e5f617760 2024-09-10T05:37:40.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.473+0000 7fd579db1640 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e5f623860 con 0x563e5f61f430 2024-09-10T05:37:40.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.473+0000 7fd578daf640 1 -- 172.21.15.62:0/544551480 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5700a9ac0 con 0x563e5f61f430 2024-09-10T05:37:40.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.473+0000 7fd578daf640 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e5f623860 con 0x7fd56c073020 2024-09-10T05:37:40.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.473+0000 7fd579db1640 1 -- 172.21.15.62:0/544551480 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd57400a4d0 con 0x7fd56c073020 2024-09-10T05:37:40.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.473+0000 7fd579db1640 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e5f623860 con 0x563e5f617760 2024-09-10T05:37:40.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.473+0000 7fd579db1640 1 -- 172.21.15.62:0/544551480 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd57400a4d0 con 0x563e5f617760 2024-09-10T05:37:40.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.473+0000 7fd579db1640 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e5f623860 con 0x7fd56c073020 2024-09-10T05:37:40.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.473+0000 7fd579db1640 1 -- 172.21.15.62:0/544551480 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd57400a4d0 con 0x7fd56c073020 2024-09-10T05:37:40.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.473+0000 7fd579db1640 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e5f623860 con 0x563e5f61f430 2024-09-10T05:37:40.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.473+0000 7fd578daf640 1 -- 172.21.15.62:0/544551480 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5700a9ac0 con 0x563e5f61f430 2024-09-10T05:37:40.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.473+0000 7fd578daf640 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e5f623860 con 0x7fd56c073020 2024-09-10T05:37:40.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.473+0000 7fd579db1640 1 -- 172.21.15.62:0/544551480 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd57400a4d0 con 0x7fd56c073020 2024-09-10T05:37:40.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.473+0000 7fd579db1640 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e5f623860 con 0x563e5f61bc10 2024-09-10T05:37:40.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.473+0000 7fd5795b0640 1 -- 172.21.15.62:0/544551480 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd56c07a070 con 0x563e5f61bc10 2024-09-10T05:37:40.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.473+0000 7fd5795b0640 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e5f623860 con 0x563e5f61bc10 2024-09-10T05:37:40.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.473+0000 7fd5795b0640 1 -- 172.21.15.62:0/544551480 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd56c07a070 con 0x563e5f61bc10 2024-09-10T05:37:40.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.473+0000 7fd5795b0640 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e5f623860 con 0x563e5f61f430 2024-09-10T05:37:40.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.473+0000 7fd578daf640 1 -- 172.21.15.62:0/544551480 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5700a9ac0 con 0x563e5f61f430 2024-09-10T05:37:40.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.473+0000 7fd578daf640 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e5f623860 con 0x563e5f61bc10 2024-09-10T05:37:40.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.477+0000 7fd5795b0640 1 -- 172.21.15.62:0/544551480 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd56c07a070 con 0x563e5f61bc10 2024-09-10T05:37:40.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.477+0000 7fd5795b0640 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e5f623860 con 0x563e5f61bc10 2024-09-10T05:37:40.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.477+0000 7fd5795b0640 1 -- 172.21.15.62:0/544551480 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd56c07a070 con 0x563e5f61bc10 2024-09-10T05:37:40.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.477+0000 7fd57baaa9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:37:40.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.477+0000 7fd57baaa9c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:37:40.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.477+0000 7fd57baaa9c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:37:40.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.477+0000 7fd57baaa9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:37:40.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.477+0000 7fd57baaa9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:37:40.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.477+0000 7fd57baaa9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:37:40.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.477+0000 7fd57baaa9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:40.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.477+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e5f622950 con 0x563e5f617760 2024-09-10T05:37:40.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.477+0000 7fd579db1640 1 -- 172.21.15.62:0/544551480 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd57400a4d0 con 0x563e5f617760 2024-09-10T05:37:40.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.477+0000 7fd57baaa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:40.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.477+0000 7fd57baaa9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:40.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.477+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e5f622560 con 0x563e5f61bc10 2024-09-10T05:37:40.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.477+0000 7fd5795b0640 1 -- 172.21.15.62:0/544551480 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd56c07a070 con 0x563e5f61bc10 2024-09-10T05:37:40.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.477+0000 7fd57baaa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:37:40.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.477+0000 7fd57baaa9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:40.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.477+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e5f623280 con 0x563e5f61f430 2024-09-10T05:37:40.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.477+0000 7fd578daf640 1 -- 172.21.15.62:0/544551480 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd5700a9ac0 con 0x563e5f61f430 2024-09-10T05:37:40.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.477+0000 7fd57baaa9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:37:40.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.477+0000 7fd57baaa9c0 20 zone default found 2024-09-10T05:37:40.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.477+0000 7fd57baaa9c0 4 Realm: () 2024-09-10T05:37:40.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.477+0000 7fd57baaa9c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:37:40.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.477+0000 7fd57baaa9c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:37:40.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.477+0000 7fd57baaa9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:37:40.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.477+0000 7fd57baaa9c0 20 zonegroup default 2024-09-10T05:37:40.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.477+0000 7fd57baaa9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:40.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.477+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e5f624140 con 0x7fd56c073020 2024-09-10T05:37:40.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.477+0000 7fd579db1640 1 -- 172.21.15.62:0/544551480 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd57400a4d0 con 0x7fd56c073020 2024-09-10T05:37:40.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.477+0000 7fd57baaa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:40.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.477+0000 7fd57baaa9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:40.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.477+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e5f626380 con 0x563e5f61f430 2024-09-10T05:37:40.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.477+0000 7fd578daf640 1 -- 172.21.15.62:0/544551480 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd5700a9ac0 con 0x563e5f61f430 2024-09-10T05:37:40.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.481+0000 7fd57baaa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:40.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.481+0000 7fd57baaa9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:40.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.481+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e5f626720 con 0x563e5f61f430 2024-09-10T05:37:40.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.481+0000 7fd578daf640 1 -- 172.21.15.62:0/544551480 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd5700a9ac0 con 0x563e5f61f430 2024-09-10T05:37:40.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.481+0000 7fd57baaa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:40.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.481+0000 7fd57baaa9c0 20 started sync module instance, tier type = 2024-09-10T05:37:40.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.481+0000 7fd57baaa9c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:37:40.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.481+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e5f6257c0 con 0x563e5f61bc10 2024-09-10T05:37:40.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.481+0000 7fd5795b0640 1 -- 172.21.15.62:0/544551480 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd56c07a070 con 0x563e5f61bc10 2024-09-10T05:37:40.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.481+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94825888242928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e5f6257c0 con 0x563e5f61bc10 2024-09-10T05:37:40.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.481+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e5f6270e0 con 0x563e5f617760 2024-09-10T05:37:40.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.485+0000 7fd579db1640 1 -- 172.21.15.62:0/544551480 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd57400a4d0 con 0x563e5f617760 2024-09-10T05:37:40.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.485+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94825888246832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e5f627980 con 0x563e5f617760 2024-09-10T05:37:40.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.485+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e5f6283a0 con 0x563e5f61bc10 2024-09-10T05:37:40.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.485+0000 7fd5795b0640 1 -- 172.21.15.62:0/544551480 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94825888242928] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd56c07a070 con 0x563e5f61bc10 2024-09-10T05:37:40.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.485+0000 7fd579db1640 1 -- 172.21.15.62:0/544551480 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94825888246832] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd57400a4d0 con 0x563e5f617760 2024-09-10T05:37:40.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.485+0000 7fd5795b0640 1 -- 172.21.15.62:0/544551480 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd56c07a070 con 0x563e5f61bc10 2024-09-10T05:37:40.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.485+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94825888251536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e5f6274d0 con 0x563e5f61bc10 2024-09-10T05:37:40.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.485+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e5f628c40 con 0x7fd56c073020 2024-09-10T05:37:40.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.489+0000 7fd579db1640 1 -- 172.21.15.62:0/544551480 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd57400a4d0 con 0x7fd56c073020 2024-09-10T05:37:40.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.489+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94825888253840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e5f6274d0 con 0x7fd56c073020 2024-09-10T05:37:40.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.489+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e5f6296c0 con 0x563e5f61bc10 2024-09-10T05:37:40.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.489+0000 7fd5795b0640 1 -- 172.21.15.62:0/544551480 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94825888251536] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd56c07a070 con 0x563e5f61bc10 2024-09-10T05:37:40.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.489+0000 7fd579db1640 1 -- 172.21.15.62:0/544551480 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94825888253840] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd57400a4d0 con 0x7fd56c073020 2024-09-10T05:37:40.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.489+0000 7fd5795b0640 1 -- 172.21.15.62:0/544551480 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd56c07a070 con 0x563e5f61bc10 2024-09-10T05:37:40.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.489+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94825888254896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e5f6291d0 con 0x563e5f61bc10 2024-09-10T05:37:40.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.489+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e5f629f90 con 0x563e5f61f430 2024-09-10T05:37:40.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.493+0000 7fd578daf640 1 -- 172.21.15.62:0/544551480 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5700a9ac0 con 0x563e5f61f430 2024-09-10T05:37:40.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.493+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94825888258784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e5f6291d0 con 0x563e5f61f430 2024-09-10T05:37:40.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.493+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e5f62a9d0 con 0x563e5f61f430 2024-09-10T05:37:40.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.493+0000 7fd5795b0640 1 -- 172.21.15.62:0/544551480 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94825888254896] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd56c07a070 con 0x563e5f61bc10 2024-09-10T05:37:40.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.493+0000 7fd578daf640 1 -- 172.21.15.62:0/544551480 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(56 notify.6 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5700a9ac0 con 0x563e5f61f430 2024-09-10T05:37:40.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.493+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94825888240400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e5f62a9d0 con 0x563e5f61f430 2024-09-10T05:37:40.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.493+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e5f62b390 con 0x7fd56c073020 2024-09-10T05:37:40.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.493+0000 7fd578daf640 1 -- 172.21.15.62:0/544551480 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94825888258784] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5700a9ac0 con 0x563e5f61f430 2024-09-10T05:37:40.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.493+0000 7fd579db1640 1 -- 172.21.15.62:0/544551480 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd57400a4d0 con 0x7fd56c073020 2024-09-10T05:37:40.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.493+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94825888259840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e5f62b390 con 0x7fd56c073020 2024-09-10T05:37:40.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.493+0000 7fd57baaa9c0 20 add_watcher() i=0 2024-09-10T05:37:40.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.493+0000 7fd57baaa9c0 20 add_watcher() i=1 2024-09-10T05:37:40.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.493+0000 7fd57baaa9c0 20 add_watcher() i=2 2024-09-10T05:37:40.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.493+0000 7fd57baaa9c0 20 add_watcher() i=3 2024-09-10T05:37:40.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.493+0000 7fd57baaa9c0 20 add_watcher() i=4 2024-09-10T05:37:40.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.493+0000 7fd57baaa9c0 20 add_watcher() i=5 2024-09-10T05:37:40.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.493+0000 7fd578daf640 1 -- 172.21.15.62:0/544551480 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94825888240400] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5700a9ac0 con 0x563e5f61f430 2024-09-10T05:37:40.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.493+0000 7fd57baaa9c0 20 add_watcher() i=6 2024-09-10T05:37:40.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.497+0000 7fd579db1640 1 -- 172.21.15.62:0/544551480 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94825888259840] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd57400a4d0 con 0x7fd56c073020 2024-09-10T05:37:40.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.497+0000 7fd57baaa9c0 20 add_watcher() i=7 2024-09-10T05:37:40.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.497+0000 7fd57baaa9c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:37:40.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.497+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e5f62a520 con 0x563e5f617760 2024-09-10T05:37:40.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.497+0000 7fd579db1640 1 -- 172.21.15.62:0/544551480 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd57400a4d0 con 0x563e5f617760 2024-09-10T05:37:40.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.497+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94825888261408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e5f62b880 con 0x563e5f617760 2024-09-10T05:37:40.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.497+0000 7fd579db1640 1 -- 172.21.15.62:0/544551480 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94825888261408] v32'222 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd57400a4d0 con 0x563e5f617760 2024-09-10T05:37:40.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.497+0000 7fd42f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:37:40.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.497+0000 7fd57baaa9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:37:40.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.497+0000 7fd57baaa9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:37:40.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.497+0000 7fd57baaa9c0 5 note: GC not initialized 2024-09-10T05:37:40.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.497+0000 7fd42e7e4640 20 reqs_thread_entry: start 2024-09-10T05:37:40.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.497+0000 7fd57baaa9c0 20 init_complete bucket index max shards: 11 2024-09-10T05:37:40.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.497+0000 7fd57baaa9c0 20 Filter name: none 2024-09-10T05:37:40.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.501+0000 7fd39ffff640 20 reqs_thread_entry: start 2024-09-10T05:37:40.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.501+0000 7fd57baaa9c0 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-10T05:37:40.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.501+0000 7fd57baaa9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:40.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.501+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e5f651570 con 0x7fd56c073020 2024-09-10T05:37:40.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.501+0000 7fd579db1640 1 -- 172.21.15.62:0/544551480 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(62 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fd57400a4d0 con 0x7fd56c073020 2024-09-10T05:37:40.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.501+0000 7fd57baaa9c0 20 rados_obj.operate() r=0 bl.length=380 2024-09-10T05:37:40.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.501+0000 7fd57baaa9c0 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-10T05:37:40.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.501+0000 7fd57baaa9c0 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-10T05:37:40.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.501+0000 7fd57baaa9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:37:40.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.501+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:63 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e5f655860 con 0x7fd56c073020 2024-09-10T05:37:40.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.501+0000 7fd579db1640 1 -- 172.21.15.62:0/544551480 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(63 fud [create,call,writefull 0~206] v32'6 uv5 ondisk = -17 ((17) File exists)) ==== 231+0+0 (crc 0 0 0) 0x7fd57400a4d0 con 0x7fd56c073020 2024-09-10T05:37:40.508 INFO:teuthology.orchestra.run.smithi062.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2024-09-10T05:37:40.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.505+0000 7fd42f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:37:40.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.505+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94825888261408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e5f64f350 con 0x563e5f617760 2024-09-10T05:37:40.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.505+0000 7fd579db1640 1 -- 172.21.15.62:0/544551480 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94825888261408] v32'223 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd57400a4d0 con 0x563e5f617760 2024-09-10T05:37:40.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.505+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94825888242928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e5f64f350 con 0x563e5f61bc10 2024-09-10T05:37:40.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.509+0000 7fd5795b0640 1 -- 172.21.15.62:0/544551480 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94825888242928] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd56c07a070 con 0x563e5f61bc10 2024-09-10T05:37:40.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.509+0000 7fd57baaa9c0 20 remove_watcher() i=0 2024-09-10T05:37:40.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.509+0000 7fd57baaa9c0 2 removed watcher, disabling cache 2024-09-10T05:37:40.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.509+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94825888246832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e5f64f350 con 0x563e5f617760 2024-09-10T05:37:40.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.509+0000 7fd579db1640 1 -- 172.21.15.62:0/544551480 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94825888246832] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd57400a4d0 con 0x563e5f617760 2024-09-10T05:37:40.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.509+0000 7fd57baaa9c0 20 remove_watcher() i=1 2024-09-10T05:37:40.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.509+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94825888251536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e5f626c30 con 0x563e5f61bc10 2024-09-10T05:37:40.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.509+0000 7fd5795b0640 1 -- 172.21.15.62:0/544551480 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94825888251536] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd56c07a070 con 0x563e5f61bc10 2024-09-10T05:37:40.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.509+0000 7fd57baaa9c0 20 remove_watcher() i=2 2024-09-10T05:37:40.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.509+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94825888253840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e5f64f350 con 0x7fd56c073020 2024-09-10T05:37:40.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.513+0000 7fd579db1640 1 -- 172.21.15.62:0/544551480 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94825888253840] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd57400a4d0 con 0x7fd56c073020 2024-09-10T05:37:40.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.513+0000 7fd57baaa9c0 20 remove_watcher() i=3 2024-09-10T05:37:40.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.513+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94825888254896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e5f627e90 con 0x563e5f61bc10 2024-09-10T05:37:40.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.513+0000 7fd5795b0640 1 -- 172.21.15.62:0/544551480 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94825888254896] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd56c07a070 con 0x563e5f61bc10 2024-09-10T05:37:40.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.513+0000 7fd57baaa9c0 20 remove_watcher() i=4 2024-09-10T05:37:40.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.513+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94825888258784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e5f626c30 con 0x563e5f61f430 2024-09-10T05:37:40.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.517+0000 7fd578daf640 1 -- 172.21.15.62:0/544551480 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94825888258784] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5700a9ac0 con 0x563e5f61f430 2024-09-10T05:37:40.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.517+0000 7fd57baaa9c0 20 remove_watcher() i=5 2024-09-10T05:37:40.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.517+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94825888240400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e5f64f350 con 0x563e5f61f430 2024-09-10T05:37:40.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.517+0000 7fd578daf640 1 -- 172.21.15.62:0/544551480 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94825888240400] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5700a9ac0 con 0x563e5f61f430 2024-09-10T05:37:40.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.517+0000 7fd57baaa9c0 20 remove_watcher() i=6 2024-09-10T05:37:40.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.517+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/544551480 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94825888259840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e5f627e90 con 0x7fd56c073020 2024-09-10T05:37:40.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.517+0000 7fd579db1640 1 -- 172.21.15.62:0/544551480 <== osd.2 v2:172.21.15.62:6800/2677868286 15 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94825888259840] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd57400a4d0 con 0x7fd56c073020 2024-09-10T05:37:40.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.517+0000 7fd57baaa9c0 20 remove_watcher() i=7 2024-09-10T05:37:40.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.517+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/544551480 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x563e5f61bc10 msgr2=0x563e5f61e000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.517+0000 7fd57baaa9c0 1 --2- 172.21.15.62:0/544551480 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x563e5f61bc10 0x563e5f61e000 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:40.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.517+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/544551480 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x563e5f617760 msgr2=0x563e5f619c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.517+0000 7fd57baaa9c0 1 --2- 172.21.15.62:0/544551480 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x563e5f617760 0x563e5f619c20 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:40.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.517+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/544551480 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fd56c073020 msgr2=0x7fd56c027a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.517+0000 7fd57baaa9c0 1 --2- 172.21.15.62:0/544551480 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fd56c073020 0x7fd56c027a50 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:40.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.517+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/544551480 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x563e5f61f430 msgr2=0x563e5f621820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.517+0000 7fd57baaa9c0 1 --2- 172.21.15.62:0/544551480 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x563e5f61f430 0x563e5f621820 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:40.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.517+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/544551480 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fd444039ac0 msgr2=0x7fd44403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.517+0000 7fd57baaa9c0 1 --2- 172.21.15.62:0/544551480 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fd444039ac0 0x7fd44403bf80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd5700ce040 tx=0x7fd5700c1040 comp rx=0 tx=0).stop 2024-09-10T05:37:40.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.517+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/544551480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e5f6055c0 msgr2=0x563e5f60c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.517+0000 7fd579db1640 1 -- 172.21.15.62:0/544551480 reap_dead start 2024-09-10T05:37:40.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.517+0000 7fd57baaa9c0 1 --2- 172.21.15.62:0/544551480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e5f6055c0 0x563e5f60c8c0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fd56c04dad0 tx=0x7fd56c025000 comp rx=0 tx=0).stop 2024-09-10T05:37:40.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.517+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/544551480 shutdown_connections 2024-09-10T05:37:40.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.517+0000 7fd57baaa9c0 1 --2- 172.21.15.62:0/544551480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e5f6055c0 0x563e5f60c8c0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:40.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.517+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/544551480 >> 172.21.15.62:0/544551480 conn(0x563e5f6019f0 msgr2=0x563e5f5ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:40.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.517+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/544551480 shutdown_connections 2024-09-10T05:37:40.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.517+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/544551480 wait complete. 2024-09-10T05:37:40.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.521+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/2792305808 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fd450039a70 msgr2=0x7fd45003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.521+0000 7fd57baaa9c0 1 --2- 172.21.15.62:0/2792305808 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fd450039a70 0x7fd45003bf30 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x563e5f5dd140 tx=0x7fd570005ad0 comp rx=0 tx=0).stop 2024-09-10T05:37:40.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.521+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/2792305808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e5f5f9010 msgr2=0x563e5f5f9430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.521+0000 7fd57baaa9c0 1 --2- 172.21.15.62:0/2792305808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e5f5f9010 0x563e5f5f9430 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fd56c017550 tx=0x7fd56c00eb10 comp rx=0 tx=0).stop 2024-09-10T05:37:40.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.521+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/2792305808 shutdown_connections 2024-09-10T05:37:40.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.521+0000 7fd57baaa9c0 1 --2- 172.21.15.62:0/2792305808 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fd450039a70 0x7fd45003bf30 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:40.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.521+0000 7fd57baaa9c0 1 --2- 172.21.15.62:0/2792305808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e5f5f9010 0x563e5f5f9430 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:40.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.521+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/2792305808 >> 172.21.15.62:0/2792305808 conn(0x563e5f5ee9c0 msgr2=0x563e5f5eeda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:40.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.521+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/2792305808 shutdown_connections 2024-09-10T05:37:40.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.521+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/2792305808 wait complete. 2024-09-10T05:37:40.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.521+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/3204023861 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x563e5f5e3520 msgr2=0x563e5f5e59e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.521+0000 7fd57baaa9c0 1 --2- 172.21.15.62:0/3204023861 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x563e5f5e3520 0x563e5f5e59e0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:40.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.521+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/3204023861 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x563e5f5e0140 msgr2=0x563e5f5e2530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.521+0000 7fd57baaa9c0 1 --2- 172.21.15.62:0/3204023861 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x563e5f5e0140 0x563e5f5e2530 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:40.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.521+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/3204023861 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x563e5f5e7f10 msgr2=0x563e5f5ea300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.521+0000 7fd57baaa9c0 1 --2- 172.21.15.62:0/3204023861 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x563e5f5e7f10 0x563e5f5ea300 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:40.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.521+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/3204023861 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fd460039a70 msgr2=0x7fd46003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.521+0000 7fd57baaa9c0 1 --2- 172.21.15.62:0/3204023861 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fd460039a70 0x7fd46003bf30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd5700ad000 tx=0x7fd5700a6000 comp rx=0 tx=0).stop 2024-09-10T05:37:40.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.521+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/3204023861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e5f4ec140 msgr2=0x563e5f5db080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.521+0000 7fd57baaa9c0 1 --2- 172.21.15.62:0/3204023861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e5f4ec140 0x563e5f5db080 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x563e5f5d46c0 tx=0x7fd56c000ee0 comp rx=0 tx=0).stop 2024-09-10T05:37:40.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.521+0000 7fd579db1640 1 -- 172.21.15.62:0/3204023861 reap_dead start 2024-09-10T05:37:40.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.521+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/3204023861 shutdown_connections 2024-09-10T05:37:40.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.521+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/3204023861 >> 172.21.15.62:0/3204023861 conn(0x563e5f4e3ac0 msgr2=0x563e5f5cde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:40.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.521+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/3204023861 shutdown_connections 2024-09-10T05:37:40.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.521+0000 7fd57baaa9c0 1 -- 172.21.15.62:0/3204023861 wait complete. 2024-09-10T05:37:40.537 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-10T05:37:40.542 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-10T05:37:40.542 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-10T05:37:40.547 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-10T05:37:40.547 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2024-09-10T05:37:40.548 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-10T05:37:40.548 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-10T05:37:40.548 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2024-09-10T05:37:40.614 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:37:40.614 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:37:40.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.609+0000 7f8fd4e369c0 1 Processor -- start 2024-09-10T05:37:40.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.609+0000 7f8fd4e369c0 1 -- start start 2024-09-10T05:37:40.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.609+0000 7f8fd4e369c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55a89dd231f0 0x55a89dd235d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.609+0000 7f8fd4e369c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a89dbd59c0 con 0x55a89dd26330 2024-09-10T05:37:40.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.609+0000 7f8fd4e369c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x55a89dc256d0 con 0x55a89dd231f0 2024-09-10T05:37:40.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.609+0000 7f8fd293c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55a89dd231f0 0x55a89dd235d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.609+0000 7f8fd213b640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x55a89dd26330 0x55a89dd28720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:50618/0 (socket says 172.21.15.62:50618) 2024-09-10T05:37:40.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.609+0000 7f8fd213b640 1 -- 172.21.15.62:0/3728429789 learned_addr learned my addr 172.21.15.62:0/3728429789 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-10T05:37:40.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.609+0000 7f8fd293c640 1 -- 172.21.15.62:0/3728429789 >> v1:172.21.15.2:6789/0 conn(0x55a89dd26330 legacy=0x55a89dd28720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.609+0000 7f8fd293c640 1 -- 172.21.15.62:0/3728429789 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a89dbc9ca0 con 0x55a89dd231f0 2024-09-10T05:37:40.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.613+0000 7f8fd293c640 1 --2- 172.21.15.62:0/3728429789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a89dd231f0 0x55a89dd235d0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc00a420 tx=0x7f8fcc01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26f99b91fec3597b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.613+0000 7f8fd193a640 1 -- 172.21.15.62:0/3728429789 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fcc0af070 con 0x55a89dd231f0 2024-09-10T05:37:40.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.613+0000 7f8fd193a640 1 -- 172.21.15.62:0/3728429789 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fcc0aa530 con 0x55a89dd231f0 2024-09-10T05:37:40.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.613+0000 7f8fd193a640 1 -- 172.21.15.62:0/3728429789 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fcc0aa850 con 0x55a89dd231f0 2024-09-10T05:37:40.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.613+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/3728429789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a89dd231f0 msgr2=0x55a89dd235d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.613+0000 7f8fd4e369c0 1 --2- 172.21.15.62:0/3728429789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a89dd231f0 0x55a89dd235d0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc00a420 tx=0x7f8fcc01afd0 comp rx=0 tx=0).stop 2024-09-10T05:37:40.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.613+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/3728429789 shutdown_connections 2024-09-10T05:37:40.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.613+0000 7f8fd4e369c0 1 --2- 172.21.15.62:0/3728429789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a89dd231f0 0x55a89dd235d0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:40.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.613+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/3728429789 >> 172.21.15.62:0/3728429789 conn(0x55a89dc96b00 msgr2=0x55a89dc96f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:40.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.613+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/3728429789 shutdown_connections 2024-09-10T05:37:40.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.613+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/3728429789 wait complete. 2024-09-10T05:37:40.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.629+0000 7f8fd4e369c0 1 Processor -- start 2024-09-10T05:37:40.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.629+0000 7f8fd4e369c0 1 -- start start 2024-09-10T05:37:40.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.629+0000 7f8fd4e369c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a89dd231f0 0x55a89de0e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.629+0000 7f8fd4e369c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a89dc29680 con 0x55a89dd231f0 2024-09-10T05:37:40.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.629+0000 7f8fd293c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a89dd231f0 0x55a89de0e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.629+0000 7f8fd293c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a89dd231f0 0x55a89de0e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:58516/0 (socket says 172.21.15.62:58516) 2024-09-10T05:37:40.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.629+0000 7f8fd293c640 1 -- 172.21.15.62:0/2000683577 learned_addr learned my addr 172.21.15.62:0/2000683577 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:40.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.629+0000 7f8fd293c640 1 -- 172.21.15.62:0/2000683577 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a89dba4da0 con 0x55a89dd231f0 2024-09-10T05:37:40.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.629+0000 7f8fd293c640 1 --2- 172.21.15.62:0/2000683577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a89dd231f0 0x55a89de0e8c0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc0ad040 tx=0x7f8fcc0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8377692d1b58c067 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.633+0000 7f8ec0e09640 1 -- 172.21.15.62:0/2000683577 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fcc0af040 con 0x55a89dd231f0 2024-09-10T05:37:40.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.633+0000 7f8ec0e09640 1 -- 172.21.15.62:0/2000683577 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fcc0aaa60 con 0x55a89dd231f0 2024-09-10T05:37:40.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.633+0000 7f8ec0e09640 1 -- 172.21.15.62:0/2000683577 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fcc0aad40 con 0x55a89dd231f0 2024-09-10T05:37:40.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.633+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/2000683577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a89dd231f0 msgr2=0x55a89de0e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.633+0000 7f8fd4e369c0 1 --2- 172.21.15.62:0/2000683577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a89dd231f0 0x55a89de0e8c0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc0ad040 tx=0x7f8fcc0033b0 comp rx=0 tx=0).stop 2024-09-10T05:37:40.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.633+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/2000683577 shutdown_connections 2024-09-10T05:37:40.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.633+0000 7f8fd4e369c0 1 --2- 172.21.15.62:0/2000683577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a89dd231f0 0x55a89de0e8c0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:40.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.633+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/2000683577 >> 172.21.15.62:0/2000683577 conn(0x55a89dc96b00 msgr2=0x55a89de0a540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:40.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.633+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/2000683577 shutdown_connections 2024-09-10T05:37:40.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.633+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/2000683577 wait complete. 2024-09-10T05:37:40.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.633+0000 7f8fd4e369c0 1 Processor -- start 2024-09-10T05:37:40.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.633+0000 7f8fd4e369c0 1 -- start start 2024-09-10T05:37:40.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.633+0000 7f8fd4e369c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a89dd26330 0x55a89de160d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.633+0000 7f8fd4e369c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a89dbcba50 con 0x55a89dd26330 2024-09-10T05:37:40.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.633+0000 7f8fd293c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a89dd26330 0x55a89de160d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.633+0000 7f8fd293c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a89dd26330 0x55a89de160d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:58522/0 (socket says 172.21.15.62:58522) 2024-09-10T05:37:40.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.633+0000 7f8fd293c640 1 -- 172.21.15.62:0/544050700 learned_addr learned my addr 172.21.15.62:0/544050700 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:40.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.633+0000 7f8fd293c640 1 -- 172.21.15.62:0/544050700 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a89de16630 con 0x55a89dd26330 2024-09-10T05:37:40.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.633+0000 7f8fd293c640 1 --2- 172.21.15.62:0/544050700 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a89dd26330 0x55a89de160d0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc01b010 tx=0x7f8fcc017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.633+0000 7f8ebf606640 1 -- 172.21.15.62:0/544050700 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fcc0c5070 con 0x55a89dd26330 2024-09-10T05:37:40.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.633+0000 7f8ebf606640 1 -- 172.21.15.62:0/544050700 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fcc0c1690 con 0x55a89dd26330 2024-09-10T05:37:40.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.633+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/544050700 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a89de168c0 con 0x55a89dd26330 2024-09-10T05:37:40.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.633+0000 7f8ebf606640 1 -- 172.21.15.62:0/544050700 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fcc0c1970 con 0x55a89dd26330 2024-09-10T05:37:40.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.633+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/544050700 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a89de17200 con 0x55a89dd26330 2024-09-10T05:37:40.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.637+0000 7f8ebf606640 1 -- 172.21.15.62:0/544050700 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8fcc0c1b10 con 0x55a89dd26330 2024-09-10T05:37:40.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.637+0000 7f8ebf606640 1 --2- 172.21.15.62:0/544050700 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8eb8039a70 0x7f8eb803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.637+0000 7f8ebf606640 1 -- 172.21.15.62:0/544050700 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7f8fcc0bb070 con 0x55a89dd26330 2024-09-10T05:37:40.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.637+0000 7f8fd213b640 1 --2- 172.21.15.62:0/544050700 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8eb8039a70 0x7f8eb803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.637+0000 7f8fd4e369c0 1 --2- 172.21.15.62:0/544050700 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55a89de1b140 0x55a89de1d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.637+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/544050700 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89de1da70 con 0x55a89de1b140 2024-09-10T05:37:40.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.637+0000 7f8fd313d640 1 --2- 172.21.15.62:0/544050700 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55a89de1b140 0x55a89de1d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.637+0000 7f8fd213b640 1 --2- 172.21.15.62:0/544050700 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8eb8039a70 0x7f8eb803bf30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc004180 tx=0x7f8fbc001340 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.637+0000 7f8fd313d640 1 --2- 172.21.15.62:0/544050700 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55a89de1b140 0x55a89de1d530 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.637+0000 7f8fd313d640 1 -- 172.21.15.62:0/544050700 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8fc40083f0 con 0x55a89de1b140 2024-09-10T05:37:40.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.637+0000 7f8fd4e369c0 1 --2- 172.21.15.62:0/544050700 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55a89de1e520 0x55a89de209e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.637+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/544050700 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89de21150 con 0x55a89de1e520 2024-09-10T05:37:40.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.637+0000 7f8fd293c640 1 --2- 172.21.15.62:0/544050700 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55a89de1e520 0x55a89de209e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.637+0000 7f8fd293c640 1 --2- 172.21.15.62:0/544050700 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55a89de1e520 0x55a89de209e0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.637+0000 7f8fd293c640 1 -- 172.21.15.62:0/544050700 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8fcc0d0070 con 0x55a89de1e520 2024-09-10T05:37:40.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.637+0000 7f8fd4e369c0 1 --2- 172.21.15.62:0/544050700 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55a89de22f10 0x55a89de25300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.637+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/544050700 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89de259f0 con 0x55a89de22f10 2024-09-10T05:37:40.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.637+0000 7f8fd213b640 1 --2- 172.21.15.62:0/544050700 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55a89de22f10 0x55a89de25300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.641+0000 7f8fd213b640 1 --2- 172.21.15.62:0/544050700 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55a89de22f10 0x55a89de25300 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.641+0000 7f8fd213b640 1 -- 172.21.15.62:0/544050700 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8fbc00e6c0 con 0x55a89de22f10 2024-09-10T05:37:40.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.641+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/544050700 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89de21db0 con 0x55a89de1e520 2024-09-10T05:37:40.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.641+0000 7f8fd293c640 1 -- 172.21.15.62:0/544050700 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8fcc0d0070 con 0x55a89de1e520 2024-09-10T05:37:40.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.641+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/544050700 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89de22210 con 0x55a89de22f10 2024-09-10T05:37:40.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.641+0000 7f8fd213b640 1 -- 172.21.15.62:0/544050700 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8fbc00e6c0 con 0x55a89de22f10 2024-09-10T05:37:40.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.641+0000 7f8fd4e369c0 1 Processor -- start 2024-09-10T05:37:40.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.641+0000 7f8fd4e369c0 1 -- start start 2024-09-10T05:37:40.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.641+0000 7f8fd4e369c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a89de34120 0x55a89de34540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.641+0000 7f8fd4e369c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a89dc36450 con 0x55a89de34120 2024-09-10T05:37:40.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.641+0000 7f8fd293c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a89de34120 0x55a89de34540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.641+0000 7f8fd293c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a89de34120 0x55a89de34540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:58532/0 (socket says 172.21.15.62:58532) 2024-09-10T05:37:40.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.641+0000 7f8fd293c640 1 -- 172.21.15.62:0/546649330 learned_addr learned my addr 172.21.15.62:0/546649330 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:40.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.641+0000 7f8fd293c640 1 -- 172.21.15.62:0/546649330 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a89de34b80 con 0x55a89de34120 2024-09-10T05:37:40.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.641+0000 7f8fd293c640 1 --2- 172.21.15.62:0/546649330 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a89de34120 0x55a89de34540 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc0033f0 tx=0x7f8fcc0a94a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.645+0000 7f8ebce01640 1 -- 172.21.15.62:0/546649330 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fcc0e2580 con 0x55a89de34120 2024-09-10T05:37:40.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.645+0000 7f8ebce01640 1 -- 172.21.15.62:0/546649330 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fcc0e2720 con 0x55a89de34120 2024-09-10T05:37:40.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.645+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/546649330 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a89de353e0 con 0x55a89de34120 2024-09-10T05:37:40.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.645+0000 7f8ebce01640 1 -- 172.21.15.62:0/546649330 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fcc0b7020 con 0x55a89de34120 2024-09-10T05:37:40.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.645+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/546649330 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a89de353e0 con 0x55a89de34120 2024-09-10T05:37:40.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.645+0000 7f8ebce01640 1 -- 172.21.15.62:0/546649330 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8fcc0b71c0 con 0x55a89de34120 2024-09-10T05:37:40.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.645+0000 7f8ebce01640 1 --2- 172.21.15.62:0/546649330 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8eac039a70 0x7f8eac03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.645+0000 7f8ebce01640 1 -- 172.21.15.62:0/546649330 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7f8fcc0da070 con 0x55a89de34120 2024-09-10T05:37:40.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.645+0000 7f8fd213b640 1 --2- 172.21.15.62:0/546649330 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8eac039a70 0x7f8eac03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.645+0000 7f8fd4e369c0 1 Processor -- start 2024-09-10T05:37:40.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.645+0000 7f8fd4e369c0 1 -- start start 2024-09-10T05:37:40.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.645+0000 7f8fd213b640 1 --2- 172.21.15.62:0/546649330 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8eac039a70 0x7f8eac03bf30 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc00c010 tx=0x7f8fbc00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.645+0000 7f8fd4e369c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a89de406d0 0x55a89de40ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.645+0000 7f8fd4e369c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a89de0f050 con 0x55a89de406d0 2024-09-10T05:37:40.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.645+0000 7f8fd293c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a89de406d0 0x55a89de40ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.645+0000 7f8fd293c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a89de406d0 0x55a89de40ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:58546/0 (socket says 172.21.15.62:58546) 2024-09-10T05:37:40.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.645+0000 7f8fd293c640 1 -- 172.21.15.62:0/1532180311 learned_addr learned my addr 172.21.15.62:0/1532180311 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:40.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.645+0000 7f8fd293c640 1 -- 172.21.15.62:0/1532180311 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a89de410a0 con 0x55a89de406d0 2024-09-10T05:37:40.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.645+0000 7f8fd293c640 1 --2- 172.21.15.62:0/1532180311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a89de406d0 0x55a89de40ab0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc0e5fd0 tx=0x7f8fcc0d3cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d68e430ad1768fc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.645+0000 7f8eb67fc640 1 -- 172.21.15.62:0/1532180311 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fcc0d3440 con 0x55a89de406d0 2024-09-10T05:37:40.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.645+0000 7f8eb67fc640 1 -- 172.21.15.62:0/1532180311 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fcc0ac090 con 0x55a89de406d0 2024-09-10T05:37:40.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.645+0000 7f8eb67fc640 1 -- 172.21.15.62:0/1532180311 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fcc0d35e0 con 0x55a89de406d0 2024-09-10T05:37:40.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.649+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/1532180311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a89de406d0 msgr2=0x55a89de40ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.649+0000 7f8fd4e369c0 1 --2- 172.21.15.62:0/1532180311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a89de406d0 0x55a89de40ab0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc0e5fd0 tx=0x7f8fcc0d3cd0 comp rx=0 tx=0).stop 2024-09-10T05:37:40.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.649+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/1532180311 shutdown_connections 2024-09-10T05:37:40.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.649+0000 7f8fd4e369c0 1 --2- 172.21.15.62:0/1532180311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a89de406d0 0x55a89de40ab0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:40.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.649+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/1532180311 >> 172.21.15.62:0/1532180311 conn(0x55a89de3cb00 msgr2=0x55a89de3ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:40.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.649+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/1532180311 shutdown_connections 2024-09-10T05:37:40.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.649+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/1532180311 wait complete. 2024-09-10T05:37:40.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.649+0000 7f8fd4e369c0 1 Processor -- start 2024-09-10T05:37:40.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.649+0000 7f8fd4e369c0 1 -- start start 2024-09-10T05:37:40.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.649+0000 7f8fd4e369c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a89de406d0 0x55a89de47a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.649+0000 7f8fd4e369c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a89de41560 con 0x55a89de406d0 2024-09-10T05:37:40.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.649+0000 7f8fd293c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a89de406d0 0x55a89de47a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.649+0000 7f8fd293c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a89de406d0 0x55a89de47a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:58560/0 (socket says 172.21.15.62:58560) 2024-09-10T05:37:40.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.649+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 learned_addr learned my addr 172.21.15.62:0/520512830 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:40.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.649+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a89de47f90 con 0x55a89de406d0 2024-09-10T05:37:40.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.649+0000 7f8fd293c640 1 --2- 172.21.15.62:0/520512830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a89de406d0 0x55a89de47a30 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc0b69e0 tx=0x7f8fcc0d4ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.649+0000 7f8eb4ff9640 1 -- 172.21.15.62:0/520512830 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fcc001b10 con 0x55a89de406d0 2024-09-10T05:37:40.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.649+0000 7f8eb4ff9640 1 -- 172.21.15.62:0/520512830 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fcc106070 con 0x55a89de406d0 2024-09-10T05:37:40.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.649+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a89de47f90 con 0x55a89de406d0 2024-09-10T05:37:40.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.649+0000 7f8eb4ff9640 1 -- 172.21.15.62:0/520512830 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fcc001cb0 con 0x55a89de406d0 2024-09-10T05:37:40.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.649+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a89de47f90 con 0x55a89de406d0 2024-09-10T05:37:40.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.653+0000 7f8eb4ff9640 1 -- 172.21.15.62:0/520512830 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8fcc110060 con 0x55a89de406d0 2024-09-10T05:37:40.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.653+0000 7f8eb4ff9640 1 --2- 172.21.15.62:0/520512830 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8e9c039a20 0x7f8e9c03bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.653+0000 7f8eb4ff9640 1 -- 172.21.15.62:0/520512830 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7f8fcc0fc070 con 0x55a89de406d0 2024-09-10T05:37:40.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.653+0000 7f8fd4e369c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:40.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.653+0000 7f8fd4e369c0 1 --2- 172.21.15.62:0/520512830 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55a89de529f0 0x55a89de54eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.653+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89de55600 con 0x55a89de529f0 2024-09-10T05:37:40.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.653+0000 7f8fd313d640 1 --2- 172.21.15.62:0/520512830 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55a89de529f0 0x55a89de54eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.653+0000 7f8fd313d640 1 --2- 172.21.15.62:0/520512830 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55a89de529f0 0x55a89de54eb0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.653+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8fc40083f0 con 0x55a89de529f0 2024-09-10T05:37:40.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.653+0000 7f8fd4e369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:40.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.653+0000 7f8fd4e369c0 20 realm 2024-09-10T05:37:40.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.653+0000 7f8fd4e369c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:40.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.653+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89de51d20 con 0x55a89de529f0 2024-09-10T05:37:40.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.653+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8fc40083f0 con 0x55a89de529f0 2024-09-10T05:37:40.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.653+0000 7f8fd4e369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:40.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.653+0000 7f8fd4e369c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:37:40.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.653+0000 7f8fd4e369c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:40.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.653+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89de560c0 con 0x55a89de529f0 2024-09-10T05:37:40.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.653+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8fc40083f0 con 0x55a89de529f0 2024-09-10T05:37:40.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.653+0000 7f8fd4e369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:40.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.653+0000 7f8fd4e369c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:40.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.653+0000 7f8fd4e369c0 1 --2- 172.21.15.62:0/520512830 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55a89de56ea0 0x55a89de59290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.653+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89de59960 con 0x55a89de56ea0 2024-09-10T05:37:40.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.653+0000 7f8fd293c640 1 --2- 172.21.15.62:0/520512830 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55a89de56ea0 0x55a89de59290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.653+0000 7f8fd293c640 1 --2- 172.21.15.62:0/520512830 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55a89de56ea0 0x55a89de59290 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.657+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8fcc11b040 con 0x55a89de56ea0 2024-09-10T05:37:40.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.657+0000 7f8fd4e369c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:37:40.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.657+0000 7f8fd4e369c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:40.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.657+0000 7f8fd4e369c0 1 --2- 172.21.15.62:0/520512830 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55a89de5a3b0 0x55a89de5c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.657+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89de5ce70 con 0x55a89de5a3b0 2024-09-10T05:37:40.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.657+0000 7f8fd213b640 1 --2- 172.21.15.62:0/520512830 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55a89de5a3b0 0x55a89de5c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.657+0000 7f8fd213b640 1 --2- 172.21.15.62:0/520512830 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55a89de5a3b0 0x55a89de5c7a0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.657+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8fbc026070 con 0x55a89de5a3b0 2024-09-10T05:37:40.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.657+0000 7f8fd4e369c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:37:40.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.657+0000 7f8fd4e369c0 20 searching for the correct realm 2024-09-10T05:37:40.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.657+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a89de5e740 con 0x55a89de5a3b0 2024-09-10T05:37:40.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.657+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fbc026070 con 0x55a89de5a3b0 2024-09-10T05:37:40.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.657+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a89de5e740 con 0x55a89de56ea0 2024-09-10T05:37:40.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.657+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fcc11b040 con 0x55a89de56ea0 2024-09-10T05:37:40.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.657+0000 7f8fd293c640 1 --2- 172.21.15.62:0/520512830 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f8fcc11e040 0x7f8fcc0a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.657+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8fcc101050 con 0x7f8fcc11e040 2024-09-10T05:37:40.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.657+0000 7f8fd313d640 1 --2- 172.21.15.62:0/520512830 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f8fcc11e040 0x7f8fcc0a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.657+0000 7f8fd313d640 1 --2- 172.21.15.62:0/520512830 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f8fcc11e040 0x7f8fcc0a5800 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.657+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fc40083f0 con 0x7f8fcc11e040 2024-09-10T05:37:40.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.657+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8fcc101050 con 0x55a89de529f0 2024-09-10T05:37:40.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.657+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fc40083f0 con 0x55a89de529f0 2024-09-10T05:37:40.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.657+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8fcc101050 con 0x55a89de529f0 2024-09-10T05:37:40.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.657+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fc40083f0 con 0x55a89de529f0 2024-09-10T05:37:40.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.657+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8fcc101050 con 0x55a89de5a3b0 2024-09-10T05:37:40.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.657+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fbc026070 con 0x55a89de5a3b0 2024-09-10T05:37:40.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.657+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8fcc101050 con 0x55a89de529f0 2024-09-10T05:37:40.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.661+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fc40083f0 con 0x55a89de529f0 2024-09-10T05:37:40.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.661+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8fcc101050 con 0x55a89de56ea0 2024-09-10T05:37:40.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.661+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fcc11b040 con 0x55a89de56ea0 2024-09-10T05:37:40.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.661+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8fcc101050 con 0x55a89de56ea0 2024-09-10T05:37:40.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.661+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fcc11b040 con 0x55a89de56ea0 2024-09-10T05:37:40.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.661+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8fcc101050 con 0x55a89de529f0 2024-09-10T05:37:40.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.661+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fc40083f0 con 0x55a89de529f0 2024-09-10T05:37:40.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.661+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8fcc101050 con 0x7f8fcc11e040 2024-09-10T05:37:40.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.661+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fc40083f0 con 0x7f8fcc11e040 2024-09-10T05:37:40.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.661+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8fcc101050 con 0x55a89de529f0 2024-09-10T05:37:40.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.661+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fc40083f0 con 0x55a89de529f0 2024-09-10T05:37:40.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.661+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8fcc101050 con 0x7f8fcc11e040 2024-09-10T05:37:40.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.661+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8fc40083f0 con 0x7f8fcc11e040 2024-09-10T05:37:40.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.661+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8fcc101050 con 0x55a89de56ea0 2024-09-10T05:37:40.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.661+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fcc11b040 con 0x55a89de56ea0 2024-09-10T05:37:40.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.661+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8fcc101050 con 0x55a89de5a3b0 2024-09-10T05:37:40.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.665+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fbc026070 con 0x55a89de5a3b0 2024-09-10T05:37:40.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.665+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8fcc101050 con 0x55a89de529f0 2024-09-10T05:37:40.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.665+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fc40083f0 con 0x55a89de529f0 2024-09-10T05:37:40.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.665+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8fcc101050 con 0x55a89de56ea0 2024-09-10T05:37:40.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.665+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fcc11b040 con 0x55a89de56ea0 2024-09-10T05:37:40.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.665+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8fcc101050 con 0x55a89de5a3b0 2024-09-10T05:37:40.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.665+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 32 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f8fbc026070 con 0x55a89de5a3b0 2024-09-10T05:37:40.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.665+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8fcc101050 con 0x55a89de529f0 2024-09-10T05:37:40.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.665+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fc40083f0 con 0x55a89de529f0 2024-09-10T05:37:40.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.665+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8fcc101050 con 0x55a89de529f0 2024-09-10T05:37:40.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.665+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8fc40083f0 con 0x55a89de529f0 2024-09-10T05:37:40.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.665+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8fcc101050 con 0x55a89de529f0 2024-09-10T05:37:40.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.665+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fc40083f0 con 0x55a89de529f0 2024-09-10T05:37:40.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.665+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8fcc101050 con 0x55a89de5a3b0 2024-09-10T05:37:40.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.665+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fbc026070 con 0x55a89de5a3b0 2024-09-10T05:37:40.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.665+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8fcc101050 con 0x7f8fcc11e040 2024-09-10T05:37:40.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.665+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fc40083f0 con 0x7f8fcc11e040 2024-09-10T05:37:40.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.665+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8fcc101050 con 0x55a89de529f0 2024-09-10T05:37:40.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.665+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fc40083f0 con 0x55a89de529f0 2024-09-10T05:37:40.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.665+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8fcc101050 con 0x7f8fcc11e040 2024-09-10T05:37:40.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.665+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fc40083f0 con 0x7f8fcc11e040 2024-09-10T05:37:40.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.665+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8fcc101050 con 0x55a89de5a3b0 2024-09-10T05:37:40.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.669+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fbc026070 con 0x55a89de5a3b0 2024-09-10T05:37:40.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.669+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8fcc101050 con 0x7f8fcc11e040 2024-09-10T05:37:40.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.669+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fc40083f0 con 0x7f8fcc11e040 2024-09-10T05:37:40.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.669+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8fcc101050 con 0x55a89de56ea0 2024-09-10T05:37:40.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.669+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fcc11b040 con 0x55a89de56ea0 2024-09-10T05:37:40.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.669+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8fcc101050 con 0x55a89de56ea0 2024-09-10T05:37:40.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.669+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fcc11b040 con 0x55a89de56ea0 2024-09-10T05:37:40.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.669+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8fcc101050 con 0x55a89de5a3b0 2024-09-10T05:37:40.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.669+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fbc026070 con 0x55a89de5a3b0 2024-09-10T05:37:40.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.669+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8fcc101050 con 0x55a89de56ea0 2024-09-10T05:37:40.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.669+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8fcc11b040 con 0x55a89de56ea0 2024-09-10T05:37:40.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.669+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8fcc101050 con 0x55a89de56ea0 2024-09-10T05:37:40.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.669+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fcc11b040 con 0x55a89de56ea0 2024-09-10T05:37:40.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.669+0000 7f8fd4e369c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:37:40.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.669+0000 7f8fd4e369c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:37:40.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.669+0000 7f8fd4e369c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:37:40.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.669+0000 7f8fd4e369c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:37:40.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.669+0000 7f8fd4e369c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:37:40.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.669+0000 7f8fd4e369c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:37:40.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.669+0000 7f8fd4e369c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:40.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.669+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89de5d830 con 0x55a89de529f0 2024-09-10T05:37:40.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.669+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8fc40083f0 con 0x55a89de529f0 2024-09-10T05:37:40.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.673+0000 7f8fd4e369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:40.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.673+0000 7f8fd4e369c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:40.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.673+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89de5d470 con 0x55a89de56ea0 2024-09-10T05:37:40.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.673+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8fcc11b040 con 0x55a89de56ea0 2024-09-10T05:37:40.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.673+0000 7f8fd4e369c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:37:40.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.673+0000 7f8fd4e369c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:40.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.673+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89de5e150 con 0x55a89de5a3b0 2024-09-10T05:37:40.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.673+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8fbc026070 con 0x55a89de5a3b0 2024-09-10T05:37:40.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.673+0000 7f8fd4e369c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:37:40.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.673+0000 7f8fd4e369c0 20 zone default found 2024-09-10T05:37:40.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.673+0000 7f8fd4e369c0 4 Realm: () 2024-09-10T05:37:40.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.673+0000 7f8fd4e369c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:37:40.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.673+0000 7f8fd4e369c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:37:40.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.673+0000 7f8fd4e369c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:37:40.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.673+0000 7f8fd4e369c0 20 zonegroup default 2024-09-10T05:37:40.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.673+0000 7f8fd4e369c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:40.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.673+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89de5dd60 con 0x7f8fcc11e040 2024-09-10T05:37:40.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.673+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8fc40083f0 con 0x7f8fcc11e040 2024-09-10T05:37:40.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.673+0000 7f8fd4e369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:40.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.673+0000 7f8fd4e369c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:40.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.673+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89de60ab0 con 0x55a89de5a3b0 2024-09-10T05:37:40.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.673+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8fbc026070 con 0x55a89de5a3b0 2024-09-10T05:37:40.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.673+0000 7f8fd4e369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:40.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.673+0000 7f8fd4e369c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:40.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.673+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89de60e50 con 0x55a89de5a3b0 2024-09-10T05:37:40.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.673+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8fbc026070 con 0x55a89de5a3b0 2024-09-10T05:37:40.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.673+0000 7f8fd4e369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:40.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.673+0000 7f8fd4e369c0 20 started sync module instance, tier type = 2024-09-10T05:37:40.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.673+0000 7f8fd4e369c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:37:40.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.673+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de5ff40 con 0x55a89de56ea0 2024-09-10T05:37:40.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.677+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fcc11b040 con 0x55a89de56ea0 2024-09-10T05:37:40.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.677+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94182691963968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de5ff40 con 0x55a89de56ea0 2024-09-10T05:37:40.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.677+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de61850 con 0x55a89de529f0 2024-09-10T05:37:40.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.677+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fc40083f0 con 0x55a89de529f0 2024-09-10T05:37:40.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.677+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94182691967840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de620f0 con 0x55a89de529f0 2024-09-10T05:37:40.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.677+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de62b30 con 0x55a89de56ea0 2024-09-10T05:37:40.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.677+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94182691963968] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fcc11b040 con 0x55a89de56ea0 2024-09-10T05:37:40.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.677+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94182691967840] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fc40083f0 con 0x55a89de529f0 2024-09-10T05:37:40.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.681+0000 7f8fd213b640 1 --2- 172.21.15.62:0/520512830 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8e9c039a20 0x7f8e9c03bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.681+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fcc11b040 con 0x55a89de56ea0 2024-09-10T05:37:40.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.681+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94182691972608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de61c40 con 0x55a89de56ea0 2024-09-10T05:37:40.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.681+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de633d0 con 0x7f8fcc11e040 2024-09-10T05:37:40.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.681+0000 7f8fd213b640 1 --2- 172.21.15.62:0/520512830 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8e9c039a20 0x7f8e9c03bee0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x55a89de25dc0 tx=0x7f8fbc025000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.681+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fc40083f0 con 0x7f8fcc11e040 2024-09-10T05:37:40.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.681+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94182691974944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de61c40 con 0x7f8fcc11e040 2024-09-10T05:37:40.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.681+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de63e10 con 0x55a89de56ea0 2024-09-10T05:37:40.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.681+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94182691974944] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fc40083f0 con 0x7f8fcc11e040 2024-09-10T05:37:40.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.681+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94182691972608] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fcc11b040 con 0x55a89de56ea0 2024-09-10T05:37:40.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.685+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fcc11b040 con 0x55a89de56ea0 2024-09-10T05:37:40.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.685+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94182691961488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de63960 con 0x55a89de56ea0 2024-09-10T05:37:40.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.685+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de641b0 con 0x55a89de5a3b0 2024-09-10T05:37:40.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.685+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fbc026070 con 0x55a89de5a3b0 2024-09-10T05:37:40.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.685+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94182691977840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de64540 con 0x55a89de5a3b0 2024-09-10T05:37:40.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.685+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de65060 con 0x55a89de5a3b0 2024-09-10T05:37:40.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.685+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94182691961488] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fcc11b040 con 0x55a89de56ea0 2024-09-10T05:37:40.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.685+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(56 notify.6 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fbc026070 con 0x55a89de5a3b0 2024-09-10T05:37:40.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.685+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94182691982128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de65020 con 0x55a89de5a3b0 2024-09-10T05:37:40.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.685+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de65ae0 con 0x7f8fcc11e040 2024-09-10T05:37:40.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.685+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94182691977840] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fbc026070 con 0x55a89de5a3b0 2024-09-10T05:37:40.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.689+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94182691982128] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fbc026070 con 0x55a89de5a3b0 2024-09-10T05:37:40.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.689+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fc40083f0 con 0x7f8fcc11e040 2024-09-10T05:37:40.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.689+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94182691976000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de65020 con 0x7f8fcc11e040 2024-09-10T05:37:40.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.689+0000 7f8fd4e369c0 20 add_watcher() i=0 2024-09-10T05:37:40.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.689+0000 7f8fd4e369c0 20 add_watcher() i=1 2024-09-10T05:37:40.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.689+0000 7f8fd4e369c0 20 add_watcher() i=2 2024-09-10T05:37:40.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.689+0000 7f8fd4e369c0 20 add_watcher() i=3 2024-09-10T05:37:40.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.689+0000 7f8fd4e369c0 20 add_watcher() i=4 2024-09-10T05:37:40.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.689+0000 7f8fd4e369c0 20 add_watcher() i=5 2024-09-10T05:37:40.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.689+0000 7f8fd4e369c0 20 add_watcher() i=6 2024-09-10T05:37:40.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.689+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94182691976000] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fc40083f0 con 0x7f8fcc11e040 2024-09-10T05:37:40.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.689+0000 7f8fd4e369c0 20 add_watcher() i=7 2024-09-10T05:37:40.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.689+0000 7f8fd4e369c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:37:40.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.689+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89de63fc0 con 0x55a89de529f0 2024-09-10T05:37:40.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.689+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8fc40083f0 con 0x55a89de529f0 2024-09-10T05:37:40.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.689+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94182691984880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de66360 con 0x55a89de529f0 2024-09-10T05:37:40.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.693+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94182691984880] v32'224 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8fc40083f0 con 0x55a89de529f0 2024-09-10T05:37:40.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.693+0000 7f8e897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:37:40.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.693+0000 7f8fd4e369c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:37:40.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.693+0000 7f8fd4e369c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:37:40.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.693+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de713f0 con 0x55a89de56ea0 2024-09-10T05:37:40.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.693+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'56 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8fcc11b040 con 0x55a89de56ea0 2024-09-10T05:37:40.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.693+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de713f0 con 0x7f8fcc11e040 2024-09-10T05:37:40.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.697+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8fc40083f0 con 0x7f8fcc11e040 2024-09-10T05:37:40.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.697+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de713f0 con 0x55a89de5a3b0 2024-09-10T05:37:40.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.697+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8fbc026070 con 0x55a89de5a3b0 2024-09-10T05:37:40.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.697+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de71e10 con 0x55a89de529f0 2024-09-10T05:37:40.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.701+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'225 uv172 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8fc40083f0 con 0x55a89de529f0 2024-09-10T05:37:40.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.701+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de72380 con 0x55a89de56ea0 2024-09-10T05:37:40.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.701+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'74 uv61 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8fcc11b040 con 0x55a89de56ea0 2024-09-10T05:37:40.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.701+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de72380 con 0x55a89de5a3b0 2024-09-10T05:37:40.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.705+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'57 uv48 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8fbc026070 con 0x55a89de5a3b0 2024-09-10T05:37:40.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.705+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de72930 con 0x55a89de56ea0 2024-09-10T05:37:40.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.705+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'37 uv31 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8fcc11b040 con 0x55a89de56ea0 2024-09-10T05:37:40.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.705+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de72910 con 0x55a89de529f0 2024-09-10T05:37:40.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.709+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'51 uv42 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8fc40083f0 con 0x55a89de529f0 2024-09-10T05:37:40.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.709+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de72ea0 con 0x55a89de56ea0 2024-09-10T05:37:40.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.709+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8fcc11b040 con 0x55a89de56ea0 2024-09-10T05:37:40.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.709+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de72e80 con 0x55a89de56ea0 2024-09-10T05:37:40.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.713+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8fcc11b040 con 0x55a89de56ea0 2024-09-10T05:37:40.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.713+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de72f70 con 0x55a89de56ea0 2024-09-10T05:37:40.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.713+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'75 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8fcc11b040 con 0x55a89de56ea0 2024-09-10T05:37:40.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.713+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de72f70 con 0x55a89de5a3b0 2024-09-10T05:37:40.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.717+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'31 uv25 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8fbc026070 con 0x55a89de5a3b0 2024-09-10T05:37:40.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.717+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de73500 con 0x55a89de56ea0 2024-09-10T05:37:40.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.717+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8fcc11b040 con 0x55a89de56ea0 2024-09-10T05:37:40.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.717+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de734e0 con 0x55a89de529f0 2024-09-10T05:37:40.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.721+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'63 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8fc40083f0 con 0x55a89de529f0 2024-09-10T05:37:40.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.721+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de734a0 con 0x55a89de529f0 2024-09-10T05:37:40.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.721+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'226 uv168 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8fc40083f0 con 0x55a89de529f0 2024-09-10T05:37:40.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.721+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de73510 con 0x55a89de56ea0 2024-09-10T05:37:40.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.725+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 <== osd.0 v2:172.21.15.2:6800/945139080 25 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'69 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8fcc11b040 con 0x55a89de56ea0 2024-09-10T05:37:40.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.725+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de73510 con 0x55a89de56ea0 2024-09-10T05:37:40.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.725+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 <== osd.0 v2:172.21.15.2:6800/945139080 26 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'76 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8fcc11b040 con 0x55a89de56ea0 2024-09-10T05:37:40.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.725+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de73510 con 0x55a89de5a3b0 2024-09-10T05:37:40.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.729+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 <== osd.3 v2:172.21.15.62:6816/2708991149 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'38 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8fbc026070 con 0x55a89de5a3b0 2024-09-10T05:37:40.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.729+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de735c0 con 0x55a89de56ea0 2024-09-10T05:37:40.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.733+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 <== osd.0 v2:172.21.15.2:6800/945139080 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8fcc11b040 con 0x55a89de56ea0 2024-09-10T05:37:40.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.733+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de735c0 con 0x55a89de529f0 2024-09-10T05:37:40.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.733+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.1 v2:172.21.15.62:6808/3442097179 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'227 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8fc40083f0 con 0x55a89de529f0 2024-09-10T05:37:40.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.733+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de735c0 con 0x55a89de56ea0 2024-09-10T05:37:40.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.737+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 <== osd.0 v2:172.21.15.2:6800/945139080 28 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'70 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8fcc11b040 con 0x55a89de56ea0 2024-09-10T05:37:40.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.737+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de735c0 con 0x7f8fcc11e040 2024-09-10T05:37:40.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.737+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'43 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8fc40083f0 con 0x7f8fcc11e040 2024-09-10T05:37:40.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.737+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de735c0 con 0x55a89de5a3b0 2024-09-10T05:37:40.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.741+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 <== osd.3 v2:172.21.15.62:6816/2708991149 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8fbc026070 con 0x55a89de5a3b0 2024-09-10T05:37:40.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.741+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de736d0 con 0x55a89de56ea0 2024-09-10T05:37:40.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.741+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 <== osd.0 v2:172.21.15.2:6800/945139080 29 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'45 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8fcc11b040 con 0x55a89de56ea0 2024-09-10T05:37:40.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.741+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de73690 con 0x55a89de5a3b0 2024-09-10T05:37:40.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.745+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 <== osd.3 v2:172.21.15.62:6816/2708991149 21 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8fbc026070 con 0x55a89de5a3b0 2024-09-10T05:37:40.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.745+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de73690 con 0x55a89de5a3b0 2024-09-10T05:37:40.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.745+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 <== osd.3 v2:172.21.15.62:6816/2708991149 22 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'58 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8fbc026070 con 0x55a89de5a3b0 2024-09-10T05:37:40.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.745+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de736f0 con 0x55a89de5a3b0 2024-09-10T05:37:40.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.749+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 <== osd.3 v2:172.21.15.62:6816/2708991149 23 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8fbc026070 con 0x55a89de5a3b0 2024-09-10T05:37:40.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.749+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de73720 con 0x55a89de56ea0 2024-09-10T05:37:40.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.753+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 <== osd.0 v2:172.21.15.2:6800/945139080 30 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'40 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8fcc11b040 con 0x55a89de56ea0 2024-09-10T05:37:40.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.753+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de73720 con 0x55a89de529f0 2024-09-10T05:37:40.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.753+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.1 v2:172.21.15.62:6808/3442097179 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'52 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8fc40083f0 con 0x55a89de529f0 2024-09-10T05:37:40.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.753+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de73720 con 0x55a89de56ea0 2024-09-10T05:37:40.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.757+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 <== osd.0 v2:172.21.15.2:6800/945139080 31 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'71 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8fcc11b040 con 0x55a89de56ea0 2024-09-10T05:37:40.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.757+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de73720 con 0x55a89de529f0 2024-09-10T05:37:40.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.757+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.1 v2:172.21.15.62:6808/3442097179 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'64 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8fc40083f0 con 0x55a89de529f0 2024-09-10T05:37:40.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.757+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de73760 con 0x7f8fcc11e040 2024-09-10T05:37:40.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.761+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8fc40083f0 con 0x7f8fcc11e040 2024-09-10T05:37:40.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.761+0000 7f8e03fff640 20 reqs_thread_entry: start 2024-09-10T05:37:40.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.761+0000 7f8fd4e369c0 20 init_complete bucket index max shards: 11 2024-09-10T05:37:40.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.761+0000 7f8fd4e369c0 20 Filter name: none 2024-09-10T05:37:40.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.761+0000 7f8e01ffb640 20 reqs_thread_entry: start 2024-09-10T05:37:40.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.761+0000 7f8fd4e369c0 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-10T05:37:40.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.761+0000 7f8fd4e369c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:40.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.761+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89de6fcf0 con 0x7f8fcc11e040 2024-09-10T05:37:40.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.761+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.2 v2:172.21.15.62:6800/2677868286 15 ==== osd_op_reply(94 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f8fc40083f0 con 0x7f8fcc11e040 2024-09-10T05:37:40.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.761+0000 7f8fd4e369c0 20 rados_obj.operate() r=0 bl.length=380 2024-09-10T05:37:40.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.761+0000 7f8fd4e369c0 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-10T05:37:40.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.761+0000 7f8fd4e369c0 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-10T05:37:40.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.761+0000 7f8fd4e369c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:37:40.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.761+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:95 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89de912b0 con 0x55a89de56ea0 2024-09-10T05:37:40.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.765+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 <== osd.0 v2:172.21.15.2:6800/945139080 32 ==== osd_op_reply(95 bud.buckets [call out=184b] v0'0 uv6 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7f8fcc11b040 con 0x55a89de56ea0 2024-09-10T05:37:40.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.765+0000 7f8fd4e369c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9 : miss 2024-09-10T05:37:40.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.765+0000 7f8fd4e369c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:40.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.765+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:96 8.14 8:2c490d8a:root::.bucket.meta.myfoo6%3a475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89de910b0 con 0x55a89de56ea0 2024-09-10T05:37:40.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.765+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 <== osd.0 v2:172.21.15.2:6800/945139080 33 ==== osd_op_reply(96 .bucket.meta.myfoo6:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9 [call out=48b,stat out=16b,read 0~388 out=388b,getxattrs out=212b] v0'0 uv5 ondisk = 0) ==== 333+0+664 (crc 0 0 0) 0x7f8fcc11b040 con 0x55a89de56ea0 2024-09-10T05:37:40.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.765+0000 7f8fd4e369c0 20 rados_obj.operate() r=0 bl.length=388 2024-09-10T05:37:40.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.765+0000 7f8fd4e369c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9 info.flags=0x17 2024-09-10T05:37:40.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.765+0000 7f8fd4e369c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9 to cache LRU end 2024-09-10T05:37:40.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.765+0000 7f8fd4e369c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:37:40.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.765+0000 7f8fd4e369c0 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-10T05:37:40.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.765+0000 7f8fd4e369c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9 2024-09-10T05:37:40.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.765+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:97 4.36 4:6e8b42e8:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89df0e650 con 0x55a89de529f0 2024-09-10T05:37:40.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.765+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.1 v2:172.21.15.62:6808/3442097179 26 ==== osd_op_reply(97 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.0 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f8fc40083f0 con 0x55a89de529f0 2024-09-10T05:37:40.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.765+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:98 4.10 4:08e659ec:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89df0e650 con 0x55a89de5a3b0 2024-09-10T05:37:40.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.765+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 <== osd.3 v2:172.21.15.62:6816/2708991149 24 ==== osd_op_reply(98 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f8fbc026070 con 0x55a89de5a3b0 2024-09-10T05:37:40.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.765+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:99 4.1 4:80b79060:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89df0e650 con 0x7f8fcc11e040 2024-09-10T05:37:40.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.765+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.2 v2:172.21.15.62:6800/2677868286 16 ==== osd_op_reply(99 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.2 [call out=89b] v0'0 uv8 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f8fc40083f0 con 0x7f8fcc11e040 2024-09-10T05:37:40.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.765+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:100 4.2f 4:f656784c:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89df0e650 con 0x55a89de529f0 2024-09-10T05:37:40.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.765+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.1 v2:172.21.15.62:6808/3442097179 27 ==== osd_op_reply(100 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.3 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f8fc40083f0 con 0x55a89de529f0 2024-09-10T05:37:40.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.765+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:101 4.3a 4:5f845990:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89df0e670 con 0x55a89de5a3b0 2024-09-10T05:37:40.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.769+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 <== osd.3 v2:172.21.15.62:6816/2708991149 25 ==== osd_op_reply(101 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.4 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f8fbc026070 con 0x55a89de5a3b0 2024-09-10T05:37:40.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.769+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:102 4.15 4:a8cf8440:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89df0e670 con 0x55a89de5a3b0 2024-09-10T05:37:40.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.769+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 <== osd.3 v2:172.21.15.62:6816/2708991149 26 ==== osd_op_reply(102 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.5 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f8fbc026070 con 0x55a89de5a3b0 2024-09-10T05:37:40.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.769+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:103 4.3b 4:de5b2d61:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89df0e6b0 con 0x7f8fcc11e040 2024-09-10T05:37:40.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.769+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.2 v2:172.21.15.62:6800/2677868286 17 ==== osd_op_reply(103 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f8fc40083f0 con 0x7f8fcc11e040 2024-09-10T05:37:40.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.769+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:104 4.31 4:8c900c14:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89df0e6b0 con 0x55a89de56ea0 2024-09-10T05:37:40.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.769+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 <== osd.0 v2:172.21.15.2:6800/945139080 34 ==== osd_op_reply(104 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.7 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f8fcc11b040 con 0x55a89de56ea0 2024-09-10T05:37:40.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.769+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:105 4.33 4:cc3b23f8:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89df0e6b0 con 0x7f8fcc11e040 2024-09-10T05:37:40.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.769+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.2 v2:172.21.15.62:6800/2677868286 18 ==== osd_op_reply(105 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.8 [call out=89b] v0'0 uv23 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f8fc40083f0 con 0x7f8fcc11e040 2024-09-10T05:37:40.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.769+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:106 4.2f 4:f4a045df:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89df0e6b0 con 0x55a89de529f0 2024-09-10T05:37:40.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.769+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.1 v2:172.21.15.62:6808/3442097179 28 ==== osd_op_reply(106 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.9 [call out=349b] v0'0 uv10 ondisk = 0) ==== 194+0+349 (crc 0 0 0) 0x7f8fc40083f0 con 0x55a89de529f0 2024-09-10T05:37:40.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.769+0000 7f8fd4e369c0 10 cls_bucket_list_unordered: got thirteen 2024-09-10T05:37:40.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.769+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:107 4.37 4:efeaefdd:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89df0e670 con 0x7f8fcc11e040 2024-09-10T05:37:40.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.769+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.2 v2:172.21.15.62:6800/2677868286 19 ==== osd_op_reply(107 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f8fc40083f0 con 0x7f8fcc11e040 2024-09-10T05:37:40.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.769+0000 7f8fd4e369c0 20 get_obj_state: octx=0x7f8fc4008ae0 obj=myfoo6:thirteen state=0x55a89df0c6f8 s->prefetch_data=0 2024-09-10T05:37:40.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.769+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:108 3.1f 3:f9774cdb:::475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89df0d520 con 0x55a89de529f0 2024-09-10T05:37:40.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.773+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.1 v2:172.21.15.62:6808/3442097179 29 ==== osd_op_reply(108 475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9_thirteen [getxattrs out=820b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 238+0+836 (crc 0 0 0) 0x7f8fc40083f0 con 0x55a89de529f0 2024-09-10T05:37:40.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.773+0000 7f8fd4e369c0 10 manifest: total_size = 8 2024-09-10T05:37:40.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.773+0000 7f8fd4e369c0 20 get_obj_state: setting s->obj_tag to _EG0a134QGwsnW2MV322K9A9q0o95tzQ 2024-09-10T05:37:40.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.773+0000 7f8fd4e369c0 20 get_obj_state: octx=0x7f8fc4008ae0 obj=myfoo6:thirteen state=0x55a89df0c6f8 s->prefetch_data=0 2024-09-10T05:37:40.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.773+0000 7f8fd4e369c0 20 prepare_atomic_modification: state is not atomic. state=0x55a89df0c6f8 2024-09-10T05:37:40.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.773+0000 7f8fd4e369c0 20 bucket index object: :.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.9 2024-09-10T05:37:40.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.773+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:109 4.2f 4:f4a045df:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89df0de20 con 0x55a89de529f0 2024-09-10T05:37:40.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.773+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.1 v2:172.21.15.62:6808/3442097179 30 ==== osd_op_reply(109 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.9 [stat,call,call] v32'11 uv11 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f8fc40083f0 con 0x55a89de529f0 2024-09-10T05:37:40.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.773+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:110 3.1f 3:f9774cdb:::475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9_thirteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89df0de20 con 0x55a89de529f0 2024-09-10T05:37:40.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.773+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.1 v2:172.21.15.62:6808/3442097179 31 ==== osd_op_reply(110 475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9_thirteen [call] v32'3 uv3 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7f8fc40083f0 con 0x55a89de529f0 2024-09-10T05:37:40.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.773+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:111 4.2f 4:f4a045df:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=264b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de95c60 con 0x55a89de529f0 2024-09-10T05:37:40.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.773+0000 7f8fd4e369c0 20 list_objects_ordered: starting attempt 1 2024-09-10T05:37:40.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.773+0000 7f8fd4e369c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-10T05:37:40.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.773+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:112 4.36 4:6e8b42e8:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89de97590 con 0x55a89de529f0 2024-09-10T05:37:40.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.773+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:113 4.10 4:08e659ec:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89de99e50 con 0x55a89de5a3b0 2024-09-10T05:37:40.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.773+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:114 4.1 4:80b79060:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89de97590 con 0x7f8fcc11e040 2024-09-10T05:37:40.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.773+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:115 4.2f 4:f656784c:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89de9ed10 con 0x55a89de529f0 2024-09-10T05:37:40.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.773+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:116 4.3a 4:5f845990:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89de97590 con 0x55a89de5a3b0 2024-09-10T05:37:40.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.773+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:117 4.15 4:a8cf8440:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89de97590 con 0x55a89de5a3b0 2024-09-10T05:37:40.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.777+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 <== osd.3 v2:172.21.15.62:6816/2708991149 27 ==== osd_op_reply(113 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f8fbc026070 con 0x55a89de5a3b0 2024-09-10T05:37:40.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.777+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:118 4.3b 4:de5b2d61:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89dea6500 con 0x7f8fcc11e040 2024-09-10T05:37:40.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.777+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.2 v2:172.21.15.62:6800/2677868286 20 ==== osd_op_reply(114 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.2 [call out=89b] v0'0 uv8 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f8fc40083f0 con 0x7f8fcc11e040 2024-09-10T05:37:40.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.777+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:119 4.31 4:8c900c14:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89dea6960 con 0x55a89de56ea0 2024-09-10T05:37:40.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.777+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 <== osd.3 v2:172.21.15.62:6816/2708991149 28 ==== osd_op_reply(116 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.4 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f8fbc026070 con 0x55a89de5a3b0 2024-09-10T05:37:40.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.777+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.1 v2:172.21.15.62:6808/3442097179 32 ==== osd_op_reply(112 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.0 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f8fc40083f0 con 0x55a89de529f0 2024-09-10T05:37:40.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.777+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:120 4.33 4:cc3b23f8:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89dea05f0 con 0x7f8fcc11e040 2024-09-10T05:37:40.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.777+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:121 4.2f 4:f4a045df:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89de95d70 con 0x55a89de529f0 2024-09-10T05:37:40.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.777+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:122 4.37 4:efeaefdd:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89dea7970 con 0x7f8fcc11e040 2024-09-10T05:37:40.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.777+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 <== osd.3 v2:172.21.15.62:6816/2708991149 29 ==== osd_op_reply(117 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.5 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f8fbc026070 con 0x55a89de5a3b0 2024-09-10T05:37:40.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.777+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.1 v2:172.21.15.62:6808/3442097179 33 ==== osd_op_reply(115 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.3 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f8fc40083f0 con 0x55a89de529f0 2024-09-10T05:37:40.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.777+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.2 v2:172.21.15.62:6800/2677868286 21 ==== osd_op_reply(118 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f8fc40083f0 con 0x7f8fcc11e040 2024-09-10T05:37:40.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.777+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.2 v2:172.21.15.62:6800/2677868286 22 ==== osd_op_reply(120 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.8 [call out=89b] v0'0 uv23 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f8fc40083f0 con 0x7f8fcc11e040 2024-09-10T05:37:40.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.777+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.2 v2:172.21.15.62:6800/2677868286 23 ==== osd_op_reply(122 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f8fc40083f0 con 0x7f8fcc11e040 2024-09-10T05:37:40.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.777+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.1 v2:172.21.15.62:6808/3442097179 34 ==== osd_op_reply(111 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.9 [stat,call,call] v32'12 uv12 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f8fc40083f0 con 0x55a89de529f0 2024-09-10T05:37:40.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.777+0000 7f8eb67fc640 20 handle_completion(): completion ok for obj=thirteen 2024-09-10T05:37:40.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.777+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 <== osd.0 v2:172.21.15.2:6800/945139080 35 ==== osd_op_reply(119 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.7 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f8fcc11b040 con 0x55a89de56ea0 2024-09-10T05:37:40.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.777+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.1 v2:172.21.15.62:6808/3442097179 35 ==== osd_op_reply(121 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.9 [call out=128b] v0'0 uv12 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f8fc40083f0 con 0x55a89de529f0 2024-09-10T05:37:40.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.777+0000 7f8fd4e369c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-10T05:37:40.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.777+0000 7f8fd4e369c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-10T05:37:40.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.777+0000 7f8fd4e369c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-10T05:37:40.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.777+0000 7f8fd4e369c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-10T05:37:40.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.777+0000 7f8fd4e369c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo6[475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9])"; uploads.size()=0; is_truncated=0 2024-09-10T05:37:40.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.777+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:123 4.36 4:6e8b42e8:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89dea6500 con 0x55a89de529f0 2024-09-10T05:37:40.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.777+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:124 4.10 4:08e659ec:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89de9b7b0 con 0x55a89de5a3b0 2024-09-10T05:37:40.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.777+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:125 4.1 4:80b79060:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89dea7970 con 0x7f8fcc11e040 2024-09-10T05:37:40.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.777+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:126 4.2f 4:f656784c:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89dea6500 con 0x55a89de529f0 2024-09-10T05:37:40.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.777+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:127 4.3a 4:5f845990:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89de9b7b0 con 0x55a89de5a3b0 2024-09-10T05:37:40.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.777+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:128 4.15 4:a8cf8440:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89dea7970 con 0x55a89de5a3b0 2024-09-10T05:37:40.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.777+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:129 4.3b 4:de5b2d61:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89dea6500 con 0x7f8fcc11e040 2024-09-10T05:37:40.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.777+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:130 4.31 4:8c900c14:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89de947a0 con 0x55a89de56ea0 2024-09-10T05:37:40.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.777+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:131 4.33 4:cc3b23f8:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89dea7970 con 0x7f8fcc11e040 2024-09-10T05:37:40.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.777+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:132 4.2f 4:f4a045df:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89deab320 con 0x55a89de529f0 2024-09-10T05:37:40.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.777+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:133 4.37 4:efeaefdd:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89deadfc0 con 0x7f8fcc11e040 2024-09-10T05:37:40.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.777+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 <== osd.3 v2:172.21.15.62:6816/2708991149 30 ==== osd_op_reply(124 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f8fbc026070 con 0x55a89de5a3b0 2024-09-10T05:37:40.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.777+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.2 v2:172.21.15.62:6800/2677868286 24 ==== osd_op_reply(125 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.2 [call out=89b] v0'0 uv8 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f8fc4052040 con 0x7f8fcc11e040 2024-09-10T05:37:40.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.777+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 <== osd.3 v2:172.21.15.62:6816/2708991149 31 ==== osd_op_reply(127 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.4 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f8fbc026070 con 0x55a89de5a3b0 2024-09-10T05:37:40.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.777+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 <== osd.3 v2:172.21.15.62:6816/2708991149 32 ==== osd_op_reply(128 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.5 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f8fbc026070 con 0x55a89de5a3b0 2024-09-10T05:37:40.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.777+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.1 v2:172.21.15.62:6808/3442097179 36 ==== osd_op_reply(123 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.0 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f8fc4052040 con 0x55a89de529f0 2024-09-10T05:37:40.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.777+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.1 v2:172.21.15.62:6808/3442097179 37 ==== osd_op_reply(126 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.3 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f8fc4052040 con 0x55a89de529f0 2024-09-10T05:37:40.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.777+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.2 v2:172.21.15.62:6800/2677868286 25 ==== osd_op_reply(129 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f8fc4052040 con 0x7f8fcc11e040 2024-09-10T05:37:40.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.777+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.2 v2:172.21.15.62:6800/2677868286 26 ==== osd_op_reply(131 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.8 [call out=89b] v0'0 uv23 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f8fc4052040 con 0x7f8fcc11e040 2024-09-10T05:37:40.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.777+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.2 v2:172.21.15.62:6800/2677868286 27 ==== osd_op_reply(133 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f8fc4052040 con 0x7f8fcc11e040 2024-09-10T05:37:40.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.777+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.1 v2:172.21.15.62:6808/3442097179 38 ==== osd_op_reply(132 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.9 [call out=128b] v0'0 uv12 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f8fc4052040 con 0x55a89de529f0 2024-09-10T05:37:40.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.777+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 <== osd.0 v2:172.21.15.2:6800/945139080 36 ==== osd_op_reply(130 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.7 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f8fcc11b040 con 0x55a89de56ea0 2024-09-10T05:37:40.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.777+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:134 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89df0e090 con 0x55a89de56ea0 2024-09-10T05:37:40.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.781+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 <== osd.0 v2:172.21.15.2:6800/945139080 37 ==== osd_op_reply(134 bud.buckets [call] v32'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f8fcc11b040 con 0x55a89de56ea0 2024-09-10T05:37:40.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.781+0000 7f8fd4e369c0 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-09-10T05:37:40.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.781+0000 7f8fd4e369c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:40.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.781+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:135 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89df0e090 con 0x55a89de529f0 2024-09-10T05:37:40.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.781+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.1 v2:172.21.15.62:6808/3442097179 39 ==== osd_op_reply(135 myfoo6 [call out=48b,read 0~166 out=166b] v0'0 uv17 ondisk = 0) ==== 192+0+214 (crc 0 0 0) 0x7f8fc4052040 con 0x55a89de529f0 2024-09-10T05:37:40.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.781+0000 7f8fd4e369c0 20 rados_obj.operate() r=0 bl.length=166 2024-09-10T05:37:40.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.781+0000 7f8fd4e369c0 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x11 2024-09-10T05:37:40.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.781+0000 7f8fd4e369c0 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-10T05:37:40.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.781+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:136 8.18 8:1944a257:root::myfoo6:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89df0e090 con 0x55a89de529f0 2024-09-10T05:37:40.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.781+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.1 v2:172.21.15.62:6808/3442097179 40 ==== osd_op_reply(136 myfoo6 [call,call,delete] v32'18 uv18 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f8fc4052040 con 0x55a89de529f0 2024-09-10T05:37:40.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.781+0000 7f8fd4e369c0 10 removing default.rgw.meta+root+myfoo6 from cache 2024-09-10T05:37:40.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.781+0000 7f8fd4e369c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-10T05:37:40.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.781+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94182692282176 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89dea7970 con 0x7f8fcc11e040 2024-09-10T05:37:40.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.785+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.2 v2:172.21.15.62:6800/2677868286 28 ==== watch-notify(notify (1) cookie 94182691974944 notify 137438953487 ret 0) ==== 192+0+0 (crc 0 0 0) 0x55a89de72910 con 0x7f8fcc11e040 2024-09-10T05:37:40.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.785+0000 7f8eb67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953487 cookie 94182691974944 notifier 4752 bl.length()=150 2024-09-10T05:37:40.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.785+0000 7f8eb67fc640 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f8e98003d70 con 0x7f8fcc11e040 2024-09-10T05:37:40.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.785+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.2 v2:172.21.15.62:6800/2677868286 29 ==== osd_op_reply(137 notify.3 [notify cookie 94182692282176 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8fc4052040 con 0x7f8fcc11e040 2024-09-10T05:37:40.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.785+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.2 v2:172.21.15.62:6800/2677868286 30 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fc4052040 con 0x7f8fcc11e040 2024-09-10T05:37:40.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.785+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.2 v2:172.21.15.62:6800/2677868286 31 ==== watch-notify(notify_complete (2) cookie 94182692282176 notify 137438953487 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a89de72cb0 con 0x7f8fcc11e040 2024-09-10T05:37:40.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.785+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:139 8.14 8:2c490d8a:root::.bucket.meta.myfoo6%3a475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89df0e090 con 0x55a89de56ea0 2024-09-10T05:37:40.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.785+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 <== osd.0 v2:172.21.15.2:6800/945139080 38 ==== osd_op_reply(139 .bucket.meta.myfoo6:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9 [call,call,delete] v32'6 uv6 ondisk = 0) ==== 291+0+0 (crc 0 0 0) 0x7f8fcc11b040 con 0x55a89de56ea0 2024-09-10T05:37:40.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.785+0000 7f8fd4e369c0 10 removing default.rgw.meta+root+.bucket.meta.myfoo6:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9 from cache 2024-09-10T05:37:40.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.785+0000 7f8fd4e369c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo6:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9, ofs0, ns] 2024-09-10T05:37:40.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.785+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:140 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94182692163616 in=219b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89dea7970 con 0x55a89de56ea0 2024-09-10T05:37:40.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.789+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 <== osd.0 v2:172.21.15.2:6800/945139080 39 ==== watch-notify(notify (1) cookie 94182691963968 notify 137438953512 ret 0) ==== 249+0+0 (crc 0 0 0) 0x55a89de905c0 con 0x55a89de56ea0 2024-09-10T05:37:40.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.789+0000 7f8eb5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953512 cookie 94182691963968 notifier 4752 bl.length()=207 2024-09-10T05:37:40.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.789+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 <== osd.0 v2:172.21.15.2:6800/945139080 40 ==== osd_op_reply(140 notify.0 [notify cookie 94182692163616 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8fcc11b040 con 0x55a89de56ea0 2024-09-10T05:37:40.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.789+0000 7f8eb5ffb640 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:141 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f8e08003330 con 0x55a89de56ea0 2024-09-10T05:37:40.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.789+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 <== osd.0 v2:172.21.15.2:6800/945139080 41 ==== watch-notify(notify_complete (2) cookie 94182692163616 notify 137438953512 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f8fcc0e8040 con 0x55a89de56ea0 2024-09-10T05:37:40.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.789+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 <== osd.0 v2:172.21.15.2:6800/945139080 42 ==== osd_op_reply(141 notify.0 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fcc11b040 con 0x55a89de56ea0 2024-09-10T05:37:40.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.789+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:142 4.36 4:6e8b42e8:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89df0e090 con 0x55a89de529f0 2024-09-10T05:37:40.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.789+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:143 4.10 4:08e659ec:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89deade20 con 0x55a89de5a3b0 2024-09-10T05:37:40.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.789+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:144 4.1 4:80b79060:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de8f900 con 0x7f8fcc11e040 2024-09-10T05:37:40.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.789+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:145 4.2f 4:f656784c:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89dea3c10 con 0x55a89de529f0 2024-09-10T05:37:40.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.789+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:146 4.3a 4:5f845990:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89dea4520 con 0x55a89de5a3b0 2024-09-10T05:37:40.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.789+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:147 4.15 4:a8cf8440:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89df0e090 con 0x55a89de5a3b0 2024-09-10T05:37:40.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.789+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:148 4.3b 4:de5b2d61:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89deade20 con 0x7f8fcc11e040 2024-09-10T05:37:40.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.789+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:149 4.31 4:8c900c14:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89dea3c10 con 0x55a89de56ea0 2024-09-10T05:37:40.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.789+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:150 4.33 4:cc3b23f8:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89dea4520 con 0x7f8fcc11e040 2024-09-10T05:37:40.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.789+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:151 4.2f 4:f4a045df:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de8f900 con 0x55a89de529f0 2024-09-10T05:37:40.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.789+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:152 4.37 4:efeaefdd:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89deade20 con 0x7f8fcc11e040 2024-09-10T05:37:40.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.793+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.1 v2:172.21.15.62:6808/3442097179 41 ==== osd_op_reply(145 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.3 [delete] v32'13 uv13 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f8fc4052040 con 0x55a89de529f0 2024-09-10T05:37:40.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.793+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.1 v2:172.21.15.62:6808/3442097179 42 ==== osd_op_reply(142 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.0 [delete] v32'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f8fc4052040 con 0x55a89de529f0 2024-09-10T05:37:40.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.793+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.1 v2:172.21.15.62:6808/3442097179 43 ==== osd_op_reply(151 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.9 [delete] v32'14 uv14 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f8fc4052040 con 0x55a89de529f0 2024-09-10T05:37:40.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.793+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 <== osd.0 v2:172.21.15.2:6800/945139080 43 ==== osd_op_reply(149 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.7 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f8fcc11b040 con 0x55a89de56ea0 2024-09-10T05:37:40.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.793+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.2 v2:172.21.15.62:6800/2677868286 32 ==== osd_op_reply(148 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.6 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f8fc4052040 con 0x7f8fcc11e040 2024-09-10T05:37:40.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.793+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.2 v2:172.21.15.62:6800/2677868286 33 ==== osd_op_reply(144 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.2 [delete] v32'9 uv9 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f8fc4052040 con 0x7f8fcc11e040 2024-09-10T05:37:40.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.793+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 <== osd.3 v2:172.21.15.62:6816/2708991149 33 ==== osd_op_reply(147 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.5 [delete] v32'5 uv5 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f8fbc026070 con 0x55a89de5a3b0 2024-09-10T05:37:40.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.793+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 <== osd.3 v2:172.21.15.62:6816/2708991149 34 ==== osd_op_reply(146 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.4 [delete] v32'5 uv5 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f8fbc026070 con 0x55a89de5a3b0 2024-09-10T05:37:40.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.793+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.2 v2:172.21.15.62:6800/2677868286 34 ==== osd_op_reply(152 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.10 [delete] v32'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f8fc4052040 con 0x7f8fcc11e040 2024-09-10T05:37:40.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.793+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 <== osd.3 v2:172.21.15.62:6816/2708991149 35 ==== osd_op_reply(143 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.1 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f8fbc026070 con 0x55a89de5a3b0 2024-09-10T05:37:40.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.793+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.2 v2:172.21.15.62:6800/2677868286 35 ==== osd_op_reply(150 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9.8 [delete] v32'24 uv24 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f8fc4052040 con 0x7f8fcc11e040 2024-09-10T05:37:40.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.793+0000 7f8fd4e369c0 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo6/475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9 : miss 2024-09-10T05:37:40.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.793+0000 7f8fd4e369c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:40.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.793+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:153 6.18 6:1c198683:::pubsub..bucket.myfoo6%2f475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89df0e090 con 0x7f8fcc11e040 2024-09-10T05:37:40.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.793+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.2 v2:172.21.15.62:6800/2677868286 36 ==== osd_op_reply(153 pubsub..bucket.myfoo6/475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7f8fc4052040 con 0x7f8fcc11e040 2024-09-10T05:37:40.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.793+0000 7f8fd4e369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:40.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.793+0000 7f8fd4e369c0 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo6/475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9 info.flags=0x0 2024-09-10T05:37:40.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.793+0000 7f8fd4e369c0 10 adding default.rgw.log++pubsub..bucket.myfoo6/475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9 to cache LRU end 2024-09-10T05:37:40.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.793+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:154 6.18 6:1c198683:::pubsub..bucket.myfoo6%2f475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89dea3c10 con 0x7f8fcc11e040 2024-09-10T05:37:40.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.797+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.2 v2:172.21.15.62:6800/2677868286 37 ==== osd_op_reply(154 pubsub..bucket.myfoo6/475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.9 [delete] v32'33 uv27 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7f8fc4052040 con 0x7f8fcc11e040 2024-09-10T05:37:40.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.797+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:155 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89dea3c10 con 0x55a89de56ea0 2024-09-10T05:37:40.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.797+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 <== osd.0 v2:172.21.15.2:6800/945139080 44 ==== osd_op_reply(155 bud.buckets [call] v32'8 uv8 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f8fcc11b040 con 0x55a89de56ea0 2024-09-10T05:37:40.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.797+0000 7f8fd4e369c0 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2024-09-10T05:37:40.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.797+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:156 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89df0df80 con 0x55a89de529f0 2024-09-10T05:37:40.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.801+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.1 v2:172.21.15.62:6808/3442097179 44 ==== osd_op_reply(156 NX5QOQKC6BH2IDN8HC7A [delete] v32'5 uv5 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f8fc4052040 con 0x55a89de529f0 2024-09-10T05:37:40.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.801+0000 7f8fd4e369c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-10T05:37:40.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.801+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:157 7.3 7:c609908c:::notify.5:head [notify cookie 94182692256048 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89df0df80 con 0x55a89de5a3b0 2024-09-10T05:37:40.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.801+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 <== osd.3 v2:172.21.15.62:6816/2708991149 36 ==== watch-notify(notify (1) cookie 94182691977840 notify 137438953506 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55a89de71d90 con 0x55a89de5a3b0 2024-09-10T05:37:40.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.801+0000 7f8eb67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953506 cookie 94182691977840 notifier 4752 bl.length()=170 2024-09-10T05:37:40.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.801+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 <== osd.3 v2:172.21.15.62:6816/2708991149 37 ==== osd_op_reply(157 notify.5 [notify cookie 94182692256048 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8fbc026070 con 0x55a89de5a3b0 2024-09-10T05:37:40.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.801+0000 7f8eb67fc640 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:158 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f8e98003d70 con 0x55a89de5a3b0 2024-09-10T05:37:40.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.801+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 <== osd.3 v2:172.21.15.62:6816/2708991149 38 ==== osd_op_reply(158 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fbc026070 con 0x55a89de5a3b0 2024-09-10T05:37:40.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.801+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 <== osd.3 v2:172.21.15.62:6816/2708991149 39 ==== watch-notify(notify_complete (2) cookie 94182692256048 notify 137438953506 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a89de72720 con 0x55a89de5a3b0 2024-09-10T05:37:40.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.801+0000 7f8fd4e369c0 10 removing email index: 2024-09-10T05:37:40.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.801+0000 7f8fd4e369c0 10 removing user buckets index 2024-09-10T05:37:40.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.801+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:159 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89df0df80 con 0x55a89de56ea0 2024-09-10T05:37:40.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.805+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 <== osd.0 v2:172.21.15.2:6800/945139080 45 ==== osd_op_reply(159 bud.buckets [delete] v32'9 uv9 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f8fcc11b040 con 0x55a89de56ea0 2024-09-10T05:37:40.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.805+0000 7f8fd4e369c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2024-09-10T05:37:40.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.805+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94182692256048 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89df0df80 con 0x55a89de5a3b0 2024-09-10T05:37:40.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.805+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 <== osd.3 v2:172.21.15.62:6816/2708991149 40 ==== watch-notify(notify (1) cookie 94182691982128 notify 137438953507 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55a89de72720 con 0x55a89de5a3b0 2024-09-10T05:37:40.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.805+0000 7f8eb67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953507 cookie 94182691982128 notifier 4752 bl.length()=160 2024-09-10T05:37:40.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.805+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 <== osd.3 v2:172.21.15.62:6816/2708991149 41 ==== osd_op_reply(160 notify.6 [notify cookie 94182692256048 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8fbc026070 con 0x55a89de5a3b0 2024-09-10T05:37:40.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.805+0000 7f8eb67fc640 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f8e98003d70 con 0x55a89de5a3b0 2024-09-10T05:37:40.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.805+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 <== osd.3 v2:172.21.15.62:6816/2708991149 42 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fbc026070 con 0x55a89de5a3b0 2024-09-10T05:37:40.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.805+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 <== osd.3 v2:172.21.15.62:6816/2708991149 43 ==== watch-notify(notify_complete (2) cookie 94182692256048 notify 137438953507 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a89de6a8a0 con 0x55a89de5a3b0 2024-09-10T05:37:40.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.805+0000 7f8fd4e369c0 10 removing user index: bud 2024-09-10T05:37:40.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.805+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:162 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89dea7930 con 0x7f8fcc11e040 2024-09-10T05:37:40.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.805+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.2 v2:172.21.15.62:6800/2677868286 38 ==== osd_op_reply(162 bud [call,call,delete] v32'3 uv3 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f8fc4052040 con 0x7f8fcc11e040 2024-09-10T05:37:40.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.805+0000 7f8fd4e369c0 10 removing default.rgw.meta+users.uid+bud from cache 2024-09-10T05:37:40.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.805+0000 7f8fd4e369c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-10T05:37:40.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.805+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94182692163616 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a89dea7930 con 0x55a89de5a3b0 2024-09-10T05:37:40.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.805+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 <== osd.3 v2:172.21.15.62:6816/2708991149 44 ==== watch-notify(notify (1) cookie 94182691977840 notify 137438953508 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55a89de6a8a0 con 0x55a89de5a3b0 2024-09-10T05:37:40.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.805+0000 7f8eb5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953508 cookie 94182691977840 notifier 4752 bl.length()=152 2024-09-10T05:37:40.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.805+0000 7f8eb5ffb640 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f8e080032d0 con 0x55a89de5a3b0 2024-09-10T05:37:40.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.809+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 <== osd.3 v2:172.21.15.62:6816/2708991149 45 ==== osd_op_reply(163 notify.5 [notify cookie 94182692163616 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8fbc026070 con 0x55a89de5a3b0 2024-09-10T05:37:40.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.809+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 <== osd.3 v2:172.21.15.62:6816/2708991149 46 ==== watch-notify(notify_complete (2) cookie 94182692163616 notify 137438953508 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a89de6ad00 con 0x55a89de5a3b0 2024-09-10T05:37:40.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.809+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 <== osd.3 v2:172.21.15.62:6816/2708991149 47 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fbc026070 con 0x55a89de5a3b0 2024-09-10T05:37:40.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.809+0000 7f8e897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:37:40.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.809+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94182691984880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de91020 con 0x55a89de529f0 2024-09-10T05:37:40.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.813+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.1 v2:172.21.15.62:6808/3442097179 45 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94182691984880] v32'228 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8fc4052040 con 0x55a89de529f0 2024-09-10T05:37:40.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.813+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94182691963968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de655f0 con 0x55a89de56ea0 2024-09-10T05:37:40.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.813+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 <== osd.0 v2:172.21.15.2:6800/945139080 46 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94182691963968] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fcc11b040 con 0x55a89de56ea0 2024-09-10T05:37:40.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.813+0000 7f8fd4e369c0 20 remove_watcher() i=0 2024-09-10T05:37:40.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.813+0000 7f8fd4e369c0 2 removed watcher, disabling cache 2024-09-10T05:37:40.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.813+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94182691967840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de655f0 con 0x55a89de529f0 2024-09-10T05:37:40.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.817+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.1 v2:172.21.15.62:6808/3442097179 46 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94182691967840] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fc4052040 con 0x55a89de529f0 2024-09-10T05:37:40.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.817+0000 7f8fd4e369c0 20 remove_watcher() i=1 2024-09-10T05:37:40.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.817+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94182691972608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de655f0 con 0x55a89de56ea0 2024-09-10T05:37:40.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.817+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 <== osd.0 v2:172.21.15.2:6800/945139080 47 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94182691972608] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fcc11b040 con 0x55a89de56ea0 2024-09-10T05:37:40.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.817+0000 7f8fd4e369c0 20 remove_watcher() i=2 2024-09-10T05:37:40.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.817+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94182691974944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de655f0 con 0x7f8fcc11e040 2024-09-10T05:37:40.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.821+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.2 v2:172.21.15.62:6800/2677868286 39 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94182691974944] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fc4052040 con 0x7f8fcc11e040 2024-09-10T05:37:40.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.821+0000 7f8fd4e369c0 20 remove_watcher() i=3 2024-09-10T05:37:40.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.821+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94182691961488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de62f20 con 0x55a89de56ea0 2024-09-10T05:37:40.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.821+0000 7f8fd293c640 1 -- 172.21.15.62:0/520512830 <== osd.0 v2:172.21.15.2:6800/945139080 48 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94182691961488] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fcc11b040 con 0x55a89de56ea0 2024-09-10T05:37:40.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.821+0000 7f8fd4e369c0 20 remove_watcher() i=4 2024-09-10T05:37:40.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.821+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94182691977840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de655f0 con 0x55a89de5a3b0 2024-09-10T05:37:40.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.825+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 <== osd.3 v2:172.21.15.62:6816/2708991149 48 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94182691977840] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fbc026070 con 0x55a89de5a3b0 2024-09-10T05:37:40.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.825+0000 7f8fd4e369c0 20 remove_watcher() i=5 2024-09-10T05:37:40.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.825+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94182691982128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de5fa90 con 0x55a89de5a3b0 2024-09-10T05:37:40.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.825+0000 7f8fd213b640 1 -- 172.21.15.62:0/520512830 <== osd.3 v2:172.21.15.62:6816/2708991149 49 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94182691982128] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fbc026070 con 0x55a89de5a3b0 2024-09-10T05:37:40.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.825+0000 7f8fd4e369c0 20 remove_watcher() i=6 2024-09-10T05:37:40.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.825+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94182691976000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a89de655f0 con 0x7f8fcc11e040 2024-09-10T05:37:40.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.829+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 <== osd.2 v2:172.21.15.62:6800/2677868286 40 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94182691976000] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fc4052040 con 0x7f8fcc11e040 2024-09-10T05:37:40.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.829+0000 7f8fd4e369c0 20 remove_watcher() i=7 2024-09-10T05:37:40.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.829+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55a89de56ea0 msgr2=0x55a89de59290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.829+0000 7f8fd4e369c0 1 --2- 172.21.15.62:0/520512830 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55a89de56ea0 0x55a89de59290 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:40.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.829+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55a89de529f0 msgr2=0x55a89de54eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.829+0000 7f8fd4e369c0 1 --2- 172.21.15.62:0/520512830 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55a89de529f0 0x55a89de54eb0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:40.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.829+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f8fcc11e040 msgr2=0x7f8fcc0a5800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.829+0000 7f8fd4e369c0 1 --2- 172.21.15.62:0/520512830 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f8fcc11e040 0x7f8fcc0a5800 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:40.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.829+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55a89de5a3b0 msgr2=0x55a89de5c7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.829+0000 7f8fd4e369c0 1 --2- 172.21.15.62:0/520512830 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55a89de5a3b0 0x55a89de5c7a0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:40.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.829+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8e9c039a20 msgr2=0x7f8e9c03bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.829+0000 7f8fd4e369c0 1 --2- 172.21.15.62:0/520512830 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8e9c039a20 0x7f8e9c03bee0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x55a89de25dc0 tx=0x7f8fbc025000 comp rx=0 tx=0).stop 2024-09-10T05:37:40.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.829+0000 7f8fd313d640 1 -- 172.21.15.62:0/520512830 reap_dead start 2024-09-10T05:37:40.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.829+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a89de406d0 msgr2=0x55a89de47a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.829+0000 7f8fd4e369c0 1 --2- 172.21.15.62:0/520512830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a89de406d0 0x55a89de47a30 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc0b69e0 tx=0x7f8fcc0d4ea0 comp rx=0 tx=0).stop 2024-09-10T05:37:40.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.829+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 shutdown_connections 2024-09-10T05:37:40.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.829+0000 7f8fd4e369c0 1 --2- 172.21.15.62:0/520512830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a89de406d0 0x55a89de47a30 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:40.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.829+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 >> 172.21.15.62:0/520512830 conn(0x55a89de3cb00 msgr2=0x55a89de3ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:40.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.829+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 shutdown_connections 2024-09-10T05:37:40.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.829+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/520512830 wait complete. 2024-09-10T05:37:40.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.829+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/546649330 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8eac039a70 msgr2=0x7f8eac03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.829+0000 7f8fd4e369c0 1 --2- 172.21.15.62:0/546649330 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8eac039a70 0x7f8eac03bf30 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc00c010 tx=0x7f8fbc00f000 comp rx=0 tx=0).stop 2024-09-10T05:37:40.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.829+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/546649330 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a89de34120 msgr2=0x55a89de34540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.829+0000 7f8fd4e369c0 1 --2- 172.21.15.62:0/546649330 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a89de34120 0x55a89de34540 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc0033f0 tx=0x7f8fcc0a94a0 comp rx=0 tx=0).stop 2024-09-10T05:37:40.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.829+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/546649330 shutdown_connections 2024-09-10T05:37:40.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.829+0000 7f8fd4e369c0 1 --2- 172.21.15.62:0/546649330 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8eac039a70 0x7f8eac03bf30 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:40.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.829+0000 7f8fd4e369c0 1 --2- 172.21.15.62:0/546649330 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a89de34120 0x55a89de34540 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:40.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.829+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/546649330 >> 172.21.15.62:0/546649330 conn(0x55a89de29ad0 msgr2=0x55a89de29eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:40.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.829+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/546649330 shutdown_connections 2024-09-10T05:37:40.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.829+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/546649330 wait complete. 2024-09-10T05:37:40.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.829+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/544050700 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55a89de1e520 msgr2=0x55a89de209e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.829+0000 7f8fd4e369c0 1 --2- 172.21.15.62:0/544050700 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55a89de1e520 0x55a89de209e0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:40.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.829+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/544050700 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55a89de1b140 msgr2=0x55a89de1d530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.829+0000 7f8fd4e369c0 1 --2- 172.21.15.62:0/544050700 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55a89de1b140 0x55a89de1d530 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:40.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.829+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/544050700 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55a89de22f10 msgr2=0x55a89de25300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.829+0000 7f8fd4e369c0 1 --2- 172.21.15.62:0/544050700 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55a89de22f10 0x55a89de25300 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:40.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.829+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/544050700 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8eb8039a70 msgr2=0x7f8eb803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.829+0000 7f8fd4e369c0 1 --2- 172.21.15.62:0/544050700 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8eb8039a70 0x7f8eb803bf30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc004180 tx=0x7f8fbc001340 comp rx=0 tx=0).stop 2024-09-10T05:37:40.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.829+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/544050700 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a89dd26330 msgr2=0x55a89de160d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.829+0000 7f8fd4e369c0 1 --2- 172.21.15.62:0/544050700 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a89dd26330 0x55a89de160d0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc01b010 tx=0x7f8fcc017d70 comp rx=0 tx=0).stop 2024-09-10T05:37:40.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.829+0000 7f8fd313d640 1 -- 172.21.15.62:0/544050700 reap_dead start 2024-09-10T05:37:40.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.829+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/544050700 shutdown_connections 2024-09-10T05:37:40.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.829+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/544050700 >> 172.21.15.62:0/544050700 conn(0x55a89dc96b00 msgr2=0x55a89de08fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:40.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.829+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/544050700 shutdown_connections 2024-09-10T05:37:40.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.829+0000 7f8fd4e369c0 1 -- 172.21.15.62:0/544050700 wait complete. 2024-09-10T05:37:40.849 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-10T05:37:40.849 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-10T05:37:40.849 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2024-09-10T05:37:40.932 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:37:40.933 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:37:40.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.929+0000 7f26aec0c9c0 1 Processor -- start 2024-09-10T05:37:40.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.929+0000 7f26aec0c9c0 1 -- start start 2024-09-10T05:37:40.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.929+0000 7f26aec0c9c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x560aa3fca340 0x560aa3fcc730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.929+0000 7f26aec0c9c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560aa3e7a9c0 con 0x560aa3f3a1f0 2024-09-10T05:37:40.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.929+0000 7f26aec0c9c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x560aa3eca6d0 con 0x560aa3fca340 2024-09-10T05:37:40.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.929+0000 7f26abf11640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x560aa3fca340 0x560aa3fcc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.929+0000 7f26ac712640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x560aa3f3a1f0 0x560aa3fc8c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:50622/0 (socket says 172.21.15.62:50622) 2024-09-10T05:37:40.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.929+0000 7f26ac712640 1 -- 172.21.15.62:0/1582354207 learned_addr learned my addr 172.21.15.62:0/1582354207 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-10T05:37:40.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.929+0000 7f26abf11640 1 -- 172.21.15.62:0/1582354207 >> v1:172.21.15.2:6789/0 conn(0x560aa3f3a1f0 legacy=0x560aa3fc8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.929+0000 7f26abf11640 1 -- 172.21.15.62:0/1582354207 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560aa3e6eca0 con 0x560aa3fca340 2024-09-10T05:37:40.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.933+0000 7f26abf11640 1 --2- 172.21.15.62:0/1582354207 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aa3fca340 0x560aa3fcc730 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f26a000a480 tx=0x7f26a001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e750768609ec9424 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.933+0000 7f26ab710640 1 -- 172.21.15.62:0/1582354207 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26a00af070 con 0x560aa3fca340 2024-09-10T05:37:40.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.933+0000 7f26ab710640 1 -- 172.21.15.62:0/1582354207 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26a00aa530 con 0x560aa3fca340 2024-09-10T05:37:40.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.933+0000 7f26ab710640 1 -- 172.21.15.62:0/1582354207 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26a00aa830 con 0x560aa3fca340 2024-09-10T05:37:40.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.933+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/1582354207 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aa3fca340 msgr2=0x560aa3fcc730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.933+0000 7f26aec0c9c0 1 --2- 172.21.15.62:0/1582354207 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aa3fca340 0x560aa3fcc730 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f26a000a480 tx=0x7f26a001b280 comp rx=0 tx=0).stop 2024-09-10T05:37:40.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.933+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/1582354207 shutdown_connections 2024-09-10T05:37:40.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.933+0000 7f26aec0c9c0 1 --2- 172.21.15.62:0/1582354207 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aa3fca340 0x560aa3fcc730 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:40.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.933+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/1582354207 >> 172.21.15.62:0/1582354207 conn(0x560aa3fc0910 msgr2=0x560aa3fc2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:40.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.933+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/1582354207 shutdown_connections 2024-09-10T05:37:40.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.933+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/1582354207 wait complete. 2024-09-10T05:37:40.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.949+0000 7f26aec0c9c0 1 Processor -- start 2024-09-10T05:37:40.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.949+0000 7f26aec0c9c0 1 -- start start 2024-09-10T05:37:40.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.949+0000 7f26aec0c9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aa3f3a1f0 0x560aa40b17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.949+0000 7f26aec0c9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560aa3ece680 con 0x560aa3f3a1f0 2024-09-10T05:37:40.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.949+0000 7f26ac712640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aa3f3a1f0 0x560aa40b17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.949+0000 7f26ac712640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aa3f3a1f0 0x560aa40b17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:58578/0 (socket says 172.21.15.62:58578) 2024-09-10T05:37:40.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.949+0000 7f26ac712640 1 -- 172.21.15.62:0/4021403759 learned_addr learned my addr 172.21.15.62:0/4021403759 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:40.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.953+0000 7f26ac712640 1 -- 172.21.15.62:0/4021403759 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560aa3e49da0 con 0x560aa3f3a1f0 2024-09-10T05:37:40.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.953+0000 7f26ac712640 1 --2- 172.21.15.62:0/4021403759 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aa3f3a1f0 0x560aa40b17f0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f269c001e50 tx=0x7f269c001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f626614a4ae50da9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.953+0000 7f259a60c640 1 -- 172.21.15.62:0/4021403759 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f269c012020 con 0x560aa3f3a1f0 2024-09-10T05:37:40.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.953+0000 7f259a60c640 1 -- 172.21.15.62:0/4021403759 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f269c00e7c0 con 0x560aa3f3a1f0 2024-09-10T05:37:40.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.953+0000 7f259a60c640 1 -- 172.21.15.62:0/4021403759 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f269c00eaa0 con 0x560aa3f3a1f0 2024-09-10T05:37:40.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.953+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/4021403759 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aa3f3a1f0 msgr2=0x560aa40b17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.953+0000 7f26aec0c9c0 1 --2- 172.21.15.62:0/4021403759 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aa3f3a1f0 0x560aa40b17f0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f269c001e50 tx=0x7f269c001e80 comp rx=0 tx=0).stop 2024-09-10T05:37:40.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.953+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/4021403759 shutdown_connections 2024-09-10T05:37:40.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.953+0000 7f26aec0c9c0 1 --2- 172.21.15.62:0/4021403759 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aa3f3a1f0 0x560aa40b17f0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:40.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.953+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/4021403759 >> 172.21.15.62:0/4021403759 conn(0x560aa3fc0910 msgr2=0x560aa40ad430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:40.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.953+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/4021403759 shutdown_connections 2024-09-10T05:37:40.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.953+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/4021403759 wait complete. 2024-09-10T05:37:40.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.953+0000 7f26aec0c9c0 1 Processor -- start 2024-09-10T05:37:40.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.953+0000 7f26aec0c9c0 1 -- start start 2024-09-10T05:37:40.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.953+0000 7f26aec0c9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aa3f3a1f0 0x560aa3fc6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.953+0000 7f26aec0c9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560aa3e70a50 con 0x560aa3f3a1f0 2024-09-10T05:37:40.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.953+0000 7f26ac712640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aa3f3a1f0 0x560aa3fc6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.953+0000 7f26ac712640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aa3f3a1f0 0x560aa3fc6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:58580/0 (socket says 172.21.15.62:58580) 2024-09-10T05:37:40.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.953+0000 7f26ac712640 1 -- 172.21.15.62:0/2879567535 learned_addr learned my addr 172.21.15.62:0/2879567535 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:40.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.957+0000 7f26ac712640 1 -- 172.21.15.62:0/2879567535 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560aa3fc6860 con 0x560aa3f3a1f0 2024-09-10T05:37:40.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.957+0000 7f26ac712640 1 --2- 172.21.15.62:0/2879567535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aa3f3a1f0 0x560aa3fc6300 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f269c001ec0 tx=0x7f269c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.957+0000 7f2598e09640 1 -- 172.21.15.62:0/2879567535 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f269c012030 con 0x560aa3f3a1f0 2024-09-10T05:37:40.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.957+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/2879567535 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560aa3fc4c40 con 0x560aa3f3a1f0 2024-09-10T05:37:40.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.957+0000 7f2598e09640 1 -- 172.21.15.62:0/2879567535 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f269c0014b0 con 0x560aa3f3a1f0 2024-09-10T05:37:40.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.957+0000 7f2598e09640 1 -- 172.21.15.62:0/2879567535 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f269c01a8d0 con 0x560aa3f3a1f0 2024-09-10T05:37:40.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.957+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/2879567535 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560aa3fc51d0 con 0x560aa3f3a1f0 2024-09-10T05:37:40.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.957+0000 7f2598e09640 1 -- 172.21.15.62:0/2879567535 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f269c015020 con 0x560aa3f3a1f0 2024-09-10T05:37:40.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.957+0000 7f2598e09640 1 --2- 172.21.15.62:0/2879567535 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2594039a70 0x7f259403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.957+0000 7f2598e09640 1 -- 172.21.15.62:0/2879567535 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7f269c020070 con 0x560aa3f3a1f0 2024-09-10T05:37:40.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.957+0000 7f26abf11640 1 --2- 172.21.15.62:0/2879567535 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2594039a70 0x7f259403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.957+0000 7f26aec0c9c0 1 --2- 172.21.15.62:0/2879567535 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560aa3fca340 0x560aa40c22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.957+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/2879567535 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa40c2830 con 0x560aa3fca340 2024-09-10T05:37:40.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.957+0000 7f26acf13640 1 --2- 172.21.15.62:0/2879567535 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560aa3fca340 0x560aa40c22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.957+0000 7f26abf11640 1 --2- 172.21.15.62:0/2879567535 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2594039a70 0x7f259403bf30 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f26a00ac000 tx=0x7f26a00a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.957+0000 7f26acf13640 1 --2- 172.21.15.62:0/2879567535 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560aa3fca340 0x560aa40c22f0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.957+0000 7f26acf13640 1 -- 172.21.15.62:0/2879567535 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa3fca340 2024-09-10T05:37:40.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.957+0000 7f26aec0c9c0 1 --2- 172.21.15.62:0/2879567535 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x560aa40c32a0 0x560aa40c5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.957+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/2879567535 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa40c5eb0 con 0x560aa40c32a0 2024-09-10T05:37:40.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.961+0000 7f26ac712640 1 --2- 172.21.15.62:0/2879567535 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x560aa40c32a0 0x560aa40c5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.961+0000 7f26ac712640 1 --2- 172.21.15.62:0/2879567535 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x560aa40c32a0 0x560aa40c5740 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.961+0000 7f26ac712640 1 -- 172.21.15.62:0/2879567535 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f269c008030 con 0x560aa40c32a0 2024-09-10T05:37:40.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.961+0000 7f26aec0c9c0 1 --2- 172.21.15.62:0/2879567535 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x560aa40c7c70 0x560aa40ca060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.961+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/2879567535 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa40ca750 con 0x560aa40c7c70 2024-09-10T05:37:40.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.961+0000 7f26abf11640 1 --2- 172.21.15.62:0/2879567535 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x560aa40c7c70 0x560aa40ca060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.961+0000 7f26abf11640 1 --2- 172.21.15.62:0/2879567535 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x560aa40c7c70 0x560aa40ca060 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.961+0000 7f26abf11640 1 -- 172.21.15.62:0/2879567535 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f26a00a8070 con 0x560aa40c7c70 2024-09-10T05:37:40.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.961+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/2879567535 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa40c6b10 con 0x560aa40c32a0 2024-09-10T05:37:40.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.961+0000 7f26ac712640 1 -- 172.21.15.62:0/2879567535 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f269c008030 con 0x560aa40c32a0 2024-09-10T05:37:40.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.961+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/2879567535 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa40c6f70 con 0x560aa40c7c70 2024-09-10T05:37:40.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.961+0000 7f26abf11640 1 -- 172.21.15.62:0/2879567535 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f26a00a8070 con 0x560aa40c7c70 2024-09-10T05:37:40.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.961+0000 7f26aec0c9c0 1 Processor -- start 2024-09-10T05:37:40.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.961+0000 7f26aec0c9c0 1 -- start start 2024-09-10T05:37:40.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.965+0000 7f26aec0c9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aa40d8d70 0x560aa40d9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.965+0000 7f26aec0c9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560aa3edb450 con 0x560aa40d8d70 2024-09-10T05:37:40.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.965+0000 7f26ac712640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aa40d8d70 0x560aa40d9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.965+0000 7f26ac712640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aa40d8d70 0x560aa40d9190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:58582/0 (socket says 172.21.15.62:58582) 2024-09-10T05:37:40.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.965+0000 7f26ac712640 1 -- 172.21.15.62:0/3863788354 learned_addr learned my addr 172.21.15.62:0/3863788354 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:40.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.965+0000 7f26ac712640 1 -- 172.21.15.62:0/3863788354 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560aa40d97d0 con 0x560aa40d8d70 2024-09-10T05:37:40.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.965+0000 7f26ac712640 1 --2- 172.21.15.62:0/3863788354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aa40d8d70 0x560aa40d9190 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f269c04ed70 tx=0x7f269c00d970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.965+0000 7f2591ffb640 1 -- 172.21.15.62:0/3863788354 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f269c01aba0 con 0x560aa40d8d70 2024-09-10T05:37:40.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.965+0000 7f2591ffb640 1 -- 172.21.15.62:0/3863788354 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f269c01ad40 con 0x560aa40d8d70 2024-09-10T05:37:40.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.965+0000 7f2591ffb640 1 -- 172.21.15.62:0/3863788354 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f269c04d4b0 con 0x560aa40d8d70 2024-09-10T05:37:40.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.965+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3863788354 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560aa40da030 con 0x560aa40d8d70 2024-09-10T05:37:40.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.965+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3863788354 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560aa40da030 con 0x560aa40d8d70 2024-09-10T05:37:40.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.965+0000 7f2591ffb640 1 -- 172.21.15.62:0/3863788354 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f269c009070 con 0x560aa40d8d70 2024-09-10T05:37:40.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.965+0000 7f2591ffb640 1 --2- 172.21.15.62:0/3863788354 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2584039a70 0x7f258403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.965+0000 7f2591ffb640 1 -- 172.21.15.62:0/3863788354 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7f269c047070 con 0x560aa40d8d70 2024-09-10T05:37:40.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.965+0000 7f26abf11640 1 --2- 172.21.15.62:0/3863788354 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2584039a70 0x7f258403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.965+0000 7f26aec0c9c0 1 Processor -- start 2024-09-10T05:37:40.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.965+0000 7f26aec0c9c0 1 -- start start 2024-09-10T05:37:40.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.965+0000 7f26abf11640 1 --2- 172.21.15.62:0/3863788354 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2584039a70 0x7f258403bf30 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x560aa3fc5c00 tx=0x7f26a0005a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.965+0000 7f26aec0c9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aa40e6350 0x560aa40e6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.965+0000 7f26aec0c9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560aa40b2040 con 0x560aa40e6350 2024-09-10T05:37:40.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.969+0000 7f26ac712640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aa40e6350 0x560aa40e6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.969+0000 7f26ac712640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aa40e6350 0x560aa40e6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:58592/0 (socket says 172.21.15.62:58592) 2024-09-10T05:37:40.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.969+0000 7f26ac712640 1 -- 172.21.15.62:0/2822618087 learned_addr learned my addr 172.21.15.62:0/2822618087 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:40.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.969+0000 7f26ac712640 1 -- 172.21.15.62:0/2822618087 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560aa40e6d40 con 0x560aa40e6350 2024-09-10T05:37:40.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.969+0000 7f26ac712640 1 --2- 172.21.15.62:0/2822618087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aa40e6350 0x560aa40e6750 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f269c02d7c0 tx=0x7f269c017940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7963e2e133fabe72 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.969+0000 7f25837fe640 1 -- 172.21.15.62:0/2822618087 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f269c057040 con 0x560aa40e6350 2024-09-10T05:37:40.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.969+0000 7f25837fe640 1 -- 172.21.15.62:0/2822618087 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f269c047790 con 0x560aa40e6350 2024-09-10T05:37:40.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.969+0000 7f25837fe640 1 -- 172.21.15.62:0/2822618087 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f269c040050 con 0x560aa40e6350 2024-09-10T05:37:40.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.969+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/2822618087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aa40e6350 msgr2=0x560aa40e6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:40.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.969+0000 7f26aec0c9c0 1 --2- 172.21.15.62:0/2822618087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aa40e6350 0x560aa40e6750 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f269c02d7c0 tx=0x7f269c017940 comp rx=0 tx=0).stop 2024-09-10T05:37:40.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.969+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/2822618087 shutdown_connections 2024-09-10T05:37:40.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.969+0000 7f26aec0c9c0 1 --2- 172.21.15.62:0/2822618087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aa40e6350 0x560aa40e6750 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:40.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.969+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/2822618087 >> 172.21.15.62:0/2822618087 conn(0x560aa40e1770 msgr2=0x560aa40df9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:40.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.969+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/2822618087 shutdown_connections 2024-09-10T05:37:40.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.969+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/2822618087 wait complete. 2024-09-10T05:37:40.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.969+0000 7f26aec0c9c0 1 Processor -- start 2024-09-10T05:37:40.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.969+0000 7f26aec0c9c0 1 -- start start 2024-09-10T05:37:40.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.969+0000 7f26aec0c9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aa40e6350 0x560aa40ec660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.969+0000 7f26aec0c9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560aa40e5120 con 0x560aa40e6350 2024-09-10T05:37:40.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.969+0000 7f26ac712640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aa40e6350 0x560aa40ec660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.969+0000 7f26ac712640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aa40e6350 0x560aa40ec660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:58600/0 (socket says 172.21.15.62:58600) 2024-09-10T05:37:40.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.969+0000 7f26ac712640 1 -- 172.21.15.62:0/3853331629 learned_addr learned my addr 172.21.15.62:0/3853331629 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:37:40.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.969+0000 7f26ac712640 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560aa40ecbc0 con 0x560aa40e6350 2024-09-10T05:37:40.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.973+0000 7f26ac712640 1 --2- 172.21.15.62:0/3853331629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aa40e6350 0x560aa40ec660 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f269c017980 tx=0x7f269c032f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.973+0000 7f2581ffb640 1 -- 172.21.15.62:0/3853331629 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f269c047790 con 0x560aa40e6350 2024-09-10T05:37:40.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.973+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560aa40ecbc0 con 0x560aa40e6350 2024-09-10T05:37:40.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.973+0000 7f2581ffb640 1 -- 172.21.15.62:0/3853331629 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f269c06b030 con 0x560aa40e6350 2024-09-10T05:37:40.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.973+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560aa40ecbc0 con 0x560aa40e6350 2024-09-10T05:37:40.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.973+0000 7f2581ffb640 1 -- 172.21.15.62:0/3853331629 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f269c075060 con 0x560aa40e6350 2024-09-10T05:37:40.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.973+0000 7f2581ffb640 1 -- 172.21.15.62:0/3853331629 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f269c047270 con 0x560aa40e6350 2024-09-10T05:37:40.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.973+0000 7f2581ffb640 1 --2- 172.21.15.62:0/3853331629 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2574039a20 0x7f257403bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.973+0000 7f2581ffb640 1 -- 172.21.15.62:0/3853331629 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5996+0+0 (secure 0 0 0) 0x7f269c005050 con 0x560aa40e6350 2024-09-10T05:37:40.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.973+0000 7f26abf11640 1 --2- 172.21.15.62:0/3853331629 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2574039a20 0x7f257403bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.973+0000 7f26aec0c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:40.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.973+0000 7f26aec0c9c0 1 --2- 172.21.15.62:0/3853331629 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560aa40f75f0 0x560aa40f9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.973+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa40fa200 con 0x560aa40f75f0 2024-09-10T05:37:40.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.973+0000 7f26acf13640 1 --2- 172.21.15.62:0/3853331629 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560aa40f75f0 0x560aa40f9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.973+0000 7f26abf11640 1 --2- 172.21.15.62:0/3853331629 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2574039a20 0x7f257403bee0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x560aa3fc5bd0 tx=0x7f26a00a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.973+0000 7f26acf13640 1 --2- 172.21.15.62:0/3853331629 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560aa40f75f0 0x560aa40f9ab0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.973+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:40.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.973+0000 7f26aec0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:40.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.973+0000 7f26aec0c9c0 20 realm 2024-09-10T05:37:40.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.973+0000 7f26aec0c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:40.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.973+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa40f6970 con 0x560aa40f75f0 2024-09-10T05:37:40.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.973+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:40.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.973+0000 7f26aec0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:40.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.973+0000 7f26aec0c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:37:40.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.973+0000 7f26aec0c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:40.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.973+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa40facd0 con 0x560aa40f75f0 2024-09-10T05:37:40.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.973+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:40.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.973+0000 7f26aec0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:40.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.973+0000 7f26aec0c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:40.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.973+0000 7f26aec0c9c0 1 --2- 172.21.15.62:0/3853331629 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x560aa40fbab0 0x560aa40fdea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.973+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa40fe530 con 0x560aa40fbab0 2024-09-10T05:37:40.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.977+0000 7f26ac712640 1 --2- 172.21.15.62:0/3853331629 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x560aa40fbab0 0x560aa40fdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.977+0000 7f26ac712640 1 --2- 172.21.15.62:0/3853331629 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x560aa40fbab0 0x560aa40fdea0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.977+0000 7f26ac712640 1 -- 172.21.15.62:0/3853331629 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f269c03d070 con 0x560aa40fbab0 2024-09-10T05:37:40.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.977+0000 7f26aec0c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:37:40.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.977+0000 7f26aec0c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:40.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.977+0000 7f26aec0c9c0 1 --2- 172.21.15.62:0/3853331629 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x560aa40ff290 0x560aa4101680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.977+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa4101e10 con 0x560aa40ff290 2024-09-10T05:37:40.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.977+0000 7f26abf11640 1 --2- 172.21.15.62:0/3853331629 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x560aa40ff290 0x560aa4101680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.977+0000 7f26abf11640 1 --2- 172.21.15.62:0/3853331629 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x560aa40ff290 0x560aa4101680 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.977+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f26a00a8070 con 0x560aa40ff290 2024-09-10T05:37:40.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.977+0000 7f26aec0c9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:37:40.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.977+0000 7f26aec0c9c0 20 searching for the correct realm 2024-09-10T05:37:40.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.977+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560aa41036e0 con 0x560aa40ff290 2024-09-10T05:37:40.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.977+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26a00a8070 con 0x560aa40ff290 2024-09-10T05:37:40.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.977+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560aa41036e0 con 0x560aa40fbab0 2024-09-10T05:37:40.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.977+0000 7f26ac712640 1 -- 172.21.15.62:0/3853331629 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f269c03d070 con 0x560aa40fbab0 2024-09-10T05:37:40.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.977+0000 7f26ac712640 1 --2- 172.21.15.62:0/3853331629 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f269c066050 0x7f269c03a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:37:40.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.977+0000 7f26ac712640 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560aa41036e0 con 0x7f269c066050 2024-09-10T05:37:40.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.977+0000 7f26acf13640 1 --2- 172.21.15.62:0/3853331629 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f269c066050 0x7f269c03a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:37:40.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.981+0000 7f26acf13640 1 --2- 172.21.15.62:0/3853331629 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f269c066050 0x7f269c03a7e0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:37:40.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.981+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26a400a4d0 con 0x7f269c066050 2024-09-10T05:37:40.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.981+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560aa41036e0 con 0x560aa40f75f0 2024-09-10T05:37:40.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.981+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:40.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.981+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560aa41036e0 con 0x560aa40f75f0 2024-09-10T05:37:40.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.981+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:40.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.981+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560aa41036e0 con 0x560aa40ff290 2024-09-10T05:37:40.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.981+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26a00a8070 con 0x560aa40ff290 2024-09-10T05:37:40.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.981+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560aa41036e0 con 0x560aa40f75f0 2024-09-10T05:37:40.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.981+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:40.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.981+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560aa41036e0 con 0x560aa40fbab0 2024-09-10T05:37:40.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.981+0000 7f26ac712640 1 -- 172.21.15.62:0/3853331629 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f269c03d070 con 0x560aa40fbab0 2024-09-10T05:37:40.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.981+0000 7f26ac712640 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560aa41036e0 con 0x560aa40fbab0 2024-09-10T05:37:40.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.981+0000 7f26ac712640 1 -- 172.21.15.62:0/3853331629 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f269c03d070 con 0x560aa40fbab0 2024-09-10T05:37:40.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.981+0000 7f26ac712640 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560aa41036e0 con 0x560aa40f75f0 2024-09-10T05:37:40.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.981+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:40.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.981+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560aa41036e0 con 0x7f269c066050 2024-09-10T05:37:40.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.981+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26a400a4d0 con 0x7f269c066050 2024-09-10T05:37:40.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.981+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560aa41036e0 con 0x560aa40f75f0 2024-09-10T05:37:40.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.985+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:40.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.985+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560aa41036e0 con 0x7f269c066050 2024-09-10T05:37:40.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.985+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f26a400a4d0 con 0x7f269c066050 2024-09-10T05:37:40.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.985+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560aa41036e0 con 0x560aa40fbab0 2024-09-10T05:37:40.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.985+0000 7f26ac712640 1 -- 172.21.15.62:0/3853331629 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f269c03d070 con 0x560aa40fbab0 2024-09-10T05:37:40.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.985+0000 7f26ac712640 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560aa41036e0 con 0x560aa40ff290 2024-09-10T05:37:40.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.985+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26a00a8070 con 0x560aa40ff290 2024-09-10T05:37:40.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.985+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560aa41036e0 con 0x560aa40f75f0 2024-09-10T05:37:40.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.985+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:40.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.985+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560aa41036e0 con 0x560aa40fbab0 2024-09-10T05:37:40.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.985+0000 7f26ac712640 1 -- 172.21.15.62:0/3853331629 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f269c03d070 con 0x560aa40fbab0 2024-09-10T05:37:40.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.985+0000 7f26ac712640 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560aa41036e0 con 0x560aa40ff290 2024-09-10T05:37:40.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.985+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 32 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f26a00a8070 con 0x560aa40ff290 2024-09-10T05:37:40.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.985+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560aa41036e0 con 0x560aa40f75f0 2024-09-10T05:37:40.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.985+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:40.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.985+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560aa41036e0 con 0x560aa40f75f0 2024-09-10T05:37:40.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.985+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:40.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.985+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560aa41036e0 con 0x560aa40f75f0 2024-09-10T05:37:40.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.985+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:40.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.985+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560aa41036e0 con 0x560aa40ff290 2024-09-10T05:37:40.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.989+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26a00a8070 con 0x560aa40ff290 2024-09-10T05:37:40.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.989+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560aa41036e0 con 0x7f269c066050 2024-09-10T05:37:40.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.989+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26a400a4d0 con 0x7f269c066050 2024-09-10T05:37:40.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.989+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560aa41036e0 con 0x560aa40f75f0 2024-09-10T05:37:40.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.989+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:40.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.989+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560aa41036e0 con 0x7f269c066050 2024-09-10T05:37:40.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.989+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26a400a4d0 con 0x7f269c066050 2024-09-10T05:37:40.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.989+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560aa41036e0 con 0x560aa40ff290 2024-09-10T05:37:40.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.989+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26a00a8070 con 0x560aa40ff290 2024-09-10T05:37:40.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.989+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560aa41036e0 con 0x7f269c066050 2024-09-10T05:37:40.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.989+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26a400a4d0 con 0x7f269c066050 2024-09-10T05:37:40.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.989+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560aa41036e0 con 0x560aa40fbab0 2024-09-10T05:37:40.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.989+0000 7f26ac712640 1 -- 172.21.15.62:0/3853331629 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f269c03d070 con 0x560aa40fbab0 2024-09-10T05:37:40.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.989+0000 7f26ac712640 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560aa41036e0 con 0x560aa40fbab0 2024-09-10T05:37:40.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.989+0000 7f26ac712640 1 -- 172.21.15.62:0/3853331629 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f269c03d070 con 0x560aa40fbab0 2024-09-10T05:37:40.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.989+0000 7f26ac712640 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560aa41036e0 con 0x560aa40ff290 2024-09-10T05:37:40.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.989+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26a00a8070 con 0x560aa40ff290 2024-09-10T05:37:40.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.989+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560aa41036e0 con 0x560aa40fbab0 2024-09-10T05:37:40.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.989+0000 7f26ac712640 1 -- 172.21.15.62:0/3853331629 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f269c03d070 con 0x560aa40fbab0 2024-09-10T05:37:40.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.993+0000 7f26ac712640 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560aa41036e0 con 0x560aa40fbab0 2024-09-10T05:37:40.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.993+0000 7f26ac712640 1 -- 172.21.15.62:0/3853331629 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f269c03d070 con 0x560aa40fbab0 2024-09-10T05:37:40.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.993+0000 7f26aec0c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:37:40.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.993+0000 7f26aec0c9c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:37:40.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.993+0000 7f26aec0c9c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:37:40.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.993+0000 7f26aec0c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:37:40.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.993+0000 7f26aec0c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:37:40.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.993+0000 7f26aec0c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:37:40.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.993+0000 7f26aec0c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:40.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.993+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa4102800 con 0x560aa40f75f0 2024-09-10T05:37:40.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.993+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:40.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.993+0000 7f26aec0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:40.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.993+0000 7f26aec0c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:40.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.993+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa41030a0 con 0x560aa40fbab0 2024-09-10T05:37:41.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.993+0000 7f26ac712640 1 -- 172.21.15.62:0/3853331629 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f269c03d070 con 0x560aa40fbab0 2024-09-10T05:37:41.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.993+0000 7f26aec0c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:37:41.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.993+0000 7f26aec0c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:41.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.993+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa4102440 con 0x560aa40ff290 2024-09-10T05:37:41.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.993+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f26a00a8070 con 0x560aa40ff290 2024-09-10T05:37:41.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.993+0000 7f26aec0c9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:37:41.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.993+0000 7f26aec0c9c0 20 zone default found 2024-09-10T05:37:41.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.993+0000 7f26aec0c9c0 4 Realm: () 2024-09-10T05:37:41.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.993+0000 7f26aec0c9c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:37:41.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.993+0000 7f26aec0c9c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:37:41.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.993+0000 7f26aec0c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:37:41.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.993+0000 7f26aec0c9c0 20 zonegroup default 2024-09-10T05:37:41.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.993+0000 7f26aec0c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:41.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.993+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa4103fc0 con 0x7f269c066050 2024-09-10T05:37:41.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.993+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f26a400a4d0 con 0x7f269c066050 2024-09-10T05:37:41.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.993+0000 7f26aec0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:41.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.993+0000 7f26aec0c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:41.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.993+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa4106200 con 0x560aa40ff290 2024-09-10T05:37:41.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.993+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f26a00a8070 con 0x560aa40ff290 2024-09-10T05:37:41.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.993+0000 7f26aec0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:41.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.993+0000 7f26aec0c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:41.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.993+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa41065a0 con 0x560aa40ff290 2024-09-10T05:37:41.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.993+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f26a00a8070 con 0x560aa40ff290 2024-09-10T05:37:41.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.993+0000 7f26aec0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:41.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.993+0000 7f26aec0c9c0 20 started sync module instance, tier type = 2024-09-10T05:37:41.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.993+0000 7f26aec0c9c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:37:41.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.993+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa4105690 con 0x560aa40fbab0 2024-09-10T05:37:41.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.997+0000 7f26ac712640 1 -- 172.21.15.62:0/3853331629 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f269c03d070 con 0x560aa40fbab0 2024-09-10T05:37:41.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.997+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94603702197136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa4105690 con 0x560aa40fbab0 2024-09-10T05:37:41.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.997+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa4106fb0 con 0x560aa40f75f0 2024-09-10T05:37:41.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.997+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:41.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.997+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94603702201088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa4107850 con 0x560aa40f75f0 2024-09-10T05:37:41.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.997+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa4108250 con 0x560aa40fbab0 2024-09-10T05:37:41.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:40.997+0000 7f26ac712640 1 -- 172.21.15.62:0/3853331629 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94603702197136] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f269c03d070 con 0x560aa40fbab0 2024-09-10T05:37:41.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.001+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94603702201088] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:41.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.001+0000 7f26ac712640 1 -- 172.21.15.62:0/3853331629 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f269c03d070 con 0x560aa40fbab0 2024-09-10T05:37:41.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.001+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94603702194656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa41073a0 con 0x560aa40fbab0 2024-09-10T05:37:41.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.001+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa4108af0 con 0x7f269c066050 2024-09-10T05:37:41.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.001+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26a400a4d0 con 0x7f269c066050 2024-09-10T05:37:41.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.001+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94603702208064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa41073a0 con 0x7f269c066050 2024-09-10T05:37:41.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.001+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa41095a0 con 0x560aa40fbab0 2024-09-10T05:37:41.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.001+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94603702208064] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26a400a4d0 con 0x7f269c066050 2024-09-10T05:37:41.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.005+0000 7f26ac712640 1 -- 172.21.15.62:0/3853331629 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94603702194656] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f269c03d070 con 0x560aa40fbab0 2024-09-10T05:37:41.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.005+0000 7f26ac712640 1 -- 172.21.15.62:0/3853331629 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f269c03d070 con 0x560aa40fbab0 2024-09-10T05:37:41.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.005+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94603702205792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa41090b0 con 0x560aa40fbab0 2024-09-10T05:37:41.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.005+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa4109e70 con 0x560aa40ff290 2024-09-10T05:37:41.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.005+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26a00a8070 con 0x560aa40ff290 2024-09-10T05:37:41.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.005+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94603702213056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa41090b0 con 0x560aa40ff290 2024-09-10T05:37:41.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.005+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa410a8b0 con 0x560aa40ff290 2024-09-10T05:37:41.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.005+0000 7f26ac712640 1 -- 172.21.15.62:0/3853331629 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94603702205792] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f269c03d070 con 0x560aa40fbab0 2024-09-10T05:37:41.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.005+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(56 notify.6 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26a00a8070 con 0x560aa40ff290 2024-09-10T05:37:41.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.005+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94603702209120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa410a8b0 con 0x560aa40ff290 2024-09-10T05:37:41.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.005+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa410b2c0 con 0x7f269c066050 2024-09-10T05:37:41.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.009+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94603702213056] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26a00a8070 con 0x560aa40ff290 2024-09-10T05:37:41.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.009+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26a400a4d0 con 0x7f269c066050 2024-09-10T05:37:41.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.009+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94603702214112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa410b2c0 con 0x7f269c066050 2024-09-10T05:37:41.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.009+0000 7f26aec0c9c0 20 add_watcher() i=0 2024-09-10T05:37:41.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.009+0000 7f26aec0c9c0 20 add_watcher() i=1 2024-09-10T05:37:41.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.009+0000 7f26aec0c9c0 20 add_watcher() i=2 2024-09-10T05:37:41.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.009+0000 7f26aec0c9c0 20 add_watcher() i=3 2024-09-10T05:37:41.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.009+0000 7f26aec0c9c0 20 add_watcher() i=4 2024-09-10T05:37:41.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.009+0000 7f26aec0c9c0 20 add_watcher() i=5 2024-09-10T05:37:41.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.009+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94603702209120] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26a00a8070 con 0x560aa40ff290 2024-09-10T05:37:41.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.009+0000 7f26aec0c9c0 20 add_watcher() i=6 2024-09-10T05:37:41.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.009+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94603702214112] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26a400a4d0 con 0x7f269c066050 2024-09-10T05:37:41.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.009+0000 7f26aec0c9c0 20 add_watcher() i=7 2024-09-10T05:37:41.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.009+0000 7f26aec0c9c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:37:41.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.009+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa410a400 con 0x560aa40f75f0 2024-09-10T05:37:41.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.009+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:41.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.009+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94603702218256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa410a400 con 0x560aa40f75f0 2024-09-10T05:37:41.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.013+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94603702218256] v32'229 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:41.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.013+0000 7f25627e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:37:41.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.013+0000 7f26aec0c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:37:41.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.013+0000 7f26aec0c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:37:41.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.013+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa4116b90 con 0x560aa40fbab0 2024-09-10T05:37:41.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.017+0000 7f26ac712640 1 -- 172.21.15.62:0/3853331629 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'57 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f269c03d070 con 0x560aa40fbab0 2024-09-10T05:37:41.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.017+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa4116c80 con 0x7f269c066050 2024-09-10T05:37:41.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.017+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f26a400a4d0 con 0x7f269c066050 2024-09-10T05:37:41.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.017+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa4117320 con 0x560aa40ff290 2024-09-10T05:37:41.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.017+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f26a00a8070 con 0x560aa40ff290 2024-09-10T05:37:41.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.017+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa41177d0 con 0x560aa40f75f0 2024-09-10T05:37:41.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.021+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'230 uv172 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:41.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.021+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa4116200 con 0x560aa40fbab0 2024-09-10T05:37:41.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.021+0000 7f26ac712640 1 -- 172.21.15.62:0/3853331629 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'77 uv61 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f269c03d070 con 0x560aa40fbab0 2024-09-10T05:37:41.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.025+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa4116200 con 0x560aa40ff290 2024-09-10T05:37:41.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.025+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'59 uv48 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f26a00a8070 con 0x560aa40ff290 2024-09-10T05:37:41.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.025+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa4116200 con 0x560aa40fbab0 2024-09-10T05:37:41.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.025+0000 7f26ac712640 1 -- 172.21.15.62:0/3853331629 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'38 uv31 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f269c03d070 con 0x560aa40fbab0 2024-09-10T05:37:41.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.025+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa4116200 con 0x560aa40f75f0 2024-09-10T05:37:41.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.029+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'53 uv42 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:41.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.029+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa4118500 con 0x560aa40fbab0 2024-09-10T05:37:41.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.033+0000 7f26ac712640 1 -- 172.21.15.62:0/3853331629 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f269c03d070 con 0x560aa40fbab0 2024-09-10T05:37:41.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.033+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa4118500 con 0x560aa40fbab0 2024-09-10T05:37:41.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.033+0000 7f26ac712640 1 -- 172.21.15.62:0/3853331629 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f269c03d070 con 0x560aa40fbab0 2024-09-10T05:37:41.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.033+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa4118500 con 0x560aa40fbab0 2024-09-10T05:37:41.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.037+0000 7f26ac712640 1 -- 172.21.15.62:0/3853331629 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'78 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f269c03d070 con 0x560aa40fbab0 2024-09-10T05:37:41.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.037+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa4118500 con 0x560aa40ff290 2024-09-10T05:37:41.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.037+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'32 uv25 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f26a00a8070 con 0x560aa40ff290 2024-09-10T05:37:41.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.037+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa41189b0 con 0x560aa40fbab0 2024-09-10T05:37:41.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.041+0000 7f26ac712640 1 -- 172.21.15.62:0/3853331629 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f269c03d070 con 0x560aa40fbab0 2024-09-10T05:37:41.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.041+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa41189b0 con 0x560aa40f75f0 2024-09-10T05:37:41.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.041+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'65 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:41.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.041+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa4118d70 con 0x560aa40f75f0 2024-09-10T05:37:41.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.045+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'231 uv168 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:41.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.045+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa4118d30 con 0x560aa40fbab0 2024-09-10T05:37:41.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.045+0000 7f26ac712640 1 -- 172.21.15.62:0/3853331629 <== osd.0 v2:172.21.15.2:6800/945139080 25 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'72 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f269c03d070 con 0x560aa40fbab0 2024-09-10T05:37:41.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.045+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa4118b70 con 0x560aa40fbab0 2024-09-10T05:37:41.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.049+0000 7f26ac712640 1 -- 172.21.15.62:0/3853331629 <== osd.0 v2:172.21.15.2:6800/945139080 26 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'79 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f269c03d070 con 0x560aa40fbab0 2024-09-10T05:37:41.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.049+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa4118b70 con 0x560aa40ff290 2024-09-10T05:37:41.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.049+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 <== osd.3 v2:172.21.15.62:6816/2708991149 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'39 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f26a00a8070 con 0x560aa40ff290 2024-09-10T05:37:41.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.049+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa4118c70 con 0x560aa40fbab0 2024-09-10T05:37:41.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.053+0000 7f26ac712640 1 -- 172.21.15.62:0/3853331629 <== osd.0 v2:172.21.15.2:6800/945139080 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f269c03d070 con 0x560aa40fbab0 2024-09-10T05:37:41.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.053+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa4118c70 con 0x560aa40f75f0 2024-09-10T05:37:41.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.053+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'232 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:41.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.053+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa4118c70 con 0x560aa40fbab0 2024-09-10T05:37:41.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.057+0000 7f26ac712640 1 -- 172.21.15.62:0/3853331629 <== osd.0 v2:172.21.15.2:6800/945139080 28 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'73 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f269c03d070 con 0x560aa40fbab0 2024-09-10T05:37:41.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.057+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa4118c70 con 0x7f269c066050 2024-09-10T05:37:41.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.061+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'44 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f26a400a4d0 con 0x7f269c066050 2024-09-10T05:37:41.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.061+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa4118c70 con 0x560aa40ff290 2024-09-10T05:37:41.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.061+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 <== osd.3 v2:172.21.15.62:6816/2708991149 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f26a00a8070 con 0x560aa40ff290 2024-09-10T05:37:41.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.061+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa4118c70 con 0x560aa40fbab0 2024-09-10T05:37:41.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.065+0000 7f26ac712640 1 -- 172.21.15.62:0/3853331629 <== osd.0 v2:172.21.15.2:6800/945139080 29 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'46 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f269c03d070 con 0x560aa40fbab0 2024-09-10T05:37:41.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.065+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa4118c70 con 0x560aa40ff290 2024-09-10T05:37:41.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.065+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 <== osd.3 v2:172.21.15.62:6816/2708991149 21 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f26a00a8070 con 0x560aa40ff290 2024-09-10T05:37:41.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.065+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa4118c70 con 0x560aa40ff290 2024-09-10T05:37:41.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.065+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 <== osd.3 v2:172.21.15.62:6816/2708991149 22 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'60 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f26a00a8070 con 0x560aa40ff290 2024-09-10T05:37:41.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.065+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa4118c70 con 0x560aa40ff290 2024-09-10T05:37:41.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.069+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 <== osd.3 v2:172.21.15.62:6816/2708991149 23 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f26a00a8070 con 0x560aa40ff290 2024-09-10T05:37:41.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.069+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa4118cf0 con 0x560aa40fbab0 2024-09-10T05:37:41.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.073+0000 7f26ac712640 1 -- 172.21.15.62:0/3853331629 <== osd.0 v2:172.21.15.2:6800/945139080 30 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'41 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f269c03d070 con 0x560aa40fbab0 2024-09-10T05:37:41.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.073+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa4118cb0 con 0x560aa40f75f0 2024-09-10T05:37:41.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.073+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'54 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:41.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.073+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa4118cf0 con 0x560aa40fbab0 2024-09-10T05:37:41.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.077+0000 7f26ac712640 1 -- 172.21.15.62:0/3853331629 <== osd.0 v2:172.21.15.2:6800/945139080 31 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'74 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f269c03d070 con 0x560aa40fbab0 2024-09-10T05:37:41.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.077+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa4118cb0 con 0x560aa40f75f0 2024-09-10T05:37:41.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.081+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'66 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:41.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.081+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa4118d30 con 0x7f269c066050 2024-09-10T05:37:41.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.081+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f26a400a4d0 con 0x7f269c066050 2024-09-10T05:37:41.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.081+0000 7f25617e2640 20 reqs_thread_entry: start 2024-09-10T05:37:41.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.081+0000 7f26aec0c9c0 20 init_complete bucket index max shards: 11 2024-09-10T05:37:41.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.081+0000 7f26aec0c9c0 20 Filter name: none 2024-09-10T05:37:41.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.081+0000 7f24d2ffd640 20 reqs_thread_entry: start 2024-09-10T05:37:41.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.081+0000 7f26aec0c9c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-10T05:37:41.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.081+0000 7f26aec0c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:41.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.081+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa41153e0 con 0x7f269c066050 2024-09-10T05:37:41.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.081+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.2 v2:172.21.15.62:6800/2677868286 15 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f26a400a4d0 con 0x7f269c066050 2024-09-10T05:37:41.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.081+0000 7f26aec0c9c0 20 rados_obj.operate() r=0 bl.length=380 2024-09-10T05:37:41.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.081+0000 7f26aec0c9c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-10T05:37:41.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.081+0000 7f26aec0c9c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T05:37:41.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.081+0000 7f26aec0c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:37:41.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.081+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa4114fc0 con 0x560aa40f75f0 2024-09-10T05:37:41.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.085+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 26 ==== osd_op_reply(95 fud.buckets [call out=186b] v0'0 uv5 ondisk = 0) ==== 155+0+186 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:41.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.085+0000 7f26aec0c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10 : miss 2024-09-10T05:37:41.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.085+0000 7f26aec0c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:41.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.085+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:96 8.1e 8:7cbbc9c7:root::.bucket.meta.myfoo7%3a475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa41364c0 con 0x560aa40ff290 2024-09-10T05:37:41.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.085+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 <== osd.3 v2:172.21.15.62:6816/2708991149 24 ==== osd_op_reply(96 .bucket.meta.myfoo7:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10 [call out=48b,stat out=16b,read 0~390 out=390b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 334+0+672 (crc 0 0 0) 0x7f26a00a8070 con 0x560aa40ff290 2024-09-10T05:37:41.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.085+0000 7f26aec0c9c0 20 rados_obj.operate() r=0 bl.length=390 2024-09-10T05:37:41.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.085+0000 7f26aec0c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10 info.flags=0x17 2024-09-10T05:37:41.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.085+0000 7f26aec0c9c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10 to cache LRU end 2024-09-10T05:37:41.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.085+0000 7f26aec0c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:37:41.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.085+0000 7f26aec0c9c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T05:37:41.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.085+0000 7f26aec0c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10 2024-09-10T05:37:41.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.085+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:97 4.3f 4:fcc9e7b2:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa41b3d70 con 0x7f269c066050 2024-09-10T05:37:41.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.085+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.2 v2:172.21.15.62:6800/2677868286 16 ==== osd_op_reply(97 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f26a400a4d0 con 0x7f269c066050 2024-09-10T05:37:41.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.085+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:98 4.36 4:6f96b8d0:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa41b3d70 con 0x560aa40f75f0 2024-09-10T05:37:41.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.085+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 27 ==== osd_op_reply(98 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.1 [call out=89b] v0'0 uv6 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:41.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.085+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:99 4.0 4:019d1eae:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa41b3d70 con 0x560aa40ff290 2024-09-10T05:37:41.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.085+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 <== osd.3 v2:172.21.15.62:6816/2708991149 25 ==== osd_op_reply(99 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.2 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f26a00a8070 con 0x560aa40ff290 2024-09-10T05:37:41.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.085+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:100 4.24 4:24885f7e:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa41b3d70 con 0x560aa40f75f0 2024-09-10T05:37:41.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.085+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 28 ==== osd_op_reply(100 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.3 [call out=89b] v0'0 uv13 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:41.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.085+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:101 4.15 4:a984c9bd:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa41b3d70 con 0x560aa40ff290 2024-09-10T05:37:41.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.089+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 <== osd.3 v2:172.21.15.62:6816/2708991149 26 ==== osd_op_reply(101 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.4 [call out=89b] v0'0 uv4 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f26a00a8070 con 0x560aa40ff290 2024-09-10T05:37:41.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.089+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:102 4.2c 4:3510c786:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa41b3d70 con 0x560aa40f75f0 2024-09-10T05:37:41.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.089+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 29 ==== osd_op_reply(102 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.5 [call out=381b] v0'0 uv5 ondisk = 0) ==== 195+0+381 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:41.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.089+0000 7f26aec0c9c0 10 cls_bucket_list_unordered: got fourteen 2024-09-10T05:37:41.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.089+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:103 4.1e 4:7a0c7961:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa41b3d70 con 0x560aa40f75f0 2024-09-10T05:37:41.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.089+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 30 ==== osd_op_reply(103 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:41.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.089+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:104 4.2d 4:b7d0c0ee:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa41b3d70 con 0x7f269c066050 2024-09-10T05:37:41.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.089+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.2 v2:172.21.15.62:6800/2677868286 17 ==== osd_op_reply(104 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f26a400a4d0 con 0x7f269c066050 2024-09-10T05:37:41.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.089+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:105 4.36 4:6c9ffb92:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa41b3d70 con 0x560aa40f75f0 2024-09-10T05:37:41.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.089+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 31 ==== osd_op_reply(105 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.8 [call out=89b] v0'0 uv7 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:41.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.089+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:106 4.3a 4:5da2850d:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa41b3d70 con 0x560aa40ff290 2024-09-10T05:37:41.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.089+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 <== osd.3 v2:172.21.15.62:6816/2708991149 27 ==== osd_op_reply(106 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.9 [call out=89b] v0'0 uv4 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f26a00a8070 con 0x560aa40ff290 2024-09-10T05:37:41.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.089+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:107 4.1b 4:d890202d:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa41b3d70 con 0x7f269c066050 2024-09-10T05:37:41.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.089+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.2 v2:172.21.15.62:6800/2677868286 18 ==== osd_op_reply(107 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.10 [call out=89b] v0'0 uv7 ondisk = 0) ==== 196+0+89 (crc 0 0 0) 0x7f26a400a4d0 con 0x7f269c066050 2024-09-10T05:37:41.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.089+0000 7f26aec0c9c0 20 get_obj_state: octx=0x7f26a400ab40 obj=myfoo7:fourteen state=0x560aa41b2168 s->prefetch_data=0 2024-09-10T05:37:41.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.089+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:108 3.26 3:66b4ddbb:::475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10_fourteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa41b2f90 con 0x7f269c066050 2024-09-10T05:37:41.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.089+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.2 v2:172.21.15.62:6800/2677868286 19 ==== osd_op_reply(108 475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10_fourteen [getxattrs out=856b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 239+0+872 (crc 0 0 0) 0x7f26a400a4d0 con 0x7f269c066050 2024-09-10T05:37:41.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.089+0000 7f26aec0c9c0 10 manifest: total_size = 8 2024-09-10T05:37:41.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.089+0000 7f26aec0c9c0 20 get_obj_state: setting s->obj_tag to 475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.5666483844819199708 2024-09-10T05:37:41.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.089+0000 7f26aec0c9c0 20 get_obj_state: octx=0x7f26a400ab40 obj=myfoo7:fourteen state=0x560aa41b2168 s->prefetch_data=0 2024-09-10T05:37:41.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.089+0000 7f26aec0c9c0 20 prepare_atomic_modification: state is not atomic. state=0x560aa41b2168 2024-09-10T05:37:41.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.089+0000 7f26aec0c9c0 20 bucket index object: :.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.5 2024-09-10T05:37:41.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.093+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:109 4.2c 4:3510c786:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=188b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa41b3a80 con 0x560aa40f75f0 2024-09-10T05:37:41.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.093+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 32 ==== osd_op_reply(109 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.5 [stat,call,call] v32'6 uv6 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:41.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.093+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:110 3.26 3:66b4ddbb:::475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa41b3a80 con 0x7f269c066050 2024-09-10T05:37:41.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.097+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.2 v2:172.21.15.62:6800/2677868286 20 ==== osd_op_reply(110 475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10_fourteen [call] v32'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7f26a400a4d0 con 0x7f269c066050 2024-09-10T05:37:41.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.097+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:111 4.2c 4:3510c786:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=265b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa413b620 con 0x560aa40f75f0 2024-09-10T05:37:41.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.097+0000 7f26aec0c9c0 20 list_objects_ordered: starting attempt 1 2024-09-10T05:37:41.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.097+0000 7f26aec0c9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-10T05:37:41.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.097+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:112 4.3f 4:fcc9e7b2:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa413b620 con 0x7f269c066050 2024-09-10T05:37:41.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.097+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:113 4.36 4:6f96b8d0:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa413f790 con 0x560aa40f75f0 2024-09-10T05:37:41.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.097+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:114 4.0 4:019d1eae:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa413b620 con 0x560aa40ff290 2024-09-10T05:37:41.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.097+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:115 4.24 4:24885f7e:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa4144550 con 0x560aa40f75f0 2024-09-10T05:37:41.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.097+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:116 4.15 4:a984c9bd:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa413b620 con 0x560aa40ff290 2024-09-10T05:37:41.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.097+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.2 v2:172.21.15.62:6800/2677868286 21 ==== osd_op_reply(112 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f26a400a4d0 con 0x7f269c066050 2024-09-10T05:37:41.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.097+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 <== osd.3 v2:172.21.15.62:6816/2708991149 28 ==== osd_op_reply(114 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.2 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f26a00f3070 con 0x560aa40ff290 2024-09-10T05:37:41.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.097+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:117 4.2c 4:3510c786:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa413b620 con 0x560aa40f75f0 2024-09-10T05:37:41.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.097+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:118 4.1e 4:7a0c7961:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa4147380 con 0x560aa40f75f0 2024-09-10T05:37:41.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.097+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:119 4.2d 4:b7d0c0ee:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa414a1d0 con 0x7f269c066050 2024-09-10T05:37:41.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.097+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:120 4.36 4:6c9ffb92:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa414d000 con 0x560aa40f75f0 2024-09-10T05:37:41.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.097+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:121 4.3a 4:5da2850d:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa414fe80 con 0x560aa40ff290 2024-09-10T05:37:41.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.097+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:122 4.1b 4:d890202d:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa4152cb0 con 0x7f269c066050 2024-09-10T05:37:41.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.097+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 <== osd.3 v2:172.21.15.62:6816/2708991149 29 ==== osd_op_reply(116 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.4 [call out=89b] v0'0 uv4 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f26a00f3070 con 0x560aa40ff290 2024-09-10T05:37:41.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.097+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 33 ==== osd_op_reply(115 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.3 [call out=89b] v0'0 uv13 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:41.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.097+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 34 ==== osd_op_reply(113 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.1 [call out=89b] v0'0 uv6 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:41.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.097+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 <== osd.3 v2:172.21.15.62:6816/2708991149 30 ==== osd_op_reply(121 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.9 [call out=89b] v0'0 uv4 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f26a00f3070 con 0x560aa40ff290 2024-09-10T05:37:41.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.097+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.2 v2:172.21.15.62:6800/2677868286 22 ==== osd_op_reply(119 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f26a400a4d0 con 0x7f269c066050 2024-09-10T05:37:41.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.097+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.2 v2:172.21.15.62:6800/2677868286 23 ==== osd_op_reply(122 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.10 [call out=89b] v0'0 uv7 ondisk = 0) ==== 196+0+89 (crc 0 0 0) 0x7f26a400a4d0 con 0x7f269c066050 2024-09-10T05:37:41.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.097+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 35 ==== osd_op_reply(120 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.8 [call out=89b] v0'0 uv7 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:41.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.097+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 36 ==== osd_op_reply(111 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.5 [stat,call,call] v32'7 uv7 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:41.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.097+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 37 ==== osd_op_reply(118 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:41.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.097+0000 7f2582ffd640 20 handle_completion(): completion ok for obj=fourteen 2024-09-10T05:37:41.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.101+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 38 ==== osd_op_reply(117 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.5 [call out=128b] v0'0 uv7 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:41.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.101+0000 7f26aec0c9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-10T05:37:41.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.101+0000 7f26aec0c9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-10T05:37:41.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.101+0000 7f26aec0c9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-10T05:37:41.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.101+0000 7f26aec0c9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-10T05:37:41.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.101+0000 7f26aec0c9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10])"; uploads.size()=0; is_truncated=0 2024-09-10T05:37:41.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.101+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:123 4.3f 4:fcc9e7b2:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa414a1d0 con 0x7f269c066050 2024-09-10T05:37:41.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.101+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:124 4.36 4:6f96b8d0:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa4147380 con 0x560aa40f75f0 2024-09-10T05:37:41.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.101+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:125 4.0 4:019d1eae:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa41459d0 con 0x560aa40ff290 2024-09-10T05:37:41.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.101+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:126 4.24 4:24885f7e:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa414a1d0 con 0x560aa40f75f0 2024-09-10T05:37:41.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.101+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:127 4.15 4:a984c9bd:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa4152820 con 0x560aa40ff290 2024-09-10T05:37:41.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.101+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:128 4.2c 4:3510c786:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa41459d0 con 0x560aa40f75f0 2024-09-10T05:37:41.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.101+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:129 4.1e 4:7a0c7961:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa4147380 con 0x560aa40f75f0 2024-09-10T05:37:41.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.101+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:130 4.2d 4:b7d0c0ee:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa414d020 con 0x7f269c066050 2024-09-10T05:37:41.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.101+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:131 4.36 4:6c9ffb92:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa4152c40 con 0x560aa40f75f0 2024-09-10T05:37:41.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.101+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:132 4.3a 4:5da2850d:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa4139150 con 0x560aa40ff290 2024-09-10T05:37:41.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.101+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:133 4.1b 4:d890202d:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa41531a0 con 0x7f269c066050 2024-09-10T05:37:41.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.101+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 <== osd.3 v2:172.21.15.62:6816/2708991149 31 ==== osd_op_reply(125 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.2 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f26a00f3070 con 0x560aa40ff290 2024-09-10T05:37:41.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.101+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.2 v2:172.21.15.62:6800/2677868286 24 ==== osd_op_reply(123 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f26a400a4d0 con 0x7f269c066050 2024-09-10T05:37:41.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.101+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.2 v2:172.21.15.62:6800/2677868286 25 ==== osd_op_reply(130 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f26a400a4d0 con 0x7f269c066050 2024-09-10T05:37:41.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.101+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.2 v2:172.21.15.62:6800/2677868286 26 ==== osd_op_reply(133 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.10 [call out=89b] v0'0 uv7 ondisk = 0) ==== 196+0+89 (crc 0 0 0) 0x7f26a400a4d0 con 0x7f269c066050 2024-09-10T05:37:41.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.101+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 39 ==== osd_op_reply(124 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.1 [call out=89b] v0'0 uv6 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:41.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.101+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 40 ==== osd_op_reply(126 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.3 [call out=89b] v0'0 uv13 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:41.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.101+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 41 ==== osd_op_reply(129 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:41.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.101+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 42 ==== osd_op_reply(128 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.5 [call out=128b] v0'0 uv7 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:41.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.101+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 43 ==== osd_op_reply(131 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.8 [call out=89b] v0'0 uv7 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:41.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.101+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 <== osd.3 v2:172.21.15.62:6816/2708991149 32 ==== osd_op_reply(127 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.4 [call out=89b] v0'0 uv4 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f26a00f3070 con 0x560aa40ff290 2024-09-10T05:37:41.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.101+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 <== osd.3 v2:172.21.15.62:6816/2708991149 33 ==== osd_op_reply(132 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.9 [call out=89b] v0'0 uv4 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f26a00f3070 con 0x560aa40ff290 2024-09-10T05:37:41.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.101+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:134 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa41b3c20 con 0x560aa40f75f0 2024-09-10T05:37:41.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.101+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 44 ==== osd_op_reply(134 fud.buckets [call] v32'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:41.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.101+0000 7f26aec0c9c0 10 cache get: name=default.rgw.meta+root+myfoo7 : miss 2024-09-10T05:37:41.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.101+0000 7f26aec0c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:41.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.101+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:135 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa41b3c20 con 0x7f269c066050 2024-09-10T05:37:41.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.105+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.2 v2:172.21.15.62:6800/2677868286 27 ==== osd_op_reply(135 myfoo7 [call out=48b,read 0~168 out=168b] v0'0 uv44 ondisk = 0) ==== 192+0+216 (crc 0 0 0) 0x7f26a400a4d0 con 0x7f269c066050 2024-09-10T05:37:41.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.105+0000 7f26aec0c9c0 20 rados_obj.operate() r=0 bl.length=168 2024-09-10T05:37:41.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.105+0000 7f26aec0c9c0 10 cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x11 2024-09-10T05:37:41.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.105+0000 7f26aec0c9c0 10 adding default.rgw.meta+root+myfoo7 to cache LRU end 2024-09-10T05:37:41.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.105+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:136 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa41b3c20 con 0x7f269c066050 2024-09-10T05:37:41.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.105+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.2 v2:172.21.15.62:6800/2677868286 28 ==== osd_op_reply(136 myfoo7 [call,call,delete] v32'45 uv45 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f26a400a4d0 con 0x7f269c066050 2024-09-10T05:37:41.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.105+0000 7f26aec0c9c0 10 removing default.rgw.meta+root+myfoo7 from cache 2024-09-10T05:37:41.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.105+0000 7f26aec0c9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2024-09-10T05:37:41.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.105+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94603702514080 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa41b3c20 con 0x7f269c066050 2024-09-10T05:37:41.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.105+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.2 v2:172.21.15.62:6800/2677868286 29 ==== watch-notify(notify (1) cookie 94603702208064 notify 137438953488 ret 0) ==== 192+0+0 (crc 0 0 0) 0x560aa4115d50 con 0x7f269c066050 2024-09-10T05:37:41.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.105+0000 7f25837fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953488 cookie 94603702208064 notifier 4759 bl.length()=150 2024-09-10T05:37:41.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.105+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.2 v2:172.21.15.62:6800/2677868286 30 ==== osd_op_reply(137 notify.3 [notify cookie 94603702514080 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f26a400a4d0 con 0x7f269c066050 2024-09-10T05:37:41.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.105+0000 7f25837fe640 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f2570003d70 con 0x7f269c066050 2024-09-10T05:37:41.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.105+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.2 v2:172.21.15.62:6800/2677868286 31 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26a400a4d0 con 0x7f269c066050 2024-09-10T05:37:41.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.105+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.2 v2:172.21.15.62:6800/2677868286 32 ==== watch-notify(notify_complete (2) cookie 94603702514080 notify 137438953488 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560aa4118330 con 0x7f269c066050 2024-09-10T05:37:41.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.105+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:139 8.1e 8:7cbbc9c7:root::.bucket.meta.myfoo7%3a475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa41b3c20 con 0x560aa40ff290 2024-09-10T05:37:41.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.109+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 <== osd.3 v2:172.21.15.62:6816/2708991149 34 ==== osd_op_reply(139 .bucket.meta.myfoo7:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10 [call,call,delete] v32'2 uv2 ondisk = 0) ==== 292+0+0 (crc 0 0 0) 0x7f26a00f3070 con 0x560aa40ff290 2024-09-10T05:37:41.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.109+0000 7f26aec0c9c0 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10 from cache 2024-09-10T05:37:41.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.109+0000 7f26aec0c9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10, ofs0, ns] 2024-09-10T05:37:41.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.109+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:140 7.0 7:05bf5b68:::notify.1:head [notify cookie 94603702514080 in=220b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa41b3c20 con 0x560aa40f75f0 2024-09-10T05:37:41.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.109+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 45 ==== watch-notify(notify (1) cookie 94603702201088 notify 137438953473 ret 0) ==== 250+0+0 (crc 0 0 0) 0x560aa4118330 con 0x560aa40f75f0 2024-09-10T05:37:41.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.109+0000 7f25837fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953473 cookie 94603702201088 notifier 4759 bl.length()=208 2024-09-10T05:37:41.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.109+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 46 ==== osd_op_reply(140 notify.1 [notify cookie 94603702514080 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:41.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.109+0000 7f25837fe640 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:141 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f2570003d70 con 0x560aa40f75f0 2024-09-10T05:37:41.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.109+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 47 ==== watch-notify(notify_complete (2) cookie 94603702514080 notify 137438953473 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560aa4115b80 con 0x560aa40f75f0 2024-09-10T05:37:41.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.109+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 48 ==== osd_op_reply(141 notify.1 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:41.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.109+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:142 4.3f 4:fcc9e7b2:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa41b3c20 con 0x7f269c066050 2024-09-10T05:37:41.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.109+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:143 4.36 4:6f96b8d0:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa41531a0 con 0x560aa40f75f0 2024-09-10T05:37:41.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.109+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:144 4.0 4:019d1eae:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa4148ea0 con 0x560aa40ff290 2024-09-10T05:37:41.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.109+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:145 4.24 4:24885f7e:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa4134a20 con 0x560aa40f75f0 2024-09-10T05:37:41.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.109+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:146 4.15 4:a984c9bd:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa4135330 con 0x560aa40ff290 2024-09-10T05:37:41.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.109+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:147 4.2c 4:3510c786:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa41b1f20 con 0x560aa40f75f0 2024-09-10T05:37:41.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.109+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:148 4.1e 4:7a0c7961:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa41477b0 con 0x560aa40f75f0 2024-09-10T05:37:41.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.109+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:149 4.2d 4:b7d0c0ee:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa41b3c20 con 0x7f269c066050 2024-09-10T05:37:41.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.109+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:150 4.36 4:6c9ffb92:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa41449a0 con 0x560aa40f75f0 2024-09-10T05:37:41.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.109+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:151 4.3a 4:5da2850d:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa4148ea0 con 0x560aa40ff290 2024-09-10T05:37:41.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.109+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:152 4.1b 4:d890202d:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa41457c0 con 0x7f269c066050 2024-09-10T05:37:41.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.113+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 <== osd.3 v2:172.21.15.62:6816/2708991149 35 ==== osd_op_reply(144 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.2 [delete] v32'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f26a00f3070 con 0x560aa40ff290 2024-09-10T05:37:41.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.113+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 49 ==== osd_op_reply(145 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.3 [delete] v32'14 uv14 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:41.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.113+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.2 v2:172.21.15.62:6800/2677868286 33 ==== osd_op_reply(152 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.10 [delete] v32'8 uv8 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7f26a400a4d0 con 0x7f269c066050 2024-09-10T05:37:41.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.113+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.2 v2:172.21.15.62:6800/2677868286 34 ==== osd_op_reply(142 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.0 [delete] v32'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f26a400a4d0 con 0x7f269c066050 2024-09-10T05:37:41.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.113+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 <== osd.3 v2:172.21.15.62:6816/2708991149 36 ==== osd_op_reply(146 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.4 [delete] v32'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f26a00f3070 con 0x560aa40ff290 2024-09-10T05:37:41.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.113+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 50 ==== osd_op_reply(143 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.1 [delete] v32'9 uv9 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:41.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.113+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 <== osd.3 v2:172.21.15.62:6816/2708991149 37 ==== osd_op_reply(151 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.9 [delete] v32'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f26a00f3070 con 0x560aa40ff290 2024-09-10T05:37:41.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.113+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 51 ==== osd_op_reply(147 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.5 [delete] v32'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:41.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.113+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 52 ==== osd_op_reply(148 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.6 [delete] v32'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:41.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.113+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.2 v2:172.21.15.62:6800/2677868286 35 ==== osd_op_reply(149 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.7 [delete] v32'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f26a400a4d0 con 0x7f269c066050 2024-09-10T05:37:41.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.113+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 53 ==== osd_op_reply(150 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10.8 [delete] v32'10 uv10 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:41.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.113+0000 7f26aec0c9c0 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo7/475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10 : miss 2024-09-10T05:37:41.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.113+0000 7f26aec0c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:37:41.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.113+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:153 6.10 6:0bd15ce7:::pubsub..bucket.myfoo7%2f475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa41b3be0 con 0x560aa40f75f0 2024-09-10T05:37:41.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.117+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 54 ==== osd_op_reply(153 pubsub..bucket.myfoo7/475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:41.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.117+0000 7f26aec0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:37:41.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.117+0000 7f26aec0c9c0 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo7/475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10 info.flags=0x0 2024-09-10T05:37:41.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.117+0000 7f26aec0c9c0 10 adding default.rgw.log++pubsub..bucket.myfoo7/475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10 to cache LRU end 2024-09-10T05:37:41.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.117+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:154 6.10 6:0bd15ce7:::pubsub..bucket.myfoo7%2f475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa41449a0 con 0x560aa40f75f0 2024-09-10T05:37:41.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.117+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 55 ==== osd_op_reply(154 pubsub..bucket.myfoo7/475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.10 [delete] v32'6 uv5 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:41.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.117+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:155 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=147b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa4134a20 con 0x560aa40f75f0 2024-09-10T05:37:41.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.117+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 56 ==== osd_op_reply(155 fud.buckets [call] v32'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:41.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.117+0000 7f26aec0c9c0 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-10T05:37:41.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.117+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:156 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa41b3be0 con 0x560aa40ff290 2024-09-10T05:37:41.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.121+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 <== osd.3 v2:172.21.15.62:6816/2708991149 38 ==== osd_op_reply(156 p5YnriCv1nAtykxBrupQ [delete] v32'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f26a00f3070 con 0x560aa40ff290 2024-09-10T05:37:41.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.121+0000 7f26aec0c9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-10T05:37:41.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.121+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:157 7.15 7:a93a5511:::notify.2:head [notify cookie 94603702473408 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa41449a0 con 0x560aa40fbab0 2024-09-10T05:37:41.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.121+0000 7f26ac712640 1 -- 172.21.15.62:0/3853331629 <== osd.0 v2:172.21.15.2:6800/945139080 32 ==== watch-notify(notify (1) cookie 94603702194656 notify 137438953513 ret 0) ==== 212+0+0 (crc 0 0 0) 0x560aa4116770 con 0x560aa40fbab0 2024-09-10T05:37:41.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.121+0000 7f2582ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953513 cookie 94603702194656 notifier 4759 bl.length()=170 2024-09-10T05:37:41.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.121+0000 7f2582ffd640 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:158 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f24e00032d0 con 0x560aa40fbab0 2024-09-10T05:37:41.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.121+0000 7f26ac712640 1 -- 172.21.15.62:0/3853331629 <== osd.0 v2:172.21.15.2:6800/945139080 33 ==== osd_op_reply(157 notify.2 [notify cookie 94603702473408 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f269c03d070 con 0x560aa40fbab0 2024-09-10T05:37:41.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.121+0000 7f26ac712640 1 -- 172.21.15.62:0/3853331629 <== osd.0 v2:172.21.15.2:6800/945139080 34 ==== watch-notify(notify_complete (2) cookie 94603702473408 notify 137438953513 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f269c04a040 con 0x560aa40fbab0 2024-09-10T05:37:41.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.121+0000 7f26ac712640 1 -- 172.21.15.62:0/3853331629 <== osd.0 v2:172.21.15.2:6800/945139080 35 ==== osd_op_reply(158 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f269c03d070 con 0x560aa40fbab0 2024-09-10T05:37:41.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.121+0000 7f26aec0c9c0 10 removing email index: 2024-09-10T05:37:41.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.121+0000 7f26aec0c9c0 10 removing user buckets index 2024-09-10T05:37:41.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.121+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:159 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa41b3be0 con 0x560aa40f75f0 2024-09-10T05:37:41.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.125+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 57 ==== osd_op_reply(159 fud.buckets [delete] v32'8 uv8 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:41.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.125+0000 7f26aec0c9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-10T05:37:41.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.125+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94603702473408 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa41449a0 con 0x560aa40ff290 2024-09-10T05:37:41.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.125+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 <== osd.3 v2:172.21.15.62:6816/2708991149 39 ==== watch-notify(notify (1) cookie 94603702209120 notify 137438953509 ret 0) ==== 202+0+0 (crc 0 0 0) 0x560aa4135a30 con 0x560aa40ff290 2024-09-10T05:37:41.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.125+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 <== osd.3 v2:172.21.15.62:6816/2708991149 40 ==== osd_op_reply(160 notify.6 [notify cookie 94603702473408 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f26a00f3070 con 0x560aa40ff290 2024-09-10T05:37:41.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.125+0000 7f25837fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953509 cookie 94603702209120 notifier 4759 bl.length()=160 2024-09-10T05:37:41.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.125+0000 7f25837fe640 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f2570003d70 con 0x560aa40ff290 2024-09-10T05:37:41.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.125+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 <== osd.3 v2:172.21.15.62:6816/2708991149 41 ==== watch-notify(notify_complete (2) cookie 94603702473408 notify 137438953509 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560aa41165a0 con 0x560aa40ff290 2024-09-10T05:37:41.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.125+0000 7f26aec0c9c0 10 removing user index: fud 2024-09-10T05:37:41.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.125+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 <== osd.3 v2:172.21.15.62:6816/2708991149 42 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26a00f3070 con 0x560aa40ff290 2024-09-10T05:37:41.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.125+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:162 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa41b3be0 con 0x7f269c066050 2024-09-10T05:37:41.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.129+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.2 v2:172.21.15.62:6800/2677868286 36 ==== osd_op_reply(162 fud [call,call,delete] v32'7 uv7 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f26a400a4d0 con 0x7f269c066050 2024-09-10T05:37:41.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.129+0000 7f26aec0c9c0 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-10T05:37:41.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.129+0000 7f26aec0c9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-10T05:37:41.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.129+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94603702473408 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560aa41449a0 con 0x560aa40ff290 2024-09-10T05:37:41.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.129+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 <== osd.3 v2:172.21.15.62:6816/2708991149 43 ==== watch-notify(notify (1) cookie 94603702213056 notify 137438953510 ret 0) ==== 194+0+0 (crc 0 0 0) 0x560aa41165a0 con 0x560aa40ff290 2024-09-10T05:37:41.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.129+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 <== osd.3 v2:172.21.15.62:6816/2708991149 44 ==== osd_op_reply(163 notify.5 [notify cookie 94603702473408 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f26a00f3070 con 0x560aa40ff290 2024-09-10T05:37:41.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.129+0000 7f25837fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953510 cookie 94603702213056 notifier 4759 bl.length()=152 2024-09-10T05:37:41.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.129+0000 7f25837fe640 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f2570003d70 con 0x560aa40ff290 2024-09-10T05:37:41.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.129+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 <== osd.3 v2:172.21.15.62:6816/2708991149 45 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26a00f3070 con 0x560aa40ff290 2024-09-10T05:37:41.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.129+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 <== osd.3 v2:172.21.15.62:6816/2708991149 46 ==== watch-notify(notify_complete (2) cookie 94603702473408 notify 137438953510 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560aa4110040 con 0x560aa40ff290 2024-09-10T05:37:41.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.129+0000 7f25627e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:37:41.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.129+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94603702218256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa41b3be0 con 0x560aa40f75f0 2024-09-10T05:37:41.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.133+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 58 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94603702218256] v32'233 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:41.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.133+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94603702197136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa41449a0 con 0x560aa40fbab0 2024-09-10T05:37:41.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.133+0000 7f26ac712640 1 -- 172.21.15.62:0/3853331629 <== osd.0 v2:172.21.15.2:6800/945139080 36 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94603702197136] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f269c03d070 con 0x560aa40fbab0 2024-09-10T05:37:41.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.133+0000 7f26aec0c9c0 20 remove_watcher() i=0 2024-09-10T05:37:41.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.133+0000 7f26aec0c9c0 2 removed watcher, disabling cache 2024-09-10T05:37:41.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.133+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94603702201088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa41b3be0 con 0x560aa40f75f0 2024-09-10T05:37:41.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.137+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.1 v2:172.21.15.62:6808/3442097179 59 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94603702201088] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26a400a4d0 con 0x560aa40f75f0 2024-09-10T05:37:41.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.137+0000 7f26aec0c9c0 20 remove_watcher() i=1 2024-09-10T05:37:41.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.137+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94603702194656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa41449a0 con 0x560aa40fbab0 2024-09-10T05:37:41.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.137+0000 7f26ac712640 1 -- 172.21.15.62:0/3853331629 <== osd.0 v2:172.21.15.2:6800/945139080 37 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94603702194656] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f269c03d070 con 0x560aa40fbab0 2024-09-10T05:37:41.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.137+0000 7f26aec0c9c0 20 remove_watcher() i=2 2024-09-10T05:37:41.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.137+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94603702208064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa41b3be0 con 0x7f269c066050 2024-09-10T05:37:41.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.141+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.2 v2:172.21.15.62:6800/2677868286 37 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94603702208064] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26a400a4d0 con 0x7f269c066050 2024-09-10T05:37:41.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.141+0000 7f26aec0c9c0 20 remove_watcher() i=3 2024-09-10T05:37:41.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.141+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94603702205792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa41449a0 con 0x560aa40fbab0 2024-09-10T05:37:41.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.145+0000 7f26ac712640 1 -- 172.21.15.62:0/3853331629 <== osd.0 v2:172.21.15.2:6800/945139080 38 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94603702205792] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f269c03d070 con 0x560aa40fbab0 2024-09-10T05:37:41.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.145+0000 7f26aec0c9c0 20 remove_watcher() i=4 2024-09-10T05:37:41.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.145+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94603702213056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa41b3be0 con 0x560aa40ff290 2024-09-10T05:37:41.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.145+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 <== osd.3 v2:172.21.15.62:6816/2708991149 47 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94603702213056] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26a00f3070 con 0x560aa40ff290 2024-09-10T05:37:41.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.145+0000 7f26aec0c9c0 20 remove_watcher() i=5 2024-09-10T05:37:41.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.145+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94603702209120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa41449a0 con 0x560aa40ff290 2024-09-10T05:37:41.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.145+0000 7f26abf11640 1 -- 172.21.15.62:0/3853331629 <== osd.3 v2:172.21.15.62:6816/2708991149 48 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94603702209120] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26a00f3070 con 0x560aa40ff290 2024-09-10T05:37:41.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.145+0000 7f26aec0c9c0 20 remove_watcher() i=6 2024-09-10T05:37:41.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.145+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94603702214112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560aa41b3be0 con 0x7f269c066050 2024-09-10T05:37:41.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.149+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 <== osd.2 v2:172.21.15.62:6800/2677868286 38 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94603702214112] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26a400a4d0 con 0x7f269c066050 2024-09-10T05:37:41.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.149+0000 7f26aec0c9c0 20 remove_watcher() i=7 2024-09-10T05:37:41.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.149+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x560aa40fbab0 msgr2=0x560aa40fdea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:41.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.149+0000 7f26aec0c9c0 1 --2- 172.21.15.62:0/3853331629 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x560aa40fbab0 0x560aa40fdea0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:41.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.149+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560aa40f75f0 msgr2=0x560aa40f9ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:41.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.149+0000 7f26aec0c9c0 1 --2- 172.21.15.62:0/3853331629 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560aa40f75f0 0x560aa40f9ab0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:41.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.149+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f269c066050 msgr2=0x7f269c03a7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:41.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.149+0000 7f26aec0c9c0 1 --2- 172.21.15.62:0/3853331629 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f269c066050 0x7f269c03a7e0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:41.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.149+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x560aa40ff290 msgr2=0x560aa4101680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:41.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.149+0000 7f26aec0c9c0 1 --2- 172.21.15.62:0/3853331629 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x560aa40ff290 0x560aa4101680 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:41.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.149+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2574039a20 msgr2=0x7f257403bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:41.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.149+0000 7f26aec0c9c0 1 --2- 172.21.15.62:0/3853331629 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2574039a20 0x7f257403bee0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x560aa3fc5bd0 tx=0x7f26a00a7000 comp rx=0 tx=0).stop 2024-09-10T05:37:41.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.149+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aa40e6350 msgr2=0x560aa40ec660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:41.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.149+0000 7f26acf13640 1 -- 172.21.15.62:0/3853331629 reap_dead start 2024-09-10T05:37:41.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.149+0000 7f26aec0c9c0 1 --2- 172.21.15.62:0/3853331629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aa40e6350 0x560aa40ec660 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f269c017980 tx=0x7f269c032f10 comp rx=0 tx=0).stop 2024-09-10T05:37:41.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.149+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 shutdown_connections 2024-09-10T05:37:41.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.149+0000 7f26aec0c9c0 1 --2- 172.21.15.62:0/3853331629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aa40e6350 0x560aa40ec660 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:41.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.149+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 >> 172.21.15.62:0/3853331629 conn(0x560aa40e1770 msgr2=0x560aa40df980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:41.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.149+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 shutdown_connections 2024-09-10T05:37:41.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.149+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3853331629 wait complete. 2024-09-10T05:37:41.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.149+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3863788354 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2584039a70 msgr2=0x7f258403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:41.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.149+0000 7f26aec0c9c0 1 --2- 172.21.15.62:0/3863788354 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2584039a70 0x7f258403bf30 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x560aa3fc5c00 tx=0x7f26a0005a10 comp rx=0 tx=0).stop 2024-09-10T05:37:41.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.149+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3863788354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aa40d8d70 msgr2=0x560aa40d9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:41.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.149+0000 7f26aec0c9c0 1 --2- 172.21.15.62:0/3863788354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aa40d8d70 0x560aa40d9190 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f269c04ed70 tx=0x7f269c00d970 comp rx=0 tx=0).stop 2024-09-10T05:37:41.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.149+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3863788354 shutdown_connections 2024-09-10T05:37:41.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.149+0000 7f26aec0c9c0 1 --2- 172.21.15.62:0/3863788354 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2584039a70 0x7f258403bf30 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:41.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.149+0000 7f26aec0c9c0 1 --2- 172.21.15.62:0/3863788354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aa40d8d70 0x560aa40d9190 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:41.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.149+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3863788354 >> 172.21.15.62:0/3863788354 conn(0x560aa40ce720 msgr2=0x560aa40ceb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:41.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.149+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3863788354 shutdown_connections 2024-09-10T05:37:41.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.149+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/3863788354 wait complete. 2024-09-10T05:37:41.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.149+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/2879567535 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x560aa40c32a0 msgr2=0x560aa40c5740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:41.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.149+0000 7f26aec0c9c0 1 --2- 172.21.15.62:0/2879567535 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x560aa40c32a0 0x560aa40c5740 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:41.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.149+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/2879567535 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560aa3fca340 msgr2=0x560aa40c22f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:41.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.149+0000 7f26aec0c9c0 1 --2- 172.21.15.62:0/2879567535 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560aa3fca340 0x560aa40c22f0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:41.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.149+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/2879567535 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x560aa40c7c70 msgr2=0x560aa40ca060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:41.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.149+0000 7f26aec0c9c0 1 --2- 172.21.15.62:0/2879567535 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x560aa40c7c70 0x560aa40ca060 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:37:41.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.153+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/2879567535 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2594039a70 msgr2=0x7f259403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:41.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.153+0000 7f26aec0c9c0 1 --2- 172.21.15.62:0/2879567535 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2594039a70 0x7f259403bf30 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f26a00ac000 tx=0x7f26a00a5000 comp rx=0 tx=0).stop 2024-09-10T05:37:41.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.153+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/2879567535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aa3f3a1f0 msgr2=0x560aa3fc6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:37:41.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.153+0000 7f26aec0c9c0 1 --2- 172.21.15.62:0/2879567535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560aa3f3a1f0 0x560aa3fc6300 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f269c001ec0 tx=0x7f269c000ee0 comp rx=0 tx=0).stop 2024-09-10T05:37:41.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.153+0000 7f26acf13640 1 -- 172.21.15.62:0/2879567535 reap_dead start 2024-09-10T05:37:41.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.153+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/2879567535 shutdown_connections 2024-09-10T05:37:41.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.153+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/2879567535 >> 172.21.15.62:0/2879567535 conn(0x560aa3fc0910 msgr2=0x560aa40abec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:37:41.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.153+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/2879567535 shutdown_connections 2024-09-10T05:37:41.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:37:41.153+0000 7f26aec0c9c0 1 -- 172.21.15.62:0/2879567535 wait complete. 2024-09-10T05:38:21.173 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2024-09-10T05:38:21.174 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2024-09-10T05:38:21.174 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2024-09-10T05:38:21.215 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:38:21.216 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:38:21.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.212+0000 7f8b2e2879c0 1 Processor -- start 2024-09-10T05:38:21.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.212+0000 7f8b2e2879c0 1 -- start start 2024-09-10T05:38:21.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.212+0000 7f8b2e2879c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5650a13cf350 0x5650a13d1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.212+0000 7f8b2e2879c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5650a127d9c0 con 0x5650a13cb200 2024-09-10T05:38:21.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.212+0000 7f8b2e2879c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x5650a12cd6d0 con 0x5650a13cf350 2024-09-10T05:38:21.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.216+0000 7f8b2b58c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5650a13cf350 0x5650a13d1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.216+0000 7f8b2b58c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5650a13cf350 0x5650a13d1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38166/0 (socket says 172.21.15.62:38166) 2024-09-10T05:38:21.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.216+0000 7f8b2bd8d640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x5650a13cb200 0x5650a13cb5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:52002/0 (socket says 172.21.15.62:52002) 2024-09-10T05:38:21.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.216+0000 7f8b2b58c640 1 -- 172.21.15.62:0/2192691051 learned_addr learned my addr 172.21.15.62:0/2192691051 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:21.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.216+0000 7f8b2b58c640 1 -- 172.21.15.62:0/2192691051 >> v1:172.21.15.2:6789/0 conn(0x5650a13cb200 legacy=0x5650a13cb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.216+0000 7f8b2b58c640 1 -- 172.21.15.62:0/2192691051 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650a1271ca0 con 0x5650a13cf350 2024-09-10T05:38:21.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.216+0000 7f8b2b58c640 1 --2- 172.21.15.62:0/2192691051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a13cf350 0x5650a13d1740 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c00a4e0 tx=0x7f8b1c01b120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d33c7c4883186f9f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.216+0000 7f8b2ad8b640 1 -- 172.21.15.62:0/2192691051 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b1c0aa540 con 0x5650a13cf350 2024-09-10T05:38:21.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.216+0000 7f8b2ad8b640 1 -- 172.21.15.62:0/2192691051 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b1c0aa6e0 con 0x5650a13cf350 2024-09-10T05:38:21.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.216+0000 7f8b2ad8b640 1 -- 172.21.15.62:0/2192691051 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b1c0aaa40 con 0x5650a13cf350 2024-09-10T05:38:21.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.220+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2192691051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a13cf350 msgr2=0x5650a13d1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.220+0000 7f8b2e2879c0 1 --2- 172.21.15.62:0/2192691051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a13cf350 0x5650a13d1740 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c00a4e0 tx=0x7f8b1c01b120 comp rx=0 tx=0).stop 2024-09-10T05:38:21.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.220+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2192691051 shutdown_connections 2024-09-10T05:38:21.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.220+0000 7f8b2e2879c0 1 --2- 172.21.15.62:0/2192691051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a13cf350 0x5650a13d1740 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:21.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.220+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2192691051 >> 172.21.15.62:0/2192691051 conn(0x5650a133eb10 msgr2=0x5650a133ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:21.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.220+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2192691051 shutdown_connections 2024-09-10T05:38:21.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.220+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2192691051 wait complete. 2024-09-10T05:38:21.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.236+0000 7f8b2e2879c0 1 Processor -- start 2024-09-10T05:38:21.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.236+0000 7f8b2e2879c0 1 -- start start 2024-09-10T05:38:21.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.236+0000 7f8b2e2879c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a13cb200 0x5650a14b68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.236+0000 7f8b2e2879c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5650a12d1680 con 0x5650a13cb200 2024-09-10T05:38:21.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.236+0000 7f8b2bd8d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a13cb200 0x5650a14b68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.236+0000 7f8b2bd8d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a13cb200 0x5650a14b68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38182/0 (socket says 172.21.15.62:38182) 2024-09-10T05:38:21.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.236+0000 7f8b2bd8d640 1 -- 172.21.15.62:0/1569684290 learned_addr learned my addr 172.21.15.62:0/1569684290 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:21.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.236+0000 7f8b2bd8d640 1 -- 172.21.15.62:0/1569684290 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650a124cda0 con 0x5650a13cb200 2024-09-10T05:38:21.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.236+0000 7f8b2bd8d640 1 --2- 172.21.15.62:0/1569684290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a13cb200 0x5650a14b68a0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f8b1400b270 tx=0x7f8b1400b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6b0a3e0b2ee4aa0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.236+0000 7f8a19e0b640 1 -- 172.21.15.62:0/1569684290 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b1400e5d0 con 0x5650a13cb200 2024-09-10T05:38:21.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.236+0000 7f8a19e0b640 1 -- 172.21.15.62:0/1569684290 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b1400e770 con 0x5650a13cb200 2024-09-10T05:38:21.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.236+0000 7f8a19e0b640 1 -- 172.21.15.62:0/1569684290 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b1400ea70 con 0x5650a13cb200 2024-09-10T05:38:21.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.240+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/1569684290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a13cb200 msgr2=0x5650a14b68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.240+0000 7f8b2e2879c0 1 --2- 172.21.15.62:0/1569684290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a13cb200 0x5650a14b68a0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f8b1400b270 tx=0x7f8b1400b670 comp rx=0 tx=0).stop 2024-09-10T05:38:21.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.240+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/1569684290 shutdown_connections 2024-09-10T05:38:21.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.240+0000 7f8b2e2879c0 1 --2- 172.21.15.62:0/1569684290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a13cb200 0x5650a14b68a0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:21.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.240+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/1569684290 >> 172.21.15.62:0/1569684290 conn(0x5650a133eb10 msgr2=0x5650a14b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:21.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.240+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/1569684290 shutdown_connections 2024-09-10T05:38:21.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.240+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/1569684290 wait complete. 2024-09-10T05:38:21.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.240+0000 7f8b2e2879c0 1 Processor -- start 2024-09-10T05:38:21.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.240+0000 7f8b2e2879c0 1 -- start start 2024-09-10T05:38:21.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.240+0000 7f8b2e2879c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a13cb200 0x5650a14bdf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.240+0000 7f8b2e2879c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5650a1273a50 con 0x5650a13cb200 2024-09-10T05:38:21.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.240+0000 7f8b2bd8d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a13cb200 0x5650a14bdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.240+0000 7f8b2bd8d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a13cb200 0x5650a14bdf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38184/0 (socket says 172.21.15.62:38184) 2024-09-10T05:38:21.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.240+0000 7f8b2bd8d640 1 -- 172.21.15.62:0/239353090 learned_addr learned my addr 172.21.15.62:0/239353090 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:21.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.240+0000 7f8b2bd8d640 1 -- 172.21.15.62:0/239353090 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650a14be4f0 con 0x5650a13cb200 2024-09-10T05:38:21.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.240+0000 7f8b2bd8d640 1 --2- 172.21.15.62:0/239353090 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a13cb200 0x5650a14bdf90 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x5650a14b7830 tx=0x7f8b14000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.240+0000 7f8a13fff640 1 -- 172.21.15.62:0/239353090 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b1400ee20 con 0x5650a13cb200 2024-09-10T05:38:21.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.240+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/239353090 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5650a14be780 con 0x5650a13cb200 2024-09-10T05:38:21.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.240+0000 7f8a13fff640 1 -- 172.21.15.62:0/239353090 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b1400fa40 con 0x5650a13cb200 2024-09-10T05:38:21.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.240+0000 7f8a13fff640 1 -- 172.21.15.62:0/239353090 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b1400fd40 con 0x5650a13cb200 2024-09-10T05:38:21.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.240+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/239353090 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650a14bf130 con 0x5650a13cb200 2024-09-10T05:38:21.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.244+0000 7f8a13fff640 1 -- 172.21.15.62:0/239353090 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8b14017070 con 0x5650a13cb200 2024-09-10T05:38:21.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.244+0000 7f8a13fff640 1 --2- 172.21.15.62:0/239353090 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8a14039a70 0x7f8a1403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.244+0000 7f8a13fff640 1 -- 172.21.15.62:0/239353090 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7f8b14015020 con 0x5650a13cb200 2024-09-10T05:38:21.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.244+0000 7f8b2b58c640 1 --2- 172.21.15.62:0/239353090 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8a14039a70 0x7f8a1403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.244+0000 7f8b2e2879c0 1 --2- 172.21.15.62:0/239353090 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5650a13cf350 0x5650a14c5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.244+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/239353090 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650a14c5640 con 0x5650a13cf350 2024-09-10T05:38:21.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.244+0000 7f8b2c58e640 1 --2- 172.21.15.62:0/239353090 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5650a13cf350 0x5650a14c5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.244+0000 7f8b2b58c640 1 --2- 172.21.15.62:0/239353090 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8a14039a70 0x7f8a1403bf30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c0ab000 tx=0x7f8b1c0a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.244+0000 7f8b2c58e640 1 --2- 172.21.15.62:0/239353090 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5650a13cf350 0x5650a14c5100 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.244+0000 7f8b2c58e640 1 -- 172.21.15.62:0/239353090 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b240083f0 con 0x5650a13cf350 2024-09-10T05:38:21.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.244+0000 7f8b2e2879c0 1 --2- 172.21.15.62:0/239353090 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5650a14c63a0 0x5650a14c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.244+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/239353090 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650a14c8d80 con 0x5650a14c63a0 2024-09-10T05:38:21.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.244+0000 7f8b2bd8d640 1 --2- 172.21.15.62:0/239353090 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5650a14c63a0 0x5650a14c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.244+0000 7f8b2bd8d640 1 --2- 172.21.15.62:0/239353090 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5650a14c63a0 0x5650a14c8790 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.244+0000 7f8b2bd8d640 1 -- 172.21.15.62:0/239353090 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8b1402e070 con 0x5650a14c63a0 2024-09-10T05:38:21.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.244+0000 7f8b2e2879c0 1 --2- 172.21.15.62:0/239353090 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5650a14cab40 0x5650a14ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.244+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/239353090 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650a14cd600 con 0x5650a14cab40 2024-09-10T05:38:21.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.244+0000 7f8b2b58c640 1 --2- 172.21.15.62:0/239353090 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5650a14cab40 0x5650a14ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.248+0000 7f8b2b58c640 1 --2- 172.21.15.62:0/239353090 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5650a14cab40 0x5650a14ccf30 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.248+0000 7f8b2b58c640 1 -- 172.21.15.62:0/239353090 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8b1c0bc040 con 0x5650a14cab40 2024-09-10T05:38:21.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.248+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/239353090 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650a14c9a10 con 0x5650a14c63a0 2024-09-10T05:38:21.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.248+0000 7f8b2bd8d640 1 -- 172.21.15.62:0/239353090 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8b1402e070 con 0x5650a14c63a0 2024-09-10T05:38:21.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.248+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/239353090 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650a14c9e30 con 0x5650a14cab40 2024-09-10T05:38:21.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.248+0000 7f8b2b58c640 1 -- 172.21.15.62:0/239353090 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8b1c0bc040 con 0x5650a14cab40 2024-09-10T05:38:21.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.248+0000 7f8b2e2879c0 1 Processor -- start 2024-09-10T05:38:21.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.248+0000 7f8b2e2879c0 1 -- start start 2024-09-10T05:38:21.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.248+0000 7f8b2e2879c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a14dbbf0 0x5650a14dc010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.248+0000 7f8b2e2879c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5650a12de450 con 0x5650a14dbbf0 2024-09-10T05:38:21.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.248+0000 7f8b2bd8d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a14dbbf0 0x5650a14dc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.248+0000 7f8b2bd8d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a14dbbf0 0x5650a14dc010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38186/0 (socket says 172.21.15.62:38186) 2024-09-10T05:38:21.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.248+0000 7f8b2bd8d640 1 -- 172.21.15.62:0/1857482302 learned_addr learned my addr 172.21.15.62:0/1857482302 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:21.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.248+0000 7f8b2bd8d640 1 -- 172.21.15.62:0/1857482302 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650a14dc650 con 0x5650a14dbbf0 2024-09-10T05:38:21.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.248+0000 7f8b2bd8d640 1 --2- 172.21.15.62:0/1857482302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a14dbbf0 0x5650a14dc010 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f8b1404f2e0 tx=0x7f8b14017490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.248+0000 7f8a117fa640 1 -- 172.21.15.62:0/1857482302 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b1401bca0 con 0x5650a14dbbf0 2024-09-10T05:38:21.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.248+0000 7f8a117fa640 1 -- 172.21.15.62:0/1857482302 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b1401be40 con 0x5650a14dbbf0 2024-09-10T05:38:21.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.252+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/1857482302 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5650a14dceb0 con 0x5650a14dbbf0 2024-09-10T05:38:21.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.252+0000 7f8a117fa640 1 -- 172.21.15.62:0/1857482302 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b140482b0 con 0x5650a14dbbf0 2024-09-10T05:38:21.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.252+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/1857482302 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650a14dceb0 con 0x5650a14dbbf0 2024-09-10T05:38:21.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.252+0000 7f8a117fa640 1 -- 172.21.15.62:0/1857482302 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8b14048450 con 0x5650a14dbbf0 2024-09-10T05:38:21.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.252+0000 7f8a117fa640 1 --2- 172.21.15.62:0/1857482302 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8a04039ac0 0x7f8a0403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.252+0000 7f8a117fa640 1 -- 172.21.15.62:0/1857482302 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7f8b14038020 con 0x5650a14dbbf0 2024-09-10T05:38:21.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.252+0000 7f8b2b58c640 1 --2- 172.21.15.62:0/1857482302 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8a04039ac0 0x7f8a0403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.252+0000 7f8b2e2879c0 1 Processor -- start 2024-09-10T05:38:21.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.252+0000 7f8b2e2879c0 1 -- start start 2024-09-10T05:38:21.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.252+0000 7f8b2b58c640 1 --2- 172.21.15.62:0/1857482302 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8a04039ac0 0x7f8a0403bf80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c000f90 tx=0x7f8b1c005e50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.252+0000 7f8b2e2879c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a14e9150 0x5650a14e9550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.252+0000 7f8b2e2879c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5650a14b70f0 con 0x5650a14e9150 2024-09-10T05:38:21.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.252+0000 7f8b2bd8d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a14e9150 0x5650a14e9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.252+0000 7f8b2bd8d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a14e9150 0x5650a14e9550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38188/0 (socket says 172.21.15.62:38188) 2024-09-10T05:38:21.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.252+0000 7f8b2bd8d640 1 -- 172.21.15.62:0/4262851168 learned_addr learned my addr 172.21.15.62:0/4262851168 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:21.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.252+0000 7f8b2bd8d640 1 -- 172.21.15.62:0/4262851168 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650a14e9b40 con 0x5650a14e9150 2024-09-10T05:38:21.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.252+0000 7f8b2bd8d640 1 --2- 172.21.15.62:0/4262851168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a14e9150 0x5650a14e9550 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f8b1400ff80 tx=0x7f8b14027ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23127b27185d358c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.252+0000 7f8a0affd640 1 -- 172.21.15.62:0/4262851168 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b14042050 con 0x5650a14e9150 2024-09-10T05:38:21.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.252+0000 7f8a0affd640 1 -- 172.21.15.62:0/4262851168 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b14061070 con 0x5650a14e9150 2024-09-10T05:38:21.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.252+0000 7f8a0affd640 1 -- 172.21.15.62:0/4262851168 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b14048e00 con 0x5650a14e9150 2024-09-10T05:38:21.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.256+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/4262851168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a14e9150 msgr2=0x5650a14e9550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.256+0000 7f8b2e2879c0 1 --2- 172.21.15.62:0/4262851168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a14e9150 0x5650a14e9550 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f8b1400ff80 tx=0x7f8b14027ca0 comp rx=0 tx=0).stop 2024-09-10T05:38:21.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.256+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/4262851168 shutdown_connections 2024-09-10T05:38:21.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.256+0000 7f8b2e2879c0 1 --2- 172.21.15.62:0/4262851168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a14e9150 0x5650a14e9550 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:21.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.256+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/4262851168 >> 172.21.15.62:0/4262851168 conn(0x5650a14e4570 msgr2=0x5650a14e27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:21.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.256+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/4262851168 shutdown_connections 2024-09-10T05:38:21.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.256+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/4262851168 wait complete. 2024-09-10T05:38:21.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.256+0000 7f8b2e2879c0 1 Processor -- start 2024-09-10T05:38:21.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.256+0000 7f8b2e2879c0 1 -- start start 2024-09-10T05:38:21.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.256+0000 7f8b2e2879c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a14e9150 0x5650a14ef480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.256+0000 7f8b2e2879c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5650a14e7f20 con 0x5650a14e9150 2024-09-10T05:38:21.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.256+0000 7f8b2bd8d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a14e9150 0x5650a14ef480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.256+0000 7f8b2bd8d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a14e9150 0x5650a14ef480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38192/0 (socket says 172.21.15.62:38192) 2024-09-10T05:38:21.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.256+0000 7f8b2bd8d640 1 -- 172.21.15.62:0/2001527524 learned_addr learned my addr 172.21.15.62:0/2001527524 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:21.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.256+0000 7f8b2bd8d640 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650a14ef9e0 con 0x5650a14e9150 2024-09-10T05:38:21.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.256+0000 7f8b2bd8d640 1 --2- 172.21.15.62:0/2001527524 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a14e9150 0x5650a14ef480 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f8b1404d200 tx=0x7f8b1404d230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.256+0000 7f8a097fa640 1 -- 172.21.15.62:0/2001527524 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b14048a10 con 0x5650a14e9150 2024-09-10T05:38:21.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.256+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5650a14ef9e0 con 0x5650a14e9150 2024-09-10T05:38:21.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.256+0000 7f8a097fa640 1 -- 172.21.15.62:0/2001527524 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b14061030 con 0x5650a14e9150 2024-09-10T05:38:21.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.256+0000 7f8a097fa640 1 -- 172.21.15.62:0/2001527524 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b1403edd0 con 0x5650a14e9150 2024-09-10T05:38:21.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.256+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650a14f0010 con 0x5650a14e9150 2024-09-10T05:38:21.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.256+0000 7f8a097fa640 1 -- 172.21.15.62:0/2001527524 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8b14042050 con 0x5650a14e9150 2024-09-10T05:38:21.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.260+0000 7f8a097fa640 1 --2- 172.21.15.62:0/2001527524 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f89f4039a70 0x7f89f403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.260+0000 7f8a097fa640 1 -- 172.21.15.62:0/2001527524 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7f8b14073bf0 con 0x5650a14e9150 2024-09-10T05:38:21.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.260+0000 7f8b2b58c640 1 --2- 172.21.15.62:0/2001527524 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f89f4039a70 0x7f89f403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.260+0000 7f8b2e2879c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:21.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.260+0000 7f8b2e2879c0 1 --2- 172.21.15.62:0/2001527524 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5650a14fa3e0 0x5650a14fc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.260+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650a14fcff0 con 0x5650a14fa3e0 2024-09-10T05:38:21.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.260+0000 7f8b2c58e640 1 --2- 172.21.15.62:0/2001527524 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5650a14fa3e0 0x5650a14fc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.260+0000 7f8b2b58c640 1 --2- 172.21.15.62:0/2001527524 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f89f4039a70 0x7f89f403bf30 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c00a190 tx=0x7f8b1c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.260+0000 7f8b2c58e640 1 --2- 172.21.15.62:0/2001527524 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5650a14fa3e0 0x5650a14fc8a0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.260+0000 7f8b2c58e640 1 -- 172.21.15.62:0/2001527524 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b240083f0 con 0x5650a14fa3e0 2024-09-10T05:38:21.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.260+0000 7f8b2e2879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:21.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.260+0000 7f8b2e2879c0 20 realm 2024-09-10T05:38:21.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.260+0000 7f8b2e2879c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:21.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.260+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650a14f9710 con 0x5650a14fa3e0 2024-09-10T05:38:21.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.260+0000 7f8b2c58e640 1 -- 172.21.15.62:0/2001527524 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b240083f0 con 0x5650a14fa3e0 2024-09-10T05:38:21.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.260+0000 7f8b2e2879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:21.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.260+0000 7f8b2e2879c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:38:21.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.260+0000 7f8b2e2879c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:21.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.260+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650a14fdab0 con 0x5650a14fa3e0 2024-09-10T05:38:21.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.260+0000 7f8b2c58e640 1 -- 172.21.15.62:0/2001527524 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b240083f0 con 0x5650a14fa3e0 2024-09-10T05:38:21.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.260+0000 7f8b2e2879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:21.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.260+0000 7f8b2e2879c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:21.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.260+0000 7f8b2e2879c0 1 --2- 172.21.15.62:0/2001527524 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5650a14fe890 0x5650a1500c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.260+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650a1501350 con 0x5650a14fe890 2024-09-10T05:38:21.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.260+0000 7f8b2bd8d640 1 --2- 172.21.15.62:0/2001527524 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5650a14fe890 0x5650a1500c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.260+0000 7f8b2bd8d640 1 --2- 172.21.15.62:0/2001527524 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5650a14fe890 0x5650a1500c80 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.260+0000 7f8b2bd8d640 1 -- 172.21.15.62:0/2001527524 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8b14079070 con 0x5650a14fe890 2024-09-10T05:38:21.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.260+0000 7f8b2e2879c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:38:21.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.260+0000 7f8b2e2879c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:21.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.260+0000 7f8b2e2879c0 1 --2- 172.21.15.62:0/2001527524 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5650a15020b0 0x5650a15044c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.260+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650a1504c50 con 0x5650a15020b0 2024-09-10T05:38:21.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.264+0000 7f8b2b58c640 1 --2- 172.21.15.62:0/2001527524 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5650a15020b0 0x5650a15044c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.264+0000 7f8b2b58c640 1 --2- 172.21.15.62:0/2001527524 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5650a15020b0 0x5650a15044c0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.264+0000 7f8b2b58c640 1 -- 172.21.15.62:0/2001527524 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8b1c0c3050 con 0x5650a15020b0 2024-09-10T05:38:21.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.264+0000 7f8b2e2879c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:38:21.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.264+0000 7f8b2e2879c0 20 searching for the correct realm 2024-09-10T05:38:21.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.264+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a1506520 con 0x5650a15020b0 2024-09-10T05:38:21.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.264+0000 7f8b2b58c640 1 -- 172.21.15.62:0/2001527524 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b1c0c3050 con 0x5650a15020b0 2024-09-10T05:38:21.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.264+0000 7f8b2b58c640 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a1506520 con 0x5650a14fe890 2024-09-10T05:38:21.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.264+0000 7f8b2bd8d640 1 -- 172.21.15.62:0/2001527524 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b14079070 con 0x5650a14fe890 2024-09-10T05:38:21.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.264+0000 7f8b2bd8d640 1 --2- 172.21.15.62:0/2001527524 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f8b14072020 0x7f8b14052a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.264+0000 7f8b2bd8d640 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a1506520 con 0x7f8b14072020 2024-09-10T05:38:21.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.264+0000 7f8b2c58e640 1 --2- 172.21.15.62:0/2001527524 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f8b14072020 0x7f8b14052a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.264+0000 7f8b2c58e640 1 --2- 172.21.15.62:0/2001527524 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f8b14072020 0x7f8b14052a90 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.264+0000 7f8b2c58e640 1 -- 172.21.15.62:0/2001527524 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b240083f0 con 0x7f8b14072020 2024-09-10T05:38:21.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.264+0000 7f8b2c58e640 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a1506520 con 0x5650a14fa3e0 2024-09-10T05:38:21.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.264+0000 7f8b2c58e640 1 -- 172.21.15.62:0/2001527524 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b240083f0 con 0x5650a14fa3e0 2024-09-10T05:38:21.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.264+0000 7f8b2c58e640 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a1506520 con 0x5650a14fa3e0 2024-09-10T05:38:21.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.264+0000 7f8b2c58e640 1 -- 172.21.15.62:0/2001527524 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b240083f0 con 0x5650a14fa3e0 2024-09-10T05:38:21.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.264+0000 7f8b2c58e640 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a1506520 con 0x5650a15020b0 2024-09-10T05:38:21.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.264+0000 7f8b2b58c640 1 -- 172.21.15.62:0/2001527524 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b1c0c3050 con 0x5650a15020b0 2024-09-10T05:38:21.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.264+0000 7f8b2b58c640 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a1506520 con 0x5650a14fa3e0 2024-09-10T05:38:21.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.268+0000 7f8b2c58e640 1 -- 172.21.15.62:0/2001527524 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b240083f0 con 0x5650a14fa3e0 2024-09-10T05:38:21.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.268+0000 7f8b2c58e640 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a1506520 con 0x5650a14fe890 2024-09-10T05:38:21.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.268+0000 7f8b2bd8d640 1 -- 172.21.15.62:0/2001527524 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b14079070 con 0x5650a14fe890 2024-09-10T05:38:21.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.268+0000 7f8b2bd8d640 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a1506520 con 0x5650a14fe890 2024-09-10T05:38:21.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.268+0000 7f8b2bd8d640 1 -- 172.21.15.62:0/2001527524 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b14079070 con 0x5650a14fe890 2024-09-10T05:38:21.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.268+0000 7f8b2bd8d640 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a1506520 con 0x5650a14fa3e0 2024-09-10T05:38:21.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.268+0000 7f8b2c58e640 1 -- 172.21.15.62:0/2001527524 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b240083f0 con 0x5650a14fa3e0 2024-09-10T05:38:21.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.268+0000 7f8b2c58e640 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a1506520 con 0x7f8b14072020 2024-09-10T05:38:21.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.268+0000 7f8b2c58e640 1 -- 172.21.15.62:0/2001527524 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b240083f0 con 0x7f8b14072020 2024-09-10T05:38:21.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.268+0000 7f8b2c58e640 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a1506520 con 0x5650a14fa3e0 2024-09-10T05:38:21.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.268+0000 7f8b2c58e640 1 -- 172.21.15.62:0/2001527524 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b240083f0 con 0x5650a14fa3e0 2024-09-10T05:38:21.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.268+0000 7f8b2c58e640 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a1506520 con 0x7f8b14072020 2024-09-10T05:38:21.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.268+0000 7f8b2c58e640 1 -- 172.21.15.62:0/2001527524 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8b240083f0 con 0x7f8b14072020 2024-09-10T05:38:21.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.268+0000 7f8b2c58e640 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a1506520 con 0x5650a14fe890 2024-09-10T05:38:21.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.268+0000 7f8b2bd8d640 1 -- 172.21.15.62:0/2001527524 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b14079070 con 0x5650a14fe890 2024-09-10T05:38:21.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.268+0000 7f8b2bd8d640 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a1506520 con 0x5650a15020b0 2024-09-10T05:38:21.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.268+0000 7f8b2b58c640 1 -- 172.21.15.62:0/2001527524 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b1c0c3050 con 0x5650a15020b0 2024-09-10T05:38:21.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.268+0000 7f8b2b58c640 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a1506520 con 0x5650a14fa3e0 2024-09-10T05:38:21.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.272+0000 7f8b2c58e640 1 -- 172.21.15.62:0/2001527524 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b240083f0 con 0x5650a14fa3e0 2024-09-10T05:38:21.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.272+0000 7f8b2c58e640 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a1506520 con 0x5650a14fe890 2024-09-10T05:38:21.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.272+0000 7f8b2bd8d640 1 -- 172.21.15.62:0/2001527524 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b14079070 con 0x5650a14fe890 2024-09-10T05:38:21.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.272+0000 7f8b2bd8d640 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a1506520 con 0x5650a15020b0 2024-09-10T05:38:21.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.272+0000 7f8b2b58c640 1 -- 172.21.15.62:0/2001527524 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 34 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f8b1c0c3050 con 0x5650a15020b0 2024-09-10T05:38:21.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.272+0000 7f8b2b58c640 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a1506520 con 0x5650a14fa3e0 2024-09-10T05:38:21.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.272+0000 7f8b2c58e640 1 -- 172.21.15.62:0/2001527524 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b240083f0 con 0x5650a14fa3e0 2024-09-10T05:38:21.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.272+0000 7f8b2c58e640 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a1506520 con 0x5650a14fa3e0 2024-09-10T05:38:21.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.272+0000 7f8b2c58e640 1 -- 172.21.15.62:0/2001527524 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8b240083f0 con 0x5650a14fa3e0 2024-09-10T05:38:21.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.272+0000 7f8b2c58e640 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a1506520 con 0x5650a14fa3e0 2024-09-10T05:38:21.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.272+0000 7f8b2c58e640 1 -- 172.21.15.62:0/2001527524 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b240083f0 con 0x5650a14fa3e0 2024-09-10T05:38:21.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.272+0000 7f8b2c58e640 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a1506520 con 0x5650a15020b0 2024-09-10T05:38:21.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.272+0000 7f8b2b58c640 1 -- 172.21.15.62:0/2001527524 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b1c0c3050 con 0x5650a15020b0 2024-09-10T05:38:21.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.272+0000 7f8b2b58c640 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a1506520 con 0x7f8b14072020 2024-09-10T05:38:21.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.272+0000 7f8b2c58e640 1 -- 172.21.15.62:0/2001527524 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b240083f0 con 0x7f8b14072020 2024-09-10T05:38:21.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.272+0000 7f8b2c58e640 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a1506520 con 0x5650a14fa3e0 2024-09-10T05:38:21.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.272+0000 7f8b2c58e640 1 -- 172.21.15.62:0/2001527524 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b240083f0 con 0x5650a14fa3e0 2024-09-10T05:38:21.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.272+0000 7f8b2c58e640 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a1506520 con 0x7f8b14072020 2024-09-10T05:38:21.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.272+0000 7f8b2c58e640 1 -- 172.21.15.62:0/2001527524 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b240083f0 con 0x7f8b14072020 2024-09-10T05:38:21.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.272+0000 7f8b2c58e640 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a1506520 con 0x5650a15020b0 2024-09-10T05:38:21.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.272+0000 7f8b2b58c640 1 -- 172.21.15.62:0/2001527524 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b1c0c3050 con 0x5650a15020b0 2024-09-10T05:38:21.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.272+0000 7f8b2b58c640 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a1506520 con 0x7f8b14072020 2024-09-10T05:38:21.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.272+0000 7f8b2c58e640 1 -- 172.21.15.62:0/2001527524 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b240083f0 con 0x7f8b14072020 2024-09-10T05:38:21.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.272+0000 7f8b2c58e640 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a1506520 con 0x5650a14fe890 2024-09-10T05:38:21.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.276+0000 7f8b2bd8d640 1 -- 172.21.15.62:0/2001527524 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b14079070 con 0x5650a14fe890 2024-09-10T05:38:21.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.276+0000 7f8b2bd8d640 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a1506520 con 0x5650a14fe890 2024-09-10T05:38:21.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.276+0000 7f8b2bd8d640 1 -- 172.21.15.62:0/2001527524 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b14079070 con 0x5650a14fe890 2024-09-10T05:38:21.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.276+0000 7f8b2bd8d640 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a1506520 con 0x5650a15020b0 2024-09-10T05:38:21.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.276+0000 7f8b2b58c640 1 -- 172.21.15.62:0/2001527524 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b1c0c3050 con 0x5650a15020b0 2024-09-10T05:38:21.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.276+0000 7f8b2b58c640 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a1506520 con 0x5650a14fe890 2024-09-10T05:38:21.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.276+0000 7f8b2bd8d640 1 -- 172.21.15.62:0/2001527524 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8b14079070 con 0x5650a14fe890 2024-09-10T05:38:21.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.276+0000 7f8b2bd8d640 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a1506520 con 0x5650a14fe890 2024-09-10T05:38:21.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.276+0000 7f8b2bd8d640 1 -- 172.21.15.62:0/2001527524 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b14079070 con 0x5650a14fe890 2024-09-10T05:38:21.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.276+0000 7f8b2e2879c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:38:21.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.276+0000 7f8b2e2879c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:38:21.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.276+0000 7f8b2e2879c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:38:21.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.276+0000 7f8b2e2879c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:38:21.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.276+0000 7f8b2e2879c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:38:21.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.276+0000 7f8b2e2879c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:38:21.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.276+0000 7f8b2e2879c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:21.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.276+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650a1505610 con 0x5650a14fa3e0 2024-09-10T05:38:21.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.276+0000 7f8b2c58e640 1 -- 172.21.15.62:0/2001527524 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b240083f0 con 0x5650a14fa3e0 2024-09-10T05:38:21.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.276+0000 7f8b2e2879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:21.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.276+0000 7f8b2e2879c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:21.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.276+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650a1505250 con 0x5650a14fe890 2024-09-10T05:38:21.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.280+0000 7f8b2bd8d640 1 -- 172.21.15.62:0/2001527524 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8b14079070 con 0x5650a14fe890 2024-09-10T05:38:21.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.280+0000 7f8b2e2879c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:38:21.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.280+0000 7f8b2e2879c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:21.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.280+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650a1505fb0 con 0x5650a15020b0 2024-09-10T05:38:21.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.280+0000 7f8b2b58c640 1 -- 172.21.15.62:0/2001527524 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8b1c0c3050 con 0x5650a15020b0 2024-09-10T05:38:21.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.280+0000 7f8b2e2879c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:38:21.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.280+0000 7f8b2e2879c0 20 zone default found 2024-09-10T05:38:21.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.280+0000 7f8b2e2879c0 4 Realm: () 2024-09-10T05:38:21.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.280+0000 7f8b2e2879c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:38:21.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.280+0000 7f8b2e2879c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:38:21.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.280+0000 7f8b2e2879c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:38:21.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.280+0000 7f8b2e2879c0 20 zonegroup default 2024-09-10T05:38:21.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.280+0000 7f8b2e2879c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:21.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.280+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650a1506e00 con 0x7f8b14072020 2024-09-10T05:38:21.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.280+0000 7f8b2c58e640 1 -- 172.21.15.62:0/2001527524 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8b240083f0 con 0x7f8b14072020 2024-09-10T05:38:21.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.280+0000 7f8b2e2879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:21.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.280+0000 7f8b2e2879c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:21.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.280+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650a1509040 con 0x5650a15020b0 2024-09-10T05:38:21.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.280+0000 7f8b2b58c640 1 -- 172.21.15.62:0/2001527524 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8b1c0c3050 con 0x5650a15020b0 2024-09-10T05:38:21.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.280+0000 7f8b2e2879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:21.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.280+0000 7f8b2e2879c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:21.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.280+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650a15093e0 con 0x5650a15020b0 2024-09-10T05:38:21.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.280+0000 7f8b2b58c640 1 -- 172.21.15.62:0/2001527524 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8b1c0c3050 con 0x5650a15020b0 2024-09-10T05:38:21.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.280+0000 7f8b2e2879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:21.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.280+0000 7f8b2e2879c0 20 started sync module instance, tier type = 2024-09-10T05:38:21.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.280+0000 7f8b2e2879c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:38:21.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.280+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a1508480 con 0x5650a14fe890 2024-09-10T05:38:21.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.284+0000 7f8b2bd8d640 1 -- 172.21.15.62:0/2001527524 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b14079070 con 0x5650a14fe890 2024-09-10T05:38:21.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.284+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94904303782000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a1508c90 con 0x5650a14fe890 2024-09-10T05:38:21.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.284+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a150a0e0 con 0x5650a14fa3e0 2024-09-10T05:38:21.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.284+0000 7f8b2c58e640 1 -- 172.21.15.62:0/2001527524 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b240083f0 con 0x5650a14fa3e0 2024-09-10T05:38:21.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.284+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94904303789264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a150ada0 con 0x5650a14fa3e0 2024-09-10T05:38:21.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.284+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a150b760 con 0x5650a14fe890 2024-09-10T05:38:21.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.284+0000 7f8b2bd8d640 1 -- 172.21.15.62:0/2001527524 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94904303782000] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b14079070 con 0x5650a14fe890 2024-09-10T05:38:21.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.284+0000 7f8b2c58e640 1 -- 172.21.15.62:0/2001527524 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94904303789264] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b240083f0 con 0x5650a14fa3e0 2024-09-10T05:38:21.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.288+0000 7f8b2bd8d640 1 -- 172.21.15.62:0/2001527524 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b14079070 con 0x5650a14fe890 2024-09-10T05:38:21.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.288+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94904303785856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a150b3c0 con 0x5650a14fe890 2024-09-10T05:38:21.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.288+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a150ada0 con 0x7f8b14072020 2024-09-10T05:38:21.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.288+0000 7f8b2c58e640 1 -- 172.21.15.62:0/2001527524 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b240083f0 con 0x7f8b14072020 2024-09-10T05:38:21.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.288+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94904303795616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a150ada0 con 0x7f8b14072020 2024-09-10T05:38:21.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.288+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a150ce30 con 0x5650a14fe890 2024-09-10T05:38:21.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.288+0000 7f8b2bd8d640 1 -- 172.21.15.62:0/2001527524 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94904303785856] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b14079070 con 0x5650a14fe890 2024-09-10T05:38:21.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.288+0000 7f8b2c58e640 1 -- 172.21.15.62:0/2001527524 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94904303795616] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b240083f0 con 0x7f8b14072020 2024-09-10T05:38:21.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.292+0000 7f8b2bd8d640 1 -- 172.21.15.62:0/2001527524 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b14079070 con 0x5650a14fe890 2024-09-10T05:38:21.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.292+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94904303797024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a150a8f0 con 0x5650a14fe890 2024-09-10T05:38:21.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.292+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a150d6d0 con 0x5650a15020b0 2024-09-10T05:38:21.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.292+0000 7f8b2b58c640 1 -- 172.21.15.62:0/2001527524 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b1c0c3050 con 0x5650a15020b0 2024-09-10T05:38:21.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.292+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94904303800864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a150a8f0 con 0x5650a15020b0 2024-09-10T05:38:21.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.292+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a150e540 con 0x5650a15020b0 2024-09-10T05:38:21.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.292+0000 7f8b2bd8d640 1 -- 172.21.15.62:0/2001527524 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94904303797024] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b14079070 con 0x5650a14fe890 2024-09-10T05:38:21.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.296+0000 7f8b2b58c640 1 -- 172.21.15.62:0/2001527524 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94904303800864] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b1c0c3050 con 0x5650a15020b0 2024-09-10T05:38:21.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.296+0000 7f8b2b58c640 1 -- 172.21.15.62:0/2001527524 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b1c0c3050 con 0x5650a15020b0 2024-09-10T05:38:21.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.296+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94904303802992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a150e090 con 0x5650a15020b0 2024-09-10T05:38:21.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.296+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a150ede0 con 0x7f8b14072020 2024-09-10T05:38:21.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.296+0000 7f8b2c58e640 1 -- 172.21.15.62:0/2001527524 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b240083f0 con 0x7f8b14072020 2024-09-10T05:38:21.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.296+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94904303806768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a150f200 con 0x7f8b14072020 2024-09-10T05:38:21.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.296+0000 7f8b2e2879c0 20 add_watcher() i=0 2024-09-10T05:38:21.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.296+0000 7f8b2e2879c0 20 add_watcher() i=1 2024-09-10T05:38:21.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.296+0000 7f8b2e2879c0 20 add_watcher() i=2 2024-09-10T05:38:21.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.296+0000 7f8b2e2879c0 20 add_watcher() i=3 2024-09-10T05:38:21.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.296+0000 7f8b2e2879c0 20 add_watcher() i=4 2024-09-10T05:38:21.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.296+0000 7f8b2e2879c0 20 add_watcher() i=5 2024-09-10T05:38:21.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.296+0000 7f8b2b58c640 1 -- 172.21.15.62:0/2001527524 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94904303802992] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b1c0c3050 con 0x5650a15020b0 2024-09-10T05:38:21.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.296+0000 7f8b2e2879c0 20 add_watcher() i=6 2024-09-10T05:38:21.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.296+0000 7f8b2c58e640 1 -- 172.21.15.62:0/2001527524 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94904303806768] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b240083f0 con 0x7f8b14072020 2024-09-10T05:38:21.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.296+0000 7f8b2e2879c0 20 add_watcher() i=7 2024-09-10T05:38:21.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.296+0000 7f8b2e2879c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:38:21.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.296+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650a1511e40 con 0x5650a14fa3e0 2024-09-10T05:38:21.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.296+0000 7f8b2c58e640 1 -- 172.21.15.62:0/2001527524 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8b240083f0 con 0x5650a14fa3e0 2024-09-10T05:38:21.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.296+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94904303798592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a150f200 con 0x5650a14fa3e0 2024-09-10T05:38:21.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.300+0000 7f8b2c58e640 1 -- 172.21.15.62:0/2001527524 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94904303798592] v34'234 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8b240083f0 con 0x5650a14fa3e0 2024-09-10T05:38:21.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.300+0000 7f89e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:38:21.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.300+0000 7f8b2e2879c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:38:21.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.300+0000 7f8b2e2879c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:38:21.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.300+0000 7f8b2e2879c0 5 note: GC not initialized 2024-09-10T05:38:21.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.300+0000 7f89e0fe1640 20 reqs_thread_entry: start 2024-09-10T05:38:21.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.300+0000 7f8b2e2879c0 20 init_complete bucket index max shards: 11 2024-09-10T05:38:21.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.300+0000 7f8b2e2879c0 20 Filter name: none 2024-09-10T05:38:21.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.300+0000 7f895a7fc640 20 reqs_thread_entry: start 2024-09-10T05:38:21.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.300+0000 7f8b2e2879c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T05:38:21.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.300+0000 7f8b2e2879c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:21.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.300+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650a1535160 con 0x5650a14fa3e0 2024-09-10T05:38:21.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.300+0000 7f8b2c58e640 1 -- 172.21.15.62:0/2001527524 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f8b240083f0 con 0x5650a14fa3e0 2024-09-10T05:38:21.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.300+0000 7f8b2e2879c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:38:21.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.300+0000 7f8b2e2879c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T05:38:21.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.300+0000 7f8b2e2879c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:38:21.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.300+0000 7f8b2e2879c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:38:21.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.300+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a1534b40 con 0x5650a15020b0 2024-09-10T05:38:21.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.304+0000 7f8b2b58c640 1 -- 172.21.15.62:0/2001527524 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(63 usage.10 [call] v34'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b1c0c3050 con 0x5650a15020b0 2024-09-10T05:38:21.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.304+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:64 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a1534b40 con 0x5650a15020b0 2024-09-10T05:38:21.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.304+0000 7f8b2b58c640 1 -- 172.21.15.62:0/2001527524 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(64 usage.10 [call] v34'34 uv33 ondisk = -61 ((61) No data available)) ==== 152+0+0 (crc 0 0 0) 0x7f8b1c0c3050 con 0x5650a15020b0 2024-09-10T05:38:21.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.304+0000 7f89e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:38:21.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.304+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94904303798592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a1534b40 con 0x5650a14fa3e0 2024-09-10T05:38:21.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.308+0000 7f8b2c58e640 1 -- 172.21.15.62:0/2001527524 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94904303798592] v34'235 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8b240083f0 con 0x5650a14fa3e0 2024-09-10T05:38:21.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.308+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94904303782000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a1534b40 con 0x5650a14fe890 2024-09-10T05:38:21.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.312+0000 7f8b2bd8d640 1 -- 172.21.15.62:0/2001527524 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94904303782000] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b14079070 con 0x5650a14fe890 2024-09-10T05:38:21.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.312+0000 7f8b2e2879c0 20 remove_watcher() i=0 2024-09-10T05:38:21.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.312+0000 7f8b2e2879c0 2 removed watcher, disabling cache 2024-09-10T05:38:21.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.312+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94904303789264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a1534b40 con 0x5650a14fa3e0 2024-09-10T05:38:21.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.312+0000 7f8b2c58e640 1 -- 172.21.15.62:0/2001527524 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94904303789264] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b240083f0 con 0x5650a14fa3e0 2024-09-10T05:38:21.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.312+0000 7f8b2e2879c0 20 remove_watcher() i=1 2024-09-10T05:38:21.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.312+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94904303785856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a1534b40 con 0x5650a14fe890 2024-09-10T05:38:21.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.316+0000 7f8b2bd8d640 1 -- 172.21.15.62:0/2001527524 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94904303785856] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b14079070 con 0x5650a14fe890 2024-09-10T05:38:21.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.316+0000 7f8b2e2879c0 20 remove_watcher() i=2 2024-09-10T05:38:21.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.316+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94904303795616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a1534b40 con 0x7f8b14072020 2024-09-10T05:38:21.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.316+0000 7f8b2c58e640 1 -- 172.21.15.62:0/2001527524 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94904303795616] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b240083f0 con 0x7f8b14072020 2024-09-10T05:38:21.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.316+0000 7f8b2e2879c0 20 remove_watcher() i=3 2024-09-10T05:38:21.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.316+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94904303797024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a1534b40 con 0x5650a14fe890 2024-09-10T05:38:21.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.320+0000 7f8b2bd8d640 1 -- 172.21.15.62:0/2001527524 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94904303797024] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b14079070 con 0x5650a14fe890 2024-09-10T05:38:21.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.320+0000 7f8b2e2879c0 20 remove_watcher() i=4 2024-09-10T05:38:21.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.320+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94904303800864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a1534b40 con 0x5650a15020b0 2024-09-10T05:38:21.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.320+0000 7f8b2b58c640 1 -- 172.21.15.62:0/2001527524 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94904303800864] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b1c0c3050 con 0x5650a15020b0 2024-09-10T05:38:21.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.320+0000 7f8b2e2879c0 20 remove_watcher() i=5 2024-09-10T05:38:21.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.320+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94904303802992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a1534b40 con 0x5650a15020b0 2024-09-10T05:38:21.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.324+0000 7f8b2b58c640 1 -- 172.21.15.62:0/2001527524 <== osd.3 v2:172.21.15.62:6816/2708991149 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94904303802992] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b1c0c3050 con 0x5650a15020b0 2024-09-10T05:38:21.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.324+0000 7f8b2e2879c0 20 remove_watcher() i=6 2024-09-10T05:38:21.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.324+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94904303806768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a150a4d0 con 0x7f8b14072020 2024-09-10T05:38:21.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.324+0000 7f8b2c58e640 1 -- 172.21.15.62:0/2001527524 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94904303806768] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b240083f0 con 0x7f8b14072020 2024-09-10T05:38:21.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.324+0000 7f8b2e2879c0 20 remove_watcher() i=7 2024-09-10T05:38:21.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.324+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5650a14fe890 msgr2=0x5650a1500c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.324+0000 7f8b2e2879c0 1 --2- 172.21.15.62:0/2001527524 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5650a14fe890 0x5650a1500c80 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:21.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.324+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5650a14fa3e0 msgr2=0x5650a14fc8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.324+0000 7f8b2e2879c0 1 --2- 172.21.15.62:0/2001527524 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5650a14fa3e0 0x5650a14fc8a0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:21.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.324+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f8b14072020 msgr2=0x7f8b14052a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.324+0000 7f8b2e2879c0 1 --2- 172.21.15.62:0/2001527524 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f8b14072020 0x7f8b14052a90 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:21.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.324+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5650a15020b0 msgr2=0x5650a15044c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.324+0000 7f8b2e2879c0 1 --2- 172.21.15.62:0/2001527524 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5650a15020b0 0x5650a15044c0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:21.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.324+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f89f4039a70 msgr2=0x7f89f403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.324+0000 7f8b2e2879c0 1 --2- 172.21.15.62:0/2001527524 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f89f4039a70 0x7f89f403bf30 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c00a190 tx=0x7f8b1c0a6000 comp rx=0 tx=0).stop 2024-09-10T05:38:21.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.324+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a14e9150 msgr2=0x5650a14ef480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.324+0000 7f8b2c58e640 1 -- 172.21.15.62:0/2001527524 reap_dead start 2024-09-10T05:38:21.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.324+0000 7f8b2e2879c0 1 --2- 172.21.15.62:0/2001527524 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a14e9150 0x5650a14ef480 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f8b1404d200 tx=0x7f8b1404d230 comp rx=0 tx=0).stop 2024-09-10T05:38:21.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.324+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 shutdown_connections 2024-09-10T05:38:21.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.324+0000 7f8b2e2879c0 1 --2- 172.21.15.62:0/2001527524 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a14e9150 0x5650a14ef480 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:21.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.324+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 >> 172.21.15.62:0/2001527524 conn(0x5650a14e4570 msgr2=0x5650a14e2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:21.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.324+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 shutdown_connections 2024-09-10T05:38:21.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.324+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/2001527524 wait complete. 2024-09-10T05:38:21.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.324+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/1857482302 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8a04039ac0 msgr2=0x7f8a0403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.324+0000 7f8b2e2879c0 1 --2- 172.21.15.62:0/1857482302 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8a04039ac0 0x7f8a0403bf80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c000f90 tx=0x7f8b1c005e50 comp rx=0 tx=0).stop 2024-09-10T05:38:21.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.324+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/1857482302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a14dbbf0 msgr2=0x5650a14dc010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.324+0000 7f8b2e2879c0 1 --2- 172.21.15.62:0/1857482302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a14dbbf0 0x5650a14dc010 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f8b1404f2e0 tx=0x7f8b14017490 comp rx=0 tx=0).stop 2024-09-10T05:38:21.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.324+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/1857482302 shutdown_connections 2024-09-10T05:38:21.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.324+0000 7f8b2e2879c0 1 --2- 172.21.15.62:0/1857482302 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8a04039ac0 0x7f8a0403bf80 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:21.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.324+0000 7f8b2e2879c0 1 --2- 172.21.15.62:0/1857482302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a14dbbf0 0x5650a14dc010 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:21.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.324+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/1857482302 >> 172.21.15.62:0/1857482302 conn(0x5650a14d15a0 msgr2=0x5650a14d1980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:21.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.324+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/1857482302 shutdown_connections 2024-09-10T05:38:21.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.324+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/1857482302 wait complete. 2024-09-10T05:38:21.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.324+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/239353090 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5650a14c63a0 msgr2=0x5650a14c8790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.324+0000 7f8b2e2879c0 1 --2- 172.21.15.62:0/239353090 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5650a14c63a0 0x5650a14c8790 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:21.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.324+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/239353090 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5650a13cf350 msgr2=0x5650a14c5100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.324+0000 7f8b2e2879c0 1 --2- 172.21.15.62:0/239353090 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5650a13cf350 0x5650a14c5100 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:21.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.324+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/239353090 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5650a14cab40 msgr2=0x5650a14ccf30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.324+0000 7f8b2e2879c0 1 --2- 172.21.15.62:0/239353090 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5650a14cab40 0x5650a14ccf30 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:21.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.324+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/239353090 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8a14039a70 msgr2=0x7f8a1403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.324+0000 7f8b2e2879c0 1 --2- 172.21.15.62:0/239353090 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8a14039a70 0x7f8a1403bf30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c0ab000 tx=0x7f8b1c0a5000 comp rx=0 tx=0).stop 2024-09-10T05:38:21.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.324+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/239353090 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a13cb200 msgr2=0x5650a14bdf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.324+0000 7f8b2e2879c0 1 --2- 172.21.15.62:0/239353090 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650a13cb200 0x5650a14bdf90 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x5650a14b7830 tx=0x7f8b14000ee0 comp rx=0 tx=0).stop 2024-09-10T05:38:21.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.324+0000 7f8b2c58e640 1 -- 172.21.15.62:0/239353090 reap_dead start 2024-09-10T05:38:21.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.324+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/239353090 shutdown_connections 2024-09-10T05:38:21.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.324+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/239353090 >> 172.21.15.62:0/239353090 conn(0x5650a133eb10 msgr2=0x5650a14b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:21.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.324+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/239353090 shutdown_connections 2024-09-10T05:38:21.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.324+0000 7f8b2e2879c0 1 -- 172.21.15.62:0/239353090 wait complete. 2024-09-10T05:38:21.341 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-10T05:38:21.341 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-10T05:38:21.341 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-10T05:38:21.424 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:38:21.425 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:38:21.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.424+0000 7ff08f4b39c0 1 Processor -- start 2024-09-10T05:38:21.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.424+0000 7ff08f4b39c0 1 -- start start 2024-09-10T05:38:21.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.424+0000 7ff08f4b39c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5643c1dea220 0x5643c1dec610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.424+0000 7ff08f4b39c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5643c1c989c0 con 0x5643c1de6710 2024-09-10T05:38:21.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.424+0000 7ff08f4b39c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x5643c1ce86d0 con 0x5643c1dea220 2024-09-10T05:38:21.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.424+0000 7ff087fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5643c1dea220 0x5643c1dec610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.424+0000 7ff08cfb9640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x5643c1de6710 0x5643c1de8b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:52012/0 (socket says 172.21.15.62:52012) 2024-09-10T05:38:21.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.424+0000 7ff08cfb9640 1 -- 172.21.15.62:0/2758127650 learned_addr learned my addr 172.21.15.62:0/2758127650 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-10T05:38:21.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.424+0000 7ff0877fe640 1 -- 172.21.15.62:0/2758127650 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 146921902 0 0) 0x5643c1c989c0 con 0x5643c1de6710 2024-09-10T05:38:21.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.424+0000 7ff0877fe640 1 -- 172.21.15.62:0/2758127650 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff07c001e20 con 0x5643c1de6710 2024-09-10T05:38:21.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.424+0000 7ff087fff640 1 -- 172.21.15.62:0/2758127650 >> v1:172.21.15.2:6789/0 conn(0x5643c1de6710 legacy=0x5643c1de8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.424+0000 7ff087fff640 1 -- 172.21.15.62:0/2758127650 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643c1c8cca0 con 0x5643c1dea220 2024-09-10T05:38:21.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.428+0000 7ff087fff640 1 --2- 172.21.15.62:0/2758127650 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c1dea220 0x5643c1dec610 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7ff07800a480 tx=0x7ff07801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=706a0e7544100a05 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.428+0000 7ff0877fe640 1 -- 172.21.15.62:0/2758127650 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0780b0070 con 0x5643c1dea220 2024-09-10T05:38:21.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.428+0000 7ff0877fe640 1 -- 172.21.15.62:0/2758127650 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0780ab540 con 0x5643c1dea220 2024-09-10T05:38:21.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.428+0000 7ff0877fe640 1 -- 172.21.15.62:0/2758127650 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0780ab840 con 0x5643c1dea220 2024-09-10T05:38:21.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.428+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/2758127650 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c1dea220 msgr2=0x5643c1dec610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.428+0000 7ff08f4b39c0 1 --2- 172.21.15.62:0/2758127650 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c1dea220 0x5643c1dec610 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7ff07800a480 tx=0x7ff07801b280 comp rx=0 tx=0).stop 2024-09-10T05:38:21.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.428+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/2758127650 shutdown_connections 2024-09-10T05:38:21.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.428+0000 7ff08f4b39c0 1 --2- 172.21.15.62:0/2758127650 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c1dea220 0x5643c1dec610 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:21.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.428+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/2758127650 >> 172.21.15.62:0/2758127650 conn(0x5643c1d59aa0 msgr2=0x5643c1d59eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:21.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.428+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/2758127650 shutdown_connections 2024-09-10T05:38:21.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.428+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/2758127650 wait complete. 2024-09-10T05:38:21.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.444+0000 7ff08f4b39c0 1 Processor -- start 2024-09-10T05:38:21.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.444+0000 7ff08f4b39c0 1 -- start start 2024-09-10T05:38:21.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.444+0000 7ff08f4b39c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c1de6710 0x5643c1ed1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.444+0000 7ff08f4b39c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5643c1cec680 con 0x5643c1de6710 2024-09-10T05:38:21.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.444+0000 7ff08cfb9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c1de6710 0x5643c1ed1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.444+0000 7ff08cfb9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c1de6710 0x5643c1ed1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38218/0 (socket says 172.21.15.62:38218) 2024-09-10T05:38:21.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.444+0000 7ff08cfb9640 1 -- 172.21.15.62:0/738825819 learned_addr learned my addr 172.21.15.62:0/738825819 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:21.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.444+0000 7ff08cfb9640 1 -- 172.21.15.62:0/738825819 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643c1c67da0 con 0x5643c1de6710 2024-09-10T05:38:21.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.444+0000 7ff08cfb9640 1 --2- 172.21.15.62:0/738825819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c1de6710 0x5643c1ed1700 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7ff080001e40 tx=0x7ff08000b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90418ef3bf1c8e0c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.444+0000 7fef7ae05640 1 -- 172.21.15.62:0/738825819 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff080012020 con 0x5643c1de6710 2024-09-10T05:38:21.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.444+0000 7fef7ae05640 1 -- 172.21.15.62:0/738825819 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff08000e690 con 0x5643c1de6710 2024-09-10T05:38:21.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.444+0000 7fef7ae05640 1 -- 172.21.15.62:0/738825819 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff08000e9b0 con 0x5643c1de6710 2024-09-10T05:38:21.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.448+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/738825819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c1de6710 msgr2=0x5643c1ed1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.448+0000 7ff08f4b39c0 1 --2- 172.21.15.62:0/738825819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c1de6710 0x5643c1ed1700 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7ff080001e40 tx=0x7ff08000b790 comp rx=0 tx=0).stop 2024-09-10T05:38:21.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.448+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/738825819 shutdown_connections 2024-09-10T05:38:21.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.448+0000 7ff08f4b39c0 1 --2- 172.21.15.62:0/738825819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c1de6710 0x5643c1ed1700 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:21.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.448+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/738825819 >> 172.21.15.62:0/738825819 conn(0x5643c1d59aa0 msgr2=0x5643c1ecd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:21.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.448+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/738825819 shutdown_connections 2024-09-10T05:38:21.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.448+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/738825819 wait complete. 2024-09-10T05:38:21.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.448+0000 7ff08f4b39c0 1 Processor -- start 2024-09-10T05:38:21.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.448+0000 7ff08f4b39c0 1 -- start start 2024-09-10T05:38:21.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.448+0000 7ff08f4b39c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c1de6710 0x5643c1ed8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.448+0000 7ff08f4b39c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5643c1c8ea50 con 0x5643c1de6710 2024-09-10T05:38:21.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.448+0000 7ff08cfb9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c1de6710 0x5643c1ed8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.448+0000 7ff08cfb9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c1de6710 0x5643c1ed8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38220/0 (socket says 172.21.15.62:38220) 2024-09-10T05:38:21.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.448+0000 7ff08cfb9640 1 -- 172.21.15.62:0/3117886188 learned_addr learned my addr 172.21.15.62:0/3117886188 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:21.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.448+0000 7ff08cfb9640 1 -- 172.21.15.62:0/3117886188 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643c1ed9300 con 0x5643c1de6710 2024-09-10T05:38:21.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.448+0000 7ff08cfb9640 1 --2- 172.21.15.62:0/3117886188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c1de6710 0x5643c1ed8da0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x5643c1ed26f0 tx=0x7ff0800040f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.448+0000 7fef79602640 1 -- 172.21.15.62:0/3117886188 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff080012030 con 0x5643c1de6710 2024-09-10T05:38:21.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.448+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3117886188 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5643c1ed9590 con 0x5643c1de6710 2024-09-10T05:38:21.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.448+0000 7fef79602640 1 -- 172.21.15.62:0/3117886188 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff08001a720 con 0x5643c1de6710 2024-09-10T05:38:21.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.448+0000 7fef79602640 1 -- 172.21.15.62:0/3117886188 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff08001aa60 con 0x5643c1de6710 2024-09-10T05:38:21.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.448+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3117886188 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643c1ed9f40 con 0x5643c1de6710 2024-09-10T05:38:21.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.452+0000 7fef79602640 1 -- 172.21.15.62:0/3117886188 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff080015020 con 0x5643c1de6710 2024-09-10T05:38:21.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.452+0000 7fef79602640 1 --2- 172.21.15.62:0/3117886188 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fef74039ac0 0x7fef7403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.452+0000 7fef79602640 1 -- 172.21.15.62:0/3117886188 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7ff080020070 con 0x5643c1de6710 2024-09-10T05:38:21.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.452+0000 7ff087fff640 1 --2- 172.21.15.62:0/3117886188 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fef74039ac0 0x7fef7403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.452+0000 7ff08f4b39c0 1 --2- 172.21.15.62:0/3117886188 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5643c1dea220 0x5643c1edff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.452+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3117886188 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643c1ee0450 con 0x5643c1dea220 2024-09-10T05:38:21.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.452+0000 7ff08d7ba640 1 --2- 172.21.15.62:0/3117886188 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5643c1dea220 0x5643c1edff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.452+0000 7ff087fff640 1 --2- 172.21.15.62:0/3117886188 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fef74039ac0 0x7fef7403bf80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff0780ad000 tx=0x7ff0780a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.452+0000 7ff08d7ba640 1 --2- 172.21.15.62:0/3117886188 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5643c1dea220 0x5643c1edff10 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.452+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3117886188 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff08800a4d0 con 0x5643c1dea220 2024-09-10T05:38:21.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.452+0000 7ff08f4b39c0 1 --2- 172.21.15.62:0/3117886188 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5643c1ee11b0 0x5643c1ee35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.452+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3117886188 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643c1ee3b90 con 0x5643c1ee11b0 2024-09-10T05:38:21.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.452+0000 7ff08cfb9640 1 --2- 172.21.15.62:0/3117886188 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5643c1ee11b0 0x5643c1ee35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.452+0000 7ff08cfb9640 1 --2- 172.21.15.62:0/3117886188 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5643c1ee11b0 0x5643c1ee35a0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.452+0000 7ff08cfb9640 1 -- 172.21.15.62:0/3117886188 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff080008030 con 0x5643c1ee11b0 2024-09-10T05:38:21.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.456+0000 7ff08f4b39c0 1 --2- 172.21.15.62:0/3117886188 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5643c1ee5950 0x5643c1ee7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.456+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3117886188 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643c1ee8430 con 0x5643c1ee5950 2024-09-10T05:38:21.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.456+0000 7ff087fff640 1 --2- 172.21.15.62:0/3117886188 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5643c1ee5950 0x5643c1ee7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.456+0000 7ff087fff640 1 --2- 172.21.15.62:0/3117886188 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5643c1ee5950 0x5643c1ee7d40 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.456+0000 7ff087fff640 1 -- 172.21.15.62:0/3117886188 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff0780aca20 con 0x5643c1ee5950 2024-09-10T05:38:21.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.456+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3117886188 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643c1ee47f0 con 0x5643c1ee11b0 2024-09-10T05:38:21.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.456+0000 7ff08cfb9640 1 -- 172.21.15.62:0/3117886188 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff080008030 con 0x5643c1ee11b0 2024-09-10T05:38:21.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.456+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3117886188 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643c1ee4c50 con 0x5643c1ee5950 2024-09-10T05:38:21.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.456+0000 7ff087fff640 1 -- 172.21.15.62:0/3117886188 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff0780aca20 con 0x5643c1ee5950 2024-09-10T05:38:21.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.456+0000 7ff08f4b39c0 1 Processor -- start 2024-09-10T05:38:21.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.456+0000 7ff08f4b39c0 1 -- start start 2024-09-10T05:38:21.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.456+0000 7ff08f4b39c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c1ef69c0 0x5643c1ef6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.456+0000 7ff08f4b39c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5643c1cf9450 con 0x5643c1ef69c0 2024-09-10T05:38:21.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.456+0000 7ff08cfb9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c1ef69c0 0x5643c1ef6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.456+0000 7ff08cfb9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c1ef69c0 0x5643c1ef6de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38232/0 (socket says 172.21.15.62:38232) 2024-09-10T05:38:21.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.456+0000 7ff08cfb9640 1 -- 172.21.15.62:0/2303625974 learned_addr learned my addr 172.21.15.62:0/2303625974 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:21.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.456+0000 7ff08cfb9640 1 -- 172.21.15.62:0/2303625974 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643c1ef7420 con 0x5643c1ef69c0 2024-09-10T05:38:21.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.456+0000 7ff08cfb9640 1 --2- 172.21.15.62:0/2303625974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c1ef69c0 0x5643c1ef6de0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7ff080000c10 tx=0x7ff08003dfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.460+0000 7fef727fc640 1 -- 172.21.15.62:0/2303625974 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff080047ad0 con 0x5643c1ef69c0 2024-09-10T05:38:21.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.460+0000 7fef727fc640 1 -- 172.21.15.62:0/2303625974 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff080047c70 con 0x5643c1ef69c0 2024-09-10T05:38:21.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.460+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/2303625974 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5643c1ef7c80 con 0x5643c1ef69c0 2024-09-10T05:38:21.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.460+0000 7fef727fc640 1 -- 172.21.15.62:0/2303625974 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff080047f50 con 0x5643c1ef69c0 2024-09-10T05:38:21.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.460+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/2303625974 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643c1ef81f0 con 0x5643c1ef69c0 2024-09-10T05:38:21.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.460+0000 7fef727fc640 1 -- 172.21.15.62:0/2303625974 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff080009070 con 0x5643c1ef69c0 2024-09-10T05:38:21.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.460+0000 7fef727fc640 1 --2- 172.21.15.62:0/2303625974 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fef64039ac0 0x7fef6403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.460+0000 7fef727fc640 1 -- 172.21.15.62:0/2303625974 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7ff080005050 con 0x5643c1ef69c0 2024-09-10T05:38:21.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.460+0000 7ff087fff640 1 --2- 172.21.15.62:0/2303625974 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fef64039ac0 0x7fef6403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.460+0000 7ff08f4b39c0 1 Processor -- start 2024-09-10T05:38:21.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.460+0000 7ff08f4b39c0 1 -- start start 2024-09-10T05:38:21.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.460+0000 7ff08f4b39c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c1f040d0 0x5643c1f044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.460+0000 7ff087fff640 1 --2- 172.21.15.62:0/2303625974 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fef64039ac0 0x7fef6403bf80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff07801b2c0 tx=0x7ff078005a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.460+0000 7ff08f4b39c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5643c1ed1f50 con 0x5643c1f040d0 2024-09-10T05:38:21.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.460+0000 7ff08cfb9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c1f040d0 0x5643c1f044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.460+0000 7ff08cfb9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c1f040d0 0x5643c1f044d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38244/0 (socket says 172.21.15.62:38244) 2024-09-10T05:38:21.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.460+0000 7ff08cfb9640 1 -- 172.21.15.62:0/3699347088 learned_addr learned my addr 172.21.15.62:0/3699347088 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:21.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.460+0000 7ff08cfb9640 1 -- 172.21.15.62:0/3699347088 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643c1f04ac0 con 0x5643c1f040d0 2024-09-10T05:38:21.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.460+0000 7ff08cfb9640 1 --2- 172.21.15.62:0/3699347088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c1f040d0 0x5643c1f044d0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7ff080021040 tx=0x7ff080022c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6700eb42bea8ba9f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.460+0000 7fef63fff640 1 -- 172.21.15.62:0/3699347088 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff08003b070 con 0x5643c1f040d0 2024-09-10T05:38:21.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.460+0000 7fef63fff640 1 -- 172.21.15.62:0/3699347088 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff08002db00 con 0x5643c1f040d0 2024-09-10T05:38:21.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.464+0000 7fef63fff640 1 -- 172.21.15.62:0/3699347088 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0800227c0 con 0x5643c1f040d0 2024-09-10T05:38:21.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.464+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3699347088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c1f040d0 msgr2=0x5643c1f044d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.464+0000 7ff08f4b39c0 1 --2- 172.21.15.62:0/3699347088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c1f040d0 0x5643c1f044d0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7ff080021040 tx=0x7ff080022c80 comp rx=0 tx=0).stop 2024-09-10T05:38:21.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.464+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3699347088 shutdown_connections 2024-09-10T05:38:21.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.464+0000 7ff08f4b39c0 1 --2- 172.21.15.62:0/3699347088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c1f040d0 0x5643c1f044d0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:21.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.464+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3699347088 >> 172.21.15.62:0/3699347088 conn(0x5643c1eff4f0 msgr2=0x5643c1efd730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:21.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.464+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3699347088 shutdown_connections 2024-09-10T05:38:21.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.464+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3699347088 wait complete. 2024-09-10T05:38:21.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.464+0000 7ff08f4b39c0 1 Processor -- start 2024-09-10T05:38:21.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.464+0000 7ff08f4b39c0 1 -- start start 2024-09-10T05:38:21.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.464+0000 7ff08f4b39c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c1f040d0 0x5643c1f0a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.464+0000 7ff08f4b39c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5643c1f02ea0 con 0x5643c1f040d0 2024-09-10T05:38:21.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.464+0000 7ff08cfb9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c1f040d0 0x5643c1f0a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.464+0000 7ff08cfb9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c1f040d0 0x5643c1f0a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38246/0 (socket says 172.21.15.62:38246) 2024-09-10T05:38:21.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.464+0000 7ff08cfb9640 1 -- 172.21.15.62:0/3878067719 learned_addr learned my addr 172.21.15.62:0/3878067719 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:21.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.464+0000 7ff08cfb9640 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643c1f0a8c0 con 0x5643c1f040d0 2024-09-10T05:38:21.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.464+0000 7ff08cfb9640 1 --2- 172.21.15.62:0/3878067719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c1f040d0 0x5643c1f0a360 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7ff080012f40 tx=0x7ff080012ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.464+0000 7fef627fc640 1 -- 172.21.15.62:0/3878067719 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff08003c930 con 0x5643c1f040d0 2024-09-10T05:38:21.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.464+0000 7fef627fc640 1 -- 172.21.15.62:0/3878067719 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff080069070 con 0x5643c1f040d0 2024-09-10T05:38:21.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.464+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5643c1f0a8c0 con 0x5643c1f040d0 2024-09-10T05:38:21.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.464+0000 7fef627fc640 1 -- 172.21.15.62:0/3878067719 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0800227c0 con 0x5643c1f040d0 2024-09-10T05:38:21.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.464+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643c1f0a8c0 con 0x5643c1f040d0 2024-09-10T05:38:21.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.468+0000 7fef627fc640 1 -- 172.21.15.62:0/3878067719 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff080060040 con 0x5643c1f040d0 2024-09-10T05:38:21.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.468+0000 7ff08f4b39c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:21.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.468+0000 7fef627fc640 1 --2- 172.21.15.62:0/3878067719 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fef58039a70 0x7fef5803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.468+0000 7fef627fc640 1 -- 172.21.15.62:0/3878067719 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7ff08005e020 con 0x5643c1f040d0 2024-09-10T05:38:21.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.468+0000 7ff087fff640 1 --2- 172.21.15.62:0/3878067719 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fef58039a70 0x7fef5803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.468+0000 7ff08f4b39c0 1 --2- 172.21.15.62:0/3878067719 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5643c1f15110 0x5643c1f17560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.468+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f17cb0 con 0x5643c1f15110 2024-09-10T05:38:21.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.468+0000 7ff08d7ba640 1 --2- 172.21.15.62:0/3878067719 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5643c1f15110 0x5643c1f17560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.468+0000 7ff087fff640 1 --2- 172.21.15.62:0/3878067719 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fef58039a70 0x7fef5803bf30 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff078000c10 tx=0x7ff0780a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.468+0000 7ff08d7ba640 1 --2- 172.21.15.62:0/3878067719 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5643c1f15110 0x5643c1f17560 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.468+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3878067719 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff08800a4d0 con 0x5643c1f15110 2024-09-10T05:38:21.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.468+0000 7ff08f4b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:21.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.468+0000 7ff08f4b39c0 20 realm 2024-09-10T05:38:21.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.468+0000 7ff08f4b39c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:21.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.468+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f14550 con 0x5643c1f15110 2024-09-10T05:38:21.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.468+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3878067719 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff08800a4d0 con 0x5643c1f15110 2024-09-10T05:38:21.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.468+0000 7ff08f4b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:21.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.468+0000 7ff08f4b39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:38:21.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.468+0000 7ff08f4b39c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:21.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.468+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f18770 con 0x5643c1f15110 2024-09-10T05:38:21.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.468+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3878067719 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff08800a4d0 con 0x5643c1f15110 2024-09-10T05:38:21.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.468+0000 7ff08f4b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:21.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.468+0000 7ff08f4b39c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:21.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.468+0000 7ff08f4b39c0 1 --2- 172.21.15.62:0/3878067719 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5643c1f19550 0x5643c1f1b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.468+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f1bfd0 con 0x5643c1f19550 2024-09-10T05:38:21.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.468+0000 7ff08cfb9640 1 --2- 172.21.15.62:0/3878067719 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5643c1f19550 0x5643c1f1b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.468+0000 7ff08cfb9640 1 --2- 172.21.15.62:0/3878067719 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5643c1f19550 0x5643c1f1b940 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.472+0000 7ff08cfb9640 1 -- 172.21.15.62:0/3878067719 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff080008030 con 0x5643c1f19550 2024-09-10T05:38:21.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.472+0000 7ff08f4b39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:38:21.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.472+0000 7ff08f4b39c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:21.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.472+0000 7ff08f4b39c0 1 --2- 172.21.15.62:0/3878067719 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5643c1f1cd80 0x5643c1f1f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.472+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f1f810 con 0x5643c1f1cd80 2024-09-10T05:38:21.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.472+0000 7ff087fff640 1 --2- 172.21.15.62:0/3878067719 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5643c1f1cd80 0x5643c1f1f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.472+0000 7ff087fff640 1 --2- 172.21.15.62:0/3878067719 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5643c1f1cd80 0x5643c1f1f170 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.472+0000 7ff087fff640 1 -- 172.21.15.62:0/3878067719 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff0780aca20 con 0x5643c1f1cd80 2024-09-10T05:38:21.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.472+0000 7ff08f4b39c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:38:21.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.472+0000 7ff08f4b39c0 20 searching for the correct realm 2024-09-10T05:38:21.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.472+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f21100 con 0x5643c1f1cd80 2024-09-10T05:38:21.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.472+0000 7ff087fff640 1 -- 172.21.15.62:0/3878067719 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0780aca20 con 0x5643c1f1cd80 2024-09-10T05:38:21.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.472+0000 7ff087fff640 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f21100 con 0x5643c1f19550 2024-09-10T05:38:21.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.472+0000 7ff08cfb9640 1 -- 172.21.15.62:0/3878067719 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff080008030 con 0x5643c1f19550 2024-09-10T05:38:21.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.472+0000 7ff08cfb9640 1 --2- 172.21.15.62:0/3878067719 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7ff080017050 0x7ff08004dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.472+0000 7ff08cfb9640 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f21100 con 0x7ff080017050 2024-09-10T05:38:21.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.472+0000 7ff08d7ba640 1 --2- 172.21.15.62:0/3878067719 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7ff080017050 0x7ff08004dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.472+0000 7ff08d7ba640 1 --2- 172.21.15.62:0/3878067719 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7ff080017050 0x7ff08004dfd0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.472+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3878067719 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff08800a4d0 con 0x7ff080017050 2024-09-10T05:38:21.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.472+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f21100 con 0x5643c1f15110 2024-09-10T05:38:21.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.472+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3878067719 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff08800a4d0 con 0x5643c1f15110 2024-09-10T05:38:21.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.472+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f21100 con 0x5643c1f15110 2024-09-10T05:38:21.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.472+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3878067719 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff08800a4d0 con 0x5643c1f15110 2024-09-10T05:38:21.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.472+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f21100 con 0x5643c1f1cd80 2024-09-10T05:38:21.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.476+0000 7ff087fff640 1 -- 172.21.15.62:0/3878067719 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0780aca20 con 0x5643c1f1cd80 2024-09-10T05:38:21.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.476+0000 7ff087fff640 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f21100 con 0x5643c1f15110 2024-09-10T05:38:21.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.476+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3878067719 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff08800a4d0 con 0x5643c1f15110 2024-09-10T05:38:21.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.476+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f21100 con 0x5643c1f19550 2024-09-10T05:38:21.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.476+0000 7ff08cfb9640 1 -- 172.21.15.62:0/3878067719 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff080008030 con 0x5643c1f19550 2024-09-10T05:38:21.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.476+0000 7ff08cfb9640 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f21100 con 0x5643c1f19550 2024-09-10T05:38:21.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.476+0000 7ff08cfb9640 1 -- 172.21.15.62:0/3878067719 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff080008030 con 0x5643c1f19550 2024-09-10T05:38:21.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.476+0000 7ff08cfb9640 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f21100 con 0x5643c1f15110 2024-09-10T05:38:21.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.476+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3878067719 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff08800a4d0 con 0x5643c1f15110 2024-09-10T05:38:21.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.476+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f21100 con 0x7ff080017050 2024-09-10T05:38:21.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.476+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3878067719 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff08800a4d0 con 0x7ff080017050 2024-09-10T05:38:21.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.476+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f21100 con 0x5643c1f15110 2024-09-10T05:38:21.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.476+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3878067719 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff08800a4d0 con 0x5643c1f15110 2024-09-10T05:38:21.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.476+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f21100 con 0x7ff080017050 2024-09-10T05:38:21.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.476+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3878067719 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff08800a4d0 con 0x7ff080017050 2024-09-10T05:38:21.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.476+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f21100 con 0x5643c1f19550 2024-09-10T05:38:21.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.476+0000 7ff08cfb9640 1 -- 172.21.15.62:0/3878067719 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff080008030 con 0x5643c1f19550 2024-09-10T05:38:21.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.476+0000 7ff08cfb9640 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f21100 con 0x5643c1f1cd80 2024-09-10T05:38:21.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.480+0000 7ff087fff640 1 -- 172.21.15.62:0/3878067719 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0780aca20 con 0x5643c1f1cd80 2024-09-10T05:38:21.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.480+0000 7ff087fff640 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f21100 con 0x5643c1f15110 2024-09-10T05:38:21.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.480+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3878067719 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff08800a4d0 con 0x5643c1f15110 2024-09-10T05:38:21.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.480+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f21100 con 0x5643c1f19550 2024-09-10T05:38:21.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.480+0000 7ff08cfb9640 1 -- 172.21.15.62:0/3878067719 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff080008030 con 0x5643c1f19550 2024-09-10T05:38:21.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.480+0000 7ff08cfb9640 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f21100 con 0x5643c1f1cd80 2024-09-10T05:38:21.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.480+0000 7ff087fff640 1 -- 172.21.15.62:0/3878067719 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 34 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7ff0780aca20 con 0x5643c1f1cd80 2024-09-10T05:38:21.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.480+0000 7ff087fff640 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f21100 con 0x5643c1f15110 2024-09-10T05:38:21.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.480+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3878067719 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff08800a4d0 con 0x5643c1f15110 2024-09-10T05:38:21.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.480+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f21100 con 0x5643c1f15110 2024-09-10T05:38:21.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.480+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3878067719 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff08800a4d0 con 0x5643c1f15110 2024-09-10T05:38:21.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.480+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f21100 con 0x5643c1f15110 2024-09-10T05:38:21.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.480+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3878067719 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff08800a4d0 con 0x5643c1f15110 2024-09-10T05:38:21.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.480+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f21100 con 0x5643c1f1cd80 2024-09-10T05:38:21.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.480+0000 7ff087fff640 1 -- 172.21.15.62:0/3878067719 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0780aca20 con 0x5643c1f1cd80 2024-09-10T05:38:21.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.480+0000 7ff087fff640 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f21100 con 0x7ff080017050 2024-09-10T05:38:21.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.480+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3878067719 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff08800a4d0 con 0x7ff080017050 2024-09-10T05:38:21.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.480+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f21100 con 0x5643c1f15110 2024-09-10T05:38:21.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.480+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3878067719 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff08800a4d0 con 0x5643c1f15110 2024-09-10T05:38:21.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.480+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f21100 con 0x7ff080017050 2024-09-10T05:38:21.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.480+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3878067719 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff08800a4d0 con 0x7ff080017050 2024-09-10T05:38:21.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.480+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f21100 con 0x5643c1f1cd80 2024-09-10T05:38:21.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.480+0000 7ff087fff640 1 -- 172.21.15.62:0/3878067719 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0780aca20 con 0x5643c1f1cd80 2024-09-10T05:38:21.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.480+0000 7ff087fff640 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f21100 con 0x7ff080017050 2024-09-10T05:38:21.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.484+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3878067719 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff08800a4d0 con 0x7ff080017050 2024-09-10T05:38:21.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.484+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f21100 con 0x5643c1f19550 2024-09-10T05:38:21.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.484+0000 7ff08cfb9640 1 -- 172.21.15.62:0/3878067719 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff080008030 con 0x5643c1f19550 2024-09-10T05:38:21.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.484+0000 7ff08cfb9640 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f21100 con 0x5643c1f19550 2024-09-10T05:38:21.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.484+0000 7ff08cfb9640 1 -- 172.21.15.62:0/3878067719 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff080008030 con 0x5643c1f19550 2024-09-10T05:38:21.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.484+0000 7ff08cfb9640 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f21100 con 0x5643c1f1cd80 2024-09-10T05:38:21.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.484+0000 7ff087fff640 1 -- 172.21.15.62:0/3878067719 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0780aca20 con 0x5643c1f1cd80 2024-09-10T05:38:21.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.484+0000 7ff087fff640 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f21100 con 0x5643c1f19550 2024-09-10T05:38:21.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.484+0000 7ff08cfb9640 1 -- 172.21.15.62:0/3878067719 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff080008030 con 0x5643c1f19550 2024-09-10T05:38:21.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.484+0000 7ff08cfb9640 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f21100 con 0x5643c1f19550 2024-09-10T05:38:21.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.484+0000 7ff08cfb9640 1 -- 172.21.15.62:0/3878067719 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff080008030 con 0x5643c1f19550 2024-09-10T05:38:21.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.484+0000 7ff08f4b39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:38:21.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.484+0000 7ff08f4b39c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:38:21.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.484+0000 7ff08f4b39c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:38:21.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.484+0000 7ff08f4b39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:38:21.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.484+0000 7ff08f4b39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:38:21.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.484+0000 7ff08f4b39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:38:21.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.484+0000 7ff08f4b39c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:21.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.484+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f201d0 con 0x5643c1f15110 2024-09-10T05:38:21.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.484+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3878067719 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff08800a4d0 con 0x5643c1f15110 2024-09-10T05:38:21.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.484+0000 7ff08f4b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:21.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.484+0000 7ff08f4b39c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:21.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.484+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f205f0 con 0x5643c1f19550 2024-09-10T05:38:21.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.488+0000 7ff08cfb9640 1 -- 172.21.15.62:0/3878067719 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff080008030 con 0x5643c1f19550 2024-09-10T05:38:21.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.488+0000 7ff08f4b39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:38:21.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.488+0000 7ff08f4b39c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:21.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.488+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f20a50 con 0x5643c1f1cd80 2024-09-10T05:38:21.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.488+0000 7ff087fff640 1 -- 172.21.15.62:0/3878067719 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff0780aca20 con 0x5643c1f1cd80 2024-09-10T05:38:21.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.488+0000 7ff08f4b39c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:38:21.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.488+0000 7ff08f4b39c0 20 zone default found 2024-09-10T05:38:21.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.488+0000 7ff08f4b39c0 4 Realm: () 2024-09-10T05:38:21.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.488+0000 7ff08f4b39c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:38:21.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.488+0000 7ff08f4b39c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:38:21.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.488+0000 7ff08f4b39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:38:21.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.488+0000 7ff08f4b39c0 20 zonegroup default 2024-09-10T05:38:21.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.488+0000 7ff08f4b39c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:21.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.488+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f215d0 con 0x7ff080017050 2024-09-10T05:38:21.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.488+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3878067719 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff08800a4d0 con 0x7ff080017050 2024-09-10T05:38:21.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.488+0000 7ff08f4b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:21.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.488+0000 7ff08f4b39c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:21.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.488+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f23890 con 0x5643c1f1cd80 2024-09-10T05:38:21.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.488+0000 7ff087fff640 1 -- 172.21.15.62:0/3878067719 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff0780aca20 con 0x5643c1f1cd80 2024-09-10T05:38:21.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.488+0000 7ff08f4b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:21.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.488+0000 7ff08f4b39c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:21.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.488+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f23c30 con 0x5643c1f1cd80 2024-09-10T05:38:21.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.488+0000 7ff087fff640 1 -- 172.21.15.62:0/3878067719 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff0780aca20 con 0x5643c1f1cd80 2024-09-10T05:38:21.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.488+0000 7ff08f4b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:21.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.488+0000 7ff08f4b39c0 20 started sync module instance, tier type = 2024-09-10T05:38:21.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.488+0000 7ff08f4b39c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:38:21.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.488+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f22d20 con 0x5643c1f19550 2024-09-10T05:38:21.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.492+0000 7ff08cfb9640 1 -- 172.21.15.62:0/3878067719 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff080008030 con 0x5643c1f19550 2024-09-10T05:38:21.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.492+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94849016672832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f22d20 con 0x5643c1f19550 2024-09-10T05:38:21.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.492+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f24740 con 0x5643c1f15110 2024-09-10T05:38:21.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.492+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3878067719 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff08800a4d0 con 0x5643c1f15110 2024-09-10T05:38:21.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.492+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94849016676912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f24fe0 con 0x5643c1f15110 2024-09-10T05:38:21.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.492+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f25a00 con 0x5643c1f19550 2024-09-10T05:38:21.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.492+0000 7ff08cfb9640 1 -- 172.21.15.62:0/3878067719 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94849016672832] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff080008030 con 0x5643c1f19550 2024-09-10T05:38:21.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.492+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3878067719 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94849016676912] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff08800a4d0 con 0x5643c1f15110 2024-09-10T05:38:21.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.496+0000 7ff08cfb9640 1 -- 172.21.15.62:0/3878067719 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff080008030 con 0x5643c1f19550 2024-09-10T05:38:21.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.496+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94849016681712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f24b30 con 0x5643c1f19550 2024-09-10T05:38:21.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.496+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f262a0 con 0x7ff080017050 2024-09-10T05:38:21.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.496+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3878067719 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff08800a4d0 con 0x7ff080017050 2024-09-10T05:38:21.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.496+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94849016684016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f24b30 con 0x7ff080017050 2024-09-10T05:38:21.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.496+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f26d40 con 0x5643c1f19550 2024-09-10T05:38:21.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.496+0000 7ff08cfb9640 1 -- 172.21.15.62:0/3878067719 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94849016681712] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff080008030 con 0x5643c1f19550 2024-09-10T05:38:21.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.496+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3878067719 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94849016684016] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff08800a4d0 con 0x7ff080017050 2024-09-10T05:38:21.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.496+0000 7ff08cfb9640 1 -- 172.21.15.62:0/3878067719 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff080008030 con 0x5643c1f19550 2024-09-10T05:38:21.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.496+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94849016685072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f26d00 con 0x5643c1f19550 2024-09-10T05:38:21.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.496+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f27130 con 0x5643c1f1cd80 2024-09-10T05:38:21.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.500+0000 7ff087fff640 1 -- 172.21.15.62:0/3878067719 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0780aca20 con 0x5643c1f1cd80 2024-09-10T05:38:21.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.500+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94849016670320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f27130 con 0x5643c1f1cd80 2024-09-10T05:38:21.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.500+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f28030 con 0x5643c1f1cd80 2024-09-10T05:38:21.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.500+0000 7ff08cfb9640 1 -- 172.21.15.62:0/3878067719 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94849016685072] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff080008030 con 0x5643c1f19550 2024-09-10T05:38:21.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.500+0000 7ff087fff640 1 -- 172.21.15.62:0/3878067719 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(56 notify.6 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0780aca20 con 0x5643c1f1cd80 2024-09-10T05:38:21.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.500+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94849016686640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f27ff0 con 0x5643c1f1cd80 2024-09-10T05:38:21.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.500+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f28a40 con 0x7ff080017050 2024-09-10T05:38:21.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.500+0000 7ff087fff640 1 -- 172.21.15.62:0/3878067719 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94849016670320] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0780aca20 con 0x5643c1f1cd80 2024-09-10T05:38:21.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.500+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3878067719 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff08800a4d0 con 0x7ff080017050 2024-09-10T05:38:21.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.500+0000 7ff087fff640 1 -- 172.21.15.62:0/3878067719 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94849016686640] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0780aca20 con 0x5643c1f1cd80 2024-09-10T05:38:21.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.500+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94849016689952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f28590 con 0x7ff080017050 2024-09-10T05:38:21.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.504+0000 7ff08f4b39c0 20 add_watcher() i=0 2024-09-10T05:38:21.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.504+0000 7ff08f4b39c0 20 add_watcher() i=1 2024-09-10T05:38:21.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.504+0000 7ff08f4b39c0 20 add_watcher() i=2 2024-09-10T05:38:21.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.504+0000 7ff08f4b39c0 20 add_watcher() i=3 2024-09-10T05:38:21.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.504+0000 7ff08f4b39c0 20 add_watcher() i=4 2024-09-10T05:38:21.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.504+0000 7ff08f4b39c0 20 add_watcher() i=5 2024-09-10T05:38:21.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.504+0000 7ff08f4b39c0 20 add_watcher() i=6 2024-09-10T05:38:21.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.504+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3878067719 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94849016689952] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff08800a4d0 con 0x7ff080017050 2024-09-10T05:38:21.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.504+0000 7ff08f4b39c0 20 add_watcher() i=7 2024-09-10T05:38:21.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.504+0000 7ff08f4b39c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:38:21.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.504+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f28590 con 0x5643c1f15110 2024-09-10T05:38:21.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.504+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3878067719 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff08800a4d0 con 0x5643c1f15110 2024-09-10T05:38:21.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.504+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94849016691520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f291a0 con 0x5643c1f15110 2024-09-10T05:38:21.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.504+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3878067719 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94849016691520] v34'236 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff08800a4d0 con 0x5643c1f15110 2024-09-10T05:38:21.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.504+0000 7fef437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:38:21.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.508+0000 7ff08f4b39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:38:21.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.508+0000 7ff08f4b39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:38:21.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.508+0000 7ff08f4b39c0 5 note: GC not initialized 2024-09-10T05:38:21.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.508+0000 7fef427e4640 20 reqs_thread_entry: start 2024-09-10T05:38:21.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.508+0000 7ff08f4b39c0 20 init_complete bucket index max shards: 11 2024-09-10T05:38:21.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.508+0000 7ff08f4b39c0 20 Filter name: none 2024-09-10T05:38:21.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.508+0000 7fef3b7fe640 20 reqs_thread_entry: start 2024-09-10T05:38:21.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.508+0000 7ff08f4b39c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:21.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.508+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f4e7d0 con 0x5643c1f15110 2024-09-10T05:38:21.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.508+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3878067719 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff08800a4d0 con 0x5643c1f15110 2024-09-10T05:38:21.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.508+0000 7ff08f4b39c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:38:21.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.508+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f4fd50 con 0x5643c1f1cd80 2024-09-10T05:38:21.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.508+0000 7ff087fff640 1 -- 172.21.15.62:0/3878067719 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(63 usage.10 [call out=15b] v0'0 uv33 ondisk = 0) ==== 152+0+15 (crc 0 0 0) 0x7ff0780aca20 con 0x5643c1f1cd80 2024-09-10T05:38:21.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.508+0000 7fef437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:38:21.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.508+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94849016691520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f28cf0 con 0x5643c1f15110 2024-09-10T05:38:21.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.512+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3878067719 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94849016691520] v34'237 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff08800a4d0 con 0x5643c1f15110 2024-09-10T05:38:21.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.512+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94849016672832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f27b40 con 0x5643c1f19550 2024-09-10T05:38:21.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.512+0000 7ff08cfb9640 1 -- 172.21.15.62:0/3878067719 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94849016672832] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff080008030 con 0x5643c1f19550 2024-09-10T05:38:21.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.512+0000 7ff08f4b39c0 20 remove_watcher() i=0 2024-09-10T05:38:21.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.512+0000 7ff08f4b39c0 2 removed watcher, disabling cache 2024-09-10T05:38:21.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.512+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94849016676912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f23240 con 0x5643c1f15110 2024-09-10T05:38:21.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.516+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3878067719 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94849016676912] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff08800a4d0 con 0x5643c1f15110 2024-09-10T05:38:21.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.516+0000 7ff08f4b39c0 20 remove_watcher() i=1 2024-09-10T05:38:21.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.516+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94849016681712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f23240 con 0x5643c1f19550 2024-09-10T05:38:21.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.516+0000 7ff08cfb9640 1 -- 172.21.15.62:0/3878067719 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94849016681712] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff080008030 con 0x5643c1f19550 2024-09-10T05:38:21.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.516+0000 7ff08f4b39c0 20 remove_watcher() i=2 2024-09-10T05:38:21.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.516+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94849016684016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f23240 con 0x7ff080017050 2024-09-10T05:38:21.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.516+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3878067719 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94849016684016] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff08800a4d0 con 0x7ff080017050 2024-09-10T05:38:21.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.516+0000 7ff08f4b39c0 20 remove_watcher() i=3 2024-09-10T05:38:21.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.516+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94849016685072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f25df0 con 0x5643c1f19550 2024-09-10T05:38:21.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.520+0000 7ff08cfb9640 1 -- 172.21.15.62:0/3878067719 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94849016685072] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff080008030 con 0x5643c1f19550 2024-09-10T05:38:21.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.520+0000 7ff08f4b39c0 20 remove_watcher() i=4 2024-09-10T05:38:21.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.520+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94849016670320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f254f0 con 0x5643c1f1cd80 2024-09-10T05:38:21.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.520+0000 7ff087fff640 1 -- 172.21.15.62:0/3878067719 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94849016670320] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0780aca20 con 0x5643c1f1cd80 2024-09-10T05:38:21.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.520+0000 7ff08f4b39c0 20 remove_watcher() i=5 2024-09-10T05:38:21.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.520+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94849016686640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f254f0 con 0x5643c1f1cd80 2024-09-10T05:38:21.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.524+0000 7ff087fff640 1 -- 172.21.15.62:0/3878067719 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94849016686640] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0780aca20 con 0x5643c1f1cd80 2024-09-10T05:38:21.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.524+0000 7ff08f4b39c0 20 remove_watcher() i=6 2024-09-10T05:38:21.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.524+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3878067719 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94849016689952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643c1f26830 con 0x7ff080017050 2024-09-10T05:38:21.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.524+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3878067719 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94849016689952] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff08800a4d0 con 0x7ff080017050 2024-09-10T05:38:21.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.524+0000 7ff08f4b39c0 20 remove_watcher() i=7 2024-09-10T05:38:21.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.524+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3878067719 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5643c1f19550 msgr2=0x5643c1f1b940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.524+0000 7ff08f4b39c0 1 --2- 172.21.15.62:0/3878067719 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5643c1f19550 0x5643c1f1b940 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:21.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.524+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3878067719 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5643c1f15110 msgr2=0x5643c1f17560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.524+0000 7ff08f4b39c0 1 --2- 172.21.15.62:0/3878067719 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5643c1f15110 0x5643c1f17560 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:21.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.524+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3878067719 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7ff080017050 msgr2=0x7ff08004dfd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.524+0000 7ff08f4b39c0 1 --2- 172.21.15.62:0/3878067719 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7ff080017050 0x7ff08004dfd0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:21.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.524+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3878067719 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5643c1f1cd80 msgr2=0x5643c1f1f170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.524+0000 7ff08f4b39c0 1 --2- 172.21.15.62:0/3878067719 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5643c1f1cd80 0x5643c1f1f170 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:21.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.524+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3878067719 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fef58039a70 msgr2=0x7fef5803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.524+0000 7ff08f4b39c0 1 --2- 172.21.15.62:0/3878067719 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fef58039a70 0x7fef5803bf30 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff078000c10 tx=0x7ff0780a6000 comp rx=0 tx=0).stop 2024-09-10T05:38:21.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.524+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3878067719 reap_dead start 2024-09-10T05:38:21.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.524+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3878067719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c1f040d0 msgr2=0x5643c1f0a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.524+0000 7ff08f4b39c0 1 --2- 172.21.15.62:0/3878067719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c1f040d0 0x5643c1f0a360 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7ff080012f40 tx=0x7ff080012ed0 comp rx=0 tx=0).stop 2024-09-10T05:38:21.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.524+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3878067719 reap_dead start 2024-09-10T05:38:21.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.524+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3878067719 shutdown_connections 2024-09-10T05:38:21.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.524+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3878067719 >> 172.21.15.62:0/3878067719 conn(0x5643c1eff4f0 msgr2=0x5643c1efd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:21.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.524+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3878067719 shutdown_connections 2024-09-10T05:38:21.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.524+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3878067719 wait complete. 2024-09-10T05:38:21.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.524+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/2303625974 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fef64039ac0 msgr2=0x7fef6403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.524+0000 7ff08f4b39c0 1 --2- 172.21.15.62:0/2303625974 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fef64039ac0 0x7fef6403bf80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff07801b2c0 tx=0x7ff078005a10 comp rx=0 tx=0).stop 2024-09-10T05:38:21.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.524+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/2303625974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c1ef69c0 msgr2=0x5643c1ef6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.524+0000 7ff08f4b39c0 1 --2- 172.21.15.62:0/2303625974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c1ef69c0 0x5643c1ef6de0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7ff080000c10 tx=0x7ff08003dfb0 comp rx=0 tx=0).stop 2024-09-10T05:38:21.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.524+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/2303625974 shutdown_connections 2024-09-10T05:38:21.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.524+0000 7ff08f4b39c0 1 --2- 172.21.15.62:0/2303625974 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fef64039ac0 0x7fef6403bf80 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:21.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.524+0000 7ff08f4b39c0 1 --2- 172.21.15.62:0/2303625974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c1ef69c0 0x5643c1ef6de0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:21.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.524+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/2303625974 >> 172.21.15.62:0/2303625974 conn(0x5643c1eec370 msgr2=0x5643c1eec750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:21.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.524+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/2303625974 shutdown_connections 2024-09-10T05:38:21.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.524+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/2303625974 wait complete. 2024-09-10T05:38:21.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.524+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3117886188 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5643c1ee11b0 msgr2=0x5643c1ee35a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.524+0000 7ff08f4b39c0 1 --2- 172.21.15.62:0/3117886188 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5643c1ee11b0 0x5643c1ee35a0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:21.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.524+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3117886188 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5643c1dea220 msgr2=0x5643c1edff10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.524+0000 7ff08f4b39c0 1 --2- 172.21.15.62:0/3117886188 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5643c1dea220 0x5643c1edff10 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:21.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.524+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3117886188 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5643c1ee5950 msgr2=0x5643c1ee7d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.524+0000 7ff08f4b39c0 1 --2- 172.21.15.62:0/3117886188 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5643c1ee5950 0x5643c1ee7d40 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:21.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.524+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3117886188 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fef74039ac0 msgr2=0x7fef7403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.524+0000 7ff08f4b39c0 1 --2- 172.21.15.62:0/3117886188 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fef74039ac0 0x7fef7403bf80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff0780ad000 tx=0x7ff0780a5040 comp rx=0 tx=0).stop 2024-09-10T05:38:21.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.524+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3117886188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c1de6710 msgr2=0x5643c1ed8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.524+0000 7ff08f4b39c0 1 --2- 172.21.15.62:0/3117886188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c1de6710 0x5643c1ed8da0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x5643c1ed26f0 tx=0x7ff0800040f0 comp rx=0 tx=0).stop 2024-09-10T05:38:21.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.524+0000 7ff08d7ba640 1 -- 172.21.15.62:0/3117886188 reap_dead start 2024-09-10T05:38:21.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.524+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3117886188 shutdown_connections 2024-09-10T05:38:21.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.524+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3117886188 >> 172.21.15.62:0/3117886188 conn(0x5643c1d59aa0 msgr2=0x5643c1ecbe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:21.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.524+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3117886188 shutdown_connections 2024-09-10T05:38:21.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.524+0000 7ff08f4b39c0 1 -- 172.21.15.62:0/3117886188 wait complete. 2024-09-10T05:38:21.539 INFO:teuthology.orchestra.run.smithi062.stdout:{"entries":[],"summary":[]} 2024-09-10T05:38:21.540 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-10T05:38:21.540 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-10T05:38:21.540 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-10T05:38:21.540 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2024-09-10T05:38:21.621 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:38:21.622 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:38:21.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.620+0000 7ff0fcff69c0 1 Processor -- start 2024-09-10T05:38:21.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.620+0000 7ff0fcff69c0 1 -- start start 2024-09-10T05:38:21.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.620+0000 7ff0fcff69c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55fa154e81f0 0x55fa154e85d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.620+0000 7ff0fcff69c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fa1539a9c0 con 0x55fa154eb330 2024-09-10T05:38:21.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.620+0000 7ff0fcff69c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x55fa153ea6d0 con 0x55fa154e81f0 2024-09-10T05:38:21.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.620+0000 7ff0faafc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55fa154e81f0 0x55fa154e85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.620+0000 7ff0faafc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55fa154e81f0 0x55fa154e85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38252/0 (socket says 172.21.15.62:38252) 2024-09-10T05:38:21.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.620+0000 7ff0fa2fb640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x55fa154eb330 0x55fa154ed720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:52016/0 (socket says 172.21.15.62:52016) 2024-09-10T05:38:21.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.620+0000 7ff0faafc640 1 -- 172.21.15.62:0/1924661176 learned_addr learned my addr 172.21.15.62:0/1924661176 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:21.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.620+0000 7ff0faafc640 1 -- 172.21.15.62:0/1924661176 >> v1:172.21.15.2:6789/0 conn(0x55fa154eb330 legacy=0x55fa154ed720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.620+0000 7ff0faafc640 1 -- 172.21.15.62:0/1924661176 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa1538eca0 con 0x55fa154e81f0 2024-09-10T05:38:21.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.624+0000 7ff0faafc640 1 --2- 172.21.15.62:0/1924661176 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa154e81f0 0x55fa154e85d0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec00a4e0 tx=0x7ff0ec01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e046be5587dc7d67 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.624+0000 7ff0f9afa640 1 -- 172.21.15.62:0/1924661176 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0ec0aa540 con 0x55fa154e81f0 2024-09-10T05:38:21.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.624+0000 7ff0f9afa640 1 -- 172.21.15.62:0/1924661176 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0ec0aa6e0 con 0x55fa154e81f0 2024-09-10T05:38:21.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.624+0000 7ff0f9afa640 1 -- 172.21.15.62:0/1924661176 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0ec0aaa40 con 0x55fa154e81f0 2024-09-10T05:38:21.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.624+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/1924661176 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa154e81f0 msgr2=0x55fa154e85d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.624+0000 7ff0fcff69c0 1 --2- 172.21.15.62:0/1924661176 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa154e81f0 0x55fa154e85d0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec00a4e0 tx=0x7ff0ec01b090 comp rx=0 tx=0).stop 2024-09-10T05:38:21.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.624+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/1924661176 shutdown_connections 2024-09-10T05:38:21.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.624+0000 7ff0fcff69c0 1 --2- 172.21.15.62:0/1924661176 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa154e81f0 0x55fa154e85d0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:21.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.624+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/1924661176 >> 172.21.15.62:0/1924661176 conn(0x55fa1545bb00 msgr2=0x55fa1545bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:21.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.624+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/1924661176 shutdown_connections 2024-09-10T05:38:21.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.624+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/1924661176 wait complete. 2024-09-10T05:38:21.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.640+0000 7ff0fcff69c0 1 Processor -- start 2024-09-10T05:38:21.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.640+0000 7ff0fcff69c0 1 -- start start 2024-09-10T05:38:21.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.640+0000 7ff0fcff69c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa154e81f0 0x55fa155d3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.640+0000 7ff0fcff69c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fa153ee680 con 0x55fa154e81f0 2024-09-10T05:38:21.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.640+0000 7ff0faafc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa154e81f0 0x55fa155d3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.640+0000 7ff0faafc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa154e81f0 0x55fa155d3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38260/0 (socket says 172.21.15.62:38260) 2024-09-10T05:38:21.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.640+0000 7ff0faafc640 1 -- 172.21.15.62:0/3690481365 learned_addr learned my addr 172.21.15.62:0/3690481365 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:21.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.640+0000 7ff0faafc640 1 -- 172.21.15.62:0/3690481365 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa15369da0 con 0x55fa154e81f0 2024-09-10T05:38:21.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.644+0000 7ff0faafc640 1 --2- 172.21.15.62:0/3690481365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa154e81f0 0x55fa155d3880 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec019740 tx=0x7ff0ec0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=109bb16378c783f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.644+0000 7fefe8e09640 1 -- 172.21.15.62:0/3690481365 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0ec0b9070 con 0x55fa154e81f0 2024-09-10T05:38:21.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.644+0000 7fefe8e09640 1 -- 172.21.15.62:0/3690481365 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0ec0aaa90 con 0x55fa154e81f0 2024-09-10T05:38:21.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.644+0000 7fefe8e09640 1 -- 172.21.15.62:0/3690481365 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0ec0aad70 con 0x55fa154e81f0 2024-09-10T05:38:21.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.644+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3690481365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa154e81f0 msgr2=0x55fa155d3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.644+0000 7ff0fcff69c0 1 --2- 172.21.15.62:0/3690481365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa154e81f0 0x55fa155d3880 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec019740 tx=0x7ff0ec0033b0 comp rx=0 tx=0).stop 2024-09-10T05:38:21.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.644+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3690481365 shutdown_connections 2024-09-10T05:38:21.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.644+0000 7ff0fcff69c0 1 --2- 172.21.15.62:0/3690481365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa154e81f0 0x55fa155d3880 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:21.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.644+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3690481365 >> 172.21.15.62:0/3690481365 conn(0x55fa1545bb00 msgr2=0x55fa155cf500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:21.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.644+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3690481365 shutdown_connections 2024-09-10T05:38:21.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.644+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3690481365 wait complete. 2024-09-10T05:38:21.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.644+0000 7ff0fcff69c0 1 Processor -- start 2024-09-10T05:38:21.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.644+0000 7ff0fcff69c0 1 -- start start 2024-09-10T05:38:21.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.644+0000 7ff0fcff69c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa154e81f0 0x55fa155dac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.644+0000 7ff0fcff69c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fa15390a50 con 0x55fa154e81f0 2024-09-10T05:38:21.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.644+0000 7ff0faafc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa154e81f0 0x55fa155dac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.644+0000 7ff0faafc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa154e81f0 0x55fa155dac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38276/0 (socket says 172.21.15.62:38276) 2024-09-10T05:38:21.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.644+0000 7ff0faafc640 1 -- 172.21.15.62:0/3267420396 learned_addr learned my addr 172.21.15.62:0/3267420396 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:21.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.644+0000 7ff0faafc640 1 -- 172.21.15.62:0/3267420396 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa155db170 con 0x55fa154e81f0 2024-09-10T05:38:21.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.644+0000 7ff0faafc640 1 --2- 172.21.15.62:0/3267420396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa154e81f0 0x55fa155dac10 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec018cc0 tx=0x7ff0ec017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.644+0000 7fefe7606640 1 -- 172.21.15.62:0/3267420396 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0ec0b9030 con 0x55fa154e81f0 2024-09-10T05:38:21.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.648+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3267420396 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fa155db400 con 0x55fa154e81f0 2024-09-10T05:38:21.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.648+0000 7fefe7606640 1 -- 172.21.15.62:0/3267420396 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0ec0b5dd0 con 0x55fa154e81f0 2024-09-10T05:38:21.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.648+0000 7fefe7606640 1 -- 172.21.15.62:0/3267420396 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0ec0aae60 con 0x55fa154e81f0 2024-09-10T05:38:21.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.648+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3267420396 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa155dbe30 con 0x55fa154e81f0 2024-09-10T05:38:21.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.648+0000 7fefe7606640 1 -- 172.21.15.62:0/3267420396 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff0ec0b3040 con 0x55fa154e81f0 2024-09-10T05:38:21.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.648+0000 7fefe7606640 1 --2- 172.21.15.62:0/3267420396 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fefe0039ac0 0x7fefe003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.648+0000 7fefe7606640 1 -- 172.21.15.62:0/3267420396 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7ff0ec0c4030 con 0x55fa154e81f0 2024-09-10T05:38:21.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.648+0000 7ff0fa2fb640 1 --2- 172.21.15.62:0/3267420396 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fefe0039ac0 0x7fefe003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.648+0000 7ff0fcff69c0 1 --2- 172.21.15.62:0/3267420396 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55fa154eb330 0x55fa155e1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.648+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3267420396 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa155e22c0 con 0x55fa154eb330 2024-09-10T05:38:21.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.648+0000 7ff0fb2fd640 1 --2- 172.21.15.62:0/3267420396 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55fa154eb330 0x55fa155e1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.648+0000 7ff0fa2fb640 1 --2- 172.21.15.62:0/3267420396 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fefe0039ac0 0x7fefe003bf80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0001e40 tx=0x7ff0f00013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.648+0000 7ff0fb2fd640 1 --2- 172.21.15.62:0/3267420396 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55fa154eb330 0x55fa155e1d80 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.648+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3267420396 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0f40083f0 con 0x55fa154eb330 2024-09-10T05:38:21.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.648+0000 7ff0fcff69c0 1 --2- 172.21.15.62:0/3267420396 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55fa155e2d70 0x55fa155e5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.648+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3267420396 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa155e59a0 con 0x55fa155e2d70 2024-09-10T05:38:21.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.648+0000 7ff0faafc640 1 --2- 172.21.15.62:0/3267420396 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55fa155e2d70 0x55fa155e5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.648+0000 7ff0faafc640 1 --2- 172.21.15.62:0/3267420396 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55fa155e2d70 0x55fa155e5230 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.652+0000 7ff0faafc640 1 -- 172.21.15.62:0/3267420396 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff0ec0cfd10 con 0x55fa155e2d70 2024-09-10T05:38:21.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.652+0000 7ff0fcff69c0 1 --2- 172.21.15.62:0/3267420396 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55fa155e7760 0x55fa155e9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.652+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3267420396 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa155ea220 con 0x55fa155e7760 2024-09-10T05:38:21.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.652+0000 7ff0fa2fb640 1 --2- 172.21.15.62:0/3267420396 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55fa155e7760 0x55fa155e9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.652+0000 7ff0fa2fb640 1 --2- 172.21.15.62:0/3267420396 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55fa155e7760 0x55fa155e9b50 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.652+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3267420396 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff0f000bd60 con 0x55fa155e7760 2024-09-10T05:38:21.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.652+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3267420396 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa155e6600 con 0x55fa155e2d70 2024-09-10T05:38:21.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.652+0000 7ff0faafc640 1 -- 172.21.15.62:0/3267420396 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff0ec0cfd10 con 0x55fa155e2d70 2024-09-10T05:38:21.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.652+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3267420396 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa155e6a20 con 0x55fa155e7760 2024-09-10T05:38:21.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.652+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3267420396 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff0f000bd60 con 0x55fa155e7760 2024-09-10T05:38:21.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.652+0000 7ff0fcff69c0 1 Processor -- start 2024-09-10T05:38:21.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.652+0000 7ff0fcff69c0 1 -- start start 2024-09-10T05:38:21.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.652+0000 7ff0fcff69c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa155f88b0 0x55fa155f8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.652+0000 7ff0fcff69c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fa153fb450 con 0x55fa155f88b0 2024-09-10T05:38:21.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.656+0000 7ff0faafc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa155f88b0 0x55fa155f8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.656+0000 7ff0faafc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa155f88b0 0x55fa155f8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38286/0 (socket says 172.21.15.62:38286) 2024-09-10T05:38:21.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.656+0000 7ff0faafc640 1 -- 172.21.15.62:0/1191837132 learned_addr learned my addr 172.21.15.62:0/1191837132 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:21.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.656+0000 7ff0faafc640 1 -- 172.21.15.62:0/1191837132 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa155f9310 con 0x55fa155f88b0 2024-09-10T05:38:21.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.656+0000 7ff0faafc640 1 --2- 172.21.15.62:0/1191837132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa155f88b0 0x55fa155f8cd0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec0e96a0 tx=0x7ff0ec0b4d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.656+0000 7fefe4e01640 1 -- 172.21.15.62:0/1191837132 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0ec0cf300 con 0x55fa155f88b0 2024-09-10T05:38:21.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.656+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/1191837132 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fa155f9b70 con 0x55fa155f88b0 2024-09-10T05:38:21.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.656+0000 7fefe4e01640 1 -- 172.21.15.62:0/1191837132 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0ec0cf880 con 0x55fa155f88b0 2024-09-10T05:38:21.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.656+0000 7fefe4e01640 1 -- 172.21.15.62:0/1191837132 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0ec0b3c00 con 0x55fa155f88b0 2024-09-10T05:38:21.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.656+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/1191837132 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa155f9b70 con 0x55fa155f88b0 2024-09-10T05:38:21.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.656+0000 7fefe4e01640 1 -- 172.21.15.62:0/1191837132 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff0ec0b43a0 con 0x55fa155f88b0 2024-09-10T05:38:21.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.656+0000 7fefe4e01640 1 --2- 172.21.15.62:0/1191837132 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fefd4039a70 0x7fefd403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.656+0000 7fefe4e01640 1 -- 172.21.15.62:0/1191837132 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7ff0ec0c0070 con 0x55fa155f88b0 2024-09-10T05:38:21.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.656+0000 7ff0fa2fb640 1 --2- 172.21.15.62:0/1191837132 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fefd4039a70 0x7fefd403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.656+0000 7ff0fcff69c0 1 Processor -- start 2024-09-10T05:38:21.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.656+0000 7ff0fcff69c0 1 -- start start 2024-09-10T05:38:21.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.656+0000 7ff0fcff69c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa15604ea0 0x55fa15605280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.656+0000 7ff0fcff69c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fa155d4010 con 0x55fa15604ea0 2024-09-10T05:38:21.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.656+0000 7ff0fa2fb640 1 --2- 172.21.15.62:0/1191837132 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fefd4039a70 0x7fefd403bf30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff0f000c010 tx=0x7ff0f000f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.660+0000 7ff0faafc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa15604ea0 0x55fa15605280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.660+0000 7ff0faafc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa15604ea0 0x55fa15605280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38288/0 (socket says 172.21.15.62:38288) 2024-09-10T05:38:21.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.660+0000 7ff0faafc640 1 -- 172.21.15.62:0/1851234799 learned_addr learned my addr 172.21.15.62:0/1851234799 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:21.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.660+0000 7ff0faafc640 1 -- 172.21.15.62:0/1851234799 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa15605850 con 0x55fa15604ea0 2024-09-10T05:38:21.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.660+0000 7ff0faafc640 1 --2- 172.21.15.62:0/1851234799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa15604ea0 0x55fa15605280 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec0bb5f0 tx=0x7ff0ec0dafd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0f623b23b6dbddf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.660+0000 7fefde7fc640 1 -- 172.21.15.62:0/1851234799 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0ec0ede60 con 0x55fa15604ea0 2024-09-10T05:38:21.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.660+0000 7fefde7fc640 1 -- 172.21.15.62:0/1851234799 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0ec0d7130 con 0x55fa15604ea0 2024-09-10T05:38:21.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.660+0000 7fefde7fc640 1 -- 172.21.15.62:0/1851234799 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0ec0071d0 con 0x55fa15604ea0 2024-09-10T05:38:21.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.660+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/1851234799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa15604ea0 msgr2=0x55fa15605280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.660+0000 7ff0fcff69c0 1 --2- 172.21.15.62:0/1851234799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa15604ea0 0x55fa15605280 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec0bb5f0 tx=0x7ff0ec0dafd0 comp rx=0 tx=0).stop 2024-09-10T05:38:21.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.660+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/1851234799 shutdown_connections 2024-09-10T05:38:21.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.660+0000 7ff0fcff69c0 1 --2- 172.21.15.62:0/1851234799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa15604ea0 0x55fa15605280 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:21.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.660+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/1851234799 >> 172.21.15.62:0/1851234799 conn(0x55fa156012f0 msgr2=0x55fa155ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:21.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.660+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/1851234799 shutdown_connections 2024-09-10T05:38:21.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.660+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/1851234799 wait complete. 2024-09-10T05:38:21.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.660+0000 7ff0fcff69c0 1 Processor -- start 2024-09-10T05:38:21.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.660+0000 7ff0fcff69c0 1 -- start start 2024-09-10T05:38:21.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.660+0000 7ff0fcff69c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa15604ea0 0x55fa1560c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.660+0000 7ff0fcff69c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fa15605d30 con 0x55fa15604ea0 2024-09-10T05:38:21.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.660+0000 7ff0faafc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa15604ea0 0x55fa1560c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.660+0000 7ff0faafc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa15604ea0 0x55fa1560c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38292/0 (socket says 172.21.15.62:38292) 2024-09-10T05:38:21.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.660+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 learned_addr learned my addr 172.21.15.62:0/3107957 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:21.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.660+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa1560c6c0 con 0x55fa15604ea0 2024-09-10T05:38:21.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.664+0000 7ff0faafc640 1 --2- 172.21.15.62:0/3107957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa15604ea0 0x55fa1560c160 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec0b24a0 tx=0x7ff0ec0f0f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.664+0000 7fefdcff9640 1 -- 172.21.15.62:0/3107957 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0ec111070 con 0x55fa15604ea0 2024-09-10T05:38:21.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.664+0000 7fefdcff9640 1 -- 172.21.15.62:0/3107957 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0ec0d7130 con 0x55fa15604ea0 2024-09-10T05:38:21.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.664+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fa1560c6c0 con 0x55fa15604ea0 2024-09-10T05:38:21.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.664+0000 7fefdcff9640 1 -- 172.21.15.62:0/3107957 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0ec0ede60 con 0x55fa15604ea0 2024-09-10T05:38:21.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.664+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa1560c6c0 con 0x55fa15604ea0 2024-09-10T05:38:21.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.664+0000 7fefdcff9640 1 -- 172.21.15.62:0/3107957 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff0ec114070 con 0x55fa15604ea0 2024-09-10T05:38:21.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.664+0000 7fefdcff9640 1 --2- 172.21.15.62:0/3107957 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fefc4039a70 0x7fefc403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.664+0000 7fefdcff9640 1 -- 172.21.15.62:0/3107957 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7ff0ec109070 con 0x55fa15604ea0 2024-09-10T05:38:21.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.664+0000 7ff0fcff69c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:21.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.664+0000 7ff0fa2fb640 1 --2- 172.21.15.62:0/3107957 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fefc4039a70 0x7fefc403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.664+0000 7ff0fcff69c0 1 --2- 172.21.15.62:0/3107957 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55fa15617110 0x55fa156195a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.664+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa15619cf0 con 0x55fa15617110 2024-09-10T05:38:21.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.664+0000 7ff0fb2fd640 1 --2- 172.21.15.62:0/3107957 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55fa15617110 0x55fa156195a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.664+0000 7ff0fa2fb640 1 --2- 172.21.15.62:0/3107957 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fefc4039a70 0x7fefc403bf30 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x55fa155dc080 tx=0x7ff0f0010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.664+0000 7ff0fb2fd640 1 --2- 172.21.15.62:0/3107957 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55fa15617110 0x55fa156195a0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.664+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0f40083f0 con 0x55fa15617110 2024-09-10T05:38:21.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.664+0000 7ff0fcff69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:21.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.664+0000 7ff0fcff69c0 20 realm 2024-09-10T05:38:21.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.664+0000 7ff0fcff69c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:21.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.664+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa156164a0 con 0x55fa15617110 2024-09-10T05:38:21.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.668+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0f40083f0 con 0x55fa15617110 2024-09-10T05:38:21.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.668+0000 7ff0fcff69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:21.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.668+0000 7ff0fcff69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:38:21.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.668+0000 7ff0fcff69c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:21.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.668+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa1561a7b0 con 0x55fa15617110 2024-09-10T05:38:21.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.668+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0f40083f0 con 0x55fa15617110 2024-09-10T05:38:21.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.668+0000 7ff0fcff69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:21.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.668+0000 7ff0fcff69c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:21.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.668+0000 7ff0fcff69c0 1 --2- 172.21.15.62:0/3107957 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55fa1561b590 0x55fa1561d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.668+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa1561e050 con 0x55fa1561b590 2024-09-10T05:38:21.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.668+0000 7ff0faafc640 1 --2- 172.21.15.62:0/3107957 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55fa1561b590 0x55fa1561d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.668+0000 7ff0faafc640 1 --2- 172.21.15.62:0/3107957 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55fa1561b590 0x55fa1561d980 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.668+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff0ec113030 con 0x55fa1561b590 2024-09-10T05:38:21.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.668+0000 7ff0fcff69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:38:21.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.668+0000 7ff0fcff69c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:21.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.668+0000 7ff0fcff69c0 1 --2- 172.21.15.62:0/3107957 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55fa1561edb0 0x55fa156211c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.668+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa15621950 con 0x55fa1561edb0 2024-09-10T05:38:21.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.668+0000 7ff0fa2fb640 1 --2- 172.21.15.62:0/3107957 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55fa1561edb0 0x55fa156211c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.668+0000 7ff0fa2fb640 1 --2- 172.21.15.62:0/3107957 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55fa1561edb0 0x55fa156211c0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.668+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3107957 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff0f000bd60 con 0x55fa1561edb0 2024-09-10T05:38:21.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.668+0000 7ff0fcff69c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:38:21.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.668+0000 7ff0fcff69c0 20 searching for the correct realm 2024-09-10T05:38:21.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.668+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa15623220 con 0x55fa1561edb0 2024-09-10T05:38:21.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.668+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3107957 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f000bd60 con 0x55fa1561edb0 2024-09-10T05:38:21.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.668+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa15623220 con 0x55fa1561b590 2024-09-10T05:38:21.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.672+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0ec113030 con 0x55fa1561b590 2024-09-10T05:38:21.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.672+0000 7ff0faafc640 1 --2- 172.21.15.62:0/3107957 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7ff0ec116060 0x7ff0ec0a47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.672+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa15623220 con 0x7ff0ec116060 2024-09-10T05:38:21.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.672+0000 7ff0fb2fd640 1 --2- 172.21.15.62:0/3107957 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7ff0ec116060 0x7ff0ec0a47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.672+0000 7ff0fb2fd640 1 --2- 172.21.15.62:0/3107957 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7ff0ec116060 0x7ff0ec0a47d0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.672+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f40083f0 con 0x7ff0ec116060 2024-09-10T05:38:21.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.672+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa15623220 con 0x55fa15617110 2024-09-10T05:38:21.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.672+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f40083f0 con 0x55fa15617110 2024-09-10T05:38:21.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.672+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa15623220 con 0x55fa15617110 2024-09-10T05:38:21.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.672+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f40083f0 con 0x55fa15617110 2024-09-10T05:38:21.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.672+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa15623220 con 0x55fa1561edb0 2024-09-10T05:38:21.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.672+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3107957 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f000bd60 con 0x55fa1561edb0 2024-09-10T05:38:21.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.672+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa15623220 con 0x55fa15617110 2024-09-10T05:38:21.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.672+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f40083f0 con 0x55fa15617110 2024-09-10T05:38:21.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.672+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa15623220 con 0x55fa1561b590 2024-09-10T05:38:21.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.672+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0ec113030 con 0x55fa1561b590 2024-09-10T05:38:21.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.672+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa15623220 con 0x55fa1561b590 2024-09-10T05:38:21.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.676+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0ec113030 con 0x55fa1561b590 2024-09-10T05:38:21.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.676+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa15623220 con 0x55fa15617110 2024-09-10T05:38:21.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.676+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f40083f0 con 0x55fa15617110 2024-09-10T05:38:21.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.676+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa15623220 con 0x7ff0ec116060 2024-09-10T05:38:21.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.676+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f40083f0 con 0x7ff0ec116060 2024-09-10T05:38:21.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.676+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa15623220 con 0x55fa15617110 2024-09-10T05:38:21.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.676+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f40083f0 con 0x55fa15617110 2024-09-10T05:38:21.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.676+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa15623220 con 0x7ff0ec116060 2024-09-10T05:38:21.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.676+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff0f40083f0 con 0x7ff0ec116060 2024-09-10T05:38:21.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.676+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa15623220 con 0x55fa1561b590 2024-09-10T05:38:21.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.676+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0ec113030 con 0x55fa1561b590 2024-09-10T05:38:21.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.676+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa15623220 con 0x55fa1561edb0 2024-09-10T05:38:21.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.676+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3107957 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f000bd60 con 0x55fa1561edb0 2024-09-10T05:38:21.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.676+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa15623220 con 0x55fa15617110 2024-09-10T05:38:21.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.676+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f40083f0 con 0x55fa15617110 2024-09-10T05:38:21.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.676+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa15623220 con 0x55fa1561b590 2024-09-10T05:38:21.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.676+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0ec113030 con 0x55fa1561b590 2024-09-10T05:38:21.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.676+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa15623220 con 0x55fa1561edb0 2024-09-10T05:38:21.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.676+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3107957 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 34 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7ff0f000bd60 con 0x55fa1561edb0 2024-09-10T05:38:21.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.676+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa15623220 con 0x55fa15617110 2024-09-10T05:38:21.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.680+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f40083f0 con 0x55fa15617110 2024-09-10T05:38:21.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.680+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa15623220 con 0x55fa15617110 2024-09-10T05:38:21.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.680+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff0f40083f0 con 0x55fa15617110 2024-09-10T05:38:21.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.680+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa15623220 con 0x55fa15617110 2024-09-10T05:38:21.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.680+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f40083f0 con 0x55fa15617110 2024-09-10T05:38:21.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.680+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa15623220 con 0x55fa1561edb0 2024-09-10T05:38:21.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.680+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3107957 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f000bd60 con 0x55fa1561edb0 2024-09-10T05:38:21.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.680+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa15623220 con 0x7ff0ec116060 2024-09-10T05:38:21.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.680+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f40083f0 con 0x7ff0ec116060 2024-09-10T05:38:21.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.680+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa15623220 con 0x55fa15617110 2024-09-10T05:38:21.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.680+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f40083f0 con 0x55fa15617110 2024-09-10T05:38:21.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.680+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa15623220 con 0x7ff0ec116060 2024-09-10T05:38:21.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.680+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f40083f0 con 0x7ff0ec116060 2024-09-10T05:38:21.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.680+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa15623220 con 0x55fa1561edb0 2024-09-10T05:38:21.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.680+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3107957 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f000bd60 con 0x55fa1561edb0 2024-09-10T05:38:21.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.680+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa15623220 con 0x7ff0ec116060 2024-09-10T05:38:21.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.680+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f40083f0 con 0x7ff0ec116060 2024-09-10T05:38:21.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.680+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa15623220 con 0x55fa1561b590 2024-09-10T05:38:21.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.680+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0ec113030 con 0x55fa1561b590 2024-09-10T05:38:21.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.680+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa15623220 con 0x55fa1561b590 2024-09-10T05:38:21.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.684+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0ec113030 con 0x55fa1561b590 2024-09-10T05:38:21.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.684+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa15623220 con 0x55fa1561edb0 2024-09-10T05:38:21.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.684+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3107957 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f000bd60 con 0x55fa1561edb0 2024-09-10T05:38:21.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.684+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa15623220 con 0x55fa1561b590 2024-09-10T05:38:21.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.684+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff0ec113030 con 0x55fa1561b590 2024-09-10T05:38:21.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.684+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa15623220 con 0x55fa1561b590 2024-09-10T05:38:21.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.684+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0ec113030 con 0x55fa1561b590 2024-09-10T05:38:21.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.684+0000 7ff0fcff69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:38:21.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.684+0000 7ff0fcff69c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:38:21.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.684+0000 7ff0fcff69c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:38:21.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.684+0000 7ff0fcff69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:38:21.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.684+0000 7ff0fcff69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:38:21.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.684+0000 7ff0fcff69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:38:21.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.684+0000 7ff0fcff69c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:21.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.684+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa15622310 con 0x55fa15617110 2024-09-10T05:38:21.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.684+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0f40083f0 con 0x55fa15617110 2024-09-10T05:38:21.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.684+0000 7ff0fcff69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:21.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.684+0000 7ff0fcff69c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:21.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.684+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa15622bb0 con 0x55fa1561b590 2024-09-10T05:38:21.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.684+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff0ec113030 con 0x55fa1561b590 2024-09-10T05:38:21.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.684+0000 7ff0fcff69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:38:21.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.684+0000 7ff0fcff69c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:21.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.684+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa15621f50 con 0x55fa1561edb0 2024-09-10T05:38:21.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.684+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3107957 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff0f000bd60 con 0x55fa1561edb0 2024-09-10T05:38:21.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.684+0000 7ff0fcff69c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:38:21.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.684+0000 7ff0fcff69c0 20 zone default found 2024-09-10T05:38:21.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.684+0000 7ff0fcff69c0 4 Realm: () 2024-09-10T05:38:21.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.684+0000 7ff0fcff69c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:38:21.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.684+0000 7ff0fcff69c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:38:21.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.684+0000 7ff0fcff69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:38:21.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.684+0000 7ff0fcff69c0 20 zonegroup default 2024-09-10T05:38:21.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.684+0000 7ff0fcff69c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:21.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.684+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa15623b00 con 0x7ff0ec116060 2024-09-10T05:38:21.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.684+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff0f40083f0 con 0x7ff0ec116060 2024-09-10T05:38:21.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.684+0000 7ff0fcff69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:21.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.684+0000 7ff0fcff69c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:21.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.684+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa15625d40 con 0x55fa1561edb0 2024-09-10T05:38:21.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.688+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3107957 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff0f000bd60 con 0x55fa1561edb0 2024-09-10T05:38:21.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.688+0000 7ff0fcff69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:21.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.688+0000 7ff0fcff69c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:21.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.688+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa156260e0 con 0x55fa1561edb0 2024-09-10T05:38:21.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.688+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3107957 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff0f000bd60 con 0x55fa1561edb0 2024-09-10T05:38:21.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.688+0000 7ff0fcff69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:21.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.688+0000 7ff0fcff69c0 20 started sync module instance, tier type = 2024-09-10T05:38:21.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.688+0000 7ff0fcff69c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:38:21.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.688+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa156251d0 con 0x55fa1561b590 2024-09-10T05:38:21.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.688+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0ec113030 con 0x55fa1561b590 2024-09-10T05:38:21.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.688+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94532588950976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa15624e30 con 0x55fa1561b590 2024-09-10T05:38:21.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.688+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa15626e90 con 0x55fa15617110 2024-09-10T05:38:21.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.692+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f40083f0 con 0x55fa15617110 2024-09-10T05:38:21.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.692+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94532588956064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa15627730 con 0x55fa15617110 2024-09-10T05:38:21.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.692+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa15628130 con 0x55fa1561b590 2024-09-10T05:38:21.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.692+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94532588950976] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0ec113030 con 0x55fa1561b590 2024-09-10T05:38:21.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.692+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94532588956064] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f40083f0 con 0x55fa15617110 2024-09-10T05:38:21.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.692+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0ec113030 con 0x55fa1561b590 2024-09-10T05:38:21.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.692+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94532588954864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa15627280 con 0x55fa1561b590 2024-09-10T05:38:21.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.692+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa156289d0 con 0x7ff0ec116060 2024-09-10T05:38:21.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.692+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f40083f0 con 0x7ff0ec116060 2024-09-10T05:38:21.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.692+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94532588963104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa15627280 con 0x7ff0ec116060 2024-09-10T05:38:21.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.692+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa15629450 con 0x55fa1561b590 2024-09-10T05:38:21.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.696+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94532588954864] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0ec113030 con 0x55fa1561b590 2024-09-10T05:38:21.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.696+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94532588963104] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f40083f0 con 0x7ff0ec116060 2024-09-10T05:38:21.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.696+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0ec113030 con 0x55fa1561b590 2024-09-10T05:38:21.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.696+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94532588964160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa15628f60 con 0x55fa1561b590 2024-09-10T05:38:21.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.696+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa15629cf0 con 0x55fa1561edb0 2024-09-10T05:38:21.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.696+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3107957 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f000bd60 con 0x55fa1561edb0 2024-09-10T05:38:21.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.696+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94532588968000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa15628f60 con 0x55fa1561edb0 2024-09-10T05:38:21.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.696+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa1562a730 con 0x55fa1561edb0 2024-09-10T05:38:21.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.696+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94532588964160] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0ec113030 con 0x55fa1561b590 2024-09-10T05:38:21.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.700+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3107957 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(56 notify.6 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f000bd60 con 0x55fa1561edb0 2024-09-10T05:38:21.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.700+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94532588960832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa1562a730 con 0x55fa1561edb0 2024-09-10T05:38:21.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.700+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa1562b0f0 con 0x7ff0ec116060 2024-09-10T05:38:21.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.700+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3107957 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94532588968000] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f000bd60 con 0x55fa1561edb0 2024-09-10T05:38:21.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.700+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3107957 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94532588960832] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f000bd60 con 0x55fa1561edb0 2024-09-10T05:38:21.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.700+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f40083f0 con 0x7ff0ec116060 2024-09-10T05:38:21.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.700+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94532588970624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa1562b0f0 con 0x7ff0ec116060 2024-09-10T05:38:21.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.700+0000 7ff0fcff69c0 20 add_watcher() i=0 2024-09-10T05:38:21.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.700+0000 7ff0fcff69c0 20 add_watcher() i=1 2024-09-10T05:38:21.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.700+0000 7ff0fcff69c0 20 add_watcher() i=2 2024-09-10T05:38:21.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.700+0000 7ff0fcff69c0 20 add_watcher() i=3 2024-09-10T05:38:21.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.700+0000 7ff0fcff69c0 20 add_watcher() i=4 2024-09-10T05:38:21.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.700+0000 7ff0fcff69c0 20 add_watcher() i=5 2024-09-10T05:38:21.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.700+0000 7ff0fcff69c0 20 add_watcher() i=6 2024-09-10T05:38:21.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.700+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94532588970624] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f40083f0 con 0x7ff0ec116060 2024-09-10T05:38:21.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.700+0000 7ff0fcff69c0 20 add_watcher() i=7 2024-09-10T05:38:21.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.700+0000 7ff0fcff69c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:38:21.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.700+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa1562b0f0 con 0x55fa15617110 2024-09-10T05:38:21.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.700+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff0f40083f0 con 0x55fa15617110 2024-09-10T05:38:21.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.704+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94532588973120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa1562b0a0 con 0x55fa15617110 2024-09-10T05:38:21.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.704+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94532588973120] v34'238 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff0f40083f0 con 0x55fa15617110 2024-09-10T05:38:21.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.704+0000 7fefb17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:38:21.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.704+0000 7ff0fcff69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:38:21.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.704+0000 7ff0fcff69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:38:21.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.704+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa156369b0 con 0x55fa1561b590 2024-09-10T05:38:21.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.708+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'58 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff0ec113030 con 0x55fa1561b590 2024-09-10T05:38:21.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.708+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa15636a70 con 0x7ff0ec116060 2024-09-10T05:38:21.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.708+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff0f40083f0 con 0x7ff0ec116060 2024-09-10T05:38:21.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.708+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa15637110 con 0x55fa1561edb0 2024-09-10T05:38:21.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.708+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3107957 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff0f000bd60 con 0x55fa1561edb0 2024-09-10T05:38:21.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.708+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa156375c0 con 0x55fa15617110 2024-09-10T05:38:21.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.712+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'239 uv172 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff0f40083f0 con 0x55fa15617110 2024-09-10T05:38:21.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.712+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa15636020 con 0x55fa1561b590 2024-09-10T05:38:21.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.712+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'80 uv61 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff0ec113030 con 0x55fa1561b590 2024-09-10T05:38:21.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.712+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa15636020 con 0x55fa1561edb0 2024-09-10T05:38:21.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.716+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3107957 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'61 uv48 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff0f000bd60 con 0x55fa1561edb0 2024-09-10T05:38:21.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.716+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa15636020 con 0x55fa1561b590 2024-09-10T05:38:21.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.716+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'39 uv31 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff0ec113030 con 0x55fa1561b590 2024-09-10T05:38:21.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.716+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa15636020 con 0x55fa15617110 2024-09-10T05:38:21.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.720+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'55 uv42 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff0f40083f0 con 0x55fa15617110 2024-09-10T05:38:21.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.720+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa156382f0 con 0x55fa1561b590 2024-09-10T05:38:21.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.720+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff0ec113030 con 0x55fa1561b590 2024-09-10T05:38:21.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.720+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa156382f0 con 0x55fa1561b590 2024-09-10T05:38:21.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.724+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff0ec113030 con 0x55fa1561b590 2024-09-10T05:38:21.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.724+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa156382f0 con 0x55fa1561b590 2024-09-10T05:38:21.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.728+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'81 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0ec113030 con 0x55fa1561b590 2024-09-10T05:38:21.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.728+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa156382f0 con 0x55fa1561edb0 2024-09-10T05:38:21.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.728+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3107957 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'35 uv25 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0f000bd60 con 0x55fa1561edb0 2024-09-10T05:38:21.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.728+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa156387a0 con 0x55fa1561b590 2024-09-10T05:38:21.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.732+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0ec113030 con 0x55fa1561b590 2024-09-10T05:38:21.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.732+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa156387a0 con 0x55fa15617110 2024-09-10T05:38:21.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.732+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'67 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0f40083f0 con 0x55fa15617110 2024-09-10T05:38:21.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.732+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa156387a0 con 0x55fa15617110 2024-09-10T05:38:21.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.732+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'240 uv168 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0f40083f0 con 0x55fa15617110 2024-09-10T05:38:21.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.732+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa15638830 con 0x55fa1561b590 2024-09-10T05:38:21.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.736+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 <== osd.0 v2:172.21.15.2:6800/945139080 25 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'75 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0ec113030 con 0x55fa1561b590 2024-09-10T05:38:21.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.736+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa15638830 con 0x55fa1561b590 2024-09-10T05:38:21.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.736+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 <== osd.0 v2:172.21.15.2:6800/945139080 26 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'82 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0ec113030 con 0x55fa1561b590 2024-09-10T05:38:21.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.740+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa15638830 con 0x55fa1561edb0 2024-09-10T05:38:21.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.740+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3107957 <== osd.3 v2:172.21.15.62:6816/2708991149 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'40 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0f000bd60 con 0x55fa1561edb0 2024-09-10T05:38:21.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.740+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa15638830 con 0x55fa1561b590 2024-09-10T05:38:21.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.744+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 <== osd.0 v2:172.21.15.2:6800/945139080 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0ec113030 con 0x55fa1561b590 2024-09-10T05:38:21.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.744+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa15638890 con 0x55fa15617110 2024-09-10T05:38:21.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.744+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.1 v2:172.21.15.62:6808/3442097179 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'241 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0f40083f0 con 0x55fa15617110 2024-09-10T05:38:21.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.744+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa15638890 con 0x55fa1561b590 2024-09-10T05:38:21.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.748+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 <== osd.0 v2:172.21.15.2:6800/945139080 28 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'76 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0ec113030 con 0x55fa1561b590 2024-09-10T05:38:21.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.748+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa15638830 con 0x7ff0ec116060 2024-09-10T05:38:21.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.748+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'45 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0f40083f0 con 0x7ff0ec116060 2024-09-10T05:38:21.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.748+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa15638830 con 0x55fa1561edb0 2024-09-10T05:38:21.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.748+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3107957 <== osd.3 v2:172.21.15.62:6816/2708991149 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0f000bd60 con 0x55fa1561edb0 2024-09-10T05:38:21.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.748+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa15638980 con 0x55fa1561b590 2024-09-10T05:38:21.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.752+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 <== osd.0 v2:172.21.15.2:6800/945139080 29 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'47 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0ec113030 con 0x55fa1561b590 2024-09-10T05:38:21.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.752+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa15638980 con 0x55fa1561edb0 2024-09-10T05:38:21.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.756+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3107957 <== osd.3 v2:172.21.15.62:6816/2708991149 21 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0f000bd60 con 0x55fa1561edb0 2024-09-10T05:38:21.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.756+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa15638a70 con 0x55fa1561edb0 2024-09-10T05:38:21.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.756+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3107957 <== osd.3 v2:172.21.15.62:6816/2708991149 22 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'62 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0f000bd60 con 0x55fa1561edb0 2024-09-10T05:38:21.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.756+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa15638a70 con 0x55fa1561edb0 2024-09-10T05:38:21.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.760+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3107957 <== osd.3 v2:172.21.15.62:6816/2708991149 23 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0f000bd60 con 0x55fa1561edb0 2024-09-10T05:38:21.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.760+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa15638a50 con 0x55fa1561b590 2024-09-10T05:38:21.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.760+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 <== osd.0 v2:172.21.15.2:6800/945139080 30 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'43 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0ec113030 con 0x55fa1561b590 2024-09-10T05:38:21.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.760+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa15638a50 con 0x55fa15617110 2024-09-10T05:38:21.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.764+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.1 v2:172.21.15.62:6808/3442097179 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'56 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0f40083f0 con 0x55fa15617110 2024-09-10T05:38:21.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.764+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa15638a50 con 0x55fa1561b590 2024-09-10T05:38:21.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.764+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 <== osd.0 v2:172.21.15.2:6800/945139080 31 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'77 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0ec113030 con 0x55fa1561b590 2024-09-10T05:38:21.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.764+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa15638a50 con 0x55fa15617110 2024-09-10T05:38:21.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.768+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.1 v2:172.21.15.62:6808/3442097179 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'68 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0f40083f0 con 0x55fa15617110 2024-09-10T05:38:21.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.768+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa15638a90 con 0x7ff0ec116060 2024-09-10T05:38:21.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.768+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0f40083f0 con 0x7ff0ec116060 2024-09-10T05:38:21.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.768+0000 7fef2bfff640 20 reqs_thread_entry: start 2024-09-10T05:38:21.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.768+0000 7ff0fcff69c0 20 init_complete bucket index max shards: 11 2024-09-10T05:38:21.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.768+0000 7ff0fcff69c0 20 Filter name: none 2024-09-10T05:38:21.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.768+0000 7fef29ffb640 20 reqs_thread_entry: start 2024-09-10T05:38:21.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.768+0000 7ff0fcff69c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T05:38:21.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.768+0000 7ff0fcff69c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:21.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.768+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa15635220 con 0x55fa15617110 2024-09-10T05:38:21.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.768+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.1 v2:172.21.15.62:6808/3442097179 26 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff0f40083f0 con 0x55fa15617110 2024-09-10T05:38:21.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.768+0000 7ff0fcff69c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:38:21.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.768+0000 7ff0fcff69c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T05:38:21.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.768+0000 7ff0fcff69c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:38:21.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.768+0000 7ff0fcff69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:38:21.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.772+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa15656130 con 0x7ff0ec116060 2024-09-10T05:38:21.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.772+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.2 v2:172.21.15.62:6800/2677868286 15 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv43 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7ff0f40083f0 con 0x7ff0ec116060 2024-09-10T05:38:21.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.772+0000 7ff0fcff69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7 : miss 2024-09-10T05:38:21.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.772+0000 7ff0fcff69c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:21.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.772+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:96 8.1b 8:dcc59b19:root::.bucket.meta.myfoo%3a475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa15656130 con 0x7ff0ec116060 2024-09-10T05:38:21.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.772+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.2 v2:172.21.15.62:6800/2677868286 16 ==== osd_op_reply(96 .bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7ff0f40083f0 con 0x7ff0ec116060 2024-09-10T05:38:21.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.772+0000 7ff0fcff69c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T05:38:21.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.772+0000 7ff0fcff69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7 info.flags=0x17 2024-09-10T05:38:21.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.772+0000 7ff0fcff69c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7 to cache LRU end 2024-09-10T05:38:21.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.772+0000 7ff0fcff69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:38:21.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.772+0000 7ff0fcff69c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T05:38:21.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.772+0000 7ff0fcff69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7 2024-09-10T05:38:21.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.772+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:97 4.e 4:7145669d:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa156d36f0 con 0x7ff0ec116060 2024-09-10T05:38:21.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.772+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.2 v2:172.21.15.62:6800/2677868286 17 ==== osd_op_reply(97 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.0 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff0f40083f0 con 0x7ff0ec116060 2024-09-10T05:38:21.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.772+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:98 4.1a 4:5b443486:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa156d36f0 con 0x55fa1561b590 2024-09-10T05:38:21.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.772+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 <== osd.0 v2:172.21.15.2:6800/945139080 32 ==== osd_op_reply(98 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.1 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff0ec113030 con 0x55fa1561b590 2024-09-10T05:38:21.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.772+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:99 4.12 4:4ab7fd09:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa156d36f0 con 0x55fa15617110 2024-09-10T05:38:21.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.772+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.1 v2:172.21.15.62:6808/3442097179 27 ==== osd_op_reply(99 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff0f40083f0 con 0x55fa15617110 2024-09-10T05:38:21.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.772+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:100 4.2 4:416193f4:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa156d36f0 con 0x55fa15617110 2024-09-10T05:38:21.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.772+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.1 v2:172.21.15.62:6808/3442097179 28 ==== osd_op_reply(100 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.3 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff0f40083f0 con 0x55fa15617110 2024-09-10T05:38:21.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.772+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:101 4.32 4:4e5b315a:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa156d36b0 con 0x55fa1561b590 2024-09-10T05:38:21.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.776+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 <== osd.0 v2:172.21.15.2:6800/945139080 33 ==== osd_op_reply(101 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.4 [call out=430b] v0'0 uv12 ondisk = 0) ==== 194+0+430 (crc 0 0 0) 0x7ff0ec113030 con 0x55fa1561b590 2024-09-10T05:38:21.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.776+0000 7ff0fcff69c0 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2024-09-10T05:38:21.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.776+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:102 4.29 4:97e17487:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa156d36b0 con 0x55fa1561edb0 2024-09-10T05:38:21.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.776+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3107957 <== osd.3 v2:172.21.15.62:6816/2708991149 24 ==== osd_op_reply(102 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.5 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff0f000bd60 con 0x55fa1561edb0 2024-09-10T05:38:21.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.776+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:103 4.32 4:4c93bb4d:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa156d36b0 con 0x55fa1561b590 2024-09-10T05:38:21.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.776+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 <== osd.0 v2:172.21.15.2:6800/945139080 34 ==== osd_op_reply(103 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.6 [call out=89b] v0'0 uv10 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff0ec133070 con 0x55fa1561b590 2024-09-10T05:38:21.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.776+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:104 4.19 4:99a816a4:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa156d3730 con 0x55fa1561edb0 2024-09-10T05:38:21.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.776+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3107957 <== osd.3 v2:172.21.15.62:6816/2708991149 25 ==== osd_op_reply(104 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff0f000bd60 con 0x55fa1561edb0 2024-09-10T05:38:21.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.776+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:105 4.1 4:82fa1628:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa156d3730 con 0x7ff0ec116060 2024-09-10T05:38:21.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.776+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.2 v2:172.21.15.62:6800/2677868286 18 ==== osd_op_reply(105 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.8 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff0f40083f0 con 0x7ff0ec116060 2024-09-10T05:38:21.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.776+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:106 4.2a 4:57a22693:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa156d3730 con 0x55fa15617110 2024-09-10T05:38:21.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.776+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.1 v2:172.21.15.62:6808/3442097179 29 ==== osd_op_reply(106 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.9 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff0f40083f0 con 0x55fa15617110 2024-09-10T05:38:21.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.776+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:107 4.4 4:21888cc4:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa156d3730 con 0x55fa15617110 2024-09-10T05:38:21.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.780+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.1 v2:172.21.15.62:6808/3442097179 30 ==== osd_op_reply(107 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7ff0f40083f0 con 0x55fa15617110 2024-09-10T05:38:21.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.780+0000 7ff0fcff69c0 20 get_obj_state: octx=0x7ff0f4008b20 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x55fa156d17b8 s->prefetch_data=0 2024-09-10T05:38:21.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.780+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:108 3.0 3:027cc0a6:::475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7_15f6f8dc036519d7fe15b39338f6e5db:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa156d25e0 con 0x55fa15617110 2024-09-10T05:38:21.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.780+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.1 v2:172.21.15.62:6808/3442097179 31 ==== osd_op_reply(108 475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7_15f6f8dc036519d7fe15b39338f6e5db [getxattrs out=879b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7ff0f40083f0 con 0x55fa15617110 2024-09-10T05:38:21.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.780+0000 7ff0fcff69c0 10 manifest: total_size = 6 2024-09-10T05:38:21.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.780+0000 7ff0fcff69c0 20 get_obj_state: setting s->obj_tag to 475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.15539147268484789101 2024-09-10T05:38:21.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.780+0000 7ff0fcff69c0 20 get_obj_state: octx=0x7ff0f4008b20 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x55fa156d17b8 s->prefetch_data=0 2024-09-10T05:38:21.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.780+0000 7ff0fcff69c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa156d17b8 2024-09-10T05:38:21.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.780+0000 7ff0fcff69c0 20 bucket index object: :.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.4 2024-09-10T05:38:21.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.780+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:109 4.32 4:4e5b315a:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa156d3160 con 0x55fa1561b590 2024-09-10T05:38:21.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.780+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 <== osd.0 v2:172.21.15.2:6800/945139080 35 ==== osd_op_reply(109 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.4 [stat,call,call] v34'13 uv13 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7ff0ec133070 con 0x55fa1561b590 2024-09-10T05:38:21.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.780+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:110 3.0 3:027cc0a6:::475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa156d3160 con 0x55fa15617110 2024-09-10T05:38:21.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.784+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.1 v2:172.21.15.62:6808/3442097179 32 ==== osd_op_reply(110 475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7_15f6f8dc036519d7fe15b39338f6e5db [call] v34'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7ff0f40083f0 con 0x55fa15617110 2024-09-10T05:38:21.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.784+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:111 4.32 4:4e5b315a:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa1565aee0 con 0x55fa1561b590 2024-09-10T05:38:21.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.784+0000 7ff0fcff69c0 20 list_objects_ordered: starting attempt 1 2024-09-10T05:38:21.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.784+0000 7ff0fcff69c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-10T05:38:21.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.784+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:112 4.e 4:7145669d:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa1565aee0 con 0x7ff0ec116060 2024-09-10T05:38:21.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.784+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:113 4.1a 4:5b443486:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa1565f1d0 con 0x55fa1561b590 2024-09-10T05:38:21.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.784+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:114 4.12 4:4ab7fd09:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa1565aee0 con 0x55fa15617110 2024-09-10T05:38:21.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.784+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:115 4.2 4:416193f4:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa1565f1d0 con 0x55fa15617110 2024-09-10T05:38:21.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.784+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:116 4.32 4:4e5b315a:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa15666750 con 0x55fa1561b590 2024-09-10T05:38:21.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.784+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:117 4.29 4:97e17487:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa1565f1d0 con 0x55fa1561edb0 2024-09-10T05:38:21.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.784+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:118 4.32 4:4c93bb4d:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa1566b850 con 0x55fa1561b590 2024-09-10T05:38:21.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.784+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:119 4.19 4:99a816a4:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa1566e540 con 0x55fa1561edb0 2024-09-10T05:38:21.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.784+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:120 4.1 4:82fa1628:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa1566b850 con 0x7ff0ec116060 2024-09-10T05:38:21.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.784+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:121 4.2a 4:57a22693:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa15673910 con 0x55fa15617110 2024-09-10T05:38:21.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.784+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:122 4.4 4:21888cc4:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa15676790 con 0x55fa15617110 2024-09-10T05:38:21.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.784+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3107957 <== osd.3 v2:172.21.15.62:6816/2708991149 26 ==== osd_op_reply(117 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.5 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff0f000bd60 con 0x55fa1561edb0 2024-09-10T05:38:21.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.784+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.2 v2:172.21.15.62:6800/2677868286 19 ==== osd_op_reply(112 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.0 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff0f40083f0 con 0x7ff0ec116060 2024-09-10T05:38:21.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.784+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3107957 <== osd.3 v2:172.21.15.62:6816/2708991149 27 ==== osd_op_reply(119 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff0f000bd60 con 0x55fa1561edb0 2024-09-10T05:38:21.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.784+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.2 v2:172.21.15.62:6800/2677868286 20 ==== osd_op_reply(120 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.8 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff0f40083f0 con 0x7ff0ec116060 2024-09-10T05:38:21.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.784+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.1 v2:172.21.15.62:6808/3442097179 33 ==== osd_op_reply(114 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff0f40083f0 con 0x55fa15617110 2024-09-10T05:38:21.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.784+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.1 v2:172.21.15.62:6808/3442097179 34 ==== osd_op_reply(115 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.3 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff0f40083f0 con 0x55fa15617110 2024-09-10T05:38:21.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.784+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.1 v2:172.21.15.62:6808/3442097179 35 ==== osd_op_reply(121 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.9 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff0f40083f0 con 0x55fa15617110 2024-09-10T05:38:21.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.784+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.1 v2:172.21.15.62:6808/3442097179 36 ==== osd_op_reply(122 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7ff0f40083f0 con 0x55fa15617110 2024-09-10T05:38:21.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.784+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 <== osd.0 v2:172.21.15.2:6800/945139080 36 ==== osd_op_reply(113 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.1 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff0ec133070 con 0x55fa1561b590 2024-09-10T05:38:21.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.784+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 <== osd.0 v2:172.21.15.2:6800/945139080 37 ==== osd_op_reply(118 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.6 [call out=89b] v0'0 uv10 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff0ec133070 con 0x55fa1561b590 2024-09-10T05:38:21.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.784+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 <== osd.0 v2:172.21.15.2:6800/945139080 38 ==== osd_op_reply(111 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.4 [stat,call,call] v34'14 uv14 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7ff0ec133070 con 0x55fa1561b590 2024-09-10T05:38:21.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.784+0000 7fefde7fc640 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2024-09-10T05:38:21.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.788+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 <== osd.0 v2:172.21.15.2:6800/945139080 39 ==== osd_op_reply(116 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.4 [call out=128b] v0'0 uv14 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7ff0ec133070 con 0x55fa1561b590 2024-09-10T05:38:21.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.788+0000 7ff0fcff69c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-10T05:38:21.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.788+0000 7ff0fcff69c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-10T05:38:21.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.788+0000 7ff0fcff69c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-10T05:38:21.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.788+0000 7ff0fcff69c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-10T05:38:21.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.788+0000 7ff0fcff69c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7])"; uploads.size()=0; is_truncated=0 2024-09-10T05:38:21.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.788+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:123 4.e 4:7145669d:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa15676710 con 0x7ff0ec116060 2024-09-10T05:38:21.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.788+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:124 4.1a 4:5b443486:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa15676030 con 0x55fa1561b590 2024-09-10T05:38:21.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.788+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:125 4.12 4:4ab7fd09:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa15674780 con 0x55fa15617110 2024-09-10T05:38:21.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.788+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:126 4.2 4:416193f4:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa15670a10 con 0x55fa15617110 2024-09-10T05:38:21.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.788+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:127 4.32 4:4e5b315a:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa1565dd10 con 0x55fa1561b590 2024-09-10T05:38:21.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.788+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:128 4.29 4:97e17487:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa15657cb0 con 0x55fa1561edb0 2024-09-10T05:38:21.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.788+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:129 4.32 4:4c93bb4d:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa15676030 con 0x55fa1561b590 2024-09-10T05:38:21.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.788+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:130 4.19 4:99a816a4:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa15676710 con 0x55fa1561edb0 2024-09-10T05:38:21.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.788+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:131 4.1 4:82fa1628:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa1565dd10 con 0x7ff0ec116060 2024-09-10T05:38:21.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.788+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:132 4.2a 4:57a22693:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa15676030 con 0x55fa15617110 2024-09-10T05:38:21.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.788+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:133 4.4 4:21888cc4:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa15670a10 con 0x55fa15617110 2024-09-10T05:38:21.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.788+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3107957 <== osd.3 v2:172.21.15.62:6816/2708991149 28 ==== osd_op_reply(128 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.5 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff0f000bd60 con 0x55fa1561edb0 2024-09-10T05:38:21.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.788+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3107957 <== osd.3 v2:172.21.15.62:6816/2708991149 29 ==== osd_op_reply(130 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff0f000bd60 con 0x55fa1561edb0 2024-09-10T05:38:21.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.788+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.2 v2:172.21.15.62:6800/2677868286 21 ==== osd_op_reply(123 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.0 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff0f40083f0 con 0x7ff0ec116060 2024-09-10T05:38:21.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.788+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.1 v2:172.21.15.62:6808/3442097179 37 ==== osd_op_reply(125 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff0f40083f0 con 0x55fa15617110 2024-09-10T05:38:21.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.788+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.1 v2:172.21.15.62:6808/3442097179 38 ==== osd_op_reply(133 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7ff0f40083f0 con 0x55fa15617110 2024-09-10T05:38:21.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.788+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.1 v2:172.21.15.62:6808/3442097179 39 ==== osd_op_reply(126 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.3 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff0f40083f0 con 0x55fa15617110 2024-09-10T05:38:21.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.788+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.1 v2:172.21.15.62:6808/3442097179 40 ==== osd_op_reply(132 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.9 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff0f40083f0 con 0x55fa15617110 2024-09-10T05:38:21.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.788+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 <== osd.0 v2:172.21.15.2:6800/945139080 40 ==== osd_op_reply(124 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.1 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff0ec133070 con 0x55fa1561b590 2024-09-10T05:38:21.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.788+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.2 v2:172.21.15.62:6800/2677868286 22 ==== osd_op_reply(131 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.8 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff0f40083f0 con 0x7ff0ec116060 2024-09-10T05:38:21.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.788+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 <== osd.0 v2:172.21.15.2:6800/945139080 41 ==== osd_op_reply(127 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.4 [call out=128b] v0'0 uv14 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7ff0ec133070 con 0x55fa1561b590 2024-09-10T05:38:21.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.788+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 <== osd.0 v2:172.21.15.2:6800/945139080 42 ==== osd_op_reply(129 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.6 [call out=89b] v0'0 uv10 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff0ec133070 con 0x55fa1561b590 2024-09-10T05:38:21.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.788+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:134 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa15676030 con 0x7ff0ec116060 2024-09-10T05:38:21.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.788+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.2 v2:172.21.15.62:6800/2677868286 23 ==== osd_op_reply(134 foo.buckets [call] v34'46 uv46 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7ff0f40083f0 con 0x7ff0ec116060 2024-09-10T05:38:21.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.788+0000 7ff0fcff69c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T05:38:21.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.788+0000 7ff0fcff69c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:21.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.788+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:135 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa15676030 con 0x7ff0ec116060 2024-09-10T05:38:21.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.788+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.2 v2:172.21.15.62:6800/2677868286 24 ==== osd_op_reply(135 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv40 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7ff0f40083f0 con 0x7ff0ec116060 2024-09-10T05:38:21.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.788+0000 7ff0fcff69c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T05:38:21.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.788+0000 7ff0fcff69c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-10T05:38:21.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.788+0000 7ff0fcff69c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T05:38:21.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.788+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:136 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa15676030 con 0x7ff0ec116060 2024-09-10T05:38:21.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.792+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.2 v2:172.21.15.62:6800/2677868286 25 ==== osd_op_reply(136 myfoo [call,call,delete] v34'47 uv47 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7ff0f40083f0 con 0x7ff0ec116060 2024-09-10T05:38:21.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.792+0000 7ff0fcff69c0 10 removing default.rgw.meta+root+myfoo from cache 2024-09-10T05:38:21.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.792+0000 7ff0fcff69c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-10T05:38:21.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.792+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:137 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94532589169040 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa15676030 con 0x55fa1561edb0 2024-09-10T05:38:21.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.792+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3107957 <== osd.3 v2:172.21.15.62:6816/2708991149 30 ==== watch-notify(notify (1) cookie 94532588960832 notify 146028888103 ret 0) ==== 191+0+0 (crc 0 0 0) 0x55fa15635f10 con 0x55fa1561edb0 2024-09-10T05:38:21.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.792+0000 7fefde7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888103 cookie 94532588960832 notifier 4780 bl.length()=149 2024-09-10T05:38:21.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.792+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3107957 <== osd.3 v2:172.21.15.62:6816/2708991149 31 ==== osd_op_reply(137 notify.6 [notify cookie 94532589169040 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff0f0052040 con 0x55fa1561edb0 2024-09-10T05:38:21.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.792+0000 7fefde7fc640 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:138 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fefc0003d70 con 0x55fa1561edb0 2024-09-10T05:38:21.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.792+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3107957 <== osd.3 v2:172.21.15.62:6816/2708991149 32 ==== osd_op_reply(138 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f0052040 con 0x55fa1561edb0 2024-09-10T05:38:21.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.792+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3107957 <== osd.3 v2:172.21.15.62:6816/2708991149 33 ==== watch-notify(notify_complete (2) cookie 94532589169040 notify 146028888103 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fa156363c0 con 0x55fa1561edb0 2024-09-10T05:38:21.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.792+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:139 8.1b 8:dcc59b19:root::.bucket.meta.myfoo%3a475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa15676030 con 0x7ff0ec116060 2024-09-10T05:38:21.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.796+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.2 v2:172.21.15.62:6800/2677868286 26 ==== osd_op_reply(139 .bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7 [call,call,delete] v34'2 uv2 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7ff0f40083f0 con 0x7ff0ec116060 2024-09-10T05:38:21.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.796+0000 7ff0fcff69c0 10 removing default.rgw.meta+root+.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7 from cache 2024-09-10T05:38:21.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.796+0000 7ff0fcff69c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7, ofs0, ns] 2024-09-10T05:38:21.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.796+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:140 7.3 7:c609908c:::notify.5:head [notify cookie 94532589150368 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa15676030 con 0x55fa1561edb0 2024-09-10T05:38:21.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.796+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3107957 <== osd.3 v2:172.21.15.62:6816/2708991149 34 ==== watch-notify(notify (1) cookie 94532588968000 notify 146028888104 ret 0) ==== 248+0+0 (crc 0 0 0) 0x55fa156363c0 con 0x55fa1561edb0 2024-09-10T05:38:21.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.796+0000 7fefde7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888104 cookie 94532588968000 notifier 4780 bl.length()=206 2024-09-10T05:38:21.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.796+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3107957 <== osd.3 v2:172.21.15.62:6816/2708991149 35 ==== osd_op_reply(140 notify.5 [notify cookie 94532589150368 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff0f0052040 con 0x55fa1561edb0 2024-09-10T05:38:21.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.796+0000 7fefde7fc640 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:141 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fefc0003d70 con 0x55fa1561edb0 2024-09-10T05:38:21.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.796+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3107957 <== osd.3 v2:172.21.15.62:6816/2708991149 36 ==== osd_op_reply(141 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f0052040 con 0x55fa1561edb0 2024-09-10T05:38:21.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.796+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3107957 <== osd.3 v2:172.21.15.62:6816/2708991149 37 ==== watch-notify(notify_complete (2) cookie 94532589150368 notify 146028888104 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fa1562fff0 con 0x55fa1561edb0 2024-09-10T05:38:21.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.796+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:142 4.e 4:7145669d:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa15676030 con 0x7ff0ec116060 2024-09-10T05:38:21.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.796+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:143 4.1a 4:5b443486:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa15654780 con 0x55fa1561b590 2024-09-10T05:38:21.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.796+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:144 4.12 4:4ab7fd09:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa15654fd0 con 0x55fa15617110 2024-09-10T05:38:21.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.796+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:145 4.2 4:416193f4:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa156553f0 con 0x55fa15617110 2024-09-10T05:38:21.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.796+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:146 4.32 4:4e5b315a:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa15676030 con 0x55fa1561b590 2024-09-10T05:38:21.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.796+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:147 4.29 4:97e17487:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa15654780 con 0x55fa1561edb0 2024-09-10T05:38:21.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.796+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:148 4.32 4:4c93bb4d:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa15654fd0 con 0x55fa1561b590 2024-09-10T05:38:21.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.796+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:149 4.19 4:99a816a4:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa15676030 con 0x55fa1561edb0 2024-09-10T05:38:21.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.796+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:150 4.1 4:82fa1628:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa156553f0 con 0x7ff0ec116060 2024-09-10T05:38:21.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.796+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:151 4.2a 4:57a22693:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa15654fd0 con 0x55fa15617110 2024-09-10T05:38:21.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.796+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:152 4.4 4:21888cc4:::.dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa15654780 con 0x55fa15617110 2024-09-10T05:38:21.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.796+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3107957 <== osd.3 v2:172.21.15.62:6816/2708991149 38 ==== osd_op_reply(147 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.5 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff0f0052040 con 0x55fa1561edb0 2024-09-10T05:38:21.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.796+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.2 v2:172.21.15.62:6800/2677868286 27 ==== osd_op_reply(142 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.0 [delete] v34'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff0f40083f0 con 0x7ff0ec116060 2024-09-10T05:38:21.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.796+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3107957 <== osd.3 v2:172.21.15.62:6816/2708991149 39 ==== osd_op_reply(149 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.7 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff0f0052040 con 0x55fa1561edb0 2024-09-10T05:38:21.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.800+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.2 v2:172.21.15.62:6800/2677868286 28 ==== osd_op_reply(150 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.8 [delete] v34'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff0f40083f0 con 0x7ff0ec116060 2024-09-10T05:38:21.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.800+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 <== osd.0 v2:172.21.15.2:6800/945139080 43 ==== osd_op_reply(146 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.4 [delete] v34'15 uv15 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff0ec133070 con 0x55fa1561b590 2024-09-10T05:38:21.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.800+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 <== osd.0 v2:172.21.15.2:6800/945139080 44 ==== osd_op_reply(143 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.1 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff0ec133070 con 0x55fa1561b590 2024-09-10T05:38:21.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.800+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.1 v2:172.21.15.62:6808/3442097179 41 ==== osd_op_reply(144 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.2 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff0f40083f0 con 0x55fa15617110 2024-09-10T05:38:21.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.800+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.1 v2:172.21.15.62:6808/3442097179 42 ==== osd_op_reply(145 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.3 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff0f40083f0 con 0x55fa15617110 2024-09-10T05:38:21.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.800+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.1 v2:172.21.15.62:6808/3442097179 43 ==== osd_op_reply(152 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.10 [delete] v34'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7ff0f40083f0 con 0x55fa15617110 2024-09-10T05:38:21.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.800+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.1 v2:172.21.15.62:6808/3442097179 44 ==== osd_op_reply(151 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.9 [delete] v34'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff0f40083f0 con 0x55fa15617110 2024-09-10T05:38:21.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.800+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 <== osd.0 v2:172.21.15.2:6800/945139080 45 ==== osd_op_reply(148 .dir.475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7.6 [delete] v34'16 uv16 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff0ec133070 con 0x55fa1561b590 2024-09-10T05:38:21.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.800+0000 7ff0fcff69c0 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7 : miss 2024-09-10T05:38:21.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.800+0000 7ff0fcff69c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:21.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.800+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:153 6.4 6:208becbf:::pubsub..bucket.myfoo%2f475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa15676030 con 0x55fa15617110 2024-09-10T05:38:21.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.800+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.1 v2:172.21.15.62:6808/3442097179 45 ==== osd_op_reply(153 pubsub..bucket.myfoo/475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7ff0f40083f0 con 0x55fa15617110 2024-09-10T05:38:21.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.800+0000 7ff0fcff69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:21.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.800+0000 7ff0fcff69c0 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7 info.flags=0x0 2024-09-10T05:38:21.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.800+0000 7ff0fcff69c0 10 adding default.rgw.log++pubsub..bucket.myfoo/475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7 to cache LRU end 2024-09-10T05:38:21.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.800+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:154 6.4 6:208becbf:::pubsub..bucket.myfoo%2f475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa15676030 con 0x55fa15617110 2024-09-10T05:38:21.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.804+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.1 v2:172.21.15.62:6808/3442097179 46 ==== osd_op_reply(154 pubsub..bucket.myfoo/475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.7 [delete] v34'242 uv172 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7ff0f40083f0 con 0x55fa15617110 2024-09-10T05:38:21.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.804+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:155 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa1565a990 con 0x7ff0ec116060 2024-09-10T05:38:21.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.804+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.2 v2:172.21.15.62:6800/2677868286 29 ==== osd_op_reply(155 foo.buckets [call] v34'48 uv48 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7ff0f40083f0 con 0x7ff0ec116060 2024-09-10T05:38:21.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.804+0000 7ff0fcff69c0 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2024-09-10T05:38:21.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.804+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:156 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa15676030 con 0x55fa15617110 2024-09-10T05:38:21.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.804+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.1 v2:172.21.15.62:6808/3442097179 47 ==== osd_op_reply(156 9te6NH5mcdcq0Tc5i8i1 [delete] v34'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7ff0f40083f0 con 0x55fa15617110 2024-09-10T05:38:21.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.804+0000 7ff0fcff69c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-10T05:38:21.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.804+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:157 7.e 7:7759931f:::notify.3:head [notify cookie 94532589169040 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa15656070 con 0x7ff0ec116060 2024-09-10T05:38:21.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.804+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.2 v2:172.21.15.62:6800/2677868286 30 ==== watch-notify(notify (1) cookie 94532588963104 notify 146028888081 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55fa15655790 con 0x7ff0ec116060 2024-09-10T05:38:21.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.804+0000 7fefddffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888081 cookie 94532588963104 notifier 4780 bl.length()=170 2024-09-10T05:38:21.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.804+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.2 v2:172.21.15.62:6800/2677868286 31 ==== osd_op_reply(157 notify.3 [notify cookie 94532589169040 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff0f40083f0 con 0x7ff0ec116060 2024-09-10T05:38:21.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.804+0000 7fefddffb640 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:158 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fef30003330 con 0x7ff0ec116060 2024-09-10T05:38:21.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.808+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.2 v2:172.21.15.62:6800/2677868286 32 ==== osd_op_reply(158 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f40083f0 con 0x7ff0ec116060 2024-09-10T05:38:21.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.808+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.2 v2:172.21.15.62:6800/2677868286 33 ==== watch-notify(notify_complete (2) cookie 94532589169040 notify 146028888081 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fa15638120 con 0x7ff0ec116060 2024-09-10T05:38:21.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.808+0000 7ff0fcff69c0 10 removing email index: foo@foo.com 2024-09-10T05:38:21.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.808+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:159 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa15676030 con 0x55fa15617110 2024-09-10T05:38:21.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.808+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.1 v2:172.21.15.62:6808/3442097179 48 ==== osd_op_reply(159 foo@foo.com [delete] v34'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7ff0f40083f0 con 0x55fa15617110 2024-09-10T05:38:21.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.808+0000 7ff0fcff69c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-10T05:38:21.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.808+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:160 7.e 7:7759931f:::notify.3:head [notify cookie 94532589169040 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa15656070 con 0x7ff0ec116060 2024-09-10T05:38:21.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.808+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.2 v2:172.21.15.62:6800/2677868286 34 ==== watch-notify(notify (1) cookie 94532588963104 notify 146028888082 ret 0) ==== 204+0+0 (crc 0 0 0) 0x55fa15638120 con 0x7ff0ec116060 2024-09-10T05:38:21.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.808+0000 7fefde7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888082 cookie 94532588963104 notifier 4780 bl.length()=162 2024-09-10T05:38:21.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.808+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.2 v2:172.21.15.62:6800/2677868286 35 ==== osd_op_reply(160 notify.3 [notify cookie 94532589169040 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff0f40083f0 con 0x7ff0ec116060 2024-09-10T05:38:21.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.808+0000 7fefde7fc640 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:161 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fefc0003d70 con 0x7ff0ec116060 2024-09-10T05:38:21.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.808+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.2 v2:172.21.15.62:6800/2677868286 36 ==== watch-notify(notify_complete (2) cookie 94532589169040 notify 146028888082 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fa156359a0 con 0x7ff0ec116060 2024-09-10T05:38:21.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.808+0000 7ff0fcff69c0 10 removing user buckets index 2024-09-10T05:38:21.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.808+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.2 v2:172.21.15.62:6800/2677868286 37 ==== osd_op_reply(161 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f40083f0 con 0x7ff0ec116060 2024-09-10T05:38:21.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.808+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:162 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa15676030 con 0x7ff0ec116060 2024-09-10T05:38:21.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.812+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.2 v2:172.21.15.62:6800/2677868286 38 ==== osd_op_reply(162 foo.buckets [delete] v34'49 uv49 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7ff0f40083f0 con 0x7ff0ec116060 2024-09-10T05:38:21.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.812+0000 7ff0fcff69c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2024-09-10T05:38:21.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.812+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94532589169040 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa15656070 con 0x55fa1561edb0 2024-09-10T05:38:21.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.812+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3107957 <== osd.3 v2:172.21.15.62:6816/2708991149 40 ==== watch-notify(notify (1) cookie 94532588968000 notify 146028888105 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55fa1562fff0 con 0x55fa1561edb0 2024-09-10T05:38:21.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.812+0000 7fefddffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888105 cookie 94532588968000 notifier 4780 bl.length()=160 2024-09-10T05:38:21.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.812+0000 7fefddffb640 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fef30003310 con 0x55fa1561edb0 2024-09-10T05:38:21.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.812+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3107957 <== osd.3 v2:172.21.15.62:6816/2708991149 41 ==== osd_op_reply(163 notify.5 [notify cookie 94532589169040 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff0f0052040 con 0x55fa1561edb0 2024-09-10T05:38:21.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.812+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3107957 <== osd.3 v2:172.21.15.62:6816/2708991149 42 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f0052040 con 0x55fa1561edb0 2024-09-10T05:38:21.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.812+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3107957 <== osd.3 v2:172.21.15.62:6816/2708991149 43 ==== watch-notify(notify_complete (2) cookie 94532589169040 notify 146028888105 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fa15630450 con 0x55fa1561edb0 2024-09-10T05:38:21.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.812+0000 7ff0fcff69c0 10 removing user index: foo 2024-09-10T05:38:21.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.812+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:165 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa15656070 con 0x55fa15617110 2024-09-10T05:38:21.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.812+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.1 v2:172.21.15.62:6808/3442097179 49 ==== osd_op_reply(165 foo [call,call,delete] v34'19 uv19 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7ff0f40083f0 con 0x55fa15617110 2024-09-10T05:38:21.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.812+0000 7ff0fcff69c0 10 removing default.rgw.meta+users.uid+foo from cache 2024-09-10T05:38:21.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.812+0000 7ff0fcff69c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T05:38:21.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.812+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:166 7.d 7:b4812045:::notify.4:head [notify cookie 94532589150320 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa15675fe0 con 0x55fa1561b590 2024-09-10T05:38:21.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.812+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 <== osd.0 v2:172.21.15.2:6800/945139080 46 ==== watch-notify(notify (1) cookie 94532588964160 notify 146028888106 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55fa156365d0 con 0x55fa1561b590 2024-09-10T05:38:21.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.812+0000 7fefde7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888106 cookie 94532588964160 notifier 4780 bl.length()=152 2024-09-10T05:38:21.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.812+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 <== osd.0 v2:172.21.15.2:6800/945139080 47 ==== osd_op_reply(166 notify.4 [notify cookie 94532589150320 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff0ec133070 con 0x55fa1561b590 2024-09-10T05:38:21.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.812+0000 7fefde7fc640 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:167 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fefc0003d70 con 0x55fa1561b590 2024-09-10T05:38:21.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.816+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 <== osd.0 v2:172.21.15.2:6800/945139080 48 ==== watch-notify(notify_complete (2) cookie 94532589150320 notify 146028888106 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7ff0ec0d9030 con 0x55fa1561b590 2024-09-10T05:38:21.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.816+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 <== osd.0 v2:172.21.15.2:6800/945139080 49 ==== osd_op_reply(167 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0ec133070 con 0x55fa1561b590 2024-09-10T05:38:21.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.816+0000 7fefb17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:38:21.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.816+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:168 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94532588973120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa15656070 con 0x55fa15617110 2024-09-10T05:38:21.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.816+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.1 v2:172.21.15.62:6808/3442097179 50 ==== osd_op_reply(168 data_loggenerations_metadata [watch unwatch cookie 94532588973120] v34'243 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff0f40083f0 con 0x55fa15617110 2024-09-10T05:38:21.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.816+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:169 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94532588950976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa1562ac40 con 0x55fa1561b590 2024-09-10T05:38:21.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.820+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 <== osd.0 v2:172.21.15.2:6800/945139080 50 ==== osd_op_reply(169 notify.0 [watch unwatch cookie 94532588950976] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0ec133070 con 0x55fa1561b590 2024-09-10T05:38:21.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.820+0000 7ff0fcff69c0 20 remove_watcher() i=0 2024-09-10T05:38:21.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.820+0000 7ff0fcff69c0 2 removed watcher, disabling cache 2024-09-10T05:38:21.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.820+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:170 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94532588956064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa1562ac40 con 0x55fa15617110 2024-09-10T05:38:21.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.820+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.1 v2:172.21.15.62:6808/3442097179 51 ==== osd_op_reply(170 notify.1 [watch unwatch cookie 94532588956064] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f40083f0 con 0x55fa15617110 2024-09-10T05:38:21.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.820+0000 7ff0fcff69c0 20 remove_watcher() i=1 2024-09-10T05:38:21.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.820+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:171 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94532588954864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa1562ac40 con 0x55fa1561b590 2024-09-10T05:38:21.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.824+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 <== osd.0 v2:172.21.15.2:6800/945139080 51 ==== osd_op_reply(171 notify.2 [watch unwatch cookie 94532588954864] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0ec133070 con 0x55fa1561b590 2024-09-10T05:38:21.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.824+0000 7ff0fcff69c0 20 remove_watcher() i=2 2024-09-10T05:38:21.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.824+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:172 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94532588963104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa156264f0 con 0x7ff0ec116060 2024-09-10T05:38:21.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.824+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.2 v2:172.21.15.62:6800/2677868286 39 ==== osd_op_reply(172 notify.3 [watch unwatch cookie 94532588963104] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f40083f0 con 0x7ff0ec116060 2024-09-10T05:38:21.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.824+0000 7ff0fcff69c0 20 remove_watcher() i=3 2024-09-10T05:38:21.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.824+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:173 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94532588964160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa1562ac40 con 0x55fa1561b590 2024-09-10T05:38:21.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.828+0000 7ff0faafc640 1 -- 172.21.15.62:0/3107957 <== osd.0 v2:172.21.15.2:6800/945139080 52 ==== osd_op_reply(173 notify.4 [watch unwatch cookie 94532588964160] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0ec133070 con 0x55fa1561b590 2024-09-10T05:38:21.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.828+0000 7ff0fcff69c0 20 remove_watcher() i=4 2024-09-10T05:38:21.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.828+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:174 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94532588968000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa1562ac40 con 0x55fa1561edb0 2024-09-10T05:38:21.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.828+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3107957 <== osd.3 v2:172.21.15.62:6816/2708991149 44 ==== osd_op_reply(174 notify.5 [watch unwatch cookie 94532588968000] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f0052040 con 0x55fa1561edb0 2024-09-10T05:38:21.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.828+0000 7ff0fcff69c0 20 remove_watcher() i=5 2024-09-10T05:38:21.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.828+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:175 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94532588960832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa15629840 con 0x55fa1561edb0 2024-09-10T05:38:21.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.828+0000 7ff0fa2fb640 1 -- 172.21.15.62:0/3107957 <== osd.3 v2:172.21.15.62:6816/2708991149 45 ==== osd_op_reply(175 notify.6 [watch unwatch cookie 94532588960832] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f0052040 con 0x55fa1561edb0 2024-09-10T05:38:21.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.828+0000 7ff0fcff69c0 20 remove_watcher() i=6 2024-09-10T05:38:21.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.828+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:176 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94532588970624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa1562ac40 con 0x7ff0ec116060 2024-09-10T05:38:21.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.832+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 <== osd.2 v2:172.21.15.62:6800/2677868286 40 ==== osd_op_reply(176 notify.7 [watch unwatch cookie 94532588970624] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f40083f0 con 0x7ff0ec116060 2024-09-10T05:38:21.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.832+0000 7ff0fcff69c0 20 remove_watcher() i=7 2024-09-10T05:38:21.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.832+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55fa1561b590 msgr2=0x55fa1561d980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.832+0000 7ff0fcff69c0 1 --2- 172.21.15.62:0/3107957 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55fa1561b590 0x55fa1561d980 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:21.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.832+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55fa15617110 msgr2=0x55fa156195a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.832+0000 7ff0fcff69c0 1 --2- 172.21.15.62:0/3107957 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55fa15617110 0x55fa156195a0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:21.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.832+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7ff0ec116060 msgr2=0x7ff0ec0a47d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.832+0000 7ff0fcff69c0 1 --2- 172.21.15.62:0/3107957 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7ff0ec116060 0x7ff0ec0a47d0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:21.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.832+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55fa1561edb0 msgr2=0x55fa156211c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.832+0000 7ff0fcff69c0 1 --2- 172.21.15.62:0/3107957 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55fa1561edb0 0x55fa156211c0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:21.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.832+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fefc4039a70 msgr2=0x7fefc403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.832+0000 7ff0fcff69c0 1 --2- 172.21.15.62:0/3107957 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fefc4039a70 0x7fefc403bf30 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x55fa155dc080 tx=0x7ff0f0010000 comp rx=0 tx=0).stop 2024-09-10T05:38:21.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.832+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa15604ea0 msgr2=0x55fa1560c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.832+0000 7ff0fcff69c0 1 --2- 172.21.15.62:0/3107957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa15604ea0 0x55fa1560c160 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec0b24a0 tx=0x7ff0ec0f0f40 comp rx=0 tx=0).stop 2024-09-10T05:38:21.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.832+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 reap_dead start 2024-09-10T05:38:21.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.832+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3107957 reap_dead start 2024-09-10T05:38:21.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.832+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 shutdown_connections 2024-09-10T05:38:21.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.832+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 >> 172.21.15.62:0/3107957 conn(0x55fa156012f0 msgr2=0x55fa155ff500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:21.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.832+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 shutdown_connections 2024-09-10T05:38:21.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.832+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3107957 wait complete. 2024-09-10T05:38:21.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.832+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/1191837132 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fefd4039a70 msgr2=0x7fefd403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.832+0000 7ff0fcff69c0 1 --2- 172.21.15.62:0/1191837132 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fefd4039a70 0x7fefd403bf30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff0f000c010 tx=0x7ff0f000f000 comp rx=0 tx=0).stop 2024-09-10T05:38:21.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.832+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/1191837132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa155f88b0 msgr2=0x55fa155f8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.832+0000 7ff0fcff69c0 1 --2- 172.21.15.62:0/1191837132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa155f88b0 0x55fa155f8cd0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec0e96a0 tx=0x7ff0ec0b4d70 comp rx=0 tx=0).stop 2024-09-10T05:38:21.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.832+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/1191837132 shutdown_connections 2024-09-10T05:38:21.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.832+0000 7ff0fcff69c0 1 --2- 172.21.15.62:0/1191837132 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fefd4039a70 0x7fefd403bf30 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:21.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.832+0000 7ff0fcff69c0 1 --2- 172.21.15.62:0/1191837132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa155f88b0 0x55fa155f8cd0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:21.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.832+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/1191837132 >> 172.21.15.62:0/1191837132 conn(0x55fa155ee260 msgr2=0x55fa155ee640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:21.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.832+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/1191837132 shutdown_connections 2024-09-10T05:38:21.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.832+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/1191837132 wait complete. 2024-09-10T05:38:21.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.832+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3267420396 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55fa155e2d70 msgr2=0x55fa155e5230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.832+0000 7ff0fcff69c0 1 --2- 172.21.15.62:0/3267420396 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55fa155e2d70 0x55fa155e5230 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:21.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.832+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3267420396 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55fa154eb330 msgr2=0x55fa155e1d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.832+0000 7ff0fcff69c0 1 --2- 172.21.15.62:0/3267420396 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55fa154eb330 0x55fa155e1d80 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:21.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.832+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3267420396 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55fa155e7760 msgr2=0x55fa155e9b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.832+0000 7ff0fcff69c0 1 --2- 172.21.15.62:0/3267420396 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55fa155e7760 0x55fa155e9b50 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:21.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.832+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3267420396 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fefe0039ac0 msgr2=0x7fefe003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.832+0000 7ff0fcff69c0 1 --2- 172.21.15.62:0/3267420396 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fefe0039ac0 0x7fefe003bf80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0001e40 tx=0x7ff0f00013a0 comp rx=0 tx=0).stop 2024-09-10T05:38:21.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.832+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3267420396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa154e81f0 msgr2=0x55fa155dac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.832+0000 7ff0fcff69c0 1 --2- 172.21.15.62:0/3267420396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa154e81f0 0x55fa155dac10 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec018cc0 tx=0x7ff0ec017e30 comp rx=0 tx=0).stop 2024-09-10T05:38:21.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.832+0000 7ff0fb2fd640 1 -- 172.21.15.62:0/3267420396 reap_dead start 2024-09-10T05:38:21.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.832+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3267420396 shutdown_connections 2024-09-10T05:38:21.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.832+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3267420396 >> 172.21.15.62:0/3267420396 conn(0x55fa1545bb00 msgr2=0x55fa155cdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:21.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.832+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3267420396 shutdown_connections 2024-09-10T05:38:21.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.832+0000 7ff0fcff69c0 1 -- 172.21.15.62:0/3267420396 wait complete. 2024-09-10T05:38:21.848 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-10T05:38:21.848 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-10T05:38:21.848 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-10T05:38:21.927 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:38:21.963 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:38:21.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.924+0000 7f3a2db869c0 1 Processor -- start 2024-09-10T05:38:21.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.924+0000 7f3a2db869c0 1 -- start start 2024-09-10T05:38:21.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.924+0000 7f3a2db869c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x555aa9f035e0 0x555aa9f97760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.924+0000 7f3a2db869c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555aa9e439c0 con 0x555aa9f03200 2024-09-10T05:38:21.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.924+0000 7f3a2db869c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x555aa9e936d0 con 0x555aa9f035e0 2024-09-10T05:38:21.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.924+0000 7f3a2ae8b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x555aa9f035e0 0x555aa9f97760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.924+0000 7f3a2ae8b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x555aa9f035e0 0x555aa9f97760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38300/0 (socket says 172.21.15.62:38300) 2024-09-10T05:38:21.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.924+0000 7f3a2b68c640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x555aa9f03200 0x555aa9f94030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:52022/0 (socket says 172.21.15.62:52022) 2024-09-10T05:38:21.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.924+0000 7f3a2ae8b640 1 -- 172.21.15.62:0/3232255463 learned_addr learned my addr 172.21.15.62:0/3232255463 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:21.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.924+0000 7f3a2ae8b640 1 -- 172.21.15.62:0/3232255463 >> v1:172.21.15.2:6789/0 conn(0x555aa9f03200 legacy=0x555aa9f94030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.928+0000 7f3a2ae8b640 1 -- 172.21.15.62:0/3232255463 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555aa9e37ca0 con 0x555aa9f035e0 2024-09-10T05:38:21.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.928+0000 7f3a2ae8b640 1 --2- 172.21.15.62:0/3232255463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa9f035e0 0x555aa9f97760 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f3a1400a5c0 tx=0x7f3a1401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb016bccc896e3dd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.928+0000 7f3a2a68a640 1 -- 172.21.15.62:0/3232255463 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a140a6070 con 0x555aa9f035e0 2024-09-10T05:38:21.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.928+0000 7f3a2a68a640 1 -- 172.21.15.62:0/3232255463 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a140af070 con 0x555aa9f035e0 2024-09-10T05:38:21.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.928+0000 7f3a2a68a640 1 -- 172.21.15.62:0/3232255463 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a140aa5c0 con 0x555aa9f035e0 2024-09-10T05:38:21.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.928+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3232255463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa9f035e0 msgr2=0x555aa9f97760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.928+0000 7f3a2db869c0 1 --2- 172.21.15.62:0/3232255463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa9f035e0 0x555aa9f97760 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f3a1400a5c0 tx=0x7f3a1401b340 comp rx=0 tx=0).stop 2024-09-10T05:38:21.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.928+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3232255463 shutdown_connections 2024-09-10T05:38:21.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.928+0000 7f3a2db869c0 1 --2- 172.21.15.62:0/3232255463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa9f035e0 0x555aa9f97760 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:21.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.928+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3232255463 >> 172.21.15.62:0/3232255463 conn(0x555aa9f89920 msgr2=0x555aa9f8bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:21.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.928+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3232255463 shutdown_connections 2024-09-10T05:38:21.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.928+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3232255463 wait complete. 2024-09-10T05:38:21.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.944+0000 7f3a2db869c0 1 Processor -- start 2024-09-10T05:38:21.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.944+0000 7f3a2db869c0 1 -- start start 2024-09-10T05:38:21.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.948+0000 7f3a2db869c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa9f03200 0x555aaa07c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.948+0000 7f3a2db869c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555aa9e97680 con 0x555aa9f03200 2024-09-10T05:38:21.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.948+0000 7f3a2b68c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa9f03200 0x555aaa07c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.948+0000 7f3a2b68c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa9f03200 0x555aaa07c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38310/0 (socket says 172.21.15.62:38310) 2024-09-10T05:38:21.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.948+0000 7f3a2b68c640 1 -- 172.21.15.62:0/1658850244 learned_addr learned my addr 172.21.15.62:0/1658850244 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:21.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.948+0000 7f3a2b68c640 1 -- 172.21.15.62:0/1658850244 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555aa9e12da0 con 0x555aa9f03200 2024-09-10T05:38:21.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.948+0000 7f3a2b68c640 1 --2- 172.21.15.62:0/1658850244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa9f03200 0x555aaa07c900 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f3a24001680 tx=0x7f3a24001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=874baab2d43b056b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.948+0000 7f391960a640 1 -- 172.21.15.62:0/1658850244 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a24013420 con 0x555aa9f03200 2024-09-10T05:38:21.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.948+0000 7f391960a640 1 -- 172.21.15.62:0/1658850244 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a240135c0 con 0x555aa9f03200 2024-09-10T05:38:21.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.948+0000 7f391960a640 1 -- 172.21.15.62:0/1658850244 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a240138e0 con 0x555aa9f03200 2024-09-10T05:38:21.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.948+0000 7f3a2db869c0 1 -- 172.21.15.62:0/1658850244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa9f03200 msgr2=0x555aaa07c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.948+0000 7f3a2db869c0 1 --2- 172.21.15.62:0/1658850244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa9f03200 0x555aaa07c900 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f3a24001680 tx=0x7f3a24001b40 comp rx=0 tx=0).stop 2024-09-10T05:38:21.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.948+0000 7f3a2db869c0 1 -- 172.21.15.62:0/1658850244 shutdown_connections 2024-09-10T05:38:21.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.948+0000 7f3a2db869c0 1 --2- 172.21.15.62:0/1658850244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa9f03200 0x555aaa07c900 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:21.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.948+0000 7f3a2db869c0 1 -- 172.21.15.62:0/1658850244 >> 172.21.15.62:0/1658850244 conn(0x555aa9f89920 msgr2=0x555aaa078540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:21.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.948+0000 7f3a2db869c0 1 -- 172.21.15.62:0/1658850244 shutdown_connections 2024-09-10T05:38:21.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.948+0000 7f3a2db869c0 1 -- 172.21.15.62:0/1658850244 wait complete. 2024-09-10T05:38:21.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.948+0000 7f3a2db869c0 1 Processor -- start 2024-09-10T05:38:21.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.948+0000 7f3a2db869c0 1 -- start start 2024-09-10T05:38:21.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.948+0000 7f3a2db869c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa9f03200 0x555aaa083f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.948+0000 7f3a2db869c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555aa9e39a50 con 0x555aa9f03200 2024-09-10T05:38:21.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.948+0000 7f3a2b68c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa9f03200 0x555aaa083f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.948+0000 7f3a2b68c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa9f03200 0x555aaa083f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38320/0 (socket says 172.21.15.62:38320) 2024-09-10T05:38:21.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.948+0000 7f3a2b68c640 1 -- 172.21.15.62:0/575655109 learned_addr learned my addr 172.21.15.62:0/575655109 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:21.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.952+0000 7f3a2b68c640 1 -- 172.21.15.62:0/575655109 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555aaa0844e0 con 0x555aa9f03200 2024-09-10T05:38:21.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.952+0000 7f3a2b68c640 1 --2- 172.21.15.62:0/575655109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa9f03200 0x555aaa083f80 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x555aaa07d890 tx=0x7f3a24000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.952+0000 7f3917e07640 1 -- 172.21.15.62:0/575655109 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a240037a0 con 0x555aa9f03200 2024-09-10T05:38:21.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.952+0000 7f3917e07640 1 -- 172.21.15.62:0/575655109 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a24023070 con 0x555aa9f03200 2024-09-10T05:38:21.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.952+0000 7f3a2db869c0 1 -- 172.21.15.62:0/575655109 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555aaa084770 con 0x555aa9f03200 2024-09-10T05:38:21.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.952+0000 7f3917e07640 1 -- 172.21.15.62:0/575655109 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a24003ad0 con 0x555aa9f03200 2024-09-10T05:38:21.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.952+0000 7f3a2db869c0 1 -- 172.21.15.62:0/575655109 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555aaa085120 con 0x555aa9f03200 2024-09-10T05:38:21.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.952+0000 7f3917e07640 1 -- 172.21.15.62:0/575655109 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f3a24010070 con 0x555aa9f03200 2024-09-10T05:38:21.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.952+0000 7f3917e07640 1 --2- 172.21.15.62:0/575655109 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3910039ac0 0x7f391003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.952+0000 7f3917e07640 1 -- 172.21.15.62:0/575655109 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7f3a24050190 con 0x555aa9f03200 2024-09-10T05:38:21.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.952+0000 7f3a2ae8b640 1 --2- 172.21.15.62:0/575655109 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3910039ac0 0x7f391003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.952+0000 7f3a2db869c0 1 --2- 172.21.15.62:0/575655109 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x555aa9f035e0 0x555aaa08b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.952+0000 7f3a2db869c0 1 -- 172.21.15.62:0/575655109 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555aaa08b630 con 0x555aa9f035e0 2024-09-10T05:38:21.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.952+0000 7f3a2be8d640 1 --2- 172.21.15.62:0/575655109 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x555aa9f035e0 0x555aaa08b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.952+0000 7f3a2ae8b640 1 --2- 172.21.15.62:0/575655109 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3910039ac0 0x7f391003bf80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3a140ae000 tx=0x7f3a140a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.952+0000 7f3a2be8d640 1 --2- 172.21.15.62:0/575655109 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x555aa9f035e0 0x555aaa08b0f0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.956+0000 7f3a2be8d640 1 -- 172.21.15.62:0/575655109 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3a1c0083f0 con 0x555aa9f035e0 2024-09-10T05:38:21.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.956+0000 7f3a2db869c0 1 --2- 172.21.15.62:0/575655109 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x555aaa08c130 0x555aaa08e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.956+0000 7f3a2db869c0 1 -- 172.21.15.62:0/575655109 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555aaa08ed60 con 0x555aaa08c130 2024-09-10T05:38:21.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.956+0000 7f3a2b68c640 1 --2- 172.21.15.62:0/575655109 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x555aaa08c130 0x555aaa08e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.956+0000 7f3a2b68c640 1 --2- 172.21.15.62:0/575655109 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x555aaa08c130 0x555aaa08e5f0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.956+0000 7f3a2b68c640 1 -- 172.21.15.62:0/575655109 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3a2400f030 con 0x555aaa08c130 2024-09-10T05:38:21.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.956+0000 7f3a2db869c0 1 --2- 172.21.15.62:0/575655109 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x555aaa090b20 0x555aaa092f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.956+0000 7f3a2db869c0 1 -- 172.21.15.62:0/575655109 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0935e0 con 0x555aaa090b20 2024-09-10T05:38:21.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.956+0000 7f3a2ae8b640 1 --2- 172.21.15.62:0/575655109 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x555aaa090b20 0x555aaa092f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.956+0000 7f3a2ae8b640 1 --2- 172.21.15.62:0/575655109 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x555aaa090b20 0x555aaa092f10 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.956+0000 7f3a2ae8b640 1 -- 172.21.15.62:0/575655109 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3a140aaa80 con 0x555aaa090b20 2024-09-10T05:38:21.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.956+0000 7f3a2db869c0 1 -- 172.21.15.62:0/575655109 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555aaa08f9c0 con 0x555aaa08c130 2024-09-10T05:38:21.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.956+0000 7f3a2b68c640 1 -- 172.21.15.62:0/575655109 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3a2400f030 con 0x555aaa08c130 2024-09-10T05:38:21.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.956+0000 7f3a2db869c0 1 -- 172.21.15.62:0/575655109 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555aaa08fe00 con 0x555aaa090b20 2024-09-10T05:38:21.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.960+0000 7f3a2ae8b640 1 -- 172.21.15.62:0/575655109 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3a140aaa80 con 0x555aaa090b20 2024-09-10T05:38:21.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.960+0000 7f3a2db869c0 1 Processor -- start 2024-09-10T05:38:21.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.960+0000 7f3a2db869c0 1 -- start start 2024-09-10T05:38:21.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.960+0000 7f3a2db869c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aaa0a1c50 0x555aaa0a2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.960+0000 7f3a2db869c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555aa9ea4450 con 0x555aaa0a1c50 2024-09-10T05:38:21.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.960+0000 7f3a2b68c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aaa0a1c50 0x555aaa0a2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.960+0000 7f3a2b68c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aaa0a1c50 0x555aaa0a2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38330/0 (socket says 172.21.15.62:38330) 2024-09-10T05:38:21.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.960+0000 7f3a2b68c640 1 -- 172.21.15.62:0/1760774934 learned_addr learned my addr 172.21.15.62:0/1760774934 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:21.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.960+0000 7f3a2b68c640 1 -- 172.21.15.62:0/1760774934 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555aaa0a26b0 con 0x555aaa0a1c50 2024-09-10T05:38:21.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.960+0000 7f3a2b68c640 1 --2- 172.21.15.62:0/1760774934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aaa0a1c50 0x555aaa0a2070 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f3a2404e890 tx=0x7f3a24003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.960+0000 7f3915602640 1 -- 172.21.15.62:0/1760774934 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a24038070 con 0x555aaa0a1c50 2024-09-10T05:38:21.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.960+0000 7f3a2db869c0 1 -- 172.21.15.62:0/1760774934 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555aaa0a2f10 con 0x555aaa0a1c50 2024-09-10T05:38:21.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.960+0000 7f3915602640 1 -- 172.21.15.62:0/1760774934 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a24019040 con 0x555aaa0a1c50 2024-09-10T05:38:21.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.960+0000 7f3915602640 1 -- 172.21.15.62:0/1760774934 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a24047db0 con 0x555aaa0a1c50 2024-09-10T05:38:21.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.960+0000 7f3a2db869c0 1 -- 172.21.15.62:0/1760774934 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555aaa0a3480 con 0x555aaa0a1c50 2024-09-10T05:38:21.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.960+0000 7f3915602640 1 -- 172.21.15.62:0/1760774934 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f3a2403b070 con 0x555aaa0a1c50 2024-09-10T05:38:21.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.960+0000 7f3915602640 1 --2- 172.21.15.62:0/1760774934 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3904039a70 0x7f390403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.964+0000 7f3915602640 1 -- 172.21.15.62:0/1760774934 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7f3a2404f030 con 0x555aaa0a1c50 2024-09-10T05:38:21.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.964+0000 7f3a2ae8b640 1 --2- 172.21.15.62:0/1760774934 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3904039a70 0x7f390403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.964+0000 7f3a2db869c0 1 Processor -- start 2024-09-10T05:38:21.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.964+0000 7f3a2db869c0 1 -- start start 2024-09-10T05:38:21.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.964+0000 7f3a2ae8b640 1 --2- 172.21.15.62:0/1760774934 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3904039a70 0x7f390403bf30 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x555aaa08b9d0 tx=0x7f3a14005ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.964+0000 7f3a2db869c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aaa0af3e0 0x555aaa0af7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.964+0000 7f3a2db869c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555aaa07d150 con 0x555aaa0af3e0 2024-09-10T05:38:21.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.964+0000 7f3a2b68c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aaa0af3e0 0x555aaa0af7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.964+0000 7f3a2b68c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aaa0af3e0 0x555aaa0af7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38334/0 (socket says 172.21.15.62:38334) 2024-09-10T05:38:21.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.964+0000 7f3a2b68c640 1 -- 172.21.15.62:0/1588136875 learned_addr learned my addr 172.21.15.62:0/1588136875 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:21.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.964+0000 7f3a2b68c640 1 -- 172.21.15.62:0/1588136875 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555aaa0afdd0 con 0x555aaa0af3e0 2024-09-10T05:38:21.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.964+0000 7f3a2b68c640 1 --2- 172.21.15.62:0/1588136875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aaa0af3e0 0x555aaa0af7e0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f3a24050d80 tx=0x7f3a2401df30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d4bd43fa58a3555 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.964+0000 7f390effd640 1 -- 172.21.15.62:0/1588136875 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a24011590 con 0x555aaa0af3e0 2024-09-10T05:38:21.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.964+0000 7f390effd640 1 -- 172.21.15.62:0/1588136875 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a24011b20 con 0x555aaa0af3e0 2024-09-10T05:38:21.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.964+0000 7f390effd640 1 -- 172.21.15.62:0/1588136875 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a24011730 con 0x555aaa0af3e0 2024-09-10T05:38:21.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.964+0000 7f3a2db869c0 1 -- 172.21.15.62:0/1588136875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aaa0af3e0 msgr2=0x555aaa0af7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:21.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.964+0000 7f3a2db869c0 1 --2- 172.21.15.62:0/1588136875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aaa0af3e0 0x555aaa0af7e0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f3a24050d80 tx=0x7f3a2401df30 comp rx=0 tx=0).stop 2024-09-10T05:38:21.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.964+0000 7f3a2db869c0 1 -- 172.21.15.62:0/1588136875 shutdown_connections 2024-09-10T05:38:21.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.964+0000 7f3a2db869c0 1 --2- 172.21.15.62:0/1588136875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aaa0af3e0 0x555aaa0af7e0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:21.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.964+0000 7f3a2db869c0 1 -- 172.21.15.62:0/1588136875 >> 172.21.15.62:0/1588136875 conn(0x555aaa0aa800 msgr2=0x555aaa0a8a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:21.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.964+0000 7f3a2db869c0 1 -- 172.21.15.62:0/1588136875 shutdown_connections 2024-09-10T05:38:21.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.964+0000 7f3a2db869c0 1 -- 172.21.15.62:0/1588136875 wait complete. 2024-09-10T05:38:21.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.964+0000 7f3a2db869c0 1 Processor -- start 2024-09-10T05:38:21.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.964+0000 7f3a2db869c0 1 -- start start 2024-09-10T05:38:21.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.964+0000 7f3a2db869c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aaa0af3e0 0x555aaa0b5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.964+0000 7f3a2db869c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555aaa0ae1b0 con 0x555aaa0af3e0 2024-09-10T05:38:21.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.964+0000 7f3a2b68c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aaa0af3e0 0x555aaa0b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.968+0000 7f3a2b68c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aaa0af3e0 0x555aaa0b5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38342/0 (socket says 172.21.15.62:38342) 2024-09-10T05:38:21.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.968+0000 7f3a2b68c640 1 -- 172.21.15.62:0/3844228474 learned_addr learned my addr 172.21.15.62:0/3844228474 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:21.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.968+0000 7f3a2b68c640 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555aaa0b5cb0 con 0x555aaa0af3e0 2024-09-10T05:38:21.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.968+0000 7f3a2b68c640 1 --2- 172.21.15.62:0/3844228474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aaa0af3e0 0x555aaa0b5750 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f3a2403cfd0 tx=0x7f3a24036f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.968+0000 7f390d7fa640 1 -- 172.21.15.62:0/3844228474 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a24011b20 con 0x555aaa0af3e0 2024-09-10T05:38:21.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.968+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555aaa0b5cb0 con 0x555aaa0af3e0 2024-09-10T05:38:21.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.968+0000 7f390d7fa640 1 -- 172.21.15.62:0/3844228474 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a24011590 con 0x555aaa0af3e0 2024-09-10T05:38:21.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.968+0000 7f390d7fa640 1 -- 172.21.15.62:0/3844228474 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a24011cc0 con 0x555aaa0af3e0 2024-09-10T05:38:21.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.968+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555aaa0b5cb0 con 0x555aaa0af3e0 2024-09-10T05:38:21.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.968+0000 7f390d7fa640 1 -- 172.21.15.62:0/3844228474 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f3a24062030 con 0x555aaa0af3e0 2024-09-10T05:38:21.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.968+0000 7f3a2db869c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:21.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.968+0000 7f390d7fa640 1 --2- 172.21.15.62:0/3844228474 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f38f4039a70 0x7f38f403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.968+0000 7f390d7fa640 1 -- 172.21.15.62:0/3844228474 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7f3a24060020 con 0x555aaa0af3e0 2024-09-10T05:38:21.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.968+0000 7f3a2ae8b640 1 --2- 172.21.15.62:0/3844228474 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f38f4039a70 0x7f38f403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.968+0000 7f3a2db869c0 1 --2- 172.21.15.62:0/3844228474 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x555aaa0c0680 0x555aaa0c2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.968+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0c3220 con 0x555aaa0c0680 2024-09-10T05:38:21.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.968+0000 7f3a2be8d640 1 --2- 172.21.15.62:0/3844228474 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x555aaa0c0680 0x555aaa0c2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.968+0000 7f3a2ae8b640 1 --2- 172.21.15.62:0/3844228474 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f38f4039a70 0x7f38f403bf30 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3a140ac040 tx=0x7f3a140c1040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.968+0000 7f3a2be8d640 1 --2- 172.21.15.62:0/3844228474 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x555aaa0c0680 0x555aaa0c2ad0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.972+0000 7f3a2be8d640 1 -- 172.21.15.62:0/3844228474 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3a1c0083f0 con 0x555aaa0c0680 2024-09-10T05:38:21.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.972+0000 7f3a2db869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:21.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.972+0000 7f3a2db869c0 20 realm 2024-09-10T05:38:21.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.972+0000 7f3a2db869c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:21.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.972+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0bfac0 con 0x555aaa0c0680 2024-09-10T05:38:21.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.972+0000 7f3a2be8d640 1 -- 172.21.15.62:0/3844228474 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3a1c0083f0 con 0x555aaa0c0680 2024-09-10T05:38:21.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.972+0000 7f3a2db869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:21.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.972+0000 7f3a2db869c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:38:21.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.972+0000 7f3a2db869c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:21.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.972+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0c3ce0 con 0x555aaa0c0680 2024-09-10T05:38:21.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.972+0000 7f3a2be8d640 1 -- 172.21.15.62:0/3844228474 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3a1c0083f0 con 0x555aaa0c0680 2024-09-10T05:38:21.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.972+0000 7f3a2db869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:21.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.972+0000 7f3a2db869c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:21.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.972+0000 7f3a2db869c0 1 --2- 172.21.15.62:0/3844228474 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x555aaa0c4ac0 0x555aaa0c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.972+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0c7560 con 0x555aaa0c4ac0 2024-09-10T05:38:21.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.972+0000 7f3a2b68c640 1 --2- 172.21.15.62:0/3844228474 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x555aaa0c4ac0 0x555aaa0c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.972+0000 7f3a2b68c640 1 --2- 172.21.15.62:0/3844228474 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x555aaa0c4ac0 0x555aaa0c6eb0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.972+0000 7f3a2b68c640 1 -- 172.21.15.62:0/3844228474 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3a2403a030 con 0x555aaa0c4ac0 2024-09-10T05:38:21.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.972+0000 7f3a2db869c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:38:21.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.972+0000 7f3a2db869c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:21.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.972+0000 7f3a2db869c0 1 --2- 172.21.15.62:0/3844228474 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x555aaa0c8310 0x555aaa0ca700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.972+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0cada0 con 0x555aaa0c8310 2024-09-10T05:38:21.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.972+0000 7f3a2ae8b640 1 --2- 172.21.15.62:0/3844228474 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x555aaa0c8310 0x555aaa0ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.972+0000 7f3a2ae8b640 1 --2- 172.21.15.62:0/3844228474 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x555aaa0c8310 0x555aaa0ca700 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.972+0000 7f3a2ae8b640 1 -- 172.21.15.62:0/3844228474 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3a140aaa80 con 0x555aaa0c8310 2024-09-10T05:38:21.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.972+0000 7f3a2db869c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:38:21.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.972+0000 7f3a2db869c0 20 searching for the correct realm 2024-09-10T05:38:21.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.972+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0cc670 con 0x555aaa0c8310 2024-09-10T05:38:21.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.972+0000 7f3a2ae8b640 1 -- 172.21.15.62:0/3844228474 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a140aaa80 con 0x555aaa0c8310 2024-09-10T05:38:21.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.972+0000 7f3a2ae8b640 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0cc670 con 0x555aaa0c4ac0 2024-09-10T05:38:21.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.976+0000 7f3a2b68c640 1 -- 172.21.15.62:0/3844228474 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a2403a030 con 0x555aaa0c4ac0 2024-09-10T05:38:21.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.976+0000 7f3a2b68c640 1 --2- 172.21.15.62:0/3844228474 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f3a2403d060 0x7f3a24012840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:21.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.976+0000 7f3a2b68c640 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0cc670 con 0x7f3a2403d060 2024-09-10T05:38:21.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.976+0000 7f3a2be8d640 1 --2- 172.21.15.62:0/3844228474 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f3a2403d060 0x7f3a24012840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:21.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.976+0000 7f3a2be8d640 1 --2- 172.21.15.62:0/3844228474 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f3a2403d060 0x7f3a24012840 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:21.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.976+0000 7f3a2be8d640 1 -- 172.21.15.62:0/3844228474 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a1c0083f0 con 0x7f3a2403d060 2024-09-10T05:38:21.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.976+0000 7f3a2be8d640 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0cc670 con 0x555aaa0c0680 2024-09-10T05:38:21.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.976+0000 7f3a2be8d640 1 -- 172.21.15.62:0/3844228474 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a1c0083f0 con 0x555aaa0c0680 2024-09-10T05:38:21.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.976+0000 7f3a2be8d640 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0cc670 con 0x555aaa0c0680 2024-09-10T05:38:21.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.976+0000 7f3a2be8d640 1 -- 172.21.15.62:0/3844228474 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a1c0083f0 con 0x555aaa0c0680 2024-09-10T05:38:21.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.976+0000 7f3a2be8d640 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0cc670 con 0x555aaa0c8310 2024-09-10T05:38:21.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.976+0000 7f3a2ae8b640 1 -- 172.21.15.62:0/3844228474 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a140aaa80 con 0x555aaa0c8310 2024-09-10T05:38:21.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.976+0000 7f3a2ae8b640 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0cc670 con 0x555aaa0c0680 2024-09-10T05:38:21.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.976+0000 7f3a2be8d640 1 -- 172.21.15.62:0/3844228474 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a1c0083f0 con 0x555aaa0c0680 2024-09-10T05:38:21.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.976+0000 7f3a2be8d640 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0cc670 con 0x555aaa0c4ac0 2024-09-10T05:38:21.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.976+0000 7f3a2b68c640 1 -- 172.21.15.62:0/3844228474 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a2403a030 con 0x555aaa0c4ac0 2024-09-10T05:38:21.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.976+0000 7f3a2b68c640 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0cc670 con 0x555aaa0c4ac0 2024-09-10T05:38:22.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.976+0000 7f3a2b68c640 1 -- 172.21.15.62:0/3844228474 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a2403a030 con 0x555aaa0c4ac0 2024-09-10T05:38:22.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.976+0000 7f3a2b68c640 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0cc670 con 0x555aaa0c0680 2024-09-10T05:38:22.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.980+0000 7f3a2be8d640 1 -- 172.21.15.62:0/3844228474 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a1c0083f0 con 0x555aaa0c0680 2024-09-10T05:38:22.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.980+0000 7f3a2be8d640 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0cc670 con 0x7f3a2403d060 2024-09-10T05:38:22.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.980+0000 7f3a2be8d640 1 -- 172.21.15.62:0/3844228474 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a1c0083f0 con 0x7f3a2403d060 2024-09-10T05:38:22.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.980+0000 7f3a2be8d640 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0cc670 con 0x555aaa0c0680 2024-09-10T05:38:22.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.980+0000 7f3a2be8d640 1 -- 172.21.15.62:0/3844228474 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a1c0083f0 con 0x555aaa0c0680 2024-09-10T05:38:22.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.980+0000 7f3a2be8d640 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0cc670 con 0x7f3a2403d060 2024-09-10T05:38:22.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.980+0000 7f3a2be8d640 1 -- 172.21.15.62:0/3844228474 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3a1c0083f0 con 0x7f3a2403d060 2024-09-10T05:38:22.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.980+0000 7f3a2be8d640 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0cc670 con 0x555aaa0c4ac0 2024-09-10T05:38:22.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.980+0000 7f3a2b68c640 1 -- 172.21.15.62:0/3844228474 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a2403a030 con 0x555aaa0c4ac0 2024-09-10T05:38:22.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.980+0000 7f3a2b68c640 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0cc670 con 0x555aaa0c8310 2024-09-10T05:38:22.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.980+0000 7f3a2ae8b640 1 -- 172.21.15.62:0/3844228474 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a140aaa80 con 0x555aaa0c8310 2024-09-10T05:38:22.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.980+0000 7f3a2ae8b640 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0cc670 con 0x555aaa0c0680 2024-09-10T05:38:22.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.980+0000 7f3a2be8d640 1 -- 172.21.15.62:0/3844228474 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a1c0083f0 con 0x555aaa0c0680 2024-09-10T05:38:22.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.980+0000 7f3a2be8d640 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0cc670 con 0x555aaa0c4ac0 2024-09-10T05:38:22.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.980+0000 7f3a2b68c640 1 -- 172.21.15.62:0/3844228474 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a2403a030 con 0x555aaa0c4ac0 2024-09-10T05:38:22.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.980+0000 7f3a2b68c640 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0cc670 con 0x555aaa0c8310 2024-09-10T05:38:22.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.980+0000 7f3a2ae8b640 1 -- 172.21.15.62:0/3844228474 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 34 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f3a140aaa80 con 0x555aaa0c8310 2024-09-10T05:38:22.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.980+0000 7f3a2ae8b640 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0cc670 con 0x555aaa0c0680 2024-09-10T05:38:22.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.980+0000 7f3a2be8d640 1 -- 172.21.15.62:0/3844228474 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a1c0083f0 con 0x555aaa0c0680 2024-09-10T05:38:22.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.980+0000 7f3a2be8d640 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0cc670 con 0x555aaa0c0680 2024-09-10T05:38:22.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.984+0000 7f3a2be8d640 1 -- 172.21.15.62:0/3844228474 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3a1c0083f0 con 0x555aaa0c0680 2024-09-10T05:38:22.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.984+0000 7f3a2be8d640 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0cc670 con 0x555aaa0c0680 2024-09-10T05:38:22.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.984+0000 7f3a2be8d640 1 -- 172.21.15.62:0/3844228474 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a1c0083f0 con 0x555aaa0c0680 2024-09-10T05:38:22.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.984+0000 7f3a2be8d640 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0cc670 con 0x555aaa0c8310 2024-09-10T05:38:22.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.984+0000 7f3a2ae8b640 1 -- 172.21.15.62:0/3844228474 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a140aaa80 con 0x555aaa0c8310 2024-09-10T05:38:22.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.984+0000 7f3a2ae8b640 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0cc670 con 0x7f3a2403d060 2024-09-10T05:38:22.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.984+0000 7f3a2be8d640 1 -- 172.21.15.62:0/3844228474 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a1c0083f0 con 0x7f3a2403d060 2024-09-10T05:38:22.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.984+0000 7f3a2be8d640 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0cc670 con 0x555aaa0c0680 2024-09-10T05:38:22.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.984+0000 7f3a2be8d640 1 -- 172.21.15.62:0/3844228474 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a1c0083f0 con 0x555aaa0c0680 2024-09-10T05:38:22.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.984+0000 7f3a2be8d640 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0cc670 con 0x7f3a2403d060 2024-09-10T05:38:22.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.984+0000 7f3a2be8d640 1 -- 172.21.15.62:0/3844228474 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a1c0083f0 con 0x7f3a2403d060 2024-09-10T05:38:22.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.984+0000 7f3a2be8d640 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0cc670 con 0x555aaa0c8310 2024-09-10T05:38:22.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.984+0000 7f3a2ae8b640 1 -- 172.21.15.62:0/3844228474 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a140aaa80 con 0x555aaa0c8310 2024-09-10T05:38:22.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.984+0000 7f3a2ae8b640 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0cc670 con 0x7f3a2403d060 2024-09-10T05:38:22.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.984+0000 7f3a2be8d640 1 -- 172.21.15.62:0/3844228474 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a1c0083f0 con 0x7f3a2403d060 2024-09-10T05:38:22.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.984+0000 7f3a2be8d640 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0cc670 con 0x555aaa0c4ac0 2024-09-10T05:38:22.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.984+0000 7f3a2b68c640 1 -- 172.21.15.62:0/3844228474 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a2403a030 con 0x555aaa0c4ac0 2024-09-10T05:38:22.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.984+0000 7f3a2b68c640 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0cc670 con 0x555aaa0c4ac0 2024-09-10T05:38:22.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.984+0000 7f3a2b68c640 1 -- 172.21.15.62:0/3844228474 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a2403a030 con 0x555aaa0c4ac0 2024-09-10T05:38:22.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.984+0000 7f3a2b68c640 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0cc670 con 0x555aaa0c8310 2024-09-10T05:38:22.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.988+0000 7f3a2ae8b640 1 -- 172.21.15.62:0/3844228474 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a140aaa80 con 0x555aaa0c8310 2024-09-10T05:38:22.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.988+0000 7f3a2ae8b640 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0cc670 con 0x555aaa0c4ac0 2024-09-10T05:38:22.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.988+0000 7f3a2b68c640 1 -- 172.21.15.62:0/3844228474 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3a2403a030 con 0x555aaa0c4ac0 2024-09-10T05:38:22.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.988+0000 7f3a2b68c640 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0cc670 con 0x555aaa0c4ac0 2024-09-10T05:38:22.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.988+0000 7f3a2b68c640 1 -- 172.21.15.62:0/3844228474 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a2403a030 con 0x555aaa0c4ac0 2024-09-10T05:38:22.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.988+0000 7f3a2db869c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:38:22.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.988+0000 7f3a2db869c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:38:22.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.988+0000 7f3a2db869c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:38:22.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.988+0000 7f3a2db869c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:38:22.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.988+0000 7f3a2db869c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:38:22.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.988+0000 7f3a2db869c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:38:22.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.988+0000 7f3a2db869c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:22.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.988+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0cb760 con 0x555aaa0c0680 2024-09-10T05:38:22.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.988+0000 7f3a2be8d640 1 -- 172.21.15.62:0/3844228474 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3a1c0083f0 con 0x555aaa0c0680 2024-09-10T05:38:22.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.988+0000 7f3a2db869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:22.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.988+0000 7f3a2db869c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:22.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.988+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0cbbb0 con 0x555aaa0c4ac0 2024-09-10T05:38:22.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.988+0000 7f3a2b68c640 1 -- 172.21.15.62:0/3844228474 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3a2403a030 con 0x555aaa0c4ac0 2024-09-10T05:38:22.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.988+0000 7f3a2db869c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:38:22.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.988+0000 7f3a2db869c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:22.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.988+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0cbfd0 con 0x555aaa0c8310 2024-09-10T05:38:22.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.988+0000 7f3a2ae8b640 1 -- 172.21.15.62:0/3844228474 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3a140aaa80 con 0x555aaa0c8310 2024-09-10T05:38:22.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.988+0000 7f3a2db869c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:38:22.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.988+0000 7f3a2db869c0 20 zone default found 2024-09-10T05:38:22.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.988+0000 7f3a2db869c0 4 Realm: () 2024-09-10T05:38:22.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.988+0000 7f3a2db869c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:38:22.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.988+0000 7f3a2db869c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:38:22.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.988+0000 7f3a2db869c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:38:22.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.988+0000 7f3a2db869c0 20 zonegroup default 2024-09-10T05:38:22.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.988+0000 7f3a2db869c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:22.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.988+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0ccb20 con 0x7f3a2403d060 2024-09-10T05:38:22.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.988+0000 7f3a2be8d640 1 -- 172.21.15.62:0/3844228474 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3a1c0083f0 con 0x7f3a2403d060 2024-09-10T05:38:22.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.988+0000 7f3a2db869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:22.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.988+0000 7f3a2db869c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:22.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.988+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0cede0 con 0x555aaa0c8310 2024-09-10T05:38:22.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.988+0000 7f3a2ae8b640 1 -- 172.21.15.62:0/3844228474 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3a140aaa80 con 0x555aaa0c8310 2024-09-10T05:38:22.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.988+0000 7f3a2db869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:22.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.988+0000 7f3a2db869c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:22.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.988+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0cf220 con 0x555aaa0c8310 2024-09-10T05:38:22.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.992+0000 7f3a2ae8b640 1 -- 172.21.15.62:0/3844228474 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3a140aaa80 con 0x555aaa0c8310 2024-09-10T05:38:22.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.992+0000 7f3a2db869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:22.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.992+0000 7f3a2db869c0 20 started sync module instance, tier type = 2024-09-10T05:38:22.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.992+0000 7f3a2db869c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:38:22.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.992+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0ce270 con 0x555aaa0c4ac0 2024-09-10T05:38:22.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.992+0000 7f3a2b68c640 1 -- 172.21.15.62:0/3844228474 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a2403a030 con 0x555aaa0c4ac0 2024-09-10T05:38:22.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.992+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93847888389728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0cded0 con 0x555aaa0c4ac0 2024-09-10T05:38:22.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.992+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0d0150 con 0x555aaa0c0680 2024-09-10T05:38:22.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.992+0000 7f3a2be8d640 1 -- 172.21.15.62:0/3844228474 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a1c0083f0 con 0x555aaa0c0680 2024-09-10T05:38:22.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.992+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93847888395424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0d09a0 con 0x555aaa0c0680 2024-09-10T05:38:22.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.992+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0d13a0 con 0x555aaa0c4ac0 2024-09-10T05:38:22.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.996+0000 7f3a2b68c640 1 -- 172.21.15.62:0/3844228474 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 93847888389728] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a2403a030 con 0x555aaa0c4ac0 2024-09-10T05:38:22.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.996+0000 7f3a2be8d640 1 -- 172.21.15.62:0/3844228474 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93847888395424] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a1c0083f0 con 0x555aaa0c0680 2024-09-10T05:38:22.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.996+0000 7f3a2b68c640 1 -- 172.21.15.62:0/3844228474 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a2403a030 con 0x555aaa0c4ac0 2024-09-10T05:38:22.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.996+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93847888393856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0d04f0 con 0x555aaa0c4ac0 2024-09-10T05:38:22.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.996+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0d1c40 con 0x7f3a2403d060 2024-09-10T05:38:22.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.996+0000 7f3a2be8d640 1 -- 172.21.15.62:0/3844228474 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a1c0083f0 con 0x7f3a2403d060 2024-09-10T05:38:22.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.996+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93847888402320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0d04f0 con 0x7f3a2403d060 2024-09-10T05:38:22.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:21.996+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0d2710 con 0x555aaa0c4ac0 2024-09-10T05:38:22.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.000+0000 7f3a2b68c640 1 -- 172.21.15.62:0/3844228474 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93847888393856] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a2403a030 con 0x555aaa0c4ac0 2024-09-10T05:38:22.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.000+0000 7f3a2be8d640 1 -- 172.21.15.62:0/3844228474 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93847888402320] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a1c0083f0 con 0x7f3a2403d060 2024-09-10T05:38:22.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.000+0000 7f3a2b68c640 1 -- 172.21.15.62:0/3844228474 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a2403a030 con 0x555aaa0c4ac0 2024-09-10T05:38:22.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.000+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93847888403376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0d26d0 con 0x555aaa0c4ac0 2024-09-10T05:38:22.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.000+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0d2b00 con 0x555aaa0c8310 2024-09-10T05:38:22.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.000+0000 7f3a2ae8b640 1 -- 172.21.15.62:0/3844228474 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a140aaa80 con 0x555aaa0c8310 2024-09-10T05:38:22.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.000+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93847888400048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0d2b00 con 0x555aaa0c8310 2024-09-10T05:38:22.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.000+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0d3a00 con 0x555aaa0c8310 2024-09-10T05:38:22.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.004+0000 7f3a2b68c640 1 -- 172.21.15.62:0/3844228474 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 93847888403376] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a2403a030 con 0x555aaa0c4ac0 2024-09-10T05:38:22.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.004+0000 7f3a2ae8b640 1 -- 172.21.15.62:0/3844228474 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93847888400048] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a140aaa80 con 0x555aaa0c8310 2024-09-10T05:38:22.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.004+0000 7f3a2ae8b640 1 -- 172.21.15.62:0/3844228474 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a140aaa80 con 0x555aaa0c8310 2024-09-10T05:38:22.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.004+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93847888408304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0d3510 con 0x555aaa0c8310 2024-09-10T05:38:22.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.004+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0d3ed0 con 0x7f3a2403d060 2024-09-10T05:38:22.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.004+0000 7f3a2ae8b640 1 -- 172.21.15.62:0/3844228474 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93847888408304] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a140aaa80 con 0x555aaa0c8310 2024-09-10T05:38:22.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.004+0000 7f3a2be8d640 1 -- 172.21.15.62:0/3844228474 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a1c0083f0 con 0x7f3a2403d060 2024-09-10T05:38:22.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.004+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93847888404992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0d3ed0 con 0x7f3a2403d060 2024-09-10T05:38:22.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.004+0000 7f3a2db869c0 20 add_watcher() i=0 2024-09-10T05:38:22.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.004+0000 7f3a2db869c0 20 add_watcher() i=1 2024-09-10T05:38:22.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.004+0000 7f3a2db869c0 20 add_watcher() i=2 2024-09-10T05:38:22.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.004+0000 7f3a2db869c0 20 add_watcher() i=3 2024-09-10T05:38:22.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.004+0000 7f3a2db869c0 20 add_watcher() i=4 2024-09-10T05:38:22.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.004+0000 7f3a2db869c0 20 add_watcher() i=5 2024-09-10T05:38:22.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.004+0000 7f3a2db869c0 20 add_watcher() i=6 2024-09-10T05:38:22.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.004+0000 7f3a2be8d640 1 -- 172.21.15.62:0/3844228474 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93847888404992] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a1c0083f0 con 0x7f3a2403d060 2024-09-10T05:38:22.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.004+0000 7f3a2db869c0 20 add_watcher() i=7 2024-09-10T05:38:22.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.004+0000 7f3a2db869c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:38:22.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.004+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0d7240 con 0x555aaa0c0680 2024-09-10T05:38:22.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.008+0000 7f3a2be8d640 1 -- 172.21.15.62:0/3844228474 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3a1c0083f0 con 0x555aaa0c0680 2024-09-10T05:38:22.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.008+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93847888423984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0d4040 con 0x555aaa0c0680 2024-09-10T05:38:22.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.008+0000 7f3a2be8d640 1 -- 172.21.15.62:0/3844228474 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93847888423984] v34'244 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3a1c0083f0 con 0x555aaa0c0680 2024-09-10T05:38:22.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.008+0000 7f38e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:38:22.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.008+0000 7f3a2db869c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:38:22.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.008+0000 7f3a2db869c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:38:22.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.008+0000 7f3a2db869c0 5 note: GC not initialized 2024-09-10T05:38:22.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.008+0000 7f38e0fe1640 20 reqs_thread_entry: start 2024-09-10T05:38:22.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.008+0000 7f3a2db869c0 20 init_complete bucket index max shards: 11 2024-09-10T05:38:22.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.008+0000 7f3a2db869c0 20 Filter name: none 2024-09-10T05:38:22.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.008+0000 7f385a7fc640 20 reqs_thread_entry: start 2024-09-10T05:38:22.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.008+0000 7f3a2db869c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:22.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.008+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0fa0b0 con 0x555aaa0c0680 2024-09-10T05:38:22.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.008+0000 7f3a2be8d640 1 -- 172.21.15.62:0/3844228474 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f3a1c0083f0 con 0x555aaa0c0680 2024-09-10T05:38:22.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.008+0000 7f3a2db869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:22.018 INFO:teuthology.orchestra.run.smithi062.stderr:could not fetch user info: no user info saved 2024-09-10T05:38:22.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.012+0000 7f38e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:38:22.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.012+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93847888423984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0fa070 con 0x555aaa0c0680 2024-09-10T05:38:22.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.012+0000 7f3a2be8d640 1 -- 172.21.15.62:0/3844228474 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93847888423984] v34'245 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3a1c0083f0 con 0x555aaa0c0680 2024-09-10T05:38:22.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.012+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93847888389728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0fa070 con 0x555aaa0c4ac0 2024-09-10T05:38:22.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.016+0000 7f3a2b68c640 1 -- 172.21.15.62:0/3844228474 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93847888389728] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a2403a030 con 0x555aaa0c4ac0 2024-09-10T05:38:22.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.016+0000 7f3a2db869c0 20 remove_watcher() i=0 2024-09-10T05:38:22.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.016+0000 7f3a2db869c0 2 removed watcher, disabling cache 2024-09-10T05:38:22.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.016+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93847888395424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0fa070 con 0x555aaa0c0680 2024-09-10T05:38:22.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.016+0000 7f3a2be8d640 1 -- 172.21.15.62:0/3844228474 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93847888395424] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a1c0083f0 con 0x555aaa0c0680 2024-09-10T05:38:22.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.016+0000 7f3a2db869c0 20 remove_watcher() i=1 2024-09-10T05:38:22.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.016+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93847888393856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0fa070 con 0x555aaa0c4ac0 2024-09-10T05:38:22.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.020+0000 7f3a2b68c640 1 -- 172.21.15.62:0/3844228474 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93847888393856] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a2403a030 con 0x555aaa0c4ac0 2024-09-10T05:38:22.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.020+0000 7f3a2db869c0 20 remove_watcher() i=2 2024-09-10T05:38:22.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.020+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93847888402320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0fa070 con 0x7f3a2403d060 2024-09-10T05:38:22.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.020+0000 7f3a2be8d640 1 -- 172.21.15.62:0/3844228474 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93847888402320] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a1c0083f0 con 0x7f3a2403d060 2024-09-10T05:38:22.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.020+0000 7f3a2db869c0 20 remove_watcher() i=3 2024-09-10T05:38:22.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.020+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93847888403376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0fa070 con 0x555aaa0c4ac0 2024-09-10T05:38:22.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.020+0000 7f3a2b68c640 1 -- 172.21.15.62:0/3844228474 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93847888403376] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a2403a030 con 0x555aaa0c4ac0 2024-09-10T05:38:22.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.020+0000 7f3a2db869c0 20 remove_watcher() i=4 2024-09-10T05:38:22.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.020+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93847888400048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0fa070 con 0x555aaa0c8310 2024-09-10T05:38:22.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.024+0000 7f3a2ae8b640 1 -- 172.21.15.62:0/3844228474 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93847888400048] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a140aaa80 con 0x555aaa0c8310 2024-09-10T05:38:22.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.024+0000 7f3a2db869c0 20 remove_watcher() i=5 2024-09-10T05:38:22.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.024+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93847888408304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0fa070 con 0x555aaa0c8310 2024-09-10T05:38:22.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.024+0000 7f3a2ae8b640 1 -- 172.21.15.62:0/3844228474 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93847888408304] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a140aaa80 con 0x555aaa0c8310 2024-09-10T05:38:22.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.024+0000 7f3a2db869c0 20 remove_watcher() i=6 2024-09-10T05:38:22.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.024+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3844228474 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93847888404992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555aaa0fa070 con 0x7f3a2403d060 2024-09-10T05:38:22.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.024+0000 7f3a2be8d640 1 -- 172.21.15.62:0/3844228474 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93847888404992] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a1c0083f0 con 0x7f3a2403d060 2024-09-10T05:38:22.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.024+0000 7f3a2db869c0 20 remove_watcher() i=7 2024-09-10T05:38:22.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.024+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3844228474 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x555aaa0c4ac0 msgr2=0x555aaa0c6eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.024+0000 7f3a2db869c0 1 --2- 172.21.15.62:0/3844228474 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x555aaa0c4ac0 0x555aaa0c6eb0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.024+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3844228474 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x555aaa0c0680 msgr2=0x555aaa0c2ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.024+0000 7f3a2db869c0 1 --2- 172.21.15.62:0/3844228474 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x555aaa0c0680 0x555aaa0c2ad0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.024+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3844228474 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f3a2403d060 msgr2=0x7f3a24012840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.024+0000 7f3a2db869c0 1 --2- 172.21.15.62:0/3844228474 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f3a2403d060 0x7f3a24012840 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.024+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3844228474 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x555aaa0c8310 msgr2=0x555aaa0ca700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.024+0000 7f3a2db869c0 1 --2- 172.21.15.62:0/3844228474 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x555aaa0c8310 0x555aaa0ca700 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.024+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3844228474 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f38f4039a70 msgr2=0x7f38f403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.024+0000 7f3a2db869c0 1 --2- 172.21.15.62:0/3844228474 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f38f4039a70 0x7f38f403bf30 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3a140ac040 tx=0x7f3a140c1040 comp rx=0 tx=0).stop 2024-09-10T05:38:22.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.024+0000 7f3a2be8d640 1 -- 172.21.15.62:0/3844228474 reap_dead start 2024-09-10T05:38:22.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.024+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3844228474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aaa0af3e0 msgr2=0x555aaa0b5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.024+0000 7f3a2db869c0 1 --2- 172.21.15.62:0/3844228474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aaa0af3e0 0x555aaa0b5750 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f3a2403cfd0 tx=0x7f3a24036f50 comp rx=0 tx=0).stop 2024-09-10T05:38:22.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.024+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3844228474 shutdown_connections 2024-09-10T05:38:22.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.024+0000 7f3a2db869c0 1 --2- 172.21.15.62:0/3844228474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aaa0af3e0 0x555aaa0b5750 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.028+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3844228474 >> 172.21.15.62:0/3844228474 conn(0x555aaa0aa800 msgr2=0x555aaa0a8a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:22.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.028+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3844228474 shutdown_connections 2024-09-10T05:38:22.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.028+0000 7f3a2db869c0 1 -- 172.21.15.62:0/3844228474 wait complete. 2024-09-10T05:38:22.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.028+0000 7f3a2db869c0 1 -- 172.21.15.62:0/1760774934 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3904039a70 msgr2=0x7f390403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.028+0000 7f3a2db869c0 1 --2- 172.21.15.62:0/1760774934 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3904039a70 0x7f390403bf30 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x555aaa08b9d0 tx=0x7f3a14005ad0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.028+0000 7f3a2db869c0 1 -- 172.21.15.62:0/1760774934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aaa0a1c50 msgr2=0x555aaa0a2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.028+0000 7f3a2db869c0 1 --2- 172.21.15.62:0/1760774934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aaa0a1c50 0x555aaa0a2070 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f3a2404e890 tx=0x7f3a24003f60 comp rx=0 tx=0).stop 2024-09-10T05:38:22.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.028+0000 7f3a2db869c0 1 -- 172.21.15.62:0/1760774934 shutdown_connections 2024-09-10T05:38:22.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.028+0000 7f3a2db869c0 1 --2- 172.21.15.62:0/1760774934 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3904039a70 0x7f390403bf30 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.028+0000 7f3a2db869c0 1 --2- 172.21.15.62:0/1760774934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aaa0a1c50 0x555aaa0a2070 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.028+0000 7f3a2db869c0 1 -- 172.21.15.62:0/1760774934 >> 172.21.15.62:0/1760774934 conn(0x555aaa097600 msgr2=0x555aaa0979e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:22.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.028+0000 7f3a2db869c0 1 -- 172.21.15.62:0/1760774934 shutdown_connections 2024-09-10T05:38:22.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.028+0000 7f3a2db869c0 1 -- 172.21.15.62:0/1760774934 wait complete. 2024-09-10T05:38:22.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.028+0000 7f3a2db869c0 1 -- 172.21.15.62:0/575655109 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x555aaa08c130 msgr2=0x555aaa08e5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.028+0000 7f3a2db869c0 1 --2- 172.21.15.62:0/575655109 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x555aaa08c130 0x555aaa08e5f0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.028+0000 7f3a2db869c0 1 -- 172.21.15.62:0/575655109 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x555aa9f035e0 msgr2=0x555aaa08b0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.028+0000 7f3a2db869c0 1 --2- 172.21.15.62:0/575655109 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x555aa9f035e0 0x555aaa08b0f0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.028+0000 7f3a2db869c0 1 -- 172.21.15.62:0/575655109 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x555aaa090b20 msgr2=0x555aaa092f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.028+0000 7f3a2db869c0 1 --2- 172.21.15.62:0/575655109 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x555aaa090b20 0x555aaa092f10 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.028+0000 7f3a2db869c0 1 -- 172.21.15.62:0/575655109 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3910039ac0 msgr2=0x7f391003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.028+0000 7f3a2db869c0 1 --2- 172.21.15.62:0/575655109 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3910039ac0 0x7f391003bf80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3a140ae000 tx=0x7f3a140a6000 comp rx=0 tx=0).stop 2024-09-10T05:38:22.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.028+0000 7f3a2db869c0 1 -- 172.21.15.62:0/575655109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa9f03200 msgr2=0x555aaa083f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.028+0000 7f3a2db869c0 1 --2- 172.21.15.62:0/575655109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555aa9f03200 0x555aaa083f80 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x555aaa07d890 tx=0x7f3a24000f50 comp rx=0 tx=0).stop 2024-09-10T05:38:22.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.028+0000 7f3a2be8d640 1 -- 172.21.15.62:0/575655109 reap_dead start 2024-09-10T05:38:22.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.028+0000 7f3a2db869c0 1 -- 172.21.15.62:0/575655109 shutdown_connections 2024-09-10T05:38:22.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.028+0000 7f3a2db869c0 1 -- 172.21.15.62:0/575655109 >> 172.21.15.62:0/575655109 conn(0x555aa9f89920 msgr2=0x555aaa076fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:22.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.028+0000 7f3a2db869c0 1 -- 172.21.15.62:0/575655109 shutdown_connections 2024-09-10T05:38:22.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.028+0000 7f3a2db869c0 1 -- 172.21.15.62:0/575655109 wait complete. 2024-09-10T05:38:22.041 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-10T05:38:22.042 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2024-09-10T05:38:22.042 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2024-09-10T05:38:22.042 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2024-09-10T05:38:22.116 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:38:22.116 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:38:22.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.112+0000 7f654151b9c0 1 Processor -- start 2024-09-10T05:38:22.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.112+0000 7f654151b9c0 1 -- start start 2024-09-10T05:38:22.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.112+0000 7f654151b9c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5566ae947170 0x5566ae945cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.112+0000 7f654151b9c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5566ae8849c0 con 0x5566ae946c40 2024-09-10T05:38:22.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.112+0000 7f654151b9c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x5566ae8d46d0 con 0x5566ae947170 2024-09-10T05:38:22.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.116+0000 7f653e820640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5566ae947170 0x5566ae945cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.116+0000 7f653e820640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5566ae947170 0x5566ae945cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38350/0 (socket says 172.21.15.62:38350) 2024-09-10T05:38:22.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.116+0000 7f653e820640 1 -- 172.21.15.62:0/82161056 learned_addr learned my addr 172.21.15.62:0/82161056 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:22.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.116+0000 7f653f021640 1 --1- 172.21.15.62:0/82161056 >> v1:172.21.15.2:6789/0 conn(0x5566ae946c40 0x5566ae9455e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:52034/0 (socket says 172.21.15.62:52034) 2024-09-10T05:38:22.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.116+0000 7f653e820640 1 -- 172.21.15.62:0/82161056 >> v1:172.21.15.2:6789/0 conn(0x5566ae946c40 legacy=0x5566ae9455e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.116+0000 7f653e820640 1 -- 172.21.15.62:0/82161056 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566ae878ca0 con 0x5566ae947170 2024-09-10T05:38:22.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.116+0000 7f653e820640 1 --2- 172.21.15.62:0/82161056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566ae947170 0x5566ae945cf0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f652800a5c0 tx=0x7f652801b2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3461763503ab0a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.116+0000 7f653e01f640 1 -- 172.21.15.62:0/82161056 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65280aa540 con 0x5566ae947170 2024-09-10T05:38:22.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.116+0000 7f653e01f640 1 -- 172.21.15.62:0/82161056 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65280af070 con 0x5566ae947170 2024-09-10T05:38:22.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.116+0000 7f653e01f640 1 -- 172.21.15.62:0/82161056 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65280aa830 con 0x5566ae947170 2024-09-10T05:38:22.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.120+0000 7f654151b9c0 1 -- 172.21.15.62:0/82161056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566ae947170 msgr2=0x5566ae945cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.120+0000 7f654151b9c0 1 --2- 172.21.15.62:0/82161056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566ae947170 0x5566ae945cf0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f652800a5c0 tx=0x7f652801b2e0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.120+0000 7f654151b9c0 1 -- 172.21.15.62:0/82161056 shutdown_connections 2024-09-10T05:38:22.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.120+0000 7f654151b9c0 1 --2- 172.21.15.62:0/82161056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566ae947170 0x5566ae945cf0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.120+0000 7f654151b9c0 1 -- 172.21.15.62:0/82161056 >> 172.21.15.62:0/82161056 conn(0x5566ae9cbb80 msgr2=0x5566ae9cdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:22.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.120+0000 7f654151b9c0 1 -- 172.21.15.62:0/82161056 shutdown_connections 2024-09-10T05:38:22.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.120+0000 7f654151b9c0 1 -- 172.21.15.62:0/82161056 wait complete. 2024-09-10T05:38:22.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.132+0000 7f654151b9c0 1 Processor -- start 2024-09-10T05:38:22.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.132+0000 7f654151b9c0 1 -- start start 2024-09-10T05:38:22.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.132+0000 7f654151b9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566ae946c40 0x5566aeabdc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.132+0000 7f654151b9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5566ae8d8680 con 0x5566ae946c40 2024-09-10T05:38:22.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.136+0000 7f653f021640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566ae946c40 0x5566aeabdc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.136+0000 7f653f021640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566ae946c40 0x5566aeabdc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38360/0 (socket says 172.21.15.62:38360) 2024-09-10T05:38:22.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.136+0000 7f653f021640 1 -- 172.21.15.62:0/71041753 learned_addr learned my addr 172.21.15.62:0/71041753 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:22.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.136+0000 7f653f021640 1 -- 172.21.15.62:0/71041753 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566ae853da0 con 0x5566ae946c40 2024-09-10T05:38:22.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.136+0000 7f653f021640 1 --2- 172.21.15.62:0/71041753 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566ae946c40 0x5566aeabdc70 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f65300016f0 tx=0x7f6530001bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20d52c6a1359b99e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.136+0000 7f642d60a640 1 -- 172.21.15.62:0/71041753 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6530003460 con 0x5566ae946c40 2024-09-10T05:38:22.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.136+0000 7f642d60a640 1 -- 172.21.15.62:0/71041753 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6530003620 con 0x5566ae946c40 2024-09-10T05:38:22.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.136+0000 7f642d60a640 1 -- 172.21.15.62:0/71041753 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6530003940 con 0x5566ae946c40 2024-09-10T05:38:22.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.136+0000 7f654151b9c0 1 -- 172.21.15.62:0/71041753 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566ae946c40 msgr2=0x5566aeabdc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.136+0000 7f654151b9c0 1 --2- 172.21.15.62:0/71041753 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566ae946c40 0x5566aeabdc70 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f65300016f0 tx=0x7f6530001bb0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.136+0000 7f654151b9c0 1 -- 172.21.15.62:0/71041753 shutdown_connections 2024-09-10T05:38:22.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.136+0000 7f654151b9c0 1 --2- 172.21.15.62:0/71041753 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566ae946c40 0x5566aeabdc70 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.136+0000 7f654151b9c0 1 -- 172.21.15.62:0/71041753 >> 172.21.15.62:0/71041753 conn(0x5566ae9cbb80 msgr2=0x5566aeab9910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:22.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.136+0000 7f654151b9c0 1 -- 172.21.15.62:0/71041753 shutdown_connections 2024-09-10T05:38:22.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.136+0000 7f654151b9c0 1 -- 172.21.15.62:0/71041753 wait complete. 2024-09-10T05:38:22.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.136+0000 7f654151b9c0 1 Processor -- start 2024-09-10T05:38:22.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.136+0000 7f654151b9c0 1 -- start start 2024-09-10T05:38:22.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.136+0000 7f654151b9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566ae946c40 0x5566aeac5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.136+0000 7f654151b9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5566ae87aa50 con 0x5566ae946c40 2024-09-10T05:38:22.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.136+0000 7f653f021640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566ae946c40 0x5566aeac5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.136+0000 7f653f021640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566ae946c40 0x5566aeac5280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38370/0 (socket says 172.21.15.62:38370) 2024-09-10T05:38:22.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.136+0000 7f653f021640 1 -- 172.21.15.62:0/4100103875 learned_addr learned my addr 172.21.15.62:0/4100103875 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:22.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.136+0000 7f653f021640 1 -- 172.21.15.62:0/4100103875 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566aeac57e0 con 0x5566ae946c40 2024-09-10T05:38:22.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.140+0000 7f653f021640 1 --2- 172.21.15.62:0/4100103875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566ae946c40 0x5566aeac5280 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x5566aeabec60 tx=0x7f6530001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.140+0000 7f642be07640 1 -- 172.21.15.62:0/4100103875 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6530022020 con 0x5566ae946c40 2024-09-10T05:38:22.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.140+0000 7f654151b9c0 1 -- 172.21.15.62:0/4100103875 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5566aeac5a70 con 0x5566ae946c40 2024-09-10T05:38:22.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.140+0000 7f642be07640 1 -- 172.21.15.62:0/4100103875 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f653001e5d0 con 0x5566ae946c40 2024-09-10T05:38:22.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.140+0000 7f642be07640 1 -- 172.21.15.62:0/4100103875 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f653001e930 con 0x5566ae946c40 2024-09-10T05:38:22.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.140+0000 7f654151b9c0 1 -- 172.21.15.62:0/4100103875 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566aeac64a0 con 0x5566ae946c40 2024-09-10T05:38:22.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.140+0000 7f654151b9c0 1 Processor -- start 2024-09-10T05:38:22.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.140+0000 7f654151b9c0 1 -- start start 2024-09-10T05:38:22.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.140+0000 7f654151b9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566aead1ea0 0x5566aead22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.140+0000 7f654151b9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5566ae8e5450 con 0x5566aead1ea0 2024-09-10T05:38:22.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.140+0000 7f642be07640 1 -- 172.21.15.62:0/4100103875 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6530025020 con 0x5566ae946c40 2024-09-10T05:38:22.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.140+0000 7f653f822640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566aead1ea0 0x5566aead22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.140+0000 7f653f822640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566aead1ea0 0x5566aead22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38386/0 (socket says 172.21.15.62:38386) 2024-09-10T05:38:22.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.140+0000 7f653f822640 1 -- 172.21.15.62:0/2605417325 learned_addr learned my addr 172.21.15.62:0/2605417325 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:22.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.140+0000 7f642be07640 1 --2- 172.21.15.62:0/4100103875 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6424039a70 0x7f642403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.140+0000 7f642be07640 1 -- 172.21.15.62:0/4100103875 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7f6530050180 con 0x5566ae946c40 2024-09-10T05:38:22.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.140+0000 7f653f021640 1 --2- 172.21.15.62:0/4100103875 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6424039a70 0x7f642403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.140+0000 7f653f822640 1 -- 172.21.15.62:0/2605417325 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566aead2890 con 0x5566aead1ea0 2024-09-10T05:38:22.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.140+0000 7f653f822640 1 --2- 172.21.15.62:0/2605417325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566aead1ea0 0x5566aead22a0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f653800a440 tx=0x7f653800a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14e418f542b52e8c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.140+0000 7f653f021640 1 --2- 172.21.15.62:0/4100103875 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6424039a70 0x7f642403bf30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f653001eb40 tx=0x7f6530034040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.140+0000 7f6429e03640 1 -- 172.21.15.62:0/2605417325 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6538008850 con 0x5566aead1ea0 2024-09-10T05:38:22.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.140+0000 7f6429e03640 1 -- 172.21.15.62:0/2605417325 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6538008a10 con 0x5566aead1ea0 2024-09-10T05:38:22.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.140+0000 7f6429e03640 1 -- 172.21.15.62:0/2605417325 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6538008d30 con 0x5566aead1ea0 2024-09-10T05:38:22.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.140+0000 7f654151b9c0 1 -- 172.21.15.62:0/2605417325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566aead1ea0 msgr2=0x5566aead22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.140+0000 7f654151b9c0 1 --2- 172.21.15.62:0/2605417325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566aead1ea0 0x5566aead22a0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f653800a440 tx=0x7f653800a900 comp rx=0 tx=0).stop 2024-09-10T05:38:22.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.140+0000 7f654151b9c0 1 -- 172.21.15.62:0/2605417325 shutdown_connections 2024-09-10T05:38:22.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.140+0000 7f654151b9c0 1 --2- 172.21.15.62:0/2605417325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566aead1ea0 0x5566aead22a0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.140+0000 7f654151b9c0 1 -- 172.21.15.62:0/2605417325 >> 172.21.15.62:0/2605417325 conn(0x5566ae947170 msgr2=0x5566aeacd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:22.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.140+0000 7f654151b9c0 1 -- 172.21.15.62:0/2605417325 shutdown_connections 2024-09-10T05:38:22.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.140+0000 7f654151b9c0 1 -- 172.21.15.62:0/2605417325 wait complete. 2024-09-10T05:38:22.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.140+0000 7f654151b9c0 1 Processor -- start 2024-09-10T05:38:22.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.140+0000 7f654151b9c0 1 -- start start 2024-09-10T05:38:22.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.144+0000 7f654151b9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566aead1ea0 0x5566aead9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.144+0000 7f654151b9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5566aead3080 con 0x5566aead1ea0 2024-09-10T05:38:22.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.144+0000 7f653f822640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566aead1ea0 0x5566aead9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.144+0000 7f653f822640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566aead1ea0 0x5566aead9240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38396/0 (socket says 172.21.15.62:38396) 2024-09-10T05:38:22.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.144+0000 7f653f822640 1 -- 172.21.15.62:0/1713554428 learned_addr learned my addr 172.21.15.62:0/1713554428 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:22.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.144+0000 7f653f822640 1 -- 172.21.15.62:0/1713554428 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566aead97a0 con 0x5566aead1ea0 2024-09-10T05:38:22.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.144+0000 7f653f822640 1 --2- 172.21.15.62:0/1713554428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566aead1ea0 0x5566aead9240 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x5566aead2da0 tx=0x7f6538003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.144+0000 7f641bfff640 1 -- 172.21.15.62:0/1713554428 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6538013a70 con 0x5566aead1ea0 2024-09-10T05:38:22.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.144+0000 7f654151b9c0 1 -- 172.21.15.62:0/1713554428 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5566aead9a30 con 0x5566aead1ea0 2024-09-10T05:38:22.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.144+0000 7f641bfff640 1 -- 172.21.15.62:0/1713554428 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6538023070 con 0x5566aead1ea0 2024-09-10T05:38:22.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.144+0000 7f641bfff640 1 -- 172.21.15.62:0/1713554428 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6538013d80 con 0x5566aead1ea0 2024-09-10T05:38:22.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.144+0000 7f654151b9c0 1 -- 172.21.15.62:0/1713554428 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566aeada3e0 con 0x5566aead1ea0 2024-09-10T05:38:22.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.144+0000 7f654151b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:38:22.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.144+0000 7f654151b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:38:22.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.144+0000 7f641bfff640 1 -- 172.21.15.62:0/1713554428 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6538028460 con 0x5566aead1ea0 2024-09-10T05:38:22.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.144+0000 7f654151b9c0 1 Processor -- start 2024-09-10T05:38:22.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.144+0000 7f641bfff640 1 --2- 172.21.15.62:0/1713554428 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6420039a70 0x7f642003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.144+0000 7f654151b9c0 1 -- start start 2024-09-10T05:38:22.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.144+0000 7f653f822640 1 --2- 172.21.15.62:0/1713554428 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6420039a70 0x7f642003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.144+0000 7f641bfff640 1 -- 172.21.15.62:0/1713554428 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7f6538050640 con 0x5566aead1ea0 2024-09-10T05:38:22.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.144+0000 7f654151b9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566aeaf2950 0x5566aeaf2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.144+0000 7f654151b9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5566aeabe440 con 0x5566aeaf2950 2024-09-10T05:38:22.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.148+0000 7f653f822640 1 --2- 172.21.15.62:0/1713554428 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6420039a70 0x7f642003bf30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6538050a40 tx=0x7f6538050990 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.148+0000 7f653f021640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566aeaf2950 0x5566aeaf2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.148+0000 7f653f021640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566aeaf2950 0x5566aeaf2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38412/0 (socket says 172.21.15.62:38412) 2024-09-10T05:38:22.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.148+0000 7f653f021640 1 -- 172.21.15.62:0/191536987 learned_addr learned my addr 172.21.15.62:0/191536987 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:22.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.148+0000 7f653f021640 1 -- 172.21.15.62:0/191536987 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566aeaf33b0 con 0x5566aeaf2950 2024-09-10T05:38:22.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.148+0000 7f653f021640 1 --2- 172.21.15.62:0/191536987 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566aeaf2950 0x5566aeaf2d70 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f653004e550 tx=0x7f6530006840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.148+0000 7f63a7fff640 1 -- 172.21.15.62:0/191536987 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f653004f670 con 0x5566aeaf2950 2024-09-10T05:38:22.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.148+0000 7f654151b9c0 1 -- 172.21.15.62:0/191536987 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5566aeaf3b50 con 0x5566aeaf2950 2024-09-10T05:38:22.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.148+0000 7f63a7fff640 1 -- 172.21.15.62:0/191536987 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f653004f810 con 0x5566aeaf2950 2024-09-10T05:38:22.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.148+0000 7f63a7fff640 1 -- 172.21.15.62:0/191536987 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f653004faf0 con 0x5566aeaf2950 2024-09-10T05:38:22.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.148+0000 7f654151b9c0 1 -- 172.21.15.62:0/191536987 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566aeaf40c0 con 0x5566aeaf2950 2024-09-10T05:38:22.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.148+0000 7f63a7fff640 1 -- 172.21.15.62:0/191536987 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6530039070 con 0x5566aeaf2950 2024-09-10T05:38:22.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.148+0000 7f63a7fff640 1 --2- 172.21.15.62:0/191536987 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6378039a70 0x7f637803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.148+0000 7f63a7fff640 1 -- 172.21.15.62:0/191536987 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7f6530043070 con 0x5566aeaf2950 2024-09-10T05:38:22.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.148+0000 7f653e820640 1 --2- 172.21.15.62:0/191536987 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6378039a70 0x7f637803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.148+0000 7f63a5ffb640 20 reqs_thread_entry: start 2024-09-10T05:38:22.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.148+0000 7f654151b9c0 1 --2- 172.21.15.62:0/4100103875 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5566aeaf8370 0x5566aeafa810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.148+0000 7f654151b9c0 1 -- 172.21.15.62:0/4100103875 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5566aeafaee0 con 0x5566aeaf8370 2024-09-10T05:38:22.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.148+0000 7f653e820640 1 --2- 172.21.15.62:0/191536987 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6378039a70 0x7f637803bf30 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f65280ae000 tx=0x7f65280a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.148+0000 7f653f822640 1 --2- 172.21.15.62:0/4100103875 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5566aeaf8370 0x5566aeafa810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.152+0000 7f653f822640 1 --2- 172.21.15.62:0/4100103875 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5566aeaf8370 0x5566aeafa810 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.152+0000 7f653f822640 1 -- 172.21.15.62:0/4100103875 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6538027ce0 con 0x5566aeaf8370 2024-09-10T05:38:22.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.152+0000 7f654151b9c0 1 --2- 172.21.15.62:0/4100103875 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5566aeafccb0 0x5566aeaff0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.152+0000 7f654151b9c0 1 -- 172.21.15.62:0/4100103875 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:2 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5566aeaff770 con 0x5566aeafccb0 2024-09-10T05:38:22.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.152+0000 7f653f021640 1 --2- 172.21.15.62:0/4100103875 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5566aeafccb0 0x5566aeaff0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.152+0000 7f653f021640 1 --2- 172.21.15.62:0/4100103875 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5566aeafccb0 0x5566aeaff0a0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.152+0000 7f653f021640 1 -- 172.21.15.62:0/4100103875 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(2 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f653004d020 con 0x5566aeafccb0 2024-09-10T05:38:22.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.152+0000 7f654151b9c0 1 -- 172.21.15.62:0/1713554428 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6420039a70 msgr2=0x7f642003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.152+0000 7f654151b9c0 1 --2- 172.21.15.62:0/1713554428 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6420039a70 0x7f642003bf30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6538050a40 tx=0x7f6538050990 comp rx=0 tx=0).stop 2024-09-10T05:38:22.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.152+0000 7f654151b9c0 1 -- 172.21.15.62:0/1713554428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566aead1ea0 msgr2=0x5566aead9240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.152+0000 7f654151b9c0 1 --2- 172.21.15.62:0/1713554428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566aead1ea0 0x5566aead9240 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x5566aead2da0 tx=0x7f6538003000 comp rx=0 tx=0).stop 2024-09-10T05:38:22.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.152+0000 7f654151b9c0 1 -- 172.21.15.62:0/1713554428 shutdown_connections 2024-09-10T05:38:22.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.152+0000 7f654151b9c0 1 --2- 172.21.15.62:0/1713554428 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6420039a70 0x7f642003bf30 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.152+0000 7f654151b9c0 1 --2- 172.21.15.62:0/1713554428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566aead1ea0 0x5566aead9240 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.152+0000 7f654151b9c0 1 -- 172.21.15.62:0/1713554428 >> 172.21.15.62:0/1713554428 conn(0x5566ae947170 msgr2=0x5566aeacd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:22.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.152+0000 7f654151b9c0 1 -- 172.21.15.62:0/1713554428 shutdown_connections 2024-09-10T05:38:22.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.152+0000 7f654151b9c0 1 -- 172.21.15.62:0/1713554428 wait complete. 2024-09-10T05:38:22.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.152+0000 7f654151b9c0 1 -- 172.21.15.62:0/191536987 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6378039a70 msgr2=0x7f637803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.152+0000 7f654151b9c0 1 --2- 172.21.15.62:0/191536987 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6378039a70 0x7f637803bf30 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f65280ae000 tx=0x7f65280a6000 comp rx=0 tx=0).stop 2024-09-10T05:38:22.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.152+0000 7f654151b9c0 1 -- 172.21.15.62:0/191536987 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566aeaf2950 msgr2=0x5566aeaf2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.152+0000 7f654151b9c0 1 --2- 172.21.15.62:0/191536987 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566aeaf2950 0x5566aeaf2d70 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f653004e550 tx=0x7f6530006840 comp rx=0 tx=0).stop 2024-09-10T05:38:22.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.152+0000 7f654151b9c0 1 -- 172.21.15.62:0/191536987 shutdown_connections 2024-09-10T05:38:22.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.156+0000 7f654151b9c0 1 --2- 172.21.15.62:0/191536987 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6378039a70 0x7f637803bf30 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.156+0000 7f654151b9c0 1 --2- 172.21.15.62:0/191536987 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566aeaf2950 0x5566aeaf2d70 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.156+0000 7f654151b9c0 1 -- 172.21.15.62:0/191536987 >> 172.21.15.62:0/191536987 conn(0x5566aeae7f50 msgr2=0x5566aeae8330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:22.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.156+0000 7f654151b9c0 1 -- 172.21.15.62:0/191536987 shutdown_connections 2024-09-10T05:38:22.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.156+0000 7f654151b9c0 1 -- 172.21.15.62:0/191536987 wait complete. 2024-09-10T05:38:22.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.156+0000 7f654151b9c0 1 -- 172.21.15.62:0/4100103875 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5566aeaf8370 msgr2=0x5566aeafa810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.156+0000 7f654151b9c0 1 --2- 172.21.15.62:0/4100103875 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5566aeaf8370 0x5566aeafa810 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.156+0000 7f654151b9c0 1 -- 172.21.15.62:0/4100103875 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5566aeafccb0 msgr2=0x5566aeaff0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.156+0000 7f654151b9c0 1 --2- 172.21.15.62:0/4100103875 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5566aeafccb0 0x5566aeaff0a0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.156+0000 7f654151b9c0 1 -- 172.21.15.62:0/4100103875 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6424039a70 msgr2=0x7f642403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.156+0000 7f654151b9c0 1 --2- 172.21.15.62:0/4100103875 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6424039a70 0x7f642403bf30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f653001eb40 tx=0x7f6530034040 comp rx=0 tx=0).stop 2024-09-10T05:38:22.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.156+0000 7f654151b9c0 1 -- 172.21.15.62:0/4100103875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566ae946c40 msgr2=0x5566aeac5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.156+0000 7f654151b9c0 1 --2- 172.21.15.62:0/4100103875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566ae946c40 0x5566aeac5280 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x5566aeabec60 tx=0x7f6530001260 comp rx=0 tx=0).stop 2024-09-10T05:38:22.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.156+0000 7f654151b9c0 1 -- 172.21.15.62:0/4100103875 shutdown_connections 2024-09-10T05:38:22.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.156+0000 7f654151b9c0 1 --2- 172.21.15.62:0/4100103875 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5566aeafccb0 0x5566aeaff0a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.156+0000 7f654151b9c0 1 --2- 172.21.15.62:0/4100103875 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5566aeaf8370 0x5566aeafa810 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.156+0000 7f654151b9c0 1 --2- 172.21.15.62:0/4100103875 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f6424039a70 0x7f642403bf30 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.156+0000 7f654151b9c0 1 --2- 172.21.15.62:0/4100103875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566ae946c40 0x5566aeac5280 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.156+0000 7f654151b9c0 1 -- 172.21.15.62:0/4100103875 >> 172.21.15.62:0/4100103875 conn(0x5566ae9cbb80 msgr2=0x5566aeab83a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:22.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.156+0000 7f654151b9c0 1 -- 172.21.15.62:0/4100103875 shutdown_connections 2024-09-10T05:38:22.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.156+0000 7f654151b9c0 1 -- 172.21.15.62:0/4100103875 wait complete. 2024-09-10T05:38:22.169 INFO:teuthology.orchestra.run.smithi062.stdout:{"id":"475ecc13-ad4b-423e-b7f2-f7f260e17071","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-10T05:38:22.169 DEBUG:tasks.util.rgw: json result: {'id': '475ecc13-ad4b-423e-b7f2-f7f260e17071', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-10T05:38:22.170 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2024-09-10T05:38:22.170 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2024-09-10T05:38:22.170 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2024-09-10T05:38:22.243 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:38:22.243 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:38:22.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.240+0000 7f0981e1e9c0 1 Processor -- start 2024-09-10T05:38:22.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.240+0000 7f0981e1e9c0 1 -- start start 2024-09-10T05:38:22.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.240+0000 7f0981e1e9c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55c818cdd1d0 0x55c818d6e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.240+0000 7f0981e1e9c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c818c1d9c0 con 0x55c818cdd5b0 2024-09-10T05:38:22.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.240+0000 7f0981e1e9c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x55c818c6d6d0 con 0x55c818cdd1d0 2024-09-10T05:38:22.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.240+0000 7f097f924640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55c818cdd1d0 0x55c818d6e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.240+0000 7f097f123640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x55c818cdd5b0 0x55c818d70550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:52048/0 (socket says 172.21.15.62:52048) 2024-09-10T05:38:22.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.240+0000 7f097f123640 1 -- 172.21.15.62:0/1308242653 learned_addr learned my addr 172.21.15.62:0/1308242653 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-10T05:38:22.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.244+0000 7f097f924640 1 -- 172.21.15.62:0/1308242653 >> v1:172.21.15.2:6789/0 conn(0x55c818cdd5b0 legacy=0x55c818d70550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.244+0000 7f097f924640 1 -- 172.21.15.62:0/1308242653 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c818c11ca0 con 0x55c818cdd1d0 2024-09-10T05:38:22.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.244+0000 7f097f924640 1 --2- 172.21.15.62:0/1308242653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c818cdd1d0 0x55c818d6e000 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f097800a420 tx=0x7f097801afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20f1d3dcc551b854 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.244+0000 7f097e922640 1 -- 172.21.15.62:0/1308242653 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09780af070 con 0x55c818cdd1d0 2024-09-10T05:38:22.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.244+0000 7f097e922640 1 -- 172.21.15.62:0/1308242653 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09780aa530 con 0x55c818cdd1d0 2024-09-10T05:38:22.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.244+0000 7f097e922640 1 -- 172.21.15.62:0/1308242653 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09780aa850 con 0x55c818cdd1d0 2024-09-10T05:38:22.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.244+0000 7f0981e1e9c0 1 -- 172.21.15.62:0/1308242653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c818cdd1d0 msgr2=0x55c818d6e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.244+0000 7f0981e1e9c0 1 --2- 172.21.15.62:0/1308242653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c818cdd1d0 0x55c818d6e000 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f097800a420 tx=0x7f097801afd0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.244+0000 7f0981e1e9c0 1 -- 172.21.15.62:0/1308242653 shutdown_connections 2024-09-10T05:38:22.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.244+0000 7f0981e1e9c0 1 --2- 172.21.15.62:0/1308242653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c818cdd1d0 0x55c818d6e000 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.244+0000 7f0981e1e9c0 1 -- 172.21.15.62:0/1308242653 >> 172.21.15.62:0/1308242653 conn(0x55c818d638f0 msgr2=0x55c818d65d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:22.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.244+0000 7f0981e1e9c0 1 -- 172.21.15.62:0/1308242653 shutdown_connections 2024-09-10T05:38:22.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.244+0000 7f0981e1e9c0 1 -- 172.21.15.62:0/1308242653 wait complete. 2024-09-10T05:38:22.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.260+0000 7f0981e1e9c0 1 Processor -- start 2024-09-10T05:38:22.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.260+0000 7f0981e1e9c0 1 -- start start 2024-09-10T05:38:22.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.260+0000 7f0981e1e9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c818cdd1d0 0x55c818e568e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.260+0000 7f0981e1e9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c818c71680 con 0x55c818cdd1d0 2024-09-10T05:38:22.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.260+0000 7f097f924640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c818cdd1d0 0x55c818e568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.260+0000 7f097f924640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c818cdd1d0 0x55c818e568e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38440/0 (socket says 172.21.15.62:38440) 2024-09-10T05:38:22.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.260+0000 7f097f924640 1 -- 172.21.15.62:0/1708791663 learned_addr learned my addr 172.21.15.62:0/1708791663 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:22.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.264+0000 7f097f924640 1 -- 172.21.15.62:0/1708791663 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c818becda0 con 0x55c818cdd1d0 2024-09-10T05:38:22.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.264+0000 7f097f924640 1 --2- 172.21.15.62:0/1708791663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c818cdd1d0 0x55c818e568e0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f0978018c00 tx=0x7f09780033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63bfce067be08ff1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.264+0000 7f086de0b640 1 -- 172.21.15.62:0/1708791663 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09780af050 con 0x55c818cdd1d0 2024-09-10T05:38:22.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.264+0000 7f086de0b640 1 -- 172.21.15.62:0/1708791663 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09780b0040 con 0x55c818cdd1d0 2024-09-10T05:38:22.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.264+0000 7f086de0b640 1 -- 172.21.15.62:0/1708791663 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09780aabb0 con 0x55c818cdd1d0 2024-09-10T05:38:22.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.264+0000 7f0981e1e9c0 1 -- 172.21.15.62:0/1708791663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c818cdd1d0 msgr2=0x55c818e568e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.264+0000 7f0981e1e9c0 1 --2- 172.21.15.62:0/1708791663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c818cdd1d0 0x55c818e568e0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f0978018c00 tx=0x7f09780033b0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.264+0000 7f0981e1e9c0 1 -- 172.21.15.62:0/1708791663 shutdown_connections 2024-09-10T05:38:22.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.264+0000 7f0981e1e9c0 1 --2- 172.21.15.62:0/1708791663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c818cdd1d0 0x55c818e568e0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.264+0000 7f0981e1e9c0 1 -- 172.21.15.62:0/1708791663 >> 172.21.15.62:0/1708791663 conn(0x55c818d638f0 msgr2=0x55c818e52520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:22.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.264+0000 7f0981e1e9c0 1 -- 172.21.15.62:0/1708791663 shutdown_connections 2024-09-10T05:38:22.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.264+0000 7f0981e1e9c0 1 -- 172.21.15.62:0/1708791663 wait complete. 2024-09-10T05:38:22.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.264+0000 7f0981e1e9c0 1 Processor -- start 2024-09-10T05:38:22.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.264+0000 7f0981e1e9c0 1 -- start start 2024-09-10T05:38:22.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.264+0000 7f0981e1e9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c818cdd1d0 0x55c818e5de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.264+0000 7f0981e1e9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c818c13a50 con 0x55c818cdd1d0 2024-09-10T05:38:22.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.264+0000 7f097f924640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c818cdd1d0 0x55c818e5de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.264+0000 7f097f924640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c818cdd1d0 0x55c818e5de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38454/0 (socket says 172.21.15.62:38454) 2024-09-10T05:38:22.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.264+0000 7f097f924640 1 -- 172.21.15.62:0/1088402980 learned_addr learned my addr 172.21.15.62:0/1088402980 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:22.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.264+0000 7f097f924640 1 -- 172.21.15.62:0/1088402980 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c818e5e3b0 con 0x55c818cdd1d0 2024-09-10T05:38:22.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.264+0000 7f097f924640 1 --2- 172.21.15.62:0/1088402980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c818cdd1d0 0x55c818e5de50 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f0978019680 tx=0x7f0978017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.268+0000 7f0867fff640 1 -- 172.21.15.62:0/1088402980 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09780c4070 con 0x55c818cdd1d0 2024-09-10T05:38:22.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.268+0000 7f0867fff640 1 -- 172.21.15.62:0/1088402980 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09780b6ce0 con 0x55c818cdd1d0 2024-09-10T05:38:22.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.268+0000 7f0981e1e9c0 1 -- 172.21.15.62:0/1088402980 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c818e5e640 con 0x55c818cdd1d0 2024-09-10T05:38:22.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.268+0000 7f0867fff640 1 -- 172.21.15.62:0/1088402980 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09780c0470 con 0x55c818cdd1d0 2024-09-10T05:38:22.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.268+0000 7f0981e1e9c0 1 -- 172.21.15.62:0/1088402980 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c818e5eff0 con 0x55c818cdd1d0 2024-09-10T05:38:22.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.268+0000 7f0981e1e9c0 1 Processor -- start 2024-09-10T05:38:22.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.268+0000 7f0981e1e9c0 1 -- start start 2024-09-10T05:38:22.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.268+0000 7f0981e1e9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c818e6aa70 0x55c818e6ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.268+0000 7f0981e1e9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c818c7e450 con 0x55c818e6aa70 2024-09-10T05:38:22.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.268+0000 7f0867fff640 1 -- 172.21.15.62:0/1088402980 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f09780c7070 con 0x55c818cdd1d0 2024-09-10T05:38:22.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.268+0000 7f0980125640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c818e6aa70 0x55c818e6ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.268+0000 7f0980125640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c818e6aa70 0x55c818e6ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38458/0 (socket says 172.21.15.62:38458) 2024-09-10T05:38:22.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.268+0000 7f0980125640 1 -- 172.21.15.62:0/148768574 learned_addr learned my addr 172.21.15.62:0/148768574 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:22.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.268+0000 7f0867fff640 1 --2- 172.21.15.62:0/1088402980 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0868039b10 0x7f086803bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.268+0000 7f0867fff640 1 -- 172.21.15.62:0/1088402980 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7f09780bb070 con 0x55c818cdd1d0 2024-09-10T05:38:22.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.268+0000 7f097f924640 1 --2- 172.21.15.62:0/1088402980 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0868039b10 0x7f086803bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.268+0000 7f0980125640 1 -- 172.21.15.62:0/148768574 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c818e6b460 con 0x55c818e6aa70 2024-09-10T05:38:22.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.268+0000 7f097f924640 1 --2- 172.21.15.62:0/1088402980 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0868039b10 0x7f086803bfd0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0978003430 tx=0x7f09780cb040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.268+0000 7f0980125640 1 --2- 172.21.15.62:0/148768574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c818e6aa70 0x55c818e6ae70 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f097000a440 tx=0x7f097000a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=850bf64a947fa50d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.268+0000 7f0865ffb640 1 -- 172.21.15.62:0/148768574 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0970008850 con 0x55c818e6aa70 2024-09-10T05:38:22.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.268+0000 7f0865ffb640 1 -- 172.21.15.62:0/148768574 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0970008a10 con 0x55c818e6aa70 2024-09-10T05:38:22.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.268+0000 7f0865ffb640 1 -- 172.21.15.62:0/148768574 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0970008d30 con 0x55c818e6aa70 2024-09-10T05:38:22.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.268+0000 7f0981e1e9c0 1 -- 172.21.15.62:0/148768574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c818e6aa70 msgr2=0x55c818e6ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.268+0000 7f0981e1e9c0 1 --2- 172.21.15.62:0/148768574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c818e6aa70 0x55c818e6ae70 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f097000a440 tx=0x7f097000a900 comp rx=0 tx=0).stop 2024-09-10T05:38:22.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.268+0000 7f0981e1e9c0 1 -- 172.21.15.62:0/148768574 shutdown_connections 2024-09-10T05:38:22.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.268+0000 7f0981e1e9c0 1 --2- 172.21.15.62:0/148768574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c818e6aa70 0x55c818e6ae70 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.268+0000 7f0981e1e9c0 1 -- 172.21.15.62:0/148768574 >> 172.21.15.62:0/148768574 conn(0x55c818cdd5b0 msgr2=0x55c818e664b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:22.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.268+0000 7f0981e1e9c0 1 -- 172.21.15.62:0/148768574 shutdown_connections 2024-09-10T05:38:22.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.268+0000 7f0981e1e9c0 1 -- 172.21.15.62:0/148768574 wait complete. 2024-09-10T05:38:22.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.268+0000 7f0981e1e9c0 1 Processor -- start 2024-09-10T05:38:22.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.272+0000 7f0981e1e9c0 1 -- start start 2024-09-10T05:38:22.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.272+0000 7f0981e1e9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c818e6aa70 0x55c818e71eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.272+0000 7f0981e1e9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c818e6bc50 con 0x55c818e6aa70 2024-09-10T05:38:22.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.272+0000 7f0980125640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c818e6aa70 0x55c818e71eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.272+0000 7f0980125640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c818e6aa70 0x55c818e71eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38468/0 (socket says 172.21.15.62:38468) 2024-09-10T05:38:22.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.272+0000 7f0980125640 1 -- 172.21.15.62:0/834990453 learned_addr learned my addr 172.21.15.62:0/834990453 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:22.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.272+0000 7f0980125640 1 -- 172.21.15.62:0/834990453 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c818e72410 con 0x55c818e6aa70 2024-09-10T05:38:22.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.272+0000 7f0980125640 1 --2- 172.21.15.62:0/834990453 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c818e6aa70 0x55c818e71eb0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x55c818e6b970 tx=0x7f0970003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.272+0000 7f085ffff640 1 -- 172.21.15.62:0/834990453 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0970013a70 con 0x55c818e6aa70 2024-09-10T05:38:22.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.272+0000 7f085ffff640 1 -- 172.21.15.62:0/834990453 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0970023070 con 0x55c818e6aa70 2024-09-10T05:38:22.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.272+0000 7f0981e1e9c0 1 -- 172.21.15.62:0/834990453 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c818e726a0 con 0x55c818e6aa70 2024-09-10T05:38:22.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.272+0000 7f0981e1e9c0 1 -- 172.21.15.62:0/834990453 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c818e73050 con 0x55c818e6aa70 2024-09-10T05:38:22.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.272+0000 7f085ffff640 1 -- 172.21.15.62:0/834990453 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0970013d80 con 0x55c818e6aa70 2024-09-10T05:38:22.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.272+0000 7f0981e1e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:38:22.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.272+0000 7f0981e1e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:38:22.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.272+0000 7f085ffff640 1 -- 172.21.15.62:0/834990453 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0970028460 con 0x55c818e6aa70 2024-09-10T05:38:22.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.272+0000 7f0981e1e9c0 1 Processor -- start 2024-09-10T05:38:22.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.272+0000 7f085ffff640 1 --2- 172.21.15.62:0/834990453 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0858039a70 0x7f085803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.272+0000 7f085ffff640 1 -- 172.21.15.62:0/834990453 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7f0970050640 con 0x55c818e6aa70 2024-09-10T05:38:22.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.272+0000 7f0981e1e9c0 1 -- start start 2024-09-10T05:38:22.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.272+0000 7f0980125640 1 --2- 172.21.15.62:0/834990453 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0858039a70 0x7f085803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.276+0000 7f0981e1e9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c818e8b560 0x55c818e8b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.276+0000 7f0981e1e9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c818e57070 con 0x55c818e8b560 2024-09-10T05:38:22.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.276+0000 7f0980125640 1 --2- 172.21.15.62:0/834990453 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0858039a70 0x7f085803bf30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f097001df90 tx=0x7f097001dea0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.276+0000 7f097f924640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c818e8b560 0x55c818e8b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.276+0000 7f097f924640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c818e8b560 0x55c818e8b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38478/0 (socket says 172.21.15.62:38478) 2024-09-10T05:38:22.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.276+0000 7f097f924640 1 -- 172.21.15.62:0/1627000409 learned_addr learned my addr 172.21.15.62:0/1627000409 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:22.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.276+0000 7f097f924640 1 -- 172.21.15.62:0/1627000409 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c818e8bfc0 con 0x55c818e8b560 2024-09-10T05:38:22.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.276+0000 7f097f924640 1 --2- 172.21.15.62:0/1627000409 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c818e8b560 0x55c818e8b980 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f09780e9a10 tx=0x7f09780be730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.276+0000 7f07dffff640 1 -- 172.21.15.62:0/1627000409 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09780e3070 con 0x55c818e8b560 2024-09-10T05:38:22.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.276+0000 7f0981e1e9c0 1 -- 172.21.15.62:0/1627000409 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c818e8c760 con 0x55c818e8b560 2024-09-10T05:38:22.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.276+0000 7f07dffff640 1 -- 172.21.15.62:0/1627000409 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09780e9b60 con 0x55c818e8b560 2024-09-10T05:38:22.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.276+0000 7f0981e1e9c0 1 -- 172.21.15.62:0/1627000409 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c818e8c760 con 0x55c818e8b560 2024-09-10T05:38:22.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.276+0000 7f07dffff640 1 -- 172.21.15.62:0/1627000409 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09780e95e0 con 0x55c818e8b560 2024-09-10T05:38:22.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.276+0000 7f07dffff640 1 -- 172.21.15.62:0/1627000409 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f09780dc040 con 0x55c818e8b560 2024-09-10T05:38:22.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.276+0000 7f07dffff640 1 --2- 172.21.15.62:0/1627000409 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f07b8039a70 0x7f07b803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.276+0000 7f07dffff640 1 -- 172.21.15.62:0/1627000409 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7f09780e0070 con 0x55c818e8b560 2024-09-10T05:38:22.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.276+0000 7f097f123640 1 --2- 172.21.15.62:0/1627000409 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f07b8039a70 0x7f07b803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.276+0000 7f07ddffb640 20 reqs_thread_entry: start 2024-09-10T05:38:22.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.276+0000 7f0981e1e9c0 1 --2- 172.21.15.62:0/1088402980 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55c818e90de0 0x55c818e93250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.276+0000 7f0981e1e9c0 1 -- 172.21.15.62:0/1088402980 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c818e938d0 con 0x55c818e90de0 2024-09-10T05:38:22.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.276+0000 7f097f123640 1 --2- 172.21.15.62:0/1627000409 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f07b8039a70 0x7f07b803bf30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0974001d00 tx=0x7f0974001260 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.276+0000 7f0980125640 1 --2- 172.21.15.62:0/1088402980 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55c818e90de0 0x55c818e93250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.280+0000 7f0980125640 1 --2- 172.21.15.62:0/1088402980 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55c818e90de0 0x55c818e93250 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.280+0000 7f0980125640 1 -- 172.21.15.62:0/1088402980 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f097001e7a0 con 0x55c818e90de0 2024-09-10T05:38:22.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.280+0000 7f0981e1e9c0 1 --2- 172.21.15.62:0/1088402980 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55c818e94690 0x55c818e96a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.280+0000 7f0981e1e9c0 1 -- 172.21.15.62:0/1088402980 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c818e97100 con 0x55c818e94690 2024-09-10T05:38:22.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.280+0000 7f097f924640 1 --2- 172.21.15.62:0/1088402980 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55c818e94690 0x55c818e96a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.280+0000 7f097f924640 1 --2- 172.21.15.62:0/1088402980 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55c818e94690 0x55c818e96a80 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.280+0000 7f097f924640 1 -- 172.21.15.62:0/1088402980 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f09780d0070 con 0x55c818e94690 2024-09-10T05:38:22.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.280+0000 7f0981e1e9c0 1 --2- 172.21.15.62:0/1088402980 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55c818e98ec0 0x55c818e9b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.280+0000 7f0981e1e9c0 1 -- 172.21.15.62:0/1088402980 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c818e9b980 con 0x55c818e98ec0 2024-09-10T05:38:22.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.280+0000 7f097f123640 1 --2- 172.21.15.62:0/1088402980 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55c818e98ec0 0x55c818e9b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.280+0000 7f097f123640 1 --2- 172.21.15.62:0/1088402980 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55c818e98ec0 0x55c818e9b2b0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.280+0000 7f097f123640 1 -- 172.21.15.62:0/1088402980 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f097400e6d0 con 0x55c818e98ec0 2024-09-10T05:38:22.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.280+0000 7f0981e1e9c0 1 -- 172.21.15.62:0/1088402980 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:4 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c818ea24c0 con 0x55c818e90de0 2024-09-10T05:38:22.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.280+0000 7f0980125640 1 -- 172.21.15.62:0/1088402980 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(4 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f097001e7a0 con 0x55c818e90de0 2024-09-10T05:38:22.288 INFO:teuthology.orchestra.run.smithi062.stderr:NOTICE: set zone's realm_id= 2024-09-10T05:38:22.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.280+0000 7f0981e1e9c0 1 -- 172.21.15.62:0/1088402980 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c818ea6520 con 0x55c818e98ec0 2024-09-10T05:38:22.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.280+0000 7f097f123640 1 -- 172.21.15.62:0/1088402980 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f097400e6d0 con 0x55c818e98ec0 2024-09-10T05:38:22.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.280+0000 7f097f123640 1 -- 172.21.15.62:0/1088402980 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:6 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c818ea6520 con 0x55c818e94690 2024-09-10T05:38:22.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.284+0000 7f097f924640 1 -- 172.21.15.62:0/1088402980 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09780d0070 con 0x55c818e94690 2024-09-10T05:38:22.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.284+0000 7f097f924640 1 --2- 172.21.15.62:0/1088402980 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f09780df040 0x7f09780bd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.284+0000 7f097f924640 1 -- 172.21.15.62:0/1088402980 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:7 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c818ea6520 con 0x7f09780df040 2024-09-10T05:38:22.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.284+0000 7f0980125640 1 --2- 172.21.15.62:0/1088402980 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f09780df040 0x7f09780bd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.284+0000 7f0980125640 1 --2- 172.21.15.62:0/1088402980 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f09780df040 0x7f09780bd9b0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.284+0000 7f0980125640 1 -- 172.21.15.62:0/1088402980 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f097001e7a0 con 0x7f09780df040 2024-09-10T05:38:22.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.284+0000 7f0980125640 1 -- 172.21.15.62:0/1088402980 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:8 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c818ea6520 con 0x55c818e90de0 2024-09-10T05:38:22.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.284+0000 7f0980125640 1 -- 172.21.15.62:0/1088402980 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f097001e7a0 con 0x55c818e90de0 2024-09-10T05:38:22.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.284+0000 7f0980125640 1 -- 172.21.15.62:0/1088402980 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c818ea6520 con 0x55c818e90de0 2024-09-10T05:38:22.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.284+0000 7f0980125640 1 -- 172.21.15.62:0/1088402980 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f097001e7a0 con 0x55c818e90de0 2024-09-10T05:38:22.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.284+0000 7f0980125640 1 -- 172.21.15.62:0/1088402980 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:10 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c818ea6520 con 0x55c818e98ec0 2024-09-10T05:38:22.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.284+0000 7f097f123640 1 -- 172.21.15.62:0/1088402980 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f097400e6d0 con 0x55c818e98ec0 2024-09-10T05:38:22.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.284+0000 7f097f123640 1 -- 172.21.15.62:0/1088402980 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:11 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c818ea6520 con 0x55c818e90de0 2024-09-10T05:38:22.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.284+0000 7f0980125640 1 -- 172.21.15.62:0/1088402980 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f097001e7a0 con 0x55c818e90de0 2024-09-10T05:38:22.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.284+0000 7f0980125640 1 -- 172.21.15.62:0/1088402980 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:12 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c818ea6520 con 0x55c818e94690 2024-09-10T05:38:22.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.284+0000 7f097f924640 1 -- 172.21.15.62:0/1088402980 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09780d0070 con 0x55c818e94690 2024-09-10T05:38:22.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.284+0000 7f097f924640 1 -- 172.21.15.62:0/1088402980 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c818ea6520 con 0x55c818e94690 2024-09-10T05:38:22.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.288+0000 7f097f924640 1 -- 172.21.15.62:0/1088402980 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09780d0070 con 0x55c818e94690 2024-09-10T05:38:22.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.288+0000 7f097f924640 1 -- 172.21.15.62:0/1088402980 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:14 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c818ea6520 con 0x55c818e90de0 2024-09-10T05:38:22.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.288+0000 7f0980125640 1 -- 172.21.15.62:0/1088402980 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f097001e7a0 con 0x55c818e90de0 2024-09-10T05:38:22.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.288+0000 7f0980125640 1 -- 172.21.15.62:0/1088402980 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:15 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c818ea6520 con 0x7f09780df040 2024-09-10T05:38:22.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.288+0000 7f0980125640 1 -- 172.21.15.62:0/1088402980 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f097001e7a0 con 0x7f09780df040 2024-09-10T05:38:22.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.288+0000 7f0980125640 1 -- 172.21.15.62:0/1088402980 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:16 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c818ea6520 con 0x55c818e90de0 2024-09-10T05:38:22.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.288+0000 7f0980125640 1 -- 172.21.15.62:0/1088402980 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f097001e7a0 con 0x55c818e90de0 2024-09-10T05:38:22.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.288+0000 7f0980125640 1 -- 172.21.15.62:0/1088402980 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:17 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c818ea6520 con 0x7f09780df040 2024-09-10T05:38:22.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.288+0000 7f0980125640 1 -- 172.21.15.62:0/1088402980 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(17 [pgnls start_epoch 34 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f097001e7a0 con 0x7f09780df040 2024-09-10T05:38:22.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.288+0000 7f0980125640 1 -- 172.21.15.62:0/1088402980 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:18 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c818ea6520 con 0x55c818e94690 2024-09-10T05:38:22.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.288+0000 7f097f924640 1 -- 172.21.15.62:0/1088402980 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(18 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09780d0070 con 0x55c818e94690 2024-09-10T05:38:22.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.288+0000 7f097f924640 1 -- 172.21.15.62:0/1088402980 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:19 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c818ea6520 con 0x55c818e98ec0 2024-09-10T05:38:22.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.288+0000 7f097f123640 1 -- 172.21.15.62:0/1088402980 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f097400e6d0 con 0x55c818e98ec0 2024-09-10T05:38:22.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.288+0000 7f097f123640 1 -- 172.21.15.62:0/1088402980 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:20 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c818ea6520 con 0x55c818e90de0 2024-09-10T05:38:22.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.288+0000 7f0980125640 1 -- 172.21.15.62:0/1088402980 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f097001e7a0 con 0x55c818e90de0 2024-09-10T05:38:22.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.288+0000 7f0980125640 1 -- 172.21.15.62:0/1088402980 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:21 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c818ea6520 con 0x55c818e94690 2024-09-10T05:38:22.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.288+0000 7f097f924640 1 -- 172.21.15.62:0/1088402980 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09780d0070 con 0x55c818e94690 2024-09-10T05:38:22.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.288+0000 7f097f924640 1 -- 172.21.15.62:0/1088402980 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:22 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c818ea6520 con 0x55c818e98ec0 2024-09-10T05:38:22.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.288+0000 7f097f123640 1 -- 172.21.15.62:0/1088402980 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=170b] v30'3 uv3 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f097400e6d0 con 0x55c818e98ec0 2024-09-10T05:38:22.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.288+0000 7f097f123640 1 -- 172.21.15.62:0/1088402980 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:23 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c818ea6520 con 0x55c818e90de0 2024-09-10T05:38:22.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.292+0000 7f0980125640 1 -- 172.21.15.62:0/1088402980 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f097001e7a0 con 0x55c818e90de0 2024-09-10T05:38:22.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.292+0000 7f0980125640 1 -- 172.21.15.62:0/1088402980 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c818ea6520 con 0x55c818e90de0 2024-09-10T05:38:22.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.292+0000 7f0980125640 1 -- 172.21.15.62:0/1088402980 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f097001e7a0 con 0x55c818e90de0 2024-09-10T05:38:22.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.292+0000 7f0980125640 1 -- 172.21.15.62:0/1088402980 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c818ea6520 con 0x55c818e90de0 2024-09-10T05:38:22.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.292+0000 7f0980125640 1 -- 172.21.15.62:0/1088402980 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f097001e7a0 con 0x55c818e90de0 2024-09-10T05:38:22.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.292+0000 7f0980125640 1 -- 172.21.15.62:0/1088402980 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:26 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c818ea6520 con 0x55c818e98ec0 2024-09-10T05:38:22.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.292+0000 7f097f123640 1 -- 172.21.15.62:0/1088402980 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f097400e6d0 con 0x55c818e98ec0 2024-09-10T05:38:22.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.292+0000 7f097f123640 1 -- 172.21.15.62:0/1088402980 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:27 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c818ea6520 con 0x7f09780df040 2024-09-10T05:38:22.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.292+0000 7f0980125640 1 -- 172.21.15.62:0/1088402980 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f097001e7a0 con 0x7f09780df040 2024-09-10T05:38:22.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.292+0000 7f0980125640 1 -- 172.21.15.62:0/1088402980 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:28 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c818ea6520 con 0x55c818e90de0 2024-09-10T05:38:22.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.292+0000 7f0980125640 1 -- 172.21.15.62:0/1088402980 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f097001e7a0 con 0x55c818e90de0 2024-09-10T05:38:22.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.292+0000 7f0980125640 1 -- 172.21.15.62:0/1088402980 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:29 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c818ea6520 con 0x7f09780df040 2024-09-10T05:38:22.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.292+0000 7f0980125640 1 -- 172.21.15.62:0/1088402980 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f097001e7a0 con 0x7f09780df040 2024-09-10T05:38:22.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.292+0000 7f0980125640 1 -- 172.21.15.62:0/1088402980 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:30 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c818ea6520 con 0x55c818e98ec0 2024-09-10T05:38:22.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.292+0000 7f097f123640 1 -- 172.21.15.62:0/1088402980 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f097400e6d0 con 0x55c818e98ec0 2024-09-10T05:38:22.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.292+0000 7f097f123640 1 -- 172.21.15.62:0/1088402980 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:31 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c818ea6520 con 0x7f09780df040 2024-09-10T05:38:22.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.292+0000 7f0980125640 1 -- 172.21.15.62:0/1088402980 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f097001e7a0 con 0x7f09780df040 2024-09-10T05:38:22.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.292+0000 7f0980125640 1 -- 172.21.15.62:0/1088402980 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:32 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c818ea6520 con 0x55c818e94690 2024-09-10T05:38:22.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.292+0000 7f097f924640 1 -- 172.21.15.62:0/1088402980 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09780d0070 con 0x55c818e94690 2024-09-10T05:38:22.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.292+0000 7f097f924640 1 -- 172.21.15.62:0/1088402980 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c818ea6520 con 0x55c818e94690 2024-09-10T05:38:22.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.292+0000 7f097f924640 1 -- 172.21.15.62:0/1088402980 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09780d0070 con 0x55c818e94690 2024-09-10T05:38:22.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.292+0000 7f097f924640 1 -- 172.21.15.62:0/1088402980 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:34 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c818ea6520 con 0x55c818e98ec0 2024-09-10T05:38:22.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.296+0000 7f097f123640 1 -- 172.21.15.62:0/1088402980 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f097400e6d0 con 0x55c818e98ec0 2024-09-10T05:38:22.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.296+0000 7f097f123640 1 -- 172.21.15.62:0/1088402980 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:35 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c818ea6520 con 0x55c818e94690 2024-09-10T05:38:22.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.296+0000 7f097f924640 1 -- 172.21.15.62:0/1088402980 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f09780d0070 con 0x55c818e94690 2024-09-10T05:38:22.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.296+0000 7f097f924640 1 -- 172.21.15.62:0/1088402980 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c818ea6520 con 0x55c818e94690 2024-09-10T05:38:22.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.296+0000 7f097f924640 1 -- 172.21.15.62:0/1088402980 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09780d0070 con 0x55c818e94690 2024-09-10T05:38:22.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.296+0000 7f0981e1e9c0 1 -- 172.21.15.62:0/1088402980 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c818ea4ea0 con 0x55c818e94690 2024-09-10T05:38:22.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.296+0000 7f097f924640 1 -- 172.21.15.62:0/1088402980 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(37 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f09780d0070 con 0x55c818e94690 2024-09-10T05:38:22.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.296+0000 7f0981e1e9c0 1 -- 172.21.15.62:0/1088402980 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:38 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c818ea2940 con 0x55c818e98ec0 2024-09-10T05:38:22.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.296+0000 7f097f123640 1 -- 172.21.15.62:0/1088402980 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(38 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f097400e6d0 con 0x55c818e98ec0 2024-09-10T05:38:22.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.296+0000 7f0981e1e9c0 1 -- 172.21.15.62:0/1088402980 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:39 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [create,call version.set in=58b,writefull 0~1155 in=1155b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c818ea1d50 con 0x55c818e98ec0 2024-09-10T05:38:22.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.300+0000 7f097f123640 1 -- 172.21.15.62:0/1088402980 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(39 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [create,call,writefull 0~1155] v34'4 uv4 ondisk = 0) ==== 274+0+0 (crc 0 0 0) 0x7f097400e6d0 con 0x55c818e98ec0 2024-09-10T05:38:22.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.300+0000 7f0981e1e9c0 1 -- 172.21.15.62:0/1088402980 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:40 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=58b,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c818ea3af0 con 0x55c818e94690 2024-09-10T05:38:22.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.300+0000 7f097f924640 1 -- 172.21.15.62:0/1088402980 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(40 zone_names.default [create,call,writefull 0~46] v34'3 uv3 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7f09780d0070 con 0x55c818e94690 2024-09-10T05:38:22.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.300+0000 7f0981e1e9c0 1 -- 172.21.15.62:0/1088402980 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:41 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c818ea4370 con 0x55c818e90de0 2024-09-10T05:38:22.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.304+0000 7f0980125640 1 -- 172.21.15.62:0/1088402980 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(41 default.zone. [create,writefull 0~46] v34'2 uv1 ondisk = -17 ((17) File exists)) ==== 199+0+0 (crc 0 0 0) 0x7f097001e7a0 con 0x55c818e90de0 2024-09-10T05:38:22.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.304+0000 7f0981e1e9c0 1 -- 172.21.15.62:0/834990453 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0858039a70 msgr2=0x7f085803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.304+0000 7f0981e1e9c0 1 --2- 172.21.15.62:0/834990453 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0858039a70 0x7f085803bf30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f097001df90 tx=0x7f097001dea0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.304+0000 7f0981e1e9c0 1 -- 172.21.15.62:0/834990453 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c818e6aa70 msgr2=0x55c818e71eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.304+0000 7f0981e1e9c0 1 --2- 172.21.15.62:0/834990453 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c818e6aa70 0x55c818e71eb0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x55c818e6b970 tx=0x7f0970003000 comp rx=0 tx=0).stop 2024-09-10T05:38:22.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.304+0000 7f0981e1e9c0 1 -- 172.21.15.62:0/834990453 shutdown_connections 2024-09-10T05:38:22.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.304+0000 7f0981e1e9c0 1 --2- 172.21.15.62:0/834990453 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0858039a70 0x7f085803bf30 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.304+0000 7f0981e1e9c0 1 --2- 172.21.15.62:0/834990453 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c818e6aa70 0x55c818e71eb0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.304+0000 7f0981e1e9c0 1 -- 172.21.15.62:0/834990453 >> 172.21.15.62:0/834990453 conn(0x55c818cdd5b0 msgr2=0x55c818e65fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:22.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.304+0000 7f0981e1e9c0 1 -- 172.21.15.62:0/834990453 shutdown_connections 2024-09-10T05:38:22.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.304+0000 7f0981e1e9c0 1 -- 172.21.15.62:0/834990453 wait complete. 2024-09-10T05:38:22.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.304+0000 7f0981e1e9c0 1 -- 172.21.15.62:0/1627000409 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f07b8039a70 msgr2=0x7f07b803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.304+0000 7f0981e1e9c0 1 --2- 172.21.15.62:0/1627000409 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f07b8039a70 0x7f07b803bf30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0974001d00 tx=0x7f0974001260 comp rx=0 tx=0).stop 2024-09-10T05:38:22.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.304+0000 7f0981e1e9c0 1 -- 172.21.15.62:0/1627000409 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c818e8b560 msgr2=0x55c818e8b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.304+0000 7f0981e1e9c0 1 --2- 172.21.15.62:0/1627000409 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c818e8b560 0x55c818e8b980 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f09780e9a10 tx=0x7f09780be730 comp rx=0 tx=0).stop 2024-09-10T05:38:22.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.304+0000 7f0981e1e9c0 1 -- 172.21.15.62:0/1627000409 shutdown_connections 2024-09-10T05:38:22.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.304+0000 7f0981e1e9c0 1 --2- 172.21.15.62:0/1627000409 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f07b8039a70 0x7f07b803bf30 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.304+0000 7f0981e1e9c0 1 --2- 172.21.15.62:0/1627000409 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c818e8b560 0x55c818e8b980 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.304+0000 7f0981e1e9c0 1 -- 172.21.15.62:0/1627000409 >> 172.21.15.62:0/1627000409 conn(0x55c818e80b60 msgr2=0x55c818e80f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:22.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.304+0000 7f0981e1e9c0 1 -- 172.21.15.62:0/1627000409 shutdown_connections 2024-09-10T05:38:22.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.304+0000 7f0981e1e9c0 1 -- 172.21.15.62:0/1627000409 wait complete. 2024-09-10T05:38:22.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.304+0000 7f0981e1e9c0 1 -- 172.21.15.62:0/1088402980 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55c818e94690 msgr2=0x55c818e96a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.304+0000 7f0981e1e9c0 1 --2- 172.21.15.62:0/1088402980 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55c818e94690 0x55c818e96a80 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.304+0000 7f0981e1e9c0 1 -- 172.21.15.62:0/1088402980 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55c818e90de0 msgr2=0x55c818e93250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.304+0000 7f0981e1e9c0 1 --2- 172.21.15.62:0/1088402980 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55c818e90de0 0x55c818e93250 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.304+0000 7f0981e1e9c0 1 -- 172.21.15.62:0/1088402980 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f09780df040 msgr2=0x7f09780bd9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.304+0000 7f0981e1e9c0 1 --2- 172.21.15.62:0/1088402980 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f09780df040 0x7f09780bd9b0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.304+0000 7f0981e1e9c0 1 -- 172.21.15.62:0/1088402980 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55c818e98ec0 msgr2=0x55c818e9b2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.304+0000 7f0981e1e9c0 1 --2- 172.21.15.62:0/1088402980 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55c818e98ec0 0x55c818e9b2b0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.304+0000 7f0981e1e9c0 1 -- 172.21.15.62:0/1088402980 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0868039b10 msgr2=0x7f086803bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.304+0000 7f0981e1e9c0 1 --2- 172.21.15.62:0/1088402980 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0868039b10 0x7f086803bfd0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0978003430 tx=0x7f09780cb040 comp rx=0 tx=0).stop 2024-09-10T05:38:22.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.304+0000 7f0981e1e9c0 1 -- 172.21.15.62:0/1088402980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c818cdd1d0 msgr2=0x55c818e5de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.304+0000 7f0980125640 1 -- 172.21.15.62:0/1088402980 reap_dead start 2024-09-10T05:38:22.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.304+0000 7f0981e1e9c0 1 --2- 172.21.15.62:0/1088402980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c818cdd1d0 0x55c818e5de50 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f0978019680 tx=0x7f0978017d70 comp rx=0 tx=0).stop 2024-09-10T05:38:22.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.304+0000 7f0981e1e9c0 1 -- 172.21.15.62:0/1088402980 shutdown_connections 2024-09-10T05:38:22.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.304+0000 7f0981e1e9c0 1 --2- 172.21.15.62:0/1088402980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c818cdd1d0 0x55c818e5de50 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.304+0000 7f0981e1e9c0 1 -- 172.21.15.62:0/1088402980 >> 172.21.15.62:0/1088402980 conn(0x55c818d638f0 msgr2=0x55c818e50fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:22.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.304+0000 7f0981e1e9c0 1 -- 172.21.15.62:0/1088402980 shutdown_connections 2024-09-10T05:38:22.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.304+0000 7f0981e1e9c0 1 -- 172.21.15.62:0/1088402980 wait complete. 2024-09-10T05:38:22.321 INFO:teuthology.orchestra.run.smithi062.stdout:{"id":"475ecc13-ad4b-423e-b7f2-f7f260e17071","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-10T05:38:22.321 DEBUG:tasks.util.rgw: json result: {'id': '475ecc13-ad4b-423e-b7f2-f7f260e17071', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-10T05:38:22.321 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2024-09-10T05:38:22.322 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2024-09-10T05:38:22.322 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2024-09-10T05:38:22.402 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:38:22.402 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:38:22.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.400+0000 7fed60ce89c0 1 Processor -- start 2024-09-10T05:38:22.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.400+0000 7fed60ce89c0 1 -- start start 2024-09-10T05:38:22.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.400+0000 7fed60ce89c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5569d85fa1d0 0x5569d85fa5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.400+0000 7fed60ce89c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5569d84ac9c0 con 0x5569d85fd310 2024-09-10T05:38:22.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.400+0000 7fed60ce89c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x5569d84fc6d0 con 0x5569d85fa1d0 2024-09-10T05:38:22.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.400+0000 7fed5e7ee640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5569d85fa1d0 0x5569d85fa5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.400+0000 7fed5dfed640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x5569d85fd310 0x5569d85ff700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:52050/0 (socket says 172.21.15.62:52050) 2024-09-10T05:38:22.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.400+0000 7fed5dfed640 1 -- 172.21.15.62:0/2241995191 learned_addr learned my addr 172.21.15.62:0/2241995191 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-10T05:38:22.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.400+0000 7fed5e7ee640 1 -- 172.21.15.62:0/2241995191 >> v1:172.21.15.2:6789/0 conn(0x5569d85fd310 legacy=0x5569d85ff700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.400+0000 7fed5e7ee640 1 -- 172.21.15.62:0/2241995191 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569d84a0ca0 con 0x5569d85fa1d0 2024-09-10T05:38:22.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.404+0000 7fed5e7ee640 1 --2- 172.21.15.62:0/2241995191 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569d85fa1d0 0x5569d85fa5b0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fed5000a420 tx=0x7fed5001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26484dee90c83d02 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.404+0000 7fed5d7ec640 1 -- 172.21.15.62:0/2241995191 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed500af070 con 0x5569d85fa1d0 2024-09-10T05:38:22.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.404+0000 7fed5d7ec640 1 -- 172.21.15.62:0/2241995191 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed500aa530 con 0x5569d85fa1d0 2024-09-10T05:38:22.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.404+0000 7fed5d7ec640 1 -- 172.21.15.62:0/2241995191 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed500aa850 con 0x5569d85fa1d0 2024-09-10T05:38:22.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.404+0000 7fed60ce89c0 1 -- 172.21.15.62:0/2241995191 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569d85fa1d0 msgr2=0x5569d85fa5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.404+0000 7fed60ce89c0 1 --2- 172.21.15.62:0/2241995191 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569d85fa1d0 0x5569d85fa5b0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fed5000a420 tx=0x7fed5001afd0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.404+0000 7fed60ce89c0 1 -- 172.21.15.62:0/2241995191 shutdown_connections 2024-09-10T05:38:22.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.404+0000 7fed60ce89c0 1 --2- 172.21.15.62:0/2241995191 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569d85fa1d0 0x5569d85fa5b0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.404+0000 7fed60ce89c0 1 -- 172.21.15.62:0/2241995191 >> 172.21.15.62:0/2241995191 conn(0x5569d856dae0 msgr2=0x5569d856def0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:22.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.404+0000 7fed60ce89c0 1 -- 172.21.15.62:0/2241995191 shutdown_connections 2024-09-10T05:38:22.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.404+0000 7fed60ce89c0 1 -- 172.21.15.62:0/2241995191 wait complete. 2024-09-10T05:38:22.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.420+0000 7fed60ce89c0 1 Processor -- start 2024-09-10T05:38:22.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.420+0000 7fed60ce89c0 1 -- start start 2024-09-10T05:38:22.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.420+0000 7fed60ce89c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569d85fa1d0 0x5569d86e5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.420+0000 7fed60ce89c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5569d8500680 con 0x5569d85fa1d0 2024-09-10T05:38:22.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.420+0000 7fed5e7ee640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569d85fa1d0 0x5569d86e5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.420+0000 7fed5e7ee640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569d85fa1d0 0x5569d86e5860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38492/0 (socket says 172.21.15.62:38492) 2024-09-10T05:38:22.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.420+0000 7fed5e7ee640 1 -- 172.21.15.62:0/737900124 learned_addr learned my addr 172.21.15.62:0/737900124 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:22.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.424+0000 7fed5e7ee640 1 -- 172.21.15.62:0/737900124 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569d847bda0 con 0x5569d85fa1d0 2024-09-10T05:38:22.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.424+0000 7fed5e7ee640 1 --2- 172.21.15.62:0/737900124 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569d85fa1d0 0x5569d86e5860 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fed50018c00 tx=0x7fed500033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb553d5f6510c8c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.424+0000 7fec4c608640 1 -- 172.21.15.62:0/737900124 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed500af040 con 0x5569d85fa1d0 2024-09-10T05:38:22.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.424+0000 7fec4c608640 1 -- 172.21.15.62:0/737900124 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed500aaa00 con 0x5569d85fa1d0 2024-09-10T05:38:22.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.424+0000 7fec4c608640 1 -- 172.21.15.62:0/737900124 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed500aace0 con 0x5569d85fa1d0 2024-09-10T05:38:22.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.424+0000 7fed60ce89c0 1 -- 172.21.15.62:0/737900124 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569d85fa1d0 msgr2=0x5569d86e5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.424+0000 7fed60ce89c0 1 --2- 172.21.15.62:0/737900124 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569d85fa1d0 0x5569d86e5860 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fed50018c00 tx=0x7fed500033b0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.424+0000 7fed60ce89c0 1 -- 172.21.15.62:0/737900124 shutdown_connections 2024-09-10T05:38:22.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.424+0000 7fed60ce89c0 1 --2- 172.21.15.62:0/737900124 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569d85fa1d0 0x5569d86e5860 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.424+0000 7fed60ce89c0 1 -- 172.21.15.62:0/737900124 >> 172.21.15.62:0/737900124 conn(0x5569d856dae0 msgr2=0x5569d86e14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:22.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.424+0000 7fed60ce89c0 1 -- 172.21.15.62:0/737900124 shutdown_connections 2024-09-10T05:38:22.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.424+0000 7fed60ce89c0 1 -- 172.21.15.62:0/737900124 wait complete. 2024-09-10T05:38:22.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.424+0000 7fed60ce89c0 1 Processor -- start 2024-09-10T05:38:22.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.424+0000 7fed60ce89c0 1 -- start start 2024-09-10T05:38:22.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.424+0000 7fed60ce89c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569d85fa1d0 0x5569d86ecdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.424+0000 7fed60ce89c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5569d84a2a50 con 0x5569d85fa1d0 2024-09-10T05:38:22.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.424+0000 7fed5e7ee640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569d85fa1d0 0x5569d86ecdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.424+0000 7fed5e7ee640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569d85fa1d0 0x5569d86ecdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38496/0 (socket says 172.21.15.62:38496) 2024-09-10T05:38:22.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.424+0000 7fed5e7ee640 1 -- 172.21.15.62:0/782329289 learned_addr learned my addr 172.21.15.62:0/782329289 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:22.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.424+0000 7fed5e7ee640 1 -- 172.21.15.62:0/782329289 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569d86ed320 con 0x5569d85fa1d0 2024-09-10T05:38:22.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.424+0000 7fed5e7ee640 1 --2- 172.21.15.62:0/782329289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569d85fa1d0 0x5569d86ecdc0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fed50018c00 tx=0x7fed50017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.424+0000 7fec4ae05640 1 -- 172.21.15.62:0/782329289 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed500c5070 con 0x5569d85fa1d0 2024-09-10T05:38:22.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.424+0000 7fed60ce89c0 1 -- 172.21.15.62:0/782329289 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5569d86ed5b0 con 0x5569d85fa1d0 2024-09-10T05:38:22.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.424+0000 7fec4ae05640 1 -- 172.21.15.62:0/782329289 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed500c1690 con 0x5569d85fa1d0 2024-09-10T05:38:22.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.424+0000 7fec4ae05640 1 -- 172.21.15.62:0/782329289 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed500c19b0 con 0x5569d85fa1d0 2024-09-10T05:38:22.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.424+0000 7fed60ce89c0 1 -- 172.21.15.62:0/782329289 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569d86edfe0 con 0x5569d85fa1d0 2024-09-10T05:38:22.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.428+0000 7fed60ce89c0 1 Processor -- start 2024-09-10T05:38:22.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.428+0000 7fed60ce89c0 1 -- start start 2024-09-10T05:38:22.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.428+0000 7fed60ce89c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569d86f9a40 0x5569d86f9e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.428+0000 7fed60ce89c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5569d850d450 con 0x5569d86f9a40 2024-09-10T05:38:22.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.428+0000 7fed5efef640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569d86f9a40 0x5569d86f9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.428+0000 7fec4ae05640 1 -- 172.21.15.62:0/782329289 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fed500b5470 con 0x5569d85fa1d0 2024-09-10T05:38:22.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.428+0000 7fed5efef640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569d86f9a40 0x5569d86f9e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38498/0 (socket says 172.21.15.62:38498) 2024-09-10T05:38:22.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.428+0000 7fed5efef640 1 -- 172.21.15.62:0/1453864405 learned_addr learned my addr 172.21.15.62:0/1453864405 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:22.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.428+0000 7fec4ae05640 1 --2- 172.21.15.62:0/782329289 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fec44039a70 0x7fec4403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.428+0000 7fec4ae05640 1 -- 172.21.15.62:0/782329289 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7fed500bb070 con 0x5569d85fa1d0 2024-09-10T05:38:22.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.428+0000 7fed5e7ee640 1 --2- 172.21.15.62:0/782329289 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fec44039a70 0x7fec4403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.428+0000 7fed5efef640 1 -- 172.21.15.62:0/1453864405 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569d86fa430 con 0x5569d86f9a40 2024-09-10T05:38:22.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.428+0000 7fed5e7ee640 1 --2- 172.21.15.62:0/782329289 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fec44039a70 0x7fec4403bf30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fed500b3730 tx=0x7fed500b6910 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.428+0000 7fed5efef640 1 --2- 172.21.15.62:0/1453864405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569d86f9a40 0x5569d86f9e40 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fed5800a440 tx=0x7fed5800a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f61a287c86557a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.428+0000 7fec48e01640 1 -- 172.21.15.62:0/1453864405 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed58008850 con 0x5569d86f9a40 2024-09-10T05:38:22.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.428+0000 7fec48e01640 1 -- 172.21.15.62:0/1453864405 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed58008a10 con 0x5569d86f9a40 2024-09-10T05:38:22.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.428+0000 7fec48e01640 1 -- 172.21.15.62:0/1453864405 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed58008d30 con 0x5569d86f9a40 2024-09-10T05:38:22.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.428+0000 7fed60ce89c0 1 -- 172.21.15.62:0/1453864405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569d86f9a40 msgr2=0x5569d86f9e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.428+0000 7fed60ce89c0 1 --2- 172.21.15.62:0/1453864405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569d86f9a40 0x5569d86f9e40 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fed5800a440 tx=0x7fed5800a900 comp rx=0 tx=0).stop 2024-09-10T05:38:22.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.428+0000 7fed60ce89c0 1 -- 172.21.15.62:0/1453864405 shutdown_connections 2024-09-10T05:38:22.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.428+0000 7fed60ce89c0 1 --2- 172.21.15.62:0/1453864405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569d86f9a40 0x5569d86f9e40 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.428+0000 7fed60ce89c0 1 -- 172.21.15.62:0/1453864405 >> 172.21.15.62:0/1453864405 conn(0x5569d85fd310 msgr2=0x5569d86f5480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:22.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.428+0000 7fed60ce89c0 1 -- 172.21.15.62:0/1453864405 shutdown_connections 2024-09-10T05:38:22.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.428+0000 7fed60ce89c0 1 -- 172.21.15.62:0/1453864405 wait complete. 2024-09-10T05:38:22.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.428+0000 7fed60ce89c0 1 Processor -- start 2024-09-10T05:38:22.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.428+0000 7fed60ce89c0 1 -- start start 2024-09-10T05:38:22.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.428+0000 7fed60ce89c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569d86f9a40 0x5569d8700e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.428+0000 7fed60ce89c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5569d86fac20 con 0x5569d86f9a40 2024-09-10T05:38:22.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.428+0000 7fed5efef640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569d86f9a40 0x5569d8700e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.428+0000 7fed5efef640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569d86f9a40 0x5569d8700e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38508/0 (socket says 172.21.15.62:38508) 2024-09-10T05:38:22.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.428+0000 7fed5efef640 1 -- 172.21.15.62:0/2501809483 learned_addr learned my addr 172.21.15.62:0/2501809483 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:22.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.432+0000 7fed5efef640 1 -- 172.21.15.62:0/2501809483 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569d8701380 con 0x5569d86f9a40 2024-09-10T05:38:22.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.432+0000 7fed5efef640 1 --2- 172.21.15.62:0/2501809483 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569d86f9a40 0x5569d8700e20 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x5569d86fa940 tx=0x7fed58003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.432+0000 7fec42ffd640 1 -- 172.21.15.62:0/2501809483 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed58013a70 con 0x5569d86f9a40 2024-09-10T05:38:22.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.432+0000 7fed60ce89c0 1 -- 172.21.15.62:0/2501809483 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5569d8701610 con 0x5569d86f9a40 2024-09-10T05:38:22.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.432+0000 7fec42ffd640 1 -- 172.21.15.62:0/2501809483 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed58023070 con 0x5569d86f9a40 2024-09-10T05:38:22.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.432+0000 7fec42ffd640 1 -- 172.21.15.62:0/2501809483 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed58013d80 con 0x5569d86f9a40 2024-09-10T05:38:22.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.432+0000 7fed60ce89c0 1 -- 172.21.15.62:0/2501809483 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569d8701fc0 con 0x5569d86f9a40 2024-09-10T05:38:22.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.432+0000 7fed60ce89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:38:22.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.432+0000 7fed60ce89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:38:22.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.432+0000 7fec42ffd640 1 -- 172.21.15.62:0/2501809483 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fed58028460 con 0x5569d86f9a40 2024-09-10T05:38:22.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.432+0000 7fed60ce89c0 1 Processor -- start 2024-09-10T05:38:22.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.432+0000 7fec42ffd640 1 --2- 172.21.15.62:0/2501809483 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fec38039a70 0x7fec3803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.432+0000 7fed60ce89c0 1 -- start start 2024-09-10T05:38:22.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.432+0000 7fec42ffd640 1 -- 172.21.15.62:0/2501809483 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7fed58050640 con 0x5569d86f9a40 2024-09-10T05:38:22.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.432+0000 7fed5efef640 1 --2- 172.21.15.62:0/2501809483 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fec38039a70 0x7fec3803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.432+0000 7fed60ce89c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569d871a4d0 0x5569d871a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.432+0000 7fed60ce89c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5569d86e5ff0 con 0x5569d871a4d0 2024-09-10T05:38:22.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.432+0000 7fed5e7ee640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569d871a4d0 0x5569d871a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.432+0000 7fed5efef640 1 --2- 172.21.15.62:0/2501809483 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fec38039a70 0x7fec3803bf30 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fed58027f50 tx=0x7fed58012ed0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.432+0000 7fed5e7ee640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569d871a4d0 0x5569d871a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38512/0 (socket says 172.21.15.62:38512) 2024-09-10T05:38:22.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.432+0000 7fed5e7ee640 1 -- 172.21.15.62:0/346058314 learned_addr learned my addr 172.21.15.62:0/346058314 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:22.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.432+0000 7fed5e7ee640 1 -- 172.21.15.62:0/346058314 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569d871af30 con 0x5569d871a4d0 2024-09-10T05:38:22.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.436+0000 7fed5e7ee640 1 --2- 172.21.15.62:0/346058314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569d871a4d0 0x5569d871a8f0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fed500aafd0 tx=0x7fed500ab3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.436+0000 7fec237e6640 1 -- 172.21.15.62:0/346058314 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed500d8070 con 0x5569d871a4d0 2024-09-10T05:38:22.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.436+0000 7fed60ce89c0 1 -- 172.21.15.62:0/346058314 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5569d871b690 con 0x5569d871a4d0 2024-09-10T05:38:22.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.436+0000 7fec237e6640 1 -- 172.21.15.62:0/346058314 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed500c0d00 con 0x5569d871a4d0 2024-09-10T05:38:22.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.436+0000 7fec237e6640 1 -- 172.21.15.62:0/346058314 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed500eb070 con 0x5569d871a4d0 2024-09-10T05:38:22.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.436+0000 7fed60ce89c0 1 -- 172.21.15.62:0/346058314 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569d871bc00 con 0x5569d871a4d0 2024-09-10T05:38:22.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.436+0000 7fec237e6640 1 -- 172.21.15.62:0/346058314 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fed500b5940 con 0x5569d871a4d0 2024-09-10T05:38:22.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.436+0000 7fec237e6640 1 --2- 172.21.15.62:0/346058314 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7feb94039a70 0x7feb9403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.436+0000 7fec237e6640 1 -- 172.21.15.62:0/346058314 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7fed500e8bf0 con 0x5569d871a4d0 2024-09-10T05:38:22.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.436+0000 7fed5dfed640 1 --2- 172.21.15.62:0/346058314 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7feb94039a70 0x7feb9403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.436+0000 7fec217e2640 20 reqs_thread_entry: start 2024-09-10T05:38:22.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.436+0000 7fed60ce89c0 1 --2- 172.21.15.62:0/782329289 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5569d871fea0 0x5569d87222d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.436+0000 7fed5dfed640 1 --2- 172.21.15.62:0/346058314 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7feb94039a70 0x7feb9403bf30 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fed48001d00 tx=0x7fed48001260 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.436+0000 7fed60ce89c0 1 -- 172.21.15.62:0/782329289 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5569d8722950 con 0x5569d871fea0 2024-09-10T05:38:22.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.436+0000 7fed5efef640 1 --2- 172.21.15.62:0/782329289 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5569d871fea0 0x5569d87222d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.436+0000 7fed5efef640 1 --2- 172.21.15.62:0/782329289 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5569d871fea0 0x5569d87222d0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.436+0000 7fed5efef640 1 -- 172.21.15.62:0/782329289 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fed58028930 con 0x5569d871fea0 2024-09-10T05:38:22.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.436+0000 7fed60ce89c0 1 --2- 172.21.15.62:0/782329289 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5569d8723710 0x5569d8725b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.436+0000 7fed60ce89c0 1 -- 172.21.15.62:0/782329289 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5569d8726160 con 0x5569d8723710 2024-09-10T05:38:22.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.440+0000 7fed5e7ee640 1 --2- 172.21.15.62:0/782329289 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5569d8723710 0x5569d8725b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.440+0000 7fed5e7ee640 1 --2- 172.21.15.62:0/782329289 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5569d8723710 0x5569d8725b00 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.440+0000 7fed5e7ee640 1 -- 172.21.15.62:0/782329289 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fed500c7070 con 0x5569d8723710 2024-09-10T05:38:22.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.440+0000 7fed60ce89c0 1 --2- 172.21.15.62:0/782329289 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5569d8727ed0 0x5569d872a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.440+0000 7fed60ce89c0 1 -- 172.21.15.62:0/782329289 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5569d872aa00 con 0x5569d8727ed0 2024-09-10T05:38:22.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.440+0000 7fed5dfed640 1 --2- 172.21.15.62:0/782329289 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5569d8727ed0 0x5569d872a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.440+0000 7fed5dfed640 1 --2- 172.21.15.62:0/782329289 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5569d8727ed0 0x5569d872a2c0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.440+0000 7fed5dfed640 1 -- 172.21.15.62:0/782329289 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~1155 out=1155b] v0'0 uv4 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7fed4800e6d0 con 0x5569d8727ed0 2024-09-10T05:38:22.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.440+0000 7fed60ce89c0 1 -- 172.21.15.62:0/2501809483 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fec38039a70 msgr2=0x7fec3803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.440+0000 7fed60ce89c0 1 --2- 172.21.15.62:0/2501809483 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fec38039a70 0x7fec3803bf30 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fed58027f50 tx=0x7fed58012ed0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.440+0000 7fed60ce89c0 1 -- 172.21.15.62:0/2501809483 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569d86f9a40 msgr2=0x5569d8700e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.440+0000 7fed60ce89c0 1 --2- 172.21.15.62:0/2501809483 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569d86f9a40 0x5569d8700e20 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x5569d86fa940 tx=0x7fed58003000 comp rx=0 tx=0).stop 2024-09-10T05:38:22.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.440+0000 7fed60ce89c0 1 -- 172.21.15.62:0/2501809483 shutdown_connections 2024-09-10T05:38:22.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.440+0000 7fed60ce89c0 1 --2- 172.21.15.62:0/2501809483 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fec38039a70 0x7fec3803bf30 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.440+0000 7fed60ce89c0 1 --2- 172.21.15.62:0/2501809483 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569d86f9a40 0x5569d8700e20 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.440+0000 7fed60ce89c0 1 -- 172.21.15.62:0/2501809483 >> 172.21.15.62:0/2501809483 conn(0x5569d85fd310 msgr2=0x5569d86f4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:22.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.440+0000 7fed60ce89c0 1 -- 172.21.15.62:0/2501809483 shutdown_connections 2024-09-10T05:38:22.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.440+0000 7fed60ce89c0 1 -- 172.21.15.62:0/2501809483 wait complete. 2024-09-10T05:38:22.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.440+0000 7fed60ce89c0 1 -- 172.21.15.62:0/346058314 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7feb94039a70 msgr2=0x7feb9403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.440+0000 7fed60ce89c0 1 --2- 172.21.15.62:0/346058314 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7feb94039a70 0x7feb9403bf30 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fed48001d00 tx=0x7fed48001260 comp rx=0 tx=0).stop 2024-09-10T05:38:22.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.440+0000 7fed60ce89c0 1 -- 172.21.15.62:0/346058314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569d871a4d0 msgr2=0x5569d871a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.440+0000 7fed60ce89c0 1 --2- 172.21.15.62:0/346058314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569d871a4d0 0x5569d871a8f0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fed500aafd0 tx=0x7fed500ab3f0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.440+0000 7fed60ce89c0 1 -- 172.21.15.62:0/346058314 shutdown_connections 2024-09-10T05:38:22.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.440+0000 7fed60ce89c0 1 --2- 172.21.15.62:0/346058314 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7feb94039a70 0x7feb9403bf30 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.440+0000 7fed60ce89c0 1 --2- 172.21.15.62:0/346058314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569d871a4d0 0x5569d871a8f0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.440+0000 7fed60ce89c0 1 -- 172.21.15.62:0/346058314 >> 172.21.15.62:0/346058314 conn(0x5569d870fad0 msgr2=0x5569d870feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:22.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.440+0000 7fed60ce89c0 1 -- 172.21.15.62:0/346058314 shutdown_connections 2024-09-10T05:38:22.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.440+0000 7fed60ce89c0 1 -- 172.21.15.62:0/346058314 wait complete. 2024-09-10T05:38:22.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.444+0000 7fed60ce89c0 1 -- 172.21.15.62:0/782329289 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5569d8723710 msgr2=0x5569d8725b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.444+0000 7fed60ce89c0 1 --2- 172.21.15.62:0/782329289 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5569d8723710 0x5569d8725b00 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.444+0000 7fed60ce89c0 1 -- 172.21.15.62:0/782329289 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5569d871fea0 msgr2=0x5569d87222d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.444+0000 7fed60ce89c0 1 --2- 172.21.15.62:0/782329289 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5569d871fea0 0x5569d87222d0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.444+0000 7fed60ce89c0 1 -- 172.21.15.62:0/782329289 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5569d8727ed0 msgr2=0x5569d872a2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.444+0000 7fed60ce89c0 1 --2- 172.21.15.62:0/782329289 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5569d8727ed0 0x5569d872a2c0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.444+0000 7fed60ce89c0 1 -- 172.21.15.62:0/782329289 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fec44039a70 msgr2=0x7fec4403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.444+0000 7fed60ce89c0 1 --2- 172.21.15.62:0/782329289 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fec44039a70 0x7fec4403bf30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fed500b3730 tx=0x7fed500b6910 comp rx=0 tx=0).stop 2024-09-10T05:38:22.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.444+0000 7fed60ce89c0 1 -- 172.21.15.62:0/782329289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569d85fa1d0 msgr2=0x5569d86ecdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.444+0000 7fed60ce89c0 1 --2- 172.21.15.62:0/782329289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569d85fa1d0 0x5569d86ecdc0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fed50018c00 tx=0x7fed50017d70 comp rx=0 tx=0).stop 2024-09-10T05:38:22.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.444+0000 7fed5efef640 1 -- 172.21.15.62:0/782329289 reap_dead start 2024-09-10T05:38:22.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.444+0000 7fed60ce89c0 1 -- 172.21.15.62:0/782329289 shutdown_connections 2024-09-10T05:38:22.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.444+0000 7fed60ce89c0 1 -- 172.21.15.62:0/782329289 >> 172.21.15.62:0/782329289 conn(0x5569d856dae0 msgr2=0x5569d86dff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:22.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.444+0000 7fed60ce89c0 1 -- 172.21.15.62:0/782329289 shutdown_connections 2024-09-10T05:38:22.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.444+0000 7fed60ce89c0 1 -- 172.21.15.62:0/782329289 wait complete. 2024-09-10T05:38:22.456 INFO:teuthology.orchestra.run.smithi062.stdout:{"id":"475ecc13-ad4b-423e-b7f2-f7f260e17071","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-10T05:38:22.457 DEBUG:tasks.util.rgw: json result: {'id': '475ecc13-ad4b-423e-b7f2-f7f260e17071', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-10T05:38:22.457 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-10T05:38:22.457 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-10T05:38:22.457 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-10T05:38:22.537 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:38:22.537 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:38:22.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.536+0000 7efd086ab9c0 1 Processor -- start 2024-09-10T05:38:22.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.536+0000 7efd086ab9c0 1 -- start start 2024-09-10T05:38:22.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.536+0000 7efd086ab9c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55cf584a5e80 0x55cf585397f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.536+0000 7efd086ab9c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cf583e59c0 con 0x55cf584a5aa0 2024-09-10T05:38:22.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.536+0000 7efd086ab9c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x55cf584356d0 con 0x55cf584a5e80 2024-09-10T05:38:22.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.536+0000 7efd059b0640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55cf584a5e80 0x55cf585397f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.536+0000 7efd059b0640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55cf584a5e80 0x55cf585397f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38520/0 (socket says 172.21.15.62:38520) 2024-09-10T05:38:22.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.536+0000 7efd061b1640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x55cf584a5aa0 0x55cf585360c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:52056/0 (socket says 172.21.15.62:52056) 2024-09-10T05:38:22.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.536+0000 7efd059b0640 1 -- 172.21.15.62:0/2005016750 learned_addr learned my addr 172.21.15.62:0/2005016750 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:22.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.536+0000 7efd059b0640 1 -- 172.21.15.62:0/2005016750 >> v1:172.21.15.2:6789/0 conn(0x55cf584a5aa0 legacy=0x55cf585360c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.536+0000 7efd059b0640 1 -- 172.21.15.62:0/2005016750 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf583d9ca0 con 0x55cf584a5e80 2024-09-10T05:38:22.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.540+0000 7efd059b0640 1 --2- 172.21.15.62:0/2005016750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf584a5e80 0x55cf585397f0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7efcf000a5c0 tx=0x7efcf001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8632aee23a268886 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.540+0000 7efd051af640 1 -- 172.21.15.62:0/2005016750 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcf00a6070 con 0x55cf584a5e80 2024-09-10T05:38:22.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.540+0000 7efd051af640 1 -- 172.21.15.62:0/2005016750 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcf00af070 con 0x55cf584a5e80 2024-09-10T05:38:22.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.540+0000 7efd051af640 1 -- 172.21.15.62:0/2005016750 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcf00aa5c0 con 0x55cf584a5e80 2024-09-10T05:38:22.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.540+0000 7efd086ab9c0 1 -- 172.21.15.62:0/2005016750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf584a5e80 msgr2=0x55cf585397f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.540+0000 7efd086ab9c0 1 --2- 172.21.15.62:0/2005016750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf584a5e80 0x55cf585397f0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7efcf000a5c0 tx=0x7efcf001b340 comp rx=0 tx=0).stop 2024-09-10T05:38:22.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.540+0000 7efd086ab9c0 1 -- 172.21.15.62:0/2005016750 shutdown_connections 2024-09-10T05:38:22.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.540+0000 7efd086ab9c0 1 --2- 172.21.15.62:0/2005016750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf584a5e80 0x55cf585397f0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.540+0000 7efd086ab9c0 1 -- 172.21.15.62:0/2005016750 >> 172.21.15.62:0/2005016750 conn(0x55cf5852b9b0 msgr2=0x55cf5852ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:22.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.540+0000 7efd086ab9c0 1 -- 172.21.15.62:0/2005016750 shutdown_connections 2024-09-10T05:38:22.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.540+0000 7efd086ab9c0 1 -- 172.21.15.62:0/2005016750 wait complete. 2024-09-10T05:38:22.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.556+0000 7efd086ab9c0 1 Processor -- start 2024-09-10T05:38:22.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.556+0000 7efd086ab9c0 1 -- start start 2024-09-10T05:38:22.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.556+0000 7efd086ab9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf584a5aa0 0x55cf5861ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.556+0000 7efd086ab9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55cf58439680 con 0x55cf584a5aa0 2024-09-10T05:38:22.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.556+0000 7efd061b1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf584a5aa0 0x55cf5861ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.556+0000 7efd061b1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf584a5aa0 0x55cf5861ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38526/0 (socket says 172.21.15.62:38526) 2024-09-10T05:38:22.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.556+0000 7efd061b1640 1 -- 172.21.15.62:0/3986924637 learned_addr learned my addr 172.21.15.62:0/3986924637 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:22.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.556+0000 7efd061b1640 1 -- 172.21.15.62:0/3986924637 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf583b4da0 con 0x55cf584a5aa0 2024-09-10T05:38:22.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.556+0000 7efd061b1640 1 --2- 172.21.15.62:0/3986924637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf584a5aa0 0x55cf5861ea00 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7efd000016f0 tx=0x7efd00001bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a7d619f11345ad9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.556+0000 7efbf4608640 1 -- 172.21.15.62:0/3986924637 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd00003460 con 0x55cf584a5aa0 2024-09-10T05:38:22.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.556+0000 7efbf4608640 1 -- 172.21.15.62:0/3986924637 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd00003620 con 0x55cf584a5aa0 2024-09-10T05:38:22.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.556+0000 7efbf4608640 1 -- 172.21.15.62:0/3986924637 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd00003940 con 0x55cf584a5aa0 2024-09-10T05:38:22.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.556+0000 7efd086ab9c0 1 -- 172.21.15.62:0/3986924637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf584a5aa0 msgr2=0x55cf5861ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.556+0000 7efd086ab9c0 1 --2- 172.21.15.62:0/3986924637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf584a5aa0 0x55cf5861ea00 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7efd000016f0 tx=0x7efd00001bb0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.556+0000 7efd086ab9c0 1 -- 172.21.15.62:0/3986924637 shutdown_connections 2024-09-10T05:38:22.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.556+0000 7efd086ab9c0 1 --2- 172.21.15.62:0/3986924637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf584a5aa0 0x55cf5861ea00 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.556+0000 7efd086ab9c0 1 -- 172.21.15.62:0/3986924637 >> 172.21.15.62:0/3986924637 conn(0x55cf5852b9b0 msgr2=0x55cf5861a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:22.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.556+0000 7efd086ab9c0 1 -- 172.21.15.62:0/3986924637 shutdown_connections 2024-09-10T05:38:22.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.556+0000 7efd086ab9c0 1 -- 172.21.15.62:0/3986924637 wait complete. 2024-09-10T05:38:22.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.556+0000 7efd086ab9c0 1 Processor -- start 2024-09-10T05:38:22.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.556+0000 7efd086ab9c0 1 -- start start 2024-09-10T05:38:22.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.560+0000 7efd086ab9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf584a5aa0 0x55cf58625fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.560+0000 7efd086ab9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55cf583dba50 con 0x55cf584a5aa0 2024-09-10T05:38:22.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.560+0000 7efd061b1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf584a5aa0 0x55cf58625fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.560+0000 7efd061b1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf584a5aa0 0x55cf58625fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38532/0 (socket says 172.21.15.62:38532) 2024-09-10T05:38:22.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.560+0000 7efd061b1640 1 -- 172.21.15.62:0/1804824776 learned_addr learned my addr 172.21.15.62:0/1804824776 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:22.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.560+0000 7efd061b1640 1 -- 172.21.15.62:0/1804824776 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf58626530 con 0x55cf584a5aa0 2024-09-10T05:38:22.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.560+0000 7efd061b1640 1 --2- 172.21.15.62:0/1804824776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf584a5aa0 0x55cf58625fd0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7efd00014040 tx=0x7efd00001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.560+0000 7efbf2e05640 1 -- 172.21.15.62:0/1804824776 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd00022020 con 0x55cf584a5aa0 2024-09-10T05:38:22.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.560+0000 7efbf2e05640 1 -- 172.21.15.62:0/1804824776 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd0001e480 con 0x55cf584a5aa0 2024-09-10T05:38:22.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.560+0000 7efd086ab9c0 1 -- 172.21.15.62:0/1804824776 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cf586267c0 con 0x55cf584a5aa0 2024-09-10T05:38:22.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.560+0000 7efbf2e05640 1 -- 172.21.15.62:0/1804824776 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd0001e7a0 con 0x55cf584a5aa0 2024-09-10T05:38:22.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.560+0000 7efd086ab9c0 1 -- 172.21.15.62:0/1804824776 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf586271f0 con 0x55cf584a5aa0 2024-09-10T05:38:22.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.560+0000 7efd086ab9c0 1 Processor -- start 2024-09-10T05:38:22.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.560+0000 7efd086ab9c0 1 -- start start 2024-09-10T05:38:22.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.560+0000 7efd086ab9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf58632bf0 0x55cf58632ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.560+0000 7efd086ab9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55cf58446450 con 0x55cf58632bf0 2024-09-10T05:38:22.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.560+0000 7efd069b2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf58632bf0 0x55cf58632ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.560+0000 7efd069b2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf58632bf0 0x55cf58632ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38548/0 (socket says 172.21.15.62:38548) 2024-09-10T05:38:22.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.560+0000 7efd069b2640 1 -- 172.21.15.62:0/3954433821 learned_addr learned my addr 172.21.15.62:0/3954433821 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:22.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.560+0000 7efbf2e05640 1 -- 172.21.15.62:0/1804824776 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7efd00025020 con 0x55cf584a5aa0 2024-09-10T05:38:22.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.560+0000 7efbf2e05640 1 --2- 172.21.15.62:0/1804824776 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7efbec039a70 0x7efbec03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.560+0000 7efd069b2640 1 -- 172.21.15.62:0/3954433821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf586335e0 con 0x55cf58632bf0 2024-09-10T05:38:22.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.560+0000 7efbf2e05640 1 -- 172.21.15.62:0/1804824776 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7efd00050190 con 0x55cf584a5aa0 2024-09-10T05:38:22.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.560+0000 7efd061b1640 1 --2- 172.21.15.62:0/1804824776 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7efbec039a70 0x7efbec03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.560+0000 7efd069b2640 1 --2- 172.21.15.62:0/3954433821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf58632bf0 0x55cf58632ff0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7efcf800a440 tx=0x7efcf800a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5f17c6bea7ca729 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.560+0000 7efd061b1640 1 --2- 172.21.15.62:0/1804824776 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7efbec039a70 0x7efbec03bf30 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7efd00001bd0 tx=0x7efd00034040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.560+0000 7efbf0e01640 1 -- 172.21.15.62:0/3954433821 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcf8008850 con 0x55cf58632bf0 2024-09-10T05:38:22.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.564+0000 7efbf0e01640 1 -- 172.21.15.62:0/3954433821 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcf8008a10 con 0x55cf58632bf0 2024-09-10T05:38:22.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.564+0000 7efbf0e01640 1 -- 172.21.15.62:0/3954433821 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcf8008d30 con 0x55cf58632bf0 2024-09-10T05:38:22.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.564+0000 7efd086ab9c0 1 -- 172.21.15.62:0/3954433821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf58632bf0 msgr2=0x55cf58632ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.564+0000 7efd086ab9c0 1 --2- 172.21.15.62:0/3954433821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf58632bf0 0x55cf58632ff0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7efcf800a440 tx=0x7efcf800a900 comp rx=0 tx=0).stop 2024-09-10T05:38:22.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.564+0000 7efd086ab9c0 1 -- 172.21.15.62:0/3954433821 shutdown_connections 2024-09-10T05:38:22.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.564+0000 7efd086ab9c0 1 --2- 172.21.15.62:0/3954433821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf58632bf0 0x55cf58632ff0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.564+0000 7efd086ab9c0 1 -- 172.21.15.62:0/3954433821 >> 172.21.15.62:0/3954433821 conn(0x55cf584a5e80 msgr2=0x55cf5862e630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:22.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.564+0000 7efd086ab9c0 1 -- 172.21.15.62:0/3954433821 shutdown_connections 2024-09-10T05:38:22.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.564+0000 7efd086ab9c0 1 -- 172.21.15.62:0/3954433821 wait complete. 2024-09-10T05:38:22.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.564+0000 7efd086ab9c0 1 Processor -- start 2024-09-10T05:38:22.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.564+0000 7efd086ab9c0 1 -- start start 2024-09-10T05:38:22.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.564+0000 7efd086ab9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf58632bf0 0x55cf58639f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.564+0000 7efd086ab9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55cf58633dd0 con 0x55cf58632bf0 2024-09-10T05:38:22.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.564+0000 7efd069b2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf58632bf0 0x55cf58639f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.564+0000 7efd069b2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf58632bf0 0x55cf58639f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38560/0 (socket says 172.21.15.62:38560) 2024-09-10T05:38:22.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.564+0000 7efd069b2640 1 -- 172.21.15.62:0/3184672879 learned_addr learned my addr 172.21.15.62:0/3184672879 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:22.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.564+0000 7efd069b2640 1 -- 172.21.15.62:0/3184672879 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf5863a4f0 con 0x55cf58632bf0 2024-09-10T05:38:22.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.564+0000 7efd069b2640 1 --2- 172.21.15.62:0/3184672879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf58632bf0 0x55cf58639f90 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x55cf58633af0 tx=0x7efcf8003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.564+0000 7efbeaffd640 1 -- 172.21.15.62:0/3184672879 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcf8013a70 con 0x55cf58632bf0 2024-09-10T05:38:22.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.564+0000 7efd086ab9c0 1 -- 172.21.15.62:0/3184672879 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cf5863a780 con 0x55cf58632bf0 2024-09-10T05:38:22.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.564+0000 7efbeaffd640 1 -- 172.21.15.62:0/3184672879 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcf8023070 con 0x55cf58632bf0 2024-09-10T05:38:22.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.564+0000 7efbeaffd640 1 -- 172.21.15.62:0/3184672879 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcf8013d80 con 0x55cf58632bf0 2024-09-10T05:38:22.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.564+0000 7efd086ab9c0 1 -- 172.21.15.62:0/3184672879 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf5863b130 con 0x55cf58632bf0 2024-09-10T05:38:22.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.564+0000 7efbeaffd640 1 -- 172.21.15.62:0/3184672879 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7efcf8028460 con 0x55cf58632bf0 2024-09-10T05:38:22.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.568+0000 7efd086ab9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:38:22.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.568+0000 7efd086ab9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:38:22.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.568+0000 7efbeaffd640 1 --2- 172.21.15.62:0/3184672879 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7efbe0039a70 0x7efbe003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.568+0000 7efbeaffd640 1 -- 172.21.15.62:0/3184672879 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7efcf8050640 con 0x55cf58632bf0 2024-09-10T05:38:22.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.568+0000 7efd069b2640 1 --2- 172.21.15.62:0/3184672879 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7efbe0039a70 0x7efbe003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.568+0000 7efd086ab9c0 1 Processor -- start 2024-09-10T05:38:22.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.568+0000 7efd086ab9c0 1 -- start start 2024-09-10T05:38:22.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.568+0000 7efd086ab9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf585320b0 0x55cf585324d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.568+0000 7efd086ab9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55cf5861f1d0 con 0x55cf585320b0 2024-09-10T05:38:22.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.568+0000 7efd069b2640 1 --2- 172.21.15.62:0/3184672879 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7efbe0039a70 0x7efbe003bf30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7efcf8028e20 tx=0x7efcf8028d70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.568+0000 7efd061b1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf585320b0 0x55cf585324d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.568+0000 7efd061b1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf585320b0 0x55cf585324d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38576/0 (socket says 172.21.15.62:38576) 2024-09-10T05:38:22.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.568+0000 7efd061b1640 1 -- 172.21.15.62:0/1450025009 learned_addr learned my addr 172.21.15.62:0/1450025009 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:22.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.568+0000 7efd061b1640 1 -- 172.21.15.62:0/1450025009 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf58532b10 con 0x55cf585320b0 2024-09-10T05:38:22.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.568+0000 7efd061b1640 1 --2- 172.21.15.62:0/1450025009 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf585320b0 0x55cf585324d0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7efd0004e530 tx=0x7efd0001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.568+0000 7efbcb7e6640 1 -- 172.21.15.62:0/1450025009 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd00010b30 con 0x55cf585320b0 2024-09-10T05:38:22.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.568+0000 7efd086ab9c0 1 -- 172.21.15.62:0/1450025009 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cf58533370 con 0x55cf585320b0 2024-09-10T05:38:22.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.568+0000 7efbcb7e6640 1 -- 172.21.15.62:0/1450025009 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd00010cd0 con 0x55cf585320b0 2024-09-10T05:38:22.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.568+0000 7efbcb7e6640 1 -- 172.21.15.62:0/1450025009 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd00012530 con 0x55cf585320b0 2024-09-10T05:38:22.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.568+0000 7efd086ab9c0 1 -- 172.21.15.62:0/1450025009 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf585338e0 con 0x55cf585320b0 2024-09-10T05:38:22.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.568+0000 7efbcb7e6640 1 -- 172.21.15.62:0/1450025009 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7efd00039070 con 0x55cf585320b0 2024-09-10T05:38:22.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.572+0000 7efbcb7e6640 1 --2- 172.21.15.62:0/1450025009 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7efb44039a70 0x7efb4403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.572+0000 7efbcb7e6640 1 -- 172.21.15.62:0/1450025009 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7efd00043070 con 0x55cf585320b0 2024-09-10T05:38:22.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.572+0000 7efd059b0640 1 --2- 172.21.15.62:0/1450025009 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7efb44039a70 0x7efb4403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.572+0000 7efbc97e2640 20 reqs_thread_entry: start 2024-09-10T05:38:22.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.572+0000 7efd086ab9c0 1 --2- 172.21.15.62:0/1804824776 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55cf5865d9e0 0x55cf5865fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.572+0000 7efd086ab9c0 1 -- 172.21.15.62:0/1804824776 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cf58660310 con 0x55cf5865d9e0 2024-09-10T05:38:22.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.572+0000 7efd059b0640 1 --2- 172.21.15.62:0/1450025009 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7efb44039a70 0x7efb4403bf30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7efcf00ae000 tx=0x7efcf00a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.572+0000 7efd069b2640 1 --2- 172.21.15.62:0/1804824776 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55cf5865d9e0 0x55cf5865fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.572+0000 7efd069b2640 1 --2- 172.21.15.62:0/1804824776 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55cf5865d9e0 0x55cf5865fdd0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.572+0000 7efd069b2640 1 -- 172.21.15.62:0/1804824776 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efcf8011a80 con 0x55cf5865d9e0 2024-09-10T05:38:22.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.572+0000 7efd086ab9c0 1 --2- 172.21.15.62:0/1804824776 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55cf58661d40 0x55cf58664190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.572+0000 7efd086ab9c0 1 -- 172.21.15.62:0/1804824776 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:2 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cf58664920 con 0x55cf58661d40 2024-09-10T05:38:22.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.572+0000 7efd061b1640 1 --2- 172.21.15.62:0/1804824776 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55cf58661d40 0x55cf58664190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.572+0000 7efd061b1640 1 --2- 172.21.15.62:0/1804824776 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55cf58661d40 0x55cf58664190 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.572+0000 7efd061b1640 1 -- 172.21.15.62:0/1804824776 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(2 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~1155 out=1155b] v0'0 uv4 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7efd0004d020 con 0x55cf58661d40 2024-09-10T05:38:22.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.572+0000 7efd086ab9c0 1 -- 172.21.15.62:0/1804824776 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf58661080 con 0x55cf58661d40 2024-09-10T05:38:22.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.576+0000 7efd061b1640 1 -- 172.21.15.62:0/1804824776 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [stat,call,call,writefull 0~993] v34'5 uv5 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7efd0004d020 con 0x55cf58661d40 2024-09-10T05:38:22.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.576+0000 7efd086ab9c0 1 -- 172.21.15.62:0/3184672879 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7efbe0039a70 msgr2=0x7efbe003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.576+0000 7efd086ab9c0 1 --2- 172.21.15.62:0/3184672879 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7efbe0039a70 0x7efbe003bf30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7efcf8028e20 tx=0x7efcf8028d70 comp rx=0 tx=0).stop 2024-09-10T05:38:22.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.576+0000 7efd086ab9c0 1 -- 172.21.15.62:0/3184672879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf58632bf0 msgr2=0x55cf58639f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.576+0000 7efd086ab9c0 1 --2- 172.21.15.62:0/3184672879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf58632bf0 0x55cf58639f90 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x55cf58633af0 tx=0x7efcf8003000 comp rx=0 tx=0).stop 2024-09-10T05:38:22.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.576+0000 7efd086ab9c0 1 -- 172.21.15.62:0/3184672879 shutdown_connections 2024-09-10T05:38:22.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.576+0000 7efd086ab9c0 1 --2- 172.21.15.62:0/3184672879 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7efbe0039a70 0x7efbe003bf30 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.576+0000 7efd086ab9c0 1 --2- 172.21.15.62:0/3184672879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf58632bf0 0x55cf58639f90 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.576+0000 7efd086ab9c0 1 -- 172.21.15.62:0/3184672879 >> 172.21.15.62:0/3184672879 conn(0x55cf584a5e80 msgr2=0x55cf5862e120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:22.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.576+0000 7efd086ab9c0 1 -- 172.21.15.62:0/3184672879 shutdown_connections 2024-09-10T05:38:22.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.576+0000 7efd086ab9c0 1 -- 172.21.15.62:0/3184672879 wait complete. 2024-09-10T05:38:22.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.576+0000 7efd086ab9c0 1 -- 172.21.15.62:0/1450025009 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7efb44039a70 msgr2=0x7efb4403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.576+0000 7efd086ab9c0 1 --2- 172.21.15.62:0/1450025009 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7efb44039a70 0x7efb4403bf30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7efcf00ae000 tx=0x7efcf00a6000 comp rx=0 tx=0).stop 2024-09-10T05:38:22.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.576+0000 7efd086ab9c0 1 -- 172.21.15.62:0/1450025009 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf585320b0 msgr2=0x55cf585324d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.576+0000 7efd086ab9c0 1 --2- 172.21.15.62:0/1450025009 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf585320b0 0x55cf585324d0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7efd0004e530 tx=0x7efd0001ed10 comp rx=0 tx=0).stop 2024-09-10T05:38:22.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.576+0000 7efd086ab9c0 1 -- 172.21.15.62:0/1450025009 shutdown_connections 2024-09-10T05:38:22.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.576+0000 7efd086ab9c0 1 --2- 172.21.15.62:0/1450025009 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7efb44039a70 0x7efb4403bf30 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.576+0000 7efd086ab9c0 1 --2- 172.21.15.62:0/1450025009 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf585320b0 0x55cf585324d0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.576+0000 7efd086ab9c0 1 -- 172.21.15.62:0/1450025009 >> 172.21.15.62:0/1450025009 conn(0x55cf58648cc0 msgr2=0x55cf586490a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:22.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.576+0000 7efd086ab9c0 1 -- 172.21.15.62:0/1450025009 shutdown_connections 2024-09-10T05:38:22.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.576+0000 7efd086ab9c0 1 -- 172.21.15.62:0/1450025009 wait complete. 2024-09-10T05:38:22.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.576+0000 7efd086ab9c0 1 -- 172.21.15.62:0/1804824776 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55cf5865d9e0 msgr2=0x55cf5865fdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.576+0000 7efd086ab9c0 1 --2- 172.21.15.62:0/1804824776 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55cf5865d9e0 0x55cf5865fdd0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.576+0000 7efd086ab9c0 1 -- 172.21.15.62:0/1804824776 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55cf58661d40 msgr2=0x55cf58664190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.576+0000 7efd086ab9c0 1 --2- 172.21.15.62:0/1804824776 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55cf58661d40 0x55cf58664190 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.576+0000 7efd086ab9c0 1 -- 172.21.15.62:0/1804824776 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7efbec039a70 msgr2=0x7efbec03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.576+0000 7efd086ab9c0 1 --2- 172.21.15.62:0/1804824776 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7efbec039a70 0x7efbec03bf30 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7efd00001bd0 tx=0x7efd00034040 comp rx=0 tx=0).stop 2024-09-10T05:38:22.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.576+0000 7efd086ab9c0 1 -- 172.21.15.62:0/1804824776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf584a5aa0 msgr2=0x55cf58625fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.576+0000 7efd086ab9c0 1 --2- 172.21.15.62:0/1804824776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf584a5aa0 0x55cf58625fd0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7efd00014040 tx=0x7efd00001260 comp rx=0 tx=0).stop 2024-09-10T05:38:22.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.576+0000 7efd086ab9c0 1 -- 172.21.15.62:0/1804824776 shutdown_connections 2024-09-10T05:38:22.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.576+0000 7efd086ab9c0 1 --2- 172.21.15.62:0/1804824776 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55cf58661d40 0x55cf58664190 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.576+0000 7efd086ab9c0 1 --2- 172.21.15.62:0/1804824776 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55cf5865d9e0 0x55cf5865fdd0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.576+0000 7efd086ab9c0 1 --2- 172.21.15.62:0/1804824776 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7efbec039a70 0x7efbec03bf30 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.576+0000 7efd086ab9c0 1 --2- 172.21.15.62:0/1804824776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf584a5aa0 0x55cf58625fd0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.576+0000 7efd086ab9c0 1 -- 172.21.15.62:0/1804824776 >> 172.21.15.62:0/1804824776 conn(0x55cf5852b9b0 msgr2=0x55cf58619130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:22.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.576+0000 7efd086ab9c0 1 -- 172.21.15.62:0/1804824776 shutdown_connections 2024-09-10T05:38:22.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.576+0000 7efd086ab9c0 1 -- 172.21.15.62:0/1804824776 wait complete. 2024-09-10T05:38:22.591 INFO:teuthology.orchestra.run.smithi062.stdout:{"id":"475ecc13-ad4b-423e-b7f2-f7f260e17071","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-10T05:38:22.591 DEBUG:tasks.util.rgw: json result: {'id': '475ecc13-ad4b-423e-b7f2-f7f260e17071', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-10T05:38:22.592 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2024-09-10T05:38:22.592 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2024-09-10T05:38:22.592 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2024-09-10T05:38:22.667 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:38:22.667 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:38:22.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.664+0000 7f41a26989c0 1 Processor -- start 2024-09-10T05:38:22.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.664+0000 7f41a26989c0 1 -- start start 2024-09-10T05:38:22.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.664+0000 7f41a26989c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55c12dac4d80 0x55c12dac71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.664+0000 7f41a26989c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c12d9779c0 con 0x55c12dac1150 2024-09-10T05:38:22.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.664+0000 7f41a26989c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x55c12d9c76d0 con 0x55c12dac4d80 2024-09-10T05:38:22.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.664+0000 7f419f99d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55c12dac4d80 0x55c12dac71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.664+0000 7f41a019e640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x55c12dac1150 0x55c12dac3540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:52070/0 (socket says 172.21.15.62:52070) 2024-09-10T05:38:22.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.668+0000 7f41a019e640 1 -- 172.21.15.62:0/1807834716 learned_addr learned my addr 172.21.15.62:0/1807834716 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-10T05:38:22.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.668+0000 7f419f99d640 1 -- 172.21.15.62:0/1807834716 >> v1:172.21.15.2:6789/0 conn(0x55c12dac1150 legacy=0x55c12dac3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.668+0000 7f419f99d640 1 -- 172.21.15.62:0/1807834716 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c12d96bca0 con 0x55c12dac4d80 2024-09-10T05:38:22.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.668+0000 7f419f19c640 1 -- 172.21.15.62:0/1807834716 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3051479231 0 0) 0x55c12d9779c0 con 0x55c12dac1150 2024-09-10T05:38:22.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.668+0000 7f419f99d640 1 --2- 172.21.15.62:0/1807834716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c12dac4d80 0x55c12dac71a0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f418800a480 tx=0x7f418801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=366430697dbcb616 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.668+0000 7f419f19c640 1 -- 172.21.15.62:0/1807834716 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41880b0070 con 0x55c12dac4d80 2024-09-10T05:38:22.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.668+0000 7f419f19c640 1 -- 172.21.15.62:0/1807834716 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41880ab540 con 0x55c12dac4d80 2024-09-10T05:38:22.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.668+0000 7f419f19c640 1 -- 172.21.15.62:0/1807834716 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41880ab840 con 0x55c12dac4d80 2024-09-10T05:38:22.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.668+0000 7f41a26989c0 1 -- 172.21.15.62:0/1807834716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c12dac4d80 msgr2=0x55c12dac71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.668+0000 7f41a26989c0 1 --2- 172.21.15.62:0/1807834716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c12dac4d80 0x55c12dac71a0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f418800a480 tx=0x7f418801b280 comp rx=0 tx=0).stop 2024-09-10T05:38:22.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.672+0000 7f41a26989c0 1 -- 172.21.15.62:0/1807834716 shutdown_connections 2024-09-10T05:38:22.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.672+0000 7f41a26989c0 1 --2- 172.21.15.62:0/1807834716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c12dac4d80 0x55c12dac71a0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.672+0000 7f41a26989c0 1 -- 172.21.15.62:0/1807834716 >> 172.21.15.62:0/1807834716 conn(0x55c12dabd0a0 msgr2=0x55c12dabf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:22.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.672+0000 7f41a26989c0 1 -- 172.21.15.62:0/1807834716 shutdown_connections 2024-09-10T05:38:22.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.672+0000 7f41a26989c0 1 -- 172.21.15.62:0/1807834716 wait complete. 2024-09-10T05:38:22.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.688+0000 7f41a26989c0 1 Processor -- start 2024-09-10T05:38:22.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.688+0000 7f41a26989c0 1 -- start start 2024-09-10T05:38:22.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.688+0000 7f41a26989c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c12dac1150 0x55c12dbb4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.688+0000 7f41a26989c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c12d9cb680 con 0x55c12dac1150 2024-09-10T05:38:22.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.688+0000 7f41a019e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c12dac1150 0x55c12dbb4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.688+0000 7f41a019e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c12dac1150 0x55c12dbb4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38586/0 (socket says 172.21.15.62:38586) 2024-09-10T05:38:22.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.688+0000 7f41a019e640 1 -- 172.21.15.62:0/310376018 learned_addr learned my addr 172.21.15.62:0/310376018 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:22.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.688+0000 7f41a019e640 1 -- 172.21.15.62:0/310376018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c12d946da0 con 0x55c12dac1150 2024-09-10T05:38:22.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.688+0000 7f41a019e640 1 --2- 172.21.15.62:0/310376018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c12dac1150 0x55c12dbb4b70 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f4198006fb0 tx=0x7f4198001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85b2ea9133c4213 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.688+0000 7f408e60c640 1 -- 172.21.15.62:0/310376018 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4198003460 con 0x55c12dac1150 2024-09-10T05:38:22.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.688+0000 7f408e60c640 1 -- 172.21.15.62:0/310376018 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4198003600 con 0x55c12dac1150 2024-09-10T05:38:22.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.688+0000 7f408e60c640 1 -- 172.21.15.62:0/310376018 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4198003920 con 0x55c12dac1150 2024-09-10T05:38:22.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.688+0000 7f41a26989c0 1 -- 172.21.15.62:0/310376018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c12dac1150 msgr2=0x55c12dbb4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.688+0000 7f41a26989c0 1 --2- 172.21.15.62:0/310376018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c12dac1150 0x55c12dbb4b70 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f4198006fb0 tx=0x7f4198001b10 comp rx=0 tx=0).stop 2024-09-10T05:38:22.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.688+0000 7f41a26989c0 1 -- 172.21.15.62:0/310376018 shutdown_connections 2024-09-10T05:38:22.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.688+0000 7f41a26989c0 1 --2- 172.21.15.62:0/310376018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c12dac1150 0x55c12dbb4b70 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.688+0000 7f41a26989c0 1 -- 172.21.15.62:0/310376018 >> 172.21.15.62:0/310376018 conn(0x55c12dabd0a0 msgr2=0x55c12dbb07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:22.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.688+0000 7f41a26989c0 1 -- 172.21.15.62:0/310376018 shutdown_connections 2024-09-10T05:38:22.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.688+0000 7f41a26989c0 1 -- 172.21.15.62:0/310376018 wait complete. 2024-09-10T05:38:22.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.688+0000 7f41a26989c0 1 Processor -- start 2024-09-10T05:38:22.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.688+0000 7f41a26989c0 1 -- start start 2024-09-10T05:38:22.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.692+0000 7f41a26989c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c12dac1150 0x55c12dbbc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.692+0000 7f41a26989c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c12d96da50 con 0x55c12dac1150 2024-09-10T05:38:22.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.692+0000 7f41a019e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c12dac1150 0x55c12dbbc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.692+0000 7f41a019e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c12dac1150 0x55c12dbbc260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38594/0 (socket says 172.21.15.62:38594) 2024-09-10T05:38:22.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.692+0000 7f41a019e640 1 -- 172.21.15.62:0/3326171936 learned_addr learned my addr 172.21.15.62:0/3326171936 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:22.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.692+0000 7f41a019e640 1 -- 172.21.15.62:0/3326171936 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c12dbbc7c0 con 0x55c12dac1150 2024-09-10T05:38:22.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.692+0000 7f41a019e640 1 --2- 172.21.15.62:0/3326171936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c12dac1150 0x55c12dbbc260 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x55c12dbb48b0 tx=0x7f4198001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.692+0000 7f408ce09640 1 -- 172.21.15.62:0/3326171936 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4198025070 con 0x55c12dac1150 2024-09-10T05:38:22.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.692+0000 7f408ce09640 1 -- 172.21.15.62:0/3326171936 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4198019040 con 0x55c12dac1150 2024-09-10T05:38:22.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.692+0000 7f408ce09640 1 -- 172.21.15.62:0/3326171936 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4198013760 con 0x55c12dac1150 2024-09-10T05:38:22.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.692+0000 7f41a26989c0 1 -- 172.21.15.62:0/3326171936 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c12dbbca50 con 0x55c12dac1150 2024-09-10T05:38:22.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.692+0000 7f41a26989c0 1 -- 172.21.15.62:0/3326171936 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c12dbbd400 con 0x55c12dac1150 2024-09-10T05:38:22.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.692+0000 7f41a26989c0 1 Processor -- start 2024-09-10T05:38:22.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.692+0000 7f41a26989c0 1 -- start start 2024-09-10T05:38:22.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.692+0000 7f41a26989c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c12dbc8e80 0x55c12dbc9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.692+0000 7f41a26989c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c12d9d8450 con 0x55c12dbc8e80 2024-09-10T05:38:22.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.692+0000 7f41a099f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c12dbc8e80 0x55c12dbc9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.692+0000 7f41a099f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c12dbc8e80 0x55c12dbc9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38610/0 (socket says 172.21.15.62:38610) 2024-09-10T05:38:22.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.692+0000 7f41a099f640 1 -- 172.21.15.62:0/92937953 learned_addr learned my addr 172.21.15.62:0/92937953 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:22.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.692+0000 7f408ce09640 1 -- 172.21.15.62:0/3326171936 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f4198010070 con 0x55c12dac1150 2024-09-10T05:38:22.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.692+0000 7f408ce09640 1 --2- 172.21.15.62:0/3326171936 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4088039ac0 0x7f408803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.692+0000 7f41a099f640 1 -- 172.21.15.62:0/92937953 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c12dbc9870 con 0x55c12dbc8e80 2024-09-10T05:38:22.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.692+0000 7f408ce09640 1 -- 172.21.15.62:0/3326171936 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7f419804f920 con 0x55c12dac1150 2024-09-10T05:38:22.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.696+0000 7f41a019e640 1 --2- 172.21.15.62:0/3326171936 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4088039ac0 0x7f408803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.696+0000 7f41a099f640 1 --2- 172.21.15.62:0/92937953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c12dbc8e80 0x55c12dbc9280 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f419000a440 tx=0x7f419000a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6077022b48844c9f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.696+0000 7f41a019e640 1 --2- 172.21.15.62:0/3326171936 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4088039ac0 0x7f408803bf80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4198003fd0 tx=0x7f4198048040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.696+0000 7f40867fc640 1 -- 172.21.15.62:0/92937953 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4190008850 con 0x55c12dbc8e80 2024-09-10T05:38:22.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.696+0000 7f40867fc640 1 -- 172.21.15.62:0/92937953 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4190008a10 con 0x55c12dbc8e80 2024-09-10T05:38:22.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.696+0000 7f40867fc640 1 -- 172.21.15.62:0/92937953 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4190008d30 con 0x55c12dbc8e80 2024-09-10T05:38:22.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.696+0000 7f41a26989c0 1 -- 172.21.15.62:0/92937953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c12dbc8e80 msgr2=0x55c12dbc9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.696+0000 7f41a26989c0 1 --2- 172.21.15.62:0/92937953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c12dbc8e80 0x55c12dbc9280 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f419000a440 tx=0x7f419000a900 comp rx=0 tx=0).stop 2024-09-10T05:38:22.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.696+0000 7f41a26989c0 1 -- 172.21.15.62:0/92937953 shutdown_connections 2024-09-10T05:38:22.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.696+0000 7f41a26989c0 1 --2- 172.21.15.62:0/92937953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c12dbc8e80 0x55c12dbc9280 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.696+0000 7f41a26989c0 1 -- 172.21.15.62:0/92937953 >> 172.21.15.62:0/92937953 conn(0x55c12dac4d80 msgr2=0x55c12dbc48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:22.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.696+0000 7f41a26989c0 1 -- 172.21.15.62:0/92937953 shutdown_connections 2024-09-10T05:38:22.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.696+0000 7f41a26989c0 1 -- 172.21.15.62:0/92937953 wait complete. 2024-09-10T05:38:22.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.696+0000 7f41a26989c0 1 Processor -- start 2024-09-10T05:38:22.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.696+0000 7f41a26989c0 1 -- start start 2024-09-10T05:38:22.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.696+0000 7f41a26989c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c12dbc8e80 0x55c12dbd0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.696+0000 7f41a26989c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c12dbca060 con 0x55c12dbc8e80 2024-09-10T05:38:22.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.696+0000 7f41a099f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c12dbc8e80 0x55c12dbd0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.696+0000 7f41a099f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c12dbc8e80 0x55c12dbd0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38626/0 (socket says 172.21.15.62:38626) 2024-09-10T05:38:22.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.696+0000 7f41a099f640 1 -- 172.21.15.62:0/3017252218 learned_addr learned my addr 172.21.15.62:0/3017252218 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:22.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.696+0000 7f41a099f640 1 -- 172.21.15.62:0/3017252218 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c12dbd07a0 con 0x55c12dbc8e80 2024-09-10T05:38:22.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.696+0000 7f41a099f640 1 --2- 172.21.15.62:0/3017252218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c12dbc8e80 0x55c12dbd0240 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x55c12dbc9d80 tx=0x7f4190003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.696+0000 7f4084ff9640 1 -- 172.21.15.62:0/3017252218 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4190013a70 con 0x55c12dbc8e80 2024-09-10T05:38:22.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.696+0000 7f4084ff9640 1 -- 172.21.15.62:0/3017252218 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4190023070 con 0x55c12dbc8e80 2024-09-10T05:38:22.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.696+0000 7f41a26989c0 1 -- 172.21.15.62:0/3017252218 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c12dbd0a30 con 0x55c12dbc8e80 2024-09-10T05:38:22.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.696+0000 7f4084ff9640 1 -- 172.21.15.62:0/3017252218 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4190013d80 con 0x55c12dbc8e80 2024-09-10T05:38:22.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.696+0000 7f41a26989c0 1 -- 172.21.15.62:0/3017252218 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c12dbd13e0 con 0x55c12dbc8e80 2024-09-10T05:38:22.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.700+0000 7f4084ff9640 1 -- 172.21.15.62:0/3017252218 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f4190028460 con 0x55c12dbc8e80 2024-09-10T05:38:22.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.700+0000 7f41a26989c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:38:22.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.700+0000 7f41a26989c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:38:22.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.700+0000 7f4084ff9640 1 --2- 172.21.15.62:0/3017252218 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4078039ac0 0x7f407803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.700+0000 7f41a26989c0 1 Processor -- start 2024-09-10T05:38:22.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.700+0000 7f4084ff9640 1 -- 172.21.15.62:0/3017252218 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7f41900505f0 con 0x55c12dbc8e80 2024-09-10T05:38:22.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.700+0000 7f41a099f640 1 --2- 172.21.15.62:0/3017252218 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4078039ac0 0x7f407803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.700+0000 7f41a26989c0 1 -- start start 2024-09-10T05:38:22.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.700+0000 7f41a26989c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c12dbe9910 0x55c12dbe9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.700+0000 7f41a26989c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c12dbb53c0 con 0x55c12dbe9910 2024-09-10T05:38:22.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.700+0000 7f41a099f640 1 --2- 172.21.15.62:0/3017252218 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4078039ac0 0x7f407803bf80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4190012fd0 tx=0x7f419001e7b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.700+0000 7f41a019e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c12dbe9910 0x55c12dbe9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.700+0000 7f41a019e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c12dbe9910 0x55c12dbe9d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38630/0 (socket says 172.21.15.62:38630) 2024-09-10T05:38:22.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.700+0000 7f41a019e640 1 -- 172.21.15.62:0/3356509939 learned_addr learned my addr 172.21.15.62:0/3356509939 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:22.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.700+0000 7f41a019e640 1 -- 172.21.15.62:0/3356509939 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c12dbea370 con 0x55c12dbe9910 2024-09-10T05:38:22.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.700+0000 7f41a019e640 1 --2- 172.21.15.62:0/3356509939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c12dbe9910 0x55c12dbe9d30 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f419804dcf0 tx=0x7f4198028e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.700+0000 7f40657e2640 1 -- 172.21.15.62:0/3356509939 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4198041070 con 0x55c12dbe9910 2024-09-10T05:38:22.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.700+0000 7f41a26989c0 1 -- 172.21.15.62:0/3356509939 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c12dbeab70 con 0x55c12dbe9910 2024-09-10T05:38:22.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.700+0000 7f40657e2640 1 -- 172.21.15.62:0/3356509939 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4198042040 con 0x55c12dbe9910 2024-09-10T05:38:22.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.700+0000 7f40657e2640 1 -- 172.21.15.62:0/3356509939 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4198011e80 con 0x55c12dbe9910 2024-09-10T05:38:22.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.700+0000 7f41a26989c0 1 -- 172.21.15.62:0/3356509939 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c12dbeb0e0 con 0x55c12dbe9910 2024-09-10T05:38:22.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.704+0000 7f40657e2640 1 -- 172.21.15.62:0/3356509939 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f419804fb70 con 0x55c12dbe9910 2024-09-10T05:38:22.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.704+0000 7f40657e2640 1 --2- 172.21.15.62:0/3356509939 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3fd8039a20 0x7f3fd803bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.704+0000 7f40657e2640 1 -- 172.21.15.62:0/3356509939 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7f4198022080 con 0x55c12dbe9910 2024-09-10T05:38:22.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.704+0000 7f419f99d640 1 --2- 172.21.15.62:0/3356509939 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3fd8039a20 0x7f3fd803bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.704+0000 7f405e7fc640 20 reqs_thread_entry: start 2024-09-10T05:38:22.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.704+0000 7f41a26989c0 1 --2- 172.21.15.62:0/3326171936 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55c12dbef800 0x55c12dbf1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.704+0000 7f41a26989c0 1 -- 172.21.15.62:0/3326171936 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c12dbf2130 con 0x55c12dbef800 2024-09-10T05:38:22.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.704+0000 7f419f99d640 1 --2- 172.21.15.62:0/3356509939 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3fd8039a20 0x7f3fd803bee0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f41880ad000 tx=0x7f41880a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.704+0000 7f41a099f640 1 --2- 172.21.15.62:0/3326171936 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55c12dbef800 0x55c12dbf1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.704+0000 7f41a099f640 1 --2- 172.21.15.62:0/3326171936 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55c12dbef800 0x55c12dbf1bf0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.704+0000 7f41a099f640 1 -- 172.21.15.62:0/3326171936 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4190012bc0 con 0x55c12dbef800 2024-09-10T05:38:22.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.704+0000 7f41a26989c0 1 --2- 172.21.15.62:0/3326171936 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55c12dbf2c60 0x55c12dbf5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.704+0000 7f41a26989c0 1 -- 172.21.15.62:0/3326171936 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c12dbf58a0 con 0x55c12dbf2c60 2024-09-10T05:38:22.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.704+0000 7f41a019e640 1 --2- 172.21.15.62:0/3326171936 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55c12dbf2c60 0x55c12dbf5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.704+0000 7f41a019e640 1 --2- 172.21.15.62:0/3326171936 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55c12dbf2c60 0x55c12dbf5120 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.704+0000 7f41a019e640 1 -- 172.21.15.62:0/3326171936 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4198058040 con 0x55c12dbf2c60 2024-09-10T05:38:22.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.704+0000 7f41a26989c0 1 --2- 172.21.15.62:0/3326171936 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55c12dbf7610 0x55c12dbf9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.704+0000 7f41a26989c0 1 -- 172.21.15.62:0/3326171936 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c12dbfa0d0 con 0x55c12dbf7610 2024-09-10T05:38:22.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.704+0000 7f419f99d640 1 --2- 172.21.15.62:0/3326171936 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55c12dbf7610 0x55c12dbf9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.708+0000 7f419f99d640 1 --2- 172.21.15.62:0/3326171936 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55c12dbf7610 0x55c12dbf9a00 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.708+0000 7f419f99d640 1 -- 172.21.15.62:0/3326171936 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f41880b3040 con 0x55c12dbf7610 2024-09-10T05:38:22.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.708+0000 7f41a26989c0 1 -- 172.21.15.62:0/3017252218 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4078039ac0 msgr2=0x7f407803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.708+0000 7f41a26989c0 1 --2- 172.21.15.62:0/3017252218 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4078039ac0 0x7f407803bf80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4190012fd0 tx=0x7f419001e7b0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.708+0000 7f41a26989c0 1 -- 172.21.15.62:0/3017252218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c12dbc8e80 msgr2=0x55c12dbd0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.708+0000 7f41a26989c0 1 --2- 172.21.15.62:0/3017252218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c12dbc8e80 0x55c12dbd0240 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x55c12dbc9d80 tx=0x7f4190003000 comp rx=0 tx=0).stop 2024-09-10T05:38:22.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.708+0000 7f41a26989c0 1 -- 172.21.15.62:0/3017252218 shutdown_connections 2024-09-10T05:38:22.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.708+0000 7f41a26989c0 1 --2- 172.21.15.62:0/3017252218 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4078039ac0 0x7f407803bf80 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.708+0000 7f41a26989c0 1 --2- 172.21.15.62:0/3017252218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c12dbc8e80 0x55c12dbd0240 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.708+0000 7f41a26989c0 1 -- 172.21.15.62:0/3017252218 >> 172.21.15.62:0/3017252218 conn(0x55c12dac4d80 msgr2=0x55c12dbc43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:22.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.708+0000 7f41a26989c0 1 -- 172.21.15.62:0/3017252218 shutdown_connections 2024-09-10T05:38:22.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.708+0000 7f41a26989c0 1 -- 172.21.15.62:0/3017252218 wait complete. 2024-09-10T05:38:22.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.708+0000 7f41a26989c0 1 -- 172.21.15.62:0/3356509939 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3fd8039a20 msgr2=0x7f3fd803bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.708+0000 7f41a26989c0 1 --2- 172.21.15.62:0/3356509939 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3fd8039a20 0x7f3fd803bee0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f41880ad000 tx=0x7f41880a5040 comp rx=0 tx=0).stop 2024-09-10T05:38:22.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.708+0000 7f41a26989c0 1 -- 172.21.15.62:0/3356509939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c12dbe9910 msgr2=0x55c12dbe9d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.708+0000 7f41a26989c0 1 --2- 172.21.15.62:0/3356509939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c12dbe9910 0x55c12dbe9d30 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f419804dcf0 tx=0x7f4198028e80 comp rx=0 tx=0).stop 2024-09-10T05:38:22.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.708+0000 7f41a26989c0 1 -- 172.21.15.62:0/3356509939 shutdown_connections 2024-09-10T05:38:22.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.708+0000 7f41a26989c0 1 --2- 172.21.15.62:0/3356509939 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f3fd8039a20 0x7f3fd803bee0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.708+0000 7f41a26989c0 1 --2- 172.21.15.62:0/3356509939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c12dbe9910 0x55c12dbe9d30 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.708+0000 7f41a26989c0 1 -- 172.21.15.62:0/3356509939 >> 172.21.15.62:0/3356509939 conn(0x55c12dbdef70 msgr2=0x55c12dbdf350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:22.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.708+0000 7f41a26989c0 1 -- 172.21.15.62:0/3356509939 shutdown_connections 2024-09-10T05:38:22.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.708+0000 7f41a26989c0 1 -- 172.21.15.62:0/3356509939 wait complete. 2024-09-10T05:38:22.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.708+0000 7f41a26989c0 1 -- 172.21.15.62:0/3326171936 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55c12dbf2c60 msgr2=0x55c12dbf5120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.708+0000 7f41a26989c0 1 --2- 172.21.15.62:0/3326171936 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55c12dbf2c60 0x55c12dbf5120 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.708+0000 7f41a26989c0 1 -- 172.21.15.62:0/3326171936 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55c12dbef800 msgr2=0x55c12dbf1bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.708+0000 7f41a26989c0 1 --2- 172.21.15.62:0/3326171936 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55c12dbef800 0x55c12dbf1bf0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.708+0000 7f41a26989c0 1 -- 172.21.15.62:0/3326171936 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55c12dbf7610 msgr2=0x55c12dbf9a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.708+0000 7f41a26989c0 1 --2- 172.21.15.62:0/3326171936 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55c12dbf7610 0x55c12dbf9a00 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.708+0000 7f41a26989c0 1 -- 172.21.15.62:0/3326171936 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4088039ac0 msgr2=0x7f408803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.708+0000 7f41a26989c0 1 --2- 172.21.15.62:0/3326171936 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4088039ac0 0x7f408803bf80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4198003fd0 tx=0x7f4198048040 comp rx=0 tx=0).stop 2024-09-10T05:38:22.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.708+0000 7f41a26989c0 1 -- 172.21.15.62:0/3326171936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c12dac1150 msgr2=0x55c12dbbc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.708+0000 7f41a26989c0 1 --2- 172.21.15.62:0/3326171936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c12dac1150 0x55c12dbbc260 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x55c12dbb48b0 tx=0x7f4198001260 comp rx=0 tx=0).stop 2024-09-10T05:38:22.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.708+0000 7f41a099f640 1 -- 172.21.15.62:0/3326171936 reap_dead start 2024-09-10T05:38:22.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.708+0000 7f41a26989c0 1 -- 172.21.15.62:0/3326171936 shutdown_connections 2024-09-10T05:38:22.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.708+0000 7f41a26989c0 1 -- 172.21.15.62:0/3326171936 >> 172.21.15.62:0/3326171936 conn(0x55c12dabd0a0 msgr2=0x55c12dbb5e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:22.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.708+0000 7f41a26989c0 1 -- 172.21.15.62:0/3326171936 shutdown_connections 2024-09-10T05:38:22.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.708+0000 7f41a26989c0 1 -- 172.21.15.62:0/3326171936 wait complete. 2024-09-10T05:38:22.723 INFO:teuthology.orchestra.run.smithi062.stdout:{"id":"1e560b55-359a-4aa1-8333-6dabf7061701","name":"default","api_name":"default","is_master":true,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"475ecc13-ad4b-423e-b7f2-f7f260e17071","zones":[{"id":"475ecc13-ad4b-423e-b7f2-f7f260e17071","name":"default","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]} 2024-09-10T05:38:22.723 DEBUG:tasks.util.rgw: json result: {'id': '1e560b55-359a-4aa1-8333-6dabf7061701', 'name': 'default', 'api_name': 'default', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': '475ecc13-ad4b-423e-b7f2-f7f260e17071', 'zones': [{'id': '475ecc13-ad4b-423e-b7f2-f7f260e17071', 'name': 'default', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['notification_v2', 'resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}, 'enabled_features': ['notification_v2', 'resharding']} 2024-09-10T05:38:22.726 INFO:teuthology.run_tasks:Running task radosgw-admin-rest... 2024-09-10T05:38:22.746 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-10T05:38:22.747 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-10T05:38:22.747 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid ada --display-name 'Ms. Admin User' --access-key MH1WC2XQ1S8UISFDZC8W --secret dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG --max-buckets 0 --caps 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write' 2024-09-10T05:38:22.815 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:38:22.815 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:38:22.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.812+0000 7ff15b1b99c0 1 Processor -- start 2024-09-10T05:38:22.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.812+0000 7ff15b1b99c0 1 -- start start 2024-09-10T05:38:22.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.812+0000 7ff15b1b99c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x560313c52560 0x560313ce66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.812+0000 7ff15b1b99c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560313b929c0 con 0x560313c52180 2024-09-10T05:38:22.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.812+0000 7ff15b1b99c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x560313be26d0 con 0x560313c52560 2024-09-10T05:38:22.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.812+0000 7ff1584be640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x560313c52560 0x560313ce66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.812+0000 7ff1584be640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x560313c52560 0x560313ce66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38638/0 (socket says 172.21.15.62:38638) 2024-09-10T05:38:22.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.812+0000 7ff158cbf640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x560313c52180 0x560313ce2fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:52084/0 (socket says 172.21.15.62:52084) 2024-09-10T05:38:22.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.812+0000 7ff1584be640 1 -- 172.21.15.62:0/2463155217 learned_addr learned my addr 172.21.15.62:0/2463155217 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:22.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.816+0000 7ff1584be640 1 -- 172.21.15.62:0/2463155217 >> v1:172.21.15.2:6789/0 conn(0x560313c52180 legacy=0x560313ce2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.816+0000 7ff1584be640 1 -- 172.21.15.62:0/2463155217 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560313b86ca0 con 0x560313c52560 2024-09-10T05:38:22.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.816+0000 7ff1584be640 1 --2- 172.21.15.62:0/2463155217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560313c52560 0x560313ce66e0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7ff14000a5c0 tx=0x7ff14001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a953ce90d5039dd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.816+0000 7ff157cbd640 1 -- 172.21.15.62:0/2463155217 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1400a6070 con 0x560313c52560 2024-09-10T05:38:22.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.816+0000 7ff157cbd640 1 -- 172.21.15.62:0/2463155217 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1400af070 con 0x560313c52560 2024-09-10T05:38:22.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.816+0000 7ff157cbd640 1 -- 172.21.15.62:0/2463155217 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1400aa5c0 con 0x560313c52560 2024-09-10T05:38:22.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.816+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/2463155217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560313c52560 msgr2=0x560313ce66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.816+0000 7ff15b1b99c0 1 --2- 172.21.15.62:0/2463155217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560313c52560 0x560313ce66e0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7ff14000a5c0 tx=0x7ff14001b340 comp rx=0 tx=0).stop 2024-09-10T05:38:22.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.816+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/2463155217 shutdown_connections 2024-09-10T05:38:22.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.816+0000 7ff15b1b99c0 1 --2- 172.21.15.62:0/2463155217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560313c52560 0x560313ce66e0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.816+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/2463155217 >> 172.21.15.62:0/2463155217 conn(0x560313cd88a0 msgr2=0x560313cdacc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:22.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.816+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/2463155217 shutdown_connections 2024-09-10T05:38:22.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.816+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/2463155217 wait complete. 2024-09-10T05:38:22.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.832+0000 7ff15b1b99c0 1 Processor -- start 2024-09-10T05:38:22.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.832+0000 7ff15b1b99c0 1 -- start start 2024-09-10T05:38:22.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.832+0000 7ff15b1b99c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560313c52180 0x560313dcba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.832+0000 7ff15b1b99c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560313be6680 con 0x560313c52180 2024-09-10T05:38:22.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.832+0000 7ff158cbf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560313c52180 0x560313dcba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.832+0000 7ff158cbf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560313c52180 0x560313dcba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38652/0 (socket says 172.21.15.62:38652) 2024-09-10T05:38:22.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.832+0000 7ff158cbf640 1 -- 172.21.15.62:0/50642287 learned_addr learned my addr 172.21.15.62:0/50642287 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:22.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.832+0000 7ff158cbf640 1 -- 172.21.15.62:0/50642287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560313b61da0 con 0x560313c52180 2024-09-10T05:38:22.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.832+0000 7ff158cbf640 1 --2- 172.21.15.62:0/50642287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560313c52180 0x560313dcba00 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7ff14800b270 tx=0x7ff14800b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b821ec0e959c71c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.832+0000 7ff045e1b640 1 -- 172.21.15.62:0/50642287 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff14800e5d0 con 0x560313c52180 2024-09-10T05:38:22.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.832+0000 7ff045e1b640 1 -- 172.21.15.62:0/50642287 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff14800e770 con 0x560313c52180 2024-09-10T05:38:22.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.832+0000 7ff045e1b640 1 -- 172.21.15.62:0/50642287 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff14800ea70 con 0x560313c52180 2024-09-10T05:38:22.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.836+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/50642287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560313c52180 msgr2=0x560313dcba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.836+0000 7ff15b1b99c0 1 --2- 172.21.15.62:0/50642287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560313c52180 0x560313dcba00 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7ff14800b270 tx=0x7ff14800b670 comp rx=0 tx=0).stop 2024-09-10T05:38:22.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.836+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/50642287 shutdown_connections 2024-09-10T05:38:22.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.836+0000 7ff15b1b99c0 1 --2- 172.21.15.62:0/50642287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560313c52180 0x560313dcba00 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.836+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/50642287 >> 172.21.15.62:0/50642287 conn(0x560313cd88a0 msgr2=0x560313dc7640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:22.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.836+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/50642287 shutdown_connections 2024-09-10T05:38:22.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.836+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/50642287 wait complete. 2024-09-10T05:38:22.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.836+0000 7ff15b1b99c0 1 Processor -- start 2024-09-10T05:38:22.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.836+0000 7ff15b1b99c0 1 -- start start 2024-09-10T05:38:22.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.836+0000 7ff15b1b99c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560313c52180 0x560313dd30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.836+0000 7ff15b1b99c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560313b88a50 con 0x560313c52180 2024-09-10T05:38:22.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.836+0000 7ff158cbf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560313c52180 0x560313dd30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.836+0000 7ff158cbf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560313c52180 0x560313dd30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38658/0 (socket says 172.21.15.62:38658) 2024-09-10T05:38:22.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.836+0000 7ff158cbf640 1 -- 172.21.15.62:0/3929300276 learned_addr learned my addr 172.21.15.62:0/3929300276 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:22.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.836+0000 7ff158cbf640 1 -- 172.21.15.62:0/3929300276 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560313dd3610 con 0x560313c52180 2024-09-10T05:38:22.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.836+0000 7ff158cbf640 1 --2- 172.21.15.62:0/3929300276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560313c52180 0x560313dd30b0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x560313dcc990 tx=0x7ff148000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.836+0000 7ff03ffff640 1 -- 172.21.15.62:0/3929300276 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff14800be70 con 0x560313c52180 2024-09-10T05:38:22.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.836+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3929300276 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560313dd38a0 con 0x560313c52180 2024-09-10T05:38:22.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.836+0000 7ff03ffff640 1 -- 172.21.15.62:0/3929300276 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff14800f9f0 con 0x560313c52180 2024-09-10T05:38:22.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.836+0000 7ff03ffff640 1 -- 172.21.15.62:0/3929300276 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff14800fcf0 con 0x560313c52180 2024-09-10T05:38:22.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.836+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3929300276 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560313dd4250 con 0x560313c52180 2024-09-10T05:38:22.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.840+0000 7ff03ffff640 1 -- 172.21.15.62:0/3929300276 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff148017070 con 0x560313c52180 2024-09-10T05:38:22.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.840+0000 7ff03ffff640 1 --2- 172.21.15.62:0/3929300276 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff040039a70 0x7ff04003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.840+0000 7ff03ffff640 1 -- 172.21.15.62:0/3929300276 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7ff148015020 con 0x560313c52180 2024-09-10T05:38:22.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.840+0000 7ff1584be640 1 --2- 172.21.15.62:0/3929300276 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff040039a70 0x7ff04003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.840+0000 7ff15b1b99c0 1 --2- 172.21.15.62:0/3929300276 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560313c52560 0x560313dda220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.840+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3929300276 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560313dda760 con 0x560313c52560 2024-09-10T05:38:22.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.840+0000 7ff1594c0640 1 --2- 172.21.15.62:0/3929300276 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560313c52560 0x560313dda220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.840+0000 7ff1584be640 1 --2- 172.21.15.62:0/3929300276 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff040039a70 0x7ff04003bf30 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff1400ae000 tx=0x7ff1400a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.840+0000 7ff1594c0640 1 --2- 172.21.15.62:0/3929300276 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560313c52560 0x560313dda220 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.840+0000 7ff1594c0640 1 -- 172.21.15.62:0/3929300276 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff15000a4d0 con 0x560313c52560 2024-09-10T05:38:22.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.840+0000 7ff15b1b99c0 1 --2- 172.21.15.62:0/3929300276 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x560313ddb510 0x560313ddd900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.840+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3929300276 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560313dddf10 con 0x560313ddb510 2024-09-10T05:38:22.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.840+0000 7ff158cbf640 1 --2- 172.21.15.62:0/3929300276 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x560313ddb510 0x560313ddd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.840+0000 7ff158cbf640 1 --2- 172.21.15.62:0/3929300276 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x560313ddb510 0x560313ddd900 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.840+0000 7ff158cbf640 1 -- 172.21.15.62:0/3929300276 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff14802e070 con 0x560313ddb510 2024-09-10T05:38:22.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.840+0000 7ff15b1b99c0 1 --2- 172.21.15.62:0/3929300276 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x560313ddfc80 0x560313de2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.840+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3929300276 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560313de2760 con 0x560313ddfc80 2024-09-10T05:38:22.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.840+0000 7ff1584be640 1 --2- 172.21.15.62:0/3929300276 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x560313ddfc80 0x560313de2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.840+0000 7ff1584be640 1 --2- 172.21.15.62:0/3929300276 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x560313ddfc80 0x560313de2070 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.844+0000 7ff1584be640 1 -- 172.21.15.62:0/3929300276 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv5 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff1400aaa70 con 0x560313ddfc80 2024-09-10T05:38:22.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.844+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3929300276 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560313ddeb20 con 0x560313ddb510 2024-09-10T05:38:22.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.844+0000 7ff158cbf640 1 -- 172.21.15.62:0/3929300276 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff14802e070 con 0x560313ddb510 2024-09-10T05:38:22.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.844+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3929300276 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560313ddefc0 con 0x560313ddfc80 2024-09-10T05:38:22.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.844+0000 7ff1584be640 1 -- 172.21.15.62:0/3929300276 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff1400aaa70 con 0x560313ddfc80 2024-09-10T05:38:22.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.844+0000 7ff15b1b99c0 1 Processor -- start 2024-09-10T05:38:22.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.844+0000 7ff15b1b99c0 1 -- start start 2024-09-10T05:38:22.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.844+0000 7ff15b1b99c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560313df0d90 0x560313df11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.844+0000 7ff15b1b99c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560313bf3450 con 0x560313df0d90 2024-09-10T05:38:22.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.844+0000 7ff158cbf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560313df0d90 0x560313df11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.844+0000 7ff158cbf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560313df0d90 0x560313df11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38664/0 (socket says 172.21.15.62:38664) 2024-09-10T05:38:22.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.844+0000 7ff158cbf640 1 -- 172.21.15.62:0/1581309132 learned_addr learned my addr 172.21.15.62:0/1581309132 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:22.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.844+0000 7ff158cbf640 1 -- 172.21.15.62:0/1581309132 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560313df17f0 con 0x560313df0d90 2024-09-10T05:38:22.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.844+0000 7ff158cbf640 1 --2- 172.21.15.62:0/1581309132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560313df0d90 0x560313df11b0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7ff148017aa0 tx=0x7ff148048dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.844+0000 7ff03d7fa640 1 -- 172.21.15.62:0/1581309132 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff14801a480 con 0x560313df0d90 2024-09-10T05:38:22.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.844+0000 7ff03d7fa640 1 -- 172.21.15.62:0/1581309132 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff14801a620 con 0x560313df0d90 2024-09-10T05:38:22.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.844+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/1581309132 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560313df17f0 con 0x560313df0d90 2024-09-10T05:38:22.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.844+0000 7ff03d7fa640 1 -- 172.21.15.62:0/1581309132 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff14801a900 con 0x560313df0d90 2024-09-10T05:38:22.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.844+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/1581309132 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560313df17f0 con 0x560313df0d90 2024-09-10T05:38:22.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.848+0000 7ff03d7fa640 1 -- 172.21.15.62:0/1581309132 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff1480420d0 con 0x560313df0d90 2024-09-10T05:38:22.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.848+0000 7ff03d7fa640 1 --2- 172.21.15.62:0/1581309132 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff030039a70 0x7ff03003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.848+0000 7ff03d7fa640 1 -- 172.21.15.62:0/1581309132 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7ff148053060 con 0x560313df0d90 2024-09-10T05:38:22.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.848+0000 7ff1584be640 1 --2- 172.21.15.62:0/1581309132 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff030039a70 0x7ff03003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.848+0000 7ff15b1b99c0 1 Processor -- start 2024-09-10T05:38:22.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.848+0000 7ff15b1b99c0 1 -- start start 2024-09-10T05:38:22.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.848+0000 7ff15b1b99c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560313dfd160 0x560313dfd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.848+0000 7ff15b1b99c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560313dcc250 con 0x560313dfd160 2024-09-10T05:38:22.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.848+0000 7ff1584be640 1 --2- 172.21.15.62:0/1581309132 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff030039a70 0x7ff03003bf30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x560313ddeaf0 tx=0x7ff140005ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.848+0000 7ff158cbf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560313dfd160 0x560313dfd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.848+0000 7ff158cbf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560313dfd160 0x560313dfd540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38666/0 (socket says 172.21.15.62:38666) 2024-09-10T05:38:22.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.848+0000 7ff158cbf640 1 -- 172.21.15.62:0/1910907467 learned_addr learned my addr 172.21.15.62:0/1910907467 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:22.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.848+0000 7ff158cbf640 1 -- 172.21.15.62:0/1910907467 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560313dfdb30 con 0x560313dfd160 2024-09-10T05:38:22.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.848+0000 7ff158cbf640 1 --2- 172.21.15.62:0/1910907467 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560313dfd160 0x560313dfd540 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7ff14803b9a0 tx=0x7ff14803cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb11e41e3aea5965 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.848+0000 7ff036ffd640 1 -- 172.21.15.62:0/1910907467 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff14805e020 con 0x560313dfd160 2024-09-10T05:38:22.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.848+0000 7ff036ffd640 1 -- 172.21.15.62:0/1910907467 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff148052020 con 0x560313dfd160 2024-09-10T05:38:22.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.848+0000 7ff036ffd640 1 -- 172.21.15.62:0/1910907467 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff14801dc90 con 0x560313dfd160 2024-09-10T05:38:22.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.848+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/1910907467 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560313dfd160 msgr2=0x560313dfd540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.848+0000 7ff15b1b99c0 1 --2- 172.21.15.62:0/1910907467 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560313dfd160 0x560313dfd540 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7ff14803b9a0 tx=0x7ff14803cb90 comp rx=0 tx=0).stop 2024-09-10T05:38:22.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.848+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/1910907467 shutdown_connections 2024-09-10T05:38:22.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.848+0000 7ff15b1b99c0 1 --2- 172.21.15.62:0/1910907467 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560313dfd160 0x560313dfd540 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.848+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/1910907467 >> 172.21.15.62:0/1910907467 conn(0x560313df95b0 msgr2=0x560313df77f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:22.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.848+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/1910907467 shutdown_connections 2024-09-10T05:38:22.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.848+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/1910907467 wait complete. 2024-09-10T05:38:22.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.848+0000 7ff15b1b99c0 1 Processor -- start 2024-09-10T05:38:22.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.848+0000 7ff15b1b99c0 1 -- start start 2024-09-10T05:38:22.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.852+0000 7ff15b1b99c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560313dfd160 0x560313e04440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.852+0000 7ff15b1b99c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560313dfdff0 con 0x560313dfd160 2024-09-10T05:38:22.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.852+0000 7ff158cbf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560313dfd160 0x560313e04440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.852+0000 7ff158cbf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560313dfd160 0x560313e04440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38682/0 (socket says 172.21.15.62:38682) 2024-09-10T05:38:22.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.852+0000 7ff158cbf640 1 -- 172.21.15.62:0/3669953593 learned_addr learned my addr 172.21.15.62:0/3669953593 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:22.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.852+0000 7ff158cbf640 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560313e049a0 con 0x560313dfd160 2024-09-10T05:38:22.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.852+0000 7ff158cbf640 1 --2- 172.21.15.62:0/3669953593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560313dfd160 0x560313e04440 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7ff14804e250 tx=0x7ff1480424c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.852+0000 7ff0357fa640 1 -- 172.21.15.62:0/3669953593 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff14801d7e0 con 0x560313dfd160 2024-09-10T05:38:22.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.852+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560313e049a0 con 0x560313dfd160 2024-09-10T05:38:22.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.852+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560313e049a0 con 0x560313dfd160 2024-09-10T05:38:22.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.852+0000 7ff0357fa640 1 -- 172.21.15.62:0/3669953593 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff148052040 con 0x560313dfd160 2024-09-10T05:38:22.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.852+0000 7ff0357fa640 1 -- 172.21.15.62:0/3669953593 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1480485b0 con 0x560313dfd160 2024-09-10T05:38:22.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.852+0000 7ff0357fa640 1 -- 172.21.15.62:0/3669953593 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff148061020 con 0x560313dfd160 2024-09-10T05:38:22.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.852+0000 7ff0357fa640 1 --2- 172.21.15.62:0/3669953593 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff020039a70 0x7ff02003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.852+0000 7ff0357fa640 1 -- 172.21.15.62:0/3669953593 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7ff148045150 con 0x560313dfd160 2024-09-10T05:38:22.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.852+0000 7ff15b1b99c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:22.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.852+0000 7ff1584be640 1 --2- 172.21.15.62:0/3669953593 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff020039a70 0x7ff02003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.852+0000 7ff15b1b99c0 1 --2- 172.21.15.62:0/3669953593 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560313e0f2c0 0x560313e11750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.852+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560313e11ea0 con 0x560313e0f2c0 2024-09-10T05:38:22.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.852+0000 7ff1594c0640 1 --2- 172.21.15.62:0/3669953593 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560313e0f2c0 0x560313e11750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.852+0000 7ff1584be640 1 --2- 172.21.15.62:0/3669953593 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff020039a70 0x7ff02003bf30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff140000c10 tx=0x7ff1400c1040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.852+0000 7ff1594c0640 1 --2- 172.21.15.62:0/3669953593 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560313e0f2c0 0x560313e11750 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.856+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff15000a4d0 con 0x560313e0f2c0 2024-09-10T05:38:22.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.856+0000 7ff15b1b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:22.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.856+0000 7ff15b1b99c0 20 realm 2024-09-10T05:38:22.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.856+0000 7ff15b1b99c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:22.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.856+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560313e0e650 con 0x560313e0f2c0 2024-09-10T05:38:22.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.856+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff15000a4d0 con 0x560313e0f2c0 2024-09-10T05:38:22.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.856+0000 7ff15b1b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:22.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.856+0000 7ff15b1b99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:38:22.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.856+0000 7ff15b1b99c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:22.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.856+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560313e12960 con 0x560313e0f2c0 2024-09-10T05:38:22.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.856+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff15000a4d0 con 0x560313e0f2c0 2024-09-10T05:38:22.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.856+0000 7ff15b1b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:22.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.856+0000 7ff15b1b99c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:22.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.856+0000 7ff15b1b99c0 1 --2- 172.21.15.62:0/3669953593 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x560313e13740 0x560313e15b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.856+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560313e16200 con 0x560313e13740 2024-09-10T05:38:22.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.856+0000 7ff158cbf640 1 --2- 172.21.15.62:0/3669953593 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x560313e13740 0x560313e15b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.856+0000 7ff158cbf640 1 --2- 172.21.15.62:0/3669953593 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x560313e13740 0x560313e15b30 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.856+0000 7ff158cbf640 1 -- 172.21.15.62:0/3669953593 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff148075020 con 0x560313e13740 2024-09-10T05:38:22.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.856+0000 7ff15b1b99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:38:22.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.856+0000 7ff15b1b99c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:22.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.856+0000 7ff15b1b99c0 1 --2- 172.21.15.62:0/3669953593 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x560313e16f60 0x560313e19370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.856+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560313e19b00 con 0x560313e16f60 2024-09-10T05:38:22.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.856+0000 7ff1584be640 1 --2- 172.21.15.62:0/3669953593 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x560313e16f60 0x560313e19370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.856+0000 7ff1584be640 1 --2- 172.21.15.62:0/3669953593 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x560313e16f60 0x560313e19370 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.856+0000 7ff1584be640 1 -- 172.21.15.62:0/3669953593 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv5 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff1400aaa70 con 0x560313e16f60 2024-09-10T05:38:22.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.856+0000 7ff15b1b99c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:38:22.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.856+0000 7ff15b1b99c0 20 searching for the correct realm 2024-09-10T05:38:22.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.856+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560313e1b3d0 con 0x560313e16f60 2024-09-10T05:38:22.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.856+0000 7ff1584be640 1 -- 172.21.15.62:0/3669953593 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1400aaa70 con 0x560313e16f60 2024-09-10T05:38:22.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.856+0000 7ff1584be640 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560313e1b3d0 con 0x560313e13740 2024-09-10T05:38:22.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.860+0000 7ff158cbf640 1 -- 172.21.15.62:0/3669953593 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff148075020 con 0x560313e13740 2024-09-10T05:38:22.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.860+0000 7ff158cbf640 1 --2- 172.21.15.62:0/3669953593 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7ff148063030 0x7ff148065440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:22.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.860+0000 7ff158cbf640 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560313e1b3d0 con 0x7ff148063030 2024-09-10T05:38:22.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.860+0000 7ff1594c0640 1 --2- 172.21.15.62:0/3669953593 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7ff148063030 0x7ff148065440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:22.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.860+0000 7ff1594c0640 1 --2- 172.21.15.62:0/3669953593 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7ff148063030 0x7ff148065440 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:22.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.860+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff15000a4d0 con 0x7ff148063030 2024-09-10T05:38:22.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.860+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560313e1b3d0 con 0x560313e0f2c0 2024-09-10T05:38:22.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.860+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff15000a4d0 con 0x560313e0f2c0 2024-09-10T05:38:22.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.860+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560313e1b3d0 con 0x560313e0f2c0 2024-09-10T05:38:22.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.860+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff15000a4d0 con 0x560313e0f2c0 2024-09-10T05:38:22.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.860+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560313e1b3d0 con 0x560313e16f60 2024-09-10T05:38:22.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.860+0000 7ff1584be640 1 -- 172.21.15.62:0/3669953593 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1400aaa70 con 0x560313e16f60 2024-09-10T05:38:22.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.860+0000 7ff1584be640 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560313e1b3d0 con 0x560313e0f2c0 2024-09-10T05:38:22.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.860+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff15000a4d0 con 0x560313e0f2c0 2024-09-10T05:38:22.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.860+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560313e1b3d0 con 0x560313e13740 2024-09-10T05:38:22.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.860+0000 7ff158cbf640 1 -- 172.21.15.62:0/3669953593 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff148075020 con 0x560313e13740 2024-09-10T05:38:22.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.860+0000 7ff158cbf640 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560313e1b3d0 con 0x560313e13740 2024-09-10T05:38:22.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.864+0000 7ff158cbf640 1 -- 172.21.15.62:0/3669953593 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff148075020 con 0x560313e13740 2024-09-10T05:38:22.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.864+0000 7ff158cbf640 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560313e1b3d0 con 0x560313e0f2c0 2024-09-10T05:38:22.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.864+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff15000a4d0 con 0x560313e0f2c0 2024-09-10T05:38:22.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.864+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560313e1b3d0 con 0x7ff148063030 2024-09-10T05:38:22.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.864+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff15000a4d0 con 0x7ff148063030 2024-09-10T05:38:22.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.864+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560313e1b3d0 con 0x560313e0f2c0 2024-09-10T05:38:22.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.864+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff15000a4d0 con 0x560313e0f2c0 2024-09-10T05:38:22.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.864+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560313e1b3d0 con 0x7ff148063030 2024-09-10T05:38:22.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.864+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff15000a4d0 con 0x7ff148063030 2024-09-10T05:38:22.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.864+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560313e1b3d0 con 0x560313e13740 2024-09-10T05:38:22.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.864+0000 7ff158cbf640 1 -- 172.21.15.62:0/3669953593 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff148075020 con 0x560313e13740 2024-09-10T05:38:22.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.864+0000 7ff158cbf640 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560313e1b3d0 con 0x560313e16f60 2024-09-10T05:38:22.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.864+0000 7ff1584be640 1 -- 172.21.15.62:0/3669953593 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1400aaa70 con 0x560313e16f60 2024-09-10T05:38:22.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.864+0000 7ff1584be640 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560313e1b3d0 con 0x560313e0f2c0 2024-09-10T05:38:22.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.864+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff15000a4d0 con 0x560313e0f2c0 2024-09-10T05:38:22.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.864+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560313e1b3d0 con 0x560313e13740 2024-09-10T05:38:22.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.864+0000 7ff158cbf640 1 -- 172.21.15.62:0/3669953593 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff148075020 con 0x560313e13740 2024-09-10T05:38:22.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.864+0000 7ff158cbf640 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560313e1b3d0 con 0x560313e16f60 2024-09-10T05:38:22.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.864+0000 7ff1584be640 1 -- 172.21.15.62:0/3669953593 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 34 out=170b] v34'5 uv5 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7ff1400aaa70 con 0x560313e16f60 2024-09-10T05:38:22.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.864+0000 7ff1584be640 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560313e1b3d0 con 0x560313e0f2c0 2024-09-10T05:38:22.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.864+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff15000a4d0 con 0x560313e0f2c0 2024-09-10T05:38:22.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.864+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560313e1b3d0 con 0x560313e0f2c0 2024-09-10T05:38:22.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.868+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff15000a4d0 con 0x560313e0f2c0 2024-09-10T05:38:22.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.868+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560313e1b3d0 con 0x560313e0f2c0 2024-09-10T05:38:22.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.868+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff15000a4d0 con 0x560313e0f2c0 2024-09-10T05:38:22.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.868+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560313e1b3d0 con 0x560313e16f60 2024-09-10T05:38:22.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.868+0000 7ff1584be640 1 -- 172.21.15.62:0/3669953593 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1400aaa70 con 0x560313e16f60 2024-09-10T05:38:22.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.868+0000 7ff1584be640 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560313e1b3d0 con 0x7ff148063030 2024-09-10T05:38:22.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.868+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff15000a4d0 con 0x7ff148063030 2024-09-10T05:38:22.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.868+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560313e1b3d0 con 0x560313e0f2c0 2024-09-10T05:38:22.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.868+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff15000a4d0 con 0x560313e0f2c0 2024-09-10T05:38:22.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.868+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560313e1b3d0 con 0x7ff148063030 2024-09-10T05:38:22.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.868+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff15000a4d0 con 0x7ff148063030 2024-09-10T05:38:22.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.868+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560313e1b3d0 con 0x560313e16f60 2024-09-10T05:38:22.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.868+0000 7ff1584be640 1 -- 172.21.15.62:0/3669953593 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1400aaa70 con 0x560313e16f60 2024-09-10T05:38:22.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.868+0000 7ff1584be640 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560313e1b3d0 con 0x7ff148063030 2024-09-10T05:38:22.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.868+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff15000a4d0 con 0x7ff148063030 2024-09-10T05:38:22.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.868+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560313e1b3d0 con 0x560313e13740 2024-09-10T05:38:22.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.868+0000 7ff158cbf640 1 -- 172.21.15.62:0/3669953593 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff148075020 con 0x560313e13740 2024-09-10T05:38:22.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.868+0000 7ff158cbf640 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560313e1b3d0 con 0x560313e13740 2024-09-10T05:38:22.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.868+0000 7ff158cbf640 1 -- 172.21.15.62:0/3669953593 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff148075020 con 0x560313e13740 2024-09-10T05:38:22.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.868+0000 7ff158cbf640 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560313e1b3d0 con 0x560313e16f60 2024-09-10T05:38:22.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.868+0000 7ff1584be640 1 -- 172.21.15.62:0/3669953593 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1400aaa70 con 0x560313e16f60 2024-09-10T05:38:22.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.868+0000 7ff1584be640 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560313e1b3d0 con 0x560313e13740 2024-09-10T05:38:22.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.872+0000 7ff158cbf640 1 -- 172.21.15.62:0/3669953593 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff148075020 con 0x560313e13740 2024-09-10T05:38:22.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.872+0000 7ff158cbf640 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560313e1b3d0 con 0x560313e13740 2024-09-10T05:38:22.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.872+0000 7ff158cbf640 1 -- 172.21.15.62:0/3669953593 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff148075020 con 0x560313e13740 2024-09-10T05:38:22.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.872+0000 7ff15b1b99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:38:22.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.872+0000 7ff15b1b99c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:38:22.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.872+0000 7ff15b1b99c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:38:22.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.872+0000 7ff15b1b99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:38:22.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.872+0000 7ff15b1b99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:38:22.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.872+0000 7ff15b1b99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:38:22.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.872+0000 7ff15b1b99c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:22.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.872+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560313e1a4c0 con 0x560313e0f2c0 2024-09-10T05:38:22.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.872+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff15000a4d0 con 0x560313e0f2c0 2024-09-10T05:38:22.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.872+0000 7ff15b1b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:22.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.872+0000 7ff15b1b99c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:22.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.872+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560313e1a100 con 0x560313e13740 2024-09-10T05:38:22.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.872+0000 7ff158cbf640 1 -- 172.21.15.62:0/3669953593 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff148075020 con 0x560313e13740 2024-09-10T05:38:22.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.872+0000 7ff15b1b99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:38:22.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.872+0000 7ff15b1b99c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:22.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.872+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560313e1ae20 con 0x560313e16f60 2024-09-10T05:38:22.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.872+0000 7ff1584be640 1 -- 172.21.15.62:0/3669953593 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff1400aaa70 con 0x560313e16f60 2024-09-10T05:38:22.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.872+0000 7ff15b1b99c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:38:22.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.872+0000 7ff15b1b99c0 20 zone default found 2024-09-10T05:38:22.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.872+0000 7ff15b1b99c0 4 Realm: () 2024-09-10T05:38:22.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.872+0000 7ff15b1b99c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:38:22.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.872+0000 7ff15b1b99c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:38:22.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.872+0000 7ff15b1b99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:38:22.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.872+0000 7ff15b1b99c0 20 zonegroup default 2024-09-10T05:38:22.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.872+0000 7ff15b1b99c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:22.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.872+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560313e1bcb0 con 0x7ff148063030 2024-09-10T05:38:22.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.872+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff15000a4d0 con 0x7ff148063030 2024-09-10T05:38:22.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.872+0000 7ff15b1b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:22.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.872+0000 7ff15b1b99c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:22.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.872+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560313e1def0 con 0x560313e16f60 2024-09-10T05:38:22.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.872+0000 7ff1584be640 1 -- 172.21.15.62:0/3669953593 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff1400aaa70 con 0x560313e16f60 2024-09-10T05:38:22.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.872+0000 7ff15b1b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:22.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.872+0000 7ff15b1b99c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:22.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.872+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560313e1e290 con 0x560313e16f60 2024-09-10T05:38:22.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.872+0000 7ff1584be640 1 -- 172.21.15.62:0/3669953593 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff1400aaa70 con 0x560313e16f60 2024-09-10T05:38:22.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.872+0000 7ff15b1b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:22.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.872+0000 7ff15b1b99c0 20 started sync module instance, tier type = 2024-09-10T05:38:22.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.872+0000 7ff15b1b99c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:38:22.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.872+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560313e1d330 con 0x560313e13740 2024-09-10T05:38:22.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.876+0000 7ff158cbf640 1 -- 172.21.15.62:0/3669953593 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff148075020 con 0x560313e13740 2024-09-10T05:38:22.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.876+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94571218458704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560313e1d330 con 0x560313e13740 2024-09-10T05:38:22.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.876+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560313e1eb80 con 0x560313e0f2c0 2024-09-10T05:38:22.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.876+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff15000a4d0 con 0x560313e0f2c0 2024-09-10T05:38:22.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.876+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94571218462256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560313e1f420 con 0x560313e0f2c0 2024-09-10T05:38:22.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.876+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560313e1fe60 con 0x560313e13740 2024-09-10T05:38:22.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.880+0000 7ff158cbf640 1 -- 172.21.15.62:0/3669953593 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94571218458704] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff148075020 con 0x560313e13740 2024-09-10T05:38:22.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.880+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94571218462256] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff15000a4d0 con 0x560313e0f2c0 2024-09-10T05:38:22.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.880+0000 7ff158cbf640 1 -- 172.21.15.62:0/3669953593 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff148075020 con 0x560313e13740 2024-09-10T05:38:22.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.880+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94571218467120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560313e1ef70 con 0x560313e13740 2024-09-10T05:38:22.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.880+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560313e20700 con 0x7ff148063030 2024-09-10T05:38:22.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.880+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff15000a4d0 con 0x7ff148063030 2024-09-10T05:38:22.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.880+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94571218469456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560313e1ef70 con 0x7ff148063030 2024-09-10T05:38:22.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.880+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560313e211a0 con 0x560313e13740 2024-09-10T05:38:22.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.880+0000 7ff158cbf640 1 -- 172.21.15.62:0/3669953593 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94571218467120] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff148075020 con 0x560313e13740 2024-09-10T05:38:22.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.884+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94571218469456] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff15000a4d0 con 0x7ff148063030 2024-09-10T05:38:22.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.884+0000 7ff158cbf640 1 -- 172.21.15.62:0/3669953593 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff148075020 con 0x560313e13740 2024-09-10T05:38:22.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.884+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94571218470512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560313e21160 con 0x560313e13740 2024-09-10T05:38:22.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.884+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560313e21590 con 0x560313e16f60 2024-09-10T05:38:22.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.884+0000 7ff1584be640 1 -- 172.21.15.62:0/3669953593 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1400aaa70 con 0x560313e16f60 2024-09-10T05:38:22.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.884+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94571218456192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560313e21590 con 0x560313e16f60 2024-09-10T05:38:22.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.884+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560313e22490 con 0x560313e16f60 2024-09-10T05:38:22.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.884+0000 7ff158cbf640 1 -- 172.21.15.62:0/3669953593 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94571218470512] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff148075020 con 0x560313e13740 2024-09-10T05:38:22.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.884+0000 7ff1584be640 1 -- 172.21.15.62:0/3669953593 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94571218456192] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1400aaa70 con 0x560313e16f60 2024-09-10T05:38:22.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.884+0000 7ff1584be640 1 -- 172.21.15.62:0/3669953593 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1400aaa70 con 0x560313e16f60 2024-09-10T05:38:22.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.888+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94571218475392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560313e21fa0 con 0x560313e16f60 2024-09-10T05:38:22.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.888+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560313e22d30 con 0x7ff148063030 2024-09-10T05:38:22.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.888+0000 7ff1584be640 1 -- 172.21.15.62:0/3669953593 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94571218475392] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1400aaa70 con 0x560313e16f60 2024-09-10T05:38:22.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.888+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff15000a4d0 con 0x7ff148063030 2024-09-10T05:38:22.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.888+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94571218472080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560313e21fa0 con 0x7ff148063030 2024-09-10T05:38:22.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.888+0000 7ff15b1b99c0 20 add_watcher() i=0 2024-09-10T05:38:22.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.888+0000 7ff15b1b99c0 20 add_watcher() i=1 2024-09-10T05:38:22.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.888+0000 7ff15b1b99c0 20 add_watcher() i=2 2024-09-10T05:38:22.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.888+0000 7ff15b1b99c0 20 add_watcher() i=3 2024-09-10T05:38:22.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.888+0000 7ff15b1b99c0 20 add_watcher() i=4 2024-09-10T05:38:22.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.888+0000 7ff15b1b99c0 20 add_watcher() i=5 2024-09-10T05:38:22.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.888+0000 7ff15b1b99c0 20 add_watcher() i=6 2024-09-10T05:38:22.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.888+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94571218472080] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff15000a4d0 con 0x7ff148063030 2024-09-10T05:38:22.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.888+0000 7ff15b1b99c0 20 add_watcher() i=7 2024-09-10T05:38:22.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.888+0000 7ff15b1b99c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:38:22.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.888+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560313e25d90 con 0x560313e0f2c0 2024-09-10T05:38:22.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.888+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff15000a4d0 con 0x560313e0f2c0 2024-09-10T05:38:22.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.888+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94571218479232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560313e23150 con 0x560313e0f2c0 2024-09-10T05:38:22.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.892+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94571218479232] v34'246 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff15000a4d0 con 0x560313e0f2c0 2024-09-10T05:38:22.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.892+0000 7ff00dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:38:22.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.892+0000 7ff15b1b99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:38:22.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.892+0000 7ff15b1b99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:38:22.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.892+0000 7ff15b1b99c0 5 note: GC not initialized 2024-09-10T05:38:22.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.892+0000 7ff00cfe1640 20 reqs_thread_entry: start 2024-09-10T05:38:22.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.892+0000 7ff15b1b99c0 20 init_complete bucket index max shards: 11 2024-09-10T05:38:22.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.892+0000 7ff15b1b99c0 20 Filter name: none 2024-09-10T05:38:22.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.892+0000 7fef867fc640 20 reqs_thread_entry: start 2024-09-10T05:38:22.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.892+0000 7ff15b1b99c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-10T05:38:22.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.892+0000 7ff15b1b99c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:22.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.892+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560313e49120 con 0x560313e0f2c0 2024-09-10T05:38:22.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.892+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(62 ada [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7ff15000a4d0 con 0x560313e0f2c0 2024-09-10T05:38:22.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.892+0000 7ff15b1b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:22.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.892+0000 7ff15b1b99c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x0 2024-09-10T05:38:22.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.892+0000 7ff15b1b99c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:38:22.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.892+0000 7ff15b1b99c0 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : miss 2024-09-10T05:38:22.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.892+0000 7ff15b1b99c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:22.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.892+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:63 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560313e477c0 con 0x560313e0f2c0 2024-09-10T05:38:22.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.892+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(63 MH1WC2XQ1S8UISFDZC8W [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7ff15000a4d0 con 0x560313e0f2c0 2024-09-10T05:38:22.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.892+0000 7ff15b1b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:22.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.892+0000 7ff15b1b99c0 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x0 2024-09-10T05:38:22.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.892+0000 7ff15b1b99c0 10 adding default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-10T05:38:22.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.892+0000 7ff15b1b99c0 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-10T05:38:22.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.892+0000 7ff15b1b99c0 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-10T05:38:22.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.892+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:64 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560313e48180 con 0x560313e0f2c0 2024-09-10T05:38:22.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.896+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(64 ada [delete,create,call,writefull 0~473] v34'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7ff15000a4d0 con 0x560313e0f2c0 2024-09-10T05:38:22.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.896+0000 7ff15b1b99c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T05:38:22.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.896+0000 7ff15b1b99c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:38:22.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.896+0000 7ff15b1b99c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-10T05:38:22.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.896+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94571218631648 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560313e4cbc0 con 0x560313e13740 2024-09-10T05:38:22.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.896+0000 7ff158cbf640 1 -- 172.21.15.62:0/3669953593 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== watch-notify(notify (1) cookie 94571218470512 notify 146028888107 ret 0) ==== 691+0+0 (crc 0 0 0) 0x7ff148037030 con 0x560313e13740 2024-09-10T05:38:22.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.896+0000 7ff036ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888107 cookie 94571218470512 notifier 4829 bl.length()=649 2024-09-10T05:38:22.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.896+0000 7ff158cbf640 1 -- 172.21.15.62:0/3669953593 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(65 notify.4 [notify cookie 94571218631648 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff148075020 con 0x560313e13740 2024-09-10T05:38:22.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.896+0000 7ff036ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T05:38:22.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.896+0000 7ff036ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:38:22.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.896+0000 7ff036ffd640 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7ff01c003eb0 con 0x560313e13740 2024-09-10T05:38:22.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.896+0000 7ff158cbf640 1 -- 172.21.15.62:0/3669953593 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== watch-notify(notify_complete (2) cookie 94571218631648 notify 146028888107 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560313dd4250 con 0x560313e13740 2024-09-10T05:38:22.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.896+0000 7ff158cbf640 1 -- 172.21.15.62:0/3669953593 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff148075020 con 0x560313e13740 2024-09-10T05:38:22.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.896+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:67 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560313e47be0 con 0x560313e0f2c0 2024-09-10T05:38:22.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.896+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(67 MH1WC2XQ1S8UISFDZC8W [delete,create,writefull 0~7] v34'20 uv20 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7ff15000a4d0 con 0x560313e0f2c0 2024-09-10T05:38:22.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.896+0000 7ff15b1b99c0 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-10T05:38:22.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.896+0000 7ff15b1b99c0 10 moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-10T05:38:22.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.896+0000 7ff15b1b99c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:MH1WC2XQ1S8UISFDZC8W, ofs0, ns] 2024-09-10T05:38:22.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.896+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94571218631568 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560313e4cfb0 con 0x560313e13740 2024-09-10T05:38:22.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.900+0000 7ff158cbf640 1 -- 172.21.15.62:0/3669953593 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== watch-notify(notify (1) cookie 94571218467120 notify 146028888108 ret 0) ==== 219+0+0 (crc 0 0 0) 0x560313dd4250 con 0x560313e13740 2024-09-10T05:38:22.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.900+0000 7ff036ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888108 cookie 94571218467120 notifier 4829 bl.length()=177 2024-09-10T05:38:22.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.900+0000 7ff158cbf640 1 -- 172.21.15.62:0/3669953593 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(68 notify.2 [notify cookie 94571218631568 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff148075020 con 0x560313e13740 2024-09-10T05:38:22.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.900+0000 7ff036ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-10T05:38:22.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.900+0000 7ff036ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-10T05:38:22.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.900+0000 7ff036ffd640 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7ff01c003eb0 con 0x560313e13740 2024-09-10T05:38:22.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.900+0000 7ff158cbf640 1 -- 172.21.15.62:0/3669953593 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== watch-notify(notify_complete (2) cookie 94571218631568 notify 146028888108 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560313dd38a0 con 0x560313e13740 2024-09-10T05:38:22.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.900+0000 7ff158cbf640 1 -- 172.21.15.62:0/3669953593 <== osd.0 v2:172.21.15.2:6800/945139080 25 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff148075020 con 0x560313e13740 2024-09-10T05:38:22.904 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-10T05:38:22.896781Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:38:22.896764Z","tags":[],"group_ids":[]} 2024-09-10T05:38:22.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.900+0000 7ff00dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:38:22.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.900+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94571218479232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560313e46ed0 con 0x560313e0f2c0 2024-09-10T05:38:22.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.904+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 <== osd.1 v2:172.21.15.62:6808/3442097179 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94571218479232] v34'247 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff15000a4d0 con 0x560313e0f2c0 2024-09-10T05:38:22.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.904+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94571218458704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560313e46ed0 con 0x560313e13740 2024-09-10T05:38:22.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.904+0000 7ff158cbf640 1 -- 172.21.15.62:0/3669953593 <== osd.0 v2:172.21.15.2:6800/945139080 26 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94571218458704] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff148075020 con 0x560313e13740 2024-09-10T05:38:22.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.904+0000 7ff15b1b99c0 20 remove_watcher() i=0 2024-09-10T05:38:22.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.904+0000 7ff15b1b99c0 2 removed watcher, disabling cache 2024-09-10T05:38:22.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.904+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94571218462256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560313e46ed0 con 0x560313e0f2c0 2024-09-10T05:38:22.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.904+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 <== osd.1 v2:172.21.15.62:6808/3442097179 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94571218462256] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff15000a4d0 con 0x560313e0f2c0 2024-09-10T05:38:22.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.908+0000 7ff15b1b99c0 20 remove_watcher() i=1 2024-09-10T05:38:22.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.908+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94571218467120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560313e46ed0 con 0x560313e13740 2024-09-10T05:38:22.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.908+0000 7ff158cbf640 1 -- 172.21.15.62:0/3669953593 <== osd.0 v2:172.21.15.2:6800/945139080 27 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94571218467120] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff148075020 con 0x560313e13740 2024-09-10T05:38:22.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.908+0000 7ff15b1b99c0 20 remove_watcher() i=2 2024-09-10T05:38:22.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.908+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94571218469456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560313e46ed0 con 0x7ff148063030 2024-09-10T05:38:22.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.908+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94571218469456] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff15000a4d0 con 0x7ff148063030 2024-09-10T05:38:22.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.908+0000 7ff15b1b99c0 20 remove_watcher() i=3 2024-09-10T05:38:22.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.908+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94571218470512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560313e46ed0 con 0x560313e13740 2024-09-10T05:38:22.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.912+0000 7ff158cbf640 1 -- 172.21.15.62:0/3669953593 <== osd.0 v2:172.21.15.2:6800/945139080 28 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94571218470512] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff148075020 con 0x560313e13740 2024-09-10T05:38:22.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.912+0000 7ff15b1b99c0 20 remove_watcher() i=4 2024-09-10T05:38:22.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.912+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94571218456192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560313e46ed0 con 0x560313e16f60 2024-09-10T05:38:22.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.912+0000 7ff1584be640 1 -- 172.21.15.62:0/3669953593 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94571218456192] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1400aaa70 con 0x560313e16f60 2024-09-10T05:38:22.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.912+0000 7ff15b1b99c0 20 remove_watcher() i=5 2024-09-10T05:38:22.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.912+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94571218475392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560313e46ed0 con 0x560313e16f60 2024-09-10T05:38:22.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.916+0000 7ff1584be640 1 -- 172.21.15.62:0/3669953593 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94571218475392] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1400aaa70 con 0x560313e16f60 2024-09-10T05:38:22.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.916+0000 7ff15b1b99c0 20 remove_watcher() i=6 2024-09-10T05:38:22.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.916+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94571218472080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560313e46ed0 con 0x7ff148063030 2024-09-10T05:38:22.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.916+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94571218472080] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff15000a4d0 con 0x7ff148063030 2024-09-10T05:38:22.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.916+0000 7ff15b1b99c0 20 remove_watcher() i=7 2024-09-10T05:38:22.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.916+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x560313e13740 msgr2=0x560313e15b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.916+0000 7ff15b1b99c0 1 --2- 172.21.15.62:0/3669953593 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x560313e13740 0x560313e15b30 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.916+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560313e0f2c0 msgr2=0x560313e11750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.916+0000 7ff15b1b99c0 1 --2- 172.21.15.62:0/3669953593 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560313e0f2c0 0x560313e11750 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.916+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7ff148063030 msgr2=0x7ff148065440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.916+0000 7ff15b1b99c0 1 --2- 172.21.15.62:0/3669953593 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7ff148063030 0x7ff148065440 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.916+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x560313e16f60 msgr2=0x560313e19370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.916+0000 7ff15b1b99c0 1 --2- 172.21.15.62:0/3669953593 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x560313e16f60 0x560313e19370 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.916+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff020039a70 msgr2=0x7ff02003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.916+0000 7ff15b1b99c0 1 --2- 172.21.15.62:0/3669953593 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff020039a70 0x7ff02003bf30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff140000c10 tx=0x7ff1400c1040 comp rx=0 tx=0).stop 2024-09-10T05:38:22.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.916+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560313dfd160 msgr2=0x560313e04440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.916+0000 7ff1594c0640 1 -- 172.21.15.62:0/3669953593 reap_dead start 2024-09-10T05:38:22.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.916+0000 7ff15b1b99c0 1 --2- 172.21.15.62:0/3669953593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560313dfd160 0x560313e04440 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7ff14804e250 tx=0x7ff1480424c0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.916+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 shutdown_connections 2024-09-10T05:38:22.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.916+0000 7ff15b1b99c0 1 --2- 172.21.15.62:0/3669953593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560313dfd160 0x560313e04440 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.916+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 >> 172.21.15.62:0/3669953593 conn(0x560313df95b0 msgr2=0x560313df77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:22.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.916+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 shutdown_connections 2024-09-10T05:38:22.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.916+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3669953593 wait complete. 2024-09-10T05:38:22.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.916+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/1581309132 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff030039a70 msgr2=0x7ff03003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.916+0000 7ff15b1b99c0 1 --2- 172.21.15.62:0/1581309132 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff030039a70 0x7ff03003bf30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x560313ddeaf0 tx=0x7ff140005ad0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.916+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/1581309132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560313df0d90 msgr2=0x560313df11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.916+0000 7ff15b1b99c0 1 --2- 172.21.15.62:0/1581309132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560313df0d90 0x560313df11b0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7ff148017aa0 tx=0x7ff148048dd0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.916+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/1581309132 shutdown_connections 2024-09-10T05:38:22.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.916+0000 7ff15b1b99c0 1 --2- 172.21.15.62:0/1581309132 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff030039a70 0x7ff03003bf30 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.916+0000 7ff15b1b99c0 1 --2- 172.21.15.62:0/1581309132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560313df0d90 0x560313df11b0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.916+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/1581309132 >> 172.21.15.62:0/1581309132 conn(0x560313de6740 msgr2=0x560313de6b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:22.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.916+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/1581309132 shutdown_connections 2024-09-10T05:38:22.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.916+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/1581309132 wait complete. 2024-09-10T05:38:22.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.916+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3929300276 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x560313ddb510 msgr2=0x560313ddd900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.916+0000 7ff15b1b99c0 1 --2- 172.21.15.62:0/3929300276 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x560313ddb510 0x560313ddd900 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.916+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3929300276 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560313c52560 msgr2=0x560313dda220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.916+0000 7ff15b1b99c0 1 --2- 172.21.15.62:0/3929300276 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560313c52560 0x560313dda220 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.916+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3929300276 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x560313ddfc80 msgr2=0x560313de2070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.916+0000 7ff15b1b99c0 1 --2- 172.21.15.62:0/3929300276 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x560313ddfc80 0x560313de2070 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.916+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3929300276 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff040039a70 msgr2=0x7ff04003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.916+0000 7ff15b1b99c0 1 --2- 172.21.15.62:0/3929300276 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7ff040039a70 0x7ff04003bf30 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff1400ae000 tx=0x7ff1400a6000 comp rx=0 tx=0).stop 2024-09-10T05:38:22.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.916+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3929300276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560313c52180 msgr2=0x560313dd30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:22.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.916+0000 7ff15b1b99c0 1 --2- 172.21.15.62:0/3929300276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560313c52180 0x560313dd30b0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x560313dcc990 tx=0x7ff148000ee0 comp rx=0 tx=0).stop 2024-09-10T05:38:22.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.916+0000 7ff1594c0640 1 -- 172.21.15.62:0/3929300276 reap_dead start 2024-09-10T05:38:22.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.916+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3929300276 shutdown_connections 2024-09-10T05:38:22.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.916+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3929300276 >> 172.21.15.62:0/3929300276 conn(0x560313cd88a0 msgr2=0x560313dc60d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:22.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.916+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3929300276 shutdown_connections 2024-09-10T05:38:22.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:22.916+0000 7ff15b1b99c0 1 -- 172.21.15.62:0/3929300276 wait complete. 2024-09-10T05:38:22.932 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T05:38:22.896781Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:38:22.896764Z', 'tags': [], 'group_ids': []} 2024-09-10T05:38:22.932 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T05:38:22.896781Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:38:22.896764Z', 'tags': [], 'group_ids': []} 2024-09-10T05:38:22.932 ERROR:root:0 2024-09-10T05:38:22.933 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T05:38:22.939 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx000009bb17d25d45b0a3a-0066dfdb4e-4227-default', 'HostId': '4227-default-default'} 2024-09-10T05:38:22.940 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'foo', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '4'} 2024-09-10T05:38:22.953 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T05:38:22.953 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 0} 2024-09-10T05:38:22.970 INFO:tasks.radosgw_admin_rest: json result: {'keys': [], 'truncated': True, 'count': 0, 'marker': '8:1e6ca5ed:users.uid::foo:head'} 2024-09-10T05:38:22.970 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1} 2024-09-10T05:38:22.991 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['foo'], 'truncated': True, 'count': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-10T05:38:22.991 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-10T05:38:23.004 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['ada'], 'truncated': False, 'count': 1} 2024-09-10T05:38:23.005 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T05:38:23.009 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T05:38:23.010 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'access-key': '9te6NH5mcdcq0Tc5i8i1', 'uid': 'uid_not_exist'} 2024-09-10T05:38:23.014 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T05:38:23.014 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-10T05:38:23.014 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-10T05:38:23.015 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write' 2024-09-10T05:38:23.056 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:38:23.056 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:38:23.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.052+0000 7f7a8791b9c0 1 Processor -- start 2024-09-10T05:38:23.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.052+0000 7f7a8791b9c0 1 -- start start 2024-09-10T05:38:23.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.052+0000 7f7a8791b9c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55c9afbd3340 0x55c9afbd5730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.052+0000 7f7a8791b9c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c9afa839c0 con 0x55c9afb431f0 2024-09-10T05:38:23.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.052+0000 7f7a8791b9c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x55c9afad36d0 con 0x55c9afbd3340 2024-09-10T05:38:23.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.056+0000 7f7a84c20640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55c9afbd3340 0x55c9afbd5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.056+0000 7f7a84c20640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55c9afbd3340 0x55c9afbd5730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38684/0 (socket says 172.21.15.62:38684) 2024-09-10T05:38:23.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.056+0000 7f7a84c20640 1 -- 172.21.15.62:0/1002600772 learned_addr learned my addr 172.21.15.62:0/1002600772 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:23.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.056+0000 7f7a85421640 1 --1- 172.21.15.62:0/1002600772 >> v1:172.21.15.2:6789/0 conn(0x55c9afb431f0 0x55c9afbd1c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:52096/0 (socket says 172.21.15.62:52096) 2024-09-10T05:38:23.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.056+0000 7f7a84c20640 1 -- 172.21.15.62:0/1002600772 >> v1:172.21.15.2:6789/0 conn(0x55c9afb431f0 legacy=0x55c9afbd1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.056+0000 7f7a84c20640 1 -- 172.21.15.62:0/1002600772 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9afa77ca0 con 0x55c9afbd3340 2024-09-10T05:38:23.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.056+0000 7f7a84c20640 1 --2- 172.21.15.62:0/1002600772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9afbd3340 0x55c9afbd5730 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c00a5c0 tx=0x7f7a7c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b3e6e565284934a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.056+0000 7f7a77fff640 1 -- 172.21.15.62:0/1002600772 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a7c0b1070 con 0x55c9afbd3340 2024-09-10T05:38:23.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.056+0000 7f7a77fff640 1 -- 172.21.15.62:0/1002600772 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a7c0a8070 con 0x55c9afbd3340 2024-09-10T05:38:23.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.056+0000 7f7a77fff640 1 -- 172.21.15.62:0/1002600772 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a7c0ac5b0 con 0x55c9afbd3340 2024-09-10T05:38:23.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.060+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1002600772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9afbd3340 msgr2=0x55c9afbd5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.060+0000 7f7a8791b9c0 1 --2- 172.21.15.62:0/1002600772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9afbd3340 0x55c9afbd5730 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c00a5c0 tx=0x7f7a7c01b340 comp rx=0 tx=0).stop 2024-09-10T05:38:23.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.060+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1002600772 shutdown_connections 2024-09-10T05:38:23.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.060+0000 7f7a8791b9c0 1 --2- 172.21.15.62:0/1002600772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9afbd3340 0x55c9afbd5730 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.060+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1002600772 >> 172.21.15.62:0/1002600772 conn(0x55c9afbc9910 msgr2=0x55c9afbcbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:23.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.060+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1002600772 shutdown_connections 2024-09-10T05:38:23.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.060+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1002600772 wait complete. 2024-09-10T05:38:23.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.076+0000 7f7a8791b9c0 1 Processor -- start 2024-09-10T05:38:23.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.076+0000 7f7a8791b9c0 1 -- start start 2024-09-10T05:38:23.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.076+0000 7f7a8791b9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9afb431f0 0x55c9afcba850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.076+0000 7f7a8791b9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c9afad7680 con 0x55c9afb431f0 2024-09-10T05:38:23.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.076+0000 7f7a85421640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9afb431f0 0x55c9afcba850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.076+0000 7f7a85421640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9afb431f0 0x55c9afcba850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38698/0 (socket says 172.21.15.62:38698) 2024-09-10T05:38:23.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.076+0000 7f7a85421640 1 -- 172.21.15.62:0/3825902193 learned_addr learned my addr 172.21.15.62:0/3825902193 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:23.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.076+0000 7f7a85421640 1 -- 172.21.15.62:0/3825902193 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9afa52da0 con 0x55c9afb431f0 2024-09-10T05:38:23.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.076+0000 7f7a85421640 1 --2- 172.21.15.62:0/3825902193 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9afb431f0 0x55c9afcba850 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f7a780016f0 tx=0x7f7a78001bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a734836a34761af server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.076+0000 7f7973606640 1 -- 172.21.15.62:0/3825902193 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a78003460 con 0x55c9afb431f0 2024-09-10T05:38:23.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.076+0000 7f7973606640 1 -- 172.21.15.62:0/3825902193 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a78003620 con 0x55c9afb431f0 2024-09-10T05:38:23.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.076+0000 7f7973606640 1 -- 172.21.15.62:0/3825902193 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a78003940 con 0x55c9afb431f0 2024-09-10T05:38:23.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.076+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/3825902193 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9afb431f0 msgr2=0x55c9afcba850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.076+0000 7f7a8791b9c0 1 --2- 172.21.15.62:0/3825902193 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9afb431f0 0x55c9afcba850 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f7a780016f0 tx=0x7f7a78001bb0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.076+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/3825902193 shutdown_connections 2024-09-10T05:38:23.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.076+0000 7f7a8791b9c0 1 --2- 172.21.15.62:0/3825902193 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9afb431f0 0x55c9afcba850 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.076+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/3825902193 >> 172.21.15.62:0/3825902193 conn(0x55c9afbc9910 msgr2=0x55c9afcb6490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:23.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.076+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/3825902193 shutdown_connections 2024-09-10T05:38:23.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.076+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/3825902193 wait complete. 2024-09-10T05:38:23.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.080+0000 7f7a8791b9c0 1 Processor -- start 2024-09-10T05:38:23.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.080+0000 7f7a8791b9c0 1 -- start start 2024-09-10T05:38:23.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.080+0000 7f7a8791b9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9afb431f0 0x55c9afcc1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.080+0000 7f7a8791b9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c9afa79a50 con 0x55c9afb431f0 2024-09-10T05:38:23.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.080+0000 7f7a85421640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9afb431f0 0x55c9afcc1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.080+0000 7f7a85421640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9afb431f0 0x55c9afcc1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38704/0 (socket says 172.21.15.62:38704) 2024-09-10T05:38:23.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.080+0000 7f7a85421640 1 -- 172.21.15.62:0/394292223 learned_addr learned my addr 172.21.15.62:0/394292223 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:23.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.080+0000 7f7a85421640 1 -- 172.21.15.62:0/394292223 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9afcc2420 con 0x55c9afb431f0 2024-09-10T05:38:23.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.080+0000 7f7a85421640 1 --2- 172.21.15.62:0/394292223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9afb431f0 0x55c9afcc1ec0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x55c9afcbb7e0 tx=0x7f7a78001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.080+0000 7f7971e03640 1 -- 172.21.15.62:0/394292223 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a78022020 con 0x55c9afb431f0 2024-09-10T05:38:23.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.080+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/394292223 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c9afcc26b0 con 0x55c9afb431f0 2024-09-10T05:38:23.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.080+0000 7f7971e03640 1 -- 172.21.15.62:0/394292223 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a7801e480 con 0x55c9afb431f0 2024-09-10T05:38:23.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.080+0000 7f7971e03640 1 -- 172.21.15.62:0/394292223 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a7801e760 con 0x55c9afb431f0 2024-09-10T05:38:23.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.080+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/394292223 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9afcc30e0 con 0x55c9afb431f0 2024-09-10T05:38:23.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.080+0000 7f7971e03640 1 -- 172.21.15.62:0/394292223 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f7a78025020 con 0x55c9afb431f0 2024-09-10T05:38:23.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.080+0000 7f7971e03640 1 --2- 172.21.15.62:0/394292223 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f796c039a70 0x7f796c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.080+0000 7f7971e03640 1 -- 172.21.15.62:0/394292223 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7f7a780500b0 con 0x55c9afb431f0 2024-09-10T05:38:23.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.080+0000 7f7a84c20640 1 --2- 172.21.15.62:0/394292223 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f796c039a70 0x7f796c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.084+0000 7f7a8791b9c0 1 --2- 172.21.15.62:0/394292223 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55c9afbd3340 0x55c9afcc9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.084+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/394292223 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9afcc9570 con 0x55c9afbd3340 2024-09-10T05:38:23.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.084+0000 7f7a85c22640 1 --2- 172.21.15.62:0/394292223 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55c9afbd3340 0x55c9afcc9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.084+0000 7f7a84c20640 1 --2- 172.21.15.62:0/394292223 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f796c039a70 0x7f796c03bf30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c0ae000 tx=0x7f7a7c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.084+0000 7f7a85c22640 1 --2- 172.21.15.62:0/394292223 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55c9afbd3340 0x55c9afcc9030 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.084+0000 7f7a85c22640 1 -- 172.21.15.62:0/394292223 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7a800083f0 con 0x55c9afbd3340 2024-09-10T05:38:23.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.084+0000 7f7a8791b9c0 1 --2- 172.21.15.62:0/394292223 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55c9afcca2d0 0x55c9afccc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.084+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/394292223 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9afccccb0 con 0x55c9afcca2d0 2024-09-10T05:38:23.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.084+0000 7f7a85421640 1 --2- 172.21.15.62:0/394292223 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55c9afcca2d0 0x55c9afccc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.084+0000 7f7a85421640 1 --2- 172.21.15.62:0/394292223 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55c9afcca2d0 0x55c9afccc6c0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.084+0000 7f7a85421640 1 -- 172.21.15.62:0/394292223 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7a7801b040 con 0x55c9afcca2d0 2024-09-10T05:38:23.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.084+0000 7f7a8791b9c0 1 --2- 172.21.15.62:0/394292223 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55c9afccea70 0x55c9afcd0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.084+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/394292223 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9afcd1550 con 0x55c9afccea70 2024-09-10T05:38:23.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.084+0000 7f7a84c20640 1 --2- 172.21.15.62:0/394292223 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55c9afccea70 0x55c9afcd0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.084+0000 7f7a84c20640 1 --2- 172.21.15.62:0/394292223 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55c9afccea70 0x55c9afcd0e60 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.084+0000 7f7a84c20640 1 -- 172.21.15.62:0/394292223 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv5 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7a7c0b4040 con 0x55c9afccea70 2024-09-10T05:38:23.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.084+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/394292223 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9afccd910 con 0x55c9afcca2d0 2024-09-10T05:38:23.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.088+0000 7f7a85421640 1 -- 172.21.15.62:0/394292223 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7a7801b040 con 0x55c9afcca2d0 2024-09-10T05:38:23.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.088+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/394292223 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9afccddb0 con 0x55c9afccea70 2024-09-10T05:38:23.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.088+0000 7f7a84c20640 1 -- 172.21.15.62:0/394292223 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7a7c0b4040 con 0x55c9afccea70 2024-09-10T05:38:23.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.088+0000 7f7a8791b9c0 1 Processor -- start 2024-09-10T05:38:23.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.088+0000 7f7a8791b9c0 1 -- start start 2024-09-10T05:38:23.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.088+0000 7f7a8791b9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9afcdfb80 0x55c9afcdffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.088+0000 7f7a8791b9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c9afae4450 con 0x55c9afcdfb80 2024-09-10T05:38:23.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.088+0000 7f7a85421640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9afcdfb80 0x55c9afcdffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.088+0000 7f7a85421640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9afcdfb80 0x55c9afcdffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38714/0 (socket says 172.21.15.62:38714) 2024-09-10T05:38:23.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.088+0000 7f7a85421640 1 -- 172.21.15.62:0/855692767 learned_addr learned my addr 172.21.15.62:0/855692767 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:23.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.088+0000 7f7a85421640 1 -- 172.21.15.62:0/855692767 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9afce05e0 con 0x55c9afcdfb80 2024-09-10T05:38:23.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.088+0000 7f7a85421640 1 --2- 172.21.15.62:0/855692767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9afcdfb80 0x55c9afcdffa0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f7a780064a0 tx=0x7f7a78047b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.088+0000 7f796affd640 1 -- 172.21.15.62:0/855692767 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a7801eae0 con 0x55c9afcdfb80 2024-09-10T05:38:23.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.088+0000 7f796affd640 1 -- 172.21.15.62:0/855692767 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a78035070 con 0x55c9afcdfb80 2024-09-10T05:38:23.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.088+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/855692767 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c9afce0e40 con 0x55c9afcdfb80 2024-09-10T05:38:23.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.088+0000 7f796affd640 1 -- 172.21.15.62:0/855692767 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a7801edf0 con 0x55c9afcdfb80 2024-09-10T05:38:23.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.088+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/855692767 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9afce13b0 con 0x55c9afcdfb80 2024-09-10T05:38:23.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.092+0000 7f796affd640 1 -- 172.21.15.62:0/855692767 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f7a78037020 con 0x55c9afcdfb80 2024-09-10T05:38:23.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.092+0000 7f796affd640 1 --2- 172.21.15.62:0/855692767 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f795c039a20 0x7f795c03bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.092+0000 7f796affd640 1 -- 172.21.15.62:0/855692767 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7f7a7803ac00 con 0x55c9afcdfb80 2024-09-10T05:38:23.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.092+0000 7f7a84c20640 1 --2- 172.21.15.62:0/855692767 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f795c039a20 0x7f795c03bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.092+0000 7f7a8791b9c0 1 Processor -- start 2024-09-10T05:38:23.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.092+0000 7f7a8791b9c0 1 -- start start 2024-09-10T05:38:23.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.092+0000 7f7a8791b9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9afcec2e0 0x55c9afcec6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.092+0000 7f7a84c20640 1 --2- 172.21.15.62:0/855692767 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f795c039a20 0x7f795c03bee0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x55c9afccd8e0 tx=0x7f7a7c005ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.092+0000 7f7a8791b9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c9afcbb040 con 0x55c9afcec2e0 2024-09-10T05:38:23.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.092+0000 7f7a85421640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9afcec2e0 0x55c9afcec6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.092+0000 7f7a85421640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9afcec2e0 0x55c9afcec6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38716/0 (socket says 172.21.15.62:38716) 2024-09-10T05:38:23.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.092+0000 7f7a85421640 1 -- 172.21.15.62:0/2905419277 learned_addr learned my addr 172.21.15.62:0/2905419277 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:23.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.092+0000 7f7a85421640 1 -- 172.21.15.62:0/2905419277 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9afcecc90 con 0x55c9afcec2e0 2024-09-10T05:38:23.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.092+0000 7f7a85421640 1 --2- 172.21.15.62:0/2905419277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9afcec2e0 0x55c9afcec6c0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f7a780036b0 tx=0x7f7a78011e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c37133b96c33f770 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.092+0000 7f7968ff9640 1 -- 172.21.15.62:0/2905419277 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a780413a0 con 0x55c9afcec2e0 2024-09-10T05:38:23.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.092+0000 7f7968ff9640 1 -- 172.21.15.62:0/2905419277 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a78060070 con 0x55c9afcec2e0 2024-09-10T05:38:23.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.092+0000 7f7968ff9640 1 -- 172.21.15.62:0/2905419277 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a78026810 con 0x55c9afcec2e0 2024-09-10T05:38:23.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.092+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/2905419277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9afcec2e0 msgr2=0x55c9afcec6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.092+0000 7f7a8791b9c0 1 --2- 172.21.15.62:0/2905419277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9afcec2e0 0x55c9afcec6c0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f7a780036b0 tx=0x7f7a78011e10 comp rx=0 tx=0).stop 2024-09-10T05:38:23.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.092+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/2905419277 shutdown_connections 2024-09-10T05:38:23.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.092+0000 7f7a8791b9c0 1 --2- 172.21.15.62:0/2905419277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9afcec2e0 0x55c9afcec6c0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.092+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/2905419277 >> 172.21.15.62:0/2905419277 conn(0x55c9afce8710 msgr2=0x55c9afce6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:23.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.092+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/2905419277 shutdown_connections 2024-09-10T05:38:23.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.092+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/2905419277 wait complete. 2024-09-10T05:38:23.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.092+0000 7f7a8791b9c0 1 Processor -- start 2024-09-10T05:38:23.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.092+0000 7f7a8791b9c0 1 -- start start 2024-09-10T05:38:23.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.092+0000 7f7a8791b9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9afcec2e0 0x55c9afcf35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.092+0000 7f7a8791b9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c9afced170 con 0x55c9afcec2e0 2024-09-10T05:38:23.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.096+0000 7f7a85421640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9afcec2e0 0x55c9afcf35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.096+0000 7f7a85421640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9afcec2e0 0x55c9afcf35d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38720/0 (socket says 172.21.15.62:38720) 2024-09-10T05:38:23.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.096+0000 7f7a85421640 1 -- 172.21.15.62:0/1759992423 learned_addr learned my addr 172.21.15.62:0/1759992423 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:23.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.096+0000 7f7a85421640 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9afcf3b30 con 0x55c9afcec2e0 2024-09-10T05:38:23.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.096+0000 7f7a85421640 1 --2- 172.21.15.62:0/1759992423 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9afcec2e0 0x55c9afcf35d0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f7a780317a0 tx=0x7f7a78045ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.096+0000 7f795affd640 1 -- 172.21.15.62:0/1759992423 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a78050490 con 0x55c9afcec2e0 2024-09-10T05:38:23.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.096+0000 7f795affd640 1 -- 172.21.15.62:0/1759992423 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a78046070 con 0x55c9afcec2e0 2024-09-10T05:38:23.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.096+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c9afcf3b30 con 0x55c9afcec2e0 2024-09-10T05:38:23.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.096+0000 7f795affd640 1 -- 172.21.15.62:0/1759992423 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a78026810 con 0x55c9afcec2e0 2024-09-10T05:38:23.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.096+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9afcf3b30 con 0x55c9afcec2e0 2024-09-10T05:38:23.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.100+0000 7f795affd640 1 -- 172.21.15.62:0/1759992423 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f7a78059030 con 0x55c9afcec2e0 2024-09-10T05:38:23.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.100+0000 7f7a8791b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.100+0000 7f795affd640 1 --2- 172.21.15.62:0/1759992423 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7950039b10 0x7f795003bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.100+0000 7f795affd640 1 -- 172.21.15.62:0/1759992423 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7f7a7806fc20 con 0x55c9afcec2e0 2024-09-10T05:38:23.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.100+0000 7f7a84c20640 1 --2- 172.21.15.62:0/1759992423 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7950039b10 0x7f795003bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.100+0000 7f7a8791b9c0 1 --2- 172.21.15.62:0/1759992423 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55c9afcfe510 0x55c9afd009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.100+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd010f0 con 0x55c9afcfe510 2024-09-10T05:38:23.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.100+0000 7f7a85c22640 1 --2- 172.21.15.62:0/1759992423 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55c9afcfe510 0x55c9afd009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.100+0000 7f7a84c20640 1 --2- 172.21.15.62:0/1759992423 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7950039b10 0x7f795003bfd0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c0c13f0 tx=0x7f7a7c0a8000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.100+0000 7f7a85c22640 1 --2- 172.21.15.62:0/1759992423 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55c9afcfe510 0x55c9afd009a0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.100+0000 7f7a85c22640 1 -- 172.21.15.62:0/1759992423 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7a800083f0 con 0x55c9afcfe510 2024-09-10T05:38:23.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.100+0000 7f7a8791b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:23.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.100+0000 7f7a8791b9c0 20 realm 2024-09-10T05:38:23.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.100+0000 7f7a8791b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.100+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9afcfd950 con 0x55c9afcfe510 2024-09-10T05:38:23.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.100+0000 7f7a85c22640 1 -- 172.21.15.62:0/1759992423 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7a800083f0 con 0x55c9afcfe510 2024-09-10T05:38:23.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.100+0000 7f7a8791b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:23.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.100+0000 7f7a8791b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:38:23.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.100+0000 7f7a8791b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.100+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd01c00 con 0x55c9afcfe510 2024-09-10T05:38:23.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.100+0000 7f7a85c22640 1 -- 172.21.15.62:0/1759992423 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7a800083f0 con 0x55c9afcfe510 2024-09-10T05:38:23.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.100+0000 7f7a8791b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:23.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.100+0000 7f7a8791b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.100+0000 7f7a8791b9c0 1 --2- 172.21.15.62:0/1759992423 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55c9afd029e0 0x55c9afd04dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.100+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd054a0 con 0x55c9afd029e0 2024-09-10T05:38:23.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.100+0000 7f7a85421640 1 --2- 172.21.15.62:0/1759992423 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55c9afd029e0 0x55c9afd04dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.100+0000 7f7a85421640 1 --2- 172.21.15.62:0/1759992423 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55c9afd029e0 0x55c9afd04dd0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.104+0000 7f7a85421640 1 -- 172.21.15.62:0/1759992423 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7a78074020 con 0x55c9afd029e0 2024-09-10T05:38:23.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.104+0000 7f7a8791b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:38:23.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.104+0000 7f7a8791b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.104+0000 7f7a8791b9c0 1 --2- 172.21.15.62:0/1759992423 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55c9afd06200 0x55c9afd08610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.104+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd08da0 con 0x55c9afd06200 2024-09-10T05:38:23.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.104+0000 7f7a84c20640 1 --2- 172.21.15.62:0/1759992423 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55c9afd06200 0x55c9afd08610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.104+0000 7f7a84c20640 1 --2- 172.21.15.62:0/1759992423 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55c9afd06200 0x55c9afd08610 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.104+0000 7f7a84c20640 1 -- 172.21.15.62:0/1759992423 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv5 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7a7c0b4040 con 0x55c9afd06200 2024-09-10T05:38:23.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.104+0000 7f7a8791b9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:38:23.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.104+0000 7f7a8791b9c0 20 searching for the correct realm 2024-09-10T05:38:23.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.104+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd0a670 con 0x55c9afd06200 2024-09-10T05:38:23.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.104+0000 7f7a84c20640 1 -- 172.21.15.62:0/1759992423 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a7c0b4040 con 0x55c9afd06200 2024-09-10T05:38:23.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.104+0000 7f7a84c20640 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd0a670 con 0x55c9afd029e0 2024-09-10T05:38:23.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.104+0000 7f7a85421640 1 -- 172.21.15.62:0/1759992423 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a78074020 con 0x55c9afd029e0 2024-09-10T05:38:23.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.104+0000 7f7a85421640 1 --2- 172.21.15.62:0/1759992423 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f7a78027020 0x7f7a78039410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.104+0000 7f7a85421640 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd0a670 con 0x7f7a78027020 2024-09-10T05:38:23.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.104+0000 7f7a85c22640 1 --2- 172.21.15.62:0/1759992423 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f7a78027020 0x7f7a78039410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.104+0000 7f7a85c22640 1 --2- 172.21.15.62:0/1759992423 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f7a78027020 0x7f7a78039410 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.104+0000 7f7a85c22640 1 -- 172.21.15.62:0/1759992423 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a800083f0 con 0x7f7a78027020 2024-09-10T05:38:23.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.104+0000 7f7a85c22640 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd0a670 con 0x55c9afcfe510 2024-09-10T05:38:23.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.104+0000 7f7a85c22640 1 -- 172.21.15.62:0/1759992423 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a800083f0 con 0x55c9afcfe510 2024-09-10T05:38:23.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.104+0000 7f7a85c22640 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd0a670 con 0x55c9afcfe510 2024-09-10T05:38:23.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.104+0000 7f7a85c22640 1 -- 172.21.15.62:0/1759992423 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a800083f0 con 0x55c9afcfe510 2024-09-10T05:38:23.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.104+0000 7f7a85c22640 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd0a670 con 0x55c9afd06200 2024-09-10T05:38:23.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.108+0000 7f7a84c20640 1 -- 172.21.15.62:0/1759992423 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a7c0b4040 con 0x55c9afd06200 2024-09-10T05:38:23.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.108+0000 7f7a84c20640 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd0a670 con 0x55c9afcfe510 2024-09-10T05:38:23.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.108+0000 7f7a85c22640 1 -- 172.21.15.62:0/1759992423 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a800083f0 con 0x55c9afcfe510 2024-09-10T05:38:23.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.108+0000 7f7a85c22640 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd0a670 con 0x55c9afd029e0 2024-09-10T05:38:23.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.108+0000 7f7a85421640 1 -- 172.21.15.62:0/1759992423 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a78074020 con 0x55c9afd029e0 2024-09-10T05:38:23.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.108+0000 7f7a85421640 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd0a670 con 0x55c9afd029e0 2024-09-10T05:38:23.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.108+0000 7f7a85421640 1 -- 172.21.15.62:0/1759992423 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a78074020 con 0x55c9afd029e0 2024-09-10T05:38:23.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.108+0000 7f7a85421640 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd0a670 con 0x55c9afcfe510 2024-09-10T05:38:23.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.108+0000 7f7a85c22640 1 -- 172.21.15.62:0/1759992423 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a800083f0 con 0x55c9afcfe510 2024-09-10T05:38:23.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.108+0000 7f7a85c22640 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd0a670 con 0x7f7a78027020 2024-09-10T05:38:23.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.108+0000 7f7a85c22640 1 -- 172.21.15.62:0/1759992423 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a800083f0 con 0x7f7a78027020 2024-09-10T05:38:23.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.108+0000 7f7a85c22640 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd0a670 con 0x55c9afcfe510 2024-09-10T05:38:23.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.108+0000 7f7a85c22640 1 -- 172.21.15.62:0/1759992423 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a800083f0 con 0x55c9afcfe510 2024-09-10T05:38:23.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.108+0000 7f7a85c22640 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd0a670 con 0x7f7a78027020 2024-09-10T05:38:23.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.108+0000 7f7a85c22640 1 -- 172.21.15.62:0/1759992423 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7a800083f0 con 0x7f7a78027020 2024-09-10T05:38:23.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.108+0000 7f7a85c22640 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd0a670 con 0x55c9afd029e0 2024-09-10T05:38:23.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.108+0000 7f7a85421640 1 -- 172.21.15.62:0/1759992423 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a78074020 con 0x55c9afd029e0 2024-09-10T05:38:23.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.108+0000 7f7a85421640 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd0a670 con 0x55c9afd06200 2024-09-10T05:38:23.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.112+0000 7f7a84c20640 1 -- 172.21.15.62:0/1759992423 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a7c0b4040 con 0x55c9afd06200 2024-09-10T05:38:23.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.112+0000 7f7a84c20640 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd0a670 con 0x55c9afcfe510 2024-09-10T05:38:23.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.112+0000 7f7a85c22640 1 -- 172.21.15.62:0/1759992423 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a800083f0 con 0x55c9afcfe510 2024-09-10T05:38:23.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.112+0000 7f7a85c22640 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd0a670 con 0x55c9afd029e0 2024-09-10T05:38:23.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.112+0000 7f7a85421640 1 -- 172.21.15.62:0/1759992423 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a78074020 con 0x55c9afd029e0 2024-09-10T05:38:23.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.112+0000 7f7a85421640 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd0a670 con 0x55c9afd06200 2024-09-10T05:38:23.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.112+0000 7f7a84c20640 1 -- 172.21.15.62:0/1759992423 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 34 out=170b] v34'5 uv5 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f7a7c0b4040 con 0x55c9afd06200 2024-09-10T05:38:23.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.112+0000 7f7a84c20640 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd0a670 con 0x55c9afcfe510 2024-09-10T05:38:23.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.112+0000 7f7a85c22640 1 -- 172.21.15.62:0/1759992423 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a800083f0 con 0x55c9afcfe510 2024-09-10T05:38:23.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.112+0000 7f7a85c22640 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd0a670 con 0x55c9afcfe510 2024-09-10T05:38:23.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.112+0000 7f7a85c22640 1 -- 172.21.15.62:0/1759992423 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7a800083f0 con 0x55c9afcfe510 2024-09-10T05:38:23.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.112+0000 7f7a85c22640 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd0a670 con 0x55c9afcfe510 2024-09-10T05:38:23.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.112+0000 7f7a85c22640 1 -- 172.21.15.62:0/1759992423 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a800083f0 con 0x55c9afcfe510 2024-09-10T05:38:23.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.112+0000 7f7a85c22640 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd0a670 con 0x55c9afd06200 2024-09-10T05:38:23.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.112+0000 7f7a84c20640 1 -- 172.21.15.62:0/1759992423 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a7c0b4040 con 0x55c9afd06200 2024-09-10T05:38:23.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.112+0000 7f7a84c20640 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd0a670 con 0x7f7a78027020 2024-09-10T05:38:23.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.112+0000 7f7a85c22640 1 -- 172.21.15.62:0/1759992423 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a800083f0 con 0x7f7a78027020 2024-09-10T05:38:23.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.112+0000 7f7a85c22640 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd0a670 con 0x55c9afcfe510 2024-09-10T05:38:23.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.112+0000 7f7a85c22640 1 -- 172.21.15.62:0/1759992423 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a800083f0 con 0x55c9afcfe510 2024-09-10T05:38:23.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.112+0000 7f7a85c22640 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd0a670 con 0x7f7a78027020 2024-09-10T05:38:23.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.112+0000 7f7a85c22640 1 -- 172.21.15.62:0/1759992423 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a800083f0 con 0x7f7a78027020 2024-09-10T05:38:23.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.112+0000 7f7a85c22640 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd0a670 con 0x55c9afd06200 2024-09-10T05:38:23.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.112+0000 7f7a84c20640 1 -- 172.21.15.62:0/1759992423 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a7c0b4040 con 0x55c9afd06200 2024-09-10T05:38:23.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.112+0000 7f7a84c20640 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd0a670 con 0x7f7a78027020 2024-09-10T05:38:23.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.116+0000 7f7a85c22640 1 -- 172.21.15.62:0/1759992423 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a800083f0 con 0x7f7a78027020 2024-09-10T05:38:23.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.116+0000 7f7a85c22640 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd0a670 con 0x55c9afd029e0 2024-09-10T05:38:23.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.116+0000 7f7a85421640 1 -- 172.21.15.62:0/1759992423 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a78074020 con 0x55c9afd029e0 2024-09-10T05:38:23.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.116+0000 7f7a85421640 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd0a670 con 0x55c9afd029e0 2024-09-10T05:38:23.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.116+0000 7f7a85421640 1 -- 172.21.15.62:0/1759992423 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a78074020 con 0x55c9afd029e0 2024-09-10T05:38:23.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.116+0000 7f7a85421640 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd0a670 con 0x55c9afd06200 2024-09-10T05:38:23.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.116+0000 7f7a84c20640 1 -- 172.21.15.62:0/1759992423 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a7c0b4040 con 0x55c9afd06200 2024-09-10T05:38:23.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.116+0000 7f7a84c20640 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd0a670 con 0x55c9afd029e0 2024-09-10T05:38:23.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.116+0000 7f7a85421640 1 -- 172.21.15.62:0/1759992423 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7a78074020 con 0x55c9afd029e0 2024-09-10T05:38:23.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.116+0000 7f7a85421640 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd0a670 con 0x55c9afd029e0 2024-09-10T05:38:23.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.116+0000 7f7a85421640 1 -- 172.21.15.62:0/1759992423 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a78074020 con 0x55c9afd029e0 2024-09-10T05:38:23.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.116+0000 7f7a8791b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:38:23.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.116+0000 7f7a8791b9c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:38:23.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.116+0000 7f7a8791b9c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:38:23.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.116+0000 7f7a8791b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:38:23.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.116+0000 7f7a8791b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:38:23.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.116+0000 7f7a8791b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:38:23.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.116+0000 7f7a8791b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.116+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd09760 con 0x55c9afcfe510 2024-09-10T05:38:23.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.116+0000 7f7a85c22640 1 -- 172.21.15.62:0/1759992423 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7a800083f0 con 0x55c9afcfe510 2024-09-10T05:38:23.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.116+0000 7f7a8791b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:23.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.116+0000 7f7a8791b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.116+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd093a0 con 0x55c9afd029e0 2024-09-10T05:38:23.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.120+0000 7f7a85421640 1 -- 172.21.15.62:0/1759992423 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7a78074020 con 0x55c9afd029e0 2024-09-10T05:38:23.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.120+0000 7f7a8791b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:38:23.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.120+0000 7f7a8791b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.120+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd0a100 con 0x55c9afd06200 2024-09-10T05:38:23.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.120+0000 7f7a84c20640 1 -- 172.21.15.62:0/1759992423 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7a7c0b4040 con 0x55c9afd06200 2024-09-10T05:38:23.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.120+0000 7f7a8791b9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:38:23.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.120+0000 7f7a8791b9c0 20 zone default found 2024-09-10T05:38:23.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.120+0000 7f7a8791b9c0 4 Realm: () 2024-09-10T05:38:23.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.120+0000 7f7a8791b9c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:38:23.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.120+0000 7f7a8791b9c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:38:23.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.120+0000 7f7a8791b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:38:23.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.120+0000 7f7a8791b9c0 20 zonegroup default 2024-09-10T05:38:23.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.120+0000 7f7a8791b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.120+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd0af50 con 0x7f7a78027020 2024-09-10T05:38:23.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.120+0000 7f7a85c22640 1 -- 172.21.15.62:0/1759992423 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7a800083f0 con 0x7f7a78027020 2024-09-10T05:38:23.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.120+0000 7f7a8791b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:23.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.120+0000 7f7a8791b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.120+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd0d190 con 0x55c9afd06200 2024-09-10T05:38:23.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.120+0000 7f7a84c20640 1 -- 172.21.15.62:0/1759992423 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7a7c0b4040 con 0x55c9afd06200 2024-09-10T05:38:23.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.120+0000 7f7a8791b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:23.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.120+0000 7f7a8791b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.120+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd0d530 con 0x55c9afd06200 2024-09-10T05:38:23.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.120+0000 7f7a84c20640 1 -- 172.21.15.62:0/1759992423 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7a7c0b4040 con 0x55c9afd06200 2024-09-10T05:38:23.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.120+0000 7f7a8791b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:23.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.120+0000 7f7a8791b9c0 20 started sync module instance, tier type = 2024-09-10T05:38:23.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.120+0000 7f7a8791b9c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:38:23.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.120+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd0c5d0 con 0x55c9afd029e0 2024-09-10T05:38:23.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.120+0000 7f7a85421640 1 -- 172.21.15.62:0/1759992423 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a78074020 con 0x55c9afd029e0 2024-09-10T05:38:23.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.124+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94324726483440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd0dd80 con 0x55c9afd029e0 2024-09-10T05:38:23.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.124+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd0e5d0 con 0x55c9afcfe510 2024-09-10T05:38:23.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.124+0000 7f7a85c22640 1 -- 172.21.15.62:0/1759992423 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a800083f0 con 0x55c9afcfe510 2024-09-10T05:38:23.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.124+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94324726488448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd0e1a0 con 0x55c9afcfe510 2024-09-10T05:38:23.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.124+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd0f530 con 0x55c9afd029e0 2024-09-10T05:38:23.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.124+0000 7f7a85421640 1 -- 172.21.15.62:0/1759992423 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94324726483440] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a78074020 con 0x55c9afd029e0 2024-09-10T05:38:23.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.124+0000 7f7a85c22640 1 -- 172.21.15.62:0/1759992423 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94324726488448] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a800083f0 con 0x55c9afcfe510 2024-09-10T05:38:23.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.124+0000 7f7a85421640 1 -- 172.21.15.62:0/1759992423 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a78074020 con 0x55c9afd029e0 2024-09-10T05:38:23.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.124+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94324726491504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd0f040 con 0x55c9afd029e0 2024-09-10T05:38:23.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.124+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd0fe00 con 0x7f7a78027020 2024-09-10T05:38:23.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.128+0000 7f7a85c22640 1 -- 172.21.15.62:0/1759992423 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a800083f0 con 0x7f7a78027020 2024-09-10T05:38:23.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.128+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94324726495568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd0f040 con 0x7f7a78027020 2024-09-10T05:38:23.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.128+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd108c0 con 0x55c9afd029e0 2024-09-10T05:38:23.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.128+0000 7f7a85c22640 1 -- 172.21.15.62:0/1759992423 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94324726495568] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a800083f0 con 0x7f7a78027020 2024-09-10T05:38:23.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.128+0000 7f7a85421640 1 -- 172.21.15.62:0/1759992423 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94324726491504] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a78074020 con 0x55c9afd029e0 2024-09-10T05:38:23.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.128+0000 7f7a85421640 1 -- 172.21.15.62:0/1759992423 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a78074020 con 0x55c9afd029e0 2024-09-10T05:38:23.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.128+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94324726487248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd10880 con 0x55c9afd029e0 2024-09-10T05:38:23.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.128+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd10cb0 con 0x55c9afd06200 2024-09-10T05:38:23.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.132+0000 7f7a84c20640 1 -- 172.21.15.62:0/1759992423 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a7c0b4040 con 0x55c9afd06200 2024-09-10T05:38:23.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.132+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94324726496624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd11160 con 0x55c9afd06200 2024-09-10T05:38:23.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.132+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd11bb0 con 0x55c9afd06200 2024-09-10T05:38:23.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.132+0000 7f7a85421640 1 -- 172.21.15.62:0/1759992423 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94324726487248] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a78074020 con 0x55c9afd029e0 2024-09-10T05:38:23.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.132+0000 7f7a84c20640 1 -- 172.21.15.62:0/1759992423 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94324726496624] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a7c0b4040 con 0x55c9afd06200 2024-09-10T05:38:23.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.132+0000 7f7a84c20640 1 -- 172.21.15.62:0/1759992423 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a7c0b4040 con 0x55c9afd06200 2024-09-10T05:38:23.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.132+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94324726503072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd10cb0 con 0x55c9afd06200 2024-09-10T05:38:23.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.132+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd12480 con 0x7f7a78027020 2024-09-10T05:38:23.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.132+0000 7f7a84c20640 1 -- 172.21.15.62:0/1759992423 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94324726503072] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a7c0b4040 con 0x55c9afd06200 2024-09-10T05:38:23.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.136+0000 7f7a85c22640 1 -- 172.21.15.62:0/1759992423 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a800083f0 con 0x7f7a78027020 2024-09-10T05:38:23.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.136+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94324726498192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd10cb0 con 0x7f7a78027020 2024-09-10T05:38:23.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.136+0000 7f7a8791b9c0 20 add_watcher() i=0 2024-09-10T05:38:23.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.136+0000 7f7a8791b9c0 20 add_watcher() i=1 2024-09-10T05:38:23.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.136+0000 7f7a8791b9c0 20 add_watcher() i=2 2024-09-10T05:38:23.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.136+0000 7f7a8791b9c0 20 add_watcher() i=3 2024-09-10T05:38:23.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.136+0000 7f7a8791b9c0 20 add_watcher() i=4 2024-09-10T05:38:23.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.136+0000 7f7a8791b9c0 20 add_watcher() i=5 2024-09-10T05:38:23.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.136+0000 7f7a8791b9c0 20 add_watcher() i=6 2024-09-10T05:38:23.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.136+0000 7f7a85c22640 1 -- 172.21.15.62:0/1759992423 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94324726498192] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a800083f0 con 0x7f7a78027020 2024-09-10T05:38:23.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.136+0000 7f7a8791b9c0 20 add_watcher() i=7 2024-09-10T05:38:23.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.136+0000 7f7a8791b9c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:38:23.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.136+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd154b0 con 0x55c9afcfe510 2024-09-10T05:38:23.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.136+0000 7f7a85c22640 1 -- 172.21.15.62:0/1759992423 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7a800083f0 con 0x55c9afcfe510 2024-09-10T05:38:23.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.136+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94324726505424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd129c0 con 0x55c9afcfe510 2024-09-10T05:38:23.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.136+0000 7f7a85c22640 1 -- 172.21.15.62:0/1759992423 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94324726505424] v34'248 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7a800083f0 con 0x55c9afcfe510 2024-09-10T05:38:23.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.140+0000 7f793bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:38:23.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.140+0000 7f7a8791b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:38:23.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.140+0000 7f7a8791b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:38:23.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.140+0000 7f7a8791b9c0 5 note: GC not initialized 2024-09-10T05:38:23.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.140+0000 7f793afe5640 20 reqs_thread_entry: start 2024-09-10T05:38:23.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.140+0000 7f7a8791b9c0 20 init_complete bucket index max shards: 11 2024-09-10T05:38:23.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.140+0000 7f7a8791b9c0 20 Filter name: none 2024-09-10T05:38:23.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.140+0000 7f7938fe1640 20 reqs_thread_entry: start 2024-09-10T05:38:23.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.140+0000 7f7a8791b9c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-10T05:38:23.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.140+0000 7f7a8791b9c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.140+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd38760 con 0x55c9afcfe510 2024-09-10T05:38:23.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.140+0000 7f7a85c22640 1 -- 172.21.15.62:0/1759992423 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f7a800083f0 con 0x55c9afcfe510 2024-09-10T05:38:23.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.140+0000 7f7a8791b9c0 20 rados_obj.operate() r=0 bl.length=473 2024-09-10T05:38:23.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.140+0000 7f7a8791b9c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-10T05:38:23.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.140+0000 7f7a8791b9c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:38:23.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.140+0000 7f7a8791b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:38:23.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.140+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd3ef00 con 0x55c9afcfe510 2024-09-10T05:38:23.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.140+0000 7f7a85c22640 1 -- 172.21.15.62:0/1759992423 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v34'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f7a800083f0 con 0x55c9afcfe510 2024-09-10T05:38:23.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.140+0000 7f7a8791b9c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T05:38:23.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.140+0000 7f7a8791b9c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:38:23.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.140+0000 7f7a8791b9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-10T05:38:23.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.140+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94324726688176 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd3a6b0 con 0x55c9afd029e0 2024-09-10T05:38:23.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.140+0000 7f7a85421640 1 -- 172.21.15.62:0/1759992423 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== watch-notify(notify (1) cookie 94324726487248 notify 146028888110 ret 0) ==== 678+0+0 (crc 0 0 0) 0x55c9afce0e40 con 0x55c9afd029e0 2024-09-10T05:38:23.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.140+0000 7f7968ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888110 cookie 94324726487248 notifier 4836 bl.length()=636 2024-09-10T05:38:23.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.144+0000 7f7968ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T05:38:23.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.144+0000 7f7968ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:38:23.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.144+0000 7f7968ff9640 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f7948003eb0 con 0x55c9afd029e0 2024-09-10T05:38:23.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.144+0000 7f7a85421640 1 -- 172.21.15.62:0/1759992423 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(64 notify.4 [notify cookie 94324726688176 out=8b] v0'0 uv243 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7a78074020 con 0x55c9afd029e0 2024-09-10T05:38:23.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.144+0000 7f7a85421640 1 -- 172.21.15.62:0/1759992423 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a78074020 con 0x55c9afd029e0 2024-09-10T05:38:23.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.144+0000 7f7a85421640 1 -- 172.21.15.62:0/1759992423 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== watch-notify(notify_complete (2) cookie 94324726688176 notify 146028888110 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c9afce05e0 con 0x55c9afd029e0 2024-09-10T05:38:23.147 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-10T05:38:22.896781Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:38:22.896764Z","tags":[],"group_ids":[]} 2024-09-10T05:38:23.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.144+0000 7f793bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:38:23.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.144+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94324726505424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd3dee0 con 0x55c9afcfe510 2024-09-10T05:38:23.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.148+0000 7f7a85c22640 1 -- 172.21.15.62:0/1759992423 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94324726505424] v34'249 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7a800083f0 con 0x55c9afcfe510 2024-09-10T05:38:23.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.148+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94324726483440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd11fd0 con 0x55c9afd029e0 2024-09-10T05:38:23.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.148+0000 7f7a85421640 1 -- 172.21.15.62:0/1759992423 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94324726483440] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a78074020 con 0x55c9afd029e0 2024-09-10T05:38:23.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.148+0000 7f7a8791b9c0 20 remove_watcher() i=0 2024-09-10T05:38:23.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.148+0000 7f7a8791b9c0 2 removed watcher, disabling cache 2024-09-10T05:38:23.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.148+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94324726488448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd0c9f0 con 0x55c9afcfe510 2024-09-10T05:38:23.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.148+0000 7f7a85c22640 1 -- 172.21.15.62:0/1759992423 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94324726488448] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a800083f0 con 0x55c9afcfe510 2024-09-10T05:38:23.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.152+0000 7f7a8791b9c0 20 remove_watcher() i=1 2024-09-10T05:38:23.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.152+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94324726491504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd0c9f0 con 0x55c9afd029e0 2024-09-10T05:38:23.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.152+0000 7f7a85421640 1 -- 172.21.15.62:0/1759992423 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94324726491504] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a78074020 con 0x55c9afd029e0 2024-09-10T05:38:23.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.152+0000 7f7a8791b9c0 20 remove_watcher() i=2 2024-09-10T05:38:23.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.152+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94324726495568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd0e970 con 0x7f7a78027020 2024-09-10T05:38:23.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.152+0000 7f7a85c22640 1 -- 172.21.15.62:0/1759992423 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94324726495568] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a800083f0 con 0x7f7a78027020 2024-09-10T05:38:23.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.152+0000 7f7a8791b9c0 20 remove_watcher() i=3 2024-09-10T05:38:23.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.152+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94324726487248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd0c9f0 con 0x55c9afd029e0 2024-09-10T05:38:23.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.156+0000 7f7a85421640 1 -- 172.21.15.62:0/1759992423 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94324726487248] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a78074020 con 0x55c9afd029e0 2024-09-10T05:38:23.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.156+0000 7f7a8791b9c0 20 remove_watcher() i=4 2024-09-10T05:38:23.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.156+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94324726496624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd0f950 con 0x55c9afd06200 2024-09-10T05:38:23.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.156+0000 7f7a84c20640 1 -- 172.21.15.62:0/1759992423 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94324726496624] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a7c0b4040 con 0x55c9afd06200 2024-09-10T05:38:23.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.156+0000 7f7a8791b9c0 20 remove_watcher() i=5 2024-09-10T05:38:23.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.156+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94324726503072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd0fe00 con 0x55c9afd06200 2024-09-10T05:38:23.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.160+0000 7f7a84c20640 1 -- 172.21.15.62:0/1759992423 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94324726503072] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a7c0b4040 con 0x55c9afd06200 2024-09-10T05:38:23.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.160+0000 7f7a8791b9c0 20 remove_watcher() i=6 2024-09-10T05:38:23.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.160+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94324726498192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9afd0e970 con 0x7f7a78027020 2024-09-10T05:38:23.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.160+0000 7f7a85c22640 1 -- 172.21.15.62:0/1759992423 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94324726498192] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a800083f0 con 0x7f7a78027020 2024-09-10T05:38:23.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.160+0000 7f7a8791b9c0 20 remove_watcher() i=7 2024-09-10T05:38:23.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.160+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55c9afd029e0 msgr2=0x55c9afd04dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.160+0000 7f7a8791b9c0 1 --2- 172.21.15.62:0/1759992423 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55c9afd029e0 0x55c9afd04dd0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.160+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55c9afcfe510 msgr2=0x55c9afd009a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.160+0000 7f7a8791b9c0 1 --2- 172.21.15.62:0/1759992423 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55c9afcfe510 0x55c9afd009a0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.160+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f7a78027020 msgr2=0x7f7a78039410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.160+0000 7f7a8791b9c0 1 --2- 172.21.15.62:0/1759992423 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f7a78027020 0x7f7a78039410 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.160+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55c9afd06200 msgr2=0x55c9afd08610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.160+0000 7f7a8791b9c0 1 --2- 172.21.15.62:0/1759992423 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55c9afd06200 0x55c9afd08610 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.160+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7950039b10 msgr2=0x7f795003bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.160+0000 7f7a8791b9c0 1 --2- 172.21.15.62:0/1759992423 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7950039b10 0x7f795003bfd0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c0c13f0 tx=0x7f7a7c0a8000 comp rx=0 tx=0).stop 2024-09-10T05:38:23.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.160+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9afcec2e0 msgr2=0x55c9afcf35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.160+0000 7f7a8791b9c0 1 --2- 172.21.15.62:0/1759992423 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9afcec2e0 0x55c9afcf35d0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f7a780317a0 tx=0x7f7a78045ee0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.160+0000 7f7a85c22640 1 -- 172.21.15.62:0/1759992423 reap_dead start 2024-09-10T05:38:23.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.160+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 shutdown_connections 2024-09-10T05:38:23.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.160+0000 7f7a8791b9c0 1 --2- 172.21.15.62:0/1759992423 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9afcec2e0 0x55c9afcf35d0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.160+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 >> 172.21.15.62:0/1759992423 conn(0x55c9afce8710 msgr2=0x55c9afce6920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:23.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.160+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 shutdown_connections 2024-09-10T05:38:23.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.160+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/1759992423 wait complete. 2024-09-10T05:38:23.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.160+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/855692767 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f795c039a20 msgr2=0x7f795c03bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.160+0000 7f7a8791b9c0 1 --2- 172.21.15.62:0/855692767 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f795c039a20 0x7f795c03bee0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x55c9afccd8e0 tx=0x7f7a7c005ad0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.160+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/855692767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9afcdfb80 msgr2=0x55c9afcdffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.160+0000 7f7a8791b9c0 1 --2- 172.21.15.62:0/855692767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9afcdfb80 0x55c9afcdffa0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f7a780064a0 tx=0x7f7a78047b40 comp rx=0 tx=0).stop 2024-09-10T05:38:23.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.160+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/855692767 shutdown_connections 2024-09-10T05:38:23.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.160+0000 7f7a8791b9c0 1 --2- 172.21.15.62:0/855692767 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f795c039a20 0x7f795c03bee0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.160+0000 7f7a8791b9c0 1 --2- 172.21.15.62:0/855692767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9afcdfb80 0x55c9afcdffa0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.160+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/855692767 >> 172.21.15.62:0/855692767 conn(0x55c9afcd5530 msgr2=0x55c9afcd5910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:23.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.160+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/855692767 shutdown_connections 2024-09-10T05:38:23.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.160+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/855692767 wait complete. 2024-09-10T05:38:23.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.160+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/394292223 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55c9afcca2d0 msgr2=0x55c9afccc6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.160+0000 7f7a8791b9c0 1 --2- 172.21.15.62:0/394292223 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55c9afcca2d0 0x55c9afccc6c0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.160+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/394292223 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55c9afbd3340 msgr2=0x55c9afcc9030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.160+0000 7f7a8791b9c0 1 --2- 172.21.15.62:0/394292223 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55c9afbd3340 0x55c9afcc9030 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.160+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/394292223 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55c9afccea70 msgr2=0x55c9afcd0e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.160+0000 7f7a8791b9c0 1 --2- 172.21.15.62:0/394292223 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55c9afccea70 0x55c9afcd0e60 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.160+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/394292223 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f796c039a70 msgr2=0x7f796c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.160+0000 7f7a8791b9c0 1 --2- 172.21.15.62:0/394292223 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f796c039a70 0x7f796c03bf30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c0ae000 tx=0x7f7a7c0a6000 comp rx=0 tx=0).stop 2024-09-10T05:38:23.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.160+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/394292223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9afb431f0 msgr2=0x55c9afcc1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.160+0000 7f7a8791b9c0 1 --2- 172.21.15.62:0/394292223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9afb431f0 0x55c9afcc1ec0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x55c9afcbb7e0 tx=0x7f7a78001260 comp rx=0 tx=0).stop 2024-09-10T05:38:23.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.160+0000 7f7a85c22640 1 -- 172.21.15.62:0/394292223 reap_dead start 2024-09-10T05:38:23.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.160+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/394292223 shutdown_connections 2024-09-10T05:38:23.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.160+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/394292223 >> 172.21.15.62:0/394292223 conn(0x55c9afbc9910 msgr2=0x55c9afcb4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:23.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.160+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/394292223 shutdown_connections 2024-09-10T05:38:23.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.160+0000 7f7a8791b9c0 1 -- 172.21.15.62:0/394292223 wait complete. 2024-09-10T05:38:23.177 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T05:38:22.896781Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:38:22.896764Z', 'tags': [], 'group_ids': []} 2024-09-10T05:38:23.177 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T05:38:22.896781Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:38:22.896764Z', 'tags': [], 'group_ids': []} 2024-09-10T05:38:23.177 ERROR:root:0 2024-09-10T05:38:23.177 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-10T05:38:23.177 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-10T05:38:23.177 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid system_user --display-name 'System User' --access-key system_akey --secret system_skey --caps user-info-without-keys=read --system 2024-09-10T05:38:23.267 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:38:23.268 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:38:23.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.264+0000 7f69dfc0e9c0 1 Processor -- start 2024-09-10T05:38:23.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.264+0000 7f69dfc0e9c0 1 -- start start 2024-09-10T05:38:23.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.264+0000 7f69dfc0e9c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55e6bdb9b560 0x55e6bdc2f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.264+0000 7f69dfc0e9c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e6bdadb9c0 con 0x55e6bdb9b180 2024-09-10T05:38:23.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.264+0000 7f69dfc0e9c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x55e6bdb2b6d0 con 0x55e6bdb9b560 2024-09-10T05:38:23.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.264+0000 7f69dcf13640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55e6bdb9b560 0x55e6bdc2f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.264+0000 7f69dd714640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x55e6bdb9b180 0x55e6bdc2bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:52110/0 (socket says 172.21.15.62:52110) 2024-09-10T05:38:23.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.264+0000 7f69dcf13640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55e6bdb9b560 0x55e6bdc2f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38724/0 (socket says 172.21.15.62:38724) 2024-09-10T05:38:23.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.264+0000 7f69dd714640 1 -- 172.21.15.62:0/2288950971 learned_addr learned my addr 172.21.15.62:0/2288950971 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-10T05:38:23.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.268+0000 7f69dcf13640 1 -- 172.21.15.62:0/2288950971 >> v1:172.21.15.2:6789/0 conn(0x55e6bdb9b180 legacy=0x55e6bdc2bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.268+0000 7f69dcf13640 1 -- 172.21.15.62:0/2288950971 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6bdacfca0 con 0x55e6bdb9b560 2024-09-10T05:38:23.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.268+0000 7f69dcf13640 1 --2- 172.21.15.62:0/2288950971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6bdb9b560 0x55e6bdc2f6e0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f69c800a480 tx=0x7f69c801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28052bde36f1f485 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.268+0000 7f69d7fff640 1 -- 172.21.15.62:0/2288950971 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69c80b0070 con 0x55e6bdb9b560 2024-09-10T05:38:23.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.268+0000 7f69d7fff640 1 -- 172.21.15.62:0/2288950971 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69c80ab540 con 0x55e6bdb9b560 2024-09-10T05:38:23.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.268+0000 7f69d7fff640 1 -- 172.21.15.62:0/2288950971 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69c80ab840 con 0x55e6bdb9b560 2024-09-10T05:38:23.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.268+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2288950971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6bdb9b560 msgr2=0x55e6bdc2f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.268+0000 7f69dfc0e9c0 1 --2- 172.21.15.62:0/2288950971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6bdb9b560 0x55e6bdc2f6e0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f69c800a480 tx=0x7f69c801b280 comp rx=0 tx=0).stop 2024-09-10T05:38:23.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.268+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2288950971 shutdown_connections 2024-09-10T05:38:23.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.268+0000 7f69dfc0e9c0 1 --2- 172.21.15.62:0/2288950971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6bdb9b560 0x55e6bdc2f6e0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.268+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2288950971 >> 172.21.15.62:0/2288950971 conn(0x55e6bdc218a0 msgr2=0x55e6bdc23cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:23.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.268+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2288950971 shutdown_connections 2024-09-10T05:38:23.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.268+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2288950971 wait complete. 2024-09-10T05:38:23.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.284+0000 7f69dfc0e9c0 1 Processor -- start 2024-09-10T05:38:23.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.284+0000 7f69dfc0e9c0 1 -- start start 2024-09-10T05:38:23.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.284+0000 7f69dfc0e9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6bdb9b180 0x55e6bdd148e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.284+0000 7f69dfc0e9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e6bdb2f680 con 0x55e6bdb9b180 2024-09-10T05:38:23.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.288+0000 7f69dd714640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6bdb9b180 0x55e6bdd148e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.288+0000 7f69dd714640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6bdb9b180 0x55e6bdd148e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38732/0 (socket says 172.21.15.62:38732) 2024-09-10T05:38:23.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.288+0000 7f69dd714640 1 -- 172.21.15.62:0/1330217126 learned_addr learned my addr 172.21.15.62:0/1330217126 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:23.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.288+0000 7f69dd714640 1 -- 172.21.15.62:0/1330217126 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6bdaaada0 con 0x55e6bdb9b180 2024-09-10T05:38:23.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.288+0000 7f69dd714640 1 --2- 172.21.15.62:0/1330217126 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6bdb9b180 0x55e6bdd148e0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f69d00017b0 tx=0x7f69d0001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ba805e9f99aded9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.288+0000 7f68cb606640 1 -- 172.21.15.62:0/1330217126 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69d00044f0 con 0x55e6bdb9b180 2024-09-10T05:38:23.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.288+0000 7f68cb606640 1 -- 172.21.15.62:0/1330217126 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69d00046b0 con 0x55e6bdb9b180 2024-09-10T05:38:23.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.288+0000 7f68cb606640 1 -- 172.21.15.62:0/1330217126 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69d0004a10 con 0x55e6bdb9b180 2024-09-10T05:38:23.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.288+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/1330217126 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6bdb9b180 msgr2=0x55e6bdd148e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.288+0000 7f69dfc0e9c0 1 --2- 172.21.15.62:0/1330217126 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6bdb9b180 0x55e6bdd148e0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f69d00017b0 tx=0x7f69d0001c70 comp rx=0 tx=0).stop 2024-09-10T05:38:23.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.288+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/1330217126 shutdown_connections 2024-09-10T05:38:23.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.288+0000 7f69dfc0e9c0 1 --2- 172.21.15.62:0/1330217126 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6bdb9b180 0x55e6bdd148e0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.288+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/1330217126 >> 172.21.15.62:0/1330217126 conn(0x55e6bdc218a0 msgr2=0x55e6bdd10520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:23.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.288+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/1330217126 shutdown_connections 2024-09-10T05:38:23.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.288+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/1330217126 wait complete. 2024-09-10T05:38:23.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.288+0000 7f69dfc0e9c0 1 Processor -- start 2024-09-10T05:38:23.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.288+0000 7f69dfc0e9c0 1 -- start start 2024-09-10T05:38:23.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.288+0000 7f69dfc0e9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6bdb9b180 0x55e6bdd1bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.288+0000 7f69dfc0e9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e6bdad1a50 con 0x55e6bdb9b180 2024-09-10T05:38:23.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.288+0000 7f69dd714640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6bdb9b180 0x55e6bdd1bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.288+0000 7f69dd714640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6bdb9b180 0x55e6bdd1bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38744/0 (socket says 172.21.15.62:38744) 2024-09-10T05:38:23.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.288+0000 7f69dd714640 1 -- 172.21.15.62:0/1603099297 learned_addr learned my addr 172.21.15.62:0/1603099297 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:23.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.288+0000 7f69dd714640 1 -- 172.21.15.62:0/1603099297 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6bdd1c4e0 con 0x55e6bdb9b180 2024-09-10T05:38:23.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.292+0000 7f69dd714640 1 --2- 172.21.15.62:0/1603099297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6bdb9b180 0x55e6bdd1bf80 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f69d0006a50 tx=0x7f69d0000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.292+0000 7f68c9e03640 1 -- 172.21.15.62:0/1603099297 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69d0013760 con 0x55e6bdb9b180 2024-09-10T05:38:23.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.292+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/1603099297 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e6bdd1c770 con 0x55e6bdb9b180 2024-09-10T05:38:23.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.292+0000 7f68c9e03640 1 -- 172.21.15.62:0/1603099297 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69d0013900 con 0x55e6bdb9b180 2024-09-10T05:38:23.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.292+0000 7f68c9e03640 1 -- 172.21.15.62:0/1603099297 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69d0013be0 con 0x55e6bdb9b180 2024-09-10T05:38:23.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.292+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/1603099297 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6bdd1d120 con 0x55e6bdb9b180 2024-09-10T05:38:23.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.292+0000 7f68c9e03640 1 -- 172.21.15.62:0/1603099297 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f69d0010070 con 0x55e6bdb9b180 2024-09-10T05:38:23.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.292+0000 7f68c9e03640 1 --2- 172.21.15.62:0/1603099297 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f68c4039a70 0x7f68c403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.292+0000 7f68c9e03640 1 -- 172.21.15.62:0/1603099297 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7f69d0018070 con 0x55e6bdb9b180 2024-09-10T05:38:23.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.292+0000 7f69dcf13640 1 --2- 172.21.15.62:0/1603099297 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f68c4039a70 0x7f68c403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.292+0000 7f69dfc0e9c0 1 --2- 172.21.15.62:0/1603099297 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55e6bdb9b560 0x55e6bdd230f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.292+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/1603099297 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6bdd23630 con 0x55e6bdb9b560 2024-09-10T05:38:23.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.292+0000 7f69ddf15640 1 --2- 172.21.15.62:0/1603099297 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55e6bdb9b560 0x55e6bdd230f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.292+0000 7f69dcf13640 1 --2- 172.21.15.62:0/1603099297 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f68c4039a70 0x7f68c403bf30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f69c80ad000 tx=0x7f69c80a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.292+0000 7f69ddf15640 1 --2- 172.21.15.62:0/1603099297 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55e6bdb9b560 0x55e6bdd230f0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.292+0000 7f69ddf15640 1 -- 172.21.15.62:0/1603099297 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69d80083f0 con 0x55e6bdb9b560 2024-09-10T05:38:23.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.292+0000 7f69dfc0e9c0 1 --2- 172.21.15.62:0/1603099297 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e6bdd24390 0x55e6bdd26780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.292+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/1603099297 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6bdd26d70 con 0x55e6bdd24390 2024-09-10T05:38:23.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.292+0000 7f69dd714640 1 --2- 172.21.15.62:0/1603099297 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e6bdd24390 0x55e6bdd26780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.296+0000 7f69dd714640 1 --2- 172.21.15.62:0/1603099297 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e6bdd24390 0x55e6bdd26780 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.296+0000 7f69dd714640 1 -- 172.21.15.62:0/1603099297 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f69d001b030 con 0x55e6bdd24390 2024-09-10T05:38:23.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.296+0000 7f69dfc0e9c0 1 --2- 172.21.15.62:0/1603099297 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55e6bdd28b30 0x55e6bdd2af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.296+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/1603099297 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6bdd2b610 con 0x55e6bdd28b30 2024-09-10T05:38:23.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.296+0000 7f69dcf13640 1 --2- 172.21.15.62:0/1603099297 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55e6bdd28b30 0x55e6bdd2af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.296+0000 7f69dcf13640 1 --2- 172.21.15.62:0/1603099297 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55e6bdd28b30 0x55e6bdd2af20 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.296+0000 7f69dcf13640 1 -- 172.21.15.62:0/1603099297 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv5 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f69c80b3040 con 0x55e6bdd28b30 2024-09-10T05:38:23.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.296+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/1603099297 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6bdd279d0 con 0x55e6bdd24390 2024-09-10T05:38:23.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.296+0000 7f69dd714640 1 -- 172.21.15.62:0/1603099297 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f69d001b030 con 0x55e6bdd24390 2024-09-10T05:38:23.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.296+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/1603099297 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6bdd27e70 con 0x55e6bdd28b30 2024-09-10T05:38:23.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.296+0000 7f69dcf13640 1 -- 172.21.15.62:0/1603099297 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f69c80b3040 con 0x55e6bdd28b30 2024-09-10T05:38:23.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.296+0000 7f69dfc0e9c0 1 Processor -- start 2024-09-10T05:38:23.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.296+0000 7f69dfc0e9c0 1 -- start start 2024-09-10T05:38:23.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.300+0000 7f69dfc0e9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6bdd39c40 0x55e6bdd3a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.300+0000 7f69dfc0e9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e6bdb3c450 con 0x55e6bdd39c40 2024-09-10T05:38:23.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.300+0000 7f69dd714640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6bdd39c40 0x55e6bdd3a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.300+0000 7f69dd714640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6bdd39c40 0x55e6bdd3a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38748/0 (socket says 172.21.15.62:38748) 2024-09-10T05:38:23.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.300+0000 7f69dd714640 1 -- 172.21.15.62:0/2714984210 learned_addr learned my addr 172.21.15.62:0/2714984210 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:23.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.300+0000 7f69dd714640 1 -- 172.21.15.62:0/2714984210 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6bdd3a6a0 con 0x55e6bdd39c40 2024-09-10T05:38:23.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.300+0000 7f69dd714640 1 --2- 172.21.15.62:0/2714984210 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6bdd39c40 0x55e6bdd3a060 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f69d0010a40 tx=0x7f69d0012b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.300+0000 7f68c2ffd640 1 -- 172.21.15.62:0/2714984210 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69d00123c0 con 0x55e6bdd39c40 2024-09-10T05:38:23.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.300+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2714984210 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e6bdd3af00 con 0x55e6bdd39c40 2024-09-10T05:38:23.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.300+0000 7f68c2ffd640 1 -- 172.21.15.62:0/2714984210 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69d0012560 con 0x55e6bdd39c40 2024-09-10T05:38:23.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.300+0000 7f68c2ffd640 1 -- 172.21.15.62:0/2714984210 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69d001db40 con 0x55e6bdd39c40 2024-09-10T05:38:23.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.300+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2714984210 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6bdd3af00 con 0x55e6bdd39c40 2024-09-10T05:38:23.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.300+0000 7f68c2ffd640 1 -- 172.21.15.62:0/2714984210 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f69d004a020 con 0x55e6bdd39c40 2024-09-10T05:38:23.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.300+0000 7f68c2ffd640 1 --2- 172.21.15.62:0/2714984210 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f68b4039a70 0x7f68b403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.300+0000 7f68c2ffd640 1 -- 172.21.15.62:0/2714984210 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7f69d0048020 con 0x55e6bdd39c40 2024-09-10T05:38:23.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.300+0000 7f69dcf13640 1 --2- 172.21.15.62:0/2714984210 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f68b4039a70 0x7f68b403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.300+0000 7f69dfc0e9c0 1 Processor -- start 2024-09-10T05:38:23.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.300+0000 7f69dfc0e9c0 1 -- start start 2024-09-10T05:38:23.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.300+0000 7f69dfc0e9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6bdd461b0 0x55e6bdd46590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.300+0000 7f69dfc0e9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e6bdd15130 con 0x55e6bdd461b0 2024-09-10T05:38:23.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.300+0000 7f69dcf13640 1 --2- 172.21.15.62:0/2714984210 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f68b4039a70 0x7f68b403bf30 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x55e6bdd1d3d0 tx=0x7f69c8005a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.304+0000 7f69dd714640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6bdd461b0 0x55e6bdd46590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.304+0000 7f69dd714640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6bdd461b0 0x55e6bdd46590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38762/0 (socket says 172.21.15.62:38762) 2024-09-10T05:38:23.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.304+0000 7f69dd714640 1 -- 172.21.15.62:0/1247814679 learned_addr learned my addr 172.21.15.62:0/1247814679 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:23.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.304+0000 7f69dd714640 1 -- 172.21.15.62:0/1247814679 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6bdd46b80 con 0x55e6bdd461b0 2024-09-10T05:38:23.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.304+0000 7f69dd714640 1 --2- 172.21.15.62:0/1247814679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6bdd461b0 0x55e6bdd46590 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f69d00109e0 tx=0x7f69d0042b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16a674303992c068 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.304+0000 7f68c0ff9640 1 -- 172.21.15.62:0/1247814679 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69d005b040 con 0x55e6bdd461b0 2024-09-10T05:38:23.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.304+0000 7f68c0ff9640 1 -- 172.21.15.62:0/1247814679 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69d0019310 con 0x55e6bdd461b0 2024-09-10T05:38:23.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.304+0000 7f68c0ff9640 1 -- 172.21.15.62:0/1247814679 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69d001ddf0 con 0x55e6bdd461b0 2024-09-10T05:38:23.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.304+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/1247814679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6bdd461b0 msgr2=0x55e6bdd46590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.304+0000 7f69dfc0e9c0 1 --2- 172.21.15.62:0/1247814679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6bdd461b0 0x55e6bdd46590 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f69d00109e0 tx=0x7f69d0042b70 comp rx=0 tx=0).stop 2024-09-10T05:38:23.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.304+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/1247814679 shutdown_connections 2024-09-10T05:38:23.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.304+0000 7f69dfc0e9c0 1 --2- 172.21.15.62:0/1247814679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6bdd461b0 0x55e6bdd46590 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.304+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/1247814679 >> 172.21.15.62:0/1247814679 conn(0x55e6bdd425e0 msgr2=0x55e6bdd40820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:23.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.304+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/1247814679 shutdown_connections 2024-09-10T05:38:23.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.304+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/1247814679 wait complete. 2024-09-10T05:38:23.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.304+0000 7f69dfc0e9c0 1 Processor -- start 2024-09-10T05:38:23.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.304+0000 7f69dfc0e9c0 1 -- start start 2024-09-10T05:38:23.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.304+0000 7f69dfc0e9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6bdd461b0 0x55e6bdd4d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.304+0000 7f69dfc0e9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e6bdd47040 con 0x55e6bdd461b0 2024-09-10T05:38:23.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.304+0000 7f69dd714640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6bdd461b0 0x55e6bdd4d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.304+0000 7f69dd714640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6bdd461b0 0x55e6bdd4d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38770/0 (socket says 172.21.15.62:38770) 2024-09-10T05:38:23.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.304+0000 7f69dd714640 1 -- 172.21.15.62:0/2119593100 learned_addr learned my addr 172.21.15.62:0/2119593100 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:23.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.304+0000 7f69dd714640 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6bdd4da40 con 0x55e6bdd461b0 2024-09-10T05:38:23.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.308+0000 7f69dd714640 1 --2- 172.21.15.62:0/2119593100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6bdd461b0 0x55e6bdd4d4e0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f69d0042c40 tx=0x7f69d0017e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.308+0000 7f68b2ffd640 1 -- 172.21.15.62:0/2119593100 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69d0064040 con 0x55e6bdd461b0 2024-09-10T05:38:23.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.308+0000 7f68b2ffd640 1 -- 172.21.15.62:0/2119593100 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69d00283d0 con 0x55e6bdd461b0 2024-09-10T05:38:23.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.308+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e6bdd4da40 con 0x55e6bdd461b0 2024-09-10T05:38:23.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.308+0000 7f68b2ffd640 1 -- 172.21.15.62:0/2119593100 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69d004c540 con 0x55e6bdd461b0 2024-09-10T05:38:23.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.308+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6bdd4da40 con 0x55e6bdd461b0 2024-09-10T05:38:23.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.308+0000 7f68b2ffd640 1 -- 172.21.15.62:0/2119593100 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f69d0070020 con 0x55e6bdd461b0 2024-09-10T05:38:23.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.308+0000 7f68b2ffd640 1 --2- 172.21.15.62:0/2119593100 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f68a8039a20 0x7f68a803bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.308+0000 7f68b2ffd640 1 -- 172.21.15.62:0/2119593100 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7f69d006e020 con 0x55e6bdd461b0 2024-09-10T05:38:23.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.308+0000 7f69dcf13640 1 --2- 172.21.15.62:0/2119593100 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f68a8039a20 0x7f68a803bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.308+0000 7f69dfc0e9c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.308+0000 7f69dfc0e9c0 1 --2- 172.21.15.62:0/2119593100 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55e6bdd58470 0x55e6bdd5a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.308+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6bdd5b080 con 0x55e6bdd58470 2024-09-10T05:38:23.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.308+0000 7f69ddf15640 1 --2- 172.21.15.62:0/2119593100 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55e6bdd58470 0x55e6bdd5a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.308+0000 7f69dcf13640 1 --2- 172.21.15.62:0/2119593100 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f68a8039a20 0x7f68a803bee0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f69c8018eb0 tx=0x7f69c80a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.308+0000 7f69ddf15640 1 --2- 172.21.15.62:0/2119593100 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55e6bdd58470 0x55e6bdd5a930 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.308+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69d80083f0 con 0x55e6bdd58470 2024-09-10T05:38:23.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.308+0000 7f69dfc0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:23.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.308+0000 7f69dfc0e9c0 20 realm 2024-09-10T05:38:23.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.308+0000 7f69dfc0e9c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.308+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6bdd577a0 con 0x55e6bdd58470 2024-09-10T05:38:23.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.308+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69d80083f0 con 0x55e6bdd58470 2024-09-10T05:38:23.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.308+0000 7f69dfc0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:23.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.308+0000 7f69dfc0e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:38:23.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.308+0000 7f69dfc0e9c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.308+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6bdd5bb40 con 0x55e6bdd58470 2024-09-10T05:38:23.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.312+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69d80083f0 con 0x55e6bdd58470 2024-09-10T05:38:23.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.312+0000 7f69dfc0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:23.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.312+0000 7f69dfc0e9c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.312+0000 7f69dfc0e9c0 1 --2- 172.21.15.62:0/2119593100 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e6bdd5c920 0x55e6bdd5ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.312+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6bdd5f3e0 con 0x55e6bdd5c920 2024-09-10T05:38:23.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.312+0000 7f69dd714640 1 --2- 172.21.15.62:0/2119593100 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e6bdd5c920 0x55e6bdd5ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.312+0000 7f69dd714640 1 --2- 172.21.15.62:0/2119593100 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e6bdd5c920 0x55e6bdd5ed10 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.312+0000 7f69dd714640 1 -- 172.21.15.62:0/2119593100 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f69d0067040 con 0x55e6bdd5c920 2024-09-10T05:38:23.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.312+0000 7f69dfc0e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:38:23.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.312+0000 7f69dfc0e9c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.312+0000 7f69dfc0e9c0 1 --2- 172.21.15.62:0/2119593100 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55e6bdd5fe30 0x55e6bdd62220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.312+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6bdd62960 con 0x55e6bdd5fe30 2024-09-10T05:38:23.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.312+0000 7f69dcf13640 1 --2- 172.21.15.62:0/2119593100 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55e6bdd5fe30 0x55e6bdd62220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.312+0000 7f69dcf13640 1 --2- 172.21.15.62:0/2119593100 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55e6bdd5fe30 0x55e6bdd62220 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.312+0000 7f69dcf13640 1 -- 172.21.15.62:0/2119593100 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv5 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f69c80b3040 con 0x55e6bdd5fe30 2024-09-10T05:38:23.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.312+0000 7f69dfc0e9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:38:23.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.312+0000 7f69dfc0e9c0 20 searching for the correct realm 2024-09-10T05:38:23.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.312+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6bdd641c0 con 0x55e6bdd5fe30 2024-09-10T05:38:23.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.312+0000 7f69dcf13640 1 -- 172.21.15.62:0/2119593100 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69c80b3040 con 0x55e6bdd5fe30 2024-09-10T05:38:23.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.312+0000 7f69dcf13640 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6bdd641c0 con 0x55e6bdd5c920 2024-09-10T05:38:23.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.316+0000 7f69dd714640 1 -- 172.21.15.62:0/2119593100 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d0067040 con 0x55e6bdd5c920 2024-09-10T05:38:23.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.316+0000 7f69dd714640 1 --2- 172.21.15.62:0/2119593100 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f69d00146f0 0x7f69d005f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.316+0000 7f69dd714640 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f69d0069070 con 0x7f69d00146f0 2024-09-10T05:38:23.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.316+0000 7f69ddf15640 1 --2- 172.21.15.62:0/2119593100 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f69d00146f0 0x7f69d005f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.316+0000 7f69ddf15640 1 --2- 172.21.15.62:0/2119593100 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f69d00146f0 0x7f69d005f420 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.316+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d80083f0 con 0x7f69d00146f0 2024-09-10T05:38:23.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.316+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f69d0069070 con 0x55e6bdd58470 2024-09-10T05:38:23.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.316+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d80083f0 con 0x55e6bdd58470 2024-09-10T05:38:23.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.316+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f69d0069070 con 0x55e6bdd58470 2024-09-10T05:38:23.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.316+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d80083f0 con 0x55e6bdd58470 2024-09-10T05:38:23.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.316+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f69d0069070 con 0x55e6bdd5fe30 2024-09-10T05:38:23.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.316+0000 7f69dcf13640 1 -- 172.21.15.62:0/2119593100 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69c80b3040 con 0x55e6bdd5fe30 2024-09-10T05:38:23.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.316+0000 7f69dcf13640 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f69d0069070 con 0x55e6bdd58470 2024-09-10T05:38:23.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.316+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d80083f0 con 0x55e6bdd58470 2024-09-10T05:38:23.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.316+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f69d0069070 con 0x55e6bdd5c920 2024-09-10T05:38:23.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.316+0000 7f69dd714640 1 -- 172.21.15.62:0/2119593100 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d0067040 con 0x55e6bdd5c920 2024-09-10T05:38:23.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.316+0000 7f69dd714640 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f69d0069070 con 0x55e6bdd5c920 2024-09-10T05:38:23.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.316+0000 7f69dd714640 1 -- 172.21.15.62:0/2119593100 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d0067040 con 0x55e6bdd5c920 2024-09-10T05:38:23.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.316+0000 7f69dd714640 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f69d0069070 con 0x55e6bdd58470 2024-09-10T05:38:23.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.316+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d80083f0 con 0x55e6bdd58470 2024-09-10T05:38:23.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.316+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f69d0069070 con 0x7f69d00146f0 2024-09-10T05:38:23.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.320+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d80083f0 con 0x7f69d00146f0 2024-09-10T05:38:23.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.320+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f69d0069070 con 0x55e6bdd58470 2024-09-10T05:38:23.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.320+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d80083f0 con 0x55e6bdd58470 2024-09-10T05:38:23.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.320+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f69d0069070 con 0x7f69d00146f0 2024-09-10T05:38:23.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.320+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f69d80083f0 con 0x7f69d00146f0 2024-09-10T05:38:23.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.320+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f69d0069070 con 0x55e6bdd5c920 2024-09-10T05:38:23.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.320+0000 7f69dd714640 1 -- 172.21.15.62:0/2119593100 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d0067040 con 0x55e6bdd5c920 2024-09-10T05:38:23.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.320+0000 7f69dd714640 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f69d0069070 con 0x55e6bdd5fe30 2024-09-10T05:38:23.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.320+0000 7f69dcf13640 1 -- 172.21.15.62:0/2119593100 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69c80b3040 con 0x55e6bdd5fe30 2024-09-10T05:38:23.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.320+0000 7f69dcf13640 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f69d0069070 con 0x55e6bdd58470 2024-09-10T05:38:23.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.320+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d80083f0 con 0x55e6bdd58470 2024-09-10T05:38:23.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.320+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f69d0069070 con 0x55e6bdd5c920 2024-09-10T05:38:23.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.320+0000 7f69dd714640 1 -- 172.21.15.62:0/2119593100 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d0067040 con 0x55e6bdd5c920 2024-09-10T05:38:23.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.320+0000 7f69dd714640 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f69d0069070 con 0x55e6bdd5fe30 2024-09-10T05:38:23.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.320+0000 7f69dcf13640 1 -- 172.21.15.62:0/2119593100 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 34 out=170b] v34'5 uv5 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f69c80b3040 con 0x55e6bdd5fe30 2024-09-10T05:38:23.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.320+0000 7f69dcf13640 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f69d0069070 con 0x55e6bdd58470 2024-09-10T05:38:23.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.320+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d80083f0 con 0x55e6bdd58470 2024-09-10T05:38:23.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.320+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f69d0069070 con 0x55e6bdd58470 2024-09-10T05:38:23.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.324+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f69d80083f0 con 0x55e6bdd58470 2024-09-10T05:38:23.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.324+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f69d0069070 con 0x55e6bdd58470 2024-09-10T05:38:23.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.324+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d80083f0 con 0x55e6bdd58470 2024-09-10T05:38:23.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.324+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f69d0069070 con 0x55e6bdd5fe30 2024-09-10T05:38:23.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.324+0000 7f69dcf13640 1 -- 172.21.15.62:0/2119593100 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69c80b3040 con 0x55e6bdd5fe30 2024-09-10T05:38:23.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.324+0000 7f69dcf13640 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f69d0069070 con 0x7f69d00146f0 2024-09-10T05:38:23.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.324+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d80083f0 con 0x7f69d00146f0 2024-09-10T05:38:23.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.324+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f69d0069070 con 0x55e6bdd58470 2024-09-10T05:38:23.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.324+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d80083f0 con 0x55e6bdd58470 2024-09-10T05:38:23.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.324+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f69d0069070 con 0x7f69d00146f0 2024-09-10T05:38:23.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.324+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d80083f0 con 0x7f69d00146f0 2024-09-10T05:38:23.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.324+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f69d0069070 con 0x55e6bdd5fe30 2024-09-10T05:38:23.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.324+0000 7f69dcf13640 1 -- 172.21.15.62:0/2119593100 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69c80b3040 con 0x55e6bdd5fe30 2024-09-10T05:38:23.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.324+0000 7f69dcf13640 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f69d0069070 con 0x7f69d00146f0 2024-09-10T05:38:23.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.324+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d80083f0 con 0x7f69d00146f0 2024-09-10T05:38:23.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.324+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f69d0069070 con 0x55e6bdd5c920 2024-09-10T05:38:23.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.324+0000 7f69dd714640 1 -- 172.21.15.62:0/2119593100 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d0067040 con 0x55e6bdd5c920 2024-09-10T05:38:23.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.324+0000 7f69dd714640 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f69d0089040 con 0x55e6bdd5c920 2024-09-10T05:38:23.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.324+0000 7f69dd714640 1 -- 172.21.15.62:0/2119593100 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d0067040 con 0x55e6bdd5c920 2024-09-10T05:38:23.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.324+0000 7f69dd714640 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f69d0089040 con 0x55e6bdd5fe30 2024-09-10T05:38:23.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.328+0000 7f69dcf13640 1 -- 172.21.15.62:0/2119593100 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69c80b3040 con 0x55e6bdd5fe30 2024-09-10T05:38:23.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.328+0000 7f69dcf13640 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f69d0089040 con 0x55e6bdd5c920 2024-09-10T05:38:23.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.328+0000 7f69dd714640 1 -- 172.21.15.62:0/2119593100 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f69d0067040 con 0x55e6bdd5c920 2024-09-10T05:38:23.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.328+0000 7f69dd714640 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f69d0089040 con 0x55e6bdd5c920 2024-09-10T05:38:23.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.328+0000 7f69dd714640 1 -- 172.21.15.62:0/2119593100 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d0067040 con 0x55e6bdd5c920 2024-09-10T05:38:23.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.328+0000 7f69dfc0e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:38:23.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.328+0000 7f69dfc0e9c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:38:23.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.328+0000 7f69dfc0e9c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:38:23.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.328+0000 7f69dfc0e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:38:23.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.328+0000 7f69dfc0e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:38:23.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.328+0000 7f69dfc0e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:38:23.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.328+0000 7f69dfc0e9c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.328+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6bdd632b0 con 0x55e6bdd58470 2024-09-10T05:38:23.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.328+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69d80083f0 con 0x55e6bdd58470 2024-09-10T05:38:23.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.328+0000 7f69dfc0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:23.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.328+0000 7f69dfc0e9c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.328+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6bdd62ef0 con 0x55e6bdd5c920 2024-09-10T05:38:23.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.328+0000 7f69dd714640 1 -- 172.21.15.62:0/2119593100 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f69d0067040 con 0x55e6bdd5c920 2024-09-10T05:38:23.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.328+0000 7f69dfc0e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:38:23.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.328+0000 7f69dfc0e9c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.328+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6bdd62f00 con 0x55e6bdd5fe30 2024-09-10T05:38:23.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.328+0000 7f69dcf13640 1 -- 172.21.15.62:0/2119593100 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f69c80b3040 con 0x55e6bdd5fe30 2024-09-10T05:38:23.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.328+0000 7f69dfc0e9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:38:23.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.328+0000 7f69dfc0e9c0 20 zone default found 2024-09-10T05:38:23.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.328+0000 7f69dfc0e9c0 4 Realm: () 2024-09-10T05:38:23.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.328+0000 7f69dfc0e9c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:38:23.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.328+0000 7f69dfc0e9c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:38:23.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.328+0000 7f69dfc0e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:38:23.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.328+0000 7f69dfc0e9c0 20 zonegroup default 2024-09-10T05:38:23.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.328+0000 7f69dfc0e9c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.328+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6bdd64150 con 0x7f69d00146f0 2024-09-10T05:38:23.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.328+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f69d80083f0 con 0x7f69d00146f0 2024-09-10T05:38:23.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.328+0000 7f69dfc0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:23.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.328+0000 7f69dfc0e9c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.332+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6bdd66510 con 0x55e6bdd5fe30 2024-09-10T05:38:23.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.332+0000 7f69dcf13640 1 -- 172.21.15.62:0/2119593100 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f69c80b3040 con 0x55e6bdd5fe30 2024-09-10T05:38:23.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.332+0000 7f69dfc0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:23.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.332+0000 7f69dfc0e9c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.332+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6bdd668b0 con 0x55e6bdd5fe30 2024-09-10T05:38:23.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.332+0000 7f69dcf13640 1 -- 172.21.15.62:0/2119593100 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f69c80b3040 con 0x55e6bdd5fe30 2024-09-10T05:38:23.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.332+0000 7f69dfc0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:23.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.332+0000 7f69dfc0e9c0 20 started sync module instance, tier type = 2024-09-10T05:38:23.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.332+0000 7f69dfc0e9c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:38:23.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.332+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6bdd659a0 con 0x55e6bdd5c920 2024-09-10T05:38:23.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.332+0000 7f69dd714640 1 -- 172.21.15.62:0/2119593100 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d0067040 con 0x55e6bdd5c920 2024-09-10T05:38:23.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.332+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94449515781840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6bdd659a0 con 0x55e6bdd5c920 2024-09-10T05:38:23.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.332+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6bdd672e0 con 0x55e6bdd58470 2024-09-10T05:38:23.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.336+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d80083f0 con 0x55e6bdd58470 2024-09-10T05:38:23.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.336+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94449515785776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6bdd67b30 con 0x55e6bdd58470 2024-09-10T05:38:23.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.336+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6bdd68530 con 0x55e6bdd5c920 2024-09-10T05:38:23.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.336+0000 7f69dd714640 1 -- 172.21.15.62:0/2119593100 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94449515781840] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d0067040 con 0x55e6bdd5c920 2024-09-10T05:38:23.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.336+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94449515785776] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d80083f0 con 0x55e6bdd58470 2024-09-10T05:38:23.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.336+0000 7f69dd714640 1 -- 172.21.15.62:0/2119593100 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d0067040 con 0x55e6bdd5c920 2024-09-10T05:38:23.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.336+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94449515779312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6bdd67680 con 0x55e6bdd5c920 2024-09-10T05:38:23.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.336+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6bdd68e00 con 0x7f69d00146f0 2024-09-10T05:38:23.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.340+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d80083f0 con 0x7f69d00146f0 2024-09-10T05:38:23.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.340+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94449515792720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6bdd67680 con 0x7f69d00146f0 2024-09-10T05:38:23.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.340+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6bdd69840 con 0x55e6bdd5c920 2024-09-10T05:38:23.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.340+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94449515792720] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d80083f0 con 0x7f69d00146f0 2024-09-10T05:38:23.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.340+0000 7f69dd714640 1 -- 172.21.15.62:0/2119593100 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94449515779312] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d0067040 con 0x55e6bdd5c920 2024-09-10T05:38:23.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.340+0000 7f69dd714640 1 -- 172.21.15.62:0/2119593100 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d0067040 con 0x55e6bdd5c920 2024-09-10T05:38:23.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.340+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94449515790400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6bdd69390 con 0x55e6bdd5c920 2024-09-10T05:38:23.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.340+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6bdd6a0e0 con 0x55e6bdd5fe30 2024-09-10T05:38:23.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.340+0000 7f69dcf13640 1 -- 172.21.15.62:0/2119593100 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69c80b3040 con 0x55e6bdd5fe30 2024-09-10T05:38:23.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.340+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94449515797552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6bdd69390 con 0x55e6bdd5fe30 2024-09-10T05:38:23.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.340+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6bdd6ab60 con 0x55e6bdd5fe30 2024-09-10T05:38:23.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.344+0000 7f69dd714640 1 -- 172.21.15.62:0/2119593100 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94449515790400] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d0067040 con 0x55e6bdd5c920 2024-09-10T05:38:23.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.344+0000 7f69dcf13640 1 -- 172.21.15.62:0/2119593100 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94449515797552] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69c80b3040 con 0x55e6bdd5fe30 2024-09-10T05:38:23.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.344+0000 7f69dcf13640 1 -- 172.21.15.62:0/2119593100 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69c80b3040 con 0x55e6bdd5fe30 2024-09-10T05:38:23.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.344+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94449515798608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6bdd6a670 con 0x55e6bdd5fe30 2024-09-10T05:38:23.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.344+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6bdd6b400 con 0x7f69d00146f0 2024-09-10T05:38:23.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.344+0000 7f69dcf13640 1 -- 172.21.15.62:0/2119593100 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94449515798608] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69c80b3040 con 0x55e6bdd5fe30 2024-09-10T05:38:23.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.344+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d80083f0 con 0x7f69d00146f0 2024-09-10T05:38:23.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.344+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94449515793776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6bdd6a670 con 0x7f69d00146f0 2024-09-10T05:38:23.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.344+0000 7f69dfc0e9c0 20 add_watcher() i=0 2024-09-10T05:38:23.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.344+0000 7f69dfc0e9c0 20 add_watcher() i=1 2024-09-10T05:38:23.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.344+0000 7f69dfc0e9c0 20 add_watcher() i=2 2024-09-10T05:38:23.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.344+0000 7f69dfc0e9c0 20 add_watcher() i=3 2024-09-10T05:38:23.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.344+0000 7f69dfc0e9c0 20 add_watcher() i=4 2024-09-10T05:38:23.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.344+0000 7f69dfc0e9c0 20 add_watcher() i=5 2024-09-10T05:38:23.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.344+0000 7f69dfc0e9c0 20 add_watcher() i=6 2024-09-10T05:38:23.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.348+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94449515793776] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d80083f0 con 0x7f69d00146f0 2024-09-10T05:38:23.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.348+0000 7f69dfc0e9c0 20 add_watcher() i=7 2024-09-10T05:38:23.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.348+0000 7f69dfc0e9c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:38:23.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.348+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6bdd6e4c0 con 0x55e6bdd58470 2024-09-10T05:38:23.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.348+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f69d80083f0 con 0x55e6bdd58470 2024-09-10T05:38:23.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.348+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94449515802448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6bdd6b9b0 con 0x55e6bdd58470 2024-09-10T05:38:23.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.348+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94449515802448] v34'250 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f69d80083f0 con 0x55e6bdd58470 2024-09-10T05:38:23.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.348+0000 7f68937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:38:23.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.348+0000 7f69dfc0e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:38:23.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.348+0000 7f69dfc0e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:38:23.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.348+0000 7f69dfc0e9c0 5 note: GC not initialized 2024-09-10T05:38:23.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.348+0000 7f68927e4640 20 reqs_thread_entry: start 2024-09-10T05:38:23.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.348+0000 7f69dfc0e9c0 20 init_complete bucket index max shards: 11 2024-09-10T05:38:23.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.348+0000 7f69dfc0e9c0 20 Filter name: none 2024-09-10T05:38:23.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.348+0000 7f6803fff640 20 reqs_thread_entry: start 2024-09-10T05:38:23.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.352+0000 7f69dfc0e9c0 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-10T05:38:23.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.352+0000 7f69dfc0e9c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.352+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:62 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6bdd91760 con 0x55e6bdd5fe30 2024-09-10T05:38:23.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.352+0000 7f69dcf13640 1 -- 172.21.15.62:0/2119593100 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(62 system_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 239+0+0 (crc 0 0 0) 0x7f69c80b3040 con 0x55e6bdd5fe30 2024-09-10T05:38:23.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.352+0000 7f69dfc0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:23.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.352+0000 7f69dfc0e9c0 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x0 2024-09-10T05:38:23.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.352+0000 7f69dfc0e9c0 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-10T05:38:23.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.352+0000 7f69dfc0e9c0 10 cache get: name=default.rgw.meta+users.keys+system_akey : miss 2024-09-10T05:38:23.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.352+0000 7f69dfc0e9c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.352+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:63 8.0 8:01223cbf:users.keys::system_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6bdd8fe00 con 0x55e6bdd5fe30 2024-09-10T05:38:23.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.352+0000 7f69dcf13640 1 -- 172.21.15.62:0/2119593100 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(63 system_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f69c80b3040 con 0x55e6bdd5fe30 2024-09-10T05:38:23.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.352+0000 7f69dfc0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:23.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.352+0000 7f69dfc0e9c0 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x0 2024-09-10T05:38:23.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.352+0000 7f69dfc0e9c0 10 adding default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-10T05:38:23.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.352+0000 7f69dfc0e9c0 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-10T05:38:23.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.352+0000 7f69dfc0e9c0 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-10T05:38:23.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.352+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:64 8.1e 8:78ce4db0:users.uid::system_user:head [delete,create,call version.set in=58b,writefull 0~349 in=349b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6bdd906d0 con 0x55e6bdd5fe30 2024-09-10T05:38:23.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.352+0000 7f69dcf13640 1 -- 172.21.15.62:0/2119593100 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== osd_op_reply(64 system_user [delete,create,call,writefull 0~349] v34'3 uv3 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f69c80b3040 con 0x55e6bdd5fe30 2024-09-10T05:38:23.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.352+0000 7f69dfc0e9c0 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-10T05:38:23.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.352+0000 7f69dfc0e9c0 10 moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-10T05:38:23.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.352+0000 7f69dfc0e9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-10T05:38:23.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.352+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94449515954720 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6bdd95200 con 0x55e6bdd5c920 2024-09-10T05:38:23.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.356+0000 7f69dd714640 1 -- 172.21.15.62:0/2119593100 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== watch-notify(notify (1) cookie 94449515781840 notify 146028888111 ret 0) ==== 575+0+0 (crc 0 0 0) 0x55e6bdd3a6a0 con 0x55e6bdd5c920 2024-09-10T05:38:23.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.356+0000 7f68c0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888111 cookie 94449515781840 notifier 4843 bl.length()=533 2024-09-10T05:38:23.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.356+0000 7f69dd714640 1 -- 172.21.15.62:0/2119593100 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(65 notify.0 [notify cookie 94449515954720 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f69d0067040 con 0x55e6bdd5c920 2024-09-10T05:38:23.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.356+0000 7f68c0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-10T05:38:23.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.356+0000 7f68c0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-10T05:38:23.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.356+0000 7f68c0ff9640 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f68a0003eb0 con 0x55e6bdd5c920 2024-09-10T05:38:23.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.356+0000 7f69dd714640 1 -- 172.21.15.62:0/2119593100 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(66 notify.0 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d0067040 con 0x55e6bdd5c920 2024-09-10T05:38:23.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.356+0000 7f69dd714640 1 -- 172.21.15.62:0/2119593100 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== watch-notify(notify_complete (2) cookie 94449515954720 notify 146028888111 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f69d003b070 con 0x55e6bdd5c920 2024-09-10T05:38:23.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.356+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:67 8.0 8:01223cbf:users.keys::system_akey:head [delete,create,writefull 0~15 in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6bdd90220 con 0x55e6bdd5fe30 2024-09-10T05:38:23.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.360+0000 7f69dcf13640 1 -- 172.21.15.62:0/2119593100 <== osd.3 v2:172.21.15.62:6816/2708991149 19 ==== osd_op_reply(67 system_akey [delete,create,writefull 0~15] v34'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f69c80b3040 con 0x55e6bdd5fe30 2024-09-10T05:38:23.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.360+0000 7f69dfc0e9c0 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-10T05:38:23.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.360+0000 7f69dfc0e9c0 10 moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-10T05:38:23.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.360+0000 7f69dfc0e9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-10T05:38:23.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.360+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify cookie 94449515954640 in=188b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6bdd95200 con 0x55e6bdd58470 2024-09-10T05:38:23.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.360+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== watch-notify(notify (1) cookie 94449515785776 notify 146028888066 ret 0) ==== 218+0+0 (crc 0 0 0) 0x7f69d802a7e0 con 0x55e6bdd58470 2024-09-10T05:38:23.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.360+0000 7f68c0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888066 cookie 94449515785776 notifier 4843 bl.length()=176 2024-09-10T05:38:23.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.360+0000 7f68c0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-10T05:38:23.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.360+0000 7f68c0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-10T05:38:23.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.360+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(68 notify.1 [notify cookie 94449515954640 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f69d80083f0 con 0x55e6bdd58470 2024-09-10T05:38:23.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.360+0000 7f68c0ff9640 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f68a0003eb0 con 0x55e6bdd58470 2024-09-10T05:38:23.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.360+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(69 notify.1 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d80083f0 con 0x55e6bdd58470 2024-09-10T05:38:23.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.360+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== watch-notify(notify_complete (2) cookie 94449515954640 notify 146028888066 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f69d802aa80 con 0x55e6bdd58470 2024-09-10T05:38:23.363 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"system_user","display_name":"System User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"system_user","access_key":"system_akey","secret_key":"system_skey","active":true,"create_date":"2024-09-10T05:38:23.354551Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","system":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:38:23.354534Z","tags":[],"group_ids":[]} 2024-09-10T05:38:23.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.360+0000 7f68937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:38:23.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.360+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94449515802448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6bdd8f540 con 0x55e6bdd58470 2024-09-10T05:38:23.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.364+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 <== osd.1 v2:172.21.15.62:6808/3442097179 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94449515802448] v34'251 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f69d80083f0 con 0x55e6bdd58470 2024-09-10T05:38:23.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.364+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94449515781840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6bdd8f540 con 0x55e6bdd5c920 2024-09-10T05:38:23.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.364+0000 7f69dd714640 1 -- 172.21.15.62:0/2119593100 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94449515781840] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d0067040 con 0x55e6bdd5c920 2024-09-10T05:38:23.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.364+0000 7f69dfc0e9c0 20 remove_watcher() i=0 2024-09-10T05:38:23.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.364+0000 7f69dfc0e9c0 2 removed watcher, disabling cache 2024-09-10T05:38:23.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.364+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94449515785776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6bdd8f540 con 0x55e6bdd58470 2024-09-10T05:38:23.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.368+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 <== osd.1 v2:172.21.15.62:6808/3442097179 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94449515785776] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d80083f0 con 0x55e6bdd58470 2024-09-10T05:38:23.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.368+0000 7f69dfc0e9c0 20 remove_watcher() i=1 2024-09-10T05:38:23.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.368+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94449515779312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6bdd8f540 con 0x55e6bdd5c920 2024-09-10T05:38:23.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.368+0000 7f69dd714640 1 -- 172.21.15.62:0/2119593100 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94449515779312] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d0067040 con 0x55e6bdd5c920 2024-09-10T05:38:23.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.368+0000 7f69dfc0e9c0 20 remove_watcher() i=2 2024-09-10T05:38:23.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.368+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94449515792720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6bdd8f540 con 0x7f69d00146f0 2024-09-10T05:38:23.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.372+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94449515792720] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d80083f0 con 0x7f69d00146f0 2024-09-10T05:38:23.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.372+0000 7f69dfc0e9c0 20 remove_watcher() i=3 2024-09-10T05:38:23.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.372+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94449515790400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6bdd8f540 con 0x55e6bdd5c920 2024-09-10T05:38:23.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.372+0000 7f69dd714640 1 -- 172.21.15.62:0/2119593100 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94449515790400] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d0067040 con 0x55e6bdd5c920 2024-09-10T05:38:23.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.372+0000 7f69dfc0e9c0 20 remove_watcher() i=4 2024-09-10T05:38:23.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.372+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94449515797552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6bdd8f540 con 0x55e6bdd5fe30 2024-09-10T05:38:23.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.376+0000 7f69dcf13640 1 -- 172.21.15.62:0/2119593100 <== osd.3 v2:172.21.15.62:6816/2708991149 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94449515797552] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69c80b3040 con 0x55e6bdd5fe30 2024-09-10T05:38:23.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.376+0000 7f69dfc0e9c0 20 remove_watcher() i=5 2024-09-10T05:38:23.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.376+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94449515798608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6bdd8f540 con 0x55e6bdd5fe30 2024-09-10T05:38:23.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.376+0000 7f69dcf13640 1 -- 172.21.15.62:0/2119593100 <== osd.3 v2:172.21.15.62:6816/2708991149 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94449515798608] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69c80b3040 con 0x55e6bdd5fe30 2024-09-10T05:38:23.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.376+0000 7f69dfc0e9c0 20 remove_watcher() i=6 2024-09-10T05:38:23.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.376+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94449515793776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6bdd8f540 con 0x7f69d00146f0 2024-09-10T05:38:23.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.376+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94449515793776] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d80083f0 con 0x7f69d00146f0 2024-09-10T05:38:23.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.376+0000 7f69dfc0e9c0 20 remove_watcher() i=7 2024-09-10T05:38:23.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.376+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e6bdd5c920 msgr2=0x55e6bdd5ed10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.376+0000 7f69dfc0e9c0 1 --2- 172.21.15.62:0/2119593100 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e6bdd5c920 0x55e6bdd5ed10 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.376+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55e6bdd58470 msgr2=0x55e6bdd5a930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.376+0000 7f69dfc0e9c0 1 --2- 172.21.15.62:0/2119593100 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55e6bdd58470 0x55e6bdd5a930 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.376+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f69d00146f0 msgr2=0x7f69d005f420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.376+0000 7f69dfc0e9c0 1 --2- 172.21.15.62:0/2119593100 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f69d00146f0 0x7f69d005f420 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.376+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55e6bdd5fe30 msgr2=0x55e6bdd62220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.376+0000 7f69dfc0e9c0 1 --2- 172.21.15.62:0/2119593100 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55e6bdd5fe30 0x55e6bdd62220 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.376+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f68a8039a20 msgr2=0x7f68a803bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.376+0000 7f69dfc0e9c0 1 --2- 172.21.15.62:0/2119593100 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f68a8039a20 0x7f68a803bee0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f69c8018eb0 tx=0x7f69c80a6000 comp rx=0 tx=0).stop 2024-09-10T05:38:23.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.376+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6bdd461b0 msgr2=0x55e6bdd4d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.376+0000 7f69dfc0e9c0 1 --2- 172.21.15.62:0/2119593100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6bdd461b0 0x55e6bdd4d4e0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f69d0042c40 tx=0x7f69d0017e90 comp rx=0 tx=0).stop 2024-09-10T05:38:23.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.376+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 reap_dead start 2024-09-10T05:38:23.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.376+0000 7f69ddf15640 1 -- 172.21.15.62:0/2119593100 reap_dead start 2024-09-10T05:38:23.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.376+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 shutdown_connections 2024-09-10T05:38:23.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.376+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 >> 172.21.15.62:0/2119593100 conn(0x55e6bdd425e0 msgr2=0x55e6bdd407f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:23.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.376+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 shutdown_connections 2024-09-10T05:38:23.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.376+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2119593100 wait complete. 2024-09-10T05:38:23.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.380+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2714984210 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f68b4039a70 msgr2=0x7f68b403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.380+0000 7f69dfc0e9c0 1 --2- 172.21.15.62:0/2714984210 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f68b4039a70 0x7f68b403bf30 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x55e6bdd1d3d0 tx=0x7f69c8005a10 comp rx=0 tx=0).stop 2024-09-10T05:38:23.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.380+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2714984210 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6bdd39c40 msgr2=0x55e6bdd3a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.380+0000 7f69dfc0e9c0 1 --2- 172.21.15.62:0/2714984210 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6bdd39c40 0x55e6bdd3a060 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f69d0010a40 tx=0x7f69d0012b20 comp rx=0 tx=0).stop 2024-09-10T05:38:23.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.380+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2714984210 shutdown_connections 2024-09-10T05:38:23.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.380+0000 7f69dfc0e9c0 1 --2- 172.21.15.62:0/2714984210 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f68b4039a70 0x7f68b403bf30 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.380+0000 7f69dfc0e9c0 1 --2- 172.21.15.62:0/2714984210 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6bdd39c40 0x55e6bdd3a060 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.380+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2714984210 >> 172.21.15.62:0/2714984210 conn(0x55e6bdd2f5f0 msgr2=0x55e6bdd2f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:23.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.380+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2714984210 shutdown_connections 2024-09-10T05:38:23.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.380+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/2714984210 wait complete. 2024-09-10T05:38:23.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.380+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/1603099297 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e6bdd24390 msgr2=0x55e6bdd26780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.380+0000 7f69dfc0e9c0 1 --2- 172.21.15.62:0/1603099297 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e6bdd24390 0x55e6bdd26780 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.380+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/1603099297 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55e6bdb9b560 msgr2=0x55e6bdd230f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.380+0000 7f69dfc0e9c0 1 --2- 172.21.15.62:0/1603099297 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55e6bdb9b560 0x55e6bdd230f0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.380+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/1603099297 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55e6bdd28b30 msgr2=0x55e6bdd2af20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.380+0000 7f69dfc0e9c0 1 --2- 172.21.15.62:0/1603099297 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55e6bdd28b30 0x55e6bdd2af20 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.380+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/1603099297 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f68c4039a70 msgr2=0x7f68c403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.380+0000 7f69dfc0e9c0 1 --2- 172.21.15.62:0/1603099297 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f68c4039a70 0x7f68c403bf30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f69c80ad000 tx=0x7f69c80a5040 comp rx=0 tx=0).stop 2024-09-10T05:38:23.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.380+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/1603099297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6bdb9b180 msgr2=0x55e6bdd1bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.380+0000 7f69dfc0e9c0 1 --2- 172.21.15.62:0/1603099297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6bdb9b180 0x55e6bdd1bf80 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f69d0006a50 tx=0x7f69d0000f50 comp rx=0 tx=0).stop 2024-09-10T05:38:23.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.380+0000 7f69ddf15640 1 -- 172.21.15.62:0/1603099297 reap_dead start 2024-09-10T05:38:23.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.380+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/1603099297 shutdown_connections 2024-09-10T05:38:23.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.380+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/1603099297 >> 172.21.15.62:0/1603099297 conn(0x55e6bdc218a0 msgr2=0x55e6bdd0efb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:23.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.380+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/1603099297 shutdown_connections 2024-09-10T05:38:23.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.380+0000 7f69dfc0e9c0 1 -- 172.21.15.62:0/1603099297 wait complete. 2024-09-10T05:38:23.393 DEBUG:tasks.util.rgw: json result: {'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-10T05:38:23.354551Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:38:23.354534Z', 'tags': [], 'group_ids': []} 2024-09-10T05:38:23.394 ERROR:root:{'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-10T05:38:23.354551Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:38:23.354534Z', 'tags': [], 'group_ids': []} 2024-09-10T05:38:23.394 ERROR:root:0 2024-09-10T05:38:23.395 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T05:38:23.399 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T05:38:23.399 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'system_user'] 2024-09-10T05:38:23.399 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'system_user'] 2024-09-10T05:38:23.399 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid system_user 2024-09-10T05:38:23.430 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:38:23.430 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:38:23.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.428+0000 7f96909829c0 1 Processor -- start 2024-09-10T05:38:23.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.428+0000 7f96909829c0 1 -- start start 2024-09-10T05:38:23.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.428+0000 7f96909829c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55d8042d1240 0x55d80435fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.428+0000 7f96909829c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d8042119c0 con 0x55d804360130 2024-09-10T05:38:23.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.428+0000 7f96909829c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x55d8042616d0 con 0x55d8042d1240 2024-09-10T05:38:23.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.428+0000 7f968e488640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55d8042d1240 0x55d80435fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.428+0000 7f968e488640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55d8042d1240 0x55d80435fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38772/0 (socket says 172.21.15.62:38772) 2024-09-10T05:38:23.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.428+0000 7f968e488640 1 -- 172.21.15.62:0/3224902552 learned_addr learned my addr 172.21.15.62:0/3224902552 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:23.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.428+0000 7f968e488640 1 -- 172.21.15.62:0/3224902552 >> v1:172.21.15.2:6789/0 conn(0x55d804360130 legacy=0x55d804362520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.428+0000 7f968e488640 1 -- 172.21.15.62:0/3224902552 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d804205ca0 con 0x55d8042d1240 2024-09-10T05:38:23.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.432+0000 7f968e488640 1 --2- 172.21.15.62:0/3224902552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d8042d1240 0x55d80435fbf0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f968000a5c0 tx=0x7f968001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a014b412de2a1c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.432+0000 7f968d486640 1 -- 172.21.15.62:0/3224902552 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96800b1070 con 0x55d8042d1240 2024-09-10T05:38:23.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.432+0000 7f968d486640 1 -- 172.21.15.62:0/3224902552 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96800a8070 con 0x55d8042d1240 2024-09-10T05:38:23.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.432+0000 7f968d486640 1 -- 172.21.15.62:0/3224902552 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96800ac5b0 con 0x55d8042d1240 2024-09-10T05:38:23.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.432+0000 7f96909829c0 1 -- 172.21.15.62:0/3224902552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d8042d1240 msgr2=0x55d80435fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.432+0000 7f96909829c0 1 --2- 172.21.15.62:0/3224902552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d8042d1240 0x55d80435fbf0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f968000a5c0 tx=0x7f968001b340 comp rx=0 tx=0).stop 2024-09-10T05:38:23.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.432+0000 7f96909829c0 1 -- 172.21.15.62:0/3224902552 shutdown_connections 2024-09-10T05:38:23.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.432+0000 7f96909829c0 1 --2- 172.21.15.62:0/3224902552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d8042d1240 0x55d80435fbf0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.432+0000 7f96909829c0 1 -- 172.21.15.62:0/3224902552 >> 172.21.15.62:0/3224902552 conn(0x55d804357920 msgr2=0x55d804359d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:23.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.432+0000 7f96909829c0 1 -- 172.21.15.62:0/3224902552 shutdown_connections 2024-09-10T05:38:23.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.432+0000 7f96909829c0 1 -- 172.21.15.62:0/3224902552 wait complete. 2024-09-10T05:38:23.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.448+0000 7f96909829c0 1 Processor -- start 2024-09-10T05:38:23.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.448+0000 7f96909829c0 1 -- start start 2024-09-10T05:38:23.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.448+0000 7f96909829c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d8042d1240 0x55d80435d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.448+0000 7f96909829c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d804265680 con 0x55d8042d1240 2024-09-10T05:38:23.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.448+0000 7f968e488640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d8042d1240 0x55d80435d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.448+0000 7f968e488640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d8042d1240 0x55d80435d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38788/0 (socket says 172.21.15.62:38788) 2024-09-10T05:38:23.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.448+0000 7f968e488640 1 -- 172.21.15.62:0/730862242 learned_addr learned my addr 172.21.15.62:0/730862242 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:23.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.448+0000 7f968e488640 1 -- 172.21.15.62:0/730862242 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8041e0da0 con 0x55d8042d1240 2024-09-10T05:38:23.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.448+0000 7f968e488640 1 --2- 172.21.15.62:0/730862242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d8042d1240 0x55d80435d150 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f96800af040 tx=0x7f9680003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac56ac83ab57e67a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.448+0000 7f957c608640 1 -- 172.21.15.62:0/730862242 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96800b1040 con 0x55d8042d1240 2024-09-10T05:38:23.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.448+0000 7f957c608640 1 -- 172.21.15.62:0/730862242 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96800ac820 con 0x55d8042d1240 2024-09-10T05:38:23.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.448+0000 7f957c608640 1 -- 172.21.15.62:0/730862242 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96800acb00 con 0x55d8042d1240 2024-09-10T05:38:23.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.452+0000 7f96909829c0 1 -- 172.21.15.62:0/730862242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d8042d1240 msgr2=0x55d80435d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.452+0000 7f96909829c0 1 --2- 172.21.15.62:0/730862242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d8042d1240 0x55d80435d150 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f96800af040 tx=0x7f9680003030 comp rx=0 tx=0).stop 2024-09-10T05:38:23.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.452+0000 7f96909829c0 1 -- 172.21.15.62:0/730862242 shutdown_connections 2024-09-10T05:38:23.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.452+0000 7f96909829c0 1 --2- 172.21.15.62:0/730862242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d8042d1240 0x55d80435d150 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.452+0000 7f96909829c0 1 -- 172.21.15.62:0/730862242 >> 172.21.15.62:0/730862242 conn(0x55d804357920 msgr2=0x55d804444400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:23.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.452+0000 7f96909829c0 1 -- 172.21.15.62:0/730862242 shutdown_connections 2024-09-10T05:38:23.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.452+0000 7f96909829c0 1 -- 172.21.15.62:0/730862242 wait complete. 2024-09-10T05:38:23.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.452+0000 7f96909829c0 1 Processor -- start 2024-09-10T05:38:23.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.452+0000 7f96909829c0 1 -- start start 2024-09-10T05:38:23.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.452+0000 7f96909829c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d8042d1240 0x55d804451f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.452+0000 7f96909829c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d804207a50 con 0x55d8042d1240 2024-09-10T05:38:23.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.452+0000 7f968e488640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d8042d1240 0x55d804451f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.452+0000 7f968e488640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d8042d1240 0x55d804451f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38798/0 (socket says 172.21.15.62:38798) 2024-09-10T05:38:23.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.452+0000 7f968e488640 1 -- 172.21.15.62:0/2867714672 learned_addr learned my addr 172.21.15.62:0/2867714672 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:23.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.452+0000 7f968e488640 1 -- 172.21.15.62:0/2867714672 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8044524f0 con 0x55d8042d1240 2024-09-10T05:38:23.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.452+0000 7f968e488640 1 --2- 172.21.15.62:0/2867714672 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d8042d1240 0x55d804451f90 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f9680018f70 tx=0x7f9680019b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.452+0000 7f957ae05640 1 -- 172.21.15.62:0/2867714672 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96800cd070 con 0x55d8042d1240 2024-09-10T05:38:23.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.452+0000 7f96909829c0 1 -- 172.21.15.62:0/2867714672 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d804452780 con 0x55d8042d1240 2024-09-10T05:38:23.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.452+0000 7f957ae05640 1 -- 172.21.15.62:0/2867714672 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96800b7a20 con 0x55d8042d1240 2024-09-10T05:38:23.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.452+0000 7f957ae05640 1 -- 172.21.15.62:0/2867714672 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96800b1070 con 0x55d8042d1240 2024-09-10T05:38:23.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.452+0000 7f96909829c0 1 -- 172.21.15.62:0/2867714672 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d804453130 con 0x55d8042d1240 2024-09-10T05:38:23.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.452+0000 7f957ae05640 1 -- 172.21.15.62:0/2867714672 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f96800d0070 con 0x55d8042d1240 2024-09-10T05:38:23.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.456+0000 7f957ae05640 1 --2- 172.21.15.62:0/2867714672 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f9574039a70 0x7f957403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.456+0000 7f957ae05640 1 -- 172.21.15.62:0/2867714672 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7f96800eb130 con 0x55d8042d1240 2024-09-10T05:38:23.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.456+0000 7f968dc87640 1 --2- 172.21.15.62:0/2867714672 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f9574039a70 0x7f957403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.456+0000 7f96909829c0 1 --2- 172.21.15.62:0/2867714672 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55d804360130 0x55d804459100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.456+0000 7f96909829c0 1 -- 172.21.15.62:0/2867714672 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d804459640 con 0x55d804360130 2024-09-10T05:38:23.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.456+0000 7f968ec89640 1 --2- 172.21.15.62:0/2867714672 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55d804360130 0x55d804459100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.456+0000 7f968dc87640 1 --2- 172.21.15.62:0/2867714672 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f9574039a70 0x7f957403bf30 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9684001e60 tx=0x7f96840013e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.456+0000 7f968ec89640 1 --2- 172.21.15.62:0/2867714672 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55d804360130 0x55d804459100 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.456+0000 7f968ec89640 1 -- 172.21.15.62:0/2867714672 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f968800a4d0 con 0x55d804360130 2024-09-10T05:38:23.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.456+0000 7f96909829c0 1 --2- 172.21.15.62:0/2867714672 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55d80445a130 0x55d80445c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.456+0000 7f96909829c0 1 -- 172.21.15.62:0/2867714672 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d80445cd60 con 0x55d80445a130 2024-09-10T05:38:23.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.456+0000 7f968e488640 1 --2- 172.21.15.62:0/2867714672 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55d80445a130 0x55d80445c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.456+0000 7f968e488640 1 --2- 172.21.15.62:0/2867714672 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55d80445a130 0x55d80445c5f0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.456+0000 7f968e488640 1 -- 172.21.15.62:0/2867714672 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f96800cf030 con 0x55d80445a130 2024-09-10T05:38:23.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.456+0000 7f96909829c0 1 --2- 172.21.15.62:0/2867714672 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55d80445eb20 0x55d804460f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.456+0000 7f96909829c0 1 -- 172.21.15.62:0/2867714672 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8044615b0 con 0x55d80445eb20 2024-09-10T05:38:23.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.456+0000 7f968dc87640 1 --2- 172.21.15.62:0/2867714672 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55d80445eb20 0x55d804460f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.456+0000 7f968dc87640 1 --2- 172.21.15.62:0/2867714672 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55d80445eb20 0x55d804460f10 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.460+0000 7f968dc87640 1 -- 172.21.15.62:0/2867714672 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv5 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f968400d040 con 0x55d80445eb20 2024-09-10T05:38:23.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.460+0000 7f96909829c0 1 -- 172.21.15.62:0/2867714672 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d80445d9c0 con 0x55d80445a130 2024-09-10T05:38:23.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.460+0000 7f968e488640 1 -- 172.21.15.62:0/2867714672 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f96800cf030 con 0x55d80445a130 2024-09-10T05:38:23.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.460+0000 7f96909829c0 1 -- 172.21.15.62:0/2867714672 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d80445de60 con 0x55d80445eb20 2024-09-10T05:38:23.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.460+0000 7f968dc87640 1 -- 172.21.15.62:0/2867714672 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f968400d040 con 0x55d80445eb20 2024-09-10T05:38:23.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.460+0000 7f96909829c0 1 Processor -- start 2024-09-10T05:38:23.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.460+0000 7f96909829c0 1 -- start start 2024-09-10T05:38:23.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.460+0000 7f96909829c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d80446fc60 0x55d804470080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.460+0000 7f96909829c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d804272450 con 0x55d80446fc60 2024-09-10T05:38:23.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.460+0000 7f968e488640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d80446fc60 0x55d804470080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.460+0000 7f968e488640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d80446fc60 0x55d804470080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38812/0 (socket says 172.21.15.62:38812) 2024-09-10T05:38:23.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.460+0000 7f968e488640 1 -- 172.21.15.62:0/2981406284 learned_addr learned my addr 172.21.15.62:0/2981406284 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:23.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.460+0000 7f968e488640 1 -- 172.21.15.62:0/2981406284 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8044706c0 con 0x55d80446fc60 2024-09-10T05:38:23.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.460+0000 7f968e488640 1 --2- 172.21.15.62:0/2981406284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d80446fc60 0x55d804470080 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f96800e9530 tx=0x7f9680006760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.460+0000 7f9573fff640 1 -- 172.21.15.62:0/2981406284 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96800e98e0 con 0x55d80446fc60 2024-09-10T05:38:23.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.460+0000 7f9573fff640 1 -- 172.21.15.62:0/2981406284 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96800e4030 con 0x55d80446fc60 2024-09-10T05:38:23.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.460+0000 7f9573fff640 1 -- 172.21.15.62:0/2981406284 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96800e9bb0 con 0x55d80446fc60 2024-09-10T05:38:23.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.460+0000 7f96909829c0 1 -- 172.21.15.62:0/2981406284 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d804470f20 con 0x55d80446fc60 2024-09-10T05:38:23.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.460+0000 7f96909829c0 1 -- 172.21.15.62:0/2981406284 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d804471490 con 0x55d80446fc60 2024-09-10T05:38:23.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.464+0000 7f9573fff640 1 -- 172.21.15.62:0/2981406284 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f96800aa070 con 0x55d80446fc60 2024-09-10T05:38:23.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.464+0000 7f9573fff640 1 --2- 172.21.15.62:0/2981406284 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f9568039ac0 0x7f956803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.464+0000 7f9573fff640 1 -- 172.21.15.62:0/2981406284 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7f96800ecc40 con 0x55d80446fc60 2024-09-10T05:38:23.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.464+0000 7f968dc87640 1 --2- 172.21.15.62:0/2981406284 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f9568039ac0 0x7f956803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.464+0000 7f96909829c0 1 Processor -- start 2024-09-10T05:38:23.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.464+0000 7f96909829c0 1 -- start start 2024-09-10T05:38:23.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.464+0000 7f968dc87640 1 --2- 172.21.15.62:0/2981406284 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f9568039ac0 0x7f956803bf80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x55d8044540d0 tx=0x7f9684006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.464+0000 7f96909829c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d80447d450 0x55d80447d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.464+0000 7f96909829c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d80435d940 con 0x55d80447d450 2024-09-10T05:38:23.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.464+0000 7f968e488640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d80447d450 0x55d80447d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.464+0000 7f968e488640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d80447d450 0x55d80447d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38814/0 (socket says 172.21.15.62:38814) 2024-09-10T05:38:23.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.464+0000 7f968e488640 1 -- 172.21.15.62:0/476867576 learned_addr learned my addr 172.21.15.62:0/476867576 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:23.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.464+0000 7f968e488640 1 -- 172.21.15.62:0/476867576 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d80447de40 con 0x55d80447d450 2024-09-10T05:38:23.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.464+0000 7f968e488640 1 --2- 172.21.15.62:0/476867576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d80447d450 0x55d80447d850 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f96800c0ad0 tx=0x7f96800c8400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=635d01235078eb48 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.464+0000 7f9571ffb640 1 -- 172.21.15.62:0/476867576 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9680105070 con 0x55d80447d450 2024-09-10T05:38:23.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.464+0000 7f9571ffb640 1 -- 172.21.15.62:0/476867576 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96800f9070 con 0x55d80447d450 2024-09-10T05:38:23.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.464+0000 7f9571ffb640 1 -- 172.21.15.62:0/476867576 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96800c7c60 con 0x55d80447d450 2024-09-10T05:38:23.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.464+0000 7f96909829c0 1 -- 172.21.15.62:0/476867576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d80447d450 msgr2=0x55d80447d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.464+0000 7f96909829c0 1 --2- 172.21.15.62:0/476867576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d80447d450 0x55d80447d850 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f96800c0ad0 tx=0x7f96800c8400 comp rx=0 tx=0).stop 2024-09-10T05:38:23.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.464+0000 7f96909829c0 1 -- 172.21.15.62:0/476867576 shutdown_connections 2024-09-10T05:38:23.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.464+0000 7f96909829c0 1 --2- 172.21.15.62:0/476867576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d80447d450 0x55d80447d850 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.464+0000 7f96909829c0 1 -- 172.21.15.62:0/476867576 >> 172.21.15.62:0/476867576 conn(0x55d804478810 msgr2=0x55d804476a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:23.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.464+0000 7f96909829c0 1 -- 172.21.15.62:0/476867576 shutdown_connections 2024-09-10T05:38:23.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.468+0000 7f96909829c0 1 -- 172.21.15.62:0/476867576 wait complete. 2024-09-10T05:38:23.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.468+0000 7f96909829c0 1 Processor -- start 2024-09-10T05:38:23.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.468+0000 7f96909829c0 1 -- start start 2024-09-10T05:38:23.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.468+0000 7f96909829c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d80447d450 0x55d8044836e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.468+0000 7f96909829c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d80447c1c0 con 0x55d80447d450 2024-09-10T05:38:23.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.468+0000 7f968e488640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d80447d450 0x55d8044836e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.468+0000 7f968e488640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d80447d450 0x55d8044836e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38820/0 (socket says 172.21.15.62:38820) 2024-09-10T05:38:23.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.468+0000 7f968e488640 1 -- 172.21.15.62:0/3928542135 learned_addr learned my addr 172.21.15.62:0/3928542135 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:23.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.468+0000 7f968e488640 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d804483c40 con 0x55d80447d450 2024-09-10T05:38:23.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.468+0000 7f968e488640 1 --2- 172.21.15.62:0/3928542135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d80447d450 0x55d8044836e0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f9680103040 tx=0x7f96800d3f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.468+0000 7f955ffff640 1 -- 172.21.15.62:0/3928542135 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f968010f070 con 0x55d80447d450 2024-09-10T05:38:23.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.468+0000 7f955ffff640 1 -- 172.21.15.62:0/3928542135 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96800d16b0 con 0x55d80447d450 2024-09-10T05:38:23.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.468+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d804483c40 con 0x55d80447d450 2024-09-10T05:38:23.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.468+0000 7f955ffff640 1 -- 172.21.15.62:0/3928542135 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9680105040 con 0x55d80447d450 2024-09-10T05:38:23.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.468+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d804483c40 con 0x55d80447d450 2024-09-10T05:38:23.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.468+0000 7f955ffff640 1 -- 172.21.15.62:0/3928542135 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f9680112070 con 0x55d80447d450 2024-09-10T05:38:23.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.468+0000 7f955ffff640 1 --2- 172.21.15.62:0/3928542135 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f9558039a20 0x7f955803bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.468+0000 7f955ffff640 1 -- 172.21.15.62:0/3928542135 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7f9680115c40 con 0x55d80447d450 2024-09-10T05:38:23.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.468+0000 7f968dc87640 1 --2- 172.21.15.62:0/3928542135 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f9558039a20 0x7f955803bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.468+0000 7f96909829c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.472+0000 7f96909829c0 1 --2- 172.21.15.62:0/3928542135 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55d80448e580 0x55d804490a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.472+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d804491190 con 0x55d80448e580 2024-09-10T05:38:23.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.472+0000 7f968ec89640 1 --2- 172.21.15.62:0/3928542135 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55d80448e580 0x55d804490a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.472+0000 7f968dc87640 1 --2- 172.21.15.62:0/3928542135 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f9558039a20 0x7f955803bee0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x55d80445d990 tx=0x7f9684011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.472+0000 7f968ec89640 1 --2- 172.21.15.62:0/3928542135 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55d80448e580 0x55d804490a40 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.472+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f968800a4d0 con 0x55d80448e580 2024-09-10T05:38:23.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.472+0000 7f96909829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:23.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.472+0000 7f96909829c0 20 realm 2024-09-10T05:38:23.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.472+0000 7f96909829c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.472+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d80448d8b0 con 0x55d80448e580 2024-09-10T05:38:23.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.472+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f968800a4d0 con 0x55d80448e580 2024-09-10T05:38:23.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.472+0000 7f96909829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:23.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.472+0000 7f96909829c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:38:23.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.472+0000 7f96909829c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.472+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d804491c60 con 0x55d80448e580 2024-09-10T05:38:23.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.472+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f968800a4d0 con 0x55d80448e580 2024-09-10T05:38:23.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.472+0000 7f96909829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:23.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.472+0000 7f96909829c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.472+0000 7f96909829c0 1 --2- 172.21.15.62:0/3928542135 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55d804492a40 0x55d804494e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.472+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8044954c0 con 0x55d804492a40 2024-09-10T05:38:23.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.472+0000 7f968e488640 1 --2- 172.21.15.62:0/3928542135 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55d804492a40 0x55d804494e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.472+0000 7f968e488640 1 --2- 172.21.15.62:0/3928542135 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55d804492a40 0x55d804494e30 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.472+0000 7f968e488640 1 -- 172.21.15.62:0/3928542135 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9680111030 con 0x55d804492a40 2024-09-10T05:38:23.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.472+0000 7f96909829c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:38:23.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.472+0000 7f96909829c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.472+0000 7f96909829c0 1 --2- 172.21.15.62:0/3928542135 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55d804496220 0x55d804498630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.472+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d804498dc0 con 0x55d804496220 2024-09-10T05:38:23.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.472+0000 7f968dc87640 1 --2- 172.21.15.62:0/3928542135 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55d804496220 0x55d804498630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.472+0000 7f968dc87640 1 --2- 172.21.15.62:0/3928542135 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55d804496220 0x55d804498630 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.472+0000 7f968dc87640 1 -- 172.21.15.62:0/3928542135 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv5 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f968400d040 con 0x55d804496220 2024-09-10T05:38:23.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.472+0000 7f96909829c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:38:23.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.472+0000 7f96909829c0 20 searching for the correct realm 2024-09-10T05:38:23.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.472+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80449a690 con 0x55d804496220 2024-09-10T05:38:23.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.476+0000 7f968dc87640 1 -- 172.21.15.62:0/3928542135 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f968400d040 con 0x55d804496220 2024-09-10T05:38:23.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.476+0000 7f968dc87640 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80449a690 con 0x55d804492a40 2024-09-10T05:38:23.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.476+0000 7f968e488640 1 -- 172.21.15.62:0/3928542135 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9680111030 con 0x55d804492a40 2024-09-10T05:38:23.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.476+0000 7f968e488640 1 --2- 172.21.15.62:0/3928542135 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f9680114070 0x7f96800ae220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.476+0000 7f968e488640 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80449a690 con 0x7f9680114070 2024-09-10T05:38:23.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.476+0000 7f968ec89640 1 --2- 172.21.15.62:0/3928542135 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f9680114070 0x7f96800ae220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.476+0000 7f968ec89640 1 --2- 172.21.15.62:0/3928542135 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f9680114070 0x7f96800ae220 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.476+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f968800a4d0 con 0x7f9680114070 2024-09-10T05:38:23.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.476+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80449a690 con 0x55d80448e580 2024-09-10T05:38:23.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.476+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f968800a4d0 con 0x55d80448e580 2024-09-10T05:38:23.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.476+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80449a690 con 0x55d80448e580 2024-09-10T05:38:23.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.476+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f968800a4d0 con 0x55d80448e580 2024-09-10T05:38:23.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.476+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80449a690 con 0x55d804496220 2024-09-10T05:38:23.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.476+0000 7f968dc87640 1 -- 172.21.15.62:0/3928542135 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f968400d040 con 0x55d804496220 2024-09-10T05:38:23.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.476+0000 7f968dc87640 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80449a690 con 0x55d80448e580 2024-09-10T05:38:23.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.476+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f968800a4d0 con 0x55d80448e580 2024-09-10T05:38:23.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.476+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80449a690 con 0x55d804492a40 2024-09-10T05:38:23.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.476+0000 7f968e488640 1 -- 172.21.15.62:0/3928542135 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9680111030 con 0x55d804492a40 2024-09-10T05:38:23.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.476+0000 7f968e488640 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80449a690 con 0x55d804492a40 2024-09-10T05:38:23.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.480+0000 7f968e488640 1 -- 172.21.15.62:0/3928542135 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9680111030 con 0x55d804492a40 2024-09-10T05:38:23.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.480+0000 7f968e488640 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80449a690 con 0x55d80448e580 2024-09-10T05:38:23.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.480+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f968800a4d0 con 0x55d80448e580 2024-09-10T05:38:23.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.480+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80449a690 con 0x7f9680114070 2024-09-10T05:38:23.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.480+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f968800a4d0 con 0x7f9680114070 2024-09-10T05:38:23.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.480+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80449a690 con 0x55d80448e580 2024-09-10T05:38:23.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.480+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f968800a4d0 con 0x55d80448e580 2024-09-10T05:38:23.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.480+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80449a690 con 0x7f9680114070 2024-09-10T05:38:23.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.480+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f968800a4d0 con 0x7f9680114070 2024-09-10T05:38:23.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.480+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80449a690 con 0x55d804492a40 2024-09-10T05:38:23.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.480+0000 7f968e488640 1 -- 172.21.15.62:0/3928542135 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9680111030 con 0x55d804492a40 2024-09-10T05:38:23.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.480+0000 7f968e488640 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80449a690 con 0x55d804496220 2024-09-10T05:38:23.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.480+0000 7f968dc87640 1 -- 172.21.15.62:0/3928542135 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f968400d040 con 0x55d804496220 2024-09-10T05:38:23.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.480+0000 7f968dc87640 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80449a690 con 0x55d80448e580 2024-09-10T05:38:23.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.480+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f968800a4d0 con 0x55d80448e580 2024-09-10T05:38:23.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.480+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80449a690 con 0x55d804492a40 2024-09-10T05:38:23.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.480+0000 7f968e488640 1 -- 172.21.15.62:0/3928542135 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9680111030 con 0x55d804492a40 2024-09-10T05:38:23.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.480+0000 7f968e488640 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80449a690 con 0x55d804496220 2024-09-10T05:38:23.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.484+0000 7f968dc87640 1 -- 172.21.15.62:0/3928542135 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 34 out=170b] v34'5 uv5 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f968400d040 con 0x55d804496220 2024-09-10T05:38:23.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.484+0000 7f968dc87640 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80449a690 con 0x55d80448e580 2024-09-10T05:38:23.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.484+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f968800a4d0 con 0x55d80448e580 2024-09-10T05:38:23.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.484+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80449a690 con 0x55d80448e580 2024-09-10T05:38:23.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.484+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f968800a4d0 con 0x55d80448e580 2024-09-10T05:38:23.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.484+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80449a690 con 0x55d80448e580 2024-09-10T05:38:23.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.484+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f968800a4d0 con 0x55d80448e580 2024-09-10T05:38:23.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.484+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80449a690 con 0x55d804496220 2024-09-10T05:38:23.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.484+0000 7f968dc87640 1 -- 172.21.15.62:0/3928542135 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f968400d040 con 0x55d804496220 2024-09-10T05:38:23.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.484+0000 7f968dc87640 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80449a690 con 0x7f9680114070 2024-09-10T05:38:23.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.484+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f968800a4d0 con 0x7f9680114070 2024-09-10T05:38:23.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.484+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80449a690 con 0x55d80448e580 2024-09-10T05:38:23.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.484+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f968800a4d0 con 0x55d80448e580 2024-09-10T05:38:23.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.484+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80449a690 con 0x7f9680114070 2024-09-10T05:38:23.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.484+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f968800a4d0 con 0x7f9680114070 2024-09-10T05:38:23.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.484+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80449a690 con 0x55d804496220 2024-09-10T05:38:23.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.484+0000 7f968dc87640 1 -- 172.21.15.62:0/3928542135 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f968400d040 con 0x55d804496220 2024-09-10T05:38:23.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.484+0000 7f968dc87640 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80449a690 con 0x7f9680114070 2024-09-10T05:38:23.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.484+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f968800a4d0 con 0x7f9680114070 2024-09-10T05:38:23.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.484+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80449a690 con 0x55d804492a40 2024-09-10T05:38:23.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.484+0000 7f968e488640 1 -- 172.21.15.62:0/3928542135 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9680111030 con 0x55d804492a40 2024-09-10T05:38:23.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.484+0000 7f968e488640 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80449a690 con 0x55d804492a40 2024-09-10T05:38:23.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.488+0000 7f968e488640 1 -- 172.21.15.62:0/3928542135 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9680111030 con 0x55d804492a40 2024-09-10T05:38:23.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.488+0000 7f968e488640 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80449a690 con 0x55d804496220 2024-09-10T05:38:23.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.488+0000 7f968dc87640 1 -- 172.21.15.62:0/3928542135 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f968400d040 con 0x55d804496220 2024-09-10T05:38:23.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.488+0000 7f968dc87640 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80449a690 con 0x55d804492a40 2024-09-10T05:38:23.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.488+0000 7f968e488640 1 -- 172.21.15.62:0/3928542135 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9680111030 con 0x55d804492a40 2024-09-10T05:38:23.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.488+0000 7f968e488640 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80449a690 con 0x55d804492a40 2024-09-10T05:38:23.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.488+0000 7f968e488640 1 -- 172.21.15.62:0/3928542135 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9680111030 con 0x55d804492a40 2024-09-10T05:38:23.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.488+0000 7f96909829c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:38:23.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.488+0000 7f96909829c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:38:23.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.488+0000 7f96909829c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:38:23.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.488+0000 7f96909829c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:38:23.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.488+0000 7f96909829c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:38:23.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.488+0000 7f96909829c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:38:23.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.488+0000 7f96909829c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.488+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8044997b0 con 0x55d80448e580 2024-09-10T05:38:23.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.488+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f968800a4d0 con 0x55d80448e580 2024-09-10T05:38:23.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.488+0000 7f96909829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:23.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.488+0000 7f96909829c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.488+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8044993f0 con 0x55d804492a40 2024-09-10T05:38:23.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.488+0000 7f968e488640 1 -- 172.21.15.62:0/3928542135 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9680111030 con 0x55d804492a40 2024-09-10T05:38:23.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.488+0000 7f96909829c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:38:23.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.488+0000 7f96909829c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.488+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d80449a150 con 0x55d804496220 2024-09-10T05:38:23.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.488+0000 7f968dc87640 1 -- 172.21.15.62:0/3928542135 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f968400d040 con 0x55d804496220 2024-09-10T05:38:23.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.488+0000 7f96909829c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:38:23.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.488+0000 7f96909829c0 20 zone default found 2024-09-10T05:38:23.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.488+0000 7f96909829c0 4 Realm: () 2024-09-10T05:38:23.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.488+0000 7f96909829c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:38:23.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.488+0000 7f96909829c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:38:23.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.488+0000 7f96909829c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:38:23.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.488+0000 7f96909829c0 20 zonegroup default 2024-09-10T05:38:23.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.488+0000 7f96909829c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.488+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d80449af70 con 0x7f9680114070 2024-09-10T05:38:23.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.492+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f968800a4d0 con 0x7f9680114070 2024-09-10T05:38:23.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.492+0000 7f96909829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:23.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.492+0000 7f96909829c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.492+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d80449d1b0 con 0x55d804496220 2024-09-10T05:38:23.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.492+0000 7f968dc87640 1 -- 172.21.15.62:0/3928542135 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f968400d040 con 0x55d804496220 2024-09-10T05:38:23.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.492+0000 7f96909829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:23.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.492+0000 7f96909829c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.492+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d80449d550 con 0x55d804496220 2024-09-10T05:38:23.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.492+0000 7f968dc87640 1 -- 172.21.15.62:0/3928542135 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f968400d040 con 0x55d804496220 2024-09-10T05:38:23.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.492+0000 7f96909829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:23.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.492+0000 7f96909829c0 20 started sync module instance, tier type = 2024-09-10T05:38:23.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.492+0000 7f96909829c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:38:23.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.492+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d80449c5f0 con 0x55d804492a40 2024-09-10T05:38:23.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.492+0000 7f968e488640 1 -- 172.21.15.62:0/3928542135 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9680111030 con 0x55d804492a40 2024-09-10T05:38:23.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.492+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94386273239360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d80449d960 con 0x55d804492a40 2024-09-10T05:38:23.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.492+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d80449e1b0 con 0x55d80448e580 2024-09-10T05:38:23.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.496+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f968800a4d0 con 0x55d80448e580 2024-09-10T05:38:23.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.496+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94386273246464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d80449eae0 con 0x55d80448e580 2024-09-10T05:38:23.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.496+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d80449f600 con 0x55d804492a40 2024-09-10T05:38:23.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.496+0000 7f968e488640 1 -- 172.21.15.62:0/3928542135 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94386273239360] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9680111030 con 0x55d804492a40 2024-09-10T05:38:23.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.496+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94386273246464] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f968800a4d0 con 0x55d80448e580 2024-09-10T05:38:23.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.500+0000 7f968e488640 1 -- 172.21.15.62:0/3928542135 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9680111030 con 0x55d804492a40 2024-09-10T05:38:23.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.500+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94386273251536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d80449f5c0 con 0x55d804492a40 2024-09-10T05:38:23.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.500+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d80449fea0 con 0x7f9680114070 2024-09-10T05:38:23.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.500+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f968800a4d0 con 0x7f9680114070 2024-09-10T05:38:23.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.500+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94386273253872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d80449f5c0 con 0x7f9680114070 2024-09-10T05:38:23.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.500+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8044a0940 con 0x55d804492a40 2024-09-10T05:38:23.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.500+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94386273253872] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f968800a4d0 con 0x7f9680114070 2024-09-10T05:38:23.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.504+0000 7f968e488640 1 -- 172.21.15.62:0/3928542135 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94386273251536] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9680111030 con 0x55d804492a40 2024-09-10T05:38:23.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.504+0000 7f968e488640 1 -- 172.21.15.62:0/3928542135 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9680111030 con 0x55d804492a40 2024-09-10T05:38:23.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.504+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94386273241568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8044a0900 con 0x55d804492a40 2024-09-10T05:38:23.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.504+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8044a0d30 con 0x55d804496220 2024-09-10T05:38:23.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.504+0000 7f968dc87640 1 -- 172.21.15.62:0/3928542135 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f968400d040 con 0x55d804496220 2024-09-10T05:38:23.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.504+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94386273254928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8044a0d30 con 0x55d804496220 2024-09-10T05:38:23.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.504+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8044a1c30 con 0x55d804496220 2024-09-10T05:38:23.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.504+0000 7f968e488640 1 -- 172.21.15.62:0/3928542135 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94386273241568] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9680111030 con 0x55d804492a40 2024-09-10T05:38:23.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.504+0000 7f968dc87640 1 -- 172.21.15.62:0/3928542135 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94386273254928] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f968400d040 con 0x55d804496220 2024-09-10T05:38:23.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.504+0000 7f968dc87640 1 -- 172.21.15.62:0/3928542135 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f968400d040 con 0x55d804496220 2024-09-10T05:38:23.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.504+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94386273259808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8044a1740 con 0x55d804496220 2024-09-10T05:38:23.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.504+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8044a24d0 con 0x7f9680114070 2024-09-10T05:38:23.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.508+0000 7f968dc87640 1 -- 172.21.15.62:0/3928542135 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94386273259808] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f968400d040 con 0x55d804496220 2024-09-10T05:38:23.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.508+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f968800a4d0 con 0x7f9680114070 2024-09-10T05:38:23.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.508+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94386273256496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8044a1740 con 0x7f9680114070 2024-09-10T05:38:23.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.508+0000 7f96909829c0 20 add_watcher() i=0 2024-09-10T05:38:23.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.508+0000 7f96909829c0 20 add_watcher() i=1 2024-09-10T05:38:23.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.508+0000 7f96909829c0 20 add_watcher() i=2 2024-09-10T05:38:23.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.508+0000 7f96909829c0 20 add_watcher() i=3 2024-09-10T05:38:23.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.508+0000 7f96909829c0 20 add_watcher() i=4 2024-09-10T05:38:23.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.508+0000 7f96909829c0 20 add_watcher() i=5 2024-09-10T05:38:23.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.508+0000 7f96909829c0 20 add_watcher() i=6 2024-09-10T05:38:23.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.508+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94386273256496] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f968800a4d0 con 0x7f9680114070 2024-09-10T05:38:23.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.508+0000 7f96909829c0 20 add_watcher() i=7 2024-09-10T05:38:23.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.508+0000 7f96909829c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:38:23.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.508+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8044a5500 con 0x55d80448e580 2024-09-10T05:38:23.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.508+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f968800a4d0 con 0x55d80448e580 2024-09-10T05:38:23.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.508+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94386273263648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8044a29c0 con 0x55d80448e580 2024-09-10T05:38:23.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.512+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94386273263648] v34'252 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f968800a4d0 con 0x55d80448e580 2024-09-10T05:38:23.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.512+0000 7f9544fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:38:23.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.512+0000 7f96909829c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:38:23.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.512+0000 7f96909829c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:38:23.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.512+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8044addd0 con 0x55d804492a40 2024-09-10T05:38:23.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.512+0000 7f968e488640 1 -- 172.21.15.62:0/3928542135 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'59 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9680111030 con 0x55d804492a40 2024-09-10T05:38:23.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.512+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8044ade00 con 0x7f9680114070 2024-09-10T05:38:23.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.516+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f968800a4d0 con 0x7f9680114070 2024-09-10T05:38:23.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.516+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8044ae500 con 0x55d804496220 2024-09-10T05:38:23.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.516+0000 7f968dc87640 1 -- 172.21.15.62:0/3928542135 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f968400d040 con 0x55d804496220 2024-09-10T05:38:23.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.516+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8044ae8e0 con 0x55d80448e580 2024-09-10T05:38:23.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.520+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'253 uv172 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f968800a4d0 con 0x55d80448e580 2024-09-10T05:38:23.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.520+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8044aee50 con 0x55d804492a40 2024-09-10T05:38:23.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.520+0000 7f968e488640 1 -- 172.21.15.62:0/3928542135 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'83 uv61 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9680111030 con 0x55d804492a40 2024-09-10T05:38:23.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.520+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8044aee50 con 0x55d804496220 2024-09-10T05:38:23.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.524+0000 7f968dc87640 1 -- 172.21.15.62:0/3928542135 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'63 uv48 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f968400d040 con 0x55d804496220 2024-09-10T05:38:23.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.524+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8044af3c0 con 0x55d804492a40 2024-09-10T05:38:23.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.524+0000 7f968e488640 1 -- 172.21.15.62:0/3928542135 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'40 uv31 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9680111030 con 0x55d804492a40 2024-09-10T05:38:23.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.524+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8044af3c0 con 0x55d80448e580 2024-09-10T05:38:23.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.528+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'57 uv42 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f968800a4d0 con 0x55d80448e580 2024-09-10T05:38:23.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.528+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8044af820 con 0x55d804492a40 2024-09-10T05:38:23.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.528+0000 7f968e488640 1 -- 172.21.15.62:0/3928542135 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9680111030 con 0x55d804492a40 2024-09-10T05:38:23.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.528+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8044af6b0 con 0x55d804492a40 2024-09-10T05:38:23.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.532+0000 7f968e488640 1 -- 172.21.15.62:0/3928542135 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9680111030 con 0x55d804492a40 2024-09-10T05:38:23.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.532+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8044af690 con 0x55d804492a40 2024-09-10T05:38:23.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.536+0000 7f968e488640 1 -- 172.21.15.62:0/3928542135 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'84 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9680111030 con 0x55d804492a40 2024-09-10T05:38:23.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.536+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8044af670 con 0x55d804496220 2024-09-10T05:38:23.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.536+0000 7f968dc87640 1 -- 172.21.15.62:0/3928542135 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'36 uv25 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f968400d040 con 0x55d804496220 2024-09-10T05:38:23.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.536+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8044afce0 con 0x55d804492a40 2024-09-10T05:38:23.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.540+0000 7f968e488640 1 -- 172.21.15.62:0/3928542135 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9680111030 con 0x55d804492a40 2024-09-10T05:38:23.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.540+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8044afd00 con 0x55d80448e580 2024-09-10T05:38:23.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.540+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'69 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f968800a4d0 con 0x55d80448e580 2024-09-10T05:38:23.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.540+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8044afdc0 con 0x55d80448e580 2024-09-10T05:38:23.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.540+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'254 uv168 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f968800a4d0 con 0x55d80448e580 2024-09-10T05:38:23.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.540+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8044afe90 con 0x55d804492a40 2024-09-10T05:38:23.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.544+0000 7f968e488640 1 -- 172.21.15.62:0/3928542135 <== osd.0 v2:172.21.15.2:6800/945139080 25 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'78 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9680111030 con 0x55d804492a40 2024-09-10T05:38:23.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.544+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8044afe90 con 0x55d804492a40 2024-09-10T05:38:23.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.548+0000 7f968e488640 1 -- 172.21.15.62:0/3928542135 <== osd.0 v2:172.21.15.2:6800/945139080 26 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'85 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9680111030 con 0x55d804492a40 2024-09-10T05:38:23.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.548+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8044afe90 con 0x55d804496220 2024-09-10T05:38:23.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.548+0000 7f968dc87640 1 -- 172.21.15.62:0/3928542135 <== osd.3 v2:172.21.15.62:6816/2708991149 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'41 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f968400d040 con 0x55d804496220 2024-09-10T05:38:23.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.548+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8044aff60 con 0x55d804492a40 2024-09-10T05:38:23.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.552+0000 7f968e488640 1 -- 172.21.15.62:0/3928542135 <== osd.0 v2:172.21.15.2:6800/945139080 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9680111030 con 0x55d804492a40 2024-09-10T05:38:23.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.552+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8044aff60 con 0x55d80448e580 2024-09-10T05:38:23.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.552+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 <== osd.1 v2:172.21.15.62:6808/3442097179 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'255 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f968800a4d0 con 0x55d80448e580 2024-09-10T05:38:23.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.552+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8044aff60 con 0x55d804492a40 2024-09-10T05:38:23.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.556+0000 7f968e488640 1 -- 172.21.15.62:0/3928542135 <== osd.0 v2:172.21.15.2:6800/945139080 28 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'79 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9680111030 con 0x55d804492a40 2024-09-10T05:38:23.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.556+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8044aff60 con 0x7f9680114070 2024-09-10T05:38:23.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.556+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'46 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f968800a4d0 con 0x7f9680114070 2024-09-10T05:38:23.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.556+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8044affa0 con 0x55d804496220 2024-09-10T05:38:23.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.560+0000 7f968dc87640 1 -- 172.21.15.62:0/3928542135 <== osd.3 v2:172.21.15.62:6816/2708991149 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f968400d040 con 0x55d804496220 2024-09-10T05:38:23.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.560+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8044b0070 con 0x55d804492a40 2024-09-10T05:38:23.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.560+0000 7f968e488640 1 -- 172.21.15.62:0/3928542135 <== osd.0 v2:172.21.15.2:6800/945139080 29 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'48 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9680111030 con 0x55d804492a40 2024-09-10T05:38:23.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.560+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8044b0070 con 0x55d804496220 2024-09-10T05:38:23.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.564+0000 7f968dc87640 1 -- 172.21.15.62:0/3928542135 <== osd.3 v2:172.21.15.62:6816/2708991149 21 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f968400d040 con 0x55d804496220 2024-09-10T05:38:23.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.564+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8044b0070 con 0x55d804496220 2024-09-10T05:38:23.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.564+0000 7f968dc87640 1 -- 172.21.15.62:0/3928542135 <== osd.3 v2:172.21.15.62:6816/2708991149 22 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'64 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f968400d040 con 0x55d804496220 2024-09-10T05:38:23.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.564+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8044b0070 con 0x55d804496220 2024-09-10T05:38:23.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.568+0000 7f968dc87640 1 -- 172.21.15.62:0/3928542135 <== osd.3 v2:172.21.15.62:6816/2708991149 23 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f968400d040 con 0x55d804496220 2024-09-10T05:38:23.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.568+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8044b0070 con 0x55d804492a40 2024-09-10T05:38:23.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.568+0000 7f968e488640 1 -- 172.21.15.62:0/3928542135 <== osd.0 v2:172.21.15.2:6800/945139080 30 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'44 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9680111030 con 0x55d804492a40 2024-09-10T05:38:23.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.568+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8044b0070 con 0x55d80448e580 2024-09-10T05:38:23.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.572+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 <== osd.1 v2:172.21.15.62:6808/3442097179 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'58 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f968800a4d0 con 0x55d80448e580 2024-09-10T05:38:23.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.572+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8044b0070 con 0x55d804492a40 2024-09-10T05:38:23.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.572+0000 7f968e488640 1 -- 172.21.15.62:0/3928542135 <== osd.0 v2:172.21.15.2:6800/945139080 31 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'80 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9680111030 con 0x55d804492a40 2024-09-10T05:38:23.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.572+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8044b0070 con 0x55d80448e580 2024-09-10T05:38:23.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.572+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 <== osd.1 v2:172.21.15.62:6808/3442097179 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'70 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f968800a4d0 con 0x55d80448e580 2024-09-10T05:38:23.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.572+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8044b0070 con 0x7f9680114070 2024-09-10T05:38:23.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.576+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f968800a4d0 con 0x7f9680114070 2024-09-10T05:38:23.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.576+0000 7f94bf7fe640 20 reqs_thread_entry: start 2024-09-10T05:38:23.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.576+0000 7f96909829c0 20 init_complete bucket index max shards: 11 2024-09-10T05:38:23.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.576+0000 7f96909829c0 20 Filter name: none 2024-09-10T05:38:23.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.576+0000 7f94bd7fa640 20 reqs_thread_entry: start 2024-09-10T05:38:23.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.576+0000 7f96909829c0 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-10T05:38:23.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.576+0000 7f96909829c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.576+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:94 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8044abf00 con 0x55d804496220 2024-09-10T05:38:23.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.576+0000 7f968dc87640 1 -- 172.21.15.62:0/3928542135 <== osd.3 v2:172.21.15.62:6816/2708991149 24 ==== osd_op_reply(94 system_user [call out=48b,read 0~349 out=349b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 239+0+472 (crc 0 0 0) 0x7f968400d040 con 0x55d804496220 2024-09-10T05:38:23.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.576+0000 7f96909829c0 20 rados_obj.operate() r=0 bl.length=349 2024-09-10T05:38:23.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.576+0000 7f96909829c0 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x13 2024-09-10T05:38:23.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.576+0000 7f96909829c0 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-10T05:38:23.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.576+0000 7f96909829c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:38:23.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.576+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:95 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8044ab960 con 0x55d804496220 2024-09-10T05:38:23.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.576+0000 7f968dc87640 1 -- 172.21.15.62:0/3928542135 <== osd.3 v2:172.21.15.62:6816/2708991149 25 ==== osd_op_reply(95 system_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7f968400d040 con 0x55d804496220 2024-09-10T05:38:23.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.576+0000 7f96909829c0 10 removing key index: system_akey 2024-09-10T05:38:23.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.576+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:96 8.0 8:01223cbf:users.keys::system_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8044cba70 con 0x55d804496220 2024-09-10T05:38:23.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.580+0000 7f968dc87640 1 -- 172.21.15.62:0/3928542135 <== osd.3 v2:172.21.15.62:6816/2708991149 26 ==== osd_op_reply(96 system_akey [delete] v34'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f968400d040 con 0x55d804496220 2024-09-10T05:38:23.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.580+0000 7f96909829c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-10T05:38:23.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.580+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [notify cookie 94386273302752 in=173b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8044ce160 con 0x55d80448e580 2024-09-10T05:38:23.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.580+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 <== osd.1 v2:172.21.15.62:6808/3442097179 26 ==== watch-notify(notify (1) cookie 94386273246464 notify 146028888067 ret 0) ==== 203+0+0 (crc 0 0 0) 0x55d8044af840 con 0x55d80448e580 2024-09-10T05:38:23.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.580+0000 7f9571ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888067 cookie 94386273246464 notifier 4850 bl.length()=161 2024-09-10T05:38:23.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.580+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 <== osd.1 v2:172.21.15.62:6808/3442097179 27 ==== osd_op_reply(97 notify.1 [notify cookie 94386273302752 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f968800a4d0 con 0x55d80448e580 2024-09-10T05:38:23.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.580+0000 7f9571ffb640 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f9554003d70 con 0x55d80448e580 2024-09-10T05:38:23.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.580+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 <== osd.1 v2:172.21.15.62:6808/3442097179 28 ==== osd_op_reply(98 notify.1 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f968800a4d0 con 0x55d80448e580 2024-09-10T05:38:23.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.580+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 <== osd.1 v2:172.21.15.62:6808/3442097179 29 ==== watch-notify(notify_complete (2) cookie 94386273302752 notify 146028888067 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d8044ae820 con 0x55d80448e580 2024-09-10T05:38:23.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.580+0000 7f96909829c0 10 removing email index: 2024-09-10T05:38:23.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.580+0000 7f96909829c0 10 removing user buckets index 2024-09-10T05:38:23.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.580+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:99 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8044ab8b0 con 0x55d804496220 2024-09-10T05:38:23.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.580+0000 7f968dc87640 1 -- 172.21.15.62:0/3928542135 <== osd.3 v2:172.21.15.62:6816/2708991149 27 ==== osd_op_reply(99 system_user.buckets [delete] v34'4 uv3 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7f968400d040 con 0x55d804496220 2024-09-10T05:38:23.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.580+0000 7f96909829c0 10 removing user index: system_user 2024-09-10T05:38:23.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.580+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:100 8.1e 8:78ce4db0:users.uid::system_user:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8044ce060 con 0x55d804496220 2024-09-10T05:38:23.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.584+0000 7f968dc87640 1 -- 172.21.15.62:0/3928542135 <== osd.3 v2:172.21.15.62:6816/2708991149 28 ==== osd_op_reply(100 system_user [call,call,delete] v34'5 uv5 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f968400d040 con 0x55d804496220 2024-09-10T05:38:23.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.584+0000 7f96909829c0 10 removing default.rgw.meta+users.uid+system_user from cache 2024-09-10T05:38:23.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.584+0000 7f96909829c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-10T05:38:23.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.584+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94386273442736 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8044cca80 con 0x55d804492a40 2024-09-10T05:38:23.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.584+0000 7f968e488640 1 -- 172.21.15.62:0/3928542135 <== osd.0 v2:172.21.15.2:6800/945139080 32 ==== watch-notify(notify (1) cookie 94386273239360 notify 146028888112 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55d8044afa10 con 0x55d804492a40 2024-09-10T05:38:23.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.584+0000 7f9571ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888112 cookie 94386273239360 notifier 4850 bl.length()=160 2024-09-10T05:38:23.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.584+0000 7f9571ffb640 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f9554003d70 con 0x55d804492a40 2024-09-10T05:38:23.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.584+0000 7f968e488640 1 -- 172.21.15.62:0/3928542135 <== osd.0 v2:172.21.15.2:6800/945139080 33 ==== osd_op_reply(101 notify.0 [notify cookie 94386273442736 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9680111030 con 0x55d804492a40 2024-09-10T05:38:23.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.584+0000 7f968e488640 1 -- 172.21.15.62:0/3928542135 <== osd.0 v2:172.21.15.2:6800/945139080 34 ==== osd_op_reply(102 notify.0 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9680111030 con 0x55d804492a40 2024-09-10T05:38:23.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.584+0000 7f968e488640 1 -- 172.21.15.62:0/3928542135 <== osd.0 v2:172.21.15.2:6800/945139080 35 ==== watch-notify(notify_complete (2) cookie 94386273442736 notify 146028888112 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d8044706c0 con 0x55d804492a40 2024-09-10T05:38:23.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.588+0000 7f9544fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:38:23.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.588+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94386273263648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8044a9e40 con 0x55d80448e580 2024-09-10T05:38:23.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.588+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 <== osd.1 v2:172.21.15.62:6808/3442097179 30 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94386273263648] v34'256 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f968800a4d0 con 0x55d80448e580 2024-09-10T05:38:23.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.588+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94386273239360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8044a2020 con 0x55d804492a40 2024-09-10T05:38:23.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.592+0000 7f968e488640 1 -- 172.21.15.62:0/3928542135 <== osd.0 v2:172.21.15.2:6800/945139080 36 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94386273239360] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9680111030 con 0x55d804492a40 2024-09-10T05:38:23.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.592+0000 7f96909829c0 20 remove_watcher() i=0 2024-09-10T05:38:23.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.592+0000 7f96909829c0 2 removed watcher, disabling cache 2024-09-10T05:38:23.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.592+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94386273246464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8044a2020 con 0x55d80448e580 2024-09-10T05:38:23.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.592+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 <== osd.1 v2:172.21.15.62:6808/3442097179 31 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94386273246464] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f968800a4d0 con 0x55d80448e580 2024-09-10T05:38:23.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.592+0000 7f96909829c0 20 remove_watcher() i=1 2024-09-10T05:38:23.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.592+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94386273251536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8044a2020 con 0x55d804492a40 2024-09-10T05:38:23.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.596+0000 7f968e488640 1 -- 172.21.15.62:0/3928542135 <== osd.0 v2:172.21.15.2:6800/945139080 37 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94386273251536] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9680111030 con 0x55d804492a40 2024-09-10T05:38:23.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.596+0000 7f96909829c0 20 remove_watcher() i=2 2024-09-10T05:38:23.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.596+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94386273253872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8044a2020 con 0x7f9680114070 2024-09-10T05:38:23.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.596+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 <== osd.2 v2:172.21.15.62:6800/2677868286 15 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94386273253872] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f968800a4d0 con 0x7f9680114070 2024-09-10T05:38:23.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.596+0000 7f96909829c0 20 remove_watcher() i=3 2024-09-10T05:38:23.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.596+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94386273241568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d80449f9f0 con 0x55d804492a40 2024-09-10T05:38:23.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.600+0000 7f968e488640 1 -- 172.21.15.62:0/3928542135 <== osd.0 v2:172.21.15.2:6800/945139080 38 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94386273241568] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9680111030 con 0x55d804492a40 2024-09-10T05:38:23.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.600+0000 7f96909829c0 20 remove_watcher() i=4 2024-09-10T05:38:23.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.600+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94386273254928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8044a2020 con 0x55d804496220 2024-09-10T05:38:23.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.600+0000 7f968dc87640 1 -- 172.21.15.62:0/3928542135 <== osd.3 v2:172.21.15.62:6816/2708991149 29 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94386273254928] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f968400d040 con 0x55d804496220 2024-09-10T05:38:23.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.600+0000 7f96909829c0 20 remove_watcher() i=5 2024-09-10T05:38:23.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.600+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94386273259808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d80449fea0 con 0x55d804496220 2024-09-10T05:38:23.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.604+0000 7f968dc87640 1 -- 172.21.15.62:0/3928542135 <== osd.3 v2:172.21.15.62:6816/2708991149 30 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94386273259808] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f968400d040 con 0x55d804496220 2024-09-10T05:38:23.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.604+0000 7f96909829c0 20 remove_watcher() i=6 2024-09-10T05:38:23.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.604+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94386273256496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d80449c9e0 con 0x7f9680114070 2024-09-10T05:38:23.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.604+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 <== osd.2 v2:172.21.15.62:6800/2677868286 16 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94386273256496] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f968800a4d0 con 0x7f9680114070 2024-09-10T05:38:23.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.604+0000 7f96909829c0 20 remove_watcher() i=7 2024-09-10T05:38:23.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.604+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55d804492a40 msgr2=0x55d804494e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.604+0000 7f96909829c0 1 --2- 172.21.15.62:0/3928542135 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55d804492a40 0x55d804494e30 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.604+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55d80448e580 msgr2=0x55d804490a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.604+0000 7f96909829c0 1 --2- 172.21.15.62:0/3928542135 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55d80448e580 0x55d804490a40 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.604+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f9680114070 msgr2=0x7f96800ae220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.604+0000 7f96909829c0 1 --2- 172.21.15.62:0/3928542135 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f9680114070 0x7f96800ae220 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.604+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55d804496220 msgr2=0x55d804498630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.604+0000 7f96909829c0 1 --2- 172.21.15.62:0/3928542135 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55d804496220 0x55d804498630 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.604+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f9558039a20 msgr2=0x7f955803bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.604+0000 7f96909829c0 1 --2- 172.21.15.62:0/3928542135 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f9558039a20 0x7f955803bee0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x55d80445d990 tx=0x7f9684011000 comp rx=0 tx=0).stop 2024-09-10T05:38:23.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.604+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d80447d450 msgr2=0x55d8044836e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.604+0000 7f96909829c0 1 --2- 172.21.15.62:0/3928542135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d80447d450 0x55d8044836e0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f9680103040 tx=0x7f96800d3f00 comp rx=0 tx=0).stop 2024-09-10T05:38:23.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.604+0000 7f968ec89640 1 -- 172.21.15.62:0/3928542135 reap_dead start 2024-09-10T05:38:23.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.604+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 shutdown_connections 2024-09-10T05:38:23.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.604+0000 7f96909829c0 1 --2- 172.21.15.62:0/3928542135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d80447d450 0x55d8044836e0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.604+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 >> 172.21.15.62:0/3928542135 conn(0x55d804478810 msgr2=0x55d804476a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:23.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.604+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 shutdown_connections 2024-09-10T05:38:23.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.604+0000 7f96909829c0 1 -- 172.21.15.62:0/3928542135 wait complete. 2024-09-10T05:38:23.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.604+0000 7f96909829c0 1 -- 172.21.15.62:0/2981406284 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f9568039ac0 msgr2=0x7f956803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.604+0000 7f96909829c0 1 --2- 172.21.15.62:0/2981406284 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f9568039ac0 0x7f956803bf80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x55d8044540d0 tx=0x7f9684006000 comp rx=0 tx=0).stop 2024-09-10T05:38:23.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.604+0000 7f96909829c0 1 -- 172.21.15.62:0/2981406284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d80446fc60 msgr2=0x55d804470080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.604+0000 7f96909829c0 1 --2- 172.21.15.62:0/2981406284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d80446fc60 0x55d804470080 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f96800e9530 tx=0x7f9680006760 comp rx=0 tx=0).stop 2024-09-10T05:38:23.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.604+0000 7f96909829c0 1 -- 172.21.15.62:0/2981406284 shutdown_connections 2024-09-10T05:38:23.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.604+0000 7f96909829c0 1 --2- 172.21.15.62:0/2981406284 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f9568039ac0 0x7f956803bf80 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.604+0000 7f96909829c0 1 --2- 172.21.15.62:0/2981406284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d80446fc60 0x55d804470080 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.604+0000 7f96909829c0 1 -- 172.21.15.62:0/2981406284 >> 172.21.15.62:0/2981406284 conn(0x55d804465610 msgr2=0x55d8044659f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:23.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.604+0000 7f96909829c0 1 -- 172.21.15.62:0/2981406284 shutdown_connections 2024-09-10T05:38:23.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.604+0000 7f96909829c0 1 -- 172.21.15.62:0/2981406284 wait complete. 2024-09-10T05:38:23.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.604+0000 7f96909829c0 1 -- 172.21.15.62:0/2867714672 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55d80445a130 msgr2=0x55d80445c5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.604+0000 7f96909829c0 1 --2- 172.21.15.62:0/2867714672 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55d80445a130 0x55d80445c5f0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.604+0000 7f96909829c0 1 -- 172.21.15.62:0/2867714672 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55d804360130 msgr2=0x55d804459100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.604+0000 7f96909829c0 1 --2- 172.21.15.62:0/2867714672 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55d804360130 0x55d804459100 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.604+0000 7f96909829c0 1 -- 172.21.15.62:0/2867714672 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55d80445eb20 msgr2=0x55d804460f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.604+0000 7f96909829c0 1 --2- 172.21.15.62:0/2867714672 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55d80445eb20 0x55d804460f10 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.604+0000 7f96909829c0 1 -- 172.21.15.62:0/2867714672 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f9574039a70 msgr2=0x7f957403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.604+0000 7f96909829c0 1 --2- 172.21.15.62:0/2867714672 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f9574039a70 0x7f957403bf30 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9684001e60 tx=0x7f96840013e0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.604+0000 7f96909829c0 1 -- 172.21.15.62:0/2867714672 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d8042d1240 msgr2=0x55d804451f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.604+0000 7f96909829c0 1 --2- 172.21.15.62:0/2867714672 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d8042d1240 0x55d804451f90 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f9680018f70 tx=0x7f9680019b80 comp rx=0 tx=0).stop 2024-09-10T05:38:23.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.604+0000 7f968ec89640 1 -- 172.21.15.62:0/2867714672 reap_dead start 2024-09-10T05:38:23.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.604+0000 7f96909829c0 1 -- 172.21.15.62:0/2867714672 shutdown_connections 2024-09-10T05:38:23.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.604+0000 7f96909829c0 1 -- 172.21.15.62:0/2867714672 >> 172.21.15.62:0/2867714672 conn(0x55d804357920 msgr2=0x55d80435be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:23.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.604+0000 7f96909829c0 1 -- 172.21.15.62:0/2867714672 shutdown_connections 2024-09-10T05:38:23.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.604+0000 7f96909829c0 1 -- 172.21.15.62:0/2867714672 wait complete. 2024-09-10T05:38:23.622 ERROR:root:None 2024-09-10T05:38:23.622 ERROR:root:0 2024-09-10T05:38:23.622 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-10T05:38:23.622 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-10T05:38:23.622 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid a_user --display-name 'True Admin User' --access-key true_admin_akey --secret true_admin_skey --caps user-info-without-keys=read --admin 2024-09-10T05:38:23.711 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:38:23.711 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:38:23.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.708+0000 7fc8c36b19c0 1 Processor -- start 2024-09-10T05:38:23.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.708+0000 7fc8c36b19c0 1 -- start start 2024-09-10T05:38:23.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.708+0000 7fc8c36b19c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5643e7658050 0x5643e765a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.708+0000 7fc8c36b19c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5643e75089c0 con 0x5643e7653f00 2024-09-10T05:38:23.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.708+0000 7fc8c36b19c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x5643e75586d0 con 0x5643e7658050 2024-09-10T05:38:23.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.708+0000 7fc8c09b6640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5643e7658050 0x5643e765a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.708+0000 7fc8c09b6640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5643e7658050 0x5643e765a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38832/0 (socket says 172.21.15.62:38832) 2024-09-10T05:38:23.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.708+0000 7fc8c11b7640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x5643e7653f00 0x5643e76542e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:52130/0 (socket says 172.21.15.62:52130) 2024-09-10T05:38:23.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.708+0000 7fc8c09b6640 1 -- 172.21.15.62:0/3719670417 learned_addr learned my addr 172.21.15.62:0/3719670417 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:23.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.712+0000 7fc8c09b6640 1 -- 172.21.15.62:0/3719670417 >> v1:172.21.15.2:6789/0 conn(0x5643e7653f00 legacy=0x5643e76542e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.712+0000 7fc8b3fff640 1 -- 172.21.15.62:0/3719670417 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2821448031 0 0) 0x5643e75089c0 con 0x5643e7653f00 2024-09-10T05:38:23.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.712+0000 7fc8c09b6640 1 -- 172.21.15.62:0/3719670417 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643e74fcca0 con 0x5643e7658050 2024-09-10T05:38:23.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.712+0000 7fc8c09b6640 1 --2- 172.21.15.62:0/3719670417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643e7658050 0x5643e765a440 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fc8b800a5c0 tx=0x7fc8b801b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feb732e8e005c9c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.712+0000 7fc8b3fff640 1 -- 172.21.15.62:0/3719670417 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8b80a9590 con 0x5643e7658050 2024-09-10T05:38:23.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.712+0000 7fc8b3fff640 1 -- 172.21.15.62:0/3719670417 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8b80ae070 con 0x5643e7658050 2024-09-10T05:38:23.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.712+0000 7fc8b3fff640 1 -- 172.21.15.62:0/3719670417 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8b80a9880 con 0x5643e7658050 2024-09-10T05:38:23.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.712+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/3719670417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643e7658050 msgr2=0x5643e765a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.712+0000 7fc8c36b19c0 1 --2- 172.21.15.62:0/3719670417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643e7658050 0x5643e765a440 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fc8b800a5c0 tx=0x7fc8b801b3d0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.712+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/3719670417 shutdown_connections 2024-09-10T05:38:23.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.712+0000 7fc8c36b19c0 1 --2- 172.21.15.62:0/3719670417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643e7658050 0x5643e765a440 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.712+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/3719670417 >> 172.21.15.62:0/3719670417 conn(0x5643e764fa20 msgr2=0x5643e7651e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:23.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.716+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/3719670417 shutdown_connections 2024-09-10T05:38:23.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.716+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/3719670417 wait complete. 2024-09-10T05:38:23.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.728+0000 7fc8c36b19c0 1 Processor -- start 2024-09-10T05:38:23.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.728+0000 7fc8c36b19c0 1 -- start start 2024-09-10T05:38:23.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.728+0000 7fc8c36b19c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643e7653f00 0x5643e773f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.728+0000 7fc8c36b19c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5643e755c680 con 0x5643e7653f00 2024-09-10T05:38:23.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.728+0000 7fc8c11b7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643e7653f00 0x5643e773f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.728+0000 7fc8c11b7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643e7653f00 0x5643e773f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38846/0 (socket says 172.21.15.62:38846) 2024-09-10T05:38:23.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.732+0000 7fc8c11b7640 1 -- 172.21.15.62:0/2926991580 learned_addr learned my addr 172.21.15.62:0/2926991580 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:23.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.732+0000 7fc8c11b7640 1 -- 172.21.15.62:0/2926991580 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643e74d7da0 con 0x5643e7653f00 2024-09-10T05:38:23.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.732+0000 7fc8c11b7640 1 --2- 172.21.15.62:0/2926991580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643e7653f00 0x5643e773f540 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4001eb0 tx=0x7fc8b400b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=698e24cfbfee86ff server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.732+0000 7fc7af606640 1 -- 172.21.15.62:0/2926991580 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8b400d640 con 0x5643e7653f00 2024-09-10T05:38:23.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.732+0000 7fc7af606640 1 -- 172.21.15.62:0/2926991580 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8b4008070 con 0x5643e7653f00 2024-09-10T05:38:23.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.732+0000 7fc7af606640 1 -- 172.21.15.62:0/2926991580 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8b400d970 con 0x5643e7653f00 2024-09-10T05:38:23.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.732+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2926991580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643e7653f00 msgr2=0x5643e773f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.732+0000 7fc8c36b19c0 1 --2- 172.21.15.62:0/2926991580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643e7653f00 0x5643e773f540 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4001eb0 tx=0x7fc8b400b6b0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.732+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2926991580 shutdown_connections 2024-09-10T05:38:23.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.732+0000 7fc8c36b19c0 1 --2- 172.21.15.62:0/2926991580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643e7653f00 0x5643e773f540 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.732+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2926991580 >> 172.21.15.62:0/2926991580 conn(0x5643e764fa20 msgr2=0x5643e773b180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:23.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.732+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2926991580 shutdown_connections 2024-09-10T05:38:23.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.732+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2926991580 wait complete. 2024-09-10T05:38:23.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.732+0000 7fc8c36b19c0 1 Processor -- start 2024-09-10T05:38:23.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.732+0000 7fc8c36b19c0 1 -- start start 2024-09-10T05:38:23.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.732+0000 7fc8c36b19c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643e7653f00 0x5643e75ca370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.732+0000 7fc8c36b19c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5643e74fea50 con 0x5643e7653f00 2024-09-10T05:38:23.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.732+0000 7fc8c11b7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643e7653f00 0x5643e75ca370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.732+0000 7fc8c11b7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643e7653f00 0x5643e75ca370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38850/0 (socket says 172.21.15.62:38850) 2024-09-10T05:38:23.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.732+0000 7fc8c11b7640 1 -- 172.21.15.62:0/1291138921 learned_addr learned my addr 172.21.15.62:0/1291138921 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:23.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.732+0000 7fc8c11b7640 1 -- 172.21.15.62:0/1291138921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643e75ca8d0 con 0x5643e7653f00 2024-09-10T05:38:23.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.732+0000 7fc8c11b7640 1 --2- 172.21.15.62:0/1291138921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643e7653f00 0x5643e75ca370 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fc8b400bbb0 tx=0x7fc8b4000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.736+0000 7fc7ade03640 1 -- 172.21.15.62:0/1291138921 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8b401a880 con 0x5643e7653f00 2024-09-10T05:38:23.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.736+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/1291138921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5643e75c8cb0 con 0x5643e7653f00 2024-09-10T05:38:23.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.736+0000 7fc7ade03640 1 -- 172.21.15.62:0/1291138921 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8b401aa20 con 0x5643e7653f00 2024-09-10T05:38:23.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.736+0000 7fc7ade03640 1 -- 172.21.15.62:0/1291138921 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8b401ad20 con 0x5643e7653f00 2024-09-10T05:38:23.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.736+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/1291138921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643e75c9240 con 0x5643e7653f00 2024-09-10T05:38:23.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.736+0000 7fc7ade03640 1 -- 172.21.15.62:0/1291138921 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc8b4017070 con 0x5643e7653f00 2024-09-10T05:38:23.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.736+0000 7fc7ade03640 1 --2- 172.21.15.62:0/1291138921 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc7a8039a70 0x7fc7a803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.736+0000 7fc7ade03640 1 -- 172.21.15.62:0/1291138921 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7fc8b4015020 con 0x5643e7653f00 2024-09-10T05:38:23.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.736+0000 7fc8c09b6640 1 --2- 172.21.15.62:0/1291138921 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc7a8039a70 0x7fc7a803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.736+0000 7fc8c36b19c0 1 --2- 172.21.15.62:0/1291138921 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5643e7658050 0x5643e774ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.736+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/1291138921 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643e7750510 con 0x5643e7658050 2024-09-10T05:38:23.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.736+0000 7fc8c19b8640 1 --2- 172.21.15.62:0/1291138921 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5643e7658050 0x5643e774ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.736+0000 7fc8c09b6640 1 --2- 172.21.15.62:0/1291138921 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc7a8039a70 0x7fc7a803bf30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc8b80ad000 tx=0x7fc8b80a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.736+0000 7fc8c19b8640 1 --2- 172.21.15.62:0/1291138921 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5643e7658050 0x5643e774ffd0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.736+0000 7fc8c19b8640 1 -- 172.21.15.62:0/1291138921 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8bc00a4d0 con 0x5643e7658050 2024-09-10T05:38:23.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.736+0000 7fc8c36b19c0 1 --2- 172.21.15.62:0/1291138921 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5643e7750fc0 0x5643e7753460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.736+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/1291138921 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643e7753bd0 con 0x5643e7750fc0 2024-09-10T05:38:23.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.736+0000 7fc8c11b7640 1 --2- 172.21.15.62:0/1291138921 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5643e7750fc0 0x5643e7753460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.740+0000 7fc8c11b7640 1 --2- 172.21.15.62:0/1291138921 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5643e7750fc0 0x5643e7753460 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.740+0000 7fc8c11b7640 1 -- 172.21.15.62:0/1291138921 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc8b402e070 con 0x5643e7750fc0 2024-09-10T05:38:23.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.740+0000 7fc8c36b19c0 1 --2- 172.21.15.62:0/1291138921 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5643e7755990 0x5643e7757d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.740+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/1291138921 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643e7758450 con 0x5643e7755990 2024-09-10T05:38:23.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.740+0000 7fc8c09b6640 1 --2- 172.21.15.62:0/1291138921 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5643e7755990 0x5643e7757d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.740+0000 7fc8c09b6640 1 --2- 172.21.15.62:0/1291138921 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5643e7755990 0x5643e7757d80 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.740+0000 7fc8c09b6640 1 -- 172.21.15.62:0/1291138921 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv5 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc8b80a9a60 con 0x5643e7755990 2024-09-10T05:38:23.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.740+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/1291138921 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643e7754830 con 0x5643e7750fc0 2024-09-10T05:38:23.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.740+0000 7fc8c11b7640 1 -- 172.21.15.62:0/1291138921 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc8b402e070 con 0x5643e7750fc0 2024-09-10T05:38:23.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.740+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/1291138921 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643e7754c70 con 0x5643e7755990 2024-09-10T05:38:23.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.740+0000 7fc8c09b6640 1 -- 172.21.15.62:0/1291138921 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc8b80a9a60 con 0x5643e7755990 2024-09-10T05:38:23.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.740+0000 7fc8c36b19c0 1 Processor -- start 2024-09-10T05:38:23.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.744+0000 7fc8c36b19c0 1 -- start start 2024-09-10T05:38:23.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.744+0000 7fc8c36b19c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643e7766ac0 0x5643e7766ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.744+0000 7fc8c36b19c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5643e7569450 con 0x5643e7766ac0 2024-09-10T05:38:23.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.744+0000 7fc8c11b7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643e7766ac0 0x5643e7766ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.744+0000 7fc8c11b7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643e7766ac0 0x5643e7766ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38856/0 (socket says 172.21.15.62:38856) 2024-09-10T05:38:23.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.744+0000 7fc8c11b7640 1 -- 172.21.15.62:0/2338811575 learned_addr learned my addr 172.21.15.62:0/2338811575 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:23.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.744+0000 7fc8c11b7640 1 -- 172.21.15.62:0/2338811575 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643e7767520 con 0x5643e7766ac0 2024-09-10T05:38:23.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.744+0000 7fc8c11b7640 1 --2- 172.21.15.62:0/2338811575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643e7766ac0 0x5643e7766ee0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fc8b400f5a0 tx=0x7fc8b400eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.744+0000 7fc7a6ffd640 1 -- 172.21.15.62:0/2338811575 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8b400e8e0 con 0x5643e7766ac0 2024-09-10T05:38:23.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.744+0000 7fc7a6ffd640 1 -- 172.21.15.62:0/2338811575 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8b40193e0 con 0x5643e7766ac0 2024-09-10T05:38:23.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.744+0000 7fc7a6ffd640 1 -- 172.21.15.62:0/2338811575 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8b40196c0 con 0x5643e7766ac0 2024-09-10T05:38:23.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.744+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2338811575 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5643e7767d80 con 0x5643e7766ac0 2024-09-10T05:38:23.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.744+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2338811575 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643e77682f0 con 0x5643e7766ac0 2024-09-10T05:38:23.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.744+0000 7fc7a6ffd640 1 -- 172.21.15.62:0/2338811575 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc8b401c450 con 0x5643e7766ac0 2024-09-10T05:38:23.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.744+0000 7fc7a6ffd640 1 --2- 172.21.15.62:0/2338811575 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc798039ac0 0x7fc79803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.744+0000 7fc7a6ffd640 1 -- 172.21.15.62:0/2338811575 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7fc8b4038020 con 0x5643e7766ac0 2024-09-10T05:38:23.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.744+0000 7fc8c09b6640 1 --2- 172.21.15.62:0/2338811575 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc798039ac0 0x7fc79803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.744+0000 7fc8c36b19c0 1 Processor -- start 2024-09-10T05:38:23.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.744+0000 7fc8c36b19c0 1 -- start start 2024-09-10T05:38:23.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.748+0000 7fc8c09b6640 1 --2- 172.21.15.62:0/2338811575 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc798039ac0 0x7fc79803bf80 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x5643e75c9cb0 tx=0x7fc8b8005ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.748+0000 7fc8c36b19c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643e7773250 0x5643e7773630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.748+0000 7fc8c36b19c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5643e773fd90 con 0x5643e7773250 2024-09-10T05:38:23.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.748+0000 7fc8c11b7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643e7773250 0x5643e7773630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.748+0000 7fc8c11b7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643e7773250 0x5643e7773630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38862/0 (socket says 172.21.15.62:38862) 2024-09-10T05:38:23.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.748+0000 7fc8c11b7640 1 -- 172.21.15.62:0/2512851100 learned_addr learned my addr 172.21.15.62:0/2512851100 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:23.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.748+0000 7fc8c11b7640 1 -- 172.21.15.62:0/2512851100 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643e7773c00 con 0x5643e7773250 2024-09-10T05:38:23.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.748+0000 7fc8c11b7640 1 --2- 172.21.15.62:0/2512851100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643e7773250 0x5643e7773630 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fc8b40437f0 tx=0x7fc8b4031b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d3a5dc850df2247 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.748+0000 7fc7a4ff9640 1 -- 172.21.15.62:0/2512851100 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8b4060070 con 0x5643e7773250 2024-09-10T05:38:23.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.748+0000 7fc7a4ff9640 1 -- 172.21.15.62:0/2512851100 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8b4042040 con 0x5643e7773250 2024-09-10T05:38:23.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.748+0000 7fc7a4ff9640 1 -- 172.21.15.62:0/2512851100 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8b4041030 con 0x5643e7773250 2024-09-10T05:38:23.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.748+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2512851100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643e7773250 msgr2=0x5643e7773630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.748+0000 7fc8c36b19c0 1 --2- 172.21.15.62:0/2512851100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643e7773250 0x5643e7773630 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fc8b40437f0 tx=0x7fc8b4031b90 comp rx=0 tx=0).stop 2024-09-10T05:38:23.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.748+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2512851100 shutdown_connections 2024-09-10T05:38:23.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.748+0000 7fc8c36b19c0 1 --2- 172.21.15.62:0/2512851100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643e7773250 0x5643e7773630 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.748+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2512851100 >> 172.21.15.62:0/2512851100 conn(0x5643e776f680 msgr2=0x5643e776d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:23.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.748+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2512851100 shutdown_connections 2024-09-10T05:38:23.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.748+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2512851100 wait complete. 2024-09-10T05:38:23.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.748+0000 7fc8c36b19c0 1 Processor -- start 2024-09-10T05:38:23.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.748+0000 7fc8c36b19c0 1 -- start start 2024-09-10T05:38:23.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.748+0000 7fc8c36b19c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643e7773250 0x5643e777a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.748+0000 7fc8c36b19c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5643e77740e0 con 0x5643e7773250 2024-09-10T05:38:23.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.748+0000 7fc8c11b7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643e7773250 0x5643e777a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.748+0000 7fc8c11b7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643e7773250 0x5643e777a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38876/0 (socket says 172.21.15.62:38876) 2024-09-10T05:38:23.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.748+0000 7fc8c11b7640 1 -- 172.21.15.62:0/2144909004 learned_addr learned my addr 172.21.15.62:0/2144909004 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:23.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.748+0000 7fc8c11b7640 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643e777ab30 con 0x5643e7773250 2024-09-10T05:38:23.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.748+0000 7fc8c11b7640 1 --2- 172.21.15.62:0/2144909004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643e7773250 0x5643e777a5d0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fc8b401cfd0 tx=0x7fc8b4048ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.748+0000 7fc796ffd640 1 -- 172.21.15.62:0/2144909004 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8b4060070 con 0x5643e7773250 2024-09-10T05:38:23.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.752+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5643e777ab30 con 0x5643e7773250 2024-09-10T05:38:23.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.752+0000 7fc796ffd640 1 -- 172.21.15.62:0/2144909004 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8b4061040 con 0x5643e7773250 2024-09-10T05:38:23.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.752+0000 7fc796ffd640 1 -- 172.21.15.62:0/2144909004 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8b4041040 con 0x5643e7773250 2024-09-10T05:38:23.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.752+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643e777ab30 con 0x5643e7773250 2024-09-10T05:38:23.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.752+0000 7fc796ffd640 1 -- 172.21.15.62:0/2144909004 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc8b406d020 con 0x5643e7773250 2024-09-10T05:38:23.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.752+0000 7fc796ffd640 1 --2- 172.21.15.62:0/2144909004 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc78c039a70 0x7fc78c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.752+0000 7fc8c36b19c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.752+0000 7fc796ffd640 1 -- 172.21.15.62:0/2144909004 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7fc8b406b020 con 0x5643e7773250 2024-09-10T05:38:23.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.752+0000 7fc8c09b6640 1 --2- 172.21.15.62:0/2144909004 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc78c039a70 0x7fc78c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.752+0000 7fc8c36b19c0 1 --2- 172.21.15.62:0/2144909004 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5643e7785460 0x5643e77878f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.752+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643e7788040 con 0x5643e7785460 2024-09-10T05:38:23.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.752+0000 7fc8c19b8640 1 --2- 172.21.15.62:0/2144909004 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5643e7785460 0x5643e77878f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.752+0000 7fc8c09b6640 1 --2- 172.21.15.62:0/2144909004 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc78c039a70 0x7fc78c03bf30 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc8b801b410 tx=0x7fc8b80c1040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.752+0000 7fc8c19b8640 1 --2- 172.21.15.62:0/2144909004 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5643e7785460 0x5643e77878f0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.752+0000 7fc8c19b8640 1 -- 172.21.15.62:0/2144909004 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8bc00a4d0 con 0x5643e7785460 2024-09-10T05:38:23.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.752+0000 7fc8c36b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:23.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.752+0000 7fc8c36b19c0 20 realm 2024-09-10T05:38:23.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.752+0000 7fc8c36b19c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.752+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643e7784850 con 0x5643e7785460 2024-09-10T05:38:23.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.752+0000 7fc8c19b8640 1 -- 172.21.15.62:0/2144909004 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8bc00a4d0 con 0x5643e7785460 2024-09-10T05:38:23.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.752+0000 7fc8c36b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:23.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.752+0000 7fc8c36b19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:38:23.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.752+0000 7fc8c36b19c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.752+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643e7788b10 con 0x5643e7785460 2024-09-10T05:38:23.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.752+0000 7fc8c19b8640 1 -- 172.21.15.62:0/2144909004 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8bc00a4d0 con 0x5643e7785460 2024-09-10T05:38:23.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.752+0000 7fc8c36b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:23.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.752+0000 7fc8c36b19c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.752+0000 7fc8c36b19c0 1 --2- 172.21.15.62:0/2144909004 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5643e77898f0 0x5643e778bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.752+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643e778c390 con 0x5643e77898f0 2024-09-10T05:38:23.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.752+0000 7fc8c11b7640 1 --2- 172.21.15.62:0/2144909004 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5643e77898f0 0x5643e778bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.756+0000 7fc8c11b7640 1 --2- 172.21.15.62:0/2144909004 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5643e77898f0 0x5643e778bce0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.756+0000 7fc8c11b7640 1 -- 172.21.15.62:0/2144909004 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc8b402e070 con 0x5643e77898f0 2024-09-10T05:38:23.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.756+0000 7fc8c36b19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:38:23.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.756+0000 7fc8c36b19c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.756+0000 7fc8c36b19c0 1 --2- 172.21.15.62:0/2144909004 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5643e778d0f0 0x5643e778f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.756+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643e778fc50 con 0x5643e778d0f0 2024-09-10T05:38:23.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.756+0000 7fc8c09b6640 1 --2- 172.21.15.62:0/2144909004 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5643e778d0f0 0x5643e778f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.756+0000 7fc8c09b6640 1 --2- 172.21.15.62:0/2144909004 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5643e778d0f0 0x5643e778f4e0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.756+0000 7fc8c09b6640 1 -- 172.21.15.62:0/2144909004 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv5 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc8b80a9a60 con 0x5643e778d0f0 2024-09-10T05:38:23.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.756+0000 7fc8c36b19c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:38:23.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.756+0000 7fc8c36b19c0 20 searching for the correct realm 2024-09-10T05:38:23.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.756+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643e7791520 con 0x5643e778d0f0 2024-09-10T05:38:23.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.756+0000 7fc8c09b6640 1 -- 172.21.15.62:0/2144909004 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8b80a9a60 con 0x5643e778d0f0 2024-09-10T05:38:23.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.756+0000 7fc8c09b6640 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643e7791520 con 0x5643e77898f0 2024-09-10T05:38:23.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.756+0000 7fc8c11b7640 1 -- 172.21.15.62:0/2144909004 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8b402e070 con 0x5643e77898f0 2024-09-10T05:38:23.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.756+0000 7fc8c11b7640 1 --2- 172.21.15.62:0/2144909004 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fc8b405a070 0x7fc8b404f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.756+0000 7fc8c11b7640 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643e7791520 con 0x7fc8b405a070 2024-09-10T05:38:23.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.756+0000 7fc8c19b8640 1 --2- 172.21.15.62:0/2144909004 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fc8b405a070 0x7fc8b404f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.756+0000 7fc8c19b8640 1 --2- 172.21.15.62:0/2144909004 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fc8b405a070 0x7fc8b404f640 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.760+0000 7fc8c19b8640 1 -- 172.21.15.62:0/2144909004 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8bc00a4d0 con 0x7fc8b405a070 2024-09-10T05:38:23.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.760+0000 7fc8c19b8640 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643e7791520 con 0x5643e7785460 2024-09-10T05:38:23.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.760+0000 7fc8c19b8640 1 -- 172.21.15.62:0/2144909004 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8bc00a4d0 con 0x5643e7785460 2024-09-10T05:38:23.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.760+0000 7fc8c19b8640 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643e7791520 con 0x5643e7785460 2024-09-10T05:38:23.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.760+0000 7fc8c19b8640 1 -- 172.21.15.62:0/2144909004 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8bc00a4d0 con 0x5643e7785460 2024-09-10T05:38:23.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.760+0000 7fc8c19b8640 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643e7791520 con 0x5643e778d0f0 2024-09-10T05:38:23.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.760+0000 7fc8c09b6640 1 -- 172.21.15.62:0/2144909004 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8b80a9a60 con 0x5643e778d0f0 2024-09-10T05:38:23.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.760+0000 7fc8c09b6640 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643e7791520 con 0x5643e7785460 2024-09-10T05:38:23.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.760+0000 7fc8c19b8640 1 -- 172.21.15.62:0/2144909004 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8bc00a4d0 con 0x5643e7785460 2024-09-10T05:38:23.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.760+0000 7fc8c19b8640 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643e7791520 con 0x5643e77898f0 2024-09-10T05:38:23.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.760+0000 7fc8c11b7640 1 -- 172.21.15.62:0/2144909004 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8b402e070 con 0x5643e77898f0 2024-09-10T05:38:23.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.760+0000 7fc8c11b7640 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643e7791520 con 0x5643e77898f0 2024-09-10T05:38:23.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.760+0000 7fc8c11b7640 1 -- 172.21.15.62:0/2144909004 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8b402e070 con 0x5643e77898f0 2024-09-10T05:38:23.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.760+0000 7fc8c11b7640 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643e7791520 con 0x5643e7785460 2024-09-10T05:38:23.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.760+0000 7fc8c19b8640 1 -- 172.21.15.62:0/2144909004 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8bc00a4d0 con 0x5643e7785460 2024-09-10T05:38:23.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.760+0000 7fc8c19b8640 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643e7791520 con 0x7fc8b405a070 2024-09-10T05:38:23.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.760+0000 7fc8c19b8640 1 -- 172.21.15.62:0/2144909004 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8bc00a4d0 con 0x7fc8b405a070 2024-09-10T05:38:23.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.760+0000 7fc8c19b8640 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643e7791520 con 0x5643e7785460 2024-09-10T05:38:23.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.760+0000 7fc8c19b8640 1 -- 172.21.15.62:0/2144909004 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8bc00a4d0 con 0x5643e7785460 2024-09-10T05:38:23.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.760+0000 7fc8c19b8640 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643e7791520 con 0x7fc8b405a070 2024-09-10T05:38:23.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.760+0000 7fc8c19b8640 1 -- 172.21.15.62:0/2144909004 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc8bc00a4d0 con 0x7fc8b405a070 2024-09-10T05:38:23.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.760+0000 7fc8c19b8640 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643e7791520 con 0x5643e77898f0 2024-09-10T05:38:23.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.764+0000 7fc8c11b7640 1 -- 172.21.15.62:0/2144909004 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8b402e070 con 0x5643e77898f0 2024-09-10T05:38:23.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.764+0000 7fc8c11b7640 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643e7791520 con 0x5643e778d0f0 2024-09-10T05:38:23.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.764+0000 7fc8c09b6640 1 -- 172.21.15.62:0/2144909004 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8b80a9a60 con 0x5643e778d0f0 2024-09-10T05:38:23.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.764+0000 7fc8c09b6640 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643e7791520 con 0x5643e7785460 2024-09-10T05:38:23.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.764+0000 7fc8c19b8640 1 -- 172.21.15.62:0/2144909004 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8bc00a4d0 con 0x5643e7785460 2024-09-10T05:38:23.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.764+0000 7fc8c19b8640 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643e7791520 con 0x5643e77898f0 2024-09-10T05:38:23.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.764+0000 7fc8c11b7640 1 -- 172.21.15.62:0/2144909004 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8b402e070 con 0x5643e77898f0 2024-09-10T05:38:23.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.764+0000 7fc8c11b7640 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643e7791520 con 0x5643e778d0f0 2024-09-10T05:38:23.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.764+0000 7fc8c09b6640 1 -- 172.21.15.62:0/2144909004 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 34 out=170b] v34'5 uv5 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7fc8b80a9a60 con 0x5643e778d0f0 2024-09-10T05:38:23.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.764+0000 7fc8c09b6640 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643e7791520 con 0x5643e7785460 2024-09-10T05:38:23.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.764+0000 7fc8c19b8640 1 -- 172.21.15.62:0/2144909004 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8bc00a4d0 con 0x5643e7785460 2024-09-10T05:38:23.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.764+0000 7fc8c19b8640 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643e7791520 con 0x5643e7785460 2024-09-10T05:38:23.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.764+0000 7fc8c19b8640 1 -- 172.21.15.62:0/2144909004 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc8bc00a4d0 con 0x5643e7785460 2024-09-10T05:38:23.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.764+0000 7fc8c19b8640 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643e7791520 con 0x5643e7785460 2024-09-10T05:38:23.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.764+0000 7fc8c19b8640 1 -- 172.21.15.62:0/2144909004 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8bc00a4d0 con 0x5643e7785460 2024-09-10T05:38:23.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.764+0000 7fc8c19b8640 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643e7791520 con 0x5643e778d0f0 2024-09-10T05:38:23.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.764+0000 7fc8c09b6640 1 -- 172.21.15.62:0/2144909004 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8b80a9a60 con 0x5643e778d0f0 2024-09-10T05:38:23.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.764+0000 7fc8c09b6640 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643e7791520 con 0x7fc8b405a070 2024-09-10T05:38:23.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.764+0000 7fc8c19b8640 1 -- 172.21.15.62:0/2144909004 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8bc00a4d0 con 0x7fc8b405a070 2024-09-10T05:38:23.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.764+0000 7fc8c19b8640 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643e7791520 con 0x5643e7785460 2024-09-10T05:38:23.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.764+0000 7fc8c19b8640 1 -- 172.21.15.62:0/2144909004 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8bc00a4d0 con 0x5643e7785460 2024-09-10T05:38:23.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.764+0000 7fc8c19b8640 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643e7791520 con 0x7fc8b405a070 2024-09-10T05:38:23.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.768+0000 7fc8c19b8640 1 -- 172.21.15.62:0/2144909004 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8bc00a4d0 con 0x7fc8b405a070 2024-09-10T05:38:23.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.768+0000 7fc8c19b8640 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643e7791520 con 0x5643e778d0f0 2024-09-10T05:38:23.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.768+0000 7fc8c09b6640 1 -- 172.21.15.62:0/2144909004 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8b80a9a60 con 0x5643e778d0f0 2024-09-10T05:38:23.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.768+0000 7fc8c09b6640 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643e7791520 con 0x7fc8b405a070 2024-09-10T05:38:23.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.768+0000 7fc8c19b8640 1 -- 172.21.15.62:0/2144909004 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8bc00a4d0 con 0x7fc8b405a070 2024-09-10T05:38:23.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.768+0000 7fc8c19b8640 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643e7791520 con 0x5643e77898f0 2024-09-10T05:38:23.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.768+0000 7fc8c11b7640 1 -- 172.21.15.62:0/2144909004 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8b402e070 con 0x5643e77898f0 2024-09-10T05:38:23.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.768+0000 7fc8c11b7640 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643e7791520 con 0x5643e77898f0 2024-09-10T05:38:23.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.768+0000 7fc8c11b7640 1 -- 172.21.15.62:0/2144909004 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8b402e070 con 0x5643e77898f0 2024-09-10T05:38:23.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.768+0000 7fc8c11b7640 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643e7791520 con 0x5643e778d0f0 2024-09-10T05:38:23.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.768+0000 7fc8c09b6640 1 -- 172.21.15.62:0/2144909004 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8b80a9a60 con 0x5643e778d0f0 2024-09-10T05:38:23.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.768+0000 7fc8c09b6640 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643e7791520 con 0x5643e77898f0 2024-09-10T05:38:23.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.768+0000 7fc8c11b7640 1 -- 172.21.15.62:0/2144909004 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc8b402e070 con 0x5643e77898f0 2024-09-10T05:38:23.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.768+0000 7fc8c11b7640 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643e7791520 con 0x5643e77898f0 2024-09-10T05:38:23.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.768+0000 7fc8c11b7640 1 -- 172.21.15.62:0/2144909004 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8b402e070 con 0x5643e77898f0 2024-09-10T05:38:23.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.768+0000 7fc8c36b19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:38:23.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.768+0000 7fc8c36b19c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:38:23.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.768+0000 7fc8c36b19c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:38:23.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.768+0000 7fc8c36b19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:38:23.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.768+0000 7fc8c36b19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:38:23.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.768+0000 7fc8c36b19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:38:23.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.768+0000 7fc8c36b19c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.768+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643e7790610 con 0x5643e7785460 2024-09-10T05:38:23.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.772+0000 7fc8c19b8640 1 -- 172.21.15.62:0/2144909004 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8bc00a4d0 con 0x5643e7785460 2024-09-10T05:38:23.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.772+0000 7fc8c36b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:23.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.772+0000 7fc8c36b19c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.772+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643e7790220 con 0x5643e77898f0 2024-09-10T05:38:23.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.772+0000 7fc8c11b7640 1 -- 172.21.15.62:0/2144909004 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc8b402e070 con 0x5643e77898f0 2024-09-10T05:38:23.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.772+0000 7fc8c36b19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:38:23.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.772+0000 7fc8c36b19c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.772+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643e7790230 con 0x5643e778d0f0 2024-09-10T05:38:23.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.772+0000 7fc8c09b6640 1 -- 172.21.15.62:0/2144909004 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc8b80a9a60 con 0x5643e778d0f0 2024-09-10T05:38:23.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.772+0000 7fc8c36b19c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:38:23.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.772+0000 7fc8c36b19c0 20 zone default found 2024-09-10T05:38:23.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.772+0000 7fc8c36b19c0 4 Realm: () 2024-09-10T05:38:23.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.772+0000 7fc8c36b19c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:38:23.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.772+0000 7fc8c36b19c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:38:23.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.772+0000 7fc8c36b19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:38:23.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.772+0000 7fc8c36b19c0 20 zonegroup default 2024-09-10T05:38:23.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.772+0000 7fc8c36b19c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.772+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643e7791950 con 0x7fc8b405a070 2024-09-10T05:38:23.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.772+0000 7fc8c19b8640 1 -- 172.21.15.62:0/2144909004 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc8bc00a4d0 con 0x7fc8b405a070 2024-09-10T05:38:23.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.772+0000 7fc8c36b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:23.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.772+0000 7fc8c36b19c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.772+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643e7793b90 con 0x5643e778d0f0 2024-09-10T05:38:23.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.772+0000 7fc8c09b6640 1 -- 172.21.15.62:0/2144909004 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc8b80a9a60 con 0x5643e778d0f0 2024-09-10T05:38:23.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.772+0000 7fc8c36b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:23.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.772+0000 7fc8c36b19c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.772+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643e7793f30 con 0x5643e778d0f0 2024-09-10T05:38:23.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.772+0000 7fc8c09b6640 1 -- 172.21.15.62:0/2144909004 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc8b80a9a60 con 0x5643e778d0f0 2024-09-10T05:38:23.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.772+0000 7fc8c36b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:23.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.772+0000 7fc8c36b19c0 20 started sync module instance, tier type = 2024-09-10T05:38:23.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.772+0000 7fc8c36b19c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:38:23.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.772+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643e7793020 con 0x5643e77898f0 2024-09-10T05:38:23.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.776+0000 7fc8c11b7640 1 -- 172.21.15.62:0/2144909004 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8b402e070 con 0x5643e77898f0 2024-09-10T05:38:23.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.776+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94849646277968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643e7793020 con 0x5643e77898f0 2024-09-10T05:38:23.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.776+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643e7794940 con 0x5643e7785460 2024-09-10T05:38:23.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.776+0000 7fc8c19b8640 1 -- 172.21.15.62:0/2144909004 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8bc00a4d0 con 0x5643e7785460 2024-09-10T05:38:23.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.776+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94849646281872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643e7795190 con 0x5643e7785460 2024-09-10T05:38:23.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.776+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643e7795b90 con 0x5643e77898f0 2024-09-10T05:38:23.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.776+0000 7fc8c19b8640 1 -- 172.21.15.62:0/2144909004 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94849646281872] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8bc00a4d0 con 0x5643e7785460 2024-09-10T05:38:23.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.776+0000 7fc8c11b7640 1 -- 172.21.15.62:0/2144909004 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94849646277968] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8b402e070 con 0x5643e77898f0 2024-09-10T05:38:23.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.780+0000 7fc8c11b7640 1 -- 172.21.15.62:0/2144909004 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8b402e070 con 0x5643e77898f0 2024-09-10T05:38:23.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.780+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94849646275440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643e7794ce0 con 0x5643e77898f0 2024-09-10T05:38:23.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.780+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643e7796430 con 0x7fc8b405a070 2024-09-10T05:38:23.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.780+0000 7fc8c19b8640 1 -- 172.21.15.62:0/2144909004 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8bc00a4d0 con 0x7fc8b405a070 2024-09-10T05:38:23.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.780+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94849646288768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643e7794ce0 con 0x7fc8b405a070 2024-09-10T05:38:23.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.780+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643e7796e70 con 0x5643e77898f0 2024-09-10T05:38:23.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.780+0000 7fc8c11b7640 1 -- 172.21.15.62:0/2144909004 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94849646275440] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8b402e070 con 0x5643e77898f0 2024-09-10T05:38:23.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.780+0000 7fc8c19b8640 1 -- 172.21.15.62:0/2144909004 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94849646288768] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8bc00a4d0 con 0x7fc8b405a070 2024-09-10T05:38:23.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.780+0000 7fc8c11b7640 1 -- 172.21.15.62:0/2144909004 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8b402e070 con 0x5643e77898f0 2024-09-10T05:38:23.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.780+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94849646289824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643e77969c0 con 0x5643e77898f0 2024-09-10T05:38:23.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.780+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643e7797290 con 0x5643e778d0f0 2024-09-10T05:38:23.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.784+0000 7fc8c09b6640 1 -- 172.21.15.62:0/2144909004 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8b80a9a60 con 0x5643e778d0f0 2024-09-10T05:38:23.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.784+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94849646291392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643e7796de0 con 0x5643e778d0f0 2024-09-10T05:38:23.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.784+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643e77981d0 con 0x5643e778d0f0 2024-09-10T05:38:23.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.784+0000 7fc8c11b7640 1 -- 172.21.15.62:0/2144909004 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94849646289824] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8b402e070 con 0x5643e77898f0 2024-09-10T05:38:23.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.784+0000 7fc8c09b6640 1 -- 172.21.15.62:0/2144909004 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94849646291392] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8b80a9a60 con 0x5643e778d0f0 2024-09-10T05:38:23.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.784+0000 7fc8c09b6640 1 -- 172.21.15.62:0/2144909004 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8b80a9a60 con 0x5643e778d0f0 2024-09-10T05:38:23.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.784+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94849646294656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643e7798190 con 0x5643e778d0f0 2024-09-10T05:38:23.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.784+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643e7798a70 con 0x7fc8b405a070 2024-09-10T05:38:23.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.784+0000 7fc8c19b8640 1 -- 172.21.15.62:0/2144909004 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8bc00a4d0 con 0x7fc8b405a070 2024-09-10T05:38:23.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.784+0000 7fc8c09b6640 1 -- 172.21.15.62:0/2144909004 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94849646294656] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8b80a9a60 con 0x5643e778d0f0 2024-09-10T05:38:23.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.784+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94849646296224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643e7798190 con 0x7fc8b405a070 2024-09-10T05:38:23.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.784+0000 7fc8c36b19c0 20 add_watcher() i=0 2024-09-10T05:38:23.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.784+0000 7fc8c36b19c0 20 add_watcher() i=1 2024-09-10T05:38:23.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.784+0000 7fc8c36b19c0 20 add_watcher() i=2 2024-09-10T05:38:23.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.784+0000 7fc8c36b19c0 20 add_watcher() i=3 2024-09-10T05:38:23.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.784+0000 7fc8c36b19c0 20 add_watcher() i=4 2024-09-10T05:38:23.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.784+0000 7fc8c36b19c0 20 add_watcher() i=5 2024-09-10T05:38:23.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.784+0000 7fc8c36b19c0 20 add_watcher() i=6 2024-09-10T05:38:23.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.788+0000 7fc8c19b8640 1 -- 172.21.15.62:0/2144909004 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94849646296224] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8bc00a4d0 con 0x7fc8b405a070 2024-09-10T05:38:23.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.788+0000 7fc8c36b19c0 20 add_watcher() i=7 2024-09-10T05:38:23.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.788+0000 7fc8c36b19c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:38:23.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.788+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643e779bb30 con 0x5643e7785460 2024-09-10T05:38:23.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.788+0000 7fc8c19b8640 1 -- 172.21.15.62:0/2144909004 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc8bc00a4d0 con 0x5643e7785460 2024-09-10T05:38:23.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.788+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94849646298560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643e7799050 con 0x5643e7785460 2024-09-10T05:38:23.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.788+0000 7fc8c19b8640 1 -- 172.21.15.62:0/2144909004 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94849646298560] v34'257 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc8bc00a4d0 con 0x5643e7785460 2024-09-10T05:38:23.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.788+0000 7fc777fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:38:23.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.788+0000 7fc8c36b19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:38:23.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.788+0000 7fc8c36b19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:38:23.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.788+0000 7fc8c36b19c0 5 note: GC not initialized 2024-09-10T05:38:23.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.788+0000 7fc776fe5640 20 reqs_thread_entry: start 2024-09-10T05:38:23.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.788+0000 7fc8c36b19c0 20 init_complete bucket index max shards: 11 2024-09-10T05:38:23.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.788+0000 7fc8c36b19c0 20 Filter name: none 2024-09-10T05:38:23.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.788+0000 7fc774fe1640 20 reqs_thread_entry: start 2024-09-10T05:38:23.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.788+0000 7fc8c36b19c0 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-10T05:38:23.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.788+0000 7fc8c36b19c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.788+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:62 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643e77beda0 con 0x5643e77898f0 2024-09-10T05:38:23.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.792+0000 7fc8c11b7640 1 -- 172.21.15.62:0/2144909004 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(62 a_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 234+0+0 (crc 0 0 0) 0x7fc8b402e070 con 0x5643e77898f0 2024-09-10T05:38:23.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.792+0000 7fc8c36b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:23.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.792+0000 7fc8c36b19c0 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x0 2024-09-10T05:38:23.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.792+0000 7fc8c36b19c0 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-10T05:38:23.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.792+0000 7fc8c36b19c0 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : miss 2024-09-10T05:38:23.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.792+0000 7fc8c36b19c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.792+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:63 8.15 8:afe09604:users.keys::true_admin_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643e77bd440 con 0x5643e778d0f0 2024-09-10T05:38:23.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.792+0000 7fc8c09b6640 1 -- 172.21.15.62:0/2144909004 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(63 true_admin_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 201+0+0 (crc 0 0 0) 0x7fc8b80a9a60 con 0x5643e778d0f0 2024-09-10T05:38:23.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.792+0000 7fc8c36b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:23.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.792+0000 7fc8c36b19c0 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x0 2024-09-10T05:38:23.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.792+0000 7fc8c36b19c0 10 adding default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-10T05:38:23.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.792+0000 7fc8c36b19c0 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-10T05:38:23.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.792+0000 7fc8c36b19c0 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-10T05:38:23.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.792+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:64 8.14 8:2efb937b:users.uid::a_user:head [delete,create,call version.set in=58b,writefull 0~363 in=363b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643e77bdce0 con 0x5643e77898f0 2024-09-10T05:38:23.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.796+0000 7fc8c11b7640 1 -- 172.21.15.62:0/2144909004 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(64 a_user [delete,create,call,writefull 0~363] v34'7 uv7 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7fc8b402e070 con 0x5643e77898f0 2024-09-10T05:38:23.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.796+0000 7fc8c36b19c0 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-10T05:38:23.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.796+0000 7fc8c36b19c0 10 moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-10T05:38:23.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.796+0000 7fc8c36b19c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-10T05:38:23.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.796+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:65 7.15 7:a93a5511:::notify.2:head [notify cookie 94849646450736 in=554b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643e77c2390 con 0x5643e77898f0 2024-09-10T05:38:23.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.796+0000 7fc8c11b7640 1 -- 172.21.15.62:0/2144909004 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== watch-notify(notify (1) cookie 94849646275440 notify 146028888113 ret 0) ==== 584+0+0 (crc 0 0 0) 0x5643e77be6f0 con 0x5643e77898f0 2024-09-10T05:38:23.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.796+0000 7fc797fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888113 cookie 94849646275440 notifier 4857 bl.length()=542 2024-09-10T05:38:23.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.796+0000 7fc797fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-10T05:38:23.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.796+0000 7fc797fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-10T05:38:23.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.796+0000 7fc797fff640 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fc6e8003440 con 0x5643e77898f0 2024-09-10T05:38:23.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.796+0000 7fc8c11b7640 1 -- 172.21.15.62:0/2144909004 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== osd_op_reply(65 notify.2 [notify cookie 94849646450736 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc8b402e070 con 0x5643e77898f0 2024-09-10T05:38:23.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.796+0000 7fc8c11b7640 1 -- 172.21.15.62:0/2144909004 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== watch-notify(notify_complete (2) cookie 94849646450736 notify 146028888113 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc8b4087020 con 0x5643e77898f0 2024-09-10T05:38:23.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.796+0000 7fc8c11b7640 1 -- 172.21.15.62:0/2144909004 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(66 notify.2 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8b402e070 con 0x5643e77898f0 2024-09-10T05:38:23.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.796+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:67 8.15 8:afe09604:users.keys::true_admin_akey:head [delete,create,writefull 0~10 in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643e77bdce0 con 0x5643e778d0f0 2024-09-10T05:38:23.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.796+0000 7fc8c09b6640 1 -- 172.21.15.62:0/2144909004 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(67 true_admin_akey [delete,create,writefull 0~10] v34'3 uv3 ondisk = 0) ==== 243+0+0 (crc 0 0 0) 0x7fc8b80a9a60 con 0x5643e778d0f0 2024-09-10T05:38:23.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.796+0000 7fc8c36b19c0 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-10T05:38:23.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.796+0000 7fc8c36b19c0 10 moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-10T05:38:23.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.796+0000 7fc8c36b19c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-10T05:38:23.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.796+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94849646450736 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643e77bdc50 con 0x5643e778d0f0 2024-09-10T05:38:23.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.796+0000 7fc8c09b6640 1 -- 172.21.15.62:0/2144909004 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== watch-notify(notify (1) cookie 94849646291392 notify 146028888106 ret 0) ==== 217+0+0 (crc 0 0 0) 0x7fc8b80e6040 con 0x5643e778d0f0 2024-09-10T05:38:23.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.796+0000 7fc8c09b6640 1 -- 172.21.15.62:0/2144909004 <== osd.3 v2:172.21.15.62:6816/2708991149 19 ==== osd_op_reply(68 notify.5 [notify cookie 94849646450736 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc8b80a9a60 con 0x5643e778d0f0 2024-09-10T05:38:23.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.796+0000 7fc797fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888106 cookie 94849646291392 notifier 4857 bl.length()=175 2024-09-10T05:38:23.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.796+0000 7fc797fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-10T05:38:23.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.796+0000 7fc797fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-10T05:38:23.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.800+0000 7fc797fff640 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fc6e8003440 con 0x5643e778d0f0 2024-09-10T05:38:23.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.800+0000 7fc8c09b6640 1 -- 172.21.15.62:0/2144909004 <== osd.3 v2:172.21.15.62:6816/2708991149 20 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8b80a9a60 con 0x5643e778d0f0 2024-09-10T05:38:23.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.800+0000 7fc8c09b6640 1 -- 172.21.15.62:0/2144909004 <== osd.3 v2:172.21.15.62:6816/2708991149 21 ==== watch-notify(notify_complete (2) cookie 94849646450736 notify 146028888106 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5643e74fcca0 con 0x5643e778d0f0 2024-09-10T05:38:23.803 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"a_user","display_name":"True Admin User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"a_user","access_key":"true_admin_akey","secret_key":"true_admin_skey","active":true,"create_date":"2024-09-10T05:38:23.794847Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","admin":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:38:23.794835Z","tags":[],"group_ids":[]} 2024-09-10T05:38:23.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.800+0000 7fc777fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:38:23.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.800+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94849646298560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643e77bcbd0 con 0x5643e7785460 2024-09-10T05:38:23.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.800+0000 7fc8c19b8640 1 -- 172.21.15.62:0/2144909004 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94849646298560] v34'258 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc8bc00a4d0 con 0x5643e7785460 2024-09-10T05:38:23.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.800+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94849646277968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643e77bcbd0 con 0x5643e77898f0 2024-09-10T05:38:23.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.804+0000 7fc8c11b7640 1 -- 172.21.15.62:0/2144909004 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94849646277968] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8b402e070 con 0x5643e77898f0 2024-09-10T05:38:23.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.804+0000 7fc8c36b19c0 20 remove_watcher() i=0 2024-09-10T05:38:23.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.804+0000 7fc8c36b19c0 2 removed watcher, disabling cache 2024-09-10T05:38:23.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.804+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94849646281872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643e77bcbd0 con 0x5643e7785460 2024-09-10T05:38:23.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.804+0000 7fc8c19b8640 1 -- 172.21.15.62:0/2144909004 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94849646281872] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8bc00a4d0 con 0x5643e7785460 2024-09-10T05:38:23.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.804+0000 7fc8c36b19c0 20 remove_watcher() i=1 2024-09-10T05:38:23.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.804+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94849646275440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643e77bcbd0 con 0x5643e77898f0 2024-09-10T05:38:23.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.808+0000 7fc8c11b7640 1 -- 172.21.15.62:0/2144909004 <== osd.0 v2:172.21.15.2:6800/945139080 25 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94849646275440] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8b402e070 con 0x5643e77898f0 2024-09-10T05:38:23.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.808+0000 7fc8c36b19c0 20 remove_watcher() i=2 2024-09-10T05:38:23.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.808+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94849646288768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643e77bcbd0 con 0x7fc8b405a070 2024-09-10T05:38:23.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.808+0000 7fc8c19b8640 1 -- 172.21.15.62:0/2144909004 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94849646288768] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8bc00a4d0 con 0x7fc8b405a070 2024-09-10T05:38:23.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.808+0000 7fc8c36b19c0 20 remove_watcher() i=3 2024-09-10T05:38:23.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.808+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94849646289824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643e77bcbd0 con 0x5643e77898f0 2024-09-10T05:38:23.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.812+0000 7fc8c11b7640 1 -- 172.21.15.62:0/2144909004 <== osd.0 v2:172.21.15.2:6800/945139080 26 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94849646289824] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8b402e070 con 0x5643e77898f0 2024-09-10T05:38:23.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.812+0000 7fc8c36b19c0 20 remove_watcher() i=4 2024-09-10T05:38:23.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.812+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94849646291392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643e77bcbd0 con 0x5643e778d0f0 2024-09-10T05:38:23.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.812+0000 7fc8c09b6640 1 -- 172.21.15.62:0/2144909004 <== osd.3 v2:172.21.15.62:6816/2708991149 22 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94849646291392] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8b80a9a60 con 0x5643e778d0f0 2024-09-10T05:38:23.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.812+0000 7fc8c36b19c0 20 remove_watcher() i=5 2024-09-10T05:38:23.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.812+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94849646294656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643e77bcbd0 con 0x5643e778d0f0 2024-09-10T05:38:23.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.812+0000 7fc8c09b6640 1 -- 172.21.15.62:0/2144909004 <== osd.3 v2:172.21.15.62:6816/2708991149 23 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94849646294656] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8b80a9a60 con 0x5643e778d0f0 2024-09-10T05:38:23.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.812+0000 7fc8c36b19c0 20 remove_watcher() i=6 2024-09-10T05:38:23.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.812+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94849646296224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643e77bcbd0 con 0x7fc8b405a070 2024-09-10T05:38:23.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.816+0000 7fc8c19b8640 1 -- 172.21.15.62:0/2144909004 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94849646296224] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8bc00a4d0 con 0x7fc8b405a070 2024-09-10T05:38:23.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.816+0000 7fc8c36b19c0 20 remove_watcher() i=7 2024-09-10T05:38:23.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.816+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5643e77898f0 msgr2=0x5643e778bce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.816+0000 7fc8c36b19c0 1 --2- 172.21.15.62:0/2144909004 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5643e77898f0 0x5643e778bce0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.816+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5643e7785460 msgr2=0x5643e77878f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.816+0000 7fc8c36b19c0 1 --2- 172.21.15.62:0/2144909004 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5643e7785460 0x5643e77878f0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.816+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fc8b405a070 msgr2=0x7fc8b404f640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.816+0000 7fc8c36b19c0 1 --2- 172.21.15.62:0/2144909004 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fc8b405a070 0x7fc8b404f640 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.816+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5643e778d0f0 msgr2=0x5643e778f4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.816+0000 7fc8c36b19c0 1 --2- 172.21.15.62:0/2144909004 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5643e778d0f0 0x5643e778f4e0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.816+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc78c039a70 msgr2=0x7fc78c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.816+0000 7fc8c36b19c0 1 --2- 172.21.15.62:0/2144909004 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc78c039a70 0x7fc78c03bf30 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc8b801b410 tx=0x7fc8b80c1040 comp rx=0 tx=0).stop 2024-09-10T05:38:23.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.816+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643e7773250 msgr2=0x5643e777a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.816+0000 7fc8c19b8640 1 -- 172.21.15.62:0/2144909004 reap_dead start 2024-09-10T05:38:23.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.816+0000 7fc8c36b19c0 1 --2- 172.21.15.62:0/2144909004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643e7773250 0x5643e777a5d0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fc8b401cfd0 tx=0x7fc8b4048ee0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.816+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 shutdown_connections 2024-09-10T05:38:23.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.816+0000 7fc8c36b19c0 1 --2- 172.21.15.62:0/2144909004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643e7773250 0x5643e777a5d0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.816+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 >> 172.21.15.62:0/2144909004 conn(0x5643e776f680 msgr2=0x5643e776d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:23.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.816+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 shutdown_connections 2024-09-10T05:38:23.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.816+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2144909004 wait complete. 2024-09-10T05:38:23.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.816+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2338811575 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc798039ac0 msgr2=0x7fc79803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.816+0000 7fc8c36b19c0 1 --2- 172.21.15.62:0/2338811575 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc798039ac0 0x7fc79803bf80 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x5643e75c9cb0 tx=0x7fc8b8005ad0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.816+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2338811575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643e7766ac0 msgr2=0x5643e7766ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.816+0000 7fc8c36b19c0 1 --2- 172.21.15.62:0/2338811575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643e7766ac0 0x5643e7766ee0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fc8b400f5a0 tx=0x7fc8b400eee0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.816+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2338811575 shutdown_connections 2024-09-10T05:38:23.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.816+0000 7fc8c36b19c0 1 --2- 172.21.15.62:0/2338811575 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc798039ac0 0x7fc79803bf80 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.816+0000 7fc8c36b19c0 1 --2- 172.21.15.62:0/2338811575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643e7766ac0 0x5643e7766ee0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.816+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2338811575 >> 172.21.15.62:0/2338811575 conn(0x5643e775c470 msgr2=0x5643e775c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:23.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.816+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2338811575 shutdown_connections 2024-09-10T05:38:23.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.816+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/2338811575 wait complete. 2024-09-10T05:38:23.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.816+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/1291138921 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5643e7750fc0 msgr2=0x5643e7753460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.816+0000 7fc8c36b19c0 1 --2- 172.21.15.62:0/1291138921 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5643e7750fc0 0x5643e7753460 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.816+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/1291138921 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5643e7658050 msgr2=0x5643e774ffd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.816+0000 7fc8c36b19c0 1 --2- 172.21.15.62:0/1291138921 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5643e7658050 0x5643e774ffd0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.816+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/1291138921 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5643e7755990 msgr2=0x5643e7757d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.816+0000 7fc8c36b19c0 1 --2- 172.21.15.62:0/1291138921 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5643e7755990 0x5643e7757d80 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.816+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/1291138921 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc7a8039a70 msgr2=0x7fc7a803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.816+0000 7fc8c36b19c0 1 --2- 172.21.15.62:0/1291138921 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc7a8039a70 0x7fc7a803bf30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc8b80ad000 tx=0x7fc8b80a6000 comp rx=0 tx=0).stop 2024-09-10T05:38:23.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.816+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/1291138921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643e7653f00 msgr2=0x5643e75ca370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.816+0000 7fc8c36b19c0 1 --2- 172.21.15.62:0/1291138921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643e7653f00 0x5643e75ca370 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fc8b400bbb0 tx=0x7fc8b4000ee0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.816+0000 7fc8c19b8640 1 -- 172.21.15.62:0/1291138921 reap_dead start 2024-09-10T05:38:23.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.816+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/1291138921 shutdown_connections 2024-09-10T05:38:23.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.816+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/1291138921 >> 172.21.15.62:0/1291138921 conn(0x5643e764fa20 msgr2=0x5643e7739c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:23.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.816+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/1291138921 shutdown_connections 2024-09-10T05:38:23.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.816+0000 7fc8c36b19c0 1 -- 172.21.15.62:0/1291138921 wait complete. 2024-09-10T05:38:23.829 DEBUG:tasks.util.rgw: json result: {'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-10T05:38:23.794847Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:38:23.794835Z', 'tags': [], 'group_ids': []} 2024-09-10T05:38:23.829 ERROR:root:{'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-10T05:38:23.794847Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:38:23.794835Z', 'tags': [], 'group_ids': []} 2024-09-10T05:38:23.829 ERROR:root:0 2024-09-10T05:38:23.830 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T05:38:23.834 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T05:38:23.834 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'a_user'] 2024-09-10T05:38:23.835 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'a_user'] 2024-09-10T05:38:23.835 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid a_user 2024-09-10T05:38:23.908 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:38:23.908 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:38:23.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.904+0000 7f43f6a169c0 1 Processor -- start 2024-09-10T05:38:23.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.904+0000 7f43f6a169c0 1 -- start start 2024-09-10T05:38:23.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.904+0000 7f43f6a169c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55fa279c6fb0 0x55fa279c7390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.904+0000 7f43f6a169c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fa2787b9c0 con 0x55fa279ca140 2024-09-10T05:38:23.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.904+0000 7f43f6a169c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x55fa278cb6d0 con 0x55fa279c6fb0 2024-09-10T05:38:23.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.908+0000 7f43f451c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55fa279c6fb0 0x55fa279c7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.908+0000 7f43f451c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55fa279c6fb0 0x55fa279c7390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38886/0 (socket says 172.21.15.62:38886) 2024-09-10T05:38:23.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.908+0000 7f43f3d1b640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x55fa279ca140 0x55fa279cc530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:52144/0 (socket says 172.21.15.62:52144) 2024-09-10T05:38:23.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.908+0000 7f43f451c640 1 -- 172.21.15.62:0/3528174809 learned_addr learned my addr 172.21.15.62:0/3528174809 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:23.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.908+0000 7f43f451c640 1 -- 172.21.15.62:0/3528174809 >> v1:172.21.15.2:6789/0 conn(0x55fa279ca140 legacy=0x55fa279cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.908+0000 7f43f451c640 1 -- 172.21.15.62:0/3528174809 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa2786fca0 con 0x55fa279c6fb0 2024-09-10T05:38:23.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.908+0000 7f43f451c640 1 --2- 172.21.15.62:0/3528174809 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa279c6fb0 0x55fa279c7390 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f43e400a5c0 tx=0x7f43e401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36c4ae6f7a1e3635 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.908+0000 7f43f351a640 1 -- 172.21.15.62:0/3528174809 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43e40a6070 con 0x55fa279c6fb0 2024-09-10T05:38:23.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.908+0000 7f43f351a640 1 -- 172.21.15.62:0/3528174809 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43e40af070 con 0x55fa279c6fb0 2024-09-10T05:38:23.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.908+0000 7f43f351a640 1 -- 172.21.15.62:0/3528174809 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43e40aa5c0 con 0x55fa279c6fb0 2024-09-10T05:38:23.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.908+0000 7f43f6a169c0 1 -- 172.21.15.62:0/3528174809 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa279c6fb0 msgr2=0x55fa279c7390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.908+0000 7f43f6a169c0 1 --2- 172.21.15.62:0/3528174809 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa279c6fb0 0x55fa279c7390 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f43e400a5c0 tx=0x7f43e401b340 comp rx=0 tx=0).stop 2024-09-10T05:38:23.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.908+0000 7f43f6a169c0 1 -- 172.21.15.62:0/3528174809 shutdown_connections 2024-09-10T05:38:23.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.908+0000 7f43f6a169c0 1 --2- 172.21.15.62:0/3528174809 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa279c6fb0 0x55fa279c7390 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.908+0000 7f43f6a169c0 1 -- 172.21.15.62:0/3528174809 >> 172.21.15.62:0/3528174809 conn(0x55fa279c2ad0 msgr2=0x55fa279c4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:23.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.908+0000 7f43f6a169c0 1 -- 172.21.15.62:0/3528174809 shutdown_connections 2024-09-10T05:38:23.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.908+0000 7f43f6a169c0 1 -- 172.21.15.62:0/3528174809 wait complete. 2024-09-10T05:38:23.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.924+0000 7f43f6a169c0 1 Processor -- start 2024-09-10T05:38:23.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.924+0000 7f43f6a169c0 1 -- start start 2024-09-10T05:38:23.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.924+0000 7f43f6a169c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa279c6fb0 0x55fa27ab2690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.924+0000 7f43f6a169c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fa278cf680 con 0x55fa279c6fb0 2024-09-10T05:38:23.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.924+0000 7f43f451c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa279c6fb0 0x55fa27ab2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.924+0000 7f43f451c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa279c6fb0 0x55fa27ab2690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38894/0 (socket says 172.21.15.62:38894) 2024-09-10T05:38:23.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.924+0000 7f43f451c640 1 -- 172.21.15.62:0/2727309052 learned_addr learned my addr 172.21.15.62:0/2727309052 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:23.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.924+0000 7f43f451c640 1 -- 172.21.15.62:0/2727309052 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa2784ada0 con 0x55fa279c6fb0 2024-09-10T05:38:23.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.924+0000 7f43f451c640 1 --2- 172.21.15.62:0/2727309052 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa279c6fb0 0x55fa27ab2690 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f43e4018f70 tx=0x7f43e4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc17ad73fc9d4da8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.924+0000 7f42e260c640 1 -- 172.21.15.62:0/2727309052 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43e40aa8b0 con 0x55fa279c6fb0 2024-09-10T05:38:23.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.928+0000 7f42e260c640 1 -- 172.21.15.62:0/2727309052 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43e40aaa50 con 0x55fa279c6fb0 2024-09-10T05:38:23.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.928+0000 7f42e260c640 1 -- 172.21.15.62:0/2727309052 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43e40aad30 con 0x55fa279c6fb0 2024-09-10T05:38:23.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.928+0000 7f43f6a169c0 1 -- 172.21.15.62:0/2727309052 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa279c6fb0 msgr2=0x55fa27ab2690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.928+0000 7f43f6a169c0 1 --2- 172.21.15.62:0/2727309052 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa279c6fb0 0x55fa27ab2690 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f43e4018f70 tx=0x7f43e4003030 comp rx=0 tx=0).stop 2024-09-10T05:38:23.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.928+0000 7f43f6a169c0 1 -- 172.21.15.62:0/2727309052 shutdown_connections 2024-09-10T05:38:23.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.928+0000 7f43f6a169c0 1 --2- 172.21.15.62:0/2727309052 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa279c6fb0 0x55fa27ab2690 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.928+0000 7f43f6a169c0 1 -- 172.21.15.62:0/2727309052 >> 172.21.15.62:0/2727309052 conn(0x55fa279c2ad0 msgr2=0x55fa27aae330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:23.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.928+0000 7f43f6a169c0 1 -- 172.21.15.62:0/2727309052 shutdown_connections 2024-09-10T05:38:23.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.928+0000 7f43f6a169c0 1 -- 172.21.15.62:0/2727309052 wait complete. 2024-09-10T05:38:23.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.928+0000 7f43f6a169c0 1 Processor -- start 2024-09-10T05:38:23.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.928+0000 7f43f6a169c0 1 -- start start 2024-09-10T05:38:23.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.928+0000 7f43f6a169c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa279c6fb0 0x55fa27ab9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.928+0000 7f43f6a169c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fa27871a50 con 0x55fa279c6fb0 2024-09-10T05:38:23.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.928+0000 7f43f451c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa279c6fb0 0x55fa27ab9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.928+0000 7f43f451c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa279c6fb0 0x55fa27ab9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38896/0 (socket says 172.21.15.62:38896) 2024-09-10T05:38:23.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.928+0000 7f43f451c640 1 -- 172.21.15.62:0/736162896 learned_addr learned my addr 172.21.15.62:0/736162896 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:23.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.928+0000 7f43f451c640 1 -- 172.21.15.62:0/736162896 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa27aba0e0 con 0x55fa279c6fb0 2024-09-10T05:38:23.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.928+0000 7f43f451c640 1 --2- 172.21.15.62:0/736162896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa279c6fb0 0x55fa27ab9b80 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f43e4018f70 tx=0x7f43e40180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.928+0000 7f42e0e09640 1 -- 172.21.15.62:0/736162896 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43e40c6690 con 0x55fa279c6fb0 2024-09-10T05:38:23.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.928+0000 7f43f6a169c0 1 -- 172.21.15.62:0/736162896 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fa27aba370 con 0x55fa279c6fb0 2024-09-10T05:38:23.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.928+0000 7f42e0e09640 1 -- 172.21.15.62:0/736162896 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43e40c6830 con 0x55fa279c6fb0 2024-09-10T05:38:23.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.928+0000 7f42e0e09640 1 -- 172.21.15.62:0/736162896 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43e40c6b10 con 0x55fa279c6fb0 2024-09-10T05:38:23.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.928+0000 7f43f6a169c0 1 -- 172.21.15.62:0/736162896 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa27abad20 con 0x55fa279c6fb0 2024-09-10T05:38:23.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.932+0000 7f42e0e09640 1 -- 172.21.15.62:0/736162896 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f43e40ce030 con 0x55fa279c6fb0 2024-09-10T05:38:23.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.932+0000 7f42e0e09640 1 --2- 172.21.15.62:0/736162896 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f42dc039a70 0x7f42dc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.932+0000 7f42e0e09640 1 -- 172.21.15.62:0/736162896 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7f43e40cc020 con 0x55fa279c6fb0 2024-09-10T05:38:23.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.932+0000 7f43f3d1b640 1 --2- 172.21.15.62:0/736162896 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f42dc039a70 0x7f42dc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.932+0000 7f43f6a169c0 1 --2- 172.21.15.62:0/736162896 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55fa279ca140 0x55fa27ac0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.932+0000 7f43f6a169c0 1 -- 172.21.15.62:0/736162896 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa27ac1230 con 0x55fa279ca140 2024-09-10T05:38:23.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.932+0000 7f43f4d1d640 1 --2- 172.21.15.62:0/736162896 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55fa279ca140 0x55fa27ac0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.932+0000 7f43f3d1b640 1 --2- 172.21.15.62:0/736162896 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f42dc039a70 0x7f42dc03bf30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f43e80016b0 tx=0x7f43e80066c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.932+0000 7f43f4d1d640 1 --2- 172.21.15.62:0/736162896 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55fa279ca140 0x55fa27ac0cf0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.932+0000 7f43f4d1d640 1 -- 172.21.15.62:0/736162896 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f43ec0083f0 con 0x55fa279ca140 2024-09-10T05:38:23.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.932+0000 7f43f6a169c0 1 --2- 172.21.15.62:0/736162896 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55fa27ac1d30 0x55fa27ac41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.932+0000 7f43f6a169c0 1 -- 172.21.15.62:0/736162896 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa27ac4960 con 0x55fa27ac1d30 2024-09-10T05:38:23.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.932+0000 7f43f451c640 1 --2- 172.21.15.62:0/736162896 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55fa27ac1d30 0x55fa27ac41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.932+0000 7f43f451c640 1 --2- 172.21.15.62:0/736162896 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55fa27ac1d30 0x55fa27ac41f0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.932+0000 7f43f451c640 1 -- 172.21.15.62:0/736162896 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f43e40cf5a0 con 0x55fa27ac1d30 2024-09-10T05:38:23.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.932+0000 7f43f6a169c0 1 --2- 172.21.15.62:0/736162896 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55fa27ac6720 0x55fa27ac8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.932+0000 7f43f6a169c0 1 -- 172.21.15.62:0/736162896 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa27ac91e0 con 0x55fa27ac6720 2024-09-10T05:38:23.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.932+0000 7f43f3d1b640 1 --2- 172.21.15.62:0/736162896 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55fa27ac6720 0x55fa27ac8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.936+0000 7f43f3d1b640 1 --2- 172.21.15.62:0/736162896 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55fa27ac6720 0x55fa27ac8b10 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.936+0000 7f43f3d1b640 1 -- 172.21.15.62:0/736162896 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv5 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f43e800f070 con 0x55fa27ac6720 2024-09-10T05:38:23.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.936+0000 7f43f6a169c0 1 -- 172.21.15.62:0/736162896 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa27ac55c0 con 0x55fa27ac1d30 2024-09-10T05:38:23.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.936+0000 7f43f451c640 1 -- 172.21.15.62:0/736162896 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f43e40cf5a0 con 0x55fa27ac1d30 2024-09-10T05:38:23.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.936+0000 7f43f6a169c0 1 -- 172.21.15.62:0/736162896 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa27ac5a00 con 0x55fa27ac6720 2024-09-10T05:38:23.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.936+0000 7f43f3d1b640 1 -- 172.21.15.62:0/736162896 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f43e800f070 con 0x55fa27ac6720 2024-09-10T05:38:23.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.936+0000 7f43f6a169c0 1 Processor -- start 2024-09-10T05:38:23.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.936+0000 7f43f6a169c0 1 -- start start 2024-09-10T05:38:23.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.936+0000 7f43f6a169c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa27ad7870 0x55fa27ad7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.936+0000 7f43f6a169c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fa278dc450 con 0x55fa27ad7870 2024-09-10T05:38:23.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.936+0000 7f43f451c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa27ad7870 0x55fa27ad7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.936+0000 7f43f451c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa27ad7870 0x55fa27ad7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38898/0 (socket says 172.21.15.62:38898) 2024-09-10T05:38:23.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.936+0000 7f43f451c640 1 -- 172.21.15.62:0/4146514935 learned_addr learned my addr 172.21.15.62:0/4146514935 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:23.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.936+0000 7f43f451c640 1 -- 172.21.15.62:0/4146514935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa27ad82d0 con 0x55fa27ad7870 2024-09-10T05:38:23.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.936+0000 7f43f451c640 1 --2- 172.21.15.62:0/4146514935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa27ad7870 0x55fa27ad7c90 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f43e40cfb30 tx=0x7f43e40c5e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.940+0000 7f42d9ffb640 1 -- 172.21.15.62:0/4146514935 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43e40a6c60 con 0x55fa27ad7870 2024-09-10T05:38:23.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.940+0000 7f43f6a169c0 1 -- 172.21.15.62:0/4146514935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fa27ad8b30 con 0x55fa27ad7870 2024-09-10T05:38:23.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.940+0000 7f42d9ffb640 1 -- 172.21.15.62:0/4146514935 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43e40a6e00 con 0x55fa27ad7870 2024-09-10T05:38:23.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.940+0000 7f42d9ffb640 1 -- 172.21.15.62:0/4146514935 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43e40c5510 con 0x55fa27ad7870 2024-09-10T05:38:23.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.940+0000 7f43f6a169c0 1 -- 172.21.15.62:0/4146514935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa27ad90a0 con 0x55fa27ad7870 2024-09-10T05:38:23.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.940+0000 7f42d9ffb640 1 -- 172.21.15.62:0/4146514935 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f43e40c56b0 con 0x55fa27ad7870 2024-09-10T05:38:23.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.940+0000 7f42d9ffb640 1 --2- 172.21.15.62:0/4146514935 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f42cc039a70 0x7f42cc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.940+0000 7f42d9ffb640 1 -- 172.21.15.62:0/4146514935 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7f43e40f9990 con 0x55fa27ad7870 2024-09-10T05:38:23.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.940+0000 7f43f3d1b640 1 --2- 172.21.15.62:0/4146514935 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f42cc039a70 0x7f42cc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.940+0000 7f43f6a169c0 1 Processor -- start 2024-09-10T05:38:23.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.940+0000 7f43f6a169c0 1 -- start start 2024-09-10T05:38:23.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.940+0000 7f43f3d1b640 1 --2- 172.21.15.62:0/4146514935 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f42cc039a70 0x7f42cc03bf30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f43e80063a0 tx=0x7f43e800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.940+0000 7f43f6a169c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa27ae4020 0x55fa27ae4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.940+0000 7f43f6a169c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fa27ab2e00 con 0x55fa27ae4020 2024-09-10T05:38:23.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.940+0000 7f43f451c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa27ae4020 0x55fa27ae4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.940+0000 7f43f451c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa27ae4020 0x55fa27ae4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38914/0 (socket says 172.21.15.62:38914) 2024-09-10T05:38:23.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.940+0000 7f43f451c640 1 -- 172.21.15.62:0/2534838797 learned_addr learned my addr 172.21.15.62:0/2534838797 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:23.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.940+0000 7f43f451c640 1 -- 172.21.15.62:0/2534838797 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa27ae49d0 con 0x55fa27ae4020 2024-09-10T05:38:23.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.940+0000 7f43f451c640 1 --2- 172.21.15.62:0/2534838797 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa27ae4020 0x55fa27ae4400 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f43e40a6fd0 tx=0x7f43e40d0410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98577dddceb563fb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.940+0000 7f42d37fe640 1 -- 172.21.15.62:0/2534838797 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43e40a7b20 con 0x55fa27ae4020 2024-09-10T05:38:23.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.940+0000 7f42d37fe640 1 -- 172.21.15.62:0/2534838797 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43e4108070 con 0x55fa27ae4020 2024-09-10T05:38:23.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.940+0000 7f42d37fe640 1 -- 172.21.15.62:0/2534838797 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43e40c86e0 con 0x55fa27ae4020 2024-09-10T05:38:23.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.940+0000 7f43f6a169c0 1 -- 172.21.15.62:0/2534838797 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa27ae4020 msgr2=0x55fa27ae4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:23.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.940+0000 7f43f6a169c0 1 --2- 172.21.15.62:0/2534838797 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa27ae4020 0x55fa27ae4400 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f43e40a6fd0 tx=0x7f43e40d0410 comp rx=0 tx=0).stop 2024-09-10T05:38:23.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.944+0000 7f43f6a169c0 1 -- 172.21.15.62:0/2534838797 shutdown_connections 2024-09-10T05:38:23.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.944+0000 7f43f6a169c0 1 --2- 172.21.15.62:0/2534838797 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa27ae4020 0x55fa27ae4400 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:23.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.944+0000 7f43f6a169c0 1 -- 172.21.15.62:0/2534838797 >> 172.21.15.62:0/2534838797 conn(0x55fa27ae0450 msgr2=0x55fa27ade690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:23.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.944+0000 7f43f6a169c0 1 -- 172.21.15.62:0/2534838797 shutdown_connections 2024-09-10T05:38:23.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.944+0000 7f43f6a169c0 1 -- 172.21.15.62:0/2534838797 wait complete. 2024-09-10T05:38:23.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.944+0000 7f43f6a169c0 1 Processor -- start 2024-09-10T05:38:23.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.944+0000 7f43f6a169c0 1 -- start start 2024-09-10T05:38:23.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.944+0000 7f43f6a169c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa27ae4020 0x55fa27aeb310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.944+0000 7f43f6a169c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fa27ae4eb0 con 0x55fa27ae4020 2024-09-10T05:38:23.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.944+0000 7f43f451c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa27ae4020 0x55fa27aeb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.944+0000 7f43f451c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa27ae4020 0x55fa27aeb310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38920/0 (socket says 172.21.15.62:38920) 2024-09-10T05:38:23.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.944+0000 7f43f451c640 1 -- 172.21.15.62:0/649478111 learned_addr learned my addr 172.21.15.62:0/649478111 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:23.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.944+0000 7f43f451c640 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa27aeb870 con 0x55fa27ae4020 2024-09-10T05:38:23.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.944+0000 7f43f451c640 1 --2- 172.21.15.62:0/649478111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa27ae4020 0x55fa27aeb310 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f43e4105040 tx=0x7f43e40f1fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.944+0000 7f42d1ffb640 1 -- 172.21.15.62:0/649478111 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43e40b3850 con 0x55fa27ae4020 2024-09-10T05:38:23.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.944+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fa27aeb870 con 0x55fa27ae4020 2024-09-10T05:38:23.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.944+0000 7f42d1ffb640 1 -- 172.21.15.62:0/649478111 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43e4108040 con 0x55fa27ae4020 2024-09-10T05:38:23.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.944+0000 7f42d1ffb640 1 -- 172.21.15.62:0/649478111 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43e40a7290 con 0x55fa27ae4020 2024-09-10T05:38:23.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.944+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa27aeb870 con 0x55fa27ae4020 2024-09-10T05:38:23.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.944+0000 7f42d1ffb640 1 -- 172.21.15.62:0/649478111 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f43e40f9c80 con 0x55fa27ae4020 2024-09-10T05:38:23.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.944+0000 7f43f6a169c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.944+0000 7f42d1ffb640 1 --2- 172.21.15.62:0/649478111 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f42c40399d0 0x7f42c403be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.944+0000 7f42d1ffb640 1 -- 172.21.15.62:0/649478111 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7f43e4118c20 con 0x55fa27ae4020 2024-09-10T05:38:23.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.944+0000 7f43f3d1b640 1 --2- 172.21.15.62:0/649478111 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f42c40399d0 0x7f42c403be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.944+0000 7f43f6a169c0 1 --2- 172.21.15.62:0/649478111 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55fa27af61a0 0x55fa27af8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.944+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa27af8d80 con 0x55fa27af61a0 2024-09-10T05:38:23.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.944+0000 7f43f4d1d640 1 --2- 172.21.15.62:0/649478111 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55fa27af61a0 0x55fa27af8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.948+0000 7f43f3d1b640 1 --2- 172.21.15.62:0/649478111 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f42c40399d0 0x7f42c403be90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x55fa27ac15d0 tx=0x7f43e8010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.948+0000 7f43f4d1d640 1 --2- 172.21.15.62:0/649478111 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55fa27af61a0 0x55fa27af8630 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.948+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f43ec0083f0 con 0x55fa27af61a0 2024-09-10T05:38:23.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.948+0000 7f43f6a169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:23.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.948+0000 7f43f6a169c0 20 realm 2024-09-10T05:38:23.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.948+0000 7f43f6a169c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.948+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa27af5530 con 0x55fa27af61a0 2024-09-10T05:38:23.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.948+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f43ec0083f0 con 0x55fa27af61a0 2024-09-10T05:38:23.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.948+0000 7f43f6a169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:23.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.948+0000 7f43f6a169c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:38:23.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.948+0000 7f43f6a169c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.948+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa27af9840 con 0x55fa27af61a0 2024-09-10T05:38:23.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.948+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f43ec0083f0 con 0x55fa27af61a0 2024-09-10T05:38:23.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.948+0000 7f43f6a169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:23.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.948+0000 7f43f6a169c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.948+0000 7f43f6a169c0 1 --2- 172.21.15.62:0/649478111 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55fa27afa620 0x55fa27afca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.948+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa27afd0e0 con 0x55fa27afa620 2024-09-10T05:38:23.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.948+0000 7f43f451c640 1 --2- 172.21.15.62:0/649478111 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55fa27afa620 0x55fa27afca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.948+0000 7f43f451c640 1 --2- 172.21.15.62:0/649478111 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55fa27afa620 0x55fa27afca10 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.948+0000 7f43f451c640 1 -- 172.21.15.62:0/649478111 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f43e411d020 con 0x55fa27afa620 2024-09-10T05:38:23.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.948+0000 7f43f6a169c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:38:23.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.948+0000 7f43f6a169c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.948+0000 7f43f6a169c0 1 --2- 172.21.15.62:0/649478111 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55fa27afde40 0x55fa27b00250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.948+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b009e0 con 0x55fa27afde40 2024-09-10T05:38:23.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.948+0000 7f43f3d1b640 1 --2- 172.21.15.62:0/649478111 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55fa27afde40 0x55fa27b00250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.948+0000 7f43f3d1b640 1 --2- 172.21.15.62:0/649478111 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55fa27afde40 0x55fa27b00250 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.948+0000 7f43f3d1b640 1 -- 172.21.15.62:0/649478111 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv5 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f43e802d040 con 0x55fa27afde40 2024-09-10T05:38:23.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.948+0000 7f43f6a169c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:38:23.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.948+0000 7f43f6a169c0 20 searching for the correct realm 2024-09-10T05:38:23.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.948+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b022b0 con 0x55fa27afde40 2024-09-10T05:38:23.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.952+0000 7f43f3d1b640 1 -- 172.21.15.62:0/649478111 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43e802d040 con 0x55fa27afde40 2024-09-10T05:38:23.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.952+0000 7f43f3d1b640 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b022b0 con 0x55fa27afa620 2024-09-10T05:38:23.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.952+0000 7f43f451c640 1 -- 172.21.15.62:0/649478111 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43e411d020 con 0x55fa27afa620 2024-09-10T05:38:23.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.952+0000 7f43f451c640 1 --2- 172.21.15.62:0/649478111 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f43e4009040 0x7f43e40f9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:23.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.952+0000 7f43f451c640 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b022b0 con 0x7f43e4009040 2024-09-10T05:38:23.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.952+0000 7f43f4d1d640 1 --2- 172.21.15.62:0/649478111 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f43e4009040 0x7f43e40f9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:23.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.952+0000 7f43f4d1d640 1 --2- 172.21.15.62:0/649478111 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f43e4009040 0x7f43e40f9270 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:23.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.952+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43ec0083f0 con 0x7f43e4009040 2024-09-10T05:38:23.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.952+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b022b0 con 0x55fa27af61a0 2024-09-10T05:38:23.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.952+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43ec0083f0 con 0x55fa27af61a0 2024-09-10T05:38:23.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.952+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b022b0 con 0x55fa27af61a0 2024-09-10T05:38:23.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.952+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43ec0083f0 con 0x55fa27af61a0 2024-09-10T05:38:23.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.952+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b022b0 con 0x55fa27afde40 2024-09-10T05:38:23.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.952+0000 7f43f3d1b640 1 -- 172.21.15.62:0/649478111 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43e802d040 con 0x55fa27afde40 2024-09-10T05:38:23.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.952+0000 7f43f3d1b640 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b022b0 con 0x55fa27af61a0 2024-09-10T05:38:23.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.952+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43ec0083f0 con 0x55fa27af61a0 2024-09-10T05:38:23.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.952+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b022b0 con 0x55fa27afa620 2024-09-10T05:38:23.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.952+0000 7f43f451c640 1 -- 172.21.15.62:0/649478111 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43e411d020 con 0x55fa27afa620 2024-09-10T05:38:23.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.952+0000 7f43f451c640 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b022b0 con 0x55fa27afa620 2024-09-10T05:38:23.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.952+0000 7f43f451c640 1 -- 172.21.15.62:0/649478111 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43e411d020 con 0x55fa27afa620 2024-09-10T05:38:23.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.952+0000 7f43f451c640 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b022b0 con 0x55fa27af61a0 2024-09-10T05:38:23.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.956+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43ec0083f0 con 0x55fa27af61a0 2024-09-10T05:38:23.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.956+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b022b0 con 0x7f43e4009040 2024-09-10T05:38:23.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.956+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43ec0083f0 con 0x7f43e4009040 2024-09-10T05:38:23.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.956+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b022b0 con 0x55fa27af61a0 2024-09-10T05:38:23.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.956+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43ec0083f0 con 0x55fa27af61a0 2024-09-10T05:38:23.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.956+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b022b0 con 0x7f43e4009040 2024-09-10T05:38:23.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.956+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f43ec0083f0 con 0x7f43e4009040 2024-09-10T05:38:23.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.956+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b022b0 con 0x55fa27afa620 2024-09-10T05:38:23.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.956+0000 7f43f451c640 1 -- 172.21.15.62:0/649478111 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43e411d020 con 0x55fa27afa620 2024-09-10T05:38:23.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.956+0000 7f43f451c640 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b022b0 con 0x55fa27afde40 2024-09-10T05:38:23.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.956+0000 7f43f3d1b640 1 -- 172.21.15.62:0/649478111 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43e802d040 con 0x55fa27afde40 2024-09-10T05:38:23.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.956+0000 7f43f3d1b640 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b022b0 con 0x55fa27af61a0 2024-09-10T05:38:23.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.956+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43ec0083f0 con 0x55fa27af61a0 2024-09-10T05:38:23.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.956+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b022b0 con 0x55fa27afa620 2024-09-10T05:38:23.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.956+0000 7f43f451c640 1 -- 172.21.15.62:0/649478111 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43e411d020 con 0x55fa27afa620 2024-09-10T05:38:23.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.956+0000 7f43f451c640 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b022b0 con 0x55fa27afde40 2024-09-10T05:38:23.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.956+0000 7f43f3d1b640 1 -- 172.21.15.62:0/649478111 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 34 out=170b] v34'5 uv5 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f43e802d040 con 0x55fa27afde40 2024-09-10T05:38:23.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.956+0000 7f43f3d1b640 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b022b0 con 0x55fa27af61a0 2024-09-10T05:38:23.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.956+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43ec0083f0 con 0x55fa27af61a0 2024-09-10T05:38:23.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.956+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b022b0 con 0x55fa27af61a0 2024-09-10T05:38:23.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.956+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f43ec0083f0 con 0x55fa27af61a0 2024-09-10T05:38:23.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.956+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b022b0 con 0x55fa27af61a0 2024-09-10T05:38:23.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.956+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43ec0083f0 con 0x55fa27af61a0 2024-09-10T05:38:23.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.956+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b022b0 con 0x55fa27afde40 2024-09-10T05:38:23.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.960+0000 7f43f3d1b640 1 -- 172.21.15.62:0/649478111 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43e802d040 con 0x55fa27afde40 2024-09-10T05:38:23.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.960+0000 7f43f3d1b640 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b022b0 con 0x7f43e4009040 2024-09-10T05:38:23.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.960+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43ec0083f0 con 0x7f43e4009040 2024-09-10T05:38:23.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.960+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b022b0 con 0x55fa27af61a0 2024-09-10T05:38:23.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.960+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43ec0083f0 con 0x55fa27af61a0 2024-09-10T05:38:23.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.960+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b022b0 con 0x7f43e4009040 2024-09-10T05:38:23.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.960+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43ec0083f0 con 0x7f43e4009040 2024-09-10T05:38:23.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.960+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b022b0 con 0x55fa27afde40 2024-09-10T05:38:23.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.960+0000 7f43f3d1b640 1 -- 172.21.15.62:0/649478111 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43e802d040 con 0x55fa27afde40 2024-09-10T05:38:23.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.960+0000 7f43f3d1b640 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b022b0 con 0x7f43e4009040 2024-09-10T05:38:23.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.960+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43ec0083f0 con 0x7f43e4009040 2024-09-10T05:38:23.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.960+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b022b0 con 0x55fa27afa620 2024-09-10T05:38:23.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.960+0000 7f43f451c640 1 -- 172.21.15.62:0/649478111 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43e411d020 con 0x55fa27afa620 2024-09-10T05:38:23.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.960+0000 7f43f451c640 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b022b0 con 0x55fa27afa620 2024-09-10T05:38:23.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.960+0000 7f43f451c640 1 -- 172.21.15.62:0/649478111 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43e411d020 con 0x55fa27afa620 2024-09-10T05:38:23.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.960+0000 7f43f451c640 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b022b0 con 0x55fa27afde40 2024-09-10T05:38:23.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.960+0000 7f43f3d1b640 1 -- 172.21.15.62:0/649478111 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43e802d040 con 0x55fa27afde40 2024-09-10T05:38:23.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.960+0000 7f43f3d1b640 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b022b0 con 0x55fa27afa620 2024-09-10T05:38:23.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.964+0000 7f43f451c640 1 -- 172.21.15.62:0/649478111 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f43e411d020 con 0x55fa27afa620 2024-09-10T05:38:23.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.964+0000 7f43f451c640 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b022b0 con 0x55fa27afa620 2024-09-10T05:38:23.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.964+0000 7f43f451c640 1 -- 172.21.15.62:0/649478111 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43e411d020 con 0x55fa27afa620 2024-09-10T05:38:23.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.964+0000 7f43f6a169c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:38:23.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.964+0000 7f43f6a169c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:38:23.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.964+0000 7f43f6a169c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:38:23.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.964+0000 7f43f6a169c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:38:23.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.964+0000 7f43f6a169c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:38:23.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.964+0000 7f43f6a169c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:38:23.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.964+0000 7f43f6a169c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.964+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b013a0 con 0x55fa27af61a0 2024-09-10T05:38:23.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.964+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f43ec0083f0 con 0x55fa27af61a0 2024-09-10T05:38:23.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.964+0000 7f43f6a169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:23.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.964+0000 7f43f6a169c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.964+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b01c40 con 0x55fa27afa620 2024-09-10T05:38:23.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.964+0000 7f43f451c640 1 -- 172.21.15.62:0/649478111 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f43e411d020 con 0x55fa27afa620 2024-09-10T05:38:23.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.964+0000 7f43f6a169c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:38:23.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.964+0000 7f43f6a169c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.964+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b00fe0 con 0x55fa27afde40 2024-09-10T05:38:23.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.964+0000 7f43f3d1b640 1 -- 172.21.15.62:0/649478111 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f43e802d040 con 0x55fa27afde40 2024-09-10T05:38:23.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.964+0000 7f43f6a169c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:38:23.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.964+0000 7f43f6a169c0 20 zone default found 2024-09-10T05:38:23.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.964+0000 7f43f6a169c0 4 Realm: () 2024-09-10T05:38:23.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.964+0000 7f43f6a169c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:38:23.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.964+0000 7f43f6a169c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:38:23.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.964+0000 7f43f6a169c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:38:23.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.964+0000 7f43f6a169c0 20 zonegroup default 2024-09-10T05:38:23.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.964+0000 7f43f6a169c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.964+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b02b90 con 0x7f43e4009040 2024-09-10T05:38:23.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.964+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f43ec0083f0 con 0x7f43e4009040 2024-09-10T05:38:23.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.964+0000 7f43f6a169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:23.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.964+0000 7f43f6a169c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.964+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b04dd0 con 0x55fa27afde40 2024-09-10T05:38:23.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.964+0000 7f43f3d1b640 1 -- 172.21.15.62:0/649478111 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f43e802d040 con 0x55fa27afde40 2024-09-10T05:38:23.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.964+0000 7f43f6a169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:23.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.964+0000 7f43f6a169c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:23.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.964+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b05170 con 0x55fa27afde40 2024-09-10T05:38:23.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.964+0000 7f43f3d1b640 1 -- 172.21.15.62:0/649478111 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f43e802d040 con 0x55fa27afde40 2024-09-10T05:38:23.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.964+0000 7f43f6a169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:23.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.964+0000 7f43f6a169c0 20 started sync module instance, tier type = 2024-09-10T05:38:23.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.964+0000 7f43f6a169c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:38:23.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.964+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b04260 con 0x55fa27afa620 2024-09-10T05:38:23.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.968+0000 7f43f451c640 1 -- 172.21.15.62:0/649478111 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43e411d020 con 0x55fa27afa620 2024-09-10T05:38:23.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.968+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94532896048720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b059c0 con 0x55fa27afa620 2024-09-10T05:38:23.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.968+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b06210 con 0x55fa27af61a0 2024-09-10T05:38:23.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.968+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43ec0083f0 con 0x55fa27af61a0 2024-09-10T05:38:23.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.968+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94532896054624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b06a60 con 0x55fa27af61a0 2024-09-10T05:38:23.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.968+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b07520 con 0x55fa27afa620 2024-09-10T05:38:23.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.972+0000 7f43f451c640 1 -- 172.21.15.62:0/649478111 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94532896048720] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43e411d020 con 0x55fa27afa620 2024-09-10T05:38:23.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.972+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94532896054624] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43ec0083f0 con 0x55fa27af61a0 2024-09-10T05:38:23.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.972+0000 7f43f451c640 1 -- 172.21.15.62:0/649478111 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43e411d020 con 0x55fa27afa620 2024-09-10T05:38:23.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.972+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94532896059472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b065b0 con 0x55fa27afa620 2024-09-10T05:38:23.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.972+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b07df0 con 0x7f43e4009040 2024-09-10T05:38:23.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.972+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43ec0083f0 con 0x7f43e4009040 2024-09-10T05:38:23.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.972+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94532896061760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b065b0 con 0x7f43e4009040 2024-09-10T05:38:23.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.972+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b08890 con 0x55fa27afa620 2024-09-10T05:38:23.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.972+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94532896061760] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43ec0083f0 con 0x7f43e4009040 2024-09-10T05:38:23.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.972+0000 7f43f451c640 1 -- 172.21.15.62:0/649478111 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94532896059472] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43e411d020 con 0x55fa27afa620 2024-09-10T05:38:23.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.976+0000 7f43f451c640 1 -- 172.21.15.62:0/649478111 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43e411d020 con 0x55fa27afa620 2024-09-10T05:38:23.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.976+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94532896052496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b065b0 con 0x55fa27afa620 2024-09-10T05:38:23.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.976+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b08cb0 con 0x55fa27afde40 2024-09-10T05:38:23.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.976+0000 7f43f3d1b640 1 -- 172.21.15.62:0/649478111 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43e802d040 con 0x55fa27afde40 2024-09-10T05:38:23.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.976+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94532896062816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b09550 con 0x55fa27afde40 2024-09-10T05:38:23.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.976+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b09f10 con 0x55fa27afde40 2024-09-10T05:38:23.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.976+0000 7f43f451c640 1 -- 172.21.15.62:0/649478111 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94532896052496] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43e411d020 con 0x55fa27afa620 2024-09-10T05:38:23.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.976+0000 7f43f3d1b640 1 -- 172.21.15.62:0/649478111 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94532896062816] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43e802d040 con 0x55fa27afde40 2024-09-10T05:38:23.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.976+0000 7f43f3d1b640 1 -- 172.21.15.62:0/649478111 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43e802d040 con 0x55fa27afde40 2024-09-10T05:38:23.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.976+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94532896070240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b09550 con 0x55fa27afde40 2024-09-10T05:38:23.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.976+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b09ee0 con 0x7f43e4009040 2024-09-10T05:38:23.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.980+0000 7f43f3d1b640 1 -- 172.21.15.62:0/649478111 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94532896070240] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43e802d040 con 0x55fa27afde40 2024-09-10T05:38:23.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.980+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43ec0083f0 con 0x7f43e4009040 2024-09-10T05:38:23.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.980+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94532896072448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b09550 con 0x7f43e4009040 2024-09-10T05:38:23.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.980+0000 7f43f6a169c0 20 add_watcher() i=0 2024-09-10T05:38:23.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.980+0000 7f43f6a169c0 20 add_watcher() i=1 2024-09-10T05:38:23.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.980+0000 7f43f6a169c0 20 add_watcher() i=2 2024-09-10T05:38:23.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.980+0000 7f43f6a169c0 20 add_watcher() i=3 2024-09-10T05:38:23.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.980+0000 7f43f6a169c0 20 add_watcher() i=4 2024-09-10T05:38:23.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.980+0000 7f43f6a169c0 20 add_watcher() i=5 2024-09-10T05:38:23.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.980+0000 7f43f6a169c0 20 add_watcher() i=6 2024-09-10T05:38:23.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.980+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94532896072448] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43ec0083f0 con 0x7f43e4009040 2024-09-10T05:38:23.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.980+0000 7f43f6a169c0 20 add_watcher() i=7 2024-09-10T05:38:23.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.980+0000 7f43f6a169c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:38:23.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.980+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b0d890 con 0x55fa27af61a0 2024-09-10T05:38:23.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.980+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f43ec0083f0 con 0x55fa27af61a0 2024-09-10T05:38:23.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.980+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94532896068208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b0ae20 con 0x55fa27af61a0 2024-09-10T05:38:23.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.980+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94532896068208] v34'259 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f43ec0083f0 con 0x55fa27af61a0 2024-09-10T05:38:23.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.984+0000 7f42aa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:38:23.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.984+0000 7f43f6a169c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:38:23.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.984+0000 7f43f6a169c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:38:23.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.984+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b16100 con 0x55fa27afa620 2024-09-10T05:38:23.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.984+0000 7f43f451c640 1 -- 172.21.15.62:0/649478111 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'60 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f43e411d020 con 0x55fa27afa620 2024-09-10T05:38:23.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.984+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b161f0 con 0x7f43e4009040 2024-09-10T05:38:23.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.984+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f43ec0083f0 con 0x7f43e4009040 2024-09-10T05:38:23.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.984+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b16980 con 0x55fa27afde40 2024-09-10T05:38:23.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.988+0000 7f43f3d1b640 1 -- 172.21.15.62:0/649478111 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f43e802d040 con 0x55fa27afde40 2024-09-10T05:38:23.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.988+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b16e30 con 0x55fa27af61a0 2024-09-10T05:38:23.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.988+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'260 uv172 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f43ec0083f0 con 0x55fa27af61a0 2024-09-10T05:38:23.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.988+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b13f70 con 0x55fa27afa620 2024-09-10T05:38:23.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.992+0000 7f43f451c640 1 -- 172.21.15.62:0/649478111 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'86 uv61 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f43e411d020 con 0x55fa27afa620 2024-09-10T05:38:23.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.992+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b13f70 con 0x55fa27afde40 2024-09-10T05:38:23.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.992+0000 7f43f3d1b640 1 -- 172.21.15.62:0/649478111 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'65 uv48 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f43e802d040 con 0x55fa27afde40 2024-09-10T05:38:23.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.992+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b13f70 con 0x55fa27afa620 2024-09-10T05:38:23.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.996+0000 7f43f451c640 1 -- 172.21.15.62:0/649478111 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'41 uv31 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f43e411d020 con 0x55fa27afa620 2024-09-10T05:38:23.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:23.996+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b13f70 con 0x55fa27af61a0 2024-09-10T05:38:24.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.000+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'59 uv42 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f43ec0083f0 con 0x55fa27af61a0 2024-09-10T05:38:24.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.000+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b17b60 con 0x55fa27afa620 2024-09-10T05:38:24.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.000+0000 7f43f451c640 1 -- 172.21.15.62:0/649478111 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f43e411d020 con 0x55fa27afa620 2024-09-10T05:38:24.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.000+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b17b60 con 0x55fa27afa620 2024-09-10T05:38:24.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.004+0000 7f43f451c640 1 -- 172.21.15.62:0/649478111 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f43e411d020 con 0x55fa27afa620 2024-09-10T05:38:24.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.004+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b17b60 con 0x55fa27afa620 2024-09-10T05:38:24.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.004+0000 7f43f451c640 1 -- 172.21.15.62:0/649478111 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'87 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43e411d020 con 0x55fa27afa620 2024-09-10T05:38:24.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.004+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b17b60 con 0x55fa27afde40 2024-09-10T05:38:24.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.008+0000 7f43f3d1b640 1 -- 172.21.15.62:0/649478111 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'37 uv25 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43e802d040 con 0x55fa27afde40 2024-09-10T05:38:24.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.008+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b17b60 con 0x55fa27afa620 2024-09-10T05:38:24.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.008+0000 7f43f451c640 1 -- 172.21.15.62:0/649478111 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43e411d020 con 0x55fa27afa620 2024-09-10T05:38:24.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.008+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b17d30 con 0x55fa27af61a0 2024-09-10T05:38:24.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.012+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'71 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43ec0083f0 con 0x55fa27af61a0 2024-09-10T05:38:24.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.012+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b181b0 con 0x55fa27af61a0 2024-09-10T05:38:24.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.012+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'261 uv168 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43ec0083f0 con 0x55fa27af61a0 2024-09-10T05:38:24.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.012+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b17f00 con 0x55fa27afa620 2024-09-10T05:38:24.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.016+0000 7f43f451c640 1 -- 172.21.15.62:0/649478111 <== osd.0 v2:172.21.15.2:6800/945139080 25 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'81 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43e411d020 con 0x55fa27afa620 2024-09-10T05:38:24.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.016+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b17f00 con 0x55fa27afa620 2024-09-10T05:38:24.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.016+0000 7f43f451c640 1 -- 172.21.15.62:0/649478111 <== osd.0 v2:172.21.15.2:6800/945139080 26 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'88 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43e411d020 con 0x55fa27afa620 2024-09-10T05:38:24.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.016+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b17f00 con 0x55fa27afde40 2024-09-10T05:38:24.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.020+0000 7f43f3d1b640 1 -- 172.21.15.62:0/649478111 <== osd.3 v2:172.21.15.62:6816/2708991149 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'42 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43e802d040 con 0x55fa27afde40 2024-09-10T05:38:24.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.020+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b18010 con 0x55fa27afa620 2024-09-10T05:38:24.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.024+0000 7f43f451c640 1 -- 172.21.15.62:0/649478111 <== osd.0 v2:172.21.15.2:6800/945139080 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43e411d020 con 0x55fa27afa620 2024-09-10T05:38:24.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.024+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b17fd0 con 0x55fa27af61a0 2024-09-10T05:38:24.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.024+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 <== osd.1 v2:172.21.15.62:6808/3442097179 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'262 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43ec0083f0 con 0x55fa27af61a0 2024-09-10T05:38:24.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.024+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b17fd0 con 0x55fa27afa620 2024-09-10T05:38:24.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.028+0000 7f43f451c640 1 -- 172.21.15.62:0/649478111 <== osd.0 v2:172.21.15.2:6800/945139080 28 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'82 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43e411d020 con 0x55fa27afa620 2024-09-10T05:38:24.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.028+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b18010 con 0x7f43e4009040 2024-09-10T05:38:24.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.028+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'47 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43ec0083f0 con 0x7f43e4009040 2024-09-10T05:38:24.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.028+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b18030 con 0x55fa27afde40 2024-09-10T05:38:24.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.028+0000 7f43f3d1b640 1 -- 172.21.15.62:0/649478111 <== osd.3 v2:172.21.15.62:6816/2708991149 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43e802d040 con 0x55fa27afde40 2024-09-10T05:38:24.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.028+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b18120 con 0x55fa27afa620 2024-09-10T05:38:24.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.032+0000 7f43f451c640 1 -- 172.21.15.62:0/649478111 <== osd.0 v2:172.21.15.2:6800/945139080 29 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'49 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43e411d020 con 0x55fa27afa620 2024-09-10T05:38:24.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.032+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b18120 con 0x55fa27afde40 2024-09-10T05:38:24.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.036+0000 7f43f3d1b640 1 -- 172.21.15.62:0/649478111 <== osd.3 v2:172.21.15.62:6816/2708991149 21 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43e802d040 con 0x55fa27afde40 2024-09-10T05:38:24.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.036+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b18120 con 0x55fa27afde40 2024-09-10T05:38:24.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.036+0000 7f43f3d1b640 1 -- 172.21.15.62:0/649478111 <== osd.3 v2:172.21.15.62:6816/2708991149 22 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'66 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43e802d040 con 0x55fa27afde40 2024-09-10T05:38:24.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.036+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b18160 con 0x55fa27afde40 2024-09-10T05:38:24.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.040+0000 7f43f3d1b640 1 -- 172.21.15.62:0/649478111 <== osd.3 v2:172.21.15.62:6816/2708991149 23 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43e802d040 con 0x55fa27afde40 2024-09-10T05:38:24.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.040+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b181a0 con 0x55fa27afa620 2024-09-10T05:38:24.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.040+0000 7f43f451c640 1 -- 172.21.15.62:0/649478111 <== osd.0 v2:172.21.15.2:6800/945139080 30 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'45 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43e411d020 con 0x55fa27afa620 2024-09-10T05:38:24.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.040+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b181a0 con 0x55fa27af61a0 2024-09-10T05:38:24.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.044+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 <== osd.1 v2:172.21.15.62:6808/3442097179 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'60 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43ec0083f0 con 0x55fa27af61a0 2024-09-10T05:38:24.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.044+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b181a0 con 0x55fa27afa620 2024-09-10T05:38:24.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.044+0000 7f43f451c640 1 -- 172.21.15.62:0/649478111 <== osd.0 v2:172.21.15.2:6800/945139080 31 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'83 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43e411d020 con 0x55fa27afa620 2024-09-10T05:38:24.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.044+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b181a0 con 0x55fa27af61a0 2024-09-10T05:38:24.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.048+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 <== osd.1 v2:172.21.15.62:6808/3442097179 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'72 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43ec0083f0 con 0x55fa27af61a0 2024-09-10T05:38:24.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.048+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b181e0 con 0x7f43e4009040 2024-09-10T05:38:24.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.048+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43ec0083f0 con 0x7f43e4009040 2024-09-10T05:38:24.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.048+0000 7f42a97e2640 20 reqs_thread_entry: start 2024-09-10T05:38:24.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.048+0000 7f43f6a169c0 20 init_complete bucket index max shards: 11 2024-09-10T05:38:24.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.048+0000 7f43f6a169c0 20 Filter name: none 2024-09-10T05:38:24.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.048+0000 7f421affd640 20 reqs_thread_entry: start 2024-09-10T05:38:24.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.048+0000 7f43f6a169c0 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-10T05:38:24.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.048+0000 7f43f6a169c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:24.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.048+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:94 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b132a0 con 0x55fa27afa620 2024-09-10T05:38:24.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.052+0000 7f43f451c640 1 -- 172.21.15.62:0/649478111 <== osd.0 v2:172.21.15.2:6800/945139080 32 ==== osd_op_reply(94 a_user [call out=48b,read 0~363 out=363b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 234+0+486 (crc 0 0 0) 0x7f43e411d020 con 0x55fa27afa620 2024-09-10T05:38:24.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.052+0000 7f43f6a169c0 20 rados_obj.operate() r=0 bl.length=363 2024-09-10T05:38:24.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.052+0000 7f43f6a169c0 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x13 2024-09-10T05:38:24.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.052+0000 7f43f6a169c0 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-10T05:38:24.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.052+0000 7f43f6a169c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:38:24.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.052+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:95 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b35d30 con 0x55fa27afa620 2024-09-10T05:38:24.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.052+0000 7f43f451c640 1 -- 172.21.15.62:0/649478111 <== osd.0 v2:172.21.15.2:6800/945139080 33 ==== osd_op_reply(95 a_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f43e411d020 con 0x55fa27afa620 2024-09-10T05:38:24.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.052+0000 7f43f6a169c0 10 removing key index: true_admin_akey 2024-09-10T05:38:24.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.052+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:96 8.15 8:afe09604:users.keys::true_admin_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b33d10 con 0x55fa27afde40 2024-09-10T05:38:24.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.052+0000 7f43f3d1b640 1 -- 172.21.15.62:0/649478111 <== osd.3 v2:172.21.15.62:6816/2708991149 24 ==== osd_op_reply(96 true_admin_akey [delete] v34'4 uv4 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f43e802d040 con 0x55fa27afde40 2024-09-10T05:38:24.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.052+0000 7f43f6a169c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-10T05:38:24.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.052+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify cookie 94532896245872 in=177b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b36150 con 0x55fa27afde40 2024-09-10T05:38:24.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.052+0000 7f43f3d1b640 1 -- 172.21.15.62:0/649478111 <== osd.3 v2:172.21.15.62:6816/2708991149 25 ==== watch-notify(notify (1) cookie 94532896062816 notify 146028888107 ret 0) ==== 207+0+0 (crc 0 0 0) 0x55fa27b17d30 con 0x55fa27afde40 2024-09-10T05:38:24.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.052+0000 7f42d37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888107 cookie 94532896062816 notifier 4864 bl.length()=165 2024-09-10T05:38:24.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.052+0000 7f43f3d1b640 1 -- 172.21.15.62:0/649478111 <== osd.3 v2:172.21.15.62:6816/2708991149 26 ==== osd_op_reply(97 notify.5 [notify cookie 94532896245872 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f43e802d040 con 0x55fa27afde40 2024-09-10T05:38:24.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.052+0000 7f42d37fe640 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f42b8003d70 con 0x55fa27afde40 2024-09-10T05:38:24.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.052+0000 7f43f3d1b640 1 -- 172.21.15.62:0/649478111 <== osd.3 v2:172.21.15.62:6816/2708991149 27 ==== osd_op_reply(98 notify.5 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43e802d040 con 0x55fa27afde40 2024-09-10T05:38:24.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.052+0000 7f43f3d1b640 1 -- 172.21.15.62:0/649478111 <== osd.3 v2:172.21.15.62:6816/2708991149 28 ==== watch-notify(notify_complete (2) cookie 94532896245872 notify 146028888107 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fa27b155d0 con 0x55fa27afde40 2024-09-10T05:38:24.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.052+0000 7f43f6a169c0 10 removing email index: 2024-09-10T05:38:24.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.052+0000 7f43f6a169c0 10 removing user buckets index 2024-09-10T05:38:24.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.052+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:99 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b33d10 con 0x55fa27afa620 2024-09-10T05:38:24.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.056+0000 7f43f451c640 1 -- 172.21.15.62:0/649478111 <== osd.0 v2:172.21.15.2:6800/945139080 34 ==== osd_op_reply(99 a_user.buckets [delete] v34'1 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f43e413a040 con 0x55fa27afa620 2024-09-10T05:38:24.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.056+0000 7f43f6a169c0 10 removing user index: a_user 2024-09-10T05:38:24.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.056+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:100 8.14 8:2efb937b:users.uid::a_user:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b37eb0 con 0x55fa27afa620 2024-09-10T05:38:24.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.056+0000 7f43f451c640 1 -- 172.21.15.62:0/649478111 <== osd.0 v2:172.21.15.2:6800/945139080 35 ==== osd_op_reply(100 a_user [call,call,delete] v34'8 uv8 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f43e413a040 con 0x55fa27afa620 2024-09-10T05:38:24.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.056+0000 7f43f6a169c0 10 removing default.rgw.meta+users.uid+a_user from cache 2024-09-10T05:38:24.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.056+0000 7f43f6a169c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-10T05:38:24.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.056+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [notify cookie 94532896258560 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b37e20 con 0x55fa27afa620 2024-09-10T05:38:24.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.060+0000 7f43f451c640 1 -- 172.21.15.62:0/649478111 <== osd.0 v2:172.21.15.2:6800/945139080 36 ==== watch-notify(notify (1) cookie 94532896059472 notify 146028888114 ret 0) ==== 197+0+0 (crc 0 0 0) 0x55fa27b157a0 con 0x55fa27afa620 2024-09-10T05:38:24.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.060+0000 7f42d37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888114 cookie 94532896059472 notifier 4864 bl.length()=155 2024-09-10T05:38:24.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.060+0000 7f43f451c640 1 -- 172.21.15.62:0/649478111 <== osd.0 v2:172.21.15.2:6800/945139080 37 ==== osd_op_reply(101 notify.2 [notify cookie 94532896258560 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f43e413a040 con 0x55fa27afa620 2024-09-10T05:38:24.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.060+0000 7f42d37fe640 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:102 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f42b8003d70 con 0x55fa27afa620 2024-09-10T05:38:24.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.060+0000 7f43f451c640 1 -- 172.21.15.62:0/649478111 <== osd.0 v2:172.21.15.2:6800/945139080 38 ==== watch-notify(notify_complete (2) cookie 94532896258560 notify 146028888114 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fa27ad82d0 con 0x55fa27afa620 2024-09-10T05:38:24.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.060+0000 7f43f451c640 1 -- 172.21.15.62:0/649478111 <== osd.0 v2:172.21.15.2:6800/945139080 39 ==== osd_op_reply(102 notify.2 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43e413a040 con 0x55fa27afa620 2024-09-10T05:38:24.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.060+0000 7f42aa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:38:24.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.060+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94532896068208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b37a00 con 0x55fa27af61a0 2024-09-10T05:38:24.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.060+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 <== osd.1 v2:172.21.15.62:6808/3442097179 26 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94532896068208] v34'263 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f43ec0083f0 con 0x55fa27af61a0 2024-09-10T05:38:24.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.060+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94532896048720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b09240 con 0x55fa27afa620 2024-09-10T05:38:24.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.064+0000 7f43f451c640 1 -- 172.21.15.62:0/649478111 <== osd.0 v2:172.21.15.2:6800/945139080 40 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94532896048720] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43e413a040 con 0x55fa27afa620 2024-09-10T05:38:24.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.064+0000 7f43f6a169c0 20 remove_watcher() i=0 2024-09-10T05:38:24.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.064+0000 7f43f6a169c0 2 removed watcher, disabling cache 2024-09-10T05:38:24.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.064+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94532896054624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b04650 con 0x55fa27af61a0 2024-09-10T05:38:24.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.064+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 <== osd.1 v2:172.21.15.62:6808/3442097179 27 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94532896054624] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43ec0083f0 con 0x55fa27af61a0 2024-09-10T05:38:24.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.064+0000 7f43f6a169c0 20 remove_watcher() i=1 2024-09-10T05:38:24.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.064+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94532896059472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b04650 con 0x55fa27afa620 2024-09-10T05:38:24.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.068+0000 7f43f451c640 1 -- 172.21.15.62:0/649478111 <== osd.0 v2:172.21.15.2:6800/945139080 41 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94532896059472] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43e413a040 con 0x55fa27afa620 2024-09-10T05:38:24.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.068+0000 7f43f6a169c0 20 remove_watcher() i=2 2024-09-10T05:38:24.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.068+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94532896061760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b07050 con 0x7f43e4009040 2024-09-10T05:38:24.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.068+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 <== osd.2 v2:172.21.15.62:6800/2677868286 15 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94532896061760] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43ec0083f0 con 0x7f43e4009040 2024-09-10T05:38:24.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.068+0000 7f43f6a169c0 20 remove_watcher() i=3 2024-09-10T05:38:24.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.068+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94532896052496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b07050 con 0x55fa27afa620 2024-09-10T05:38:24.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.072+0000 7f43f451c640 1 -- 172.21.15.62:0/649478111 <== osd.0 v2:172.21.15.2:6800/945139080 42 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94532896052496] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43e413a040 con 0x55fa27afa620 2024-09-10T05:38:24.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.072+0000 7f43f6a169c0 20 remove_watcher() i=4 2024-09-10T05:38:24.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.072+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94532896062816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b05510 con 0x55fa27afde40 2024-09-10T05:38:24.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.072+0000 7f43f3d1b640 1 -- 172.21.15.62:0/649478111 <== osd.3 v2:172.21.15.62:6816/2708991149 29 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94532896062816] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43e802d040 con 0x55fa27afde40 2024-09-10T05:38:24.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.072+0000 7f43f6a169c0 20 remove_watcher() i=5 2024-09-10T05:38:24.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.072+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94532896070240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b05510 con 0x55fa27afde40 2024-09-10T05:38:24.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.072+0000 7f43f3d1b640 1 -- 172.21.15.62:0/649478111 <== osd.3 v2:172.21.15.62:6816/2708991149 30 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94532896070240] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43e802d040 con 0x55fa27afde40 2024-09-10T05:38:24.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.072+0000 7f43f6a169c0 20 remove_watcher() i=6 2024-09-10T05:38:24.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.072+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94532896072448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa27b05510 con 0x7f43e4009040 2024-09-10T05:38:24.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.072+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 <== osd.2 v2:172.21.15.62:6800/2677868286 16 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94532896072448] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43ec0083f0 con 0x7f43e4009040 2024-09-10T05:38:24.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.072+0000 7f43f6a169c0 20 remove_watcher() i=7 2024-09-10T05:38:24.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.072+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55fa27afa620 msgr2=0x55fa27afca10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.072+0000 7f43f6a169c0 1 --2- 172.21.15.62:0/649478111 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55fa27afa620 0x55fa27afca10 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.072+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55fa27af61a0 msgr2=0x55fa27af8630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.072+0000 7f43f6a169c0 1 --2- 172.21.15.62:0/649478111 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55fa27af61a0 0x55fa27af8630 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.072+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f43e4009040 msgr2=0x7f43e40f9270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.072+0000 7f43f6a169c0 1 --2- 172.21.15.62:0/649478111 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f43e4009040 0x7f43e40f9270 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.072+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55fa27afde40 msgr2=0x55fa27b00250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.072+0000 7f43f6a169c0 1 --2- 172.21.15.62:0/649478111 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55fa27afde40 0x55fa27b00250 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.076+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f42c40399d0 msgr2=0x7f42c403be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.076+0000 7f43f6a169c0 1 --2- 172.21.15.62:0/649478111 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f42c40399d0 0x7f42c403be90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x55fa27ac15d0 tx=0x7f43e8010000 comp rx=0 tx=0).stop 2024-09-10T05:38:24.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.076+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa27ae4020 msgr2=0x55fa27aeb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.076+0000 7f43f6a169c0 1 --2- 172.21.15.62:0/649478111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa27ae4020 0x55fa27aeb310 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f43e4105040 tx=0x7f43e40f1fe0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.076+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 reap_dead start 2024-09-10T05:38:24.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.076+0000 7f43f4d1d640 1 -- 172.21.15.62:0/649478111 reap_dead start 2024-09-10T05:38:24.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.076+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 shutdown_connections 2024-09-10T05:38:24.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.076+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 >> 172.21.15.62:0/649478111 conn(0x55fa27ae0450 msgr2=0x55fa27ade660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:24.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.076+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 shutdown_connections 2024-09-10T05:38:24.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.076+0000 7f43f6a169c0 1 -- 172.21.15.62:0/649478111 wait complete. 2024-09-10T05:38:24.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.076+0000 7f43f6a169c0 1 -- 172.21.15.62:0/4146514935 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f42cc039a70 msgr2=0x7f42cc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.076+0000 7f43f6a169c0 1 --2- 172.21.15.62:0/4146514935 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f42cc039a70 0x7f42cc03bf30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f43e80063a0 tx=0x7f43e800f000 comp rx=0 tx=0).stop 2024-09-10T05:38:24.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.076+0000 7f43f6a169c0 1 -- 172.21.15.62:0/4146514935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa27ad7870 msgr2=0x55fa27ad7c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.076+0000 7f43f6a169c0 1 --2- 172.21.15.62:0/4146514935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa27ad7870 0x55fa27ad7c90 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f43e40cfb30 tx=0x7f43e40c5e00 comp rx=0 tx=0).stop 2024-09-10T05:38:24.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.076+0000 7f43f6a169c0 1 -- 172.21.15.62:0/4146514935 shutdown_connections 2024-09-10T05:38:24.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.076+0000 7f43f6a169c0 1 --2- 172.21.15.62:0/4146514935 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f42cc039a70 0x7f42cc03bf30 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.076+0000 7f43f6a169c0 1 --2- 172.21.15.62:0/4146514935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa27ad7870 0x55fa27ad7c90 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.076+0000 7f43f6a169c0 1 -- 172.21.15.62:0/4146514935 >> 172.21.15.62:0/4146514935 conn(0x55fa27acd220 msgr2=0x55fa27acd600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:24.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.076+0000 7f43f6a169c0 1 -- 172.21.15.62:0/4146514935 shutdown_connections 2024-09-10T05:38:24.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.076+0000 7f43f6a169c0 1 -- 172.21.15.62:0/4146514935 wait complete. 2024-09-10T05:38:24.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.076+0000 7f43f6a169c0 1 -- 172.21.15.62:0/736162896 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55fa27ac1d30 msgr2=0x55fa27ac41f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.076+0000 7f43f6a169c0 1 --2- 172.21.15.62:0/736162896 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55fa27ac1d30 0x55fa27ac41f0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.076+0000 7f43f6a169c0 1 -- 172.21.15.62:0/736162896 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55fa279ca140 msgr2=0x55fa27ac0cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.076+0000 7f43f6a169c0 1 --2- 172.21.15.62:0/736162896 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55fa279ca140 0x55fa27ac0cf0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.076+0000 7f43f6a169c0 1 -- 172.21.15.62:0/736162896 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55fa27ac6720 msgr2=0x55fa27ac8b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.076+0000 7f43f6a169c0 1 --2- 172.21.15.62:0/736162896 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55fa27ac6720 0x55fa27ac8b10 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.076+0000 7f43f6a169c0 1 -- 172.21.15.62:0/736162896 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f42dc039a70 msgr2=0x7f42dc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.076+0000 7f43f6a169c0 1 --2- 172.21.15.62:0/736162896 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f42dc039a70 0x7f42dc03bf30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f43e80016b0 tx=0x7f43e80066c0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.076+0000 7f43f6a169c0 1 -- 172.21.15.62:0/736162896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa279c6fb0 msgr2=0x55fa27ab9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.076+0000 7f43f6a169c0 1 --2- 172.21.15.62:0/736162896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa279c6fb0 0x55fa27ab9b80 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f43e4018f70 tx=0x7f43e40180e0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.076+0000 7f43f4d1d640 1 -- 172.21.15.62:0/736162896 reap_dead start 2024-09-10T05:38:24.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.076+0000 7f43f6a169c0 1 -- 172.21.15.62:0/736162896 shutdown_connections 2024-09-10T05:38:24.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.076+0000 7f43f6a169c0 1 -- 172.21.15.62:0/736162896 >> 172.21.15.62:0/736162896 conn(0x55fa279c2ad0 msgr2=0x55fa27aacdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:24.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.076+0000 7f43f6a169c0 1 -- 172.21.15.62:0/736162896 shutdown_connections 2024-09-10T05:38:24.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.076+0000 7f43f6a169c0 1 -- 172.21.15.62:0/736162896 wait complete. 2024-09-10T05:38:24.088 ERROR:root:None 2024-09-10T05:38:24.088 ERROR:root:0 2024-09-10T05:38:24.088 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-10T05:38:24.088 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-10T05:38:24.088 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=read 2024-09-10T05:38:24.170 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:38:24.170 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:38:24.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.168+0000 7f61fdf079c0 1 Processor -- start 2024-09-10T05:38:24.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.168+0000 7f61fdf079c0 1 -- start start 2024-09-10T05:38:24.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.168+0000 7f61fdf079c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x558b6a3765d0 0x558b6a40a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.168+0000 7f61fdf079c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558b6a2b69c0 con 0x558b6a3761f0 2024-09-10T05:38:24.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.168+0000 7f61fdf079c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x558b6a3066d0 con 0x558b6a3765d0 2024-09-10T05:38:24.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.168+0000 7f61fb20c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x558b6a3765d0 0x558b6a40a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.168+0000 7f61fba0d640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x558b6a3761f0 0x558b6a407020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:52156/0 (socket says 172.21.15.62:52156) 2024-09-10T05:38:24.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.168+0000 7f61fba0d640 1 -- 172.21.15.62:0/3745349969 learned_addr learned my addr 172.21.15.62:0/3745349969 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-10T05:38:24.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.168+0000 7f61fb20c640 1 -- 172.21.15.62:0/3745349969 >> v1:172.21.15.2:6789/0 conn(0x558b6a3761f0 legacy=0x558b6a407020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.168+0000 7f61fb20c640 1 -- 172.21.15.62:0/3745349969 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b6a2aaca0 con 0x558b6a3765d0 2024-09-10T05:38:24.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.172+0000 7f61fb20c640 1 --2- 172.21.15.62:0/3745349969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6a3765d0 0x558b6a40a750 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f61f000a480 tx=0x7f61f001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e4ed4a4199c12fb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.172+0000 7f61faa0b640 1 -- 172.21.15.62:0/3745349969 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61f00b0070 con 0x558b6a3765d0 2024-09-10T05:38:24.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.172+0000 7f61faa0b640 1 -- 172.21.15.62:0/3745349969 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61f00ab540 con 0x558b6a3765d0 2024-09-10T05:38:24.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.172+0000 7f61faa0b640 1 -- 172.21.15.62:0/3745349969 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61f00ab840 con 0x558b6a3765d0 2024-09-10T05:38:24.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.172+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3745349969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6a3765d0 msgr2=0x558b6a40a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.172+0000 7f61fdf079c0 1 --2- 172.21.15.62:0/3745349969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6a3765d0 0x558b6a40a750 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f61f000a480 tx=0x7f61f001b280 comp rx=0 tx=0).stop 2024-09-10T05:38:24.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.172+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3745349969 shutdown_connections 2024-09-10T05:38:24.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.172+0000 7f61fdf079c0 1 --2- 172.21.15.62:0/3745349969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6a3765d0 0x558b6a40a750 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.172+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3745349969 >> 172.21.15.62:0/3745349969 conn(0x558b6a3fc910 msgr2=0x558b6a3fed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:24.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.172+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3745349969 shutdown_connections 2024-09-10T05:38:24.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.172+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3745349969 wait complete. 2024-09-10T05:38:24.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.188+0000 7f61fdf079c0 1 Processor -- start 2024-09-10T05:38:24.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.188+0000 7f61fdf079c0 1 -- start start 2024-09-10T05:38:24.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.188+0000 7f61fdf079c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6a3761f0 0x558b6a4ef950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.188+0000 7f61fdf079c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558b6a30a680 con 0x558b6a3761f0 2024-09-10T05:38:24.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.188+0000 7f61fba0d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6a3761f0 0x558b6a4ef950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.188+0000 7f61fba0d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6a3761f0 0x558b6a4ef950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38932/0 (socket says 172.21.15.62:38932) 2024-09-10T05:38:24.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.188+0000 7f61fba0d640 1 -- 172.21.15.62:0/1557619027 learned_addr learned my addr 172.21.15.62:0/1557619027 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:24.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.188+0000 7f61fba0d640 1 -- 172.21.15.62:0/1557619027 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b6a285da0 con 0x558b6a3761f0 2024-09-10T05:38:24.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.188+0000 7f61fba0d640 1 --2- 172.21.15.62:0/1557619027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6a3761f0 0x558b6a4ef950 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f61ec001e00 tx=0x7f61ec00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1831ad63ea16a560 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.188+0000 7f60e9e0b640 1 -- 172.21.15.62:0/1557619027 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61ec012020 con 0x558b6a3761f0 2024-09-10T05:38:24.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.188+0000 7f60e9e0b640 1 -- 172.21.15.62:0/1557619027 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61ec00e690 con 0x558b6a3761f0 2024-09-10T05:38:24.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.188+0000 7f60e9e0b640 1 -- 172.21.15.62:0/1557619027 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61ec00ea10 con 0x558b6a3761f0 2024-09-10T05:38:24.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.188+0000 7f61fdf079c0 1 -- 172.21.15.62:0/1557619027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6a3761f0 msgr2=0x558b6a4ef950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.188+0000 7f61fdf079c0 1 --2- 172.21.15.62:0/1557619027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6a3761f0 0x558b6a4ef950 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f61ec001e00 tx=0x7f61ec00b6d0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.188+0000 7f61fdf079c0 1 -- 172.21.15.62:0/1557619027 shutdown_connections 2024-09-10T05:38:24.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.188+0000 7f61fdf079c0 1 --2- 172.21.15.62:0/1557619027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6a3761f0 0x558b6a4ef950 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.188+0000 7f61fdf079c0 1 -- 172.21.15.62:0/1557619027 >> 172.21.15.62:0/1557619027 conn(0x558b6a3fc910 msgr2=0x558b6a4eb590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:24.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.188+0000 7f61fdf079c0 1 -- 172.21.15.62:0/1557619027 shutdown_connections 2024-09-10T05:38:24.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.188+0000 7f61fdf079c0 1 -- 172.21.15.62:0/1557619027 wait complete. 2024-09-10T05:38:24.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.188+0000 7f61fdf079c0 1 Processor -- start 2024-09-10T05:38:24.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.188+0000 7f61fdf079c0 1 -- start start 2024-09-10T05:38:24.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.192+0000 7f61fdf079c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6a3761f0 0x558b6a4f6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.192+0000 7f61fdf079c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558b6a2aca50 con 0x558b6a3761f0 2024-09-10T05:38:24.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.192+0000 7f61fba0d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6a3761f0 0x558b6a4f6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.192+0000 7f61fba0d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6a3761f0 0x558b6a4f6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38946/0 (socket says 172.21.15.62:38946) 2024-09-10T05:38:24.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.192+0000 7f61fba0d640 1 -- 172.21.15.62:0/948738128 learned_addr learned my addr 172.21.15.62:0/948738128 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:24.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.192+0000 7f61fba0d640 1 -- 172.21.15.62:0/948738128 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b6a4f7520 con 0x558b6a3761f0 2024-09-10T05:38:24.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.192+0000 7f61fba0d640 1 --2- 172.21.15.62:0/948738128 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6a3761f0 0x558b6a4f6fc0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x558b6a4f08e0 tx=0x7f61ec000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.192+0000 7f60e3fff640 1 -- 172.21.15.62:0/948738128 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61ec012030 con 0x558b6a3761f0 2024-09-10T05:38:24.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.192+0000 7f61fdf079c0 1 -- 172.21.15.62:0/948738128 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558b6a4f77b0 con 0x558b6a3761f0 2024-09-10T05:38:24.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.192+0000 7f60e3fff640 1 -- 172.21.15.62:0/948738128 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61ec01a750 con 0x558b6a3761f0 2024-09-10T05:38:24.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.192+0000 7f60e3fff640 1 -- 172.21.15.62:0/948738128 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61ec01aa30 con 0x558b6a3761f0 2024-09-10T05:38:24.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.192+0000 7f61fdf079c0 1 -- 172.21.15.62:0/948738128 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b6a4f8160 con 0x558b6a3761f0 2024-09-10T05:38:24.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.192+0000 7f60e3fff640 1 -- 172.21.15.62:0/948738128 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f61ec015020 con 0x558b6a3761f0 2024-09-10T05:38:24.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.192+0000 7f60e3fff640 1 --2- 172.21.15.62:0/948738128 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f60e4039a70 0x7f60e403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.192+0000 7f60e3fff640 1 -- 172.21.15.62:0/948738128 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7f61ec020030 con 0x558b6a3761f0 2024-09-10T05:38:24.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.192+0000 7f61fb20c640 1 --2- 172.21.15.62:0/948738128 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f60e4039a70 0x7f60e403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.192+0000 7f61fdf079c0 1 --2- 172.21.15.62:0/948738128 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x558b6a3765d0 0x558b6a4fe130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.192+0000 7f61fdf079c0 1 -- 172.21.15.62:0/948738128 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b6a4fe670 con 0x558b6a3765d0 2024-09-10T05:38:24.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.192+0000 7f61fc20e640 1 --2- 172.21.15.62:0/948738128 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x558b6a3765d0 0x558b6a4fe130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.192+0000 7f61fb20c640 1 --2- 172.21.15.62:0/948738128 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f60e4039a70 0x7f60e403bf30 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f61f00ad000 tx=0x7f61f00a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.196+0000 7f61fc20e640 1 --2- 172.21.15.62:0/948738128 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x558b6a3765d0 0x558b6a4fe130 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.196+0000 7f61fc20e640 1 -- 172.21.15.62:0/948738128 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f61f400a4d0 con 0x558b6a3765d0 2024-09-10T05:38:24.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.196+0000 7f61fdf079c0 1 --2- 172.21.15.62:0/948738128 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x558b6a4ff0e0 0x558b6a501580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.196+0000 7f61fdf079c0 1 -- 172.21.15.62:0/948738128 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b6a501cf0 con 0x558b6a4ff0e0 2024-09-10T05:38:24.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.196+0000 7f61fba0d640 1 --2- 172.21.15.62:0/948738128 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x558b6a4ff0e0 0x558b6a501580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.196+0000 7f61fba0d640 1 --2- 172.21.15.62:0/948738128 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x558b6a4ff0e0 0x558b6a501580 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.196+0000 7f61fba0d640 1 -- 172.21.15.62:0/948738128 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f61ec008030 con 0x558b6a4ff0e0 2024-09-10T05:38:24.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.196+0000 7f61fdf079c0 1 --2- 172.21.15.62:0/948738128 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x558b6a503ab0 0x558b6a505ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.196+0000 7f61fdf079c0 1 -- 172.21.15.62:0/948738128 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b6a506590 con 0x558b6a503ab0 2024-09-10T05:38:24.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.196+0000 7f61fb20c640 1 --2- 172.21.15.62:0/948738128 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x558b6a503ab0 0x558b6a505ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.196+0000 7f61fb20c640 1 --2- 172.21.15.62:0/948738128 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x558b6a503ab0 0x558b6a505ea0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.196+0000 7f61fb20c640 1 -- 172.21.15.62:0/948738128 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv5 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f61f00b3040 con 0x558b6a503ab0 2024-09-10T05:38:24.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.196+0000 7f61fdf079c0 1 -- 172.21.15.62:0/948738128 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b6a502950 con 0x558b6a4ff0e0 2024-09-10T05:38:24.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.196+0000 7f61fba0d640 1 -- 172.21.15.62:0/948738128 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f61ec008030 con 0x558b6a4ff0e0 2024-09-10T05:38:24.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.196+0000 7f61fdf079c0 1 -- 172.21.15.62:0/948738128 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b6a502df0 con 0x558b6a503ab0 2024-09-10T05:38:24.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.200+0000 7f61fb20c640 1 -- 172.21.15.62:0/948738128 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f61f00b3040 con 0x558b6a503ab0 2024-09-10T05:38:24.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.200+0000 7f61fdf079c0 1 Processor -- start 2024-09-10T05:38:24.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.200+0000 7f61fdf079c0 1 -- start start 2024-09-10T05:38:24.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.200+0000 7f61fdf079c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6a514be0 0x558b6a515000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.200+0000 7f61fdf079c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558b6a317450 con 0x558b6a514be0 2024-09-10T05:38:24.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.200+0000 7f61fba0d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6a514be0 0x558b6a515000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.200+0000 7f61fba0d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6a514be0 0x558b6a515000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38956/0 (socket says 172.21.15.62:38956) 2024-09-10T05:38:24.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.200+0000 7f61fba0d640 1 -- 172.21.15.62:0/2904516177 learned_addr learned my addr 172.21.15.62:0/2904516177 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:24.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.200+0000 7f61fba0d640 1 -- 172.21.15.62:0/2904516177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b6a515640 con 0x558b6a514be0 2024-09-10T05:38:24.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.200+0000 7f61fba0d640 1 --2- 172.21.15.62:0/2904516177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6a514be0 0x558b6a515000 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f61ec043010 tx=0x7f61ec016ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.200+0000 7f60e17fa640 1 -- 172.21.15.62:0/2904516177 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61ec00d7b0 con 0x558b6a514be0 2024-09-10T05:38:24.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.200+0000 7f60e17fa640 1 -- 172.21.15.62:0/2904516177 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61ec00dae0 con 0x558b6a514be0 2024-09-10T05:38:24.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.200+0000 7f61fdf079c0 1 -- 172.21.15.62:0/2904516177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558b6a515ea0 con 0x558b6a514be0 2024-09-10T05:38:24.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.200+0000 7f60e17fa640 1 -- 172.21.15.62:0/2904516177 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61ec00ddc0 con 0x558b6a514be0 2024-09-10T05:38:24.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.200+0000 7f61fdf079c0 1 -- 172.21.15.62:0/2904516177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b6a516410 con 0x558b6a514be0 2024-09-10T05:38:24.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.200+0000 7f60e17fa640 1 -- 172.21.15.62:0/2904516177 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f61ec03e060 con 0x558b6a514be0 2024-09-10T05:38:24.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.200+0000 7f60e17fa640 1 --2- 172.21.15.62:0/2904516177 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f60d4039a70 0x7f60d403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.200+0000 7f60e17fa640 1 -- 172.21.15.62:0/2904516177 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7f61ec04a040 con 0x558b6a514be0 2024-09-10T05:38:24.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.200+0000 7f61fb20c640 1 --2- 172.21.15.62:0/2904516177 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f60d4039a70 0x7f60d403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.200+0000 7f61fdf079c0 1 Processor -- start 2024-09-10T05:38:24.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.200+0000 7f61fdf079c0 1 -- start start 2024-09-10T05:38:24.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.204+0000 7f61fdf079c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6a521360 0x558b6a521740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.204+0000 7f61fdf079c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558b6a4f01a0 con 0x558b6a521360 2024-09-10T05:38:24.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.204+0000 7f61fb20c640 1 --2- 172.21.15.62:0/2904516177 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f60d4039a70 0x7f60d403bf30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x558b6a502920 tx=0x7f61f0005a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.204+0000 7f61fba0d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6a521360 0x558b6a521740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.204+0000 7f61fba0d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6a521360 0x558b6a521740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38964/0 (socket says 172.21.15.62:38964) 2024-09-10T05:38:24.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.204+0000 7f61fba0d640 1 -- 172.21.15.62:0/497272417 learned_addr learned my addr 172.21.15.62:0/497272417 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:24.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.204+0000 7f61fba0d640 1 -- 172.21.15.62:0/497272417 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b6a521d10 con 0x558b6a521360 2024-09-10T05:38:24.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.204+0000 7f61fba0d640 1 --2- 172.21.15.62:0/497272417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6a521360 0x558b6a521740 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f61ec012390 tx=0x7f61ec047b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15d2f923c479c872 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.204+0000 7f60daffd640 1 -- 172.21.15.62:0/497272417 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61ec012cb0 con 0x558b6a521360 2024-09-10T05:38:24.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.204+0000 7f60daffd640 1 -- 172.21.15.62:0/497272417 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61ec036c30 con 0x558b6a521360 2024-09-10T05:38:24.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.204+0000 7f60daffd640 1 -- 172.21.15.62:0/497272417 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61ec04d330 con 0x558b6a521360 2024-09-10T05:38:24.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.204+0000 7f61fdf079c0 1 -- 172.21.15.62:0/497272417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6a521360 msgr2=0x558b6a521740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.204+0000 7f61fdf079c0 1 --2- 172.21.15.62:0/497272417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6a521360 0x558b6a521740 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f61ec012390 tx=0x7f61ec047b20 comp rx=0 tx=0).stop 2024-09-10T05:38:24.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.204+0000 7f61fdf079c0 1 -- 172.21.15.62:0/497272417 shutdown_connections 2024-09-10T05:38:24.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.204+0000 7f61fdf079c0 1 --2- 172.21.15.62:0/497272417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6a521360 0x558b6a521740 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.204+0000 7f61fdf079c0 1 -- 172.21.15.62:0/497272417 >> 172.21.15.62:0/497272417 conn(0x558b6a51d790 msgr2=0x558b6a51b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:24.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.204+0000 7f61fdf079c0 1 -- 172.21.15.62:0/497272417 shutdown_connections 2024-09-10T05:38:24.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.204+0000 7f61fdf079c0 1 -- 172.21.15.62:0/497272417 wait complete. 2024-09-10T05:38:24.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.204+0000 7f61fdf079c0 1 Processor -- start 2024-09-10T05:38:24.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.204+0000 7f61fdf079c0 1 -- start start 2024-09-10T05:38:24.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.204+0000 7f61fdf079c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6a521360 0x558b6a528700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.204+0000 7f61fdf079c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558b6a5221f0 con 0x558b6a521360 2024-09-10T05:38:24.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.204+0000 7f61fba0d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6a521360 0x558b6a528700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.204+0000 7f61fba0d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6a521360 0x558b6a528700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:38972/0 (socket says 172.21.15.62:38972) 2024-09-10T05:38:24.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.204+0000 7f61fba0d640 1 -- 172.21.15.62:0/3824298454 learned_addr learned my addr 172.21.15.62:0/3824298454 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:24.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.204+0000 7f61fba0d640 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b6a528c60 con 0x558b6a521360 2024-09-10T05:38:24.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.204+0000 7f61fba0d640 1 --2- 172.21.15.62:0/3824298454 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6a521360 0x558b6a528700 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f61ec04da60 tx=0x7f61ec005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.204+0000 7f60d97fa640 1 -- 172.21.15.62:0/3824298454 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61ec036c30 con 0x558b6a521360 2024-09-10T05:38:24.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.204+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558b6a528c60 con 0x558b6a521360 2024-09-10T05:38:24.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.208+0000 7f60d97fa640 1 -- 172.21.15.62:0/3824298454 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61ec00c7b0 con 0x558b6a521360 2024-09-10T05:38:24.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.208+0000 7f60d97fa640 1 -- 172.21.15.62:0/3824298454 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61ec024420 con 0x558b6a521360 2024-09-10T05:38:24.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.208+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b6a529290 con 0x558b6a521360 2024-09-10T05:38:24.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.208+0000 7f60d97fa640 1 -- 172.21.15.62:0/3824298454 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f61ec061040 con 0x558b6a521360 2024-09-10T05:38:24.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.208+0000 7f60d97fa640 1 --2- 172.21.15.62:0/3824298454 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f60c4039a70 0x7f60c403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.208+0000 7f60d97fa640 1 -- 172.21.15.62:0/3824298454 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7f61ec05f020 con 0x558b6a521360 2024-09-10T05:38:24.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.208+0000 7f61fdf079c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:24.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.208+0000 7f61fb20c640 1 --2- 172.21.15.62:0/3824298454 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f60c4039a70 0x7f60c403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.208+0000 7f61fdf079c0 1 --2- 172.21.15.62:0/3824298454 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x558b6a533680 0x558b6a535b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.208+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b6a536260 con 0x558b6a533680 2024-09-10T05:38:24.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.208+0000 7f61fc20e640 1 --2- 172.21.15.62:0/3824298454 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x558b6a533680 0x558b6a535b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.208+0000 7f61fb20c640 1 --2- 172.21.15.62:0/3824298454 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f60c4039a70 0x7f60c403bf30 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f61f00ae040 tx=0x7f61f00a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.208+0000 7f61fc20e640 1 --2- 172.21.15.62:0/3824298454 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x558b6a533680 0x558b6a535b10 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.208+0000 7f61fc20e640 1 -- 172.21.15.62:0/3824298454 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f61f400a4d0 con 0x558b6a533680 2024-09-10T05:38:24.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.208+0000 7f61fdf079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:24.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.208+0000 7f61fdf079c0 20 realm 2024-09-10T05:38:24.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.208+0000 7f61fdf079c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:24.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.208+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b6a532a70 con 0x558b6a533680 2024-09-10T05:38:24.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.208+0000 7f61fc20e640 1 -- 172.21.15.62:0/3824298454 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f61f400a4d0 con 0x558b6a533680 2024-09-10T05:38:24.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.208+0000 7f61fdf079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:24.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.208+0000 7f61fdf079c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:38:24.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.208+0000 7f61fdf079c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:24.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.208+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b6a536d20 con 0x558b6a533680 2024-09-10T05:38:24.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.208+0000 7f61fc20e640 1 -- 172.21.15.62:0/3824298454 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f61f400a4d0 con 0x558b6a533680 2024-09-10T05:38:24.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.208+0000 7f61fdf079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:24.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.208+0000 7f61fdf079c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:24.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.208+0000 7f61fdf079c0 1 --2- 172.21.15.62:0/3824298454 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x558b6a537b00 0x558b6a539ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.208+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b6a53a5c0 con 0x558b6a537b00 2024-09-10T05:38:24.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.208+0000 7f61fba0d640 1 --2- 172.21.15.62:0/3824298454 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x558b6a537b00 0x558b6a539ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.212+0000 7f61fba0d640 1 --2- 172.21.15.62:0/3824298454 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x558b6a537b00 0x558b6a539ef0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.212+0000 7f61fba0d640 1 -- 172.21.15.62:0/3824298454 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f61ec074020 con 0x558b6a537b00 2024-09-10T05:38:24.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.212+0000 7f61fdf079c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:38:24.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.212+0000 7f61fdf079c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:24.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.212+0000 7f61fdf079c0 1 --2- 172.21.15.62:0/3824298454 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x558b6a53b320 0x558b6a53d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.212+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b6a53dec0 con 0x558b6a53b320 2024-09-10T05:38:24.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.212+0000 7f61fb20c640 1 --2- 172.21.15.62:0/3824298454 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x558b6a53b320 0x558b6a53d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.212+0000 7f61fb20c640 1 --2- 172.21.15.62:0/3824298454 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x558b6a53b320 0x558b6a53d730 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.212+0000 7f61fb20c640 1 -- 172.21.15.62:0/3824298454 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv5 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f61f00b3040 con 0x558b6a53b320 2024-09-10T05:38:24.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.212+0000 7f61fdf079c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:38:24.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.212+0000 7f61fdf079c0 20 searching for the correct realm 2024-09-10T05:38:24.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.212+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b6a53f790 con 0x558b6a53b320 2024-09-10T05:38:24.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.212+0000 7f61fb20c640 1 -- 172.21.15.62:0/3824298454 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61f00b3040 con 0x558b6a53b320 2024-09-10T05:38:24.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.212+0000 7f61fb20c640 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b6a53f790 con 0x558b6a537b00 2024-09-10T05:38:24.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.212+0000 7f61fba0d640 1 -- 172.21.15.62:0/3824298454 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61ec074020 con 0x558b6a537b00 2024-09-10T05:38:24.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.212+0000 7f61fba0d640 1 --2- 172.21.15.62:0/3824298454 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f61ec064050 0x7f61ec012400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.212+0000 7f61fba0d640 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b6a53f790 con 0x7f61ec064050 2024-09-10T05:38:24.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.212+0000 7f61fc20e640 1 --2- 172.21.15.62:0/3824298454 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f61ec064050 0x7f61ec012400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.212+0000 7f61fc20e640 1 --2- 172.21.15.62:0/3824298454 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f61ec064050 0x7f61ec012400 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.212+0000 7f61fc20e640 1 -- 172.21.15.62:0/3824298454 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61f400a4d0 con 0x7f61ec064050 2024-09-10T05:38:24.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.212+0000 7f61fc20e640 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b6a53f790 con 0x558b6a533680 2024-09-10T05:38:24.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.212+0000 7f61fc20e640 1 -- 172.21.15.62:0/3824298454 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61f400a4d0 con 0x558b6a533680 2024-09-10T05:38:24.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.212+0000 7f61fc20e640 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b6a53f790 con 0x558b6a533680 2024-09-10T05:38:24.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.212+0000 7f61fc20e640 1 -- 172.21.15.62:0/3824298454 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61f400a4d0 con 0x558b6a533680 2024-09-10T05:38:24.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.212+0000 7f61fc20e640 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b6a53f790 con 0x558b6a53b320 2024-09-10T05:38:24.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.216+0000 7f61fb20c640 1 -- 172.21.15.62:0/3824298454 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61f00b3040 con 0x558b6a53b320 2024-09-10T05:38:24.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.216+0000 7f61fb20c640 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b6a53f790 con 0x558b6a533680 2024-09-10T05:38:24.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.216+0000 7f61fc20e640 1 -- 172.21.15.62:0/3824298454 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61f400a4d0 con 0x558b6a533680 2024-09-10T05:38:24.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.216+0000 7f61fc20e640 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b6a53f790 con 0x558b6a537b00 2024-09-10T05:38:24.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.216+0000 7f61fba0d640 1 -- 172.21.15.62:0/3824298454 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61ec074020 con 0x558b6a537b00 2024-09-10T05:38:24.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.216+0000 7f61fba0d640 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b6a53f790 con 0x558b6a537b00 2024-09-10T05:38:24.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.216+0000 7f61fba0d640 1 -- 172.21.15.62:0/3824298454 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61ec074020 con 0x558b6a537b00 2024-09-10T05:38:24.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.216+0000 7f61fba0d640 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b6a53f790 con 0x558b6a533680 2024-09-10T05:38:24.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.216+0000 7f61fc20e640 1 -- 172.21.15.62:0/3824298454 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61f400a4d0 con 0x558b6a533680 2024-09-10T05:38:24.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.216+0000 7f61fc20e640 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b6a53f790 con 0x7f61ec064050 2024-09-10T05:38:24.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.216+0000 7f61fc20e640 1 -- 172.21.15.62:0/3824298454 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61f400a4d0 con 0x7f61ec064050 2024-09-10T05:38:24.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.216+0000 7f61fc20e640 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b6a53f790 con 0x558b6a533680 2024-09-10T05:38:24.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.216+0000 7f61fc20e640 1 -- 172.21.15.62:0/3824298454 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61f400a4d0 con 0x558b6a533680 2024-09-10T05:38:24.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.216+0000 7f61fc20e640 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b6a53f790 con 0x7f61ec064050 2024-09-10T05:38:24.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.216+0000 7f61fc20e640 1 -- 172.21.15.62:0/3824298454 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f61f400a4d0 con 0x7f61ec064050 2024-09-10T05:38:24.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.216+0000 7f61fc20e640 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b6a53f790 con 0x558b6a537b00 2024-09-10T05:38:24.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.216+0000 7f61fba0d640 1 -- 172.21.15.62:0/3824298454 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61ec074020 con 0x558b6a537b00 2024-09-10T05:38:24.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.216+0000 7f61fba0d640 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b6a53f790 con 0x558b6a53b320 2024-09-10T05:38:24.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.216+0000 7f61fb20c640 1 -- 172.21.15.62:0/3824298454 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61f00b3040 con 0x558b6a53b320 2024-09-10T05:38:24.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.216+0000 7f61fb20c640 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b6a53f790 con 0x558b6a533680 2024-09-10T05:38:24.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.216+0000 7f61fc20e640 1 -- 172.21.15.62:0/3824298454 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61f400a4d0 con 0x558b6a533680 2024-09-10T05:38:24.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.216+0000 7f61fc20e640 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b6a53f790 con 0x558b6a537b00 2024-09-10T05:38:24.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.220+0000 7f61fba0d640 1 -- 172.21.15.62:0/3824298454 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61ec074020 con 0x558b6a537b00 2024-09-10T05:38:24.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.220+0000 7f61fba0d640 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b6a53f790 con 0x558b6a53b320 2024-09-10T05:38:24.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.220+0000 7f61fb20c640 1 -- 172.21.15.62:0/3824298454 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 34 out=170b] v34'5 uv5 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f61f00b3040 con 0x558b6a53b320 2024-09-10T05:38:24.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.220+0000 7f61fb20c640 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b6a53f790 con 0x558b6a533680 2024-09-10T05:38:24.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.220+0000 7f61fc20e640 1 -- 172.21.15.62:0/3824298454 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61f400a4d0 con 0x558b6a533680 2024-09-10T05:38:24.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.220+0000 7f61fc20e640 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b6a53f790 con 0x558b6a533680 2024-09-10T05:38:24.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.220+0000 7f61fc20e640 1 -- 172.21.15.62:0/3824298454 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f61f400a4d0 con 0x558b6a533680 2024-09-10T05:38:24.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.220+0000 7f61fc20e640 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b6a53f790 con 0x558b6a533680 2024-09-10T05:38:24.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.220+0000 7f61fc20e640 1 -- 172.21.15.62:0/3824298454 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61f400a4d0 con 0x558b6a533680 2024-09-10T05:38:24.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.220+0000 7f61fc20e640 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b6a53f790 con 0x558b6a53b320 2024-09-10T05:38:24.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.220+0000 7f61fb20c640 1 -- 172.21.15.62:0/3824298454 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61f00b3040 con 0x558b6a53b320 2024-09-10T05:38:24.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.220+0000 7f61fb20c640 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b6a53f790 con 0x7f61ec064050 2024-09-10T05:38:24.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.220+0000 7f61fc20e640 1 -- 172.21.15.62:0/3824298454 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61f400a4d0 con 0x7f61ec064050 2024-09-10T05:38:24.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.220+0000 7f61fc20e640 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b6a53f790 con 0x558b6a533680 2024-09-10T05:38:24.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.220+0000 7f61fc20e640 1 -- 172.21.15.62:0/3824298454 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61f400a4d0 con 0x558b6a533680 2024-09-10T05:38:24.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.220+0000 7f61fc20e640 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b6a53f790 con 0x7f61ec064050 2024-09-10T05:38:24.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.220+0000 7f61fc20e640 1 -- 172.21.15.62:0/3824298454 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61f400a4d0 con 0x7f61ec064050 2024-09-10T05:38:24.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.220+0000 7f61fc20e640 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b6a53f790 con 0x558b6a53b320 2024-09-10T05:38:24.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.220+0000 7f61fb20c640 1 -- 172.21.15.62:0/3824298454 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61f00b3040 con 0x558b6a53b320 2024-09-10T05:38:24.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.220+0000 7f61fb20c640 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b6a53f790 con 0x7f61ec064050 2024-09-10T05:38:24.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.220+0000 7f61fc20e640 1 -- 172.21.15.62:0/3824298454 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61f400a4d0 con 0x7f61ec064050 2024-09-10T05:38:24.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.220+0000 7f61fc20e640 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b6a53f790 con 0x558b6a537b00 2024-09-10T05:38:24.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.224+0000 7f61fba0d640 1 -- 172.21.15.62:0/3824298454 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61ec074020 con 0x558b6a537b00 2024-09-10T05:38:24.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.224+0000 7f61fba0d640 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b6a53f790 con 0x558b6a537b00 2024-09-10T05:38:24.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.224+0000 7f61fba0d640 1 -- 172.21.15.62:0/3824298454 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61ec074020 con 0x558b6a537b00 2024-09-10T05:38:24.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.224+0000 7f61fba0d640 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b6a53f790 con 0x558b6a53b320 2024-09-10T05:38:24.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.224+0000 7f61fb20c640 1 -- 172.21.15.62:0/3824298454 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61f00b3040 con 0x558b6a53b320 2024-09-10T05:38:24.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.224+0000 7f61fb20c640 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b6a53f790 con 0x558b6a537b00 2024-09-10T05:38:24.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.224+0000 7f61fba0d640 1 -- 172.21.15.62:0/3824298454 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f61ec074020 con 0x558b6a537b00 2024-09-10T05:38:24.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.224+0000 7f61fba0d640 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b6a53f790 con 0x558b6a537b00 2024-09-10T05:38:24.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.224+0000 7f61fba0d640 1 -- 172.21.15.62:0/3824298454 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61ec074020 con 0x558b6a537b00 2024-09-10T05:38:24.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.224+0000 7f61fdf079c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:38:24.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.224+0000 7f61fdf079c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:38:24.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.224+0000 7f61fdf079c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:38:24.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.224+0000 7f61fdf079c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:38:24.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.224+0000 7f61fdf079c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:38:24.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.224+0000 7f61fdf079c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:38:24.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.224+0000 7f61fdf079c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:24.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.224+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b6a53e880 con 0x558b6a533680 2024-09-10T05:38:24.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.224+0000 7f61fc20e640 1 -- 172.21.15.62:0/3824298454 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f61f400a4d0 con 0x558b6a533680 2024-09-10T05:38:24.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.224+0000 7f61fdf079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:24.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.224+0000 7f61fdf079c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:24.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.224+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b6a53e4c0 con 0x558b6a537b00 2024-09-10T05:38:24.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.224+0000 7f61fba0d640 1 -- 172.21.15.62:0/3824298454 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f61ec074020 con 0x558b6a537b00 2024-09-10T05:38:24.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.224+0000 7f61fdf079c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:38:24.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.224+0000 7f61fdf079c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:24.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.224+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b6a53f1e0 con 0x558b6a53b320 2024-09-10T05:38:24.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.228+0000 7f61fb20c640 1 -- 172.21.15.62:0/3824298454 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f61f00b3040 con 0x558b6a53b320 2024-09-10T05:38:24.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.228+0000 7f61fdf079c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:38:24.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.228+0000 7f61fdf079c0 20 zone default found 2024-09-10T05:38:24.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.228+0000 7f61fdf079c0 4 Realm: () 2024-09-10T05:38:24.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.228+0000 7f61fdf079c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:38:24.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.228+0000 7f61fdf079c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:38:24.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.228+0000 7f61fdf079c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:38:24.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.228+0000 7f61fdf079c0 20 zonegroup default 2024-09-10T05:38:24.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.228+0000 7f61fdf079c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:24.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.228+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b6a540070 con 0x7f61ec064050 2024-09-10T05:38:24.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.228+0000 7f61fc20e640 1 -- 172.21.15.62:0/3824298454 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f61f400a4d0 con 0x7f61ec064050 2024-09-10T05:38:24.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.228+0000 7f61fdf079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:24.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.228+0000 7f61fdf079c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:24.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.228+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b6a5422b0 con 0x558b6a53b320 2024-09-10T05:38:24.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.228+0000 7f61fb20c640 1 -- 172.21.15.62:0/3824298454 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f61f00b3040 con 0x558b6a53b320 2024-09-10T05:38:24.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.228+0000 7f61fdf079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:24.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.228+0000 7f61fdf079c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:24.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.228+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b6a542650 con 0x558b6a53b320 2024-09-10T05:38:24.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.228+0000 7f61fb20c640 1 -- 172.21.15.62:0/3824298454 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f61f00b3040 con 0x558b6a53b320 2024-09-10T05:38:24.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.228+0000 7f61fdf079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:24.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.228+0000 7f61fdf079c0 20 started sync module instance, tier type = 2024-09-10T05:38:24.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.228+0000 7f61fdf079c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:38:24.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.228+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b6a5416f0 con 0x558b6a537b00 2024-09-10T05:38:24.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.228+0000 7f61fba0d640 1 -- 172.21.15.62:0/3824298454 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61ec074020 con 0x558b6a537b00 2024-09-10T05:38:24.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.228+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94057272709696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b6a542650 con 0x558b6a537b00 2024-09-10T05:38:24.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.228+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b6a543010 con 0x558b6a533680 2024-09-10T05:38:24.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.232+0000 7f61fc20e640 1 -- 172.21.15.62:0/3824298454 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61f400a4d0 con 0x558b6a533680 2024-09-10T05:38:24.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.232+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94057272716128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b6a543860 con 0x558b6a533680 2024-09-10T05:38:24.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.232+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b6a544280 con 0x558b6a537b00 2024-09-10T05:38:24.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.232+0000 7f61fba0d640 1 -- 172.21.15.62:0/3824298454 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94057272709696] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61ec074020 con 0x558b6a537b00 2024-09-10T05:38:24.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.232+0000 7f61fc20e640 1 -- 172.21.15.62:0/3824298454 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94057272716128] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61f400a4d0 con 0x558b6a533680 2024-09-10T05:38:24.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.232+0000 7f61fba0d640 1 -- 172.21.15.62:0/3824298454 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61ec074020 con 0x558b6a537b00 2024-09-10T05:38:24.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.232+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94057272720752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b6a5433b0 con 0x558b6a537b00 2024-09-10T05:38:24.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.232+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b6a544b20 con 0x7f61ec064050 2024-09-10T05:38:24.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.232+0000 7f61fc20e640 1 -- 172.21.15.62:0/3824298454 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61f400a4d0 con 0x7f61ec064050 2024-09-10T05:38:24.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.232+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94057272723056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b6a5433b0 con 0x7f61ec064050 2024-09-10T05:38:24.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.232+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b6a5455a0 con 0x558b6a537b00 2024-09-10T05:38:24.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.236+0000 7f61fba0d640 1 -- 172.21.15.62:0/3824298454 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94057272720752] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61ec074020 con 0x558b6a537b00 2024-09-10T05:38:24.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.236+0000 7f61fc20e640 1 -- 172.21.15.62:0/3824298454 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94057272723056] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61f400a4d0 con 0x7f61ec064050 2024-09-10T05:38:24.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.236+0000 7f61fba0d640 1 -- 172.21.15.62:0/3824298454 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61ec074020 con 0x558b6a537b00 2024-09-10T05:38:24.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.236+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94057272724112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b6a5450b0 con 0x558b6a537b00 2024-09-10T05:38:24.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.236+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b6a545e70 con 0x558b6a53b320 2024-09-10T05:38:24.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.236+0000 7f61fb20c640 1 -- 172.21.15.62:0/3824298454 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61f00b3040 con 0x558b6a53b320 2024-09-10T05:38:24.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.236+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94057272728000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b6a5450b0 con 0x558b6a53b320 2024-09-10T05:38:24.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.236+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b6a5468b0 con 0x558b6a53b320 2024-09-10T05:38:24.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.240+0000 7f61fba0d640 1 -- 172.21.15.62:0/3824298454 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94057272724112] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61ec074020 con 0x558b6a537b00 2024-09-10T05:38:24.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.240+0000 7f61fb20c640 1 -- 172.21.15.62:0/3824298454 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94057272728000] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61f00b3040 con 0x558b6a53b320 2024-09-10T05:38:24.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.240+0000 7f61fb20c640 1 -- 172.21.15.62:0/3824298454 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61f00b3040 con 0x558b6a53b320 2024-09-10T05:38:24.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.240+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94057272729056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b6a546400 con 0x558b6a53b320 2024-09-10T05:38:24.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.240+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b6a547150 con 0x7f61ec064050 2024-09-10T05:38:24.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.240+0000 7f61fc20e640 1 -- 172.21.15.62:0/3824298454 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61f400a4d0 con 0x7f61ec064050 2024-09-10T05:38:24.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.240+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94057272732832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b6a547570 con 0x7f61ec064050 2024-09-10T05:38:24.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.240+0000 7f61fdf079c0 20 add_watcher() i=0 2024-09-10T05:38:24.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.240+0000 7f61fdf079c0 20 add_watcher() i=1 2024-09-10T05:38:24.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.240+0000 7f61fdf079c0 20 add_watcher() i=2 2024-09-10T05:38:24.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.240+0000 7f61fdf079c0 20 add_watcher() i=3 2024-09-10T05:38:24.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.240+0000 7f61fdf079c0 20 add_watcher() i=4 2024-09-10T05:38:24.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.240+0000 7f61fdf079c0 20 add_watcher() i=5 2024-09-10T05:38:24.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.240+0000 7f61fb20c640 1 -- 172.21.15.62:0/3824298454 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94057272729056] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61f00b3040 con 0x558b6a53b320 2024-09-10T05:38:24.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.240+0000 7f61fdf079c0 20 add_watcher() i=6 2024-09-10T05:38:24.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.240+0000 7f61fc20e640 1 -- 172.21.15.62:0/3824298454 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94057272732832] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61f400a4d0 con 0x7f61ec064050 2024-09-10T05:38:24.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.240+0000 7f61fdf079c0 20 add_watcher() i=7 2024-09-10T05:38:24.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.240+0000 7f61fdf079c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:38:24.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.240+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b6a54a1c0 con 0x558b6a533680 2024-09-10T05:38:24.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.240+0000 7f61fc20e640 1 -- 172.21.15.62:0/3824298454 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f61f400a4d0 con 0x558b6a533680 2024-09-10T05:38:24.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.240+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94057272711968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b6a547570 con 0x558b6a533680 2024-09-10T05:38:24.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.244+0000 7f61fc20e640 1 -- 172.21.15.62:0/3824298454 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94057272711968] v34'264 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f61f400a4d0 con 0x558b6a533680 2024-09-10T05:38:24.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.244+0000 7f60b27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:38:24.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.244+0000 7f61fdf079c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:38:24.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.244+0000 7f61fdf079c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:38:24.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.244+0000 7f61fdf079c0 5 note: GC not initialized 2024-09-10T05:38:24.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.244+0000 7f60b17e2640 20 reqs_thread_entry: start 2024-09-10T05:38:24.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.244+0000 7f61fdf079c0 20 init_complete bucket index max shards: 11 2024-09-10T05:38:24.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.244+0000 7f61fdf079c0 20 Filter name: none 2024-09-10T05:38:24.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.244+0000 7f60aa7fc640 20 reqs_thread_entry: start 2024-09-10T05:38:24.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.244+0000 7f61fdf079c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-10T05:38:24.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.244+0000 7f61fdf079c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:24.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.244+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b6a56d4b0 con 0x558b6a533680 2024-09-10T05:38:24.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.244+0000 7f61fc20e640 1 -- 172.21.15.62:0/3824298454 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f61f400a4d0 con 0x558b6a533680 2024-09-10T05:38:24.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.244+0000 7f61fdf079c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-10T05:38:24.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.244+0000 7f61fdf079c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-10T05:38:24.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.244+0000 7f61fdf079c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:38:24.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.244+0000 7f61fdf079c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:38:24.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.244+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b6a5739d0 con 0x558b6a533680 2024-09-10T05:38:24.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.248+0000 7f61fc20e640 1 -- 172.21.15.62:0/3824298454 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v34'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f61f4039040 con 0x558b6a533680 2024-09-10T05:38:24.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.248+0000 7f61fdf079c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T05:38:24.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.248+0000 7f61fdf079c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:38:24.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.248+0000 7f61fdf079c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-10T05:38:24.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.248+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94057272915072 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b6a56f140 con 0x558b6a537b00 2024-09-10T05:38:24.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.248+0000 7f61fba0d640 1 -- 172.21.15.62:0/3824298454 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== watch-notify(notify (1) cookie 94057272724112 notify 146028888115 ret 0) ==== 708+0+0 (crc 0 0 0) 0x558b6a515ea0 con 0x558b6a537b00 2024-09-10T05:38:24.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.248+0000 7f60daffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888115 cookie 94057272724112 notifier 4871 bl.length()=666 2024-09-10T05:38:24.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.248+0000 7f60daffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T05:38:24.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.248+0000 7f60daffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:38:24.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.248+0000 7f60daffd640 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f60c0003eb0 con 0x558b6a537b00 2024-09-10T05:38:24.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.248+0000 7f61fba0d640 1 -- 172.21.15.62:0/3824298454 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(64 notify.4 [notify cookie 94057272915072 out=8b] v0'0 uv258 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f61ec074020 con 0x558b6a537b00 2024-09-10T05:38:24.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.248+0000 7f61fba0d640 1 -- 172.21.15.62:0/3824298454 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61ec074020 con 0x558b6a537b00 2024-09-10T05:38:24.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.248+0000 7f61fba0d640 1 -- 172.21.15.62:0/3824298454 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== watch-notify(notify_complete (2) cookie 94057272915072 notify 146028888115 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558b6a515640 con 0x558b6a537b00 2024-09-10T05:38:24.253 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-10T05:38:22.896781Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"read"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:38:22.896764Z","tags":[],"group_ids":[]} 2024-09-10T05:38:24.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.252+0000 7f60b27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:38:24.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.252+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94057272711968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b6a56b290 con 0x558b6a533680 2024-09-10T05:38:24.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.252+0000 7f61fc20e640 1 -- 172.21.15.62:0/3824298454 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94057272711968] v34'265 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f61f4039040 con 0x558b6a533680 2024-09-10T05:38:24.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.252+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94057272709696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b6a56b290 con 0x558b6a537b00 2024-09-10T05:38:24.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.256+0000 7f61fba0d640 1 -- 172.21.15.62:0/3824298454 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94057272709696] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61ec074020 con 0x558b6a537b00 2024-09-10T05:38:24.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.256+0000 7f61fdf079c0 20 remove_watcher() i=0 2024-09-10T05:38:24.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.256+0000 7f61fdf079c0 2 removed watcher, disabling cache 2024-09-10T05:38:24.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.256+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94057272716128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b6a56b290 con 0x558b6a533680 2024-09-10T05:38:24.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.256+0000 7f61fc20e640 1 -- 172.21.15.62:0/3824298454 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94057272716128] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61f4039040 con 0x558b6a533680 2024-09-10T05:38:24.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.256+0000 7f61fdf079c0 20 remove_watcher() i=1 2024-09-10T05:38:24.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.256+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94057272720752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b6a56b290 con 0x558b6a537b00 2024-09-10T05:38:24.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.260+0000 7f61fba0d640 1 -- 172.21.15.62:0/3824298454 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94057272720752] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61ec074020 con 0x558b6a537b00 2024-09-10T05:38:24.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.260+0000 7f61fdf079c0 20 remove_watcher() i=2 2024-09-10T05:38:24.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.260+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94057272723056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b6a56b290 con 0x7f61ec064050 2024-09-10T05:38:24.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.260+0000 7f61fc20e640 1 -- 172.21.15.62:0/3824298454 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94057272723056] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61f4039040 con 0x7f61ec064050 2024-09-10T05:38:24.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.260+0000 7f61fdf079c0 20 remove_watcher() i=3 2024-09-10T05:38:24.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.260+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94057272724112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b6a56b290 con 0x558b6a537b00 2024-09-10T05:38:24.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.264+0000 7f61fba0d640 1 -- 172.21.15.62:0/3824298454 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94057272724112] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61ec074020 con 0x558b6a537b00 2024-09-10T05:38:24.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.264+0000 7f61fdf079c0 20 remove_watcher() i=4 2024-09-10T05:38:24.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.264+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94057272728000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b6a56b290 con 0x558b6a53b320 2024-09-10T05:38:24.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.264+0000 7f61fb20c640 1 -- 172.21.15.62:0/3824298454 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94057272728000] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61f00b3040 con 0x558b6a53b320 2024-09-10T05:38:24.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.264+0000 7f61fdf079c0 20 remove_watcher() i=5 2024-09-10T05:38:24.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.264+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94057272729056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b6a56b290 con 0x558b6a53b320 2024-09-10T05:38:24.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.264+0000 7f61fb20c640 1 -- 172.21.15.62:0/3824298454 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94057272729056] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61f00b3040 con 0x558b6a53b320 2024-09-10T05:38:24.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.264+0000 7f61fdf079c0 20 remove_watcher() i=6 2024-09-10T05:38:24.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.264+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94057272732832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b6a56b290 con 0x7f61ec064050 2024-09-10T05:38:24.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.268+0000 7f61fc20e640 1 -- 172.21.15.62:0/3824298454 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94057272732832] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61f4039040 con 0x7f61ec064050 2024-09-10T05:38:24.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.268+0000 7f61fdf079c0 20 remove_watcher() i=7 2024-09-10T05:38:24.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.268+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x558b6a537b00 msgr2=0x558b6a539ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.268+0000 7f61fdf079c0 1 --2- 172.21.15.62:0/3824298454 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x558b6a537b00 0x558b6a539ef0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.268+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x558b6a533680 msgr2=0x558b6a535b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.268+0000 7f61fdf079c0 1 --2- 172.21.15.62:0/3824298454 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x558b6a533680 0x558b6a535b10 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.268+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f61ec064050 msgr2=0x7f61ec012400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.268+0000 7f61fdf079c0 1 --2- 172.21.15.62:0/3824298454 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f61ec064050 0x7f61ec012400 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.268+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x558b6a53b320 msgr2=0x558b6a53d730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.268+0000 7f61fdf079c0 1 --2- 172.21.15.62:0/3824298454 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x558b6a53b320 0x558b6a53d730 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.268+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f60c4039a70 msgr2=0x7f60c403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.268+0000 7f61fdf079c0 1 --2- 172.21.15.62:0/3824298454 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f60c4039a70 0x7f60c403bf30 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f61f00ae040 tx=0x7f61f00a6000 comp rx=0 tx=0).stop 2024-09-10T05:38:24.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.268+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6a521360 msgr2=0x558b6a528700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.268+0000 7f61fdf079c0 1 --2- 172.21.15.62:0/3824298454 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6a521360 0x558b6a528700 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f61ec04da60 tx=0x7f61ec005f10 comp rx=0 tx=0).stop 2024-09-10T05:38:24.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.268+0000 7f61fc20e640 1 -- 172.21.15.62:0/3824298454 reap_dead start 2024-09-10T05:38:24.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.268+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 shutdown_connections 2024-09-10T05:38:24.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.268+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 >> 172.21.15.62:0/3824298454 conn(0x558b6a51d790 msgr2=0x558b6a51b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:24.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.268+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 shutdown_connections 2024-09-10T05:38:24.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.268+0000 7f61fdf079c0 1 -- 172.21.15.62:0/3824298454 wait complete. 2024-09-10T05:38:24.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.268+0000 7f61fdf079c0 1 -- 172.21.15.62:0/2904516177 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f60d4039a70 msgr2=0x7f60d403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.268+0000 7f61fdf079c0 1 --2- 172.21.15.62:0/2904516177 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f60d4039a70 0x7f60d403bf30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x558b6a502920 tx=0x7f61f0005a10 comp rx=0 tx=0).stop 2024-09-10T05:38:24.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.268+0000 7f61fdf079c0 1 -- 172.21.15.62:0/2904516177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6a514be0 msgr2=0x558b6a515000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.268+0000 7f61fdf079c0 1 --2- 172.21.15.62:0/2904516177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6a514be0 0x558b6a515000 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f61ec043010 tx=0x7f61ec016ab0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.268+0000 7f61fdf079c0 1 -- 172.21.15.62:0/2904516177 shutdown_connections 2024-09-10T05:38:24.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.268+0000 7f61fdf079c0 1 --2- 172.21.15.62:0/2904516177 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f60d4039a70 0x7f60d403bf30 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.268+0000 7f61fdf079c0 1 --2- 172.21.15.62:0/2904516177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6a514be0 0x558b6a515000 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.268+0000 7f61fdf079c0 1 -- 172.21.15.62:0/2904516177 >> 172.21.15.62:0/2904516177 conn(0x558b6a50a590 msgr2=0x558b6a50a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:24.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.268+0000 7f61fdf079c0 1 -- 172.21.15.62:0/2904516177 shutdown_connections 2024-09-10T05:38:24.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.268+0000 7f61fdf079c0 1 -- 172.21.15.62:0/2904516177 wait complete. 2024-09-10T05:38:24.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.268+0000 7f61fdf079c0 1 -- 172.21.15.62:0/948738128 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x558b6a4ff0e0 msgr2=0x558b6a501580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.268+0000 7f61fdf079c0 1 --2- 172.21.15.62:0/948738128 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x558b6a4ff0e0 0x558b6a501580 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.268+0000 7f61fdf079c0 1 -- 172.21.15.62:0/948738128 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x558b6a3765d0 msgr2=0x558b6a4fe130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.268+0000 7f61fdf079c0 1 --2- 172.21.15.62:0/948738128 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x558b6a3765d0 0x558b6a4fe130 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.268+0000 7f61fdf079c0 1 -- 172.21.15.62:0/948738128 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x558b6a503ab0 msgr2=0x558b6a505ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.268+0000 7f61fdf079c0 1 --2- 172.21.15.62:0/948738128 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x558b6a503ab0 0x558b6a505ea0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.268+0000 7f61fdf079c0 1 -- 172.21.15.62:0/948738128 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f60e4039a70 msgr2=0x7f60e403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.268+0000 7f61fdf079c0 1 --2- 172.21.15.62:0/948738128 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f60e4039a70 0x7f60e403bf30 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f61f00ad000 tx=0x7f61f00a5040 comp rx=0 tx=0).stop 2024-09-10T05:38:24.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.268+0000 7f61fdf079c0 1 -- 172.21.15.62:0/948738128 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6a3761f0 msgr2=0x558b6a4f6fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.268+0000 7f61fdf079c0 1 --2- 172.21.15.62:0/948738128 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b6a3761f0 0x558b6a4f6fc0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x558b6a4f08e0 tx=0x7f61ec000bd0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.268+0000 7f61fc20e640 1 -- 172.21.15.62:0/948738128 reap_dead start 2024-09-10T05:38:24.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.268+0000 7f61fdf079c0 1 -- 172.21.15.62:0/948738128 shutdown_connections 2024-09-10T05:38:24.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.268+0000 7f61fdf079c0 1 -- 172.21.15.62:0/948738128 >> 172.21.15.62:0/948738128 conn(0x558b6a3fc910 msgr2=0x558b6a4ea020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:24.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.268+0000 7f61fdf079c0 1 -- 172.21.15.62:0/948738128 shutdown_connections 2024-09-10T05:38:24.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.268+0000 7f61fdf079c0 1 -- 172.21.15.62:0/948738128 wait complete. 2024-09-10T05:38:24.283 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T05:38:22.896781Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:38:22.896764Z', 'tags': [], 'group_ids': []} 2024-09-10T05:38:24.283 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T05:38:22.896781Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:38:22.896764Z', 'tags': [], 'group_ids': []} 2024-09-10T05:38:24.283 ERROR:root:0 2024-09-10T05:38:24.283 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T05:38:24.287 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T05:38:24.288 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-10T05:38:24.288 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-10T05:38:24.288 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'user-info-without-keys=*' 2024-09-10T05:38:24.358 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:38:24.358 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:38:24.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.356+0000 7fc8aee0c9c0 1 Processor -- start 2024-09-10T05:38:24.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.356+0000 7fc8aee0c9c0 1 -- start start 2024-09-10T05:38:24.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.356+0000 7fc8aee0c9c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x56456885af70 0x56456885b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.356+0000 7fc8aee0c9c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56456870f9c0 con 0x56456885e0b0 2024-09-10T05:38:24.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.356+0000 7fc8aee0c9c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x56456875f6d0 con 0x56456885af70 2024-09-10T05:38:24.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.356+0000 7fc8ac912640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x56456885af70 0x56456885b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.356+0000 7fc8ac111640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x56456885e0b0 0x5645688604a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:52164/0 (socket says 172.21.15.62:52164) 2024-09-10T05:38:24.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.356+0000 7fc8ac111640 1 -- 172.21.15.62:0/153443733 learned_addr learned my addr 172.21.15.62:0/153443733 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-10T05:38:24.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.356+0000 7fc8ac912640 1 -- 172.21.15.62:0/153443733 >> v1:172.21.15.2:6789/0 conn(0x56456885e0b0 legacy=0x5645688604a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.356+0000 7fc8ac912640 1 -- 172.21.15.62:0/153443733 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564568703ca0 con 0x56456885af70 2024-09-10T05:38:24.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.360+0000 7fc8ac912640 1 --2- 172.21.15.62:0/153443733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456885af70 0x56456885b350 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fc89c00a480 tx=0x7fc89c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f91683c085f7906 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.360+0000 7fc8ab910640 1 -- 172.21.15.62:0/153443733 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc89c0b0070 con 0x56456885af70 2024-09-10T05:38:24.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.360+0000 7fc8ab910640 1 -- 172.21.15.62:0/153443733 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc89c0ab540 con 0x56456885af70 2024-09-10T05:38:24.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.360+0000 7fc8ab910640 1 -- 172.21.15.62:0/153443733 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc89c0ab840 con 0x56456885af70 2024-09-10T05:38:24.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.360+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/153443733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456885af70 msgr2=0x56456885b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.360+0000 7fc8aee0c9c0 1 --2- 172.21.15.62:0/153443733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456885af70 0x56456885b350 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fc89c00a480 tx=0x7fc89c01b280 comp rx=0 tx=0).stop 2024-09-10T05:38:24.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.360+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/153443733 shutdown_connections 2024-09-10T05:38:24.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.360+0000 7fc8aee0c9c0 1 --2- 172.21.15.62:0/153443733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456885af70 0x56456885b350 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.360+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/153443733 >> 172.21.15.62:0/153443733 conn(0x564568856a90 msgr2=0x564568858eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:24.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.360+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/153443733 shutdown_connections 2024-09-10T05:38:24.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.360+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/153443733 wait complete. 2024-09-10T05:38:24.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.376+0000 7fc8aee0c9c0 1 Processor -- start 2024-09-10T05:38:24.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.376+0000 7fc8aee0c9c0 1 -- start start 2024-09-10T05:38:24.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.376+0000 7fc8aee0c9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456885af70 0x564568946740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.376+0000 7fc8aee0c9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564568763680 con 0x56456885af70 2024-09-10T05:38:24.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.376+0000 7fc8ac912640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456885af70 0x564568946740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.376+0000 7fc8ac912640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456885af70 0x564568946740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:39002/0 (socket says 172.21.15.62:39002) 2024-09-10T05:38:24.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.376+0000 7fc8ac912640 1 -- 172.21.15.62:0/3867753372 learned_addr learned my addr 172.21.15.62:0/3867753372 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:24.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.380+0000 7fc8ac912640 1 -- 172.21.15.62:0/3867753372 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645686deda0 con 0x56456885af70 2024-09-10T05:38:24.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.380+0000 7fc8ac912640 1 --2- 172.21.15.62:0/3867753372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456885af70 0x564568946740 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fc89c018eb0 tx=0x7fc89c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0b4e134038a6da9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.380+0000 7fc79ae0d640 1 -- 172.21.15.62:0/3867753372 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc89c0b0070 con 0x56456885af70 2024-09-10T05:38:24.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.380+0000 7fc79ae0d640 1 -- 172.21.15.62:0/3867753372 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc89c0b1040 con 0x56456885af70 2024-09-10T05:38:24.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.380+0000 7fc79ae0d640 1 -- 172.21.15.62:0/3867753372 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc89c0ab6f0 con 0x56456885af70 2024-09-10T05:38:24.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.380+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/3867753372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456885af70 msgr2=0x564568946740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.380+0000 7fc8aee0c9c0 1 --2- 172.21.15.62:0/3867753372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456885af70 0x564568946740 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fc89c018eb0 tx=0x7fc89c003030 comp rx=0 tx=0).stop 2024-09-10T05:38:24.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.380+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/3867753372 shutdown_connections 2024-09-10T05:38:24.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.380+0000 7fc8aee0c9c0 1 --2- 172.21.15.62:0/3867753372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456885af70 0x564568946740 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.380+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/3867753372 >> 172.21.15.62:0/3867753372 conn(0x564568856a90 msgr2=0x564568942380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:24.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.380+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/3867753372 shutdown_connections 2024-09-10T05:38:24.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.380+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/3867753372 wait complete. 2024-09-10T05:38:24.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.380+0000 7fc8aee0c9c0 1 Processor -- start 2024-09-10T05:38:24.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.380+0000 7fc8aee0c9c0 1 -- start start 2024-09-10T05:38:24.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.380+0000 7fc8aee0c9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456885af70 0x5645687d13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.380+0000 7fc8aee0c9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564568705a50 con 0x56456885af70 2024-09-10T05:38:24.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.380+0000 7fc8ac912640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456885af70 0x5645687d13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.380+0000 7fc8ac912640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456885af70 0x5645687d13e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:39008/0 (socket says 172.21.15.62:39008) 2024-09-10T05:38:24.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.380+0000 7fc8ac912640 1 -- 172.21.15.62:0/1045623479 learned_addr learned my addr 172.21.15.62:0/1045623479 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:24.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.380+0000 7fc8ac912640 1 -- 172.21.15.62:0/1045623479 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645687d1940 con 0x56456885af70 2024-09-10T05:38:24.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.384+0000 7fc8ac912640 1 --2- 172.21.15.62:0/1045623479 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456885af70 0x5645687d13e0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fc89c0ab510 tx=0x7fc89c018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.384+0000 7fc79960a640 1 -- 172.21.15.62:0/1045623479 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc89c0c4070 con 0x56456885af70 2024-09-10T05:38:24.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.384+0000 7fc79960a640 1 -- 172.21.15.62:0/1045623479 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc89c0b75b0 con 0x56456885af70 2024-09-10T05:38:24.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.384+0000 7fc79960a640 1 -- 172.21.15.62:0/1045623479 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc89c0b7890 con 0x56456885af70 2024-09-10T05:38:24.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.384+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1045623479 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5645687cfd20 con 0x56456885af70 2024-09-10T05:38:24.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.384+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1045623479 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645687d02b0 con 0x56456885af70 2024-09-10T05:38:24.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.384+0000 7fc79960a640 1 -- 172.21.15.62:0/1045623479 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc89c0c7070 con 0x56456885af70 2024-09-10T05:38:24.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.384+0000 7fc79960a640 1 --2- 172.21.15.62:0/1045623479 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc794039ac0 0x7fc79403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.384+0000 7fc79960a640 1 -- 172.21.15.62:0/1045623479 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7fc89c0bc070 con 0x56456885af70 2024-09-10T05:38:24.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.384+0000 7fc8ac111640 1 --2- 172.21.15.62:0/1045623479 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc794039ac0 0x7fc79403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.384+0000 7fc8aee0c9c0 1 --2- 172.21.15.62:0/1045623479 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56456885e0b0 0x564568957140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.384+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1045623479 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564568957680 con 0x56456885e0b0 2024-09-10T05:38:24.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.384+0000 7fc8ad113640 1 --2- 172.21.15.62:0/1045623479 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56456885e0b0 0x564568957140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.384+0000 7fc8ac111640 1 --2- 172.21.15.62:0/1045623479 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc794039ac0 0x7fc79403bf80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc894001d80 tx=0x7fc8940012e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.384+0000 7fc8ad113640 1 --2- 172.21.15.62:0/1045623479 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56456885e0b0 0x564568957140 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.384+0000 7fc8ad113640 1 -- 172.21.15.62:0/1045623479 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8a400a4d0 con 0x56456885e0b0 2024-09-10T05:38:24.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.384+0000 7fc8aee0c9c0 1 --2- 172.21.15.62:0/1045623479 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x564568958130 0x56456895a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.384+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1045623479 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56456895ad40 con 0x564568958130 2024-09-10T05:38:24.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.388+0000 7fc8ac912640 1 --2- 172.21.15.62:0/1045623479 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x564568958130 0x56456895a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.388+0000 7fc8ac912640 1 --2- 172.21.15.62:0/1045623479 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x564568958130 0x56456895a5d0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.388+0000 7fc8ac912640 1 -- 172.21.15.62:0/1045623479 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc89c0d0070 con 0x564568958130 2024-09-10T05:38:24.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.388+0000 7fc8aee0c9c0 1 --2- 172.21.15.62:0/1045623479 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56456895cb00 0x56456895eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.388+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1045623479 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56456895f5c0 con 0x56456895cb00 2024-09-10T05:38:24.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.388+0000 7fc8ac111640 1 --2- 172.21.15.62:0/1045623479 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56456895cb00 0x56456895eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.388+0000 7fc8ac111640 1 --2- 172.21.15.62:0/1045623479 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56456895cb00 0x56456895eef0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.388+0000 7fc8ac111640 1 -- 172.21.15.62:0/1045623479 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv5 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc89400e620 con 0x56456895cb00 2024-09-10T05:38:24.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.388+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1045623479 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56456895b9a0 con 0x564568958130 2024-09-10T05:38:24.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.388+0000 7fc8ac912640 1 -- 172.21.15.62:0/1045623479 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc89c0d0070 con 0x564568958130 2024-09-10T05:38:24.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.388+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1045623479 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56456895bdc0 con 0x56456895cb00 2024-09-10T05:38:24.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.388+0000 7fc8ac111640 1 -- 172.21.15.62:0/1045623479 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc89400e620 con 0x56456895cb00 2024-09-10T05:38:24.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.388+0000 7fc8aee0c9c0 1 Processor -- start 2024-09-10T05:38:24.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.388+0000 7fc8aee0c9c0 1 -- start start 2024-09-10T05:38:24.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.392+0000 7fc8aee0c9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456896dc90 0x56456896e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.392+0000 7fc8aee0c9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564568770450 con 0x56456896dc90 2024-09-10T05:38:24.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.392+0000 7fc8ac912640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456896dc90 0x56456896e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.392+0000 7fc8ac912640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456896dc90 0x56456896e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:39022/0 (socket says 172.21.15.62:39022) 2024-09-10T05:38:24.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.392+0000 7fc8ac912640 1 -- 172.21.15.62:0/2075456942 learned_addr learned my addr 172.21.15.62:0/2075456942 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:24.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.392+0000 7fc8ac912640 1 -- 172.21.15.62:0/2075456942 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56456896e6f0 con 0x56456896dc90 2024-09-10T05:38:24.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.392+0000 7fc8ac912640 1 --2- 172.21.15.62:0/2075456942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456896dc90 0x56456896e0b0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fc89c0b67d0 tx=0x7fc89c001c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.392+0000 7fc7927fc640 1 -- 172.21.15.62:0/2075456942 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc89c0e2250 con 0x56456896dc90 2024-09-10T05:38:24.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.392+0000 7fc7927fc640 1 -- 172.21.15.62:0/2075456942 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc89c0d8070 con 0x56456896dc90 2024-09-10T05:38:24.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.392+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/2075456942 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56456896ef50 con 0x56456896dc90 2024-09-10T05:38:24.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.392+0000 7fc7927fc640 1 -- 172.21.15.62:0/2075456942 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc89c0e2520 con 0x56456896dc90 2024-09-10T05:38:24.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.392+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/2075456942 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56456896f4c0 con 0x56456896dc90 2024-09-10T05:38:24.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.392+0000 7fc7927fc640 1 -- 172.21.15.62:0/2075456942 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc89c0b5380 con 0x56456896dc90 2024-09-10T05:38:24.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.392+0000 7fc7927fc640 1 --2- 172.21.15.62:0/2075456942 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc784039a70 0x7fc78403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.392+0000 7fc7927fc640 1 -- 172.21.15.62:0/2075456942 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7fc89c0a8070 con 0x56456896dc90 2024-09-10T05:38:24.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.392+0000 7fc8ac111640 1 --2- 172.21.15.62:0/2075456942 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc784039a70 0x7fc78403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.392+0000 7fc8aee0c9c0 1 Processor -- start 2024-09-10T05:38:24.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.396+0000 7fc8aee0c9c0 1 -- start start 2024-09-10T05:38:24.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.396+0000 7fc8aee0c9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456897a3b0 0x56456897a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.396+0000 7fc8ac111640 1 --2- 172.21.15.62:0/2075456942 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc784039a70 0x7fc78403bf30 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc89400bf50 tx=0x7fc89400f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.396+0000 7fc8aee0c9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564568946ed0 con 0x56456897a3b0 2024-09-10T05:38:24.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.396+0000 7fc8ac912640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456897a3b0 0x56456897a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.396+0000 7fc8ac912640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456897a3b0 0x56456897a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:39026/0 (socket says 172.21.15.62:39026) 2024-09-10T05:38:24.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.396+0000 7fc8ac912640 1 -- 172.21.15.62:0/2303371936 learned_addr learned my addr 172.21.15.62:0/2303371936 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:24.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.396+0000 7fc8ac912640 1 -- 172.21.15.62:0/2303371936 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56456897ad60 con 0x56456897a3b0 2024-09-10T05:38:24.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.396+0000 7fc8ac912640 1 --2- 172.21.15.62:0/2303371936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456897a3b0 0x56456897a790 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fc89c0e8130 tx=0x7fc89c0b6cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20699f5d6b154c6d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.396+0000 7fc783fff640 1 -- 172.21.15.62:0/2303371936 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc89c0e9dd0 con 0x56456897a3b0 2024-09-10T05:38:24.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.396+0000 7fc783fff640 1 -- 172.21.15.62:0/2303371936 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc89c102070 con 0x56456897a3b0 2024-09-10T05:38:24.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.396+0000 7fc783fff640 1 -- 172.21.15.62:0/2303371936 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc89c0b6970 con 0x56456897a3b0 2024-09-10T05:38:24.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.396+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/2303371936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456897a3b0 msgr2=0x56456897a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.396+0000 7fc8aee0c9c0 1 --2- 172.21.15.62:0/2303371936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456897a3b0 0x56456897a790 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fc89c0e8130 tx=0x7fc89c0b6cd0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.396+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/2303371936 shutdown_connections 2024-09-10T05:38:24.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.396+0000 7fc8aee0c9c0 1 --2- 172.21.15.62:0/2303371936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456897a3b0 0x56456897a790 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.396+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/2303371936 >> 172.21.15.62:0/2303371936 conn(0x5645689767e0 msgr2=0x564568974a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:24.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.396+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/2303371936 shutdown_connections 2024-09-10T05:38:24.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.396+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/2303371936 wait complete. 2024-09-10T05:38:24.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.396+0000 7fc8aee0c9c0 1 Processor -- start 2024-09-10T05:38:24.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.396+0000 7fc8aee0c9c0 1 -- start start 2024-09-10T05:38:24.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.396+0000 7fc8aee0c9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456897a3b0 0x5645689816a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.396+0000 7fc8aee0c9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56456897b240 con 0x56456897a3b0 2024-09-10T05:38:24.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.396+0000 7fc8ac912640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456897a3b0 0x5645689816a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.396+0000 7fc8ac912640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456897a3b0 0x5645689816a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:39034/0 (socket says 172.21.15.62:39034) 2024-09-10T05:38:24.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.396+0000 7fc8ac912640 1 -- 172.21.15.62:0/1603294756 learned_addr learned my addr 172.21.15.62:0/1603294756 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:24.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.396+0000 7fc8ac912640 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564568981c00 con 0x56456897a3b0 2024-09-10T05:38:24.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.400+0000 7fc8ac912640 1 --2- 172.21.15.62:0/1603294756 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456897a3b0 0x5645689816a0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fc89c0d37f0 tx=0x7fc89c0beee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.400+0000 7fc7827fc640 1 -- 172.21.15.62:0/1603294756 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc89c0e9dd0 con 0x56456897a3b0 2024-09-10T05:38:24.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.400+0000 7fc7827fc640 1 -- 172.21.15.62:0/1603294756 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc89c102040 con 0x56456897a3b0 2024-09-10T05:38:24.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.400+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564568981c00 con 0x56456897a3b0 2024-09-10T05:38:24.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.400+0000 7fc7827fc640 1 -- 172.21.15.62:0/1603294756 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc89c0aab60 con 0x56456897a3b0 2024-09-10T05:38:24.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.400+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564568981c00 con 0x56456897a3b0 2024-09-10T05:38:24.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.400+0000 7fc7827fc640 1 -- 172.21.15.62:0/1603294756 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc89c0fc070 con 0x56456897a3b0 2024-09-10T05:38:24.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.400+0000 7fc7827fc640 1 --2- 172.21.15.62:0/1603294756 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc778039a70 0x7fc77803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.400+0000 7fc8aee0c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:24.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.400+0000 7fc7827fc640 1 -- 172.21.15.62:0/1603294756 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7fc89c112c20 con 0x56456897a3b0 2024-09-10T05:38:24.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.400+0000 7fc8ac111640 1 --2- 172.21.15.62:0/1603294756 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc778039a70 0x7fc77803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.400+0000 7fc8aee0c9c0 1 --2- 172.21.15.62:0/1603294756 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56456898c670 0x56456898eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.400+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56456898f250 con 0x56456898c670 2024-09-10T05:38:24.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.400+0000 7fc8ad113640 1 --2- 172.21.15.62:0/1603294756 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56456898c670 0x56456898eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.400+0000 7fc8ac111640 1 --2- 172.21.15.62:0/1603294756 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc778039a70 0x7fc77803bf30 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x56456895bd40 tx=0x7fc894010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.400+0000 7fc8ad113640 1 --2- 172.21.15.62:0/1603294756 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56456898c670 0x56456898eb00 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.400+0000 7fc8ad113640 1 -- 172.21.15.62:0/1603294756 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8a400a4d0 con 0x56456898c670 2024-09-10T05:38:24.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.400+0000 7fc8aee0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:24.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.400+0000 7fc8aee0c9c0 20 realm 2024-09-10T05:38:24.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.400+0000 7fc8aee0c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:24.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.400+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56456898ba60 con 0x56456898c670 2024-09-10T05:38:24.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.400+0000 7fc8ad113640 1 -- 172.21.15.62:0/1603294756 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8a400a4d0 con 0x56456898c670 2024-09-10T05:38:24.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.400+0000 7fc8aee0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:24.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.400+0000 7fc8aee0c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:38:24.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.400+0000 7fc8aee0c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:24.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.400+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56456898fd20 con 0x56456898c670 2024-09-10T05:38:24.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.404+0000 7fc8ad113640 1 -- 172.21.15.62:0/1603294756 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8a400a4d0 con 0x56456898c670 2024-09-10T05:38:24.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.404+0000 7fc8aee0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:24.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.404+0000 7fc8aee0c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:24.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.404+0000 7fc8aee0c9c0 1 --2- 172.21.15.62:0/1603294756 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x564568990b00 0x564568992ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.404+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5645689935a0 con 0x564568990b00 2024-09-10T05:38:24.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.404+0000 7fc8ac912640 1 --2- 172.21.15.62:0/1603294756 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x564568990b00 0x564568992ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.404+0000 7fc8ac912640 1 --2- 172.21.15.62:0/1603294756 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x564568990b00 0x564568992ef0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.404+0000 7fc8ac912640 1 -- 172.21.15.62:0/1603294756 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc89c117020 con 0x564568990b00 2024-09-10T05:38:24.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.404+0000 7fc8aee0c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:38:24.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.404+0000 7fc8aee0c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:24.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.404+0000 7fc8aee0c9c0 1 --2- 172.21.15.62:0/1603294756 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x564568994300 0x564568996710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.404+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564568996ea0 con 0x564568994300 2024-09-10T05:38:24.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.404+0000 7fc8ac111640 1 --2- 172.21.15.62:0/1603294756 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x564568994300 0x564568996710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.404+0000 7fc8ac111640 1 --2- 172.21.15.62:0/1603294756 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x564568994300 0x564568996710 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.404+0000 7fc8ac111640 1 -- 172.21.15.62:0/1603294756 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv5 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc894026070 con 0x564568994300 2024-09-10T05:38:24.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.404+0000 7fc8aee0c9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:38:24.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.404+0000 7fc8aee0c9c0 20 searching for the correct realm 2024-09-10T05:38:24.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.404+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564568998770 con 0x564568994300 2024-09-10T05:38:24.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.404+0000 7fc8ac111640 1 -- 172.21.15.62:0/1603294756 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc894026070 con 0x564568994300 2024-09-10T05:38:24.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.404+0000 7fc8ac111640 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564568998770 con 0x564568990b00 2024-09-10T05:38:24.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.404+0000 7fc8ac912640 1 -- 172.21.15.62:0/1603294756 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc89c117020 con 0x564568990b00 2024-09-10T05:38:24.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.404+0000 7fc8ac912640 1 --2- 172.21.15.62:0/1603294756 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fc89c0c9070 0x7fc89c11aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.404+0000 7fc8ac912640 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564568998770 con 0x7fc89c0c9070 2024-09-10T05:38:24.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.404+0000 7fc8ad113640 1 --2- 172.21.15.62:0/1603294756 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fc89c0c9070 0x7fc89c11aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.408+0000 7fc8ad113640 1 --2- 172.21.15.62:0/1603294756 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fc89c0c9070 0x7fc89c11aa90 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.408+0000 7fc8ad113640 1 -- 172.21.15.62:0/1603294756 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8a400a4d0 con 0x7fc89c0c9070 2024-09-10T05:38:24.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.408+0000 7fc8ad113640 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564568998770 con 0x56456898c670 2024-09-10T05:38:24.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.408+0000 7fc8ad113640 1 -- 172.21.15.62:0/1603294756 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8a400a4d0 con 0x56456898c670 2024-09-10T05:38:24.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.408+0000 7fc8ad113640 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564568998770 con 0x56456898c670 2024-09-10T05:38:24.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.408+0000 7fc8ad113640 1 -- 172.21.15.62:0/1603294756 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8a400a4d0 con 0x56456898c670 2024-09-10T05:38:24.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.408+0000 7fc8ad113640 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564568998770 con 0x564568994300 2024-09-10T05:38:24.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.408+0000 7fc8ac111640 1 -- 172.21.15.62:0/1603294756 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc894026070 con 0x564568994300 2024-09-10T05:38:24.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.408+0000 7fc8ac111640 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564568998770 con 0x56456898c670 2024-09-10T05:38:24.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.408+0000 7fc8ad113640 1 -- 172.21.15.62:0/1603294756 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8a400a4d0 con 0x56456898c670 2024-09-10T05:38:24.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.408+0000 7fc8ad113640 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564568998770 con 0x564568990b00 2024-09-10T05:38:24.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.408+0000 7fc8ac912640 1 -- 172.21.15.62:0/1603294756 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc89c117020 con 0x564568990b00 2024-09-10T05:38:24.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.408+0000 7fc8ac912640 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564568998770 con 0x564568990b00 2024-09-10T05:38:24.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.408+0000 7fc8ac912640 1 -- 172.21.15.62:0/1603294756 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc89c117020 con 0x564568990b00 2024-09-10T05:38:24.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.408+0000 7fc8ac912640 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564568998770 con 0x56456898c670 2024-09-10T05:38:24.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.408+0000 7fc8ad113640 1 -- 172.21.15.62:0/1603294756 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8a400a4d0 con 0x56456898c670 2024-09-10T05:38:24.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.408+0000 7fc8ad113640 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564568998770 con 0x7fc89c0c9070 2024-09-10T05:38:24.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.408+0000 7fc8ad113640 1 -- 172.21.15.62:0/1603294756 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8a400a4d0 con 0x7fc89c0c9070 2024-09-10T05:38:24.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.408+0000 7fc8ad113640 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564568998770 con 0x56456898c670 2024-09-10T05:38:24.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.408+0000 7fc8ad113640 1 -- 172.21.15.62:0/1603294756 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8a400a4d0 con 0x56456898c670 2024-09-10T05:38:24.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.408+0000 7fc8ad113640 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564568998770 con 0x7fc89c0c9070 2024-09-10T05:38:24.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.408+0000 7fc8ad113640 1 -- 172.21.15.62:0/1603294756 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc8a400a4d0 con 0x7fc89c0c9070 2024-09-10T05:38:24.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.408+0000 7fc8ad113640 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564568998770 con 0x564568990b00 2024-09-10T05:38:24.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.412+0000 7fc8ac912640 1 -- 172.21.15.62:0/1603294756 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc89c117020 con 0x564568990b00 2024-09-10T05:38:24.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.412+0000 7fc8ac912640 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564568998770 con 0x564568994300 2024-09-10T05:38:24.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.412+0000 7fc8ac111640 1 -- 172.21.15.62:0/1603294756 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc894026070 con 0x564568994300 2024-09-10T05:38:24.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.412+0000 7fc8ac111640 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564568998770 con 0x56456898c670 2024-09-10T05:38:24.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.412+0000 7fc8ad113640 1 -- 172.21.15.62:0/1603294756 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8a400a4d0 con 0x56456898c670 2024-09-10T05:38:24.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.412+0000 7fc8ad113640 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564568998770 con 0x564568990b00 2024-09-10T05:38:24.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.412+0000 7fc8ac912640 1 -- 172.21.15.62:0/1603294756 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc89c117020 con 0x564568990b00 2024-09-10T05:38:24.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.412+0000 7fc8ac912640 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564568998770 con 0x564568994300 2024-09-10T05:38:24.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.412+0000 7fc8ac111640 1 -- 172.21.15.62:0/1603294756 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 34 out=170b] v34'5 uv5 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7fc894026070 con 0x564568994300 2024-09-10T05:38:24.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.412+0000 7fc8ac111640 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564568998770 con 0x56456898c670 2024-09-10T05:38:24.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.412+0000 7fc8ad113640 1 -- 172.21.15.62:0/1603294756 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8a400a4d0 con 0x56456898c670 2024-09-10T05:38:24.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.412+0000 7fc8ad113640 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564568998770 con 0x56456898c670 2024-09-10T05:38:24.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.412+0000 7fc8ad113640 1 -- 172.21.15.62:0/1603294756 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc8a400a4d0 con 0x56456898c670 2024-09-10T05:38:24.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.412+0000 7fc8ad113640 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564568998770 con 0x56456898c670 2024-09-10T05:38:24.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.412+0000 7fc8ad113640 1 -- 172.21.15.62:0/1603294756 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8a400a4d0 con 0x56456898c670 2024-09-10T05:38:24.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.412+0000 7fc8ad113640 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564568998770 con 0x564568994300 2024-09-10T05:38:24.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.412+0000 7fc8ac111640 1 -- 172.21.15.62:0/1603294756 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc894026070 con 0x564568994300 2024-09-10T05:38:24.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.412+0000 7fc8ac111640 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564568998770 con 0x7fc89c0c9070 2024-09-10T05:38:24.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.412+0000 7fc8ad113640 1 -- 172.21.15.62:0/1603294756 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8a400a4d0 con 0x7fc89c0c9070 2024-09-10T05:38:24.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.412+0000 7fc8ad113640 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564568998770 con 0x56456898c670 2024-09-10T05:38:24.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.412+0000 7fc8ad113640 1 -- 172.21.15.62:0/1603294756 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8a400a4d0 con 0x56456898c670 2024-09-10T05:38:24.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.412+0000 7fc8ad113640 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564568998770 con 0x7fc89c0c9070 2024-09-10T05:38:24.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.416+0000 7fc8ad113640 1 -- 172.21.15.62:0/1603294756 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8a400a4d0 con 0x7fc89c0c9070 2024-09-10T05:38:24.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.416+0000 7fc8ad113640 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564568998770 con 0x564568994300 2024-09-10T05:38:24.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.416+0000 7fc8ac111640 1 -- 172.21.15.62:0/1603294756 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc894026070 con 0x564568994300 2024-09-10T05:38:24.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.416+0000 7fc8ac111640 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564568998770 con 0x7fc89c0c9070 2024-09-10T05:38:24.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.416+0000 7fc8ad113640 1 -- 172.21.15.62:0/1603294756 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8a400a4d0 con 0x7fc89c0c9070 2024-09-10T05:38:24.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.416+0000 7fc8ad113640 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564568998770 con 0x564568990b00 2024-09-10T05:38:24.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.416+0000 7fc8ac912640 1 -- 172.21.15.62:0/1603294756 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc89c117020 con 0x564568990b00 2024-09-10T05:38:24.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.416+0000 7fc8ac912640 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564568998770 con 0x564568990b00 2024-09-10T05:38:24.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.416+0000 7fc8ac912640 1 -- 172.21.15.62:0/1603294756 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc89c117020 con 0x564568990b00 2024-09-10T05:38:24.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.416+0000 7fc8ac912640 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564568998770 con 0x564568994300 2024-09-10T05:38:24.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.416+0000 7fc8ac111640 1 -- 172.21.15.62:0/1603294756 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc894026070 con 0x564568994300 2024-09-10T05:38:24.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.416+0000 7fc8ac111640 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564568998770 con 0x564568990b00 2024-09-10T05:38:24.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.416+0000 7fc8ac912640 1 -- 172.21.15.62:0/1603294756 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc89c117020 con 0x564568990b00 2024-09-10T05:38:24.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.416+0000 7fc8ac912640 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564568998770 con 0x564568990b00 2024-09-10T05:38:24.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.416+0000 7fc8ac912640 1 -- 172.21.15.62:0/1603294756 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc89c117020 con 0x564568990b00 2024-09-10T05:38:24.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.416+0000 7fc8aee0c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:38:24.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.416+0000 7fc8aee0c9c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:38:24.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.416+0000 7fc8aee0c9c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:38:24.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.416+0000 7fc8aee0c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:38:24.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.416+0000 7fc8aee0c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:38:24.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.416+0000 7fc8aee0c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:38:24.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.420+0000 7fc8aee0c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:24.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.420+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564568997890 con 0x56456898c670 2024-09-10T05:38:24.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.420+0000 7fc8ad113640 1 -- 172.21.15.62:0/1603294756 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8a400a4d0 con 0x56456898c670 2024-09-10T05:38:24.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.420+0000 7fc8aee0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:24.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.420+0000 7fc8aee0c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:24.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.420+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564568998130 con 0x564568990b00 2024-09-10T05:38:24.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.420+0000 7fc8ac912640 1 -- 172.21.15.62:0/1603294756 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc89c117020 con 0x564568990b00 2024-09-10T05:38:24.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.420+0000 7fc8aee0c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:38:24.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.420+0000 7fc8aee0c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:24.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.420+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5645689974d0 con 0x564568994300 2024-09-10T05:38:24.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.420+0000 7fc8ac111640 1 -- 172.21.15.62:0/1603294756 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc894026070 con 0x564568994300 2024-09-10T05:38:24.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.420+0000 7fc8aee0c9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:38:24.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.420+0000 7fc8aee0c9c0 20 zone default found 2024-09-10T05:38:24.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.420+0000 7fc8aee0c9c0 4 Realm: () 2024-09-10T05:38:24.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.420+0000 7fc8aee0c9c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:38:24.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.420+0000 7fc8aee0c9c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:38:24.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.420+0000 7fc8aee0c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:38:24.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.420+0000 7fc8aee0c9c0 20 zonegroup default 2024-09-10T05:38:24.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.420+0000 7fc8aee0c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:24.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.420+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564568999050 con 0x7fc89c0c9070 2024-09-10T05:38:24.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.420+0000 7fc8ad113640 1 -- 172.21.15.62:0/1603294756 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc8a400a4d0 con 0x7fc89c0c9070 2024-09-10T05:38:24.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.420+0000 7fc8aee0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:24.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.420+0000 7fc8aee0c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:24.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.420+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56456899b290 con 0x564568994300 2024-09-10T05:38:24.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.420+0000 7fc8ac111640 1 -- 172.21.15.62:0/1603294756 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc894026070 con 0x564568994300 2024-09-10T05:38:24.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.420+0000 7fc8aee0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:24.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.420+0000 7fc8aee0c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:24.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.420+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56456899b630 con 0x564568994300 2024-09-10T05:38:24.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.420+0000 7fc8ac111640 1 -- 172.21.15.62:0/1603294756 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc894026070 con 0x564568994300 2024-09-10T05:38:24.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.420+0000 7fc8aee0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:24.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.420+0000 7fc8aee0c9c0 20 started sync module instance, tier type = 2024-09-10T05:38:24.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.420+0000 7fc8aee0c9c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:38:24.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.420+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56456899a720 con 0x564568990b00 2024-09-10T05:38:24.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.424+0000 7fc8ac912640 1 -- 172.21.15.62:0/1603294756 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc89c117020 con 0x564568990b00 2024-09-10T05:38:24.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.424+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94856107633424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56456899a380 con 0x564568990b00 2024-09-10T05:38:24.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.424+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56456899c380 con 0x56456898c670 2024-09-10T05:38:24.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.424+0000 7fc8ad113640 1 -- 172.21.15.62:0/1603294756 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8a400a4d0 con 0x56456898c670 2024-09-10T05:38:24.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.424+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94856107640688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56456899d040 con 0x56456898c670 2024-09-10T05:38:24.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.424+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56456899da00 con 0x564568990b00 2024-09-10T05:38:24.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.424+0000 7fc8ac912640 1 -- 172.21.15.62:0/1603294756 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94856107633424] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc89c117020 con 0x564568990b00 2024-09-10T05:38:24.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.424+0000 7fc8ad113640 1 -- 172.21.15.62:0/1603294756 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94856107640688] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8a400a4d0 con 0x56456898c670 2024-09-10T05:38:24.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.428+0000 7fc8ac912640 1 -- 172.21.15.62:0/1603294756 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc89c117020 con 0x564568990b00 2024-09-10T05:38:24.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.428+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94856107644240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56456899d040 con 0x564568990b00 2024-09-10T05:38:24.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.428+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56456899d970 con 0x7fc89c0c9070 2024-09-10T05:38:24.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.428+0000 7fc8ad113640 1 -- 172.21.15.62:0/1603294756 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8a400a4d0 con 0x7fc89c0c9070 2024-09-10T05:38:24.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.428+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94856107646448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56456899d970 con 0x7fc89c0c9070 2024-09-10T05:38:24.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.428+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56456899ece0 con 0x564568990b00 2024-09-10T05:38:24.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.428+0000 7fc8ad113640 1 -- 172.21.15.62:0/1603294756 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94856107646448] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8a400a4d0 con 0x7fc89c0c9070 2024-09-10T05:38:24.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.432+0000 7fc8ac912640 1 -- 172.21.15.62:0/1603294756 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94856107644240] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc89c117020 con 0x564568990b00 2024-09-10T05:38:24.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.432+0000 7fc8ac912640 1 -- 172.21.15.62:0/1603294756 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc89c117020 con 0x564568990b00 2024-09-10T05:38:24.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.432+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94856107641744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56456899e830 con 0x564568990b00 2024-09-10T05:38:24.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.432+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56456899f580 con 0x564568994300 2024-09-10T05:38:24.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.432+0000 7fc8ac111640 1 -- 172.21.15.62:0/1603294756 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc894026070 con 0x564568994300 2024-09-10T05:38:24.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.432+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94856107651280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56456899e830 con 0x564568994300 2024-09-10T05:38:24.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.432+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5645689a0000 con 0x564568994300 2024-09-10T05:38:24.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.432+0000 7fc8ac912640 1 -- 172.21.15.62:0/1603294756 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94856107641744] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc89c117020 con 0x564568990b00 2024-09-10T05:38:24.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.432+0000 7fc8ac111640 1 -- 172.21.15.62:0/1603294756 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94856107651280] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc894026070 con 0x564568994300 2024-09-10T05:38:24.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.432+0000 7fc8ac111640 1 -- 172.21.15.62:0/1603294756 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc894026070 con 0x564568994300 2024-09-10T05:38:24.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.432+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94856107652336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56456899fb10 con 0x564568994300 2024-09-10T05:38:24.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.432+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5645689a08a0 con 0x7fc89c0c9070 2024-09-10T05:38:24.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.436+0000 7fc8ad113640 1 -- 172.21.15.62:0/1603294756 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8a400a4d0 con 0x7fc89c0c9070 2024-09-10T05:38:24.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.436+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94856107656176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5645689a0cc0 con 0x7fc89c0c9070 2024-09-10T05:38:24.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.436+0000 7fc8aee0c9c0 20 add_watcher() i=0 2024-09-10T05:38:24.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.436+0000 7fc8aee0c9c0 20 add_watcher() i=1 2024-09-10T05:38:24.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.436+0000 7fc8aee0c9c0 20 add_watcher() i=2 2024-09-10T05:38:24.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.436+0000 7fc8aee0c9c0 20 add_watcher() i=3 2024-09-10T05:38:24.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.436+0000 7fc8aee0c9c0 20 add_watcher() i=4 2024-09-10T05:38:24.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.436+0000 7fc8aee0c9c0 20 add_watcher() i=5 2024-09-10T05:38:24.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.436+0000 7fc8ac111640 1 -- 172.21.15.62:0/1603294756 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94856107652336] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc894026070 con 0x564568994300 2024-09-10T05:38:24.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.436+0000 7fc8aee0c9c0 20 add_watcher() i=6 2024-09-10T05:38:24.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.436+0000 7fc8ad113640 1 -- 172.21.15.62:0/1603294756 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94856107656176] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8a400a4d0 con 0x7fc89c0c9070 2024-09-10T05:38:24.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.436+0000 7fc8aee0c9c0 20 add_watcher() i=7 2024-09-10T05:38:24.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.436+0000 7fc8aee0c9c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:38:24.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.436+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5645689a38f0 con 0x56456898c670 2024-09-10T05:38:24.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.436+0000 7fc8ad113640 1 -- 172.21.15.62:0/1603294756 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc8a400a4d0 con 0x56456898c670 2024-09-10T05:38:24.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.436+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94856107647504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5645689a0cc0 con 0x56456898c670 2024-09-10T05:38:24.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.440+0000 7fc8ad113640 1 -- 172.21.15.62:0/1603294756 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94856107647504] v34'266 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc8a400a4d0 con 0x56456898c670 2024-09-10T05:38:24.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.440+0000 7fc7637e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:38:24.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.440+0000 7fc8aee0c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:38:24.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.440+0000 7fc8aee0c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:38:24.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.440+0000 7fc8aee0c9c0 5 note: GC not initialized 2024-09-10T05:38:24.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.440+0000 7fc7627e4640 20 reqs_thread_entry: start 2024-09-10T05:38:24.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.440+0000 7fc8aee0c9c0 20 init_complete bucket index max shards: 11 2024-09-10T05:38:24.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.440+0000 7fc8aee0c9c0 20 Filter name: none 2024-09-10T05:38:24.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.440+0000 7fc7607e0640 20 reqs_thread_entry: start 2024-09-10T05:38:24.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.440+0000 7fc8aee0c9c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-10T05:38:24.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.440+0000 7fc8aee0c9c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:24.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.440+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5645689c6b60 con 0x56456898c670 2024-09-10T05:38:24.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.440+0000 7fc8ad113640 1 -- 172.21.15.62:0/1603294756 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7fc8a400a4d0 con 0x56456898c670 2024-09-10T05:38:24.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.440+0000 7fc8aee0c9c0 20 rados_obj.operate() r=0 bl.length=490 2024-09-10T05:38:24.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.440+0000 7fc8aee0c9c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-10T05:38:24.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.440+0000 7fc8aee0c9c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:38:24.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.440+0000 7fc8aee0c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:38:24.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.440+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5645689cd3d0 con 0x56456898c670 2024-09-10T05:38:24.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.440+0000 7fc8ad113640 1 -- 172.21.15.62:0/1603294756 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v34'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fc8a400a4d0 con 0x56456898c670 2024-09-10T05:38:24.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.440+0000 7fc8aee0c9c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T05:38:24.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.440+0000 7fc8aee0c9c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:38:24.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.440+0000 7fc8aee0c9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-10T05:38:24.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.440+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94856107839040 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5645689c8b20 con 0x564568990b00 2024-09-10T05:38:24.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.444+0000 7fc8ac912640 1 -- 172.21.15.62:0/1603294756 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== watch-notify(notify (1) cookie 94856107641744 notify 146028888116 ret 0) ==== 708+0+0 (crc 0 0 0) 0x56456896ef50 con 0x564568990b00 2024-09-10T05:38:24.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.444+0000 7fc783fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888116 cookie 94856107641744 notifier 4878 bl.length()=666 2024-09-10T05:38:24.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.444+0000 7fc783fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T05:38:24.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.444+0000 7fc783fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:38:24.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.444+0000 7fc8ac912640 1 -- 172.21.15.62:0/1603294756 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(64 notify.4 [notify cookie 94856107839040 out=8b] v0'0 uv261 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc89c117020 con 0x564568990b00 2024-09-10T05:38:24.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.444+0000 7fc783fff640 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fc770003eb0 con 0x564568990b00 2024-09-10T05:38:24.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.444+0000 7fc8ac912640 1 -- 172.21.15.62:0/1603294756 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== watch-notify(notify_complete (2) cookie 94856107839040 notify 146028888116 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56456896e6f0 con 0x564568990b00 2024-09-10T05:38:24.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.444+0000 7fc8ac912640 1 -- 172.21.15.62:0/1603294756 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc89c117020 con 0x564568990b00 2024-09-10T05:38:24.448 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-10T05:38:22.896781Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:38:22.896764Z","tags":[],"group_ids":[]} 2024-09-10T05:38:24.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.444+0000 7fc7637e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:38:24.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.444+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94856107647504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5645689c8670 con 0x56456898c670 2024-09-10T05:38:24.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.448+0000 7fc8ad113640 1 -- 172.21.15.62:0/1603294756 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94856107647504] v34'267 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc8a400a4d0 con 0x56456898c670 2024-09-10T05:38:24.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.448+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94856107633424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56456899e210 con 0x564568990b00 2024-09-10T05:38:24.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.448+0000 7fc8ac912640 1 -- 172.21.15.62:0/1603294756 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94856107633424] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc89c117020 con 0x564568990b00 2024-09-10T05:38:24.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.448+0000 7fc8aee0c9c0 20 remove_watcher() i=0 2024-09-10T05:38:24.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.448+0000 7fc8aee0c9c0 2 removed watcher, disabling cache 2024-09-10T05:38:24.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.448+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94856107640688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56456899ab10 con 0x56456898c670 2024-09-10T05:38:24.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.452+0000 7fc8ad113640 1 -- 172.21.15.62:0/1603294756 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94856107640688] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8a400a4d0 con 0x56456898c670 2024-09-10T05:38:24.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.452+0000 7fc8aee0c9c0 20 remove_watcher() i=1 2024-09-10T05:38:24.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.452+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94856107644240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56456899ab10 con 0x564568990b00 2024-09-10T05:38:24.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.452+0000 7fc8ac912640 1 -- 172.21.15.62:0/1603294756 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94856107644240] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc89c117020 con 0x564568990b00 2024-09-10T05:38:24.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.452+0000 7fc8aee0c9c0 20 remove_watcher() i=2 2024-09-10T05:38:24.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.452+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94856107646448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56456899d550 con 0x7fc89c0c9070 2024-09-10T05:38:24.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.456+0000 7fc8ad113640 1 -- 172.21.15.62:0/1603294756 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94856107646448] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8a400a4d0 con 0x7fc89c0c9070 2024-09-10T05:38:24.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.456+0000 7fc8aee0c9c0 20 remove_watcher() i=3 2024-09-10T05:38:24.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.456+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94856107641744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56456899ab10 con 0x564568990b00 2024-09-10T05:38:24.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.456+0000 7fc8ac912640 1 -- 172.21.15.62:0/1603294756 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94856107641744] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc89c117020 con 0x564568990b00 2024-09-10T05:38:24.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.456+0000 7fc8aee0c9c0 20 remove_watcher() i=4 2024-09-10T05:38:24.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.456+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94856107651280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56456899ab10 con 0x564568994300 2024-09-10T05:38:24.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.460+0000 7fc8ac111640 1 -- 172.21.15.62:0/1603294756 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94856107651280] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc894026070 con 0x564568994300 2024-09-10T05:38:24.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.460+0000 7fc8aee0c9c0 20 remove_watcher() i=5 2024-09-10T05:38:24.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.460+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94856107652336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56456899f0d0 con 0x564568994300 2024-09-10T05:38:24.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.460+0000 7fc8ac111640 1 -- 172.21.15.62:0/1603294756 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94856107652336] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc894026070 con 0x564568994300 2024-09-10T05:38:24.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.460+0000 7fc8aee0c9c0 20 remove_watcher() i=6 2024-09-10T05:38:24.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.460+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94856107656176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56456899ab10 con 0x7fc89c0c9070 2024-09-10T05:38:24.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.460+0000 7fc8ad113640 1 -- 172.21.15.62:0/1603294756 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94856107656176] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8a400a4d0 con 0x7fc89c0c9070 2024-09-10T05:38:24.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.460+0000 7fc8aee0c9c0 20 remove_watcher() i=7 2024-09-10T05:38:24.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.460+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x564568990b00 msgr2=0x564568992ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.460+0000 7fc8aee0c9c0 1 --2- 172.21.15.62:0/1603294756 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x564568990b00 0x564568992ef0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.460+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56456898c670 msgr2=0x56456898eb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.460+0000 7fc8aee0c9c0 1 --2- 172.21.15.62:0/1603294756 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56456898c670 0x56456898eb00 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.460+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fc89c0c9070 msgr2=0x7fc89c11aa90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.460+0000 7fc8aee0c9c0 1 --2- 172.21.15.62:0/1603294756 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fc89c0c9070 0x7fc89c11aa90 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.460+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x564568994300 msgr2=0x564568996710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.460+0000 7fc8aee0c9c0 1 --2- 172.21.15.62:0/1603294756 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x564568994300 0x564568996710 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.460+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc778039a70 msgr2=0x7fc77803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.460+0000 7fc8aee0c9c0 1 --2- 172.21.15.62:0/1603294756 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc778039a70 0x7fc77803bf30 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x56456895bd40 tx=0x7fc894010000 comp rx=0 tx=0).stop 2024-09-10T05:38:24.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.460+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456897a3b0 msgr2=0x5645689816a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.460+0000 7fc8ad113640 1 -- 172.21.15.62:0/1603294756 reap_dead start 2024-09-10T05:38:24.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.460+0000 7fc8aee0c9c0 1 --2- 172.21.15.62:0/1603294756 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456897a3b0 0x5645689816a0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fc89c0d37f0 tx=0x7fc89c0beee0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.460+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 shutdown_connections 2024-09-10T05:38:24.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.460+0000 7fc8aee0c9c0 1 --2- 172.21.15.62:0/1603294756 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456897a3b0 0x5645689816a0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.460+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 >> 172.21.15.62:0/1603294756 conn(0x5645689767e0 msgr2=0x5645689749f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:24.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.460+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 shutdown_connections 2024-09-10T05:38:24.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.460+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1603294756 wait complete. 2024-09-10T05:38:24.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.464+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/2075456942 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc784039a70 msgr2=0x7fc78403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.464+0000 7fc8aee0c9c0 1 --2- 172.21.15.62:0/2075456942 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc784039a70 0x7fc78403bf30 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc89400bf50 tx=0x7fc89400f000 comp rx=0 tx=0).stop 2024-09-10T05:38:24.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.464+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/2075456942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456896dc90 msgr2=0x56456896e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.464+0000 7fc8aee0c9c0 1 --2- 172.21.15.62:0/2075456942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456896dc90 0x56456896e0b0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fc89c0b67d0 tx=0x7fc89c001c50 comp rx=0 tx=0).stop 2024-09-10T05:38:24.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.464+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/2075456942 shutdown_connections 2024-09-10T05:38:24.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.464+0000 7fc8aee0c9c0 1 --2- 172.21.15.62:0/2075456942 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc784039a70 0x7fc78403bf30 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.464+0000 7fc8aee0c9c0 1 --2- 172.21.15.62:0/2075456942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456896dc90 0x56456896e0b0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.464+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/2075456942 >> 172.21.15.62:0/2075456942 conn(0x564568963640 msgr2=0x564568963a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:24.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.464+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/2075456942 shutdown_connections 2024-09-10T05:38:24.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.464+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/2075456942 wait complete. 2024-09-10T05:38:24.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.464+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1045623479 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x564568958130 msgr2=0x56456895a5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.464+0000 7fc8aee0c9c0 1 --2- 172.21.15.62:0/1045623479 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x564568958130 0x56456895a5d0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.464+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1045623479 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56456885e0b0 msgr2=0x564568957140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.464+0000 7fc8aee0c9c0 1 --2- 172.21.15.62:0/1045623479 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x56456885e0b0 0x564568957140 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.464+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1045623479 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56456895cb00 msgr2=0x56456895eef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.464+0000 7fc8aee0c9c0 1 --2- 172.21.15.62:0/1045623479 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56456895cb00 0x56456895eef0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.464+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1045623479 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc794039ac0 msgr2=0x7fc79403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.464+0000 7fc8aee0c9c0 1 --2- 172.21.15.62:0/1045623479 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc794039ac0 0x7fc79403bf80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc894001d80 tx=0x7fc8940012e0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.464+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1045623479 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456885af70 msgr2=0x5645687d13e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.464+0000 7fc8aee0c9c0 1 --2- 172.21.15.62:0/1045623479 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56456885af70 0x5645687d13e0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fc89c0ab510 tx=0x7fc89c018020 comp rx=0 tx=0).stop 2024-09-10T05:38:24.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.464+0000 7fc8ad113640 1 -- 172.21.15.62:0/1045623479 reap_dead start 2024-09-10T05:38:24.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.464+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1045623479 shutdown_connections 2024-09-10T05:38:24.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.464+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1045623479 >> 172.21.15.62:0/1045623479 conn(0x564568856a90 msgr2=0x564568940e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:24.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.464+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1045623479 shutdown_connections 2024-09-10T05:38:24.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.464+0000 7fc8aee0c9c0 1 -- 172.21.15.62:0/1045623479 wait complete. 2024-09-10T05:38:24.478 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T05:38:22.896781Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:38:22.896764Z', 'tags': [], 'group_ids': []} 2024-09-10T05:38:24.478 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T05:38:22.896781Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:38:22.896764Z', 'tags': [], 'group_ids': []} 2024-09-10T05:38:24.478 ERROR:root:0 2024-09-10T05:38:24.478 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T05:38:24.482 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T05:38:24.483 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-10T05:38:24.483 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-10T05:38:24.483 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-10T05:38:24.560 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:38:24.561 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:38:24.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.560+0000 7fb5a5a699c0 1 Processor -- start 2024-09-10T05:38:24.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.560+0000 7fb5a5a699c0 1 -- start start 2024-09-10T05:38:24.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.560+0000 7fb5a5a699c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55e463386230 0x55e463414be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.560+0000 7fb5a5a699c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e4632c69c0 con 0x55e463415120 2024-09-10T05:38:24.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.560+0000 7fb5a5a699c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x55e4633166d0 con 0x55e463386230 2024-09-10T05:38:24.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.560+0000 7fb5a356f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55e463386230 0x55e463414be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.560+0000 7fb5a356f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55e463386230 0x55e463414be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:39040/0 (socket says 172.21.15.62:39040) 2024-09-10T05:38:24.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.560+0000 7fb5a356f640 1 -- 172.21.15.62:0/4000095564 learned_addr learned my addr 172.21.15.62:0/4000095564 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:24.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.560+0000 7fb5a2d6e640 1 --1- 172.21.15.62:0/4000095564 >> v1:172.21.15.2:6789/0 conn(0x55e463415120 0x55e463417510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:52166/0 (socket says 172.21.15.62:52166) 2024-09-10T05:38:24.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.560+0000 7fb5a356f640 1 -- 172.21.15.62:0/4000095564 >> v1:172.21.15.2:6789/0 conn(0x55e463415120 legacy=0x55e463417510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.560+0000 7fb5a356f640 1 -- 172.21.15.62:0/4000095564 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4632baca0 con 0x55e463386230 2024-09-10T05:38:24.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.560+0000 7fb5a356f640 1 --2- 172.21.15.62:0/4000095564 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e463386230 0x55e463414be0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fb59400a5c0 tx=0x7fb59401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c43b1304f3d26838 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.564+0000 7fb5a256d640 1 -- 172.21.15.62:0/4000095564 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5940b1070 con 0x55e463386230 2024-09-10T05:38:24.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.564+0000 7fb5a256d640 1 -- 172.21.15.62:0/4000095564 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5940a8070 con 0x55e463386230 2024-09-10T05:38:24.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.564+0000 7fb5a256d640 1 -- 172.21.15.62:0/4000095564 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5940ac5b0 con 0x55e463386230 2024-09-10T05:38:24.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.564+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/4000095564 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e463386230 msgr2=0x55e463414be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.564+0000 7fb5a5a699c0 1 --2- 172.21.15.62:0/4000095564 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e463386230 0x55e463414be0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fb59400a5c0 tx=0x7fb59401b340 comp rx=0 tx=0).stop 2024-09-10T05:38:24.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.564+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/4000095564 shutdown_connections 2024-09-10T05:38:24.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.564+0000 7fb5a5a699c0 1 --2- 172.21.15.62:0/4000095564 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e463386230 0x55e463414be0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.564+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/4000095564 >> 172.21.15.62:0/4000095564 conn(0x55e46340c910 msgr2=0x55e46340ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:24.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.564+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/4000095564 shutdown_connections 2024-09-10T05:38:24.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.564+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/4000095564 wait complete. 2024-09-10T05:38:24.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.580+0000 7fb5a5a699c0 1 Processor -- start 2024-09-10T05:38:24.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.580+0000 7fb5a5a699c0 1 -- start start 2024-09-10T05:38:24.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.580+0000 7fb5a5a699c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e463386230 0x55e4634fd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.580+0000 7fb5a5a699c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e46331a680 con 0x55e463386230 2024-09-10T05:38:24.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.580+0000 7fb5a356f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e463386230 0x55e4634fd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.580+0000 7fb5a356f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e463386230 0x55e4634fd850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:39042/0 (socket says 172.21.15.62:39042) 2024-09-10T05:38:24.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.580+0000 7fb5a356f640 1 -- 172.21.15.62:0/2534733338 learned_addr learned my addr 172.21.15.62:0/2534733338 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:24.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.580+0000 7fb5a356f640 1 -- 172.21.15.62:0/2534733338 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e463295da0 con 0x55e463386230 2024-09-10T05:38:24.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.580+0000 7fb5a356f640 1 --2- 172.21.15.62:0/2534733338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e463386230 0x55e4634fd850 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fb594017f50 tx=0x7fb594003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5190d2242f6684ab server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.580+0000 7fb49160a640 1 -- 172.21.15.62:0/2534733338 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5940b1040 con 0x55e463386230 2024-09-10T05:38:24.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.580+0000 7fb49160a640 1 -- 172.21.15.62:0/2534733338 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5940ac7a0 con 0x55e463386230 2024-09-10T05:38:24.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.580+0000 7fb49160a640 1 -- 172.21.15.62:0/2534733338 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5940acaa0 con 0x55e463386230 2024-09-10T05:38:24.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.580+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/2534733338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e463386230 msgr2=0x55e4634fd850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.580+0000 7fb5a5a699c0 1 --2- 172.21.15.62:0/2534733338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e463386230 0x55e4634fd850 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fb594017f50 tx=0x7fb594003030 comp rx=0 tx=0).stop 2024-09-10T05:38:24.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.580+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/2534733338 shutdown_connections 2024-09-10T05:38:24.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.580+0000 7fb5a5a699c0 1 --2- 172.21.15.62:0/2534733338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e463386230 0x55e4634fd850 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.580+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/2534733338 >> 172.21.15.62:0/2534733338 conn(0x55e46340c910 msgr2=0x55e4634f9490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:24.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.580+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/2534733338 shutdown_connections 2024-09-10T05:38:24.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.580+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/2534733338 wait complete. 2024-09-10T05:38:24.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.580+0000 7fb5a5a699c0 1 Processor -- start 2024-09-10T05:38:24.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.580+0000 7fb5a5a699c0 1 -- start start 2024-09-10T05:38:24.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.580+0000 7fb5a5a699c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e463386230 0x55e4634122c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.580+0000 7fb5a5a699c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e4632bca50 con 0x55e463386230 2024-09-10T05:38:24.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.584+0000 7fb5a356f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e463386230 0x55e4634122c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.584+0000 7fb5a356f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e463386230 0x55e4634122c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:39056/0 (socket says 172.21.15.62:39056) 2024-09-10T05:38:24.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.584+0000 7fb5a356f640 1 -- 172.21.15.62:0/2729808399 learned_addr learned my addr 172.21.15.62:0/2729808399 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:24.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.584+0000 7fb5a356f640 1 -- 172.21.15.62:0/2729808399 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e463412820 con 0x55e463386230 2024-09-10T05:38:24.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.584+0000 7fb5a356f640 1 --2- 172.21.15.62:0/2729808399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e463386230 0x55e4634122c0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fb59401b380 tx=0x7fb5940180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.584+0000 7fb48fe07640 1 -- 172.21.15.62:0/2729808399 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5940b1050 con 0x55e463386230 2024-09-10T05:38:24.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.584+0000 7fb48fe07640 1 -- 172.21.15.62:0/2729808399 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5940b7710 con 0x55e463386230 2024-09-10T05:38:24.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.584+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/2729808399 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e463410c00 con 0x55e463386230 2024-09-10T05:38:24.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.584+0000 7fb48fe07640 1 -- 172.21.15.62:0/2729808399 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5940b79f0 con 0x55e463386230 2024-09-10T05:38:24.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.584+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/2729808399 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4634111f0 con 0x55e463386230 2024-09-10T05:38:24.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.584+0000 7fb48fe07640 1 -- 172.21.15.62:0/2729808399 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb5940aa070 con 0x55e463386230 2024-09-10T05:38:24.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.584+0000 7fb48fe07640 1 --2- 172.21.15.62:0/2729808399 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb488039a70 0x7fb48803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.584+0000 7fb48fe07640 1 -- 172.21.15.62:0/2729808399 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7fb5940eaf00 con 0x55e463386230 2024-09-10T05:38:24.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.584+0000 7fb5a2d6e640 1 --2- 172.21.15.62:0/2729808399 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb488039a70 0x7fb48803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.584+0000 7fb5a5a699c0 1 --2- 172.21.15.62:0/2729808399 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55e463415120 0x55e46350e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.584+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/2729808399 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e46350e7f0 con 0x55e463415120 2024-09-10T05:38:24.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.584+0000 7fb5a3d70640 1 --2- 172.21.15.62:0/2729808399 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55e463415120 0x55e46350e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.584+0000 7fb5a2d6e640 1 --2- 172.21.15.62:0/2729808399 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb488039a70 0x7fb48803bf30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb58c001e40 tx=0x7fb58c0013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.584+0000 7fb5a3d70640 1 --2- 172.21.15.62:0/2729808399 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55e463415120 0x55e46350e2b0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.588+0000 7fb5a3d70640 1 -- 172.21.15.62:0/2729808399 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb59c00a4d0 con 0x55e463415120 2024-09-10T05:38:24.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.588+0000 7fb5a5a699c0 1 --2- 172.21.15.62:0/2729808399 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e46350f2c0 0x55e463511780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.588+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/2729808399 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e463511ef0 con 0x55e46350f2c0 2024-09-10T05:38:24.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.588+0000 7fb5a356f640 1 --2- 172.21.15.62:0/2729808399 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e46350f2c0 0x55e463511780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.588+0000 7fb5a356f640 1 --2- 172.21.15.62:0/2729808399 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e46350f2c0 0x55e463511780 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.588+0000 7fb5a356f640 1 -- 172.21.15.62:0/2729808399 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb5940be070 con 0x55e46350f2c0 2024-09-10T05:38:24.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.588+0000 7fb5a5a699c0 1 --2- 172.21.15.62:0/2729808399 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55e463513cb0 0x55e4635160a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.588+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/2729808399 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e463516790 con 0x55e463513cb0 2024-09-10T05:38:24.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.588+0000 7fb5a2d6e640 1 --2- 172.21.15.62:0/2729808399 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55e463513cb0 0x55e4635160a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.588+0000 7fb5a2d6e640 1 --2- 172.21.15.62:0/2729808399 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55e463513cb0 0x55e4635160a0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.588+0000 7fb5a2d6e640 1 -- 172.21.15.62:0/2729808399 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv5 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb58c00bd60 con 0x55e463513cb0 2024-09-10T05:38:24.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.588+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/2729808399 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e463512b50 con 0x55e46350f2c0 2024-09-10T05:38:24.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.592+0000 7fb5a356f640 1 -- 172.21.15.62:0/2729808399 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb5940be070 con 0x55e46350f2c0 2024-09-10T05:38:24.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.592+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/2729808399 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e463512f70 con 0x55e463513cb0 2024-09-10T05:38:24.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.592+0000 7fb5a2d6e640 1 -- 172.21.15.62:0/2729808399 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb58c00bd60 con 0x55e463513cb0 2024-09-10T05:38:24.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.592+0000 7fb5a5a699c0 1 Processor -- start 2024-09-10T05:38:24.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.592+0000 7fb5a5a699c0 1 -- start start 2024-09-10T05:38:24.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.592+0000 7fb5a5a699c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e463524e40 0x55e463525260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.592+0000 7fb5a5a699c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e463327450 con 0x55e463524e40 2024-09-10T05:38:24.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.592+0000 7fb5a356f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e463524e40 0x55e463525260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.592+0000 7fb5a356f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e463524e40 0x55e463525260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:39058/0 (socket says 172.21.15.62:39058) 2024-09-10T05:38:24.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.592+0000 7fb5a356f640 1 -- 172.21.15.62:0/3415115019 learned_addr learned my addr 172.21.15.62:0/3415115019 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:24.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.592+0000 7fb5a356f640 1 -- 172.21.15.62:0/3415115019 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4635258a0 con 0x55e463524e40 2024-09-10T05:38:24.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.592+0000 7fb5a356f640 1 --2- 172.21.15.62:0/3415115019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e463524e40 0x55e463525260 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fb594003050 tx=0x7fb5940c1ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.592+0000 7fb48d602640 1 -- 172.21.15.62:0/3415115019 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5940da040 con 0x55e463524e40 2024-09-10T05:38:24.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.592+0000 7fb48d602640 1 -- 172.21.15.62:0/3415115019 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5940d3510 con 0x55e463524e40 2024-09-10T05:38:24.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.592+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/3415115019 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e463526100 con 0x55e463524e40 2024-09-10T05:38:24.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.592+0000 7fb48d602640 1 -- 172.21.15.62:0/3415115019 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb594006840 con 0x55e463524e40 2024-09-10T05:38:24.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.592+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/3415115019 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e463526670 con 0x55e463524e40 2024-09-10T05:38:24.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.596+0000 7fb48d602640 1 -- 172.21.15.62:0/3415115019 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb5940018a0 con 0x55e463524e40 2024-09-10T05:38:24.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.596+0000 7fb48d602640 1 --2- 172.21.15.62:0/3415115019 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb47c039b10 0x7fb47c03bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.596+0000 7fb48d602640 1 -- 172.21.15.62:0/3415115019 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7fb5940dfc00 con 0x55e463524e40 2024-09-10T05:38:24.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.596+0000 7fb5a2d6e640 1 --2- 172.21.15.62:0/3415115019 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb47c039b10 0x7fb47c03bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.596+0000 7fb5a5a699c0 1 Processor -- start 2024-09-10T05:38:24.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.596+0000 7fb5a5a699c0 1 -- start start 2024-09-10T05:38:24.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.596+0000 7fb5a5a699c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e463531580 0x55e463531960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.596+0000 7fb5a2d6e640 1 --2- 172.21.15.62:0/3415115019 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb47c039b10 0x7fb47c03bfd0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x55e463512ef0 tx=0x7fb58c00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.596+0000 7fb5a5a699c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e4634fe040 con 0x55e463531580 2024-09-10T05:38:24.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.596+0000 7fb5a356f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e463531580 0x55e463531960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.596+0000 7fb5a356f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e463531580 0x55e463531960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:39072/0 (socket says 172.21.15.62:39072) 2024-09-10T05:38:24.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.596+0000 7fb5a356f640 1 -- 172.21.15.62:0/2192206221 learned_addr learned my addr 172.21.15.62:0/2192206221 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:24.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.596+0000 7fb5a356f640 1 -- 172.21.15.62:0/2192206221 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e463531f30 con 0x55e463531580 2024-09-10T05:38:24.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.596+0000 7fb5a356f640 1 --2- 172.21.15.62:0/2192206221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e463531580 0x55e463531960 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fb59401b170 tx=0x7fb5940c18c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a879ec671739c4c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.596+0000 7fb486ffd640 1 -- 172.21.15.62:0/2192206221 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5940fd020 con 0x55e463531580 2024-09-10T05:38:24.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.596+0000 7fb486ffd640 1 -- 172.21.15.62:0/2192206221 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5940ca600 con 0x55e463531580 2024-09-10T05:38:24.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.596+0000 7fb486ffd640 1 -- 172.21.15.62:0/2192206221 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5940c1030 con 0x55e463531580 2024-09-10T05:38:24.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.596+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/2192206221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e463531580 msgr2=0x55e463531960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.596+0000 7fb5a5a699c0 1 --2- 172.21.15.62:0/2192206221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e463531580 0x55e463531960 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fb59401b170 tx=0x7fb5940c18c0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.596+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/2192206221 shutdown_connections 2024-09-10T05:38:24.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.596+0000 7fb5a5a699c0 1 --2- 172.21.15.62:0/2192206221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e463531580 0x55e463531960 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.596+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/2192206221 >> 172.21.15.62:0/2192206221 conn(0x55e46352d9b0 msgr2=0x55e46352bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:24.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.596+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/2192206221 shutdown_connections 2024-09-10T05:38:24.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.596+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/2192206221 wait complete. 2024-09-10T05:38:24.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.596+0000 7fb5a5a699c0 1 Processor -- start 2024-09-10T05:38:24.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.596+0000 7fb5a5a699c0 1 -- start start 2024-09-10T05:38:24.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.600+0000 7fb5a5a699c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e463531580 0x55e463538820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.600+0000 7fb5a5a699c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e463532410 con 0x55e463531580 2024-09-10T05:38:24.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.600+0000 7fb5a356f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e463531580 0x55e463538820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.600+0000 7fb5a356f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e463531580 0x55e463538820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:39074/0 (socket says 172.21.15.62:39074) 2024-09-10T05:38:24.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.600+0000 7fb5a356f640 1 -- 172.21.15.62:0/1294033669 learned_addr learned my addr 172.21.15.62:0/1294033669 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:24.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.600+0000 7fb5a356f640 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e463538d80 con 0x55e463531580 2024-09-10T05:38:24.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.600+0000 7fb5a356f640 1 --2- 172.21.15.62:0/1294033669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e463531580 0x55e463538820 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fb5940e21c0 tx=0x7fb5940c8f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.600+0000 7fb4857fa640 1 -- 172.21.15.62:0/1294033669 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb594111070 con 0x55e463531580 2024-09-10T05:38:24.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.600+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e463538d80 con 0x55e463531580 2024-09-10T05:38:24.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.600+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e463538d80 con 0x55e463531580 2024-09-10T05:38:24.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.600+0000 7fb4857fa640 1 -- 172.21.15.62:0/1294033669 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5940069e0 con 0x55e463531580 2024-09-10T05:38:24.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.600+0000 7fb4857fa640 1 -- 172.21.15.62:0/1294033669 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5940cabc0 con 0x55e463531580 2024-09-10T05:38:24.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.600+0000 7fb4857fa640 1 -- 172.21.15.62:0/1294033669 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb594114070 con 0x55e463531580 2024-09-10T05:38:24.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.600+0000 7fb4857fa640 1 --2- 172.21.15.62:0/1294033669 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb46c039a70 0x7fb46c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.600+0000 7fb4857fa640 1 -- 172.21.15.62:0/1294033669 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7fb594117c30 con 0x55e463531580 2024-09-10T05:38:24.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.600+0000 7fb5a2d6e640 1 --2- 172.21.15.62:0/1294033669 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb46c039a70 0x7fb46c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.600+0000 7fb5a5a699c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:24.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.600+0000 7fb5a5a699c0 1 --2- 172.21.15.62:0/1294033669 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55e463543690 0x55e463545b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.600+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4635462a0 con 0x55e463543690 2024-09-10T05:38:24.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.600+0000 7fb5a3d70640 1 --2- 172.21.15.62:0/1294033669 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55e463543690 0x55e463545b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.600+0000 7fb5a2d6e640 1 --2- 172.21.15.62:0/1294033669 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb46c039a70 0x7fb46c03bf30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x55e463512b20 tx=0x7fb58c010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.604+0000 7fb5a3d70640 1 --2- 172.21.15.62:0/1294033669 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55e463543690 0x55e463545b50 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.604+0000 7fb5a3d70640 1 -- 172.21.15.62:0/1294033669 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb59c00a4d0 con 0x55e463543690 2024-09-10T05:38:24.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.604+0000 7fb5a5a699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:24.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.604+0000 7fb5a5a699c0 20 realm 2024-09-10T05:38:24.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.604+0000 7fb5a5a699c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:24.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.604+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4635429c0 con 0x55e463543690 2024-09-10T05:38:24.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.604+0000 7fb5a3d70640 1 -- 172.21.15.62:0/1294033669 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb59c00a4d0 con 0x55e463543690 2024-09-10T05:38:24.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.604+0000 7fb5a5a699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:24.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.604+0000 7fb5a5a699c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:38:24.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.604+0000 7fb5a5a699c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:24.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.604+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e463546d70 con 0x55e463543690 2024-09-10T05:38:24.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.604+0000 7fb5a3d70640 1 -- 172.21.15.62:0/1294033669 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb59c00a4d0 con 0x55e463543690 2024-09-10T05:38:24.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.604+0000 7fb5a5a699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:24.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.604+0000 7fb5a5a699c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:24.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.604+0000 7fb5a5a699c0 1 --2- 172.21.15.62:0/1294033669 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e463547b50 0x55e463549f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.604+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e46354a5f0 con 0x55e463547b50 2024-09-10T05:38:24.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.604+0000 7fb5a356f640 1 --2- 172.21.15.62:0/1294033669 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e463547b50 0x55e463549f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.604+0000 7fb5a356f640 1 --2- 172.21.15.62:0/1294033669 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e463547b50 0x55e463549f40 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.604+0000 7fb5a356f640 1 -- 172.21.15.62:0/1294033669 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb594113030 con 0x55e463547b50 2024-09-10T05:38:24.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.604+0000 7fb5a5a699c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:38:24.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.604+0000 7fb5a5a699c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:24.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.604+0000 7fb5a5a699c0 1 --2- 172.21.15.62:0/1294033669 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55e46354b350 0x55e46354d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.604+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e46354def0 con 0x55e46354b350 2024-09-10T05:38:24.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.604+0000 7fb5a2d6e640 1 --2- 172.21.15.62:0/1294033669 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55e46354b350 0x55e46354d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.604+0000 7fb5a2d6e640 1 --2- 172.21.15.62:0/1294033669 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55e46354b350 0x55e46354d760 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.604+0000 7fb5a2d6e640 1 -- 172.21.15.62:0/1294033669 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv5 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb58c00bd60 con 0x55e46354b350 2024-09-10T05:38:24.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.604+0000 7fb5a5a699c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:38:24.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.604+0000 7fb5a5a699c0 20 searching for the correct realm 2024-09-10T05:38:24.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.604+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e46354f7c0 con 0x55e46354b350 2024-09-10T05:38:24.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.608+0000 7fb5a2d6e640 1 -- 172.21.15.62:0/1294033669 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb58c00bd60 con 0x55e46354b350 2024-09-10T05:38:24.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.608+0000 7fb5a2d6e640 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e46354f7c0 con 0x55e463547b50 2024-09-10T05:38:24.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.608+0000 7fb5a356f640 1 -- 172.21.15.62:0/1294033669 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb594113030 con 0x55e463547b50 2024-09-10T05:38:24.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.608+0000 7fb5a356f640 1 --2- 172.21.15.62:0/1294033669 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fb594116060 0x7fb5940b0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.608+0000 7fb5a356f640 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e46354f7c0 con 0x7fb594116060 2024-09-10T05:38:24.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.608+0000 7fb5a3d70640 1 --2- 172.21.15.62:0/1294033669 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fb594116060 0x7fb5940b0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.608+0000 7fb5a3d70640 1 --2- 172.21.15.62:0/1294033669 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fb594116060 0x7fb5940b0790 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.608+0000 7fb5a3d70640 1 -- 172.21.15.62:0/1294033669 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb59c00a4d0 con 0x7fb594116060 2024-09-10T05:38:24.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.608+0000 7fb5a3d70640 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e46354f7c0 con 0x55e463543690 2024-09-10T05:38:24.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.608+0000 7fb5a3d70640 1 -- 172.21.15.62:0/1294033669 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb59c00a4d0 con 0x55e463543690 2024-09-10T05:38:24.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.608+0000 7fb5a3d70640 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e46354f7c0 con 0x55e463543690 2024-09-10T05:38:24.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.608+0000 7fb5a3d70640 1 -- 172.21.15.62:0/1294033669 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb59c00a4d0 con 0x55e463543690 2024-09-10T05:38:24.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.608+0000 7fb5a3d70640 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e46354f7c0 con 0x55e46354b350 2024-09-10T05:38:24.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.608+0000 7fb5a2d6e640 1 -- 172.21.15.62:0/1294033669 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb58c00bd60 con 0x55e46354b350 2024-09-10T05:38:24.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.608+0000 7fb5a2d6e640 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e46354f7c0 con 0x55e463543690 2024-09-10T05:38:24.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.608+0000 7fb5a3d70640 1 -- 172.21.15.62:0/1294033669 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb59c00a4d0 con 0x55e463543690 2024-09-10T05:38:24.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.608+0000 7fb5a3d70640 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e46354f7c0 con 0x55e463547b50 2024-09-10T05:38:24.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.608+0000 7fb5a356f640 1 -- 172.21.15.62:0/1294033669 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb594113030 con 0x55e463547b50 2024-09-10T05:38:24.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.608+0000 7fb5a356f640 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e46354f7c0 con 0x55e463547b50 2024-09-10T05:38:24.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.612+0000 7fb5a356f640 1 -- 172.21.15.62:0/1294033669 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb594113030 con 0x55e463547b50 2024-09-10T05:38:24.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.612+0000 7fb5a356f640 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e46354f7c0 con 0x55e463543690 2024-09-10T05:38:24.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.612+0000 7fb5a3d70640 1 -- 172.21.15.62:0/1294033669 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb59c00a4d0 con 0x55e463543690 2024-09-10T05:38:24.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.612+0000 7fb5a3d70640 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e46354f7c0 con 0x7fb594116060 2024-09-10T05:38:24.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.612+0000 7fb5a3d70640 1 -- 172.21.15.62:0/1294033669 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb59c00a4d0 con 0x7fb594116060 2024-09-10T05:38:24.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.612+0000 7fb5a3d70640 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e46354f7c0 con 0x55e463543690 2024-09-10T05:38:24.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.612+0000 7fb5a3d70640 1 -- 172.21.15.62:0/1294033669 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb59c00a4d0 con 0x55e463543690 2024-09-10T05:38:24.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.612+0000 7fb5a3d70640 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e46354f7c0 con 0x7fb594116060 2024-09-10T05:38:24.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.612+0000 7fb5a3d70640 1 -- 172.21.15.62:0/1294033669 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb59c00a4d0 con 0x7fb594116060 2024-09-10T05:38:24.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.612+0000 7fb5a3d70640 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e46354f7c0 con 0x55e463547b50 2024-09-10T05:38:24.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.612+0000 7fb5a356f640 1 -- 172.21.15.62:0/1294033669 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb594113030 con 0x55e463547b50 2024-09-10T05:38:24.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.612+0000 7fb5a356f640 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e46354f7c0 con 0x55e46354b350 2024-09-10T05:38:24.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.612+0000 7fb5a2d6e640 1 -- 172.21.15.62:0/1294033669 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb58c00bd60 con 0x55e46354b350 2024-09-10T05:38:24.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.612+0000 7fb5a2d6e640 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e46354f7c0 con 0x55e463543690 2024-09-10T05:38:24.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.612+0000 7fb5a3d70640 1 -- 172.21.15.62:0/1294033669 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb59c00a4d0 con 0x55e463543690 2024-09-10T05:38:24.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.612+0000 7fb5a3d70640 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e46354f7c0 con 0x55e463547b50 2024-09-10T05:38:24.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.612+0000 7fb5a356f640 1 -- 172.21.15.62:0/1294033669 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb594113030 con 0x55e463547b50 2024-09-10T05:38:24.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.612+0000 7fb5a356f640 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e46354f7c0 con 0x55e46354b350 2024-09-10T05:38:24.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.616+0000 7fb5a2d6e640 1 -- 172.21.15.62:0/1294033669 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 34 out=170b] v34'5 uv5 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7fb58c00bd60 con 0x55e46354b350 2024-09-10T05:38:24.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.616+0000 7fb5a2d6e640 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e46354f7c0 con 0x55e463543690 2024-09-10T05:38:24.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.616+0000 7fb5a3d70640 1 -- 172.21.15.62:0/1294033669 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb59c00a4d0 con 0x55e463543690 2024-09-10T05:38:24.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.616+0000 7fb5a3d70640 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e46354f7c0 con 0x55e463543690 2024-09-10T05:38:24.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.616+0000 7fb5a3d70640 1 -- 172.21.15.62:0/1294033669 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb59c00a4d0 con 0x55e463543690 2024-09-10T05:38:24.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.616+0000 7fb5a3d70640 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e46354f7c0 con 0x55e463543690 2024-09-10T05:38:24.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.616+0000 7fb5a3d70640 1 -- 172.21.15.62:0/1294033669 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb59c00a4d0 con 0x55e463543690 2024-09-10T05:38:24.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.616+0000 7fb5a3d70640 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e46354f7c0 con 0x55e46354b350 2024-09-10T05:38:24.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.616+0000 7fb5a2d6e640 1 -- 172.21.15.62:0/1294033669 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb58c00bd60 con 0x55e46354b350 2024-09-10T05:38:24.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.616+0000 7fb5a2d6e640 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e46354f7c0 con 0x7fb594116060 2024-09-10T05:38:24.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.616+0000 7fb5a3d70640 1 -- 172.21.15.62:0/1294033669 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb59c00a4d0 con 0x7fb594116060 2024-09-10T05:38:24.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.616+0000 7fb5a3d70640 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e46354f7c0 con 0x55e463543690 2024-09-10T05:38:24.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.616+0000 7fb5a3d70640 1 -- 172.21.15.62:0/1294033669 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb59c00a4d0 con 0x55e463543690 2024-09-10T05:38:24.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.616+0000 7fb5a3d70640 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e46354f7c0 con 0x7fb594116060 2024-09-10T05:38:24.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.616+0000 7fb5a3d70640 1 -- 172.21.15.62:0/1294033669 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb59c00a4d0 con 0x7fb594116060 2024-09-10T05:38:24.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.616+0000 7fb5a3d70640 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e46354f7c0 con 0x55e46354b350 2024-09-10T05:38:24.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.616+0000 7fb5a2d6e640 1 -- 172.21.15.62:0/1294033669 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb58c00bd60 con 0x55e46354b350 2024-09-10T05:38:24.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.616+0000 7fb5a2d6e640 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e46354f7c0 con 0x7fb594116060 2024-09-10T05:38:24.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.616+0000 7fb5a3d70640 1 -- 172.21.15.62:0/1294033669 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb59c00a4d0 con 0x7fb594116060 2024-09-10T05:38:24.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.616+0000 7fb5a3d70640 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e46354f7c0 con 0x55e463547b50 2024-09-10T05:38:24.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.616+0000 7fb5a356f640 1 -- 172.21.15.62:0/1294033669 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb594113030 con 0x55e463547b50 2024-09-10T05:38:24.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.616+0000 7fb5a356f640 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e46354f7c0 con 0x55e463547b50 2024-09-10T05:38:24.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.620+0000 7fb5a356f640 1 -- 172.21.15.62:0/1294033669 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb594113030 con 0x55e463547b50 2024-09-10T05:38:24.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.620+0000 7fb5a356f640 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e46354f7c0 con 0x55e46354b350 2024-09-10T05:38:24.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.620+0000 7fb5a2d6e640 1 -- 172.21.15.62:0/1294033669 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb58c00bd60 con 0x55e46354b350 2024-09-10T05:38:24.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.620+0000 7fb5a2d6e640 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e46354f7c0 con 0x55e463547b50 2024-09-10T05:38:24.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.620+0000 7fb5a356f640 1 -- 172.21.15.62:0/1294033669 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb594113030 con 0x55e463547b50 2024-09-10T05:38:24.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.620+0000 7fb5a356f640 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e46354f7c0 con 0x55e463547b50 2024-09-10T05:38:24.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.620+0000 7fb5a356f640 1 -- 172.21.15.62:0/1294033669 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb594113030 con 0x55e463547b50 2024-09-10T05:38:24.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.620+0000 7fb5a5a699c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:38:24.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.620+0000 7fb5a5a699c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:38:24.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.620+0000 7fb5a5a699c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:38:24.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.620+0000 7fb5a5a699c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:38:24.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.620+0000 7fb5a5a699c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:38:24.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.620+0000 7fb5a5a699c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:38:24.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.620+0000 7fb5a5a699c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:24.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.620+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e46354e8e0 con 0x55e463543690 2024-09-10T05:38:24.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.620+0000 7fb5a3d70640 1 -- 172.21.15.62:0/1294033669 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb59c00a4d0 con 0x55e463543690 2024-09-10T05:38:24.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.620+0000 7fb5a5a699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:24.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.620+0000 7fb5a5a699c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:24.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.620+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e46354e520 con 0x55e463547b50 2024-09-10T05:38:24.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.620+0000 7fb5a356f640 1 -- 172.21.15.62:0/1294033669 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb594113030 con 0x55e463547b50 2024-09-10T05:38:24.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.620+0000 7fb5a5a699c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:38:24.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.620+0000 7fb5a5a699c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:24.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.620+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e46354f280 con 0x55e46354b350 2024-09-10T05:38:24.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.624+0000 7fb5a2d6e640 1 -- 172.21.15.62:0/1294033669 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb58c00bd60 con 0x55e46354b350 2024-09-10T05:38:24.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.624+0000 7fb5a5a699c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:38:24.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.624+0000 7fb5a5a699c0 20 zone default found 2024-09-10T05:38:24.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.624+0000 7fb5a5a699c0 4 Realm: () 2024-09-10T05:38:24.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.624+0000 7fb5a5a699c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:38:24.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.624+0000 7fb5a5a699c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:38:24.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.624+0000 7fb5a5a699c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:38:24.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.624+0000 7fb5a5a699c0 20 zonegroup default 2024-09-10T05:38:24.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.624+0000 7fb5a5a699c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:24.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.624+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4635500a0 con 0x7fb594116060 2024-09-10T05:38:24.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.624+0000 7fb5a3d70640 1 -- 172.21.15.62:0/1294033669 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb59c00a4d0 con 0x7fb594116060 2024-09-10T05:38:24.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.624+0000 7fb5a5a699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:24.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.624+0000 7fb5a5a699c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:24.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.624+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4635522e0 con 0x55e46354b350 2024-09-10T05:38:24.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.624+0000 7fb5a2d6e640 1 -- 172.21.15.62:0/1294033669 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb58c00bd60 con 0x55e46354b350 2024-09-10T05:38:24.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.624+0000 7fb5a5a699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:24.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.624+0000 7fb5a5a699c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:24.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.624+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e463552680 con 0x55e46354b350 2024-09-10T05:38:24.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.624+0000 7fb5a2d6e640 1 -- 172.21.15.62:0/1294033669 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb58c00bd60 con 0x55e46354b350 2024-09-10T05:38:24.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.624+0000 7fb5a5a699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:24.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.624+0000 7fb5a5a699c0 20 started sync module instance, tier type = 2024-09-10T05:38:24.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.624+0000 7fb5a5a699c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:38:24.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.624+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e463551770 con 0x55e463547b50 2024-09-10T05:38:24.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.628+0000 7fb5a356f640 1 -- 172.21.15.62:0/1294033669 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb594113030 con 0x55e463547b50 2024-09-10T05:38:24.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.628+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94439407426400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e463552f40 con 0x55e463547b50 2024-09-10T05:38:24.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.628+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e463553790 con 0x55e463543690 2024-09-10T05:38:24.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.628+0000 7fb5a3d70640 1 -- 172.21.15.62:0/1294033669 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb59c00a4d0 con 0x55e463543690 2024-09-10T05:38:24.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.628+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94439407432416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e463553fe0 con 0x55e463543690 2024-09-10T05:38:24.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.628+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e463554a80 con 0x55e463547b50 2024-09-10T05:38:24.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.628+0000 7fb5a356f640 1 -- 172.21.15.62:0/1294033669 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94439407426400] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb594113030 con 0x55e463547b50 2024-09-10T05:38:24.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.628+0000 7fb5a3d70640 1 -- 172.21.15.62:0/1294033669 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94439407432416] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb59c00a4d0 con 0x55e463543690 2024-09-10T05:38:24.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.632+0000 7fb5a356f640 1 -- 172.21.15.62:0/1294033669 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb594113030 con 0x55e463547b50 2024-09-10T05:38:24.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.632+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94439407437136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e463553b30 con 0x55e463547b50 2024-09-10T05:38:24.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.632+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e463555320 con 0x7fb594116060 2024-09-10T05:38:24.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.632+0000 7fb5a3d70640 1 -- 172.21.15.62:0/1294033669 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb59c00a4d0 con 0x7fb594116060 2024-09-10T05:38:24.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.632+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94439407439472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e463553b30 con 0x7fb594116060 2024-09-10T05:38:24.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.632+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e463555da0 con 0x55e463547b50 2024-09-10T05:38:24.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.632+0000 7fb5a3d70640 1 -- 172.21.15.62:0/1294033669 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94439407439472] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb59c00a4d0 con 0x7fb594116060 2024-09-10T05:38:24.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.632+0000 7fb5a356f640 1 -- 172.21.15.62:0/1294033669 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94439407437136] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb594113030 con 0x55e463547b50 2024-09-10T05:38:24.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.636+0000 7fb5a356f640 1 -- 172.21.15.62:0/1294033669 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb594113030 con 0x55e463547b50 2024-09-10T05:38:24.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.636+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94439407430288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4635558b0 con 0x55e463547b50 2024-09-10T05:38:24.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.636+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4635561a0 con 0x55e46354b350 2024-09-10T05:38:24.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.636+0000 7fb5a2d6e640 1 -- 172.21.15.62:0/1294033669 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb58c00bd60 con 0x55e46354b350 2024-09-10T05:38:24.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.636+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94439407442096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e463555cd0 con 0x55e46354b350 2024-09-10T05:38:24.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.636+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4635570a0 con 0x55e46354b350 2024-09-10T05:38:24.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.636+0000 7fb5a356f640 1 -- 172.21.15.62:0/1294033669 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94439407430288] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb594113030 con 0x55e463547b50 2024-09-10T05:38:24.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.636+0000 7fb5a2d6e640 1 -- 172.21.15.62:0/1294033669 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94439407442096] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb58c00bd60 con 0x55e46354b350 2024-09-10T05:38:24.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.636+0000 7fb5a2d6e640 1 -- 172.21.15.62:0/1294033669 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb58c00bd60 con 0x55e46354b350 2024-09-10T05:38:24.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.636+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94439407445392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e463556bb0 con 0x55e46354b350 2024-09-10T05:38:24.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.636+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e463557940 con 0x7fb594116060 2024-09-10T05:38:24.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.640+0000 7fb5a2d6e640 1 -- 172.21.15.62:0/1294033669 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94439407445392] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb58c00bd60 con 0x55e46354b350 2024-09-10T05:38:24.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.640+0000 7fb5a3d70640 1 -- 172.21.15.62:0/1294033669 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb59c00a4d0 con 0x7fb594116060 2024-09-10T05:38:24.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.640+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94439407440528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e463556bb0 con 0x7fb594116060 2024-09-10T05:38:24.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.640+0000 7fb5a5a699c0 20 add_watcher() i=0 2024-09-10T05:38:24.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.640+0000 7fb5a5a699c0 20 add_watcher() i=1 2024-09-10T05:38:24.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.640+0000 7fb5a5a699c0 20 add_watcher() i=2 2024-09-10T05:38:24.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.640+0000 7fb5a5a699c0 20 add_watcher() i=3 2024-09-10T05:38:24.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.640+0000 7fb5a5a699c0 20 add_watcher() i=4 2024-09-10T05:38:24.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.640+0000 7fb5a5a699c0 20 add_watcher() i=5 2024-09-10T05:38:24.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.640+0000 7fb5a5a699c0 20 add_watcher() i=6 2024-09-10T05:38:24.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.640+0000 7fb5a3d70640 1 -- 172.21.15.62:0/1294033669 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94439407440528] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb59c00a4d0 con 0x7fb594116060 2024-09-10T05:38:24.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.640+0000 7fb5a5a699c0 20 add_watcher() i=7 2024-09-10T05:38:24.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.640+0000 7fb5a5a699c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:38:24.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.640+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e46355a9a0 con 0x55e463543690 2024-09-10T05:38:24.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.640+0000 7fb5a3d70640 1 -- 172.21.15.62:0/1294033669 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb59c00a4d0 con 0x55e463543690 2024-09-10T05:38:24.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.640+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94439407449232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e463557ec0 con 0x55e463543690 2024-09-10T05:38:24.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.644+0000 7fb5a3d70640 1 -- 172.21.15.62:0/1294033669 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94439407449232] v34'268 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb59c00a4d0 con 0x55e463543690 2024-09-10T05:38:24.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.644+0000 7fb459fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:38:24.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.644+0000 7fb5a5a699c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:38:24.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.644+0000 7fb5a5a699c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:38:24.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.644+0000 7fb5a5a699c0 5 note: GC not initialized 2024-09-10T05:38:24.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.644+0000 7fb458fe1640 20 reqs_thread_entry: start 2024-09-10T05:38:24.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.644+0000 7fb5a5a699c0 20 init_complete bucket index max shards: 11 2024-09-10T05:38:24.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.644+0000 7fb5a5a699c0 20 Filter name: none 2024-09-10T05:38:24.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.644+0000 7fb3d27fc640 20 reqs_thread_entry: start 2024-09-10T05:38:24.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.644+0000 7fb5a5a699c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-10T05:38:24.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.644+0000 7fb5a5a699c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:24.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.644+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e46357dd30 con 0x55e463543690 2024-09-10T05:38:24.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.644+0000 7fb5a3d70640 1 -- 172.21.15.62:0/1294033669 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7fb59c00a4d0 con 0x55e463543690 2024-09-10T05:38:24.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.644+0000 7fb5a5a699c0 20 rados_obj.operate() r=0 bl.length=490 2024-09-10T05:38:24.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.644+0000 7fb5a5a699c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-10T05:38:24.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.644+0000 7fb5a5a699c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:38:24.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.644+0000 7fb5a5a699c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:38:24.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.644+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~503 in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e463584500 con 0x55e463543690 2024-09-10T05:38:24.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.644+0000 7fb5a3d70640 1 -- 172.21.15.62:0/1294033669 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~503] v34'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fb59c00a4d0 con 0x55e463543690 2024-09-10T05:38:24.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.644+0000 7fb5a5a699c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T05:38:24.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.644+0000 7fb5a5a699c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:38:24.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.644+0000 7fb5a5a699c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-10T05:38:24.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.644+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94439407632304 in=691b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e46357fc10 con 0x55e463547b50 2024-09-10T05:38:24.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.648+0000 7fb5a356f640 1 -- 172.21.15.62:0/1294033669 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== watch-notify(notify (1) cookie 94439407430288 notify 146028888117 ret 0) ==== 721+0+0 (crc 0 0 0) 0x55e463526100 con 0x55e463547b50 2024-09-10T05:38:24.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.648+0000 7fb486ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888117 cookie 94439407430288 notifier 4885 bl.length()=679 2024-09-10T05:38:24.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.648+0000 7fb486ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T05:38:24.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.648+0000 7fb486ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:38:24.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.648+0000 7fb5a356f640 1 -- 172.21.15.62:0/1294033669 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(64 notify.4 [notify cookie 94439407632304 out=8b] v0'0 uv264 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb594113030 con 0x55e463547b50 2024-09-10T05:38:24.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.648+0000 7fb486ffd640 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fb468003eb0 con 0x55e463547b50 2024-09-10T05:38:24.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.648+0000 7fb5a356f640 1 -- 172.21.15.62:0/1294033669 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb594113030 con 0x55e463547b50 2024-09-10T05:38:24.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.648+0000 7fb5a356f640 1 -- 172.21.15.62:0/1294033669 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== watch-notify(notify_complete (2) cookie 94439407632304 notify 146028888117 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e4635258a0 con 0x55e463547b50 2024-09-10T05:38:24.654 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-10T05:38:22.896781Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:38:22.896764Z","tags":[],"group_ids":[]} 2024-09-10T05:38:24.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.648+0000 7fb459fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:38:24.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.648+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94439407449232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e46357bb40 con 0x55e463543690 2024-09-10T05:38:24.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.652+0000 7fb5a3d70640 1 -- 172.21.15.62:0/1294033669 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94439407449232] v34'269 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb59c00a4d0 con 0x55e463543690 2024-09-10T05:38:24.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.652+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94439407426400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e46357bb40 con 0x55e463547b50 2024-09-10T05:38:24.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.652+0000 7fb5a356f640 1 -- 172.21.15.62:0/1294033669 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94439407426400] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb594113030 con 0x55e463547b50 2024-09-10T05:38:24.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.652+0000 7fb5a5a699c0 20 remove_watcher() i=0 2024-09-10T05:38:24.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.652+0000 7fb5a5a699c0 2 removed watcher, disabling cache 2024-09-10T05:38:24.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.652+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94439407432416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e46357bb40 con 0x55e463543690 2024-09-10T05:38:24.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.656+0000 7fb5a3d70640 1 -- 172.21.15.62:0/1294033669 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94439407432416] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb59c00a4d0 con 0x55e463543690 2024-09-10T05:38:24.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.656+0000 7fb5a5a699c0 20 remove_watcher() i=1 2024-09-10T05:38:24.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.656+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94439407437136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e46357bb40 con 0x55e463547b50 2024-09-10T05:38:24.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.656+0000 7fb5a356f640 1 -- 172.21.15.62:0/1294033669 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94439407437136] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb594113030 con 0x55e463547b50 2024-09-10T05:38:24.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.656+0000 7fb5a5a699c0 20 remove_watcher() i=2 2024-09-10T05:38:24.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.656+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94439407439472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e46357bb40 con 0x7fb594116060 2024-09-10T05:38:24.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.660+0000 7fb5a3d70640 1 -- 172.21.15.62:0/1294033669 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94439407439472] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb59c00a4d0 con 0x7fb594116060 2024-09-10T05:38:24.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.660+0000 7fb5a5a699c0 20 remove_watcher() i=3 2024-09-10T05:38:24.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.660+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94439407430288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e46357bb40 con 0x55e463547b50 2024-09-10T05:38:24.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.660+0000 7fb5a356f640 1 -- 172.21.15.62:0/1294033669 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94439407430288] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb594113030 con 0x55e463547b50 2024-09-10T05:38:24.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.660+0000 7fb5a5a699c0 20 remove_watcher() i=4 2024-09-10T05:38:24.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.660+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94439407442096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e46357bb40 con 0x55e46354b350 2024-09-10T05:38:24.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.664+0000 7fb5a2d6e640 1 -- 172.21.15.62:0/1294033669 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94439407442096] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb58c00bd60 con 0x55e46354b350 2024-09-10T05:38:24.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.664+0000 7fb5a5a699c0 20 remove_watcher() i=5 2024-09-10T05:38:24.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.664+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94439407445392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e46357bb40 con 0x55e46354b350 2024-09-10T05:38:24.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.664+0000 7fb5a2d6e640 1 -- 172.21.15.62:0/1294033669 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94439407445392] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb58c00bd60 con 0x55e46354b350 2024-09-10T05:38:24.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.664+0000 7fb5a5a699c0 20 remove_watcher() i=6 2024-09-10T05:38:24.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.664+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94439407440528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e46357bb40 con 0x7fb594116060 2024-09-10T05:38:24.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.664+0000 7fb5a3d70640 1 -- 172.21.15.62:0/1294033669 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94439407440528] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb59c00a4d0 con 0x7fb594116060 2024-09-10T05:38:24.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.664+0000 7fb5a5a699c0 20 remove_watcher() i=7 2024-09-10T05:38:24.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.664+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e463547b50 msgr2=0x55e463549f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.664+0000 7fb5a5a699c0 1 --2- 172.21.15.62:0/1294033669 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e463547b50 0x55e463549f40 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.664+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55e463543690 msgr2=0x55e463545b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.664+0000 7fb5a5a699c0 1 --2- 172.21.15.62:0/1294033669 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55e463543690 0x55e463545b50 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.664+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fb594116060 msgr2=0x7fb5940b0790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.664+0000 7fb5a5a699c0 1 --2- 172.21.15.62:0/1294033669 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fb594116060 0x7fb5940b0790 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.664+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55e46354b350 msgr2=0x55e46354d760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.664+0000 7fb5a5a699c0 1 --2- 172.21.15.62:0/1294033669 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55e46354b350 0x55e46354d760 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.664+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb46c039a70 msgr2=0x7fb46c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.664+0000 7fb5a5a699c0 1 --2- 172.21.15.62:0/1294033669 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb46c039a70 0x7fb46c03bf30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x55e463512b20 tx=0x7fb58c010000 comp rx=0 tx=0).stop 2024-09-10T05:38:24.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.664+0000 7fb5a3d70640 1 -- 172.21.15.62:0/1294033669 reap_dead start 2024-09-10T05:38:24.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.664+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e463531580 msgr2=0x55e463538820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.664+0000 7fb5a5a699c0 1 --2- 172.21.15.62:0/1294033669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e463531580 0x55e463538820 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fb5940e21c0 tx=0x7fb5940c8f50 comp rx=0 tx=0).stop 2024-09-10T05:38:24.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.664+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 shutdown_connections 2024-09-10T05:38:24.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.664+0000 7fb5a5a699c0 1 --2- 172.21.15.62:0/1294033669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e463531580 0x55e463538820 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.664+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 >> 172.21.15.62:0/1294033669 conn(0x55e46352d9b0 msgr2=0x55e46352bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:24.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.668+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 shutdown_connections 2024-09-10T05:38:24.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.668+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/1294033669 wait complete. 2024-09-10T05:38:24.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.668+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/3415115019 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb47c039b10 msgr2=0x7fb47c03bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.668+0000 7fb5a5a699c0 1 --2- 172.21.15.62:0/3415115019 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb47c039b10 0x7fb47c03bfd0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x55e463512ef0 tx=0x7fb58c00f000 comp rx=0 tx=0).stop 2024-09-10T05:38:24.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.668+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/3415115019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e463524e40 msgr2=0x55e463525260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.668+0000 7fb5a5a699c0 1 --2- 172.21.15.62:0/3415115019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e463524e40 0x55e463525260 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fb594003050 tx=0x7fb5940c1ee0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.668+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/3415115019 shutdown_connections 2024-09-10T05:38:24.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.668+0000 7fb5a5a699c0 1 --2- 172.21.15.62:0/3415115019 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb47c039b10 0x7fb47c03bfd0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.668+0000 7fb5a5a699c0 1 --2- 172.21.15.62:0/3415115019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e463524e40 0x55e463525260 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.668+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/3415115019 >> 172.21.15.62:0/3415115019 conn(0x55e46351a7f0 msgr2=0x55e46351abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:24.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.668+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/3415115019 shutdown_connections 2024-09-10T05:38:24.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.668+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/3415115019 wait complete. 2024-09-10T05:38:24.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.668+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/2729808399 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e46350f2c0 msgr2=0x55e463511780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.668+0000 7fb5a5a699c0 1 --2- 172.21.15.62:0/2729808399 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55e46350f2c0 0x55e463511780 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.668+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/2729808399 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55e463415120 msgr2=0x55e46350e2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.668+0000 7fb5a5a699c0 1 --2- 172.21.15.62:0/2729808399 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55e463415120 0x55e46350e2b0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.668+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/2729808399 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55e463513cb0 msgr2=0x55e4635160a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.668+0000 7fb5a5a699c0 1 --2- 172.21.15.62:0/2729808399 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55e463513cb0 0x55e4635160a0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.668+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/2729808399 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb488039a70 msgr2=0x7fb48803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.668+0000 7fb5a5a699c0 1 --2- 172.21.15.62:0/2729808399 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb488039a70 0x7fb48803bf30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb58c001e40 tx=0x7fb58c0013a0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.668+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/2729808399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e463386230 msgr2=0x55e4634122c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.668+0000 7fb5a5a699c0 1 --2- 172.21.15.62:0/2729808399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e463386230 0x55e4634122c0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fb59401b380 tx=0x7fb5940180e0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.668+0000 7fb5a3d70640 1 -- 172.21.15.62:0/2729808399 reap_dead start 2024-09-10T05:38:24.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.668+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/2729808399 shutdown_connections 2024-09-10T05:38:24.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.668+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/2729808399 >> 172.21.15.62:0/2729808399 conn(0x55e46340c910 msgr2=0x55e4634f7f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:24.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.668+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/2729808399 shutdown_connections 2024-09-10T05:38:24.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.668+0000 7fb5a5a699c0 1 -- 172.21.15.62:0/2729808399 wait complete. 2024-09-10T05:38:24.682 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T05:38:22.896781Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:38:22.896764Z', 'tags': [], 'group_ids': []} 2024-09-10T05:38:24.682 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T05:38:22.896781Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:38:22.896764Z', 'tags': [], 'group_ids': []} 2024-09-10T05:38:24.682 ERROR:root:0 2024-09-10T05:38:24.682 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T05:38:24.687 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T05:38:24.687 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-10T05:38:24.687 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-10T05:38:24.687 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write; user-info-without-keys=*' 2024-09-10T05:38:24.760 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:38:24.761 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:38:24.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.760+0000 7f2d4d7709c0 1 Processor -- start 2024-09-10T05:38:24.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.760+0000 7f2d4d7709c0 1 -- start start 2024-09-10T05:38:24.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.760+0000 7f2d4d7709c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5652cb6ae1f0 0x5652cb73f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.760+0000 7f2d4d7709c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5652cb5ee9c0 con 0x5652cb6ae5d0 2024-09-10T05:38:24.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.760+0000 7f2d4d7709c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x5652cb63e6d0 con 0x5652cb6ae1f0 2024-09-10T05:38:24.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.760+0000 7f2d4b276640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5652cb6ae1f0 0x5652cb73f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.760+0000 7f2d4b276640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5652cb6ae1f0 0x5652cb73f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:53702/0 (socket says 172.21.15.62:53702) 2024-09-10T05:38:24.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.760+0000 7f2d4b276640 1 -- 172.21.15.62:0/2949742449 learned_addr learned my addr 172.21.15.62:0/2949742449 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:24.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.760+0000 7f2d4b276640 1 -- 172.21.15.62:0/2949742449 >> v1:172.21.15.2:6789/0 conn(0x5652cb6ae5d0 legacy=0x5652cb741570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.760+0000 7f2d4b276640 1 -- 172.21.15.62:0/2949742449 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652cb5e2ca0 con 0x5652cb6ae1f0 2024-09-10T05:38:24.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.760+0000 7f2d4b276640 1 --2- 172.21.15.62:0/2949742449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5652cb6ae1f0 0x5652cb73f020 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c00a5c0 tx=0x7f2d3c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2faccefb35e1070 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.764+0000 7f2d4a274640 1 -- 172.21.15.62:0/2949742449 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d3c0a6070 con 0x5652cb6ae1f0 2024-09-10T05:38:24.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.764+0000 7f2d4a274640 1 -- 172.21.15.62:0/2949742449 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d3c0af070 con 0x5652cb6ae1f0 2024-09-10T05:38:24.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.764+0000 7f2d4a274640 1 -- 172.21.15.62:0/2949742449 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d3c0aa5c0 con 0x5652cb6ae1f0 2024-09-10T05:38:24.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.764+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/2949742449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5652cb6ae1f0 msgr2=0x5652cb73f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.764+0000 7f2d4d7709c0 1 --2- 172.21.15.62:0/2949742449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5652cb6ae1f0 0x5652cb73f020 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c00a5c0 tx=0x7f2d3c01b340 comp rx=0 tx=0).stop 2024-09-10T05:38:24.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.764+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/2949742449 shutdown_connections 2024-09-10T05:38:24.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.764+0000 7f2d4d7709c0 1 --2- 172.21.15.62:0/2949742449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5652cb6ae1f0 0x5652cb73f020 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.764+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/2949742449 >> 172.21.15.62:0/2949742449 conn(0x5652cb734910 msgr2=0x5652cb736d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:24.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.764+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/2949742449 shutdown_connections 2024-09-10T05:38:24.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.764+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/2949742449 wait complete. 2024-09-10T05:38:24.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.780+0000 7f2d4d7709c0 1 Processor -- start 2024-09-10T05:38:24.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.780+0000 7f2d4d7709c0 1 -- start start 2024-09-10T05:38:24.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.780+0000 7f2d4d7709c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5652cb6ae1f0 0x5652cb827910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.780+0000 7f2d4d7709c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5652cb642680 con 0x5652cb6ae1f0 2024-09-10T05:38:24.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.780+0000 7f2d4b276640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5652cb6ae1f0 0x5652cb827910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.780+0000 7f2d4b276640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5652cb6ae1f0 0x5652cb827910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:53710/0 (socket says 172.21.15.62:53710) 2024-09-10T05:38:24.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.780+0000 7f2d4b276640 1 -- 172.21.15.62:0/1077494554 learned_addr learned my addr 172.21.15.62:0/1077494554 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:24.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.780+0000 7f2d4b276640 1 -- 172.21.15.62:0/1077494554 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652cb5bdda0 con 0x5652cb6ae1f0 2024-09-10T05:38:24.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.780+0000 7f2d4b276640 1 --2- 172.21.15.62:0/1077494554 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5652cb6ae1f0 0x5652cb827910 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c018f70 tx=0x7f2d3c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34bb812c314dd5c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.780+0000 7f2c3960a640 1 -- 172.21.15.62:0/1077494554 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d3c0aa9e0 con 0x5652cb6ae1f0 2024-09-10T05:38:24.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.780+0000 7f2c3960a640 1 -- 172.21.15.62:0/1077494554 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d3c0aab80 con 0x5652cb6ae1f0 2024-09-10T05:38:24.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.780+0000 7f2c3960a640 1 -- 172.21.15.62:0/1077494554 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d3c0aae60 con 0x5652cb6ae1f0 2024-09-10T05:38:24.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.780+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1077494554 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5652cb6ae1f0 msgr2=0x5652cb827910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.780+0000 7f2d4d7709c0 1 --2- 172.21.15.62:0/1077494554 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5652cb6ae1f0 0x5652cb827910 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c018f70 tx=0x7f2d3c003030 comp rx=0 tx=0).stop 2024-09-10T05:38:24.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.780+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1077494554 shutdown_connections 2024-09-10T05:38:24.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.780+0000 7f2d4d7709c0 1 --2- 172.21.15.62:0/1077494554 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5652cb6ae1f0 0x5652cb827910 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.780+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1077494554 >> 172.21.15.62:0/1077494554 conn(0x5652cb734910 msgr2=0x5652cb823560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:24.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.780+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1077494554 shutdown_connections 2024-09-10T05:38:24.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.780+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1077494554 wait complete. 2024-09-10T05:38:24.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.780+0000 7f2d4d7709c0 1 Processor -- start 2024-09-10T05:38:24.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.780+0000 7f2d4d7709c0 1 -- start start 2024-09-10T05:38:24.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.780+0000 7f2d4d7709c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5652cb6ae1f0 0x5652cb82eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.780+0000 7f2d4d7709c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5652cb5e4a50 con 0x5652cb6ae1f0 2024-09-10T05:38:24.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.784+0000 7f2d4b276640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5652cb6ae1f0 0x5652cb82eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.784+0000 7f2d4b276640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5652cb6ae1f0 0x5652cb82eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:53716/0 (socket says 172.21.15.62:53716) 2024-09-10T05:38:24.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.784+0000 7f2d4b276640 1 -- 172.21.15.62:0/1896138533 learned_addr learned my addr 172.21.15.62:0/1896138533 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:24.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.784+0000 7f2d4b276640 1 -- 172.21.15.62:0/1896138533 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652cb82f420 con 0x5652cb6ae1f0 2024-09-10T05:38:24.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.784+0000 7f2d4b276640 1 --2- 172.21.15.62:0/1896138533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5652cb6ae1f0 0x5652cb82eec0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c000c10 tx=0x7f2d3c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.784+0000 7f2c37e07640 1 -- 172.21.15.62:0/1896138533 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d3c0c6750 con 0x5652cb6ae1f0 2024-09-10T05:38:24.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.784+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1896138533 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5652cb82f6b0 con 0x5652cb6ae1f0 2024-09-10T05:38:24.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.784+0000 7f2c37e07640 1 -- 172.21.15.62:0/1896138533 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d3c0c68f0 con 0x5652cb6ae1f0 2024-09-10T05:38:24.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.784+0000 7f2c37e07640 1 -- 172.21.15.62:0/1896138533 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d3c0c6bf0 con 0x5652cb6ae1f0 2024-09-10T05:38:24.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.784+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1896138533 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652cb830060 con 0x5652cb6ae1f0 2024-09-10T05:38:24.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.784+0000 7f2c37e07640 1 -- 172.21.15.62:0/1896138533 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2d3c0ce030 con 0x5652cb6ae1f0 2024-09-10T05:38:24.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.784+0000 7f2c37e07640 1 --2- 172.21.15.62:0/1896138533 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2c30039a70 0x7f2c3003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.784+0000 7f2c37e07640 1 -- 172.21.15.62:0/1896138533 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7f2d3c0cc020 con 0x5652cb6ae1f0 2024-09-10T05:38:24.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.784+0000 7f2d4d7709c0 1 --2- 172.21.15.62:0/1896138533 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5652cb6ae5d0 0x5652cb836030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.784+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1896138533 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5652cb836570 con 0x5652cb6ae5d0 2024-09-10T05:38:24.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.784+0000 7f2d4aa75640 1 --2- 172.21.15.62:0/1896138533 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2c30039a70 0x7f2c3003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.784+0000 7f2d4ba77640 1 --2- 172.21.15.62:0/1896138533 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5652cb6ae5d0 0x5652cb836030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.784+0000 7f2d4aa75640 1 --2- 172.21.15.62:0/1896138533 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2c30039a70 0x7f2c3003bf30 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2d40001e60 tx=0x7f2d400013e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.788+0000 7f2d4ba77640 1 --2- 172.21.15.62:0/1896138533 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5652cb6ae5d0 0x5652cb836030 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.788+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1896138533 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2d4400a4d0 con 0x5652cb6ae5d0 2024-09-10T05:38:24.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.788+0000 7f2d4d7709c0 1 --2- 172.21.15.62:0/1896138533 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5652cb837320 0x5652cb839710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.788+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1896138533 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5652cb839d40 con 0x5652cb837320 2024-09-10T05:38:24.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.788+0000 7f2d4b276640 1 --2- 172.21.15.62:0/1896138533 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5652cb837320 0x5652cb839710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.788+0000 7f2d4b276640 1 --2- 172.21.15.62:0/1896138533 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5652cb837320 0x5652cb839710 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.788+0000 7f2d4b276640 1 -- 172.21.15.62:0/1896138533 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2d3c0c53e0 con 0x5652cb837320 2024-09-10T05:38:24.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.788+0000 7f2d4d7709c0 1 --2- 172.21.15.62:0/1896138533 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5652cb83bb00 0x5652cb83def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.788+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1896138533 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5652cb83e5e0 con 0x5652cb83bb00 2024-09-10T05:38:24.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.788+0000 7f2d4aa75640 1 --2- 172.21.15.62:0/1896138533 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5652cb83bb00 0x5652cb83def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.788+0000 7f2d4aa75640 1 --2- 172.21.15.62:0/1896138533 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5652cb83bb00 0x5652cb83def0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.788+0000 7f2d4aa75640 1 -- 172.21.15.62:0/1896138533 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv5 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2d4000d040 con 0x5652cb83bb00 2024-09-10T05:38:24.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.788+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1896138533 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5652cb83a9a0 con 0x5652cb837320 2024-09-10T05:38:24.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.792+0000 7f2d4b276640 1 -- 172.21.15.62:0/1896138533 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2d3c0c53e0 con 0x5652cb837320 2024-09-10T05:38:24.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.792+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1896138533 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5652cb83ae00 con 0x5652cb83bb00 2024-09-10T05:38:24.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.792+0000 7f2d4aa75640 1 -- 172.21.15.62:0/1896138533 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2d4000d040 con 0x5652cb83bb00 2024-09-10T05:38:24.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.792+0000 7f2d4d7709c0 1 Processor -- start 2024-09-10T05:38:24.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.792+0000 7f2d4d7709c0 1 -- start start 2024-09-10T05:38:24.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.792+0000 7f2d4d7709c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5652cb84cc40 0x5652cb84d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.792+0000 7f2d4d7709c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5652cb64f450 con 0x5652cb84cc40 2024-09-10T05:38:24.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.792+0000 7f2d4b276640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5652cb84cc40 0x5652cb84d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.792+0000 7f2d4b276640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5652cb84cc40 0x5652cb84d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:53718/0 (socket says 172.21.15.62:53718) 2024-09-10T05:38:24.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.792+0000 7f2d4b276640 1 -- 172.21.15.62:0/3431312561 learned_addr learned my addr 172.21.15.62:0/3431312561 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:24.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.792+0000 7f2d4b276640 1 -- 172.21.15.62:0/3431312561 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652cb84d6a0 con 0x5652cb84cc40 2024-09-10T05:38:24.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.792+0000 7f2d4b276640 1 --2- 172.21.15.62:0/3431312561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5652cb84cc40 0x5652cb84d060 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c018f70 tx=0x7f2d3c0cf6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.792+0000 7f2c35602640 1 -- 172.21.15.62:0/3431312561 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d3c0d0970 con 0x5652cb84cc40 2024-09-10T05:38:24.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.792+0000 7f2c35602640 1 -- 172.21.15.62:0/3431312561 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d3c0e2e10 con 0x5652cb84cc40 2024-09-10T05:38:24.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.792+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/3431312561 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5652cb84df00 con 0x5652cb84cc40 2024-09-10T05:38:24.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.792+0000 7f2c35602640 1 -- 172.21.15.62:0/3431312561 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d3c0e30f0 con 0x5652cb84cc40 2024-09-10T05:38:24.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.792+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/3431312561 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652cb84e470 con 0x5652cb84cc40 2024-09-10T05:38:24.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.796+0000 7f2c35602640 1 -- 172.21.15.62:0/3431312561 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2d3c0f2060 con 0x5652cb84cc40 2024-09-10T05:38:24.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.796+0000 7f2c35602640 1 --2- 172.21.15.62:0/3431312561 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2c24039c60 0x7f2c2403c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.796+0000 7f2c35602640 1 -- 172.21.15.62:0/3431312561 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7f2d3c0e1030 con 0x5652cb84cc40 2024-09-10T05:38:24.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.796+0000 7f2d4aa75640 1 --2- 172.21.15.62:0/3431312561 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2c24039c60 0x7f2c2403c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.796+0000 7f2d4d7709c0 1 Processor -- start 2024-09-10T05:38:24.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.796+0000 7f2d4d7709c0 1 -- start start 2024-09-10T05:38:24.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.796+0000 7f2d4aa75640 1 --2- 172.21.15.62:0/3431312561 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2c24039c60 0x7f2c2403c120 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x5652cb830340 tx=0x7f2d40006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.796+0000 7f2d4d7709c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5652cb8593e0 0x5652cb8597c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.796+0000 7f2d4d7709c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5652cb8280a0 con 0x5652cb8593e0 2024-09-10T05:38:24.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.796+0000 7f2d4b276640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5652cb8593e0 0x5652cb8597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.796+0000 7f2d4b276640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5652cb8593e0 0x5652cb8597c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:53730/0 (socket says 172.21.15.62:53730) 2024-09-10T05:38:24.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.796+0000 7f2d4b276640 1 -- 172.21.15.62:0/2494145558 learned_addr learned my addr 172.21.15.62:0/2494145558 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:24.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.796+0000 7f2d4b276640 1 -- 172.21.15.62:0/2494145558 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652cb859d90 con 0x5652cb8593e0 2024-09-10T05:38:24.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.796+0000 7f2d4b276640 1 --2- 172.21.15.62:0/2494145558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5652cb8593e0 0x5652cb8597c0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c0c6e30 tx=0x7f2d3c0d96a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5720d796fdd58dc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.796+0000 7f2c2effd640 1 -- 172.21.15.62:0/2494145558 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d3c102020 con 0x5652cb8593e0 2024-09-10T05:38:24.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.796+0000 7f2c2effd640 1 -- 172.21.15.62:0/2494145558 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d3c0d9e10 con 0x5652cb8593e0 2024-09-10T05:38:24.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.796+0000 7f2c2effd640 1 -- 172.21.15.62:0/2494145558 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d3c0e8ac0 con 0x5652cb8593e0 2024-09-10T05:38:24.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.800+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/2494145558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5652cb8593e0 msgr2=0x5652cb8597c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.800+0000 7f2d4d7709c0 1 --2- 172.21.15.62:0/2494145558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5652cb8593e0 0x5652cb8597c0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c0c6e30 tx=0x7f2d3c0d96a0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.800+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/2494145558 shutdown_connections 2024-09-10T05:38:24.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.800+0000 7f2d4d7709c0 1 --2- 172.21.15.62:0/2494145558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5652cb8593e0 0x5652cb8597c0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.800+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/2494145558 >> 172.21.15.62:0/2494145558 conn(0x5652cb855810 msgr2=0x5652cb853a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:24.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.800+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/2494145558 shutdown_connections 2024-09-10T05:38:24.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.800+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/2494145558 wait complete. 2024-09-10T05:38:24.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.800+0000 7f2d4d7709c0 1 Processor -- start 2024-09-10T05:38:24.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.800+0000 7f2d4d7709c0 1 -- start start 2024-09-10T05:38:24.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.800+0000 7f2d4d7709c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5652cb8593e0 0x5652cb860680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.800+0000 7f2d4d7709c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5652cb85a270 con 0x5652cb8593e0 2024-09-10T05:38:24.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.800+0000 7f2d4b276640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5652cb8593e0 0x5652cb860680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.800+0000 7f2d4b276640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5652cb8593e0 0x5652cb860680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:53744/0 (socket says 172.21.15.62:53744) 2024-09-10T05:38:24.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.800+0000 7f2d4b276640 1 -- 172.21.15.62:0/1379205031 learned_addr learned my addr 172.21.15.62:0/1379205031 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:24.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.800+0000 7f2d4b276640 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652cb860be0 con 0x5652cb8593e0 2024-09-10T05:38:24.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.800+0000 7f2d4b276640 1 --2- 172.21.15.62:0/1379205031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5652cb8593e0 0x5652cb860680 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c0b0f70 tx=0x7f2d3c0b0f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.800+0000 7f2c2d7fa640 1 -- 172.21.15.62:0/1379205031 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d3c117070 con 0x5652cb8593e0 2024-09-10T05:38:24.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.800+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5652cb860be0 con 0x5652cb8593e0 2024-09-10T05:38:24.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.800+0000 7f2c2d7fa640 1 -- 172.21.15.62:0/1379205031 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d3c0c5800 con 0x5652cb8593e0 2024-09-10T05:38:24.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.800+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652cb8610a0 con 0x5652cb8593e0 2024-09-10T05:38:24.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.800+0000 7f2c2d7fa640 1 -- 172.21.15.62:0/1379205031 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d3c121060 con 0x5652cb8593e0 2024-09-10T05:38:24.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.800+0000 7f2c2d7fa640 1 -- 172.21.15.62:0/1379205031 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2d3c11a070 con 0x5652cb8593e0 2024-09-10T05:38:24.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.804+0000 7f2c2d7fa640 1 --2- 172.21.15.62:0/1379205031 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2c14039a70 0x7f2c1403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.804+0000 7f2c2d7fa640 1 -- 172.21.15.62:0/1379205031 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7f2d3c10d030 con 0x5652cb8593e0 2024-09-10T05:38:24.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.804+0000 7f2d4aa75640 1 --2- 172.21.15.62:0/1379205031 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2c14039a70 0x7f2c1403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.804+0000 7f2d4d7709c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:24.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.804+0000 7f2d4d7709c0 1 --2- 172.21.15.62:0/1379205031 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5652cb86b4c0 0x5652cb86d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.804+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5652cb86e0a0 con 0x5652cb86b4c0 2024-09-10T05:38:24.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.804+0000 7f2d4ba77640 1 --2- 172.21.15.62:0/1379205031 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5652cb86b4c0 0x5652cb86d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.804+0000 7f2d4aa75640 1 --2- 172.21.15.62:0/1379205031 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2c14039a70 0x7f2c1403bf30 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x5652cb83e9b0 tx=0x7f2d40011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.804+0000 7f2d4ba77640 1 --2- 172.21.15.62:0/1379205031 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5652cb86b4c0 0x5652cb86d950 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.804+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1379205031 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2d4400a4d0 con 0x5652cb86b4c0 2024-09-10T05:38:24.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.804+0000 7f2d4d7709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:24.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.804+0000 7f2d4d7709c0 20 realm 2024-09-10T05:38:24.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.804+0000 7f2d4d7709c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:24.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.804+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5652cb86a850 con 0x5652cb86b4c0 2024-09-10T05:38:24.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.804+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1379205031 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2d4400a4d0 con 0x5652cb86b4c0 2024-09-10T05:38:24.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.804+0000 7f2d4d7709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:24.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.804+0000 7f2d4d7709c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:38:24.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.804+0000 7f2d4d7709c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:24.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.804+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5652cb86eb60 con 0x5652cb86b4c0 2024-09-10T05:38:24.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.804+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1379205031 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2d4400a4d0 con 0x5652cb86b4c0 2024-09-10T05:38:24.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.804+0000 7f2d4d7709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:24.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.804+0000 7f2d4d7709c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:24.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.804+0000 7f2d4d7709c0 1 --2- 172.21.15.62:0/1379205031 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5652cb86f940 0x5652cb871d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.804+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5652cb872400 con 0x5652cb86f940 2024-09-10T05:38:24.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.804+0000 7f2d4b276640 1 --2- 172.21.15.62:0/1379205031 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5652cb86f940 0x5652cb871d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.804+0000 7f2d4b276640 1 --2- 172.21.15.62:0/1379205031 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5652cb86f940 0x5652cb871d30 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.808+0000 7f2d4b276640 1 -- 172.21.15.62:0/1379205031 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2d3c119030 con 0x5652cb86f940 2024-09-10T05:38:24.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.808+0000 7f2d4d7709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:38:24.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.808+0000 7f2d4d7709c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:24.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.808+0000 7f2d4d7709c0 1 --2- 172.21.15.62:0/1379205031 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5652cb873160 0x5652cb875570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.808+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5652cb875d00 con 0x5652cb873160 2024-09-10T05:38:24.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.808+0000 7f2d4aa75640 1 --2- 172.21.15.62:0/1379205031 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5652cb873160 0x5652cb875570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.808+0000 7f2d4aa75640 1 --2- 172.21.15.62:0/1379205031 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5652cb873160 0x5652cb875570 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.808+0000 7f2d4aa75640 1 -- 172.21.15.62:0/1379205031 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv5 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2d4000d040 con 0x5652cb873160 2024-09-10T05:38:24.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.808+0000 7f2d4d7709c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:38:24.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.808+0000 7f2d4d7709c0 20 searching for the correct realm 2024-09-10T05:38:24.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.808+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5652cb8775d0 con 0x5652cb873160 2024-09-10T05:38:24.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.808+0000 7f2d4aa75640 1 -- 172.21.15.62:0/1379205031 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d4000d040 con 0x5652cb873160 2024-09-10T05:38:24.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.808+0000 7f2d4aa75640 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5652cb8775d0 con 0x5652cb86f940 2024-09-10T05:38:24.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.808+0000 7f2d4b276640 1 -- 172.21.15.62:0/1379205031 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d3c119030 con 0x5652cb86f940 2024-09-10T05:38:24.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.808+0000 7f2d4b276640 1 --2- 172.21.15.62:0/1379205031 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f2d3c11c060 0x7f2d3c0e3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.808+0000 7f2d4b276640 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5652cb8775d0 con 0x7f2d3c11c060 2024-09-10T05:38:24.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.808+0000 7f2d4ba77640 1 --2- 172.21.15.62:0/1379205031 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f2d3c11c060 0x7f2d3c0e3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.808+0000 7f2d4ba77640 1 --2- 172.21.15.62:0/1379205031 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f2d3c11c060 0x7f2d3c0e3570 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.808+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1379205031 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d4400a4d0 con 0x7f2d3c11c060 2024-09-10T05:38:24.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.808+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5652cb8775d0 con 0x5652cb86b4c0 2024-09-10T05:38:24.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.808+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1379205031 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d4400a4d0 con 0x5652cb86b4c0 2024-09-10T05:38:24.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.808+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5652cb8775d0 con 0x5652cb86b4c0 2024-09-10T05:38:24.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.808+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1379205031 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d4400a4d0 con 0x5652cb86b4c0 2024-09-10T05:38:24.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.808+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5652cb8775d0 con 0x5652cb873160 2024-09-10T05:38:24.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.812+0000 7f2d4aa75640 1 -- 172.21.15.62:0/1379205031 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d4000d040 con 0x5652cb873160 2024-09-10T05:38:24.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.812+0000 7f2d4aa75640 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5652cb8775d0 con 0x5652cb86b4c0 2024-09-10T05:38:24.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.812+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1379205031 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d4400a4d0 con 0x5652cb86b4c0 2024-09-10T05:38:24.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.812+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5652cb8775d0 con 0x5652cb86f940 2024-09-10T05:38:24.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.812+0000 7f2d4b276640 1 -- 172.21.15.62:0/1379205031 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d3c119030 con 0x5652cb86f940 2024-09-10T05:38:24.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.812+0000 7f2d4b276640 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5652cb8775d0 con 0x5652cb86f940 2024-09-10T05:38:24.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.812+0000 7f2d4b276640 1 -- 172.21.15.62:0/1379205031 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d3c119030 con 0x5652cb86f940 2024-09-10T05:38:24.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.812+0000 7f2d4b276640 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5652cb8775d0 con 0x5652cb86b4c0 2024-09-10T05:38:24.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.812+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1379205031 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d4400a4d0 con 0x5652cb86b4c0 2024-09-10T05:38:24.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.812+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5652cb8775d0 con 0x7f2d3c11c060 2024-09-10T05:38:24.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.812+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1379205031 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d4400a4d0 con 0x7f2d3c11c060 2024-09-10T05:38:24.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.812+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5652cb8775d0 con 0x5652cb86b4c0 2024-09-10T05:38:24.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.812+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1379205031 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d4400a4d0 con 0x5652cb86b4c0 2024-09-10T05:38:24.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.812+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5652cb8775d0 con 0x7f2d3c11c060 2024-09-10T05:38:24.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.812+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1379205031 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2d4400a4d0 con 0x7f2d3c11c060 2024-09-10T05:38:24.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.812+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5652cb8775d0 con 0x5652cb86f940 2024-09-10T05:38:24.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.812+0000 7f2d4b276640 1 -- 172.21.15.62:0/1379205031 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d3c119030 con 0x5652cb86f940 2024-09-10T05:38:24.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.812+0000 7f2d4b276640 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5652cb8775d0 con 0x5652cb873160 2024-09-10T05:38:24.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.812+0000 7f2d4aa75640 1 -- 172.21.15.62:0/1379205031 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d4000d040 con 0x5652cb873160 2024-09-10T05:38:24.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.812+0000 7f2d4aa75640 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5652cb8775d0 con 0x5652cb86b4c0 2024-09-10T05:38:24.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.816+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1379205031 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d4400a4d0 con 0x5652cb86b4c0 2024-09-10T05:38:24.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.816+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5652cb8775d0 con 0x5652cb86f940 2024-09-10T05:38:24.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.816+0000 7f2d4b276640 1 -- 172.21.15.62:0/1379205031 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d3c119030 con 0x5652cb86f940 2024-09-10T05:38:24.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.816+0000 7f2d4b276640 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5652cb8775d0 con 0x5652cb873160 2024-09-10T05:38:24.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.816+0000 7f2d4aa75640 1 -- 172.21.15.62:0/1379205031 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 34 out=170b] v34'5 uv5 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f2d4000d040 con 0x5652cb873160 2024-09-10T05:38:24.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.816+0000 7f2d4aa75640 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5652cb8775d0 con 0x5652cb86b4c0 2024-09-10T05:38:24.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.816+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1379205031 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d4400a4d0 con 0x5652cb86b4c0 2024-09-10T05:38:24.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.816+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5652cb8775d0 con 0x5652cb86b4c0 2024-09-10T05:38:24.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.816+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1379205031 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2d4400a4d0 con 0x5652cb86b4c0 2024-09-10T05:38:24.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.816+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5652cb8775d0 con 0x5652cb86b4c0 2024-09-10T05:38:24.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.816+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1379205031 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d4400a4d0 con 0x5652cb86b4c0 2024-09-10T05:38:24.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.816+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5652cb8775d0 con 0x5652cb873160 2024-09-10T05:38:24.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.816+0000 7f2d4aa75640 1 -- 172.21.15.62:0/1379205031 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d4000d040 con 0x5652cb873160 2024-09-10T05:38:24.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.816+0000 7f2d4aa75640 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5652cb8775d0 con 0x7f2d3c11c060 2024-09-10T05:38:24.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.816+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1379205031 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d4400a4d0 con 0x7f2d3c11c060 2024-09-10T05:38:24.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.816+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5652cb8775d0 con 0x5652cb86b4c0 2024-09-10T05:38:24.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.816+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1379205031 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d4400a4d0 con 0x5652cb86b4c0 2024-09-10T05:38:24.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.816+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5652cb8775d0 con 0x7f2d3c11c060 2024-09-10T05:38:24.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.816+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1379205031 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d4400a4d0 con 0x7f2d3c11c060 2024-09-10T05:38:24.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.816+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5652cb8775d0 con 0x5652cb873160 2024-09-10T05:38:24.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.816+0000 7f2d4aa75640 1 -- 172.21.15.62:0/1379205031 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d4000d040 con 0x5652cb873160 2024-09-10T05:38:24.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.816+0000 7f2d4aa75640 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5652cb8775d0 con 0x7f2d3c11c060 2024-09-10T05:38:24.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.820+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1379205031 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d4400a4d0 con 0x7f2d3c11c060 2024-09-10T05:38:24.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.820+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5652cb8775d0 con 0x5652cb86f940 2024-09-10T05:38:24.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.820+0000 7f2d4b276640 1 -- 172.21.15.62:0/1379205031 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d3c119030 con 0x5652cb86f940 2024-09-10T05:38:24.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.820+0000 7f2d4b276640 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5652cb8775d0 con 0x5652cb86f940 2024-09-10T05:38:24.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.820+0000 7f2d4b276640 1 -- 172.21.15.62:0/1379205031 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d3c119030 con 0x5652cb86f940 2024-09-10T05:38:24.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.820+0000 7f2d4b276640 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5652cb8775d0 con 0x5652cb873160 2024-09-10T05:38:24.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.820+0000 7f2d4aa75640 1 -- 172.21.15.62:0/1379205031 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d4000d040 con 0x5652cb873160 2024-09-10T05:38:24.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.820+0000 7f2d4aa75640 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5652cb8775d0 con 0x5652cb86f940 2024-09-10T05:38:24.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.820+0000 7f2d4b276640 1 -- 172.21.15.62:0/1379205031 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2d3c119030 con 0x5652cb86f940 2024-09-10T05:38:24.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.820+0000 7f2d4b276640 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5652cb8775d0 con 0x5652cb86f940 2024-09-10T05:38:24.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.820+0000 7f2d4b276640 1 -- 172.21.15.62:0/1379205031 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d3c119030 con 0x5652cb86f940 2024-09-10T05:38:24.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.820+0000 7f2d4d7709c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:38:24.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.820+0000 7f2d4d7709c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:38:24.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.820+0000 7f2d4d7709c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:38:24.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.820+0000 7f2d4d7709c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:38:24.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.820+0000 7f2d4d7709c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:38:24.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.820+0000 7f2d4d7709c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:38:24.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.820+0000 7f2d4d7709c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:24.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.820+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5652cb8766c0 con 0x5652cb86b4c0 2024-09-10T05:38:24.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.824+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1379205031 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2d4400a4d0 con 0x5652cb86b4c0 2024-09-10T05:38:24.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.824+0000 7f2d4d7709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:24.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.824+0000 7f2d4d7709c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:24.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.824+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5652cb876f60 con 0x5652cb86f940 2024-09-10T05:38:24.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.824+0000 7f2d4b276640 1 -- 172.21.15.62:0/1379205031 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2d3c119030 con 0x5652cb86f940 2024-09-10T05:38:24.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.824+0000 7f2d4d7709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:38:24.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.824+0000 7f2d4d7709c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:24.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.824+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5652cb876300 con 0x5652cb873160 2024-09-10T05:38:24.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.824+0000 7f2d4aa75640 1 -- 172.21.15.62:0/1379205031 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2d4000d040 con 0x5652cb873160 2024-09-10T05:38:24.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.824+0000 7f2d4d7709c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:38:24.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.824+0000 7f2d4d7709c0 20 zone default found 2024-09-10T05:38:24.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.824+0000 7f2d4d7709c0 4 Realm: () 2024-09-10T05:38:24.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.824+0000 7f2d4d7709c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:38:24.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.824+0000 7f2d4d7709c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:38:24.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.824+0000 7f2d4d7709c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:38:24.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.824+0000 7f2d4d7709c0 20 zonegroup default 2024-09-10T05:38:24.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.824+0000 7f2d4d7709c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:24.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.824+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5652cb877eb0 con 0x7f2d3c11c060 2024-09-10T05:38:24.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.824+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1379205031 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2d4400a4d0 con 0x7f2d3c11c060 2024-09-10T05:38:24.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.824+0000 7f2d4d7709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:24.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.824+0000 7f2d4d7709c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:24.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.824+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5652cb87a0f0 con 0x5652cb873160 2024-09-10T05:38:24.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.824+0000 7f2d4aa75640 1 -- 172.21.15.62:0/1379205031 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2d4000d040 con 0x5652cb873160 2024-09-10T05:38:24.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.824+0000 7f2d4d7709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:24.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.824+0000 7f2d4d7709c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:24.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.824+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5652cb87a490 con 0x5652cb873160 2024-09-10T05:38:24.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.824+0000 7f2d4aa75640 1 -- 172.21.15.62:0/1379205031 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2d4000d040 con 0x5652cb873160 2024-09-10T05:38:24.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.824+0000 7f2d4d7709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:24.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.824+0000 7f2d4d7709c0 20 started sync module instance, tier type = 2024-09-10T05:38:24.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.824+0000 7f2d4d7709c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:38:24.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.824+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5652cb879530 con 0x5652cb86f940 2024-09-10T05:38:24.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.828+0000 7f2d4b276640 1 -- 172.21.15.62:0/1379205031 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d3c119030 con 0x5652cb86f940 2024-09-10T05:38:24.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.828+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94913601966208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5652cb87a880 con 0x5652cb86f940 2024-09-10T05:38:24.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.828+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5652cb87b0d0 con 0x5652cb86b4c0 2024-09-10T05:38:24.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.828+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1379205031 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d4400a4d0 con 0x5652cb86b4c0 2024-09-10T05:38:24.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.828+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94913601973280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5652cb87b960 con 0x5652cb86b4c0 2024-09-10T05:38:24.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.828+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5652cb87c460 con 0x5652cb86f940 2024-09-10T05:38:24.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.828+0000 7f2d4b276640 1 -- 172.21.15.62:0/1379205031 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94913601966208] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d3c119030 con 0x5652cb86f940 2024-09-10T05:38:24.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.832+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1379205031 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94913601973280] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d4400a4d0 con 0x5652cb86b4c0 2024-09-10T05:38:24.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.832+0000 7f2d4b276640 1 -- 172.21.15.62:0/1379205031 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d3c119030 con 0x5652cb86f940 2024-09-10T05:38:24.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.832+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94913601978192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5652cb87c420 con 0x5652cb86f940 2024-09-10T05:38:24.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.832+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5652cb87cd00 con 0x7f2d3c11c060 2024-09-10T05:38:24.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.832+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1379205031 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d4400a4d0 con 0x7f2d3c11c060 2024-09-10T05:38:24.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.832+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94913601980496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5652cb87c420 con 0x7f2d3c11c060 2024-09-10T05:38:24.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.832+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5652cb87d7b0 con 0x5652cb86f940 2024-09-10T05:38:24.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.832+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1379205031 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94913601980496] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d4400a4d0 con 0x7f2d3c11c060 2024-09-10T05:38:24.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.836+0000 7f2d4b276640 1 -- 172.21.15.62:0/1379205031 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94913601978192] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d3c119030 con 0x5652cb86f940 2024-09-10T05:38:24.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.836+0000 7f2d4b276640 1 -- 172.21.15.62:0/1379205031 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d3c119030 con 0x5652cb86f940 2024-09-10T05:38:24.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.836+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94913601968416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5652cb87d7b0 con 0x5652cb86f940 2024-09-10T05:38:24.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.836+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5652cb87dba0 con 0x5652cb873160 2024-09-10T05:38:24.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.836+0000 7f2d4aa75640 1 -- 172.21.15.62:0/1379205031 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d4000d040 con 0x5652cb873160 2024-09-10T05:38:24.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.836+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94913601981552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5652cb87dba0 con 0x5652cb873160 2024-09-10T05:38:24.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.836+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5652cb87eaa0 con 0x5652cb873160 2024-09-10T05:38:24.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.836+0000 7f2d4b276640 1 -- 172.21.15.62:0/1379205031 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94913601968416] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d3c119030 con 0x5652cb86f940 2024-09-10T05:38:24.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.836+0000 7f2d4aa75640 1 -- 172.21.15.62:0/1379205031 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94913601981552] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d4000d040 con 0x5652cb873160 2024-09-10T05:38:24.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.836+0000 7f2d4aa75640 1 -- 172.21.15.62:0/1379205031 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d4000d040 con 0x5652cb873160 2024-09-10T05:38:24.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.840+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94913601986448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5652cb87e5b0 con 0x5652cb873160 2024-09-10T05:38:24.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.840+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5652cb87f340 con 0x7f2d3c11c060 2024-09-10T05:38:24.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.840+0000 7f2d4aa75640 1 -- 172.21.15.62:0/1379205031 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94913601986448] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d4000d040 con 0x5652cb873160 2024-09-10T05:38:24.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.840+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1379205031 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d4400a4d0 con 0x7f2d3c11c060 2024-09-10T05:38:24.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.840+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94913601983168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5652cb87e5b0 con 0x7f2d3c11c060 2024-09-10T05:38:24.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.840+0000 7f2d4d7709c0 20 add_watcher() i=0 2024-09-10T05:38:24.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.840+0000 7f2d4d7709c0 20 add_watcher() i=1 2024-09-10T05:38:24.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.840+0000 7f2d4d7709c0 20 add_watcher() i=2 2024-09-10T05:38:24.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.840+0000 7f2d4d7709c0 20 add_watcher() i=3 2024-09-10T05:38:24.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.840+0000 7f2d4d7709c0 20 add_watcher() i=4 2024-09-10T05:38:24.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.840+0000 7f2d4d7709c0 20 add_watcher() i=5 2024-09-10T05:38:24.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.840+0000 7f2d4d7709c0 20 add_watcher() i=6 2024-09-10T05:38:24.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.840+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1379205031 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94913601983168] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d4400a4d0 con 0x7f2d3c11c060 2024-09-10T05:38:24.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.840+0000 7f2d4d7709c0 20 add_watcher() i=7 2024-09-10T05:38:24.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.840+0000 7f2d4d7709c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:38:24.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.840+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5652cb8823d0 con 0x5652cb86b4c0 2024-09-10T05:38:24.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.840+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1379205031 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2d4400a4d0 con 0x5652cb86b4c0 2024-09-10T05:38:24.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.840+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94913601990288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5652cb87f920 con 0x5652cb86b4c0 2024-09-10T05:38:24.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.844+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1379205031 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94913601990288] v34'270 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2d4400a4d0 con 0x5652cb86b4c0 2024-09-10T05:38:24.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.844+0000 7f2c01fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:38:24.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.844+0000 7f2d4d7709c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:38:24.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.844+0000 7f2d4d7709c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:38:24.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.844+0000 7f2d4d7709c0 5 note: GC not initialized 2024-09-10T05:38:24.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.844+0000 7f2c00fe1640 20 reqs_thread_entry: start 2024-09-10T05:38:24.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.844+0000 7f2d4d7709c0 20 init_complete bucket index max shards: 11 2024-09-10T05:38:24.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.844+0000 7f2d4d7709c0 20 Filter name: none 2024-09-10T05:38:24.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.844+0000 7f2b7a7fc640 20 reqs_thread_entry: start 2024-09-10T05:38:24.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.844+0000 7f2d4d7709c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-10T05:38:24.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.844+0000 7f2d4d7709c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:24.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.844+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5652cb8a56a0 con 0x5652cb86b4c0 2024-09-10T05:38:24.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.844+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1379205031 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(62 ada [call out=48b,read 0~503 out=503b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+626 (crc 0 0 0) 0x7f2d4400a4d0 con 0x5652cb86b4c0 2024-09-10T05:38:24.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.844+0000 7f2d4d7709c0 20 rados_obj.operate() r=0 bl.length=503 2024-09-10T05:38:24.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.844+0000 7f2d4d7709c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-10T05:38:24.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.844+0000 7f2d4d7709c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:38:24.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.844+0000 7f2d4d7709c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:38:24.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.844+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5652cb8abf40 con 0x5652cb86b4c0 2024-09-10T05:38:24.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.844+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1379205031 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v34'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f2d4400a4d0 con 0x5652cb86b4c0 2024-09-10T05:38:24.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.848+0000 7f2d4d7709c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T05:38:24.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.848+0000 7f2d4d7709c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:38:24.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.848+0000 7f2d4d7709c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-10T05:38:24.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.848+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94913602173424 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5652cb8a76f0 con 0x5652cb86f940 2024-09-10T05:38:24.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.848+0000 7f2d4b276640 1 -- 172.21.15.62:0/1379205031 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== watch-notify(notify (1) cookie 94913601968416 notify 146028888118 ret 0) ==== 678+0+0 (crc 0 0 0) 0x5652cb84df00 con 0x5652cb86f940 2024-09-10T05:38:24.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.848+0000 7f2c2effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888118 cookie 94913601968416 notifier 4892 bl.length()=636 2024-09-10T05:38:24.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.848+0000 7f2c2effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T05:38:24.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.848+0000 7f2c2effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:38:24.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.848+0000 7f2d4b276640 1 -- 172.21.15.62:0/1379205031 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(64 notify.4 [notify cookie 94913602173424 out=8b] v0'0 uv267 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2d3c119030 con 0x5652cb86f940 2024-09-10T05:38:24.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.848+0000 7f2c2effd640 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f2c10003eb0 con 0x5652cb86f940 2024-09-10T05:38:24.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.848+0000 7f2d4b276640 1 -- 172.21.15.62:0/1379205031 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== watch-notify(notify_complete (2) cookie 94913602173424 notify 146028888118 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5652cb84d6a0 con 0x5652cb86f940 2024-09-10T05:38:24.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.848+0000 7f2d4b276640 1 -- 172.21.15.62:0/1379205031 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d3c119030 con 0x5652cb86f940 2024-09-10T05:38:24.852 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-10T05:38:22.896781Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:38:22.896764Z","tags":[],"group_ids":[]} 2024-09-10T05:38:24.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.848+0000 7f2c01fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:38:24.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.848+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94913601990288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5652cb8a3470 con 0x5652cb86b4c0 2024-09-10T05:38:24.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.852+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1379205031 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94913601990288] v34'271 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2d4400a4d0 con 0x5652cb86b4c0 2024-09-10T05:38:24.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.852+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94913601966208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5652cb8a3470 con 0x5652cb86f940 2024-09-10T05:38:24.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.856+0000 7f2d4b276640 1 -- 172.21.15.62:0/1379205031 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94913601966208] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d3c119030 con 0x5652cb86f940 2024-09-10T05:38:24.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.856+0000 7f2d4d7709c0 20 remove_watcher() i=0 2024-09-10T05:38:24.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.856+0000 7f2d4d7709c0 2 removed watcher, disabling cache 2024-09-10T05:38:24.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.856+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94913601973280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5652cb8a3470 con 0x5652cb86b4c0 2024-09-10T05:38:24.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.856+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1379205031 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94913601973280] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d4400a4d0 con 0x5652cb86b4c0 2024-09-10T05:38:24.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.856+0000 7f2d4d7709c0 20 remove_watcher() i=1 2024-09-10T05:38:24.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.856+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94913601978192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5652cb8a3470 con 0x5652cb86f940 2024-09-10T05:38:24.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.860+0000 7f2d4b276640 1 -- 172.21.15.62:0/1379205031 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94913601978192] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d3c119030 con 0x5652cb86f940 2024-09-10T05:38:24.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.860+0000 7f2d4d7709c0 20 remove_watcher() i=2 2024-09-10T05:38:24.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.860+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94913601980496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5652cb8a3470 con 0x7f2d3c11c060 2024-09-10T05:38:24.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.860+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1379205031 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94913601980496] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d4400a4d0 con 0x7f2d3c11c060 2024-09-10T05:38:24.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.860+0000 7f2d4d7709c0 20 remove_watcher() i=3 2024-09-10T05:38:24.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.860+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94913601968416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5652cb8a3470 con 0x5652cb86f940 2024-09-10T05:38:24.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.860+0000 7f2d4b276640 1 -- 172.21.15.62:0/1379205031 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94913601968416] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d3c119030 con 0x5652cb86f940 2024-09-10T05:38:24.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.860+0000 7f2d4d7709c0 20 remove_watcher() i=4 2024-09-10T05:38:24.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.860+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94913601981552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5652cb8a3470 con 0x5652cb873160 2024-09-10T05:38:24.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.864+0000 7f2d4aa75640 1 -- 172.21.15.62:0/1379205031 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94913601981552] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d4000d040 con 0x5652cb873160 2024-09-10T05:38:24.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.864+0000 7f2d4d7709c0 20 remove_watcher() i=5 2024-09-10T05:38:24.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.864+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94913601986448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5652cb8a3470 con 0x5652cb873160 2024-09-10T05:38:24.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.864+0000 7f2d4aa75640 1 -- 172.21.15.62:0/1379205031 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94913601986448] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d4000d040 con 0x5652cb873160 2024-09-10T05:38:24.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.864+0000 7f2d4d7709c0 20 remove_watcher() i=6 2024-09-10T05:38:24.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.864+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94913601983168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5652cb8a3470 con 0x7f2d3c11c060 2024-09-10T05:38:24.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.864+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1379205031 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94913601983168] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d4400a4d0 con 0x7f2d3c11c060 2024-09-10T05:38:24.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.864+0000 7f2d4d7709c0 20 remove_watcher() i=7 2024-09-10T05:38:24.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.864+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5652cb86f940 msgr2=0x5652cb871d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.864+0000 7f2d4d7709c0 1 --2- 172.21.15.62:0/1379205031 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5652cb86f940 0x5652cb871d30 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.864+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5652cb86b4c0 msgr2=0x5652cb86d950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.864+0000 7f2d4d7709c0 1 --2- 172.21.15.62:0/1379205031 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5652cb86b4c0 0x5652cb86d950 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.864+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f2d3c11c060 msgr2=0x7f2d3c0e3570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.864+0000 7f2d4d7709c0 1 --2- 172.21.15.62:0/1379205031 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f2d3c11c060 0x7f2d3c0e3570 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.864+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5652cb873160 msgr2=0x5652cb875570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.864+0000 7f2d4d7709c0 1 --2- 172.21.15.62:0/1379205031 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5652cb873160 0x5652cb875570 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.868+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2c14039a70 msgr2=0x7f2c1403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.868+0000 7f2d4d7709c0 1 --2- 172.21.15.62:0/1379205031 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2c14039a70 0x7f2c1403bf30 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x5652cb83e9b0 tx=0x7f2d40011000 comp rx=0 tx=0).stop 2024-09-10T05:38:24.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.868+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5652cb8593e0 msgr2=0x5652cb860680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.868+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1379205031 reap_dead start 2024-09-10T05:38:24.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.868+0000 7f2d4d7709c0 1 --2- 172.21.15.62:0/1379205031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5652cb8593e0 0x5652cb860680 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c0b0f70 tx=0x7f2d3c0b0f00 comp rx=0 tx=0).stop 2024-09-10T05:38:24.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.868+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 shutdown_connections 2024-09-10T05:38:24.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.868+0000 7f2d4d7709c0 1 --2- 172.21.15.62:0/1379205031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5652cb8593e0 0x5652cb860680 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.868+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 >> 172.21.15.62:0/1379205031 conn(0x5652cb855810 msgr2=0x5652cb853a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:24.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.868+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 shutdown_connections 2024-09-10T05:38:24.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.868+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1379205031 wait complete. 2024-09-10T05:38:24.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.868+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/3431312561 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2c24039c60 msgr2=0x7f2c2403c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.868+0000 7f2d4d7709c0 1 --2- 172.21.15.62:0/3431312561 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2c24039c60 0x7f2c2403c120 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x5652cb830340 tx=0x7f2d40006000 comp rx=0 tx=0).stop 2024-09-10T05:38:24.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.868+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/3431312561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5652cb84cc40 msgr2=0x5652cb84d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.868+0000 7f2d4d7709c0 1 --2- 172.21.15.62:0/3431312561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5652cb84cc40 0x5652cb84d060 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c018f70 tx=0x7f2d3c0cf6b0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.868+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/3431312561 shutdown_connections 2024-09-10T05:38:24.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.868+0000 7f2d4d7709c0 1 --2- 172.21.15.62:0/3431312561 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2c24039c60 0x7f2c2403c120 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.868+0000 7f2d4d7709c0 1 --2- 172.21.15.62:0/3431312561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5652cb84cc40 0x5652cb84d060 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.868+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/3431312561 >> 172.21.15.62:0/3431312561 conn(0x5652cb8425f0 msgr2=0x5652cb8429d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:24.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.868+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/3431312561 shutdown_connections 2024-09-10T05:38:24.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.868+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/3431312561 wait complete. 2024-09-10T05:38:24.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.868+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1896138533 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5652cb837320 msgr2=0x5652cb839710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.868+0000 7f2d4d7709c0 1 --2- 172.21.15.62:0/1896138533 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5652cb837320 0x5652cb839710 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.868+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1896138533 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5652cb6ae5d0 msgr2=0x5652cb836030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.868+0000 7f2d4d7709c0 1 --2- 172.21.15.62:0/1896138533 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5652cb6ae5d0 0x5652cb836030 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.868+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1896138533 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5652cb83bb00 msgr2=0x5652cb83def0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.868+0000 7f2d4d7709c0 1 --2- 172.21.15.62:0/1896138533 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5652cb83bb00 0x5652cb83def0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.868+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1896138533 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2c30039a70 msgr2=0x7f2c3003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.868+0000 7f2d4d7709c0 1 --2- 172.21.15.62:0/1896138533 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2c30039a70 0x7f2c3003bf30 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2d40001e60 tx=0x7f2d400013e0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.868+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1896138533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5652cb6ae1f0 msgr2=0x5652cb82eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.868+0000 7f2d4d7709c0 1 --2- 172.21.15.62:0/1896138533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5652cb6ae1f0 0x5652cb82eec0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c000c10 tx=0x7f2d3c0180e0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.868+0000 7f2d4ba77640 1 -- 172.21.15.62:0/1896138533 reap_dead start 2024-09-10T05:38:24.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.868+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1896138533 shutdown_connections 2024-09-10T05:38:24.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.868+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1896138533 >> 172.21.15.62:0/1896138533 conn(0x5652cb734910 msgr2=0x5652cb821ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:24.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.868+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1896138533 shutdown_connections 2024-09-10T05:38:24.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.868+0000 7f2d4d7709c0 1 -- 172.21.15.62:0/1896138533 wait complete. 2024-09-10T05:38:24.882 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T05:38:22.896781Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:38:22.896764Z', 'tags': [], 'group_ids': []} 2024-09-10T05:38:24.883 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T05:38:22.896781Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:38:22.896764Z', 'tags': [], 'group_ids': []} 2024-09-10T05:38:24.883 ERROR:root:0 2024-09-10T05:38:24.883 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-10T05:38:24.883 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-10T05:38:24.883 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=write 2024-09-10T05:38:24.965 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:38:24.965 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:38:24.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.964+0000 7f4db2ea19c0 1 Processor -- start 2024-09-10T05:38:24.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.964+0000 7f4db2ea19c0 1 -- start start 2024-09-10T05:38:24.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.964+0000 7f4db2ea19c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5605654ea0c0 0x5605654ec4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.964+0000 7f4db2ea19c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56056539a9c0 con 0x5605654e5f70 2024-09-10T05:38:24.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.964+0000 7f4db2ea19c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x5605653ea6d0 con 0x5605654ea0c0 2024-09-10T05:38:24.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.964+0000 7f4db01a6640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5605654ea0c0 0x5605654ec4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.964+0000 7f4db01a6640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5605654ea0c0 0x5605654ec4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:53752/0 (socket says 172.21.15.62:53752) 2024-09-10T05:38:24.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.964+0000 7f4db09a7640 1 --1- 172.21.15.62:0/1514552466 >> v1:172.21.15.2:6789/0 conn(0x5605654e5f70 0x5605654e6350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:48832/0 (socket says 172.21.15.62:48832) 2024-09-10T05:38:24.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.964+0000 7f4db01a6640 1 -- 172.21.15.62:0/1514552466 learned_addr learned my addr 172.21.15.62:0/1514552466 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:24.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.964+0000 7f4db01a6640 1 -- 172.21.15.62:0/1514552466 >> v1:172.21.15.2:6789/0 conn(0x5605654e5f70 legacy=0x5605654e6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.964+0000 7f4db01a6640 1 -- 172.21.15.62:0/1514552466 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56056538eca0 con 0x5605654ea0c0 2024-09-10T05:38:24.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.968+0000 7f4db01a6640 1 --2- 172.21.15.62:0/1514552466 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605654ea0c0 0x5605654ec4b0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f4d9800a4e0 tx=0x7f4d9801b120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=398e82480fdd3f26 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.968+0000 7f4daf9a5640 1 -- 172.21.15.62:0/1514552466 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d980aa540 con 0x5605654ea0c0 2024-09-10T05:38:24.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.968+0000 7f4daf9a5640 1 -- 172.21.15.62:0/1514552466 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d980aa6e0 con 0x5605654ea0c0 2024-09-10T05:38:24.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.968+0000 7f4daf9a5640 1 -- 172.21.15.62:0/1514552466 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d980aaa40 con 0x5605654ea0c0 2024-09-10T05:38:24.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.968+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/1514552466 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605654ea0c0 msgr2=0x5605654ec4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.968+0000 7f4db2ea19c0 1 --2- 172.21.15.62:0/1514552466 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605654ea0c0 0x5605654ec4b0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f4d9800a4e0 tx=0x7f4d9801b120 comp rx=0 tx=0).stop 2024-09-10T05:38:24.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.968+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/1514552466 shutdown_connections 2024-09-10T05:38:24.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.968+0000 7f4db2ea19c0 1 --2- 172.21.15.62:0/1514552466 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605654ea0c0 0x5605654ec4b0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.968+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/1514552466 >> 172.21.15.62:0/1514552466 conn(0x5605654e1a90 msgr2=0x5605654e3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:24.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.968+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/1514552466 shutdown_connections 2024-09-10T05:38:24.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.968+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/1514552466 wait complete. 2024-09-10T05:38:24.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.984+0000 7f4db2ea19c0 1 Processor -- start 2024-09-10T05:38:24.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.984+0000 7f4db2ea19c0 1 -- start start 2024-09-10T05:38:24.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.984+0000 7f4db2ea19c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605654e5f70 0x5605655d1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.984+0000 7f4db2ea19c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5605653ee680 con 0x5605654e5f70 2024-09-10T05:38:24.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.984+0000 7f4db09a7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605654e5f70 0x5605655d1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.984+0000 7f4db09a7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605654e5f70 0x5605655d1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:53760/0 (socket says 172.21.15.62:53760) 2024-09-10T05:38:24.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.984+0000 7f4db09a7640 1 -- 172.21.15.62:0/1640623504 learned_addr learned my addr 172.21.15.62:0/1640623504 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:24.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.984+0000 7f4db09a7640 1 -- 172.21.15.62:0/1640623504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560565369da0 con 0x5605654e5f70 2024-09-10T05:38:24.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.984+0000 7f4db09a7640 1 --2- 172.21.15.62:0/1640623504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605654e5f70 0x5605655d1770 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f4da0001ec0 tx=0x7f4da000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9168ccdba921eaa5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.984+0000 7f4c9ee0d640 1 -- 172.21.15.62:0/1640623504 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4da000e5d0 con 0x5605654e5f70 2024-09-10T05:38:24.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.984+0000 7f4c9ee0d640 1 -- 172.21.15.62:0/1640623504 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4da000e770 con 0x5605654e5f70 2024-09-10T05:38:24.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.984+0000 7f4c9ee0d640 1 -- 172.21.15.62:0/1640623504 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4da000ea70 con 0x5605654e5f70 2024-09-10T05:38:24.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.988+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/1640623504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605654e5f70 msgr2=0x5605655d1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:24.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.988+0000 7f4db2ea19c0 1 --2- 172.21.15.62:0/1640623504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605654e5f70 0x5605655d1770 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f4da0001ec0 tx=0x7f4da000b6d0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.988+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/1640623504 shutdown_connections 2024-09-10T05:38:24.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.988+0000 7f4db2ea19c0 1 --2- 172.21.15.62:0/1640623504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605654e5f70 0x5605655d1770 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:24.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.988+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/1640623504 >> 172.21.15.62:0/1640623504 conn(0x5605654e1a90 msgr2=0x5605655cd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:24.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.988+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/1640623504 shutdown_connections 2024-09-10T05:38:24.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.988+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/1640623504 wait complete. 2024-09-10T05:38:24.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.988+0000 7f4db2ea19c0 1 Processor -- start 2024-09-10T05:38:24.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.988+0000 7f4db2ea19c0 1 -- start start 2024-09-10T05:38:24.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.988+0000 7f4db2ea19c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605654e5f70 0x5605655d8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.988+0000 7f4db2ea19c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560565390a50 con 0x5605654e5f70 2024-09-10T05:38:24.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.988+0000 7f4db09a7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605654e5f70 0x5605655d8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.988+0000 7f4db09a7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605654e5f70 0x5605655d8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:53772/0 (socket says 172.21.15.62:53772) 2024-09-10T05:38:24.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.988+0000 7f4db09a7640 1 -- 172.21.15.62:0/2306071923 learned_addr learned my addr 172.21.15.62:0/2306071923 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:24.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.988+0000 7f4db09a7640 1 -- 172.21.15.62:0/2306071923 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605655d93a0 con 0x5605654e5f70 2024-09-10T05:38:24.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.988+0000 7f4db09a7640 1 --2- 172.21.15.62:0/2306071923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605654e5f70 0x5605655d8e40 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x5605655d2700 tx=0x7f4da0000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.988+0000 7f4c9d60a640 1 -- 172.21.15.62:0/2306071923 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4da000f8e0 con 0x5605654e5f70 2024-09-10T05:38:24.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.988+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2306071923 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5605655d9630 con 0x5605654e5f70 2024-09-10T05:38:24.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.988+0000 7f4c9d60a640 1 -- 172.21.15.62:0/2306071923 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4da000fa80 con 0x5605654e5f70 2024-09-10T05:38:24.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.988+0000 7f4c9d60a640 1 -- 172.21.15.62:0/2306071923 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4da000fda0 con 0x5605654e5f70 2024-09-10T05:38:24.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.988+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2306071923 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605655d9fe0 con 0x5605654e5f70 2024-09-10T05:38:24.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.992+0000 7f4c9d60a640 1 -- 172.21.15.62:0/2306071923 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f4da0017070 con 0x5605654e5f70 2024-09-10T05:38:24.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.992+0000 7f4c9d60a640 1 --2- 172.21.15.62:0/2306071923 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4c98039a70 0x7f4c9803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.992+0000 7f4c9d60a640 1 -- 172.21.15.62:0/2306071923 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7f4da0015020 con 0x5605654e5f70 2024-09-10T05:38:24.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.992+0000 7f4db01a6640 1 --2- 172.21.15.62:0/2306071923 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4c98039a70 0x7f4c9803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.992+0000 7f4db2ea19c0 1 --2- 172.21.15.62:0/2306071923 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5605654ea0c0 0x5605655dffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.992+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2306071923 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5605655e04f0 con 0x5605654ea0c0 2024-09-10T05:38:24.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.992+0000 7f4db11a8640 1 --2- 172.21.15.62:0/2306071923 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5605654ea0c0 0x5605655dffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.992+0000 7f4db01a6640 1 --2- 172.21.15.62:0/2306071923 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4c98039a70 0x7f4c9803bf30 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f4d980ab000 tx=0x7f4d980a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.992+0000 7f4db11a8640 1 --2- 172.21.15.62:0/2306071923 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5605654ea0c0 0x5605655dffb0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.992+0000 7f4db11a8640 1 -- 172.21.15.62:0/2306071923 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4da80083f0 con 0x5605654ea0c0 2024-09-10T05:38:24.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.992+0000 7f4db2ea19c0 1 --2- 172.21.15.62:0/2306071923 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5605655e12a0 0x5605655e3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.992+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2306071923 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5605655e3ca0 con 0x5605655e12a0 2024-09-10T05:38:24.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.992+0000 7f4db09a7640 1 --2- 172.21.15.62:0/2306071923 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5605655e12a0 0x5605655e3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.992+0000 7f4db09a7640 1 --2- 172.21.15.62:0/2306071923 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5605655e12a0 0x5605655e3690 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.992+0000 7f4db09a7640 1 -- 172.21.15.62:0/2306071923 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4da002e070 con 0x5605655e12a0 2024-09-10T05:38:24.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.992+0000 7f4db2ea19c0 1 --2- 172.21.15.62:0/2306071923 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5605655e5a10 0x5605655e7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:24.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.992+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2306071923 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5605655e8540 con 0x5605655e5a10 2024-09-10T05:38:24.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.992+0000 7f4db01a6640 1 --2- 172.21.15.62:0/2306071923 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5605655e5a10 0x5605655e7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:24.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.992+0000 7f4db01a6640 1 --2- 172.21.15.62:0/2306071923 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5605655e5a10 0x5605655e7e00 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:24.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.996+0000 7f4db01a6640 1 -- 172.21.15.62:0/2306071923 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv5 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4d980bc040 con 0x5605655e5a10 2024-09-10T05:38:24.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.996+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2306071923 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5605655e48b0 con 0x5605655e12a0 2024-09-10T05:38:24.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.996+0000 7f4db09a7640 1 -- 172.21.15.62:0/2306071923 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4da002e070 con 0x5605655e12a0 2024-09-10T05:38:24.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.996+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2306071923 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5605655e4d10 con 0x5605655e5a10 2024-09-10T05:38:24.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.996+0000 7f4db01a6640 1 -- 172.21.15.62:0/2306071923 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4d980bc040 con 0x5605655e5a10 2024-09-10T05:38:24.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.996+0000 7f4db2ea19c0 1 Processor -- start 2024-09-10T05:38:24.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.996+0000 7f4db2ea19c0 1 -- start start 2024-09-10T05:38:24.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.996+0000 7f4db2ea19c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605655f6b10 0x5605655f6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.996+0000 7f4db2ea19c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5605653fb450 con 0x5605655f6b10 2024-09-10T05:38:25.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.996+0000 7f4db09a7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605655f6b10 0x5605655f6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.996+0000 7f4db09a7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605655f6b10 0x5605655f6f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:53774/0 (socket says 172.21.15.62:53774) 2024-09-10T05:38:25.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.996+0000 7f4db09a7640 1 -- 172.21.15.62:0/1824723145 learned_addr learned my addr 172.21.15.62:0/1824723145 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:25.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.996+0000 7f4db09a7640 1 -- 172.21.15.62:0/1824723145 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605655f7570 con 0x5605655f6b10 2024-09-10T05:38:25.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.996+0000 7f4db09a7640 1 --2- 172.21.15.62:0/1824723145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605655f6b10 0x5605655f6f30 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f4da0017cd0 tx=0x7f4da0019e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.996+0000 7f4c967fc640 1 -- 172.21.15.62:0/1824723145 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4da0048e50 con 0x5605655f6b10 2024-09-10T05:38:25.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.996+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/1824723145 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5605655f7dd0 con 0x5605655f6b10 2024-09-10T05:38:25.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.996+0000 7f4c967fc640 1 -- 172.21.15.62:0/1824723145 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4da00193e0 con 0x5605655f6b10 2024-09-10T05:38:25.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:24.996+0000 7f4c967fc640 1 -- 172.21.15.62:0/1824723145 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4da00196c0 con 0x5605655f6b10 2024-09-10T05:38:25.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.000+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/1824723145 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605655f7dd0 con 0x5605655f6b10 2024-09-10T05:38:25.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.000+0000 7f4c967fc640 1 -- 172.21.15.62:0/1824723145 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f4da001a480 con 0x5605655f6b10 2024-09-10T05:38:25.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.000+0000 7f4c967fc640 1 --2- 172.21.15.62:0/1824723145 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4c88039a70 0x7f4c8803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.000+0000 7f4c967fc640 1 -- 172.21.15.62:0/1824723145 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7f4da0028c80 con 0x5605655f6b10 2024-09-10T05:38:25.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.000+0000 7f4db01a6640 1 --2- 172.21.15.62:0/1824723145 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4c88039a70 0x7f4c8803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.000+0000 7f4db2ea19c0 1 Processor -- start 2024-09-10T05:38:25.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.000+0000 7f4db2ea19c0 1 -- start start 2024-09-10T05:38:25.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.000+0000 7f4db2ea19c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56056545acc0 0x56056545b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.000+0000 7f4db2ea19c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5605655d1fc0 con 0x56056545acc0 2024-09-10T05:38:25.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.000+0000 7f4db01a6640 1 --2- 172.21.15.62:0/1824723145 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4c88039a70 0x7f4c8803bf30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x5605655da2c0 tx=0x7f4d98005e50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.000+0000 7f4db09a7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56056545acc0 0x56056545b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.000+0000 7f4db09a7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56056545acc0 0x56056545b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:53778/0 (socket says 172.21.15.62:53778) 2024-09-10T05:38:25.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.000+0000 7f4db09a7640 1 -- 172.21.15.62:0/3350889472 learned_addr learned my addr 172.21.15.62:0/3350889472 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:25.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.000+0000 7f4db09a7640 1 -- 172.21.15.62:0/3350889472 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56056545b600 con 0x56056545acc0 2024-09-10T05:38:25.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.000+0000 7f4db09a7640 1 --2- 172.21.15.62:0/3350889472 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56056545acc0 0x56056545b0c0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f4da004e170 tx=0x7f4da001a830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d5b75bbc9b0a2b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.000+0000 7f4c87fff640 1 -- 172.21.15.62:0/3350889472 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4da0059040 con 0x56056545acc0 2024-09-10T05:38:25.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.000+0000 7f4c87fff640 1 -- 172.21.15.62:0/3350889472 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4da0030d10 con 0x56056545acc0 2024-09-10T05:38:25.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.000+0000 7f4c87fff640 1 -- 172.21.15.62:0/3350889472 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4da0040040 con 0x56056545acc0 2024-09-10T05:38:25.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.004+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/3350889472 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56056545acc0 msgr2=0x56056545b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.004+0000 7f4db2ea19c0 1 --2- 172.21.15.62:0/3350889472 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56056545acc0 0x56056545b0c0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f4da004e170 tx=0x7f4da001a830 comp rx=0 tx=0).stop 2024-09-10T05:38:25.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.004+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/3350889472 shutdown_connections 2024-09-10T05:38:25.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.004+0000 7f4db2ea19c0 1 --2- 172.21.15.62:0/3350889472 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56056545acc0 0x56056545b0c0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.004+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/3350889472 >> 172.21.15.62:0/3350889472 conn(0x5605655ff510 msgr2=0x5605655fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:25.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.004+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/3350889472 shutdown_connections 2024-09-10T05:38:25.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.004+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/3350889472 wait complete. 2024-09-10T05:38:25.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.004+0000 7f4db2ea19c0 1 Processor -- start 2024-09-10T05:38:25.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.004+0000 7f4db2ea19c0 1 -- start start 2024-09-10T05:38:25.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.004+0000 7f4db2ea19c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56056545acc0 0x56056560c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.004+0000 7f4db2ea19c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56056545bbd0 con 0x56056545acc0 2024-09-10T05:38:25.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.004+0000 7f4db09a7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56056545acc0 0x56056560c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.004+0000 7f4db09a7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56056545acc0 0x56056560c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:53782/0 (socket says 172.21.15.62:53782) 2024-09-10T05:38:25.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.004+0000 7f4db09a7640 1 -- 172.21.15.62:0/2170081097 learned_addr learned my addr 172.21.15.62:0/2170081097 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:25.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.004+0000 7f4db09a7640 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56056560cbb0 con 0x56056545acc0 2024-09-10T05:38:25.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.004+0000 7f4db09a7640 1 --2- 172.21.15.62:0/2170081097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56056545acc0 0x56056560c650 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f4da001dfd0 tx=0x7f4da00471f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.004+0000 7f4c867fc640 1 -- 172.21.15.62:0/2170081097 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4da0070070 con 0x56056545acc0 2024-09-10T05:38:25.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.004+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56056560cbb0 con 0x56056545acc0 2024-09-10T05:38:25.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.004+0000 7f4c867fc640 1 -- 172.21.15.62:0/2170081097 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4da004f510 con 0x56056545acc0 2024-09-10T05:38:25.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.004+0000 7f4c867fc640 1 -- 172.21.15.62:0/2170081097 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4da0040070 con 0x56056545acc0 2024-09-10T05:38:25.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.004+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56056560d020 con 0x56056545acc0 2024-09-10T05:38:25.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.008+0000 7f4c867fc640 1 -- 172.21.15.62:0/2170081097 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f4da004f830 con 0x56056545acc0 2024-09-10T05:38:25.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.008+0000 7f4db2ea19c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:25.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.008+0000 7f4c867fc640 1 --2- 172.21.15.62:0/2170081097 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4c7c039a70 0x7f4c7c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.008+0000 7f4c867fc640 1 -- 172.21.15.62:0/2170081097 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7f4da006bc60 con 0x56056545acc0 2024-09-10T05:38:25.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.008+0000 7f4db01a6640 1 --2- 172.21.15.62:0/2170081097 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4c7c039a70 0x7f4c7c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.008+0000 7f4db2ea19c0 1 --2- 172.21.15.62:0/2170081097 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560565617450 0x5605656198e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.008+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56056561a030 con 0x560565617450 2024-09-10T05:38:25.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.008+0000 7f4db11a8640 1 --2- 172.21.15.62:0/2170081097 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560565617450 0x5605656198e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.008+0000 7f4db01a6640 1 --2- 172.21.15.62:0/2170081097 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4c7c039a70 0x7f4c7c03bf30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f4d980aa980 tx=0x7f4d980a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.008+0000 7f4db11a8640 1 --2- 172.21.15.62:0/2170081097 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560565617450 0x5605656198e0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.008+0000 7f4db11a8640 1 -- 172.21.15.62:0/2170081097 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4da80083f0 con 0x560565617450 2024-09-10T05:38:25.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.008+0000 7f4db2ea19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:25.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.008+0000 7f4db2ea19c0 20 realm 2024-09-10T05:38:25.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.008+0000 7f4db2ea19c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:25.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.008+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5605656167e0 con 0x560565617450 2024-09-10T05:38:25.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.008+0000 7f4db11a8640 1 -- 172.21.15.62:0/2170081097 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4da80083f0 con 0x560565617450 2024-09-10T05:38:25.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.008+0000 7f4db2ea19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:25.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.008+0000 7f4db2ea19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:38:25.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.008+0000 7f4db2ea19c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:25.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.008+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56056561ab00 con 0x560565617450 2024-09-10T05:38:25.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.008+0000 7f4db11a8640 1 -- 172.21.15.62:0/2170081097 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4da80083f0 con 0x560565617450 2024-09-10T05:38:25.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.008+0000 7f4db2ea19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:25.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.008+0000 7f4db2ea19c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:25.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.008+0000 7f4db2ea19c0 1 --2- 172.21.15.62:0/2170081097 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x56056561b8e0 0x56056561dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.008+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56056561e380 con 0x56056561b8e0 2024-09-10T05:38:25.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.008+0000 7f4db09a7640 1 --2- 172.21.15.62:0/2170081097 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x56056561b8e0 0x56056561dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.008+0000 7f4db09a7640 1 --2- 172.21.15.62:0/2170081097 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x56056561b8e0 0x56056561dcd0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.012+0000 7f4db09a7640 1 -- 172.21.15.62:0/2170081097 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4da0067040 con 0x56056561b8e0 2024-09-10T05:38:25.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.012+0000 7f4db2ea19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:38:25.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.012+0000 7f4db2ea19c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:25.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.012+0000 7f4db2ea19c0 1 --2- 172.21.15.62:0/2170081097 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56056561f0e0 0x5605656214d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.012+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560565621c40 con 0x56056561f0e0 2024-09-10T05:38:25.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.012+0000 7f4db01a6640 1 --2- 172.21.15.62:0/2170081097 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56056561f0e0 0x5605656214d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.012+0000 7f4db01a6640 1 --2- 172.21.15.62:0/2170081097 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56056561f0e0 0x5605656214d0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.012+0000 7f4db01a6640 1 -- 172.21.15.62:0/2170081097 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv5 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4d980c3050 con 0x56056561f0e0 2024-09-10T05:38:25.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.012+0000 7f4db2ea19c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:38:25.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.012+0000 7f4db2ea19c0 20 searching for the correct realm 2024-09-10T05:38:25.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.012+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560565623510 con 0x56056561f0e0 2024-09-10T05:38:25.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.012+0000 7f4db01a6640 1 -- 172.21.15.62:0/2170081097 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d980c3050 con 0x56056561f0e0 2024-09-10T05:38:25.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.012+0000 7f4db01a6640 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560565623510 con 0x56056561b8e0 2024-09-10T05:38:25.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.012+0000 7f4db09a7640 1 -- 172.21.15.62:0/2170081097 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da0067040 con 0x56056561b8e0 2024-09-10T05:38:25.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.012+0000 7f4db09a7640 1 --2- 172.21.15.62:0/2170081097 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f4da000d770 0x7f4da0042710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.012+0000 7f4db09a7640 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560565623510 con 0x7f4da000d770 2024-09-10T05:38:25.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.012+0000 7f4db11a8640 1 --2- 172.21.15.62:0/2170081097 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f4da000d770 0x7f4da0042710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.012+0000 7f4db11a8640 1 --2- 172.21.15.62:0/2170081097 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f4da000d770 0x7f4da0042710 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.012+0000 7f4db11a8640 1 -- 172.21.15.62:0/2170081097 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da80083f0 con 0x7f4da000d770 2024-09-10T05:38:25.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.012+0000 7f4db11a8640 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560565623510 con 0x560565617450 2024-09-10T05:38:25.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.012+0000 7f4db11a8640 1 -- 172.21.15.62:0/2170081097 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da80083f0 con 0x560565617450 2024-09-10T05:38:25.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.012+0000 7f4db11a8640 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560565623510 con 0x560565617450 2024-09-10T05:38:25.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.012+0000 7f4db11a8640 1 -- 172.21.15.62:0/2170081097 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da80083f0 con 0x560565617450 2024-09-10T05:38:25.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.012+0000 7f4db11a8640 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560565623510 con 0x56056561f0e0 2024-09-10T05:38:25.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.016+0000 7f4db01a6640 1 -- 172.21.15.62:0/2170081097 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d980c3050 con 0x56056561f0e0 2024-09-10T05:38:25.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.016+0000 7f4db01a6640 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560565623510 con 0x560565617450 2024-09-10T05:38:25.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.016+0000 7f4db11a8640 1 -- 172.21.15.62:0/2170081097 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da80083f0 con 0x560565617450 2024-09-10T05:38:25.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.016+0000 7f4db11a8640 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560565623510 con 0x56056561b8e0 2024-09-10T05:38:25.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.016+0000 7f4db09a7640 1 -- 172.21.15.62:0/2170081097 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da0067040 con 0x56056561b8e0 2024-09-10T05:38:25.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.016+0000 7f4db09a7640 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560565623510 con 0x56056561b8e0 2024-09-10T05:38:25.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.016+0000 7f4db09a7640 1 -- 172.21.15.62:0/2170081097 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da0067040 con 0x56056561b8e0 2024-09-10T05:38:25.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.016+0000 7f4db09a7640 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560565623510 con 0x560565617450 2024-09-10T05:38:25.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.016+0000 7f4db11a8640 1 -- 172.21.15.62:0/2170081097 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da80083f0 con 0x560565617450 2024-09-10T05:38:25.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.016+0000 7f4db11a8640 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560565623510 con 0x7f4da000d770 2024-09-10T05:38:25.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.016+0000 7f4db11a8640 1 -- 172.21.15.62:0/2170081097 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da80083f0 con 0x7f4da000d770 2024-09-10T05:38:25.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.016+0000 7f4db11a8640 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560565623510 con 0x560565617450 2024-09-10T05:38:25.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.016+0000 7f4db11a8640 1 -- 172.21.15.62:0/2170081097 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da80083f0 con 0x560565617450 2024-09-10T05:38:25.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.016+0000 7f4db11a8640 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560565623510 con 0x7f4da000d770 2024-09-10T05:38:25.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.016+0000 7f4db11a8640 1 -- 172.21.15.62:0/2170081097 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4da80083f0 con 0x7f4da000d770 2024-09-10T05:38:25.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.016+0000 7f4db11a8640 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560565623510 con 0x56056561b8e0 2024-09-10T05:38:25.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.016+0000 7f4db09a7640 1 -- 172.21.15.62:0/2170081097 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da0067040 con 0x56056561b8e0 2024-09-10T05:38:25.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.016+0000 7f4db09a7640 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560565623510 con 0x56056561f0e0 2024-09-10T05:38:25.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.016+0000 7f4db01a6640 1 -- 172.21.15.62:0/2170081097 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d980c3050 con 0x56056561f0e0 2024-09-10T05:38:25.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.020+0000 7f4db01a6640 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560565623510 con 0x560565617450 2024-09-10T05:38:25.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.020+0000 7f4db11a8640 1 -- 172.21.15.62:0/2170081097 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da80083f0 con 0x560565617450 2024-09-10T05:38:25.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.020+0000 7f4db11a8640 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560565623510 con 0x56056561b8e0 2024-09-10T05:38:25.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.020+0000 7f4db09a7640 1 -- 172.21.15.62:0/2170081097 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da0067040 con 0x56056561b8e0 2024-09-10T05:38:25.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.020+0000 7f4db09a7640 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560565623510 con 0x56056561f0e0 2024-09-10T05:38:25.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.020+0000 7f4db01a6640 1 -- 172.21.15.62:0/2170081097 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 34 out=170b] v34'5 uv5 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f4d980c3050 con 0x56056561f0e0 2024-09-10T05:38:25.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.020+0000 7f4db01a6640 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560565623510 con 0x560565617450 2024-09-10T05:38:25.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.020+0000 7f4db11a8640 1 -- 172.21.15.62:0/2170081097 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da80083f0 con 0x560565617450 2024-09-10T05:38:25.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.020+0000 7f4db11a8640 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560565623510 con 0x560565617450 2024-09-10T05:38:25.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.020+0000 7f4db11a8640 1 -- 172.21.15.62:0/2170081097 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4da80083f0 con 0x560565617450 2024-09-10T05:38:25.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.020+0000 7f4db11a8640 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560565623510 con 0x560565617450 2024-09-10T05:38:25.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.020+0000 7f4db11a8640 1 -- 172.21.15.62:0/2170081097 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da80083f0 con 0x560565617450 2024-09-10T05:38:25.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.020+0000 7f4db11a8640 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560565623510 con 0x56056561f0e0 2024-09-10T05:38:25.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.020+0000 7f4db01a6640 1 -- 172.21.15.62:0/2170081097 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d980c3050 con 0x56056561f0e0 2024-09-10T05:38:25.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.020+0000 7f4db01a6640 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560565623510 con 0x7f4da000d770 2024-09-10T05:38:25.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.020+0000 7f4db11a8640 1 -- 172.21.15.62:0/2170081097 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da80083f0 con 0x7f4da000d770 2024-09-10T05:38:25.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.020+0000 7f4db11a8640 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560565623510 con 0x560565617450 2024-09-10T05:38:25.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.020+0000 7f4db11a8640 1 -- 172.21.15.62:0/2170081097 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da80083f0 con 0x560565617450 2024-09-10T05:38:25.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.020+0000 7f4db11a8640 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560565623510 con 0x7f4da000d770 2024-09-10T05:38:25.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.020+0000 7f4db11a8640 1 -- 172.21.15.62:0/2170081097 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da80083f0 con 0x7f4da000d770 2024-09-10T05:38:25.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.020+0000 7f4db11a8640 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560565623510 con 0x56056561f0e0 2024-09-10T05:38:25.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.020+0000 7f4db01a6640 1 -- 172.21.15.62:0/2170081097 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d980c3050 con 0x56056561f0e0 2024-09-10T05:38:25.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.020+0000 7f4db01a6640 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560565623510 con 0x7f4da000d770 2024-09-10T05:38:25.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.024+0000 7f4db11a8640 1 -- 172.21.15.62:0/2170081097 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da80083f0 con 0x7f4da000d770 2024-09-10T05:38:25.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.024+0000 7f4db11a8640 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560565623510 con 0x56056561b8e0 2024-09-10T05:38:25.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.024+0000 7f4db09a7640 1 -- 172.21.15.62:0/2170081097 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da0067040 con 0x56056561b8e0 2024-09-10T05:38:25.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.024+0000 7f4db09a7640 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560565623510 con 0x56056561b8e0 2024-09-10T05:38:25.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.024+0000 7f4db09a7640 1 -- 172.21.15.62:0/2170081097 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da0067040 con 0x56056561b8e0 2024-09-10T05:38:25.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.024+0000 7f4db09a7640 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560565623510 con 0x56056561f0e0 2024-09-10T05:38:25.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.024+0000 7f4db01a6640 1 -- 172.21.15.62:0/2170081097 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d980c3050 con 0x56056561f0e0 2024-09-10T05:38:25.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.024+0000 7f4db01a6640 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560565623510 con 0x56056561b8e0 2024-09-10T05:38:25.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.024+0000 7f4db09a7640 1 -- 172.21.15.62:0/2170081097 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4da0067040 con 0x56056561b8e0 2024-09-10T05:38:25.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.024+0000 7f4db09a7640 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560565623510 con 0x56056561b8e0 2024-09-10T05:38:25.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.024+0000 7f4db09a7640 1 -- 172.21.15.62:0/2170081097 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da0067040 con 0x56056561b8e0 2024-09-10T05:38:25.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.024+0000 7f4db2ea19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:38:25.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.024+0000 7f4db2ea19c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:38:25.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.024+0000 7f4db2ea19c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:38:25.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.024+0000 7f4db2ea19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:38:25.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.024+0000 7f4db2ea19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:38:25.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.024+0000 7f4db2ea19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:38:25.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.024+0000 7f4db2ea19c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:25.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.024+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560565622600 con 0x560565617450 2024-09-10T05:38:25.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.024+0000 7f4db11a8640 1 -- 172.21.15.62:0/2170081097 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4da80083f0 con 0x560565617450 2024-09-10T05:38:25.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.024+0000 7f4db2ea19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:25.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.024+0000 7f4db2ea19c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:25.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.024+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560565622210 con 0x56056561b8e0 2024-09-10T05:38:25.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.028+0000 7f4db09a7640 1 -- 172.21.15.62:0/2170081097 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4da0067040 con 0x56056561b8e0 2024-09-10T05:38:25.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.028+0000 7f4db2ea19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:38:25.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.028+0000 7f4db2ea19c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:25.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.028+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560565622f30 con 0x56056561f0e0 2024-09-10T05:38:25.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.028+0000 7f4db01a6640 1 -- 172.21.15.62:0/2170081097 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4d980c3050 con 0x56056561f0e0 2024-09-10T05:38:25.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.028+0000 7f4db2ea19c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:38:25.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.028+0000 7f4db2ea19c0 20 zone default found 2024-09-10T05:38:25.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.028+0000 7f4db2ea19c0 4 Realm: () 2024-09-10T05:38:25.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.028+0000 7f4db2ea19c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:38:25.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.028+0000 7f4db2ea19c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:38:25.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.028+0000 7f4db2ea19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:38:25.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.028+0000 7f4db2ea19c0 20 zonegroup default 2024-09-10T05:38:25.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.028+0000 7f4db2ea19c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:25.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.028+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560565623df0 con 0x7f4da000d770 2024-09-10T05:38:25.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.028+0000 7f4db11a8640 1 -- 172.21.15.62:0/2170081097 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4da80083f0 con 0x7f4da000d770 2024-09-10T05:38:25.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.028+0000 7f4db2ea19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:25.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.028+0000 7f4db2ea19c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:25.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.028+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560565626030 con 0x56056561f0e0 2024-09-10T05:38:25.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.028+0000 7f4db01a6640 1 -- 172.21.15.62:0/2170081097 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4d980c3050 con 0x56056561f0e0 2024-09-10T05:38:25.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.028+0000 7f4db2ea19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:25.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.028+0000 7f4db2ea19c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:25.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.028+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5605656263d0 con 0x56056561f0e0 2024-09-10T05:38:25.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.028+0000 7f4db01a6640 1 -- 172.21.15.62:0/2170081097 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4d980c3050 con 0x56056561f0e0 2024-09-10T05:38:25.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.028+0000 7f4db2ea19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:25.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.028+0000 7f4db2ea19c0 20 started sync module instance, tier type = 2024-09-10T05:38:25.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.028+0000 7f4db2ea19c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:38:25.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.028+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560565625470 con 0x56056561b8e0 2024-09-10T05:38:25.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.032+0000 7f4db09a7640 1 -- 172.21.15.62:0/2170081097 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da0067040 con 0x56056561b8e0 2024-09-10T05:38:25.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.032+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94581175769488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560565625470 con 0x56056561b8e0 2024-09-10T05:38:25.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.032+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560565626d90 con 0x560565617450 2024-09-10T05:38:25.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.032+0000 7f4db11a8640 1 -- 172.21.15.62:0/2170081097 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da80083f0 con 0x560565617450 2024-09-10T05:38:25.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.032+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94581175773408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5605656275e0 con 0x560565617450 2024-09-10T05:38:25.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.032+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560565627fe0 con 0x56056561b8e0 2024-09-10T05:38:25.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.032+0000 7f4db09a7640 1 -- 172.21.15.62:0/2170081097 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94581175769488] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da0067040 con 0x56056561b8e0 2024-09-10T05:38:25.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.032+0000 7f4db11a8640 1 -- 172.21.15.62:0/2170081097 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94581175773408] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da80083f0 con 0x560565617450 2024-09-10T05:38:25.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.036+0000 7f4db09a7640 1 -- 172.21.15.62:0/2170081097 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da0067040 con 0x56056561b8e0 2024-09-10T05:38:25.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.036+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94581175766976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560565627130 con 0x56056561b8e0 2024-09-10T05:38:25.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.036+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560565628880 con 0x7f4da000d770 2024-09-10T05:38:25.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.036+0000 7f4db11a8640 1 -- 172.21.15.62:0/2170081097 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da80083f0 con 0x7f4da000d770 2024-09-10T05:38:25.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.036+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94581175780304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560565627130 con 0x7f4da000d770 2024-09-10T05:38:25.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.036+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560565629300 con 0x56056561b8e0 2024-09-10T05:38:25.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.036+0000 7f4db09a7640 1 -- 172.21.15.62:0/2170081097 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94581175766976] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da0067040 con 0x56056561b8e0 2024-09-10T05:38:25.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.036+0000 7f4db11a8640 1 -- 172.21.15.62:0/2170081097 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94581175780304] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da80083f0 con 0x7f4da000d770 2024-09-10T05:38:25.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.040+0000 7f4db09a7640 1 -- 172.21.15.62:0/2170081097 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da0067040 con 0x56056561b8e0 2024-09-10T05:38:25.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.040+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94581175781360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560565628e10 con 0x56056561b8e0 2024-09-10T05:38:25.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.040+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560565629ba0 con 0x56056561f0e0 2024-09-10T05:38:25.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.040+0000 7f4db01a6640 1 -- 172.21.15.62:0/2170081097 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d980c3050 con 0x56056561f0e0 2024-09-10T05:38:25.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.040+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94581175785200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560565628e10 con 0x56056561f0e0 2024-09-10T05:38:25.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.040+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56056562aa10 con 0x56056561f0e0 2024-09-10T05:38:25.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.040+0000 7f4db09a7640 1 -- 172.21.15.62:0/2170081097 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94581175781360] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da0067040 con 0x56056561b8e0 2024-09-10T05:38:25.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.040+0000 7f4db01a6640 1 -- 172.21.15.62:0/2170081097 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94581175785200] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d980c3050 con 0x56056561f0e0 2024-09-10T05:38:25.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.040+0000 7f4db01a6640 1 -- 172.21.15.62:0/2170081097 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d980c3050 con 0x56056561f0e0 2024-09-10T05:38:25.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.040+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94581175787328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56056562a560 con 0x56056561f0e0 2024-09-10T05:38:25.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.040+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56056562ae50 con 0x7f4da000d770 2024-09-10T05:38:25.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.044+0000 7f4db01a6640 1 -- 172.21.15.62:0/2170081097 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94581175787328] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d980c3050 con 0x56056561f0e0 2024-09-10T05:38:25.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.044+0000 7f4db11a8640 1 -- 172.21.15.62:0/2170081097 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da80083f0 con 0x7f4da000d770 2024-09-10T05:38:25.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.044+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94581175778032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56056562aa10 con 0x7f4da000d770 2024-09-10T05:38:25.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.044+0000 7f4db2ea19c0 20 add_watcher() i=0 2024-09-10T05:38:25.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.044+0000 7f4db2ea19c0 20 add_watcher() i=1 2024-09-10T05:38:25.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.044+0000 7f4db2ea19c0 20 add_watcher() i=2 2024-09-10T05:38:25.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.044+0000 7f4db2ea19c0 20 add_watcher() i=3 2024-09-10T05:38:25.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.044+0000 7f4db2ea19c0 20 add_watcher() i=4 2024-09-10T05:38:25.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.044+0000 7f4db2ea19c0 20 add_watcher() i=5 2024-09-10T05:38:25.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.044+0000 7f4db2ea19c0 20 add_watcher() i=6 2024-09-10T05:38:25.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.044+0000 7f4db11a8640 1 -- 172.21.15.62:0/2170081097 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94581175778032] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da80083f0 con 0x7f4da000d770 2024-09-10T05:38:25.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.044+0000 7f4db2ea19c0 20 add_watcher() i=7 2024-09-10T05:38:25.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.044+0000 7f4db2ea19c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:38:25.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.044+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56056562e2a0 con 0x560565617450 2024-09-10T05:38:25.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.044+0000 7f4db11a8640 1 -- 172.21.15.62:0/2170081097 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4da80083f0 con 0x560565617450 2024-09-10T05:38:25.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.044+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94581175789440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56056562b6a0 con 0x560565617450 2024-09-10T05:38:25.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.048+0000 7f4db11a8640 1 -- 172.21.15.62:0/2170081097 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94581175789440] v34'272 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4da80083f0 con 0x560565617450 2024-09-10T05:38:25.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.048+0000 7f4c66fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:38:25.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.048+0000 7f4db2ea19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:38:25.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.048+0000 7f4db2ea19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:38:25.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.048+0000 7f4db2ea19c0 5 note: GC not initialized 2024-09-10T05:38:25.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.048+0000 7f4c65fe3640 20 reqs_thread_entry: start 2024-09-10T05:38:25.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.048+0000 7f4db2ea19c0 20 init_complete bucket index max shards: 11 2024-09-10T05:38:25.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.048+0000 7f4db2ea19c0 20 Filter name: none 2024-09-10T05:38:25.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.048+0000 7f4bd77fe640 20 reqs_thread_entry: start 2024-09-10T05:38:25.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.048+0000 7f4db2ea19c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-10T05:38:25.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.048+0000 7f4db2ea19c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:25.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.048+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560565651660 con 0x560565617450 2024-09-10T05:38:25.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.048+0000 7f4db11a8640 1 -- 172.21.15.62:0/2170081097 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f4da80083f0 con 0x560565617450 2024-09-10T05:38:25.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.048+0000 7f4db2ea19c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-10T05:38:25.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.048+0000 7f4db2ea19c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-10T05:38:25.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.048+0000 7f4db2ea19c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:38:25.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.048+0000 7f4db2ea19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:38:25.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.048+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560565657b70 con 0x560565617450 2024-09-10T05:38:25.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.048+0000 7f4db11a8640 1 -- 172.21.15.62:0/2170081097 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v34'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f4da803a040 con 0x560565617450 2024-09-10T05:38:25.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.048+0000 7f4db2ea19c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T05:38:25.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.048+0000 7f4db2ea19c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:38:25.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.048+0000 7f4db2ea19c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-10T05:38:25.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.052+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94581175973344 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5605656532a0 con 0x56056561b8e0 2024-09-10T05:38:25.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.052+0000 7f4db09a7640 1 -- 172.21.15.62:0/2170081097 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== watch-notify(notify (1) cookie 94581175781360 notify 146028888119 ret 0) ==== 708+0+0 (crc 0 0 0) 0x5605655f7570 con 0x56056561b8e0 2024-09-10T05:38:25.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.052+0000 7f4db09a7640 1 -- 172.21.15.62:0/2170081097 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(64 notify.4 [notify cookie 94581175973344 out=8b] v0'0 uv270 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4da0067040 con 0x56056561b8e0 2024-09-10T05:38:25.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.052+0000 7f4c877fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888119 cookie 94581175781360 notifier 4899 bl.length()=666 2024-09-10T05:38:25.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.052+0000 7f4c877fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T05:38:25.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.052+0000 7f4c877fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:38:25.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.052+0000 7f4c877fe640 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f4be4003440 con 0x56056561b8e0 2024-09-10T05:38:25.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.052+0000 7f4db09a7640 1 -- 172.21.15.62:0/2170081097 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== watch-notify(notify_complete (2) cookie 94581175973344 notify 146028888119 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5605655d9fe0 con 0x56056561b8e0 2024-09-10T05:38:25.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.052+0000 7f4db09a7640 1 -- 172.21.15.62:0/2170081097 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da0067040 con 0x56056561b8e0 2024-09-10T05:38:25.055 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-10T05:38:22.896781Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"write"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:38:22.896764Z","tags":[],"group_ids":[]} 2024-09-10T05:38:25.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.052+0000 7f4c66fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:38:25.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.052+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94581175789440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56056564f470 con 0x560565617450 2024-09-10T05:38:25.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.056+0000 7f4db11a8640 1 -- 172.21.15.62:0/2170081097 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94581175789440] v34'273 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4da803a040 con 0x560565617450 2024-09-10T05:38:25.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.056+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94581175769488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56056564f470 con 0x56056561b8e0 2024-09-10T05:38:25.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.056+0000 7f4db09a7640 1 -- 172.21.15.62:0/2170081097 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94581175769488] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da0067040 con 0x56056561b8e0 2024-09-10T05:38:25.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.060+0000 7f4db2ea19c0 20 remove_watcher() i=0 2024-09-10T05:38:25.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.060+0000 7f4db2ea19c0 2 removed watcher, disabling cache 2024-09-10T05:38:25.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.060+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94581175773408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56056564f470 con 0x560565617450 2024-09-10T05:38:25.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.060+0000 7f4db11a8640 1 -- 172.21.15.62:0/2170081097 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94581175773408] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da803a040 con 0x560565617450 2024-09-10T05:38:25.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.060+0000 7f4db2ea19c0 20 remove_watcher() i=1 2024-09-10T05:38:25.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.060+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94581175766976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56056564f470 con 0x56056561b8e0 2024-09-10T05:38:25.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.060+0000 7f4db09a7640 1 -- 172.21.15.62:0/2170081097 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94581175766976] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da0067040 con 0x56056561b8e0 2024-09-10T05:38:25.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.060+0000 7f4db2ea19c0 20 remove_watcher() i=2 2024-09-10T05:38:25.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.060+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94581175780304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56056564f470 con 0x7f4da000d770 2024-09-10T05:38:25.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.064+0000 7f4db11a8640 1 -- 172.21.15.62:0/2170081097 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94581175780304] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da803a040 con 0x7f4da000d770 2024-09-10T05:38:25.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.064+0000 7f4db2ea19c0 20 remove_watcher() i=3 2024-09-10T05:38:25.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.064+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94581175781360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56056564f470 con 0x56056561b8e0 2024-09-10T05:38:25.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.064+0000 7f4db09a7640 1 -- 172.21.15.62:0/2170081097 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94581175781360] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da0067040 con 0x56056561b8e0 2024-09-10T05:38:25.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.064+0000 7f4db2ea19c0 20 remove_watcher() i=4 2024-09-10T05:38:25.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.064+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94581175785200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56056564f470 con 0x56056561f0e0 2024-09-10T05:38:25.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.068+0000 7f4db01a6640 1 -- 172.21.15.62:0/2170081097 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94581175785200] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d980c3050 con 0x56056561f0e0 2024-09-10T05:38:25.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.068+0000 7f4db2ea19c0 20 remove_watcher() i=5 2024-09-10T05:38:25.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.068+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94581175787328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56056564f470 con 0x56056561f0e0 2024-09-10T05:38:25.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.068+0000 7f4db01a6640 1 -- 172.21.15.62:0/2170081097 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94581175787328] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d980c3050 con 0x56056561f0e0 2024-09-10T05:38:25.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.068+0000 7f4db2ea19c0 20 remove_watcher() i=6 2024-09-10T05:38:25.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.068+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94581175778032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56056564f470 con 0x7f4da000d770 2024-09-10T05:38:25.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.068+0000 7f4db11a8640 1 -- 172.21.15.62:0/2170081097 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94581175778032] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da803a040 con 0x7f4da000d770 2024-09-10T05:38:25.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.068+0000 7f4db2ea19c0 20 remove_watcher() i=7 2024-09-10T05:38:25.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.068+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x56056561b8e0 msgr2=0x56056561dcd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.068+0000 7f4db2ea19c0 1 --2- 172.21.15.62:0/2170081097 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x56056561b8e0 0x56056561dcd0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.068+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560565617450 msgr2=0x5605656198e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.068+0000 7f4db2ea19c0 1 --2- 172.21.15.62:0/2170081097 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560565617450 0x5605656198e0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.068+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f4da000d770 msgr2=0x7f4da0042710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.068+0000 7f4db2ea19c0 1 --2- 172.21.15.62:0/2170081097 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f4da000d770 0x7f4da0042710 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.068+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56056561f0e0 msgr2=0x5605656214d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.068+0000 7f4db2ea19c0 1 --2- 172.21.15.62:0/2170081097 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x56056561f0e0 0x5605656214d0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.068+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4c7c039a70 msgr2=0x7f4c7c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.068+0000 7f4db2ea19c0 1 --2- 172.21.15.62:0/2170081097 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4c7c039a70 0x7f4c7c03bf30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f4d980aa980 tx=0x7f4d980a6000 comp rx=0 tx=0).stop 2024-09-10T05:38:25.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.068+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56056545acc0 msgr2=0x56056560c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.068+0000 7f4db11a8640 1 -- 172.21.15.62:0/2170081097 reap_dead start 2024-09-10T05:38:25.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.068+0000 7f4db2ea19c0 1 --2- 172.21.15.62:0/2170081097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56056545acc0 0x56056560c650 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f4da001dfd0 tx=0x7f4da00471f0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.068+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 shutdown_connections 2024-09-10T05:38:25.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.068+0000 7f4db2ea19c0 1 --2- 172.21.15.62:0/2170081097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56056545acc0 0x56056560c650 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.068+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 >> 172.21.15.62:0/2170081097 conn(0x5605655ff510 msgr2=0x5605655fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:25.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.068+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 shutdown_connections 2024-09-10T05:38:25.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.068+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2170081097 wait complete. 2024-09-10T05:38:25.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.068+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/1824723145 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4c88039a70 msgr2=0x7f4c8803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.068+0000 7f4db2ea19c0 1 --2- 172.21.15.62:0/1824723145 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4c88039a70 0x7f4c8803bf30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x5605655da2c0 tx=0x7f4d98005e50 comp rx=0 tx=0).stop 2024-09-10T05:38:25.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.068+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/1824723145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605655f6b10 msgr2=0x5605655f6f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.068+0000 7f4db2ea19c0 1 --2- 172.21.15.62:0/1824723145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605655f6b10 0x5605655f6f30 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f4da0017cd0 tx=0x7f4da0019e60 comp rx=0 tx=0).stop 2024-09-10T05:38:25.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.072+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/1824723145 shutdown_connections 2024-09-10T05:38:25.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.072+0000 7f4db2ea19c0 1 --2- 172.21.15.62:0/1824723145 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4c88039a70 0x7f4c8803bf30 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.072+0000 7f4db2ea19c0 1 --2- 172.21.15.62:0/1824723145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605655f6b10 0x5605655f6f30 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.072+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/1824723145 >> 172.21.15.62:0/1824723145 conn(0x5605655ec4c0 msgr2=0x5605655ec8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:25.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.072+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/1824723145 shutdown_connections 2024-09-10T05:38:25.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.072+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/1824723145 wait complete. 2024-09-10T05:38:25.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.072+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2306071923 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5605655e12a0 msgr2=0x5605655e3690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.072+0000 7f4db2ea19c0 1 --2- 172.21.15.62:0/2306071923 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x5605655e12a0 0x5605655e3690 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.072+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2306071923 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5605654ea0c0 msgr2=0x5605655dffb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.072+0000 7f4db2ea19c0 1 --2- 172.21.15.62:0/2306071923 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x5605654ea0c0 0x5605655dffb0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.072+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2306071923 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5605655e5a10 msgr2=0x5605655e7e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.072+0000 7f4db2ea19c0 1 --2- 172.21.15.62:0/2306071923 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x5605655e5a10 0x5605655e7e00 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.072+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2306071923 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4c98039a70 msgr2=0x7f4c9803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.072+0000 7f4db2ea19c0 1 --2- 172.21.15.62:0/2306071923 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f4c98039a70 0x7f4c9803bf30 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f4d980ab000 tx=0x7f4d980a5000 comp rx=0 tx=0).stop 2024-09-10T05:38:25.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.072+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2306071923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605654e5f70 msgr2=0x5605655d8e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.072+0000 7f4db2ea19c0 1 --2- 172.21.15.62:0/2306071923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605654e5f70 0x5605655d8e40 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x5605655d2700 tx=0x7f4da0000bd0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.072+0000 7f4db11a8640 1 -- 172.21.15.62:0/2306071923 reap_dead start 2024-09-10T05:38:25.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.072+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2306071923 shutdown_connections 2024-09-10T05:38:25.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.072+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2306071923 >> 172.21.15.62:0/2306071923 conn(0x5605654e1a90 msgr2=0x5605655cbe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:25.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.072+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2306071923 shutdown_connections 2024-09-10T05:38:25.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.072+0000 7f4db2ea19c0 1 -- 172.21.15.62:0/2306071923 wait complete. 2024-09-10T05:38:25.085 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T05:38:22.896781Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:38:22.896764Z', 'tags': [], 'group_ids': []} 2024-09-10T05:38:25.085 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T05:38:22.896781Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:38:22.896764Z', 'tags': [], 'group_ids': []} 2024-09-10T05:38:25.085 ERROR:root:0 2024-09-10T05:38:25.086 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T05:38:25.090 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'AccessDenied', 'Message': '', 'RequestId': 'tx00000d4542494ef0e3c5a-0066dfdb51-4227-default', 'HostId': '4227-default-default'} 2024-09-10T05:38:25.090 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-10T05:38:25.090 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-10T05:38:25.090 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps user-info-without-keys=write 2024-09-10T05:38:25.168 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:38:25.169 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:38:25.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.168+0000 7fab54ab79c0 1 Processor -- start 2024-09-10T05:38:25.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.168+0000 7fab54ab79c0 1 -- start start 2024-09-10T05:38:25.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.168+0000 7fab54ab79c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55def0bf1fe0 0x55def0bf43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.168+0000 7fab54ab79c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55def0aa39c0 con 0x55def0beddf0 2024-09-10T05:38:25.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.168+0000 7fab54ab79c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x55def0af36d0 con 0x55def0bf1fe0 2024-09-10T05:38:25.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.168+0000 7fab51dbc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55def0bf1fe0 0x55def0bf43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.168+0000 7fab51dbc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55def0bf1fe0 0x55def0bf43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:53794/0 (socket says 172.21.15.62:53794) 2024-09-10T05:38:25.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.168+0000 7fab51dbc640 1 -- 172.21.15.62:0/3598814351 learned_addr learned my addr 172.21.15.62:0/3598814351 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:25.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.168+0000 7fab525bd640 1 --1- 172.21.15.62:0/3598814351 >> v1:172.21.15.2:6789/0 conn(0x55def0beddf0 0x55def0bee1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:48844/0 (socket says 172.21.15.62:48844) 2024-09-10T05:38:25.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.168+0000 7fab51dbc640 1 -- 172.21.15.62:0/3598814351 >> v1:172.21.15.2:6789/0 conn(0x55def0beddf0 legacy=0x55def0bee1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.168+0000 7fab51dbc640 1 -- 172.21.15.62:0/3598814351 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55def0a97ca0 con 0x55def0bf1fe0 2024-09-10T05:38:25.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.168+0000 7fab51dbc640 1 --2- 172.21.15.62:0/3598814351 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55def0bf1fe0 0x55def0bf43d0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fab4800a750 tx=0x7fab4801d290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=359de506cbd78352 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.168+0000 7fab515bb640 1 -- 172.21.15.62:0/3598814351 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab4800a200 con 0x55def0bf1fe0 2024-09-10T05:38:25.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.168+0000 7fab515bb640 1 -- 172.21.15.62:0/3598814351 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab4800a3a0 con 0x55def0bf1fe0 2024-09-10T05:38:25.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.168+0000 7fab515bb640 1 -- 172.21.15.62:0/3598814351 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab480086f0 con 0x55def0bf1fe0 2024-09-10T05:38:25.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.172+0000 7fab54ab79c0 1 -- 172.21.15.62:0/3598814351 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55def0bf1fe0 msgr2=0x55def0bf43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.172+0000 7fab54ab79c0 1 --2- 172.21.15.62:0/3598814351 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55def0bf1fe0 0x55def0bf43d0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fab4800a750 tx=0x7fab4801d290 comp rx=0 tx=0).stop 2024-09-10T05:38:25.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.172+0000 7fab54ab79c0 1 -- 172.21.15.62:0/3598814351 shutdown_connections 2024-09-10T05:38:25.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.172+0000 7fab54ab79c0 1 --2- 172.21.15.62:0/3598814351 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55def0bf1fe0 0x55def0bf43d0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.172+0000 7fab54ab79c0 1 -- 172.21.15.62:0/3598814351 >> 172.21.15.62:0/3598814351 conn(0x55def0be9910 msgr2=0x55def0bebd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:25.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.172+0000 7fab54ab79c0 1 -- 172.21.15.62:0/3598814351 shutdown_connections 2024-09-10T05:38:25.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.172+0000 7fab54ab79c0 1 -- 172.21.15.62:0/3598814351 wait complete. 2024-09-10T05:38:25.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.184+0000 7fab54ab79c0 1 Processor -- start 2024-09-10T05:38:25.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.184+0000 7fab54ab79c0 1 -- start start 2024-09-10T05:38:25.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.188+0000 7fab54ab79c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55def0beddf0 0x55def0cd84e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.188+0000 7fab54ab79c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55def0af7680 con 0x55def0beddf0 2024-09-10T05:38:25.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.188+0000 7fab525bd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55def0beddf0 0x55def0cd84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.188+0000 7fab525bd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55def0beddf0 0x55def0cd84e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:53804/0 (socket says 172.21.15.62:53804) 2024-09-10T05:38:25.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.188+0000 7fab525bd640 1 -- 172.21.15.62:0/2020027136 learned_addr learned my addr 172.21.15.62:0/2020027136 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:25.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.188+0000 7fab525bd640 1 -- 172.21.15.62:0/2020027136 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55def0a72da0 con 0x55def0beddf0 2024-09-10T05:38:25.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.188+0000 7fab525bd640 1 --2- 172.21.15.62:0/2020027136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55def0beddf0 0x55def0cd84e0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fab4c0016f0 tx=0x7fab4c001bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da8ef6a1d58ba181 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.188+0000 7faa40608640 1 -- 172.21.15.62:0/2020027136 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab4c003460 con 0x55def0beddf0 2024-09-10T05:38:25.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.188+0000 7faa40608640 1 -- 172.21.15.62:0/2020027136 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab4c003620 con 0x55def0beddf0 2024-09-10T05:38:25.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.188+0000 7faa40608640 1 -- 172.21.15.62:0/2020027136 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab4c003940 con 0x55def0beddf0 2024-09-10T05:38:25.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.188+0000 7fab54ab79c0 1 -- 172.21.15.62:0/2020027136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55def0beddf0 msgr2=0x55def0cd84e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.188+0000 7fab54ab79c0 1 --2- 172.21.15.62:0/2020027136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55def0beddf0 0x55def0cd84e0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fab4c0016f0 tx=0x7fab4c001bb0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.188+0000 7fab54ab79c0 1 -- 172.21.15.62:0/2020027136 shutdown_connections 2024-09-10T05:38:25.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.188+0000 7fab54ab79c0 1 --2- 172.21.15.62:0/2020027136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55def0beddf0 0x55def0cd84e0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.188+0000 7fab54ab79c0 1 -- 172.21.15.62:0/2020027136 >> 172.21.15.62:0/2020027136 conn(0x55def0be9910 msgr2=0x55def0cd4120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:25.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.188+0000 7fab54ab79c0 1 -- 172.21.15.62:0/2020027136 shutdown_connections 2024-09-10T05:38:25.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.188+0000 7fab54ab79c0 1 -- 172.21.15.62:0/2020027136 wait complete. 2024-09-10T05:38:25.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.188+0000 7fab54ab79c0 1 Processor -- start 2024-09-10T05:38:25.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.188+0000 7fab54ab79c0 1 -- start start 2024-09-10T05:38:25.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.188+0000 7fab54ab79c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55def0beddf0 0x55def0ce3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.188+0000 7fab54ab79c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55def0a99a50 con 0x55def0beddf0 2024-09-10T05:38:25.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.188+0000 7fab525bd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55def0beddf0 0x55def0ce3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.188+0000 7fab525bd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55def0beddf0 0x55def0ce3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:53810/0 (socket says 172.21.15.62:53810) 2024-09-10T05:38:25.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.188+0000 7fab525bd640 1 -- 172.21.15.62:0/824498398 learned_addr learned my addr 172.21.15.62:0/824498398 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:25.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.192+0000 7fab525bd640 1 -- 172.21.15.62:0/824498398 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55def0ce44e0 con 0x55def0beddf0 2024-09-10T05:38:25.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.192+0000 7fab525bd640 1 --2- 172.21.15.62:0/824498398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55def0beddf0 0x55def0ce3f80 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fab4c001bf0 tx=0x7fab4c001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.192+0000 7faa3ee05640 1 -- 172.21.15.62:0/824498398 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab4c022020 con 0x55def0beddf0 2024-09-10T05:38:25.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.192+0000 7fab54ab79c0 1 -- 172.21.15.62:0/824498398 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55def0ce4770 con 0x55def0beddf0 2024-09-10T05:38:25.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.192+0000 7faa3ee05640 1 -- 172.21.15.62:0/824498398 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab4c006820 con 0x55def0beddf0 2024-09-10T05:38:25.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.192+0000 7faa3ee05640 1 -- 172.21.15.62:0/824498398 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab4c01e690 con 0x55def0beddf0 2024-09-10T05:38:25.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.192+0000 7fab54ab79c0 1 -- 172.21.15.62:0/824498398 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55def0ce51a0 con 0x55def0beddf0 2024-09-10T05:38:25.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.192+0000 7faa3ee05640 1 -- 172.21.15.62:0/824498398 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fab4c025020 con 0x55def0beddf0 2024-09-10T05:38:25.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.192+0000 7faa3ee05640 1 --2- 172.21.15.62:0/824498398 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7faa38039a70 0x7faa3803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.192+0000 7faa3ee05640 1 -- 172.21.15.62:0/824498398 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7fab4c0500a0 con 0x55def0beddf0 2024-09-10T05:38:25.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.192+0000 7fab51dbc640 1 --2- 172.21.15.62:0/824498398 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7faa38039a70 0x7faa3803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.192+0000 7fab54ab79c0 1 --2- 172.21.15.62:0/824498398 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55def0bf1fe0 0x55def0ceb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.192+0000 7fab54ab79c0 1 -- 172.21.15.62:0/824498398 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55def0ceb630 con 0x55def0bf1fe0 2024-09-10T05:38:25.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.192+0000 7fab52dbe640 1 --2- 172.21.15.62:0/824498398 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55def0bf1fe0 0x55def0ceb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.192+0000 7fab51dbc640 1 --2- 172.21.15.62:0/824498398 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7faa38039a70 0x7faa3803bf30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fab480ad000 tx=0x7fab480a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.192+0000 7fab52dbe640 1 --2- 172.21.15.62:0/824498398 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55def0bf1fe0 0x55def0ceb0f0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.192+0000 7fab52dbe640 1 -- 172.21.15.62:0/824498398 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab440083f0 con 0x55def0bf1fe0 2024-09-10T05:38:25.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.192+0000 7fab54ab79c0 1 --2- 172.21.15.62:0/824498398 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55def0cec390 0x55def0cee780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.192+0000 7fab54ab79c0 1 -- 172.21.15.62:0/824498398 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55def0ceed70 con 0x55def0cec390 2024-09-10T05:38:25.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.196+0000 7fab525bd640 1 --2- 172.21.15.62:0/824498398 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55def0cec390 0x55def0cee780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.196+0000 7fab525bd640 1 --2- 172.21.15.62:0/824498398 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55def0cec390 0x55def0cee780 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.196+0000 7fab525bd640 1 -- 172.21.15.62:0/824498398 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fab4c01b040 con 0x55def0cec390 2024-09-10T05:38:25.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.196+0000 7fab54ab79c0 1 --2- 172.21.15.62:0/824498398 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55def0cf0b30 0x55def0cf2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.196+0000 7fab54ab79c0 1 -- 172.21.15.62:0/824498398 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55def0cf3610 con 0x55def0cf0b30 2024-09-10T05:38:25.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.196+0000 7fab51dbc640 1 --2- 172.21.15.62:0/824498398 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55def0cf0b30 0x55def0cf2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.196+0000 7fab51dbc640 1 --2- 172.21.15.62:0/824498398 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55def0cf0b30 0x55def0cf2f20 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.196+0000 7fab51dbc640 1 -- 172.21.15.62:0/824498398 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv5 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fab480aa070 con 0x55def0cf0b30 2024-09-10T05:38:25.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.196+0000 7fab54ab79c0 1 -- 172.21.15.62:0/824498398 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55def0cef9a0 con 0x55def0cec390 2024-09-10T05:38:25.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.196+0000 7fab525bd640 1 -- 172.21.15.62:0/824498398 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fab4c01b040 con 0x55def0cec390 2024-09-10T05:38:25.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.196+0000 7fab54ab79c0 1 -- 172.21.15.62:0/824498398 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55def0cefe00 con 0x55def0cf0b30 2024-09-10T05:38:25.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.196+0000 7fab51dbc640 1 -- 172.21.15.62:0/824498398 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fab480aa070 con 0x55def0cf0b30 2024-09-10T05:38:25.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.196+0000 7fab54ab79c0 1 Processor -- start 2024-09-10T05:38:25.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.200+0000 7fab54ab79c0 1 -- start start 2024-09-10T05:38:25.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.200+0000 7fab54ab79c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55def0d01c20 0x55def0d02040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.200+0000 7fab54ab79c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55def0b04450 con 0x55def0d01c20 2024-09-10T05:38:25.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.200+0000 7fab525bd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55def0d01c20 0x55def0d02040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.200+0000 7fab525bd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55def0d01c20 0x55def0d02040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:53818/0 (socket says 172.21.15.62:53818) 2024-09-10T05:38:25.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.200+0000 7fab525bd640 1 -- 172.21.15.62:0/2748708408 learned_addr learned my addr 172.21.15.62:0/2748708408 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:25.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.200+0000 7fab525bd640 1 -- 172.21.15.62:0/2748708408 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55def0d02680 con 0x55def0d01c20 2024-09-10T05:38:25.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.200+0000 7fab525bd640 1 --2- 172.21.15.62:0/2748708408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55def0d01c20 0x55def0d02040 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fab4c0069d0 tx=0x7fab4c0129b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.200+0000 7faa37fff640 1 -- 172.21.15.62:0/2748708408 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab4c047520 con 0x55def0d01c20 2024-09-10T05:38:25.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.200+0000 7fab54ab79c0 1 -- 172.21.15.62:0/2748708408 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55def0d02ee0 con 0x55def0d01c20 2024-09-10T05:38:25.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.200+0000 7faa37fff640 1 -- 172.21.15.62:0/2748708408 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab4c0476c0 con 0x55def0d01c20 2024-09-10T05:38:25.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.200+0000 7faa37fff640 1 -- 172.21.15.62:0/2748708408 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab4c01e8c0 con 0x55def0d01c20 2024-09-10T05:38:25.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.200+0000 7fab54ab79c0 1 -- 172.21.15.62:0/2748708408 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55def0d03450 con 0x55def0d01c20 2024-09-10T05:38:25.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.200+0000 7faa37fff640 1 -- 172.21.15.62:0/2748708408 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fab4c01ea60 con 0x55def0d01c20 2024-09-10T05:38:25.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.200+0000 7faa37fff640 1 --2- 172.21.15.62:0/2748708408 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7faa2c039a70 0x7faa2c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.200+0000 7faa37fff640 1 -- 172.21.15.62:0/2748708408 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7fab4c039c20 con 0x55def0d01c20 2024-09-10T05:38:25.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.200+0000 7fab51dbc640 1 --2- 172.21.15.62:0/2748708408 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7faa2c039a70 0x7faa2c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.200+0000 7fab54ab79c0 1 Processor -- start 2024-09-10T05:38:25.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.204+0000 7fab54ab79c0 1 -- start start 2024-09-10T05:38:25.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.204+0000 7fab51dbc640 1 --2- 172.21.15.62:0/2748708408 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7faa2c039a70 0x7faa2c03bf30 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x55def0ce53a0 tx=0x7fab48005ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.204+0000 7fab54ab79c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55def0d0f410 0x55def0d0f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.204+0000 7fab54ab79c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55def0cd8cd0 con 0x55def0d0f410 2024-09-10T05:38:25.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.204+0000 7fab525bd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55def0d0f410 0x55def0d0f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.204+0000 7fab525bd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55def0d0f410 0x55def0d0f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:53828/0 (socket says 172.21.15.62:53828) 2024-09-10T05:38:25.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.204+0000 7fab525bd640 1 -- 172.21.15.62:0/4108043922 learned_addr learned my addr 172.21.15.62:0/4108043922 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:25.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.204+0000 7fab525bd640 1 -- 172.21.15.62:0/4108043922 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55def0d0fdc0 con 0x55def0d0f410 2024-09-10T05:38:25.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.204+0000 7fab525bd640 1 --2- 172.21.15.62:0/4108043922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55def0d0f410 0x55def0d0f7f0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fab4c01d9c0 tx=0x7fab4c027b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=412485c4850381b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.204+0000 7faa35ffb640 1 -- 172.21.15.62:0/4108043922 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab4c03d040 con 0x55def0d0f410 2024-09-10T05:38:25.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.204+0000 7faa35ffb640 1 -- 172.21.15.62:0/4108043922 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab4c01d5a0 con 0x55def0d0f410 2024-09-10T05:38:25.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.204+0000 7faa35ffb640 1 -- 172.21.15.62:0/4108043922 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab4c04e850 con 0x55def0d0f410 2024-09-10T05:38:25.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.204+0000 7fab54ab79c0 1 -- 172.21.15.62:0/4108043922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55def0d0f410 msgr2=0x55def0d0f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.204+0000 7fab54ab79c0 1 --2- 172.21.15.62:0/4108043922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55def0d0f410 0x55def0d0f7f0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fab4c01d9c0 tx=0x7fab4c027b50 comp rx=0 tx=0).stop 2024-09-10T05:38:25.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.204+0000 7fab54ab79c0 1 -- 172.21.15.62:0/4108043922 shutdown_connections 2024-09-10T05:38:25.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.204+0000 7fab54ab79c0 1 --2- 172.21.15.62:0/4108043922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55def0d0f410 0x55def0d0f7f0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.204+0000 7fab54ab79c0 1 -- 172.21.15.62:0/4108043922 >> 172.21.15.62:0/4108043922 conn(0x55def0d0a7d0 msgr2=0x55def0d08a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:25.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.204+0000 7fab54ab79c0 1 -- 172.21.15.62:0/4108043922 shutdown_connections 2024-09-10T05:38:25.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.204+0000 7fab54ab79c0 1 -- 172.21.15.62:0/4108043922 wait complete. 2024-09-10T05:38:25.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.204+0000 7fab54ab79c0 1 Processor -- start 2024-09-10T05:38:25.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.204+0000 7fab54ab79c0 1 -- start start 2024-09-10T05:38:25.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.204+0000 7fab54ab79c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55def0d0f410 0x55def0d15690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.204+0000 7fab54ab79c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55def0d0e180 con 0x55def0d0f410 2024-09-10T05:38:25.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.204+0000 7fab525bd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55def0d0f410 0x55def0d15690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.204+0000 7fab525bd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55def0d0f410 0x55def0d15690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:53838/0 (socket says 172.21.15.62:53838) 2024-09-10T05:38:25.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.204+0000 7fab525bd640 1 -- 172.21.15.62:0/396152306 learned_addr learned my addr 172.21.15.62:0/396152306 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:25.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.204+0000 7fab525bd640 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55def0d15bf0 con 0x55def0d0f410 2024-09-10T05:38:25.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.208+0000 7fab525bd640 1 --2- 172.21.15.62:0/396152306 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55def0d0f410 0x55def0d15690 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fab4c0137b0 tx=0x7fab4c013740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.208+0000 7faa23fff640 1 -- 172.21.15.62:0/396152306 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab4c06c070 con 0x55def0d0f410 2024-09-10T05:38:25.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.208+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55def0d15bf0 con 0x55def0d0f410 2024-09-10T05:38:25.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.208+0000 7faa23fff640 1 -- 172.21.15.62:0/396152306 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab4c01d5a0 con 0x55def0d0f410 2024-09-10T05:38:25.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.208+0000 7faa23fff640 1 -- 172.21.15.62:0/396152306 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab4c03d040 con 0x55def0d0f410 2024-09-10T05:38:25.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.208+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55def0d15bf0 con 0x55def0d0f410 2024-09-10T05:38:25.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.208+0000 7faa23fff640 1 -- 172.21.15.62:0/396152306 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fab4c04ebd0 con 0x55def0d0f410 2024-09-10T05:38:25.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.208+0000 7fab54ab79c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:25.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.208+0000 7faa23fff640 1 --2- 172.21.15.62:0/396152306 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7faa1c0399d0 0x7faa1c03be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.208+0000 7faa23fff640 1 -- 172.21.15.62:0/396152306 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7fab4c064070 con 0x55def0d0f410 2024-09-10T05:38:25.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.208+0000 7fab51dbc640 1 --2- 172.21.15.62:0/396152306 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7faa1c0399d0 0x7faa1c03be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.208+0000 7fab54ab79c0 1 --2- 172.21.15.62:0/396152306 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55def0d205f0 0x55def0d22a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.208+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55def0d231d0 con 0x55def0d205f0 2024-09-10T05:38:25.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.208+0000 7fab52dbe640 1 --2- 172.21.15.62:0/396152306 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55def0d205f0 0x55def0d22a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.208+0000 7fab51dbc640 1 --2- 172.21.15.62:0/396152306 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7faa1c0399d0 0x7faa1c03be90 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fab4801d2d0 tx=0x7fab480a9000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.208+0000 7fab52dbe640 1 --2- 172.21.15.62:0/396152306 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55def0d205f0 0x55def0d22a80 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.208+0000 7fab52dbe640 1 -- 172.21.15.62:0/396152306 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab440083f0 con 0x55def0d205f0 2024-09-10T05:38:25.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.208+0000 7fab54ab79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:25.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.208+0000 7fab54ab79c0 20 realm 2024-09-10T05:38:25.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.208+0000 7fab54ab79c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:25.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.208+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55def0d1f9e0 con 0x55def0d205f0 2024-09-10T05:38:25.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.208+0000 7fab52dbe640 1 -- 172.21.15.62:0/396152306 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab440083f0 con 0x55def0d205f0 2024-09-10T05:38:25.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.208+0000 7fab54ab79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:25.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.208+0000 7fab54ab79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:38:25.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.208+0000 7fab54ab79c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:25.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.208+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55def0d23ca0 con 0x55def0d205f0 2024-09-10T05:38:25.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.208+0000 7fab52dbe640 1 -- 172.21.15.62:0/396152306 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab440083f0 con 0x55def0d205f0 2024-09-10T05:38:25.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.208+0000 7fab54ab79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:25.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.208+0000 7fab54ab79c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:25.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.208+0000 7fab54ab79c0 1 --2- 172.21.15.62:0/396152306 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55def0d24a80 0x55def0d26e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.208+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55def0d27520 con 0x55def0d24a80 2024-09-10T05:38:25.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.212+0000 7fab525bd640 1 --2- 172.21.15.62:0/396152306 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55def0d24a80 0x55def0d26e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.212+0000 7fab525bd640 1 --2- 172.21.15.62:0/396152306 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55def0d24a80 0x55def0d26e70 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.212+0000 7fab525bd640 1 -- 172.21.15.62:0/396152306 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fab4c03f070 con 0x55def0d24a80 2024-09-10T05:38:25.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.212+0000 7fab54ab79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:38:25.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.212+0000 7fab54ab79c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:25.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.212+0000 7fab54ab79c0 1 --2- 172.21.15.62:0/396152306 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55def0d28280 0x55def0d2a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.212+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55def0d2ade0 con 0x55def0d28280 2024-09-10T05:38:25.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.212+0000 7fab51dbc640 1 --2- 172.21.15.62:0/396152306 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55def0d28280 0x55def0d2a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.212+0000 7fab51dbc640 1 --2- 172.21.15.62:0/396152306 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55def0d28280 0x55def0d2a670 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.212+0000 7fab51dbc640 1 -- 172.21.15.62:0/396152306 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv5 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fab480aa070 con 0x55def0d28280 2024-09-10T05:38:25.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.212+0000 7fab54ab79c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:38:25.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.212+0000 7fab54ab79c0 20 searching for the correct realm 2024-09-10T05:38:25.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.212+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55def0d2c6b0 con 0x55def0d28280 2024-09-10T05:38:25.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.212+0000 7fab51dbc640 1 -- 172.21.15.62:0/396152306 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab480aa070 con 0x55def0d28280 2024-09-10T05:38:25.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.212+0000 7fab51dbc640 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55def0d2c6b0 con 0x55def0d24a80 2024-09-10T05:38:25.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.212+0000 7fab525bd640 1 -- 172.21.15.62:0/396152306 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab4c03f070 con 0x55def0d24a80 2024-09-10T05:38:25.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.212+0000 7fab525bd640 1 --2- 172.21.15.62:0/396152306 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fab4c027020 0x7fab4c06b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.212+0000 7fab525bd640 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55def0d2c6b0 con 0x7fab4c027020 2024-09-10T05:38:25.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.216+0000 7fab52dbe640 1 --2- 172.21.15.62:0/396152306 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fab4c027020 0x7fab4c06b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.216+0000 7fab52dbe640 1 --2- 172.21.15.62:0/396152306 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fab4c027020 0x7fab4c06b7e0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.216+0000 7fab52dbe640 1 -- 172.21.15.62:0/396152306 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab440083f0 con 0x7fab4c027020 2024-09-10T05:38:25.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.216+0000 7fab52dbe640 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55def0d2c6b0 con 0x55def0d205f0 2024-09-10T05:38:25.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.216+0000 7fab52dbe640 1 -- 172.21.15.62:0/396152306 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab440083f0 con 0x55def0d205f0 2024-09-10T05:38:25.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.216+0000 7fab52dbe640 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55def0d2c6b0 con 0x55def0d205f0 2024-09-10T05:38:25.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.216+0000 7fab52dbe640 1 -- 172.21.15.62:0/396152306 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab440083f0 con 0x55def0d205f0 2024-09-10T05:38:25.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.216+0000 7fab52dbe640 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55def0d2c6b0 con 0x55def0d28280 2024-09-10T05:38:25.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.216+0000 7fab51dbc640 1 -- 172.21.15.62:0/396152306 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab480aa070 con 0x55def0d28280 2024-09-10T05:38:25.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.216+0000 7fab51dbc640 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55def0d2c6b0 con 0x55def0d205f0 2024-09-10T05:38:25.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.216+0000 7fab52dbe640 1 -- 172.21.15.62:0/396152306 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab440083f0 con 0x55def0d205f0 2024-09-10T05:38:25.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.216+0000 7fab52dbe640 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55def0d2c6b0 con 0x55def0d24a80 2024-09-10T05:38:25.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.216+0000 7fab525bd640 1 -- 172.21.15.62:0/396152306 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab4c03f070 con 0x55def0d24a80 2024-09-10T05:38:25.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.216+0000 7fab525bd640 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55def0d2c6b0 con 0x55def0d24a80 2024-09-10T05:38:25.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.216+0000 7fab525bd640 1 -- 172.21.15.62:0/396152306 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab4c03f070 con 0x55def0d24a80 2024-09-10T05:38:25.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.216+0000 7fab525bd640 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55def0d2c6b0 con 0x55def0d205f0 2024-09-10T05:38:25.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.216+0000 7fab52dbe640 1 -- 172.21.15.62:0/396152306 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab440083f0 con 0x55def0d205f0 2024-09-10T05:38:25.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.216+0000 7fab52dbe640 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55def0d2c6b0 con 0x7fab4c027020 2024-09-10T05:38:25.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.216+0000 7fab52dbe640 1 -- 172.21.15.62:0/396152306 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab440083f0 con 0x7fab4c027020 2024-09-10T05:38:25.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.216+0000 7fab52dbe640 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55def0d2c6b0 con 0x55def0d205f0 2024-09-10T05:38:25.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.216+0000 7fab52dbe640 1 -- 172.21.15.62:0/396152306 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab440083f0 con 0x55def0d205f0 2024-09-10T05:38:25.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.216+0000 7fab52dbe640 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55def0d2c6b0 con 0x7fab4c027020 2024-09-10T05:38:25.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.220+0000 7fab52dbe640 1 -- 172.21.15.62:0/396152306 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fab440083f0 con 0x7fab4c027020 2024-09-10T05:38:25.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.220+0000 7fab52dbe640 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55def0d2c6b0 con 0x55def0d24a80 2024-09-10T05:38:25.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.220+0000 7fab525bd640 1 -- 172.21.15.62:0/396152306 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab4c03f070 con 0x55def0d24a80 2024-09-10T05:38:25.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.220+0000 7fab525bd640 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55def0d2c6b0 con 0x55def0d28280 2024-09-10T05:38:25.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.220+0000 7fab51dbc640 1 -- 172.21.15.62:0/396152306 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab480aa070 con 0x55def0d28280 2024-09-10T05:38:25.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.220+0000 7fab51dbc640 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55def0d2c6b0 con 0x55def0d205f0 2024-09-10T05:38:25.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.220+0000 7fab52dbe640 1 -- 172.21.15.62:0/396152306 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab440083f0 con 0x55def0d205f0 2024-09-10T05:38:25.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.220+0000 7fab52dbe640 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55def0d2c6b0 con 0x55def0d24a80 2024-09-10T05:38:25.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.220+0000 7fab525bd640 1 -- 172.21.15.62:0/396152306 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab4c03f070 con 0x55def0d24a80 2024-09-10T05:38:25.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.220+0000 7fab525bd640 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55def0d2c6b0 con 0x55def0d28280 2024-09-10T05:38:25.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.220+0000 7fab51dbc640 1 -- 172.21.15.62:0/396152306 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 34 out=170b] v34'5 uv5 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7fab480aa070 con 0x55def0d28280 2024-09-10T05:38:25.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.220+0000 7fab51dbc640 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55def0d2c6b0 con 0x55def0d205f0 2024-09-10T05:38:25.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.220+0000 7fab52dbe640 1 -- 172.21.15.62:0/396152306 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab440083f0 con 0x55def0d205f0 2024-09-10T05:38:25.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.220+0000 7fab52dbe640 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55def0d2c6b0 con 0x55def0d205f0 2024-09-10T05:38:25.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.220+0000 7fab52dbe640 1 -- 172.21.15.62:0/396152306 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fab440083f0 con 0x55def0d205f0 2024-09-10T05:38:25.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.220+0000 7fab52dbe640 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55def0d2c6b0 con 0x55def0d205f0 2024-09-10T05:38:25.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.220+0000 7fab52dbe640 1 -- 172.21.15.62:0/396152306 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab440083f0 con 0x55def0d205f0 2024-09-10T05:38:25.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.220+0000 7fab52dbe640 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55def0d2c6b0 con 0x55def0d28280 2024-09-10T05:38:25.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.220+0000 7fab51dbc640 1 -- 172.21.15.62:0/396152306 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab480aa070 con 0x55def0d28280 2024-09-10T05:38:25.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.220+0000 7fab51dbc640 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55def0d2c6b0 con 0x7fab4c027020 2024-09-10T05:38:25.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.220+0000 7fab52dbe640 1 -- 172.21.15.62:0/396152306 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab440083f0 con 0x7fab4c027020 2024-09-10T05:38:25.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.220+0000 7fab52dbe640 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55def0d2c6b0 con 0x55def0d205f0 2024-09-10T05:38:25.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.220+0000 7fab52dbe640 1 -- 172.21.15.62:0/396152306 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab440083f0 con 0x55def0d205f0 2024-09-10T05:38:25.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.220+0000 7fab52dbe640 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55def0d2c6b0 con 0x7fab4c027020 2024-09-10T05:38:25.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.224+0000 7fab52dbe640 1 -- 172.21.15.62:0/396152306 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab440083f0 con 0x7fab4c027020 2024-09-10T05:38:25.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.224+0000 7fab52dbe640 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55def0d2c6b0 con 0x55def0d28280 2024-09-10T05:38:25.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.224+0000 7fab51dbc640 1 -- 172.21.15.62:0/396152306 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab480aa070 con 0x55def0d28280 2024-09-10T05:38:25.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.224+0000 7fab51dbc640 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55def0d2c6b0 con 0x7fab4c027020 2024-09-10T05:38:25.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.224+0000 7fab52dbe640 1 -- 172.21.15.62:0/396152306 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab440083f0 con 0x7fab4c027020 2024-09-10T05:38:25.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.224+0000 7fab52dbe640 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55def0d2c6b0 con 0x55def0d24a80 2024-09-10T05:38:25.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.224+0000 7fab525bd640 1 -- 172.21.15.62:0/396152306 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab4c03f070 con 0x55def0d24a80 2024-09-10T05:38:25.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.224+0000 7fab525bd640 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55def0d2c6b0 con 0x55def0d24a80 2024-09-10T05:38:25.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.224+0000 7fab525bd640 1 -- 172.21.15.62:0/396152306 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab4c03f070 con 0x55def0d24a80 2024-09-10T05:38:25.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.224+0000 7fab525bd640 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55def0d2c6b0 con 0x55def0d28280 2024-09-10T05:38:25.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.224+0000 7fab51dbc640 1 -- 172.21.15.62:0/396152306 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab480aa070 con 0x55def0d28280 2024-09-10T05:38:25.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.224+0000 7fab51dbc640 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55def0d2c6b0 con 0x55def0d24a80 2024-09-10T05:38:25.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.224+0000 7fab525bd640 1 -- 172.21.15.62:0/396152306 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fab4c03f070 con 0x55def0d24a80 2024-09-10T05:38:25.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.224+0000 7fab525bd640 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55def0d2c6b0 con 0x55def0d24a80 2024-09-10T05:38:25.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.228+0000 7fab525bd640 1 -- 172.21.15.62:0/396152306 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab4c03f070 con 0x55def0d24a80 2024-09-10T05:38:25.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.228+0000 7fab54ab79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:38:25.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.228+0000 7fab54ab79c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:38:25.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.228+0000 7fab54ab79c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:38:25.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.228+0000 7fab54ab79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:38:25.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.228+0000 7fab54ab79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:38:25.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.228+0000 7fab54ab79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:38:25.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.228+0000 7fab54ab79c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:25.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.228+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55def0d2b7d0 con 0x55def0d205f0 2024-09-10T05:38:25.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.228+0000 7fab52dbe640 1 -- 172.21.15.62:0/396152306 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab440083f0 con 0x55def0d205f0 2024-09-10T05:38:25.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.228+0000 7fab54ab79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:25.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.228+0000 7fab54ab79c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:25.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.228+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55def0d2b410 con 0x55def0d24a80 2024-09-10T05:38:25.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.228+0000 7fab525bd640 1 -- 172.21.15.62:0/396152306 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fab4c03f070 con 0x55def0d24a80 2024-09-10T05:38:25.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.228+0000 7fab54ab79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:38:25.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.228+0000 7fab54ab79c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:25.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.228+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55def0d2c170 con 0x55def0d28280 2024-09-10T05:38:25.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.228+0000 7fab51dbc640 1 -- 172.21.15.62:0/396152306 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fab480aa070 con 0x55def0d28280 2024-09-10T05:38:25.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.228+0000 7fab54ab79c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:38:25.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.228+0000 7fab54ab79c0 20 zone default found 2024-09-10T05:38:25.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.228+0000 7fab54ab79c0 4 Realm: () 2024-09-10T05:38:25.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.228+0000 7fab54ab79c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:38:25.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.228+0000 7fab54ab79c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:38:25.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.228+0000 7fab54ab79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:38:25.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.228+0000 7fab54ab79c0 20 zonegroup default 2024-09-10T05:38:25.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.228+0000 7fab54ab79c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:25.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.228+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55def0d2cf90 con 0x7fab4c027020 2024-09-10T05:38:25.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.228+0000 7fab52dbe640 1 -- 172.21.15.62:0/396152306 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fab440083f0 con 0x7fab4c027020 2024-09-10T05:38:25.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.228+0000 7fab54ab79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:25.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.228+0000 7fab54ab79c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:25.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.228+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55def0d2f1d0 con 0x55def0d28280 2024-09-10T05:38:25.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.228+0000 7fab51dbc640 1 -- 172.21.15.62:0/396152306 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fab480aa070 con 0x55def0d28280 2024-09-10T05:38:25.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.228+0000 7fab54ab79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:25.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.228+0000 7fab54ab79c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:25.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.228+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55def0d2f570 con 0x55def0d28280 2024-09-10T05:38:25.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.228+0000 7fab51dbc640 1 -- 172.21.15.62:0/396152306 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fab480aa070 con 0x55def0d28280 2024-09-10T05:38:25.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.228+0000 7fab54ab79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:25.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.228+0000 7fab54ab79c0 20 started sync module instance, tier type = 2024-09-10T05:38:25.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.228+0000 7fab54ab79c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:38:25.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.228+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55def0d2e660 con 0x55def0d24a80 2024-09-10T05:38:25.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.232+0000 7fab525bd640 1 -- 172.21.15.62:0/396152306 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab4c03f070 con 0x55def0d24a80 2024-09-10T05:38:25.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.232+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94416011455056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55def0d2fe10 con 0x55def0d24a80 2024-09-10T05:38:25.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.232+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55def0d30660 con 0x55def0d205f0 2024-09-10T05:38:25.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.232+0000 7fab52dbe640 1 -- 172.21.15.62:0/396152306 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab440083f0 con 0x55def0d205f0 2024-09-10T05:38:25.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.232+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94416011460112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55def0d30230 con 0x55def0d205f0 2024-09-10T05:38:25.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.232+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55def0d315e0 con 0x55def0d24a80 2024-09-10T05:38:25.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.232+0000 7fab52dbe640 1 -- 172.21.15.62:0/396152306 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94416011460112] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab440083f0 con 0x55def0d205f0 2024-09-10T05:38:25.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.232+0000 7fab525bd640 1 -- 172.21.15.62:0/396152306 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94416011455056] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab4c03f070 con 0x55def0d24a80 2024-09-10T05:38:25.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.236+0000 7fab525bd640 1 -- 172.21.15.62:0/396152306 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab4c03f070 con 0x55def0d24a80 2024-09-10T05:38:25.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.236+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94416011458912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55def0d315a0 con 0x55def0d24a80 2024-09-10T05:38:25.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.236+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55def0d31eb0 con 0x7fab4c027020 2024-09-10T05:38:25.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.236+0000 7fab52dbe640 1 -- 172.21.15.62:0/396152306 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab440083f0 con 0x7fab4c027020 2024-09-10T05:38:25.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.236+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94416011467264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55def0d315a0 con 0x7fab4c027020 2024-09-10T05:38:25.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.236+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55def0d32930 con 0x55def0d24a80 2024-09-10T05:38:25.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.236+0000 7fab525bd640 1 -- 172.21.15.62:0/396152306 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94416011458912] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab4c03f070 con 0x55def0d24a80 2024-09-10T05:38:25.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.236+0000 7fab52dbe640 1 -- 172.21.15.62:0/396152306 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94416011467264] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab440083f0 con 0x7fab4c027020 2024-09-10T05:38:25.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.240+0000 7fab525bd640 1 -- 172.21.15.62:0/396152306 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab4c03f070 con 0x55def0d24a80 2024-09-10T05:38:25.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.240+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94416011468320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55def0d32440 con 0x55def0d24a80 2024-09-10T05:38:25.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.240+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55def0d33200 con 0x55def0d28280 2024-09-10T05:38:25.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.240+0000 7fab51dbc640 1 -- 172.21.15.62:0/396152306 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab480aa070 con 0x55def0d28280 2024-09-10T05:38:25.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.240+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94416011472208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55def0d32440 con 0x55def0d28280 2024-09-10T05:38:25.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.240+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55def0d33c40 con 0x55def0d28280 2024-09-10T05:38:25.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.240+0000 7fab51dbc640 1 -- 172.21.15.62:0/396152306 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94416011472208] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab480aa070 con 0x55def0d28280 2024-09-10T05:38:25.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.240+0000 7fab51dbc640 1 -- 172.21.15.62:0/396152306 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab480aa070 con 0x55def0d28280 2024-09-10T05:38:25.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.240+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94416011473264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55def0d33c40 con 0x55def0d28280 2024-09-10T05:38:25.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.240+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55def0d34650 con 0x7fab4c027020 2024-09-10T05:38:25.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.240+0000 7fab525bd640 1 -- 172.21.15.62:0/396152306 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94416011468320] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab4c03f070 con 0x55def0d24a80 2024-09-10T05:38:25.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.244+0000 7fab51dbc640 1 -- 172.21.15.62:0/396152306 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94416011473264] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab480aa070 con 0x55def0d28280 2024-09-10T05:38:25.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.244+0000 7fab52dbe640 1 -- 172.21.15.62:0/396152306 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab440083f0 con 0x7fab4c027020 2024-09-10T05:38:25.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.244+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94416011477408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55def0d33c40 con 0x7fab4c027020 2024-09-10T05:38:25.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.244+0000 7fab54ab79c0 20 add_watcher() i=0 2024-09-10T05:38:25.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.244+0000 7fab54ab79c0 20 add_watcher() i=1 2024-09-10T05:38:25.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.244+0000 7fab54ab79c0 20 add_watcher() i=2 2024-09-10T05:38:25.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.244+0000 7fab54ab79c0 20 add_watcher() i=3 2024-09-10T05:38:25.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.244+0000 7fab54ab79c0 20 add_watcher() i=4 2024-09-10T05:38:25.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.244+0000 7fab54ab79c0 20 add_watcher() i=5 2024-09-10T05:38:25.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.244+0000 7fab54ab79c0 20 add_watcher() i=6 2024-09-10T05:38:25.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.244+0000 7fab52dbe640 1 -- 172.21.15.62:0/396152306 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94416011477408] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab440083f0 con 0x7fab4c027020 2024-09-10T05:38:25.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.244+0000 7fab54ab79c0 20 add_watcher() i=7 2024-09-10T05:38:25.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.244+0000 7fab54ab79c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:38:25.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.244+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55def0d33c40 con 0x55def0d205f0 2024-09-10T05:38:25.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.244+0000 7fab52dbe640 1 -- 172.21.15.62:0/396152306 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fab440083f0 con 0x55def0d205f0 2024-09-10T05:38:25.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.244+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94416011474832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55def0d34d90 con 0x55def0d205f0 2024-09-10T05:38:25.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.248+0000 7fab52dbe640 1 -- 172.21.15.62:0/396152306 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94416011474832] v34'274 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fab440083f0 con 0x55def0d205f0 2024-09-10T05:38:25.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.248+0000 7faa08fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:38:25.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.248+0000 7fab54ab79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:38:25.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.248+0000 7fab54ab79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:38:25.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.248+0000 7fab54ab79c0 5 note: GC not initialized 2024-09-10T05:38:25.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.248+0000 7fa9837fe640 20 reqs_thread_entry: start 2024-09-10T05:38:25.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.248+0000 7fab54ab79c0 20 init_complete bucket index max shards: 11 2024-09-10T05:38:25.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.248+0000 7fab54ab79c0 20 Filter name: none 2024-09-10T05:38:25.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.248+0000 7fa9817fa640 20 reqs_thread_entry: start 2024-09-10T05:38:25.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.248+0000 7fab54ab79c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-10T05:38:25.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.248+0000 7fab54ab79c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:25.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.248+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55def0d5a7f0 con 0x55def0d205f0 2024-09-10T05:38:25.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.248+0000 7fab52dbe640 1 -- 172.21.15.62:0/396152306 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7fab440083f0 con 0x55def0d205f0 2024-09-10T05:38:25.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.248+0000 7fab54ab79c0 20 rados_obj.operate() r=0 bl.length=490 2024-09-10T05:38:25.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.248+0000 7fab54ab79c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-10T05:38:25.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.248+0000 7fab54ab79c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:38:25.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.248+0000 7fab54ab79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:38:25.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.248+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55def0d61030 con 0x55def0d205f0 2024-09-10T05:38:25.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.248+0000 7fab52dbe640 1 -- 172.21.15.62:0/396152306 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v34'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fab440083f0 con 0x55def0d205f0 2024-09-10T05:38:25.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.248+0000 7fab54ab79c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T05:38:25.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.248+0000 7fab54ab79c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:38:25.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.248+0000 7fab54ab79c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-10T05:38:25.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.248+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94416011659936 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55def0d5c760 con 0x55def0d24a80 2024-09-10T05:38:25.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.252+0000 7fab525bd640 1 -- 172.21.15.62:0/396152306 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== watch-notify(notify (1) cookie 94416011468320 notify 146028888120 ret 0) ==== 678+0+0 (crc 0 0 0) 0x55def0d02ee0 con 0x55def0d24a80 2024-09-10T05:38:25.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.252+0000 7faa35ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888120 cookie 94416011468320 notifier 4906 bl.length()=636 2024-09-10T05:38:25.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.252+0000 7faa35ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T05:38:25.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.252+0000 7faa35ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:38:25.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.252+0000 7faa35ffb640 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7faa18003eb0 con 0x55def0d24a80 2024-09-10T05:38:25.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.252+0000 7fab525bd640 1 -- 172.21.15.62:0/396152306 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(64 notify.4 [notify cookie 94416011659936 out=8b] v0'0 uv273 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fab4c03f070 con 0x55def0d24a80 2024-09-10T05:38:25.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.252+0000 7fab525bd640 1 -- 172.21.15.62:0/396152306 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab4c03f070 con 0x55def0d24a80 2024-09-10T05:38:25.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.252+0000 7fab525bd640 1 -- 172.21.15.62:0/396152306 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== watch-notify(notify_complete (2) cookie 94416011659936 notify 146028888120 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55def0d02680 con 0x55def0d24a80 2024-09-10T05:38:25.255 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-10T05:38:22.896781Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:38:22.896764Z","tags":[],"group_ids":[]} 2024-09-10T05:38:25.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.252+0000 7faa08fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:38:25.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.252+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94416011474832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55def0d58610 con 0x55def0d205f0 2024-09-10T05:38:25.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.256+0000 7fab52dbe640 1 -- 172.21.15.62:0/396152306 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94416011474832] v34'275 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fab440083f0 con 0x55def0d205f0 2024-09-10T05:38:25.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.256+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94416011455056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55def0d58610 con 0x55def0d24a80 2024-09-10T05:38:25.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.256+0000 7fab525bd640 1 -- 172.21.15.62:0/396152306 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94416011455056] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab4c03f070 con 0x55def0d24a80 2024-09-10T05:38:25.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.256+0000 7fab54ab79c0 20 remove_watcher() i=0 2024-09-10T05:38:25.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.256+0000 7fab54ab79c0 2 removed watcher, disabling cache 2024-09-10T05:38:25.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.256+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94416011460112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55def0d58610 con 0x55def0d205f0 2024-09-10T05:38:25.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.256+0000 7fab52dbe640 1 -- 172.21.15.62:0/396152306 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94416011460112] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab440083f0 con 0x55def0d205f0 2024-09-10T05:38:25.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.256+0000 7fab54ab79c0 20 remove_watcher() i=1 2024-09-10T05:38:25.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.256+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94416011458912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55def0d58610 con 0x55def0d24a80 2024-09-10T05:38:25.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.260+0000 7fab525bd640 1 -- 172.21.15.62:0/396152306 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94416011458912] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab4c03f070 con 0x55def0d24a80 2024-09-10T05:38:25.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.260+0000 7fab54ab79c0 20 remove_watcher() i=2 2024-09-10T05:38:25.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.260+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94416011467264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55def0d58610 con 0x7fab4c027020 2024-09-10T05:38:25.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.260+0000 7fab52dbe640 1 -- 172.21.15.62:0/396152306 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94416011467264] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab440083f0 con 0x7fab4c027020 2024-09-10T05:38:25.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.260+0000 7fab54ab79c0 20 remove_watcher() i=3 2024-09-10T05:38:25.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.260+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94416011468320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55def0d58610 con 0x55def0d24a80 2024-09-10T05:38:25.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.264+0000 7fab525bd640 1 -- 172.21.15.62:0/396152306 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94416011468320] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab4c03f070 con 0x55def0d24a80 2024-09-10T05:38:25.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.264+0000 7fab54ab79c0 20 remove_watcher() i=4 2024-09-10T05:38:25.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.264+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94416011472208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55def0d58610 con 0x55def0d28280 2024-09-10T05:38:25.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.264+0000 7fab51dbc640 1 -- 172.21.15.62:0/396152306 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94416011472208] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab480aa070 con 0x55def0d28280 2024-09-10T05:38:25.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.264+0000 7fab54ab79c0 20 remove_watcher() i=5 2024-09-10T05:38:25.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.264+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94416011473264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55def0d58610 con 0x55def0d28280 2024-09-10T05:38:25.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.264+0000 7fab51dbc640 1 -- 172.21.15.62:0/396152306 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94416011473264] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab480aa070 con 0x55def0d28280 2024-09-10T05:38:25.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.264+0000 7fab54ab79c0 20 remove_watcher() i=6 2024-09-10T05:38:25.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.264+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94416011477408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55def0d58610 con 0x7fab4c027020 2024-09-10T05:38:25.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.268+0000 7fab52dbe640 1 -- 172.21.15.62:0/396152306 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94416011477408] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab440083f0 con 0x7fab4c027020 2024-09-10T05:38:25.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.268+0000 7fab54ab79c0 20 remove_watcher() i=7 2024-09-10T05:38:25.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.268+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55def0d24a80 msgr2=0x55def0d26e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.268+0000 7fab54ab79c0 1 --2- 172.21.15.62:0/396152306 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55def0d24a80 0x55def0d26e70 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.268+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55def0d205f0 msgr2=0x55def0d22a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.268+0000 7fab54ab79c0 1 --2- 172.21.15.62:0/396152306 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55def0d205f0 0x55def0d22a80 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.268+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fab4c027020 msgr2=0x7fab4c06b7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.268+0000 7fab54ab79c0 1 --2- 172.21.15.62:0/396152306 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7fab4c027020 0x7fab4c06b7e0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.268+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55def0d28280 msgr2=0x55def0d2a670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.268+0000 7fab54ab79c0 1 --2- 172.21.15.62:0/396152306 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55def0d28280 0x55def0d2a670 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.268+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7faa1c0399d0 msgr2=0x7faa1c03be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.268+0000 7fab54ab79c0 1 --2- 172.21.15.62:0/396152306 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7faa1c0399d0 0x7faa1c03be90 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fab4801d2d0 tx=0x7fab480a9000 comp rx=0 tx=0).stop 2024-09-10T05:38:25.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.268+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55def0d0f410 msgr2=0x55def0d15690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.268+0000 7fab52dbe640 1 -- 172.21.15.62:0/396152306 reap_dead start 2024-09-10T05:38:25.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.268+0000 7fab54ab79c0 1 --2- 172.21.15.62:0/396152306 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55def0d0f410 0x55def0d15690 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fab4c0137b0 tx=0x7fab4c013740 comp rx=0 tx=0).stop 2024-09-10T05:38:25.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.268+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 shutdown_connections 2024-09-10T05:38:25.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.268+0000 7fab54ab79c0 1 --2- 172.21.15.62:0/396152306 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55def0d0f410 0x55def0d15690 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.268+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 >> 172.21.15.62:0/396152306 conn(0x55def0d0a7d0 msgr2=0x55def0d089e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:25.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.268+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 shutdown_connections 2024-09-10T05:38:25.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.268+0000 7fab54ab79c0 1 -- 172.21.15.62:0/396152306 wait complete. 2024-09-10T05:38:25.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.268+0000 7fab54ab79c0 1 -- 172.21.15.62:0/2748708408 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7faa2c039a70 msgr2=0x7faa2c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.268+0000 7fab54ab79c0 1 --2- 172.21.15.62:0/2748708408 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7faa2c039a70 0x7faa2c03bf30 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x55def0ce53a0 tx=0x7fab48005ad0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.268+0000 7fab54ab79c0 1 -- 172.21.15.62:0/2748708408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55def0d01c20 msgr2=0x55def0d02040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.268+0000 7fab54ab79c0 1 --2- 172.21.15.62:0/2748708408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55def0d01c20 0x55def0d02040 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fab4c0069d0 tx=0x7fab4c0129b0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.268+0000 7fab54ab79c0 1 -- 172.21.15.62:0/2748708408 shutdown_connections 2024-09-10T05:38:25.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.268+0000 7fab54ab79c0 1 --2- 172.21.15.62:0/2748708408 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7faa2c039a70 0x7faa2c03bf30 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.268+0000 7fab54ab79c0 1 --2- 172.21.15.62:0/2748708408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55def0d01c20 0x55def0d02040 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.268+0000 7fab54ab79c0 1 -- 172.21.15.62:0/2748708408 >> 172.21.15.62:0/2748708408 conn(0x55def0cf75d0 msgr2=0x55def0cf79b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:25.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.268+0000 7fab54ab79c0 1 -- 172.21.15.62:0/2748708408 shutdown_connections 2024-09-10T05:38:25.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.268+0000 7fab54ab79c0 1 -- 172.21.15.62:0/2748708408 wait complete. 2024-09-10T05:38:25.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.268+0000 7fab54ab79c0 1 -- 172.21.15.62:0/824498398 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55def0cec390 msgr2=0x55def0cee780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.268+0000 7fab54ab79c0 1 --2- 172.21.15.62:0/824498398 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55def0cec390 0x55def0cee780 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.268+0000 7fab54ab79c0 1 -- 172.21.15.62:0/824498398 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55def0bf1fe0 msgr2=0x55def0ceb0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.268+0000 7fab54ab79c0 1 --2- 172.21.15.62:0/824498398 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55def0bf1fe0 0x55def0ceb0f0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.268+0000 7fab54ab79c0 1 -- 172.21.15.62:0/824498398 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55def0cf0b30 msgr2=0x55def0cf2f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.268+0000 7fab54ab79c0 1 --2- 172.21.15.62:0/824498398 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55def0cf0b30 0x55def0cf2f20 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.268+0000 7fab54ab79c0 1 -- 172.21.15.62:0/824498398 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7faa38039a70 msgr2=0x7faa3803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.268+0000 7fab54ab79c0 1 --2- 172.21.15.62:0/824498398 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7faa38039a70 0x7faa3803bf30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fab480ad000 tx=0x7fab480a7000 comp rx=0 tx=0).stop 2024-09-10T05:38:25.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.268+0000 7fab54ab79c0 1 -- 172.21.15.62:0/824498398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55def0beddf0 msgr2=0x55def0ce3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.268+0000 7fab54ab79c0 1 --2- 172.21.15.62:0/824498398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55def0beddf0 0x55def0ce3f80 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fab4c001bf0 tx=0x7fab4c001260 comp rx=0 tx=0).stop 2024-09-10T05:38:25.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.268+0000 7fab52dbe640 1 -- 172.21.15.62:0/824498398 reap_dead start 2024-09-10T05:38:25.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.268+0000 7fab54ab79c0 1 -- 172.21.15.62:0/824498398 shutdown_connections 2024-09-10T05:38:25.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.268+0000 7fab54ab79c0 1 -- 172.21.15.62:0/824498398 >> 172.21.15.62:0/824498398 conn(0x55def0be9910 msgr2=0x55def0cd2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:25.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.268+0000 7fab54ab79c0 1 -- 172.21.15.62:0/824498398 shutdown_connections 2024-09-10T05:38:25.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.268+0000 7fab54ab79c0 1 -- 172.21.15.62:0/824498398 wait complete. 2024-09-10T05:38:25.281 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T05:38:22.896781Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:38:22.896764Z', 'tags': [], 'group_ids': []} 2024-09-10T05:38:25.281 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T05:38:22.896781Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:38:22.896764Z', 'tags': [], 'group_ids': []} 2024-09-10T05:38:25.281 ERROR:root:0 2024-09-10T05:38:25.281 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-10T05:38:25.282 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-10T05:38:25.282 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-10T05:38:25.363 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:38:25.363 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:38:25.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.360+0000 7f032d1de9c0 1 Processor -- start 2024-09-10T05:38:25.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.360+0000 7f032d1de9c0 1 -- start start 2024-09-10T05:38:25.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.360+0000 7f032d1de9c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x562f6a44df70 0x562f6a44e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.360+0000 7f032d1de9c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562f6a3029c0 con 0x562f6a4510b0 2024-09-10T05:38:25.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.360+0000 7f032d1de9c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x562f6a3526d0 con 0x562f6a44df70 2024-09-10T05:38:25.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.360+0000 7f032ace4640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x562f6a44df70 0x562f6a44e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.360+0000 7f032ace4640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x562f6a44df70 0x562f6a44e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:53846/0 (socket says 172.21.15.62:53846) 2024-09-10T05:38:25.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.360+0000 7f032ace4640 1 -- 172.21.15.62:0/3663450760 learned_addr learned my addr 172.21.15.62:0/3663450760 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:25.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.360+0000 7f032ace4640 1 -- 172.21.15.62:0/3663450760 >> v1:172.21.15.2:6789/0 conn(0x562f6a4510b0 legacy=0x562f6a4534a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.360+0000 7f032ace4640 1 -- 172.21.15.62:0/3663450760 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f6a2f6ca0 con 0x562f6a44df70 2024-09-10T05:38:25.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.364+0000 7f032ace4640 1 --2- 172.21.15.62:0/3663450760 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f6a44df70 0x562f6a44e350 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f031c00a5c0 tx=0x7f031c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a6d6f3f43911a9f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.364+0000 7f0329ce2640 1 -- 172.21.15.62:0/3663450760 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f031c0a6070 con 0x562f6a44df70 2024-09-10T05:38:25.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.364+0000 7f0329ce2640 1 -- 172.21.15.62:0/3663450760 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f031c0af070 con 0x562f6a44df70 2024-09-10T05:38:25.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.364+0000 7f0329ce2640 1 -- 172.21.15.62:0/3663450760 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f031c0aa5c0 con 0x562f6a44df70 2024-09-10T05:38:25.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.364+0000 7f032d1de9c0 1 -- 172.21.15.62:0/3663450760 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f6a44df70 msgr2=0x562f6a44e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.364+0000 7f032d1de9c0 1 --2- 172.21.15.62:0/3663450760 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f6a44df70 0x562f6a44e350 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f031c00a5c0 tx=0x7f031c01b340 comp rx=0 tx=0).stop 2024-09-10T05:38:25.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.364+0000 7f032d1de9c0 1 -- 172.21.15.62:0/3663450760 shutdown_connections 2024-09-10T05:38:25.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.364+0000 7f032d1de9c0 1 --2- 172.21.15.62:0/3663450760 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f6a44df70 0x562f6a44e350 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.364+0000 7f032d1de9c0 1 -- 172.21.15.62:0/3663450760 >> 172.21.15.62:0/3663450760 conn(0x562f6a449a90 msgr2=0x562f6a44beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:25.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.364+0000 7f032d1de9c0 1 -- 172.21.15.62:0/3663450760 shutdown_connections 2024-09-10T05:38:25.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.364+0000 7f032d1de9c0 1 -- 172.21.15.62:0/3663450760 wait complete. 2024-09-10T05:38:25.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.376+0000 7f032d1de9c0 1 Processor -- start 2024-09-10T05:38:25.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.376+0000 7f032d1de9c0 1 -- start start 2024-09-10T05:38:25.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.380+0000 7f032d1de9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f6a44df70 0x562f6a539700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.380+0000 7f032d1de9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562f6a356680 con 0x562f6a44df70 2024-09-10T05:38:25.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.380+0000 7f032ace4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f6a44df70 0x562f6a539700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.380+0000 7f032ace4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f6a44df70 0x562f6a539700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:53852/0 (socket says 172.21.15.62:53852) 2024-09-10T05:38:25.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.380+0000 7f032ace4640 1 -- 172.21.15.62:0/3267094679 learned_addr learned my addr 172.21.15.62:0/3267094679 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:25.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.380+0000 7f032ace4640 1 -- 172.21.15.62:0/3267094679 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f6a2d1da0 con 0x562f6a44df70 2024-09-10T05:38:25.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.380+0000 7f032ace4640 1 --2- 172.21.15.62:0/3267094679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f6a44df70 0x562f6a539700 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f031c018f70 tx=0x7f031c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3135585285d92ea server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.380+0000 7f0218e09640 1 -- 172.21.15.62:0/3267094679 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f031c0aa8b0 con 0x562f6a44df70 2024-09-10T05:38:25.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.380+0000 7f0218e09640 1 -- 172.21.15.62:0/3267094679 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f031c0aaa50 con 0x562f6a44df70 2024-09-10T05:38:25.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.380+0000 7f0218e09640 1 -- 172.21.15.62:0/3267094679 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f031c0aad30 con 0x562f6a44df70 2024-09-10T05:38:25.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.380+0000 7f032d1de9c0 1 -- 172.21.15.62:0/3267094679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f6a44df70 msgr2=0x562f6a539700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.380+0000 7f032d1de9c0 1 --2- 172.21.15.62:0/3267094679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f6a44df70 0x562f6a539700 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f031c018f70 tx=0x7f031c003030 comp rx=0 tx=0).stop 2024-09-10T05:38:25.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.380+0000 7f032d1de9c0 1 -- 172.21.15.62:0/3267094679 shutdown_connections 2024-09-10T05:38:25.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.380+0000 7f032d1de9c0 1 --2- 172.21.15.62:0/3267094679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f6a44df70 0x562f6a539700 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.380+0000 7f032d1de9c0 1 -- 172.21.15.62:0/3267094679 >> 172.21.15.62:0/3267094679 conn(0x562f6a449a90 msgr2=0x562f6a535340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:25.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.380+0000 7f032d1de9c0 1 -- 172.21.15.62:0/3267094679 shutdown_connections 2024-09-10T05:38:25.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.380+0000 7f032d1de9c0 1 -- 172.21.15.62:0/3267094679 wait complete. 2024-09-10T05:38:25.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.380+0000 7f032d1de9c0 1 Processor -- start 2024-09-10T05:38:25.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.380+0000 7f032d1de9c0 1 -- start start 2024-09-10T05:38:25.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.380+0000 7f032d1de9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f6a44df70 0x562f6a3c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.380+0000 7f032d1de9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562f6a2f8a50 con 0x562f6a44df70 2024-09-10T05:38:25.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.380+0000 7f032ace4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f6a44df70 0x562f6a3c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.380+0000 7f032ace4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f6a44df70 0x562f6a3c43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:53864/0 (socket says 172.21.15.62:53864) 2024-09-10T05:38:25.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.380+0000 7f032ace4640 1 -- 172.21.15.62:0/2744991776 learned_addr learned my addr 172.21.15.62:0/2744991776 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:25.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.380+0000 7f032ace4640 1 -- 172.21.15.62:0/2744991776 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f6a3c4940 con 0x562f6a44df70 2024-09-10T05:38:25.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.384+0000 7f032ace4640 1 --2- 172.21.15.62:0/2744991776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f6a44df70 0x562f6a3c43e0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f031c018f70 tx=0x7f031c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.384+0000 7f0217606640 1 -- 172.21.15.62:0/2744991776 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f031c0c6690 con 0x562f6a44df70 2024-09-10T05:38:25.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.384+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2744991776 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562f6a3c2d20 con 0x562f6a44df70 2024-09-10T05:38:25.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.384+0000 7f0217606640 1 -- 172.21.15.62:0/2744991776 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f031c0c6830 con 0x562f6a44df70 2024-09-10T05:38:25.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.384+0000 7f0217606640 1 -- 172.21.15.62:0/2744991776 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f031c0c6b30 con 0x562f6a44df70 2024-09-10T05:38:25.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.384+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2744991776 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f6a3c32b0 con 0x562f6a44df70 2024-09-10T05:38:25.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.384+0000 7f0217606640 1 -- 172.21.15.62:0/2744991776 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f031c0ce030 con 0x562f6a44df70 2024-09-10T05:38:25.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.384+0000 7f0217606640 1 --2- 172.21.15.62:0/2744991776 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0210039a70 0x7f021003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.384+0000 7f0217606640 1 -- 172.21.15.62:0/2744991776 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7f031c0cc020 con 0x562f6a44df70 2024-09-10T05:38:25.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.384+0000 7f032a4e3640 1 --2- 172.21.15.62:0/2744991776 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0210039a70 0x7f021003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.384+0000 7f032d1de9c0 1 --2- 172.21.15.62:0/2744991776 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x562f6a4510b0 0x562f6a54a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.384+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2744991776 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f6a54a590 con 0x562f6a4510b0 2024-09-10T05:38:25.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.384+0000 7f032b4e5640 1 --2- 172.21.15.62:0/2744991776 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x562f6a4510b0 0x562f6a54a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.384+0000 7f032a4e3640 1 --2- 172.21.15.62:0/2744991776 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0210039a70 0x7f021003bf30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0314001e60 tx=0x7f03140013e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.384+0000 7f032b4e5640 1 --2- 172.21.15.62:0/2744991776 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x562f6a4510b0 0x562f6a54a050 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.384+0000 7f032b4e5640 1 -- 172.21.15.62:0/2744991776 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f032400a4d0 con 0x562f6a4510b0 2024-09-10T05:38:25.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.384+0000 7f032d1de9c0 1 --2- 172.21.15.62:0/2744991776 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x562f6a54b040 0x562f6a54d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.384+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2744991776 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f6a54dc70 con 0x562f6a54b040 2024-09-10T05:38:25.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.384+0000 7f032ace4640 1 --2- 172.21.15.62:0/2744991776 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x562f6a54b040 0x562f6a54d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.388+0000 7f032ace4640 1 --2- 172.21.15.62:0/2744991776 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x562f6a54b040 0x562f6a54d500 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.388+0000 7f032ace4640 1 -- 172.21.15.62:0/2744991776 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f031c0ae200 con 0x562f6a54b040 2024-09-10T05:38:25.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.388+0000 7f032d1de9c0 1 --2- 172.21.15.62:0/2744991776 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x562f6a54fa30 0x562f6a551e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.388+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2744991776 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f6a552510 con 0x562f6a54fa30 2024-09-10T05:38:25.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.388+0000 7f032a4e3640 1 --2- 172.21.15.62:0/2744991776 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x562f6a54fa30 0x562f6a551e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.388+0000 7f032a4e3640 1 --2- 172.21.15.62:0/2744991776 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x562f6a54fa30 0x562f6a551e20 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.388+0000 7f032a4e3640 1 -- 172.21.15.62:0/2744991776 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv5 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f031400d040 con 0x562f6a54fa30 2024-09-10T05:38:25.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.388+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2744991776 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f6a54e8d0 con 0x562f6a54b040 2024-09-10T05:38:25.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.388+0000 7f032ace4640 1 -- 172.21.15.62:0/2744991776 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f031c0ae200 con 0x562f6a54b040 2024-09-10T05:38:25.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.388+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2744991776 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f6a54ecf0 con 0x562f6a54fa30 2024-09-10T05:38:25.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.388+0000 7f032a4e3640 1 -- 172.21.15.62:0/2744991776 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f031400d040 con 0x562f6a54fa30 2024-09-10T05:38:25.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.388+0000 7f032d1de9c0 1 Processor -- start 2024-09-10T05:38:25.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.388+0000 7f032d1de9c0 1 -- start start 2024-09-10T05:38:25.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.388+0000 7f032d1de9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f6a560be0 0x562f6a561000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.388+0000 7f032d1de9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562f6a363450 con 0x562f6a560be0 2024-09-10T05:38:25.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.388+0000 7f032ace4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f6a560be0 0x562f6a561000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.388+0000 7f032ace4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f6a560be0 0x562f6a561000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:53880/0 (socket says 172.21.15.62:53880) 2024-09-10T05:38:25.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.388+0000 7f032ace4640 1 -- 172.21.15.62:0/2229000468 learned_addr learned my addr 172.21.15.62:0/2229000468 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:25.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.392+0000 7f032ace4640 1 -- 172.21.15.62:0/2229000468 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f6a561640 con 0x562f6a560be0 2024-09-10T05:38:25.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.392+0000 7f032ace4640 1 --2- 172.21.15.62:0/2229000468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f6a560be0 0x562f6a561000 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f031c0e9fb0 tx=0x7f031c0cfe00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.392+0000 7f0214e01640 1 -- 172.21.15.62:0/2229000468 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f031c0cf640 con 0x562f6a560be0 2024-09-10T05:38:25.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.392+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2229000468 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562f6a561ea0 con 0x562f6a560be0 2024-09-10T05:38:25.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.392+0000 7f0214e01640 1 -- 172.21.15.62:0/2229000468 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f031c0cf7e0 con 0x562f6a560be0 2024-09-10T05:38:25.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.392+0000 7f0214e01640 1 -- 172.21.15.62:0/2229000468 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f031c0d0410 con 0x562f6a560be0 2024-09-10T05:38:25.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.392+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2229000468 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f6a562410 con 0x562f6a560be0 2024-09-10T05:38:25.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.392+0000 7f0214e01640 1 -- 172.21.15.62:0/2229000468 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f031c0f2060 con 0x562f6a560be0 2024-09-10T05:38:25.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.392+0000 7f0214e01640 1 --2- 172.21.15.62:0/2229000468 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0204039a70 0x7f020403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.392+0000 7f0214e01640 1 -- 172.21.15.62:0/2229000468 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7f031c0e1030 con 0x562f6a560be0 2024-09-10T05:38:25.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.392+0000 7f032a4e3640 1 --2- 172.21.15.62:0/2229000468 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0204039a70 0x7f020403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.392+0000 7f032d1de9c0 1 Processor -- start 2024-09-10T05:38:25.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.392+0000 7f032d1de9c0 1 -- start start 2024-09-10T05:38:25.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.392+0000 7f032d1de9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f6a56d380 0x562f6a56d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.392+0000 7f032d1de9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562f6a539e90 con 0x562f6a56d380 2024-09-10T05:38:25.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.392+0000 7f032a4e3640 1 --2- 172.21.15.62:0/2229000468 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0204039a70 0x7f020403bf30 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x562f6a54ec70 tx=0x7f0314006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.392+0000 7f032ace4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f6a56d380 0x562f6a56d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.392+0000 7f032ace4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f6a56d380 0x562f6a56d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:53892/0 (socket says 172.21.15.62:53892) 2024-09-10T05:38:25.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.392+0000 7f032ace4640 1 -- 172.21.15.62:0/2614658710 learned_addr learned my addr 172.21.15.62:0/2614658710 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:25.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.392+0000 7f032ace4640 1 -- 172.21.15.62:0/2614658710 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f6a56dd50 con 0x562f6a56d380 2024-09-10T05:38:25.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.396+0000 7f032ace4640 1 --2- 172.21.15.62:0/2614658710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f6a56d380 0x562f6a56d760 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f031c006840 tx=0x7f031c006870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fcfc26502888420 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.396+0000 7f020e7fc640 1 -- 172.21.15.62:0/2614658710 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f031c101020 con 0x562f6a56d380 2024-09-10T05:38:25.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.396+0000 7f020e7fc640 1 -- 172.21.15.62:0/2614658710 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f031c0e8b50 con 0x562f6a56d380 2024-09-10T05:38:25.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.396+0000 7f020e7fc640 1 -- 172.21.15.62:0/2614658710 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f031c0e8380 con 0x562f6a56d380 2024-09-10T05:38:25.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.396+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2614658710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f6a56d380 msgr2=0x562f6a56d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.396+0000 7f032d1de9c0 1 --2- 172.21.15.62:0/2614658710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f6a56d380 0x562f6a56d760 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f031c006840 tx=0x7f031c006870 comp rx=0 tx=0).stop 2024-09-10T05:38:25.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.396+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2614658710 shutdown_connections 2024-09-10T05:38:25.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.396+0000 7f032d1de9c0 1 --2- 172.21.15.62:0/2614658710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f6a56d380 0x562f6a56d760 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.396+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2614658710 >> 172.21.15.62:0/2614658710 conn(0x562f6a5697b0 msgr2=0x562f6a5679f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:25.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.396+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2614658710 shutdown_connections 2024-09-10T05:38:25.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.396+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2614658710 wait complete. 2024-09-10T05:38:25.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.396+0000 7f032d1de9c0 1 Processor -- start 2024-09-10T05:38:25.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.396+0000 7f032d1de9c0 1 -- start start 2024-09-10T05:38:25.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.396+0000 7f032d1de9c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f6a56d380 0x562f6a5746d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.396+0000 7f032d1de9c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562f6a56e210 con 0x562f6a56d380 2024-09-10T05:38:25.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.396+0000 7f032ace4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f6a56d380 0x562f6a5746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.396+0000 7f032ace4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f6a56d380 0x562f6a5746d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:53894/0 (socket says 172.21.15.62:53894) 2024-09-10T05:38:25.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.396+0000 7f032ace4640 1 -- 172.21.15.62:0/2370960255 learned_addr learned my addr 172.21.15.62:0/2370960255 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:25.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.396+0000 7f032ace4640 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f6a574c30 con 0x562f6a56d380 2024-09-10T05:38:25.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.396+0000 7f032ace4640 1 --2- 172.21.15.62:0/2370960255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f6a56d380 0x562f6a5746d0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f031c006730 tx=0x7f031c0a8f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.396+0000 7f020cff9640 1 -- 172.21.15.62:0/2370960255 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f031c116070 con 0x562f6a56d380 2024-09-10T05:38:25.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.396+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562f6a574c30 con 0x562f6a56d380 2024-09-10T05:38:25.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.396+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f6a5750a0 con 0x562f6a56d380 2024-09-10T05:38:25.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.396+0000 7f020cff9640 1 -- 172.21.15.62:0/2370960255 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f031c0e3c40 con 0x562f6a56d380 2024-09-10T05:38:25.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.396+0000 7f020cff9640 1 -- 172.21.15.62:0/2370960255 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f031c0aeed0 con 0x562f6a56d380 2024-09-10T05:38:25.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.400+0000 7f032d1de9c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:25.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.400+0000 7f020cff9640 1 -- 172.21.15.62:0/2370960255 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f031c119070 con 0x562f6a56d380 2024-09-10T05:38:25.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.400+0000 7f020cff9640 1 --2- 172.21.15.62:0/2370960255 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f01f4039ac0 0x7f01f403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.400+0000 7f020cff9640 1 -- 172.21.15.62:0/2370960255 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7f031c10d030 con 0x562f6a56d380 2024-09-10T05:38:25.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.400+0000 7f032a4e3640 1 --2- 172.21.15.62:0/2370960255 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f01f4039ac0 0x7f01f403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.400+0000 7f032d1de9c0 1 --2- 172.21.15.62:0/2370960255 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x562f6a57f530 0x562f6a5819c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.400+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f6a582110 con 0x562f6a57f530 2024-09-10T05:38:25.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.400+0000 7f032b4e5640 1 --2- 172.21.15.62:0/2370960255 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x562f6a57f530 0x562f6a5819c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.400+0000 7f032a4e3640 1 --2- 172.21.15.62:0/2370960255 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f01f4039ac0 0x7f01f403bf80 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x562f6a54e8a0 tx=0x7f0314011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.400+0000 7f032b4e5640 1 --2- 172.21.15.62:0/2370960255 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x562f6a57f530 0x562f6a5819c0 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.400+0000 7f032b4e5640 1 -- 172.21.15.62:0/2370960255 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f032400a4d0 con 0x562f6a57f530 2024-09-10T05:38:25.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.400+0000 7f032d1de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:25.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.400+0000 7f032d1de9c0 20 realm 2024-09-10T05:38:25.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.400+0000 7f032d1de9c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:25.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.400+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f6a57e8c0 con 0x562f6a57f530 2024-09-10T05:38:25.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.400+0000 7f032b4e5640 1 -- 172.21.15.62:0/2370960255 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f032400a4d0 con 0x562f6a57f530 2024-09-10T05:38:25.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.400+0000 7f032d1de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:25.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.400+0000 7f032d1de9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:38:25.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.400+0000 7f032d1de9c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:25.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.400+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f6a582be0 con 0x562f6a57f530 2024-09-10T05:38:25.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.400+0000 7f032b4e5640 1 -- 172.21.15.62:0/2370960255 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f032400a4d0 con 0x562f6a57f530 2024-09-10T05:38:25.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.400+0000 7f032d1de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:25.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.400+0000 7f032d1de9c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:25.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.400+0000 7f032d1de9c0 1 --2- 172.21.15.62:0/2370960255 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x562f6a5839c0 0x562f6a585db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.400+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f6a586440 con 0x562f6a5839c0 2024-09-10T05:38:25.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.400+0000 7f032ace4640 1 --2- 172.21.15.62:0/2370960255 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x562f6a5839c0 0x562f6a585db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.400+0000 7f032ace4640 1 --2- 172.21.15.62:0/2370960255 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x562f6a5839c0 0x562f6a585db0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.404+0000 7f032ace4640 1 -- 172.21.15.62:0/2370960255 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f031c111d70 con 0x562f6a5839c0 2024-09-10T05:38:25.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.404+0000 7f032d1de9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:38:25.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.404+0000 7f032d1de9c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:25.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.404+0000 7f032d1de9c0 1 --2- 172.21.15.62:0/2370960255 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x562f6a5871a0 0x562f6a589590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.404+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f6a589d20 con 0x562f6a5871a0 2024-09-10T05:38:25.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.404+0000 7f032a4e3640 1 --2- 172.21.15.62:0/2370960255 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x562f6a5871a0 0x562f6a589590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.404+0000 7f032a4e3640 1 --2- 172.21.15.62:0/2370960255 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x562f6a5871a0 0x562f6a589590 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.404+0000 7f032a4e3640 1 -- 172.21.15.62:0/2370960255 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv5 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f031400d040 con 0x562f6a5871a0 2024-09-10T05:38:25.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.404+0000 7f032d1de9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:38:25.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.404+0000 7f032d1de9c0 20 searching for the correct realm 2024-09-10T05:38:25.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.404+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f6a58b5f0 con 0x562f6a5871a0 2024-09-10T05:38:25.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.404+0000 7f032a4e3640 1 -- 172.21.15.62:0/2370960255 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031400d040 con 0x562f6a5871a0 2024-09-10T05:38:25.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.404+0000 7f032a4e3640 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f6a58b5f0 con 0x562f6a5839c0 2024-09-10T05:38:25.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.404+0000 7f032ace4640 1 -- 172.21.15.62:0/2370960255 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031c111d70 con 0x562f6a5839c0 2024-09-10T05:38:25.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.404+0000 7f032ace4640 1 --2- 172.21.15.62:0/2370960255 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f031c11b060 0x7f031c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.404+0000 7f032ace4640 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f031c125040 con 0x7f031c11b060 2024-09-10T05:38:25.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.404+0000 7f032b4e5640 1 --2- 172.21.15.62:0/2370960255 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f031c11b060 0x7f031c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.404+0000 7f032b4e5640 1 --2- 172.21.15.62:0/2370960255 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f031c11b060 0x7f031c0b7820 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.404+0000 7f032b4e5640 1 -- 172.21.15.62:0/2370960255 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f032400a4d0 con 0x7f031c11b060 2024-09-10T05:38:25.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.404+0000 7f032b4e5640 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f031c125040 con 0x562f6a57f530 2024-09-10T05:38:25.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.404+0000 7f032b4e5640 1 -- 172.21.15.62:0/2370960255 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f032400a4d0 con 0x562f6a57f530 2024-09-10T05:38:25.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.404+0000 7f032b4e5640 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f031c125040 con 0x562f6a57f530 2024-09-10T05:38:25.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.404+0000 7f032b4e5640 1 -- 172.21.15.62:0/2370960255 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f032400a4d0 con 0x562f6a57f530 2024-09-10T05:38:25.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.404+0000 7f032b4e5640 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f031c125040 con 0x562f6a5871a0 2024-09-10T05:38:25.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.404+0000 7f032a4e3640 1 -- 172.21.15.62:0/2370960255 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031400d040 con 0x562f6a5871a0 2024-09-10T05:38:25.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.404+0000 7f032a4e3640 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f031c125040 con 0x562f6a57f530 2024-09-10T05:38:25.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.404+0000 7f032b4e5640 1 -- 172.21.15.62:0/2370960255 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f032400a4d0 con 0x562f6a57f530 2024-09-10T05:38:25.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.404+0000 7f032b4e5640 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f031c125040 con 0x562f6a5839c0 2024-09-10T05:38:25.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.408+0000 7f032ace4640 1 -- 172.21.15.62:0/2370960255 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031c111d70 con 0x562f6a5839c0 2024-09-10T05:38:25.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.408+0000 7f032ace4640 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f031c125040 con 0x562f6a5839c0 2024-09-10T05:38:25.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.408+0000 7f032ace4640 1 -- 172.21.15.62:0/2370960255 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031c111d70 con 0x562f6a5839c0 2024-09-10T05:38:25.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.408+0000 7f032ace4640 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f031c125040 con 0x562f6a57f530 2024-09-10T05:38:25.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.408+0000 7f032b4e5640 1 -- 172.21.15.62:0/2370960255 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f032400a4d0 con 0x562f6a57f530 2024-09-10T05:38:25.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.408+0000 7f032b4e5640 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f031c125040 con 0x7f031c11b060 2024-09-10T05:38:25.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.408+0000 7f032b4e5640 1 -- 172.21.15.62:0/2370960255 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f032400a4d0 con 0x7f031c11b060 2024-09-10T05:38:25.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.408+0000 7f032b4e5640 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f031c125040 con 0x562f6a57f530 2024-09-10T05:38:25.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.408+0000 7f032b4e5640 1 -- 172.21.15.62:0/2370960255 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f032400a4d0 con 0x562f6a57f530 2024-09-10T05:38:25.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.408+0000 7f032b4e5640 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f031c125040 con 0x7f031c11b060 2024-09-10T05:38:25.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.408+0000 7f032b4e5640 1 -- 172.21.15.62:0/2370960255 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f032400a4d0 con 0x7f031c11b060 2024-09-10T05:38:25.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.408+0000 7f032b4e5640 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f031c125040 con 0x562f6a5839c0 2024-09-10T05:38:25.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.408+0000 7f032ace4640 1 -- 172.21.15.62:0/2370960255 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031c111d70 con 0x562f6a5839c0 2024-09-10T05:38:25.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.408+0000 7f032ace4640 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f031c125040 con 0x562f6a5871a0 2024-09-10T05:38:25.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.408+0000 7f032a4e3640 1 -- 172.21.15.62:0/2370960255 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031400d040 con 0x562f6a5871a0 2024-09-10T05:38:25.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.408+0000 7f032a4e3640 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f031c125040 con 0x562f6a57f530 2024-09-10T05:38:25.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.408+0000 7f032b4e5640 1 -- 172.21.15.62:0/2370960255 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f032400a4d0 con 0x562f6a57f530 2024-09-10T05:38:25.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.408+0000 7f032b4e5640 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f031c125040 con 0x562f6a5839c0 2024-09-10T05:38:25.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.412+0000 7f032ace4640 1 -- 172.21.15.62:0/2370960255 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031c111d70 con 0x562f6a5839c0 2024-09-10T05:38:25.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.412+0000 7f032ace4640 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f031c125040 con 0x562f6a5871a0 2024-09-10T05:38:25.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.412+0000 7f032a4e3640 1 -- 172.21.15.62:0/2370960255 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 34 out=170b] v34'5 uv5 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f031400d040 con 0x562f6a5871a0 2024-09-10T05:38:25.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.412+0000 7f032a4e3640 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f031c125040 con 0x562f6a57f530 2024-09-10T05:38:25.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.412+0000 7f032b4e5640 1 -- 172.21.15.62:0/2370960255 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f032400a4d0 con 0x562f6a57f530 2024-09-10T05:38:25.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.412+0000 7f032b4e5640 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f031c125040 con 0x562f6a57f530 2024-09-10T05:38:25.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.412+0000 7f032b4e5640 1 -- 172.21.15.62:0/2370960255 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f032400a4d0 con 0x562f6a57f530 2024-09-10T05:38:25.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.412+0000 7f032b4e5640 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f031c125040 con 0x562f6a57f530 2024-09-10T05:38:25.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.412+0000 7f032b4e5640 1 -- 172.21.15.62:0/2370960255 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f032400a4d0 con 0x562f6a57f530 2024-09-10T05:38:25.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.412+0000 7f032b4e5640 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f031c125040 con 0x562f6a5871a0 2024-09-10T05:38:25.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.412+0000 7f032a4e3640 1 -- 172.21.15.62:0/2370960255 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031400d040 con 0x562f6a5871a0 2024-09-10T05:38:25.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.412+0000 7f032a4e3640 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f031c125040 con 0x7f031c11b060 2024-09-10T05:38:25.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.412+0000 7f032b4e5640 1 -- 172.21.15.62:0/2370960255 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f032400a4d0 con 0x7f031c11b060 2024-09-10T05:38:25.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.412+0000 7f032b4e5640 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f031c125040 con 0x562f6a57f530 2024-09-10T05:38:25.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.412+0000 7f032b4e5640 1 -- 172.21.15.62:0/2370960255 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f032400a4d0 con 0x562f6a57f530 2024-09-10T05:38:25.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.412+0000 7f032b4e5640 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f031c125040 con 0x7f031c11b060 2024-09-10T05:38:25.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.412+0000 7f032b4e5640 1 -- 172.21.15.62:0/2370960255 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f032400a4d0 con 0x7f031c11b060 2024-09-10T05:38:25.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.412+0000 7f032b4e5640 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f031c125040 con 0x562f6a5871a0 2024-09-10T05:38:25.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.412+0000 7f032a4e3640 1 -- 172.21.15.62:0/2370960255 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031400d040 con 0x562f6a5871a0 2024-09-10T05:38:25.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.412+0000 7f032a4e3640 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f031c125040 con 0x7f031c11b060 2024-09-10T05:38:25.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.412+0000 7f032b4e5640 1 -- 172.21.15.62:0/2370960255 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f032400a4d0 con 0x7f031c11b060 2024-09-10T05:38:25.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.412+0000 7f032b4e5640 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f031c125040 con 0x562f6a5839c0 2024-09-10T05:38:25.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.412+0000 7f032ace4640 1 -- 172.21.15.62:0/2370960255 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031c111d70 con 0x562f6a5839c0 2024-09-10T05:38:25.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.412+0000 7f032ace4640 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f031c125040 con 0x562f6a5839c0 2024-09-10T05:38:25.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.412+0000 7f032ace4640 1 -- 172.21.15.62:0/2370960255 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031c111d70 con 0x562f6a5839c0 2024-09-10T05:38:25.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.412+0000 7f032ace4640 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f031c125040 con 0x562f6a5871a0 2024-09-10T05:38:25.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.416+0000 7f032a4e3640 1 -- 172.21.15.62:0/2370960255 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031400d040 con 0x562f6a5871a0 2024-09-10T05:38:25.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.416+0000 7f032a4e3640 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f031c125040 con 0x562f6a5839c0 2024-09-10T05:38:25.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.416+0000 7f032ace4640 1 -- 172.21.15.62:0/2370960255 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f031c111d70 con 0x562f6a5839c0 2024-09-10T05:38:25.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.416+0000 7f032ace4640 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f031c125040 con 0x562f6a5839c0 2024-09-10T05:38:25.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.416+0000 7f032ace4640 1 -- 172.21.15.62:0/2370960255 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031c111d70 con 0x562f6a5839c0 2024-09-10T05:38:25.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.416+0000 7f032d1de9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:38:25.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.416+0000 7f032d1de9c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:38:25.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.416+0000 7f032d1de9c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:38:25.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.416+0000 7f032d1de9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:38:25.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.416+0000 7f032d1de9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:38:25.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.416+0000 7f032d1de9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:38:25.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.416+0000 7f032d1de9c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:25.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.416+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f6a58a710 con 0x562f6a57f530 2024-09-10T05:38:25.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.416+0000 7f032b4e5640 1 -- 172.21.15.62:0/2370960255 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f032400a4d0 con 0x562f6a57f530 2024-09-10T05:38:25.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.416+0000 7f032d1de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:25.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.416+0000 7f032d1de9c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:25.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.416+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f6a58afb0 con 0x562f6a5839c0 2024-09-10T05:38:25.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.416+0000 7f032ace4640 1 -- 172.21.15.62:0/2370960255 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f031c111d70 con 0x562f6a5839c0 2024-09-10T05:38:25.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.416+0000 7f032d1de9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:38:25.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.416+0000 7f032d1de9c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:25.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.416+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f6a58a350 con 0x562f6a5871a0 2024-09-10T05:38:25.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.416+0000 7f032a4e3640 1 -- 172.21.15.62:0/2370960255 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f031400d040 con 0x562f6a5871a0 2024-09-10T05:38:25.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.416+0000 7f032d1de9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:38:25.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.416+0000 7f032d1de9c0 20 zone default found 2024-09-10T05:38:25.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.416+0000 7f032d1de9c0 4 Realm: () 2024-09-10T05:38:25.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.416+0000 7f032d1de9c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:38:25.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.416+0000 7f032d1de9c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:38:25.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.416+0000 7f032d1de9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:38:25.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.416+0000 7f032d1de9c0 20 zonegroup default 2024-09-10T05:38:25.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.416+0000 7f032d1de9c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:25.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.416+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f6a58bed0 con 0x7f031c11b060 2024-09-10T05:38:25.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.416+0000 7f032b4e5640 1 -- 172.21.15.62:0/2370960255 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f032400a4d0 con 0x7f031c11b060 2024-09-10T05:38:25.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.416+0000 7f032d1de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:25.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.416+0000 7f032d1de9c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:25.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.416+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f6a58e110 con 0x562f6a5871a0 2024-09-10T05:38:25.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.416+0000 7f032a4e3640 1 -- 172.21.15.62:0/2370960255 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f031400d040 con 0x562f6a5871a0 2024-09-10T05:38:25.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.416+0000 7f032d1de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:25.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.416+0000 7f032d1de9c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:25.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.416+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f6a58e4b0 con 0x562f6a5871a0 2024-09-10T05:38:25.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.416+0000 7f032a4e3640 1 -- 172.21.15.62:0/2370960255 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f031400d040 con 0x562f6a5871a0 2024-09-10T05:38:25.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.416+0000 7f032d1de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:25.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.416+0000 7f032d1de9c0 20 started sync module instance, tier type = 2024-09-10T05:38:25.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.416+0000 7f032d1de9c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:38:25.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.416+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f6a58d550 con 0x562f6a5839c0 2024-09-10T05:38:25.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.420+0000 7f032ace4640 1 -- 172.21.15.62:0/2370960255 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031c111d70 con 0x562f6a5839c0 2024-09-10T05:38:25.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.420+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94761647659328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f6a58d550 con 0x562f6a5839c0 2024-09-10T05:38:25.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.420+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f6a58edf0 con 0x562f6a57f530 2024-09-10T05:38:25.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.420+0000 7f032b4e5640 1 -- 172.21.15.62:0/2370960255 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f032400a4d0 con 0x562f6a57f530 2024-09-10T05:38:25.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.420+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94761647663424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f6a58f640 con 0x562f6a57f530 2024-09-10T05:38:25.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.420+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f6a58fe90 con 0x562f6a5839c0 2024-09-10T05:38:25.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.420+0000 7f032ace4640 1 -- 172.21.15.62:0/2370960255 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94761647659328] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031c111d70 con 0x562f6a5839c0 2024-09-10T05:38:25.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.420+0000 7f032b4e5640 1 -- 172.21.15.62:0/2370960255 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94761647663424] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f032400a4d0 con 0x562f6a57f530 2024-09-10T05:38:25.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.424+0000 7f032ace4640 1 -- 172.21.15.62:0/2370960255 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031c111d70 con 0x562f6a5839c0 2024-09-10T05:38:25.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.424+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94761647665552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f6a58fa60 con 0x562f6a5839c0 2024-09-10T05:38:25.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.424+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f6a5902b0 con 0x7f031c11b060 2024-09-10T05:38:25.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.424+0000 7f032b4e5640 1 -- 172.21.15.62:0/2370960255 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f032400a4d0 con 0x7f031c11b060 2024-09-10T05:38:25.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.424+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94761647668080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f6a5906a0 con 0x7f031c11b060 2024-09-10T05:38:25.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.424+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f6a591170 con 0x562f6a5839c0 2024-09-10T05:38:25.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.424+0000 7f032b4e5640 1 -- 172.21.15.62:0/2370960255 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94761647668080] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f032400a4d0 con 0x7f031c11b060 2024-09-10T05:38:25.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.428+0000 7f032ace4640 1 -- 172.21.15.62:0/2370960255 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94761647665552] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031c111d70 con 0x562f6a5839c0 2024-09-10T05:38:25.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.428+0000 7f032ace4640 1 -- 172.21.15.62:0/2370960255 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031c111d70 con 0x562f6a5839c0 2024-09-10T05:38:25.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.428+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94761647666608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f6a591130 con 0x562f6a5839c0 2024-09-10T05:38:25.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.428+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f6a591a10 con 0x562f6a5871a0 2024-09-10T05:38:25.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.428+0000 7f032a4e3640 1 -- 172.21.15.62:0/2370960255 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031400d040 con 0x562f6a5871a0 2024-09-10T05:38:25.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.428+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94761647674720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f6a591130 con 0x562f6a5871a0 2024-09-10T05:38:25.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.428+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f6a592490 con 0x562f6a5871a0 2024-09-10T05:38:25.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.428+0000 7f032a4e3640 1 -- 172.21.15.62:0/2370960255 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94761647674720] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031400d040 con 0x562f6a5871a0 2024-09-10T05:38:25.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.428+0000 7f032a4e3640 1 -- 172.21.15.62:0/2370960255 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031400d040 con 0x562f6a5871a0 2024-09-10T05:38:25.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.428+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94761647675776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f6a592450 con 0x562f6a5871a0 2024-09-10T05:38:25.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.428+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f6a592ee0 con 0x7f031c11b060 2024-09-10T05:38:25.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.428+0000 7f032ace4640 1 -- 172.21.15.62:0/2370960255 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94761647666608] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031c111d70 con 0x562f6a5839c0 2024-09-10T05:38:25.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.432+0000 7f032a4e3640 1 -- 172.21.15.62:0/2370960255 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94761647675776] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031400d040 con 0x562f6a5871a0 2024-09-10T05:38:25.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.432+0000 7f032b4e5640 1 -- 172.21.15.62:0/2370960255 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f032400a4d0 con 0x7f031c11b060 2024-09-10T05:38:25.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.432+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94761647672416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f6a591fa0 con 0x7f031c11b060 2024-09-10T05:38:25.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.432+0000 7f032d1de9c0 20 add_watcher() i=0 2024-09-10T05:38:25.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.432+0000 7f032d1de9c0 20 add_watcher() i=1 2024-09-10T05:38:25.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.432+0000 7f032d1de9c0 20 add_watcher() i=2 2024-09-10T05:38:25.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.432+0000 7f032d1de9c0 20 add_watcher() i=3 2024-09-10T05:38:25.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.432+0000 7f032d1de9c0 20 add_watcher() i=4 2024-09-10T05:38:25.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.432+0000 7f032d1de9c0 20 add_watcher() i=5 2024-09-10T05:38:25.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.432+0000 7f032d1de9c0 20 add_watcher() i=6 2024-09-10T05:38:25.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.432+0000 7f032b4e5640 1 -- 172.21.15.62:0/2370960255 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94761647672416] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f032400a4d0 con 0x7f031c11b060 2024-09-10T05:38:25.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.432+0000 7f032d1de9c0 20 add_watcher() i=7 2024-09-10T05:38:25.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.432+0000 7f032d1de9c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:38:25.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.432+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f6a5923f0 con 0x562f6a57f530 2024-09-10T05:38:25.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.432+0000 7f032b4e5640 1 -- 172.21.15.62:0/2370960255 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f032400a4d0 con 0x562f6a57f530 2024-09-10T05:38:25.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.432+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94761647679984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f6a5923f0 con 0x562f6a57f530 2024-09-10T05:38:25.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.432+0000 7f032b4e5640 1 -- 172.21.15.62:0/2370960255 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94761647679984] v34'276 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f032400a4d0 con 0x562f6a57f530 2024-09-10T05:38:25.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.432+0000 7f01e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:38:25.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.432+0000 7f032d1de9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:38:25.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.432+0000 7f032d1de9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:38:25.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.432+0000 7f032d1de9c0 5 note: GC not initialized 2024-09-10T05:38:25.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.432+0000 7f015bfff640 20 reqs_thread_entry: start 2024-09-10T05:38:25.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.436+0000 7f032d1de9c0 20 init_complete bucket index max shards: 11 2024-09-10T05:38:25.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.436+0000 7f032d1de9c0 20 Filter name: none 2024-09-10T05:38:25.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.436+0000 7f0159ffb640 20 reqs_thread_entry: start 2024-09-10T05:38:25.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.436+0000 7f032d1de9c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-10T05:38:25.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.436+0000 7f032d1de9c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:25.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.436+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f6a5b9050 con 0x562f6a57f530 2024-09-10T05:38:25.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.436+0000 7f032b4e5640 1 -- 172.21.15.62:0/2370960255 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f032400a4d0 con 0x562f6a57f530 2024-09-10T05:38:25.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.436+0000 7f032d1de9c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-10T05:38:25.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.436+0000 7f032d1de9c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-10T05:38:25.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.436+0000 7f032d1de9c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:38:25.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.436+0000 7f032d1de9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:38:25.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.436+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f6a5bf520 con 0x562f6a57f530 2024-09-10T05:38:25.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.436+0000 7f032b4e5640 1 -- 172.21.15.62:0/2370960255 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v34'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f0324039040 con 0x562f6a57f530 2024-09-10T05:38:25.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.436+0000 7f032d1de9c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T05:38:25.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.436+0000 7f032d1de9c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:38:25.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.436+0000 7f032d1de9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-10T05:38:25.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.436+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94761647861712 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f6a5bacb0 con 0x562f6a5839c0 2024-09-10T05:38:25.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.436+0000 7f032ace4640 1 -- 172.21.15.62:0/2370960255 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== watch-notify(notify (1) cookie 94761647666608 notify 146028888121 ret 0) ==== 691+0+0 (crc 0 0 0) 0x562f6a561ea0 con 0x562f6a5839c0 2024-09-10T05:38:25.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.436+0000 7f020e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888121 cookie 94761647666608 notifier 4913 bl.length()=649 2024-09-10T05:38:25.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.436+0000 7f020e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T05:38:25.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.436+0000 7f020e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:38:25.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.436+0000 7f020e7fc640 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f01f0003eb0 con 0x562f6a5839c0 2024-09-10T05:38:25.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.436+0000 7f032ace4640 1 -- 172.21.15.62:0/2370960255 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(64 notify.4 [notify cookie 94761647861712 out=8b] v0'0 uv276 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f031c111d70 con 0x562f6a5839c0 2024-09-10T05:38:25.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.440+0000 7f032ace4640 1 -- 172.21.15.62:0/2370960255 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== watch-notify(notify_complete (2) cookie 94761647861712 notify 146028888121 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562f6a561640 con 0x562f6a5839c0 2024-09-10T05:38:25.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.440+0000 7f032ace4640 1 -- 172.21.15.62:0/2370960255 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031c111d70 con 0x562f6a5839c0 2024-09-10T05:38:25.442 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-10T05:38:22.896781Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:38:22.896764Z","tags":[],"group_ids":[]} 2024-09-10T05:38:25.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.440+0000 7f01e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:38:25.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.440+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94761647679984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f6a5be8b0 con 0x562f6a57f530 2024-09-10T05:38:25.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.440+0000 7f032b4e5640 1 -- 172.21.15.62:0/2370960255 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94761647679984] v34'277 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0324039040 con 0x562f6a57f530 2024-09-10T05:38:25.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.440+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94761647659328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f6a5be8b0 con 0x562f6a5839c0 2024-09-10T05:38:25.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.444+0000 7f032ace4640 1 -- 172.21.15.62:0/2370960255 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94761647659328] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031c111d70 con 0x562f6a5839c0 2024-09-10T05:38:25.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.444+0000 7f032d1de9c0 20 remove_watcher() i=0 2024-09-10T05:38:25.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.444+0000 7f032d1de9c0 2 removed watcher, disabling cache 2024-09-10T05:38:25.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.444+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94761647663424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f6a5be8b0 con 0x562f6a57f530 2024-09-10T05:38:25.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.444+0000 7f032b4e5640 1 -- 172.21.15.62:0/2370960255 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94761647663424] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0324039040 con 0x562f6a57f530 2024-09-10T05:38:25.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.444+0000 7f032d1de9c0 20 remove_watcher() i=1 2024-09-10T05:38:25.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.444+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94761647665552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f6a5be8b0 con 0x562f6a5839c0 2024-09-10T05:38:25.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.448+0000 7f032ace4640 1 -- 172.21.15.62:0/2370960255 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94761647665552] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031c111d70 con 0x562f6a5839c0 2024-09-10T05:38:25.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.448+0000 7f032d1de9c0 20 remove_watcher() i=2 2024-09-10T05:38:25.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.448+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94761647668080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f6a58d940 con 0x7f031c11b060 2024-09-10T05:38:25.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.448+0000 7f032b4e5640 1 -- 172.21.15.62:0/2370960255 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94761647668080] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0324039040 con 0x7f031c11b060 2024-09-10T05:38:25.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.448+0000 7f032d1de9c0 20 remove_watcher() i=3 2024-09-10T05:38:25.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.448+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94761647666608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f6a58f190 con 0x562f6a5839c0 2024-09-10T05:38:25.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.452+0000 7f032ace4640 1 -- 172.21.15.62:0/2370960255 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94761647666608] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031c111d70 con 0x562f6a5839c0 2024-09-10T05:38:25.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.452+0000 7f032d1de9c0 20 remove_watcher() i=4 2024-09-10T05:38:25.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.452+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94761647674720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f6a58fb70 con 0x562f6a5871a0 2024-09-10T05:38:25.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.452+0000 7f032a4e3640 1 -- 172.21.15.62:0/2370960255 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94761647674720] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031400d040 con 0x562f6a5871a0 2024-09-10T05:38:25.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.452+0000 7f032d1de9c0 20 remove_watcher() i=5 2024-09-10T05:38:25.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.452+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94761647675776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f6a58d940 con 0x562f6a5871a0 2024-09-10T05:38:25.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.452+0000 7f032a4e3640 1 -- 172.21.15.62:0/2370960255 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94761647675776] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031400d040 con 0x562f6a5871a0 2024-09-10T05:38:25.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.452+0000 7f032d1de9c0 20 remove_watcher() i=6 2024-09-10T05:38:25.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.452+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94761647672416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f6a58fb70 con 0x7f031c11b060 2024-09-10T05:38:25.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.452+0000 7f032b4e5640 1 -- 172.21.15.62:0/2370960255 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94761647672416] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0324039040 con 0x7f031c11b060 2024-09-10T05:38:25.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.452+0000 7f032d1de9c0 20 remove_watcher() i=7 2024-09-10T05:38:25.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.452+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x562f6a5839c0 msgr2=0x562f6a585db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.452+0000 7f032d1de9c0 1 --2- 172.21.15.62:0/2370960255 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x562f6a5839c0 0x562f6a585db0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.452+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x562f6a57f530 msgr2=0x562f6a5819c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.452+0000 7f032d1de9c0 1 --2- 172.21.15.62:0/2370960255 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x562f6a57f530 0x562f6a5819c0 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.452+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f031c11b060 msgr2=0x7f031c0b7820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.452+0000 7f032d1de9c0 1 --2- 172.21.15.62:0/2370960255 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f031c11b060 0x7f031c0b7820 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.452+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x562f6a5871a0 msgr2=0x562f6a589590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.452+0000 7f032d1de9c0 1 --2- 172.21.15.62:0/2370960255 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x562f6a5871a0 0x562f6a589590 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.452+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f01f4039ac0 msgr2=0x7f01f403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.452+0000 7f032d1de9c0 1 --2- 172.21.15.62:0/2370960255 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f01f4039ac0 0x7f01f403bf80 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x562f6a54e8a0 tx=0x7f0314011000 comp rx=0 tx=0).stop 2024-09-10T05:38:25.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.452+0000 7f032b4e5640 1 -- 172.21.15.62:0/2370960255 reap_dead start 2024-09-10T05:38:25.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.452+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f6a56d380 msgr2=0x562f6a5746d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.452+0000 7f032d1de9c0 1 --2- 172.21.15.62:0/2370960255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f6a56d380 0x562f6a5746d0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f031c006730 tx=0x7f031c0a8f40 comp rx=0 tx=0).stop 2024-09-10T05:38:25.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.452+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 shutdown_connections 2024-09-10T05:38:25.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.452+0000 7f032d1de9c0 1 --2- 172.21.15.62:0/2370960255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f6a56d380 0x562f6a5746d0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.452+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 >> 172.21.15.62:0/2370960255 conn(0x562f6a5697b0 msgr2=0x562f6a5679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:25.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.452+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 shutdown_connections 2024-09-10T05:38:25.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.452+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2370960255 wait complete. 2024-09-10T05:38:25.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.456+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2229000468 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0204039a70 msgr2=0x7f020403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.456+0000 7f032d1de9c0 1 --2- 172.21.15.62:0/2229000468 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0204039a70 0x7f020403bf30 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x562f6a54ec70 tx=0x7f0314006000 comp rx=0 tx=0).stop 2024-09-10T05:38:25.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.456+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2229000468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f6a560be0 msgr2=0x562f6a561000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.456+0000 7f032d1de9c0 1 --2- 172.21.15.62:0/2229000468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f6a560be0 0x562f6a561000 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f031c0e9fb0 tx=0x7f031c0cfe00 comp rx=0 tx=0).stop 2024-09-10T05:38:25.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.456+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2229000468 shutdown_connections 2024-09-10T05:38:25.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.456+0000 7f032d1de9c0 1 --2- 172.21.15.62:0/2229000468 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0204039a70 0x7f020403bf30 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.456+0000 7f032d1de9c0 1 --2- 172.21.15.62:0/2229000468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f6a560be0 0x562f6a561000 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.456+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2229000468 >> 172.21.15.62:0/2229000468 conn(0x562f6a556590 msgr2=0x562f6a556970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:25.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.456+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2229000468 shutdown_connections 2024-09-10T05:38:25.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.456+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2229000468 wait complete. 2024-09-10T05:38:25.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.456+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2744991776 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x562f6a54b040 msgr2=0x562f6a54d500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.456+0000 7f032d1de9c0 1 --2- 172.21.15.62:0/2744991776 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x562f6a54b040 0x562f6a54d500 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.456+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2744991776 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x562f6a4510b0 msgr2=0x562f6a54a050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.456+0000 7f032d1de9c0 1 --2- 172.21.15.62:0/2744991776 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x562f6a4510b0 0x562f6a54a050 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.456+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2744991776 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x562f6a54fa30 msgr2=0x562f6a551e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.456+0000 7f032d1de9c0 1 --2- 172.21.15.62:0/2744991776 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x562f6a54fa30 0x562f6a551e20 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.456+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2744991776 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0210039a70 msgr2=0x7f021003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.456+0000 7f032d1de9c0 1 --2- 172.21.15.62:0/2744991776 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f0210039a70 0x7f021003bf30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0314001e60 tx=0x7f03140013e0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.456+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2744991776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f6a44df70 msgr2=0x562f6a3c43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.456+0000 7f032d1de9c0 1 --2- 172.21.15.62:0/2744991776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f6a44df70 0x562f6a3c43e0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f031c018f70 tx=0x7f031c0180e0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.456+0000 7f032b4e5640 1 -- 172.21.15.62:0/2744991776 reap_dead start 2024-09-10T05:38:25.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.456+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2744991776 shutdown_connections 2024-09-10T05:38:25.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.456+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2744991776 >> 172.21.15.62:0/2744991776 conn(0x562f6a449a90 msgr2=0x562f6a533dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:25.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.456+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2744991776 shutdown_connections 2024-09-10T05:38:25.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.456+0000 7f032d1de9c0 1 -- 172.21.15.62:0/2744991776 wait complete. 2024-09-10T05:38:25.467 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T05:38:22.896781Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:38:22.896764Z', 'tags': [], 'group_ids': []} 2024-09-10T05:38:25.468 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T05:38:22.896781Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:38:22.896764Z', 'tags': [], 'group_ids': []} 2024-09-10T05:38:25.468 ERROR:root:0 2024-09-10T05:38:25.468 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-10T05:38:25.468 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-10T05:38:25.468 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-10T05:38:25.543 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:38:25.543 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:38:25.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.540+0000 7f90bfc809c0 1 Processor -- start 2024-09-10T05:38:25.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.540+0000 7f90bfc809c0 1 -- start start 2024-09-10T05:38:25.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.540+0000 7f90bfc809c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x560e18e3cf70 0x560e18e3d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.540+0000 7f90bfc809c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560e18cf19c0 con 0x560e18e400b0 2024-09-10T05:38:25.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.540+0000 7f90bfc809c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x560e18d416d0 con 0x560e18e3cf70 2024-09-10T05:38:25.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.540+0000 7f90bd786640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x560e18e3cf70 0x560e18e3d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.540+0000 7f90bd786640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x560e18e3cf70 0x560e18e3d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:53896/0 (socket says 172.21.15.62:53896) 2024-09-10T05:38:25.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.540+0000 7f90bcf85640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x560e18e400b0 0x560e18e424a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.62:48862/0 (socket says 172.21.15.62:48862) 2024-09-10T05:38:25.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.540+0000 7f90bd786640 1 -- 172.21.15.62:0/426481696 learned_addr learned my addr 172.21.15.62:0/426481696 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:25.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.544+0000 7f90bd786640 1 -- 172.21.15.62:0/426481696 >> v1:172.21.15.2:6789/0 conn(0x560e18e400b0 legacy=0x560e18e424a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.544+0000 7f90bd786640 1 -- 172.21.15.62:0/426481696 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e18ce5ca0 con 0x560e18e3cf70 2024-09-10T05:38:25.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.544+0000 7f90bd786640 1 --2- 172.21.15.62:0/426481696 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e18e3cf70 0x560e18e3d350 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f90b000a5c0 tx=0x7f90b001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b1f45fc57dcdb26 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.544+0000 7f90affff640 1 -- 172.21.15.62:0/426481696 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90b00a6070 con 0x560e18e3cf70 2024-09-10T05:38:25.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.544+0000 7f90affff640 1 -- 172.21.15.62:0/426481696 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90b00af070 con 0x560e18e3cf70 2024-09-10T05:38:25.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.544+0000 7f90affff640 1 -- 172.21.15.62:0/426481696 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90b00aa5c0 con 0x560e18e3cf70 2024-09-10T05:38:25.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.544+0000 7f90bfc809c0 1 -- 172.21.15.62:0/426481696 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e18e3cf70 msgr2=0x560e18e3d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.544+0000 7f90bfc809c0 1 --2- 172.21.15.62:0/426481696 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e18e3cf70 0x560e18e3d350 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f90b000a5c0 tx=0x7f90b001b340 comp rx=0 tx=0).stop 2024-09-10T05:38:25.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.544+0000 7f90bfc809c0 1 -- 172.21.15.62:0/426481696 shutdown_connections 2024-09-10T05:38:25.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.544+0000 7f90bfc809c0 1 --2- 172.21.15.62:0/426481696 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e18e3cf70 0x560e18e3d350 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.544+0000 7f90bfc809c0 1 -- 172.21.15.62:0/426481696 >> 172.21.15.62:0/426481696 conn(0x560e18e38a90 msgr2=0x560e18e3aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:25.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.544+0000 7f90bfc809c0 1 -- 172.21.15.62:0/426481696 shutdown_connections 2024-09-10T05:38:25.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.544+0000 7f90bfc809c0 1 -- 172.21.15.62:0/426481696 wait complete. 2024-09-10T05:38:25.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.556+0000 7f90bfc809c0 1 Processor -- start 2024-09-10T05:38:25.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.556+0000 7f90bfc809c0 1 -- start start 2024-09-10T05:38:25.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.560+0000 7f90bfc809c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e18e3cf70 0x560e18f28700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.560+0000 7f90bfc809c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560e18d45680 con 0x560e18e3cf70 2024-09-10T05:38:25.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.560+0000 7f90bd786640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e18e3cf70 0x560e18f28700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.560+0000 7f90bd786640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e18e3cf70 0x560e18f28700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:53912/0 (socket says 172.21.15.62:53912) 2024-09-10T05:38:25.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.560+0000 7f90bd786640 1 -- 172.21.15.62:0/3876537774 learned_addr learned my addr 172.21.15.62:0/3876537774 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:25.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.560+0000 7f90bd786640 1 -- 172.21.15.62:0/3876537774 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e18cc0da0 con 0x560e18e3cf70 2024-09-10T05:38:25.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.560+0000 7f90bd786640 1 --2- 172.21.15.62:0/3876537774 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e18e3cf70 0x560e18f28700 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f90b00ac040 tx=0x7f90b0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89cc0913bda1f306 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.560+0000 7f8fab606640 1 -- 172.21.15.62:0/3876537774 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90b00aa970 con 0x560e18e3cf70 2024-09-10T05:38:25.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.560+0000 7f8fab606640 1 -- 172.21.15.62:0/3876537774 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90b00aab10 con 0x560e18e3cf70 2024-09-10T05:38:25.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.560+0000 7f8fab606640 1 -- 172.21.15.62:0/3876537774 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90b00aae30 con 0x560e18e3cf70 2024-09-10T05:38:25.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.560+0000 7f90bfc809c0 1 -- 172.21.15.62:0/3876537774 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e18e3cf70 msgr2=0x560e18f28700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.560+0000 7f90bfc809c0 1 --2- 172.21.15.62:0/3876537774 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e18e3cf70 0x560e18f28700 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f90b00ac040 tx=0x7f90b0003030 comp rx=0 tx=0).stop 2024-09-10T05:38:25.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.560+0000 7f90bfc809c0 1 -- 172.21.15.62:0/3876537774 shutdown_connections 2024-09-10T05:38:25.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.560+0000 7f90bfc809c0 1 --2- 172.21.15.62:0/3876537774 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e18e3cf70 0x560e18f28700 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.560+0000 7f90bfc809c0 1 -- 172.21.15.62:0/3876537774 >> 172.21.15.62:0/3876537774 conn(0x560e18e38a90 msgr2=0x560e18f24340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:25.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.560+0000 7f90bfc809c0 1 -- 172.21.15.62:0/3876537774 shutdown_connections 2024-09-10T05:38:25.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.560+0000 7f90bfc809c0 1 -- 172.21.15.62:0/3876537774 wait complete. 2024-09-10T05:38:25.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.560+0000 7f90bfc809c0 1 Processor -- start 2024-09-10T05:38:25.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.560+0000 7f90bfc809c0 1 -- start start 2024-09-10T05:38:25.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.560+0000 7f90bfc809c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e18e3cf70 0x560e18f2fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.560+0000 7f90bfc809c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560e18ce7a50 con 0x560e18e3cf70 2024-09-10T05:38:25.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.560+0000 7f90bd786640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e18e3cf70 0x560e18f2fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.560+0000 7f90bd786640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e18e3cf70 0x560e18f2fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:53918/0 (socket says 172.21.15.62:53918) 2024-09-10T05:38:25.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.560+0000 7f90bd786640 1 -- 172.21.15.62:0/959562367 learned_addr learned my addr 172.21.15.62:0/959562367 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:25.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.560+0000 7f90bd786640 1 -- 172.21.15.62:0/959562367 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e18f301d0 con 0x560e18e3cf70 2024-09-10T05:38:25.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.564+0000 7f90bd786640 1 --2- 172.21.15.62:0/959562367 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e18e3cf70 0x560e18f2fc70 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f90b001b170 tx=0x7f90b00180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.564+0000 7f8fa9e03640 1 -- 172.21.15.62:0/959562367 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90b00c6690 con 0x560e18e3cf70 2024-09-10T05:38:25.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.564+0000 7f8fa9e03640 1 -- 172.21.15.62:0/959562367 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90b00cc070 con 0x560e18e3cf70 2024-09-10T05:38:25.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.564+0000 7f90bfc809c0 1 -- 172.21.15.62:0/959562367 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560e18f30460 con 0x560e18e3cf70 2024-09-10T05:38:25.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.564+0000 7f8fa9e03640 1 -- 172.21.15.62:0/959562367 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90b00c6960 con 0x560e18e3cf70 2024-09-10T05:38:25.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.564+0000 7f90bfc809c0 1 -- 172.21.15.62:0/959562367 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e18f30e10 con 0x560e18e3cf70 2024-09-10T05:38:25.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.564+0000 7f8fa9e03640 1 -- 172.21.15.62:0/959562367 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f90b00c6c10 con 0x560e18e3cf70 2024-09-10T05:38:25.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.564+0000 7f8fa9e03640 1 --2- 172.21.15.62:0/959562367 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8fa4039a70 0x7f8fa403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.564+0000 7f8fa9e03640 1 -- 172.21.15.62:0/959562367 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7f90b00ebdd0 con 0x560e18e3cf70 2024-09-10T05:38:25.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.564+0000 7f90bcf85640 1 --2- 172.21.15.62:0/959562367 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8fa4039a70 0x7f8fa403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.564+0000 7f90bfc809c0 1 --2- 172.21.15.62:0/959562367 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560e18e400b0 0x560e18f36de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.564+0000 7f90bfc809c0 1 -- 172.21.15.62:0/959562367 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e18f37320 con 0x560e18e400b0 2024-09-10T05:38:25.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.564+0000 7f90bdf87640 1 --2- 172.21.15.62:0/959562367 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560e18e400b0 0x560e18f36de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.564+0000 7f90bcf85640 1 --2- 172.21.15.62:0/959562367 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8fa4039a70 0x7f8fa403bf30 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f90b40016b0 tx=0x7f90b40066c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.564+0000 7f90bdf87640 1 --2- 172.21.15.62:0/959562367 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560e18e400b0 0x560e18f36de0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.564+0000 7f90bdf87640 1 -- 172.21.15.62:0/959562367 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90b80083f0 con 0x560e18e400b0 2024-09-10T05:38:25.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.564+0000 7f90bfc809c0 1 --2- 172.21.15.62:0/959562367 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x560e18f37e20 0x560e18f3a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.564+0000 7f90bfc809c0 1 -- 172.21.15.62:0/959562367 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e18f3aa50 con 0x560e18f37e20 2024-09-10T05:38:25.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.564+0000 7f90bd786640 1 --2- 172.21.15.62:0/959562367 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x560e18f37e20 0x560e18f3a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.564+0000 7f90bd786640 1 --2- 172.21.15.62:0/959562367 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x560e18f37e20 0x560e18f3a2e0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.568+0000 7f90bd786640 1 -- 172.21.15.62:0/959562367 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f90b00b3cd0 con 0x560e18f37e20 2024-09-10T05:38:25.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.568+0000 7f90bfc809c0 1 --2- 172.21.15.62:0/959562367 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x560e18f3c810 0x560e18f3ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.568+0000 7f90bfc809c0 1 -- 172.21.15.62:0/959562367 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e18f3f2f0 con 0x560e18f3c810 2024-09-10T05:38:25.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.568+0000 7f90bcf85640 1 --2- 172.21.15.62:0/959562367 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x560e18f3c810 0x560e18f3ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.568+0000 7f90bcf85640 1 --2- 172.21.15.62:0/959562367 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x560e18f3c810 0x560e18f3ec00 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.568+0000 7f90bcf85640 1 -- 172.21.15.62:0/959562367 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv5 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f90b400f070 con 0x560e18f3c810 2024-09-10T05:38:25.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.568+0000 7f90bfc809c0 1 -- 172.21.15.62:0/959562367 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e18f3b6b0 con 0x560e18f37e20 2024-09-10T05:38:25.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.568+0000 7f90bd786640 1 -- 172.21.15.62:0/959562367 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f90b00b3cd0 con 0x560e18f37e20 2024-09-10T05:38:25.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.568+0000 7f90bfc809c0 1 -- 172.21.15.62:0/959562367 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e18f3bb10 con 0x560e18f3c810 2024-09-10T05:38:25.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.568+0000 7f90bcf85640 1 -- 172.21.15.62:0/959562367 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f90b400f070 con 0x560e18f3c810 2024-09-10T05:38:25.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.568+0000 7f90bfc809c0 1 Processor -- start 2024-09-10T05:38:25.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.568+0000 7f90bfc809c0 1 -- start start 2024-09-10T05:38:25.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.568+0000 7f90bfc809c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e18db3460 0x560e18db1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.568+0000 7f90bfc809c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560e18d52450 con 0x560e18db3460 2024-09-10T05:38:25.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.568+0000 7f90bd786640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e18db3460 0x560e18db1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.568+0000 7f90bd786640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e18db3460 0x560e18db1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:53926/0 (socket says 172.21.15.62:53926) 2024-09-10T05:38:25.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.568+0000 7f90bd786640 1 -- 172.21.15.62:0/3565670118 learned_addr learned my addr 172.21.15.62:0/3565670118 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:25.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.572+0000 7f90bd786640 1 -- 172.21.15.62:0/3565670118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e18db3980 con 0x560e18db3460 2024-09-10T05:38:25.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.572+0000 7f90bd786640 1 --2- 172.21.15.62:0/3565670118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e18db3460 0x560e18db1d00 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f90b00ea1d0 tx=0x7f90b00c5de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.572+0000 7f8fa2ffd640 1 -- 172.21.15.62:0/3565670118 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90b00c55f0 con 0x560e18db3460 2024-09-10T05:38:25.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.572+0000 7f90bfc809c0 1 -- 172.21.15.62:0/3565670118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560e18db2240 con 0x560e18db3460 2024-09-10T05:38:25.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.572+0000 7f8fa2ffd640 1 -- 172.21.15.62:0/3565670118 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90b00c5790 con 0x560e18db3460 2024-09-10T05:38:25.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.572+0000 7f8fa2ffd640 1 -- 172.21.15.62:0/3565670118 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90b00d05f0 con 0x560e18db3460 2024-09-10T05:38:25.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.572+0000 7f90bfc809c0 1 -- 172.21.15.62:0/3565670118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e18db27b0 con 0x560e18db3460 2024-09-10T05:38:25.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.572+0000 7f8fa2ffd640 1 -- 172.21.15.62:0/3565670118 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f90b00d0790 con 0x560e18db3460 2024-09-10T05:38:25.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.572+0000 7f8fa2ffd640 1 --2- 172.21.15.62:0/3565670118 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8f94039a70 0x7f8f9403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.572+0000 7f8fa2ffd640 1 -- 172.21.15.62:0/3565670118 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7f90b00f3bf0 con 0x560e18db3460 2024-09-10T05:38:25.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.572+0000 7f90bcf85640 1 --2- 172.21.15.62:0/3565670118 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8f94039a70 0x7f8f9403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.572+0000 7f90bfc809c0 1 Processor -- start 2024-09-10T05:38:25.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.572+0000 7f90bfc809c0 1 -- start start 2024-09-10T05:38:25.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.572+0000 7f90bcf85640 1 --2- 172.21.15.62:0/3565670118 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8f94039a70 0x7f8f9403bf30 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f90b40063a0 tx=0x7f90b400f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.572+0000 7f90bfc809c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e18f5c140 0x560e18f5c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.572+0000 7f90bfc809c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560e18f28e90 con 0x560e18f5c140 2024-09-10T05:38:25.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.572+0000 7f90bd786640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e18f5c140 0x560e18f5c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.572+0000 7f90bd786640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e18f5c140 0x560e18f5c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:53936/0 (socket says 172.21.15.62:53936) 2024-09-10T05:38:25.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.572+0000 7f90bd786640 1 -- 172.21.15.62:0/3791828288 learned_addr learned my addr 172.21.15.62:0/3791828288 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:25.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.572+0000 7f90bd786640 1 -- 172.21.15.62:0/3791828288 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e18f5caf0 con 0x560e18f5c140 2024-09-10T05:38:25.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.576+0000 7f90bd786640 1 --2- 172.21.15.62:0/3791828288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e18f5c140 0x560e18f5c520 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f90b00dccf0 tx=0x7f90b00dc820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22f32f6b0b901d14 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.576+0000 7f8fa0ff9640 1 -- 172.21.15.62:0/3791828288 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90b00dc9e0 con 0x560e18f5c140 2024-09-10T05:38:25.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.576+0000 7f8fa0ff9640 1 -- 172.21.15.62:0/3791828288 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90b00b38c0 con 0x560e18f5c140 2024-09-10T05:38:25.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.576+0000 7f8fa0ff9640 1 -- 172.21.15.62:0/3791828288 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90b00b33f0 con 0x560e18f5c140 2024-09-10T05:38:25.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.576+0000 7f90bfc809c0 1 -- 172.21.15.62:0/3791828288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e18f5c140 msgr2=0x560e18f5c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.576+0000 7f90bfc809c0 1 --2- 172.21.15.62:0/3791828288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e18f5c140 0x560e18f5c520 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f90b00dccf0 tx=0x7f90b00dc820 comp rx=0 tx=0).stop 2024-09-10T05:38:25.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.576+0000 7f90bfc809c0 1 -- 172.21.15.62:0/3791828288 shutdown_connections 2024-09-10T05:38:25.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.576+0000 7f90bfc809c0 1 --2- 172.21.15.62:0/3791828288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e18f5c140 0x560e18f5c520 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.576+0000 7f90bfc809c0 1 -- 172.21.15.62:0/3791828288 >> 172.21.15.62:0/3791828288 conn(0x560e18f58570 msgr2=0x560e18f567b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:25.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.576+0000 7f90bfc809c0 1 -- 172.21.15.62:0/3791828288 shutdown_connections 2024-09-10T05:38:25.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.576+0000 7f90bfc809c0 1 -- 172.21.15.62:0/3791828288 wait complete. 2024-09-10T05:38:25.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.576+0000 7f90bfc809c0 1 Processor -- start 2024-09-10T05:38:25.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.576+0000 7f90bfc809c0 1 -- start start 2024-09-10T05:38:25.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.576+0000 7f90bfc809c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e18f5c140 0x560e18f63530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.576+0000 7f90bfc809c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560e18f5cfd0 con 0x560e18f5c140 2024-09-10T05:38:25.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.576+0000 7f90bd786640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e18f5c140 0x560e18f63530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.576+0000 7f90bd786640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e18f5c140 0x560e18f63530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:53942/0 (socket says 172.21.15.62:53942) 2024-09-10T05:38:25.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.576+0000 7f90bd786640 1 -- 172.21.15.62:0/515524841 learned_addr learned my addr 172.21.15.62:0/515524841 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:38:25.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.576+0000 7f90bd786640 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e18f63a90 con 0x560e18f5c140 2024-09-10T05:38:25.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.576+0000 7f90bd786640 1 --2- 172.21.15.62:0/515524841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e18f5c140 0x560e18f63530 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f90b00ecf80 tx=0x7f90b00ecf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.576+0000 7f8f92ffd640 1 -- 172.21.15.62:0/515524841 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90b0114020 con 0x560e18f5c140 2024-09-10T05:38:25.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.576+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560e18f63a90 con 0x560e18f5c140 2024-09-10T05:38:25.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.576+0000 7f8f92ffd640 1 -- 172.21.15.62:0/515524841 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90b00e1dd0 con 0x560e18f5c140 2024-09-10T05:38:25.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.576+0000 7f8f92ffd640 1 -- 172.21.15.62:0/515524841 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90b00dc580 con 0x560e18f5c140 2024-09-10T05:38:25.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.576+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e18f64060 con 0x560e18f5c140 2024-09-10T05:38:25.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.580+0000 7f8f92ffd640 1 -- 172.21.15.62:0/515524841 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f90b0117020 con 0x560e18f5c140 2024-09-10T05:38:25.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.580+0000 7f90bfc809c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:25.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.580+0000 7f8f92ffd640 1 --2- 172.21.15.62:0/515524841 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8f88039a70 0x7f8f8803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.580+0000 7f8f92ffd640 1 -- 172.21.15.62:0/515524841 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7f90b010b050 con 0x560e18f5c140 2024-09-10T05:38:25.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.580+0000 7f90bcf85640 1 --2- 172.21.15.62:0/515524841 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8f88039a70 0x7f8f8803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.580+0000 7f90bfc809c0 1 --2- 172.21.15.62:0/515524841 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560e18f6e460 0x560e18f708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.580+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e18f71040 con 0x560e18f6e460 2024-09-10T05:38:25.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.580+0000 7f90bdf87640 1 --2- 172.21.15.62:0/515524841 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560e18f6e460 0x560e18f708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.580+0000 7f90bcf85640 1 --2- 172.21.15.62:0/515524841 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8f88039a70 0x7f8f8803bf30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x560e18f376c0 tx=0x7f90b4010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.580+0000 7f90bdf87640 1 --2- 172.21.15.62:0/515524841 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560e18f6e460 0x560e18f708f0 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.580+0000 7f90bdf87640 1 -- 172.21.15.62:0/515524841 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90b80083f0 con 0x560e18f6e460 2024-09-10T05:38:25.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.580+0000 7f90bfc809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:25.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.580+0000 7f90bfc809c0 20 realm 2024-09-10T05:38:25.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.580+0000 7f90bfc809c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:25.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.580+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e18f6d7f0 con 0x560e18f6e460 2024-09-10T05:38:25.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.580+0000 7f90bdf87640 1 -- 172.21.15.62:0/515524841 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90b80083f0 con 0x560e18f6e460 2024-09-10T05:38:25.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.580+0000 7f90bfc809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:25.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.580+0000 7f90bfc809c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:38:25.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.580+0000 7f90bfc809c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:25.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.580+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e18f71b00 con 0x560e18f6e460 2024-09-10T05:38:25.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.580+0000 7f90bdf87640 1 -- 172.21.15.62:0/515524841 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90b80083f0 con 0x560e18f6e460 2024-09-10T05:38:25.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.580+0000 7f90bfc809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:25.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.580+0000 7f90bfc809c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:25.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.580+0000 7f90bfc809c0 1 --2- 172.21.15.62:0/515524841 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x560e18f728e0 0x560e18f74cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.580+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e18f753a0 con 0x560e18f728e0 2024-09-10T05:38:25.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.580+0000 7f90bd786640 1 --2- 172.21.15.62:0/515524841 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x560e18f728e0 0x560e18f74cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.580+0000 7f90bd786640 1 --2- 172.21.15.62:0/515524841 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x560e18f728e0 0x560e18f74cd0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.580+0000 7f90bd786640 1 -- 172.21.15.62:0/515524841 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f90b00f9070 con 0x560e18f728e0 2024-09-10T05:38:25.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.580+0000 7f90bfc809c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:38:25.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.580+0000 7f90bfc809c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:25.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.580+0000 7f90bfc809c0 1 --2- 172.21.15.62:0/515524841 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x560e18f76100 0x560e18f78510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.580+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e18f78ca0 con 0x560e18f76100 2024-09-10T05:38:25.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.580+0000 7f90bcf85640 1 --2- 172.21.15.62:0/515524841 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x560e18f76100 0x560e18f78510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.584+0000 7f90bcf85640 1 --2- 172.21.15.62:0/515524841 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x560e18f76100 0x560e18f78510 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.584+0000 7f90bcf85640 1 -- 172.21.15.62:0/515524841 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv5 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f90b402d040 con 0x560e18f76100 2024-09-10T05:38:25.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.584+0000 7f90bfc809c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:38:25.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.584+0000 7f90bfc809c0 20 searching for the correct realm 2024-09-10T05:38:25.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.584+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e18f7a570 con 0x560e18f76100 2024-09-10T05:38:25.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.584+0000 7f90bcf85640 1 -- 172.21.15.62:0/515524841 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b402d040 con 0x560e18f76100 2024-09-10T05:38:25.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.584+0000 7f90bcf85640 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e18f7a570 con 0x560e18f728e0 2024-09-10T05:38:25.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.584+0000 7f90bd786640 1 -- 172.21.15.62:0/515524841 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b00f9070 con 0x560e18f728e0 2024-09-10T05:38:25.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.584+0000 7f90bd786640 1 --2- 172.21.15.62:0/515524841 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f90b0119020 0x7f90b00cf890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:38:25.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.584+0000 7f90bd786640 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e18f7a570 con 0x7f90b0119020 2024-09-10T05:38:25.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.584+0000 7f90bdf87640 1 --2- 172.21.15.62:0/515524841 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f90b0119020 0x7f90b00cf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:38:25.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.584+0000 7f90bdf87640 1 --2- 172.21.15.62:0/515524841 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f90b0119020 0x7f90b00cf890 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:38:25.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.584+0000 7f90bdf87640 1 -- 172.21.15.62:0/515524841 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b80083f0 con 0x7f90b0119020 2024-09-10T05:38:25.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.584+0000 7f90bdf87640 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e18f7a570 con 0x560e18f6e460 2024-09-10T05:38:25.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.584+0000 7f90bdf87640 1 -- 172.21.15.62:0/515524841 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b80083f0 con 0x560e18f6e460 2024-09-10T05:38:25.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.584+0000 7f90bdf87640 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e18f7a570 con 0x560e18f6e460 2024-09-10T05:38:25.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.584+0000 7f90bdf87640 1 -- 172.21.15.62:0/515524841 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b80083f0 con 0x560e18f6e460 2024-09-10T05:38:25.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.584+0000 7f90bdf87640 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e18f7a570 con 0x560e18f76100 2024-09-10T05:38:25.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.584+0000 7f90bcf85640 1 -- 172.21.15.62:0/515524841 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b402d040 con 0x560e18f76100 2024-09-10T05:38:25.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.584+0000 7f90bcf85640 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e18f7a570 con 0x560e18f6e460 2024-09-10T05:38:25.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.584+0000 7f90bdf87640 1 -- 172.21.15.62:0/515524841 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b80083f0 con 0x560e18f6e460 2024-09-10T05:38:25.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.584+0000 7f90bdf87640 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e18f7a570 con 0x560e18f728e0 2024-09-10T05:38:25.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.584+0000 7f90bd786640 1 -- 172.21.15.62:0/515524841 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b00f9070 con 0x560e18f728e0 2024-09-10T05:38:25.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.584+0000 7f90bd786640 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e18f7a570 con 0x560e18f728e0 2024-09-10T05:38:25.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.588+0000 7f90bd786640 1 -- 172.21.15.62:0/515524841 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b00f9070 con 0x560e18f728e0 2024-09-10T05:38:25.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.588+0000 7f90bd786640 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e18f7a570 con 0x560e18f6e460 2024-09-10T05:38:25.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.588+0000 7f90bdf87640 1 -- 172.21.15.62:0/515524841 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b80083f0 con 0x560e18f6e460 2024-09-10T05:38:25.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.588+0000 7f90bdf87640 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e18f7a570 con 0x7f90b0119020 2024-09-10T05:38:25.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.588+0000 7f90bdf87640 1 -- 172.21.15.62:0/515524841 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b80083f0 con 0x7f90b0119020 2024-09-10T05:38:25.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.588+0000 7f90bdf87640 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e18f7a570 con 0x560e18f6e460 2024-09-10T05:38:25.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.588+0000 7f90bdf87640 1 -- 172.21.15.62:0/515524841 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b80083f0 con 0x560e18f6e460 2024-09-10T05:38:25.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.588+0000 7f90bdf87640 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e18f7a570 con 0x7f90b0119020 2024-09-10T05:38:25.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.588+0000 7f90bdf87640 1 -- 172.21.15.62:0/515524841 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f90b80083f0 con 0x7f90b0119020 2024-09-10T05:38:25.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.588+0000 7f90bdf87640 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e18f7a570 con 0x560e18f728e0 2024-09-10T05:38:25.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.588+0000 7f90bd786640 1 -- 172.21.15.62:0/515524841 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b00f9070 con 0x560e18f728e0 2024-09-10T05:38:25.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.588+0000 7f90bd786640 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e18f7a570 con 0x560e18f76100 2024-09-10T05:38:25.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.588+0000 7f90bcf85640 1 -- 172.21.15.62:0/515524841 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b402d040 con 0x560e18f76100 2024-09-10T05:38:25.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.588+0000 7f90bcf85640 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e18f7a570 con 0x560e18f6e460 2024-09-10T05:38:25.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.588+0000 7f90bdf87640 1 -- 172.21.15.62:0/515524841 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b80083f0 con 0x560e18f6e460 2024-09-10T05:38:25.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.588+0000 7f90bdf87640 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e18f7a570 con 0x560e18f728e0 2024-09-10T05:38:25.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.588+0000 7f90bd786640 1 -- 172.21.15.62:0/515524841 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b00f9070 con 0x560e18f728e0 2024-09-10T05:38:25.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.588+0000 7f90bd786640 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e18f7a570 con 0x560e18f76100 2024-09-10T05:38:25.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.588+0000 7f90bcf85640 1 -- 172.21.15.62:0/515524841 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 34 out=170b] v34'5 uv5 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f90b402d040 con 0x560e18f76100 2024-09-10T05:38:25.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.588+0000 7f90bcf85640 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e18f7a570 con 0x560e18f6e460 2024-09-10T05:38:25.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.588+0000 7f90bdf87640 1 -- 172.21.15.62:0/515524841 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b80083f0 con 0x560e18f6e460 2024-09-10T05:38:25.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.588+0000 7f90bdf87640 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e18f7a570 con 0x560e18f6e460 2024-09-10T05:38:25.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.588+0000 7f90bdf87640 1 -- 172.21.15.62:0/515524841 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f90b80083f0 con 0x560e18f6e460 2024-09-10T05:38:25.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.592+0000 7f90bdf87640 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e18f7a570 con 0x560e18f6e460 2024-09-10T05:38:25.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.592+0000 7f90bdf87640 1 -- 172.21.15.62:0/515524841 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b80083f0 con 0x560e18f6e460 2024-09-10T05:38:25.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.592+0000 7f90bdf87640 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e18f7a570 con 0x560e18f76100 2024-09-10T05:38:25.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.592+0000 7f90bcf85640 1 -- 172.21.15.62:0/515524841 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b402d040 con 0x560e18f76100 2024-09-10T05:38:25.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.592+0000 7f90bcf85640 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e18f7a570 con 0x7f90b0119020 2024-09-10T05:38:25.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.592+0000 7f90bdf87640 1 -- 172.21.15.62:0/515524841 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b80083f0 con 0x7f90b0119020 2024-09-10T05:38:25.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.592+0000 7f90bdf87640 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e18f7a570 con 0x560e18f6e460 2024-09-10T05:38:25.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.592+0000 7f90bdf87640 1 -- 172.21.15.62:0/515524841 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b80083f0 con 0x560e18f6e460 2024-09-10T05:38:25.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.592+0000 7f90bdf87640 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e18f7a570 con 0x7f90b0119020 2024-09-10T05:38:25.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.592+0000 7f90bdf87640 1 -- 172.21.15.62:0/515524841 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b80083f0 con 0x7f90b0119020 2024-09-10T05:38:25.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.592+0000 7f90bdf87640 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e18f7a570 con 0x560e18f76100 2024-09-10T05:38:25.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.592+0000 7f90bcf85640 1 -- 172.21.15.62:0/515524841 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b402d040 con 0x560e18f76100 2024-09-10T05:38:25.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.592+0000 7f90bcf85640 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e18f7a570 con 0x7f90b0119020 2024-09-10T05:38:25.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.592+0000 7f90bdf87640 1 -- 172.21.15.62:0/515524841 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b80083f0 con 0x7f90b0119020 2024-09-10T05:38:25.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.592+0000 7f90bdf87640 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e18f7a570 con 0x560e18f728e0 2024-09-10T05:38:25.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.592+0000 7f90bd786640 1 -- 172.21.15.62:0/515524841 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b00f9070 con 0x560e18f728e0 2024-09-10T05:38:25.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.592+0000 7f90bd786640 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e18f7a570 con 0x560e18f728e0 2024-09-10T05:38:25.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.592+0000 7f90bd786640 1 -- 172.21.15.62:0/515524841 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b00f9070 con 0x560e18f728e0 2024-09-10T05:38:25.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.592+0000 7f90bd786640 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e18f7a570 con 0x560e18f76100 2024-09-10T05:38:25.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.592+0000 7f90bcf85640 1 -- 172.21.15.62:0/515524841 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b402d040 con 0x560e18f76100 2024-09-10T05:38:25.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.592+0000 7f90bcf85640 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e18f7a570 con 0x560e18f728e0 2024-09-10T05:38:25.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.596+0000 7f90bd786640 1 -- 172.21.15.62:0/515524841 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f90b00f9070 con 0x560e18f728e0 2024-09-10T05:38:25.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.596+0000 7f90bd786640 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e18f7a570 con 0x560e18f728e0 2024-09-10T05:38:25.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.596+0000 7f90bd786640 1 -- 172.21.15.62:0/515524841 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b00f9070 con 0x560e18f728e0 2024-09-10T05:38:25.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.596+0000 7f90bfc809c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:38:25.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.596+0000 7f90bfc809c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:38:25.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.596+0000 7f90bfc809c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:38:25.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.596+0000 7f90bfc809c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:38:25.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.596+0000 7f90bfc809c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:38:25.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.596+0000 7f90bfc809c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:38:25.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.596+0000 7f90bfc809c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:25.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.596+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e18f79660 con 0x560e18f6e460 2024-09-10T05:38:25.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.596+0000 7f90bdf87640 1 -- 172.21.15.62:0/515524841 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90b80083f0 con 0x560e18f6e460 2024-09-10T05:38:25.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.596+0000 7f90bfc809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:25.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.596+0000 7f90bfc809c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:25.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.596+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e18f79f00 con 0x560e18f728e0 2024-09-10T05:38:25.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.596+0000 7f90bd786640 1 -- 172.21.15.62:0/515524841 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f90b00f9070 con 0x560e18f728e0 2024-09-10T05:38:25.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.596+0000 7f90bfc809c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:38:25.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.596+0000 7f90bfc809c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:25.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.596+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e18f792a0 con 0x560e18f76100 2024-09-10T05:38:25.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.596+0000 7f90bcf85640 1 -- 172.21.15.62:0/515524841 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f90b402d040 con 0x560e18f76100 2024-09-10T05:38:25.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.596+0000 7f90bfc809c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:38:25.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.596+0000 7f90bfc809c0 20 zone default found 2024-09-10T05:38:25.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.596+0000 7f90bfc809c0 4 Realm: () 2024-09-10T05:38:25.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.596+0000 7f90bfc809c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:38:25.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.596+0000 7f90bfc809c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:38:25.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.596+0000 7f90bfc809c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:38:25.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.596+0000 7f90bfc809c0 20 zonegroup default 2024-09-10T05:38:25.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.596+0000 7f90bfc809c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:25.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.596+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e18f7a9a0 con 0x7f90b0119020 2024-09-10T05:38:25.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.596+0000 7f90bdf87640 1 -- 172.21.15.62:0/515524841 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f90b80083f0 con 0x7f90b0119020 2024-09-10T05:38:25.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.596+0000 7f90bfc809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:25.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.596+0000 7f90bfc809c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:25.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.596+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e18f7cc60 con 0x560e18f76100 2024-09-10T05:38:25.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.596+0000 7f90bcf85640 1 -- 172.21.15.62:0/515524841 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f90b402d040 con 0x560e18f76100 2024-09-10T05:38:25.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.596+0000 7f90bfc809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:25.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.596+0000 7f90bfc809c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:25.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.596+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e18f7d000 con 0x560e18f76100 2024-09-10T05:38:25.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.596+0000 7f90bcf85640 1 -- 172.21.15.62:0/515524841 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f90b402d040 con 0x560e18f76100 2024-09-10T05:38:25.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.596+0000 7f90bfc809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:38:25.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.596+0000 7f90bfc809c0 20 started sync module instance, tier type = 2024-09-10T05:38:25.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.596+0000 7f90bfc809c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:38:25.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.596+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e18f7c0f0 con 0x560e18f728e0 2024-09-10T05:38:25.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.600+0000 7f90bd786640 1 -- 172.21.15.62:0/515524841 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90b00f9070 con 0x560e18f728e0 2024-09-10T05:38:25.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.600+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94618548422128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e18f7c0f0 con 0x560e18f728e0 2024-09-10T05:38:25.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.600+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e18f7da50 con 0x560e18f6e460 2024-09-10T05:38:25.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.600+0000 7f90bdf87640 1 -- 172.21.15.62:0/515524841 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90b80083f0 con 0x560e18f6e460 2024-09-10T05:38:25.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.600+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94618548426144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e18f7e2f0 con 0x560e18f6e460 2024-09-10T05:38:25.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.600+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e18f7ed60 con 0x560e18f728e0 2024-09-10T05:38:25.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.600+0000 7f90bdf87640 1 -- 172.21.15.62:0/515524841 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94618548426144] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90b80083f0 con 0x560e18f6e460 2024-09-10T05:38:25.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.600+0000 7f90bd786640 1 -- 172.21.15.62:0/515524841 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94618548422128] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90b00f9070 con 0x560e18f728e0 2024-09-10T05:38:25.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.604+0000 7f90bd786640 1 -- 172.21.15.62:0/515524841 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90b00f9070 con 0x560e18f728e0 2024-09-10T05:38:25.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.604+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94618548430896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e18f7de40 con 0x560e18f728e0 2024-09-10T05:38:25.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.604+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e18f7f600 con 0x7f90b0119020 2024-09-10T05:38:25.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.604+0000 7f90bdf87640 1 -- 172.21.15.62:0/515524841 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90b80083f0 con 0x7f90b0119020 2024-09-10T05:38:25.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.604+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94618548433232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e18f7de40 con 0x7f90b0119020 2024-09-10T05:38:25.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.604+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e18f80080 con 0x560e18f728e0 2024-09-10T05:38:25.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.604+0000 7f90bd786640 1 -- 172.21.15.62:0/515524841 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94618548430896] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90b00f9070 con 0x560e18f728e0 2024-09-10T05:38:25.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.604+0000 7f90bdf87640 1 -- 172.21.15.62:0/515524841 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94618548433232] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90b80083f0 con 0x7f90b0119020 2024-09-10T05:38:25.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.604+0000 7f90bd786640 1 -- 172.21.15.62:0/515524841 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90b00f9070 con 0x560e18f728e0 2024-09-10T05:38:25.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.604+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94618548434288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e18f7fb90 con 0x560e18f728e0 2024-09-10T05:38:25.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.604+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e18f80920 con 0x560e18f76100 2024-09-10T05:38:25.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.608+0000 7f90bcf85640 1 -- 172.21.15.62:0/515524841 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90b402d040 con 0x560e18f76100 2024-09-10T05:38:25.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.608+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94618548438128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e18f7fb90 con 0x560e18f76100 2024-09-10T05:38:25.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.608+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e18f81790 con 0x560e18f76100 2024-09-10T05:38:25.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.608+0000 7f90bcf85640 1 -- 172.21.15.62:0/515524841 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94618548438128] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90b402d040 con 0x560e18f76100 2024-09-10T05:38:25.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.608+0000 7f90bcf85640 1 -- 172.21.15.62:0/515524841 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90b402d040 con 0x560e18f76100 2024-09-10T05:38:25.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.608+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94618548440256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e18f81790 con 0x560e18f76100 2024-09-10T05:38:25.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.608+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e18f82150 con 0x7f90b0119020 2024-09-10T05:38:25.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.608+0000 7f90bd786640 1 -- 172.21.15.62:0/515524841 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94618548434288] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90b00f9070 con 0x560e18f728e0 2024-09-10T05:38:25.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.608+0000 7f90bcf85640 1 -- 172.21.15.62:0/515524841 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94618548440256] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90b402d040 con 0x560e18f76100 2024-09-10T05:38:25.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.608+0000 7f90bdf87640 1 -- 172.21.15.62:0/515524841 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90b80083f0 con 0x7f90b0119020 2024-09-10T05:38:25.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.608+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94618548444320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e18f81790 con 0x7f90b0119020 2024-09-10T05:38:25.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.608+0000 7f90bfc809c0 20 add_watcher() i=0 2024-09-10T05:38:25.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.608+0000 7f90bfc809c0 20 add_watcher() i=1 2024-09-10T05:38:25.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.608+0000 7f90bfc809c0 20 add_watcher() i=2 2024-09-10T05:38:25.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.608+0000 7f90bfc809c0 20 add_watcher() i=3 2024-09-10T05:38:25.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.608+0000 7f90bfc809c0 20 add_watcher() i=4 2024-09-10T05:38:25.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.608+0000 7f90bfc809c0 20 add_watcher() i=5 2024-09-10T05:38:25.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.608+0000 7f90bfc809c0 20 add_watcher() i=6 2024-09-10T05:38:25.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.608+0000 7f90bdf87640 1 -- 172.21.15.62:0/515524841 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94618548444320] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90b80083f0 con 0x7f90b0119020 2024-09-10T05:38:25.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.608+0000 7f90bfc809c0 20 add_watcher() i=7 2024-09-10T05:38:25.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.608+0000 7f90bfc809c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:38:25.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.608+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e18f81790 con 0x560e18f6e460 2024-09-10T05:38:25.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.612+0000 7f90bdf87640 1 -- 172.21.15.62:0/515524841 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f90b80083f0 con 0x560e18f6e460 2024-09-10T05:38:25.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.612+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94618548441824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e18f82820 con 0x560e18f6e460 2024-09-10T05:38:25.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.612+0000 7f90bdf87640 1 -- 172.21.15.62:0/515524841 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94618548441824] v34'278 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f90b80083f0 con 0x560e18f6e460 2024-09-10T05:38:25.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.612+0000 7f8f737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:38:25.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.612+0000 7f90bfc809c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:38:25.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.612+0000 7f90bfc809c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:38:25.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.612+0000 7f90bfc809c0 5 note: GC not initialized 2024-09-10T05:38:25.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.612+0000 7f8f727e4640 20 reqs_thread_entry: start 2024-09-10T05:38:25.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.612+0000 7f90bfc809c0 20 init_complete bucket index max shards: 11 2024-09-10T05:38:25.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.612+0000 7f90bfc809c0 20 Filter name: none 2024-09-10T05:38:25.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.612+0000 7f8ee3fff640 20 reqs_thread_entry: start 2024-09-10T05:38:25.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.612+0000 7f90bfc809c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-10T05:38:25.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.612+0000 7f90bfc809c0 20 rados->read ofs=0 len=0 2024-09-10T05:38:25.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.612+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e18fa82a0 con 0x560e18f6e460 2024-09-10T05:38:25.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.612+0000 7f90bdf87640 1 -- 172.21.15.62:0/515524841 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f90b80083f0 con 0x560e18f6e460 2024-09-10T05:38:25.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.612+0000 7f90bfc809c0 20 rados_obj.operate() r=0 bl.length=473 2024-09-10T05:38:25.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.612+0000 7f90bfc809c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-10T05:38:25.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.612+0000 7f90bfc809c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:38:25.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.612+0000 7f90bfc809c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:38:25.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.612+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e18faeab0 con 0x560e18f6e460 2024-09-10T05:38:25.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.616+0000 7f90bdf87640 1 -- 172.21.15.62:0/515524841 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v34'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f90b80083f0 con 0x560e18f6e460 2024-09-10T05:38:25.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.616+0000 7f90bfc809c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T05:38:25.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.616+0000 7f90bfc809c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:38:25.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.616+0000 7f90bfc809c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-10T05:38:25.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.616+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94618548626784 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e18faa240 con 0x560e18f728e0 2024-09-10T05:38:25.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.616+0000 7f90bd786640 1 -- 172.21.15.62:0/515524841 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== watch-notify(notify (1) cookie 94618548434288 notify 146028888122 ret 0) ==== 691+0+0 (crc 0 0 0) 0x560e18db3980 con 0x560e18f728e0 2024-09-10T05:38:25.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.616+0000 7f8fa0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888122 cookie 94618548434288 notifier 4920 bl.length()=649 2024-09-10T05:38:25.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.616+0000 7f8fa0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T05:38:25.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.616+0000 7f8fa0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:38:25.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.616+0000 7f8fa0ff9640 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f8f80003eb0 con 0x560e18f728e0 2024-09-10T05:38:25.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.616+0000 7f90bd786640 1 -- 172.21.15.62:0/515524841 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(64 notify.4 [notify cookie 94618548626784 out=8b] v0'0 uv279 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f90b00f9070 con 0x560e18f728e0 2024-09-10T05:38:25.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.616+0000 7f90bd786640 1 -- 172.21.15.62:0/515524841 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== watch-notify(notify_complete (2) cookie 94618548626784 notify 146028888122 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f90b00e2070 con 0x560e18f728e0 2024-09-10T05:38:25.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.616+0000 7f90bd786640 1 -- 172.21.15.62:0/515524841 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90b00f9070 con 0x560e18f728e0 2024-09-10T05:38:25.629 INFO:teuthology.orchestra.run.smithi062.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-10T05:38:22.896781Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:38:22.896764Z","tags":[],"group_ids":[]} 2024-09-10T05:38:25.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.616+0000 7f8f737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:38:25.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.616+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94618548441824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e18fade40 con 0x560e18f6e460 2024-09-10T05:38:25.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.620+0000 7f90bdf87640 1 -- 172.21.15.62:0/515524841 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94618548441824] v34'279 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f90b80083f0 con 0x560e18f6e460 2024-09-10T05:38:25.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.620+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94618548422128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e18fade40 con 0x560e18f728e0 2024-09-10T05:38:25.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.624+0000 7f90bd786640 1 -- 172.21.15.62:0/515524841 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94618548422128] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90b00f9070 con 0x560e18f728e0 2024-09-10T05:38:25.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.624+0000 7f90bfc809c0 20 remove_watcher() i=0 2024-09-10T05:38:25.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.624+0000 7f90bfc809c0 2 removed watcher, disabling cache 2024-09-10T05:38:25.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.624+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94618548426144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e18fade40 con 0x560e18f6e460 2024-09-10T05:38:25.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.624+0000 7f90bdf87640 1 -- 172.21.15.62:0/515524841 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94618548426144] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90b80083f0 con 0x560e18f6e460 2024-09-10T05:38:25.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.624+0000 7f90bfc809c0 20 remove_watcher() i=1 2024-09-10T05:38:25.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.624+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94618548430896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e18fade40 con 0x560e18f728e0 2024-09-10T05:38:25.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.624+0000 7f90bd786640 1 -- 172.21.15.62:0/515524841 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94618548430896] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90b00f9070 con 0x560e18f728e0 2024-09-10T05:38:25.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.628+0000 7f90bfc809c0 20 remove_watcher() i=2 2024-09-10T05:38:25.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.628+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94618548433232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e18fa6080 con 0x7f90b0119020 2024-09-10T05:38:25.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.628+0000 7f90bdf87640 1 -- 172.21.15.62:0/515524841 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94618548433232] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90b80083f0 con 0x7f90b0119020 2024-09-10T05:38:25.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.628+0000 7f90bfc809c0 20 remove_watcher() i=3 2024-09-10T05:38:25.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.628+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94618548434288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e18fa6080 con 0x560e18f728e0 2024-09-10T05:38:25.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.628+0000 7f90bd786640 1 -- 172.21.15.62:0/515524841 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94618548434288] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90b00f9070 con 0x560e18f728e0 2024-09-10T05:38:25.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.628+0000 7f90bfc809c0 20 remove_watcher() i=4 2024-09-10T05:38:25.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.628+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94618548438128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e18fa6080 con 0x560e18f76100 2024-09-10T05:38:25.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.632+0000 7f90bcf85640 1 -- 172.21.15.62:0/515524841 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94618548438128] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90b402d040 con 0x560e18f76100 2024-09-10T05:38:25.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.632+0000 7f90bfc809c0 20 remove_watcher() i=5 2024-09-10T05:38:25.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.632+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94618548440256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e18fa6080 con 0x560e18f76100 2024-09-10T05:38:25.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.632+0000 7f90bcf85640 1 -- 172.21.15.62:0/515524841 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94618548440256] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90b402d040 con 0x560e18f76100 2024-09-10T05:38:25.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.632+0000 7f90bfc809c0 20 remove_watcher() i=6 2024-09-10T05:38:25.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.632+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94618548444320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e18fa6080 con 0x7f90b0119020 2024-09-10T05:38:25.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.632+0000 7f90bdf87640 1 -- 172.21.15.62:0/515524841 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94618548444320] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90b80083f0 con 0x7f90b0119020 2024-09-10T05:38:25.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.632+0000 7f90bfc809c0 20 remove_watcher() i=7 2024-09-10T05:38:25.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.632+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x560e18f728e0 msgr2=0x560e18f74cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.632+0000 7f90bfc809c0 1 --2- 172.21.15.62:0/515524841 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x560e18f728e0 0x560e18f74cd0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.632+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560e18f6e460 msgr2=0x560e18f708f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.632+0000 7f90bfc809c0 1 --2- 172.21.15.62:0/515524841 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560e18f6e460 0x560e18f708f0 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.632+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f90b0119020 msgr2=0x7f90b00cf890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.632+0000 7f90bfc809c0 1 --2- 172.21.15.62:0/515524841 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f90b0119020 0x7f90b00cf890 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.632+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x560e18f76100 msgr2=0x560e18f78510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.632+0000 7f90bfc809c0 1 --2- 172.21.15.62:0/515524841 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x560e18f76100 0x560e18f78510 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.632+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8f88039a70 msgr2=0x7f8f8803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.632+0000 7f90bfc809c0 1 --2- 172.21.15.62:0/515524841 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8f88039a70 0x7f8f8803bf30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x560e18f376c0 tx=0x7f90b4010000 comp rx=0 tx=0).stop 2024-09-10T05:38:25.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.632+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e18f5c140 msgr2=0x560e18f63530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.632+0000 7f90bfc809c0 1 --2- 172.21.15.62:0/515524841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e18f5c140 0x560e18f63530 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f90b00ecf80 tx=0x7f90b00ecf10 comp rx=0 tx=0).stop 2024-09-10T05:38:25.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.632+0000 7f90bdf87640 1 -- 172.21.15.62:0/515524841 reap_dead start 2024-09-10T05:38:25.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.632+0000 7f90bdf87640 1 -- 172.21.15.62:0/515524841 reap_dead start 2024-09-10T05:38:25.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.632+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 shutdown_connections 2024-09-10T05:38:25.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.632+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 >> 172.21.15.62:0/515524841 conn(0x560e18f58570 msgr2=0x560e18f56780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:25.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.632+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 shutdown_connections 2024-09-10T05:38:25.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.632+0000 7f90bfc809c0 1 -- 172.21.15.62:0/515524841 wait complete. 2024-09-10T05:38:25.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.632+0000 7f90bfc809c0 1 -- 172.21.15.62:0/3565670118 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8f94039a70 msgr2=0x7f8f9403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.632+0000 7f90bfc809c0 1 --2- 172.21.15.62:0/3565670118 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8f94039a70 0x7f8f9403bf30 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f90b40063a0 tx=0x7f90b400f000 comp rx=0 tx=0).stop 2024-09-10T05:38:25.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.632+0000 7f90bfc809c0 1 -- 172.21.15.62:0/3565670118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e18db3460 msgr2=0x560e18db1d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.632+0000 7f90bfc809c0 1 --2- 172.21.15.62:0/3565670118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e18db3460 0x560e18db1d00 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f90b00ea1d0 tx=0x7f90b00c5de0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.632+0000 7f90bfc809c0 1 -- 172.21.15.62:0/3565670118 shutdown_connections 2024-09-10T05:38:25.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.632+0000 7f90bfc809c0 1 --2- 172.21.15.62:0/3565670118 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8f94039a70 0x7f8f9403bf30 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.632+0000 7f90bfc809c0 1 --2- 172.21.15.62:0/3565670118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e18db3460 0x560e18db1d00 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.632+0000 7f90bfc809c0 1 -- 172.21.15.62:0/3565670118 >> 172.21.15.62:0/3565670118 conn(0x560e18f432f0 msgr2=0x560e18f436d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:25.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.632+0000 7f90bfc809c0 1 -- 172.21.15.62:0/3565670118 shutdown_connections 2024-09-10T05:38:25.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.632+0000 7f90bfc809c0 1 -- 172.21.15.62:0/3565670118 wait complete. 2024-09-10T05:38:25.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.636+0000 7f90bfc809c0 1 -- 172.21.15.62:0/959562367 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x560e18f37e20 msgr2=0x560e18f3a2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.636+0000 7f90bfc809c0 1 --2- 172.21.15.62:0/959562367 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x560e18f37e20 0x560e18f3a2e0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.636+0000 7f90bfc809c0 1 -- 172.21.15.62:0/959562367 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560e18e400b0 msgr2=0x560e18f36de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.636+0000 7f90bfc809c0 1 --2- 172.21.15.62:0/959562367 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x560e18e400b0 0x560e18f36de0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.636+0000 7f90bfc809c0 1 -- 172.21.15.62:0/959562367 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x560e18f3c810 msgr2=0x560e18f3ec00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.636+0000 7f90bfc809c0 1 --2- 172.21.15.62:0/959562367 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x560e18f3c810 0x560e18f3ec00 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.636+0000 7f90bfc809c0 1 -- 172.21.15.62:0/959562367 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8fa4039a70 msgr2=0x7f8fa403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.636+0000 7f90bfc809c0 1 --2- 172.21.15.62:0/959562367 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f8fa4039a70 0x7f8fa403bf30 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f90b40016b0 tx=0x7f90b40066c0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.636+0000 7f90bfc809c0 1 -- 172.21.15.62:0/959562367 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e18e3cf70 msgr2=0x560e18f2fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:38:25.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.636+0000 7f90bfc809c0 1 --2- 172.21.15.62:0/959562367 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e18e3cf70 0x560e18f2fc70 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f90b001b170 tx=0x7f90b00180e0 comp rx=0 tx=0).stop 2024-09-10T05:38:25.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.636+0000 7f90bdf87640 1 -- 172.21.15.62:0/959562367 reap_dead start 2024-09-10T05:38:25.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.636+0000 7f90bfc809c0 1 -- 172.21.15.62:0/959562367 shutdown_connections 2024-09-10T05:38:25.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.636+0000 7f90bfc809c0 1 -- 172.21.15.62:0/959562367 >> 172.21.15.62:0/959562367 conn(0x560e18e38a90 msgr2=0x560e18f22dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:38:25.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.636+0000 7f90bfc809c0 1 -- 172.21.15.62:0/959562367 shutdown_connections 2024-09-10T05:38:25.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:38:25.636+0000 7f90bfc809c0 1 -- 172.21.15.62:0/959562367 wait complete. 2024-09-10T05:38:25.648 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T05:38:22.896781Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:38:22.896764Z', 'tags': [], 'group_ids': []} 2024-09-10T05:38:25.648 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T05:38:22.896781Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:38:22.896764Z', 'tags': [], 'group_ids': []} 2024-09-10T05:38:25.648 ERROR:root:0 2024-09-10T05:38:25.648 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-10T05:38:25.656 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T05:38:25.656 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T05:38:25.660 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T05:38:25.660 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-10T05:38:25.667 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T05:38:25.667 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T05:38:25.671 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T05:38:25.672 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'create'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'} 2024-09-10T05:38:25.681 INFO:tasks.radosgw_admin_rest: json result: [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}] 2024-09-10T05:38:25.682 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T05:38:25.685 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T05:38:25.685 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ'} 2024-09-10T05:38:25.695 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T05:38:25.695 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T05:38:25.698 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T05:38:25.699 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo1', 'secret-key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'key-type': 'swift'} 2024-09-10T05:38:25.707 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}] 2024-09-10T05:38:25.708 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T05:38:25.711 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T05:38:25.712 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo2', 'secret-key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'key-type': 'swift'} 2024-09-10T05:38:25.721 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}] 2024-09-10T05:38:25.721 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T05:38:25.725 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T05:38:25.725 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'subuser': 'foo:foo1', 'key-type': 'swift'} 2024-09-10T05:38:25.733 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T05:38:25.734 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T05:38:25.737 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T05:38:25.737 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo1'} 2024-09-10T05:38:25.743 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T05:38:25.743 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T05:38:25.748 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T05:38:25.748 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo2', 'key-type': 'swift', '{purge-keys': True} 2024-09-10T05:38:25.757 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T05:38:25.758 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T05:38:25.761 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T05:38:25.761 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-10T05:38:25.765 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-10T05:38:25.766 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-10T05:38:25.770 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-10T05:38:25.787 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-10T05:38:25.791 INFO:tasks.radosgw_admin_rest: json result: ['myfoo'] 2024-09-10T05:38:25.791 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-10T05:38:25.797 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '1e560b55-359a-4aa1-8333-6dabf7061701', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.11', 'marker': '475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-10T05:38:25.780473Z', 'creation_time': '2024-09-10T05:38:25.775101Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-10T05:38:25.798 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-10T05:38:25.867 INFO:tasks.radosgw_admin_rest: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '1e560b55-359a-4aa1-8333-6dabf7061701', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.11', 'marker': '475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-10T05:38:25.780473Z', 'creation_time': '2024-09-10T05:38:25.775101Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1}] 2024-09-10T05:38:25.876 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-10T05:38:25.883 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '1e560b55-359a-4aa1-8333-6dabf7061701', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.11', 'marker': '475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-10T05:38:25.780473Z', 'creation_time': '2024-09-10T05:38:25.775101Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-10T05:38:25.883 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'doesnotexist'} 2024-09-10T05:38:25.888 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchBucket', 'Message': '', 'RequestId': 'tx000000b0de11ecc35fb4d-0066dfdb51-4227-default', 'HostId': '4227-default-default'} 2024-09-10T05:38:25.897 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'unlink'] {'uid': 'foo', 'bucket': 'myfoo'} 2024-09-10T05:38:25.908 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T05:38:25.909 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'fud', 'display-name': 'Fud', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'max-buckets': '1'} 2024-09-10T05:38:25.924 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'fud', 'tenant': '', 'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T05:38:25.942 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'fud', 'bucket': 'myfoo', 'bucket-id': '475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.11'} 2024-09-10T05:38:25.963 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T05:38:26.009 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'foo', 'bucket': 'myfoo', 'bucket-id': '475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.11'} 2024-09-10T05:38:26.031 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T05:38:26.031 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'fud'} 2024-09-10T05:38:26.049 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T05:38:26.061 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['object', 'rm'] {'bucket': 'myfoo', 'object': 'four'} 2024-09-10T05:38:26.074 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T05:38:26.074 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-10T05:38:26.082 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '1e560b55-359a-4aa1-8333-6dabf7061701', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.11', 'marker': '475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-10T05:38:26.017641Z', 'creation_time': '2024-09-10T05:38:25.775101Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 3} 2024-09-10T05:39:26.204 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'categories': 'delete_obj'} 2024-09-10T05:39:26.239 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'anonymous', 'categories': [], 's3select': {}}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'bar', 'categories': [], 's3select': {}}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'bud', 'categories': [], 's3select': {}}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'fud', 'categories': [], 's3select': {}}, {'bucket': 'myfoo7', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'fud', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bar', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'fud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T05:39:26.240 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] None 2024-09-10T05:39:26.271 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'useless-bucket', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'fud', 'categories': [{'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 0, 'ops': 1, 'successful_ops': 0}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo7', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 8, 'ops': 2, 'successful_ops': 2, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 16, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 8, 'ops': 2, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 242, 'bytes_received': 8, 'ops': 5, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T05:39:26.271 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-10T05:39:26.277 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'useless-bucket', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T05:39:26.277 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'create_bucket'} 2024-09-10T05:39:26.282 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T05:39:26.282 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'put_obj'} 2024-09-10T05:39:26.287 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T05:39:26.288 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_obj'} 2024-09-10T05:39:26.293 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T05:39:26.293 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_bucket'} 2024-09-10T05:39:26.298 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T05:39:26.299 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'trim'] {'uid': 'foo'} 2024-09-10T05:39:26.308 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T05:39:26.308 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-10T05:39:26.313 INFO:tasks.radosgw_admin_rest: json result: {'entries': [], 'summary': []} 2024-09-10T05:39:26.313 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-10T05:39:26.330 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T05:39:26.335 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-10T05:39:26.352 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T05:39:26.738 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-10T05:39:26.744 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx000008b136696a11d0533-0066dfdb8e-4227-default', 'HostId': '4227-default-default'} 2024-09-10T05:39:26.971 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-10T05:39:26.978 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [], 'grant_map': [{'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-10T05:39:26.988 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-10T05:39:26.994 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [{'group': 1, 'acl': 1}], 'grant_map': [{'id': '', 'grant': {'type': {'type': 2}, 'group': 1, 'permission': {'flags': 1}}}, {'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-10T05:39:27.141 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'rm'] {'bucket': 'myfoo', 'purge-objects': True} 2024-09-10T05:39:27.232 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T05:39:27.232 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'add'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-10T05:39:27.243 INFO:tasks.radosgw_admin_rest: json result: [{'type': 'usage', 'perm': 'read'}] 2024-09-10T05:39:27.243 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'rm'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-10T05:39:27.253 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-10T05:39:27.281 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-10T05:39:27.286 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx0000043fd05ad210c7757-0066dfdb8f-4227-default', 'HostId': '4227-default-default'} 2024-09-10T05:39:27.333 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo', 'purge-data': True} 2024-09-10T05:39:27.410 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T05:39:27.410 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T05:39:27.415 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx00000f17b17524a87bf2e-0066dfdb8f-4227-default', 'HostId': '4227-default-default'} 2024-09-10T05:39:27.416 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['info', ''] None 2024-09-10T05:39:27.420 INFO:tasks.radosgw_admin_rest: json result: {'info': {'storage_backends': [{'name': 'rados', 'cluster_id': '004d9798-7539-4e93-b06c-e32e30a3c3b6'}]}} 2024-09-10T05:39:27.420 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'ratelimit_user', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '1000'} 2024-09-10T05:39:27.441 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'ratelimit_user', 'tenant': '', 'user_id': 'ratelimit_user', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'ratelimit_user', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T05:39:27.441 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-10T05:39:27.446 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-10T05:39:27.446 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring'} 2024-09-10T05:39:27.451 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx0000037c7b966d39c0949-0066dfdb8f-4227-default', 'HostId': '4227-default-default'} 2024-09-10T05:39:27.451 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user'} 2024-09-10T05:39:27.456 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000008053e83b0819a13a-0066dfdb8f-4227-default', 'HostId': '4227-default-default'} 2024-09-10T05:39:27.482 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-10T05:39:27.486 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-10T05:39:27.486 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring'} 2024-09-10T05:39:27.491 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx000007760ee549bfbe49e-0066dfdb8f-4227-default', 'HostId': '4227-default-default'} 2024-09-10T05:39:27.492 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket'} 2024-09-10T05:39:27.496 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000004b57df1c3e9325f8-0066dfdb8f-4227-default', 'HostId': '4227-default-default'} 2024-09-10T05:39:27.496 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'global': 'true'} 2024-09-10T05:39:27.501 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'anonymous_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-10T05:39:27.501 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring', 'enabled': 'true'} 2024-09-10T05:39:27.505 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx0000020cbc8c342a4764d-0066dfdb8f-4227-default', 'HostId': '4227-default-default'} 2024-09-10T05:39:27.506 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user'} 2024-09-10T05:39:27.510 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx0000041ec453d75bb84d8-0066dfdb8f-4227-default', 'HostId': '4227-default-default'} 2024-09-10T05:39:27.510 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring', 'enabled': 'true'} 2024-09-10T05:39:27.514 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000779c12c670bac3cf-0066dfdb8f-4227-default', 'HostId': '4227-default-default'} 2024-09-10T05:39:27.514 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'enabled': 'true'} 2024-09-10T05:39:27.518 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000d7da9785c0bccca2-0066dfdb8f-4227-default', 'HostId': '4227-default-default'} 2024-09-10T05:39:27.518 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user', 'enabled': 'true', 'max-read-bytes': '2'} 2024-09-10T05:39:27.537 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T05:39:27.537 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-10T05:39:27.541 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 2, 'max_write_bytes': 0, 'enabled': True}} 2024-09-10T05:39:27.542 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket', 'enabled': 'true', 'max-write-bytes': '2'} 2024-09-10T05:39:27.552 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T05:39:27.552 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-10T05:39:27.556 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 2, 'enabled': True}} 2024-09-10T05:39:27.556 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'global': 'true', 'enabled': 'true'} 2024-09-10T05:39:27.566 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T05:39:27.570 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-10T05:39:27.580 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-10T05:39:27.580 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T05:39:27.581 INFO:tasks.rgw.client.0.smithi062.stdout:2024-09-10T05:39:27.575+0000 7fbd6aec3640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 28849) UID: 0 2024-09-10T05:39:27.581 INFO:tasks.rgw.client.0.smithi062.stdout:2024-09-10T05:39:27.575+0000 7fbd6e70ba40 -1 shutting down 2024-09-10T05:39:58.088 INFO:tasks.rgw.client.0:Stopped 2024-09-10T05:39:58.089 DEBUG:teuthology.orchestra.run.smithi062:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-10T05:39:58.096 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f /etc/ceph/vault-root-token 2024-09-10T05:39:58.151 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-10T05:39:58.207 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-10T05:39:58.207 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-10T05:39:58.208 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-10T05:39:58.286 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:39:58.286 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:39:58.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.283+0000 7f248d0d79c0 1 Processor -- start 2024-09-10T05:39:58.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.283+0000 7f248d0d79c0 1 -- start start 2024-09-10T05:39:58.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.283+0000 7f248d0d79c0 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55a433ac3200 0x55a433b51c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:39:58.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.283+0000 7f248d0d79c0 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a433a039c0 con 0x55a433b52170 2024-09-10T05:39:58.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.283+0000 7f248d0d79c0 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x55a433a536d0 con 0x55a433ac3200 2024-09-10T05:39:58.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.283+0000 7f248abdd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55a433ac3200 0x55a433b51c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:39:58.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.283+0000 7f248abdd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55a433ac3200 0x55a433b51c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:53662/0 (socket says 172.21.15.62:53662) 2024-09-10T05:39:58.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.283+0000 7f248abdd640 1 -- 172.21.15.62:0/3290658822 learned_addr learned my addr 172.21.15.62:0/3290658822 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:39:58.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.283+0000 7f248abdd640 1 -- 172.21.15.62:0/3290658822 >> v1:172.21.15.2:6789/0 conn(0x55a433b52170 legacy=0x55a433b54560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:39:58.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.283+0000 7f248abdd640 1 -- 172.21.15.62:0/3290658822 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4339f7ca0 con 0x55a433ac3200 2024-09-10T05:39:58.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.287+0000 7f248abdd640 1 --2- 172.21.15.62:0/3290658822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a433ac3200 0x55a433b51c30 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f247c00a4e0 tx=0x7f247c01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3731800148d080d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:39:58.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.287+0000 7f2489bdb640 1 -- 172.21.15.62:0/3290658822 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f247c0aa540 con 0x55a433ac3200 2024-09-10T05:39:58.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.287+0000 7f2489bdb640 1 -- 172.21.15.62:0/3290658822 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f247c0aa6e0 con 0x55a433ac3200 2024-09-10T05:39:58.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.287+0000 7f2489bdb640 1 -- 172.21.15.62:0/3290658822 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f247c0aaa40 con 0x55a433ac3200 2024-09-10T05:39:58.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.287+0000 7f248d0d79c0 1 -- 172.21.15.62:0/3290658822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a433ac3200 msgr2=0x55a433b51c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:39:58.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.287+0000 7f248d0d79c0 1 --2- 172.21.15.62:0/3290658822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a433ac3200 0x55a433b51c30 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f247c00a4e0 tx=0x7f247c01b090 comp rx=0 tx=0).stop 2024-09-10T05:39:58.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.287+0000 7f248d0d79c0 1 -- 172.21.15.62:0/3290658822 shutdown_connections 2024-09-10T05:39:58.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.287+0000 7f248d0d79c0 1 --2- 172.21.15.62:0/3290658822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a433ac3200 0x55a433b51c30 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:39:58.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.287+0000 7f248d0d79c0 1 -- 172.21.15.62:0/3290658822 >> 172.21.15.62:0/3290658822 conn(0x55a433b49920 msgr2=0x55a433b4bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:39:58.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.287+0000 7f248d0d79c0 1 -- 172.21.15.62:0/3290658822 shutdown_connections 2024-09-10T05:39:58.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.287+0000 7f248d0d79c0 1 -- 172.21.15.62:0/3290658822 wait complete. 2024-09-10T05:39:58.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.303+0000 7f248d0d79c0 1 Processor -- start 2024-09-10T05:39:58.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.303+0000 7f248d0d79c0 1 -- start start 2024-09-10T05:39:58.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.303+0000 7f248d0d79c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a433ac3200 0x55a433b4f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:39:58.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.303+0000 7f248d0d79c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a433a57680 con 0x55a433ac3200 2024-09-10T05:39:58.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.303+0000 7f248abdd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a433ac3200 0x55a433b4f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:39:58.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.303+0000 7f248abdd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a433ac3200 0x55a433b4f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:53666/0 (socket says 172.21.15.62:53666) 2024-09-10T05:39:58.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.303+0000 7f248abdd640 1 -- 172.21.15.62:0/4075079068 learned_addr learned my addr 172.21.15.62:0/4075079068 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:39:58.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.307+0000 7f248abdd640 1 -- 172.21.15.62:0/4075079068 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4339d2da0 con 0x55a433ac3200 2024-09-10T05:39:58.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.307+0000 7f248abdd640 1 --2- 172.21.15.62:0/4075079068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a433ac3200 0x55a433b4f190 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f247c017ca0 tx=0x7f247c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7d2eb9651898ae0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:39:58.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.307+0000 7f2378e09640 1 -- 172.21.15.62:0/4075079068 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f247c0b9030 con 0x55a433ac3200 2024-09-10T05:39:58.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.307+0000 7f2378e09640 1 -- 172.21.15.62:0/4075079068 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f247c0aaa80 con 0x55a433ac3200 2024-09-10T05:39:58.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.307+0000 7f2378e09640 1 -- 172.21.15.62:0/4075079068 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f247c0aada0 con 0x55a433ac3200 2024-09-10T05:39:58.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.307+0000 7f248d0d79c0 1 -- 172.21.15.62:0/4075079068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a433ac3200 msgr2=0x55a433b4f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:39:58.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.307+0000 7f248d0d79c0 1 --2- 172.21.15.62:0/4075079068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a433ac3200 0x55a433b4f190 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f247c017ca0 tx=0x7f247c0033b0 comp rx=0 tx=0).stop 2024-09-10T05:39:58.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.307+0000 7f248d0d79c0 1 -- 172.21.15.62:0/4075079068 shutdown_connections 2024-09-10T05:39:58.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.307+0000 7f248d0d79c0 1 --2- 172.21.15.62:0/4075079068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a433ac3200 0x55a433b4f190 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:39:58.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.307+0000 7f248d0d79c0 1 -- 172.21.15.62:0/4075079068 >> 172.21.15.62:0/4075079068 conn(0x55a433b49920 msgr2=0x55a433c363f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:39:58.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.307+0000 7f248d0d79c0 1 -- 172.21.15.62:0/4075079068 shutdown_connections 2024-09-10T05:39:58.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.307+0000 7f248d0d79c0 1 -- 172.21.15.62:0/4075079068 wait complete. 2024-09-10T05:39:58.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.307+0000 7f248d0d79c0 1 Processor -- start 2024-09-10T05:39:58.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.307+0000 7f248d0d79c0 1 -- start start 2024-09-10T05:39:58.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.307+0000 7f248d0d79c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a433ac3200 0x55a433c43f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:39:58.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.307+0000 7f248d0d79c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a4339f9a50 con 0x55a433ac3200 2024-09-10T05:39:58.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.307+0000 7f248abdd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a433ac3200 0x55a433c43f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:39:58.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.307+0000 7f248abdd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a433ac3200 0x55a433c43f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:53674/0 (socket says 172.21.15.62:53674) 2024-09-10T05:39:58.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.307+0000 7f248abdd640 1 -- 172.21.15.62:0/3079658343 learned_addr learned my addr 172.21.15.62:0/3079658343 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:39:58.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.307+0000 7f248abdd640 1 -- 172.21.15.62:0/3079658343 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a433c44470 con 0x55a433ac3200 2024-09-10T05:39:58.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.307+0000 7f248abdd640 1 --2- 172.21.15.62:0/3079658343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a433ac3200 0x55a433c43f10 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f247c01b930 tx=0x7f247c017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:39:58.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.307+0000 7f2377606640 1 -- 172.21.15.62:0/3079658343 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f247c0b9070 con 0x55a433ac3200 2024-09-10T05:39:58.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.307+0000 7f248d0d79c0 1 -- 172.21.15.62:0/3079658343 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a433c44700 con 0x55a433ac3200 2024-09-10T05:39:58.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.307+0000 7f2377606640 1 -- 172.21.15.62:0/3079658343 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f247c0c3030 con 0x55a433ac3200 2024-09-10T05:39:58.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.311+0000 7f2377606640 1 -- 172.21.15.62:0/3079658343 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f247c0b5c40 con 0x55a433ac3200 2024-09-10T05:39:58.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.311+0000 7f248d0d79c0 1 -- 172.21.15.62:0/3079658343 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a433c450b0 con 0x55a433ac3200 2024-09-10T05:39:58.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.311+0000 7f2377606640 1 -- 172.21.15.62:0/3079658343 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f247c0b3040 con 0x55a433ac3200 2024-09-10T05:39:58.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.311+0000 7f2377606640 1 --2- 172.21.15.62:0/3079658343 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2370039a70 0x7f237003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:39:58.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.311+0000 7f2377606640 1 -- 172.21.15.62:0/3079658343 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7f247c0ba070 con 0x55a433ac3200 2024-09-10T05:39:58.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.311+0000 7f248a3dc640 1 --2- 172.21.15.62:0/3079658343 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2370039a70 0x7f237003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:39:58.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.311+0000 7f248d0d79c0 1 --2- 172.21.15.62:0/3079658343 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55a433b52170 0x55a433c4b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:39:58.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.311+0000 7f248d0d79c0 1 -- 172.21.15.62:0/3079658343 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c4b5c0 con 0x55a433b52170 2024-09-10T05:39:58.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.311+0000 7f248b3de640 1 --2- 172.21.15.62:0/3079658343 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55a433b52170 0x55a433c4b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:39:58.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.311+0000 7f248a3dc640 1 --2- 172.21.15.62:0/3079658343 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2370039a70 0x7f237003bf30 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2480001e60 tx=0x7f24800013e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:39:58.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.311+0000 7f248b3de640 1 --2- 172.21.15.62:0/3079658343 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55a433b52170 0x55a433c4b080 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:39:58.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.311+0000 7f248b3de640 1 -- 172.21.15.62:0/3079658343 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24840083f0 con 0x55a433b52170 2024-09-10T05:39:58.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.311+0000 7f248d0d79c0 1 --2- 172.21.15.62:0/3079658343 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55a433c4c320 0x55a433c4e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:39:58.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.311+0000 7f248d0d79c0 1 -- 172.21.15.62:0/3079658343 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c4ed20 con 0x55a433c4c320 2024-09-10T05:39:58.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.311+0000 7f248abdd640 1 --2- 172.21.15.62:0/3079658343 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55a433c4c320 0x55a433c4e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:39:58.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.311+0000 7f248abdd640 1 --2- 172.21.15.62:0/3079658343 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55a433c4c320 0x55a433c4e710 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:39:58.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.315+0000 7f248abdd640 1 -- 172.21.15.62:0/3079658343 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f247c0cf070 con 0x55a433c4c320 2024-09-10T05:39:58.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.315+0000 7f248d0d79c0 1 --2- 172.21.15.62:0/3079658343 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55a433c50ae0 0x55a433c52ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:39:58.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.315+0000 7f248d0d79c0 1 -- 172.21.15.62:0/3079658343 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:3 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c535c0 con 0x55a433c50ae0 2024-09-10T05:39:58.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.315+0000 7f248a3dc640 1 --2- 172.21.15.62:0/3079658343 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55a433c50ae0 0x55a433c52ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:39:58.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.315+0000 7f248a3dc640 1 --2- 172.21.15.62:0/3079658343 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55a433c50ae0 0x55a433c52ed0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:39:58.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.315+0000 7f248a3dc640 1 -- 172.21.15.62:0/3079658343 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(3 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [call out=48b,read 0~993 out=993b] v0'0 uv5 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f248000d040 con 0x55a433c50ae0 2024-09-10T05:39:58.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.315+0000 7f248d0d79c0 1 -- 172.21.15.62:0/3079658343 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c4f980 con 0x55a433c4c320 2024-09-10T05:39:58.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.315+0000 7f248abdd640 1 -- 172.21.15.62:0/3079658343 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f247c0cf070 con 0x55a433c4c320 2024-09-10T05:39:58.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.315+0000 7f248d0d79c0 1 -- 172.21.15.62:0/3079658343 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c4fde0 con 0x55a433c50ae0 2024-09-10T05:39:58.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.315+0000 7f248a3dc640 1 -- 172.21.15.62:0/3079658343 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(5 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f248000d040 con 0x55a433c50ae0 2024-09-10T05:39:58.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.315+0000 7f248d0d79c0 1 Processor -- start 2024-09-10T05:39:58.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.315+0000 7f248d0d79c0 1 -- start start 2024-09-10T05:39:58.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.315+0000 7f248d0d79c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a433c61c50 0x55a433c62070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:39:58.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.315+0000 7f248d0d79c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a433a64450 con 0x55a433c61c50 2024-09-10T05:39:58.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.319+0000 7f248abdd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a433c61c50 0x55a433c62070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:39:58.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.319+0000 7f248abdd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a433c61c50 0x55a433c62070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:53688/0 (socket says 172.21.15.62:53688) 2024-09-10T05:39:58.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.319+0000 7f248abdd640 1 -- 172.21.15.62:0/4241595804 learned_addr learned my addr 172.21.15.62:0/4241595804 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:39:58.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.319+0000 7f248abdd640 1 -- 172.21.15.62:0/4241595804 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a433c626b0 con 0x55a433c61c50 2024-09-10T05:39:58.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.319+0000 7f248abdd640 1 --2- 172.21.15.62:0/4241595804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a433c61c50 0x55a433c62070 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f247c0bee20 tx=0x7f247c0bddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:39:58.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.319+0000 7f2374e01640 1 -- 172.21.15.62:0/4241595804 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f247c0b4560 con 0x55a433c61c50 2024-09-10T05:39:58.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.319+0000 7f2374e01640 1 -- 172.21.15.62:0/4241595804 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f247c0b4700 con 0x55a433c61c50 2024-09-10T05:39:58.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.319+0000 7f2374e01640 1 -- 172.21.15.62:0/4241595804 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f247c0e83a0 con 0x55a433c61c50 2024-09-10T05:39:58.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.319+0000 7f248d0d79c0 1 -- 172.21.15.62:0/4241595804 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a433c62f10 con 0x55a433c61c50 2024-09-10T05:39:58.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.319+0000 7f248d0d79c0 1 -- 172.21.15.62:0/4241595804 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a433c63480 con 0x55a433c61c50 2024-09-10T05:39:58.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.319+0000 7f2374e01640 1 -- 172.21.15.62:0/4241595804 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f247c0e8540 con 0x55a433c61c50 2024-09-10T05:39:58.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.319+0000 7f2374e01640 1 --2- 172.21.15.62:0/4241595804 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2364039a70 0x7f236403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:39:58.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.319+0000 7f2374e01640 1 -- 172.21.15.62:0/4241595804 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7f247c0db040 con 0x55a433c61c50 2024-09-10T05:39:58.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.319+0000 7f248a3dc640 1 --2- 172.21.15.62:0/4241595804 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2364039a70 0x7f236403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:39:58.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.323+0000 7f248d0d79c0 1 Processor -- start 2024-09-10T05:39:58.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.323+0000 7f248d0d79c0 1 -- start start 2024-09-10T05:39:58.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.323+0000 7f248a3dc640 1 --2- 172.21.15.62:0/4241595804 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2364039a70 0x7f236403bf30 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x55a433c45420 tx=0x7f2480006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:39:58.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.323+0000 7f248d0d79c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a433c6e340 0x55a433c6e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:39:58.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.323+0000 7f248d0d79c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a433b4f920 con 0x55a433c6e340 2024-09-10T05:39:58.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.323+0000 7f248abdd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a433c6e340 0x55a433c6e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:39:58.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.323+0000 7f248abdd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a433c6e340 0x55a433c6e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:53702/0 (socket says 172.21.15.62:53702) 2024-09-10T05:39:58.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.323+0000 7f248abdd640 1 -- 172.21.15.62:0/2223197789 learned_addr learned my addr 172.21.15.62:0/2223197789 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:39:58.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.323+0000 7f248abdd640 1 -- 172.21.15.62:0/2223197789 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a433c6ecf0 con 0x55a433c6e340 2024-09-10T05:39:58.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.323+0000 7f248abdd640 1 --2- 172.21.15.62:0/2223197789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a433c6e340 0x55a433c6e720 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f247c0e3220 tx=0x7f247c0e8830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=518f75c67cbdf923 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:39:58.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.323+0000 7f236e7fc640 1 -- 172.21.15.62:0/2223197789 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f247c0fa070 con 0x55a433c6e340 2024-09-10T05:39:58.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.323+0000 7f236e7fc640 1 -- 172.21.15.62:0/2223197789 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f247c0d08d0 con 0x55a433c6e340 2024-09-10T05:39:58.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.323+0000 7f236e7fc640 1 -- 172.21.15.62:0/2223197789 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f247c0d0350 con 0x55a433c6e340 2024-09-10T05:39:58.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.323+0000 7f248d0d79c0 1 -- 172.21.15.62:0/2223197789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a433c6e340 msgr2=0x55a433c6e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:39:58.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.323+0000 7f248d0d79c0 1 --2- 172.21.15.62:0/2223197789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a433c6e340 0x55a433c6e720 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f247c0e3220 tx=0x7f247c0e8830 comp rx=0 tx=0).stop 2024-09-10T05:39:58.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.323+0000 7f248d0d79c0 1 -- 172.21.15.62:0/2223197789 shutdown_connections 2024-09-10T05:39:58.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.323+0000 7f248d0d79c0 1 --2- 172.21.15.62:0/2223197789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a433c6e340 0x55a433c6e720 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:39:58.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.323+0000 7f248d0d79c0 1 -- 172.21.15.62:0/2223197789 >> 172.21.15.62:0/2223197789 conn(0x55a433c6a770 msgr2=0x55a433c689b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:39:58.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.323+0000 7f248d0d79c0 1 -- 172.21.15.62:0/2223197789 shutdown_connections 2024-09-10T05:39:58.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.323+0000 7f248d0d79c0 1 -- 172.21.15.62:0/2223197789 wait complete. 2024-09-10T05:39:58.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.323+0000 7f248d0d79c0 1 Processor -- start 2024-09-10T05:39:58.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.323+0000 7f248d0d79c0 1 -- start start 2024-09-10T05:39:58.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.323+0000 7f248d0d79c0 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a433c6e340 0x55a433c756d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:39:58.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.323+0000 7f248d0d79c0 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a433c6f1d0 con 0x55a433c6e340 2024-09-10T05:39:58.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.323+0000 7f248abdd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a433c6e340 0x55a433c756d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:39:58.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.323+0000 7f248abdd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a433c6e340 0x55a433c756d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.62:53718/0 (socket says 172.21.15.62:53718) 2024-09-10T05:39:58.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.323+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 learned_addr learned my addr 172.21.15.62:0/749411572 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-10T05:39:58.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.327+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a433c75c30 con 0x55a433c6e340 2024-09-10T05:39:58.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.327+0000 7f248abdd640 1 --2- 172.21.15.62:0/749411572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a433c6e340 0x55a433c756d0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f247c0b0fd0 tx=0x7f247c0efea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:39:58.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.327+0000 7f236cff9640 1 -- 172.21.15.62:0/749411572 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f247c10f070 con 0x55a433c6e340 2024-09-10T05:39:58.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.327+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a433c75c30 con 0x55a433c6e340 2024-09-10T05:39:58.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.327+0000 7f236cff9640 1 -- 172.21.15.62:0/749411572 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f247c0d08d0 con 0x55a433c6e340 2024-09-10T05:39:58.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.327+0000 7f236cff9640 1 -- 172.21.15.62:0/749411572 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f247c0c8470 con 0x55a433c6e340 2024-09-10T05:39:58.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.327+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a433c75c30 con 0x55a433c6e340 2024-09-10T05:39:58.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.327+0000 7f236cff9640 1 -- 172.21.15.62:0/749411572 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f247c112070 con 0x55a433c6e340 2024-09-10T05:39:58.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.327+0000 7f236cff9640 1 --2- 172.21.15.62:0/749411572 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f23540399d0 0x7f235403be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:39:58.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.327+0000 7f236cff9640 1 -- 172.21.15.62:0/749411572 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7f247c115c30 con 0x55a433c6e340 2024-09-10T05:39:58.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.327+0000 7f248a3dc640 1 --2- 172.21.15.62:0/749411572 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f23540399d0 0x7f235403be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:39:58.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.327+0000 7f248d0d79c0 20 rados->read ofs=0 len=0 2024-09-10T05:39:58.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.327+0000 7f248d0d79c0 1 --2- 172.21.15.62:0/749411572 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55a433c80510 0x55a433c829d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:39:58.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.327+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c83120 con 0x55a433c80510 2024-09-10T05:39:58.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.327+0000 7f248b3de640 1 --2- 172.21.15.62:0/749411572 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55a433c80510 0x55a433c829d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:39:58.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.327+0000 7f248a3dc640 1 --2- 172.21.15.62:0/749411572 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f23540399d0 0x7f235403be90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x55a433c4f950 tx=0x7f2480011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:39:58.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.327+0000 7f248b3de640 1 --2- 172.21.15.62:0/749411572 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55a433c80510 0x55a433c829d0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:39:58.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.327+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.327+0000 7f248d0d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:39:58.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.327+0000 7f248d0d79c0 20 realm 2024-09-10T05:39:58.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.327+0000 7f248d0d79c0 20 rados->read ofs=0 len=0 2024-09-10T05:39:58.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.327+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c7f840 con 0x55a433c80510 2024-09-10T05:39:58.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.327+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.327+0000 7f248d0d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:39:58.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.327+0000 7f248d0d79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:39:58.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.327+0000 7f248d0d79c0 20 rados->read ofs=0 len=0 2024-09-10T05:39:58.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.327+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c83bf0 con 0x55a433c80510 2024-09-10T05:39:58.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.331+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.331+0000 7f248d0d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:39:58.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.331+0000 7f248d0d79c0 20 rados->read ofs=0 len=0 2024-09-10T05:39:58.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.331+0000 7f248d0d79c0 1 --2- 172.21.15.62:0/749411572 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55a433c849d0 0x55a433c86dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:39:58.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.331+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c87470 con 0x55a433c849d0 2024-09-10T05:39:58.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.331+0000 7f248abdd640 1 --2- 172.21.15.62:0/749411572 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55a433c849d0 0x55a433c86dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:39:58.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.331+0000 7f248abdd640 1 --2- 172.21.15.62:0/749411572 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55a433c849d0 0x55a433c86dc0 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:39:58.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.331+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.331+0000 7f248d0d79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:39:58.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.331+0000 7f248d0d79c0 20 rados->read ofs=0 len=0 2024-09-10T05:39:58.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.331+0000 7f248d0d79c0 1 --2- 172.21.15.62:0/749411572 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55a433c881d0 0x55a433c8a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:39:58.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.331+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:5 5.11 5:88018d38:::zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c8ad50 con 0x55a433c881d0 2024-09-10T05:39:58.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.331+0000 7f248a3dc640 1 --2- 172.21.15.62:0/749411572 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55a433c881d0 0x55a433c8a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:39:58.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.331+0000 7f248a3dc640 1 --2- 172.21.15.62:0/749411572 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55a433c881d0 0x55a433c8a5c0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:39:58.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.331+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== osd_op_reply(5 zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 [read 0~993 out=993b] v0'0 uv5 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.331+0000 7f248d0d79c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:39:58.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.331+0000 7f248d0d79c0 20 searching for the correct realm 2024-09-10T05:39:58.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.331+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a433c8c620 con 0x55a433c881d0 2024-09-10T05:39:58.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.331+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.331+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a433c8c620 con 0x55a433c849d0 2024-09-10T05:39:58.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.331+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.331+0000 7f248abdd640 1 --2- 172.21.15.62:0/749411572 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f247c114060 0x7f247c0cd060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:39:58.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.331+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a433c8c620 con 0x7f247c114060 2024-09-10T05:39:58.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.335+0000 7f248b3de640 1 --2- 172.21.15.62:0/749411572 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f247c114060 0x7f247c0cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:39:58.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.335+0000 7f248b3de640 1 --2- 172.21.15.62:0/749411572 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f247c114060 0x7f247c0cd060 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:39:58.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.335+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24840083f0 con 0x7f247c114060 2024-09-10T05:39:58.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.335+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a433c8c620 con 0x55a433c80510 2024-09-10T05:39:58.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.335+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.335+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a433c8c620 con 0x55a433c80510 2024-09-10T05:39:58.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.335+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.335+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a433c8c620 con 0x55a433c881d0 2024-09-10T05:39:58.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.335+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.335+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a433c8c620 con 0x55a433c80510 2024-09-10T05:39:58.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.335+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.335+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a433c8c620 con 0x55a433c849d0 2024-09-10T05:39:58.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.335+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.335+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a433c8c620 con 0x55a433c849d0 2024-09-10T05:39:58.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.335+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.335+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a433c8c620 con 0x55a433c80510 2024-09-10T05:39:58.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.335+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.335+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a433c8c620 con 0x7f247c114060 2024-09-10T05:39:58.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.339+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24840083f0 con 0x7f247c114060 2024-09-10T05:39:58.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.339+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a433c8c620 con 0x55a433c80510 2024-09-10T05:39:58.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.339+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.339+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a433c8c620 con 0x7f247c114060 2024-09-10T05:39:58.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.339+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.2 v2:172.21.15.62:6800/2677868286 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f24840083f0 con 0x7f247c114060 2024-09-10T05:39:58.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.339+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a433c8c620 con 0x55a433c849d0 2024-09-10T05:39:58.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.339+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.339+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a433c8c620 con 0x55a433c881d0 2024-09-10T05:39:58.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.339+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.339+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a433c8c620 con 0x55a433c80510 2024-09-10T05:39:58.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.339+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.339+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a433c8c620 con 0x55a433c849d0 2024-09-10T05:39:58.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.339+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.339+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a433c8c620 con 0x55a433c881d0 2024-09-10T05:39:58.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.339+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 5 ==== osd_op_reply(23 [pgnls start_epoch 34 out=170b] v34'5 uv5 ondisk = 1) ==== 144+0+170 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.339+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a433c8c620 con 0x55a433c80510 2024-09-10T05:39:58.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.339+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.339+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a433c8c620 con 0x55a433c80510 2024-09-10T05:39:58.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.339+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.339+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a433c8c620 con 0x55a433c80510 2024-09-10T05:39:58.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.339+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.339+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a433c8c620 con 0x55a433c881d0 2024-09-10T05:39:58.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.343+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 6 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.343+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a433c8c620 con 0x7f247c114060 2024-09-10T05:39:58.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.343+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.2 v2:172.21.15.62:6800/2677868286 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24840083f0 con 0x7f247c114060 2024-09-10T05:39:58.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.343+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a433c8c620 con 0x55a433c80510 2024-09-10T05:39:58.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.343+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.343+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a433c8c620 con 0x7f247c114060 2024-09-10T05:39:58.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.343+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.2 v2:172.21.15.62:6800/2677868286 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=82b] v34'1 uv1 ondisk = 1) ==== 144+0+82 (crc 0 0 0) 0x7f24840083f0 con 0x7f247c114060 2024-09-10T05:39:58.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.343+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a433c8c620 con 0x55a433c881d0 2024-09-10T05:39:58.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.343+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 7 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.343+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a433c8c620 con 0x7f247c114060 2024-09-10T05:39:58.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.343+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.2 v2:172.21.15.62:6800/2677868286 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24840083f0 con 0x7f247c114060 2024-09-10T05:39:58.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.343+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a433c8c620 con 0x55a433c849d0 2024-09-10T05:39:58.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.343+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.343+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a433c8c620 con 0x55a433c849d0 2024-09-10T05:39:58.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.343+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.343+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a433c8c620 con 0x55a433c881d0 2024-09-10T05:39:58.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.343+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.343+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a433c8c620 con 0x55a433c849d0 2024-09-10T05:39:58.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.347+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.347+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a433c8c620 con 0x55a433c849d0 2024-09-10T05:39:58.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.347+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.347+0000 7f248d0d79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:39:58.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.347+0000 7f248d0d79c0 20 RGWRados::pool_iterate: got zone_info.475ecc13-ad4b-423e-b7f2-f7f260e17071 2024-09-10T05:39:58.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.347+0000 7f248d0d79c0 20 RGWRados::pool_iterate: got zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 2024-09-10T05:39:58.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.347+0000 7f248d0d79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:39:58.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.347+0000 7f248d0d79c0 20 RGWRados::pool_iterate: got period_config.default 2024-09-10T05:39:58.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.347+0000 7f248d0d79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:39:58.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.347+0000 7f248d0d79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:39:58.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.347+0000 7f248d0d79c0 20 rados->read ofs=0 len=0 2024-09-10T05:39:58.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.347+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c8b740 con 0x55a433c80510 2024-09-10T05:39:58.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.347+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.347+0000 7f248d0d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:39:58.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.347+0000 7f248d0d79c0 20 rados->read ofs=0 len=0 2024-09-10T05:39:58.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.347+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c8bfe0 con 0x55a433c849d0 2024-09-10T05:39:58.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.347+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.347+0000 7f248d0d79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:39:58.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.347+0000 7f248d0d79c0 20 rados->read ofs=0 len=0 2024-09-10T05:39:58.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.347+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:40 5.11 5:8e02e38a:::zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c8b380 con 0x55a433c881d0 2024-09-10T05:39:58.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.347+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 9 ==== osd_op_reply(40 zonegroup_info.1e560b55-359a-4aa1-8333-6dabf7061701 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.347+0000 7f248d0d79c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:39:58.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.347+0000 7f248d0d79c0 20 zone default found 2024-09-10T05:39:58.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.347+0000 7f248d0d79c0 4 Realm: () 2024-09-10T05:39:58.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.347+0000 7f248d0d79c0 4 ZoneGroup: default (1e560b55-359a-4aa1-8333-6dabf7061701) 2024-09-10T05:39:58.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.347+0000 7f248d0d79c0 4 Zone: default (475ecc13-ad4b-423e-b7f2-f7f260e17071) 2024-09-10T05:39:58.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.347+0000 7f248d0d79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:39:58.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.347+0000 7f248d0d79c0 20 zonegroup default 2024-09-10T05:39:58.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.347+0000 7f248d0d79c0 20 rados->read ofs=0 len=0 2024-09-10T05:39:58.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.347+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c8cf00 con 0x7f247c114060 2024-09-10T05:39:58.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.351+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.2 v2:172.21.15.62:6800/2677868286 7 ==== osd_op_reply(41 period_config.default [read 0~187 out=187b] v0'0 uv1 ondisk = 0) ==== 165+0+187 (crc 0 0 0) 0x7f24840083f0 con 0x7f247c114060 2024-09-10T05:39:58.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.351+0000 7f248d0d79c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-10T05:39:58.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.351+0000 7f248d0d79c0 20 rados->read ofs=0 len=0 2024-09-10T05:39:58.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.351+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c8f140 con 0x55a433c881d0 2024-09-10T05:39:58.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.351+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.351+0000 7f248d0d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:39:58.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.351+0000 7f248d0d79c0 20 rados->read ofs=0 len=0 2024-09-10T05:39:58.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.351+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c8f510 con 0x55a433c881d0 2024-09-10T05:39:58.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.351+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.351+0000 7f248d0d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:39:58.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.351+0000 7f248d0d79c0 20 started sync module instance, tier type = 2024-09-10T05:39:58.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.351+0000 7f248d0d79c0 20 started zone id=475ecc13-ad4b-423e-b7f2-f7f260e17071 (name=default) with tier type = 2024-09-10T05:39:58.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.351+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c8e580 con 0x55a433c849d0 2024-09-10T05:39:58.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.355+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 12 ==== osd_op_reply(44 notify.0 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.355+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94163731800272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c8f970 con 0x55a433c849d0 2024-09-10T05:39:58.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.355+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c901c0 con 0x55a433c80510 2024-09-10T05:39:58.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.355+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 15 ==== osd_op_reply(46 notify.1 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.355+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94163731806576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c90a10 con 0x55a433c80510 2024-09-10T05:39:58.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.355+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c912a0 con 0x55a433c849d0 2024-09-10T05:39:58.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.355+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94163731800272] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.355+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94163731806576] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.355+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 14 ==== osd_op_reply(48 notify.2 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.355+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94163731802480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c90a10 con 0x55a433c849d0 2024-09-10T05:39:58.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.355+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c91b40 con 0x7f247c114060 2024-09-10T05:39:58.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.359+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.2 v2:172.21.15.62:6800/2677868286 8 ==== osd_op_reply(50 notify.3 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24840083f0 con 0x7f247c114060 2024-09-10T05:39:58.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.359+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94163731814032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c90a10 con 0x7f247c114060 2024-09-10T05:39:58.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.359+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c925c0 con 0x55a433c849d0 2024-09-10T05:39:58.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.359+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94163731802480] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.359+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.2 v2:172.21.15.62:6800/2677868286 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94163731814032] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24840083f0 con 0x7f247c114060 2024-09-10T05:39:58.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.359+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 16 ==== osd_op_reply(52 notify.4 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.359+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94163731815088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c90560 con 0x55a433c849d0 2024-09-10T05:39:58.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.359+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c92e60 con 0x55a433c881d0 2024-09-10T05:39:58.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.363+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 12 ==== osd_op_reply(54 notify.5 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.363+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94163731818928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c90560 con 0x55a433c881d0 2024-09-10T05:39:58.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.363+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c938a0 con 0x55a433c881d0 2024-09-10T05:39:58.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.363+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94163731815088] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.363+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94163731818928] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.363+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 14 ==== osd_op_reply(56 notify.6 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.363+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94163731819984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c933f0 con 0x55a433c881d0 2024-09-10T05:39:58.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.363+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c93c40 con 0x7f247c114060 2024-09-10T05:39:58.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.367+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94163731819984] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.367+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.2 v2:172.21.15.62:6800/2677868286 10 ==== osd_op_reply(58 notify.7 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24840083f0 con 0x7f247c114060 2024-09-10T05:39:58.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.367+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94163731821552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c94030 con 0x7f247c114060 2024-09-10T05:39:58.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.367+0000 7f248d0d79c0 20 add_watcher() i=0 2024-09-10T05:39:58.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.367+0000 7f248d0d79c0 20 add_watcher() i=1 2024-09-10T05:39:58.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.367+0000 7f248d0d79c0 20 add_watcher() i=2 2024-09-10T05:39:58.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.367+0000 7f248d0d79c0 20 add_watcher() i=3 2024-09-10T05:39:58.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.367+0000 7f248d0d79c0 20 add_watcher() i=4 2024-09-10T05:39:58.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.367+0000 7f248d0d79c0 20 add_watcher() i=5 2024-09-10T05:39:58.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.367+0000 7f248d0d79c0 20 add_watcher() i=6 2024-09-10T05:39:58.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.367+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.2 v2:172.21.15.62:6800/2677868286 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94163731821552] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24840083f0 con 0x7f247c114060 2024-09-10T05:39:58.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.367+0000 7f248d0d79c0 20 add_watcher() i=7 2024-09-10T05:39:58.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.367+0000 7f248d0d79c0 2 all 8 watchers are set, enabling cache 2024-09-10T05:39:58.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.367+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c97090 con 0x55a433c80510 2024-09-10T05:39:58.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.367+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.367+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94163731823200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c94470 con 0x55a433c80510 2024-09-10T05:39:58.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.371+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94163731823200] v34'281 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.371+0000 7f23417e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:39:58.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.371+0000 7f248d0d79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:39:58.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.371+0000 7f248d0d79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:39:58.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.371+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f800 con 0x55a433c849d0 2024-09-10T05:39:58.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.371+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 18 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'61 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.371+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f880 con 0x7f247c114060 2024-09-10T05:39:58.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.375+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.2 v2:172.21.15.62:6800/2677868286 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'38 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f24840083f0 con 0x7f247c114060 2024-09-10T05:39:58.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.375+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9fef0 con 0x55a433c881d0 2024-09-10T05:39:58.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.375+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.375+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433ca0330 con 0x55a433c80510 2024-09-10T05:39:58.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.379+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'282 uv172 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.379+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433ca0750 con 0x55a433c849d0 2024-09-10T05:39:58.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.379+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 19 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'89 uv61 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.383+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433ca0770 con 0x55a433c881d0 2024-09-10T05:39:58.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.383+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'67 uv48 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.383+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433ca0dc0 con 0x55a433c849d0 2024-09-10T05:39:58.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.387+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 20 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'43 uv31 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.387+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433ca0d60 con 0x55a433c80510 2024-09-10T05:39:58.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.387+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'61 uv42 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.387+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433ca12d0 con 0x55a433c849d0 2024-09-10T05:39:58.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.391+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 21 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.391+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433ca12d0 con 0x55a433c849d0 2024-09-10T05:39:58.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.391+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 22 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.395+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433ca12d0 con 0x55a433c849d0 2024-09-10T05:39:58.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.395+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 23 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'90 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.395+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433ca12d0 con 0x55a433c881d0 2024-09-10T05:39:58.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.399+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'42 uv25 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.399+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433ca1770 con 0x55a433c849d0 2024-09-10T05:39:58.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.399+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 24 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.399+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433ca1650 con 0x55a433c80510 2024-09-10T05:39:58.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.403+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'75 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.403+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433ca1820 con 0x55a433c80510 2024-09-10T05:39:58.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.403+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'283 uv168 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.403+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433ca1950 con 0x55a433c849d0 2024-09-10T05:39:58.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.407+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 25 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'84 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.407+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433ca1950 con 0x55a433c849d0 2024-09-10T05:39:58.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.411+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 26 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'91 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.411+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433ca1990 con 0x55a433c881d0 2024-09-10T05:39:58.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.411+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'43 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.411+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433ca1a90 con 0x55a433c849d0 2024-09-10T05:39:58.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.415+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.415+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433ca1a50 con 0x55a433c80510 2024-09-10T05:39:58.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.415+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'284 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.415+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433ca1a50 con 0x55a433c849d0 2024-09-10T05:39:58.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.419+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 28 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'85 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.419+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433ca1a90 con 0x7f247c114060 2024-09-10T05:39:58.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.419+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.2 v2:172.21.15.62:6800/2677868286 13 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'48 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f24840083f0 con 0x7f247c114060 2024-09-10T05:39:58.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.419+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433ca1ab0 con 0x55a433c881d0 2024-09-10T05:39:58.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.423+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.423+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433ca1b80 con 0x55a433c849d0 2024-09-10T05:39:58.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.427+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 29 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'50 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.427+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433ca1b40 con 0x55a433c881d0 2024-09-10T05:39:58.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.427+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 21 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'34 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.427+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433ca1b40 con 0x55a433c881d0 2024-09-10T05:39:58.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.431+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 22 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'68 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.431+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433ca1b40 con 0x55a433c881d0 2024-09-10T05:39:58.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.431+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 23 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.431+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433ca1b40 con 0x55a433c849d0 2024-09-10T05:39:58.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.435+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 30 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'48 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.435+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433ca1b40 con 0x55a433c80510 2024-09-10T05:39:58.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.435+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'62 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.435+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433ca1b40 con 0x55a433c849d0 2024-09-10T05:39:58.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.439+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 31 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'86 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.439+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433ca1b40 con 0x55a433c80510 2024-09-10T05:39:58.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.443+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'76 uv73 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.443+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433ca1b40 con 0x7f247c114060 2024-09-10T05:39:58.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.443+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.2 v2:172.21.15.62:6800/2677868286 14 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f24840083f0 con 0x7f247c114060 2024-09-10T05:39:58.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.443+0000 7f22bbfff640 20 reqs_thread_entry: start 2024-09-10T05:39:58.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.443+0000 7f248d0d79c0 20 init_complete bucket index max shards: 11 2024-09-10T05:39:58.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.443+0000 7f248d0d79c0 20 Filter name: none 2024-09-10T05:39:58.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.443+0000 7f22b9ffb640 20 reqs_thread_entry: start 2024-09-10T05:39:58.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.443+0000 7f248d0d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-10T05:39:58.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.443+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:94 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c80510 2024-09-10T05:39:58.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.447+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 26 ==== osd_op_reply(94 gc.13 [call] v34'77 uv77 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.447+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:95 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c80510 2024-09-10T05:39:58.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.447+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 27 ==== osd_op_reply(95 gc.13 [call out=15b] v0'0 uv77 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.447+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.447+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:96 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c80510 2024-09-10T05:39:58.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.447+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 28 ==== osd_op_reply(96 gc.13 [call out=24b] v0'0 uv77 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.447+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:97 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c80510 2024-09-10T05:39:58.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.447+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 29 ==== osd_op_reply(97 gc.13 [call out=15b] v0'0 uv77 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.447+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:39:58.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.447+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:98 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c80510 2024-09-10T05:39:58.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.447+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 30 ==== osd_op_reply(98 gc.13 [call out=15b] v0'0 uv77 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.447+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.447+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:99 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c80510 2024-09-10T05:39:58.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.451+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 31 ==== osd_op_reply(99 gc.13 [call] v34'78 uv78 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.451+0000 7f248d0d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-10T05:39:58.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.451+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:100 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c80510 2024-09-10T05:39:58.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.451+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 32 ==== osd_op_reply(100 gc.14 [call] v34'285 uv285 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.451+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:101 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c80510 2024-09-10T05:39:58.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.451+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 33 ==== osd_op_reply(101 gc.14 [call out=15b] v0'0 uv285 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.451+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.451+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:102 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c80510 2024-09-10T05:39:58.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.451+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 34 ==== osd_op_reply(102 gc.14 [call out=24b] v0'0 uv285 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.451+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:103 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c80510 2024-09-10T05:39:58.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.455+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 35 ==== osd_op_reply(103 gc.14 [call out=15b] v0'0 uv285 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.455+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:39:58.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.455+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:104 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c80510 2024-09-10T05:39:58.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.455+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 36 ==== osd_op_reply(104 gc.14 [call out=15b] v0'0 uv285 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.455+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.455+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:105 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c80510 2024-09-10T05:39:58.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.455+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 37 ==== osd_op_reply(105 gc.14 [call] v34'286 uv286 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.455+0000 7f248d0d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-10T05:39:58.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.455+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:106 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c849d0 2024-09-10T05:39:58.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.459+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 32 ==== osd_op_reply(106 gc.15 [call] v34'87 uv87 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.459+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:107 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c849d0 2024-09-10T05:39:58.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.459+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 33 ==== osd_op_reply(107 gc.15 [call out=15b] v0'0 uv87 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.459+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.459+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:108 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c849d0 2024-09-10T05:39:58.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.459+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 34 ==== osd_op_reply(108 gc.15 [call out=24b] v0'0 uv87 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.459+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:109 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c849d0 2024-09-10T05:39:58.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.459+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 35 ==== osd_op_reply(109 gc.15 [call out=15b] v0'0 uv87 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.459+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:39:58.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.459+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:110 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c849d0 2024-09-10T05:39:58.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.459+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 36 ==== osd_op_reply(110 gc.15 [call out=15b] v0'0 uv87 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.459+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.459+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:111 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c849d0 2024-09-10T05:39:58.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.463+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 37 ==== osd_op_reply(111 gc.15 [call] v34'88 uv88 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.463+0000 7f248d0d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-10T05:39:58.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.463+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:112 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c849d0 2024-09-10T05:39:58.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.467+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 38 ==== osd_op_reply(112 gc.16 [call] v34'92 uv92 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.467+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:113 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c849d0 2024-09-10T05:39:58.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.467+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 39 ==== osd_op_reply(113 gc.16 [call out=15b] v0'0 uv92 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.467+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.467+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:114 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c849d0 2024-09-10T05:39:58.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.467+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 40 ==== osd_op_reply(114 gc.16 [call out=24b] v0'0 uv92 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.467+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:115 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c849d0 2024-09-10T05:39:58.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.467+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 41 ==== osd_op_reply(115 gc.16 [call out=15b] v0'0 uv92 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.467+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:39:58.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.467+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:116 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c849d0 2024-09-10T05:39:58.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.467+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 42 ==== osd_op_reply(116 gc.16 [call out=15b] v0'0 uv92 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.467+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.467+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:117 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c849d0 2024-09-10T05:39:58.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.471+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 43 ==== osd_op_reply(117 gc.16 [call] v34'93 uv93 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.471+0000 7f248d0d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-10T05:39:58.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.471+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:118 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c881d0 2024-09-10T05:39:58.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.475+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 24 ==== osd_op_reply(118 gc.17 [call] v34'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.475+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:119 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c881d0 2024-09-10T05:39:58.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.475+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 25 ==== osd_op_reply(119 gc.17 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.475+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.475+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:120 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c881d0 2024-09-10T05:39:58.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.475+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 26 ==== osd_op_reply(120 gc.17 [call out=24b] v0'0 uv44 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.475+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:121 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c881d0 2024-09-10T05:39:58.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.475+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 27 ==== osd_op_reply(121 gc.17 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.475+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:39:58.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.475+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:122 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c881d0 2024-09-10T05:39:58.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.475+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 28 ==== osd_op_reply(122 gc.17 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.475+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.475+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:123 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c881d0 2024-09-10T05:39:58.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.475+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 29 ==== osd_op_reply(123 gc.17 [call] v34'45 uv45 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.475+0000 7f248d0d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-10T05:39:58.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.475+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:124 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c849d0 2024-09-10T05:39:58.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.479+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 44 ==== osd_op_reply(124 gc.18 [call] v34'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.479+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:125 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c849d0 2024-09-10T05:39:58.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.479+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 45 ==== osd_op_reply(125 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.479+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.479+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:126 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c849d0 2024-09-10T05:39:58.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.483+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 46 ==== osd_op_reply(126 gc.18 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.483+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:127 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c849d0 2024-09-10T05:39:58.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.483+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 47 ==== osd_op_reply(127 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.483+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:39:58.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.483+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:128 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c849d0 2024-09-10T05:39:58.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.483+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 48 ==== osd_op_reply(128 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.483+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.483+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:129 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c849d0 2024-09-10T05:39:58.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.487+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 49 ==== osd_op_reply(129 gc.18 [call] v34'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.487+0000 7f248d0d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-10T05:39:58.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.487+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:130 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c80510 2024-09-10T05:39:58.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.487+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 38 ==== osd_op_reply(130 gc.19 [call] v34'287 uv287 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.491+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:131 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c80510 2024-09-10T05:39:58.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.491+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 39 ==== osd_op_reply(131 gc.19 [call out=15b] v0'0 uv287 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.491+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.491+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:132 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c80510 2024-09-10T05:39:58.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.491+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 40 ==== osd_op_reply(132 gc.19 [call out=24b] v0'0 uv287 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.491+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:133 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c80510 2024-09-10T05:39:58.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.491+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 41 ==== osd_op_reply(133 gc.19 [call out=15b] v0'0 uv287 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.491+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:39:58.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.491+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:134 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c80510 2024-09-10T05:39:58.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.491+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 42 ==== osd_op_reply(134 gc.19 [call out=15b] v0'0 uv287 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.491+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.491+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:135 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c80510 2024-09-10T05:39:58.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.495+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 43 ==== osd_op_reply(135 gc.19 [call] v34'288 uv288 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.495+0000 7f248d0d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-10T05:39:58.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.495+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:136 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c849d0 2024-09-10T05:39:58.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.495+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 50 ==== osd_op_reply(136 gc.20 [call] v34'89 uv89 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.495+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:137 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c849d0 2024-09-10T05:39:58.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.499+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 51 ==== osd_op_reply(137 gc.20 [call out=15b] v0'0 uv89 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.499+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.499+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:138 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c849d0 2024-09-10T05:39:58.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.499+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 52 ==== osd_op_reply(138 gc.20 [call out=24b] v0'0 uv89 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.499+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:139 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c849d0 2024-09-10T05:39:58.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.499+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 53 ==== osd_op_reply(139 gc.20 [call out=15b] v0'0 uv89 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.499+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:39:58.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.499+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:140 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c849d0 2024-09-10T05:39:58.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.499+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 54 ==== osd_op_reply(140 gc.20 [call out=15b] v0'0 uv89 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.499+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.499+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:141 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c849d0 2024-09-10T05:39:58.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.503+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 55 ==== osd_op_reply(141 gc.20 [call] v34'90 uv90 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.503+0000 7f248d0d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-10T05:39:58.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.503+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:142 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x7f247c114060 2024-09-10T05:39:58.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.507+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.2 v2:172.21.15.62:6800/2677868286 15 ==== osd_op_reply(142 gc.21 [call] v34'49 uv49 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24840083f0 con 0x7f247c114060 2024-09-10T05:39:58.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.507+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:143 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x7f247c114060 2024-09-10T05:39:58.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.507+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.2 v2:172.21.15.62:6800/2677868286 16 ==== osd_op_reply(143 gc.21 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24840083f0 con 0x7f247c114060 2024-09-10T05:39:58.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.507+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.507+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:144 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x7f247c114060 2024-09-10T05:39:58.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.507+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.2 v2:172.21.15.62:6800/2677868286 17 ==== osd_op_reply(144 gc.21 [call out=24b] v0'0 uv49 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f24840083f0 con 0x7f247c114060 2024-09-10T05:39:58.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.507+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:145 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x7f247c114060 2024-09-10T05:39:58.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.507+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.2 v2:172.21.15.62:6800/2677868286 18 ==== osd_op_reply(145 gc.21 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24840083f0 con 0x7f247c114060 2024-09-10T05:39:58.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.507+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:39:58.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.507+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:146 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x7f247c114060 2024-09-10T05:39:58.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.507+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.2 v2:172.21.15.62:6800/2677868286 19 ==== osd_op_reply(146 gc.21 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24840083f0 con 0x7f247c114060 2024-09-10T05:39:58.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.507+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.507+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:147 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x7f247c114060 2024-09-10T05:39:58.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.511+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.2 v2:172.21.15.62:6800/2677868286 20 ==== osd_op_reply(147 gc.21 [call] v34'50 uv50 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24840083f0 con 0x7f247c114060 2024-09-10T05:39:58.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.511+0000 7f248d0d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-10T05:39:58.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.511+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:148 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c881d0 2024-09-10T05:39:58.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.511+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 30 ==== osd_op_reply(148 gc.22 [call] v34'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.511+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:149 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c881d0 2024-09-10T05:39:58.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.511+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 31 ==== osd_op_reply(149 gc.22 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.515+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.515+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:150 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c881d0 2024-09-10T05:39:58.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.515+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 32 ==== osd_op_reply(150 gc.22 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.515+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:151 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c881d0 2024-09-10T05:39:58.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.515+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 33 ==== osd_op_reply(151 gc.22 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.515+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:39:58.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.515+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:152 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c881d0 2024-09-10T05:39:58.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.515+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 34 ==== osd_op_reply(152 gc.22 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.515+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.515+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:153 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c881d0 2024-09-10T05:39:58.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.519+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 35 ==== osd_op_reply(153 gc.22 [call] v34'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.519+0000 7f248d0d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-10T05:39:58.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.519+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:154 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c849d0 2024-09-10T05:39:58.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.519+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 56 ==== osd_op_reply(154 gc.23 [call] v34'51 uv51 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.523+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:155 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c849d0 2024-09-10T05:39:58.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.523+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 57 ==== osd_op_reply(155 gc.23 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.523+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.523+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:156 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c849d0 2024-09-10T05:39:58.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.523+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 58 ==== osd_op_reply(156 gc.23 [call out=24b] v0'0 uv51 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.523+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:157 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c849d0 2024-09-10T05:39:58.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.523+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 59 ==== osd_op_reply(157 gc.23 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.523+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:39:58.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.523+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:158 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c849d0 2024-09-10T05:39:58.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.523+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 60 ==== osd_op_reply(158 gc.23 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.523+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.523+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:159 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c849d0 2024-09-10T05:39:58.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.527+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 61 ==== osd_op_reply(159 gc.23 [call] v34'52 uv52 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.527+0000 7f248d0d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-10T05:39:58.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.527+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:160 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c881d0 2024-09-10T05:39:58.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.531+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 36 ==== osd_op_reply(160 gc.24 [call] v34'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.531+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:161 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c881d0 2024-09-10T05:39:58.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.531+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 37 ==== osd_op_reply(161 gc.24 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.531+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.531+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:162 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c881d0 2024-09-10T05:39:58.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.531+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 38 ==== osd_op_reply(162 gc.24 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.531+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:163 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c881d0 2024-09-10T05:39:58.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.531+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 39 ==== osd_op_reply(163 gc.24 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.531+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:39:58.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.531+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:164 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c881d0 2024-09-10T05:39:58.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.531+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 40 ==== osd_op_reply(164 gc.24 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.531+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.531+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:165 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c881d0 2024-09-10T05:39:58.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.535+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 41 ==== osd_op_reply(165 gc.24 [call] v34'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.535+0000 7f248d0d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-10T05:39:58.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.535+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:166 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c881d0 2024-09-10T05:39:58.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.539+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 42 ==== osd_op_reply(166 gc.25 [call] v34'69 uv69 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.539+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:167 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c881d0 2024-09-10T05:39:58.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.539+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 43 ==== osd_op_reply(167 gc.25 [call out=15b] v0'0 uv69 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.539+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.539+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:168 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c881d0 2024-09-10T05:39:58.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.539+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 44 ==== osd_op_reply(168 gc.25 [call out=24b] v0'0 uv69 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.539+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c881d0 2024-09-10T05:39:58.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.539+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 45 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv69 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.539+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:39:58.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.539+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c881d0 2024-09-10T05:39:58.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.539+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 46 ==== osd_op_reply(170 gc.25 [call out=15b] v0'0 uv69 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.539+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.539+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c881d0 2024-09-10T05:39:58.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.543+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 47 ==== osd_op_reply(171 gc.25 [call] v34'70 uv70 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.543+0000 7f248d0d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-10T05:39:58.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.543+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c881d0 2024-09-10T05:39:58.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.547+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 48 ==== osd_op_reply(172 gc.26 [call] v34'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.547+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c881d0 2024-09-10T05:39:58.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.547+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 49 ==== osd_op_reply(173 gc.26 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.547+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.547+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c881d0 2024-09-10T05:39:58.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.547+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 50 ==== osd_op_reply(174 gc.26 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.547+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:175 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c881d0 2024-09-10T05:39:58.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.547+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 51 ==== osd_op_reply(175 gc.26 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.547+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:39:58.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.547+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:176 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c881d0 2024-09-10T05:39:58.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.547+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 52 ==== osd_op_reply(176 gc.26 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.547+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.547+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:177 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c881d0 2024-09-10T05:39:58.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.551+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 53 ==== osd_op_reply(177 gc.26 [call] v34'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.551+0000 7f248d0d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-10T05:39:58.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.551+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:178 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c849d0 2024-09-10T05:39:58.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.555+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 62 ==== osd_op_reply(178 gc.27 [call] v34'49 uv49 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.555+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:179 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c849d0 2024-09-10T05:39:58.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.555+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 63 ==== osd_op_reply(179 gc.27 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.555+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.555+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:180 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c849d0 2024-09-10T05:39:58.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.555+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 64 ==== osd_op_reply(180 gc.27 [call out=24b] v0'0 uv49 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.555+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:181 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c849d0 2024-09-10T05:39:58.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.555+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 65 ==== osd_op_reply(181 gc.27 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.555+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:39:58.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.555+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:182 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c849d0 2024-09-10T05:39:58.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.559+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 66 ==== osd_op_reply(182 gc.27 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.559+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.559+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:183 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c849d0 2024-09-10T05:39:58.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.559+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 67 ==== osd_op_reply(183 gc.27 [call] v34'50 uv50 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.559+0000 7f248d0d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-10T05:39:58.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.563+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:184 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c80510 2024-09-10T05:39:58.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.563+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 44 ==== osd_op_reply(184 gc.28 [call] v34'63 uv63 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.563+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:185 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c80510 2024-09-10T05:39:58.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.563+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 45 ==== osd_op_reply(185 gc.28 [call out=15b] v0'0 uv63 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.563+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.563+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:186 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c80510 2024-09-10T05:39:58.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.567+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 46 ==== osd_op_reply(186 gc.28 [call out=24b] v0'0 uv63 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.567+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:187 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c80510 2024-09-10T05:39:58.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.567+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 47 ==== osd_op_reply(187 gc.28 [call out=15b] v0'0 uv63 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.567+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:39:58.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.567+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:188 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c80510 2024-09-10T05:39:58.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.567+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 48 ==== osd_op_reply(188 gc.28 [call out=15b] v0'0 uv63 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.567+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.567+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:189 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c80510 2024-09-10T05:39:58.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.571+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 49 ==== osd_op_reply(189 gc.28 [call] v34'64 uv64 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.571+0000 7f248d0d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-10T05:39:58.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.571+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:190 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c849d0 2024-09-10T05:39:58.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.571+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 68 ==== osd_op_reply(190 gc.29 [call] v34'91 uv91 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.571+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:191 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c849d0 2024-09-10T05:39:58.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.571+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 69 ==== osd_op_reply(191 gc.29 [call out=15b] v0'0 uv91 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.571+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.571+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:192 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c849d0 2024-09-10T05:39:58.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.575+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 70 ==== osd_op_reply(192 gc.29 [call out=24b] v0'0 uv91 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.575+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:193 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c849d0 2024-09-10T05:39:58.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.575+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 71 ==== osd_op_reply(193 gc.29 [call out=15b] v0'0 uv91 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.575+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:39:58.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.575+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:194 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c849d0 2024-09-10T05:39:58.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.575+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 72 ==== osd_op_reply(194 gc.29 [call out=15b] v0'0 uv91 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.575+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.575+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:195 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c849d0 2024-09-10T05:39:58.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.579+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 73 ==== osd_op_reply(195 gc.29 [call] v34'92 uv92 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.579+0000 7f248d0d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-10T05:39:58.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.579+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:196 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c80510 2024-09-10T05:39:58.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.579+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 50 ==== osd_op_reply(196 gc.30 [call] v34'79 uv79 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.579+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:197 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c80510 2024-09-10T05:39:58.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.583+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 51 ==== osd_op_reply(197 gc.30 [call out=15b] v0'0 uv79 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.583+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.583+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:198 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c80510 2024-09-10T05:39:58.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.583+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 52 ==== osd_op_reply(198 gc.30 [call out=24b] v0'0 uv79 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.583+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:199 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c80510 2024-09-10T05:39:58.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.583+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 53 ==== osd_op_reply(199 gc.30 [call out=15b] v0'0 uv79 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.583+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:39:58.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.583+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:200 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433c9f080 con 0x55a433c80510 2024-09-10T05:39:58.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.583+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 54 ==== osd_op_reply(200 gc.30 [call out=1715b] v0'0 uv79 ondisk = 0) ==== 149+0+1715 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.583+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-10T05:39:58.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.583+0000 7f248d0d79c0 20 garbage collection: RGWGC::process iterating over entry tag='475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.4407243865766794748', time=2024-09-10T05:39:41.735714+0000, chain.objs.size()=7 2024-09-10T05:39:58.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.583+0000 7f248d0d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.11__shadow_.mW_bHVhPSsHLrKg5Bmp1Z_-3VdejhmW_1 2024-09-10T05:39:58.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.583+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:201 3.5 3:a0560248:::475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.11__shadow_.mW_bHVhPSsHLrKg5Bmp1Z_-3VdejhmW_1:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbecc0 con 0x55a433c849d0 2024-09-10T05:39:58.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.583+0000 7f248d0d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.11__shadow_.mW_bHVhPSsHLrKg5Bmp1Z_-3VdejhmW_2 2024-09-10T05:39:58.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.583+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:202 3.2 3:42b4c587:::475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.11__shadow_.mW_bHVhPSsHLrKg5Bmp1Z_-3VdejhmW_2:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433cc1630 con 0x55a433c881d0 2024-09-10T05:39:58.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.583+0000 7f248d0d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.11__shadow_.mW_bHVhPSsHLrKg5Bmp1Z_-3VdejhmW_3 2024-09-10T05:39:58.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.583+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:203 3.15 3:aa45e1cf:::475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.11__shadow_.mW_bHVhPSsHLrKg5Bmp1Z_-3VdejhmW_3:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433cc3f60 con 0x7f247c114060 2024-09-10T05:39:58.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.583+0000 7f248d0d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.11__shadow_.mW_bHVhPSsHLrKg5Bmp1Z_-3VdejhmW_4 2024-09-10T05:39:58.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.583+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:204 3.21 3:87f916c7:::475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.11__shadow_.mW_bHVhPSsHLrKg5Bmp1Z_-3VdejhmW_4:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433cc67d0 con 0x7f247c114060 2024-09-10T05:39:58.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.583+0000 7f248d0d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.11__shadow_.mW_bHVhPSsHLrKg5Bmp1Z_-3VdejhmW_5 2024-09-10T05:39:58.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.583+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:205 3.8 3:10527d22:::475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.11__shadow_.mW_bHVhPSsHLrKg5Bmp1Z_-3VdejhmW_5:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433cc9040 con 0x55a433c881d0 2024-09-10T05:39:58.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.583+0000 7f248d0d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.11__shadow_.mW_bHVhPSsHLrKg5Bmp1Z_-3VdejhmW_6 2024-09-10T05:39:58.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.583+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:206 3.31 3:8dd38182:::475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.11__shadow_.mW_bHVhPSsHLrKg5Bmp1Z_-3VdejhmW_6:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433ccb8b0 con 0x55a433c80510 2024-09-10T05:39:58.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.583+0000 7f248d0d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.11__shadow_.mW_bHVhPSsHLrKg5Bmp1Z_-3VdejhmW_7 2024-09-10T05:39:58.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.583+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:207 3.33 3:cd666ac9:::475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.11__shadow_.mW_bHVhPSsHLrKg5Bmp1Z_-3VdejhmW_7:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433cc9040 con 0x7f247c114060 2024-09-10T05:39:58.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.591+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 54 ==== osd_op_reply(202 475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.11__shadow_.mW_bHVhPSsHLrKg5Bmp1Z_-3VdejhmW_2 [call] v34'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.591+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.2 v2:172.21.15.62:6800/2677868286 21 ==== osd_op_reply(207 475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.11__shadow_.mW_bHVhPSsHLrKg5Bmp1Z_-3VdejhmW_7 [call] v34'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f24840083f0 con 0x7f247c114060 2024-09-10T05:39:58.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.591+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 74 ==== osd_op_reply(201 475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.11__shadow_.mW_bHVhPSsHLrKg5Bmp1Z_-3VdejhmW_1 [call] v34'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.591+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.2 v2:172.21.15.62:6800/2677868286 22 ==== osd_op_reply(203 475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.11__shadow_.mW_bHVhPSsHLrKg5Bmp1Z_-3VdejhmW_3 [call] v34'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f24840083f0 con 0x7f247c114060 2024-09-10T05:39:58.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.591+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.2 v2:172.21.15.62:6800/2677868286 23 ==== osd_op_reply(204 475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.11__shadow_.mW_bHVhPSsHLrKg5Bmp1Z_-3VdejhmW_4 [call] v34'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f24840083f0 con 0x7f247c114060 2024-09-10T05:39:58.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.591+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 55 ==== osd_op_reply(205 475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.11__shadow_.mW_bHVhPSsHLrKg5Bmp1Z_-3VdejhmW_5 [call] v34'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.595+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 55 ==== osd_op_reply(206 475ecc13-ad4b-423e-b7f2-f7f260e17071.4227.11__shadow_.mW_bHVhPSsHLrKg5Bmp1Z_-3VdejhmW_6 [call] v34'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.595+0000 7f248d0d79c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-10T05:39:58.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.595+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:208 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433cc1a90 con 0x55a433c80510 2024-09-10T05:39:58.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.595+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 56 ==== osd_op_reply(208 gc.30 [call] v34'80 uv80 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.595+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:209 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433cc1a90 con 0x55a433c80510 2024-09-10T05:39:58.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.599+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 57 ==== osd_op_reply(209 gc.30 [call] v34'81 uv81 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.599+0000 7f248d0d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-10T05:39:58.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.599+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:210 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433cc1a70 con 0x7f247c114060 2024-09-10T05:39:58.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.603+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.2 v2:172.21.15.62:6800/2677868286 24 ==== osd_op_reply(210 gc.31 [call] v34'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24840083f0 con 0x7f247c114060 2024-09-10T05:39:58.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.603+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:211 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cc1a70 con 0x7f247c114060 2024-09-10T05:39:58.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.603+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.2 v2:172.21.15.62:6800/2677868286 25 ==== osd_op_reply(211 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24840083f0 con 0x7f247c114060 2024-09-10T05:39:58.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.603+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.603+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:212 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbdcb0 con 0x7f247c114060 2024-09-10T05:39:58.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.603+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.2 v2:172.21.15.62:6800/2677868286 26 ==== osd_op_reply(212 gc.31 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f24840083f0 con 0x7f247c114060 2024-09-10T05:39:58.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.603+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:213 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cc1a70 con 0x7f247c114060 2024-09-10T05:39:58.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.603+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.2 v2:172.21.15.62:6800/2677868286 27 ==== osd_op_reply(213 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24840083f0 con 0x7f247c114060 2024-09-10T05:39:58.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.603+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:39:58.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.603+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:214 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cc1a70 con 0x7f247c114060 2024-09-10T05:39:58.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.607+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.2 v2:172.21.15.62:6800/2677868286 28 ==== osd_op_reply(214 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24840083f0 con 0x7f247c114060 2024-09-10T05:39:58.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.607+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.607+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:215 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433cc1a30 con 0x7f247c114060 2024-09-10T05:39:58.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.607+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.2 v2:172.21.15.62:6800/2677868286 29 ==== osd_op_reply(215 gc.31 [call] v34'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24840083f0 con 0x7f247c114060 2024-09-10T05:39:58.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.607+0000 7f248d0d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-10T05:39:58.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.607+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:216 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433cc1a30 con 0x55a433c849d0 2024-09-10T05:39:58.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.611+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 75 ==== osd_op_reply(216 gc.0 [call] v34'62 uv62 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.611+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:217 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cc1a30 con 0x55a433c849d0 2024-09-10T05:39:58.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.611+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 76 ==== osd_op_reply(217 gc.0 [call out=15b] v0'0 uv62 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.611+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.611+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:218 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbdcb0 con 0x55a433c849d0 2024-09-10T05:39:58.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.615+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 77 ==== osd_op_reply(218 gc.0 [call out=24b] v0'0 uv62 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.615+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:219 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cc1a30 con 0x55a433c849d0 2024-09-10T05:39:58.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.615+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 78 ==== osd_op_reply(219 gc.0 [call out=15b] v0'0 uv62 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.615+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:39:58.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.615+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:220 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cc1a30 con 0x55a433c849d0 2024-09-10T05:39:58.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.615+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 79 ==== osd_op_reply(220 gc.0 [call out=15b] v0'0 uv62 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.615+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.615+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:221 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433cc1a30 con 0x55a433c849d0 2024-09-10T05:39:58.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.619+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 80 ==== osd_op_reply(221 gc.0 [call] v34'63 uv63 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.619+0000 7f248d0d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-10T05:39:58.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.619+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:222 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433cc1a30 con 0x7f247c114060 2024-09-10T05:39:58.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.623+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.2 v2:172.21.15.62:6800/2677868286 30 ==== osd_op_reply(222 gc.1 [call] v34'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f24840083f0 con 0x7f247c114060 2024-09-10T05:39:58.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.623+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:223 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cc1a30 con 0x7f247c114060 2024-09-10T05:39:58.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.623+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.2 v2:172.21.15.62:6800/2677868286 31 ==== osd_op_reply(223 gc.1 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f24840083f0 con 0x7f247c114060 2024-09-10T05:39:58.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.623+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.623+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:224 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbdcb0 con 0x7f247c114060 2024-09-10T05:39:58.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.623+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.2 v2:172.21.15.62:6800/2677868286 32 ==== osd_op_reply(224 gc.1 [call out=24b] v0'0 uv39 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f24840083f0 con 0x7f247c114060 2024-09-10T05:39:58.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.623+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:225 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cc1a30 con 0x7f247c114060 2024-09-10T05:39:58.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.623+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.2 v2:172.21.15.62:6800/2677868286 33 ==== osd_op_reply(225 gc.1 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f24840083f0 con 0x7f247c114060 2024-09-10T05:39:58.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.623+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:39:58.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.623+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:226 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cc1a30 con 0x7f247c114060 2024-09-10T05:39:58.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.623+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.2 v2:172.21.15.62:6800/2677868286 34 ==== osd_op_reply(226 gc.1 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f24840083f0 con 0x7f247c114060 2024-09-10T05:39:58.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.623+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.623+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:227 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433cc1a30 con 0x7f247c114060 2024-09-10T05:39:58.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.627+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.2 v2:172.21.15.62:6800/2677868286 35 ==== osd_op_reply(227 gc.1 [call] v34'40 uv40 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f24840083f0 con 0x7f247c114060 2024-09-10T05:39:58.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.627+0000 7f248d0d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-10T05:39:58.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.627+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:228 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433cc1a30 con 0x55a433c881d0 2024-09-10T05:39:58.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.631+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 56 ==== osd_op_reply(228 gc.2 [call] v34'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.631+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:229 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cc1a30 con 0x55a433c881d0 2024-09-10T05:39:58.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.631+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 57 ==== osd_op_reply(229 gc.2 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.631+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.631+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:230 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbdcb0 con 0x55a433c881d0 2024-09-10T05:39:58.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.631+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 58 ==== osd_op_reply(230 gc.2 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.631+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:231 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cc1a30 con 0x55a433c881d0 2024-09-10T05:39:58.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.635+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 59 ==== osd_op_reply(231 gc.2 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.635+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:39:58.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.635+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:232 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c881d0 2024-09-10T05:39:58.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.635+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 60 ==== osd_op_reply(232 gc.2 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.635+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.635+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:233 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c881d0 2024-09-10T05:39:58.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.639+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 61 ==== osd_op_reply(233 gc.2 [call] v34'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.639+0000 7f248d0d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-10T05:39:58.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.639+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:234 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c80510 2024-09-10T05:39:58.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.639+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 58 ==== osd_op_reply(234 gc.3 [call] v34'289 uv289 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.639+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:235 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c80510 2024-09-10T05:39:58.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.639+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 59 ==== osd_op_reply(235 gc.3 [call out=15b] v0'0 uv289 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.639+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.643+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:236 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c80510 2024-09-10T05:39:58.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.643+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 60 ==== osd_op_reply(236 gc.3 [call out=24b] v0'0 uv289 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.643+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:237 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c80510 2024-09-10T05:39:58.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.643+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 61 ==== osd_op_reply(237 gc.3 [call out=15b] v0'0 uv289 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.643+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:39:58.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.643+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:238 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c80510 2024-09-10T05:39:58.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.643+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 62 ==== osd_op_reply(238 gc.3 [call out=15b] v0'0 uv289 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.643+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.643+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:239 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c80510 2024-09-10T05:39:58.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.647+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 63 ==== osd_op_reply(239 gc.3 [call] v34'290 uv290 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.647+0000 7f248d0d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-10T05:39:58.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.647+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:240 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c849d0 2024-09-10T05:39:58.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.651+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 81 ==== osd_op_reply(240 gc.4 [call] v34'94 uv94 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.651+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:241 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c849d0 2024-09-10T05:39:58.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.651+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 82 ==== osd_op_reply(241 gc.4 [call out=15b] v0'0 uv94 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.651+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.651+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:242 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c849d0 2024-09-10T05:39:58.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.651+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 83 ==== osd_op_reply(242 gc.4 [call out=24b] v0'0 uv94 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.651+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:243 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c849d0 2024-09-10T05:39:58.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.651+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 84 ==== osd_op_reply(243 gc.4 [call out=15b] v0'0 uv94 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.655+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:39:58.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.655+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:244 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c849d0 2024-09-10T05:39:58.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.655+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 85 ==== osd_op_reply(244 gc.4 [call out=15b] v0'0 uv94 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.655+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.655+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:245 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c849d0 2024-09-10T05:39:58.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.659+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 86 ==== osd_op_reply(245 gc.4 [call] v34'95 uv95 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.659+0000 7f248d0d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-10T05:39:58.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.659+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:246 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c881d0 2024-09-10T05:39:58.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.659+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 62 ==== osd_op_reply(246 gc.5 [call] v34'71 uv71 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.659+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:247 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c881d0 2024-09-10T05:39:58.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.663+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 63 ==== osd_op_reply(247 gc.5 [call out=15b] v0'0 uv71 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.663+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.663+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:248 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c881d0 2024-09-10T05:39:58.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.663+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 64 ==== osd_op_reply(248 gc.5 [call out=24b] v0'0 uv71 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.663+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:249 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c881d0 2024-09-10T05:39:58.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.663+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 65 ==== osd_op_reply(249 gc.5 [call out=15b] v0'0 uv71 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.663+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:39:58.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.663+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:250 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c881d0 2024-09-10T05:39:58.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.663+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 66 ==== osd_op_reply(250 gc.5 [call out=15b] v0'0 uv71 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.663+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.663+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:251 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c881d0 2024-09-10T05:39:58.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.667+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 67 ==== osd_op_reply(251 gc.5 [call] v34'72 uv72 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.667+0000 7f248d0d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-10T05:39:58.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.667+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:252 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c849d0 2024-09-10T05:39:58.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.671+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 87 ==== osd_op_reply(252 gc.6 [call] v34'44 uv44 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.671+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:253 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c849d0 2024-09-10T05:39:58.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.671+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 88 ==== osd_op_reply(253 gc.6 [call out=15b] v0'0 uv44 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.671+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.671+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:254 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c849d0 2024-09-10T05:39:58.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.671+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 89 ==== osd_op_reply(254 gc.6 [call out=24b] v0'0 uv44 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.671+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:255 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c849d0 2024-09-10T05:39:58.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.671+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 90 ==== osd_op_reply(255 gc.6 [call out=15b] v0'0 uv44 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.671+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:39:58.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.671+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:256 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c849d0 2024-09-10T05:39:58.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.675+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 91 ==== osd_op_reply(256 gc.6 [call out=15b] v0'0 uv44 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.675+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.675+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:257 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c849d0 2024-09-10T05:39:58.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.675+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 92 ==== osd_op_reply(257 gc.6 [call] v34'45 uv45 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.675+0000 7f248d0d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-10T05:39:58.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.675+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:258 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c80510 2024-09-10T05:39:58.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.679+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 64 ==== osd_op_reply(258 gc.7 [call] v34'65 uv65 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.679+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:259 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c80510 2024-09-10T05:39:58.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.679+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 65 ==== osd_op_reply(259 gc.7 [call out=15b] v0'0 uv65 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.679+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.679+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:260 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c80510 2024-09-10T05:39:58.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.679+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 66 ==== osd_op_reply(260 gc.7 [call out=24b] v0'0 uv65 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.679+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:261 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c80510 2024-09-10T05:39:58.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.683+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 67 ==== osd_op_reply(261 gc.7 [call out=15b] v0'0 uv65 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.683+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:39:58.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.683+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:262 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c80510 2024-09-10T05:39:58.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.683+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 68 ==== osd_op_reply(262 gc.7 [call out=15b] v0'0 uv65 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.683+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.683+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:263 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c80510 2024-09-10T05:39:58.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.683+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 69 ==== osd_op_reply(263 gc.7 [call] v34'66 uv66 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.683+0000 7f248d0d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-10T05:39:58.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.683+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:264 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c849d0 2024-09-10T05:39:58.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.687+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 93 ==== osd_op_reply(264 gc.8 [call] v34'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.687+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:265 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c849d0 2024-09-10T05:39:58.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.691+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 94 ==== osd_op_reply(265 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.691+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.691+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:266 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c849d0 2024-09-10T05:39:58.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.691+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 95 ==== osd_op_reply(266 gc.8 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.691+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:267 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c849d0 2024-09-10T05:39:58.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.691+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 96 ==== osd_op_reply(267 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.691+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:39:58.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.691+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:268 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c849d0 2024-09-10T05:39:58.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.695+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 97 ==== osd_op_reply(268 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.695+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.695+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:269 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c849d0 2024-09-10T05:39:58.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.699+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 98 ==== osd_op_reply(269 gc.8 [call] v34'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.699+0000 7f248d0d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-10T05:39:58.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.699+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:270 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c849d0 2024-09-10T05:39:58.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.699+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 99 ==== osd_op_reply(270 gc.9 [call] v34'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.699+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:271 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c849d0 2024-09-10T05:39:58.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.703+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 100 ==== osd_op_reply(271 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.703+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.703+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:272 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c849d0 2024-09-10T05:39:58.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.703+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 101 ==== osd_op_reply(272 gc.9 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.703+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:273 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c849d0 2024-09-10T05:39:58.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.703+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 102 ==== osd_op_reply(273 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.703+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:39:58.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.703+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:274 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c849d0 2024-09-10T05:39:58.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.703+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 103 ==== osd_op_reply(274 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.703+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.703+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:275 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c849d0 2024-09-10T05:39:58.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.707+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 104 ==== osd_op_reply(275 gc.9 [call] v34'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.707+0000 7f248d0d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-10T05:39:58.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.707+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:276 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c849d0 2024-09-10T05:39:58.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.711+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 105 ==== osd_op_reply(276 gc.10 [call] v34'96 uv96 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.711+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:277 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c849d0 2024-09-10T05:39:58.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.711+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 106 ==== osd_op_reply(277 gc.10 [call out=15b] v0'0 uv96 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.711+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.711+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:278 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c849d0 2024-09-10T05:39:58.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.715+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 107 ==== osd_op_reply(278 gc.10 [call out=24b] v0'0 uv96 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.715+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:279 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c849d0 2024-09-10T05:39:58.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.715+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 108 ==== osd_op_reply(279 gc.10 [call out=15b] v0'0 uv96 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.715+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:39:58.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.715+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:280 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c849d0 2024-09-10T05:39:58.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.715+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 109 ==== osd_op_reply(280 gc.10 [call out=15b] v0'0 uv96 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.715+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.715+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:281 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c849d0 2024-09-10T05:39:58.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.719+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 110 ==== osd_op_reply(281 gc.10 [call] v34'97 uv97 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.719+0000 7f248d0d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-10T05:39:58.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.719+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:282 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c881d0 2024-09-10T05:39:58.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.723+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 68 ==== osd_op_reply(282 gc.11 [call] v34'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.723+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:283 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c881d0 2024-09-10T05:39:58.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.723+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 69 ==== osd_op_reply(283 gc.11 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.723+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.723+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:284 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c881d0 2024-09-10T05:39:58.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.723+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 70 ==== osd_op_reply(284 gc.11 [call out=24b] v0'0 uv43 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.723+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:285 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c881d0 2024-09-10T05:39:58.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.723+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 71 ==== osd_op_reply(285 gc.11 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.723+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:39:58.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.723+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:286 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c881d0 2024-09-10T05:39:58.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.723+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 72 ==== osd_op_reply(286 gc.11 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.723+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.723+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:287 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c881d0 2024-09-10T05:39:58.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.727+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 73 ==== osd_op_reply(287 gc.11 [call] v34'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.727+0000 7f248d0d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-10T05:39:58.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.727+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:288 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c849d0 2024-09-10T05:39:58.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.731+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 111 ==== osd_op_reply(288 gc.12 [call] v34'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.731+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:289 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c849d0 2024-09-10T05:39:58.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.731+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 112 ==== osd_op_reply(289 gc.12 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.731+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.731+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:290 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c849d0 2024-09-10T05:39:58.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.731+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 113 ==== osd_op_reply(290 gc.12 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.731+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:291 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c849d0 2024-09-10T05:39:58.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.735+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 114 ==== osd_op_reply(291 gc.12 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.735+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:39:58.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.735+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:292 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c849d0 2024-09-10T05:39:58.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.735+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 115 ==== osd_op_reply(292 gc.12 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.735+0000 7f248d0d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:39:58.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.735+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:293 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c849d0 2024-09-10T05:39:58.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.739+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 116 ==== osd_op_reply(293 gc.12 [call] v34'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.739+0000 7f23417e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:39:58.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.739+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94163731823200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c80510 2024-09-10T05:39:58.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.743+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 70 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94163731823200] v34'291 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.743+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94163731800272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c849d0 2024-09-10T05:39:58.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.747+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 117 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94163731800272] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.747+0000 7f248d0d79c0 20 remove_watcher() i=0 2024-09-10T05:39:58.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.747+0000 7f248d0d79c0 2 removed watcher, disabling cache 2024-09-10T05:39:58.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.747+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94163731806576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c80510 2024-09-10T05:39:58.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.747+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.1 v2:172.21.15.62:6808/3442097179 71 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94163731806576] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24840083f0 con 0x55a433c80510 2024-09-10T05:39:58.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.747+0000 7f248d0d79c0 20 remove_watcher() i=1 2024-09-10T05:39:58.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.747+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94163731802480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c849d0 2024-09-10T05:39:58.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.751+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 118 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94163731802480] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.751+0000 7f248d0d79c0 20 remove_watcher() i=2 2024-09-10T05:39:58.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.751+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94163731814032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x7f247c114060 2024-09-10T05:39:58.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.755+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.2 v2:172.21.15.62:6800/2677868286 36 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94163731814032] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24840083f0 con 0x7f247c114060 2024-09-10T05:39:58.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.755+0000 7f248d0d79c0 20 remove_watcher() i=3 2024-09-10T05:39:58.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.755+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94163731815088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c849d0 2024-09-10T05:39:58.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.755+0000 7f248abdd640 1 -- 172.21.15.62:0/749411572 <== osd.0 v2:172.21.15.2:6800/945139080 119 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94163731815088] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f247c111030 con 0x55a433c849d0 2024-09-10T05:39:58.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.755+0000 7f248d0d79c0 20 remove_watcher() i=4 2024-09-10T05:39:58.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.755+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94163731818928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c881d0 2024-09-10T05:39:58.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.759+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 74 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94163731818928] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.759+0000 7f248d0d79c0 20 remove_watcher() i=5 2024-09-10T05:39:58.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.759+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94163731819984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x55a433c881d0 2024-09-10T05:39:58.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.759+0000 7f248a3dc640 1 -- 172.21.15.62:0/749411572 <== osd.3 v2:172.21.15.62:6816/2708991149 75 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94163731819984] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f248000d040 con 0x55a433c881d0 2024-09-10T05:39:58.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.763+0000 7f248d0d79c0 20 remove_watcher() i=6 2024-09-10T05:39:58.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.763+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94163731821552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a433cbef10 con 0x7f247c114060 2024-09-10T05:39:58.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.763+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 <== osd.2 v2:172.21.15.62:6800/2677868286 37 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94163731821552] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24840083f0 con 0x7f247c114060 2024-09-10T05:39:58.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.763+0000 7f248d0d79c0 20 remove_watcher() i=7 2024-09-10T05:39:58.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.763+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55a433c849d0 msgr2=0x55a433c86dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:39:58.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.763+0000 7f248d0d79c0 1 --2- 172.21.15.62:0/749411572 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55a433c849d0 0x55a433c86dc0 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:39:58.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.763+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55a433c80510 msgr2=0x55a433c829d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:39:58.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.763+0000 7f248d0d79c0 1 --2- 172.21.15.62:0/749411572 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55a433c80510 0x55a433c829d0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:39:58.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.763+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f247c114060 msgr2=0x7f247c0cd060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:39:58.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.763+0000 7f248d0d79c0 1 --2- 172.21.15.62:0/749411572 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f247c114060 0x7f247c0cd060 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:39:58.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.763+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55a433c881d0 msgr2=0x55a433c8a5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:39:58.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.763+0000 7f248d0d79c0 1 --2- 172.21.15.62:0/749411572 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55a433c881d0 0x55a433c8a5c0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:39:58.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.763+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f23540399d0 msgr2=0x7f235403be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:39:58.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.763+0000 7f248d0d79c0 1 --2- 172.21.15.62:0/749411572 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f23540399d0 0x7f235403be90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x55a433c4f950 tx=0x7f2480011000 comp rx=0 tx=0).stop 2024-09-10T05:39:58.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.763+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a433c6e340 msgr2=0x55a433c756d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:39:58.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.763+0000 7f248d0d79c0 1 --2- 172.21.15.62:0/749411572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a433c6e340 0x55a433c756d0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f247c0b0fd0 tx=0x7f247c0efea0 comp rx=0 tx=0).stop 2024-09-10T05:39:58.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.763+0000 7f248b3de640 1 -- 172.21.15.62:0/749411572 reap_dead start 2024-09-10T05:39:58.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.763+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 shutdown_connections 2024-09-10T05:39:58.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.763+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 >> 172.21.15.62:0/749411572 conn(0x55a433c6a770 msgr2=0x55a433c68980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:39:58.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.763+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 shutdown_connections 2024-09-10T05:39:58.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.763+0000 7f248d0d79c0 1 -- 172.21.15.62:0/749411572 wait complete. 2024-09-10T05:39:58.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.763+0000 7f248d0d79c0 1 -- 172.21.15.62:0/4241595804 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2364039a70 msgr2=0x7f236403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:39:58.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.763+0000 7f248d0d79c0 1 --2- 172.21.15.62:0/4241595804 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2364039a70 0x7f236403bf30 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x55a433c45420 tx=0x7f2480006000 comp rx=0 tx=0).stop 2024-09-10T05:39:58.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.763+0000 7f248d0d79c0 1 -- 172.21.15.62:0/4241595804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a433c61c50 msgr2=0x55a433c62070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:39:58.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.763+0000 7f248d0d79c0 1 --2- 172.21.15.62:0/4241595804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a433c61c50 0x55a433c62070 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f247c0bee20 tx=0x7f247c0bddf0 comp rx=0 tx=0).stop 2024-09-10T05:39:58.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.767+0000 7f248d0d79c0 1 -- 172.21.15.62:0/4241595804 shutdown_connections 2024-09-10T05:39:58.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.767+0000 7f248d0d79c0 1 --2- 172.21.15.62:0/4241595804 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2364039a70 0x7f236403bf30 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:39:58.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.767+0000 7f248d0d79c0 1 --2- 172.21.15.62:0/4241595804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a433c61c50 0x55a433c62070 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:39:58.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.767+0000 7f248d0d79c0 1 -- 172.21.15.62:0/4241595804 >> 172.21.15.62:0/4241595804 conn(0x55a433c57600 msgr2=0x55a433c579e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:39:58.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.767+0000 7f248d0d79c0 1 -- 172.21.15.62:0/4241595804 shutdown_connections 2024-09-10T05:39:58.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.767+0000 7f248d0d79c0 1 -- 172.21.15.62:0/4241595804 wait complete. 2024-09-10T05:39:58.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.767+0000 7f248d0d79c0 1 -- 172.21.15.62:0/3079658343 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55a433c4c320 msgr2=0x55a433c4e710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:39:58.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.767+0000 7f248d0d79c0 1 --2- 172.21.15.62:0/3079658343 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x55a433c4c320 0x55a433c4e710 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:39:58.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.767+0000 7f248d0d79c0 1 -- 172.21.15.62:0/3079658343 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55a433b52170 msgr2=0x55a433c4b080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:39:58.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.767+0000 7f248d0d79c0 1 --2- 172.21.15.62:0/3079658343 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x55a433b52170 0x55a433c4b080 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:39:58.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.767+0000 7f248d0d79c0 1 -- 172.21.15.62:0/3079658343 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55a433c50ae0 msgr2=0x55a433c52ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:39:58.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.767+0000 7f248d0d79c0 1 --2- 172.21.15.62:0/3079658343 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x55a433c50ae0 0x55a433c52ed0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:39:58.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.767+0000 7f248d0d79c0 1 -- 172.21.15.62:0/3079658343 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2370039a70 msgr2=0x7f237003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:39:58.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.767+0000 7f248d0d79c0 1 --2- 172.21.15.62:0/3079658343 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2370039a70 0x7f237003bf30 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2480001e60 tx=0x7f24800013e0 comp rx=0 tx=0).stop 2024-09-10T05:39:58.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.767+0000 7f248d0d79c0 1 -- 172.21.15.62:0/3079658343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a433ac3200 msgr2=0x55a433c43f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:39:58.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.767+0000 7f248d0d79c0 1 --2- 172.21.15.62:0/3079658343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a433ac3200 0x55a433c43f10 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f247c01b930 tx=0x7f247c017e30 comp rx=0 tx=0).stop 2024-09-10T05:39:58.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.767+0000 7f248b3de640 1 -- 172.21.15.62:0/3079658343 reap_dead start 2024-09-10T05:39:58.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.767+0000 7f248d0d79c0 1 -- 172.21.15.62:0/3079658343 shutdown_connections 2024-09-10T05:39:58.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.767+0000 7f248d0d79c0 1 -- 172.21.15.62:0/3079658343 >> 172.21.15.62:0/3079658343 conn(0x55a433b49920 msgr2=0x55a433b4de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:39:58.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.767+0000 7f248d0d79c0 1 -- 172.21.15.62:0/3079658343 shutdown_connections 2024-09-10T05:39:58.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-10T05:39:58.767+0000 7f248d0d79c0 1 -- 172.21.15.62:0/3079658343 wait complete. 2024-09-10T05:39:58.789 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-10T05:39:58.798 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T05:39:58.798 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T05:39:58.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:58.929+0000 7fc7a8029640 1 Processor -- start 2024-09-10T05:39:58.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:58.929+0000 7fc7a8029640 1 -- start start 2024-09-10T05:39:58.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:58.929+0000 7fc7a8029640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc7a0111890 0x7fc7a0132450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:39:58.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:58.929+0000 7fc7a8029640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7a0073a90 con 0x7fc7a0110da0 2024-09-10T05:39:58.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:58.929+0000 7fc7a8029640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fc7a00696e0 con 0x7fc7a0111890 2024-09-10T05:39:58.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:58.929+0000 7fc7a55c4640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc7a0111890 0x7fc7a0132450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:39:58.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:58.929+0000 7fc7a5dc5640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc7a0110da0 0x7fc7a0111180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48554/0 (socket says 172.21.15.2:48554) 2024-09-10T05:39:58.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:58.929+0000 7fc7a5dc5640 1 -- 172.21.15.2:0/1068610705 learned_addr learned my addr 172.21.15.2:0/1068610705 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T05:39:58.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:58.929+0000 7fc7a55c4640 1 -- 172.21.15.2:0/1068610705 >> v1:172.21.15.2:6789/0 conn(0x7fc7a0110da0 legacy=0x7fc7a0111180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:39:58.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:58.929+0000 7fc7a55c4640 1 -- 172.21.15.2:0/1068610705 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7a006dd50 con 0x7fc7a0111890 2024-09-10T05:39:58.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:58.929+0000 7fc7a55c4640 1 --2- 172.21.15.2:0/1068610705 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7a0111890 0x7fc7a0132450 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fc790009740 tx=0x7fc79001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73e55a855da03a37 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:39:58.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:58.929+0000 7fc7a4dc3640 1 -- 172.21.15.2:0/1068610705 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7900b0070 con 0x7fc7a0111890 2024-09-10T05:39:58.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:58.933+0000 7fc7a4dc3640 1 -- 172.21.15.2:0/1068610705 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7900ab530 con 0x7fc7a0111890 2024-09-10T05:39:58.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:58.933+0000 7fc7a4dc3640 1 -- 172.21.15.2:0/1068610705 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7900ab830 con 0x7fc7a0111890 2024-09-10T05:39:58.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:58.933+0000 7fc7a8029640 1 -- 172.21.15.2:0/1068610705 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7a0111890 msgr2=0x7fc7a0132450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:39:58.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:58.933+0000 7fc7a8029640 1 --2- 172.21.15.2:0/1068610705 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7a0111890 0x7fc7a0132450 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fc790009740 tx=0x7fc79001c370 comp rx=0 tx=0).stop 2024-09-10T05:39:58.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:58.933+0000 7fc7a8029640 1 -- 172.21.15.2:0/1068610705 shutdown_connections 2024-09-10T05:39:58.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:58.933+0000 7fc7a8029640 1 --2- 172.21.15.2:0/1068610705 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7a0111890 0x7fc7a0132450 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:39:58.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:58.933+0000 7fc7a8029640 1 -- 172.21.15.2:0/1068610705 >> 172.21.15.2:0/1068610705 conn(0x7fc7a0070900 msgr2=0x7fc7a0072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:39:58.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:58.933+0000 7fc7a8029640 1 -- 172.21.15.2:0/1068610705 shutdown_connections 2024-09-10T05:39:58.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:58.933+0000 7fc7a8029640 1 -- 172.21.15.2:0/1068610705 wait complete. 2024-09-10T05:39:58.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:58.933+0000 7fc7a8029640 1 Processor -- start 2024-09-10T05:39:58.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:58.933+0000 7fc7a8029640 1 -- start start 2024-09-10T05:39:58.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:58.933+0000 7fc7a8029640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7a0110da0 0x7fc7a012f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:39:58.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:58.933+0000 7fc7a8029640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a0135330 con 0x7fc7a0110da0 2024-09-10T05:39:58.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:58.933+0000 7fc7a5dc5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7a0110da0 0x7fc7a012f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:39:58.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:58.933+0000 7fc7a5dc5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7a0110da0 0x7fc7a012f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35422/0 (socket says 172.21.15.2:35422) 2024-09-10T05:39:58.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:58.933+0000 7fc7a5dc5640 1 -- 172.21.15.2:0/3960492759 learned_addr learned my addr 172.21.15.2:0/3960492759 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:39:58.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:58.933+0000 7fc7a5dc5640 1 -- 172.21.15.2:0/3960492759 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7a01323a0 con 0x7fc7a0110da0 2024-09-10T05:39:58.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:58.933+0000 7fc7a5dc5640 1 --2- 172.21.15.2:0/3960492759 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7a0110da0 0x7fc7a012f890 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fc79c00c480 tx=0x7fc79c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:39:58.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:58.933+0000 7fc7967fc640 1 -- 172.21.15.2:0/3960492759 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc79c017070 con 0x7fc7a0110da0 2024-09-10T05:39:58.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:58.933+0000 7fc7967fc640 1 -- 172.21.15.2:0/3960492759 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc79c005c20 con 0x7fc7a0110da0 2024-09-10T05:39:58.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:58.933+0000 7fc7a8029640 1 -- 172.21.15.2:0/3960492759 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7a01320c0 con 0x7fc7a0110da0 2024-09-10T05:39:58.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:58.933+0000 7fc7967fc640 1 -- 172.21.15.2:0/3960492759 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc79c0070d0 con 0x7fc7a0110da0 2024-09-10T05:39:58.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:58.933+0000 7fc7a8029640 1 -- 172.21.15.2:0/3960492759 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7a012fdd0 con 0x7fc7a0110da0 2024-09-10T05:39:58.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:58.933+0000 7fc7a8029640 1 -- 172.21.15.2:0/3960492759 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7a0111180 con 0x7fc7a0110da0 2024-09-10T05:39:58.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:58.933+0000 7fc7967fc640 1 -- 172.21.15.2:0/3960492759 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc79c01a070 con 0x7fc7a0110da0 2024-09-10T05:39:58.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:58.937+0000 7fc7967fc640 1 --2- 172.21.15.2:0/3960492759 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc78403b1d0 0x7fc78403d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:39:58.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:58.937+0000 7fc7967fc640 1 -- 172.21.15.2:0/3960492759 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7fc79c04e9c0 con 0x7fc7a0110da0 2024-09-10T05:39:58.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:58.937+0000 7fc7a55c4640 1 --2- 172.21.15.2:0/3960492759 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc78403b1d0 0x7fc78403d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:39:58.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:58.937+0000 7fc7a55c4640 1 --2- 172.21.15.2:0/3960492759 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc78403b1d0 0x7fc78403d690 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc7900ad000 tx=0x7fc7900a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:39:58.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:58.941+0000 7fc7967fc640 1 -- 172.21.15.2:0/3960492759 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fc79c01ad80 con 0x7fc7a0110da0 2024-09-10T05:39:59.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.109+0000 7fc7a8029640 1 -- 172.21.15.2:0/3960492759 --> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc7a0131c70 con 0x7fc78403b1d0 2024-09-10T05:39:59.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.153+0000 7fc7967fc640 1 -- 172.21.15.2:0/3960492759 <== mgr.4101 v2:172.21.15.62:6824/3663628807 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665574 (secure 0 0 0) 0x7fc7a0131c70 con 0x7fc78403b1d0 2024-09-10T05:39:59.164 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T05:39:59.170 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-10T05:39:59.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.161+0000 7fc7a8029640 1 -- 172.21.15.2:0/3960492759 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc78403b1d0 msgr2=0x7fc78403d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:39:59.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.161+0000 7fc7a8029640 1 --2- 172.21.15.2:0/3960492759 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc78403b1d0 0x7fc78403d690 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc7900ad000 tx=0x7fc7900a6000 comp rx=0 tx=0).stop 2024-09-10T05:39:59.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.161+0000 7fc7a8029640 1 -- 172.21.15.2:0/3960492759 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7a0110da0 msgr2=0x7fc7a012f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:39:59.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.161+0000 7fc7a8029640 1 --2- 172.21.15.2:0/3960492759 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7a0110da0 0x7fc7a012f890 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fc79c00c480 tx=0x7fc79c00c940 comp rx=0 tx=0).stop 2024-09-10T05:39:59.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.161+0000 7fc7a8029640 1 -- 172.21.15.2:0/3960492759 shutdown_connections 2024-09-10T05:39:59.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.161+0000 7fc7a8029640 1 --2- 172.21.15.2:0/3960492759 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc78403b1d0 0x7fc78403d690 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:39:59.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.161+0000 7fc7a8029640 1 --2- 172.21.15.2:0/3960492759 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7a0110da0 0x7fc7a012f890 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:39:59.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.161+0000 7fc7a8029640 1 -- 172.21.15.2:0/3960492759 >> 172.21.15.2:0/3960492759 conn(0x7fc7a0070900 msgr2=0x7fc7a0071ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:39:59.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.161+0000 7fc7a8029640 1 -- 172.21.15.2:0/3960492759 shutdown_connections 2024-09-10T05:39:59.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.161+0000 7fc7a8029640 1 -- 172.21.15.2:0/3960492759 wait complete. 2024-09-10T05:39:59.184 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2024-09-10T05:39:57.695525+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412816,"num_objects":261,"num_object_clones":0,"num_object_copies":522,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":261,"num_whiteouts":0,"num_read":5222,"num_read_kb":4776,"num_write":2242,"num_write_kb":60587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":639982,"num_keys_recovered":1,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4630,"ondisk_log_size":4630,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":190544,"kb_used_data":53328,"kb_used_omap":6,"kb_used_meta":137145,"kb_avail":377296816,"statfs":{"total":386547056640,"available":386351939584,"internally_reserved":0,"allocated":54607872,"data_stored":53388664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":140437270},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006351"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.898799+0000","last_change":"2024-09-10T05:36:11.606846+0000","last_active":"2024-09-10T05:37:55.898799+0000","last_peered":"2024-09-10T05:37:55.898799+0000","last_clean":"2024-09-10T05:37:55.898799+0000","last_became_active":"2024-09-10T05:36:11.605721+0000","last_became_peered":"2024-09-10T05:36:11.605721+0000","last_unstale":"2024-09-10T05:37:55.898799+0000","last_undegraded":"2024-09-10T05:37:55.898799+0000","last_fullsized":"2024-09-10T05:37:55.898799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:44:08.530179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"30'2","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.900982+0000","last_change":"2024-09-10T05:36:13.628621+0000","last_active":"2024-09-10T05:37:55.900982+0000","last_peered":"2024-09-10T05:37:55.900982+0000","last_clean":"2024-09-10T05:37:55.900982+0000","last_became_active":"2024-09-10T05:36:13.628174+0000","last_became_peered":"2024-09-10T05:36:13.628174+0000","last_unstale":"2024-09-10T05:37:55.900982+0000","last_undegraded":"2024-09-10T05:37:55.900982+0000","last_fullsized":"2024-09-10T05:37:55.900982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:47.128005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"30'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.856072+0000","last_change":"2024-09-10T05:36:11.596391+0000","last_active":"2024-09-10T05:37:53.856072+0000","last_peered":"2024-09-10T05:37:53.856072+0000","last_clean":"2024-09-10T05:37:53.856072+0000","last_became_active":"2024-09-10T05:36:11.596100+0000","last_became_peered":"2024-09-10T05:36:11.596100+0000","last_unstale":"2024-09-10T05:37:53.856072+0000","last_undegraded":"2024-09-10T05:37:53.856072+0000","last_fullsized":"2024-09-10T05:37:53.856072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:45:53.700310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"34'5","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:43.687749+0000","last_change":"2024-09-10T05:36:13.601197+0000","last_active":"2024-09-10T05:38:43.687749+0000","last_peered":"2024-09-10T05:38:43.687749+0000","last_clean":"2024-09-10T05:38:43.687749+0000","last_became_active":"2024-09-10T05:36:13.598320+0000","last_became_peered":"2024-09-10T05:36:13.598320+0000","last_unstale":"2024-09-10T05:38:43.687749+0000","last_undegraded":"2024-09-10T05:38:43.687749+0000","last_fullsized":"2024-09-10T05:38:43.687749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:38:17.550395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.726285+0000","last_change":"2024-09-10T05:36:11.604217+0000","last_active":"2024-09-10T05:37:53.726285+0000","last_peered":"2024-09-10T05:37:53.726285+0000","last_clean":"2024-09-10T05:37:53.726285+0000","last_became_active":"2024-09-10T05:36:11.603193+0000","last_became_peered":"2024-09-10T05:36:11.603193+0000","last_unstale":"2024-09-10T05:37:53.726285+0000","last_undegraded":"2024-09-10T05:37:53.726285+0000","last_fullsized":"2024-09-10T05:37:53.726285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:09:46.125040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'10","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.200739+0000","last_change":"2024-09-10T05:36:13.604439+0000","last_active":"2024-09-10T05:39:27.200739+0000","last_peered":"2024-09-10T05:39:27.200739+0000","last_clean":"2024-09-10T05:39:27.200739+0000","last_became_active":"2024-09-10T05:36:13.604094+0000","last_became_peered":"2024-09-10T05:36:13.604094+0000","last_unstale":"2024-09-10T05:39:27.200739+0000","last_undegraded":"2024-09-10T05:39:27.200739+0000","last_fullsized":"2024-09-10T05:39:27.200739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:17:01.676891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.713626+0000","last_change":"2024-09-10T05:36:11.611784+0000","last_active":"2024-09-10T05:37:53.713626+0000","last_peered":"2024-09-10T05:37:53.713626+0000","last_clean":"2024-09-10T05:37:53.713626+0000","last_became_active":"2024-09-10T05:36:11.611399+0000","last_became_peered":"2024-09-10T05:36:11.611399+0000","last_unstale":"2024-09-10T05:37:53.713626+0000","last_undegraded":"2024-09-10T05:37:53.713626+0000","last_fullsized":"2024-09-10T05:37:53.713626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:34:57.058604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'10","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.363850+0000","last_change":"2024-09-10T05:36:52.703620+0000","last_active":"2024-09-10T05:39:27.363850+0000","last_peered":"2024-09-10T05:39:27.363850+0000","last_clean":"2024-09-10T05:39:27.363850+0000","last_became_active":"2024-09-10T05:36:52.702713+0000","last_became_peered":"2024-09-10T05:36:52.702713+0000","last_unstale":"2024-09-10T05:39:27.363850+0000","last_undegraded":"2024-09-10T05:39:27.363850+0000","last_fullsized":"2024-09-10T05:39:27.363850+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:09:12.955195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.897222+0000","last_change":"2024-09-10T05:36:11.598408+0000","last_active":"2024-09-10T05:37:55.897222+0000","last_peered":"2024-09-10T05:37:55.897222+0000","last_clean":"2024-09-10T05:37:55.897222+0000","last_became_active":"2024-09-10T05:36:11.597514+0000","last_became_peered":"2024-09-10T05:36:11.597514+0000","last_unstale":"2024-09-10T05:37:55.897222+0000","last_undegraded":"2024-09-10T05:37:55.897222+0000","last_fullsized":"2024-09-10T05:37:55.897222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:23.782584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"34'11","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.024907+0000","last_change":"2024-09-10T05:36:13.622714+0000","last_active":"2024-09-10T05:39:27.024907+0000","last_peered":"2024-09-10T05:39:27.024907+0000","last_clean":"2024-09-10T05:39:27.024907+0000","last_became_active":"2024-09-10T05:36:13.621573+0000","last_became_peered":"2024-09-10T05:36:13.621573+0000","last_unstale":"2024-09-10T05:39:27.024907+0000","last_undegraded":"2024-09-10T05:39:27.024907+0000","last_fullsized":"2024-09-10T05:39:27.024907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:33.906083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.902223+0000","last_change":"2024-09-10T05:36:52.704991+0000","last_active":"2024-09-10T05:37:55.902223+0000","last_peered":"2024-09-10T05:37:55.902223+0000","last_clean":"2024-09-10T05:37:55.902223+0000","last_became_active":"2024-09-10T05:36:52.704285+0000","last_became_peered":"2024-09-10T05:36:52.704285+0000","last_unstale":"2024-09-10T05:37:55.902223+0000","last_undegraded":"2024-09-10T05:37:55.902223+0000","last_fullsized":"2024-09-10T05:37:55.902223+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:31:44.000002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.905524+0000","last_change":"2024-09-10T05:36:13.613130+0000","last_active":"2024-09-10T05:37:55.905524+0000","last_peered":"2024-09-10T05:37:55.905524+0000","last_clean":"2024-09-10T05:37:55.905524+0000","last_became_active":"2024-09-10T05:36:13.612127+0000","last_became_peered":"2024-09-10T05:36:13.612127+0000","last_unstale":"2024-09-10T05:37:55.905524+0000","last_undegraded":"2024-09-10T05:37:55.905524+0000","last_fullsized":"2024-09-10T05:37:55.905524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:55:15.649785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.723024+0000","last_change":"2024-09-10T05:36:11.598434+0000","last_active":"2024-09-10T05:37:53.723024+0000","last_peered":"2024-09-10T05:37:53.723024+0000","last_clean":"2024-09-10T05:37:53.723024+0000","last_became_active":"2024-09-10T05:36:11.598054+0000","last_became_peered":"2024-09-10T05:36:11.598054+0000","last_unstale":"2024-09-10T05:37:53.723024+0000","last_undegraded":"2024-09-10T05:37:53.723024+0000","last_fullsized":"2024-09-10T05:37:53.723024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:15:17.547203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'8","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.905442+0000","last_change":"2024-09-10T05:36:13.613557+0000","last_active":"2024-09-10T05:37:55.905442+0000","last_peered":"2024-09-10T05:37:55.905442+0000","last_clean":"2024-09-10T05:37:55.905442+0000","last_became_active":"2024-09-10T05:36:13.612743+0000","last_became_peered":"2024-09-10T05:36:13.612743+0000","last_unstale":"2024-09-10T05:37:55.905442+0000","last_undegraded":"2024-09-10T05:37:55.905442+0000","last_fullsized":"2024-09-10T05:37:55.905442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:46:09.360826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.721935+0000","last_change":"2024-09-10T05:36:11.593912+0000","last_active":"2024-09-10T05:37:53.721935+0000","last_peered":"2024-09-10T05:37:53.721935+0000","last_clean":"2024-09-10T05:37:53.721935+0000","last_became_active":"2024-09-10T05:36:11.593454+0000","last_became_peered":"2024-09-10T05:36:11.593454+0000","last_unstale":"2024-09-10T05:37:53.721935+0000","last_undegraded":"2024-09-10T05:37:53.721935+0000","last_fullsized":"2024-09-10T05:37:53.721935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:50:30.548750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"34'10","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.861683+0000","last_change":"2024-09-10T05:36:13.621644+0000","last_active":"2024-09-10T05:39:26.861683+0000","last_peered":"2024-09-10T05:39:26.861683+0000","last_clean":"2024-09-10T05:39:26.861683+0000","last_became_active":"2024-09-10T05:36:13.621362+0000","last_became_peered":"2024-09-10T05:36:13.621362+0000","last_unstale":"2024-09-10T05:39:26.861683+0000","last_undegraded":"2024-09-10T05:39:26.861683+0000","last_fullsized":"2024-09-10T05:39:26.861683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:44:10.159543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.295664+0000","last_change":"2024-09-10T05:36:13.628746+0000","last_active":"2024-09-10T05:39:27.295664+0000","last_peered":"2024-09-10T05:39:27.295664+0000","last_clean":"2024-09-10T05:39:27.295664+0000","last_became_active":"2024-09-10T05:36:13.628203+0000","last_became_peered":"2024-09-10T05:36:13.628203+0000","last_unstale":"2024-09-10T05:39:27.295664+0000","last_undegraded":"2024-09-10T05:39:27.295664+0000","last_fullsized":"2024-09-10T05:39:27.295664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:15:01.197465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"30'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.860067+0000","last_change":"2024-09-10T05:36:11.595338+0000","last_active":"2024-09-10T05:37:53.860067+0000","last_peered":"2024-09-10T05:37:53.860067+0000","last_clean":"2024-09-10T05:37:53.860067+0000","last_became_active":"2024-09-10T05:36:11.594409+0000","last_became_peered":"2024-09-10T05:36:11.594409+0000","last_unstale":"2024-09-10T05:37:53.860067+0000","last_undegraded":"2024-09-10T05:37:53.860067+0000","last_fullsized":"2024-09-10T05:37:53.860067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:40:54.327881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'8","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.314170+0000","last_change":"2024-09-10T05:36:13.620594+0000","last_active":"2024-09-10T05:39:27.314170+0000","last_peered":"2024-09-10T05:39:27.314170+0000","last_clean":"2024-09-10T05:39:27.314170+0000","last_became_active":"2024-09-10T05:36:13.619905+0000","last_became_peered":"2024-09-10T05:36:13.619905+0000","last_unstale":"2024-09-10T05:39:27.314170+0000","last_undegraded":"2024-09-10T05:39:27.314170+0000","last_fullsized":"2024-09-10T05:39:27.314170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:43:07.884535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.716388+0000","last_change":"2024-09-10T05:36:11.612156+0000","last_active":"2024-09-10T05:37:53.716388+0000","last_peered":"2024-09-10T05:37:53.716388+0000","last_clean":"2024-09-10T05:37:53.716388+0000","last_became_active":"2024-09-10T05:36:11.611735+0000","last_became_peered":"2024-09-10T05:36:11.611735+0000","last_unstale":"2024-09-10T05:37:53.716388+0000","last_undegraded":"2024-09-10T05:37:53.716388+0000","last_fullsized":"2024-09-10T05:37:53.716388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:25:27.078667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'18","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.364017+0000","last_change":"2024-09-10T05:36:13.625084+0000","last_active":"2024-09-10T05:39:27.364017+0000","last_peered":"2024-09-10T05:39:27.364017+0000","last_clean":"2024-09-10T05:39:27.364017+0000","last_became_active":"2024-09-10T05:36:13.624358+0000","last_became_peered":"2024-09-10T05:36:13.624358+0000","last_unstale":"2024-09-10T05:39:27.364017+0000","last_undegraded":"2024-09-10T05:39:27.364017+0000","last_fullsized":"2024-09-10T05:39:27.364017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:03:25.809000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":77,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"34'4","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.188377+0000","last_change":"2024-09-10T05:36:11.608840+0000","last_active":"2024-09-10T05:39:27.188377+0000","last_peered":"2024-09-10T05:39:27.188377+0000","last_clean":"2024-09-10T05:39:27.188377+0000","last_became_active":"2024-09-10T05:36:11.608244+0000","last_became_peered":"2024-09-10T05:36:11.608244+0000","last_unstale":"2024-09-10T05:39:27.188377+0000","last_undegraded":"2024-09-10T05:39:27.188377+0000","last_fullsized":"2024-09-10T05:39:27.188377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:54:31.346128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"32'24","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.714987+0000","last_change":"2024-09-10T05:36:13.614877+0000","last_active":"2024-09-10T05:37:53.714987+0000","last_peered":"2024-09-10T05:37:53.714987+0000","last_clean":"2024-09-10T05:37:53.714987+0000","last_became_active":"2024-09-10T05:36:13.613298+0000","last_became_peered":"2024-09-10T05:36:13.613298+0000","last_unstale":"2024-09-10T05:37:53.714987+0000","last_undegraded":"2024-09-10T05:37:53.714987+0000","last_fullsized":"2024-09-10T05:37:53.714987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:36:36.280933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":77,"num_write":32,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"32'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.896973+0000","last_change":"2024-09-10T05:36:11.600946+0000","last_active":"2024-09-10T05:37:55.896973+0000","last_peered":"2024-09-10T05:37:55.896973+0000","last_clean":"2024-09-10T05:37:55.896973+0000","last_became_active":"2024-09-10T05:36:11.600159+0000","last_became_peered":"2024-09-10T05:36:11.600159+0000","last_unstale":"2024-09-10T05:37:55.896973+0000","last_undegraded":"2024-09-10T05:37:55.896973+0000","last_fullsized":"2024-09-10T05:37:55.896973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:17:55.025975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"34'10","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.465170+0000","last_change":"2024-09-10T05:36:13.610326+0000","last_active":"2024-09-10T05:39:27.465170+0000","last_peered":"2024-09-10T05:39:27.465170+0000","last_clean":"2024-09-10T05:39:27.465170+0000","last_became_active":"2024-09-10T05:36:13.605913+0000","last_became_peered":"2024-09-10T05:36:13.605913+0000","last_unstale":"2024-09-10T05:39:27.465170+0000","last_undegraded":"2024-09-10T05:39:27.465170+0000","last_fullsized":"2024-09-10T05:39:27.465170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:40:06.248271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"34'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:17.692508+0000","last_change":"2024-09-10T05:36:52.721595+0000","last_active":"2024-09-10T05:39:17.692508+0000","last_peered":"2024-09-10T05:39:17.692508+0000","last_clean":"2024-09-10T05:39:17.692508+0000","last_became_active":"2024-09-10T05:36:52.701277+0000","last_became_peered":"2024-09-10T05:36:52.701277+0000","last_unstale":"2024-09-10T05:39:17.692508+0000","last_undegraded":"2024-09-10T05:39:17.692508+0000","last_fullsized":"2024-09-10T05:39:17.692508+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:20:16.743547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3,"num_write_kb":1250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":639872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.855635+0000","last_change":"2024-09-10T05:36:13.600360+0000","last_active":"2024-09-10T05:37:53.855635+0000","last_peered":"2024-09-10T05:37:53.855635+0000","last_clean":"2024-09-10T05:37:53.855635+0000","last_became_active":"2024-09-10T05:36:13.599955+0000","last_became_peered":"2024-09-10T05:36:13.599955+0000","last_unstale":"2024-09-10T05:37:53.855635+0000","last_undegraded":"2024-09-10T05:37:53.855635+0000","last_fullsized":"2024-09-10T05:37:53.855635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:12:25.023354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.158891+0000","last_change":"2024-09-10T05:36:11.606469+0000","last_active":"2024-09-10T05:39:27.158891+0000","last_peered":"2024-09-10T05:39:27.158891+0000","last_clean":"2024-09-10T05:39:27.158891+0000","last_became_active":"2024-09-10T05:36:11.603982+0000","last_became_peered":"2024-09-10T05:36:11.603982+0000","last_unstale":"2024-09-10T05:39:27.158891+0000","last_undegraded":"2024-09-10T05:39:27.158891+0000","last_fullsized":"2024-09-10T05:39:27.158891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:27:57.248963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'35","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.250994+0000","last_change":"2024-09-10T05:36:21.673756+0000","last_active":"2024-09-10T05:39:27.250994+0000","last_peered":"2024-09-10T05:39:27.250994+0000","last_clean":"2024-09-10T05:39:27.250994+0000","last_became_active":"2024-09-10T05:36:21.672975+0000","last_became_peered":"2024-09-10T05:36:21.672975+0000","last_unstale":"2024-09-10T05:39:27.250994+0000","last_undegraded":"2024-09-10T05:39:27.250994+0000","last_fullsized":"2024-09-10T05:39:27.250994+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:09:28.929715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'10","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.200652+0000","last_change":"2024-09-10T05:36:13.616306+0000","last_active":"2024-09-10T05:39:27.200652+0000","last_peered":"2024-09-10T05:39:27.200652+0000","last_clean":"2024-09-10T05:39:27.200652+0000","last_became_active":"2024-09-10T05:36:13.616006+0000","last_became_peered":"2024-09-10T05:36:13.616006+0000","last_unstale":"2024-09-10T05:39:27.200652+0000","last_undegraded":"2024-09-10T05:39:27.200652+0000","last_fullsized":"2024-09-10T05:39:27.200652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:12:47.354260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.725430+0000","last_change":"2024-09-10T05:36:11.606773+0000","last_active":"2024-09-10T05:37:53.725430+0000","last_peered":"2024-09-10T05:37:53.725430+0000","last_clean":"2024-09-10T05:37:53.725430+0000","last_became_active":"2024-09-10T05:36:11.601101+0000","last_became_peered":"2024-09-10T05:36:11.601101+0000","last_unstale":"2024-09-10T05:37:53.725430+0000","last_undegraded":"2024-09-10T05:37:53.725430+0000","last_fullsized":"2024-09-10T05:37:53.725430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:18:28.907356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.727535+0000","last_change":"2024-09-10T05:36:15.626686+0000","last_active":"2024-09-10T05:37:53.727535+0000","last_peered":"2024-09-10T05:37:53.727535+0000","last_clean":"2024-09-10T05:37:53.727535+0000","last_became_active":"2024-09-10T05:36:15.626172+0000","last_became_peered":"2024-09-10T05:36:15.626172+0000","last_unstale":"2024-09-10T05:37:53.727535+0000","last_undegraded":"2024-09-10T05:37:53.727535+0000","last_fullsized":"2024-09-10T05:37:53.727535+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:39:20.579324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'42","reported_seq":101,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.023324+0000","last_change":"2024-09-10T05:36:17.640065+0000","last_active":"2024-09-10T05:38:24.023324+0000","last_peered":"2024-09-10T05:38:24.023324+0000","last_clean":"2024-09-10T05:38:24.023324+0000","last_became_active":"2024-09-10T05:36:17.639318+0000","last_became_peered":"2024-09-10T05:36:17.639318+0000","last_unstale":"2024-09-10T05:38:24.023324+0000","last_undegraded":"2024-09-10T05:38:24.023324+0000","last_fullsized":"2024-09-10T05:38:24.023324+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:05:59.617319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.898449+0000","last_change":"2024-09-10T05:36:19.648793+0000","last_active":"2024-09-10T05:37:55.898449+0000","last_peered":"2024-09-10T05:37:55.898449+0000","last_clean":"2024-09-10T05:37:55.898449+0000","last_became_active":"2024-09-10T05:36:19.647998+0000","last_became_peered":"2024-09-10T05:36:19.647998+0000","last_unstale":"2024-09-10T05:37:55.898449+0000","last_undegraded":"2024-09-10T05:37:55.898449+0000","last_fullsized":"2024-09-10T05:37:55.898449+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:14:38.933277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"32'9","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.899552+0000","last_change":"2024-09-10T05:36:21.673262+0000","last_active":"2024-09-10T05:37:55.899552+0000","last_peered":"2024-09-10T05:37:55.899552+0000","last_clean":"2024-09-10T05:37:55.899552+0000","last_became_active":"2024-09-10T05:36:21.672757+0000","last_became_peered":"2024-09-10T05:36:21.672757+0000","last_unstale":"2024-09-10T05:37:55.899552+0000","last_undegraded":"2024-09-10T05:37:55.899552+0000","last_fullsized":"2024-09-10T05:37:55.899552+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:49:20.130241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"32'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.727360+0000","last_change":"2024-09-10T05:36:13.598805+0000","last_active":"2024-09-10T05:37:53.727360+0000","last_peered":"2024-09-10T05:37:53.727360+0000","last_clean":"2024-09-10T05:37:53.727360+0000","last_became_active":"2024-09-10T05:36:13.597649+0000","last_became_peered":"2024-09-10T05:36:13.597649+0000","last_unstale":"2024-09-10T05:37:53.727360+0000","last_undegraded":"2024-09-10T05:37:53.727360+0000","last_fullsized":"2024-09-10T05:37:53.727360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:02:19.101449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.711943+0000","last_change":"2024-09-10T05:36:11.611702+0000","last_active":"2024-09-10T05:37:53.711943+0000","last_peered":"2024-09-10T05:37:53.711943+0000","last_clean":"2024-09-10T05:37:53.711943+0000","last_became_active":"2024-09-10T05:36:11.611326+0000","last_became_peered":"2024-09-10T05:36:11.611326+0000","last_unstale":"2024-09-10T05:37:53.711943+0000","last_undegraded":"2024-09-10T05:37:53.711943+0000","last_fullsized":"2024-09-10T05:37:53.711943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:06:03.034626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.725805+0000","last_change":"2024-09-10T05:36:15.608668+0000","last_active":"2024-09-10T05:37:53.725805+0000","last_peered":"2024-09-10T05:37:53.725805+0000","last_clean":"2024-09-10T05:37:53.725805+0000","last_became_active":"2024-09-10T05:36:15.607918+0000","last_became_peered":"2024-09-10T05:36:15.607918+0000","last_unstale":"2024-09-10T05:37:53.725805+0000","last_undegraded":"2024-09-10T05:37:53.725805+0000","last_fullsized":"2024-09-10T05:37:53.725805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:57.614009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"30'12","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.859373+0000","last_change":"2024-09-10T05:36:17.644680+0000","last_active":"2024-09-10T05:37:53.859373+0000","last_peered":"2024-09-10T05:37:53.859373+0000","last_clean":"2024-09-10T05:37:53.859373+0000","last_became_active":"2024-09-10T05:36:17.643856+0000","last_became_peered":"2024-09-10T05:36:17.643856+0000","last_unstale":"2024-09-10T05:37:53.859373+0000","last_undegraded":"2024-09-10T05:37:53.859373+0000","last_fullsized":"2024-09-10T05:37:53.859373+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:31:24.591766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.899864+0000","last_change":"2024-09-10T05:36:19.648357+0000","last_active":"2024-09-10T05:37:55.899864+0000","last_peered":"2024-09-10T05:37:55.899864+0000","last_clean":"2024-09-10T05:37:55.899864+0000","last_became_active":"2024-09-10T05:36:19.647612+0000","last_became_peered":"2024-09-10T05:36:19.647612+0000","last_unstale":"2024-09-10T05:37:55.899864+0000","last_undegraded":"2024-09-10T05:37:55.899864+0000","last_fullsized":"2024-09-10T05:37:55.899864+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:06:01.493680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"34'10","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.344196+0000","last_change":"2024-09-10T05:36:21.679828+0000","last_active":"2024-09-10T05:39:26.344196+0000","last_peered":"2024-09-10T05:39:26.344196+0000","last_clean":"2024-09-10T05:39:26.344196+0000","last_became_active":"2024-09-10T05:36:21.679052+0000","last_became_peered":"2024-09-10T05:36:21.679052+0000","last_unstale":"2024-09-10T05:39:26.344196+0000","last_undegraded":"2024-09-10T05:39:26.344196+0000","last_fullsized":"2024-09-10T05:39:26.344196+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:53.565670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.729075+0000","last_change":"2024-09-10T05:36:13.612634+0000","last_active":"2024-09-10T05:37:53.729075+0000","last_peered":"2024-09-10T05:37:53.729075+0000","last_clean":"2024-09-10T05:37:53.729075+0000","last_became_active":"2024-09-10T05:36:13.611935+0000","last_became_peered":"2024-09-10T05:36:13.611935+0000","last_unstale":"2024-09-10T05:37:53.729075+0000","last_undegraded":"2024-09-10T05:37:53.729075+0000","last_fullsized":"2024-09-10T05:37:53.729075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:11.305578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.897677+0000","last_change":"2024-09-10T05:36:11.596948+0000","last_active":"2024-09-10T05:37:55.897677+0000","last_peered":"2024-09-10T05:37:55.897677+0000","last_clean":"2024-09-10T05:37:55.897677+0000","last_became_active":"2024-09-10T05:36:11.596047+0000","last_became_peered":"2024-09-10T05:36:11.596047+0000","last_unstale":"2024-09-10T05:37:55.897677+0000","last_undegraded":"2024-09-10T05:37:55.897677+0000","last_fullsized":"2024-09-10T05:37:55.897677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:36:34.651568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.729520+0000","last_change":"2024-09-10T05:36:15.636316+0000","last_active":"2024-09-10T05:37:53.729520+0000","last_peered":"2024-09-10T05:37:53.729520+0000","last_clean":"2024-09-10T05:37:53.729520+0000","last_became_active":"2024-09-10T05:36:15.635534+0000","last_became_peered":"2024-09-10T05:36:15.635534+0000","last_unstale":"2024-09-10T05:37:53.729520+0000","last_undegraded":"2024-09-10T05:37:53.729520+0000","last_fullsized":"2024-09-10T05:37:53.729520+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:51:10.736802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"30'23","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.715019+0000","last_change":"2024-09-10T05:36:17.630853+0000","last_active":"2024-09-10T05:37:53.715019+0000","last_peered":"2024-09-10T05:37:53.715019+0000","last_clean":"2024-09-10T05:37:53.715019+0000","last_became_active":"2024-09-10T05:36:17.626936+0000","last_became_peered":"2024-09-10T05:36:17.626936+0000","last_unstale":"2024-09-10T05:37:53.715019+0000","last_undegraded":"2024-09-10T05:37:53.715019+0000","last_fullsized":"2024-09-10T05:37:53.715019+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:27:38.243510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'282","reported_seq":391,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.551691+0000","last_change":"2024-09-10T05:36:19.665303+0000","last_active":"2024-09-10T05:39:27.551691+0000","last_peered":"2024-09-10T05:39:27.551691+0000","last_clean":"2024-09-10T05:39:27.551691+0000","last_became_active":"2024-09-10T05:36:19.664741+0000","last_became_peered":"2024-09-10T05:36:19.664741+0000","last_unstale":"2024-09-10T05:39:27.551691+0000","last_undegraded":"2024-09-10T05:39:27.551691+0000","last_fullsized":"2024-09-10T05:39:27.551691+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:34:14.254885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"34'2","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:21.797711+0000","last_change":"2024-09-10T05:36:21.657298+0000","last_active":"2024-09-10T05:38:21.797711+0000","last_peered":"2024-09-10T05:38:21.797711+0000","last_clean":"2024-09-10T05:38:21.797711+0000","last_became_active":"2024-09-10T05:36:21.656522+0000","last_became_peered":"2024-09-10T05:36:21.656522+0000","last_unstale":"2024-09-10T05:38:21.797711+0000","last_undegraded":"2024-09-10T05:38:21.797711+0000","last_fullsized":"2024-09-10T05:38:21.797711+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:46:36.764173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'8","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.883202+0000","last_change":"2024-09-10T05:36:13.623674+0000","last_active":"2024-09-10T05:39:26.883202+0000","last_peered":"2024-09-10T05:39:26.883202+0000","last_clean":"2024-09-10T05:39:26.883202+0000","last_became_active":"2024-09-10T05:36:13.622771+0000","last_became_peered":"2024-09-10T05:36:13.622771+0000","last_unstale":"2024-09-10T05:39:26.883202+0000","last_undegraded":"2024-09-10T05:39:26.883202+0000","last_fullsized":"2024-09-10T05:39:26.883202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:10.534366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"32'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.898045+0000","last_change":"2024-09-10T05:36:11.598113+0000","last_active":"2024-09-10T05:37:55.898045+0000","last_peered":"2024-09-10T05:37:55.898045+0000","last_clean":"2024-09-10T05:37:55.898045+0000","last_became_active":"2024-09-10T05:36:11.596165+0000","last_became_peered":"2024-09-10T05:36:11.596165+0000","last_unstale":"2024-09-10T05:37:55.898045+0000","last_undegraded":"2024-09-10T05:37:55.898045+0000","last_fullsized":"2024-09-10T05:37:55.898045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:34.424848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.905564+0000","last_change":"2024-09-10T05:36:15.616568+0000","last_active":"2024-09-10T05:37:55.905564+0000","last_peered":"2024-09-10T05:37:55.905564+0000","last_clean":"2024-09-10T05:37:55.905564+0000","last_became_active":"2024-09-10T05:36:15.615994+0000","last_became_peered":"2024-09-10T05:36:15.615994+0000","last_unstale":"2024-09-10T05:37:55.905564+0000","last_undegraded":"2024-09-10T05:37:55.905564+0000","last_fullsized":"2024-09-10T05:37:55.905564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:15:00.093895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"34'36","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.012568+0000","last_change":"2024-09-10T05:36:17.631891+0000","last_active":"2024-09-10T05:38:24.012568+0000","last_peered":"2024-09-10T05:38:24.012568+0000","last_clean":"2024-09-10T05:38:24.012568+0000","last_became_active":"2024-09-10T05:36:17.631054+0000","last_became_peered":"2024-09-10T05:36:17.631054+0000","last_unstale":"2024-09-10T05:38:24.012568+0000","last_undegraded":"2024-09-10T05:38:24.012568+0000","last_fullsized":"2024-09-10T05:38:24.012568+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:59.553249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"34'282","reported_seq":407,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.372296+0000","last_change":"2024-09-10T05:36:19.671507+0000","last_active":"2024-09-10T05:39:27.372296+0000","last_peered":"2024-09-10T05:39:27.372296+0000","last_clean":"2024-09-10T05:39:27.372296+0000","last_became_active":"2024-09-10T05:36:19.670915+0000","last_became_peered":"2024-09-10T05:36:19.670915+0000","last_unstale":"2024-09-10T05:39:27.372296+0000","last_undegraded":"2024-09-10T05:39:27.372296+0000","last_fullsized":"2024-09-10T05:39:27.372296+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:35.175677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"34'8","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.859732+0000","last_change":"2024-09-10T05:36:13.598359+0000","last_active":"2024-09-10T05:39:26.859732+0000","last_peered":"2024-09-10T05:39:26.859732+0000","last_clean":"2024-09-10T05:39:26.859732+0000","last_became_active":"2024-09-10T05:36:13.597477+0000","last_became_peered":"2024-09-10T05:36:13.597477+0000","last_unstale":"2024-09-10T05:39:26.859732+0000","last_undegraded":"2024-09-10T05:39:26.859732+0000","last_fullsized":"2024-09-10T05:39:26.859732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:33.752285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.899248+0000","last_change":"2024-09-10T05:36:11.601343+0000","last_active":"2024-09-10T05:37:55.899248+0000","last_peered":"2024-09-10T05:37:55.899248+0000","last_clean":"2024-09-10T05:37:55.899248+0000","last_became_active":"2024-09-10T05:36:11.600405+0000","last_became_peered":"2024-09-10T05:36:11.600405+0000","last_unstale":"2024-09-10T05:37:55.899248+0000","last_undegraded":"2024-09-10T05:37:55.899248+0000","last_fullsized":"2024-09-10T05:37:55.899248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:06:53.012489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.857307+0000","last_change":"2024-09-10T05:36:15.624083+0000","last_active":"2024-09-10T05:37:53.857307+0000","last_peered":"2024-09-10T05:37:53.857307+0000","last_clean":"2024-09-10T05:37:53.857307+0000","last_became_active":"2024-09-10T05:36:15.620908+0000","last_became_peered":"2024-09-10T05:36:15.620908+0000","last_unstale":"2024-09-10T05:37:53.857307+0000","last_undegraded":"2024-09-10T05:37:53.857307+0000","last_fullsized":"2024-09-10T05:37:53.857307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:18:19.390635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'47","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.031891+0000","last_change":"2024-09-10T05:36:52.763550+0000","last_active":"2024-09-10T05:38:24.031891+0000","last_peered":"2024-09-10T05:38:24.031891+0000","last_clean":"2024-09-10T05:38:24.031891+0000","last_became_active":"2024-09-10T05:36:52.710284+0000","last_became_peered":"2024-09-10T05:36:52.710284+0000","last_unstale":"2024-09-10T05:38:24.031891+0000","last_undegraded":"2024-09-10T05:38:24.031891+0000","last_fullsized":"2024-09-10T05:38:24.031891+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:08.202725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.853131+0000","last_change":"2024-09-10T05:36:19.641236+0000","last_active":"2024-09-10T05:37:53.853131+0000","last_peered":"2024-09-10T05:37:53.853131+0000","last_clean":"2024-09-10T05:37:53.853131+0000","last_became_active":"2024-09-10T05:36:19.640470+0000","last_became_peered":"2024-09-10T05:36:19.640470+0000","last_unstale":"2024-09-10T05:37:53.853131+0000","last_undegraded":"2024-09-10T05:37:53.853131+0000","last_fullsized":"2024-09-10T05:37:53.853131+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:38.686660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"32'3","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.715202+0000","last_change":"2024-09-10T05:36:21.665615+0000","last_active":"2024-09-10T05:37:53.715202+0000","last_peered":"2024-09-10T05:37:53.715202+0000","last_clean":"2024-09-10T05:37:53.715202+0000","last_became_active":"2024-09-10T05:36:21.664232+0000","last_became_peered":"2024-09-10T05:36:21.664232+0000","last_unstale":"2024-09-10T05:37:53.715202+0000","last_undegraded":"2024-09-10T05:37:53.715202+0000","last_fullsized":"2024-09-10T05:37:53.715202+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:22:54.635544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'2","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.296681+0000","last_change":"2024-09-10T05:36:52.704557+0000","last_active":"2024-09-10T05:39:27.296681+0000","last_peered":"2024-09-10T05:39:27.296681+0000","last_clean":"2024-09-10T05:39:27.296681+0000","last_became_active":"2024-09-10T05:36:52.703743+0000","last_became_peered":"2024-09-10T05:36:52.703743+0000","last_unstale":"2024-09-10T05:39:27.296681+0000","last_undegraded":"2024-09-10T05:39:27.296681+0000","last_fullsized":"2024-09-10T05:39:27.296681+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:08:22.378233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.899208+0000","last_change":"2024-09-10T05:36:11.599409+0000","last_active":"2024-09-10T05:37:55.899208+0000","last_peered":"2024-09-10T05:37:55.899208+0000","last_clean":"2024-09-10T05:37:55.899208+0000","last_became_active":"2024-09-10T05:36:11.597717+0000","last_became_peered":"2024-09-10T05:36:11.597717+0000","last_unstale":"2024-09-10T05:37:55.899208+0000","last_undegraded":"2024-09-10T05:37:55.899208+0000","last_fullsized":"2024-09-10T05:37:55.899208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:31:10.630773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.712459+0000","last_change":"2024-09-10T05:36:15.632405+0000","last_active":"2024-09-10T05:37:53.712459+0000","last_peered":"2024-09-10T05:37:53.712459+0000","last_clean":"2024-09-10T05:37:53.712459+0000","last_became_active":"2024-09-10T05:36:15.631635+0000","last_became_peered":"2024-09-10T05:36:15.631635+0000","last_unstale":"2024-09-10T05:37:53.712459+0000","last_undegraded":"2024-09-10T05:37:53.712459+0000","last_fullsized":"2024-09-10T05:37:53.712459+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:17:58.666673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"34'36","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:23.991157+0000","last_change":"2024-09-10T05:36:17.638936+0000","last_active":"2024-09-10T05:38:23.991157+0000","last_peered":"2024-09-10T05:38:23.991157+0000","last_clean":"2024-09-10T05:38:23.991157+0000","last_became_active":"2024-09-10T05:36:17.638301+0000","last_became_peered":"2024-09-10T05:36:17.638301+0000","last_unstale":"2024-09-10T05:38:23.991157+0000","last_undegraded":"2024-09-10T05:38:23.991157+0000","last_fullsized":"2024-09-10T05:38:23.991157+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:17.394424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.725401+0000","last_change":"2024-09-10T05:36:19.671665+0000","last_active":"2024-09-10T05:37:53.725401+0000","last_peered":"2024-09-10T05:37:53.725401+0000","last_clean":"2024-09-10T05:37:53.725401+0000","last_became_active":"2024-09-10T05:36:19.671022+0000","last_became_peered":"2024-09-10T05:36:19.671022+0000","last_unstale":"2024-09-10T05:37:53.725401+0000","last_undegraded":"2024-09-10T05:37:53.725401+0000","last_fullsized":"2024-09-10T05:37:53.725401+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:52:58.839879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"32'3","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.854472+0000","last_change":"2024-09-10T05:36:21.667571+0000","last_active":"2024-09-10T05:37:53.854472+0000","last_peered":"2024-09-10T05:37:53.854472+0000","last_clean":"2024-09-10T05:37:53.854472+0000","last_became_active":"2024-09-10T05:36:21.666042+0000","last_became_peered":"2024-09-10T05:36:21.666042+0000","last_unstale":"2024-09-10T05:37:53.854472+0000","last_undegraded":"2024-09-10T05:37:53.854472+0000","last_fullsized":"2024-09-10T05:37:53.854472+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:39.262665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'13","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.222570+0000","last_change":"2024-09-10T05:36:52.713178+0000","last_active":"2024-09-10T05:39:27.222570+0000","last_peered":"2024-09-10T05:39:27.222570+0000","last_clean":"2024-09-10T05:39:27.222570+0000","last_became_active":"2024-09-10T05:36:52.696116+0000","last_became_peered":"2024-09-10T05:36:52.696116+0000","last_unstale":"2024-09-10T05:39:27.222570+0000","last_undegraded":"2024-09-10T05:39:27.222570+0000","last_fullsized":"2024-09-10T05:39:27.222570+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:19:34.691310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.897741+0000","last_change":"2024-09-10T05:36:11.607638+0000","last_active":"2024-09-10T05:37:55.897741+0000","last_peered":"2024-09-10T05:37:55.897741+0000","last_clean":"2024-09-10T05:37:55.897741+0000","last_became_active":"2024-09-10T05:36:11.606576+0000","last_became_peered":"2024-09-10T05:36:11.606576+0000","last_unstale":"2024-09-10T05:37:55.897741+0000","last_undegraded":"2024-09-10T05:37:55.897741+0000","last_fullsized":"2024-09-10T05:37:55.897741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:18:24.850629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.712965+0000","last_change":"2024-09-10T05:36:15.618352+0000","last_active":"2024-09-10T05:37:53.712965+0000","last_peered":"2024-09-10T05:37:53.712965+0000","last_clean":"2024-09-10T05:37:53.712965+0000","last_became_active":"2024-09-10T05:36:15.617647+0000","last_became_peered":"2024-09-10T05:36:15.617647+0000","last_unstale":"2024-09-10T05:37:53.712965+0000","last_undegraded":"2024-09-10T05:37:53.712965+0000","last_fullsized":"2024-09-10T05:37:53.712965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:04:41.335062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"34'49","reported_seq":111,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.035913+0000","last_change":"2024-09-10T05:36:17.636835+0000","last_active":"2024-09-10T05:38:24.035913+0000","last_peered":"2024-09-10T05:38:24.035913+0000","last_clean":"2024-09-10T05:38:24.035913+0000","last_became_active":"2024-09-10T05:36:17.636000+0000","last_became_peered":"2024-09-10T05:36:17.636000+0000","last_unstale":"2024-09-10T05:38:24.035913+0000","last_undegraded":"2024-09-10T05:38:24.035913+0000","last_fullsized":"2024-09-10T05:38:24.035913+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:10:22.233813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"34'282","reported_seq":354,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.565613+0000","last_change":"2024-09-10T05:36:19.664630+0000","last_active":"2024-09-10T05:39:27.565613+0000","last_peered":"2024-09-10T05:39:27.565613+0000","last_clean":"2024-09-10T05:39:27.565613+0000","last_became_active":"2024-09-10T05:36:19.663950+0000","last_became_peered":"2024-09-10T05:36:19.663950+0000","last_unstale":"2024-09-10T05:39:27.565613+0000","last_undegraded":"2024-09-10T05:39:27.565613+0000","last_fullsized":"2024-09-10T05:39:27.565613+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:53.165826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"32'2","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.854389+0000","last_change":"2024-09-10T05:36:21.691277+0000","last_active":"2024-09-10T05:37:53.854389+0000","last_peered":"2024-09-10T05:37:53.854389+0000","last_clean":"2024-09-10T05:37:53.854389+0000","last_became_active":"2024-09-10T05:36:21.690772+0000","last_became_peered":"2024-09-10T05:36:21.690772+0000","last_unstale":"2024-09-10T05:37:53.854389+0000","last_undegraded":"2024-09-10T05:37:53.854389+0000","last_fullsized":"2024-09-10T05:37:53.854389+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:17:39.487372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"34'6","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.364489+0000","last_change":"2024-09-10T05:36:13.612369+0000","last_active":"2024-09-10T05:39:27.364489+0000","last_peered":"2024-09-10T05:39:27.364489+0000","last_clean":"2024-09-10T05:39:27.364489+0000","last_became_active":"2024-09-10T05:36:13.611694+0000","last_became_peered":"2024-09-10T05:36:13.611694+0000","last_unstale":"2024-09-10T05:39:27.364489+0000","last_undegraded":"2024-09-10T05:39:27.364489+0000","last_fullsized":"2024-09-10T05:39:27.364489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:25.411949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.897408+0000","last_change":"2024-09-10T05:36:11.607748+0000","last_active":"2024-09-10T05:37:55.897408+0000","last_peered":"2024-09-10T05:37:55.897408+0000","last_clean":"2024-09-10T05:37:55.897408+0000","last_became_active":"2024-09-10T05:36:11.606957+0000","last_became_peered":"2024-09-10T05:36:11.606957+0000","last_unstale":"2024-09-10T05:37:55.897408+0000","last_undegraded":"2024-09-10T05:37:55.897408+0000","last_fullsized":"2024-09-10T05:37:55.897408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:51:30.178935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.712437+0000","last_change":"2024-09-10T05:36:15.632297+0000","last_active":"2024-09-10T05:37:53.712437+0000","last_peered":"2024-09-10T05:37:53.712437+0000","last_clean":"2024-09-10T05:37:53.712437+0000","last_became_active":"2024-09-10T05:36:15.631551+0000","last_became_peered":"2024-09-10T05:36:15.631551+0000","last_unstale":"2024-09-10T05:37:53.712437+0000","last_undegraded":"2024-09-10T05:37:53.712437+0000","last_fullsized":"2024-09-10T05:37:53.712437+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:38:35.217361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"34'66","reported_seq":139,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.040124+0000","last_change":"2024-09-10T05:36:17.651071+0000","last_active":"2024-09-10T05:38:24.040124+0000","last_peered":"2024-09-10T05:38:24.040124+0000","last_clean":"2024-09-10T05:38:24.040124+0000","last_became_active":"2024-09-10T05:36:17.650601+0000","last_became_peered":"2024-09-10T05:36:17.650601+0000","last_unstale":"2024-09-10T05:38:24.040124+0000","last_undegraded":"2024-09-10T05:38:24.040124+0000","last_fullsized":"2024-09-10T05:38:24.040124+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:33:18.024305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":30,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.712799+0000","last_change":"2024-09-10T05:36:19.638840+0000","last_active":"2024-09-10T05:37:53.712799+0000","last_peered":"2024-09-10T05:37:53.712799+0000","last_clean":"2024-09-10T05:37:53.712799+0000","last_became_active":"2024-09-10T05:36:19.638087+0000","last_became_peered":"2024-09-10T05:36:19.638087+0000","last_unstale":"2024-09-10T05:37:53.712799+0000","last_undegraded":"2024-09-10T05:37:53.712799+0000","last_fullsized":"2024-09-10T05:37:53.712799+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:43:13.922357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"34'18","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.525874+0000","last_change":"2024-09-10T05:36:21.681112+0000","last_active":"2024-09-10T05:39:27.525874+0000","last_peered":"2024-09-10T05:39:27.525874+0000","last_clean":"2024-09-10T05:39:27.525874+0000","last_became_active":"2024-09-10T05:36:21.680246+0000","last_became_peered":"2024-09-10T05:36:21.680246+0000","last_unstale":"2024-09-10T05:39:27.525874+0000","last_undegraded":"2024-09-10T05:39:27.525874+0000","last_fullsized":"2024-09-10T05:39:27.525874+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:41.764675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"34'5","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:07.690351+0000","last_change":"2024-09-10T05:36:52.725901+0000","last_active":"2024-09-10T05:39:07.690351+0000","last_peered":"2024-09-10T05:39:07.690351+0000","last_clean":"2024-09-10T05:39:07.690351+0000","last_became_active":"2024-09-10T05:36:52.702912+0000","last_became_peered":"2024-09-10T05:36:52.702912+0000","last_unstale":"2024-09-10T05:39:07.690351+0000","last_undegraded":"2024-09-10T05:39:07.690351+0000","last_fullsized":"2024-09-10T05:39:07.690351+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:30:22.591725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.165811+0000","last_change":"2024-09-10T05:36:11.608535+0000","last_active":"2024-09-10T05:39:27.165811+0000","last_peered":"2024-09-10T05:39:27.165811+0000","last_clean":"2024-09-10T05:39:27.165811+0000","last_became_active":"2024-09-10T05:36:11.606930+0000","last_became_peered":"2024-09-10T05:36:11.606930+0000","last_unstale":"2024-09-10T05:39:27.165811+0000","last_undegraded":"2024-09-10T05:39:27.165811+0000","last_fullsized":"2024-09-10T05:39:27.165811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:23:14.287549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.714198+0000","last_change":"2024-09-10T05:36:15.617401+0000","last_active":"2024-09-10T05:37:53.714198+0000","last_peered":"2024-09-10T05:37:53.714198+0000","last_clean":"2024-09-10T05:37:53.714198+0000","last_became_active":"2024-09-10T05:36:15.616975+0000","last_became_peered":"2024-09-10T05:36:15.616975+0000","last_unstale":"2024-09-10T05:37:53.714198+0000","last_undegraded":"2024-09-10T05:37:53.714198+0000","last_fullsized":"2024-09-10T05:37:53.714198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:18:28.491327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'42","reported_seq":96,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:32.690954+0000","last_change":"2024-09-10T05:36:17.651377+0000","last_active":"2024-09-10T05:38:32.690954+0000","last_peered":"2024-09-10T05:38:32.690954+0000","last_clean":"2024-09-10T05:38:32.690954+0000","last_became_active":"2024-09-10T05:36:17.650522+0000","last_became_peered":"2024-09-10T05:36:17.650522+0000","last_unstale":"2024-09-10T05:38:32.690954+0000","last_undegraded":"2024-09-10T05:38:32.690954+0000","last_fullsized":"2024-09-10T05:38:32.690954+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:31:03.454940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.728744+0000","last_change":"2024-09-10T05:36:19.664052+0000","last_active":"2024-09-10T05:37:53.728744+0000","last_peered":"2024-09-10T05:37:53.728744+0000","last_clean":"2024-09-10T05:37:53.728744+0000","last_became_active":"2024-09-10T05:36:19.663287+0000","last_became_peered":"2024-09-10T05:36:19.663287+0000","last_unstale":"2024-09-10T05:37:53.728744+0000","last_undegraded":"2024-09-10T05:37:53.728744+0000","last_fullsized":"2024-09-10T05:37:53.728744+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:39.277013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'5","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.028076+0000","last_change":"2024-09-10T05:36:21.664412+0000","last_active":"2024-09-10T05:39:27.028076+0000","last_peered":"2024-09-10T05:39:27.028076+0000","last_clean":"2024-09-10T05:39:27.028076+0000","last_became_active":"2024-09-10T05:36:21.663661+0000","last_became_peered":"2024-09-10T05:36:21.663661+0000","last_unstale":"2024-09-10T05:39:27.028076+0000","last_undegraded":"2024-09-10T05:39:27.028076+0000","last_fullsized":"2024-09-10T05:39:27.028076+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:53.553843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'5","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.024835+0000","last_change":"2024-09-10T05:36:13.631202+0000","last_active":"2024-09-10T05:39:27.024835+0000","last_peered":"2024-09-10T05:39:27.024835+0000","last_clean":"2024-09-10T05:39:27.024835+0000","last_became_active":"2024-09-10T05:36:13.630386+0000","last_became_peered":"2024-09-10T05:36:13.630386+0000","last_unstale":"2024-09-10T05:39:27.024835+0000","last_undegraded":"2024-09-10T05:39:27.024835+0000","last_fullsized":"2024-09-10T05:39:27.024835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:36.024873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.897689+0000","last_change":"2024-09-10T05:36:11.598765+0000","last_active":"2024-09-10T05:37:55.897689+0000","last_peered":"2024-09-10T05:37:55.897689+0000","last_clean":"2024-09-10T05:37:55.897689+0000","last_became_active":"2024-09-10T05:36:11.597935+0000","last_became_peered":"2024-09-10T05:36:11.597935+0000","last_unstale":"2024-09-10T05:37:55.897689+0000","last_undegraded":"2024-09-10T05:37:55.897689+0000","last_fullsized":"2024-09-10T05:37:55.897689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:06:01.704380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.853934+0000","last_change":"2024-09-10T05:36:15.619918+0000","last_active":"2024-09-10T05:37:53.853934+0000","last_peered":"2024-09-10T05:37:53.853934+0000","last_clean":"2024-09-10T05:37:53.853934+0000","last_became_active":"2024-09-10T05:36:15.619388+0000","last_became_peered":"2024-09-10T05:36:15.619388+0000","last_unstale":"2024-09-10T05:37:53.853934+0000","last_undegraded":"2024-09-10T05:37:53.853934+0000","last_fullsized":"2024-09-10T05:37:53.853934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:26.033372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"34'36","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.051975+0000","last_change":"2024-09-10T05:36:17.638791+0000","last_active":"2024-09-10T05:38:24.051975+0000","last_peered":"2024-09-10T05:38:24.051975+0000","last_clean":"2024-09-10T05:38:24.051975+0000","last_became_active":"2024-09-10T05:36:17.636568+0000","last_became_peered":"2024-09-10T05:36:17.636568+0000","last_unstale":"2024-09-10T05:38:24.051975+0000","last_undegraded":"2024-09-10T05:38:24.051975+0000","last_fullsized":"2024-09-10T05:38:24.051975+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:58.268199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'282","reported_seq":409,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.536932+0000","last_change":"2024-09-10T05:36:19.667395+0000","last_active":"2024-09-10T05:39:27.536932+0000","last_peered":"2024-09-10T05:39:27.536932+0000","last_clean":"2024-09-10T05:39:27.536932+0000","last_became_active":"2024-09-10T05:36:19.666610+0000","last_became_peered":"2024-09-10T05:36:19.666610+0000","last_unstale":"2024-09-10T05:39:27.536932+0000","last_undegraded":"2024-09-10T05:39:27.536932+0000","last_fullsized":"2024-09-10T05:39:27.536932+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:22:18.017142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'12","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:27.686883+0000","last_change":"2024-09-10T05:36:21.669588+0000","last_active":"2024-09-10T05:38:27.686883+0000","last_peered":"2024-09-10T05:38:27.686883+0000","last_clean":"2024-09-10T05:38:27.686883+0000","last_became_active":"2024-09-10T05:36:21.668641+0000","last_became_peered":"2024-09-10T05:36:21.668641+0000","last_unstale":"2024-09-10T05:38:27.686883+0000","last_undegraded":"2024-09-10T05:38:27.686883+0000","last_fullsized":"2024-09-10T05:38:27.686883+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:59.764142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"34'7","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:27.681562+0000","last_change":"2024-09-10T05:36:13.609927+0000","last_active":"2024-09-10T05:38:27.681562+0000","last_peered":"2024-09-10T05:38:27.681562+0000","last_clean":"2024-09-10T05:38:27.681562+0000","last_became_active":"2024-09-10T05:36:13.605112+0000","last_became_peered":"2024-09-10T05:36:13.605112+0000","last_unstale":"2024-09-10T05:38:27.681562+0000","last_undegraded":"2024-09-10T05:38:27.681562+0000","last_fullsized":"2024-09-10T05:38:27.681562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:54:32.975492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.722448+0000","last_change":"2024-09-10T05:36:11.606136+0000","last_active":"2024-09-10T05:37:53.722448+0000","last_peered":"2024-09-10T05:37:53.722448+0000","last_clean":"2024-09-10T05:37:53.722448+0000","last_became_active":"2024-09-10T05:36:11.600833+0000","last_became_peered":"2024-09-10T05:36:11.600833+0000","last_unstale":"2024-09-10T05:37:53.722448+0000","last_undegraded":"2024-09-10T05:37:53.722448+0000","last_fullsized":"2024-09-10T05:37:53.722448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:30:30.034878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'3","reported_seq":418,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:25.599083+0000","last_change":"2024-09-10T05:36:15.636516+0000","last_active":"2024-09-10T05:38:25.599083+0000","last_peered":"2024-09-10T05:38:25.599083+0000","last_clean":"2024-09-10T05:38:25.599083+0000","last_became_active":"2024-09-10T05:36:15.635670+0000","last_became_peered":"2024-09-10T05:36:15.635670+0000","last_unstale":"2024-09-10T05:38:25.599083+0000","last_undegraded":"2024-09-10T05:38:25.599083+0000","last_fullsized":"2024-09-10T05:38:25.599083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:38:23.956906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.726176+0000","last_change":"2024-09-10T05:36:17.639202+0000","last_active":"2024-09-10T05:37:53.726176+0000","last_peered":"2024-09-10T05:37:53.726176+0000","last_clean":"2024-09-10T05:37:53.726176+0000","last_became_active":"2024-09-10T05:36:17.633215+0000","last_became_peered":"2024-09-10T05:36:17.633215+0000","last_unstale":"2024-09-10T05:37:53.726176+0000","last_undegraded":"2024-09-10T05:37:53.726176+0000","last_fullsized":"2024-09-10T05:37:53.726176+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:47:38.759892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'282","reported_seq":471,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.479089+0000","last_change":"2024-09-10T05:36:19.650595+0000","last_active":"2024-09-10T05:39:27.479089+0000","last_peered":"2024-09-10T05:39:27.479089+0000","last_clean":"2024-09-10T05:39:27.479089+0000","last_became_active":"2024-09-10T05:36:19.649781+0000","last_became_peered":"2024-09-10T05:36:19.649781+0000","last_unstale":"2024-09-10T05:39:27.479089+0000","last_undegraded":"2024-09-10T05:39:27.479089+0000","last_fullsized":"2024-09-10T05:39:27.479089+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:13:23.575638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:25.756309+0000","last_change":"2024-09-10T05:36:21.665015+0000","last_active":"2024-09-10T05:38:25.756309+0000","last_peered":"2024-09-10T05:38:25.756309+0000","last_clean":"2024-09-10T05:38:25.756309+0000","last_became_active":"2024-09-10T05:36:21.664283+0000","last_became_peered":"2024-09-10T05:36:21.664283+0000","last_unstale":"2024-09-10T05:38:25.756309+0000","last_undegraded":"2024-09-10T05:38:25.756309+0000","last_fullsized":"2024-09-10T05:38:25.756309+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:35:48.390527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'4","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.363782+0000","last_change":"2024-09-10T05:37:53.730744+0000","last_active":"2024-09-10T05:39:27.363782+0000","last_peered":"2024-09-10T05:39:27.363782+0000","last_clean":"2024-09-10T05:39:27.363782+0000","last_became_active":"2024-09-10T05:37:53.724668+0000","last_became_peered":"2024-09-10T05:37:53.724668+0000","last_unstale":"2024-09-10T05:39:27.363782+0000","last_undegraded":"2024-09-10T05:39:27.363782+0000","last_fullsized":"2024-09-10T05:39:27.363782+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:32.648839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"34'3","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:23.682228+0000","last_change":"2024-09-10T05:36:11.598666+0000","last_active":"2024-09-10T05:38:23.682228+0000","last_peered":"2024-09-10T05:38:23.682228+0000","last_clean":"2024-09-10T05:38:23.682228+0000","last_became_active":"2024-09-10T05:36:11.598213+0000","last_became_peered":"2024-09-10T05:36:11.598213+0000","last_unstale":"2024-09-10T05:38:23.682228+0000","last_undegraded":"2024-09-10T05:38:23.682228+0000","last_fullsized":"2024-09-10T05:38:23.682228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:54.224630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.729250+0000","last_change":"2024-09-10T05:36:15.622429+0000","last_active":"2024-09-10T05:37:53.729250+0000","last_peered":"2024-09-10T05:37:53.729250+0000","last_clean":"2024-09-10T05:37:53.729250+0000","last_became_active":"2024-09-10T05:36:15.621697+0000","last_became_peered":"2024-09-10T05:36:15.621697+0000","last_unstale":"2024-09-10T05:37:53.729250+0000","last_undegraded":"2024-09-10T05:37:53.729250+0000","last_fullsized":"2024-09-10T05:37:53.729250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:13:04.950511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'38","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.025920+0000","last_change":"2024-09-10T05:36:17.648212+0000","last_active":"2024-09-10T05:38:24.025920+0000","last_peered":"2024-09-10T05:38:24.025920+0000","last_clean":"2024-09-10T05:38:24.025920+0000","last_became_active":"2024-09-10T05:36:17.647533+0000","last_became_peered":"2024-09-10T05:36:17.647533+0000","last_unstale":"2024-09-10T05:38:24.025920+0000","last_undegraded":"2024-09-10T05:38:24.025920+0000","last_fullsized":"2024-09-10T05:38:24.025920+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:49:23.646157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.896760+0000","last_change":"2024-09-10T05:36:19.641688+0000","last_active":"2024-09-10T05:37:55.896760+0000","last_peered":"2024-09-10T05:37:55.896760+0000","last_clean":"2024-09-10T05:37:55.896760+0000","last_became_active":"2024-09-10T05:36:19.640885+0000","last_became_peered":"2024-09-10T05:36:19.640885+0000","last_unstale":"2024-09-10T05:37:55.896760+0000","last_undegraded":"2024-09-10T05:37:55.896760+0000","last_fullsized":"2024-09-10T05:37:55.896760+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:07.106507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"34'8","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.434518+0000","last_change":"2024-09-10T05:36:21.665178+0000","last_active":"2024-09-10T05:39:27.434518+0000","last_peered":"2024-09-10T05:39:27.434518+0000","last_clean":"2024-09-10T05:39:27.434518+0000","last_became_active":"2024-09-10T05:36:21.664454+0000","last_became_peered":"2024-09-10T05:36:21.664454+0000","last_unstale":"2024-09-10T05:39:27.434518+0000","last_undegraded":"2024-09-10T05:39:27.434518+0000","last_fullsized":"2024-09-10T05:39:27.434518+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:10:47.751838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'6","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.005232+0000","last_change":"2024-09-10T05:36:13.605825+0000","last_active":"2024-09-10T05:39:27.005232+0000","last_peered":"2024-09-10T05:39:27.005232+0000","last_clean":"2024-09-10T05:39:27.005232+0000","last_became_active":"2024-09-10T05:36:13.605318+0000","last_became_peered":"2024-09-10T05:36:13.605318+0000","last_unstale":"2024-09-10T05:39:27.005232+0000","last_undegraded":"2024-09-10T05:39:27.005232+0000","last_fullsized":"2024-09-10T05:39:27.005232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:18:36.672577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'72","reported_seq":146,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.852563+0000","last_change":"2024-09-10T05:35:59.488460+0000","last_active":"2024-09-10T05:37:53.852563+0000","last_peered":"2024-09-10T05:37:53.852563+0000","last_clean":"2024-09-10T05:37:53.852563+0000","last_became_active":"2024-09-10T05:35:59.486077+0000","last_became_peered":"2024-09-10T05:35:59.486077+0000","last_unstale":"2024-09-10T05:37:53.852563+0000","last_undegraded":"2024-09-10T05:37:53.852563+0000","last_fullsized":"2024-09-10T05:37:53.852563+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:35:57.655557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:35:57.655557+0000","last_clean_scrub_stamp":"2024-09-10T05:35:57.655557+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:41:07.276856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.897409+0000","last_change":"2024-09-10T05:36:05.711729+0000","last_active":"2024-09-10T05:37:55.897409+0000","last_peered":"2024-09-10T05:37:55.897409+0000","last_clean":"2024-09-10T05:37:55.897409+0000","last_became_active":"2024-09-10T05:36:03.710352+0000","last_became_peered":"2024-09-10T05:36:03.710352+0000","last_unstale":"2024-09-10T05:37:55.897409+0000","last_undegraded":"2024-09-10T05:37:55.897409+0000","last_fullsized":"2024-09-10T05:37:55.897409+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_clean_scrub_stamp":"2024-09-10T05:36:02.684661+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:03:30.592449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002047461,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"34'1","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:18.681097+0000","last_change":"2024-09-10T05:36:11.606900+0000","last_active":"2024-09-10T05:38:18.681097+0000","last_peered":"2024-09-10T05:38:18.681097+0000","last_clean":"2024-09-10T05:38:18.681097+0000","last_became_active":"2024-09-10T05:36:11.604178+0000","last_became_peered":"2024-09-10T05:36:11.604178+0000","last_unstale":"2024-09-10T05:38:18.681097+0000","last_undegraded":"2024-09-10T05:38:18.681097+0000","last_fullsized":"2024-09-10T05:38:18.681097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:53:24.406596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.854195+0000","last_change":"2024-09-10T05:36:15.624270+0000","last_active":"2024-09-10T05:37:53.854195+0000","last_peered":"2024-09-10T05:37:53.854195+0000","last_clean":"2024-09-10T05:37:53.854195+0000","last_became_active":"2024-09-10T05:36:15.623637+0000","last_became_peered":"2024-09-10T05:36:15.623637+0000","last_unstale":"2024-09-10T05:37:53.854195+0000","last_undegraded":"2024-09-10T05:37:53.854195+0000","last_fullsized":"2024-09-10T05:37:53.854195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:37:16.145975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'83","reported_seq":163,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.049037+0000","last_change":"2024-09-10T05:36:17.637408+0000","last_active":"2024-09-10T05:38:24.049037+0000","last_peered":"2024-09-10T05:38:24.049037+0000","last_clean":"2024-09-10T05:38:24.049037+0000","last_became_active":"2024-09-10T05:36:17.636543+0000","last_became_peered":"2024-09-10T05:36:17.636543+0000","last_unstale":"2024-09-10T05:38:24.049037+0000","last_undegraded":"2024-09-10T05:38:24.049037+0000","last_fullsized":"2024-09-10T05:38:24.049037+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:15:25.918278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.728409+0000","last_change":"2024-09-10T05:36:19.664203+0000","last_active":"2024-09-10T05:37:53.728409+0000","last_peered":"2024-09-10T05:37:53.728409+0000","last_clean":"2024-09-10T05:37:53.728409+0000","last_became_active":"2024-09-10T05:36:19.663584+0000","last_became_peered":"2024-09-10T05:36:19.663584+0000","last_unstale":"2024-09-10T05:37:53.728409+0000","last_undegraded":"2024-09-10T05:37:53.728409+0000","last_fullsized":"2024-09-10T05:37:53.728409+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:33.708215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"34'82","reported_seq":168,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.391356+0000","last_change":"2024-09-10T05:36:21.664939+0000","last_active":"2024-09-10T05:39:27.391356+0000","last_peered":"2024-09-10T05:39:27.391356+0000","last_clean":"2024-09-10T05:39:27.391356+0000","last_became_active":"2024-09-10T05:36:21.664075+0000","last_became_peered":"2024-09-10T05:36:21.664075+0000","last_unstale":"2024-09-10T05:39:27.391356+0000","last_undegraded":"2024-09-10T05:39:27.391356+0000","last_fullsized":"2024-09-10T05:39:27.391356+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:13:56.435337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":223,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"30'2","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.729039+0000","last_change":"2024-09-10T05:36:13.617433+0000","last_active":"2024-09-10T05:37:53.729039+0000","last_peered":"2024-09-10T05:37:53.729039+0000","last_clean":"2024-09-10T05:37:53.729039+0000","last_became_active":"2024-09-10T05:36:13.616766+0000","last_became_peered":"2024-09-10T05:36:13.616766+0000","last_unstale":"2024-09-10T05:37:53.729039+0000","last_undegraded":"2024-09-10T05:37:53.729039+0000","last_fullsized":"2024-09-10T05:37:53.729039+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:08:29.778211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.896383+0000","last_change":"2024-09-10T05:36:05.710898+0000","last_active":"2024-09-10T05:37:55.896383+0000","last_peered":"2024-09-10T05:37:55.896383+0000","last_clean":"2024-09-10T05:37:55.896383+0000","last_became_active":"2024-09-10T05:36:03.706256+0000","last_became_peered":"2024-09-10T05:36:03.706256+0000","last_unstale":"2024-09-10T05:37:55.896383+0000","last_undegraded":"2024-09-10T05:37:55.896383+0000","last_fullsized":"2024-09-10T05:37:55.896383+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_clean_scrub_stamp":"2024-09-10T05:36:02.684661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:42:18.313806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001383542,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.856705+0000","last_change":"2024-09-10T05:36:11.591881+0000","last_active":"2024-09-10T05:37:53.856705+0000","last_peered":"2024-09-10T05:37:53.856705+0000","last_clean":"2024-09-10T05:37:53.856705+0000","last_became_active":"2024-09-10T05:36:11.591339+0000","last_became_peered":"2024-09-10T05:36:11.591339+0000","last_unstale":"2024-09-10T05:37:53.856705+0000","last_undegraded":"2024-09-10T05:37:53.856705+0000","last_fullsized":"2024-09-10T05:37:53.856705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:21:35.347921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.906123+0000","last_change":"2024-09-10T05:36:52.705367+0000","last_active":"2024-09-10T05:37:55.906123+0000","last_peered":"2024-09-10T05:37:55.906123+0000","last_clean":"2024-09-10T05:37:55.906123+0000","last_became_active":"2024-09-10T05:36:52.704490+0000","last_became_peered":"2024-09-10T05:36:52.704490+0000","last_unstale":"2024-09-10T05:37:55.906123+0000","last_undegraded":"2024-09-10T05:37:55.906123+0000","last_fullsized":"2024-09-10T05:37:55.906123+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:44:28.080659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"34'280","reported_seq":495,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:25.874900+0000","last_change":"2024-09-10T05:36:17.640102+0000","last_active":"2024-09-10T05:39:25.874900+0000","last_peered":"2024-09-10T05:39:25.874900+0000","last_clean":"2024-09-10T05:39:25.874900+0000","last_became_active":"2024-09-10T05:36:17.637623+0000","last_became_peered":"2024-09-10T05:36:17.637623+0000","last_unstale":"2024-09-10T05:39:25.874900+0000","last_undegraded":"2024-09-10T05:39:25.874900+0000","last_fullsized":"2024-09-10T05:39:25.874900+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:47:34.520585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":366,"num_read_kb":350,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.725860+0000","last_change":"2024-09-10T05:36:19.673384+0000","last_active":"2024-09-10T05:37:53.725860+0000","last_peered":"2024-09-10T05:37:53.725860+0000","last_clean":"2024-09-10T05:37:53.725860+0000","last_became_active":"2024-09-10T05:36:19.672554+0000","last_became_peered":"2024-09-10T05:36:19.672554+0000","last_unstale":"2024-09-10T05:37:53.725860+0000","last_undegraded":"2024-09-10T05:37:53.725860+0000","last_fullsized":"2024-09-10T05:37:53.725860+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:09.659188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'5","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.856766+0000","last_change":"2024-09-10T05:36:21.662079+0000","last_active":"2024-09-10T05:37:53.856766+0000","last_peered":"2024-09-10T05:37:53.856766+0000","last_clean":"2024-09-10T05:37:53.856766+0000","last_became_active":"2024-09-10T05:36:21.661347+0000","last_became_peered":"2024-09-10T05:36:21.661347+0000","last_unstale":"2024-09-10T05:37:53.856766+0000","last_undegraded":"2024-09-10T05:37:53.856766+0000","last_fullsized":"2024-09-10T05:37:53.856766+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:23.555775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'6","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.364285+0000","last_change":"2024-09-10T05:36:13.626334+0000","last_active":"2024-09-10T05:39:27.364285+0000","last_peered":"2024-09-10T05:39:27.364285+0000","last_clean":"2024-09-10T05:39:27.364285+0000","last_became_active":"2024-09-10T05:36:13.621451+0000","last_became_peered":"2024-09-10T05:36:13.621451+0000","last_unstale":"2024-09-10T05:39:27.364285+0000","last_undegraded":"2024-09-10T05:39:27.364285+0000","last_fullsized":"2024-09-10T05:39:27.364285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:29:14.676606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.713298+0000","last_change":"2024-09-10T05:36:06.203202+0000","last_active":"2024-09-10T05:37:53.713298+0000","last_peered":"2024-09-10T05:37:53.713298+0000","last_clean":"2024-09-10T05:37:53.713298+0000","last_became_active":"2024-09-10T05:36:03.707045+0000","last_became_peered":"2024-09-10T05:36:03.707045+0000","last_unstale":"2024-09-10T05:37:53.713298+0000","last_undegraded":"2024-09-10T05:37:53.713298+0000","last_fullsized":"2024-09-10T05:37:53.713298+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_clean_scrub_stamp":"2024-09-10T05:36:02.684661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:47:09.787526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093121299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:21.782377+0000","last_change":"2024-09-10T05:36:11.595624+0000","last_active":"2024-09-10T05:38:21.782377+0000","last_peered":"2024-09-10T05:38:21.782377+0000","last_clean":"2024-09-10T05:38:21.782377+0000","last_became_active":"2024-09-10T05:36:11.594432+0000","last_became_peered":"2024-09-10T05:36:11.594432+0000","last_unstale":"2024-09-10T05:38:21.782377+0000","last_undegraded":"2024-09-10T05:38:21.782377+0000","last_fullsized":"2024-09-10T05:38:21.782377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:25:27.078667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.716765+0000","last_change":"2024-09-10T05:36:15.620736+0000","last_active":"2024-09-10T05:37:53.716765+0000","last_peered":"2024-09-10T05:37:53.716765+0000","last_clean":"2024-09-10T05:37:53.716765+0000","last_became_active":"2024-09-10T05:36:15.620043+0000","last_became_peered":"2024-09-10T05:36:15.620043+0000","last_unstale":"2024-09-10T05:37:53.716765+0000","last_undegraded":"2024-09-10T05:37:53.716765+0000","last_fullsized":"2024-09-10T05:37:53.716765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:34.666759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'17","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.227823+0000","last_change":"2024-09-10T05:36:17.637187+0000","last_active":"2024-09-10T05:39:27.227823+0000","last_peered":"2024-09-10T05:39:27.227823+0000","last_clean":"2024-09-10T05:39:27.227823+0000","last_became_active":"2024-09-10T05:36:17.636381+0000","last_became_peered":"2024-09-10T05:36:17.636381+0000","last_unstale":"2024-09-10T05:39:27.227823+0000","last_undegraded":"2024-09-10T05:39:27.227823+0000","last_fullsized":"2024-09-10T05:39:27.227823+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:55:19.261582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.854702+0000","last_change":"2024-09-10T05:36:19.666298+0000","last_active":"2024-09-10T05:37:53.854702+0000","last_peered":"2024-09-10T05:37:53.854702+0000","last_clean":"2024-09-10T05:37:53.854702+0000","last_became_active":"2024-09-10T05:36:19.664396+0000","last_became_peered":"2024-09-10T05:36:19.664396+0000","last_unstale":"2024-09-10T05:37:53.854702+0000","last_undegraded":"2024-09-10T05:37:53.854702+0000","last_fullsized":"2024-09-10T05:37:53.854702+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:27:46.613544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.725249+0000","last_change":"2024-09-10T05:36:21.675746+0000","last_active":"2024-09-10T05:37:53.725249+0000","last_peered":"2024-09-10T05:37:53.725249+0000","last_clean":"2024-09-10T05:37:53.725249+0000","last_became_active":"2024-09-10T05:36:21.674984+0000","last_became_peered":"2024-09-10T05:36:21.674984+0000","last_unstale":"2024-09-10T05:37:53.725249+0000","last_undegraded":"2024-09-10T05:37:53.725249+0000","last_fullsized":"2024-09-10T05:37:53.725249+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:13.261758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'3","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:21.803367+0000","last_change":"2024-09-10T05:36:13.627345+0000","last_active":"2024-09-10T05:38:21.803367+0000","last_peered":"2024-09-10T05:38:21.803367+0000","last_clean":"2024-09-10T05:38:21.803367+0000","last_became_active":"2024-09-10T05:36:13.626654+0000","last_became_peered":"2024-09-10T05:36:13.626654+0000","last_unstale":"2024-09-10T05:38:21.803367+0000","last_undegraded":"2024-09-10T05:38:21.803367+0000","last_fullsized":"2024-09-10T05:38:21.803367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:41:27.351374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.897831+0000","last_change":"2024-09-10T05:36:05.710910+0000","last_active":"2024-09-10T05:37:55.897831+0000","last_peered":"2024-09-10T05:37:55.897831+0000","last_clean":"2024-09-10T05:37:55.897831+0000","last_became_active":"2024-09-10T05:36:03.708495+0000","last_became_peered":"2024-09-10T05:36:03.708495+0000","last_unstale":"2024-09-10T05:37:55.897831+0000","last_undegraded":"2024-09-10T05:37:55.897831+0000","last_fullsized":"2024-09-10T05:37:55.897831+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_clean_scrub_stamp":"2024-09-10T05:36:02.684661+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:51.729077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012525469999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.897736+0000","last_change":"2024-09-10T05:36:11.602156+0000","last_active":"2024-09-10T05:37:55.897736+0000","last_peered":"2024-09-10T05:37:55.897736+0000","last_clean":"2024-09-10T05:37:55.897736+0000","last_became_active":"2024-09-10T05:36:11.601414+0000","last_became_peered":"2024-09-10T05:36:11.601414+0000","last_unstale":"2024-09-10T05:37:55.897736+0000","last_undegraded":"2024-09-10T05:37:55.897736+0000","last_fullsized":"2024-09-10T05:37:55.897736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:42:50.298063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.856412+0000","last_change":"2024-09-10T05:36:15.619942+0000","last_active":"2024-09-10T05:37:53.856412+0000","last_peered":"2024-09-10T05:37:53.856412+0000","last_clean":"2024-09-10T05:37:53.856412+0000","last_became_active":"2024-09-10T05:36:15.619505+0000","last_became_peered":"2024-09-10T05:36:15.619505+0000","last_unstale":"2024-09-10T05:37:53.856412+0000","last_undegraded":"2024-09-10T05:37:53.856412+0000","last_fullsized":"2024-09-10T05:37:53.856412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:14:30.972656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"33'13","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.217385+0000","last_change":"2024-09-10T05:36:17.638373+0000","last_active":"2024-09-10T05:39:26.217385+0000","last_peered":"2024-09-10T05:39:26.217385+0000","last_clean":"2024-09-10T05:39:26.217385+0000","last_became_active":"2024-09-10T05:36:17.637551+0000","last_became_peered":"2024-09-10T05:36:17.637551+0000","last_unstale":"2024-09-10T05:39:26.217385+0000","last_undegraded":"2024-09-10T05:39:26.217385+0000","last_fullsized":"2024-09-10T05:39:26.217385+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:56:29.072774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.728759+0000","last_change":"2024-09-10T05:36:19.670810+0000","last_active":"2024-09-10T05:37:53.728759+0000","last_peered":"2024-09-10T05:37:53.728759+0000","last_clean":"2024-09-10T05:37:53.728759+0000","last_became_active":"2024-09-10T05:36:19.669130+0000","last_became_peered":"2024-09-10T05:36:19.669130+0000","last_unstale":"2024-09-10T05:37:53.728759+0000","last_undegraded":"2024-09-10T05:37:53.728759+0000","last_fullsized":"2024-09-10T05:37:53.728759+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:50:25.186904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'6","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:25.732480+0000","last_change":"2024-09-10T05:36:21.672078+0000","last_active":"2024-09-10T05:38:25.732480+0000","last_peered":"2024-09-10T05:38:25.732480+0000","last_clean":"2024-09-10T05:38:25.732480+0000","last_became_active":"2024-09-10T05:36:21.671206+0000","last_became_peered":"2024-09-10T05:36:21.671206+0000","last_unstale":"2024-09-10T05:38:25.732480+0000","last_undegraded":"2024-09-10T05:38:25.732480+0000","last_fullsized":"2024-09-10T05:38:25.732480+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:44:48.926007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'4","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:21.790850+0000","last_change":"2024-09-10T05:36:13.611873+0000","last_active":"2024-09-10T05:38:21.790850+0000","last_peered":"2024-09-10T05:38:21.790850+0000","last_clean":"2024-09-10T05:38:21.790850+0000","last_became_active":"2024-09-10T05:36:13.611242+0000","last_became_peered":"2024-09-10T05:36:13.611242+0000","last_unstale":"2024-09-10T05:38:21.790850+0000","last_undegraded":"2024-09-10T05:38:21.790850+0000","last_fullsized":"2024-09-10T05:38:21.790850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:54:18.272234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'1","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:17.687049+0000","last_change":"2024-09-10T05:36:11.605555+0000","last_active":"2024-09-10T05:38:17.687049+0000","last_peered":"2024-09-10T05:38:17.687049+0000","last_clean":"2024-09-10T05:38:17.687049+0000","last_became_active":"2024-09-10T05:36:11.604802+0000","last_became_peered":"2024-09-10T05:36:11.604802+0000","last_unstale":"2024-09-10T05:38:17.687049+0000","last_undegraded":"2024-09-10T05:38:17.687049+0000","last_fullsized":"2024-09-10T05:38:17.687049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:31.026061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.854446+0000","last_change":"2024-09-10T05:36:05.716234+0000","last_active":"2024-09-10T05:37:53.854446+0000","last_peered":"2024-09-10T05:37:53.854446+0000","last_clean":"2024-09-10T05:37:53.854446+0000","last_became_active":"2024-09-10T05:36:03.705338+0000","last_became_peered":"2024-09-10T05:36:03.705338+0000","last_unstale":"2024-09-10T05:37:53.854446+0000","last_undegraded":"2024-09-10T05:37:53.854446+0000","last_fullsized":"2024-09-10T05:37:53.854446+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_clean_scrub_stamp":"2024-09-10T05:36:02.684661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:59.676796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010885789999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:22.680314+0000","last_change":"2024-09-10T05:36:15.618592+0000","last_active":"2024-09-10T05:38:22.680314+0000","last_peered":"2024-09-10T05:38:22.680314+0000","last_clean":"2024-09-10T05:38:22.680314+0000","last_became_active":"2024-09-10T05:36:15.618041+0000","last_became_peered":"2024-09-10T05:36:15.618041+0000","last_unstale":"2024-09-10T05:38:22.680314+0000","last_undegraded":"2024-09-10T05:38:22.680314+0000","last_fullsized":"2024-09-10T05:38:22.680314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:44.697723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"34'74","reported_seq":150,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.738721+0000","last_change":"2024-09-10T05:36:17.654376+0000","last_active":"2024-09-10T05:39:26.738721+0000","last_peered":"2024-09-10T05:39:26.738721+0000","last_clean":"2024-09-10T05:39:26.738721+0000","last_became_active":"2024-09-10T05:36:17.653627+0000","last_became_peered":"2024-09-10T05:36:17.653627+0000","last_unstale":"2024-09-10T05:39:26.738721+0000","last_undegraded":"2024-09-10T05:39:26.738721+0000","last_fullsized":"2024-09-10T05:39:26.738721+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:43:52.608114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5916,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":79,"num_read_kb":65,"num_write":40,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.896388+0000","last_change":"2024-09-10T05:36:19.650800+0000","last_active":"2024-09-10T05:37:55.896388+0000","last_peered":"2024-09-10T05:37:55.896388+0000","last_clean":"2024-09-10T05:37:55.896388+0000","last_became_active":"2024-09-10T05:36:19.650115+0000","last_became_peered":"2024-09-10T05:36:19.650115+0000","last_unstale":"2024-09-10T05:37:55.896388+0000","last_undegraded":"2024-09-10T05:37:55.896388+0000","last_fullsized":"2024-09-10T05:37:55.896388+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:27:32.687339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"34'9","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:26.048065+0000","last_change":"2024-09-10T05:36:21.689033+0000","last_active":"2024-09-10T05:38:26.048065+0000","last_peered":"2024-09-10T05:38:26.048065+0000","last_clean":"2024-09-10T05:38:26.048065+0000","last_became_active":"2024-09-10T05:36:21.687744+0000","last_became_peered":"2024-09-10T05:36:21.687744+0000","last_unstale":"2024-09-10T05:38:26.048065+0000","last_undegraded":"2024-09-10T05:38:26.048065+0000","last_fullsized":"2024-09-10T05:38:26.048065+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:05:42.167772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"32'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.853863+0000","last_change":"2024-09-10T05:36:13.618496+0000","last_active":"2024-09-10T05:37:53.853863+0000","last_peered":"2024-09-10T05:37:53.853863+0000","last_clean":"2024-09-10T05:37:53.853863+0000","last_became_active":"2024-09-10T05:36:13.617814+0000","last_became_peered":"2024-09-10T05:36:13.617814+0000","last_unstale":"2024-09-10T05:37:53.853863+0000","last_undegraded":"2024-09-10T05:37:53.853863+0000","last_fullsized":"2024-09-10T05:37:53.853863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:45.951433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.855803+0000","last_change":"2024-09-10T05:36:11.596607+0000","last_active":"2024-09-10T05:37:53.855803+0000","last_peered":"2024-09-10T05:37:53.855803+0000","last_clean":"2024-09-10T05:37:53.855803+0000","last_became_active":"2024-09-10T05:36:11.595349+0000","last_became_peered":"2024-09-10T05:36:11.595349+0000","last_unstale":"2024-09-10T05:37:53.855803+0000","last_undegraded":"2024-09-10T05:37:53.855803+0000","last_fullsized":"2024-09-10T05:37:53.855803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:26:47.764082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.898073+0000","last_change":"2024-09-10T05:36:05.712138+0000","last_active":"2024-09-10T05:37:55.898073+0000","last_peered":"2024-09-10T05:37:55.898073+0000","last_clean":"2024-09-10T05:37:55.898073+0000","last_became_active":"2024-09-10T05:36:03.709534+0000","last_became_peered":"2024-09-10T05:36:03.709534+0000","last_unstale":"2024-09-10T05:37:55.898073+0000","last_undegraded":"2024-09-10T05:37:55.898073+0000","last_fullsized":"2024-09-10T05:37:55.898073+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_clean_scrub_stamp":"2024-09-10T05:36:02.684661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:58:56.347286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022338829999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.901170+0000","last_change":"2024-09-10T05:36:15.619244+0000","last_active":"2024-09-10T05:37:55.901170+0000","last_peered":"2024-09-10T05:37:55.901170+0000","last_clean":"2024-09-10T05:37:55.901170+0000","last_became_active":"2024-09-10T05:36:15.618491+0000","last_became_peered":"2024-09-10T05:36:15.618491+0000","last_unstale":"2024-09-10T05:37:55.901170+0000","last_undegraded":"2024-09-10T05:37:55.901170+0000","last_fullsized":"2024-09-10T05:37:55.901170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:43:50.594184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"30'20","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.856948+0000","last_change":"2024-09-10T05:36:17.658105+0000","last_active":"2024-09-10T05:37:53.856948+0000","last_peered":"2024-09-10T05:37:53.856948+0000","last_clean":"2024-09-10T05:37:53.856948+0000","last_became_active":"2024-09-10T05:36:17.657112+0000","last_became_peered":"2024-09-10T05:36:17.657112+0000","last_unstale":"2024-09-10T05:37:53.856948+0000","last_undegraded":"2024-09-10T05:37:53.856948+0000","last_fullsized":"2024-09-10T05:37:53.856948+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:40.438888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'282","reported_seq":361,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:25.874874+0000","last_change":"2024-09-10T05:36:19.649214+0000","last_active":"2024-09-10T05:39:25.874874+0000","last_peered":"2024-09-10T05:39:25.874874+0000","last_clean":"2024-09-10T05:39:25.874874+0000","last_became_active":"2024-09-10T05:36:19.643319+0000","last_became_peered":"2024-09-10T05:36:19.643319+0000","last_unstale":"2024-09-10T05:39:25.874874+0000","last_undegraded":"2024-09-10T05:39:25.874874+0000","last_fullsized":"2024-09-10T05:39:25.874874+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:07:40.515326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"30'2","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.729162+0000","last_change":"2024-09-10T05:36:21.692062+0000","last_active":"2024-09-10T05:37:53.729162+0000","last_peered":"2024-09-10T05:37:53.729162+0000","last_clean":"2024-09-10T05:37:53.729162+0000","last_became_active":"2024-09-10T05:36:21.691590+0000","last_became_peered":"2024-09-10T05:36:21.691590+0000","last_unstale":"2024-09-10T05:37:53.729162+0000","last_undegraded":"2024-09-10T05:37:53.729162+0000","last_fullsized":"2024-09-10T05:37:53.729162+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:43:35.691961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'6","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.295258+0000","last_change":"2024-09-10T05:36:13.607662+0000","last_active":"2024-09-10T05:39:27.295258+0000","last_peered":"2024-09-10T05:39:27.295258+0000","last_clean":"2024-09-10T05:39:27.295258+0000","last_became_active":"2024-09-10T05:36:13.607367+0000","last_became_peered":"2024-09-10T05:36:13.607367+0000","last_unstale":"2024-09-10T05:39:27.295258+0000","last_undegraded":"2024-09-10T05:39:27.295258+0000","last_fullsized":"2024-09-10T05:39:27.295258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:45.424290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:26.122156+0000","last_change":"2024-09-10T05:36:11.608356+0000","last_active":"2024-09-10T05:38:26.122156+0000","last_peered":"2024-09-10T05:38:26.122156+0000","last_clean":"2024-09-10T05:38:26.122156+0000","last_became_active":"2024-09-10T05:36:11.606234+0000","last_became_peered":"2024-09-10T05:36:11.606234+0000","last_unstale":"2024-09-10T05:38:26.122156+0000","last_undegraded":"2024-09-10T05:38:26.122156+0000","last_fullsized":"2024-09-10T05:38:26.122156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:03.114192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.854826+0000","last_change":"2024-09-10T05:36:05.716475+0000","last_active":"2024-09-10T05:37:53.854826+0000","last_peered":"2024-09-10T05:37:53.854826+0000","last_clean":"2024-09-10T05:37:53.854826+0000","last_became_active":"2024-09-10T05:36:03.705038+0000","last_became_peered":"2024-09-10T05:36:03.705038+0000","last_unstale":"2024-09-10T05:37:53.854826+0000","last_undegraded":"2024-09-10T05:37:53.854826+0000","last_fullsized":"2024-09-10T05:37:53.854826+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_clean_scrub_stamp":"2024-09-10T05:36:02.684661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:33:56.689163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00126935,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.901115+0000","last_change":"2024-09-10T05:36:15.618499+0000","last_active":"2024-09-10T05:37:55.901115+0000","last_peered":"2024-09-10T05:37:55.901115+0000","last_clean":"2024-09-10T05:37:55.901115+0000","last_became_active":"2024-09-10T05:36:15.617690+0000","last_became_peered":"2024-09-10T05:36:15.617690+0000","last_unstale":"2024-09-10T05:37:55.901115+0000","last_undegraded":"2024-09-10T05:37:55.901115+0000","last_fullsized":"2024-09-10T05:37:55.901115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:44.575577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"30'16","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.724231+0000","last_change":"2024-09-10T05:36:17.635256+0000","last_active":"2024-09-10T05:37:53.724231+0000","last_peered":"2024-09-10T05:37:53.724231+0000","last_clean":"2024-09-10T05:37:53.724231+0000","last_became_active":"2024-09-10T05:36:17.634261+0000","last_became_peered":"2024-09-10T05:36:17.634261+0000","last_unstale":"2024-09-10T05:37:53.724231+0000","last_undegraded":"2024-09-10T05:37:53.724231+0000","last_fullsized":"2024-09-10T05:37:53.724231+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:56:40.871070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'282","reported_seq":435,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.527554+0000","last_change":"2024-09-10T05:36:19.673204+0000","last_active":"2024-09-10T05:39:27.527554+0000","last_peered":"2024-09-10T05:39:27.527554+0000","last_clean":"2024-09-10T05:39:27.527554+0000","last_became_active":"2024-09-10T05:36:19.672586+0000","last_became_peered":"2024-09-10T05:36:19.672586+0000","last_unstale":"2024-09-10T05:39:27.527554+0000","last_undegraded":"2024-09-10T05:39:27.527554+0000","last_fullsized":"2024-09-10T05:39:27.527554+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:18:32.110473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.853637+0000","last_change":"2024-09-10T05:36:21.670112+0000","last_active":"2024-09-10T05:37:53.853637+0000","last_peered":"2024-09-10T05:37:53.853637+0000","last_clean":"2024-09-10T05:37:53.853637+0000","last_became_active":"2024-09-10T05:36:21.668909+0000","last_became_peered":"2024-09-10T05:36:21.668909+0000","last_unstale":"2024-09-10T05:37:53.853637+0000","last_undegraded":"2024-09-10T05:37:53.853637+0000","last_fullsized":"2024-09-10T05:37:53.853637+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:37:35.984330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'14","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.201146+0000","last_change":"2024-09-10T05:36:13.622291+0000","last_active":"2024-09-10T05:39:27.201146+0000","last_peered":"2024-09-10T05:39:27.201146+0000","last_clean":"2024-09-10T05:39:27.201146+0000","last_became_active":"2024-09-10T05:36:13.621703+0000","last_became_peered":"2024-09-10T05:36:13.621703+0000","last_unstale":"2024-09-10T05:39:27.201146+0000","last_undegraded":"2024-09-10T05:39:27.201146+0000","last_fullsized":"2024-09-10T05:39:27.201146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:40:52.344660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.855830+0000","last_change":"2024-09-10T05:36:11.594329+0000","last_active":"2024-09-10T05:37:53.855830+0000","last_peered":"2024-09-10T05:37:53.855830+0000","last_clean":"2024-09-10T05:37:53.855830+0000","last_became_active":"2024-09-10T05:36:11.594029+0000","last_became_peered":"2024-09-10T05:36:11.594029+0000","last_unstale":"2024-09-10T05:37:53.855830+0000","last_undegraded":"2024-09-10T05:37:53.855830+0000","last_fullsized":"2024-09-10T05:37:53.855830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:10:40.202152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.899337+0000","last_change":"2024-09-10T05:36:05.711580+0000","last_active":"2024-09-10T05:37:55.899337+0000","last_peered":"2024-09-10T05:37:55.899337+0000","last_clean":"2024-09-10T05:37:55.899337+0000","last_became_active":"2024-09-10T05:36:03.708884+0000","last_became_peered":"2024-09-10T05:36:03.708884+0000","last_unstale":"2024-09-10T05:37:55.899337+0000","last_undegraded":"2024-09-10T05:37:55.899337+0000","last_fullsized":"2024-09-10T05:37:55.899337+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_clean_scrub_stamp":"2024-09-10T05:36:02.684661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:41:36.044908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018824390000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.722537+0000","last_change":"2024-09-10T05:36:15.638715+0000","last_active":"2024-09-10T05:37:53.722537+0000","last_peered":"2024-09-10T05:37:53.722537+0000","last_clean":"2024-09-10T05:37:53.722537+0000","last_became_active":"2024-09-10T05:36:15.637890+0000","last_became_peered":"2024-09-10T05:36:15.637890+0000","last_unstale":"2024-09-10T05:37:53.722537+0000","last_undegraded":"2024-09-10T05:37:53.722537+0000","last_fullsized":"2024-09-10T05:37:53.722537+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:43:41.621798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'88","reported_seq":171,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.008941+0000","last_change":"2024-09-10T05:36:17.632261+0000","last_active":"2024-09-10T05:38:24.008941+0000","last_peered":"2024-09-10T05:38:24.008941+0000","last_clean":"2024-09-10T05:38:24.008941+0000","last_became_active":"2024-09-10T05:36:17.631509+0000","last_became_peered":"2024-09-10T05:36:17.631509+0000","last_unstale":"2024-09-10T05:38:24.008941+0000","last_undegraded":"2024-09-10T05:38:24.008941+0000","last_fullsized":"2024-09-10T05:38:24.008941+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:42.713689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":84,"num_read_kb":69,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.723343+0000","last_change":"2024-09-10T05:36:19.668038+0000","last_active":"2024-09-10T05:37:53.723343+0000","last_peered":"2024-09-10T05:37:53.723343+0000","last_clean":"2024-09-10T05:37:53.723343+0000","last_became_active":"2024-09-10T05:36:19.667446+0000","last_became_peered":"2024-09-10T05:36:19.667446+0000","last_unstale":"2024-09-10T05:37:53.723343+0000","last_undegraded":"2024-09-10T05:37:53.723343+0000","last_fullsized":"2024-09-10T05:37:53.723343+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:54:25.333105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.713880+0000","last_change":"2024-09-10T05:36:21.658395+0000","last_active":"2024-09-10T05:37:53.713880+0000","last_peered":"2024-09-10T05:37:53.713880+0000","last_clean":"2024-09-10T05:37:53.713880+0000","last_became_active":"2024-09-10T05:36:21.657621+0000","last_became_peered":"2024-09-10T05:36:21.657621+0000","last_unstale":"2024-09-10T05:37:53.713880+0000","last_undegraded":"2024-09-10T05:37:53.713880+0000","last_fullsized":"2024-09-10T05:37:53.713880+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:09.853561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"32'8","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.717636+0000","last_change":"2024-09-10T05:36:21.657351+0000","last_active":"2024-09-10T05:37:53.717636+0000","last_peered":"2024-09-10T05:37:53.717636+0000","last_clean":"2024-09-10T05:37:53.717636+0000","last_became_active":"2024-09-10T05:36:21.656563+0000","last_became_peered":"2024-09-10T05:36:21.656563+0000","last_unstale":"2024-09-10T05:37:53.717636+0000","last_undegraded":"2024-09-10T05:37:53.717636+0000","last_fullsized":"2024-09-10T05:37:53.717636+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:25:08.627704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.714178+0000","last_change":"2024-09-10T05:36:13.621461+0000","last_active":"2024-09-10T05:37:53.714178+0000","last_peered":"2024-09-10T05:37:53.714178+0000","last_clean":"2024-09-10T05:37:53.714178+0000","last_became_active":"2024-09-10T05:36:13.620892+0000","last_became_peered":"2024-09-10T05:36:13.620892+0000","last_unstale":"2024-09-10T05:37:53.714178+0000","last_undegraded":"2024-09-10T05:37:53.714178+0000","last_fullsized":"2024-09-10T05:37:53.714178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:39.193639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'6","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.350902+0000","last_change":"2024-09-10T05:36:11.598055+0000","last_active":"2024-09-10T05:39:27.350902+0000","last_peered":"2024-09-10T05:39:27.350902+0000","last_clean":"2024-09-10T05:39:27.350902+0000","last_became_active":"2024-09-10T05:36:11.597209+0000","last_became_peered":"2024-09-10T05:36:11.597209+0000","last_unstale":"2024-09-10T05:39:27.350902+0000","last_undegraded":"2024-09-10T05:39:27.350902+0000","last_fullsized":"2024-09-10T05:39:27.350902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:02.735158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.858869+0000","last_change":"2024-09-10T05:36:15.617459+0000","last_active":"2024-09-10T05:37:53.858869+0000","last_peered":"2024-09-10T05:37:53.858869+0000","last_clean":"2024-09-10T05:37:53.858869+0000","last_became_active":"2024-09-10T05:36:15.617049+0000","last_became_peered":"2024-09-10T05:36:15.617049+0000","last_unstale":"2024-09-10T05:37:53.858869+0000","last_undegraded":"2024-09-10T05:37:53.858869+0000","last_fullsized":"2024-09-10T05:37:53.858869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:13:50.392282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'38","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.033044+0000","last_change":"2024-09-10T05:36:17.658656+0000","last_active":"2024-09-10T05:38:24.033044+0000","last_peered":"2024-09-10T05:38:24.033044+0000","last_clean":"2024-09-10T05:38:24.033044+0000","last_became_active":"2024-09-10T05:36:17.657669+0000","last_became_peered":"2024-09-10T05:36:17.657669+0000","last_unstale":"2024-09-10T05:38:24.033044+0000","last_undegraded":"2024-09-10T05:38:24.033044+0000","last_fullsized":"2024-09-10T05:38:24.033044+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:39.765543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.724025+0000","last_change":"2024-09-10T05:36:19.673156+0000","last_active":"2024-09-10T05:37:53.724025+0000","last_peered":"2024-09-10T05:37:53.724025+0000","last_clean":"2024-09-10T05:37:53.724025+0000","last_became_active":"2024-09-10T05:36:19.672498+0000","last_became_peered":"2024-09-10T05:36:19.672498+0000","last_unstale":"2024-09-10T05:37:53.724025+0000","last_undegraded":"2024-09-10T05:37:53.724025+0000","last_fullsized":"2024-09-10T05:37:53.724025+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:27:09.531398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'5","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:23.587545+0000","last_change":"2024-09-10T05:36:21.689435+0000","last_active":"2024-09-10T05:38:23.587545+0000","last_peered":"2024-09-10T05:38:23.587545+0000","last_clean":"2024-09-10T05:38:23.587545+0000","last_became_active":"2024-09-10T05:36:21.688864+0000","last_became_peered":"2024-09-10T05:36:21.688864+0000","last_unstale":"2024-09-10T05:38:23.587545+0000","last_undegraded":"2024-09-10T05:38:23.587545+0000","last_fullsized":"2024-09-10T05:38:23.587545+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:55:36.492043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"34'10","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.294531+0000","last_change":"2024-09-10T05:36:13.612003+0000","last_active":"2024-09-10T05:39:27.294531+0000","last_peered":"2024-09-10T05:39:27.294531+0000","last_clean":"2024-09-10T05:39:27.294531+0000","last_became_active":"2024-09-10T05:36:13.610883+0000","last_became_peered":"2024-09-10T05:36:13.610883+0000","last_unstale":"2024-09-10T05:39:27.294531+0000","last_undegraded":"2024-09-10T05:39:27.294531+0000","last_fullsized":"2024-09-10T05:39:27.294531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:29:40.273630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'1","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:37.684035+0000","last_change":"2024-09-10T05:36:11.605653+0000","last_active":"2024-09-10T05:38:37.684035+0000","last_peered":"2024-09-10T05:38:37.684035+0000","last_clean":"2024-09-10T05:38:37.684035+0000","last_became_active":"2024-09-10T05:36:11.605259+0000","last_became_peered":"2024-09-10T05:36:11.605259+0000","last_unstale":"2024-09-10T05:38:37.684035+0000","last_undegraded":"2024-09-10T05:38:37.684035+0000","last_fullsized":"2024-09-10T05:38:37.684035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:18:08.260486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.724971+0000","last_change":"2024-09-10T05:36:15.630108+0000","last_active":"2024-09-10T05:37:53.724971+0000","last_peered":"2024-09-10T05:37:53.724971+0000","last_clean":"2024-09-10T05:37:53.724971+0000","last_became_active":"2024-09-10T05:36:15.629278+0000","last_became_peered":"2024-09-10T05:36:15.629278+0000","last_unstale":"2024-09-10T05:37:53.724971+0000","last_undegraded":"2024-09-10T05:37:53.724971+0000","last_fullsized":"2024-09-10T05:37:53.724971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:14:38.879647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'6","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.226218+0000","last_change":"2024-09-10T05:36:17.652832+0000","last_active":"2024-09-10T05:39:26.226218+0000","last_peered":"2024-09-10T05:39:26.226218+0000","last_clean":"2024-09-10T05:39:26.226218+0000","last_became_active":"2024-09-10T05:36:17.648835+0000","last_became_peered":"2024-09-10T05:36:17.648835+0000","last_unstale":"2024-09-10T05:39:26.226218+0000","last_undegraded":"2024-09-10T05:39:26.226218+0000","last_fullsized":"2024-09-10T05:39:26.226218+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:46.589507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.711967+0000","last_change":"2024-09-10T05:36:19.638688+0000","last_active":"2024-09-10T05:37:53.711967+0000","last_peered":"2024-09-10T05:37:53.711967+0000","last_clean":"2024-09-10T05:37:53.711967+0000","last_became_active":"2024-09-10T05:36:19.637912+0000","last_became_peered":"2024-09-10T05:36:19.637912+0000","last_unstale":"2024-09-10T05:37:53.711967+0000","last_undegraded":"2024-09-10T05:37:53.711967+0000","last_fullsized":"2024-09-10T05:37:53.711967+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:25:54.923848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.854267+0000","last_change":"2024-09-10T05:36:21.668904+0000","last_active":"2024-09-10T05:37:53.854267+0000","last_peered":"2024-09-10T05:37:53.854267+0000","last_clean":"2024-09-10T05:37:53.854267+0000","last_became_active":"2024-09-10T05:36:21.666877+0000","last_became_peered":"2024-09-10T05:36:21.666877+0000","last_unstale":"2024-09-10T05:37:53.854267+0000","last_undegraded":"2024-09-10T05:37:53.854267+0000","last_fullsized":"2024-09-10T05:37:53.854267+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:43:13.848554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"34'4","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.856889+0000","last_change":"2024-09-10T05:36:13.598863+0000","last_active":"2024-09-10T05:39:26.856889+0000","last_peered":"2024-09-10T05:39:26.856889+0000","last_clean":"2024-09-10T05:39:26.856889+0000","last_became_active":"2024-09-10T05:36:13.597857+0000","last_became_peered":"2024-09-10T05:36:13.597857+0000","last_unstale":"2024-09-10T05:39:26.856889+0000","last_undegraded":"2024-09-10T05:39:26.856889+0000","last_fullsized":"2024-09-10T05:39:26.856889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:32:45.970120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.898820+0000","last_change":"2024-09-10T05:36:11.601417+0000","last_active":"2024-09-10T05:37:55.898820+0000","last_peered":"2024-09-10T05:37:55.898820+0000","last_clean":"2024-09-10T05:37:55.898820+0000","last_became_active":"2024-09-10T05:36:11.600603+0000","last_became_peered":"2024-09-10T05:36:11.600603+0000","last_unstale":"2024-09-10T05:37:55.898820+0000","last_undegraded":"2024-09-10T05:37:55.898820+0000","last_fullsized":"2024-09-10T05:37:55.898820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:55:12.247844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.900977+0000","last_change":"2024-09-10T05:36:15.638682+0000","last_active":"2024-09-10T05:37:55.900977+0000","last_peered":"2024-09-10T05:37:55.900977+0000","last_clean":"2024-09-10T05:37:55.900977+0000","last_became_active":"2024-09-10T05:36:15.638197+0000","last_became_peered":"2024-09-10T05:36:15.638197+0000","last_unstale":"2024-09-10T05:37:55.900977+0000","last_undegraded":"2024-09-10T05:37:55.900977+0000","last_fullsized":"2024-09-10T05:37:55.900977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:53:28.099101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"34'41","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.313275+0000","last_change":"2024-09-10T05:36:17.647135+0000","last_active":"2024-09-10T05:39:26.313275+0000","last_peered":"2024-09-10T05:39:26.313275+0000","last_clean":"2024-09-10T05:39:26.313275+0000","last_became_active":"2024-09-10T05:36:17.646459+0000","last_became_peered":"2024-09-10T05:36:17.646459+0000","last_unstale":"2024-09-10T05:39:26.313275+0000","last_undegraded":"2024-09-10T05:39:26.313275+0000","last_fullsized":"2024-09-10T05:39:26.313275+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:25:06.130753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.852746+0000","last_change":"2024-09-10T05:36:19.654869+0000","last_active":"2024-09-10T05:37:53.852746+0000","last_peered":"2024-09-10T05:37:53.852746+0000","last_clean":"2024-09-10T05:37:53.852746+0000","last_became_active":"2024-09-10T05:36:19.648608+0000","last_became_peered":"2024-09-10T05:36:19.648608+0000","last_unstale":"2024-09-10T05:37:53.852746+0000","last_undegraded":"2024-09-10T05:37:53.852746+0000","last_fullsized":"2024-09-10T05:37:53.852746+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:00.797025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.723161+0000","last_change":"2024-09-10T05:36:21.684218+0000","last_active":"2024-09-10T05:37:53.723161+0000","last_peered":"2024-09-10T05:37:53.723161+0000","last_clean":"2024-09-10T05:37:53.723161+0000","last_became_active":"2024-09-10T05:36:21.683406+0000","last_became_peered":"2024-09-10T05:36:21.683406+0000","last_unstale":"2024-09-10T05:37:53.723161+0000","last_undegraded":"2024-09-10T05:37:53.723161+0000","last_fullsized":"2024-09-10T05:37:53.723161+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:58:10.494998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'4","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.200914+0000","last_change":"2024-09-10T05:36:13.607573+0000","last_active":"2024-09-10T05:39:27.200914+0000","last_peered":"2024-09-10T05:39:27.200914+0000","last_clean":"2024-09-10T05:39:27.200914+0000","last_became_active":"2024-09-10T05:36:13.606903+0000","last_became_peered":"2024-09-10T05:36:13.606903+0000","last_unstale":"2024-09-10T05:39:27.200914+0000","last_undegraded":"2024-09-10T05:39:27.200914+0000","last_fullsized":"2024-09-10T05:39:27.200914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:36.946797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.859661+0000","last_change":"2024-09-10T05:36:11.595373+0000","last_active":"2024-09-10T05:37:53.859661+0000","last_peered":"2024-09-10T05:37:53.859661+0000","last_clean":"2024-09-10T05:37:53.859661+0000","last_became_active":"2024-09-10T05:36:11.594653+0000","last_became_peered":"2024-09-10T05:36:11.594653+0000","last_unstale":"2024-09-10T05:37:53.859661+0000","last_undegraded":"2024-09-10T05:37:53.859661+0000","last_fullsized":"2024-09-10T05:37:53.859661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:01:15.108575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"34'5","reported_seq":420,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:25.599472+0000","last_change":"2024-09-10T05:36:15.617558+0000","last_active":"2024-09-10T05:38:25.599472+0000","last_peered":"2024-09-10T05:38:25.599472+0000","last_clean":"2024-09-10T05:38:25.599472+0000","last_became_active":"2024-09-10T05:36:15.615147+0000","last_became_peered":"2024-09-10T05:36:15.615147+0000","last_unstale":"2024-09-10T05:38:25.599472+0000","last_undegraded":"2024-09-10T05:38:25.599472+0000","last_fullsized":"2024-09-10T05:38:25.599472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:18:16.479290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1429,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":580,"num_read_kb":580,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'30","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.003868+0000","last_change":"2024-09-10T05:36:17.632006+0000","last_active":"2024-09-10T05:38:24.003868+0000","last_peered":"2024-09-10T05:38:24.003868+0000","last_clean":"2024-09-10T05:38:24.003868+0000","last_became_active":"2024-09-10T05:36:17.631446+0000","last_became_peered":"2024-09-10T05:36:17.631446+0000","last_unstale":"2024-09-10T05:38:24.003868+0000","last_undegraded":"2024-09-10T05:38:24.003868+0000","last_fullsized":"2024-09-10T05:38:24.003868+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:30.388651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.715083+0000","last_change":"2024-09-10T05:36:19.639207+0000","last_active":"2024-09-10T05:37:53.715083+0000","last_peered":"2024-09-10T05:37:53.715083+0000","last_clean":"2024-09-10T05:37:53.715083+0000","last_became_active":"2024-09-10T05:36:19.638240+0000","last_became_peered":"2024-09-10T05:36:19.638240+0000","last_unstale":"2024-09-10T05:37:53.715083+0000","last_undegraded":"2024-09-10T05:37:53.715083+0000","last_fullsized":"2024-09-10T05:37:53.715083+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:39:50.347393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'8","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.905694+0000","last_change":"2024-09-10T05:36:13.619194+0000","last_active":"2024-09-10T05:37:55.905694+0000","last_peered":"2024-09-10T05:37:55.905694+0000","last_clean":"2024-09-10T05:37:55.905694+0000","last_became_active":"2024-09-10T05:36:13.618656+0000","last_became_peered":"2024-09-10T05:36:13.618656+0000","last_unstale":"2024-09-10T05:37:55.905694+0000","last_undegraded":"2024-09-10T05:37:55.905694+0000","last_fullsized":"2024-09-10T05:37:55.905694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:02:21.175825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.721692+0000","last_change":"2024-09-10T05:36:11.598128+0000","last_active":"2024-09-10T05:37:53.721692+0000","last_peered":"2024-09-10T05:37:53.721692+0000","last_clean":"2024-09-10T05:37:53.721692+0000","last_became_active":"2024-09-10T05:36:11.597710+0000","last_became_peered":"2024-09-10T05:36:11.597710+0000","last_unstale":"2024-09-10T05:37:53.721692+0000","last_undegraded":"2024-09-10T05:37:53.721692+0000","last_fullsized":"2024-09-10T05:37:53.721692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:38:54.156857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.856979+0000","last_change":"2024-09-10T05:36:15.627731+0000","last_active":"2024-09-10T05:37:53.856979+0000","last_peered":"2024-09-10T05:37:53.856979+0000","last_clean":"2024-09-10T05:37:53.856979+0000","last_became_active":"2024-09-10T05:36:15.626787+0000","last_became_peered":"2024-09-10T05:36:15.626787+0000","last_unstale":"2024-09-10T05:37:53.856979+0000","last_undegraded":"2024-09-10T05:37:53.856979+0000","last_fullsized":"2024-09-10T05:37:53.856979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:46:30.721119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"34'60","reported_seq":127,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.046372+0000","last_change":"2024-09-10T05:36:17.645250+0000","last_active":"2024-09-10T05:38:24.046372+0000","last_peered":"2024-09-10T05:38:24.046372+0000","last_clean":"2024-09-10T05:38:24.046372+0000","last_became_active":"2024-09-10T05:36:17.644469+0000","last_became_peered":"2024-09-10T05:36:17.644469+0000","last_unstale":"2024-09-10T05:38:24.046372+0000","last_undegraded":"2024-09-10T05:38:24.046372+0000","last_fullsized":"2024-09-10T05:38:24.046372+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:35.181585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":58,"num_read_kb":48,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.715316+0000","last_change":"2024-09-10T05:36:19.639542+0000","last_active":"2024-09-10T05:37:53.715316+0000","last_peered":"2024-09-10T05:37:53.715316+0000","last_clean":"2024-09-10T05:37:53.715316+0000","last_became_active":"2024-09-10T05:36:19.638136+0000","last_became_peered":"2024-09-10T05:36:19.638136+0000","last_unstale":"2024-09-10T05:37:53.715316+0000","last_undegraded":"2024-09-10T05:37:53.715316+0000","last_fullsized":"2024-09-10T05:37:53.715316+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:15:07.235287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'14","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:26.038899+0000","last_change":"2024-09-10T05:36:21.682080+0000","last_active":"2024-09-10T05:38:26.038899+0000","last_peered":"2024-09-10T05:38:26.038899+0000","last_clean":"2024-09-10T05:38:26.038899+0000","last_became_active":"2024-09-10T05:36:21.681263+0000","last_became_peered":"2024-09-10T05:36:21.681263+0000","last_unstale":"2024-09-10T05:38:26.038899+0000","last_undegraded":"2024-09-10T05:38:26.038899+0000","last_fullsized":"2024-09-10T05:38:26.038899+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:35:30.867304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"34'10","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.004821+0000","last_change":"2024-09-10T05:36:13.610413+0000","last_active":"2024-09-10T05:39:27.004821+0000","last_peered":"2024-09-10T05:39:27.004821+0000","last_clean":"2024-09-10T05:39:27.004821+0000","last_became_active":"2024-09-10T05:36:13.609773+0000","last_became_peered":"2024-09-10T05:36:13.609773+0000","last_unstale":"2024-09-10T05:39:27.004821+0000","last_undegraded":"2024-09-10T05:39:27.004821+0000","last_fullsized":"2024-09-10T05:39:27.004821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:39:34.903497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.853462+0000","last_change":"2024-09-10T05:36:11.596239+0000","last_active":"2024-09-10T05:37:53.853462+0000","last_peered":"2024-09-10T05:37:53.853462+0000","last_clean":"2024-09-10T05:37:53.853462+0000","last_became_active":"2024-09-10T05:36:11.595758+0000","last_became_peered":"2024-09-10T05:36:11.595758+0000","last_unstale":"2024-09-10T05:37:53.853462+0000","last_undegraded":"2024-09-10T05:37:53.853462+0000","last_fullsized":"2024-09-10T05:37:53.853462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:59:57.154376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.906346+0000","last_change":"2024-09-10T05:36:15.614782+0000","last_active":"2024-09-10T05:37:55.906346+0000","last_peered":"2024-09-10T05:37:55.906346+0000","last_clean":"2024-09-10T05:37:55.906346+0000","last_became_active":"2024-09-10T05:36:15.613949+0000","last_became_peered":"2024-09-10T05:36:15.613949+0000","last_unstale":"2024-09-10T05:37:55.906346+0000","last_undegraded":"2024-09-10T05:37:55.906346+0000","last_fullsized":"2024-09-10T05:37:55.906346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:33.167655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"34'36","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.006452+0000","last_change":"2024-09-10T05:36:17.637253+0000","last_active":"2024-09-10T05:38:24.006452+0000","last_peered":"2024-09-10T05:38:24.006452+0000","last_clean":"2024-09-10T05:38:24.006452+0000","last_became_active":"2024-09-10T05:36:17.636067+0000","last_became_peered":"2024-09-10T05:36:17.636067+0000","last_unstale":"2024-09-10T05:38:24.006452+0000","last_undegraded":"2024-09-10T05:38:24.006452+0000","last_fullsized":"2024-09-10T05:38:24.006452+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:27:48.471606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.856515+0000","last_change":"2024-09-10T05:36:19.665827+0000","last_active":"2024-09-10T05:37:53.856515+0000","last_peered":"2024-09-10T05:37:53.856515+0000","last_clean":"2024-09-10T05:37:53.856515+0000","last_became_active":"2024-09-10T05:36:19.665010+0000","last_became_peered":"2024-09-10T05:36:19.665010+0000","last_unstale":"2024-09-10T05:37:53.856515+0000","last_undegraded":"2024-09-10T05:37:53.856515+0000","last_fullsized":"2024-09-10T05:37:53.856515+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:47:10.890181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.899872+0000","last_change":"2024-09-10T05:36:21.665684+0000","last_active":"2024-09-10T05:37:55.899872+0000","last_peered":"2024-09-10T05:37:55.899872+0000","last_clean":"2024-09-10T05:37:55.899872+0000","last_became_active":"2024-09-10T05:36:21.664884+0000","last_became_peered":"2024-09-10T05:36:21.664884+0000","last_unstale":"2024-09-10T05:37:55.899872+0000","last_undegraded":"2024-09-10T05:37:55.899872+0000","last_fullsized":"2024-09-10T05:37:55.899872+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:21:16.296649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.726940+0000","last_change":"2024-09-10T05:36:13.616705+0000","last_active":"2024-09-10T05:37:53.726940+0000","last_peered":"2024-09-10T05:37:53.726940+0000","last_clean":"2024-09-10T05:37:53.726940+0000","last_became_active":"2024-09-10T05:36:13.616392+0000","last_became_peered":"2024-09-10T05:36:13.616392+0000","last_unstale":"2024-09-10T05:37:53.726940+0000","last_undegraded":"2024-09-10T05:37:53.726940+0000","last_fullsized":"2024-09-10T05:37:53.726940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:58:42.346686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.808522+0000","last_change":"2024-09-10T05:36:11.596038+0000","last_active":"2024-09-10T05:39:26.808522+0000","last_peered":"2024-09-10T05:39:26.808522+0000","last_clean":"2024-09-10T05:39:26.808522+0000","last_became_active":"2024-09-10T05:36:11.595319+0000","last_became_peered":"2024-09-10T05:36:11.595319+0000","last_unstale":"2024-09-10T05:39:26.808522+0000","last_undegraded":"2024-09-10T05:39:26.808522+0000","last_fullsized":"2024-09-10T05:39:26.808522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:55:19.990619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.902488+0000","last_change":"2024-09-10T05:36:15.618307+0000","last_active":"2024-09-10T05:37:55.902488+0000","last_peered":"2024-09-10T05:37:55.902488+0000","last_clean":"2024-09-10T05:37:55.902488+0000","last_became_active":"2024-09-10T05:36:15.617595+0000","last_became_peered":"2024-09-10T05:36:15.617595+0000","last_unstale":"2024-09-10T05:37:55.902488+0000","last_undegraded":"2024-09-10T05:37:55.902488+0000","last_fullsized":"2024-09-10T05:37:55.902488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:38.424958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1f","version":"34'38","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:23.682856+0000","last_change":"2024-09-10T05:36:17.635281+0000","last_active":"2024-09-10T05:38:23.682856+0000","last_peered":"2024-09-10T05:38:23.682856+0000","last_clean":"2024-09-10T05:38:23.682856+0000","last_became_active":"2024-09-10T05:36:17.634616+0000","last_became_peered":"2024-09-10T05:36:17.634616+0000","last_unstale":"2024-09-10T05:38:23.682856+0000","last_undegraded":"2024-09-10T05:38:23.682856+0000","last_fullsized":"2024-09-10T05:38:23.682856+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:14.597186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.859042+0000","last_change":"2024-09-10T05:36:19.665974+0000","last_active":"2024-09-10T05:37:53.859042+0000","last_peered":"2024-09-10T05:37:53.859042+0000","last_clean":"2024-09-10T05:37:53.859042+0000","last_became_active":"2024-09-10T05:36:19.665236+0000","last_became_peered":"2024-09-10T05:36:19.665236+0000","last_unstale":"2024-09-10T05:37:53.859042+0000","last_undegraded":"2024-09-10T05:37:53.859042+0000","last_fullsized":"2024-09-10T05:37:53.859042+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:24.647011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"34'5","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.906432+0000","last_change":"2024-09-10T05:36:21.695106+0000","last_active":"2024-09-10T05:39:26.906432+0000","last_peered":"2024-09-10T05:39:26.906432+0000","last_clean":"2024-09-10T05:39:26.906432+0000","last_became_active":"2024-09-10T05:36:21.694522+0000","last_became_peered":"2024-09-10T05:36:21.694522+0000","last_unstale":"2024-09-10T05:39:26.906432+0000","last_undegraded":"2024-09-10T05:39:26.906432+0000","last_fullsized":"2024-09-10T05:39:26.906432+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:40.765075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.295199+0000","last_change":"2024-09-10T05:36:13.611415+0000","last_active":"2024-09-10T05:39:27.295199+0000","last_peered":"2024-09-10T05:39:27.295199+0000","last_clean":"2024-09-10T05:39:27.295199+0000","last_became_active":"2024-09-10T05:36:13.610788+0000","last_became_peered":"2024-09-10T05:36:13.610788+0000","last_unstale":"2024-09-10T05:39:27.295199+0000","last_undegraded":"2024-09-10T05:39:27.295199+0000","last_fullsized":"2024-09-10T05:39:27.295199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:04.364523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"32'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.724690+0000","last_change":"2024-09-10T05:36:11.606056+0000","last_active":"2024-09-10T05:37:53.724690+0000","last_peered":"2024-09-10T05:37:53.724690+0000","last_clean":"2024-09-10T05:37:53.724690+0000","last_became_active":"2024-09-10T05:36:11.600655+0000","last_became_peered":"2024-09-10T05:36:11.600655+0000","last_unstale":"2024-09-10T05:37:53.724690+0000","last_undegraded":"2024-09-10T05:37:53.724690+0000","last_fullsized":"2024-09-10T05:37:53.724690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:42:31.168856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.857028+0000","last_change":"2024-09-10T05:36:15.624306+0000","last_active":"2024-09-10T05:37:53.857028+0000","last_peered":"2024-09-10T05:37:53.857028+0000","last_clean":"2024-09-10T05:37:53.857028+0000","last_became_active":"2024-09-10T05:36:15.623436+0000","last_became_peered":"2024-09-10T05:36:15.623436+0000","last_unstale":"2024-09-10T05:37:53.857028+0000","last_undegraded":"2024-09-10T05:37:53.857028+0000","last_fullsized":"2024-09-10T05:37:53.857028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:35:42.347473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'16","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.729552+0000","last_change":"2024-09-10T05:36:17.639307+0000","last_active":"2024-09-10T05:37:53.729552+0000","last_peered":"2024-09-10T05:37:53.729552+0000","last_clean":"2024-09-10T05:37:53.729552+0000","last_became_active":"2024-09-10T05:36:17.638408+0000","last_became_peered":"2024-09-10T05:36:17.638408+0000","last_unstale":"2024-09-10T05:37:53.729552+0000","last_undegraded":"2024-09-10T05:37:53.729552+0000","last_fullsized":"2024-09-10T05:37:53.729552+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:30.086363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'282","reported_seq":423,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.376804+0000","last_change":"2024-09-10T05:36:19.651451+0000","last_active":"2024-09-10T05:39:27.376804+0000","last_peered":"2024-09-10T05:39:27.376804+0000","last_clean":"2024-09-10T05:39:27.376804+0000","last_became_active":"2024-09-10T05:36:19.649079+0000","last_became_peered":"2024-09-10T05:36:19.649079+0000","last_unstale":"2024-09-10T05:39:27.376804+0000","last_undegraded":"2024-09-10T05:39:27.376804+0000","last_fullsized":"2024-09-10T05:39:27.376804+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:13:31.933741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.899307+0000","last_change":"2024-09-10T05:36:21.665833+0000","last_active":"2024-09-10T05:37:55.899307+0000","last_peered":"2024-09-10T05:37:55.899307+0000","last_clean":"2024-09-10T05:37:55.899307+0000","last_became_active":"2024-09-10T05:36:21.665112+0000","last_became_peered":"2024-09-10T05:36:21.665112+0000","last_unstale":"2024-09-10T05:37:55.899307+0000","last_undegraded":"2024-09-10T05:37:55.899307+0000","last_fullsized":"2024-09-10T05:37:55.899307+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:16:25.547381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"32'8","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.714229+0000","last_change":"2024-09-10T05:36:13.620715+0000","last_active":"2024-09-10T05:37:53.714229+0000","last_peered":"2024-09-10T05:37:53.714229+0000","last_clean":"2024-09-10T05:37:53.714229+0000","last_became_active":"2024-09-10T05:36:13.614222+0000","last_became_peered":"2024-09-10T05:36:13.614222+0000","last_unstale":"2024-09-10T05:37:53.714229+0000","last_undegraded":"2024-09-10T05:37:53.714229+0000","last_fullsized":"2024-09-10T05:37:53.714229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:14:25.317688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.180964+0000","last_change":"2024-09-10T05:36:11.593230+0000","last_active":"2024-09-10T05:39:27.180964+0000","last_peered":"2024-09-10T05:39:27.180964+0000","last_clean":"2024-09-10T05:39:27.180964+0000","last_became_active":"2024-09-10T05:36:11.592805+0000","last_became_peered":"2024-09-10T05:36:11.592805+0000","last_unstale":"2024-09-10T05:39:27.180964+0000","last_undegraded":"2024-09-10T05:39:27.180964+0000","last_fullsized":"2024-09-10T05:39:27.180964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:02:54.932468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.857006+0000","last_change":"2024-09-10T05:36:15.620727+0000","last_active":"2024-09-10T05:37:53.857006+0000","last_peered":"2024-09-10T05:37:53.857006+0000","last_clean":"2024-09-10T05:37:53.857006+0000","last_became_active":"2024-09-10T05:36:15.620288+0000","last_became_peered":"2024-09-10T05:36:15.620288+0000","last_unstale":"2024-09-10T05:37:53.857006+0000","last_undegraded":"2024-09-10T05:37:53.857006+0000","last_fullsized":"2024-09-10T05:37:53.857006+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:02:23.187158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'60","reported_seq":134,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:23.987842+0000","last_change":"2024-09-10T05:36:17.651973+0000","last_active":"2024-09-10T05:38:23.987842+0000","last_peered":"2024-09-10T05:38:23.987842+0000","last_clean":"2024-09-10T05:38:23.987842+0000","last_became_active":"2024-09-10T05:36:17.651364+0000","last_became_peered":"2024-09-10T05:36:17.651364+0000","last_unstale":"2024-09-10T05:38:23.987842+0000","last_undegraded":"2024-09-10T05:38:23.987842+0000","last_fullsized":"2024-09-10T05:38:23.987842+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:42:52.172095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":74,"num_read_kb":61,"num_write":42,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.721434+0000","last_change":"2024-09-10T05:36:19.659340+0000","last_active":"2024-09-10T05:37:53.721434+0000","last_peered":"2024-09-10T05:37:53.721434+0000","last_clean":"2024-09-10T05:37:53.721434+0000","last_became_active":"2024-09-10T05:36:19.658646+0000","last_became_peered":"2024-09-10T05:36:19.658646+0000","last_unstale":"2024-09-10T05:37:53.721434+0000","last_undegraded":"2024-09-10T05:37:53.721434+0000","last_fullsized":"2024-09-10T05:37:53.721434+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:22:35.133305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"34'4","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.471685+0000","last_change":"2024-09-10T05:36:21.689581+0000","last_active":"2024-09-10T05:39:27.471685+0000","last_peered":"2024-09-10T05:39:27.471685+0000","last_clean":"2024-09-10T05:39:27.471685+0000","last_became_active":"2024-09-10T05:36:21.688695+0000","last_became_peered":"2024-09-10T05:36:21.688695+0000","last_unstale":"2024-09-10T05:39:27.471685+0000","last_undegraded":"2024-09-10T05:39:27.471685+0000","last_fullsized":"2024-09-10T05:39:27.471685+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:53.585393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"34'4","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:21.802832+0000","last_change":"2024-09-10T05:36:13.616187+0000","last_active":"2024-09-10T05:38:21.802832+0000","last_peered":"2024-09-10T05:38:21.802832+0000","last_clean":"2024-09-10T05:38:21.802832+0000","last_became_active":"2024-09-10T05:36:13.615340+0000","last_became_peered":"2024-09-10T05:36:13.615340+0000","last_unstale":"2024-09-10T05:38:21.802832+0000","last_undegraded":"2024-09-10T05:38:21.802832+0000","last_fullsized":"2024-09-10T05:38:21.802832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:35:40.336140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"30'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.897590+0000","last_change":"2024-09-10T05:36:11.598985+0000","last_active":"2024-09-10T05:37:55.897590+0000","last_peered":"2024-09-10T05:37:55.897590+0000","last_clean":"2024-09-10T05:37:55.897590+0000","last_became_active":"2024-09-10T05:36:11.597360+0000","last_became_peered":"2024-09-10T05:36:11.597360+0000","last_unstale":"2024-09-10T05:37:55.897590+0000","last_undegraded":"2024-09-10T05:37:55.897590+0000","last_fullsized":"2024-09-10T05:37:55.897590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:38:31.576663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.902188+0000","last_change":"2024-09-10T05:36:15.620708+0000","last_active":"2024-09-10T05:37:55.902188+0000","last_peered":"2024-09-10T05:37:55.902188+0000","last_clean":"2024-09-10T05:37:55.902188+0000","last_became_active":"2024-09-10T05:36:15.619849+0000","last_became_peered":"2024-09-10T05:36:15.619849+0000","last_unstale":"2024-09-10T05:37:55.902188+0000","last_undegraded":"2024-09-10T05:37:55.902188+0000","last_fullsized":"2024-09-10T05:37:55.902188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:47:32.506655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"34'37","reported_seq":90,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:23.989171+0000","last_change":"2024-09-10T05:36:17.647578+0000","last_active":"2024-09-10T05:38:23.989171+0000","last_peered":"2024-09-10T05:38:23.989171+0000","last_clean":"2024-09-10T05:38:23.989171+0000","last_became_active":"2024-09-10T05:36:17.646780+0000","last_became_peered":"2024-09-10T05:36:17.646780+0000","last_unstale":"2024-09-10T05:38:23.989171+0000","last_undegraded":"2024-09-10T05:38:23.989171+0000","last_fullsized":"2024-09-10T05:38:23.989171+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:44.392590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.896432+0000","last_change":"2024-09-10T05:36:19.652878+0000","last_active":"2024-09-10T05:37:55.896432+0000","last_peered":"2024-09-10T05:37:55.896432+0000","last_clean":"2024-09-10T05:37:55.896432+0000","last_became_active":"2024-09-10T05:36:19.652114+0000","last_became_peered":"2024-09-10T05:36:19.652114+0000","last_unstale":"2024-09-10T05:37:55.896432+0000","last_undegraded":"2024-09-10T05:37:55.896432+0000","last_fullsized":"2024-09-10T05:37:55.896432+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:46:40.081106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.16","version":"34'2","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.271654+0000","last_change":"2024-09-10T05:36:21.693139+0000","last_active":"2024-09-10T05:39:27.271654+0000","last_peered":"2024-09-10T05:39:27.271654+0000","last_clean":"2024-09-10T05:39:27.271654+0000","last_became_active":"2024-09-10T05:36:21.692564+0000","last_became_peered":"2024-09-10T05:36:21.692564+0000","last_unstale":"2024-09-10T05:39:27.271654+0000","last_undegraded":"2024-09-10T05:39:27.271654+0000","last_fullsized":"2024-09-10T05:39:27.271654+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:51.507378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'6","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:26.195675+0000","last_change":"2024-09-10T05:36:13.600568+0000","last_active":"2024-09-10T05:38:26.195675+0000","last_peered":"2024-09-10T05:38:26.195675+0000","last_clean":"2024-09-10T05:38:26.195675+0000","last_became_active":"2024-09-10T05:36:13.600225+0000","last_became_peered":"2024-09-10T05:36:13.600225+0000","last_unstale":"2024-09-10T05:38:26.195675+0000","last_undegraded":"2024-09-10T05:38:26.195675+0000","last_fullsized":"2024-09-10T05:38:26.195675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:12:34.999826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.729875+0000","last_change":"2024-09-10T05:36:11.600905+0000","last_active":"2024-09-10T05:37:53.729875+0000","last_peered":"2024-09-10T05:37:53.729875+0000","last_clean":"2024-09-10T05:37:53.729875+0000","last_became_active":"2024-09-10T05:36:11.600598+0000","last_became_peered":"2024-09-10T05:36:11.600598+0000","last_unstale":"2024-09-10T05:37:53.729875+0000","last_undegraded":"2024-09-10T05:37:53.729875+0000","last_fullsized":"2024-09-10T05:37:53.729875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:33:49.620025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.853389+0000","last_change":"2024-09-10T05:36:15.635553+0000","last_active":"2024-09-10T05:37:53.853389+0000","last_peered":"2024-09-10T05:37:53.853389+0000","last_clean":"2024-09-10T05:37:53.853389+0000","last_became_active":"2024-09-10T05:36:15.634465+0000","last_became_peered":"2024-09-10T05:36:15.634465+0000","last_unstale":"2024-09-10T05:37:53.853389+0000","last_undegraded":"2024-09-10T05:37:53.853389+0000","last_fullsized":"2024-09-10T05:37:53.853389+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:18:38.683911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'33","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:26.200284+0000","last_change":"2024-09-10T05:36:17.635770+0000","last_active":"2024-09-10T05:38:26.200284+0000","last_peered":"2024-09-10T05:38:26.200284+0000","last_clean":"2024-09-10T05:38:26.200284+0000","last_became_active":"2024-09-10T05:36:17.634874+0000","last_became_peered":"2024-09-10T05:36:17.634874+0000","last_unstale":"2024-09-10T05:38:26.200284+0000","last_undegraded":"2024-09-10T05:38:26.200284+0000","last_fullsized":"2024-09-10T05:38:26.200284+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:54:06.818353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":27,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.898394+0000","last_change":"2024-09-10T05:36:19.638483+0000","last_active":"2024-09-10T05:37:55.898394+0000","last_peered":"2024-09-10T05:37:55.898394+0000","last_clean":"2024-09-10T05:37:55.898394+0000","last_became_active":"2024-09-10T05:36:19.637682+0000","last_became_peered":"2024-09-10T05:36:19.637682+0000","last_unstale":"2024-09-10T05:37:55.898394+0000","last_undegraded":"2024-09-10T05:37:55.898394+0000","last_fullsized":"2024-09-10T05:37:55.898394+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:35.498813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"34'4","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.056283+0000","last_change":"2024-09-10T05:36:21.688794+0000","last_active":"2024-09-10T05:38:24.056283+0000","last_peered":"2024-09-10T05:38:24.056283+0000","last_clean":"2024-09-10T05:38:24.056283+0000","last_became_active":"2024-09-10T05:36:21.688046+0000","last_became_peered":"2024-09-10T05:36:21.688046+0000","last_unstale":"2024-09-10T05:38:24.056283+0000","last_undegraded":"2024-09-10T05:38:24.056283+0000","last_fullsized":"2024-09-10T05:38:24.056283+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:06:36.753067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.200751+0000","last_change":"2024-09-10T05:36:13.612701+0000","last_active":"2024-09-10T05:39:27.200751+0000","last_peered":"2024-09-10T05:39:27.200751+0000","last_clean":"2024-09-10T05:39:27.200751+0000","last_became_active":"2024-09-10T05:36:13.611864+0000","last_became_peered":"2024-09-10T05:36:13.611864+0000","last_unstale":"2024-09-10T05:39:27.200751+0000","last_undegraded":"2024-09-10T05:39:27.200751+0000","last_fullsized":"2024-09-10T05:39:27.200751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:07:57.487596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"32'3","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.859772+0000","last_change":"2024-09-10T05:36:11.595800+0000","last_active":"2024-09-10T05:37:53.859772+0000","last_peered":"2024-09-10T05:37:53.859772+0000","last_clean":"2024-09-10T05:37:53.859772+0000","last_became_active":"2024-09-10T05:36:11.594949+0000","last_became_peered":"2024-09-10T05:36:11.594949+0000","last_unstale":"2024-09-10T05:37:53.859772+0000","last_undegraded":"2024-09-10T05:37:53.859772+0000","last_fullsized":"2024-09-10T05:37:53.859772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:42.468342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:22.306367+0000","last_change":"2024-09-10T05:36:15.619284+0000","last_active":"2024-09-10T05:38:22.306367+0000","last_peered":"2024-09-10T05:38:22.306367+0000","last_clean":"2024-09-10T05:38:22.306367+0000","last_became_active":"2024-09-10T05:36:15.618169+0000","last_became_peered":"2024-09-10T05:36:15.618169+0000","last_unstale":"2024-09-10T05:38:22.306367+0000","last_undegraded":"2024-09-10T05:38:22.306367+0000","last_fullsized":"2024-09-10T05:38:22.306367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:22:48.592489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'47","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.260272+0000","last_change":"2024-09-10T05:36:17.631950+0000","last_active":"2024-09-10T05:39:26.260272+0000","last_peered":"2024-09-10T05:39:26.260272+0000","last_clean":"2024-09-10T05:39:26.260272+0000","last_became_active":"2024-09-10T05:36:17.631194+0000","last_became_peered":"2024-09-10T05:36:17.631194+0000","last_unstale":"2024-09-10T05:39:26.260272+0000","last_undegraded":"2024-09-10T05:39:26.260272+0000","last_fullsized":"2024-09-10T05:39:26.260272+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:53:16.893462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":67,"num_write":34,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.713950+0000","last_change":"2024-09-10T05:36:19.637266+0000","last_active":"2024-09-10T05:37:53.713950+0000","last_peered":"2024-09-10T05:37:53.713950+0000","last_clean":"2024-09-10T05:37:53.713950+0000","last_became_active":"2024-09-10T05:36:19.636483+0000","last_became_peered":"2024-09-10T05:36:19.636483+0000","last_unstale":"2024-09-10T05:37:53.713950+0000","last_undegraded":"2024-09-10T05:37:53.713950+0000","last_fullsized":"2024-09-10T05:37:53.713950+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:56:30.945572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"34'8","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.060943+0000","last_change":"2024-09-10T05:36:21.689539+0000","last_active":"2024-09-10T05:38:24.060943+0000","last_peered":"2024-09-10T05:38:24.060943+0000","last_clean":"2024-09-10T05:38:24.060943+0000","last_became_active":"2024-09-10T05:36:21.688818+0000","last_became_peered":"2024-09-10T05:36:21.688818+0000","last_unstale":"2024-09-10T05:38:24.060943+0000","last_undegraded":"2024-09-10T05:38:24.060943+0000","last_fullsized":"2024-09-10T05:38:24.060943+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:50:15.537977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":19,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"34'8","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.381517+0000","last_change":"2024-09-10T05:36:13.618862+0000","last_active":"2024-09-10T05:39:27.381517+0000","last_peered":"2024-09-10T05:39:27.381517+0000","last_clean":"2024-09-10T05:39:27.381517+0000","last_became_active":"2024-09-10T05:36:13.618260+0000","last_became_peered":"2024-09-10T05:36:13.618260+0000","last_unstale":"2024-09-10T05:39:27.381517+0000","last_undegraded":"2024-09-10T05:39:27.381517+0000","last_fullsized":"2024-09-10T05:39:27.381517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:25:48.886027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.711408+0000","last_change":"2024-09-10T05:36:11.604033+0000","last_active":"2024-09-10T05:37:53.711408+0000","last_peered":"2024-09-10T05:37:53.711408+0000","last_clean":"2024-09-10T05:37:53.711408+0000","last_became_active":"2024-09-10T05:36:11.603738+0000","last_became_peered":"2024-09-10T05:36:11.603738+0000","last_unstale":"2024-09-10T05:37:53.711408+0000","last_undegraded":"2024-09-10T05:37:53.711408+0000","last_fullsized":"2024-09-10T05:37:53.711408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:24:44.820464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'14","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.005687+0000","last_change":"2024-09-10T05:36:13.624965+0000","last_active":"2024-09-10T05:39:27.005687+0000","last_peered":"2024-09-10T05:39:27.005687+0000","last_clean":"2024-09-10T05:39:27.005687+0000","last_became_active":"2024-09-10T05:36:13.624460+0000","last_became_peered":"2024-09-10T05:36:13.624460+0000","last_unstale":"2024-09-10T05:39:27.005687+0000","last_undegraded":"2024-09-10T05:39:27.005687+0000","last_fullsized":"2024-09-10T05:39:27.005687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:05:54.096604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":58,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"34'1","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:17.679564+0000","last_change":"2024-09-10T05:36:11.602104+0000","last_active":"2024-09-10T05:38:17.679564+0000","last_peered":"2024-09-10T05:38:17.679564+0000","last_clean":"2024-09-10T05:38:17.679564+0000","last_became_active":"2024-09-10T05:36:11.601762+0000","last_became_peered":"2024-09-10T05:36:11.601762+0000","last_unstale":"2024-09-10T05:38:17.679564+0000","last_undegraded":"2024-09-10T05:38:17.679564+0000","last_fullsized":"2024-09-10T05:38:17.679564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:40:20.378957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"34'20","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.202070+0000","last_change":"2024-09-10T05:36:13.615511+0000","last_active":"2024-09-10T05:39:27.202070+0000","last_peered":"2024-09-10T05:39:27.202070+0000","last_clean":"2024-09-10T05:39:27.202070+0000","last_became_active":"2024-09-10T05:36:13.614221+0000","last_became_peered":"2024-09-10T05:36:13.614221+0000","last_unstale":"2024-09-10T05:39:27.202070+0000","last_undegraded":"2024-09-10T05:39:27.202070+0000","last_fullsized":"2024-09-10T05:39:27.202070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:22:46.581156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":66,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.723905+0000","last_change":"2024-09-10T05:36:11.606212+0000","last_active":"2024-09-10T05:37:53.723905+0000","last_peered":"2024-09-10T05:37:53.723905+0000","last_clean":"2024-09-10T05:37:53.723905+0000","last_became_active":"2024-09-10T05:36:11.601269+0000","last_became_peered":"2024-09-10T05:36:11.601269+0000","last_unstale":"2024-09-10T05:37:53.723905+0000","last_undegraded":"2024-09-10T05:37:53.723905+0000","last_fullsized":"2024-09-10T05:37:53.723905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:20.541837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'21","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.222435+0000","last_change":"2024-09-10T05:36:13.626184+0000","last_active":"2024-09-10T05:39:27.222435+0000","last_peered":"2024-09-10T05:39:27.222435+0000","last_clean":"2024-09-10T05:39:27.222435+0000","last_became_active":"2024-09-10T05:36:13.626022+0000","last_became_peered":"2024-09-10T05:36:13.626022+0000","last_unstale":"2024-09-10T05:39:27.222435+0000","last_undegraded":"2024-09-10T05:39:27.222435+0000","last_fullsized":"2024-09-10T05:39:27.222435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:53:45.495092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":48,"num_read_kb":40,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.713130+0000","last_change":"2024-09-10T05:36:11.611309+0000","last_active":"2024-09-10T05:37:53.713130+0000","last_peered":"2024-09-10T05:37:53.713130+0000","last_clean":"2024-09-10T05:37:53.713130+0000","last_became_active":"2024-09-10T05:36:11.610933+0000","last_became_peered":"2024-09-10T05:36:11.610933+0000","last_unstale":"2024-09-10T05:37:53.713130+0000","last_undegraded":"2024-09-10T05:37:53.713130+0000","last_fullsized":"2024-09-10T05:37:53.713130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:18.400915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"34'14","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.311516+0000","last_change":"2024-09-10T05:36:13.599973+0000","last_active":"2024-09-10T05:39:27.311516+0000","last_peered":"2024-09-10T05:39:27.311516+0000","last_clean":"2024-09-10T05:39:27.311516+0000","last_became_active":"2024-09-10T05:36:13.597975+0000","last_became_peered":"2024-09-10T05:36:13.597975+0000","last_unstale":"2024-09-10T05:39:27.311516+0000","last_undegraded":"2024-09-10T05:39:27.311516+0000","last_fullsized":"2024-09-10T05:39:27.311516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:04.875436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:26.066736+0000","last_change":"2024-09-10T05:36:11.603591+0000","last_active":"2024-09-10T05:38:26.066736+0000","last_peered":"2024-09-10T05:38:26.066736+0000","last_clean":"2024-09-10T05:38:26.066736+0000","last_became_active":"2024-09-10T05:36:11.603085+0000","last_became_peered":"2024-09-10T05:36:11.603085+0000","last_unstale":"2024-09-10T05:38:26.066736+0000","last_undegraded":"2024-09-10T05:38:26.066736+0000","last_fullsized":"2024-09-10T05:38:26.066736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:10:49.254963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.854228+0000","last_change":"2024-09-10T05:36:13.611510+0000","last_active":"2024-09-10T05:37:53.854228+0000","last_peered":"2024-09-10T05:37:53.854228+0000","last_clean":"2024-09-10T05:37:53.854228+0000","last_became_active":"2024-09-10T05:36:13.610894+0000","last_became_peered":"2024-09-10T05:36:13.610894+0000","last_unstale":"2024-09-10T05:37:53.854228+0000","last_undegraded":"2024-09-10T05:37:53.854228+0000","last_fullsized":"2024-09-10T05:37:53.854228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:07:55.559113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.854514+0000","last_change":"2024-09-10T05:36:11.593190+0000","last_active":"2024-09-10T05:37:53.854514+0000","last_peered":"2024-09-10T05:37:53.854514+0000","last_clean":"2024-09-10T05:37:53.854514+0000","last_became_active":"2024-09-10T05:36:11.592809+0000","last_became_peered":"2024-09-10T05:36:11.592809+0000","last_unstale":"2024-09-10T05:37:53.854514+0000","last_undegraded":"2024-09-10T05:37:53.854514+0000","last_fullsized":"2024-09-10T05:37:53.854514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:58:36.951469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:26.178147+0000","last_change":"2024-09-10T05:36:13.607562+0000","last_active":"2024-09-10T05:38:26.178147+0000","last_peered":"2024-09-10T05:38:26.178147+0000","last_clean":"2024-09-10T05:38:26.178147+0000","last_became_active":"2024-09-10T05:36:13.607052+0000","last_became_peered":"2024-09-10T05:36:13.607052+0000","last_unstale":"2024-09-10T05:38:26.178147+0000","last_undegraded":"2024-09-10T05:38:26.178147+0000","last_fullsized":"2024-09-10T05:38:26.178147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:33:32.480741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"32'2","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.715328+0000","last_change":"2024-09-10T05:36:11.594051+0000","last_active":"2024-09-10T05:37:53.715328+0000","last_peered":"2024-09-10T05:37:53.715328+0000","last_clean":"2024-09-10T05:37:53.715328+0000","last_became_active":"2024-09-10T05:36:11.593614+0000","last_became_peered":"2024-09-10T05:36:11.593614+0000","last_unstale":"2024-09-10T05:37:53.715328+0000","last_undegraded":"2024-09-10T05:37:53.715328+0000","last_fullsized":"2024-09-10T05:37:53.715328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:46:37.205574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.363940+0000","last_change":"2024-09-10T05:36:13.595278+0000","last_active":"2024-09-10T05:39:27.363940+0000","last_peered":"2024-09-10T05:39:27.363940+0000","last_clean":"2024-09-10T05:39:27.363940+0000","last_became_active":"2024-09-10T05:36:13.593693+0000","last_became_peered":"2024-09-10T05:36:13.593693+0000","last_unstale":"2024-09-10T05:39:27.363940+0000","last_undegraded":"2024-09-10T05:39:27.363940+0000","last_fullsized":"2024-09-10T05:39:27.363940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:22:11.979321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"34'8","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.727061+0000","last_change":"2024-09-10T05:36:11.606672+0000","last_active":"2024-09-10T05:39:26.727061+0000","last_peered":"2024-09-10T05:39:26.727061+0000","last_clean":"2024-09-10T05:39:26.727061+0000","last_became_active":"2024-09-10T05:36:11.604011+0000","last_became_peered":"2024-09-10T05:36:11.604011+0000","last_unstale":"2024-09-10T05:39:26.727061+0000","last_undegraded":"2024-09-10T05:39:26.727061+0000","last_fullsized":"2024-09-10T05:39:26.727061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:10:51.639983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":24,"num_write_kb":12289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"34'16","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:26.194535+0000","last_change":"2024-09-10T05:36:13.630165+0000","last_active":"2024-09-10T05:38:26.194535+0000","last_peered":"2024-09-10T05:38:26.194535+0000","last_clean":"2024-09-10T05:38:26.194535+0000","last_became_active":"2024-09-10T05:36:13.629760+0000","last_became_peered":"2024-09-10T05:36:13.629760+0000","last_unstale":"2024-09-10T05:38:26.194535+0000","last_undegraded":"2024-09-10T05:38:26.194535+0000","last_fullsized":"2024-09-10T05:38:26.194535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:59:45.392768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":66,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.721785+0000","last_change":"2024-09-10T05:36:11.597692+0000","last_active":"2024-09-10T05:37:53.721785+0000","last_peered":"2024-09-10T05:37:53.721785+0000","last_clean":"2024-09-10T05:37:53.721785+0000","last_became_active":"2024-09-10T05:36:11.597158+0000","last_became_peered":"2024-09-10T05:36:11.597158+0000","last_unstale":"2024-09-10T05:37:53.721785+0000","last_undegraded":"2024-09-10T05:37:53.721785+0000","last_fullsized":"2024-09-10T05:37:53.721785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:49.958598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.006147+0000","last_change":"2024-09-10T05:36:13.613919+0000","last_active":"2024-09-10T05:39:27.006147+0000","last_peered":"2024-09-10T05:39:27.006147+0000","last_clean":"2024-09-10T05:39:27.006147+0000","last_became_active":"2024-09-10T05:36:13.613206+0000","last_became_peered":"2024-09-10T05:36:13.613206+0000","last_unstale":"2024-09-10T05:39:27.006147+0000","last_undegraded":"2024-09-10T05:39:27.006147+0000","last_fullsized":"2024-09-10T05:39:27.006147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:20:09.645015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.854005+0000","last_change":"2024-09-10T05:36:52.706116+0000","last_active":"2024-09-10T05:37:53.854005+0000","last_peered":"2024-09-10T05:37:53.854005+0000","last_clean":"2024-09-10T05:37:53.854005+0000","last_became_active":"2024-09-10T05:36:52.705212+0000","last_became_peered":"2024-09-10T05:36:52.705212+0000","last_unstale":"2024-09-10T05:37:53.854005+0000","last_undegraded":"2024-09-10T05:37:53.854005+0000","last_fullsized":"2024-09-10T05:37:53.854005+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:27.831627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.005396+0000","last_change":"2024-09-10T05:36:13.627667+0000","last_active":"2024-09-10T05:39:27.005396+0000","last_peered":"2024-09-10T05:39:27.005396+0000","last_clean":"2024-09-10T05:39:27.005396+0000","last_became_active":"2024-09-10T05:36:13.626912+0000","last_became_peered":"2024-09-10T05:36:13.626912+0000","last_unstale":"2024-09-10T05:39:27.005396+0000","last_undegraded":"2024-09-10T05:39:27.005396+0000","last_fullsized":"2024-09-10T05:39:27.005396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:36.054213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.896918+0000","last_change":"2024-09-10T05:36:11.607179+0000","last_active":"2024-09-10T05:37:55.896918+0000","last_peered":"2024-09-10T05:37:55.896918+0000","last_clean":"2024-09-10T05:37:55.896918+0000","last_became_active":"2024-09-10T05:36:11.606369+0000","last_became_peered":"2024-09-10T05:36:11.606369+0000","last_unstale":"2024-09-10T05:37:55.896918+0000","last_undegraded":"2024-09-10T05:37:55.896918+0000","last_fullsized":"2024-09-10T05:37:55.896918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:14:23.688323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"32'8","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.858816+0000","last_change":"2024-09-10T05:36:13.608226+0000","last_active":"2024-09-10T05:37:53.858816+0000","last_peered":"2024-09-10T05:37:53.858816+0000","last_clean":"2024-09-10T05:37:53.858816+0000","last_became_active":"2024-09-10T05:36:13.607807+0000","last_became_peered":"2024-09-10T05:36:13.607807+0000","last_unstale":"2024-09-10T05:37:53.858816+0000","last_undegraded":"2024-09-10T05:37:53.858816+0000","last_fullsized":"2024-09-10T05:37:53.858816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:30:41.672233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.854315+0000","last_change":"2024-09-10T05:36:11.594296+0000","last_active":"2024-09-10T05:37:53.854315+0000","last_peered":"2024-09-10T05:37:53.854315+0000","last_clean":"2024-09-10T05:37:53.854315+0000","last_became_active":"2024-09-10T05:36:11.593962+0000","last_became_peered":"2024-09-10T05:36:11.593962+0000","last_unstale":"2024-09-10T05:37:53.854315+0000","last_undegraded":"2024-09-10T05:37:53.854315+0000","last_fullsized":"2024-09-10T05:37:53.854315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:55.429080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.902466+0000","last_change":"2024-09-10T05:36:13.615141+0000","last_active":"2024-09-10T05:37:55.902466+0000","last_peered":"2024-09-10T05:37:55.902466+0000","last_clean":"2024-09-10T05:37:55.902466+0000","last_became_active":"2024-09-10T05:36:13.614155+0000","last_became_peered":"2024-09-10T05:36:13.614155+0000","last_unstale":"2024-09-10T05:37:55.902466+0000","last_undegraded":"2024-09-10T05:37:55.902466+0000","last_fullsized":"2024-09-10T05:37:55.902466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:39:44.309572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.724975+0000","last_change":"2024-09-10T05:36:11.603262+0000","last_active":"2024-09-10T05:37:53.724975+0000","last_peered":"2024-09-10T05:37:53.724975+0000","last_clean":"2024-09-10T05:37:53.724975+0000","last_became_active":"2024-09-10T05:36:11.602866+0000","last_became_peered":"2024-09-10T05:36:11.602866+0000","last_unstale":"2024-09-10T05:37:53.724975+0000","last_undegraded":"2024-09-10T05:37:53.724975+0000","last_fullsized":"2024-09-10T05:37:53.724975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:54:03.517815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'15","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.381320+0000","last_change":"2024-09-10T05:36:13.613437+0000","last_active":"2024-09-10T05:39:27.381320+0000","last_peered":"2024-09-10T05:39:27.381320+0000","last_clean":"2024-09-10T05:39:27.381320+0000","last_became_active":"2024-09-10T05:36:13.611391+0000","last_became_peered":"2024-09-10T05:36:13.611391+0000","last_unstale":"2024-09-10T05:39:27.381320+0000","last_undegraded":"2024-09-10T05:39:27.381320+0000","last_fullsized":"2024-09-10T05:39:27.381320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:28:23.276697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.853711+0000","last_change":"2024-09-10T05:36:52.707618+0000","last_active":"2024-09-10T05:37:53.853711+0000","last_peered":"2024-09-10T05:37:53.853711+0000","last_clean":"2024-09-10T05:37:53.853711+0000","last_became_active":"2024-09-10T05:36:52.706226+0000","last_became_peered":"2024-09-10T05:36:52.706226+0000","last_unstale":"2024-09-10T05:37:53.853711+0000","last_undegraded":"2024-09-10T05:37:53.853711+0000","last_fullsized":"2024-09-10T05:37:53.853711+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:21:59.439322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"34'10","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.200918+0000","last_change":"2024-09-10T05:36:13.616625+0000","last_active":"2024-09-10T05:39:27.200918+0000","last_peered":"2024-09-10T05:39:27.200918+0000","last_clean":"2024-09-10T05:39:27.200918+0000","last_became_active":"2024-09-10T05:36:13.616136+0000","last_became_peered":"2024-09-10T05:36:13.616136+0000","last_unstale":"2024-09-10T05:39:27.200918+0000","last_undegraded":"2024-09-10T05:39:27.200918+0000","last_fullsized":"2024-09-10T05:39:27.200918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:40:37.044525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"32'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.715111+0000","last_change":"2024-09-10T05:36:11.600692+0000","last_active":"2024-09-10T05:37:53.715111+0000","last_peered":"2024-09-10T05:37:53.715111+0000","last_clean":"2024-09-10T05:37:53.715111+0000","last_became_active":"2024-09-10T05:36:11.600234+0000","last_became_peered":"2024-09-10T05:36:11.600234+0000","last_unstale":"2024-09-10T05:37:53.715111+0000","last_undegraded":"2024-09-10T05:37:53.715111+0000","last_fullsized":"2024-09-10T05:37:53.715111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:23:34.604922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"30'2","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.899857+0000","last_change":"2024-09-10T05:36:13.615416+0000","last_active":"2024-09-10T05:37:55.899857+0000","last_peered":"2024-09-10T05:37:55.899857+0000","last_clean":"2024-09-10T05:37:55.899857+0000","last_became_active":"2024-09-10T05:36:13.614098+0000","last_became_peered":"2024-09-10T05:36:13.614098+0000","last_unstale":"2024-09-10T05:37:55.899857+0000","last_undegraded":"2024-09-10T05:37:55.899857+0000","last_fullsized":"2024-09-10T05:37:55.899857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:56:24.907751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"30'2","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.729428+0000","last_change":"2024-09-10T05:36:11.606179+0000","last_active":"2024-09-10T05:37:53.729428+0000","last_peered":"2024-09-10T05:37:53.729428+0000","last_clean":"2024-09-10T05:37:53.729428+0000","last_became_active":"2024-09-10T05:36:11.603972+0000","last_became_peered":"2024-09-10T05:36:11.603972+0000","last_unstale":"2024-09-10T05:37:53.729428+0000","last_undegraded":"2024-09-10T05:37:53.729428+0000","last_fullsized":"2024-09-10T05:37:53.729428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:01:31.149492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.897044+0000","last_change":"2024-09-10T05:36:11.597226+0000","last_active":"2024-09-10T05:37:55.897044+0000","last_peered":"2024-09-10T05:37:55.897044+0000","last_clean":"2024-09-10T05:37:55.897044+0000","last_became_active":"2024-09-10T05:36:11.595183+0000","last_became_peered":"2024-09-10T05:36:11.595183+0000","last_unstale":"2024-09-10T05:37:55.897044+0000","last_undegraded":"2024-09-10T05:37:55.897044+0000","last_fullsized":"2024-09-10T05:37:55.897044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:40:04.618907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"34'8","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.296974+0000","last_change":"2024-09-10T05:36:13.623166+0000","last_active":"2024-09-10T05:39:27.296974+0000","last_peered":"2024-09-10T05:39:27.296974+0000","last_clean":"2024-09-10T05:39:27.296974+0000","last_became_active":"2024-09-10T05:36:13.622559+0000","last_became_peered":"2024-09-10T05:36:13.622559+0000","last_unstale":"2024-09-10T05:39:27.296974+0000","last_undegraded":"2024-09-10T05:39:27.296974+0000","last_fullsized":"2024-09-10T05:39:27.296974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:42:51.927427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"34'1","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:32.688141+0000","last_change":"2024-09-10T05:36:11.591759+0000","last_active":"2024-09-10T05:38:32.688141+0000","last_peered":"2024-09-10T05:38:32.688141+0000","last_clean":"2024-09-10T05:38:32.688141+0000","last_became_active":"2024-09-10T05:36:11.588124+0000","last_became_peered":"2024-09-10T05:36:11.588124+0000","last_unstale":"2024-09-10T05:38:32.688141+0000","last_undegraded":"2024-09-10T05:38:32.688141+0000","last_fullsized":"2024-09-10T05:38:32.688141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:46:37.205574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"34'20","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.383693+0000","last_change":"2024-09-10T05:36:13.618023+0000","last_active":"2024-09-10T05:39:27.383693+0000","last_peered":"2024-09-10T05:39:27.383693+0000","last_clean":"2024-09-10T05:39:27.383693+0000","last_became_active":"2024-09-10T05:36:13.614959+0000","last_became_peered":"2024-09-10T05:36:13.614959+0000","last_unstale":"2024-09-10T05:39:27.383693+0000","last_undegraded":"2024-09-10T05:39:27.383693+0000","last_fullsized":"2024-09-10T05:39:27.383693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:10:02.645509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":56,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":692,"num_read_kb":660,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1690,"num_read_kb":1444,"num_write":723,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1470,"ondisk_log_size":1470,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1683,"num_read_kb":1573,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":130,"num_read_kb":83,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":639872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51617792,"data_stored":51611392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640306,"num_pgs":142,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56324,"kb_used_data":16820,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94315516,"statfs":{"total":96636764160,"available":96579088384,"internally_reserved":0,"allocated":17223680,"data_stored":16927949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673011,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45136,"kb_used_data":9792,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94326704,"statfs":{"total":96636764160,"available":96590544896,"internally_reserved":0,"allocated":10027008,"data_stored":9765035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673012,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48668,"kb_used_data":13324,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323172,"statfs":{"total":96636764160,"available":96586928128,"internally_reserved":0,"allocated":13643776,"data_stored":13323216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949673011,"num_pgs":143,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40416,"kb_used_data":13392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94331424,"statfs":{"total":96636764160,"available":96595378176,"internally_reserved":0,"allocated":13713408,"data_stored":13372464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13225984,"data_stored":13222784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9031680,"data_stored":9028480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":2712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T05:39:59.196 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T05:39:59.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.353+0000 7fd28e624640 1 Processor -- start 2024-09-10T05:39:59.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.353+0000 7fd28e624640 1 -- start start 2024-09-10T05:39:59.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.353+0000 7fd28e624640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd28812aee0 0x7fd28812b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:39:59.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.353+0000 7fd28e624640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2880008e0 con 0x7fd28812f110 2024-09-10T05:39:59.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.353+0000 7fd28e624640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fd288071e70 con 0x7fd28812aee0 2024-09-10T05:39:59.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.353+0000 7fd287fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd28812aee0 0x7fd28812b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:39:59.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.353+0000 7fd2877fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd28812f110 0x7fd28812f550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48564/0 (socket says 172.21.15.2:48564) 2024-09-10T05:39:59.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.353+0000 7fd2877fe640 1 -- 172.21.15.2:0/3199255787 learned_addr learned my addr 172.21.15.2:0/3199255787 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T05:39:59.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.353+0000 7fd286ffd640 1 -- 172.21.15.2:0/3199255787 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2401858378 0 0) 0x7fd2880008e0 con 0x7fd28812f110 2024-09-10T05:39:59.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.353+0000 7fd286ffd640 1 -- 172.21.15.2:0/3199255787 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd270003530 con 0x7fd28812f110 2024-09-10T05:39:59.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.353+0000 7fd287fff640 1 -- 172.21.15.2:0/3199255787 >> v1:172.21.15.2:6789/0 conn(0x7fd28812f110 legacy=0x7fd28812f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:39:59.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.353+0000 7fd287fff640 1 -- 172.21.15.2:0/3199255787 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2880a30b0 con 0x7fd28812aee0 2024-09-10T05:39:59.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.357+0000 7fd287fff640 1 --2- 172.21.15.2:0/3199255787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd28812aee0 0x7fd28812b2c0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fd278009740 tx=0x7fd27801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4be9891172a6e806 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:39:59.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.357+0000 7fd286ffd640 1 -- 172.21.15.2:0/3199255787 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2780b1070 con 0x7fd28812aee0 2024-09-10T05:39:59.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.357+0000 7fd286ffd640 1 -- 172.21.15.2:0/3199255787 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2780ac520 con 0x7fd28812aee0 2024-09-10T05:39:59.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.357+0000 7fd286ffd640 1 -- 172.21.15.2:0/3199255787 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2780ac800 con 0x7fd28812aee0 2024-09-10T05:39:59.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.357+0000 7fd28e624640 1 -- 172.21.15.2:0/3199255787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd28812aee0 msgr2=0x7fd28812b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:39:59.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.357+0000 7fd28e624640 1 --2- 172.21.15.2:0/3199255787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd28812aee0 0x7fd28812b2c0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fd278009740 tx=0x7fd27801c370 comp rx=0 tx=0).stop 2024-09-10T05:39:59.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.357+0000 7fd28e624640 1 -- 172.21.15.2:0/3199255787 shutdown_connections 2024-09-10T05:39:59.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.357+0000 7fd28e624640 1 --2- 172.21.15.2:0/3199255787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd28812aee0 0x7fd28812b2c0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:39:59.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.357+0000 7fd28e624640 1 -- 172.21.15.2:0/3199255787 >> 172.21.15.2:0/3199255787 conn(0x7fd2880a0a60 msgr2=0x7fd28806e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:39:59.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.357+0000 7fd28e624640 1 -- 172.21.15.2:0/3199255787 shutdown_connections 2024-09-10T05:39:59.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.357+0000 7fd28e624640 1 -- 172.21.15.2:0/3199255787 wait complete. 2024-09-10T05:39:59.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.361+0000 7fd28e624640 1 Processor -- start 2024-09-10T05:39:59.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.361+0000 7fd28e624640 1 -- start start 2024-09-10T05:39:59.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.361+0000 7fd28e624640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd28812aee0 0x7fd28812a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:39:59.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.361+0000 7fd28e624640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd28812b980 con 0x7fd28812aee0 2024-09-10T05:39:59.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.361+0000 7fd287fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd28812aee0 0x7fd28812a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:39:59.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.361+0000 7fd287fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd28812aee0 0x7fd28812a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35434/0 (socket says 172.21.15.2:35434) 2024-09-10T05:39:59.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.361+0000 7fd287fff640 1 -- 172.21.15.2:0/926042936 learned_addr learned my addr 172.21.15.2:0/926042936 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:39:59.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.361+0000 7fd287fff640 1 -- 172.21.15.2:0/926042936 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd28808d9a0 con 0x7fd28812aee0 2024-09-10T05:39:59.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.361+0000 7fd287fff640 1 --2- 172.21.15.2:0/926042936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd28812aee0 0x7fd28812a200 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fd278019fa0 tx=0x7fd27801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:39:59.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.361+0000 7fd284ff9640 1 -- 172.21.15.2:0/926042936 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2780bc070 con 0x7fd28812aee0 2024-09-10T05:39:59.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.361+0000 7fd284ff9640 1 -- 172.21.15.2:0/926042936 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd278004020 con 0x7fd28812aee0 2024-09-10T05:39:59.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.361+0000 7fd28e624640 1 -- 172.21.15.2:0/926042936 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd28808ebb0 con 0x7fd28812aee0 2024-09-10T05:39:59.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.361+0000 7fd284ff9640 1 -- 172.21.15.2:0/926042936 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2780b1040 con 0x7fd28812aee0 2024-09-10T05:39:59.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.361+0000 7fd28e624640 1 -- 172.21.15.2:0/926042936 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd28812a910 con 0x7fd28812aee0 2024-09-10T05:39:59.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.361+0000 7fd284ff9640 1 -- 172.21.15.2:0/926042936 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd278004340 con 0x7fd28812aee0 2024-09-10T05:39:59.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.361+0000 7fd28e624640 1 -- 172.21.15.2:0/926042936 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd28812b2c0 con 0x7fd28812aee0 2024-09-10T05:39:59.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.361+0000 7fd284ff9640 1 --2- 172.21.15.2:0/926042936 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fd27403b1d0 0x7fd27403d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:39:59.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.361+0000 7fd284ff9640 1 -- 172.21.15.2:0/926042936 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7fd2780e9cf0 con 0x7fd28812aee0 2024-09-10T05:39:59.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.361+0000 7fd2877fe640 1 --2- 172.21.15.2:0/926042936 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fd27403b1d0 0x7fd27403d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:39:59.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.365+0000 7fd2877fe640 1 --2- 172.21.15.2:0/926042936 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fd27403b1d0 0x7fd27403d690 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd27c007fd0 tx=0x7fd27c007900 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:39:59.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.369+0000 7fd284ff9640 1 -- 172.21.15.2:0/926042936 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fd2780a9070 con 0x7fd28812aee0 2024-09-10T05:39:59.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.533+0000 7fd28e624640 1 -- 172.21.15.2:0/926042936 --> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd288073a80 con 0x7fd27403b1d0 2024-09-10T05:39:59.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.565+0000 7fd284ff9640 1 -- 172.21.15.2:0/926042936 <== mgr.4101 v2:172.21.15.62:6824/3663628807 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665574 (secure 0 0 0) 0x7fd288073a80 con 0x7fd27403b1d0 2024-09-10T05:39:59.572 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T05:39:59.582 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-10T05:39:59.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.573+0000 7fd28e624640 1 -- 172.21.15.2:0/926042936 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fd27403b1d0 msgr2=0x7fd27403d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:39:59.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.573+0000 7fd28e624640 1 --2- 172.21.15.2:0/926042936 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fd27403b1d0 0x7fd27403d690 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd27c007fd0 tx=0x7fd27c007900 comp rx=0 tx=0).stop 2024-09-10T05:39:59.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.573+0000 7fd28e624640 1 -- 172.21.15.2:0/926042936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd28812aee0 msgr2=0x7fd28812a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:39:59.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.573+0000 7fd28e624640 1 --2- 172.21.15.2:0/926042936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd28812aee0 0x7fd28812a200 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fd278019fa0 tx=0x7fd27801abb0 comp rx=0 tx=0).stop 2024-09-10T05:39:59.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.573+0000 7fd28e624640 1 -- 172.21.15.2:0/926042936 shutdown_connections 2024-09-10T05:39:59.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.573+0000 7fd28e624640 1 --2- 172.21.15.2:0/926042936 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fd27403b1d0 0x7fd27403d690 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:39:59.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.573+0000 7fd28e624640 1 --2- 172.21.15.2:0/926042936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd28812aee0 0x7fd28812a200 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:39:59.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.573+0000 7fd28e624640 1 -- 172.21.15.2:0/926042936 >> 172.21.15.2:0/926042936 conn(0x7fd2880a0a60 msgr2=0x7fd2880a0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:39:59.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.573+0000 7fd28e624640 1 -- 172.21.15.2:0/926042936 shutdown_connections 2024-09-10T05:39:59.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.573+0000 7fd28e624640 1 -- 172.21.15.2:0/926042936 wait complete. 2024-09-10T05:39:59.596 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2024-09-10T05:39:57.695525+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412816,"num_objects":261,"num_object_clones":0,"num_object_copies":522,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":261,"num_whiteouts":0,"num_read":5222,"num_read_kb":4776,"num_write":2242,"num_write_kb":60587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":639982,"num_keys_recovered":1,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4630,"ondisk_log_size":4630,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":190544,"kb_used_data":53328,"kb_used_omap":6,"kb_used_meta":137145,"kb_avail":377296816,"statfs":{"total":386547056640,"available":386351939584,"internally_reserved":0,"allocated":54607872,"data_stored":53388664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":140437270},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006351"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.898799+0000","last_change":"2024-09-10T05:36:11.606846+0000","last_active":"2024-09-10T05:37:55.898799+0000","last_peered":"2024-09-10T05:37:55.898799+0000","last_clean":"2024-09-10T05:37:55.898799+0000","last_became_active":"2024-09-10T05:36:11.605721+0000","last_became_peered":"2024-09-10T05:36:11.605721+0000","last_unstale":"2024-09-10T05:37:55.898799+0000","last_undegraded":"2024-09-10T05:37:55.898799+0000","last_fullsized":"2024-09-10T05:37:55.898799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:44:08.530179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"30'2","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.900982+0000","last_change":"2024-09-10T05:36:13.628621+0000","last_active":"2024-09-10T05:37:55.900982+0000","last_peered":"2024-09-10T05:37:55.900982+0000","last_clean":"2024-09-10T05:37:55.900982+0000","last_became_active":"2024-09-10T05:36:13.628174+0000","last_became_peered":"2024-09-10T05:36:13.628174+0000","last_unstale":"2024-09-10T05:37:55.900982+0000","last_undegraded":"2024-09-10T05:37:55.900982+0000","last_fullsized":"2024-09-10T05:37:55.900982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:47.128005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"30'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.856072+0000","last_change":"2024-09-10T05:36:11.596391+0000","last_active":"2024-09-10T05:37:53.856072+0000","last_peered":"2024-09-10T05:37:53.856072+0000","last_clean":"2024-09-10T05:37:53.856072+0000","last_became_active":"2024-09-10T05:36:11.596100+0000","last_became_peered":"2024-09-10T05:36:11.596100+0000","last_unstale":"2024-09-10T05:37:53.856072+0000","last_undegraded":"2024-09-10T05:37:53.856072+0000","last_fullsized":"2024-09-10T05:37:53.856072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:45:53.700310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"34'5","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:43.687749+0000","last_change":"2024-09-10T05:36:13.601197+0000","last_active":"2024-09-10T05:38:43.687749+0000","last_peered":"2024-09-10T05:38:43.687749+0000","last_clean":"2024-09-10T05:38:43.687749+0000","last_became_active":"2024-09-10T05:36:13.598320+0000","last_became_peered":"2024-09-10T05:36:13.598320+0000","last_unstale":"2024-09-10T05:38:43.687749+0000","last_undegraded":"2024-09-10T05:38:43.687749+0000","last_fullsized":"2024-09-10T05:38:43.687749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:38:17.550395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.726285+0000","last_change":"2024-09-10T05:36:11.604217+0000","last_active":"2024-09-10T05:37:53.726285+0000","last_peered":"2024-09-10T05:37:53.726285+0000","last_clean":"2024-09-10T05:37:53.726285+0000","last_became_active":"2024-09-10T05:36:11.603193+0000","last_became_peered":"2024-09-10T05:36:11.603193+0000","last_unstale":"2024-09-10T05:37:53.726285+0000","last_undegraded":"2024-09-10T05:37:53.726285+0000","last_fullsized":"2024-09-10T05:37:53.726285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:09:46.125040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'10","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.200739+0000","last_change":"2024-09-10T05:36:13.604439+0000","last_active":"2024-09-10T05:39:27.200739+0000","last_peered":"2024-09-10T05:39:27.200739+0000","last_clean":"2024-09-10T05:39:27.200739+0000","last_became_active":"2024-09-10T05:36:13.604094+0000","last_became_peered":"2024-09-10T05:36:13.604094+0000","last_unstale":"2024-09-10T05:39:27.200739+0000","last_undegraded":"2024-09-10T05:39:27.200739+0000","last_fullsized":"2024-09-10T05:39:27.200739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:17:01.676891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.713626+0000","last_change":"2024-09-10T05:36:11.611784+0000","last_active":"2024-09-10T05:37:53.713626+0000","last_peered":"2024-09-10T05:37:53.713626+0000","last_clean":"2024-09-10T05:37:53.713626+0000","last_became_active":"2024-09-10T05:36:11.611399+0000","last_became_peered":"2024-09-10T05:36:11.611399+0000","last_unstale":"2024-09-10T05:37:53.713626+0000","last_undegraded":"2024-09-10T05:37:53.713626+0000","last_fullsized":"2024-09-10T05:37:53.713626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:34:57.058604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'10","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.363850+0000","last_change":"2024-09-10T05:36:52.703620+0000","last_active":"2024-09-10T05:39:27.363850+0000","last_peered":"2024-09-10T05:39:27.363850+0000","last_clean":"2024-09-10T05:39:27.363850+0000","last_became_active":"2024-09-10T05:36:52.702713+0000","last_became_peered":"2024-09-10T05:36:52.702713+0000","last_unstale":"2024-09-10T05:39:27.363850+0000","last_undegraded":"2024-09-10T05:39:27.363850+0000","last_fullsized":"2024-09-10T05:39:27.363850+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:09:12.955195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.897222+0000","last_change":"2024-09-10T05:36:11.598408+0000","last_active":"2024-09-10T05:37:55.897222+0000","last_peered":"2024-09-10T05:37:55.897222+0000","last_clean":"2024-09-10T05:37:55.897222+0000","last_became_active":"2024-09-10T05:36:11.597514+0000","last_became_peered":"2024-09-10T05:36:11.597514+0000","last_unstale":"2024-09-10T05:37:55.897222+0000","last_undegraded":"2024-09-10T05:37:55.897222+0000","last_fullsized":"2024-09-10T05:37:55.897222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:23.782584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"34'11","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.024907+0000","last_change":"2024-09-10T05:36:13.622714+0000","last_active":"2024-09-10T05:39:27.024907+0000","last_peered":"2024-09-10T05:39:27.024907+0000","last_clean":"2024-09-10T05:39:27.024907+0000","last_became_active":"2024-09-10T05:36:13.621573+0000","last_became_peered":"2024-09-10T05:36:13.621573+0000","last_unstale":"2024-09-10T05:39:27.024907+0000","last_undegraded":"2024-09-10T05:39:27.024907+0000","last_fullsized":"2024-09-10T05:39:27.024907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:33.906083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.902223+0000","last_change":"2024-09-10T05:36:52.704991+0000","last_active":"2024-09-10T05:37:55.902223+0000","last_peered":"2024-09-10T05:37:55.902223+0000","last_clean":"2024-09-10T05:37:55.902223+0000","last_became_active":"2024-09-10T05:36:52.704285+0000","last_became_peered":"2024-09-10T05:36:52.704285+0000","last_unstale":"2024-09-10T05:37:55.902223+0000","last_undegraded":"2024-09-10T05:37:55.902223+0000","last_fullsized":"2024-09-10T05:37:55.902223+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:31:44.000002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.905524+0000","last_change":"2024-09-10T05:36:13.613130+0000","last_active":"2024-09-10T05:37:55.905524+0000","last_peered":"2024-09-10T05:37:55.905524+0000","last_clean":"2024-09-10T05:37:55.905524+0000","last_became_active":"2024-09-10T05:36:13.612127+0000","last_became_peered":"2024-09-10T05:36:13.612127+0000","last_unstale":"2024-09-10T05:37:55.905524+0000","last_undegraded":"2024-09-10T05:37:55.905524+0000","last_fullsized":"2024-09-10T05:37:55.905524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:55:15.649785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.723024+0000","last_change":"2024-09-10T05:36:11.598434+0000","last_active":"2024-09-10T05:37:53.723024+0000","last_peered":"2024-09-10T05:37:53.723024+0000","last_clean":"2024-09-10T05:37:53.723024+0000","last_became_active":"2024-09-10T05:36:11.598054+0000","last_became_peered":"2024-09-10T05:36:11.598054+0000","last_unstale":"2024-09-10T05:37:53.723024+0000","last_undegraded":"2024-09-10T05:37:53.723024+0000","last_fullsized":"2024-09-10T05:37:53.723024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:15:17.547203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'8","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.905442+0000","last_change":"2024-09-10T05:36:13.613557+0000","last_active":"2024-09-10T05:37:55.905442+0000","last_peered":"2024-09-10T05:37:55.905442+0000","last_clean":"2024-09-10T05:37:55.905442+0000","last_became_active":"2024-09-10T05:36:13.612743+0000","last_became_peered":"2024-09-10T05:36:13.612743+0000","last_unstale":"2024-09-10T05:37:55.905442+0000","last_undegraded":"2024-09-10T05:37:55.905442+0000","last_fullsized":"2024-09-10T05:37:55.905442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:46:09.360826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.721935+0000","last_change":"2024-09-10T05:36:11.593912+0000","last_active":"2024-09-10T05:37:53.721935+0000","last_peered":"2024-09-10T05:37:53.721935+0000","last_clean":"2024-09-10T05:37:53.721935+0000","last_became_active":"2024-09-10T05:36:11.593454+0000","last_became_peered":"2024-09-10T05:36:11.593454+0000","last_unstale":"2024-09-10T05:37:53.721935+0000","last_undegraded":"2024-09-10T05:37:53.721935+0000","last_fullsized":"2024-09-10T05:37:53.721935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:50:30.548750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"34'10","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.861683+0000","last_change":"2024-09-10T05:36:13.621644+0000","last_active":"2024-09-10T05:39:26.861683+0000","last_peered":"2024-09-10T05:39:26.861683+0000","last_clean":"2024-09-10T05:39:26.861683+0000","last_became_active":"2024-09-10T05:36:13.621362+0000","last_became_peered":"2024-09-10T05:36:13.621362+0000","last_unstale":"2024-09-10T05:39:26.861683+0000","last_undegraded":"2024-09-10T05:39:26.861683+0000","last_fullsized":"2024-09-10T05:39:26.861683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:44:10.159543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.295664+0000","last_change":"2024-09-10T05:36:13.628746+0000","last_active":"2024-09-10T05:39:27.295664+0000","last_peered":"2024-09-10T05:39:27.295664+0000","last_clean":"2024-09-10T05:39:27.295664+0000","last_became_active":"2024-09-10T05:36:13.628203+0000","last_became_peered":"2024-09-10T05:36:13.628203+0000","last_unstale":"2024-09-10T05:39:27.295664+0000","last_undegraded":"2024-09-10T05:39:27.295664+0000","last_fullsized":"2024-09-10T05:39:27.295664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:15:01.197465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"30'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.860067+0000","last_change":"2024-09-10T05:36:11.595338+0000","last_active":"2024-09-10T05:37:53.860067+0000","last_peered":"2024-09-10T05:37:53.860067+0000","last_clean":"2024-09-10T05:37:53.860067+0000","last_became_active":"2024-09-10T05:36:11.594409+0000","last_became_peered":"2024-09-10T05:36:11.594409+0000","last_unstale":"2024-09-10T05:37:53.860067+0000","last_undegraded":"2024-09-10T05:37:53.860067+0000","last_fullsized":"2024-09-10T05:37:53.860067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:40:54.327881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'8","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.314170+0000","last_change":"2024-09-10T05:36:13.620594+0000","last_active":"2024-09-10T05:39:27.314170+0000","last_peered":"2024-09-10T05:39:27.314170+0000","last_clean":"2024-09-10T05:39:27.314170+0000","last_became_active":"2024-09-10T05:36:13.619905+0000","last_became_peered":"2024-09-10T05:36:13.619905+0000","last_unstale":"2024-09-10T05:39:27.314170+0000","last_undegraded":"2024-09-10T05:39:27.314170+0000","last_fullsized":"2024-09-10T05:39:27.314170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:43:07.884535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.716388+0000","last_change":"2024-09-10T05:36:11.612156+0000","last_active":"2024-09-10T05:37:53.716388+0000","last_peered":"2024-09-10T05:37:53.716388+0000","last_clean":"2024-09-10T05:37:53.716388+0000","last_became_active":"2024-09-10T05:36:11.611735+0000","last_became_peered":"2024-09-10T05:36:11.611735+0000","last_unstale":"2024-09-10T05:37:53.716388+0000","last_undegraded":"2024-09-10T05:37:53.716388+0000","last_fullsized":"2024-09-10T05:37:53.716388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:25:27.078667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'18","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.364017+0000","last_change":"2024-09-10T05:36:13.625084+0000","last_active":"2024-09-10T05:39:27.364017+0000","last_peered":"2024-09-10T05:39:27.364017+0000","last_clean":"2024-09-10T05:39:27.364017+0000","last_became_active":"2024-09-10T05:36:13.624358+0000","last_became_peered":"2024-09-10T05:36:13.624358+0000","last_unstale":"2024-09-10T05:39:27.364017+0000","last_undegraded":"2024-09-10T05:39:27.364017+0000","last_fullsized":"2024-09-10T05:39:27.364017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:03:25.809000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":77,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"34'4","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.188377+0000","last_change":"2024-09-10T05:36:11.608840+0000","last_active":"2024-09-10T05:39:27.188377+0000","last_peered":"2024-09-10T05:39:27.188377+0000","last_clean":"2024-09-10T05:39:27.188377+0000","last_became_active":"2024-09-10T05:36:11.608244+0000","last_became_peered":"2024-09-10T05:36:11.608244+0000","last_unstale":"2024-09-10T05:39:27.188377+0000","last_undegraded":"2024-09-10T05:39:27.188377+0000","last_fullsized":"2024-09-10T05:39:27.188377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:54:31.346128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"32'24","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.714987+0000","last_change":"2024-09-10T05:36:13.614877+0000","last_active":"2024-09-10T05:37:53.714987+0000","last_peered":"2024-09-10T05:37:53.714987+0000","last_clean":"2024-09-10T05:37:53.714987+0000","last_became_active":"2024-09-10T05:36:13.613298+0000","last_became_peered":"2024-09-10T05:36:13.613298+0000","last_unstale":"2024-09-10T05:37:53.714987+0000","last_undegraded":"2024-09-10T05:37:53.714987+0000","last_fullsized":"2024-09-10T05:37:53.714987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:36:36.280933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":77,"num_write":32,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"32'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.896973+0000","last_change":"2024-09-10T05:36:11.600946+0000","last_active":"2024-09-10T05:37:55.896973+0000","last_peered":"2024-09-10T05:37:55.896973+0000","last_clean":"2024-09-10T05:37:55.896973+0000","last_became_active":"2024-09-10T05:36:11.600159+0000","last_became_peered":"2024-09-10T05:36:11.600159+0000","last_unstale":"2024-09-10T05:37:55.896973+0000","last_undegraded":"2024-09-10T05:37:55.896973+0000","last_fullsized":"2024-09-10T05:37:55.896973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:17:55.025975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"34'10","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.465170+0000","last_change":"2024-09-10T05:36:13.610326+0000","last_active":"2024-09-10T05:39:27.465170+0000","last_peered":"2024-09-10T05:39:27.465170+0000","last_clean":"2024-09-10T05:39:27.465170+0000","last_became_active":"2024-09-10T05:36:13.605913+0000","last_became_peered":"2024-09-10T05:36:13.605913+0000","last_unstale":"2024-09-10T05:39:27.465170+0000","last_undegraded":"2024-09-10T05:39:27.465170+0000","last_fullsized":"2024-09-10T05:39:27.465170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:40:06.248271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"34'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:17.692508+0000","last_change":"2024-09-10T05:36:52.721595+0000","last_active":"2024-09-10T05:39:17.692508+0000","last_peered":"2024-09-10T05:39:17.692508+0000","last_clean":"2024-09-10T05:39:17.692508+0000","last_became_active":"2024-09-10T05:36:52.701277+0000","last_became_peered":"2024-09-10T05:36:52.701277+0000","last_unstale":"2024-09-10T05:39:17.692508+0000","last_undegraded":"2024-09-10T05:39:17.692508+0000","last_fullsized":"2024-09-10T05:39:17.692508+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:20:16.743547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3,"num_write_kb":1250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":639872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.855635+0000","last_change":"2024-09-10T05:36:13.600360+0000","last_active":"2024-09-10T05:37:53.855635+0000","last_peered":"2024-09-10T05:37:53.855635+0000","last_clean":"2024-09-10T05:37:53.855635+0000","last_became_active":"2024-09-10T05:36:13.599955+0000","last_became_peered":"2024-09-10T05:36:13.599955+0000","last_unstale":"2024-09-10T05:37:53.855635+0000","last_undegraded":"2024-09-10T05:37:53.855635+0000","last_fullsized":"2024-09-10T05:37:53.855635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:12:25.023354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.158891+0000","last_change":"2024-09-10T05:36:11.606469+0000","last_active":"2024-09-10T05:39:27.158891+0000","last_peered":"2024-09-10T05:39:27.158891+0000","last_clean":"2024-09-10T05:39:27.158891+0000","last_became_active":"2024-09-10T05:36:11.603982+0000","last_became_peered":"2024-09-10T05:36:11.603982+0000","last_unstale":"2024-09-10T05:39:27.158891+0000","last_undegraded":"2024-09-10T05:39:27.158891+0000","last_fullsized":"2024-09-10T05:39:27.158891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:27:57.248963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'35","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.250994+0000","last_change":"2024-09-10T05:36:21.673756+0000","last_active":"2024-09-10T05:39:27.250994+0000","last_peered":"2024-09-10T05:39:27.250994+0000","last_clean":"2024-09-10T05:39:27.250994+0000","last_became_active":"2024-09-10T05:36:21.672975+0000","last_became_peered":"2024-09-10T05:36:21.672975+0000","last_unstale":"2024-09-10T05:39:27.250994+0000","last_undegraded":"2024-09-10T05:39:27.250994+0000","last_fullsized":"2024-09-10T05:39:27.250994+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:09:28.929715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'10","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.200652+0000","last_change":"2024-09-10T05:36:13.616306+0000","last_active":"2024-09-10T05:39:27.200652+0000","last_peered":"2024-09-10T05:39:27.200652+0000","last_clean":"2024-09-10T05:39:27.200652+0000","last_became_active":"2024-09-10T05:36:13.616006+0000","last_became_peered":"2024-09-10T05:36:13.616006+0000","last_unstale":"2024-09-10T05:39:27.200652+0000","last_undegraded":"2024-09-10T05:39:27.200652+0000","last_fullsized":"2024-09-10T05:39:27.200652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:12:47.354260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.725430+0000","last_change":"2024-09-10T05:36:11.606773+0000","last_active":"2024-09-10T05:37:53.725430+0000","last_peered":"2024-09-10T05:37:53.725430+0000","last_clean":"2024-09-10T05:37:53.725430+0000","last_became_active":"2024-09-10T05:36:11.601101+0000","last_became_peered":"2024-09-10T05:36:11.601101+0000","last_unstale":"2024-09-10T05:37:53.725430+0000","last_undegraded":"2024-09-10T05:37:53.725430+0000","last_fullsized":"2024-09-10T05:37:53.725430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:18:28.907356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.727535+0000","last_change":"2024-09-10T05:36:15.626686+0000","last_active":"2024-09-10T05:37:53.727535+0000","last_peered":"2024-09-10T05:37:53.727535+0000","last_clean":"2024-09-10T05:37:53.727535+0000","last_became_active":"2024-09-10T05:36:15.626172+0000","last_became_peered":"2024-09-10T05:36:15.626172+0000","last_unstale":"2024-09-10T05:37:53.727535+0000","last_undegraded":"2024-09-10T05:37:53.727535+0000","last_fullsized":"2024-09-10T05:37:53.727535+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:39:20.579324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'42","reported_seq":101,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.023324+0000","last_change":"2024-09-10T05:36:17.640065+0000","last_active":"2024-09-10T05:38:24.023324+0000","last_peered":"2024-09-10T05:38:24.023324+0000","last_clean":"2024-09-10T05:38:24.023324+0000","last_became_active":"2024-09-10T05:36:17.639318+0000","last_became_peered":"2024-09-10T05:36:17.639318+0000","last_unstale":"2024-09-10T05:38:24.023324+0000","last_undegraded":"2024-09-10T05:38:24.023324+0000","last_fullsized":"2024-09-10T05:38:24.023324+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:05:59.617319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.898449+0000","last_change":"2024-09-10T05:36:19.648793+0000","last_active":"2024-09-10T05:37:55.898449+0000","last_peered":"2024-09-10T05:37:55.898449+0000","last_clean":"2024-09-10T05:37:55.898449+0000","last_became_active":"2024-09-10T05:36:19.647998+0000","last_became_peered":"2024-09-10T05:36:19.647998+0000","last_unstale":"2024-09-10T05:37:55.898449+0000","last_undegraded":"2024-09-10T05:37:55.898449+0000","last_fullsized":"2024-09-10T05:37:55.898449+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:14:38.933277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"32'9","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.899552+0000","last_change":"2024-09-10T05:36:21.673262+0000","last_active":"2024-09-10T05:37:55.899552+0000","last_peered":"2024-09-10T05:37:55.899552+0000","last_clean":"2024-09-10T05:37:55.899552+0000","last_became_active":"2024-09-10T05:36:21.672757+0000","last_became_peered":"2024-09-10T05:36:21.672757+0000","last_unstale":"2024-09-10T05:37:55.899552+0000","last_undegraded":"2024-09-10T05:37:55.899552+0000","last_fullsized":"2024-09-10T05:37:55.899552+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:49:20.130241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"32'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.727360+0000","last_change":"2024-09-10T05:36:13.598805+0000","last_active":"2024-09-10T05:37:53.727360+0000","last_peered":"2024-09-10T05:37:53.727360+0000","last_clean":"2024-09-10T05:37:53.727360+0000","last_became_active":"2024-09-10T05:36:13.597649+0000","last_became_peered":"2024-09-10T05:36:13.597649+0000","last_unstale":"2024-09-10T05:37:53.727360+0000","last_undegraded":"2024-09-10T05:37:53.727360+0000","last_fullsized":"2024-09-10T05:37:53.727360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:02:19.101449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.711943+0000","last_change":"2024-09-10T05:36:11.611702+0000","last_active":"2024-09-10T05:37:53.711943+0000","last_peered":"2024-09-10T05:37:53.711943+0000","last_clean":"2024-09-10T05:37:53.711943+0000","last_became_active":"2024-09-10T05:36:11.611326+0000","last_became_peered":"2024-09-10T05:36:11.611326+0000","last_unstale":"2024-09-10T05:37:53.711943+0000","last_undegraded":"2024-09-10T05:37:53.711943+0000","last_fullsized":"2024-09-10T05:37:53.711943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:06:03.034626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.725805+0000","last_change":"2024-09-10T05:36:15.608668+0000","last_active":"2024-09-10T05:37:53.725805+0000","last_peered":"2024-09-10T05:37:53.725805+0000","last_clean":"2024-09-10T05:37:53.725805+0000","last_became_active":"2024-09-10T05:36:15.607918+0000","last_became_peered":"2024-09-10T05:36:15.607918+0000","last_unstale":"2024-09-10T05:37:53.725805+0000","last_undegraded":"2024-09-10T05:37:53.725805+0000","last_fullsized":"2024-09-10T05:37:53.725805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:57.614009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"30'12","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.859373+0000","last_change":"2024-09-10T05:36:17.644680+0000","last_active":"2024-09-10T05:37:53.859373+0000","last_peered":"2024-09-10T05:37:53.859373+0000","last_clean":"2024-09-10T05:37:53.859373+0000","last_became_active":"2024-09-10T05:36:17.643856+0000","last_became_peered":"2024-09-10T05:36:17.643856+0000","last_unstale":"2024-09-10T05:37:53.859373+0000","last_undegraded":"2024-09-10T05:37:53.859373+0000","last_fullsized":"2024-09-10T05:37:53.859373+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:31:24.591766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.899864+0000","last_change":"2024-09-10T05:36:19.648357+0000","last_active":"2024-09-10T05:37:55.899864+0000","last_peered":"2024-09-10T05:37:55.899864+0000","last_clean":"2024-09-10T05:37:55.899864+0000","last_became_active":"2024-09-10T05:36:19.647612+0000","last_became_peered":"2024-09-10T05:36:19.647612+0000","last_unstale":"2024-09-10T05:37:55.899864+0000","last_undegraded":"2024-09-10T05:37:55.899864+0000","last_fullsized":"2024-09-10T05:37:55.899864+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:06:01.493680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"34'10","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.344196+0000","last_change":"2024-09-10T05:36:21.679828+0000","last_active":"2024-09-10T05:39:26.344196+0000","last_peered":"2024-09-10T05:39:26.344196+0000","last_clean":"2024-09-10T05:39:26.344196+0000","last_became_active":"2024-09-10T05:36:21.679052+0000","last_became_peered":"2024-09-10T05:36:21.679052+0000","last_unstale":"2024-09-10T05:39:26.344196+0000","last_undegraded":"2024-09-10T05:39:26.344196+0000","last_fullsized":"2024-09-10T05:39:26.344196+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:53.565670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.729075+0000","last_change":"2024-09-10T05:36:13.612634+0000","last_active":"2024-09-10T05:37:53.729075+0000","last_peered":"2024-09-10T05:37:53.729075+0000","last_clean":"2024-09-10T05:37:53.729075+0000","last_became_active":"2024-09-10T05:36:13.611935+0000","last_became_peered":"2024-09-10T05:36:13.611935+0000","last_unstale":"2024-09-10T05:37:53.729075+0000","last_undegraded":"2024-09-10T05:37:53.729075+0000","last_fullsized":"2024-09-10T05:37:53.729075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:11.305578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.897677+0000","last_change":"2024-09-10T05:36:11.596948+0000","last_active":"2024-09-10T05:37:55.897677+0000","last_peered":"2024-09-10T05:37:55.897677+0000","last_clean":"2024-09-10T05:37:55.897677+0000","last_became_active":"2024-09-10T05:36:11.596047+0000","last_became_peered":"2024-09-10T05:36:11.596047+0000","last_unstale":"2024-09-10T05:37:55.897677+0000","last_undegraded":"2024-09-10T05:37:55.897677+0000","last_fullsized":"2024-09-10T05:37:55.897677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:36:34.651568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.729520+0000","last_change":"2024-09-10T05:36:15.636316+0000","last_active":"2024-09-10T05:37:53.729520+0000","last_peered":"2024-09-10T05:37:53.729520+0000","last_clean":"2024-09-10T05:37:53.729520+0000","last_became_active":"2024-09-10T05:36:15.635534+0000","last_became_peered":"2024-09-10T05:36:15.635534+0000","last_unstale":"2024-09-10T05:37:53.729520+0000","last_undegraded":"2024-09-10T05:37:53.729520+0000","last_fullsized":"2024-09-10T05:37:53.729520+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:51:10.736802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"30'23","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.715019+0000","last_change":"2024-09-10T05:36:17.630853+0000","last_active":"2024-09-10T05:37:53.715019+0000","last_peered":"2024-09-10T05:37:53.715019+0000","last_clean":"2024-09-10T05:37:53.715019+0000","last_became_active":"2024-09-10T05:36:17.626936+0000","last_became_peered":"2024-09-10T05:36:17.626936+0000","last_unstale":"2024-09-10T05:37:53.715019+0000","last_undegraded":"2024-09-10T05:37:53.715019+0000","last_fullsized":"2024-09-10T05:37:53.715019+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:27:38.243510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'282","reported_seq":391,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.551691+0000","last_change":"2024-09-10T05:36:19.665303+0000","last_active":"2024-09-10T05:39:27.551691+0000","last_peered":"2024-09-10T05:39:27.551691+0000","last_clean":"2024-09-10T05:39:27.551691+0000","last_became_active":"2024-09-10T05:36:19.664741+0000","last_became_peered":"2024-09-10T05:36:19.664741+0000","last_unstale":"2024-09-10T05:39:27.551691+0000","last_undegraded":"2024-09-10T05:39:27.551691+0000","last_fullsized":"2024-09-10T05:39:27.551691+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:34:14.254885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"34'2","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:21.797711+0000","last_change":"2024-09-10T05:36:21.657298+0000","last_active":"2024-09-10T05:38:21.797711+0000","last_peered":"2024-09-10T05:38:21.797711+0000","last_clean":"2024-09-10T05:38:21.797711+0000","last_became_active":"2024-09-10T05:36:21.656522+0000","last_became_peered":"2024-09-10T05:36:21.656522+0000","last_unstale":"2024-09-10T05:38:21.797711+0000","last_undegraded":"2024-09-10T05:38:21.797711+0000","last_fullsized":"2024-09-10T05:38:21.797711+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:46:36.764173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'8","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.883202+0000","last_change":"2024-09-10T05:36:13.623674+0000","last_active":"2024-09-10T05:39:26.883202+0000","last_peered":"2024-09-10T05:39:26.883202+0000","last_clean":"2024-09-10T05:39:26.883202+0000","last_became_active":"2024-09-10T05:36:13.622771+0000","last_became_peered":"2024-09-10T05:36:13.622771+0000","last_unstale":"2024-09-10T05:39:26.883202+0000","last_undegraded":"2024-09-10T05:39:26.883202+0000","last_fullsized":"2024-09-10T05:39:26.883202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:10.534366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"32'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.898045+0000","last_change":"2024-09-10T05:36:11.598113+0000","last_active":"2024-09-10T05:37:55.898045+0000","last_peered":"2024-09-10T05:37:55.898045+0000","last_clean":"2024-09-10T05:37:55.898045+0000","last_became_active":"2024-09-10T05:36:11.596165+0000","last_became_peered":"2024-09-10T05:36:11.596165+0000","last_unstale":"2024-09-10T05:37:55.898045+0000","last_undegraded":"2024-09-10T05:37:55.898045+0000","last_fullsized":"2024-09-10T05:37:55.898045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:34.424848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.905564+0000","last_change":"2024-09-10T05:36:15.616568+0000","last_active":"2024-09-10T05:37:55.905564+0000","last_peered":"2024-09-10T05:37:55.905564+0000","last_clean":"2024-09-10T05:37:55.905564+0000","last_became_active":"2024-09-10T05:36:15.615994+0000","last_became_peered":"2024-09-10T05:36:15.615994+0000","last_unstale":"2024-09-10T05:37:55.905564+0000","last_undegraded":"2024-09-10T05:37:55.905564+0000","last_fullsized":"2024-09-10T05:37:55.905564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:15:00.093895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"34'36","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.012568+0000","last_change":"2024-09-10T05:36:17.631891+0000","last_active":"2024-09-10T05:38:24.012568+0000","last_peered":"2024-09-10T05:38:24.012568+0000","last_clean":"2024-09-10T05:38:24.012568+0000","last_became_active":"2024-09-10T05:36:17.631054+0000","last_became_peered":"2024-09-10T05:36:17.631054+0000","last_unstale":"2024-09-10T05:38:24.012568+0000","last_undegraded":"2024-09-10T05:38:24.012568+0000","last_fullsized":"2024-09-10T05:38:24.012568+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:59.553249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"34'282","reported_seq":407,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.372296+0000","last_change":"2024-09-10T05:36:19.671507+0000","last_active":"2024-09-10T05:39:27.372296+0000","last_peered":"2024-09-10T05:39:27.372296+0000","last_clean":"2024-09-10T05:39:27.372296+0000","last_became_active":"2024-09-10T05:36:19.670915+0000","last_became_peered":"2024-09-10T05:36:19.670915+0000","last_unstale":"2024-09-10T05:39:27.372296+0000","last_undegraded":"2024-09-10T05:39:27.372296+0000","last_fullsized":"2024-09-10T05:39:27.372296+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:35.175677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"34'8","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.859732+0000","last_change":"2024-09-10T05:36:13.598359+0000","last_active":"2024-09-10T05:39:26.859732+0000","last_peered":"2024-09-10T05:39:26.859732+0000","last_clean":"2024-09-10T05:39:26.859732+0000","last_became_active":"2024-09-10T05:36:13.597477+0000","last_became_peered":"2024-09-10T05:36:13.597477+0000","last_unstale":"2024-09-10T05:39:26.859732+0000","last_undegraded":"2024-09-10T05:39:26.859732+0000","last_fullsized":"2024-09-10T05:39:26.859732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:33.752285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.899248+0000","last_change":"2024-09-10T05:36:11.601343+0000","last_active":"2024-09-10T05:37:55.899248+0000","last_peered":"2024-09-10T05:37:55.899248+0000","last_clean":"2024-09-10T05:37:55.899248+0000","last_became_active":"2024-09-10T05:36:11.600405+0000","last_became_peered":"2024-09-10T05:36:11.600405+0000","last_unstale":"2024-09-10T05:37:55.899248+0000","last_undegraded":"2024-09-10T05:37:55.899248+0000","last_fullsized":"2024-09-10T05:37:55.899248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:06:53.012489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.857307+0000","last_change":"2024-09-10T05:36:15.624083+0000","last_active":"2024-09-10T05:37:53.857307+0000","last_peered":"2024-09-10T05:37:53.857307+0000","last_clean":"2024-09-10T05:37:53.857307+0000","last_became_active":"2024-09-10T05:36:15.620908+0000","last_became_peered":"2024-09-10T05:36:15.620908+0000","last_unstale":"2024-09-10T05:37:53.857307+0000","last_undegraded":"2024-09-10T05:37:53.857307+0000","last_fullsized":"2024-09-10T05:37:53.857307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:18:19.390635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'47","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.031891+0000","last_change":"2024-09-10T05:36:52.763550+0000","last_active":"2024-09-10T05:38:24.031891+0000","last_peered":"2024-09-10T05:38:24.031891+0000","last_clean":"2024-09-10T05:38:24.031891+0000","last_became_active":"2024-09-10T05:36:52.710284+0000","last_became_peered":"2024-09-10T05:36:52.710284+0000","last_unstale":"2024-09-10T05:38:24.031891+0000","last_undegraded":"2024-09-10T05:38:24.031891+0000","last_fullsized":"2024-09-10T05:38:24.031891+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:08.202725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.853131+0000","last_change":"2024-09-10T05:36:19.641236+0000","last_active":"2024-09-10T05:37:53.853131+0000","last_peered":"2024-09-10T05:37:53.853131+0000","last_clean":"2024-09-10T05:37:53.853131+0000","last_became_active":"2024-09-10T05:36:19.640470+0000","last_became_peered":"2024-09-10T05:36:19.640470+0000","last_unstale":"2024-09-10T05:37:53.853131+0000","last_undegraded":"2024-09-10T05:37:53.853131+0000","last_fullsized":"2024-09-10T05:37:53.853131+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:38.686660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"32'3","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.715202+0000","last_change":"2024-09-10T05:36:21.665615+0000","last_active":"2024-09-10T05:37:53.715202+0000","last_peered":"2024-09-10T05:37:53.715202+0000","last_clean":"2024-09-10T05:37:53.715202+0000","last_became_active":"2024-09-10T05:36:21.664232+0000","last_became_peered":"2024-09-10T05:36:21.664232+0000","last_unstale":"2024-09-10T05:37:53.715202+0000","last_undegraded":"2024-09-10T05:37:53.715202+0000","last_fullsized":"2024-09-10T05:37:53.715202+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:22:54.635544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'2","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.296681+0000","last_change":"2024-09-10T05:36:52.704557+0000","last_active":"2024-09-10T05:39:27.296681+0000","last_peered":"2024-09-10T05:39:27.296681+0000","last_clean":"2024-09-10T05:39:27.296681+0000","last_became_active":"2024-09-10T05:36:52.703743+0000","last_became_peered":"2024-09-10T05:36:52.703743+0000","last_unstale":"2024-09-10T05:39:27.296681+0000","last_undegraded":"2024-09-10T05:39:27.296681+0000","last_fullsized":"2024-09-10T05:39:27.296681+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:08:22.378233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.899208+0000","last_change":"2024-09-10T05:36:11.599409+0000","last_active":"2024-09-10T05:37:55.899208+0000","last_peered":"2024-09-10T05:37:55.899208+0000","last_clean":"2024-09-10T05:37:55.899208+0000","last_became_active":"2024-09-10T05:36:11.597717+0000","last_became_peered":"2024-09-10T05:36:11.597717+0000","last_unstale":"2024-09-10T05:37:55.899208+0000","last_undegraded":"2024-09-10T05:37:55.899208+0000","last_fullsized":"2024-09-10T05:37:55.899208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:31:10.630773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.712459+0000","last_change":"2024-09-10T05:36:15.632405+0000","last_active":"2024-09-10T05:37:53.712459+0000","last_peered":"2024-09-10T05:37:53.712459+0000","last_clean":"2024-09-10T05:37:53.712459+0000","last_became_active":"2024-09-10T05:36:15.631635+0000","last_became_peered":"2024-09-10T05:36:15.631635+0000","last_unstale":"2024-09-10T05:37:53.712459+0000","last_undegraded":"2024-09-10T05:37:53.712459+0000","last_fullsized":"2024-09-10T05:37:53.712459+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:17:58.666673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"34'36","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:23.991157+0000","last_change":"2024-09-10T05:36:17.638936+0000","last_active":"2024-09-10T05:38:23.991157+0000","last_peered":"2024-09-10T05:38:23.991157+0000","last_clean":"2024-09-10T05:38:23.991157+0000","last_became_active":"2024-09-10T05:36:17.638301+0000","last_became_peered":"2024-09-10T05:36:17.638301+0000","last_unstale":"2024-09-10T05:38:23.991157+0000","last_undegraded":"2024-09-10T05:38:23.991157+0000","last_fullsized":"2024-09-10T05:38:23.991157+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:17.394424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.725401+0000","last_change":"2024-09-10T05:36:19.671665+0000","last_active":"2024-09-10T05:37:53.725401+0000","last_peered":"2024-09-10T05:37:53.725401+0000","last_clean":"2024-09-10T05:37:53.725401+0000","last_became_active":"2024-09-10T05:36:19.671022+0000","last_became_peered":"2024-09-10T05:36:19.671022+0000","last_unstale":"2024-09-10T05:37:53.725401+0000","last_undegraded":"2024-09-10T05:37:53.725401+0000","last_fullsized":"2024-09-10T05:37:53.725401+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:52:58.839879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"32'3","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.854472+0000","last_change":"2024-09-10T05:36:21.667571+0000","last_active":"2024-09-10T05:37:53.854472+0000","last_peered":"2024-09-10T05:37:53.854472+0000","last_clean":"2024-09-10T05:37:53.854472+0000","last_became_active":"2024-09-10T05:36:21.666042+0000","last_became_peered":"2024-09-10T05:36:21.666042+0000","last_unstale":"2024-09-10T05:37:53.854472+0000","last_undegraded":"2024-09-10T05:37:53.854472+0000","last_fullsized":"2024-09-10T05:37:53.854472+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:39.262665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'13","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.222570+0000","last_change":"2024-09-10T05:36:52.713178+0000","last_active":"2024-09-10T05:39:27.222570+0000","last_peered":"2024-09-10T05:39:27.222570+0000","last_clean":"2024-09-10T05:39:27.222570+0000","last_became_active":"2024-09-10T05:36:52.696116+0000","last_became_peered":"2024-09-10T05:36:52.696116+0000","last_unstale":"2024-09-10T05:39:27.222570+0000","last_undegraded":"2024-09-10T05:39:27.222570+0000","last_fullsized":"2024-09-10T05:39:27.222570+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:19:34.691310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.897741+0000","last_change":"2024-09-10T05:36:11.607638+0000","last_active":"2024-09-10T05:37:55.897741+0000","last_peered":"2024-09-10T05:37:55.897741+0000","last_clean":"2024-09-10T05:37:55.897741+0000","last_became_active":"2024-09-10T05:36:11.606576+0000","last_became_peered":"2024-09-10T05:36:11.606576+0000","last_unstale":"2024-09-10T05:37:55.897741+0000","last_undegraded":"2024-09-10T05:37:55.897741+0000","last_fullsized":"2024-09-10T05:37:55.897741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:18:24.850629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.712965+0000","last_change":"2024-09-10T05:36:15.618352+0000","last_active":"2024-09-10T05:37:53.712965+0000","last_peered":"2024-09-10T05:37:53.712965+0000","last_clean":"2024-09-10T05:37:53.712965+0000","last_became_active":"2024-09-10T05:36:15.617647+0000","last_became_peered":"2024-09-10T05:36:15.617647+0000","last_unstale":"2024-09-10T05:37:53.712965+0000","last_undegraded":"2024-09-10T05:37:53.712965+0000","last_fullsized":"2024-09-10T05:37:53.712965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:04:41.335062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"34'49","reported_seq":111,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.035913+0000","last_change":"2024-09-10T05:36:17.636835+0000","last_active":"2024-09-10T05:38:24.035913+0000","last_peered":"2024-09-10T05:38:24.035913+0000","last_clean":"2024-09-10T05:38:24.035913+0000","last_became_active":"2024-09-10T05:36:17.636000+0000","last_became_peered":"2024-09-10T05:36:17.636000+0000","last_unstale":"2024-09-10T05:38:24.035913+0000","last_undegraded":"2024-09-10T05:38:24.035913+0000","last_fullsized":"2024-09-10T05:38:24.035913+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:10:22.233813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"34'282","reported_seq":354,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.565613+0000","last_change":"2024-09-10T05:36:19.664630+0000","last_active":"2024-09-10T05:39:27.565613+0000","last_peered":"2024-09-10T05:39:27.565613+0000","last_clean":"2024-09-10T05:39:27.565613+0000","last_became_active":"2024-09-10T05:36:19.663950+0000","last_became_peered":"2024-09-10T05:36:19.663950+0000","last_unstale":"2024-09-10T05:39:27.565613+0000","last_undegraded":"2024-09-10T05:39:27.565613+0000","last_fullsized":"2024-09-10T05:39:27.565613+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:53.165826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"32'2","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.854389+0000","last_change":"2024-09-10T05:36:21.691277+0000","last_active":"2024-09-10T05:37:53.854389+0000","last_peered":"2024-09-10T05:37:53.854389+0000","last_clean":"2024-09-10T05:37:53.854389+0000","last_became_active":"2024-09-10T05:36:21.690772+0000","last_became_peered":"2024-09-10T05:36:21.690772+0000","last_unstale":"2024-09-10T05:37:53.854389+0000","last_undegraded":"2024-09-10T05:37:53.854389+0000","last_fullsized":"2024-09-10T05:37:53.854389+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:17:39.487372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"34'6","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.364489+0000","last_change":"2024-09-10T05:36:13.612369+0000","last_active":"2024-09-10T05:39:27.364489+0000","last_peered":"2024-09-10T05:39:27.364489+0000","last_clean":"2024-09-10T05:39:27.364489+0000","last_became_active":"2024-09-10T05:36:13.611694+0000","last_became_peered":"2024-09-10T05:36:13.611694+0000","last_unstale":"2024-09-10T05:39:27.364489+0000","last_undegraded":"2024-09-10T05:39:27.364489+0000","last_fullsized":"2024-09-10T05:39:27.364489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:25.411949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.897408+0000","last_change":"2024-09-10T05:36:11.607748+0000","last_active":"2024-09-10T05:37:55.897408+0000","last_peered":"2024-09-10T05:37:55.897408+0000","last_clean":"2024-09-10T05:37:55.897408+0000","last_became_active":"2024-09-10T05:36:11.606957+0000","last_became_peered":"2024-09-10T05:36:11.606957+0000","last_unstale":"2024-09-10T05:37:55.897408+0000","last_undegraded":"2024-09-10T05:37:55.897408+0000","last_fullsized":"2024-09-10T05:37:55.897408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:51:30.178935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.712437+0000","last_change":"2024-09-10T05:36:15.632297+0000","last_active":"2024-09-10T05:37:53.712437+0000","last_peered":"2024-09-10T05:37:53.712437+0000","last_clean":"2024-09-10T05:37:53.712437+0000","last_became_active":"2024-09-10T05:36:15.631551+0000","last_became_peered":"2024-09-10T05:36:15.631551+0000","last_unstale":"2024-09-10T05:37:53.712437+0000","last_undegraded":"2024-09-10T05:37:53.712437+0000","last_fullsized":"2024-09-10T05:37:53.712437+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:38:35.217361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"34'66","reported_seq":139,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.040124+0000","last_change":"2024-09-10T05:36:17.651071+0000","last_active":"2024-09-10T05:38:24.040124+0000","last_peered":"2024-09-10T05:38:24.040124+0000","last_clean":"2024-09-10T05:38:24.040124+0000","last_became_active":"2024-09-10T05:36:17.650601+0000","last_became_peered":"2024-09-10T05:36:17.650601+0000","last_unstale":"2024-09-10T05:38:24.040124+0000","last_undegraded":"2024-09-10T05:38:24.040124+0000","last_fullsized":"2024-09-10T05:38:24.040124+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:33:18.024305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":30,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.712799+0000","last_change":"2024-09-10T05:36:19.638840+0000","last_active":"2024-09-10T05:37:53.712799+0000","last_peered":"2024-09-10T05:37:53.712799+0000","last_clean":"2024-09-10T05:37:53.712799+0000","last_became_active":"2024-09-10T05:36:19.638087+0000","last_became_peered":"2024-09-10T05:36:19.638087+0000","last_unstale":"2024-09-10T05:37:53.712799+0000","last_undegraded":"2024-09-10T05:37:53.712799+0000","last_fullsized":"2024-09-10T05:37:53.712799+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:43:13.922357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"34'18","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.525874+0000","last_change":"2024-09-10T05:36:21.681112+0000","last_active":"2024-09-10T05:39:27.525874+0000","last_peered":"2024-09-10T05:39:27.525874+0000","last_clean":"2024-09-10T05:39:27.525874+0000","last_became_active":"2024-09-10T05:36:21.680246+0000","last_became_peered":"2024-09-10T05:36:21.680246+0000","last_unstale":"2024-09-10T05:39:27.525874+0000","last_undegraded":"2024-09-10T05:39:27.525874+0000","last_fullsized":"2024-09-10T05:39:27.525874+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:41.764675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"34'5","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:07.690351+0000","last_change":"2024-09-10T05:36:52.725901+0000","last_active":"2024-09-10T05:39:07.690351+0000","last_peered":"2024-09-10T05:39:07.690351+0000","last_clean":"2024-09-10T05:39:07.690351+0000","last_became_active":"2024-09-10T05:36:52.702912+0000","last_became_peered":"2024-09-10T05:36:52.702912+0000","last_unstale":"2024-09-10T05:39:07.690351+0000","last_undegraded":"2024-09-10T05:39:07.690351+0000","last_fullsized":"2024-09-10T05:39:07.690351+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:30:22.591725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.165811+0000","last_change":"2024-09-10T05:36:11.608535+0000","last_active":"2024-09-10T05:39:27.165811+0000","last_peered":"2024-09-10T05:39:27.165811+0000","last_clean":"2024-09-10T05:39:27.165811+0000","last_became_active":"2024-09-10T05:36:11.606930+0000","last_became_peered":"2024-09-10T05:36:11.606930+0000","last_unstale":"2024-09-10T05:39:27.165811+0000","last_undegraded":"2024-09-10T05:39:27.165811+0000","last_fullsized":"2024-09-10T05:39:27.165811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:23:14.287549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.714198+0000","last_change":"2024-09-10T05:36:15.617401+0000","last_active":"2024-09-10T05:37:53.714198+0000","last_peered":"2024-09-10T05:37:53.714198+0000","last_clean":"2024-09-10T05:37:53.714198+0000","last_became_active":"2024-09-10T05:36:15.616975+0000","last_became_peered":"2024-09-10T05:36:15.616975+0000","last_unstale":"2024-09-10T05:37:53.714198+0000","last_undegraded":"2024-09-10T05:37:53.714198+0000","last_fullsized":"2024-09-10T05:37:53.714198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:18:28.491327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'42","reported_seq":96,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:32.690954+0000","last_change":"2024-09-10T05:36:17.651377+0000","last_active":"2024-09-10T05:38:32.690954+0000","last_peered":"2024-09-10T05:38:32.690954+0000","last_clean":"2024-09-10T05:38:32.690954+0000","last_became_active":"2024-09-10T05:36:17.650522+0000","last_became_peered":"2024-09-10T05:36:17.650522+0000","last_unstale":"2024-09-10T05:38:32.690954+0000","last_undegraded":"2024-09-10T05:38:32.690954+0000","last_fullsized":"2024-09-10T05:38:32.690954+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:31:03.454940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.728744+0000","last_change":"2024-09-10T05:36:19.664052+0000","last_active":"2024-09-10T05:37:53.728744+0000","last_peered":"2024-09-10T05:37:53.728744+0000","last_clean":"2024-09-10T05:37:53.728744+0000","last_became_active":"2024-09-10T05:36:19.663287+0000","last_became_peered":"2024-09-10T05:36:19.663287+0000","last_unstale":"2024-09-10T05:37:53.728744+0000","last_undegraded":"2024-09-10T05:37:53.728744+0000","last_fullsized":"2024-09-10T05:37:53.728744+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:39.277013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'5","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.028076+0000","last_change":"2024-09-10T05:36:21.664412+0000","last_active":"2024-09-10T05:39:27.028076+0000","last_peered":"2024-09-10T05:39:27.028076+0000","last_clean":"2024-09-10T05:39:27.028076+0000","last_became_active":"2024-09-10T05:36:21.663661+0000","last_became_peered":"2024-09-10T05:36:21.663661+0000","last_unstale":"2024-09-10T05:39:27.028076+0000","last_undegraded":"2024-09-10T05:39:27.028076+0000","last_fullsized":"2024-09-10T05:39:27.028076+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:53.553843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'5","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.024835+0000","last_change":"2024-09-10T05:36:13.631202+0000","last_active":"2024-09-10T05:39:27.024835+0000","last_peered":"2024-09-10T05:39:27.024835+0000","last_clean":"2024-09-10T05:39:27.024835+0000","last_became_active":"2024-09-10T05:36:13.630386+0000","last_became_peered":"2024-09-10T05:36:13.630386+0000","last_unstale":"2024-09-10T05:39:27.024835+0000","last_undegraded":"2024-09-10T05:39:27.024835+0000","last_fullsized":"2024-09-10T05:39:27.024835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:36.024873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.897689+0000","last_change":"2024-09-10T05:36:11.598765+0000","last_active":"2024-09-10T05:37:55.897689+0000","last_peered":"2024-09-10T05:37:55.897689+0000","last_clean":"2024-09-10T05:37:55.897689+0000","last_became_active":"2024-09-10T05:36:11.597935+0000","last_became_peered":"2024-09-10T05:36:11.597935+0000","last_unstale":"2024-09-10T05:37:55.897689+0000","last_undegraded":"2024-09-10T05:37:55.897689+0000","last_fullsized":"2024-09-10T05:37:55.897689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:06:01.704380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.853934+0000","last_change":"2024-09-10T05:36:15.619918+0000","last_active":"2024-09-10T05:37:53.853934+0000","last_peered":"2024-09-10T05:37:53.853934+0000","last_clean":"2024-09-10T05:37:53.853934+0000","last_became_active":"2024-09-10T05:36:15.619388+0000","last_became_peered":"2024-09-10T05:36:15.619388+0000","last_unstale":"2024-09-10T05:37:53.853934+0000","last_undegraded":"2024-09-10T05:37:53.853934+0000","last_fullsized":"2024-09-10T05:37:53.853934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:26.033372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"34'36","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.051975+0000","last_change":"2024-09-10T05:36:17.638791+0000","last_active":"2024-09-10T05:38:24.051975+0000","last_peered":"2024-09-10T05:38:24.051975+0000","last_clean":"2024-09-10T05:38:24.051975+0000","last_became_active":"2024-09-10T05:36:17.636568+0000","last_became_peered":"2024-09-10T05:36:17.636568+0000","last_unstale":"2024-09-10T05:38:24.051975+0000","last_undegraded":"2024-09-10T05:38:24.051975+0000","last_fullsized":"2024-09-10T05:38:24.051975+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:58.268199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'282","reported_seq":409,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.536932+0000","last_change":"2024-09-10T05:36:19.667395+0000","last_active":"2024-09-10T05:39:27.536932+0000","last_peered":"2024-09-10T05:39:27.536932+0000","last_clean":"2024-09-10T05:39:27.536932+0000","last_became_active":"2024-09-10T05:36:19.666610+0000","last_became_peered":"2024-09-10T05:36:19.666610+0000","last_unstale":"2024-09-10T05:39:27.536932+0000","last_undegraded":"2024-09-10T05:39:27.536932+0000","last_fullsized":"2024-09-10T05:39:27.536932+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:22:18.017142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'12","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:27.686883+0000","last_change":"2024-09-10T05:36:21.669588+0000","last_active":"2024-09-10T05:38:27.686883+0000","last_peered":"2024-09-10T05:38:27.686883+0000","last_clean":"2024-09-10T05:38:27.686883+0000","last_became_active":"2024-09-10T05:36:21.668641+0000","last_became_peered":"2024-09-10T05:36:21.668641+0000","last_unstale":"2024-09-10T05:38:27.686883+0000","last_undegraded":"2024-09-10T05:38:27.686883+0000","last_fullsized":"2024-09-10T05:38:27.686883+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:59.764142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"34'7","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:27.681562+0000","last_change":"2024-09-10T05:36:13.609927+0000","last_active":"2024-09-10T05:38:27.681562+0000","last_peered":"2024-09-10T05:38:27.681562+0000","last_clean":"2024-09-10T05:38:27.681562+0000","last_became_active":"2024-09-10T05:36:13.605112+0000","last_became_peered":"2024-09-10T05:36:13.605112+0000","last_unstale":"2024-09-10T05:38:27.681562+0000","last_undegraded":"2024-09-10T05:38:27.681562+0000","last_fullsized":"2024-09-10T05:38:27.681562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:54:32.975492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.722448+0000","last_change":"2024-09-10T05:36:11.606136+0000","last_active":"2024-09-10T05:37:53.722448+0000","last_peered":"2024-09-10T05:37:53.722448+0000","last_clean":"2024-09-10T05:37:53.722448+0000","last_became_active":"2024-09-10T05:36:11.600833+0000","last_became_peered":"2024-09-10T05:36:11.600833+0000","last_unstale":"2024-09-10T05:37:53.722448+0000","last_undegraded":"2024-09-10T05:37:53.722448+0000","last_fullsized":"2024-09-10T05:37:53.722448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:30:30.034878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'3","reported_seq":418,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:25.599083+0000","last_change":"2024-09-10T05:36:15.636516+0000","last_active":"2024-09-10T05:38:25.599083+0000","last_peered":"2024-09-10T05:38:25.599083+0000","last_clean":"2024-09-10T05:38:25.599083+0000","last_became_active":"2024-09-10T05:36:15.635670+0000","last_became_peered":"2024-09-10T05:36:15.635670+0000","last_unstale":"2024-09-10T05:38:25.599083+0000","last_undegraded":"2024-09-10T05:38:25.599083+0000","last_fullsized":"2024-09-10T05:38:25.599083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:38:23.956906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.726176+0000","last_change":"2024-09-10T05:36:17.639202+0000","last_active":"2024-09-10T05:37:53.726176+0000","last_peered":"2024-09-10T05:37:53.726176+0000","last_clean":"2024-09-10T05:37:53.726176+0000","last_became_active":"2024-09-10T05:36:17.633215+0000","last_became_peered":"2024-09-10T05:36:17.633215+0000","last_unstale":"2024-09-10T05:37:53.726176+0000","last_undegraded":"2024-09-10T05:37:53.726176+0000","last_fullsized":"2024-09-10T05:37:53.726176+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:47:38.759892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'282","reported_seq":471,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.479089+0000","last_change":"2024-09-10T05:36:19.650595+0000","last_active":"2024-09-10T05:39:27.479089+0000","last_peered":"2024-09-10T05:39:27.479089+0000","last_clean":"2024-09-10T05:39:27.479089+0000","last_became_active":"2024-09-10T05:36:19.649781+0000","last_became_peered":"2024-09-10T05:36:19.649781+0000","last_unstale":"2024-09-10T05:39:27.479089+0000","last_undegraded":"2024-09-10T05:39:27.479089+0000","last_fullsized":"2024-09-10T05:39:27.479089+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:13:23.575638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:25.756309+0000","last_change":"2024-09-10T05:36:21.665015+0000","last_active":"2024-09-10T05:38:25.756309+0000","last_peered":"2024-09-10T05:38:25.756309+0000","last_clean":"2024-09-10T05:38:25.756309+0000","last_became_active":"2024-09-10T05:36:21.664283+0000","last_became_peered":"2024-09-10T05:36:21.664283+0000","last_unstale":"2024-09-10T05:38:25.756309+0000","last_undegraded":"2024-09-10T05:38:25.756309+0000","last_fullsized":"2024-09-10T05:38:25.756309+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:35:48.390527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'4","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.363782+0000","last_change":"2024-09-10T05:37:53.730744+0000","last_active":"2024-09-10T05:39:27.363782+0000","last_peered":"2024-09-10T05:39:27.363782+0000","last_clean":"2024-09-10T05:39:27.363782+0000","last_became_active":"2024-09-10T05:37:53.724668+0000","last_became_peered":"2024-09-10T05:37:53.724668+0000","last_unstale":"2024-09-10T05:39:27.363782+0000","last_undegraded":"2024-09-10T05:39:27.363782+0000","last_fullsized":"2024-09-10T05:39:27.363782+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:32.648839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"34'3","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:23.682228+0000","last_change":"2024-09-10T05:36:11.598666+0000","last_active":"2024-09-10T05:38:23.682228+0000","last_peered":"2024-09-10T05:38:23.682228+0000","last_clean":"2024-09-10T05:38:23.682228+0000","last_became_active":"2024-09-10T05:36:11.598213+0000","last_became_peered":"2024-09-10T05:36:11.598213+0000","last_unstale":"2024-09-10T05:38:23.682228+0000","last_undegraded":"2024-09-10T05:38:23.682228+0000","last_fullsized":"2024-09-10T05:38:23.682228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:54.224630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.729250+0000","last_change":"2024-09-10T05:36:15.622429+0000","last_active":"2024-09-10T05:37:53.729250+0000","last_peered":"2024-09-10T05:37:53.729250+0000","last_clean":"2024-09-10T05:37:53.729250+0000","last_became_active":"2024-09-10T05:36:15.621697+0000","last_became_peered":"2024-09-10T05:36:15.621697+0000","last_unstale":"2024-09-10T05:37:53.729250+0000","last_undegraded":"2024-09-10T05:37:53.729250+0000","last_fullsized":"2024-09-10T05:37:53.729250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:13:04.950511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'38","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.025920+0000","last_change":"2024-09-10T05:36:17.648212+0000","last_active":"2024-09-10T05:38:24.025920+0000","last_peered":"2024-09-10T05:38:24.025920+0000","last_clean":"2024-09-10T05:38:24.025920+0000","last_became_active":"2024-09-10T05:36:17.647533+0000","last_became_peered":"2024-09-10T05:36:17.647533+0000","last_unstale":"2024-09-10T05:38:24.025920+0000","last_undegraded":"2024-09-10T05:38:24.025920+0000","last_fullsized":"2024-09-10T05:38:24.025920+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:49:23.646157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.896760+0000","last_change":"2024-09-10T05:36:19.641688+0000","last_active":"2024-09-10T05:37:55.896760+0000","last_peered":"2024-09-10T05:37:55.896760+0000","last_clean":"2024-09-10T05:37:55.896760+0000","last_became_active":"2024-09-10T05:36:19.640885+0000","last_became_peered":"2024-09-10T05:36:19.640885+0000","last_unstale":"2024-09-10T05:37:55.896760+0000","last_undegraded":"2024-09-10T05:37:55.896760+0000","last_fullsized":"2024-09-10T05:37:55.896760+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:07.106507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"34'8","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.434518+0000","last_change":"2024-09-10T05:36:21.665178+0000","last_active":"2024-09-10T05:39:27.434518+0000","last_peered":"2024-09-10T05:39:27.434518+0000","last_clean":"2024-09-10T05:39:27.434518+0000","last_became_active":"2024-09-10T05:36:21.664454+0000","last_became_peered":"2024-09-10T05:36:21.664454+0000","last_unstale":"2024-09-10T05:39:27.434518+0000","last_undegraded":"2024-09-10T05:39:27.434518+0000","last_fullsized":"2024-09-10T05:39:27.434518+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:10:47.751838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'6","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.005232+0000","last_change":"2024-09-10T05:36:13.605825+0000","last_active":"2024-09-10T05:39:27.005232+0000","last_peered":"2024-09-10T05:39:27.005232+0000","last_clean":"2024-09-10T05:39:27.005232+0000","last_became_active":"2024-09-10T05:36:13.605318+0000","last_became_peered":"2024-09-10T05:36:13.605318+0000","last_unstale":"2024-09-10T05:39:27.005232+0000","last_undegraded":"2024-09-10T05:39:27.005232+0000","last_fullsized":"2024-09-10T05:39:27.005232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:18:36.672577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'72","reported_seq":146,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.852563+0000","last_change":"2024-09-10T05:35:59.488460+0000","last_active":"2024-09-10T05:37:53.852563+0000","last_peered":"2024-09-10T05:37:53.852563+0000","last_clean":"2024-09-10T05:37:53.852563+0000","last_became_active":"2024-09-10T05:35:59.486077+0000","last_became_peered":"2024-09-10T05:35:59.486077+0000","last_unstale":"2024-09-10T05:37:53.852563+0000","last_undegraded":"2024-09-10T05:37:53.852563+0000","last_fullsized":"2024-09-10T05:37:53.852563+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:35:57.655557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:35:57.655557+0000","last_clean_scrub_stamp":"2024-09-10T05:35:57.655557+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:41:07.276856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.897409+0000","last_change":"2024-09-10T05:36:05.711729+0000","last_active":"2024-09-10T05:37:55.897409+0000","last_peered":"2024-09-10T05:37:55.897409+0000","last_clean":"2024-09-10T05:37:55.897409+0000","last_became_active":"2024-09-10T05:36:03.710352+0000","last_became_peered":"2024-09-10T05:36:03.710352+0000","last_unstale":"2024-09-10T05:37:55.897409+0000","last_undegraded":"2024-09-10T05:37:55.897409+0000","last_fullsized":"2024-09-10T05:37:55.897409+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_clean_scrub_stamp":"2024-09-10T05:36:02.684661+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:03:30.592449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002047461,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"34'1","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:18.681097+0000","last_change":"2024-09-10T05:36:11.606900+0000","last_active":"2024-09-10T05:38:18.681097+0000","last_peered":"2024-09-10T05:38:18.681097+0000","last_clean":"2024-09-10T05:38:18.681097+0000","last_became_active":"2024-09-10T05:36:11.604178+0000","last_became_peered":"2024-09-10T05:36:11.604178+0000","last_unstale":"2024-09-10T05:38:18.681097+0000","last_undegraded":"2024-09-10T05:38:18.681097+0000","last_fullsized":"2024-09-10T05:38:18.681097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:53:24.406596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.854195+0000","last_change":"2024-09-10T05:36:15.624270+0000","last_active":"2024-09-10T05:37:53.854195+0000","last_peered":"2024-09-10T05:37:53.854195+0000","last_clean":"2024-09-10T05:37:53.854195+0000","last_became_active":"2024-09-10T05:36:15.623637+0000","last_became_peered":"2024-09-10T05:36:15.623637+0000","last_unstale":"2024-09-10T05:37:53.854195+0000","last_undegraded":"2024-09-10T05:37:53.854195+0000","last_fullsized":"2024-09-10T05:37:53.854195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:37:16.145975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'83","reported_seq":163,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.049037+0000","last_change":"2024-09-10T05:36:17.637408+0000","last_active":"2024-09-10T05:38:24.049037+0000","last_peered":"2024-09-10T05:38:24.049037+0000","last_clean":"2024-09-10T05:38:24.049037+0000","last_became_active":"2024-09-10T05:36:17.636543+0000","last_became_peered":"2024-09-10T05:36:17.636543+0000","last_unstale":"2024-09-10T05:38:24.049037+0000","last_undegraded":"2024-09-10T05:38:24.049037+0000","last_fullsized":"2024-09-10T05:38:24.049037+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:15:25.918278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.728409+0000","last_change":"2024-09-10T05:36:19.664203+0000","last_active":"2024-09-10T05:37:53.728409+0000","last_peered":"2024-09-10T05:37:53.728409+0000","last_clean":"2024-09-10T05:37:53.728409+0000","last_became_active":"2024-09-10T05:36:19.663584+0000","last_became_peered":"2024-09-10T05:36:19.663584+0000","last_unstale":"2024-09-10T05:37:53.728409+0000","last_undegraded":"2024-09-10T05:37:53.728409+0000","last_fullsized":"2024-09-10T05:37:53.728409+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:33.708215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"34'82","reported_seq":168,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.391356+0000","last_change":"2024-09-10T05:36:21.664939+0000","last_active":"2024-09-10T05:39:27.391356+0000","last_peered":"2024-09-10T05:39:27.391356+0000","last_clean":"2024-09-10T05:39:27.391356+0000","last_became_active":"2024-09-10T05:36:21.664075+0000","last_became_peered":"2024-09-10T05:36:21.664075+0000","last_unstale":"2024-09-10T05:39:27.391356+0000","last_undegraded":"2024-09-10T05:39:27.391356+0000","last_fullsized":"2024-09-10T05:39:27.391356+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:13:56.435337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":223,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"30'2","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.729039+0000","last_change":"2024-09-10T05:36:13.617433+0000","last_active":"2024-09-10T05:37:53.729039+0000","last_peered":"2024-09-10T05:37:53.729039+0000","last_clean":"2024-09-10T05:37:53.729039+0000","last_became_active":"2024-09-10T05:36:13.616766+0000","last_became_peered":"2024-09-10T05:36:13.616766+0000","last_unstale":"2024-09-10T05:37:53.729039+0000","last_undegraded":"2024-09-10T05:37:53.729039+0000","last_fullsized":"2024-09-10T05:37:53.729039+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:08:29.778211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.896383+0000","last_change":"2024-09-10T05:36:05.710898+0000","last_active":"2024-09-10T05:37:55.896383+0000","last_peered":"2024-09-10T05:37:55.896383+0000","last_clean":"2024-09-10T05:37:55.896383+0000","last_became_active":"2024-09-10T05:36:03.706256+0000","last_became_peered":"2024-09-10T05:36:03.706256+0000","last_unstale":"2024-09-10T05:37:55.896383+0000","last_undegraded":"2024-09-10T05:37:55.896383+0000","last_fullsized":"2024-09-10T05:37:55.896383+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_clean_scrub_stamp":"2024-09-10T05:36:02.684661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:42:18.313806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001383542,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.856705+0000","last_change":"2024-09-10T05:36:11.591881+0000","last_active":"2024-09-10T05:37:53.856705+0000","last_peered":"2024-09-10T05:37:53.856705+0000","last_clean":"2024-09-10T05:37:53.856705+0000","last_became_active":"2024-09-10T05:36:11.591339+0000","last_became_peered":"2024-09-10T05:36:11.591339+0000","last_unstale":"2024-09-10T05:37:53.856705+0000","last_undegraded":"2024-09-10T05:37:53.856705+0000","last_fullsized":"2024-09-10T05:37:53.856705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:21:35.347921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.906123+0000","last_change":"2024-09-10T05:36:52.705367+0000","last_active":"2024-09-10T05:37:55.906123+0000","last_peered":"2024-09-10T05:37:55.906123+0000","last_clean":"2024-09-10T05:37:55.906123+0000","last_became_active":"2024-09-10T05:36:52.704490+0000","last_became_peered":"2024-09-10T05:36:52.704490+0000","last_unstale":"2024-09-10T05:37:55.906123+0000","last_undegraded":"2024-09-10T05:37:55.906123+0000","last_fullsized":"2024-09-10T05:37:55.906123+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:44:28.080659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"34'280","reported_seq":495,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:25.874900+0000","last_change":"2024-09-10T05:36:17.640102+0000","last_active":"2024-09-10T05:39:25.874900+0000","last_peered":"2024-09-10T05:39:25.874900+0000","last_clean":"2024-09-10T05:39:25.874900+0000","last_became_active":"2024-09-10T05:36:17.637623+0000","last_became_peered":"2024-09-10T05:36:17.637623+0000","last_unstale":"2024-09-10T05:39:25.874900+0000","last_undegraded":"2024-09-10T05:39:25.874900+0000","last_fullsized":"2024-09-10T05:39:25.874900+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:47:34.520585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":366,"num_read_kb":350,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.725860+0000","last_change":"2024-09-10T05:36:19.673384+0000","last_active":"2024-09-10T05:37:53.725860+0000","last_peered":"2024-09-10T05:37:53.725860+0000","last_clean":"2024-09-10T05:37:53.725860+0000","last_became_active":"2024-09-10T05:36:19.672554+0000","last_became_peered":"2024-09-10T05:36:19.672554+0000","last_unstale":"2024-09-10T05:37:53.725860+0000","last_undegraded":"2024-09-10T05:37:53.725860+0000","last_fullsized":"2024-09-10T05:37:53.725860+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:09.659188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'5","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.856766+0000","last_change":"2024-09-10T05:36:21.662079+0000","last_active":"2024-09-10T05:37:53.856766+0000","last_peered":"2024-09-10T05:37:53.856766+0000","last_clean":"2024-09-10T05:37:53.856766+0000","last_became_active":"2024-09-10T05:36:21.661347+0000","last_became_peered":"2024-09-10T05:36:21.661347+0000","last_unstale":"2024-09-10T05:37:53.856766+0000","last_undegraded":"2024-09-10T05:37:53.856766+0000","last_fullsized":"2024-09-10T05:37:53.856766+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:23.555775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'6","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.364285+0000","last_change":"2024-09-10T05:36:13.626334+0000","last_active":"2024-09-10T05:39:27.364285+0000","last_peered":"2024-09-10T05:39:27.364285+0000","last_clean":"2024-09-10T05:39:27.364285+0000","last_became_active":"2024-09-10T05:36:13.621451+0000","last_became_peered":"2024-09-10T05:36:13.621451+0000","last_unstale":"2024-09-10T05:39:27.364285+0000","last_undegraded":"2024-09-10T05:39:27.364285+0000","last_fullsized":"2024-09-10T05:39:27.364285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:29:14.676606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.713298+0000","last_change":"2024-09-10T05:36:06.203202+0000","last_active":"2024-09-10T05:37:53.713298+0000","last_peered":"2024-09-10T05:37:53.713298+0000","last_clean":"2024-09-10T05:37:53.713298+0000","last_became_active":"2024-09-10T05:36:03.707045+0000","last_became_peered":"2024-09-10T05:36:03.707045+0000","last_unstale":"2024-09-10T05:37:53.713298+0000","last_undegraded":"2024-09-10T05:37:53.713298+0000","last_fullsized":"2024-09-10T05:37:53.713298+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_clean_scrub_stamp":"2024-09-10T05:36:02.684661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:47:09.787526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093121299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:21.782377+0000","last_change":"2024-09-10T05:36:11.595624+0000","last_active":"2024-09-10T05:38:21.782377+0000","last_peered":"2024-09-10T05:38:21.782377+0000","last_clean":"2024-09-10T05:38:21.782377+0000","last_became_active":"2024-09-10T05:36:11.594432+0000","last_became_peered":"2024-09-10T05:36:11.594432+0000","last_unstale":"2024-09-10T05:38:21.782377+0000","last_undegraded":"2024-09-10T05:38:21.782377+0000","last_fullsized":"2024-09-10T05:38:21.782377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:25:27.078667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.716765+0000","last_change":"2024-09-10T05:36:15.620736+0000","last_active":"2024-09-10T05:37:53.716765+0000","last_peered":"2024-09-10T05:37:53.716765+0000","last_clean":"2024-09-10T05:37:53.716765+0000","last_became_active":"2024-09-10T05:36:15.620043+0000","last_became_peered":"2024-09-10T05:36:15.620043+0000","last_unstale":"2024-09-10T05:37:53.716765+0000","last_undegraded":"2024-09-10T05:37:53.716765+0000","last_fullsized":"2024-09-10T05:37:53.716765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:34.666759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'17","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.227823+0000","last_change":"2024-09-10T05:36:17.637187+0000","last_active":"2024-09-10T05:39:27.227823+0000","last_peered":"2024-09-10T05:39:27.227823+0000","last_clean":"2024-09-10T05:39:27.227823+0000","last_became_active":"2024-09-10T05:36:17.636381+0000","last_became_peered":"2024-09-10T05:36:17.636381+0000","last_unstale":"2024-09-10T05:39:27.227823+0000","last_undegraded":"2024-09-10T05:39:27.227823+0000","last_fullsized":"2024-09-10T05:39:27.227823+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:55:19.261582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.854702+0000","last_change":"2024-09-10T05:36:19.666298+0000","last_active":"2024-09-10T05:37:53.854702+0000","last_peered":"2024-09-10T05:37:53.854702+0000","last_clean":"2024-09-10T05:37:53.854702+0000","last_became_active":"2024-09-10T05:36:19.664396+0000","last_became_peered":"2024-09-10T05:36:19.664396+0000","last_unstale":"2024-09-10T05:37:53.854702+0000","last_undegraded":"2024-09-10T05:37:53.854702+0000","last_fullsized":"2024-09-10T05:37:53.854702+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:27:46.613544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.725249+0000","last_change":"2024-09-10T05:36:21.675746+0000","last_active":"2024-09-10T05:37:53.725249+0000","last_peered":"2024-09-10T05:37:53.725249+0000","last_clean":"2024-09-10T05:37:53.725249+0000","last_became_active":"2024-09-10T05:36:21.674984+0000","last_became_peered":"2024-09-10T05:36:21.674984+0000","last_unstale":"2024-09-10T05:37:53.725249+0000","last_undegraded":"2024-09-10T05:37:53.725249+0000","last_fullsized":"2024-09-10T05:37:53.725249+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:13.261758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'3","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:21.803367+0000","last_change":"2024-09-10T05:36:13.627345+0000","last_active":"2024-09-10T05:38:21.803367+0000","last_peered":"2024-09-10T05:38:21.803367+0000","last_clean":"2024-09-10T05:38:21.803367+0000","last_became_active":"2024-09-10T05:36:13.626654+0000","last_became_peered":"2024-09-10T05:36:13.626654+0000","last_unstale":"2024-09-10T05:38:21.803367+0000","last_undegraded":"2024-09-10T05:38:21.803367+0000","last_fullsized":"2024-09-10T05:38:21.803367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:41:27.351374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.897831+0000","last_change":"2024-09-10T05:36:05.710910+0000","last_active":"2024-09-10T05:37:55.897831+0000","last_peered":"2024-09-10T05:37:55.897831+0000","last_clean":"2024-09-10T05:37:55.897831+0000","last_became_active":"2024-09-10T05:36:03.708495+0000","last_became_peered":"2024-09-10T05:36:03.708495+0000","last_unstale":"2024-09-10T05:37:55.897831+0000","last_undegraded":"2024-09-10T05:37:55.897831+0000","last_fullsized":"2024-09-10T05:37:55.897831+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_clean_scrub_stamp":"2024-09-10T05:36:02.684661+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:51.729077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012525469999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.897736+0000","last_change":"2024-09-10T05:36:11.602156+0000","last_active":"2024-09-10T05:37:55.897736+0000","last_peered":"2024-09-10T05:37:55.897736+0000","last_clean":"2024-09-10T05:37:55.897736+0000","last_became_active":"2024-09-10T05:36:11.601414+0000","last_became_peered":"2024-09-10T05:36:11.601414+0000","last_unstale":"2024-09-10T05:37:55.897736+0000","last_undegraded":"2024-09-10T05:37:55.897736+0000","last_fullsized":"2024-09-10T05:37:55.897736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:42:50.298063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.856412+0000","last_change":"2024-09-10T05:36:15.619942+0000","last_active":"2024-09-10T05:37:53.856412+0000","last_peered":"2024-09-10T05:37:53.856412+0000","last_clean":"2024-09-10T05:37:53.856412+0000","last_became_active":"2024-09-10T05:36:15.619505+0000","last_became_peered":"2024-09-10T05:36:15.619505+0000","last_unstale":"2024-09-10T05:37:53.856412+0000","last_undegraded":"2024-09-10T05:37:53.856412+0000","last_fullsized":"2024-09-10T05:37:53.856412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:14:30.972656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"33'13","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.217385+0000","last_change":"2024-09-10T05:36:17.638373+0000","last_active":"2024-09-10T05:39:26.217385+0000","last_peered":"2024-09-10T05:39:26.217385+0000","last_clean":"2024-09-10T05:39:26.217385+0000","last_became_active":"2024-09-10T05:36:17.637551+0000","last_became_peered":"2024-09-10T05:36:17.637551+0000","last_unstale":"2024-09-10T05:39:26.217385+0000","last_undegraded":"2024-09-10T05:39:26.217385+0000","last_fullsized":"2024-09-10T05:39:26.217385+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:56:29.072774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.728759+0000","last_change":"2024-09-10T05:36:19.670810+0000","last_active":"2024-09-10T05:37:53.728759+0000","last_peered":"2024-09-10T05:37:53.728759+0000","last_clean":"2024-09-10T05:37:53.728759+0000","last_became_active":"2024-09-10T05:36:19.669130+0000","last_became_peered":"2024-09-10T05:36:19.669130+0000","last_unstale":"2024-09-10T05:37:53.728759+0000","last_undegraded":"2024-09-10T05:37:53.728759+0000","last_fullsized":"2024-09-10T05:37:53.728759+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:50:25.186904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'6","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:25.732480+0000","last_change":"2024-09-10T05:36:21.672078+0000","last_active":"2024-09-10T05:38:25.732480+0000","last_peered":"2024-09-10T05:38:25.732480+0000","last_clean":"2024-09-10T05:38:25.732480+0000","last_became_active":"2024-09-10T05:36:21.671206+0000","last_became_peered":"2024-09-10T05:36:21.671206+0000","last_unstale":"2024-09-10T05:38:25.732480+0000","last_undegraded":"2024-09-10T05:38:25.732480+0000","last_fullsized":"2024-09-10T05:38:25.732480+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:44:48.926007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'4","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:21.790850+0000","last_change":"2024-09-10T05:36:13.611873+0000","last_active":"2024-09-10T05:38:21.790850+0000","last_peered":"2024-09-10T05:38:21.790850+0000","last_clean":"2024-09-10T05:38:21.790850+0000","last_became_active":"2024-09-10T05:36:13.611242+0000","last_became_peered":"2024-09-10T05:36:13.611242+0000","last_unstale":"2024-09-10T05:38:21.790850+0000","last_undegraded":"2024-09-10T05:38:21.790850+0000","last_fullsized":"2024-09-10T05:38:21.790850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:54:18.272234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'1","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:17.687049+0000","last_change":"2024-09-10T05:36:11.605555+0000","last_active":"2024-09-10T05:38:17.687049+0000","last_peered":"2024-09-10T05:38:17.687049+0000","last_clean":"2024-09-10T05:38:17.687049+0000","last_became_active":"2024-09-10T05:36:11.604802+0000","last_became_peered":"2024-09-10T05:36:11.604802+0000","last_unstale":"2024-09-10T05:38:17.687049+0000","last_undegraded":"2024-09-10T05:38:17.687049+0000","last_fullsized":"2024-09-10T05:38:17.687049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:31.026061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.854446+0000","last_change":"2024-09-10T05:36:05.716234+0000","last_active":"2024-09-10T05:37:53.854446+0000","last_peered":"2024-09-10T05:37:53.854446+0000","last_clean":"2024-09-10T05:37:53.854446+0000","last_became_active":"2024-09-10T05:36:03.705338+0000","last_became_peered":"2024-09-10T05:36:03.705338+0000","last_unstale":"2024-09-10T05:37:53.854446+0000","last_undegraded":"2024-09-10T05:37:53.854446+0000","last_fullsized":"2024-09-10T05:37:53.854446+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_clean_scrub_stamp":"2024-09-10T05:36:02.684661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:59.676796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010885789999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:22.680314+0000","last_change":"2024-09-10T05:36:15.618592+0000","last_active":"2024-09-10T05:38:22.680314+0000","last_peered":"2024-09-10T05:38:22.680314+0000","last_clean":"2024-09-10T05:38:22.680314+0000","last_became_active":"2024-09-10T05:36:15.618041+0000","last_became_peered":"2024-09-10T05:36:15.618041+0000","last_unstale":"2024-09-10T05:38:22.680314+0000","last_undegraded":"2024-09-10T05:38:22.680314+0000","last_fullsized":"2024-09-10T05:38:22.680314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:44.697723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"34'74","reported_seq":150,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.738721+0000","last_change":"2024-09-10T05:36:17.654376+0000","last_active":"2024-09-10T05:39:26.738721+0000","last_peered":"2024-09-10T05:39:26.738721+0000","last_clean":"2024-09-10T05:39:26.738721+0000","last_became_active":"2024-09-10T05:36:17.653627+0000","last_became_peered":"2024-09-10T05:36:17.653627+0000","last_unstale":"2024-09-10T05:39:26.738721+0000","last_undegraded":"2024-09-10T05:39:26.738721+0000","last_fullsized":"2024-09-10T05:39:26.738721+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:43:52.608114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5916,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":79,"num_read_kb":65,"num_write":40,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.896388+0000","last_change":"2024-09-10T05:36:19.650800+0000","last_active":"2024-09-10T05:37:55.896388+0000","last_peered":"2024-09-10T05:37:55.896388+0000","last_clean":"2024-09-10T05:37:55.896388+0000","last_became_active":"2024-09-10T05:36:19.650115+0000","last_became_peered":"2024-09-10T05:36:19.650115+0000","last_unstale":"2024-09-10T05:37:55.896388+0000","last_undegraded":"2024-09-10T05:37:55.896388+0000","last_fullsized":"2024-09-10T05:37:55.896388+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:27:32.687339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"34'9","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:26.048065+0000","last_change":"2024-09-10T05:36:21.689033+0000","last_active":"2024-09-10T05:38:26.048065+0000","last_peered":"2024-09-10T05:38:26.048065+0000","last_clean":"2024-09-10T05:38:26.048065+0000","last_became_active":"2024-09-10T05:36:21.687744+0000","last_became_peered":"2024-09-10T05:36:21.687744+0000","last_unstale":"2024-09-10T05:38:26.048065+0000","last_undegraded":"2024-09-10T05:38:26.048065+0000","last_fullsized":"2024-09-10T05:38:26.048065+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:05:42.167772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"32'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.853863+0000","last_change":"2024-09-10T05:36:13.618496+0000","last_active":"2024-09-10T05:37:53.853863+0000","last_peered":"2024-09-10T05:37:53.853863+0000","last_clean":"2024-09-10T05:37:53.853863+0000","last_became_active":"2024-09-10T05:36:13.617814+0000","last_became_peered":"2024-09-10T05:36:13.617814+0000","last_unstale":"2024-09-10T05:37:53.853863+0000","last_undegraded":"2024-09-10T05:37:53.853863+0000","last_fullsized":"2024-09-10T05:37:53.853863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:45.951433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.855803+0000","last_change":"2024-09-10T05:36:11.596607+0000","last_active":"2024-09-10T05:37:53.855803+0000","last_peered":"2024-09-10T05:37:53.855803+0000","last_clean":"2024-09-10T05:37:53.855803+0000","last_became_active":"2024-09-10T05:36:11.595349+0000","last_became_peered":"2024-09-10T05:36:11.595349+0000","last_unstale":"2024-09-10T05:37:53.855803+0000","last_undegraded":"2024-09-10T05:37:53.855803+0000","last_fullsized":"2024-09-10T05:37:53.855803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:26:47.764082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.898073+0000","last_change":"2024-09-10T05:36:05.712138+0000","last_active":"2024-09-10T05:37:55.898073+0000","last_peered":"2024-09-10T05:37:55.898073+0000","last_clean":"2024-09-10T05:37:55.898073+0000","last_became_active":"2024-09-10T05:36:03.709534+0000","last_became_peered":"2024-09-10T05:36:03.709534+0000","last_unstale":"2024-09-10T05:37:55.898073+0000","last_undegraded":"2024-09-10T05:37:55.898073+0000","last_fullsized":"2024-09-10T05:37:55.898073+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_clean_scrub_stamp":"2024-09-10T05:36:02.684661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:58:56.347286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022338829999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.901170+0000","last_change":"2024-09-10T05:36:15.619244+0000","last_active":"2024-09-10T05:37:55.901170+0000","last_peered":"2024-09-10T05:37:55.901170+0000","last_clean":"2024-09-10T05:37:55.901170+0000","last_became_active":"2024-09-10T05:36:15.618491+0000","last_became_peered":"2024-09-10T05:36:15.618491+0000","last_unstale":"2024-09-10T05:37:55.901170+0000","last_undegraded":"2024-09-10T05:37:55.901170+0000","last_fullsized":"2024-09-10T05:37:55.901170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:43:50.594184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"30'20","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.856948+0000","last_change":"2024-09-10T05:36:17.658105+0000","last_active":"2024-09-10T05:37:53.856948+0000","last_peered":"2024-09-10T05:37:53.856948+0000","last_clean":"2024-09-10T05:37:53.856948+0000","last_became_active":"2024-09-10T05:36:17.657112+0000","last_became_peered":"2024-09-10T05:36:17.657112+0000","last_unstale":"2024-09-10T05:37:53.856948+0000","last_undegraded":"2024-09-10T05:37:53.856948+0000","last_fullsized":"2024-09-10T05:37:53.856948+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:40.438888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'282","reported_seq":361,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:25.874874+0000","last_change":"2024-09-10T05:36:19.649214+0000","last_active":"2024-09-10T05:39:25.874874+0000","last_peered":"2024-09-10T05:39:25.874874+0000","last_clean":"2024-09-10T05:39:25.874874+0000","last_became_active":"2024-09-10T05:36:19.643319+0000","last_became_peered":"2024-09-10T05:36:19.643319+0000","last_unstale":"2024-09-10T05:39:25.874874+0000","last_undegraded":"2024-09-10T05:39:25.874874+0000","last_fullsized":"2024-09-10T05:39:25.874874+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:07:40.515326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"30'2","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.729162+0000","last_change":"2024-09-10T05:36:21.692062+0000","last_active":"2024-09-10T05:37:53.729162+0000","last_peered":"2024-09-10T05:37:53.729162+0000","last_clean":"2024-09-10T05:37:53.729162+0000","last_became_active":"2024-09-10T05:36:21.691590+0000","last_became_peered":"2024-09-10T05:36:21.691590+0000","last_unstale":"2024-09-10T05:37:53.729162+0000","last_undegraded":"2024-09-10T05:37:53.729162+0000","last_fullsized":"2024-09-10T05:37:53.729162+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:43:35.691961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'6","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.295258+0000","last_change":"2024-09-10T05:36:13.607662+0000","last_active":"2024-09-10T05:39:27.295258+0000","last_peered":"2024-09-10T05:39:27.295258+0000","last_clean":"2024-09-10T05:39:27.295258+0000","last_became_active":"2024-09-10T05:36:13.607367+0000","last_became_peered":"2024-09-10T05:36:13.607367+0000","last_unstale":"2024-09-10T05:39:27.295258+0000","last_undegraded":"2024-09-10T05:39:27.295258+0000","last_fullsized":"2024-09-10T05:39:27.295258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:45.424290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:26.122156+0000","last_change":"2024-09-10T05:36:11.608356+0000","last_active":"2024-09-10T05:38:26.122156+0000","last_peered":"2024-09-10T05:38:26.122156+0000","last_clean":"2024-09-10T05:38:26.122156+0000","last_became_active":"2024-09-10T05:36:11.606234+0000","last_became_peered":"2024-09-10T05:36:11.606234+0000","last_unstale":"2024-09-10T05:38:26.122156+0000","last_undegraded":"2024-09-10T05:38:26.122156+0000","last_fullsized":"2024-09-10T05:38:26.122156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:03.114192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.854826+0000","last_change":"2024-09-10T05:36:05.716475+0000","last_active":"2024-09-10T05:37:53.854826+0000","last_peered":"2024-09-10T05:37:53.854826+0000","last_clean":"2024-09-10T05:37:53.854826+0000","last_became_active":"2024-09-10T05:36:03.705038+0000","last_became_peered":"2024-09-10T05:36:03.705038+0000","last_unstale":"2024-09-10T05:37:53.854826+0000","last_undegraded":"2024-09-10T05:37:53.854826+0000","last_fullsized":"2024-09-10T05:37:53.854826+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_clean_scrub_stamp":"2024-09-10T05:36:02.684661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:33:56.689163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00126935,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.901115+0000","last_change":"2024-09-10T05:36:15.618499+0000","last_active":"2024-09-10T05:37:55.901115+0000","last_peered":"2024-09-10T05:37:55.901115+0000","last_clean":"2024-09-10T05:37:55.901115+0000","last_became_active":"2024-09-10T05:36:15.617690+0000","last_became_peered":"2024-09-10T05:36:15.617690+0000","last_unstale":"2024-09-10T05:37:55.901115+0000","last_undegraded":"2024-09-10T05:37:55.901115+0000","last_fullsized":"2024-09-10T05:37:55.901115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:44.575577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"30'16","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.724231+0000","last_change":"2024-09-10T05:36:17.635256+0000","last_active":"2024-09-10T05:37:53.724231+0000","last_peered":"2024-09-10T05:37:53.724231+0000","last_clean":"2024-09-10T05:37:53.724231+0000","last_became_active":"2024-09-10T05:36:17.634261+0000","last_became_peered":"2024-09-10T05:36:17.634261+0000","last_unstale":"2024-09-10T05:37:53.724231+0000","last_undegraded":"2024-09-10T05:37:53.724231+0000","last_fullsized":"2024-09-10T05:37:53.724231+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:56:40.871070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'282","reported_seq":435,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.527554+0000","last_change":"2024-09-10T05:36:19.673204+0000","last_active":"2024-09-10T05:39:27.527554+0000","last_peered":"2024-09-10T05:39:27.527554+0000","last_clean":"2024-09-10T05:39:27.527554+0000","last_became_active":"2024-09-10T05:36:19.672586+0000","last_became_peered":"2024-09-10T05:36:19.672586+0000","last_unstale":"2024-09-10T05:39:27.527554+0000","last_undegraded":"2024-09-10T05:39:27.527554+0000","last_fullsized":"2024-09-10T05:39:27.527554+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:18:32.110473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.853637+0000","last_change":"2024-09-10T05:36:21.670112+0000","last_active":"2024-09-10T05:37:53.853637+0000","last_peered":"2024-09-10T05:37:53.853637+0000","last_clean":"2024-09-10T05:37:53.853637+0000","last_became_active":"2024-09-10T05:36:21.668909+0000","last_became_peered":"2024-09-10T05:36:21.668909+0000","last_unstale":"2024-09-10T05:37:53.853637+0000","last_undegraded":"2024-09-10T05:37:53.853637+0000","last_fullsized":"2024-09-10T05:37:53.853637+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:37:35.984330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'14","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.201146+0000","last_change":"2024-09-10T05:36:13.622291+0000","last_active":"2024-09-10T05:39:27.201146+0000","last_peered":"2024-09-10T05:39:27.201146+0000","last_clean":"2024-09-10T05:39:27.201146+0000","last_became_active":"2024-09-10T05:36:13.621703+0000","last_became_peered":"2024-09-10T05:36:13.621703+0000","last_unstale":"2024-09-10T05:39:27.201146+0000","last_undegraded":"2024-09-10T05:39:27.201146+0000","last_fullsized":"2024-09-10T05:39:27.201146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:40:52.344660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.855830+0000","last_change":"2024-09-10T05:36:11.594329+0000","last_active":"2024-09-10T05:37:53.855830+0000","last_peered":"2024-09-10T05:37:53.855830+0000","last_clean":"2024-09-10T05:37:53.855830+0000","last_became_active":"2024-09-10T05:36:11.594029+0000","last_became_peered":"2024-09-10T05:36:11.594029+0000","last_unstale":"2024-09-10T05:37:53.855830+0000","last_undegraded":"2024-09-10T05:37:53.855830+0000","last_fullsized":"2024-09-10T05:37:53.855830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:10:40.202152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.899337+0000","last_change":"2024-09-10T05:36:05.711580+0000","last_active":"2024-09-10T05:37:55.899337+0000","last_peered":"2024-09-10T05:37:55.899337+0000","last_clean":"2024-09-10T05:37:55.899337+0000","last_became_active":"2024-09-10T05:36:03.708884+0000","last_became_peered":"2024-09-10T05:36:03.708884+0000","last_unstale":"2024-09-10T05:37:55.899337+0000","last_undegraded":"2024-09-10T05:37:55.899337+0000","last_fullsized":"2024-09-10T05:37:55.899337+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_clean_scrub_stamp":"2024-09-10T05:36:02.684661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:41:36.044908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018824390000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.722537+0000","last_change":"2024-09-10T05:36:15.638715+0000","last_active":"2024-09-10T05:37:53.722537+0000","last_peered":"2024-09-10T05:37:53.722537+0000","last_clean":"2024-09-10T05:37:53.722537+0000","last_became_active":"2024-09-10T05:36:15.637890+0000","last_became_peered":"2024-09-10T05:36:15.637890+0000","last_unstale":"2024-09-10T05:37:53.722537+0000","last_undegraded":"2024-09-10T05:37:53.722537+0000","last_fullsized":"2024-09-10T05:37:53.722537+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:43:41.621798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'88","reported_seq":171,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.008941+0000","last_change":"2024-09-10T05:36:17.632261+0000","last_active":"2024-09-10T05:38:24.008941+0000","last_peered":"2024-09-10T05:38:24.008941+0000","last_clean":"2024-09-10T05:38:24.008941+0000","last_became_active":"2024-09-10T05:36:17.631509+0000","last_became_peered":"2024-09-10T05:36:17.631509+0000","last_unstale":"2024-09-10T05:38:24.008941+0000","last_undegraded":"2024-09-10T05:38:24.008941+0000","last_fullsized":"2024-09-10T05:38:24.008941+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:42.713689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":84,"num_read_kb":69,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.723343+0000","last_change":"2024-09-10T05:36:19.668038+0000","last_active":"2024-09-10T05:37:53.723343+0000","last_peered":"2024-09-10T05:37:53.723343+0000","last_clean":"2024-09-10T05:37:53.723343+0000","last_became_active":"2024-09-10T05:36:19.667446+0000","last_became_peered":"2024-09-10T05:36:19.667446+0000","last_unstale":"2024-09-10T05:37:53.723343+0000","last_undegraded":"2024-09-10T05:37:53.723343+0000","last_fullsized":"2024-09-10T05:37:53.723343+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:54:25.333105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.713880+0000","last_change":"2024-09-10T05:36:21.658395+0000","last_active":"2024-09-10T05:37:53.713880+0000","last_peered":"2024-09-10T05:37:53.713880+0000","last_clean":"2024-09-10T05:37:53.713880+0000","last_became_active":"2024-09-10T05:36:21.657621+0000","last_became_peered":"2024-09-10T05:36:21.657621+0000","last_unstale":"2024-09-10T05:37:53.713880+0000","last_undegraded":"2024-09-10T05:37:53.713880+0000","last_fullsized":"2024-09-10T05:37:53.713880+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:09.853561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"32'8","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.717636+0000","last_change":"2024-09-10T05:36:21.657351+0000","last_active":"2024-09-10T05:37:53.717636+0000","last_peered":"2024-09-10T05:37:53.717636+0000","last_clean":"2024-09-10T05:37:53.717636+0000","last_became_active":"2024-09-10T05:36:21.656563+0000","last_became_peered":"2024-09-10T05:36:21.656563+0000","last_unstale":"2024-09-10T05:37:53.717636+0000","last_undegraded":"2024-09-10T05:37:53.717636+0000","last_fullsized":"2024-09-10T05:37:53.717636+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:25:08.627704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.714178+0000","last_change":"2024-09-10T05:36:13.621461+0000","last_active":"2024-09-10T05:37:53.714178+0000","last_peered":"2024-09-10T05:37:53.714178+0000","last_clean":"2024-09-10T05:37:53.714178+0000","last_became_active":"2024-09-10T05:36:13.620892+0000","last_became_peered":"2024-09-10T05:36:13.620892+0000","last_unstale":"2024-09-10T05:37:53.714178+0000","last_undegraded":"2024-09-10T05:37:53.714178+0000","last_fullsized":"2024-09-10T05:37:53.714178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:39.193639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'6","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.350902+0000","last_change":"2024-09-10T05:36:11.598055+0000","last_active":"2024-09-10T05:39:27.350902+0000","last_peered":"2024-09-10T05:39:27.350902+0000","last_clean":"2024-09-10T05:39:27.350902+0000","last_became_active":"2024-09-10T05:36:11.597209+0000","last_became_peered":"2024-09-10T05:36:11.597209+0000","last_unstale":"2024-09-10T05:39:27.350902+0000","last_undegraded":"2024-09-10T05:39:27.350902+0000","last_fullsized":"2024-09-10T05:39:27.350902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:02.735158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.858869+0000","last_change":"2024-09-10T05:36:15.617459+0000","last_active":"2024-09-10T05:37:53.858869+0000","last_peered":"2024-09-10T05:37:53.858869+0000","last_clean":"2024-09-10T05:37:53.858869+0000","last_became_active":"2024-09-10T05:36:15.617049+0000","last_became_peered":"2024-09-10T05:36:15.617049+0000","last_unstale":"2024-09-10T05:37:53.858869+0000","last_undegraded":"2024-09-10T05:37:53.858869+0000","last_fullsized":"2024-09-10T05:37:53.858869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:13:50.392282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'38","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.033044+0000","last_change":"2024-09-10T05:36:17.658656+0000","last_active":"2024-09-10T05:38:24.033044+0000","last_peered":"2024-09-10T05:38:24.033044+0000","last_clean":"2024-09-10T05:38:24.033044+0000","last_became_active":"2024-09-10T05:36:17.657669+0000","last_became_peered":"2024-09-10T05:36:17.657669+0000","last_unstale":"2024-09-10T05:38:24.033044+0000","last_undegraded":"2024-09-10T05:38:24.033044+0000","last_fullsized":"2024-09-10T05:38:24.033044+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:39.765543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.724025+0000","last_change":"2024-09-10T05:36:19.673156+0000","last_active":"2024-09-10T05:37:53.724025+0000","last_peered":"2024-09-10T05:37:53.724025+0000","last_clean":"2024-09-10T05:37:53.724025+0000","last_became_active":"2024-09-10T05:36:19.672498+0000","last_became_peered":"2024-09-10T05:36:19.672498+0000","last_unstale":"2024-09-10T05:37:53.724025+0000","last_undegraded":"2024-09-10T05:37:53.724025+0000","last_fullsized":"2024-09-10T05:37:53.724025+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:27:09.531398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'5","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:23.587545+0000","last_change":"2024-09-10T05:36:21.689435+0000","last_active":"2024-09-10T05:38:23.587545+0000","last_peered":"2024-09-10T05:38:23.587545+0000","last_clean":"2024-09-10T05:38:23.587545+0000","last_became_active":"2024-09-10T05:36:21.688864+0000","last_became_peered":"2024-09-10T05:36:21.688864+0000","last_unstale":"2024-09-10T05:38:23.587545+0000","last_undegraded":"2024-09-10T05:38:23.587545+0000","last_fullsized":"2024-09-10T05:38:23.587545+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:55:36.492043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"34'10","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.294531+0000","last_change":"2024-09-10T05:36:13.612003+0000","last_active":"2024-09-10T05:39:27.294531+0000","last_peered":"2024-09-10T05:39:27.294531+0000","last_clean":"2024-09-10T05:39:27.294531+0000","last_became_active":"2024-09-10T05:36:13.610883+0000","last_became_peered":"2024-09-10T05:36:13.610883+0000","last_unstale":"2024-09-10T05:39:27.294531+0000","last_undegraded":"2024-09-10T05:39:27.294531+0000","last_fullsized":"2024-09-10T05:39:27.294531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:29:40.273630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'1","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:37.684035+0000","last_change":"2024-09-10T05:36:11.605653+0000","last_active":"2024-09-10T05:38:37.684035+0000","last_peered":"2024-09-10T05:38:37.684035+0000","last_clean":"2024-09-10T05:38:37.684035+0000","last_became_active":"2024-09-10T05:36:11.605259+0000","last_became_peered":"2024-09-10T05:36:11.605259+0000","last_unstale":"2024-09-10T05:38:37.684035+0000","last_undegraded":"2024-09-10T05:38:37.684035+0000","last_fullsized":"2024-09-10T05:38:37.684035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:18:08.260486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.724971+0000","last_change":"2024-09-10T05:36:15.630108+0000","last_active":"2024-09-10T05:37:53.724971+0000","last_peered":"2024-09-10T05:37:53.724971+0000","last_clean":"2024-09-10T05:37:53.724971+0000","last_became_active":"2024-09-10T05:36:15.629278+0000","last_became_peered":"2024-09-10T05:36:15.629278+0000","last_unstale":"2024-09-10T05:37:53.724971+0000","last_undegraded":"2024-09-10T05:37:53.724971+0000","last_fullsized":"2024-09-10T05:37:53.724971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:14:38.879647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'6","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.226218+0000","last_change":"2024-09-10T05:36:17.652832+0000","last_active":"2024-09-10T05:39:26.226218+0000","last_peered":"2024-09-10T05:39:26.226218+0000","last_clean":"2024-09-10T05:39:26.226218+0000","last_became_active":"2024-09-10T05:36:17.648835+0000","last_became_peered":"2024-09-10T05:36:17.648835+0000","last_unstale":"2024-09-10T05:39:26.226218+0000","last_undegraded":"2024-09-10T05:39:26.226218+0000","last_fullsized":"2024-09-10T05:39:26.226218+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:46.589507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.711967+0000","last_change":"2024-09-10T05:36:19.638688+0000","last_active":"2024-09-10T05:37:53.711967+0000","last_peered":"2024-09-10T05:37:53.711967+0000","last_clean":"2024-09-10T05:37:53.711967+0000","last_became_active":"2024-09-10T05:36:19.637912+0000","last_became_peered":"2024-09-10T05:36:19.637912+0000","last_unstale":"2024-09-10T05:37:53.711967+0000","last_undegraded":"2024-09-10T05:37:53.711967+0000","last_fullsized":"2024-09-10T05:37:53.711967+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:25:54.923848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.854267+0000","last_change":"2024-09-10T05:36:21.668904+0000","last_active":"2024-09-10T05:37:53.854267+0000","last_peered":"2024-09-10T05:37:53.854267+0000","last_clean":"2024-09-10T05:37:53.854267+0000","last_became_active":"2024-09-10T05:36:21.666877+0000","last_became_peered":"2024-09-10T05:36:21.666877+0000","last_unstale":"2024-09-10T05:37:53.854267+0000","last_undegraded":"2024-09-10T05:37:53.854267+0000","last_fullsized":"2024-09-10T05:37:53.854267+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:43:13.848554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"34'4","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.856889+0000","last_change":"2024-09-10T05:36:13.598863+0000","last_active":"2024-09-10T05:39:26.856889+0000","last_peered":"2024-09-10T05:39:26.856889+0000","last_clean":"2024-09-10T05:39:26.856889+0000","last_became_active":"2024-09-10T05:36:13.597857+0000","last_became_peered":"2024-09-10T05:36:13.597857+0000","last_unstale":"2024-09-10T05:39:26.856889+0000","last_undegraded":"2024-09-10T05:39:26.856889+0000","last_fullsized":"2024-09-10T05:39:26.856889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:32:45.970120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.898820+0000","last_change":"2024-09-10T05:36:11.601417+0000","last_active":"2024-09-10T05:37:55.898820+0000","last_peered":"2024-09-10T05:37:55.898820+0000","last_clean":"2024-09-10T05:37:55.898820+0000","last_became_active":"2024-09-10T05:36:11.600603+0000","last_became_peered":"2024-09-10T05:36:11.600603+0000","last_unstale":"2024-09-10T05:37:55.898820+0000","last_undegraded":"2024-09-10T05:37:55.898820+0000","last_fullsized":"2024-09-10T05:37:55.898820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:55:12.247844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.900977+0000","last_change":"2024-09-10T05:36:15.638682+0000","last_active":"2024-09-10T05:37:55.900977+0000","last_peered":"2024-09-10T05:37:55.900977+0000","last_clean":"2024-09-10T05:37:55.900977+0000","last_became_active":"2024-09-10T05:36:15.638197+0000","last_became_peered":"2024-09-10T05:36:15.638197+0000","last_unstale":"2024-09-10T05:37:55.900977+0000","last_undegraded":"2024-09-10T05:37:55.900977+0000","last_fullsized":"2024-09-10T05:37:55.900977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:53:28.099101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"34'41","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.313275+0000","last_change":"2024-09-10T05:36:17.647135+0000","last_active":"2024-09-10T05:39:26.313275+0000","last_peered":"2024-09-10T05:39:26.313275+0000","last_clean":"2024-09-10T05:39:26.313275+0000","last_became_active":"2024-09-10T05:36:17.646459+0000","last_became_peered":"2024-09-10T05:36:17.646459+0000","last_unstale":"2024-09-10T05:39:26.313275+0000","last_undegraded":"2024-09-10T05:39:26.313275+0000","last_fullsized":"2024-09-10T05:39:26.313275+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:25:06.130753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.852746+0000","last_change":"2024-09-10T05:36:19.654869+0000","last_active":"2024-09-10T05:37:53.852746+0000","last_peered":"2024-09-10T05:37:53.852746+0000","last_clean":"2024-09-10T05:37:53.852746+0000","last_became_active":"2024-09-10T05:36:19.648608+0000","last_became_peered":"2024-09-10T05:36:19.648608+0000","last_unstale":"2024-09-10T05:37:53.852746+0000","last_undegraded":"2024-09-10T05:37:53.852746+0000","last_fullsized":"2024-09-10T05:37:53.852746+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:00.797025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.723161+0000","last_change":"2024-09-10T05:36:21.684218+0000","last_active":"2024-09-10T05:37:53.723161+0000","last_peered":"2024-09-10T05:37:53.723161+0000","last_clean":"2024-09-10T05:37:53.723161+0000","last_became_active":"2024-09-10T05:36:21.683406+0000","last_became_peered":"2024-09-10T05:36:21.683406+0000","last_unstale":"2024-09-10T05:37:53.723161+0000","last_undegraded":"2024-09-10T05:37:53.723161+0000","last_fullsized":"2024-09-10T05:37:53.723161+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:58:10.494998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'4","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.200914+0000","last_change":"2024-09-10T05:36:13.607573+0000","last_active":"2024-09-10T05:39:27.200914+0000","last_peered":"2024-09-10T05:39:27.200914+0000","last_clean":"2024-09-10T05:39:27.200914+0000","last_became_active":"2024-09-10T05:36:13.606903+0000","last_became_peered":"2024-09-10T05:36:13.606903+0000","last_unstale":"2024-09-10T05:39:27.200914+0000","last_undegraded":"2024-09-10T05:39:27.200914+0000","last_fullsized":"2024-09-10T05:39:27.200914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:36.946797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.859661+0000","last_change":"2024-09-10T05:36:11.595373+0000","last_active":"2024-09-10T05:37:53.859661+0000","last_peered":"2024-09-10T05:37:53.859661+0000","last_clean":"2024-09-10T05:37:53.859661+0000","last_became_active":"2024-09-10T05:36:11.594653+0000","last_became_peered":"2024-09-10T05:36:11.594653+0000","last_unstale":"2024-09-10T05:37:53.859661+0000","last_undegraded":"2024-09-10T05:37:53.859661+0000","last_fullsized":"2024-09-10T05:37:53.859661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:01:15.108575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"34'5","reported_seq":420,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:25.599472+0000","last_change":"2024-09-10T05:36:15.617558+0000","last_active":"2024-09-10T05:38:25.599472+0000","last_peered":"2024-09-10T05:38:25.599472+0000","last_clean":"2024-09-10T05:38:25.599472+0000","last_became_active":"2024-09-10T05:36:15.615147+0000","last_became_peered":"2024-09-10T05:36:15.615147+0000","last_unstale":"2024-09-10T05:38:25.599472+0000","last_undegraded":"2024-09-10T05:38:25.599472+0000","last_fullsized":"2024-09-10T05:38:25.599472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:18:16.479290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1429,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":580,"num_read_kb":580,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'30","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.003868+0000","last_change":"2024-09-10T05:36:17.632006+0000","last_active":"2024-09-10T05:38:24.003868+0000","last_peered":"2024-09-10T05:38:24.003868+0000","last_clean":"2024-09-10T05:38:24.003868+0000","last_became_active":"2024-09-10T05:36:17.631446+0000","last_became_peered":"2024-09-10T05:36:17.631446+0000","last_unstale":"2024-09-10T05:38:24.003868+0000","last_undegraded":"2024-09-10T05:38:24.003868+0000","last_fullsized":"2024-09-10T05:38:24.003868+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:30.388651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.715083+0000","last_change":"2024-09-10T05:36:19.639207+0000","last_active":"2024-09-10T05:37:53.715083+0000","last_peered":"2024-09-10T05:37:53.715083+0000","last_clean":"2024-09-10T05:37:53.715083+0000","last_became_active":"2024-09-10T05:36:19.638240+0000","last_became_peered":"2024-09-10T05:36:19.638240+0000","last_unstale":"2024-09-10T05:37:53.715083+0000","last_undegraded":"2024-09-10T05:37:53.715083+0000","last_fullsized":"2024-09-10T05:37:53.715083+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:39:50.347393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'8","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.905694+0000","last_change":"2024-09-10T05:36:13.619194+0000","last_active":"2024-09-10T05:37:55.905694+0000","last_peered":"2024-09-10T05:37:55.905694+0000","last_clean":"2024-09-10T05:37:55.905694+0000","last_became_active":"2024-09-10T05:36:13.618656+0000","last_became_peered":"2024-09-10T05:36:13.618656+0000","last_unstale":"2024-09-10T05:37:55.905694+0000","last_undegraded":"2024-09-10T05:37:55.905694+0000","last_fullsized":"2024-09-10T05:37:55.905694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:02:21.175825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.721692+0000","last_change":"2024-09-10T05:36:11.598128+0000","last_active":"2024-09-10T05:37:53.721692+0000","last_peered":"2024-09-10T05:37:53.721692+0000","last_clean":"2024-09-10T05:37:53.721692+0000","last_became_active":"2024-09-10T05:36:11.597710+0000","last_became_peered":"2024-09-10T05:36:11.597710+0000","last_unstale":"2024-09-10T05:37:53.721692+0000","last_undegraded":"2024-09-10T05:37:53.721692+0000","last_fullsized":"2024-09-10T05:37:53.721692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:38:54.156857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.856979+0000","last_change":"2024-09-10T05:36:15.627731+0000","last_active":"2024-09-10T05:37:53.856979+0000","last_peered":"2024-09-10T05:37:53.856979+0000","last_clean":"2024-09-10T05:37:53.856979+0000","last_became_active":"2024-09-10T05:36:15.626787+0000","last_became_peered":"2024-09-10T05:36:15.626787+0000","last_unstale":"2024-09-10T05:37:53.856979+0000","last_undegraded":"2024-09-10T05:37:53.856979+0000","last_fullsized":"2024-09-10T05:37:53.856979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:46:30.721119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"34'60","reported_seq":127,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.046372+0000","last_change":"2024-09-10T05:36:17.645250+0000","last_active":"2024-09-10T05:38:24.046372+0000","last_peered":"2024-09-10T05:38:24.046372+0000","last_clean":"2024-09-10T05:38:24.046372+0000","last_became_active":"2024-09-10T05:36:17.644469+0000","last_became_peered":"2024-09-10T05:36:17.644469+0000","last_unstale":"2024-09-10T05:38:24.046372+0000","last_undegraded":"2024-09-10T05:38:24.046372+0000","last_fullsized":"2024-09-10T05:38:24.046372+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:35.181585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":58,"num_read_kb":48,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.715316+0000","last_change":"2024-09-10T05:36:19.639542+0000","last_active":"2024-09-10T05:37:53.715316+0000","last_peered":"2024-09-10T05:37:53.715316+0000","last_clean":"2024-09-10T05:37:53.715316+0000","last_became_active":"2024-09-10T05:36:19.638136+0000","last_became_peered":"2024-09-10T05:36:19.638136+0000","last_unstale":"2024-09-10T05:37:53.715316+0000","last_undegraded":"2024-09-10T05:37:53.715316+0000","last_fullsized":"2024-09-10T05:37:53.715316+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:15:07.235287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'14","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:26.038899+0000","last_change":"2024-09-10T05:36:21.682080+0000","last_active":"2024-09-10T05:38:26.038899+0000","last_peered":"2024-09-10T05:38:26.038899+0000","last_clean":"2024-09-10T05:38:26.038899+0000","last_became_active":"2024-09-10T05:36:21.681263+0000","last_became_peered":"2024-09-10T05:36:21.681263+0000","last_unstale":"2024-09-10T05:38:26.038899+0000","last_undegraded":"2024-09-10T05:38:26.038899+0000","last_fullsized":"2024-09-10T05:38:26.038899+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:35:30.867304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"34'10","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.004821+0000","last_change":"2024-09-10T05:36:13.610413+0000","last_active":"2024-09-10T05:39:27.004821+0000","last_peered":"2024-09-10T05:39:27.004821+0000","last_clean":"2024-09-10T05:39:27.004821+0000","last_became_active":"2024-09-10T05:36:13.609773+0000","last_became_peered":"2024-09-10T05:36:13.609773+0000","last_unstale":"2024-09-10T05:39:27.004821+0000","last_undegraded":"2024-09-10T05:39:27.004821+0000","last_fullsized":"2024-09-10T05:39:27.004821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:39:34.903497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.853462+0000","last_change":"2024-09-10T05:36:11.596239+0000","last_active":"2024-09-10T05:37:53.853462+0000","last_peered":"2024-09-10T05:37:53.853462+0000","last_clean":"2024-09-10T05:37:53.853462+0000","last_became_active":"2024-09-10T05:36:11.595758+0000","last_became_peered":"2024-09-10T05:36:11.595758+0000","last_unstale":"2024-09-10T05:37:53.853462+0000","last_undegraded":"2024-09-10T05:37:53.853462+0000","last_fullsized":"2024-09-10T05:37:53.853462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:59:57.154376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.906346+0000","last_change":"2024-09-10T05:36:15.614782+0000","last_active":"2024-09-10T05:37:55.906346+0000","last_peered":"2024-09-10T05:37:55.906346+0000","last_clean":"2024-09-10T05:37:55.906346+0000","last_became_active":"2024-09-10T05:36:15.613949+0000","last_became_peered":"2024-09-10T05:36:15.613949+0000","last_unstale":"2024-09-10T05:37:55.906346+0000","last_undegraded":"2024-09-10T05:37:55.906346+0000","last_fullsized":"2024-09-10T05:37:55.906346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:33.167655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"34'36","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.006452+0000","last_change":"2024-09-10T05:36:17.637253+0000","last_active":"2024-09-10T05:38:24.006452+0000","last_peered":"2024-09-10T05:38:24.006452+0000","last_clean":"2024-09-10T05:38:24.006452+0000","last_became_active":"2024-09-10T05:36:17.636067+0000","last_became_peered":"2024-09-10T05:36:17.636067+0000","last_unstale":"2024-09-10T05:38:24.006452+0000","last_undegraded":"2024-09-10T05:38:24.006452+0000","last_fullsized":"2024-09-10T05:38:24.006452+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:27:48.471606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.856515+0000","last_change":"2024-09-10T05:36:19.665827+0000","last_active":"2024-09-10T05:37:53.856515+0000","last_peered":"2024-09-10T05:37:53.856515+0000","last_clean":"2024-09-10T05:37:53.856515+0000","last_became_active":"2024-09-10T05:36:19.665010+0000","last_became_peered":"2024-09-10T05:36:19.665010+0000","last_unstale":"2024-09-10T05:37:53.856515+0000","last_undegraded":"2024-09-10T05:37:53.856515+0000","last_fullsized":"2024-09-10T05:37:53.856515+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:47:10.890181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.899872+0000","last_change":"2024-09-10T05:36:21.665684+0000","last_active":"2024-09-10T05:37:55.899872+0000","last_peered":"2024-09-10T05:37:55.899872+0000","last_clean":"2024-09-10T05:37:55.899872+0000","last_became_active":"2024-09-10T05:36:21.664884+0000","last_became_peered":"2024-09-10T05:36:21.664884+0000","last_unstale":"2024-09-10T05:37:55.899872+0000","last_undegraded":"2024-09-10T05:37:55.899872+0000","last_fullsized":"2024-09-10T05:37:55.899872+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:21:16.296649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.726940+0000","last_change":"2024-09-10T05:36:13.616705+0000","last_active":"2024-09-10T05:37:53.726940+0000","last_peered":"2024-09-10T05:37:53.726940+0000","last_clean":"2024-09-10T05:37:53.726940+0000","last_became_active":"2024-09-10T05:36:13.616392+0000","last_became_peered":"2024-09-10T05:36:13.616392+0000","last_unstale":"2024-09-10T05:37:53.726940+0000","last_undegraded":"2024-09-10T05:37:53.726940+0000","last_fullsized":"2024-09-10T05:37:53.726940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:58:42.346686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.808522+0000","last_change":"2024-09-10T05:36:11.596038+0000","last_active":"2024-09-10T05:39:26.808522+0000","last_peered":"2024-09-10T05:39:26.808522+0000","last_clean":"2024-09-10T05:39:26.808522+0000","last_became_active":"2024-09-10T05:36:11.595319+0000","last_became_peered":"2024-09-10T05:36:11.595319+0000","last_unstale":"2024-09-10T05:39:26.808522+0000","last_undegraded":"2024-09-10T05:39:26.808522+0000","last_fullsized":"2024-09-10T05:39:26.808522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:55:19.990619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.902488+0000","last_change":"2024-09-10T05:36:15.618307+0000","last_active":"2024-09-10T05:37:55.902488+0000","last_peered":"2024-09-10T05:37:55.902488+0000","last_clean":"2024-09-10T05:37:55.902488+0000","last_became_active":"2024-09-10T05:36:15.617595+0000","last_became_peered":"2024-09-10T05:36:15.617595+0000","last_unstale":"2024-09-10T05:37:55.902488+0000","last_undegraded":"2024-09-10T05:37:55.902488+0000","last_fullsized":"2024-09-10T05:37:55.902488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:38.424958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1f","version":"34'38","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:23.682856+0000","last_change":"2024-09-10T05:36:17.635281+0000","last_active":"2024-09-10T05:38:23.682856+0000","last_peered":"2024-09-10T05:38:23.682856+0000","last_clean":"2024-09-10T05:38:23.682856+0000","last_became_active":"2024-09-10T05:36:17.634616+0000","last_became_peered":"2024-09-10T05:36:17.634616+0000","last_unstale":"2024-09-10T05:38:23.682856+0000","last_undegraded":"2024-09-10T05:38:23.682856+0000","last_fullsized":"2024-09-10T05:38:23.682856+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:14.597186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.859042+0000","last_change":"2024-09-10T05:36:19.665974+0000","last_active":"2024-09-10T05:37:53.859042+0000","last_peered":"2024-09-10T05:37:53.859042+0000","last_clean":"2024-09-10T05:37:53.859042+0000","last_became_active":"2024-09-10T05:36:19.665236+0000","last_became_peered":"2024-09-10T05:36:19.665236+0000","last_unstale":"2024-09-10T05:37:53.859042+0000","last_undegraded":"2024-09-10T05:37:53.859042+0000","last_fullsized":"2024-09-10T05:37:53.859042+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:24.647011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"34'5","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.906432+0000","last_change":"2024-09-10T05:36:21.695106+0000","last_active":"2024-09-10T05:39:26.906432+0000","last_peered":"2024-09-10T05:39:26.906432+0000","last_clean":"2024-09-10T05:39:26.906432+0000","last_became_active":"2024-09-10T05:36:21.694522+0000","last_became_peered":"2024-09-10T05:36:21.694522+0000","last_unstale":"2024-09-10T05:39:26.906432+0000","last_undegraded":"2024-09-10T05:39:26.906432+0000","last_fullsized":"2024-09-10T05:39:26.906432+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:40.765075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.295199+0000","last_change":"2024-09-10T05:36:13.611415+0000","last_active":"2024-09-10T05:39:27.295199+0000","last_peered":"2024-09-10T05:39:27.295199+0000","last_clean":"2024-09-10T05:39:27.295199+0000","last_became_active":"2024-09-10T05:36:13.610788+0000","last_became_peered":"2024-09-10T05:36:13.610788+0000","last_unstale":"2024-09-10T05:39:27.295199+0000","last_undegraded":"2024-09-10T05:39:27.295199+0000","last_fullsized":"2024-09-10T05:39:27.295199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:04.364523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"32'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.724690+0000","last_change":"2024-09-10T05:36:11.606056+0000","last_active":"2024-09-10T05:37:53.724690+0000","last_peered":"2024-09-10T05:37:53.724690+0000","last_clean":"2024-09-10T05:37:53.724690+0000","last_became_active":"2024-09-10T05:36:11.600655+0000","last_became_peered":"2024-09-10T05:36:11.600655+0000","last_unstale":"2024-09-10T05:37:53.724690+0000","last_undegraded":"2024-09-10T05:37:53.724690+0000","last_fullsized":"2024-09-10T05:37:53.724690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:42:31.168856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.857028+0000","last_change":"2024-09-10T05:36:15.624306+0000","last_active":"2024-09-10T05:37:53.857028+0000","last_peered":"2024-09-10T05:37:53.857028+0000","last_clean":"2024-09-10T05:37:53.857028+0000","last_became_active":"2024-09-10T05:36:15.623436+0000","last_became_peered":"2024-09-10T05:36:15.623436+0000","last_unstale":"2024-09-10T05:37:53.857028+0000","last_undegraded":"2024-09-10T05:37:53.857028+0000","last_fullsized":"2024-09-10T05:37:53.857028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:35:42.347473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'16","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.729552+0000","last_change":"2024-09-10T05:36:17.639307+0000","last_active":"2024-09-10T05:37:53.729552+0000","last_peered":"2024-09-10T05:37:53.729552+0000","last_clean":"2024-09-10T05:37:53.729552+0000","last_became_active":"2024-09-10T05:36:17.638408+0000","last_became_peered":"2024-09-10T05:36:17.638408+0000","last_unstale":"2024-09-10T05:37:53.729552+0000","last_undegraded":"2024-09-10T05:37:53.729552+0000","last_fullsized":"2024-09-10T05:37:53.729552+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:30.086363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'282","reported_seq":423,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.376804+0000","last_change":"2024-09-10T05:36:19.651451+0000","last_active":"2024-09-10T05:39:27.376804+0000","last_peered":"2024-09-10T05:39:27.376804+0000","last_clean":"2024-09-10T05:39:27.376804+0000","last_became_active":"2024-09-10T05:36:19.649079+0000","last_became_peered":"2024-09-10T05:36:19.649079+0000","last_unstale":"2024-09-10T05:39:27.376804+0000","last_undegraded":"2024-09-10T05:39:27.376804+0000","last_fullsized":"2024-09-10T05:39:27.376804+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:13:31.933741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.899307+0000","last_change":"2024-09-10T05:36:21.665833+0000","last_active":"2024-09-10T05:37:55.899307+0000","last_peered":"2024-09-10T05:37:55.899307+0000","last_clean":"2024-09-10T05:37:55.899307+0000","last_became_active":"2024-09-10T05:36:21.665112+0000","last_became_peered":"2024-09-10T05:36:21.665112+0000","last_unstale":"2024-09-10T05:37:55.899307+0000","last_undegraded":"2024-09-10T05:37:55.899307+0000","last_fullsized":"2024-09-10T05:37:55.899307+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:16:25.547381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"32'8","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.714229+0000","last_change":"2024-09-10T05:36:13.620715+0000","last_active":"2024-09-10T05:37:53.714229+0000","last_peered":"2024-09-10T05:37:53.714229+0000","last_clean":"2024-09-10T05:37:53.714229+0000","last_became_active":"2024-09-10T05:36:13.614222+0000","last_became_peered":"2024-09-10T05:36:13.614222+0000","last_unstale":"2024-09-10T05:37:53.714229+0000","last_undegraded":"2024-09-10T05:37:53.714229+0000","last_fullsized":"2024-09-10T05:37:53.714229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:14:25.317688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.180964+0000","last_change":"2024-09-10T05:36:11.593230+0000","last_active":"2024-09-10T05:39:27.180964+0000","last_peered":"2024-09-10T05:39:27.180964+0000","last_clean":"2024-09-10T05:39:27.180964+0000","last_became_active":"2024-09-10T05:36:11.592805+0000","last_became_peered":"2024-09-10T05:36:11.592805+0000","last_unstale":"2024-09-10T05:39:27.180964+0000","last_undegraded":"2024-09-10T05:39:27.180964+0000","last_fullsized":"2024-09-10T05:39:27.180964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:02:54.932468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.857006+0000","last_change":"2024-09-10T05:36:15.620727+0000","last_active":"2024-09-10T05:37:53.857006+0000","last_peered":"2024-09-10T05:37:53.857006+0000","last_clean":"2024-09-10T05:37:53.857006+0000","last_became_active":"2024-09-10T05:36:15.620288+0000","last_became_peered":"2024-09-10T05:36:15.620288+0000","last_unstale":"2024-09-10T05:37:53.857006+0000","last_undegraded":"2024-09-10T05:37:53.857006+0000","last_fullsized":"2024-09-10T05:37:53.857006+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:02:23.187158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'60","reported_seq":134,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:23.987842+0000","last_change":"2024-09-10T05:36:17.651973+0000","last_active":"2024-09-10T05:38:23.987842+0000","last_peered":"2024-09-10T05:38:23.987842+0000","last_clean":"2024-09-10T05:38:23.987842+0000","last_became_active":"2024-09-10T05:36:17.651364+0000","last_became_peered":"2024-09-10T05:36:17.651364+0000","last_unstale":"2024-09-10T05:38:23.987842+0000","last_undegraded":"2024-09-10T05:38:23.987842+0000","last_fullsized":"2024-09-10T05:38:23.987842+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:42:52.172095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":74,"num_read_kb":61,"num_write":42,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.721434+0000","last_change":"2024-09-10T05:36:19.659340+0000","last_active":"2024-09-10T05:37:53.721434+0000","last_peered":"2024-09-10T05:37:53.721434+0000","last_clean":"2024-09-10T05:37:53.721434+0000","last_became_active":"2024-09-10T05:36:19.658646+0000","last_became_peered":"2024-09-10T05:36:19.658646+0000","last_unstale":"2024-09-10T05:37:53.721434+0000","last_undegraded":"2024-09-10T05:37:53.721434+0000","last_fullsized":"2024-09-10T05:37:53.721434+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:22:35.133305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"34'4","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.471685+0000","last_change":"2024-09-10T05:36:21.689581+0000","last_active":"2024-09-10T05:39:27.471685+0000","last_peered":"2024-09-10T05:39:27.471685+0000","last_clean":"2024-09-10T05:39:27.471685+0000","last_became_active":"2024-09-10T05:36:21.688695+0000","last_became_peered":"2024-09-10T05:36:21.688695+0000","last_unstale":"2024-09-10T05:39:27.471685+0000","last_undegraded":"2024-09-10T05:39:27.471685+0000","last_fullsized":"2024-09-10T05:39:27.471685+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:53.585393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"34'4","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:21.802832+0000","last_change":"2024-09-10T05:36:13.616187+0000","last_active":"2024-09-10T05:38:21.802832+0000","last_peered":"2024-09-10T05:38:21.802832+0000","last_clean":"2024-09-10T05:38:21.802832+0000","last_became_active":"2024-09-10T05:36:13.615340+0000","last_became_peered":"2024-09-10T05:36:13.615340+0000","last_unstale":"2024-09-10T05:38:21.802832+0000","last_undegraded":"2024-09-10T05:38:21.802832+0000","last_fullsized":"2024-09-10T05:38:21.802832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:35:40.336140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"30'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.897590+0000","last_change":"2024-09-10T05:36:11.598985+0000","last_active":"2024-09-10T05:37:55.897590+0000","last_peered":"2024-09-10T05:37:55.897590+0000","last_clean":"2024-09-10T05:37:55.897590+0000","last_became_active":"2024-09-10T05:36:11.597360+0000","last_became_peered":"2024-09-10T05:36:11.597360+0000","last_unstale":"2024-09-10T05:37:55.897590+0000","last_undegraded":"2024-09-10T05:37:55.897590+0000","last_fullsized":"2024-09-10T05:37:55.897590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:38:31.576663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.902188+0000","last_change":"2024-09-10T05:36:15.620708+0000","last_active":"2024-09-10T05:37:55.902188+0000","last_peered":"2024-09-10T05:37:55.902188+0000","last_clean":"2024-09-10T05:37:55.902188+0000","last_became_active":"2024-09-10T05:36:15.619849+0000","last_became_peered":"2024-09-10T05:36:15.619849+0000","last_unstale":"2024-09-10T05:37:55.902188+0000","last_undegraded":"2024-09-10T05:37:55.902188+0000","last_fullsized":"2024-09-10T05:37:55.902188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:47:32.506655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"34'37","reported_seq":90,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:23.989171+0000","last_change":"2024-09-10T05:36:17.647578+0000","last_active":"2024-09-10T05:38:23.989171+0000","last_peered":"2024-09-10T05:38:23.989171+0000","last_clean":"2024-09-10T05:38:23.989171+0000","last_became_active":"2024-09-10T05:36:17.646780+0000","last_became_peered":"2024-09-10T05:36:17.646780+0000","last_unstale":"2024-09-10T05:38:23.989171+0000","last_undegraded":"2024-09-10T05:38:23.989171+0000","last_fullsized":"2024-09-10T05:38:23.989171+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:44.392590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.896432+0000","last_change":"2024-09-10T05:36:19.652878+0000","last_active":"2024-09-10T05:37:55.896432+0000","last_peered":"2024-09-10T05:37:55.896432+0000","last_clean":"2024-09-10T05:37:55.896432+0000","last_became_active":"2024-09-10T05:36:19.652114+0000","last_became_peered":"2024-09-10T05:36:19.652114+0000","last_unstale":"2024-09-10T05:37:55.896432+0000","last_undegraded":"2024-09-10T05:37:55.896432+0000","last_fullsized":"2024-09-10T05:37:55.896432+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:46:40.081106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.16","version":"34'2","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.271654+0000","last_change":"2024-09-10T05:36:21.693139+0000","last_active":"2024-09-10T05:39:27.271654+0000","last_peered":"2024-09-10T05:39:27.271654+0000","last_clean":"2024-09-10T05:39:27.271654+0000","last_became_active":"2024-09-10T05:36:21.692564+0000","last_became_peered":"2024-09-10T05:36:21.692564+0000","last_unstale":"2024-09-10T05:39:27.271654+0000","last_undegraded":"2024-09-10T05:39:27.271654+0000","last_fullsized":"2024-09-10T05:39:27.271654+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:51.507378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'6","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:26.195675+0000","last_change":"2024-09-10T05:36:13.600568+0000","last_active":"2024-09-10T05:38:26.195675+0000","last_peered":"2024-09-10T05:38:26.195675+0000","last_clean":"2024-09-10T05:38:26.195675+0000","last_became_active":"2024-09-10T05:36:13.600225+0000","last_became_peered":"2024-09-10T05:36:13.600225+0000","last_unstale":"2024-09-10T05:38:26.195675+0000","last_undegraded":"2024-09-10T05:38:26.195675+0000","last_fullsized":"2024-09-10T05:38:26.195675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:12:34.999826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.729875+0000","last_change":"2024-09-10T05:36:11.600905+0000","last_active":"2024-09-10T05:37:53.729875+0000","last_peered":"2024-09-10T05:37:53.729875+0000","last_clean":"2024-09-10T05:37:53.729875+0000","last_became_active":"2024-09-10T05:36:11.600598+0000","last_became_peered":"2024-09-10T05:36:11.600598+0000","last_unstale":"2024-09-10T05:37:53.729875+0000","last_undegraded":"2024-09-10T05:37:53.729875+0000","last_fullsized":"2024-09-10T05:37:53.729875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:33:49.620025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.853389+0000","last_change":"2024-09-10T05:36:15.635553+0000","last_active":"2024-09-10T05:37:53.853389+0000","last_peered":"2024-09-10T05:37:53.853389+0000","last_clean":"2024-09-10T05:37:53.853389+0000","last_became_active":"2024-09-10T05:36:15.634465+0000","last_became_peered":"2024-09-10T05:36:15.634465+0000","last_unstale":"2024-09-10T05:37:53.853389+0000","last_undegraded":"2024-09-10T05:37:53.853389+0000","last_fullsized":"2024-09-10T05:37:53.853389+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:18:38.683911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'33","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:26.200284+0000","last_change":"2024-09-10T05:36:17.635770+0000","last_active":"2024-09-10T05:38:26.200284+0000","last_peered":"2024-09-10T05:38:26.200284+0000","last_clean":"2024-09-10T05:38:26.200284+0000","last_became_active":"2024-09-10T05:36:17.634874+0000","last_became_peered":"2024-09-10T05:36:17.634874+0000","last_unstale":"2024-09-10T05:38:26.200284+0000","last_undegraded":"2024-09-10T05:38:26.200284+0000","last_fullsized":"2024-09-10T05:38:26.200284+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:54:06.818353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":27,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.898394+0000","last_change":"2024-09-10T05:36:19.638483+0000","last_active":"2024-09-10T05:37:55.898394+0000","last_peered":"2024-09-10T05:37:55.898394+0000","last_clean":"2024-09-10T05:37:55.898394+0000","last_became_active":"2024-09-10T05:36:19.637682+0000","last_became_peered":"2024-09-10T05:36:19.637682+0000","last_unstale":"2024-09-10T05:37:55.898394+0000","last_undegraded":"2024-09-10T05:37:55.898394+0000","last_fullsized":"2024-09-10T05:37:55.898394+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:35.498813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"34'4","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.056283+0000","last_change":"2024-09-10T05:36:21.688794+0000","last_active":"2024-09-10T05:38:24.056283+0000","last_peered":"2024-09-10T05:38:24.056283+0000","last_clean":"2024-09-10T05:38:24.056283+0000","last_became_active":"2024-09-10T05:36:21.688046+0000","last_became_peered":"2024-09-10T05:36:21.688046+0000","last_unstale":"2024-09-10T05:38:24.056283+0000","last_undegraded":"2024-09-10T05:38:24.056283+0000","last_fullsized":"2024-09-10T05:38:24.056283+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:06:36.753067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.200751+0000","last_change":"2024-09-10T05:36:13.612701+0000","last_active":"2024-09-10T05:39:27.200751+0000","last_peered":"2024-09-10T05:39:27.200751+0000","last_clean":"2024-09-10T05:39:27.200751+0000","last_became_active":"2024-09-10T05:36:13.611864+0000","last_became_peered":"2024-09-10T05:36:13.611864+0000","last_unstale":"2024-09-10T05:39:27.200751+0000","last_undegraded":"2024-09-10T05:39:27.200751+0000","last_fullsized":"2024-09-10T05:39:27.200751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:07:57.487596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"32'3","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.859772+0000","last_change":"2024-09-10T05:36:11.595800+0000","last_active":"2024-09-10T05:37:53.859772+0000","last_peered":"2024-09-10T05:37:53.859772+0000","last_clean":"2024-09-10T05:37:53.859772+0000","last_became_active":"2024-09-10T05:36:11.594949+0000","last_became_peered":"2024-09-10T05:36:11.594949+0000","last_unstale":"2024-09-10T05:37:53.859772+0000","last_undegraded":"2024-09-10T05:37:53.859772+0000","last_fullsized":"2024-09-10T05:37:53.859772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:42.468342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:22.306367+0000","last_change":"2024-09-10T05:36:15.619284+0000","last_active":"2024-09-10T05:38:22.306367+0000","last_peered":"2024-09-10T05:38:22.306367+0000","last_clean":"2024-09-10T05:38:22.306367+0000","last_became_active":"2024-09-10T05:36:15.618169+0000","last_became_peered":"2024-09-10T05:36:15.618169+0000","last_unstale":"2024-09-10T05:38:22.306367+0000","last_undegraded":"2024-09-10T05:38:22.306367+0000","last_fullsized":"2024-09-10T05:38:22.306367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:22:48.592489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'47","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.260272+0000","last_change":"2024-09-10T05:36:17.631950+0000","last_active":"2024-09-10T05:39:26.260272+0000","last_peered":"2024-09-10T05:39:26.260272+0000","last_clean":"2024-09-10T05:39:26.260272+0000","last_became_active":"2024-09-10T05:36:17.631194+0000","last_became_peered":"2024-09-10T05:36:17.631194+0000","last_unstale":"2024-09-10T05:39:26.260272+0000","last_undegraded":"2024-09-10T05:39:26.260272+0000","last_fullsized":"2024-09-10T05:39:26.260272+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:53:16.893462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":67,"num_write":34,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.713950+0000","last_change":"2024-09-10T05:36:19.637266+0000","last_active":"2024-09-10T05:37:53.713950+0000","last_peered":"2024-09-10T05:37:53.713950+0000","last_clean":"2024-09-10T05:37:53.713950+0000","last_became_active":"2024-09-10T05:36:19.636483+0000","last_became_peered":"2024-09-10T05:36:19.636483+0000","last_unstale":"2024-09-10T05:37:53.713950+0000","last_undegraded":"2024-09-10T05:37:53.713950+0000","last_fullsized":"2024-09-10T05:37:53.713950+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:56:30.945572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"34'8","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.060943+0000","last_change":"2024-09-10T05:36:21.689539+0000","last_active":"2024-09-10T05:38:24.060943+0000","last_peered":"2024-09-10T05:38:24.060943+0000","last_clean":"2024-09-10T05:38:24.060943+0000","last_became_active":"2024-09-10T05:36:21.688818+0000","last_became_peered":"2024-09-10T05:36:21.688818+0000","last_unstale":"2024-09-10T05:38:24.060943+0000","last_undegraded":"2024-09-10T05:38:24.060943+0000","last_fullsized":"2024-09-10T05:38:24.060943+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:50:15.537977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":19,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"34'8","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.381517+0000","last_change":"2024-09-10T05:36:13.618862+0000","last_active":"2024-09-10T05:39:27.381517+0000","last_peered":"2024-09-10T05:39:27.381517+0000","last_clean":"2024-09-10T05:39:27.381517+0000","last_became_active":"2024-09-10T05:36:13.618260+0000","last_became_peered":"2024-09-10T05:36:13.618260+0000","last_unstale":"2024-09-10T05:39:27.381517+0000","last_undegraded":"2024-09-10T05:39:27.381517+0000","last_fullsized":"2024-09-10T05:39:27.381517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:25:48.886027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.711408+0000","last_change":"2024-09-10T05:36:11.604033+0000","last_active":"2024-09-10T05:37:53.711408+0000","last_peered":"2024-09-10T05:37:53.711408+0000","last_clean":"2024-09-10T05:37:53.711408+0000","last_became_active":"2024-09-10T05:36:11.603738+0000","last_became_peered":"2024-09-10T05:36:11.603738+0000","last_unstale":"2024-09-10T05:37:53.711408+0000","last_undegraded":"2024-09-10T05:37:53.711408+0000","last_fullsized":"2024-09-10T05:37:53.711408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:24:44.820464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'14","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.005687+0000","last_change":"2024-09-10T05:36:13.624965+0000","last_active":"2024-09-10T05:39:27.005687+0000","last_peered":"2024-09-10T05:39:27.005687+0000","last_clean":"2024-09-10T05:39:27.005687+0000","last_became_active":"2024-09-10T05:36:13.624460+0000","last_became_peered":"2024-09-10T05:36:13.624460+0000","last_unstale":"2024-09-10T05:39:27.005687+0000","last_undegraded":"2024-09-10T05:39:27.005687+0000","last_fullsized":"2024-09-10T05:39:27.005687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:05:54.096604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":58,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"34'1","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:17.679564+0000","last_change":"2024-09-10T05:36:11.602104+0000","last_active":"2024-09-10T05:38:17.679564+0000","last_peered":"2024-09-10T05:38:17.679564+0000","last_clean":"2024-09-10T05:38:17.679564+0000","last_became_active":"2024-09-10T05:36:11.601762+0000","last_became_peered":"2024-09-10T05:36:11.601762+0000","last_unstale":"2024-09-10T05:38:17.679564+0000","last_undegraded":"2024-09-10T05:38:17.679564+0000","last_fullsized":"2024-09-10T05:38:17.679564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:40:20.378957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"34'20","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.202070+0000","last_change":"2024-09-10T05:36:13.615511+0000","last_active":"2024-09-10T05:39:27.202070+0000","last_peered":"2024-09-10T05:39:27.202070+0000","last_clean":"2024-09-10T05:39:27.202070+0000","last_became_active":"2024-09-10T05:36:13.614221+0000","last_became_peered":"2024-09-10T05:36:13.614221+0000","last_unstale":"2024-09-10T05:39:27.202070+0000","last_undegraded":"2024-09-10T05:39:27.202070+0000","last_fullsized":"2024-09-10T05:39:27.202070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:22:46.581156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":66,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.723905+0000","last_change":"2024-09-10T05:36:11.606212+0000","last_active":"2024-09-10T05:37:53.723905+0000","last_peered":"2024-09-10T05:37:53.723905+0000","last_clean":"2024-09-10T05:37:53.723905+0000","last_became_active":"2024-09-10T05:36:11.601269+0000","last_became_peered":"2024-09-10T05:36:11.601269+0000","last_unstale":"2024-09-10T05:37:53.723905+0000","last_undegraded":"2024-09-10T05:37:53.723905+0000","last_fullsized":"2024-09-10T05:37:53.723905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:20.541837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'21","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.222435+0000","last_change":"2024-09-10T05:36:13.626184+0000","last_active":"2024-09-10T05:39:27.222435+0000","last_peered":"2024-09-10T05:39:27.222435+0000","last_clean":"2024-09-10T05:39:27.222435+0000","last_became_active":"2024-09-10T05:36:13.626022+0000","last_became_peered":"2024-09-10T05:36:13.626022+0000","last_unstale":"2024-09-10T05:39:27.222435+0000","last_undegraded":"2024-09-10T05:39:27.222435+0000","last_fullsized":"2024-09-10T05:39:27.222435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:53:45.495092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":48,"num_read_kb":40,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.713130+0000","last_change":"2024-09-10T05:36:11.611309+0000","last_active":"2024-09-10T05:37:53.713130+0000","last_peered":"2024-09-10T05:37:53.713130+0000","last_clean":"2024-09-10T05:37:53.713130+0000","last_became_active":"2024-09-10T05:36:11.610933+0000","last_became_peered":"2024-09-10T05:36:11.610933+0000","last_unstale":"2024-09-10T05:37:53.713130+0000","last_undegraded":"2024-09-10T05:37:53.713130+0000","last_fullsized":"2024-09-10T05:37:53.713130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:18.400915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"34'14","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.311516+0000","last_change":"2024-09-10T05:36:13.599973+0000","last_active":"2024-09-10T05:39:27.311516+0000","last_peered":"2024-09-10T05:39:27.311516+0000","last_clean":"2024-09-10T05:39:27.311516+0000","last_became_active":"2024-09-10T05:36:13.597975+0000","last_became_peered":"2024-09-10T05:36:13.597975+0000","last_unstale":"2024-09-10T05:39:27.311516+0000","last_undegraded":"2024-09-10T05:39:27.311516+0000","last_fullsized":"2024-09-10T05:39:27.311516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:04.875436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:26.066736+0000","last_change":"2024-09-10T05:36:11.603591+0000","last_active":"2024-09-10T05:38:26.066736+0000","last_peered":"2024-09-10T05:38:26.066736+0000","last_clean":"2024-09-10T05:38:26.066736+0000","last_became_active":"2024-09-10T05:36:11.603085+0000","last_became_peered":"2024-09-10T05:36:11.603085+0000","last_unstale":"2024-09-10T05:38:26.066736+0000","last_undegraded":"2024-09-10T05:38:26.066736+0000","last_fullsized":"2024-09-10T05:38:26.066736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:10:49.254963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.854228+0000","last_change":"2024-09-10T05:36:13.611510+0000","last_active":"2024-09-10T05:37:53.854228+0000","last_peered":"2024-09-10T05:37:53.854228+0000","last_clean":"2024-09-10T05:37:53.854228+0000","last_became_active":"2024-09-10T05:36:13.610894+0000","last_became_peered":"2024-09-10T05:36:13.610894+0000","last_unstale":"2024-09-10T05:37:53.854228+0000","last_undegraded":"2024-09-10T05:37:53.854228+0000","last_fullsized":"2024-09-10T05:37:53.854228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:07:55.559113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.854514+0000","last_change":"2024-09-10T05:36:11.593190+0000","last_active":"2024-09-10T05:37:53.854514+0000","last_peered":"2024-09-10T05:37:53.854514+0000","last_clean":"2024-09-10T05:37:53.854514+0000","last_became_active":"2024-09-10T05:36:11.592809+0000","last_became_peered":"2024-09-10T05:36:11.592809+0000","last_unstale":"2024-09-10T05:37:53.854514+0000","last_undegraded":"2024-09-10T05:37:53.854514+0000","last_fullsized":"2024-09-10T05:37:53.854514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:58:36.951469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:26.178147+0000","last_change":"2024-09-10T05:36:13.607562+0000","last_active":"2024-09-10T05:38:26.178147+0000","last_peered":"2024-09-10T05:38:26.178147+0000","last_clean":"2024-09-10T05:38:26.178147+0000","last_became_active":"2024-09-10T05:36:13.607052+0000","last_became_peered":"2024-09-10T05:36:13.607052+0000","last_unstale":"2024-09-10T05:38:26.178147+0000","last_undegraded":"2024-09-10T05:38:26.178147+0000","last_fullsized":"2024-09-10T05:38:26.178147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:33:32.480741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"32'2","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.715328+0000","last_change":"2024-09-10T05:36:11.594051+0000","last_active":"2024-09-10T05:37:53.715328+0000","last_peered":"2024-09-10T05:37:53.715328+0000","last_clean":"2024-09-10T05:37:53.715328+0000","last_became_active":"2024-09-10T05:36:11.593614+0000","last_became_peered":"2024-09-10T05:36:11.593614+0000","last_unstale":"2024-09-10T05:37:53.715328+0000","last_undegraded":"2024-09-10T05:37:53.715328+0000","last_fullsized":"2024-09-10T05:37:53.715328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:46:37.205574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.363940+0000","last_change":"2024-09-10T05:36:13.595278+0000","last_active":"2024-09-10T05:39:27.363940+0000","last_peered":"2024-09-10T05:39:27.363940+0000","last_clean":"2024-09-10T05:39:27.363940+0000","last_became_active":"2024-09-10T05:36:13.593693+0000","last_became_peered":"2024-09-10T05:36:13.593693+0000","last_unstale":"2024-09-10T05:39:27.363940+0000","last_undegraded":"2024-09-10T05:39:27.363940+0000","last_fullsized":"2024-09-10T05:39:27.363940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:22:11.979321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"34'8","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.727061+0000","last_change":"2024-09-10T05:36:11.606672+0000","last_active":"2024-09-10T05:39:26.727061+0000","last_peered":"2024-09-10T05:39:26.727061+0000","last_clean":"2024-09-10T05:39:26.727061+0000","last_became_active":"2024-09-10T05:36:11.604011+0000","last_became_peered":"2024-09-10T05:36:11.604011+0000","last_unstale":"2024-09-10T05:39:26.727061+0000","last_undegraded":"2024-09-10T05:39:26.727061+0000","last_fullsized":"2024-09-10T05:39:26.727061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:10:51.639983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":24,"num_write_kb":12289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"34'16","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:26.194535+0000","last_change":"2024-09-10T05:36:13.630165+0000","last_active":"2024-09-10T05:38:26.194535+0000","last_peered":"2024-09-10T05:38:26.194535+0000","last_clean":"2024-09-10T05:38:26.194535+0000","last_became_active":"2024-09-10T05:36:13.629760+0000","last_became_peered":"2024-09-10T05:36:13.629760+0000","last_unstale":"2024-09-10T05:38:26.194535+0000","last_undegraded":"2024-09-10T05:38:26.194535+0000","last_fullsized":"2024-09-10T05:38:26.194535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:59:45.392768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":66,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.721785+0000","last_change":"2024-09-10T05:36:11.597692+0000","last_active":"2024-09-10T05:37:53.721785+0000","last_peered":"2024-09-10T05:37:53.721785+0000","last_clean":"2024-09-10T05:37:53.721785+0000","last_became_active":"2024-09-10T05:36:11.597158+0000","last_became_peered":"2024-09-10T05:36:11.597158+0000","last_unstale":"2024-09-10T05:37:53.721785+0000","last_undegraded":"2024-09-10T05:37:53.721785+0000","last_fullsized":"2024-09-10T05:37:53.721785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:49.958598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.006147+0000","last_change":"2024-09-10T05:36:13.613919+0000","last_active":"2024-09-10T05:39:27.006147+0000","last_peered":"2024-09-10T05:39:27.006147+0000","last_clean":"2024-09-10T05:39:27.006147+0000","last_became_active":"2024-09-10T05:36:13.613206+0000","last_became_peered":"2024-09-10T05:36:13.613206+0000","last_unstale":"2024-09-10T05:39:27.006147+0000","last_undegraded":"2024-09-10T05:39:27.006147+0000","last_fullsized":"2024-09-10T05:39:27.006147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:20:09.645015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.854005+0000","last_change":"2024-09-10T05:36:52.706116+0000","last_active":"2024-09-10T05:37:53.854005+0000","last_peered":"2024-09-10T05:37:53.854005+0000","last_clean":"2024-09-10T05:37:53.854005+0000","last_became_active":"2024-09-10T05:36:52.705212+0000","last_became_peered":"2024-09-10T05:36:52.705212+0000","last_unstale":"2024-09-10T05:37:53.854005+0000","last_undegraded":"2024-09-10T05:37:53.854005+0000","last_fullsized":"2024-09-10T05:37:53.854005+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:27.831627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.005396+0000","last_change":"2024-09-10T05:36:13.627667+0000","last_active":"2024-09-10T05:39:27.005396+0000","last_peered":"2024-09-10T05:39:27.005396+0000","last_clean":"2024-09-10T05:39:27.005396+0000","last_became_active":"2024-09-10T05:36:13.626912+0000","last_became_peered":"2024-09-10T05:36:13.626912+0000","last_unstale":"2024-09-10T05:39:27.005396+0000","last_undegraded":"2024-09-10T05:39:27.005396+0000","last_fullsized":"2024-09-10T05:39:27.005396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:36.054213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.896918+0000","last_change":"2024-09-10T05:36:11.607179+0000","last_active":"2024-09-10T05:37:55.896918+0000","last_peered":"2024-09-10T05:37:55.896918+0000","last_clean":"2024-09-10T05:37:55.896918+0000","last_became_active":"2024-09-10T05:36:11.606369+0000","last_became_peered":"2024-09-10T05:36:11.606369+0000","last_unstale":"2024-09-10T05:37:55.896918+0000","last_undegraded":"2024-09-10T05:37:55.896918+0000","last_fullsized":"2024-09-10T05:37:55.896918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:14:23.688323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"32'8","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.858816+0000","last_change":"2024-09-10T05:36:13.608226+0000","last_active":"2024-09-10T05:37:53.858816+0000","last_peered":"2024-09-10T05:37:53.858816+0000","last_clean":"2024-09-10T05:37:53.858816+0000","last_became_active":"2024-09-10T05:36:13.607807+0000","last_became_peered":"2024-09-10T05:36:13.607807+0000","last_unstale":"2024-09-10T05:37:53.858816+0000","last_undegraded":"2024-09-10T05:37:53.858816+0000","last_fullsized":"2024-09-10T05:37:53.858816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:30:41.672233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.854315+0000","last_change":"2024-09-10T05:36:11.594296+0000","last_active":"2024-09-10T05:37:53.854315+0000","last_peered":"2024-09-10T05:37:53.854315+0000","last_clean":"2024-09-10T05:37:53.854315+0000","last_became_active":"2024-09-10T05:36:11.593962+0000","last_became_peered":"2024-09-10T05:36:11.593962+0000","last_unstale":"2024-09-10T05:37:53.854315+0000","last_undegraded":"2024-09-10T05:37:53.854315+0000","last_fullsized":"2024-09-10T05:37:53.854315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:55.429080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.902466+0000","last_change":"2024-09-10T05:36:13.615141+0000","last_active":"2024-09-10T05:37:55.902466+0000","last_peered":"2024-09-10T05:37:55.902466+0000","last_clean":"2024-09-10T05:37:55.902466+0000","last_became_active":"2024-09-10T05:36:13.614155+0000","last_became_peered":"2024-09-10T05:36:13.614155+0000","last_unstale":"2024-09-10T05:37:55.902466+0000","last_undegraded":"2024-09-10T05:37:55.902466+0000","last_fullsized":"2024-09-10T05:37:55.902466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:39:44.309572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.724975+0000","last_change":"2024-09-10T05:36:11.603262+0000","last_active":"2024-09-10T05:37:53.724975+0000","last_peered":"2024-09-10T05:37:53.724975+0000","last_clean":"2024-09-10T05:37:53.724975+0000","last_became_active":"2024-09-10T05:36:11.602866+0000","last_became_peered":"2024-09-10T05:36:11.602866+0000","last_unstale":"2024-09-10T05:37:53.724975+0000","last_undegraded":"2024-09-10T05:37:53.724975+0000","last_fullsized":"2024-09-10T05:37:53.724975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:54:03.517815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'15","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.381320+0000","last_change":"2024-09-10T05:36:13.613437+0000","last_active":"2024-09-10T05:39:27.381320+0000","last_peered":"2024-09-10T05:39:27.381320+0000","last_clean":"2024-09-10T05:39:27.381320+0000","last_became_active":"2024-09-10T05:36:13.611391+0000","last_became_peered":"2024-09-10T05:36:13.611391+0000","last_unstale":"2024-09-10T05:39:27.381320+0000","last_undegraded":"2024-09-10T05:39:27.381320+0000","last_fullsized":"2024-09-10T05:39:27.381320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:28:23.276697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.853711+0000","last_change":"2024-09-10T05:36:52.707618+0000","last_active":"2024-09-10T05:37:53.853711+0000","last_peered":"2024-09-10T05:37:53.853711+0000","last_clean":"2024-09-10T05:37:53.853711+0000","last_became_active":"2024-09-10T05:36:52.706226+0000","last_became_peered":"2024-09-10T05:36:52.706226+0000","last_unstale":"2024-09-10T05:37:53.853711+0000","last_undegraded":"2024-09-10T05:37:53.853711+0000","last_fullsized":"2024-09-10T05:37:53.853711+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:21:59.439322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"34'10","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.200918+0000","last_change":"2024-09-10T05:36:13.616625+0000","last_active":"2024-09-10T05:39:27.200918+0000","last_peered":"2024-09-10T05:39:27.200918+0000","last_clean":"2024-09-10T05:39:27.200918+0000","last_became_active":"2024-09-10T05:36:13.616136+0000","last_became_peered":"2024-09-10T05:36:13.616136+0000","last_unstale":"2024-09-10T05:39:27.200918+0000","last_undegraded":"2024-09-10T05:39:27.200918+0000","last_fullsized":"2024-09-10T05:39:27.200918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:40:37.044525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"32'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.715111+0000","last_change":"2024-09-10T05:36:11.600692+0000","last_active":"2024-09-10T05:37:53.715111+0000","last_peered":"2024-09-10T05:37:53.715111+0000","last_clean":"2024-09-10T05:37:53.715111+0000","last_became_active":"2024-09-10T05:36:11.600234+0000","last_became_peered":"2024-09-10T05:36:11.600234+0000","last_unstale":"2024-09-10T05:37:53.715111+0000","last_undegraded":"2024-09-10T05:37:53.715111+0000","last_fullsized":"2024-09-10T05:37:53.715111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:23:34.604922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"30'2","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.899857+0000","last_change":"2024-09-10T05:36:13.615416+0000","last_active":"2024-09-10T05:37:55.899857+0000","last_peered":"2024-09-10T05:37:55.899857+0000","last_clean":"2024-09-10T05:37:55.899857+0000","last_became_active":"2024-09-10T05:36:13.614098+0000","last_became_peered":"2024-09-10T05:36:13.614098+0000","last_unstale":"2024-09-10T05:37:55.899857+0000","last_undegraded":"2024-09-10T05:37:55.899857+0000","last_fullsized":"2024-09-10T05:37:55.899857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:56:24.907751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"30'2","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.729428+0000","last_change":"2024-09-10T05:36:11.606179+0000","last_active":"2024-09-10T05:37:53.729428+0000","last_peered":"2024-09-10T05:37:53.729428+0000","last_clean":"2024-09-10T05:37:53.729428+0000","last_became_active":"2024-09-10T05:36:11.603972+0000","last_became_peered":"2024-09-10T05:36:11.603972+0000","last_unstale":"2024-09-10T05:37:53.729428+0000","last_undegraded":"2024-09-10T05:37:53.729428+0000","last_fullsized":"2024-09-10T05:37:53.729428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:01:31.149492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.897044+0000","last_change":"2024-09-10T05:36:11.597226+0000","last_active":"2024-09-10T05:37:55.897044+0000","last_peered":"2024-09-10T05:37:55.897044+0000","last_clean":"2024-09-10T05:37:55.897044+0000","last_became_active":"2024-09-10T05:36:11.595183+0000","last_became_peered":"2024-09-10T05:36:11.595183+0000","last_unstale":"2024-09-10T05:37:55.897044+0000","last_undegraded":"2024-09-10T05:37:55.897044+0000","last_fullsized":"2024-09-10T05:37:55.897044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:40:04.618907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"34'8","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.296974+0000","last_change":"2024-09-10T05:36:13.623166+0000","last_active":"2024-09-10T05:39:27.296974+0000","last_peered":"2024-09-10T05:39:27.296974+0000","last_clean":"2024-09-10T05:39:27.296974+0000","last_became_active":"2024-09-10T05:36:13.622559+0000","last_became_peered":"2024-09-10T05:36:13.622559+0000","last_unstale":"2024-09-10T05:39:27.296974+0000","last_undegraded":"2024-09-10T05:39:27.296974+0000","last_fullsized":"2024-09-10T05:39:27.296974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:42:51.927427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"34'1","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:32.688141+0000","last_change":"2024-09-10T05:36:11.591759+0000","last_active":"2024-09-10T05:38:32.688141+0000","last_peered":"2024-09-10T05:38:32.688141+0000","last_clean":"2024-09-10T05:38:32.688141+0000","last_became_active":"2024-09-10T05:36:11.588124+0000","last_became_peered":"2024-09-10T05:36:11.588124+0000","last_unstale":"2024-09-10T05:38:32.688141+0000","last_undegraded":"2024-09-10T05:38:32.688141+0000","last_fullsized":"2024-09-10T05:38:32.688141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:46:37.205574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"34'20","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.383693+0000","last_change":"2024-09-10T05:36:13.618023+0000","last_active":"2024-09-10T05:39:27.383693+0000","last_peered":"2024-09-10T05:39:27.383693+0000","last_clean":"2024-09-10T05:39:27.383693+0000","last_became_active":"2024-09-10T05:36:13.614959+0000","last_became_peered":"2024-09-10T05:36:13.614959+0000","last_unstale":"2024-09-10T05:39:27.383693+0000","last_undegraded":"2024-09-10T05:39:27.383693+0000","last_fullsized":"2024-09-10T05:39:27.383693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:10:02.645509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":56,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":692,"num_read_kb":660,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1690,"num_read_kb":1444,"num_write":723,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1470,"ondisk_log_size":1470,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1683,"num_read_kb":1573,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":130,"num_read_kb":83,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":639872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51617792,"data_stored":51611392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640306,"num_pgs":142,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56324,"kb_used_data":16820,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94315516,"statfs":{"total":96636764160,"available":96579088384,"internally_reserved":0,"allocated":17223680,"data_stored":16927949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673011,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45136,"kb_used_data":9792,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94326704,"statfs":{"total":96636764160,"available":96590544896,"internally_reserved":0,"allocated":10027008,"data_stored":9765035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673012,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48668,"kb_used_data":13324,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323172,"statfs":{"total":96636764160,"available":96586928128,"internally_reserved":0,"allocated":13643776,"data_stored":13323216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949673011,"num_pgs":143,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40416,"kb_used_data":13392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94331424,"statfs":{"total":96636764160,"available":96595378176,"internally_reserved":0,"allocated":13713408,"data_stored":13372464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13225984,"data_stored":13222784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9031680,"data_stored":9028480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":2712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T05:39:59.604 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T05:39:59.605 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T05:39:59.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.761+0000 7fd3a2e8f640 1 Processor -- start 2024-09-10T05:39:59.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.761+0000 7fd3a2e8f640 1 -- start start 2024-09-10T05:39:59.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.765+0000 7fd3a2e8f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd39c111890 0x7fd39c132450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:39:59.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.765+0000 7fd3a2e8f640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd39c073a90 con 0x7fd39c110da0 2024-09-10T05:39:59.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.765+0000 7fd3a2e8f640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fd39c0696e0 con 0x7fd39c111890 2024-09-10T05:39:59.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.765+0000 7fd39bfff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd39c111890 0x7fd39c132450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:39:59.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.765+0000 7fd39bfff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd39c111890 0x7fd39c132450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35444/0 (socket says 172.21.15.2:35444) 2024-09-10T05:39:59.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.765+0000 7fd39bfff640 1 -- 172.21.15.2:0/1092605007 learned_addr learned my addr 172.21.15.2:0/1092605007 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:39:59.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.765+0000 7fd39bfff640 1 -- 172.21.15.2:0/1092605007 >> v1:172.21.15.2:6789/0 conn(0x7fd39c110da0 legacy=0x7fd39c111180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:39:59.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.765+0000 7fd39bfff640 1 -- 172.21.15.2:0/1092605007 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd39c06dd50 con 0x7fd39c111890 2024-09-10T05:39:59.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.765+0000 7fd39bfff640 1 --2- 172.21.15.2:0/1092605007 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd39c111890 0x7fd39c132450 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fd3900097f0 tx=0x7fd39001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed48a0b9c14127a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:39:59.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.765+0000 7fd39b7fe640 1 -- 172.21.15.2:0/1092605007 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3900b0070 con 0x7fd39c111890 2024-09-10T05:39:59.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.765+0000 7fd39b7fe640 1 -- 172.21.15.2:0/1092605007 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3900ab530 con 0x7fd39c111890 2024-09-10T05:39:59.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.765+0000 7fd39b7fe640 1 -- 172.21.15.2:0/1092605007 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3900ab830 con 0x7fd39c111890 2024-09-10T05:39:59.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.769+0000 7fd3a2e8f640 1 -- 172.21.15.2:0/1092605007 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd39c111890 msgr2=0x7fd39c132450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:39:59.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.769+0000 7fd3a2e8f640 1 --2- 172.21.15.2:0/1092605007 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd39c111890 0x7fd39c132450 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fd3900097f0 tx=0x7fd39001c430 comp rx=0 tx=0).stop 2024-09-10T05:39:59.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.769+0000 7fd3a2e8f640 1 -- 172.21.15.2:0/1092605007 shutdown_connections 2024-09-10T05:39:59.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.769+0000 7fd3a2e8f640 1 --2- 172.21.15.2:0/1092605007 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd39c111890 0x7fd39c132450 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:39:59.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.769+0000 7fd3a2e8f640 1 -- 172.21.15.2:0/1092605007 >> 172.21.15.2:0/1092605007 conn(0x7fd39c070900 msgr2=0x7fd39c072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:39:59.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.769+0000 7fd3a2e8f640 1 -- 172.21.15.2:0/1092605007 shutdown_connections 2024-09-10T05:39:59.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.769+0000 7fd3a2e8f640 1 -- 172.21.15.2:0/1092605007 wait complete. 2024-09-10T05:39:59.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.769+0000 7fd3a2e8f640 1 Processor -- start 2024-09-10T05:39:59.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.769+0000 7fd3a2e8f640 1 -- start start 2024-09-10T05:39:59.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.769+0000 7fd3a2e8f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd39c110da0 0x7fd39c122a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:39:59.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.769+0000 7fd3a2e8f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd39c135330 con 0x7fd39c110da0 2024-09-10T05:39:59.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.769+0000 7fd3a0c2b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd39c110da0 0x7fd39c122a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:39:59.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.769+0000 7fd3a0c2b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd39c110da0 0x7fd39c122a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35452/0 (socket says 172.21.15.2:35452) 2024-09-10T05:39:59.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.769+0000 7fd3a0c2b640 1 -- 172.21.15.2:0/1744851084 learned_addr learned my addr 172.21.15.2:0/1744851084 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:39:59.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.769+0000 7fd3a0c2b640 1 -- 172.21.15.2:0/1744851084 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd39c131dd0 con 0x7fd39c110da0 2024-09-10T05:39:59.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.769+0000 7fd3a0c2b640 1 --2- 172.21.15.2:0/1744851084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd39c110da0 0x7fd39c122a50 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fd38c00c430 tx=0x7fd38c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:39:59.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.769+0000 7fd3997fa640 1 -- 172.21.15.2:0/1744851084 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd38c017070 con 0x7fd39c110da0 2024-09-10T05:39:59.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.769+0000 7fd3997fa640 1 -- 172.21.15.2:0/1744851084 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd38c005200 con 0x7fd39c110da0 2024-09-10T05:39:59.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.769+0000 7fd3a2e8f640 1 -- 172.21.15.2:0/1744851084 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd39c12fee0 con 0x7fd39c110da0 2024-09-10T05:39:59.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.769+0000 7fd3997fa640 1 -- 172.21.15.2:0/1744851084 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd38c003600 con 0x7fd39c110da0 2024-09-10T05:39:59.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.769+0000 7fd3a2e8f640 1 -- 172.21.15.2:0/1744851084 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd39c130f70 con 0x7fd39c110da0 2024-09-10T05:39:59.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.769+0000 7fd3997fa640 1 -- 172.21.15.2:0/1744851084 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd38c01a070 con 0x7fd39c110da0 2024-09-10T05:39:59.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.773+0000 7fd3997fa640 1 --2- 172.21.15.2:0/1744851084 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fd38803b180 0x7fd38803d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:39:59.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.773+0000 7fd3a2e8f640 1 -- 172.21.15.2:0/1744851084 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd39c111180 con 0x7fd39c110da0 2024-09-10T05:39:59.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.773+0000 7fd3997fa640 1 -- 172.21.15.2:0/1744851084 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7fd38c04ea40 con 0x7fd39c110da0 2024-09-10T05:39:59.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.773+0000 7fd39bfff640 1 --2- 172.21.15.2:0/1744851084 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fd38803b180 0x7fd38803d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:39:59.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.773+0000 7fd39bfff640 1 --2- 172.21.15.2:0/1744851084 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fd38803b180 0x7fd38803d640 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd39c073cb0 tx=0x7fd3900a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:39:59.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.777+0000 7fd3997fa640 1 -- 172.21.15.2:0/1744851084 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fd38c04ee20 con 0x7fd39c110da0 2024-09-10T05:39:59.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.945+0000 7fd3a2e8f640 1 -- 172.21.15.2:0/1744851084 --> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd39c122f90 con 0x7fd38803b180 2024-09-10T05:39:59.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.973+0000 7fd3997fa640 1 -- 172.21.15.2:0/1744851084 <== mgr.4101 v2:172.21.15.62:6824/3663628807 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665554 (secure 0 0 0) 0x7fd390009490 con 0x7fd38803b180 2024-09-10T05:39:59.983 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T05:39:59.989 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-10T05:39:59.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.977+0000 7fd3a2e8f640 1 -- 172.21.15.2:0/1744851084 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fd38803b180 msgr2=0x7fd38803d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:39:59.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.977+0000 7fd3a2e8f640 1 --2- 172.21.15.2:0/1744851084 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fd38803b180 0x7fd38803d640 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd39c073cb0 tx=0x7fd3900a6000 comp rx=0 tx=0).stop 2024-09-10T05:39:59.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.977+0000 7fd3a2e8f640 1 -- 172.21.15.2:0/1744851084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd39c110da0 msgr2=0x7fd39c122a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:39:59.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.977+0000 7fd3a2e8f640 1 --2- 172.21.15.2:0/1744851084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd39c110da0 0x7fd39c122a50 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fd38c00c430 tx=0x7fd38c00c8f0 comp rx=0 tx=0).stop 2024-09-10T05:39:59.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.981+0000 7fd3a2e8f640 1 -- 172.21.15.2:0/1744851084 shutdown_connections 2024-09-10T05:39:59.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.981+0000 7fd3a2e8f640 1 --2- 172.21.15.2:0/1744851084 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fd38803b180 0x7fd38803d640 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:39:59.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.981+0000 7fd3a2e8f640 1 --2- 172.21.15.2:0/1744851084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd39c110da0 0x7fd39c122a50 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:39:59.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.981+0000 7fd3a2e8f640 1 -- 172.21.15.2:0/1744851084 >> 172.21.15.2:0/1744851084 conn(0x7fd39c070900 msgr2=0x7fd39c071ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:39:59.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.981+0000 7fd3a2e8f640 1 -- 172.21.15.2:0/1744851084 shutdown_connections 2024-09-10T05:39:59.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:39:59.981+0000 7fd3a2e8f640 1 -- 172.21.15.2:0/1744851084 wait complete. 2024-09-10T05:39:59.999 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":152,"stamp":"2024-09-10T05:39:59.696337+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":18024208,"num_objects":259,"num_object_clones":0,"num_object_copies":518,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":259,"num_whiteouts":0,"num_read":5272,"num_read_kb":4824,"num_write":2258,"num_write_kb":60587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":639982,"num_keys_recovered":1,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4658,"ondisk_log_size":4658,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":174160,"kb_used_data":36944,"kb_used_omap":6,"kb_used_meta":137145,"kb_avail":377313200,"statfs":{"total":386547056640,"available":386368716800,"internally_reserved":0,"allocated":37830656,"data_stored":36611448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":140437270},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8388608,"num_objects":-2,"num_object_clones":0,"num_object_copies":-4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006235"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.898799+0000","last_change":"2024-09-10T05:36:11.606846+0000","last_active":"2024-09-10T05:37:55.898799+0000","last_peered":"2024-09-10T05:37:55.898799+0000","last_clean":"2024-09-10T05:37:55.898799+0000","last_became_active":"2024-09-10T05:36:11.605721+0000","last_became_peered":"2024-09-10T05:36:11.605721+0000","last_unstale":"2024-09-10T05:37:55.898799+0000","last_undegraded":"2024-09-10T05:37:55.898799+0000","last_fullsized":"2024-09-10T05:37:55.898799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:44:08.530179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"30'2","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.900982+0000","last_change":"2024-09-10T05:36:13.628621+0000","last_active":"2024-09-10T05:37:55.900982+0000","last_peered":"2024-09-10T05:37:55.900982+0000","last_clean":"2024-09-10T05:37:55.900982+0000","last_became_active":"2024-09-10T05:36:13.628174+0000","last_became_peered":"2024-09-10T05:36:13.628174+0000","last_unstale":"2024-09-10T05:37:55.900982+0000","last_undegraded":"2024-09-10T05:37:55.900982+0000","last_fullsized":"2024-09-10T05:37:55.900982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:47.128005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"30'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.856072+0000","last_change":"2024-09-10T05:36:11.596391+0000","last_active":"2024-09-10T05:37:53.856072+0000","last_peered":"2024-09-10T05:37:53.856072+0000","last_clean":"2024-09-10T05:37:53.856072+0000","last_became_active":"2024-09-10T05:36:11.596100+0000","last_became_peered":"2024-09-10T05:36:11.596100+0000","last_unstale":"2024-09-10T05:37:53.856072+0000","last_undegraded":"2024-09-10T05:37:53.856072+0000","last_fullsized":"2024-09-10T05:37:53.856072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:45:53.700310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"34'5","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:43.687749+0000","last_change":"2024-09-10T05:36:13.601197+0000","last_active":"2024-09-10T05:38:43.687749+0000","last_peered":"2024-09-10T05:38:43.687749+0000","last_clean":"2024-09-10T05:38:43.687749+0000","last_became_active":"2024-09-10T05:36:13.598320+0000","last_became_peered":"2024-09-10T05:36:13.598320+0000","last_unstale":"2024-09-10T05:38:43.687749+0000","last_undegraded":"2024-09-10T05:38:43.687749+0000","last_fullsized":"2024-09-10T05:38:43.687749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:38:17.550395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.726285+0000","last_change":"2024-09-10T05:36:11.604217+0000","last_active":"2024-09-10T05:37:53.726285+0000","last_peered":"2024-09-10T05:37:53.726285+0000","last_clean":"2024-09-10T05:37:53.726285+0000","last_became_active":"2024-09-10T05:36:11.603193+0000","last_became_peered":"2024-09-10T05:36:11.603193+0000","last_unstale":"2024-09-10T05:37:53.726285+0000","last_undegraded":"2024-09-10T05:37:53.726285+0000","last_fullsized":"2024-09-10T05:37:53.726285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:09:46.125040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'10","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.200739+0000","last_change":"2024-09-10T05:36:13.604439+0000","last_active":"2024-09-10T05:39:27.200739+0000","last_peered":"2024-09-10T05:39:27.200739+0000","last_clean":"2024-09-10T05:39:27.200739+0000","last_became_active":"2024-09-10T05:36:13.604094+0000","last_became_peered":"2024-09-10T05:36:13.604094+0000","last_unstale":"2024-09-10T05:39:27.200739+0000","last_undegraded":"2024-09-10T05:39:27.200739+0000","last_fullsized":"2024-09-10T05:39:27.200739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:17:01.676891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.713626+0000","last_change":"2024-09-10T05:36:11.611784+0000","last_active":"2024-09-10T05:37:53.713626+0000","last_peered":"2024-09-10T05:37:53.713626+0000","last_clean":"2024-09-10T05:37:53.713626+0000","last_became_active":"2024-09-10T05:36:11.611399+0000","last_became_peered":"2024-09-10T05:36:11.611399+0000","last_unstale":"2024-09-10T05:37:53.713626+0000","last_undegraded":"2024-09-10T05:37:53.713626+0000","last_fullsized":"2024-09-10T05:37:53.713626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:34:57.058604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'10","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.363850+0000","last_change":"2024-09-10T05:36:52.703620+0000","last_active":"2024-09-10T05:39:27.363850+0000","last_peered":"2024-09-10T05:39:27.363850+0000","last_clean":"2024-09-10T05:39:27.363850+0000","last_became_active":"2024-09-10T05:36:52.702713+0000","last_became_peered":"2024-09-10T05:36:52.702713+0000","last_unstale":"2024-09-10T05:39:27.363850+0000","last_undegraded":"2024-09-10T05:39:27.363850+0000","last_fullsized":"2024-09-10T05:39:27.363850+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:09:12.955195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.897222+0000","last_change":"2024-09-10T05:36:11.598408+0000","last_active":"2024-09-10T05:37:55.897222+0000","last_peered":"2024-09-10T05:37:55.897222+0000","last_clean":"2024-09-10T05:37:55.897222+0000","last_became_active":"2024-09-10T05:36:11.597514+0000","last_became_peered":"2024-09-10T05:36:11.597514+0000","last_unstale":"2024-09-10T05:37:55.897222+0000","last_undegraded":"2024-09-10T05:37:55.897222+0000","last_fullsized":"2024-09-10T05:37:55.897222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:23.782584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"34'11","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.024907+0000","last_change":"2024-09-10T05:36:13.622714+0000","last_active":"2024-09-10T05:39:27.024907+0000","last_peered":"2024-09-10T05:39:27.024907+0000","last_clean":"2024-09-10T05:39:27.024907+0000","last_became_active":"2024-09-10T05:36:13.621573+0000","last_became_peered":"2024-09-10T05:36:13.621573+0000","last_unstale":"2024-09-10T05:39:27.024907+0000","last_undegraded":"2024-09-10T05:39:27.024907+0000","last_fullsized":"2024-09-10T05:39:27.024907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:33.906083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.902223+0000","last_change":"2024-09-10T05:36:52.704991+0000","last_active":"2024-09-10T05:37:55.902223+0000","last_peered":"2024-09-10T05:37:55.902223+0000","last_clean":"2024-09-10T05:37:55.902223+0000","last_became_active":"2024-09-10T05:36:52.704285+0000","last_became_peered":"2024-09-10T05:36:52.704285+0000","last_unstale":"2024-09-10T05:37:55.902223+0000","last_undegraded":"2024-09-10T05:37:55.902223+0000","last_fullsized":"2024-09-10T05:37:55.902223+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:31:44.000002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.905524+0000","last_change":"2024-09-10T05:36:13.613130+0000","last_active":"2024-09-10T05:37:55.905524+0000","last_peered":"2024-09-10T05:37:55.905524+0000","last_clean":"2024-09-10T05:37:55.905524+0000","last_became_active":"2024-09-10T05:36:13.612127+0000","last_became_peered":"2024-09-10T05:36:13.612127+0000","last_unstale":"2024-09-10T05:37:55.905524+0000","last_undegraded":"2024-09-10T05:37:55.905524+0000","last_fullsized":"2024-09-10T05:37:55.905524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:55:15.649785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.723024+0000","last_change":"2024-09-10T05:36:11.598434+0000","last_active":"2024-09-10T05:37:53.723024+0000","last_peered":"2024-09-10T05:37:53.723024+0000","last_clean":"2024-09-10T05:37:53.723024+0000","last_became_active":"2024-09-10T05:36:11.598054+0000","last_became_peered":"2024-09-10T05:36:11.598054+0000","last_unstale":"2024-09-10T05:37:53.723024+0000","last_undegraded":"2024-09-10T05:37:53.723024+0000","last_fullsized":"2024-09-10T05:37:53.723024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:15:17.547203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'8","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.905442+0000","last_change":"2024-09-10T05:36:13.613557+0000","last_active":"2024-09-10T05:37:55.905442+0000","last_peered":"2024-09-10T05:37:55.905442+0000","last_clean":"2024-09-10T05:37:55.905442+0000","last_became_active":"2024-09-10T05:36:13.612743+0000","last_became_peered":"2024-09-10T05:36:13.612743+0000","last_unstale":"2024-09-10T05:37:55.905442+0000","last_undegraded":"2024-09-10T05:37:55.905442+0000","last_fullsized":"2024-09-10T05:37:55.905442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:46:09.360826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.721935+0000","last_change":"2024-09-10T05:36:11.593912+0000","last_active":"2024-09-10T05:37:53.721935+0000","last_peered":"2024-09-10T05:37:53.721935+0000","last_clean":"2024-09-10T05:37:53.721935+0000","last_became_active":"2024-09-10T05:36:11.593454+0000","last_became_peered":"2024-09-10T05:36:11.593454+0000","last_unstale":"2024-09-10T05:37:53.721935+0000","last_undegraded":"2024-09-10T05:37:53.721935+0000","last_fullsized":"2024-09-10T05:37:53.721935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:50:30.548750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"34'10","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.861683+0000","last_change":"2024-09-10T05:36:13.621644+0000","last_active":"2024-09-10T05:39:26.861683+0000","last_peered":"2024-09-10T05:39:26.861683+0000","last_clean":"2024-09-10T05:39:26.861683+0000","last_became_active":"2024-09-10T05:36:13.621362+0000","last_became_peered":"2024-09-10T05:36:13.621362+0000","last_unstale":"2024-09-10T05:39:26.861683+0000","last_undegraded":"2024-09-10T05:39:26.861683+0000","last_fullsized":"2024-09-10T05:39:26.861683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:44:10.159543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.295664+0000","last_change":"2024-09-10T05:36:13.628746+0000","last_active":"2024-09-10T05:39:27.295664+0000","last_peered":"2024-09-10T05:39:27.295664+0000","last_clean":"2024-09-10T05:39:27.295664+0000","last_became_active":"2024-09-10T05:36:13.628203+0000","last_became_peered":"2024-09-10T05:36:13.628203+0000","last_unstale":"2024-09-10T05:39:27.295664+0000","last_undegraded":"2024-09-10T05:39:27.295664+0000","last_fullsized":"2024-09-10T05:39:27.295664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:15:01.197465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"30'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.860067+0000","last_change":"2024-09-10T05:36:11.595338+0000","last_active":"2024-09-10T05:37:53.860067+0000","last_peered":"2024-09-10T05:37:53.860067+0000","last_clean":"2024-09-10T05:37:53.860067+0000","last_became_active":"2024-09-10T05:36:11.594409+0000","last_became_peered":"2024-09-10T05:36:11.594409+0000","last_unstale":"2024-09-10T05:37:53.860067+0000","last_undegraded":"2024-09-10T05:37:53.860067+0000","last_fullsized":"2024-09-10T05:37:53.860067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:40:54.327881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'8","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.314170+0000","last_change":"2024-09-10T05:36:13.620594+0000","last_active":"2024-09-10T05:39:27.314170+0000","last_peered":"2024-09-10T05:39:27.314170+0000","last_clean":"2024-09-10T05:39:27.314170+0000","last_became_active":"2024-09-10T05:36:13.619905+0000","last_became_peered":"2024-09-10T05:36:13.619905+0000","last_unstale":"2024-09-10T05:39:27.314170+0000","last_undegraded":"2024-09-10T05:39:27.314170+0000","last_fullsized":"2024-09-10T05:39:27.314170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:43:07.884535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.716388+0000","last_change":"2024-09-10T05:36:11.612156+0000","last_active":"2024-09-10T05:37:53.716388+0000","last_peered":"2024-09-10T05:37:53.716388+0000","last_clean":"2024-09-10T05:37:53.716388+0000","last_became_active":"2024-09-10T05:36:11.611735+0000","last_became_peered":"2024-09-10T05:36:11.611735+0000","last_unstale":"2024-09-10T05:37:53.716388+0000","last_undegraded":"2024-09-10T05:37:53.716388+0000","last_fullsized":"2024-09-10T05:37:53.716388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:25:27.078667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'18","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.364017+0000","last_change":"2024-09-10T05:36:13.625084+0000","last_active":"2024-09-10T05:39:27.364017+0000","last_peered":"2024-09-10T05:39:27.364017+0000","last_clean":"2024-09-10T05:39:27.364017+0000","last_became_active":"2024-09-10T05:36:13.624358+0000","last_became_peered":"2024-09-10T05:36:13.624358+0000","last_unstale":"2024-09-10T05:39:27.364017+0000","last_undegraded":"2024-09-10T05:39:27.364017+0000","last_fullsized":"2024-09-10T05:39:27.364017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:03:25.809000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":77,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"34'4","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.188377+0000","last_change":"2024-09-10T05:36:11.608840+0000","last_active":"2024-09-10T05:39:27.188377+0000","last_peered":"2024-09-10T05:39:27.188377+0000","last_clean":"2024-09-10T05:39:27.188377+0000","last_became_active":"2024-09-10T05:36:11.608244+0000","last_became_peered":"2024-09-10T05:36:11.608244+0000","last_unstale":"2024-09-10T05:39:27.188377+0000","last_undegraded":"2024-09-10T05:39:27.188377+0000","last_fullsized":"2024-09-10T05:39:27.188377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:54:31.346128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"32'24","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.714987+0000","last_change":"2024-09-10T05:36:13.614877+0000","last_active":"2024-09-10T05:37:53.714987+0000","last_peered":"2024-09-10T05:37:53.714987+0000","last_clean":"2024-09-10T05:37:53.714987+0000","last_became_active":"2024-09-10T05:36:13.613298+0000","last_became_peered":"2024-09-10T05:36:13.613298+0000","last_unstale":"2024-09-10T05:37:53.714987+0000","last_undegraded":"2024-09-10T05:37:53.714987+0000","last_fullsized":"2024-09-10T05:37:53.714987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:36:36.280933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":77,"num_write":32,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"32'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.896973+0000","last_change":"2024-09-10T05:36:11.600946+0000","last_active":"2024-09-10T05:37:55.896973+0000","last_peered":"2024-09-10T05:37:55.896973+0000","last_clean":"2024-09-10T05:37:55.896973+0000","last_became_active":"2024-09-10T05:36:11.600159+0000","last_became_peered":"2024-09-10T05:36:11.600159+0000","last_unstale":"2024-09-10T05:37:55.896973+0000","last_undegraded":"2024-09-10T05:37:55.896973+0000","last_fullsized":"2024-09-10T05:37:55.896973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:17:55.025975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"34'10","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.465170+0000","last_change":"2024-09-10T05:36:13.610326+0000","last_active":"2024-09-10T05:39:27.465170+0000","last_peered":"2024-09-10T05:39:27.465170+0000","last_clean":"2024-09-10T05:39:27.465170+0000","last_became_active":"2024-09-10T05:36:13.605913+0000","last_became_peered":"2024-09-10T05:36:13.605913+0000","last_unstale":"2024-09-10T05:39:27.465170+0000","last_undegraded":"2024-09-10T05:39:27.465170+0000","last_fullsized":"2024-09-10T05:39:27.465170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:40:06.248271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"34'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:17.692508+0000","last_change":"2024-09-10T05:36:52.721595+0000","last_active":"2024-09-10T05:39:17.692508+0000","last_peered":"2024-09-10T05:39:17.692508+0000","last_clean":"2024-09-10T05:39:17.692508+0000","last_became_active":"2024-09-10T05:36:52.701277+0000","last_became_peered":"2024-09-10T05:36:52.701277+0000","last_unstale":"2024-09-10T05:39:17.692508+0000","last_undegraded":"2024-09-10T05:39:17.692508+0000","last_fullsized":"2024-09-10T05:39:17.692508+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:20:16.743547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3,"num_write_kb":1250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":639872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.855635+0000","last_change":"2024-09-10T05:36:13.600360+0000","last_active":"2024-09-10T05:37:53.855635+0000","last_peered":"2024-09-10T05:37:53.855635+0000","last_clean":"2024-09-10T05:37:53.855635+0000","last_became_active":"2024-09-10T05:36:13.599955+0000","last_became_peered":"2024-09-10T05:36:13.599955+0000","last_unstale":"2024-09-10T05:37:53.855635+0000","last_undegraded":"2024-09-10T05:37:53.855635+0000","last_fullsized":"2024-09-10T05:37:53.855635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:12:25.023354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.158891+0000","last_change":"2024-09-10T05:36:11.606469+0000","last_active":"2024-09-10T05:39:27.158891+0000","last_peered":"2024-09-10T05:39:27.158891+0000","last_clean":"2024-09-10T05:39:27.158891+0000","last_became_active":"2024-09-10T05:36:11.603982+0000","last_became_peered":"2024-09-10T05:36:11.603982+0000","last_unstale":"2024-09-10T05:39:27.158891+0000","last_undegraded":"2024-09-10T05:39:27.158891+0000","last_fullsized":"2024-09-10T05:39:27.158891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:27:57.248963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'35","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.250994+0000","last_change":"2024-09-10T05:36:21.673756+0000","last_active":"2024-09-10T05:39:27.250994+0000","last_peered":"2024-09-10T05:39:27.250994+0000","last_clean":"2024-09-10T05:39:27.250994+0000","last_became_active":"2024-09-10T05:36:21.672975+0000","last_became_peered":"2024-09-10T05:36:21.672975+0000","last_unstale":"2024-09-10T05:39:27.250994+0000","last_undegraded":"2024-09-10T05:39:27.250994+0000","last_fullsized":"2024-09-10T05:39:27.250994+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:09:28.929715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'10","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.200652+0000","last_change":"2024-09-10T05:36:13.616306+0000","last_active":"2024-09-10T05:39:27.200652+0000","last_peered":"2024-09-10T05:39:27.200652+0000","last_clean":"2024-09-10T05:39:27.200652+0000","last_became_active":"2024-09-10T05:36:13.616006+0000","last_became_peered":"2024-09-10T05:36:13.616006+0000","last_unstale":"2024-09-10T05:39:27.200652+0000","last_undegraded":"2024-09-10T05:39:27.200652+0000","last_fullsized":"2024-09-10T05:39:27.200652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:12:47.354260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.725430+0000","last_change":"2024-09-10T05:36:11.606773+0000","last_active":"2024-09-10T05:37:53.725430+0000","last_peered":"2024-09-10T05:37:53.725430+0000","last_clean":"2024-09-10T05:37:53.725430+0000","last_became_active":"2024-09-10T05:36:11.601101+0000","last_became_peered":"2024-09-10T05:36:11.601101+0000","last_unstale":"2024-09-10T05:37:53.725430+0000","last_undegraded":"2024-09-10T05:37:53.725430+0000","last_fullsized":"2024-09-10T05:37:53.725430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:18:28.907356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.727535+0000","last_change":"2024-09-10T05:36:15.626686+0000","last_active":"2024-09-10T05:37:53.727535+0000","last_peered":"2024-09-10T05:37:53.727535+0000","last_clean":"2024-09-10T05:37:53.727535+0000","last_became_active":"2024-09-10T05:36:15.626172+0000","last_became_peered":"2024-09-10T05:36:15.626172+0000","last_unstale":"2024-09-10T05:37:53.727535+0000","last_undegraded":"2024-09-10T05:37:53.727535+0000","last_fullsized":"2024-09-10T05:37:53.727535+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:39:20.579324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'45","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.479585+0000","last_change":"2024-09-10T05:36:17.640065+0000","last_active":"2024-09-10T05:39:58.479585+0000","last_peered":"2024-09-10T05:39:58.479585+0000","last_clean":"2024-09-10T05:39:58.479585+0000","last_became_active":"2024-09-10T05:36:17.639318+0000","last_became_peered":"2024-09-10T05:36:17.639318+0000","last_unstale":"2024-09-10T05:39:58.479585+0000","last_undegraded":"2024-09-10T05:39:58.479585+0000","last_fullsized":"2024-09-10T05:39:58.479585+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:05:59.617319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.898449+0000","last_change":"2024-09-10T05:36:19.648793+0000","last_active":"2024-09-10T05:37:55.898449+0000","last_peered":"2024-09-10T05:37:55.898449+0000","last_clean":"2024-09-10T05:37:55.898449+0000","last_became_active":"2024-09-10T05:36:19.647998+0000","last_became_peered":"2024-09-10T05:36:19.647998+0000","last_unstale":"2024-09-10T05:37:55.898449+0000","last_undegraded":"2024-09-10T05:37:55.898449+0000","last_fullsized":"2024-09-10T05:37:55.898449+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:14:38.933277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"32'9","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.899552+0000","last_change":"2024-09-10T05:36:21.673262+0000","last_active":"2024-09-10T05:37:55.899552+0000","last_peered":"2024-09-10T05:37:55.899552+0000","last_clean":"2024-09-10T05:37:55.899552+0000","last_became_active":"2024-09-10T05:36:21.672757+0000","last_became_peered":"2024-09-10T05:36:21.672757+0000","last_unstale":"2024-09-10T05:37:55.899552+0000","last_undegraded":"2024-09-10T05:37:55.899552+0000","last_fullsized":"2024-09-10T05:37:55.899552+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:49:20.130241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"32'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.727360+0000","last_change":"2024-09-10T05:36:13.598805+0000","last_active":"2024-09-10T05:37:53.727360+0000","last_peered":"2024-09-10T05:37:53.727360+0000","last_clean":"2024-09-10T05:37:53.727360+0000","last_became_active":"2024-09-10T05:36:13.597649+0000","last_became_peered":"2024-09-10T05:36:13.597649+0000","last_unstale":"2024-09-10T05:37:53.727360+0000","last_undegraded":"2024-09-10T05:37:53.727360+0000","last_fullsized":"2024-09-10T05:37:53.727360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:02:19.101449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.711943+0000","last_change":"2024-09-10T05:36:11.611702+0000","last_active":"2024-09-10T05:37:53.711943+0000","last_peered":"2024-09-10T05:37:53.711943+0000","last_clean":"2024-09-10T05:37:53.711943+0000","last_became_active":"2024-09-10T05:36:11.611326+0000","last_became_peered":"2024-09-10T05:36:11.611326+0000","last_unstale":"2024-09-10T05:37:53.711943+0000","last_undegraded":"2024-09-10T05:37:53.711943+0000","last_fullsized":"2024-09-10T05:37:53.711943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:06:03.034626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.725805+0000","last_change":"2024-09-10T05:36:15.608668+0000","last_active":"2024-09-10T05:37:53.725805+0000","last_peered":"2024-09-10T05:37:53.725805+0000","last_clean":"2024-09-10T05:37:53.725805+0000","last_became_active":"2024-09-10T05:36:15.607918+0000","last_became_peered":"2024-09-10T05:36:15.607918+0000","last_unstale":"2024-09-10T05:37:53.725805+0000","last_undegraded":"2024-09-10T05:37:53.725805+0000","last_fullsized":"2024-09-10T05:37:53.725805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:57.614009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"30'12","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.859373+0000","last_change":"2024-09-10T05:36:17.644680+0000","last_active":"2024-09-10T05:37:53.859373+0000","last_peered":"2024-09-10T05:37:53.859373+0000","last_clean":"2024-09-10T05:37:53.859373+0000","last_became_active":"2024-09-10T05:36:17.643856+0000","last_became_peered":"2024-09-10T05:36:17.643856+0000","last_unstale":"2024-09-10T05:37:53.859373+0000","last_undegraded":"2024-09-10T05:37:53.859373+0000","last_fullsized":"2024-09-10T05:37:53.859373+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:31:24.591766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.899864+0000","last_change":"2024-09-10T05:36:19.648357+0000","last_active":"2024-09-10T05:37:55.899864+0000","last_peered":"2024-09-10T05:37:55.899864+0000","last_clean":"2024-09-10T05:37:55.899864+0000","last_became_active":"2024-09-10T05:36:19.647612+0000","last_became_peered":"2024-09-10T05:36:19.647612+0000","last_unstale":"2024-09-10T05:37:55.899864+0000","last_undegraded":"2024-09-10T05:37:55.899864+0000","last_fullsized":"2024-09-10T05:37:55.899864+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:06:01.493680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"34'10","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.344196+0000","last_change":"2024-09-10T05:36:21.679828+0000","last_active":"2024-09-10T05:39:26.344196+0000","last_peered":"2024-09-10T05:39:26.344196+0000","last_clean":"2024-09-10T05:39:26.344196+0000","last_became_active":"2024-09-10T05:36:21.679052+0000","last_became_peered":"2024-09-10T05:36:21.679052+0000","last_unstale":"2024-09-10T05:39:26.344196+0000","last_undegraded":"2024-09-10T05:39:26.344196+0000","last_fullsized":"2024-09-10T05:39:26.344196+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:53.565670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.729075+0000","last_change":"2024-09-10T05:36:13.612634+0000","last_active":"2024-09-10T05:37:53.729075+0000","last_peered":"2024-09-10T05:37:53.729075+0000","last_clean":"2024-09-10T05:37:53.729075+0000","last_became_active":"2024-09-10T05:36:13.611935+0000","last_became_peered":"2024-09-10T05:36:13.611935+0000","last_unstale":"2024-09-10T05:37:53.729075+0000","last_undegraded":"2024-09-10T05:37:53.729075+0000","last_fullsized":"2024-09-10T05:37:53.729075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:11.305578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.897677+0000","last_change":"2024-09-10T05:36:11.596948+0000","last_active":"2024-09-10T05:37:55.897677+0000","last_peered":"2024-09-10T05:37:55.897677+0000","last_clean":"2024-09-10T05:37:55.897677+0000","last_became_active":"2024-09-10T05:36:11.596047+0000","last_became_peered":"2024-09-10T05:36:11.596047+0000","last_unstale":"2024-09-10T05:37:55.897677+0000","last_undegraded":"2024-09-10T05:37:55.897677+0000","last_fullsized":"2024-09-10T05:37:55.897677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:36:34.651568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.729520+0000","last_change":"2024-09-10T05:36:15.636316+0000","last_active":"2024-09-10T05:37:53.729520+0000","last_peered":"2024-09-10T05:37:53.729520+0000","last_clean":"2024-09-10T05:37:53.729520+0000","last_became_active":"2024-09-10T05:36:15.635534+0000","last_became_peered":"2024-09-10T05:36:15.635534+0000","last_unstale":"2024-09-10T05:37:53.729520+0000","last_undegraded":"2024-09-10T05:37:53.729520+0000","last_fullsized":"2024-09-10T05:37:53.729520+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:51:10.736802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"30'23","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.715019+0000","last_change":"2024-09-10T05:36:17.630853+0000","last_active":"2024-09-10T05:37:53.715019+0000","last_peered":"2024-09-10T05:37:53.715019+0000","last_clean":"2024-09-10T05:37:53.715019+0000","last_became_active":"2024-09-10T05:36:17.626936+0000","last_became_peered":"2024-09-10T05:36:17.626936+0000","last_unstale":"2024-09-10T05:37:53.715019+0000","last_undegraded":"2024-09-10T05:37:53.715019+0000","last_fullsized":"2024-09-10T05:37:53.715019+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:27:38.243510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'282","reported_seq":391,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.551691+0000","last_change":"2024-09-10T05:36:19.665303+0000","last_active":"2024-09-10T05:39:27.551691+0000","last_peered":"2024-09-10T05:39:27.551691+0000","last_clean":"2024-09-10T05:39:27.551691+0000","last_became_active":"2024-09-10T05:36:19.664741+0000","last_became_peered":"2024-09-10T05:36:19.664741+0000","last_unstale":"2024-09-10T05:39:27.551691+0000","last_undegraded":"2024-09-10T05:39:27.551691+0000","last_fullsized":"2024-09-10T05:39:27.551691+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:34:14.254885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"34'2","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:21.797711+0000","last_change":"2024-09-10T05:36:21.657298+0000","last_active":"2024-09-10T05:38:21.797711+0000","last_peered":"2024-09-10T05:38:21.797711+0000","last_clean":"2024-09-10T05:38:21.797711+0000","last_became_active":"2024-09-10T05:36:21.656522+0000","last_became_peered":"2024-09-10T05:36:21.656522+0000","last_unstale":"2024-09-10T05:38:21.797711+0000","last_undegraded":"2024-09-10T05:38:21.797711+0000","last_fullsized":"2024-09-10T05:38:21.797711+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:46:36.764173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'8","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.883202+0000","last_change":"2024-09-10T05:36:13.623674+0000","last_active":"2024-09-10T05:39:26.883202+0000","last_peered":"2024-09-10T05:39:26.883202+0000","last_clean":"2024-09-10T05:39:26.883202+0000","last_became_active":"2024-09-10T05:36:13.622771+0000","last_became_peered":"2024-09-10T05:36:13.622771+0000","last_unstale":"2024-09-10T05:39:26.883202+0000","last_undegraded":"2024-09-10T05:39:26.883202+0000","last_fullsized":"2024-09-10T05:39:26.883202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:10.534366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"32'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.898045+0000","last_change":"2024-09-10T05:36:11.598113+0000","last_active":"2024-09-10T05:37:55.898045+0000","last_peered":"2024-09-10T05:37:55.898045+0000","last_clean":"2024-09-10T05:37:55.898045+0000","last_became_active":"2024-09-10T05:36:11.596165+0000","last_became_peered":"2024-09-10T05:36:11.596165+0000","last_unstale":"2024-09-10T05:37:55.898045+0000","last_undegraded":"2024-09-10T05:37:55.898045+0000","last_fullsized":"2024-09-10T05:37:55.898045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:34.424848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.905564+0000","last_change":"2024-09-10T05:36:15.616568+0000","last_active":"2024-09-10T05:37:55.905564+0000","last_peered":"2024-09-10T05:37:55.905564+0000","last_clean":"2024-09-10T05:37:55.905564+0000","last_became_active":"2024-09-10T05:36:15.615994+0000","last_became_peered":"2024-09-10T05:36:15.615994+0000","last_unstale":"2024-09-10T05:37:55.905564+0000","last_undegraded":"2024-09-10T05:37:55.905564+0000","last_fullsized":"2024-09-10T05:37:55.905564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:15:00.093895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"34'36","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.012568+0000","last_change":"2024-09-10T05:36:17.631891+0000","last_active":"2024-09-10T05:38:24.012568+0000","last_peered":"2024-09-10T05:38:24.012568+0000","last_clean":"2024-09-10T05:38:24.012568+0000","last_became_active":"2024-09-10T05:36:17.631054+0000","last_became_peered":"2024-09-10T05:36:17.631054+0000","last_unstale":"2024-09-10T05:38:24.012568+0000","last_undegraded":"2024-09-10T05:38:24.012568+0000","last_fullsized":"2024-09-10T05:38:24.012568+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:59.553249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"34'284","reported_seq":409,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.368908+0000","last_change":"2024-09-10T05:36:19.671507+0000","last_active":"2024-09-10T05:39:58.368908+0000","last_peered":"2024-09-10T05:39:58.368908+0000","last_clean":"2024-09-10T05:39:58.368908+0000","last_became_active":"2024-09-10T05:36:19.670915+0000","last_became_peered":"2024-09-10T05:36:19.670915+0000","last_unstale":"2024-09-10T05:39:58.368908+0000","last_undegraded":"2024-09-10T05:39:58.368908+0000","last_fullsized":"2024-09-10T05:39:58.368908+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:35.175677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"34'8","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.859732+0000","last_change":"2024-09-10T05:36:13.598359+0000","last_active":"2024-09-10T05:39:26.859732+0000","last_peered":"2024-09-10T05:39:26.859732+0000","last_clean":"2024-09-10T05:39:26.859732+0000","last_became_active":"2024-09-10T05:36:13.597477+0000","last_became_peered":"2024-09-10T05:36:13.597477+0000","last_unstale":"2024-09-10T05:39:26.859732+0000","last_undegraded":"2024-09-10T05:39:26.859732+0000","last_fullsized":"2024-09-10T05:39:26.859732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:33.752285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.899248+0000","last_change":"2024-09-10T05:36:11.601343+0000","last_active":"2024-09-10T05:37:55.899248+0000","last_peered":"2024-09-10T05:37:55.899248+0000","last_clean":"2024-09-10T05:37:55.899248+0000","last_became_active":"2024-09-10T05:36:11.600405+0000","last_became_peered":"2024-09-10T05:36:11.600405+0000","last_unstale":"2024-09-10T05:37:55.899248+0000","last_undegraded":"2024-09-10T05:37:55.899248+0000","last_fullsized":"2024-09-10T05:37:55.899248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:06:53.012489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.857307+0000","last_change":"2024-09-10T05:36:15.624083+0000","last_active":"2024-09-10T05:37:53.857307+0000","last_peered":"2024-09-10T05:37:53.857307+0000","last_clean":"2024-09-10T05:37:53.857307+0000","last_became_active":"2024-09-10T05:36:15.620908+0000","last_became_peered":"2024-09-10T05:36:15.620908+0000","last_unstale":"2024-09-10T05:37:53.857307+0000","last_undegraded":"2024-09-10T05:37:53.857307+0000","last_fullsized":"2024-09-10T05:37:53.857307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:18:19.390635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'47","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.031891+0000","last_change":"2024-09-10T05:36:52.763550+0000","last_active":"2024-09-10T05:38:24.031891+0000","last_peered":"2024-09-10T05:38:24.031891+0000","last_clean":"2024-09-10T05:38:24.031891+0000","last_became_active":"2024-09-10T05:36:52.710284+0000","last_became_peered":"2024-09-10T05:36:52.710284+0000","last_unstale":"2024-09-10T05:38:24.031891+0000","last_undegraded":"2024-09-10T05:38:24.031891+0000","last_fullsized":"2024-09-10T05:38:24.031891+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:08.202725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.853131+0000","last_change":"2024-09-10T05:36:19.641236+0000","last_active":"2024-09-10T05:37:53.853131+0000","last_peered":"2024-09-10T05:37:53.853131+0000","last_clean":"2024-09-10T05:37:53.853131+0000","last_became_active":"2024-09-10T05:36:19.640470+0000","last_became_peered":"2024-09-10T05:36:19.640470+0000","last_unstale":"2024-09-10T05:37:53.853131+0000","last_undegraded":"2024-09-10T05:37:53.853131+0000","last_fullsized":"2024-09-10T05:37:53.853131+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:38.686660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"32'3","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.715202+0000","last_change":"2024-09-10T05:36:21.665615+0000","last_active":"2024-09-10T05:37:53.715202+0000","last_peered":"2024-09-10T05:37:53.715202+0000","last_clean":"2024-09-10T05:37:53.715202+0000","last_became_active":"2024-09-10T05:36:21.664232+0000","last_became_peered":"2024-09-10T05:36:21.664232+0000","last_unstale":"2024-09-10T05:37:53.715202+0000","last_undegraded":"2024-09-10T05:37:53.715202+0000","last_fullsized":"2024-09-10T05:37:53.715202+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:22:54.635544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'2","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.296681+0000","last_change":"2024-09-10T05:36:52.704557+0000","last_active":"2024-09-10T05:39:27.296681+0000","last_peered":"2024-09-10T05:39:27.296681+0000","last_clean":"2024-09-10T05:39:27.296681+0000","last_became_active":"2024-09-10T05:36:52.703743+0000","last_became_peered":"2024-09-10T05:36:52.703743+0000","last_unstale":"2024-09-10T05:39:27.296681+0000","last_undegraded":"2024-09-10T05:39:27.296681+0000","last_fullsized":"2024-09-10T05:39:27.296681+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:08:22.378233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.899208+0000","last_change":"2024-09-10T05:36:11.599409+0000","last_active":"2024-09-10T05:37:55.899208+0000","last_peered":"2024-09-10T05:37:55.899208+0000","last_clean":"2024-09-10T05:37:55.899208+0000","last_became_active":"2024-09-10T05:36:11.597717+0000","last_became_peered":"2024-09-10T05:36:11.597717+0000","last_unstale":"2024-09-10T05:37:55.899208+0000","last_undegraded":"2024-09-10T05:37:55.899208+0000","last_fullsized":"2024-09-10T05:37:55.899208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:31:10.630773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.712459+0000","last_change":"2024-09-10T05:36:15.632405+0000","last_active":"2024-09-10T05:37:53.712459+0000","last_peered":"2024-09-10T05:37:53.712459+0000","last_clean":"2024-09-10T05:37:53.712459+0000","last_became_active":"2024-09-10T05:36:15.631635+0000","last_became_peered":"2024-09-10T05:36:15.631635+0000","last_unstale":"2024-09-10T05:37:53.712459+0000","last_undegraded":"2024-09-10T05:37:53.712459+0000","last_fullsized":"2024-09-10T05:37:53.712459+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:17:58.666673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"34'39","reported_seq":96,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.638757+0000","last_change":"2024-09-10T05:36:17.638936+0000","last_active":"2024-09-10T05:39:58.638757+0000","last_peered":"2024-09-10T05:39:58.638757+0000","last_clean":"2024-09-10T05:39:58.638757+0000","last_became_active":"2024-09-10T05:36:17.638301+0000","last_became_peered":"2024-09-10T05:36:17.638301+0000","last_unstale":"2024-09-10T05:39:58.638757+0000","last_undegraded":"2024-09-10T05:39:58.638757+0000","last_fullsized":"2024-09-10T05:39:58.638757+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:17.394424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.725401+0000","last_change":"2024-09-10T05:36:19.671665+0000","last_active":"2024-09-10T05:37:53.725401+0000","last_peered":"2024-09-10T05:37:53.725401+0000","last_clean":"2024-09-10T05:37:53.725401+0000","last_became_active":"2024-09-10T05:36:19.671022+0000","last_became_peered":"2024-09-10T05:36:19.671022+0000","last_unstale":"2024-09-10T05:37:53.725401+0000","last_undegraded":"2024-09-10T05:37:53.725401+0000","last_fullsized":"2024-09-10T05:37:53.725401+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:52:58.839879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"32'3","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.854472+0000","last_change":"2024-09-10T05:36:21.667571+0000","last_active":"2024-09-10T05:37:53.854472+0000","last_peered":"2024-09-10T05:37:53.854472+0000","last_clean":"2024-09-10T05:37:53.854472+0000","last_became_active":"2024-09-10T05:36:21.666042+0000","last_became_peered":"2024-09-10T05:36:21.666042+0000","last_unstale":"2024-09-10T05:37:53.854472+0000","last_undegraded":"2024-09-10T05:37:53.854472+0000","last_fullsized":"2024-09-10T05:37:53.854472+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:39.262665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'13","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.222570+0000","last_change":"2024-09-10T05:36:52.713178+0000","last_active":"2024-09-10T05:39:27.222570+0000","last_peered":"2024-09-10T05:39:27.222570+0000","last_clean":"2024-09-10T05:39:27.222570+0000","last_became_active":"2024-09-10T05:36:52.696116+0000","last_became_peered":"2024-09-10T05:36:52.696116+0000","last_unstale":"2024-09-10T05:39:27.222570+0000","last_undegraded":"2024-09-10T05:39:27.222570+0000","last_fullsized":"2024-09-10T05:39:27.222570+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:19:34.691310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.897741+0000","last_change":"2024-09-10T05:36:11.607638+0000","last_active":"2024-09-10T05:37:55.897741+0000","last_peered":"2024-09-10T05:37:55.897741+0000","last_clean":"2024-09-10T05:37:55.897741+0000","last_became_active":"2024-09-10T05:36:11.606576+0000","last_became_peered":"2024-09-10T05:36:11.606576+0000","last_unstale":"2024-09-10T05:37:55.897741+0000","last_undegraded":"2024-09-10T05:37:55.897741+0000","last_fullsized":"2024-09-10T05:37:55.897741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:18:24.850629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.712965+0000","last_change":"2024-09-10T05:36:15.618352+0000","last_active":"2024-09-10T05:37:53.712965+0000","last_peered":"2024-09-10T05:37:53.712965+0000","last_clean":"2024-09-10T05:37:53.712965+0000","last_became_active":"2024-09-10T05:36:15.617647+0000","last_became_peered":"2024-09-10T05:36:15.617647+0000","last_unstale":"2024-09-10T05:37:53.712965+0000","last_undegraded":"2024-09-10T05:37:53.712965+0000","last_fullsized":"2024-09-10T05:37:53.712965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:04:41.335062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"34'49","reported_seq":111,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.035913+0000","last_change":"2024-09-10T05:36:17.636835+0000","last_active":"2024-09-10T05:38:24.035913+0000","last_peered":"2024-09-10T05:38:24.035913+0000","last_clean":"2024-09-10T05:38:24.035913+0000","last_became_active":"2024-09-10T05:36:17.636000+0000","last_became_peered":"2024-09-10T05:36:17.636000+0000","last_unstale":"2024-09-10T05:38:24.035913+0000","last_undegraded":"2024-09-10T05:38:24.035913+0000","last_fullsized":"2024-09-10T05:38:24.035913+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:10:22.233813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"34'282","reported_seq":354,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.565613+0000","last_change":"2024-09-10T05:36:19.664630+0000","last_active":"2024-09-10T05:39:27.565613+0000","last_peered":"2024-09-10T05:39:27.565613+0000","last_clean":"2024-09-10T05:39:27.565613+0000","last_became_active":"2024-09-10T05:36:19.663950+0000","last_became_peered":"2024-09-10T05:36:19.663950+0000","last_unstale":"2024-09-10T05:39:27.565613+0000","last_undegraded":"2024-09-10T05:39:27.565613+0000","last_fullsized":"2024-09-10T05:39:27.565613+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:53.165826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"32'2","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.854389+0000","last_change":"2024-09-10T05:36:21.691277+0000","last_active":"2024-09-10T05:37:53.854389+0000","last_peered":"2024-09-10T05:37:53.854389+0000","last_clean":"2024-09-10T05:37:53.854389+0000","last_became_active":"2024-09-10T05:36:21.690772+0000","last_became_peered":"2024-09-10T05:36:21.690772+0000","last_unstale":"2024-09-10T05:37:53.854389+0000","last_undegraded":"2024-09-10T05:37:53.854389+0000","last_fullsized":"2024-09-10T05:37:53.854389+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:17:39.487372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"34'6","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.364489+0000","last_change":"2024-09-10T05:36:13.612369+0000","last_active":"2024-09-10T05:39:27.364489+0000","last_peered":"2024-09-10T05:39:27.364489+0000","last_clean":"2024-09-10T05:39:27.364489+0000","last_became_active":"2024-09-10T05:36:13.611694+0000","last_became_peered":"2024-09-10T05:36:13.611694+0000","last_unstale":"2024-09-10T05:39:27.364489+0000","last_undegraded":"2024-09-10T05:39:27.364489+0000","last_fullsized":"2024-09-10T05:39:27.364489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:25.411949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.897408+0000","last_change":"2024-09-10T05:36:11.607748+0000","last_active":"2024-09-10T05:37:55.897408+0000","last_peered":"2024-09-10T05:37:55.897408+0000","last_clean":"2024-09-10T05:37:55.897408+0000","last_became_active":"2024-09-10T05:36:11.606957+0000","last_became_peered":"2024-09-10T05:36:11.606957+0000","last_unstale":"2024-09-10T05:37:55.897408+0000","last_undegraded":"2024-09-10T05:37:55.897408+0000","last_fullsized":"2024-09-10T05:37:55.897408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:51:30.178935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.712437+0000","last_change":"2024-09-10T05:36:15.632297+0000","last_active":"2024-09-10T05:37:53.712437+0000","last_peered":"2024-09-10T05:37:53.712437+0000","last_clean":"2024-09-10T05:37:53.712437+0000","last_became_active":"2024-09-10T05:36:15.631551+0000","last_became_peered":"2024-09-10T05:36:15.631551+0000","last_unstale":"2024-09-10T05:37:53.712437+0000","last_undegraded":"2024-09-10T05:37:53.712437+0000","last_fullsized":"2024-09-10T05:37:53.712437+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:38:35.217361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"34'72","reported_seq":153,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.668223+0000","last_change":"2024-09-10T05:36:17.651071+0000","last_active":"2024-09-10T05:39:58.668223+0000","last_peered":"2024-09-10T05:39:58.668223+0000","last_clean":"2024-09-10T05:39:58.668223+0000","last_became_active":"2024-09-10T05:36:17.650601+0000","last_became_peered":"2024-09-10T05:36:17.650601+0000","last_unstale":"2024-09-10T05:39:58.668223+0000","last_undegraded":"2024-09-10T05:39:58.668223+0000","last_fullsized":"2024-09-10T05:39:58.668223+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:33:18.024305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.712799+0000","last_change":"2024-09-10T05:36:19.638840+0000","last_active":"2024-09-10T05:37:53.712799+0000","last_peered":"2024-09-10T05:37:53.712799+0000","last_clean":"2024-09-10T05:37:53.712799+0000","last_became_active":"2024-09-10T05:36:19.638087+0000","last_became_peered":"2024-09-10T05:36:19.638087+0000","last_unstale":"2024-09-10T05:37:53.712799+0000","last_undegraded":"2024-09-10T05:37:53.712799+0000","last_fullsized":"2024-09-10T05:37:53.712799+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:43:13.922357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"34'18","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.525874+0000","last_change":"2024-09-10T05:36:21.681112+0000","last_active":"2024-09-10T05:39:27.525874+0000","last_peered":"2024-09-10T05:39:27.525874+0000","last_clean":"2024-09-10T05:39:27.525874+0000","last_became_active":"2024-09-10T05:36:21.680246+0000","last_became_peered":"2024-09-10T05:36:21.680246+0000","last_unstale":"2024-09-10T05:39:27.525874+0000","last_undegraded":"2024-09-10T05:39:27.525874+0000","last_fullsized":"2024-09-10T05:39:27.525874+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:41.764675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"34'5","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:07.690351+0000","last_change":"2024-09-10T05:36:52.725901+0000","last_active":"2024-09-10T05:39:07.690351+0000","last_peered":"2024-09-10T05:39:07.690351+0000","last_clean":"2024-09-10T05:39:07.690351+0000","last_became_active":"2024-09-10T05:36:52.702912+0000","last_became_peered":"2024-09-10T05:36:52.702912+0000","last_unstale":"2024-09-10T05:39:07.690351+0000","last_undegraded":"2024-09-10T05:39:07.690351+0000","last_fullsized":"2024-09-10T05:39:07.690351+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:30:22.591725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.165811+0000","last_change":"2024-09-10T05:36:11.608535+0000","last_active":"2024-09-10T05:39:27.165811+0000","last_peered":"2024-09-10T05:39:27.165811+0000","last_clean":"2024-09-10T05:39:27.165811+0000","last_became_active":"2024-09-10T05:36:11.606930+0000","last_became_peered":"2024-09-10T05:36:11.606930+0000","last_unstale":"2024-09-10T05:39:27.165811+0000","last_undegraded":"2024-09-10T05:39:27.165811+0000","last_fullsized":"2024-09-10T05:39:27.165811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:23:14.287549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.714198+0000","last_change":"2024-09-10T05:36:15.617401+0000","last_active":"2024-09-10T05:37:53.714198+0000","last_peered":"2024-09-10T05:37:53.714198+0000","last_clean":"2024-09-10T05:37:53.714198+0000","last_became_active":"2024-09-10T05:36:15.616975+0000","last_became_peered":"2024-09-10T05:36:15.616975+0000","last_unstale":"2024-09-10T05:37:53.714198+0000","last_undegraded":"2024-09-10T05:37:53.714198+0000","last_fullsized":"2024-09-10T05:37:53.714198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:18:28.491327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'42","reported_seq":96,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:32.690954+0000","last_change":"2024-09-10T05:36:17.651377+0000","last_active":"2024-09-10T05:38:32.690954+0000","last_peered":"2024-09-10T05:38:32.690954+0000","last_clean":"2024-09-10T05:38:32.690954+0000","last_became_active":"2024-09-10T05:36:17.650522+0000","last_became_peered":"2024-09-10T05:36:17.650522+0000","last_unstale":"2024-09-10T05:38:32.690954+0000","last_undegraded":"2024-09-10T05:38:32.690954+0000","last_fullsized":"2024-09-10T05:38:32.690954+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:31:03.454940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.728744+0000","last_change":"2024-09-10T05:36:19.664052+0000","last_active":"2024-09-10T05:37:53.728744+0000","last_peered":"2024-09-10T05:37:53.728744+0000","last_clean":"2024-09-10T05:37:53.728744+0000","last_became_active":"2024-09-10T05:36:19.663287+0000","last_became_peered":"2024-09-10T05:36:19.663287+0000","last_unstale":"2024-09-10T05:37:53.728744+0000","last_undegraded":"2024-09-10T05:37:53.728744+0000","last_fullsized":"2024-09-10T05:37:53.728744+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:39.277013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'5","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.028076+0000","last_change":"2024-09-10T05:36:21.664412+0000","last_active":"2024-09-10T05:39:27.028076+0000","last_peered":"2024-09-10T05:39:27.028076+0000","last_clean":"2024-09-10T05:39:27.028076+0000","last_became_active":"2024-09-10T05:36:21.663661+0000","last_became_peered":"2024-09-10T05:36:21.663661+0000","last_unstale":"2024-09-10T05:39:27.028076+0000","last_undegraded":"2024-09-10T05:39:27.028076+0000","last_fullsized":"2024-09-10T05:39:27.028076+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:53.553843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'5","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.024835+0000","last_change":"2024-09-10T05:36:13.631202+0000","last_active":"2024-09-10T05:39:27.024835+0000","last_peered":"2024-09-10T05:39:27.024835+0000","last_clean":"2024-09-10T05:39:27.024835+0000","last_became_active":"2024-09-10T05:36:13.630386+0000","last_became_peered":"2024-09-10T05:36:13.630386+0000","last_unstale":"2024-09-10T05:39:27.024835+0000","last_undegraded":"2024-09-10T05:39:27.024835+0000","last_fullsized":"2024-09-10T05:39:27.024835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:36.024873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.897689+0000","last_change":"2024-09-10T05:36:11.598765+0000","last_active":"2024-09-10T05:37:55.897689+0000","last_peered":"2024-09-10T05:37:55.897689+0000","last_clean":"2024-09-10T05:37:55.897689+0000","last_became_active":"2024-09-10T05:36:11.597935+0000","last_became_peered":"2024-09-10T05:36:11.597935+0000","last_unstale":"2024-09-10T05:37:55.897689+0000","last_undegraded":"2024-09-10T05:37:55.897689+0000","last_fullsized":"2024-09-10T05:37:55.897689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:06:01.704380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.853934+0000","last_change":"2024-09-10T05:36:15.619918+0000","last_active":"2024-09-10T05:37:53.853934+0000","last_peered":"2024-09-10T05:37:53.853934+0000","last_clean":"2024-09-10T05:37:53.853934+0000","last_became_active":"2024-09-10T05:36:15.619388+0000","last_became_peered":"2024-09-10T05:36:15.619388+0000","last_unstale":"2024-09-10T05:37:53.853934+0000","last_undegraded":"2024-09-10T05:37:53.853934+0000","last_fullsized":"2024-09-10T05:37:53.853934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:26.033372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"34'36","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.051975+0000","last_change":"2024-09-10T05:36:17.638791+0000","last_active":"2024-09-10T05:38:24.051975+0000","last_peered":"2024-09-10T05:38:24.051975+0000","last_clean":"2024-09-10T05:38:24.051975+0000","last_became_active":"2024-09-10T05:36:17.636568+0000","last_became_peered":"2024-09-10T05:36:17.636568+0000","last_unstale":"2024-09-10T05:38:24.051975+0000","last_undegraded":"2024-09-10T05:38:24.051975+0000","last_fullsized":"2024-09-10T05:38:24.051975+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:58.268199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'282","reported_seq":409,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.536932+0000","last_change":"2024-09-10T05:36:19.667395+0000","last_active":"2024-09-10T05:39:27.536932+0000","last_peered":"2024-09-10T05:39:27.536932+0000","last_clean":"2024-09-10T05:39:27.536932+0000","last_became_active":"2024-09-10T05:36:19.666610+0000","last_became_peered":"2024-09-10T05:36:19.666610+0000","last_unstale":"2024-09-10T05:39:27.536932+0000","last_undegraded":"2024-09-10T05:39:27.536932+0000","last_fullsized":"2024-09-10T05:39:27.536932+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:22:18.017142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'12","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:27.686883+0000","last_change":"2024-09-10T05:36:21.669588+0000","last_active":"2024-09-10T05:38:27.686883+0000","last_peered":"2024-09-10T05:38:27.686883+0000","last_clean":"2024-09-10T05:38:27.686883+0000","last_became_active":"2024-09-10T05:36:21.668641+0000","last_became_peered":"2024-09-10T05:36:21.668641+0000","last_unstale":"2024-09-10T05:38:27.686883+0000","last_undegraded":"2024-09-10T05:38:27.686883+0000","last_fullsized":"2024-09-10T05:38:27.686883+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:59.764142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"34'7","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:27.681562+0000","last_change":"2024-09-10T05:36:13.609927+0000","last_active":"2024-09-10T05:38:27.681562+0000","last_peered":"2024-09-10T05:38:27.681562+0000","last_clean":"2024-09-10T05:38:27.681562+0000","last_became_active":"2024-09-10T05:36:13.605112+0000","last_became_peered":"2024-09-10T05:36:13.605112+0000","last_unstale":"2024-09-10T05:38:27.681562+0000","last_undegraded":"2024-09-10T05:38:27.681562+0000","last_fullsized":"2024-09-10T05:38:27.681562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:54:32.975492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.722448+0000","last_change":"2024-09-10T05:36:11.606136+0000","last_active":"2024-09-10T05:37:53.722448+0000","last_peered":"2024-09-10T05:37:53.722448+0000","last_clean":"2024-09-10T05:37:53.722448+0000","last_became_active":"2024-09-10T05:36:11.600833+0000","last_became_peered":"2024-09-10T05:36:11.600833+0000","last_unstale":"2024-09-10T05:37:53.722448+0000","last_undegraded":"2024-09-10T05:37:53.722448+0000","last_fullsized":"2024-09-10T05:37:53.722448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:30:30.034878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'3","reported_seq":418,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:25.599083+0000","last_change":"2024-09-10T05:36:15.636516+0000","last_active":"2024-09-10T05:38:25.599083+0000","last_peered":"2024-09-10T05:38:25.599083+0000","last_clean":"2024-09-10T05:38:25.599083+0000","last_became_active":"2024-09-10T05:36:15.635670+0000","last_became_peered":"2024-09-10T05:36:15.635670+0000","last_unstale":"2024-09-10T05:38:25.599083+0000","last_undegraded":"2024-09-10T05:38:25.599083+0000","last_fullsized":"2024-09-10T05:38:25.599083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:38:23.956906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.726176+0000","last_change":"2024-09-10T05:36:17.639202+0000","last_active":"2024-09-10T05:37:53.726176+0000","last_peered":"2024-09-10T05:37:53.726176+0000","last_clean":"2024-09-10T05:37:53.726176+0000","last_became_active":"2024-09-10T05:36:17.633215+0000","last_became_peered":"2024-09-10T05:36:17.633215+0000","last_unstale":"2024-09-10T05:37:53.726176+0000","last_undegraded":"2024-09-10T05:37:53.726176+0000","last_fullsized":"2024-09-10T05:37:53.726176+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:47:38.759892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'282","reported_seq":471,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.479089+0000","last_change":"2024-09-10T05:36:19.650595+0000","last_active":"2024-09-10T05:39:27.479089+0000","last_peered":"2024-09-10T05:39:27.479089+0000","last_clean":"2024-09-10T05:39:27.479089+0000","last_became_active":"2024-09-10T05:36:19.649781+0000","last_became_peered":"2024-09-10T05:36:19.649781+0000","last_unstale":"2024-09-10T05:39:27.479089+0000","last_undegraded":"2024-09-10T05:39:27.479089+0000","last_fullsized":"2024-09-10T05:39:27.479089+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:13:23.575638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:25.756309+0000","last_change":"2024-09-10T05:36:21.665015+0000","last_active":"2024-09-10T05:38:25.756309+0000","last_peered":"2024-09-10T05:38:25.756309+0000","last_clean":"2024-09-10T05:38:25.756309+0000","last_became_active":"2024-09-10T05:36:21.664283+0000","last_became_peered":"2024-09-10T05:36:21.664283+0000","last_unstale":"2024-09-10T05:38:25.756309+0000","last_undegraded":"2024-09-10T05:38:25.756309+0000","last_fullsized":"2024-09-10T05:38:25.756309+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:35:48.390527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'4","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.363782+0000","last_change":"2024-09-10T05:37:53.730744+0000","last_active":"2024-09-10T05:39:27.363782+0000","last_peered":"2024-09-10T05:39:27.363782+0000","last_clean":"2024-09-10T05:39:27.363782+0000","last_became_active":"2024-09-10T05:37:53.724668+0000","last_became_peered":"2024-09-10T05:37:53.724668+0000","last_unstale":"2024-09-10T05:39:27.363782+0000","last_undegraded":"2024-09-10T05:39:27.363782+0000","last_fullsized":"2024-09-10T05:39:27.363782+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:32.648839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.676279+0000","last_change":"2024-09-10T05:36:11.598666+0000","last_active":"2024-09-10T05:39:26.676279+0000","last_peered":"2024-09-10T05:39:26.676279+0000","last_clean":"2024-09-10T05:39:26.676279+0000","last_became_active":"2024-09-10T05:36:11.598213+0000","last_became_peered":"2024-09-10T05:36:11.598213+0000","last_unstale":"2024-09-10T05:39:26.676279+0000","last_undegraded":"2024-09-10T05:39:26.676279+0000","last_fullsized":"2024-09-10T05:39:26.676279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:54.224630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.729250+0000","last_change":"2024-09-10T05:36:15.622429+0000","last_active":"2024-09-10T05:37:53.729250+0000","last_peered":"2024-09-10T05:37:53.729250+0000","last_clean":"2024-09-10T05:37:53.729250+0000","last_became_active":"2024-09-10T05:36:15.621697+0000","last_became_peered":"2024-09-10T05:36:15.621697+0000","last_unstale":"2024-09-10T05:37:53.729250+0000","last_undegraded":"2024-09-10T05:37:53.729250+0000","last_fullsized":"2024-09-10T05:37:53.729250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:13:04.950511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'38","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.025920+0000","last_change":"2024-09-10T05:36:17.648212+0000","last_active":"2024-09-10T05:38:24.025920+0000","last_peered":"2024-09-10T05:38:24.025920+0000","last_clean":"2024-09-10T05:38:24.025920+0000","last_became_active":"2024-09-10T05:36:17.647533+0000","last_became_peered":"2024-09-10T05:36:17.647533+0000","last_unstale":"2024-09-10T05:38:24.025920+0000","last_undegraded":"2024-09-10T05:38:24.025920+0000","last_fullsized":"2024-09-10T05:38:24.025920+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:49:23.646157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.896760+0000","last_change":"2024-09-10T05:36:19.641688+0000","last_active":"2024-09-10T05:37:55.896760+0000","last_peered":"2024-09-10T05:37:55.896760+0000","last_clean":"2024-09-10T05:37:55.896760+0000","last_became_active":"2024-09-10T05:36:19.640885+0000","last_became_peered":"2024-09-10T05:36:19.640885+0000","last_unstale":"2024-09-10T05:37:55.896760+0000","last_undegraded":"2024-09-10T05:37:55.896760+0000","last_fullsized":"2024-09-10T05:37:55.896760+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:07.106507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"34'8","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.434518+0000","last_change":"2024-09-10T05:36:21.665178+0000","last_active":"2024-09-10T05:39:27.434518+0000","last_peered":"2024-09-10T05:39:27.434518+0000","last_clean":"2024-09-10T05:39:27.434518+0000","last_became_active":"2024-09-10T05:36:21.664454+0000","last_became_peered":"2024-09-10T05:36:21.664454+0000","last_unstale":"2024-09-10T05:39:27.434518+0000","last_undegraded":"2024-09-10T05:39:27.434518+0000","last_fullsized":"2024-09-10T05:39:27.434518+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:10:47.751838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'6","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.005232+0000","last_change":"2024-09-10T05:36:13.605825+0000","last_active":"2024-09-10T05:39:27.005232+0000","last_peered":"2024-09-10T05:39:27.005232+0000","last_clean":"2024-09-10T05:39:27.005232+0000","last_became_active":"2024-09-10T05:36:13.605318+0000","last_became_peered":"2024-09-10T05:36:13.605318+0000","last_unstale":"2024-09-10T05:39:27.005232+0000","last_undegraded":"2024-09-10T05:39:27.005232+0000","last_fullsized":"2024-09-10T05:39:27.005232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:18:36.672577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'72","reported_seq":146,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.852563+0000","last_change":"2024-09-10T05:35:59.488460+0000","last_active":"2024-09-10T05:37:53.852563+0000","last_peered":"2024-09-10T05:37:53.852563+0000","last_clean":"2024-09-10T05:37:53.852563+0000","last_became_active":"2024-09-10T05:35:59.486077+0000","last_became_peered":"2024-09-10T05:35:59.486077+0000","last_unstale":"2024-09-10T05:37:53.852563+0000","last_undegraded":"2024-09-10T05:37:53.852563+0000","last_fullsized":"2024-09-10T05:37:53.852563+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:35:57.655557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:35:57.655557+0000","last_clean_scrub_stamp":"2024-09-10T05:35:57.655557+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:41:07.276856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.897409+0000","last_change":"2024-09-10T05:36:05.711729+0000","last_active":"2024-09-10T05:37:55.897409+0000","last_peered":"2024-09-10T05:37:55.897409+0000","last_clean":"2024-09-10T05:37:55.897409+0000","last_became_active":"2024-09-10T05:36:03.710352+0000","last_became_peered":"2024-09-10T05:36:03.710352+0000","last_unstale":"2024-09-10T05:37:55.897409+0000","last_undegraded":"2024-09-10T05:37:55.897409+0000","last_fullsized":"2024-09-10T05:37:55.897409+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_clean_scrub_stamp":"2024-09-10T05:36:02.684661+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:03:30.592449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002047461,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.596937+0000","last_change":"2024-09-10T05:36:11.606900+0000","last_active":"2024-09-10T05:39:26.596937+0000","last_peered":"2024-09-10T05:39:26.596937+0000","last_clean":"2024-09-10T05:39:26.596937+0000","last_became_active":"2024-09-10T05:36:11.604178+0000","last_became_peered":"2024-09-10T05:36:11.604178+0000","last_unstale":"2024-09-10T05:39:26.596937+0000","last_undegraded":"2024-09-10T05:39:26.596937+0000","last_fullsized":"2024-09-10T05:39:26.596937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:53:24.406596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.854195+0000","last_change":"2024-09-10T05:36:15.624270+0000","last_active":"2024-09-10T05:37:53.854195+0000","last_peered":"2024-09-10T05:37:53.854195+0000","last_clean":"2024-09-10T05:37:53.854195+0000","last_became_active":"2024-09-10T05:36:15.623637+0000","last_became_peered":"2024-09-10T05:36:15.623637+0000","last_unstale":"2024-09-10T05:37:53.854195+0000","last_undegraded":"2024-09-10T05:37:53.854195+0000","last_fullsized":"2024-09-10T05:37:53.854195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:37:16.145975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'83","reported_seq":163,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.049037+0000","last_change":"2024-09-10T05:36:17.637408+0000","last_active":"2024-09-10T05:38:24.049037+0000","last_peered":"2024-09-10T05:38:24.049037+0000","last_clean":"2024-09-10T05:38:24.049037+0000","last_became_active":"2024-09-10T05:36:17.636543+0000","last_became_peered":"2024-09-10T05:36:17.636543+0000","last_unstale":"2024-09-10T05:38:24.049037+0000","last_undegraded":"2024-09-10T05:38:24.049037+0000","last_fullsized":"2024-09-10T05:38:24.049037+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:15:25.918278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.728409+0000","last_change":"2024-09-10T05:36:19.664203+0000","last_active":"2024-09-10T05:37:53.728409+0000","last_peered":"2024-09-10T05:37:53.728409+0000","last_clean":"2024-09-10T05:37:53.728409+0000","last_became_active":"2024-09-10T05:36:19.663584+0000","last_became_peered":"2024-09-10T05:36:19.663584+0000","last_unstale":"2024-09-10T05:37:53.728409+0000","last_undegraded":"2024-09-10T05:37:53.728409+0000","last_fullsized":"2024-09-10T05:37:53.728409+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:33.708215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"34'82","reported_seq":168,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.391356+0000","last_change":"2024-09-10T05:36:21.664939+0000","last_active":"2024-09-10T05:39:27.391356+0000","last_peered":"2024-09-10T05:39:27.391356+0000","last_clean":"2024-09-10T05:39:27.391356+0000","last_became_active":"2024-09-10T05:36:21.664075+0000","last_became_peered":"2024-09-10T05:36:21.664075+0000","last_unstale":"2024-09-10T05:39:27.391356+0000","last_undegraded":"2024-09-10T05:39:27.391356+0000","last_fullsized":"2024-09-10T05:39:27.391356+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:13:56.435337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":223,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"30'2","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.729039+0000","last_change":"2024-09-10T05:36:13.617433+0000","last_active":"2024-09-10T05:37:53.729039+0000","last_peered":"2024-09-10T05:37:53.729039+0000","last_clean":"2024-09-10T05:37:53.729039+0000","last_became_active":"2024-09-10T05:36:13.616766+0000","last_became_peered":"2024-09-10T05:36:13.616766+0000","last_unstale":"2024-09-10T05:37:53.729039+0000","last_undegraded":"2024-09-10T05:37:53.729039+0000","last_fullsized":"2024-09-10T05:37:53.729039+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:08:29.778211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.896383+0000","last_change":"2024-09-10T05:36:05.710898+0000","last_active":"2024-09-10T05:37:55.896383+0000","last_peered":"2024-09-10T05:37:55.896383+0000","last_clean":"2024-09-10T05:37:55.896383+0000","last_became_active":"2024-09-10T05:36:03.706256+0000","last_became_peered":"2024-09-10T05:36:03.706256+0000","last_unstale":"2024-09-10T05:37:55.896383+0000","last_undegraded":"2024-09-10T05:37:55.896383+0000","last_fullsized":"2024-09-10T05:37:55.896383+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_clean_scrub_stamp":"2024-09-10T05:36:02.684661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:42:18.313806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001383542,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.856705+0000","last_change":"2024-09-10T05:36:11.591881+0000","last_active":"2024-09-10T05:37:53.856705+0000","last_peered":"2024-09-10T05:37:53.856705+0000","last_clean":"2024-09-10T05:37:53.856705+0000","last_became_active":"2024-09-10T05:36:11.591339+0000","last_became_peered":"2024-09-10T05:36:11.591339+0000","last_unstale":"2024-09-10T05:37:53.856705+0000","last_undegraded":"2024-09-10T05:37:53.856705+0000","last_fullsized":"2024-09-10T05:37:53.856705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:21:35.347921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.906123+0000","last_change":"2024-09-10T05:36:52.705367+0000","last_active":"2024-09-10T05:37:55.906123+0000","last_peered":"2024-09-10T05:37:55.906123+0000","last_clean":"2024-09-10T05:37:55.906123+0000","last_became_active":"2024-09-10T05:36:52.704490+0000","last_became_peered":"2024-09-10T05:36:52.704490+0000","last_unstale":"2024-09-10T05:37:55.906123+0000","last_undegraded":"2024-09-10T05:37:55.906123+0000","last_fullsized":"2024-09-10T05:37:55.906123+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:44:28.080659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"34'280","reported_seq":495,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:25.874900+0000","last_change":"2024-09-10T05:36:17.640102+0000","last_active":"2024-09-10T05:39:25.874900+0000","last_peered":"2024-09-10T05:39:25.874900+0000","last_clean":"2024-09-10T05:39:25.874900+0000","last_became_active":"2024-09-10T05:36:17.637623+0000","last_became_peered":"2024-09-10T05:36:17.637623+0000","last_unstale":"2024-09-10T05:39:25.874900+0000","last_undegraded":"2024-09-10T05:39:25.874900+0000","last_fullsized":"2024-09-10T05:39:25.874900+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:47:34.520585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":366,"num_read_kb":350,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.725860+0000","last_change":"2024-09-10T05:36:19.673384+0000","last_active":"2024-09-10T05:37:53.725860+0000","last_peered":"2024-09-10T05:37:53.725860+0000","last_clean":"2024-09-10T05:37:53.725860+0000","last_became_active":"2024-09-10T05:36:19.672554+0000","last_became_peered":"2024-09-10T05:36:19.672554+0000","last_unstale":"2024-09-10T05:37:53.725860+0000","last_undegraded":"2024-09-10T05:37:53.725860+0000","last_fullsized":"2024-09-10T05:37:53.725860+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:09.659188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'5","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.856766+0000","last_change":"2024-09-10T05:36:21.662079+0000","last_active":"2024-09-10T05:37:53.856766+0000","last_peered":"2024-09-10T05:37:53.856766+0000","last_clean":"2024-09-10T05:37:53.856766+0000","last_became_active":"2024-09-10T05:36:21.661347+0000","last_became_peered":"2024-09-10T05:36:21.661347+0000","last_unstale":"2024-09-10T05:37:53.856766+0000","last_undegraded":"2024-09-10T05:37:53.856766+0000","last_fullsized":"2024-09-10T05:37:53.856766+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:23.555775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'6","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.364285+0000","last_change":"2024-09-10T05:36:13.626334+0000","last_active":"2024-09-10T05:39:27.364285+0000","last_peered":"2024-09-10T05:39:27.364285+0000","last_clean":"2024-09-10T05:39:27.364285+0000","last_became_active":"2024-09-10T05:36:13.621451+0000","last_became_peered":"2024-09-10T05:36:13.621451+0000","last_unstale":"2024-09-10T05:39:27.364285+0000","last_undegraded":"2024-09-10T05:39:27.364285+0000","last_fullsized":"2024-09-10T05:39:27.364285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:29:14.676606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.713298+0000","last_change":"2024-09-10T05:36:06.203202+0000","last_active":"2024-09-10T05:37:53.713298+0000","last_peered":"2024-09-10T05:37:53.713298+0000","last_clean":"2024-09-10T05:37:53.713298+0000","last_became_active":"2024-09-10T05:36:03.707045+0000","last_became_peered":"2024-09-10T05:36:03.707045+0000","last_unstale":"2024-09-10T05:37:53.713298+0000","last_undegraded":"2024-09-10T05:37:53.713298+0000","last_fullsized":"2024-09-10T05:37:53.713298+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_clean_scrub_stamp":"2024-09-10T05:36:02.684661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:47:09.787526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093121299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:21.782377+0000","last_change":"2024-09-10T05:36:11.595624+0000","last_active":"2024-09-10T05:38:21.782377+0000","last_peered":"2024-09-10T05:38:21.782377+0000","last_clean":"2024-09-10T05:38:21.782377+0000","last_became_active":"2024-09-10T05:36:11.594432+0000","last_became_peered":"2024-09-10T05:36:11.594432+0000","last_unstale":"2024-09-10T05:38:21.782377+0000","last_undegraded":"2024-09-10T05:38:21.782377+0000","last_fullsized":"2024-09-10T05:38:21.782377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:25:27.078667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.716765+0000","last_change":"2024-09-10T05:36:15.620736+0000","last_active":"2024-09-10T05:37:53.716765+0000","last_peered":"2024-09-10T05:37:53.716765+0000","last_clean":"2024-09-10T05:37:53.716765+0000","last_became_active":"2024-09-10T05:36:15.620043+0000","last_became_peered":"2024-09-10T05:36:15.620043+0000","last_unstale":"2024-09-10T05:37:53.716765+0000","last_undegraded":"2024-09-10T05:37:53.716765+0000","last_fullsized":"2024-09-10T05:37:53.716765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:34.666759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'17","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.227823+0000","last_change":"2024-09-10T05:36:17.637187+0000","last_active":"2024-09-10T05:39:27.227823+0000","last_peered":"2024-09-10T05:39:27.227823+0000","last_clean":"2024-09-10T05:39:27.227823+0000","last_became_active":"2024-09-10T05:36:17.636381+0000","last_became_peered":"2024-09-10T05:36:17.636381+0000","last_unstale":"2024-09-10T05:39:27.227823+0000","last_undegraded":"2024-09-10T05:39:27.227823+0000","last_fullsized":"2024-09-10T05:39:27.227823+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:55:19.261582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.854702+0000","last_change":"2024-09-10T05:36:19.666298+0000","last_active":"2024-09-10T05:37:53.854702+0000","last_peered":"2024-09-10T05:37:53.854702+0000","last_clean":"2024-09-10T05:37:53.854702+0000","last_became_active":"2024-09-10T05:36:19.664396+0000","last_became_peered":"2024-09-10T05:36:19.664396+0000","last_unstale":"2024-09-10T05:37:53.854702+0000","last_undegraded":"2024-09-10T05:37:53.854702+0000","last_fullsized":"2024-09-10T05:37:53.854702+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:27:46.613544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.725249+0000","last_change":"2024-09-10T05:36:21.675746+0000","last_active":"2024-09-10T05:37:53.725249+0000","last_peered":"2024-09-10T05:37:53.725249+0000","last_clean":"2024-09-10T05:37:53.725249+0000","last_became_active":"2024-09-10T05:36:21.674984+0000","last_became_peered":"2024-09-10T05:36:21.674984+0000","last_unstale":"2024-09-10T05:37:53.725249+0000","last_undegraded":"2024-09-10T05:37:53.725249+0000","last_fullsized":"2024-09-10T05:37:53.725249+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:13.261758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'3","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:21.803367+0000","last_change":"2024-09-10T05:36:13.627345+0000","last_active":"2024-09-10T05:38:21.803367+0000","last_peered":"2024-09-10T05:38:21.803367+0000","last_clean":"2024-09-10T05:38:21.803367+0000","last_became_active":"2024-09-10T05:36:13.626654+0000","last_became_peered":"2024-09-10T05:36:13.626654+0000","last_unstale":"2024-09-10T05:38:21.803367+0000","last_undegraded":"2024-09-10T05:38:21.803367+0000","last_fullsized":"2024-09-10T05:38:21.803367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:41:27.351374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.897831+0000","last_change":"2024-09-10T05:36:05.710910+0000","last_active":"2024-09-10T05:37:55.897831+0000","last_peered":"2024-09-10T05:37:55.897831+0000","last_clean":"2024-09-10T05:37:55.897831+0000","last_became_active":"2024-09-10T05:36:03.708495+0000","last_became_peered":"2024-09-10T05:36:03.708495+0000","last_unstale":"2024-09-10T05:37:55.897831+0000","last_undegraded":"2024-09-10T05:37:55.897831+0000","last_fullsized":"2024-09-10T05:37:55.897831+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_clean_scrub_stamp":"2024-09-10T05:36:02.684661+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:51.729077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012525469999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.897736+0000","last_change":"2024-09-10T05:36:11.602156+0000","last_active":"2024-09-10T05:37:55.897736+0000","last_peered":"2024-09-10T05:37:55.897736+0000","last_clean":"2024-09-10T05:37:55.897736+0000","last_became_active":"2024-09-10T05:36:11.601414+0000","last_became_peered":"2024-09-10T05:36:11.601414+0000","last_unstale":"2024-09-10T05:37:55.897736+0000","last_undegraded":"2024-09-10T05:37:55.897736+0000","last_fullsized":"2024-09-10T05:37:55.897736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:42:50.298063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.856412+0000","last_change":"2024-09-10T05:36:15.619942+0000","last_active":"2024-09-10T05:37:53.856412+0000","last_peered":"2024-09-10T05:37:53.856412+0000","last_clean":"2024-09-10T05:37:53.856412+0000","last_became_active":"2024-09-10T05:36:15.619505+0000","last_became_peered":"2024-09-10T05:36:15.619505+0000","last_unstale":"2024-09-10T05:37:53.856412+0000","last_undegraded":"2024-09-10T05:37:53.856412+0000","last_fullsized":"2024-09-10T05:37:53.856412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:14:30.972656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"33'13","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.217385+0000","last_change":"2024-09-10T05:36:17.638373+0000","last_active":"2024-09-10T05:39:26.217385+0000","last_peered":"2024-09-10T05:39:26.217385+0000","last_clean":"2024-09-10T05:39:26.217385+0000","last_became_active":"2024-09-10T05:36:17.637551+0000","last_became_peered":"2024-09-10T05:36:17.637551+0000","last_unstale":"2024-09-10T05:39:26.217385+0000","last_undegraded":"2024-09-10T05:39:26.217385+0000","last_fullsized":"2024-09-10T05:39:26.217385+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:56:29.072774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.728759+0000","last_change":"2024-09-10T05:36:19.670810+0000","last_active":"2024-09-10T05:37:53.728759+0000","last_peered":"2024-09-10T05:37:53.728759+0000","last_clean":"2024-09-10T05:37:53.728759+0000","last_became_active":"2024-09-10T05:36:19.669130+0000","last_became_peered":"2024-09-10T05:36:19.669130+0000","last_unstale":"2024-09-10T05:37:53.728759+0000","last_undegraded":"2024-09-10T05:37:53.728759+0000","last_fullsized":"2024-09-10T05:37:53.728759+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:50:25.186904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'6","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:25.732480+0000","last_change":"2024-09-10T05:36:21.672078+0000","last_active":"2024-09-10T05:38:25.732480+0000","last_peered":"2024-09-10T05:38:25.732480+0000","last_clean":"2024-09-10T05:38:25.732480+0000","last_became_active":"2024-09-10T05:36:21.671206+0000","last_became_peered":"2024-09-10T05:36:21.671206+0000","last_unstale":"2024-09-10T05:38:25.732480+0000","last_undegraded":"2024-09-10T05:38:25.732480+0000","last_fullsized":"2024-09-10T05:38:25.732480+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:44:48.926007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'4","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:21.790850+0000","last_change":"2024-09-10T05:36:13.611873+0000","last_active":"2024-09-10T05:38:21.790850+0000","last_peered":"2024-09-10T05:38:21.790850+0000","last_clean":"2024-09-10T05:38:21.790850+0000","last_became_active":"2024-09-10T05:36:13.611242+0000","last_became_peered":"2024-09-10T05:36:13.611242+0000","last_unstale":"2024-09-10T05:38:21.790850+0000","last_undegraded":"2024-09-10T05:38:21.790850+0000","last_fullsized":"2024-09-10T05:38:21.790850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:54:18.272234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'1","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:17.687049+0000","last_change":"2024-09-10T05:36:11.605555+0000","last_active":"2024-09-10T05:38:17.687049+0000","last_peered":"2024-09-10T05:38:17.687049+0000","last_clean":"2024-09-10T05:38:17.687049+0000","last_became_active":"2024-09-10T05:36:11.604802+0000","last_became_peered":"2024-09-10T05:36:11.604802+0000","last_unstale":"2024-09-10T05:38:17.687049+0000","last_undegraded":"2024-09-10T05:38:17.687049+0000","last_fullsized":"2024-09-10T05:38:17.687049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:31.026061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.854446+0000","last_change":"2024-09-10T05:36:05.716234+0000","last_active":"2024-09-10T05:37:53.854446+0000","last_peered":"2024-09-10T05:37:53.854446+0000","last_clean":"2024-09-10T05:37:53.854446+0000","last_became_active":"2024-09-10T05:36:03.705338+0000","last_became_peered":"2024-09-10T05:36:03.705338+0000","last_unstale":"2024-09-10T05:37:53.854446+0000","last_undegraded":"2024-09-10T05:37:53.854446+0000","last_fullsized":"2024-09-10T05:37:53.854446+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_clean_scrub_stamp":"2024-09-10T05:36:02.684661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:59.676796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010885789999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:22.680314+0000","last_change":"2024-09-10T05:36:15.618592+0000","last_active":"2024-09-10T05:38:22.680314+0000","last_peered":"2024-09-10T05:38:22.680314+0000","last_clean":"2024-09-10T05:38:22.680314+0000","last_became_active":"2024-09-10T05:36:15.618041+0000","last_became_peered":"2024-09-10T05:36:15.618041+0000","last_unstale":"2024-09-10T05:38:22.680314+0000","last_undegraded":"2024-09-10T05:38:22.680314+0000","last_fullsized":"2024-09-10T05:38:22.680314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:44.697723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"34'74","reported_seq":150,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.738721+0000","last_change":"2024-09-10T05:36:17.654376+0000","last_active":"2024-09-10T05:39:26.738721+0000","last_peered":"2024-09-10T05:39:26.738721+0000","last_clean":"2024-09-10T05:39:26.738721+0000","last_became_active":"2024-09-10T05:36:17.653627+0000","last_became_peered":"2024-09-10T05:36:17.653627+0000","last_unstale":"2024-09-10T05:39:26.738721+0000","last_undegraded":"2024-09-10T05:39:26.738721+0000","last_fullsized":"2024-09-10T05:39:26.738721+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:43:52.608114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5916,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":79,"num_read_kb":65,"num_write":40,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.896388+0000","last_change":"2024-09-10T05:36:19.650800+0000","last_active":"2024-09-10T05:37:55.896388+0000","last_peered":"2024-09-10T05:37:55.896388+0000","last_clean":"2024-09-10T05:37:55.896388+0000","last_became_active":"2024-09-10T05:36:19.650115+0000","last_became_peered":"2024-09-10T05:36:19.650115+0000","last_unstale":"2024-09-10T05:37:55.896388+0000","last_undegraded":"2024-09-10T05:37:55.896388+0000","last_fullsized":"2024-09-10T05:37:55.896388+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:27:32.687339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"34'9","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:26.048065+0000","last_change":"2024-09-10T05:36:21.689033+0000","last_active":"2024-09-10T05:38:26.048065+0000","last_peered":"2024-09-10T05:38:26.048065+0000","last_clean":"2024-09-10T05:38:26.048065+0000","last_became_active":"2024-09-10T05:36:21.687744+0000","last_became_peered":"2024-09-10T05:36:21.687744+0000","last_unstale":"2024-09-10T05:38:26.048065+0000","last_undegraded":"2024-09-10T05:38:26.048065+0000","last_fullsized":"2024-09-10T05:38:26.048065+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:05:42.167772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"32'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.853863+0000","last_change":"2024-09-10T05:36:13.618496+0000","last_active":"2024-09-10T05:37:53.853863+0000","last_peered":"2024-09-10T05:37:53.853863+0000","last_clean":"2024-09-10T05:37:53.853863+0000","last_became_active":"2024-09-10T05:36:13.617814+0000","last_became_peered":"2024-09-10T05:36:13.617814+0000","last_unstale":"2024-09-10T05:37:53.853863+0000","last_undegraded":"2024-09-10T05:37:53.853863+0000","last_fullsized":"2024-09-10T05:37:53.853863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:45.951433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.855803+0000","last_change":"2024-09-10T05:36:11.596607+0000","last_active":"2024-09-10T05:37:53.855803+0000","last_peered":"2024-09-10T05:37:53.855803+0000","last_clean":"2024-09-10T05:37:53.855803+0000","last_became_active":"2024-09-10T05:36:11.595349+0000","last_became_peered":"2024-09-10T05:36:11.595349+0000","last_unstale":"2024-09-10T05:37:53.855803+0000","last_undegraded":"2024-09-10T05:37:53.855803+0000","last_fullsized":"2024-09-10T05:37:53.855803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:26:47.764082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.898073+0000","last_change":"2024-09-10T05:36:05.712138+0000","last_active":"2024-09-10T05:37:55.898073+0000","last_peered":"2024-09-10T05:37:55.898073+0000","last_clean":"2024-09-10T05:37:55.898073+0000","last_became_active":"2024-09-10T05:36:03.709534+0000","last_became_peered":"2024-09-10T05:36:03.709534+0000","last_unstale":"2024-09-10T05:37:55.898073+0000","last_undegraded":"2024-09-10T05:37:55.898073+0000","last_fullsized":"2024-09-10T05:37:55.898073+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_clean_scrub_stamp":"2024-09-10T05:36:02.684661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:58:56.347286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022338829999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.901170+0000","last_change":"2024-09-10T05:36:15.619244+0000","last_active":"2024-09-10T05:37:55.901170+0000","last_peered":"2024-09-10T05:37:55.901170+0000","last_clean":"2024-09-10T05:37:55.901170+0000","last_became_active":"2024-09-10T05:36:15.618491+0000","last_became_peered":"2024-09-10T05:36:15.618491+0000","last_unstale":"2024-09-10T05:37:55.901170+0000","last_undegraded":"2024-09-10T05:37:55.901170+0000","last_fullsized":"2024-09-10T05:37:55.901170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:43:50.594184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"30'20","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.856948+0000","last_change":"2024-09-10T05:36:17.658105+0000","last_active":"2024-09-10T05:37:53.856948+0000","last_peered":"2024-09-10T05:37:53.856948+0000","last_clean":"2024-09-10T05:37:53.856948+0000","last_became_active":"2024-09-10T05:36:17.657112+0000","last_became_peered":"2024-09-10T05:36:17.657112+0000","last_unstale":"2024-09-10T05:37:53.856948+0000","last_undegraded":"2024-09-10T05:37:53.856948+0000","last_fullsized":"2024-09-10T05:37:53.856948+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:40.438888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'282","reported_seq":361,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:25.874874+0000","last_change":"2024-09-10T05:36:19.649214+0000","last_active":"2024-09-10T05:39:25.874874+0000","last_peered":"2024-09-10T05:39:25.874874+0000","last_clean":"2024-09-10T05:39:25.874874+0000","last_became_active":"2024-09-10T05:36:19.643319+0000","last_became_peered":"2024-09-10T05:36:19.643319+0000","last_unstale":"2024-09-10T05:39:25.874874+0000","last_undegraded":"2024-09-10T05:39:25.874874+0000","last_fullsized":"2024-09-10T05:39:25.874874+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:07:40.515326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"30'2","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.729162+0000","last_change":"2024-09-10T05:36:21.692062+0000","last_active":"2024-09-10T05:37:53.729162+0000","last_peered":"2024-09-10T05:37:53.729162+0000","last_clean":"2024-09-10T05:37:53.729162+0000","last_became_active":"2024-09-10T05:36:21.691590+0000","last_became_peered":"2024-09-10T05:36:21.691590+0000","last_unstale":"2024-09-10T05:37:53.729162+0000","last_undegraded":"2024-09-10T05:37:53.729162+0000","last_fullsized":"2024-09-10T05:37:53.729162+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:43:35.691961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'6","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.295258+0000","last_change":"2024-09-10T05:36:13.607662+0000","last_active":"2024-09-10T05:39:27.295258+0000","last_peered":"2024-09-10T05:39:27.295258+0000","last_clean":"2024-09-10T05:39:27.295258+0000","last_became_active":"2024-09-10T05:36:13.607367+0000","last_became_peered":"2024-09-10T05:36:13.607367+0000","last_unstale":"2024-09-10T05:39:27.295258+0000","last_undegraded":"2024-09-10T05:39:27.295258+0000","last_fullsized":"2024-09-10T05:39:27.295258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:45.424290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:26.122156+0000","last_change":"2024-09-10T05:36:11.608356+0000","last_active":"2024-09-10T05:38:26.122156+0000","last_peered":"2024-09-10T05:38:26.122156+0000","last_clean":"2024-09-10T05:38:26.122156+0000","last_became_active":"2024-09-10T05:36:11.606234+0000","last_became_peered":"2024-09-10T05:36:11.606234+0000","last_unstale":"2024-09-10T05:38:26.122156+0000","last_undegraded":"2024-09-10T05:38:26.122156+0000","last_fullsized":"2024-09-10T05:38:26.122156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:03.114192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.854826+0000","last_change":"2024-09-10T05:36:05.716475+0000","last_active":"2024-09-10T05:37:53.854826+0000","last_peered":"2024-09-10T05:37:53.854826+0000","last_clean":"2024-09-10T05:37:53.854826+0000","last_became_active":"2024-09-10T05:36:03.705038+0000","last_became_peered":"2024-09-10T05:36:03.705038+0000","last_unstale":"2024-09-10T05:37:53.854826+0000","last_undegraded":"2024-09-10T05:37:53.854826+0000","last_fullsized":"2024-09-10T05:37:53.854826+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_clean_scrub_stamp":"2024-09-10T05:36:02.684661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:33:56.689163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00126935,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.901115+0000","last_change":"2024-09-10T05:36:15.618499+0000","last_active":"2024-09-10T05:37:55.901115+0000","last_peered":"2024-09-10T05:37:55.901115+0000","last_clean":"2024-09-10T05:37:55.901115+0000","last_became_active":"2024-09-10T05:36:15.617690+0000","last_became_peered":"2024-09-10T05:36:15.617690+0000","last_unstale":"2024-09-10T05:37:55.901115+0000","last_undegraded":"2024-09-10T05:37:55.901115+0000","last_fullsized":"2024-09-10T05:37:55.901115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:44.575577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"30'16","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.724231+0000","last_change":"2024-09-10T05:36:17.635256+0000","last_active":"2024-09-10T05:37:53.724231+0000","last_peered":"2024-09-10T05:37:53.724231+0000","last_clean":"2024-09-10T05:37:53.724231+0000","last_became_active":"2024-09-10T05:36:17.634261+0000","last_became_peered":"2024-09-10T05:36:17.634261+0000","last_unstale":"2024-09-10T05:37:53.724231+0000","last_undegraded":"2024-09-10T05:37:53.724231+0000","last_fullsized":"2024-09-10T05:37:53.724231+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:56:40.871070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'284","reported_seq":437,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.366924+0000","last_change":"2024-09-10T05:36:19.673204+0000","last_active":"2024-09-10T05:39:58.366924+0000","last_peered":"2024-09-10T05:39:58.366924+0000","last_clean":"2024-09-10T05:39:58.366924+0000","last_became_active":"2024-09-10T05:36:19.672586+0000","last_became_peered":"2024-09-10T05:36:19.672586+0000","last_unstale":"2024-09-10T05:39:58.366924+0000","last_undegraded":"2024-09-10T05:39:58.366924+0000","last_fullsized":"2024-09-10T05:39:58.366924+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:18:32.110473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.853637+0000","last_change":"2024-09-10T05:36:21.670112+0000","last_active":"2024-09-10T05:37:53.853637+0000","last_peered":"2024-09-10T05:37:53.853637+0000","last_clean":"2024-09-10T05:37:53.853637+0000","last_became_active":"2024-09-10T05:36:21.668909+0000","last_became_peered":"2024-09-10T05:36:21.668909+0000","last_unstale":"2024-09-10T05:37:53.853637+0000","last_undegraded":"2024-09-10T05:37:53.853637+0000","last_fullsized":"2024-09-10T05:37:53.853637+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:37:35.984330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'14","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.201146+0000","last_change":"2024-09-10T05:36:13.622291+0000","last_active":"2024-09-10T05:39:27.201146+0000","last_peered":"2024-09-10T05:39:27.201146+0000","last_clean":"2024-09-10T05:39:27.201146+0000","last_became_active":"2024-09-10T05:36:13.621703+0000","last_became_peered":"2024-09-10T05:36:13.621703+0000","last_unstale":"2024-09-10T05:39:27.201146+0000","last_undegraded":"2024-09-10T05:39:27.201146+0000","last_fullsized":"2024-09-10T05:39:27.201146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:40:52.344660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.855830+0000","last_change":"2024-09-10T05:36:11.594329+0000","last_active":"2024-09-10T05:37:53.855830+0000","last_peered":"2024-09-10T05:37:53.855830+0000","last_clean":"2024-09-10T05:37:53.855830+0000","last_became_active":"2024-09-10T05:36:11.594029+0000","last_became_peered":"2024-09-10T05:36:11.594029+0000","last_unstale":"2024-09-10T05:37:53.855830+0000","last_undegraded":"2024-09-10T05:37:53.855830+0000","last_fullsized":"2024-09-10T05:37:53.855830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:10:40.202152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.899337+0000","last_change":"2024-09-10T05:36:05.711580+0000","last_active":"2024-09-10T05:37:55.899337+0000","last_peered":"2024-09-10T05:37:55.899337+0000","last_clean":"2024-09-10T05:37:55.899337+0000","last_became_active":"2024-09-10T05:36:03.708884+0000","last_became_peered":"2024-09-10T05:36:03.708884+0000","last_unstale":"2024-09-10T05:37:55.899337+0000","last_undegraded":"2024-09-10T05:37:55.899337+0000","last_fullsized":"2024-09-10T05:37:55.899337+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_clean_scrub_stamp":"2024-09-10T05:36:02.684661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:41:36.044908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018824390000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.722537+0000","last_change":"2024-09-10T05:36:15.638715+0000","last_active":"2024-09-10T05:37:53.722537+0000","last_peered":"2024-09-10T05:37:53.722537+0000","last_clean":"2024-09-10T05:37:53.722537+0000","last_became_active":"2024-09-10T05:36:15.637890+0000","last_became_peered":"2024-09-10T05:36:15.637890+0000","last_unstale":"2024-09-10T05:37:53.722537+0000","last_undegraded":"2024-09-10T05:37:53.722537+0000","last_fullsized":"2024-09-10T05:37:53.722537+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:43:41.621798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'88","reported_seq":171,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.008941+0000","last_change":"2024-09-10T05:36:17.632261+0000","last_active":"2024-09-10T05:38:24.008941+0000","last_peered":"2024-09-10T05:38:24.008941+0000","last_clean":"2024-09-10T05:38:24.008941+0000","last_became_active":"2024-09-10T05:36:17.631509+0000","last_became_peered":"2024-09-10T05:36:17.631509+0000","last_unstale":"2024-09-10T05:38:24.008941+0000","last_undegraded":"2024-09-10T05:38:24.008941+0000","last_fullsized":"2024-09-10T05:38:24.008941+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:42.713689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":84,"num_read_kb":69,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.723343+0000","last_change":"2024-09-10T05:36:19.668038+0000","last_active":"2024-09-10T05:37:53.723343+0000","last_peered":"2024-09-10T05:37:53.723343+0000","last_clean":"2024-09-10T05:37:53.723343+0000","last_became_active":"2024-09-10T05:36:19.667446+0000","last_became_peered":"2024-09-10T05:36:19.667446+0000","last_unstale":"2024-09-10T05:37:53.723343+0000","last_undegraded":"2024-09-10T05:37:53.723343+0000","last_fullsized":"2024-09-10T05:37:53.723343+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:54:25.333105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.713880+0000","last_change":"2024-09-10T05:36:21.658395+0000","last_active":"2024-09-10T05:37:53.713880+0000","last_peered":"2024-09-10T05:37:53.713880+0000","last_clean":"2024-09-10T05:37:53.713880+0000","last_became_active":"2024-09-10T05:36:21.657621+0000","last_became_peered":"2024-09-10T05:36:21.657621+0000","last_unstale":"2024-09-10T05:37:53.713880+0000","last_undegraded":"2024-09-10T05:37:53.713880+0000","last_fullsized":"2024-09-10T05:37:53.713880+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:09.853561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"32'8","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.717636+0000","last_change":"2024-09-10T05:36:21.657351+0000","last_active":"2024-09-10T05:37:53.717636+0000","last_peered":"2024-09-10T05:37:53.717636+0000","last_clean":"2024-09-10T05:37:53.717636+0000","last_became_active":"2024-09-10T05:36:21.656563+0000","last_became_peered":"2024-09-10T05:36:21.656563+0000","last_unstale":"2024-09-10T05:37:53.717636+0000","last_undegraded":"2024-09-10T05:37:53.717636+0000","last_fullsized":"2024-09-10T05:37:53.717636+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:25:08.627704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.714178+0000","last_change":"2024-09-10T05:36:13.621461+0000","last_active":"2024-09-10T05:37:53.714178+0000","last_peered":"2024-09-10T05:37:53.714178+0000","last_clean":"2024-09-10T05:37:53.714178+0000","last_became_active":"2024-09-10T05:36:13.620892+0000","last_became_peered":"2024-09-10T05:36:13.620892+0000","last_unstale":"2024-09-10T05:37:53.714178+0000","last_undegraded":"2024-09-10T05:37:53.714178+0000","last_fullsized":"2024-09-10T05:37:53.714178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:39.193639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'6","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.350902+0000","last_change":"2024-09-10T05:36:11.598055+0000","last_active":"2024-09-10T05:39:27.350902+0000","last_peered":"2024-09-10T05:39:27.350902+0000","last_clean":"2024-09-10T05:39:27.350902+0000","last_became_active":"2024-09-10T05:36:11.597209+0000","last_became_peered":"2024-09-10T05:36:11.597209+0000","last_unstale":"2024-09-10T05:39:27.350902+0000","last_undegraded":"2024-09-10T05:39:27.350902+0000","last_fullsized":"2024-09-10T05:39:27.350902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:02.735158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.858869+0000","last_change":"2024-09-10T05:36:15.617459+0000","last_active":"2024-09-10T05:37:53.858869+0000","last_peered":"2024-09-10T05:37:53.858869+0000","last_clean":"2024-09-10T05:37:53.858869+0000","last_became_active":"2024-09-10T05:36:15.617049+0000","last_became_peered":"2024-09-10T05:36:15.617049+0000","last_unstale":"2024-09-10T05:37:53.858869+0000","last_undegraded":"2024-09-10T05:37:53.858869+0000","last_fullsized":"2024-09-10T05:37:53.858869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:13:50.392282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'41","reported_seq":99,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.519835+0000","last_change":"2024-09-10T05:36:17.658656+0000","last_active":"2024-09-10T05:39:58.519835+0000","last_peered":"2024-09-10T05:39:58.519835+0000","last_clean":"2024-09-10T05:39:58.519835+0000","last_became_active":"2024-09-10T05:36:17.657669+0000","last_became_peered":"2024-09-10T05:36:17.657669+0000","last_unstale":"2024-09-10T05:39:58.519835+0000","last_undegraded":"2024-09-10T05:39:58.519835+0000","last_fullsized":"2024-09-10T05:39:58.519835+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:39.765543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.724025+0000","last_change":"2024-09-10T05:36:19.673156+0000","last_active":"2024-09-10T05:37:53.724025+0000","last_peered":"2024-09-10T05:37:53.724025+0000","last_clean":"2024-09-10T05:37:53.724025+0000","last_became_active":"2024-09-10T05:36:19.672498+0000","last_became_peered":"2024-09-10T05:36:19.672498+0000","last_unstale":"2024-09-10T05:37:53.724025+0000","last_undegraded":"2024-09-10T05:37:53.724025+0000","last_fullsized":"2024-09-10T05:37:53.724025+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:27:09.531398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'5","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:23.587545+0000","last_change":"2024-09-10T05:36:21.689435+0000","last_active":"2024-09-10T05:38:23.587545+0000","last_peered":"2024-09-10T05:38:23.587545+0000","last_clean":"2024-09-10T05:38:23.587545+0000","last_became_active":"2024-09-10T05:36:21.688864+0000","last_became_peered":"2024-09-10T05:36:21.688864+0000","last_unstale":"2024-09-10T05:38:23.587545+0000","last_undegraded":"2024-09-10T05:38:23.587545+0000","last_fullsized":"2024-09-10T05:38:23.587545+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:55:36.492043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"34'10","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.294531+0000","last_change":"2024-09-10T05:36:13.612003+0000","last_active":"2024-09-10T05:39:27.294531+0000","last_peered":"2024-09-10T05:39:27.294531+0000","last_clean":"2024-09-10T05:39:27.294531+0000","last_became_active":"2024-09-10T05:36:13.610883+0000","last_became_peered":"2024-09-10T05:36:13.610883+0000","last_unstale":"2024-09-10T05:39:27.294531+0000","last_undegraded":"2024-09-10T05:39:27.294531+0000","last_fullsized":"2024-09-10T05:39:27.294531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:29:40.273630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'1","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:37.684035+0000","last_change":"2024-09-10T05:36:11.605653+0000","last_active":"2024-09-10T05:38:37.684035+0000","last_peered":"2024-09-10T05:38:37.684035+0000","last_clean":"2024-09-10T05:38:37.684035+0000","last_became_active":"2024-09-10T05:36:11.605259+0000","last_became_peered":"2024-09-10T05:36:11.605259+0000","last_unstale":"2024-09-10T05:38:37.684035+0000","last_undegraded":"2024-09-10T05:38:37.684035+0000","last_fullsized":"2024-09-10T05:38:37.684035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:18:08.260486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.724971+0000","last_change":"2024-09-10T05:36:15.630108+0000","last_active":"2024-09-10T05:37:53.724971+0000","last_peered":"2024-09-10T05:37:53.724971+0000","last_clean":"2024-09-10T05:37:53.724971+0000","last_became_active":"2024-09-10T05:36:15.629278+0000","last_became_peered":"2024-09-10T05:36:15.629278+0000","last_unstale":"2024-09-10T05:37:53.724971+0000","last_undegraded":"2024-09-10T05:37:53.724971+0000","last_fullsized":"2024-09-10T05:37:53.724971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:14:38.879647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'6","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.226218+0000","last_change":"2024-09-10T05:36:17.652832+0000","last_active":"2024-09-10T05:39:26.226218+0000","last_peered":"2024-09-10T05:39:26.226218+0000","last_clean":"2024-09-10T05:39:26.226218+0000","last_became_active":"2024-09-10T05:36:17.648835+0000","last_became_peered":"2024-09-10T05:36:17.648835+0000","last_unstale":"2024-09-10T05:39:26.226218+0000","last_undegraded":"2024-09-10T05:39:26.226218+0000","last_fullsized":"2024-09-10T05:39:26.226218+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:46.589507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.711967+0000","last_change":"2024-09-10T05:36:19.638688+0000","last_active":"2024-09-10T05:37:53.711967+0000","last_peered":"2024-09-10T05:37:53.711967+0000","last_clean":"2024-09-10T05:37:53.711967+0000","last_became_active":"2024-09-10T05:36:19.637912+0000","last_became_peered":"2024-09-10T05:36:19.637912+0000","last_unstale":"2024-09-10T05:37:53.711967+0000","last_undegraded":"2024-09-10T05:37:53.711967+0000","last_fullsized":"2024-09-10T05:37:53.711967+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:25:54.923848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.854267+0000","last_change":"2024-09-10T05:36:21.668904+0000","last_active":"2024-09-10T05:37:53.854267+0000","last_peered":"2024-09-10T05:37:53.854267+0000","last_clean":"2024-09-10T05:37:53.854267+0000","last_became_active":"2024-09-10T05:36:21.666877+0000","last_became_peered":"2024-09-10T05:36:21.666877+0000","last_unstale":"2024-09-10T05:37:53.854267+0000","last_undegraded":"2024-09-10T05:37:53.854267+0000","last_fullsized":"2024-09-10T05:37:53.854267+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:43:13.848554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"34'4","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.856889+0000","last_change":"2024-09-10T05:36:13.598863+0000","last_active":"2024-09-10T05:39:26.856889+0000","last_peered":"2024-09-10T05:39:26.856889+0000","last_clean":"2024-09-10T05:39:26.856889+0000","last_became_active":"2024-09-10T05:36:13.597857+0000","last_became_peered":"2024-09-10T05:36:13.597857+0000","last_unstale":"2024-09-10T05:39:26.856889+0000","last_undegraded":"2024-09-10T05:39:26.856889+0000","last_fullsized":"2024-09-10T05:39:26.856889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:32:45.970120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.898820+0000","last_change":"2024-09-10T05:36:11.601417+0000","last_active":"2024-09-10T05:37:55.898820+0000","last_peered":"2024-09-10T05:37:55.898820+0000","last_clean":"2024-09-10T05:37:55.898820+0000","last_became_active":"2024-09-10T05:36:11.600603+0000","last_became_peered":"2024-09-10T05:36:11.600603+0000","last_unstale":"2024-09-10T05:37:55.898820+0000","last_undegraded":"2024-09-10T05:37:55.898820+0000","last_fullsized":"2024-09-10T05:37:55.898820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:55:12.247844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.900977+0000","last_change":"2024-09-10T05:36:15.638682+0000","last_active":"2024-09-10T05:37:55.900977+0000","last_peered":"2024-09-10T05:37:55.900977+0000","last_clean":"2024-09-10T05:37:55.900977+0000","last_became_active":"2024-09-10T05:36:15.638197+0000","last_became_peered":"2024-09-10T05:36:15.638197+0000","last_unstale":"2024-09-10T05:37:55.900977+0000","last_undegraded":"2024-09-10T05:37:55.900977+0000","last_fullsized":"2024-09-10T05:37:55.900977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:53:28.099101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"34'42","reported_seq":106,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.587641+0000","last_change":"2024-09-10T05:36:17.647135+0000","last_active":"2024-09-10T05:39:27.587641+0000","last_peered":"2024-09-10T05:39:27.587641+0000","last_clean":"2024-09-10T05:39:27.587641+0000","last_became_active":"2024-09-10T05:36:17.646459+0000","last_became_peered":"2024-09-10T05:36:17.646459+0000","last_unstale":"2024-09-10T05:39:27.587641+0000","last_undegraded":"2024-09-10T05:39:27.587641+0000","last_fullsized":"2024-09-10T05:39:27.587641+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:25:06.130753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.852746+0000","last_change":"2024-09-10T05:36:19.654869+0000","last_active":"2024-09-10T05:37:53.852746+0000","last_peered":"2024-09-10T05:37:53.852746+0000","last_clean":"2024-09-10T05:37:53.852746+0000","last_became_active":"2024-09-10T05:36:19.648608+0000","last_became_peered":"2024-09-10T05:36:19.648608+0000","last_unstale":"2024-09-10T05:37:53.852746+0000","last_undegraded":"2024-09-10T05:37:53.852746+0000","last_fullsized":"2024-09-10T05:37:53.852746+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:00.797025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.723161+0000","last_change":"2024-09-10T05:36:21.684218+0000","last_active":"2024-09-10T05:37:53.723161+0000","last_peered":"2024-09-10T05:37:53.723161+0000","last_clean":"2024-09-10T05:37:53.723161+0000","last_became_active":"2024-09-10T05:36:21.683406+0000","last_became_peered":"2024-09-10T05:36:21.683406+0000","last_unstale":"2024-09-10T05:37:53.723161+0000","last_undegraded":"2024-09-10T05:37:53.723161+0000","last_fullsized":"2024-09-10T05:37:53.723161+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:58:10.494998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'4","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.200914+0000","last_change":"2024-09-10T05:36:13.607573+0000","last_active":"2024-09-10T05:39:27.200914+0000","last_peered":"2024-09-10T05:39:27.200914+0000","last_clean":"2024-09-10T05:39:27.200914+0000","last_became_active":"2024-09-10T05:36:13.606903+0000","last_became_peered":"2024-09-10T05:36:13.606903+0000","last_unstale":"2024-09-10T05:39:27.200914+0000","last_undegraded":"2024-09-10T05:39:27.200914+0000","last_fullsized":"2024-09-10T05:39:27.200914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:36.946797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.859661+0000","last_change":"2024-09-10T05:36:11.595373+0000","last_active":"2024-09-10T05:37:53.859661+0000","last_peered":"2024-09-10T05:37:53.859661+0000","last_clean":"2024-09-10T05:37:53.859661+0000","last_became_active":"2024-09-10T05:36:11.594653+0000","last_became_peered":"2024-09-10T05:36:11.594653+0000","last_unstale":"2024-09-10T05:37:53.859661+0000","last_undegraded":"2024-09-10T05:37:53.859661+0000","last_fullsized":"2024-09-10T05:37:53.859661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:01:15.108575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"34'5","reported_seq":424,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.336436+0000","last_change":"2024-09-10T05:36:15.617558+0000","last_active":"2024-09-10T05:39:58.336436+0000","last_peered":"2024-09-10T05:39:58.336436+0000","last_clean":"2024-09-10T05:39:58.336436+0000","last_became_active":"2024-09-10T05:36:15.615147+0000","last_became_peered":"2024-09-10T05:36:15.615147+0000","last_unstale":"2024-09-10T05:39:58.336436+0000","last_undegraded":"2024-09-10T05:39:58.336436+0000","last_fullsized":"2024-09-10T05:39:58.336436+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:18:16.479290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1429,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":586,"num_read_kb":586,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'30","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.003868+0000","last_change":"2024-09-10T05:36:17.632006+0000","last_active":"2024-09-10T05:38:24.003868+0000","last_peered":"2024-09-10T05:38:24.003868+0000","last_clean":"2024-09-10T05:38:24.003868+0000","last_became_active":"2024-09-10T05:36:17.631446+0000","last_became_peered":"2024-09-10T05:36:17.631446+0000","last_unstale":"2024-09-10T05:38:24.003868+0000","last_undegraded":"2024-09-10T05:38:24.003868+0000","last_fullsized":"2024-09-10T05:38:24.003868+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:30.388651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.715083+0000","last_change":"2024-09-10T05:36:19.639207+0000","last_active":"2024-09-10T05:37:53.715083+0000","last_peered":"2024-09-10T05:37:53.715083+0000","last_clean":"2024-09-10T05:37:53.715083+0000","last_became_active":"2024-09-10T05:36:19.638240+0000","last_became_peered":"2024-09-10T05:36:19.638240+0000","last_unstale":"2024-09-10T05:37:53.715083+0000","last_undegraded":"2024-09-10T05:37:53.715083+0000","last_fullsized":"2024-09-10T05:37:53.715083+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:39:50.347393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'8","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.905694+0000","last_change":"2024-09-10T05:36:13.619194+0000","last_active":"2024-09-10T05:37:55.905694+0000","last_peered":"2024-09-10T05:37:55.905694+0000","last_clean":"2024-09-10T05:37:55.905694+0000","last_became_active":"2024-09-10T05:36:13.618656+0000","last_became_peered":"2024-09-10T05:36:13.618656+0000","last_unstale":"2024-09-10T05:37:55.905694+0000","last_undegraded":"2024-09-10T05:37:55.905694+0000","last_fullsized":"2024-09-10T05:37:55.905694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:02:21.175825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.721692+0000","last_change":"2024-09-10T05:36:11.598128+0000","last_active":"2024-09-10T05:37:53.721692+0000","last_peered":"2024-09-10T05:37:53.721692+0000","last_clean":"2024-09-10T05:37:53.721692+0000","last_became_active":"2024-09-10T05:36:11.597710+0000","last_became_peered":"2024-09-10T05:36:11.597710+0000","last_unstale":"2024-09-10T05:37:53.721692+0000","last_undegraded":"2024-09-10T05:37:53.721692+0000","last_fullsized":"2024-09-10T05:37:53.721692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:38:54.156857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.856979+0000","last_change":"2024-09-10T05:36:15.627731+0000","last_active":"2024-09-10T05:37:53.856979+0000","last_peered":"2024-09-10T05:37:53.856979+0000","last_clean":"2024-09-10T05:37:53.856979+0000","last_became_active":"2024-09-10T05:36:15.626787+0000","last_became_peered":"2024-09-10T05:36:15.626787+0000","last_unstale":"2024-09-10T05:37:53.856979+0000","last_undegraded":"2024-09-10T05:37:53.856979+0000","last_fullsized":"2024-09-10T05:37:53.856979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:46:30.721119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"34'60","reported_seq":127,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.046372+0000","last_change":"2024-09-10T05:36:17.645250+0000","last_active":"2024-09-10T05:38:24.046372+0000","last_peered":"2024-09-10T05:38:24.046372+0000","last_clean":"2024-09-10T05:38:24.046372+0000","last_became_active":"2024-09-10T05:36:17.644469+0000","last_became_peered":"2024-09-10T05:36:17.644469+0000","last_unstale":"2024-09-10T05:38:24.046372+0000","last_undegraded":"2024-09-10T05:38:24.046372+0000","last_fullsized":"2024-09-10T05:38:24.046372+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:35.181585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":58,"num_read_kb":48,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.715316+0000","last_change":"2024-09-10T05:36:19.639542+0000","last_active":"2024-09-10T05:37:53.715316+0000","last_peered":"2024-09-10T05:37:53.715316+0000","last_clean":"2024-09-10T05:37:53.715316+0000","last_became_active":"2024-09-10T05:36:19.638136+0000","last_became_peered":"2024-09-10T05:36:19.638136+0000","last_unstale":"2024-09-10T05:37:53.715316+0000","last_undegraded":"2024-09-10T05:37:53.715316+0000","last_fullsized":"2024-09-10T05:37:53.715316+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:15:07.235287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'14","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:26.038899+0000","last_change":"2024-09-10T05:36:21.682080+0000","last_active":"2024-09-10T05:38:26.038899+0000","last_peered":"2024-09-10T05:38:26.038899+0000","last_clean":"2024-09-10T05:38:26.038899+0000","last_became_active":"2024-09-10T05:36:21.681263+0000","last_became_peered":"2024-09-10T05:36:21.681263+0000","last_unstale":"2024-09-10T05:38:26.038899+0000","last_undegraded":"2024-09-10T05:38:26.038899+0000","last_fullsized":"2024-09-10T05:38:26.038899+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:35:30.867304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"34'10","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.004821+0000","last_change":"2024-09-10T05:36:13.610413+0000","last_active":"2024-09-10T05:39:27.004821+0000","last_peered":"2024-09-10T05:39:27.004821+0000","last_clean":"2024-09-10T05:39:27.004821+0000","last_became_active":"2024-09-10T05:36:13.609773+0000","last_became_peered":"2024-09-10T05:36:13.609773+0000","last_unstale":"2024-09-10T05:39:27.004821+0000","last_undegraded":"2024-09-10T05:39:27.004821+0000","last_fullsized":"2024-09-10T05:39:27.004821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:39:34.903497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.853462+0000","last_change":"2024-09-10T05:36:11.596239+0000","last_active":"2024-09-10T05:37:53.853462+0000","last_peered":"2024-09-10T05:37:53.853462+0000","last_clean":"2024-09-10T05:37:53.853462+0000","last_became_active":"2024-09-10T05:36:11.595758+0000","last_became_peered":"2024-09-10T05:36:11.595758+0000","last_unstale":"2024-09-10T05:37:53.853462+0000","last_undegraded":"2024-09-10T05:37:53.853462+0000","last_fullsized":"2024-09-10T05:37:53.853462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:59:57.154376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.906346+0000","last_change":"2024-09-10T05:36:15.614782+0000","last_active":"2024-09-10T05:37:55.906346+0000","last_peered":"2024-09-10T05:37:55.906346+0000","last_clean":"2024-09-10T05:37:55.906346+0000","last_became_active":"2024-09-10T05:36:15.613949+0000","last_became_peered":"2024-09-10T05:36:15.613949+0000","last_unstale":"2024-09-10T05:37:55.906346+0000","last_undegraded":"2024-09-10T05:37:55.906346+0000","last_fullsized":"2024-09-10T05:37:55.906346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:33.167655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"34'36","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.006452+0000","last_change":"2024-09-10T05:36:17.637253+0000","last_active":"2024-09-10T05:38:24.006452+0000","last_peered":"2024-09-10T05:38:24.006452+0000","last_clean":"2024-09-10T05:38:24.006452+0000","last_became_active":"2024-09-10T05:36:17.636067+0000","last_became_peered":"2024-09-10T05:36:17.636067+0000","last_unstale":"2024-09-10T05:38:24.006452+0000","last_undegraded":"2024-09-10T05:38:24.006452+0000","last_fullsized":"2024-09-10T05:38:24.006452+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:27:48.471606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.856515+0000","last_change":"2024-09-10T05:36:19.665827+0000","last_active":"2024-09-10T05:37:53.856515+0000","last_peered":"2024-09-10T05:37:53.856515+0000","last_clean":"2024-09-10T05:37:53.856515+0000","last_became_active":"2024-09-10T05:36:19.665010+0000","last_became_peered":"2024-09-10T05:36:19.665010+0000","last_unstale":"2024-09-10T05:37:53.856515+0000","last_undegraded":"2024-09-10T05:37:53.856515+0000","last_fullsized":"2024-09-10T05:37:53.856515+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:47:10.890181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.899872+0000","last_change":"2024-09-10T05:36:21.665684+0000","last_active":"2024-09-10T05:37:55.899872+0000","last_peered":"2024-09-10T05:37:55.899872+0000","last_clean":"2024-09-10T05:37:55.899872+0000","last_became_active":"2024-09-10T05:36:21.664884+0000","last_became_peered":"2024-09-10T05:36:21.664884+0000","last_unstale":"2024-09-10T05:37:55.899872+0000","last_undegraded":"2024-09-10T05:37:55.899872+0000","last_fullsized":"2024-09-10T05:37:55.899872+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:21:16.296649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.726940+0000","last_change":"2024-09-10T05:36:13.616705+0000","last_active":"2024-09-10T05:37:53.726940+0000","last_peered":"2024-09-10T05:37:53.726940+0000","last_clean":"2024-09-10T05:37:53.726940+0000","last_became_active":"2024-09-10T05:36:13.616392+0000","last_became_peered":"2024-09-10T05:36:13.616392+0000","last_unstale":"2024-09-10T05:37:53.726940+0000","last_undegraded":"2024-09-10T05:37:53.726940+0000","last_fullsized":"2024-09-10T05:37:53.726940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:58:42.346686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.808522+0000","last_change":"2024-09-10T05:36:11.596038+0000","last_active":"2024-09-10T05:39:26.808522+0000","last_peered":"2024-09-10T05:39:26.808522+0000","last_clean":"2024-09-10T05:39:26.808522+0000","last_became_active":"2024-09-10T05:36:11.595319+0000","last_became_peered":"2024-09-10T05:36:11.595319+0000","last_unstale":"2024-09-10T05:39:26.808522+0000","last_undegraded":"2024-09-10T05:39:26.808522+0000","last_fullsized":"2024-09-10T05:39:26.808522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:55:19.990619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.902488+0000","last_change":"2024-09-10T05:36:15.618307+0000","last_active":"2024-09-10T05:37:55.902488+0000","last_peered":"2024-09-10T05:37:55.902488+0000","last_clean":"2024-09-10T05:37:55.902488+0000","last_became_active":"2024-09-10T05:36:15.617595+0000","last_became_peered":"2024-09-10T05:36:15.617595+0000","last_unstale":"2024-09-10T05:37:55.902488+0000","last_undegraded":"2024-09-10T05:37:55.902488+0000","last_fullsized":"2024-09-10T05:37:55.902488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:38.424958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1f","version":"34'41","reported_seq":99,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.551852+0000","last_change":"2024-09-10T05:36:17.635281+0000","last_active":"2024-09-10T05:39:58.551852+0000","last_peered":"2024-09-10T05:39:58.551852+0000","last_clean":"2024-09-10T05:39:58.551852+0000","last_became_active":"2024-09-10T05:36:17.634616+0000","last_became_peered":"2024-09-10T05:36:17.634616+0000","last_unstale":"2024-09-10T05:39:58.551852+0000","last_undegraded":"2024-09-10T05:39:58.551852+0000","last_fullsized":"2024-09-10T05:39:58.551852+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:14.597186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.859042+0000","last_change":"2024-09-10T05:36:19.665974+0000","last_active":"2024-09-10T05:37:53.859042+0000","last_peered":"2024-09-10T05:37:53.859042+0000","last_clean":"2024-09-10T05:37:53.859042+0000","last_became_active":"2024-09-10T05:36:19.665236+0000","last_became_peered":"2024-09-10T05:36:19.665236+0000","last_unstale":"2024-09-10T05:37:53.859042+0000","last_undegraded":"2024-09-10T05:37:53.859042+0000","last_fullsized":"2024-09-10T05:37:53.859042+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:24.647011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"34'5","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.906432+0000","last_change":"2024-09-10T05:36:21.695106+0000","last_active":"2024-09-10T05:39:26.906432+0000","last_peered":"2024-09-10T05:39:26.906432+0000","last_clean":"2024-09-10T05:39:26.906432+0000","last_became_active":"2024-09-10T05:36:21.694522+0000","last_became_peered":"2024-09-10T05:36:21.694522+0000","last_unstale":"2024-09-10T05:39:26.906432+0000","last_undegraded":"2024-09-10T05:39:26.906432+0000","last_fullsized":"2024-09-10T05:39:26.906432+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:40.765075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.295199+0000","last_change":"2024-09-10T05:36:13.611415+0000","last_active":"2024-09-10T05:39:27.295199+0000","last_peered":"2024-09-10T05:39:27.295199+0000","last_clean":"2024-09-10T05:39:27.295199+0000","last_became_active":"2024-09-10T05:36:13.610788+0000","last_became_peered":"2024-09-10T05:36:13.610788+0000","last_unstale":"2024-09-10T05:39:27.295199+0000","last_undegraded":"2024-09-10T05:39:27.295199+0000","last_fullsized":"2024-09-10T05:39:27.295199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:04.364523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"32'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.724690+0000","last_change":"2024-09-10T05:36:11.606056+0000","last_active":"2024-09-10T05:37:53.724690+0000","last_peered":"2024-09-10T05:37:53.724690+0000","last_clean":"2024-09-10T05:37:53.724690+0000","last_became_active":"2024-09-10T05:36:11.600655+0000","last_became_peered":"2024-09-10T05:36:11.600655+0000","last_unstale":"2024-09-10T05:37:53.724690+0000","last_undegraded":"2024-09-10T05:37:53.724690+0000","last_fullsized":"2024-09-10T05:37:53.724690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:42:31.168856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.857028+0000","last_change":"2024-09-10T05:36:15.624306+0000","last_active":"2024-09-10T05:37:53.857028+0000","last_peered":"2024-09-10T05:37:53.857028+0000","last_clean":"2024-09-10T05:37:53.857028+0000","last_became_active":"2024-09-10T05:36:15.623436+0000","last_became_peered":"2024-09-10T05:36:15.623436+0000","last_unstale":"2024-09-10T05:37:53.857028+0000","last_undegraded":"2024-09-10T05:37:53.857028+0000","last_fullsized":"2024-09-10T05:37:53.857028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:35:42.347473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'16","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.729552+0000","last_change":"2024-09-10T05:36:17.639307+0000","last_active":"2024-09-10T05:37:53.729552+0000","last_peered":"2024-09-10T05:37:53.729552+0000","last_clean":"2024-09-10T05:37:53.729552+0000","last_became_active":"2024-09-10T05:36:17.638408+0000","last_became_peered":"2024-09-10T05:36:17.638408+0000","last_unstale":"2024-09-10T05:37:53.729552+0000","last_undegraded":"2024-09-10T05:37:53.729552+0000","last_fullsized":"2024-09-10T05:37:53.729552+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:30.086363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'282","reported_seq":423,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.376804+0000","last_change":"2024-09-10T05:36:19.651451+0000","last_active":"2024-09-10T05:39:27.376804+0000","last_peered":"2024-09-10T05:39:27.376804+0000","last_clean":"2024-09-10T05:39:27.376804+0000","last_became_active":"2024-09-10T05:36:19.649079+0000","last_became_peered":"2024-09-10T05:36:19.649079+0000","last_unstale":"2024-09-10T05:39:27.376804+0000","last_undegraded":"2024-09-10T05:39:27.376804+0000","last_fullsized":"2024-09-10T05:39:27.376804+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:13:31.933741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.899307+0000","last_change":"2024-09-10T05:36:21.665833+0000","last_active":"2024-09-10T05:37:55.899307+0000","last_peered":"2024-09-10T05:37:55.899307+0000","last_clean":"2024-09-10T05:37:55.899307+0000","last_became_active":"2024-09-10T05:36:21.665112+0000","last_became_peered":"2024-09-10T05:36:21.665112+0000","last_unstale":"2024-09-10T05:37:55.899307+0000","last_undegraded":"2024-09-10T05:37:55.899307+0000","last_fullsized":"2024-09-10T05:37:55.899307+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:16:25.547381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"32'8","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.714229+0000","last_change":"2024-09-10T05:36:13.620715+0000","last_active":"2024-09-10T05:37:53.714229+0000","last_peered":"2024-09-10T05:37:53.714229+0000","last_clean":"2024-09-10T05:37:53.714229+0000","last_became_active":"2024-09-10T05:36:13.614222+0000","last_became_peered":"2024-09-10T05:36:13.614222+0000","last_unstale":"2024-09-10T05:37:53.714229+0000","last_undegraded":"2024-09-10T05:37:53.714229+0000","last_fullsized":"2024-09-10T05:37:53.714229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:14:25.317688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.180964+0000","last_change":"2024-09-10T05:36:11.593230+0000","last_active":"2024-09-10T05:39:27.180964+0000","last_peered":"2024-09-10T05:39:27.180964+0000","last_clean":"2024-09-10T05:39:27.180964+0000","last_became_active":"2024-09-10T05:36:11.592805+0000","last_became_peered":"2024-09-10T05:36:11.592805+0000","last_unstale":"2024-09-10T05:39:27.180964+0000","last_undegraded":"2024-09-10T05:39:27.180964+0000","last_fullsized":"2024-09-10T05:39:27.180964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:02:54.932468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.857006+0000","last_change":"2024-09-10T05:36:15.620727+0000","last_active":"2024-09-10T05:37:53.857006+0000","last_peered":"2024-09-10T05:37:53.857006+0000","last_clean":"2024-09-10T05:37:53.857006+0000","last_became_active":"2024-09-10T05:36:15.620288+0000","last_became_peered":"2024-09-10T05:36:15.620288+0000","last_unstale":"2024-09-10T05:37:53.857006+0000","last_undegraded":"2024-09-10T05:37:53.857006+0000","last_fullsized":"2024-09-10T05:37:53.857006+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:02:23.187158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'60","reported_seq":134,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:23.987842+0000","last_change":"2024-09-10T05:36:17.651973+0000","last_active":"2024-09-10T05:38:23.987842+0000","last_peered":"2024-09-10T05:38:23.987842+0000","last_clean":"2024-09-10T05:38:23.987842+0000","last_became_active":"2024-09-10T05:36:17.651364+0000","last_became_peered":"2024-09-10T05:36:17.651364+0000","last_unstale":"2024-09-10T05:38:23.987842+0000","last_undegraded":"2024-09-10T05:38:23.987842+0000","last_fullsized":"2024-09-10T05:38:23.987842+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:42:52.172095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":74,"num_read_kb":61,"num_write":42,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.721434+0000","last_change":"2024-09-10T05:36:19.659340+0000","last_active":"2024-09-10T05:37:53.721434+0000","last_peered":"2024-09-10T05:37:53.721434+0000","last_clean":"2024-09-10T05:37:53.721434+0000","last_became_active":"2024-09-10T05:36:19.658646+0000","last_became_peered":"2024-09-10T05:36:19.658646+0000","last_unstale":"2024-09-10T05:37:53.721434+0000","last_undegraded":"2024-09-10T05:37:53.721434+0000","last_fullsized":"2024-09-10T05:37:53.721434+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:22:35.133305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"34'4","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.471685+0000","last_change":"2024-09-10T05:36:21.689581+0000","last_active":"2024-09-10T05:39:27.471685+0000","last_peered":"2024-09-10T05:39:27.471685+0000","last_clean":"2024-09-10T05:39:27.471685+0000","last_became_active":"2024-09-10T05:36:21.688695+0000","last_became_peered":"2024-09-10T05:36:21.688695+0000","last_unstale":"2024-09-10T05:39:27.471685+0000","last_undegraded":"2024-09-10T05:39:27.471685+0000","last_fullsized":"2024-09-10T05:39:27.471685+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:53.585393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"34'4","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:21.802832+0000","last_change":"2024-09-10T05:36:13.616187+0000","last_active":"2024-09-10T05:38:21.802832+0000","last_peered":"2024-09-10T05:38:21.802832+0000","last_clean":"2024-09-10T05:38:21.802832+0000","last_became_active":"2024-09-10T05:36:13.615340+0000","last_became_peered":"2024-09-10T05:36:13.615340+0000","last_unstale":"2024-09-10T05:38:21.802832+0000","last_undegraded":"2024-09-10T05:38:21.802832+0000","last_fullsized":"2024-09-10T05:38:21.802832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:35:40.336140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"30'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.897590+0000","last_change":"2024-09-10T05:36:11.598985+0000","last_active":"2024-09-10T05:37:55.897590+0000","last_peered":"2024-09-10T05:37:55.897590+0000","last_clean":"2024-09-10T05:37:55.897590+0000","last_became_active":"2024-09-10T05:36:11.597360+0000","last_became_peered":"2024-09-10T05:36:11.597360+0000","last_unstale":"2024-09-10T05:37:55.897590+0000","last_undegraded":"2024-09-10T05:37:55.897590+0000","last_fullsized":"2024-09-10T05:37:55.897590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:38:31.576663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.902188+0000","last_change":"2024-09-10T05:36:15.620708+0000","last_active":"2024-09-10T05:37:55.902188+0000","last_peered":"2024-09-10T05:37:55.902188+0000","last_clean":"2024-09-10T05:37:55.902188+0000","last_became_active":"2024-09-10T05:36:15.619849+0000","last_became_peered":"2024-09-10T05:36:15.619849+0000","last_unstale":"2024-09-10T05:37:55.902188+0000","last_undegraded":"2024-09-10T05:37:55.902188+0000","last_fullsized":"2024-09-10T05:37:55.902188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:47:32.506655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"34'37","reported_seq":90,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:23.989171+0000","last_change":"2024-09-10T05:36:17.647578+0000","last_active":"2024-09-10T05:38:23.989171+0000","last_peered":"2024-09-10T05:38:23.989171+0000","last_clean":"2024-09-10T05:38:23.989171+0000","last_became_active":"2024-09-10T05:36:17.646780+0000","last_became_peered":"2024-09-10T05:36:17.646780+0000","last_unstale":"2024-09-10T05:38:23.989171+0000","last_undegraded":"2024-09-10T05:38:23.989171+0000","last_fullsized":"2024-09-10T05:38:23.989171+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:44.392590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.896432+0000","last_change":"2024-09-10T05:36:19.652878+0000","last_active":"2024-09-10T05:37:55.896432+0000","last_peered":"2024-09-10T05:37:55.896432+0000","last_clean":"2024-09-10T05:37:55.896432+0000","last_became_active":"2024-09-10T05:36:19.652114+0000","last_became_peered":"2024-09-10T05:36:19.652114+0000","last_unstale":"2024-09-10T05:37:55.896432+0000","last_undegraded":"2024-09-10T05:37:55.896432+0000","last_fullsized":"2024-09-10T05:37:55.896432+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:46:40.081106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.16","version":"34'2","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.271654+0000","last_change":"2024-09-10T05:36:21.693139+0000","last_active":"2024-09-10T05:39:27.271654+0000","last_peered":"2024-09-10T05:39:27.271654+0000","last_clean":"2024-09-10T05:39:27.271654+0000","last_became_active":"2024-09-10T05:36:21.692564+0000","last_became_peered":"2024-09-10T05:36:21.692564+0000","last_unstale":"2024-09-10T05:39:27.271654+0000","last_undegraded":"2024-09-10T05:39:27.271654+0000","last_fullsized":"2024-09-10T05:39:27.271654+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:51.507378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'6","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:26.195675+0000","last_change":"2024-09-10T05:36:13.600568+0000","last_active":"2024-09-10T05:38:26.195675+0000","last_peered":"2024-09-10T05:38:26.195675+0000","last_clean":"2024-09-10T05:38:26.195675+0000","last_became_active":"2024-09-10T05:36:13.600225+0000","last_became_peered":"2024-09-10T05:36:13.600225+0000","last_unstale":"2024-09-10T05:38:26.195675+0000","last_undegraded":"2024-09-10T05:38:26.195675+0000","last_fullsized":"2024-09-10T05:38:26.195675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:12:34.999826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.729875+0000","last_change":"2024-09-10T05:36:11.600905+0000","last_active":"2024-09-10T05:37:53.729875+0000","last_peered":"2024-09-10T05:37:53.729875+0000","last_clean":"2024-09-10T05:37:53.729875+0000","last_became_active":"2024-09-10T05:36:11.600598+0000","last_became_peered":"2024-09-10T05:36:11.600598+0000","last_unstale":"2024-09-10T05:37:53.729875+0000","last_undegraded":"2024-09-10T05:37:53.729875+0000","last_fullsized":"2024-09-10T05:37:53.729875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:33:49.620025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.853389+0000","last_change":"2024-09-10T05:36:15.635553+0000","last_active":"2024-09-10T05:37:53.853389+0000","last_peered":"2024-09-10T05:37:53.853389+0000","last_clean":"2024-09-10T05:37:53.853389+0000","last_became_active":"2024-09-10T05:36:15.634465+0000","last_became_peered":"2024-09-10T05:36:15.634465+0000","last_unstale":"2024-09-10T05:37:53.853389+0000","last_undegraded":"2024-09-10T05:37:53.853389+0000","last_fullsized":"2024-09-10T05:37:53.853389+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:18:38.683911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'36","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.537394+0000","last_change":"2024-09-10T05:36:17.635770+0000","last_active":"2024-09-10T05:39:58.537394+0000","last_peered":"2024-09-10T05:39:58.537394+0000","last_clean":"2024-09-10T05:39:58.537394+0000","last_became_active":"2024-09-10T05:36:17.634874+0000","last_became_peered":"2024-09-10T05:36:17.634874+0000","last_unstale":"2024-09-10T05:39:58.537394+0000","last_undegraded":"2024-09-10T05:39:58.537394+0000","last_fullsized":"2024-09-10T05:39:58.537394+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:54:06.818353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.898394+0000","last_change":"2024-09-10T05:36:19.638483+0000","last_active":"2024-09-10T05:37:55.898394+0000","last_peered":"2024-09-10T05:37:55.898394+0000","last_clean":"2024-09-10T05:37:55.898394+0000","last_became_active":"2024-09-10T05:36:19.637682+0000","last_became_peered":"2024-09-10T05:36:19.637682+0000","last_unstale":"2024-09-10T05:37:55.898394+0000","last_undegraded":"2024-09-10T05:37:55.898394+0000","last_fullsized":"2024-09-10T05:37:55.898394+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:35.498813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"34'4","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.056283+0000","last_change":"2024-09-10T05:36:21.688794+0000","last_active":"2024-09-10T05:38:24.056283+0000","last_peered":"2024-09-10T05:38:24.056283+0000","last_clean":"2024-09-10T05:38:24.056283+0000","last_became_active":"2024-09-10T05:36:21.688046+0000","last_became_peered":"2024-09-10T05:36:21.688046+0000","last_unstale":"2024-09-10T05:38:24.056283+0000","last_undegraded":"2024-09-10T05:38:24.056283+0000","last_fullsized":"2024-09-10T05:38:24.056283+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:06:36.753067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.200751+0000","last_change":"2024-09-10T05:36:13.612701+0000","last_active":"2024-09-10T05:39:27.200751+0000","last_peered":"2024-09-10T05:39:27.200751+0000","last_clean":"2024-09-10T05:39:27.200751+0000","last_became_active":"2024-09-10T05:36:13.611864+0000","last_became_peered":"2024-09-10T05:36:13.611864+0000","last_unstale":"2024-09-10T05:39:27.200751+0000","last_undegraded":"2024-09-10T05:39:27.200751+0000","last_fullsized":"2024-09-10T05:39:27.200751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:07:57.487596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"32'3","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.859772+0000","last_change":"2024-09-10T05:36:11.595800+0000","last_active":"2024-09-10T05:37:53.859772+0000","last_peered":"2024-09-10T05:37:53.859772+0000","last_clean":"2024-09-10T05:37:53.859772+0000","last_became_active":"2024-09-10T05:36:11.594949+0000","last_became_peered":"2024-09-10T05:36:11.594949+0000","last_unstale":"2024-09-10T05:37:53.859772+0000","last_undegraded":"2024-09-10T05:37:53.859772+0000","last_fullsized":"2024-09-10T05:37:53.859772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:42.468342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:22.306367+0000","last_change":"2024-09-10T05:36:15.619284+0000","last_active":"2024-09-10T05:38:22.306367+0000","last_peered":"2024-09-10T05:38:22.306367+0000","last_clean":"2024-09-10T05:38:22.306367+0000","last_became_active":"2024-09-10T05:36:15.618169+0000","last_became_peered":"2024-09-10T05:36:15.618169+0000","last_unstale":"2024-09-10T05:38:22.306367+0000","last_undegraded":"2024-09-10T05:38:22.306367+0000","last_fullsized":"2024-09-10T05:38:22.306367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:22:48.592489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'47","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.260272+0000","last_change":"2024-09-10T05:36:17.631950+0000","last_active":"2024-09-10T05:39:26.260272+0000","last_peered":"2024-09-10T05:39:26.260272+0000","last_clean":"2024-09-10T05:39:26.260272+0000","last_became_active":"2024-09-10T05:36:17.631194+0000","last_became_peered":"2024-09-10T05:36:17.631194+0000","last_unstale":"2024-09-10T05:39:26.260272+0000","last_undegraded":"2024-09-10T05:39:26.260272+0000","last_fullsized":"2024-09-10T05:39:26.260272+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:53:16.893462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":67,"num_write":34,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.713950+0000","last_change":"2024-09-10T05:36:19.637266+0000","last_active":"2024-09-10T05:37:53.713950+0000","last_peered":"2024-09-10T05:37:53.713950+0000","last_clean":"2024-09-10T05:37:53.713950+0000","last_became_active":"2024-09-10T05:36:19.636483+0000","last_became_peered":"2024-09-10T05:36:19.636483+0000","last_unstale":"2024-09-10T05:37:53.713950+0000","last_undegraded":"2024-09-10T05:37:53.713950+0000","last_fullsized":"2024-09-10T05:37:53.713950+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:56:30.945572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"34'8","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.060943+0000","last_change":"2024-09-10T05:36:21.689539+0000","last_active":"2024-09-10T05:38:24.060943+0000","last_peered":"2024-09-10T05:38:24.060943+0000","last_clean":"2024-09-10T05:38:24.060943+0000","last_became_active":"2024-09-10T05:36:21.688818+0000","last_became_peered":"2024-09-10T05:36:21.688818+0000","last_unstale":"2024-09-10T05:38:24.060943+0000","last_undegraded":"2024-09-10T05:38:24.060943+0000","last_fullsized":"2024-09-10T05:38:24.060943+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:50:15.537977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":19,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"34'8","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.381517+0000","last_change":"2024-09-10T05:36:13.618862+0000","last_active":"2024-09-10T05:39:27.381517+0000","last_peered":"2024-09-10T05:39:27.381517+0000","last_clean":"2024-09-10T05:39:27.381517+0000","last_became_active":"2024-09-10T05:36:13.618260+0000","last_became_peered":"2024-09-10T05:36:13.618260+0000","last_unstale":"2024-09-10T05:39:27.381517+0000","last_undegraded":"2024-09-10T05:39:27.381517+0000","last_fullsized":"2024-09-10T05:39:27.381517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:25:48.886027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.711408+0000","last_change":"2024-09-10T05:36:11.604033+0000","last_active":"2024-09-10T05:37:53.711408+0000","last_peered":"2024-09-10T05:37:53.711408+0000","last_clean":"2024-09-10T05:37:53.711408+0000","last_became_active":"2024-09-10T05:36:11.603738+0000","last_became_peered":"2024-09-10T05:36:11.603738+0000","last_unstale":"2024-09-10T05:37:53.711408+0000","last_undegraded":"2024-09-10T05:37:53.711408+0000","last_fullsized":"2024-09-10T05:37:53.711408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:24:44.820464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'14","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.005687+0000","last_change":"2024-09-10T05:36:13.624965+0000","last_active":"2024-09-10T05:39:27.005687+0000","last_peered":"2024-09-10T05:39:27.005687+0000","last_clean":"2024-09-10T05:39:27.005687+0000","last_became_active":"2024-09-10T05:36:13.624460+0000","last_became_peered":"2024-09-10T05:36:13.624460+0000","last_unstale":"2024-09-10T05:39:27.005687+0000","last_undegraded":"2024-09-10T05:39:27.005687+0000","last_fullsized":"2024-09-10T05:39:27.005687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:05:54.096604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":58,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"34'1","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:17.679564+0000","last_change":"2024-09-10T05:36:11.602104+0000","last_active":"2024-09-10T05:38:17.679564+0000","last_peered":"2024-09-10T05:38:17.679564+0000","last_clean":"2024-09-10T05:38:17.679564+0000","last_became_active":"2024-09-10T05:36:11.601762+0000","last_became_peered":"2024-09-10T05:36:11.601762+0000","last_unstale":"2024-09-10T05:38:17.679564+0000","last_undegraded":"2024-09-10T05:38:17.679564+0000","last_fullsized":"2024-09-10T05:38:17.679564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:40:20.378957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"34'20","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.202070+0000","last_change":"2024-09-10T05:36:13.615511+0000","last_active":"2024-09-10T05:39:27.202070+0000","last_peered":"2024-09-10T05:39:27.202070+0000","last_clean":"2024-09-10T05:39:27.202070+0000","last_became_active":"2024-09-10T05:36:13.614221+0000","last_became_peered":"2024-09-10T05:36:13.614221+0000","last_unstale":"2024-09-10T05:39:27.202070+0000","last_undegraded":"2024-09-10T05:39:27.202070+0000","last_fullsized":"2024-09-10T05:39:27.202070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:22:46.581156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":66,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.723905+0000","last_change":"2024-09-10T05:36:11.606212+0000","last_active":"2024-09-10T05:37:53.723905+0000","last_peered":"2024-09-10T05:37:53.723905+0000","last_clean":"2024-09-10T05:37:53.723905+0000","last_became_active":"2024-09-10T05:36:11.601269+0000","last_became_peered":"2024-09-10T05:36:11.601269+0000","last_unstale":"2024-09-10T05:37:53.723905+0000","last_undegraded":"2024-09-10T05:37:53.723905+0000","last_fullsized":"2024-09-10T05:37:53.723905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:20.541837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'21","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.222435+0000","last_change":"2024-09-10T05:36:13.626184+0000","last_active":"2024-09-10T05:39:27.222435+0000","last_peered":"2024-09-10T05:39:27.222435+0000","last_clean":"2024-09-10T05:39:27.222435+0000","last_became_active":"2024-09-10T05:36:13.626022+0000","last_became_peered":"2024-09-10T05:36:13.626022+0000","last_unstale":"2024-09-10T05:39:27.222435+0000","last_undegraded":"2024-09-10T05:39:27.222435+0000","last_fullsized":"2024-09-10T05:39:27.222435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:53:45.495092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":48,"num_read_kb":40,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.713130+0000","last_change":"2024-09-10T05:36:11.611309+0000","last_active":"2024-09-10T05:37:53.713130+0000","last_peered":"2024-09-10T05:37:53.713130+0000","last_clean":"2024-09-10T05:37:53.713130+0000","last_became_active":"2024-09-10T05:36:11.610933+0000","last_became_peered":"2024-09-10T05:36:11.610933+0000","last_unstale":"2024-09-10T05:37:53.713130+0000","last_undegraded":"2024-09-10T05:37:53.713130+0000","last_fullsized":"2024-09-10T05:37:53.713130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:18.400915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"34'14","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.311516+0000","last_change":"2024-09-10T05:36:13.599973+0000","last_active":"2024-09-10T05:39:27.311516+0000","last_peered":"2024-09-10T05:39:27.311516+0000","last_clean":"2024-09-10T05:39:27.311516+0000","last_became_active":"2024-09-10T05:36:13.597975+0000","last_became_peered":"2024-09-10T05:36:13.597975+0000","last_unstale":"2024-09-10T05:39:27.311516+0000","last_undegraded":"2024-09-10T05:39:27.311516+0000","last_fullsized":"2024-09-10T05:39:27.311516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:04.875436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:26.066736+0000","last_change":"2024-09-10T05:36:11.603591+0000","last_active":"2024-09-10T05:38:26.066736+0000","last_peered":"2024-09-10T05:38:26.066736+0000","last_clean":"2024-09-10T05:38:26.066736+0000","last_became_active":"2024-09-10T05:36:11.603085+0000","last_became_peered":"2024-09-10T05:36:11.603085+0000","last_unstale":"2024-09-10T05:38:26.066736+0000","last_undegraded":"2024-09-10T05:38:26.066736+0000","last_fullsized":"2024-09-10T05:38:26.066736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:10:49.254963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.854228+0000","last_change":"2024-09-10T05:36:13.611510+0000","last_active":"2024-09-10T05:37:53.854228+0000","last_peered":"2024-09-10T05:37:53.854228+0000","last_clean":"2024-09-10T05:37:53.854228+0000","last_became_active":"2024-09-10T05:36:13.610894+0000","last_became_peered":"2024-09-10T05:36:13.610894+0000","last_unstale":"2024-09-10T05:37:53.854228+0000","last_undegraded":"2024-09-10T05:37:53.854228+0000","last_fullsized":"2024-09-10T05:37:53.854228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:07:55.559113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.854514+0000","last_change":"2024-09-10T05:36:11.593190+0000","last_active":"2024-09-10T05:37:53.854514+0000","last_peered":"2024-09-10T05:37:53.854514+0000","last_clean":"2024-09-10T05:37:53.854514+0000","last_became_active":"2024-09-10T05:36:11.592809+0000","last_became_peered":"2024-09-10T05:36:11.592809+0000","last_unstale":"2024-09-10T05:37:53.854514+0000","last_undegraded":"2024-09-10T05:37:53.854514+0000","last_fullsized":"2024-09-10T05:37:53.854514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:58:36.951469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:26.178147+0000","last_change":"2024-09-10T05:36:13.607562+0000","last_active":"2024-09-10T05:38:26.178147+0000","last_peered":"2024-09-10T05:38:26.178147+0000","last_clean":"2024-09-10T05:38:26.178147+0000","last_became_active":"2024-09-10T05:36:13.607052+0000","last_became_peered":"2024-09-10T05:36:13.607052+0000","last_unstale":"2024-09-10T05:38:26.178147+0000","last_undegraded":"2024-09-10T05:38:26.178147+0000","last_fullsized":"2024-09-10T05:38:26.178147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:33:32.480741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"32'2","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.715328+0000","last_change":"2024-09-10T05:36:11.594051+0000","last_active":"2024-09-10T05:37:53.715328+0000","last_peered":"2024-09-10T05:37:53.715328+0000","last_clean":"2024-09-10T05:37:53.715328+0000","last_became_active":"2024-09-10T05:36:11.593614+0000","last_became_peered":"2024-09-10T05:36:11.593614+0000","last_unstale":"2024-09-10T05:37:53.715328+0000","last_undegraded":"2024-09-10T05:37:53.715328+0000","last_fullsized":"2024-09-10T05:37:53.715328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:46:37.205574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.363940+0000","last_change":"2024-09-10T05:36:13.595278+0000","last_active":"2024-09-10T05:39:27.363940+0000","last_peered":"2024-09-10T05:39:27.363940+0000","last_clean":"2024-09-10T05:39:27.363940+0000","last_became_active":"2024-09-10T05:36:13.593693+0000","last_became_peered":"2024-09-10T05:36:13.593693+0000","last_unstale":"2024-09-10T05:39:27.363940+0000","last_undegraded":"2024-09-10T05:39:27.363940+0000","last_fullsized":"2024-09-10T05:39:27.363940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:22:11.979321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"34'8","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.727061+0000","last_change":"2024-09-10T05:36:11.606672+0000","last_active":"2024-09-10T05:39:26.727061+0000","last_peered":"2024-09-10T05:39:26.727061+0000","last_clean":"2024-09-10T05:39:26.727061+0000","last_became_active":"2024-09-10T05:36:11.604011+0000","last_became_peered":"2024-09-10T05:36:11.604011+0000","last_unstale":"2024-09-10T05:39:26.727061+0000","last_undegraded":"2024-09-10T05:39:26.727061+0000","last_fullsized":"2024-09-10T05:39:26.727061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:10:51.639983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":24,"num_write_kb":12289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"34'16","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:26.194535+0000","last_change":"2024-09-10T05:36:13.630165+0000","last_active":"2024-09-10T05:38:26.194535+0000","last_peered":"2024-09-10T05:38:26.194535+0000","last_clean":"2024-09-10T05:38:26.194535+0000","last_became_active":"2024-09-10T05:36:13.629760+0000","last_became_peered":"2024-09-10T05:36:13.629760+0000","last_unstale":"2024-09-10T05:38:26.194535+0000","last_undegraded":"2024-09-10T05:38:26.194535+0000","last_fullsized":"2024-09-10T05:38:26.194535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:59:45.392768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":66,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.721785+0000","last_change":"2024-09-10T05:36:11.597692+0000","last_active":"2024-09-10T05:37:53.721785+0000","last_peered":"2024-09-10T05:37:53.721785+0000","last_clean":"2024-09-10T05:37:53.721785+0000","last_became_active":"2024-09-10T05:36:11.597158+0000","last_became_peered":"2024-09-10T05:36:11.597158+0000","last_unstale":"2024-09-10T05:37:53.721785+0000","last_undegraded":"2024-09-10T05:37:53.721785+0000","last_fullsized":"2024-09-10T05:37:53.721785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:49.958598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.006147+0000","last_change":"2024-09-10T05:36:13.613919+0000","last_active":"2024-09-10T05:39:27.006147+0000","last_peered":"2024-09-10T05:39:27.006147+0000","last_clean":"2024-09-10T05:39:27.006147+0000","last_became_active":"2024-09-10T05:36:13.613206+0000","last_became_peered":"2024-09-10T05:36:13.613206+0000","last_unstale":"2024-09-10T05:39:27.006147+0000","last_undegraded":"2024-09-10T05:39:27.006147+0000","last_fullsized":"2024-09-10T05:39:27.006147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:20:09.645015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.854005+0000","last_change":"2024-09-10T05:36:52.706116+0000","last_active":"2024-09-10T05:37:53.854005+0000","last_peered":"2024-09-10T05:37:53.854005+0000","last_clean":"2024-09-10T05:37:53.854005+0000","last_became_active":"2024-09-10T05:36:52.705212+0000","last_became_peered":"2024-09-10T05:36:52.705212+0000","last_unstale":"2024-09-10T05:37:53.854005+0000","last_undegraded":"2024-09-10T05:37:53.854005+0000","last_fullsized":"2024-09-10T05:37:53.854005+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:27.831627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.005396+0000","last_change":"2024-09-10T05:36:13.627667+0000","last_active":"2024-09-10T05:39:27.005396+0000","last_peered":"2024-09-10T05:39:27.005396+0000","last_clean":"2024-09-10T05:39:27.005396+0000","last_became_active":"2024-09-10T05:36:13.626912+0000","last_became_peered":"2024-09-10T05:36:13.626912+0000","last_unstale":"2024-09-10T05:39:27.005396+0000","last_undegraded":"2024-09-10T05:39:27.005396+0000","last_fullsized":"2024-09-10T05:39:27.005396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:36.054213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.896918+0000","last_change":"2024-09-10T05:36:11.607179+0000","last_active":"2024-09-10T05:37:55.896918+0000","last_peered":"2024-09-10T05:37:55.896918+0000","last_clean":"2024-09-10T05:37:55.896918+0000","last_became_active":"2024-09-10T05:36:11.606369+0000","last_became_peered":"2024-09-10T05:36:11.606369+0000","last_unstale":"2024-09-10T05:37:55.896918+0000","last_undegraded":"2024-09-10T05:37:55.896918+0000","last_fullsized":"2024-09-10T05:37:55.896918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:14:23.688323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"32'8","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.858816+0000","last_change":"2024-09-10T05:36:13.608226+0000","last_active":"2024-09-10T05:37:53.858816+0000","last_peered":"2024-09-10T05:37:53.858816+0000","last_clean":"2024-09-10T05:37:53.858816+0000","last_became_active":"2024-09-10T05:36:13.607807+0000","last_became_peered":"2024-09-10T05:36:13.607807+0000","last_unstale":"2024-09-10T05:37:53.858816+0000","last_undegraded":"2024-09-10T05:37:53.858816+0000","last_fullsized":"2024-09-10T05:37:53.858816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:30:41.672233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.854315+0000","last_change":"2024-09-10T05:36:11.594296+0000","last_active":"2024-09-10T05:37:53.854315+0000","last_peered":"2024-09-10T05:37:53.854315+0000","last_clean":"2024-09-10T05:37:53.854315+0000","last_became_active":"2024-09-10T05:36:11.593962+0000","last_became_peered":"2024-09-10T05:36:11.593962+0000","last_unstale":"2024-09-10T05:37:53.854315+0000","last_undegraded":"2024-09-10T05:37:53.854315+0000","last_fullsized":"2024-09-10T05:37:53.854315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:55.429080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.902466+0000","last_change":"2024-09-10T05:36:13.615141+0000","last_active":"2024-09-10T05:37:55.902466+0000","last_peered":"2024-09-10T05:37:55.902466+0000","last_clean":"2024-09-10T05:37:55.902466+0000","last_became_active":"2024-09-10T05:36:13.614155+0000","last_became_peered":"2024-09-10T05:36:13.614155+0000","last_unstale":"2024-09-10T05:37:55.902466+0000","last_undegraded":"2024-09-10T05:37:55.902466+0000","last_fullsized":"2024-09-10T05:37:55.902466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:39:44.309572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.724975+0000","last_change":"2024-09-10T05:36:11.603262+0000","last_active":"2024-09-10T05:37:53.724975+0000","last_peered":"2024-09-10T05:37:53.724975+0000","last_clean":"2024-09-10T05:37:53.724975+0000","last_became_active":"2024-09-10T05:36:11.602866+0000","last_became_peered":"2024-09-10T05:36:11.602866+0000","last_unstale":"2024-09-10T05:37:53.724975+0000","last_undegraded":"2024-09-10T05:37:53.724975+0000","last_fullsized":"2024-09-10T05:37:53.724975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:54:03.517815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'15","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.381320+0000","last_change":"2024-09-10T05:36:13.613437+0000","last_active":"2024-09-10T05:39:27.381320+0000","last_peered":"2024-09-10T05:39:27.381320+0000","last_clean":"2024-09-10T05:39:27.381320+0000","last_became_active":"2024-09-10T05:36:13.611391+0000","last_became_peered":"2024-09-10T05:36:13.611391+0000","last_unstale":"2024-09-10T05:39:27.381320+0000","last_undegraded":"2024-09-10T05:39:27.381320+0000","last_fullsized":"2024-09-10T05:39:27.381320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:28:23.276697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.853711+0000","last_change":"2024-09-10T05:36:52.707618+0000","last_active":"2024-09-10T05:37:53.853711+0000","last_peered":"2024-09-10T05:37:53.853711+0000","last_clean":"2024-09-10T05:37:53.853711+0000","last_became_active":"2024-09-10T05:36:52.706226+0000","last_became_peered":"2024-09-10T05:36:52.706226+0000","last_unstale":"2024-09-10T05:37:53.853711+0000","last_undegraded":"2024-09-10T05:37:53.853711+0000","last_fullsized":"2024-09-10T05:37:53.853711+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:21:59.439322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"34'10","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.200918+0000","last_change":"2024-09-10T05:36:13.616625+0000","last_active":"2024-09-10T05:39:27.200918+0000","last_peered":"2024-09-10T05:39:27.200918+0000","last_clean":"2024-09-10T05:39:27.200918+0000","last_became_active":"2024-09-10T05:36:13.616136+0000","last_became_peered":"2024-09-10T05:36:13.616136+0000","last_unstale":"2024-09-10T05:39:27.200918+0000","last_undegraded":"2024-09-10T05:39:27.200918+0000","last_fullsized":"2024-09-10T05:39:27.200918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:40:37.044525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"32'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.715111+0000","last_change":"2024-09-10T05:36:11.600692+0000","last_active":"2024-09-10T05:37:53.715111+0000","last_peered":"2024-09-10T05:37:53.715111+0000","last_clean":"2024-09-10T05:37:53.715111+0000","last_became_active":"2024-09-10T05:36:11.600234+0000","last_became_peered":"2024-09-10T05:36:11.600234+0000","last_unstale":"2024-09-10T05:37:53.715111+0000","last_undegraded":"2024-09-10T05:37:53.715111+0000","last_fullsized":"2024-09-10T05:37:53.715111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:23:34.604922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"30'2","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.899857+0000","last_change":"2024-09-10T05:36:13.615416+0000","last_active":"2024-09-10T05:37:55.899857+0000","last_peered":"2024-09-10T05:37:55.899857+0000","last_clean":"2024-09-10T05:37:55.899857+0000","last_became_active":"2024-09-10T05:36:13.614098+0000","last_became_peered":"2024-09-10T05:36:13.614098+0000","last_unstale":"2024-09-10T05:37:55.899857+0000","last_undegraded":"2024-09-10T05:37:55.899857+0000","last_fullsized":"2024-09-10T05:37:55.899857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:56:24.907751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"30'2","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.729428+0000","last_change":"2024-09-10T05:36:11.606179+0000","last_active":"2024-09-10T05:37:53.729428+0000","last_peered":"2024-09-10T05:37:53.729428+0000","last_clean":"2024-09-10T05:37:53.729428+0000","last_became_active":"2024-09-10T05:36:11.603972+0000","last_became_peered":"2024-09-10T05:36:11.603972+0000","last_unstale":"2024-09-10T05:37:53.729428+0000","last_undegraded":"2024-09-10T05:37:53.729428+0000","last_fullsized":"2024-09-10T05:37:53.729428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:01:31.149492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.897044+0000","last_change":"2024-09-10T05:36:11.597226+0000","last_active":"2024-09-10T05:37:55.897044+0000","last_peered":"2024-09-10T05:37:55.897044+0000","last_clean":"2024-09-10T05:37:55.897044+0000","last_became_active":"2024-09-10T05:36:11.595183+0000","last_became_peered":"2024-09-10T05:36:11.595183+0000","last_unstale":"2024-09-10T05:37:55.897044+0000","last_undegraded":"2024-09-10T05:37:55.897044+0000","last_fullsized":"2024-09-10T05:37:55.897044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:40:04.618907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"34'8","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.296974+0000","last_change":"2024-09-10T05:36:13.623166+0000","last_active":"2024-09-10T05:39:27.296974+0000","last_peered":"2024-09-10T05:39:27.296974+0000","last_clean":"2024-09-10T05:39:27.296974+0000","last_became_active":"2024-09-10T05:36:13.622559+0000","last_became_peered":"2024-09-10T05:36:13.622559+0000","last_unstale":"2024-09-10T05:39:27.296974+0000","last_undegraded":"2024-09-10T05:39:27.296974+0000","last_fullsized":"2024-09-10T05:39:27.296974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:42:51.927427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"34'1","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:32.688141+0000","last_change":"2024-09-10T05:36:11.591759+0000","last_active":"2024-09-10T05:38:32.688141+0000","last_peered":"2024-09-10T05:38:32.688141+0000","last_clean":"2024-09-10T05:38:32.688141+0000","last_became_active":"2024-09-10T05:36:11.588124+0000","last_became_peered":"2024-09-10T05:36:11.588124+0000","last_unstale":"2024-09-10T05:38:32.688141+0000","last_undegraded":"2024-09-10T05:38:32.688141+0000","last_fullsized":"2024-09-10T05:38:32.688141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:46:37.205574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"34'20","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.383693+0000","last_change":"2024-09-10T05:36:13.618023+0000","last_active":"2024-09-10T05:39:27.383693+0000","last_peered":"2024-09-10T05:39:27.383693+0000","last_clean":"2024-09-10T05:39:27.383693+0000","last_became_active":"2024-09-10T05:36:13.614959+0000","last_became_peered":"2024-09-10T05:36:13.614959+0000","last_unstale":"2024-09-10T05:39:27.383693+0000","last_undegraded":"2024-09-10T05:39:27.383693+0000","last_fullsized":"2024-09-10T05:39:27.383693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:10:02.645509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":56,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":692,"num_read_kb":660,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2260,"ondisk_log_size":2260,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1732,"num_read_kb":1486,"num_write":737,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":9114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1492,"ondisk_log_size":1492,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":967,"num_read_kb":967,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1683,"num_read_kb":1573,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":17417088,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":132,"num_read_kb":83,"num_write":311,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":639872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34840576,"data_stored":34834176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640307,"num_pgs":142,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39940,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331900,"statfs":{"total":96636764160,"available":96595865600,"internally_reserved":0,"allocated":446464,"data_stored":150733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673012,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45136,"kb_used_data":9792,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94326704,"statfs":{"total":96636764160,"available":96590544896,"internally_reserved":0,"allocated":10027008,"data_stored":9765035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673013,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48668,"kb_used_data":13324,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323172,"statfs":{"total":96636764160,"available":96586928128,"internally_reserved":0,"allocated":13643776,"data_stored":13323216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949673012,"num_pgs":143,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40416,"kb_used_data":13392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94331424,"statfs":{"total":96636764160,"available":96595378176,"internally_reserved":0,"allocated":13713408,"data_stored":13372464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13225984,"data_stored":13222784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9031680,"data_stored":9028480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":2712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T05:40:00.008 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T05:40:00.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.161+0000 7fb1c8c3c640 1 Processor -- start 2024-09-10T05:40:00.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.161+0000 7fb1c8c3c640 1 -- start start 2024-09-10T05:40:00.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.161+0000 7fb1c8c3c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb1c4110da0 0x7fb1c4111180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:40:00.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.161+0000 7fb1c8c3c640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1c4073a90 con 0x7fb1c41116c0 2024-09-10T05:40:00.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.161+0000 7fb1c8c3c640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fb1c40696e0 con 0x7fb1c4110da0 2024-09-10T05:40:00.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.161+0000 7fb1c259c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb1c4110da0 0x7fb1c4111180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:40:00.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.165+0000 7fb1c259c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb1c4110da0 0x7fb1c4111180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35464/0 (socket says 172.21.15.2:35464) 2024-09-10T05:40:00.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.165+0000 7fb1c1d9b640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb1c41116c0 0x7fb1c41231e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48588/0 (socket says 172.21.15.2:48588) 2024-09-10T05:40:00.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.165+0000 7fb1c259c640 1 -- 172.21.15.2:0/2860208361 learned_addr learned my addr 172.21.15.2:0/2860208361 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:40:00.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.165+0000 7fb1c259c640 1 -- 172.21.15.2:0/2860208361 >> v1:172.21.15.2:6789/0 conn(0x7fb1c41116c0 legacy=0x7fb1c41231e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:40:00.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.165+0000 7fb1c259c640 1 -- 172.21.15.2:0/2860208361 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1c406dd50 con 0x7fb1c4110da0 2024-09-10T05:40:00.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.165+0000 7fb1c259c640 1 --2- 172.21.15.2:0/2860208361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1c4110da0 0x7fb1c4111180 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc0097f0 tx=0x7fb1bc01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3476cebc7622f11a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:40:00.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.165+0000 7fb1c159a640 1 -- 172.21.15.2:0/2860208361 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1bc0b0070 con 0x7fb1c4110da0 2024-09-10T05:40:00.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.165+0000 7fb1c159a640 1 -- 172.21.15.2:0/2860208361 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1bc0ab530 con 0x7fb1c4110da0 2024-09-10T05:40:00.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.165+0000 7fb1c159a640 1 -- 172.21.15.2:0/2860208361 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1bc0ab830 con 0x7fb1c4110da0 2024-09-10T05:40:00.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.165+0000 7fb1c8c3c640 1 -- 172.21.15.2:0/2860208361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1c4110da0 msgr2=0x7fb1c4111180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:40:00.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.165+0000 7fb1c8c3c640 1 --2- 172.21.15.2:0/2860208361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1c4110da0 0x7fb1c4111180 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc0097f0 tx=0x7fb1bc01c430 comp rx=0 tx=0).stop 2024-09-10T05:40:00.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.165+0000 7fb1c8c3c640 1 -- 172.21.15.2:0/2860208361 shutdown_connections 2024-09-10T05:40:00.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.165+0000 7fb1c8c3c640 1 --2- 172.21.15.2:0/2860208361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1c4110da0 0x7fb1c4111180 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:40:00.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.165+0000 7fb1c8c3c640 1 -- 172.21.15.2:0/2860208361 >> 172.21.15.2:0/2860208361 conn(0x7fb1c4070900 msgr2=0x7fb1c4072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:40:00.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.165+0000 7fb1c8c3c640 1 -- 172.21.15.2:0/2860208361 shutdown_connections 2024-09-10T05:40:00.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.165+0000 7fb1c8c3c640 1 -- 172.21.15.2:0/2860208361 wait complete. 2024-09-10T05:40:00.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.169+0000 7fb1c8c3c640 1 Processor -- start 2024-09-10T05:40:00.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.169+0000 7fb1c8c3c640 1 -- start start 2024-09-10T05:40:00.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.169+0000 7fb1c8c3c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1c4110da0 0x7fb1c4130730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:40:00.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.169+0000 7fb1c8c3c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c4135470 con 0x7fb1c4110da0 2024-09-10T05:40:00.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.169+0000 7fb1c259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1c4110da0 0x7fb1c4130730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:40:00.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.169+0000 7fb1c259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1c4110da0 0x7fb1c4130730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35472/0 (socket says 172.21.15.2:35472) 2024-09-10T05:40:00.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.169+0000 7fb1c259c640 1 -- 172.21.15.2:0/1293385793 learned_addr learned my addr 172.21.15.2:0/1293385793 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:40:00.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.169+0000 7fb1c259c640 1 -- 172.21.15.2:0/1293385793 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1c41331b0 con 0x7fb1c4110da0 2024-09-10T05:40:00.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.169+0000 7fb1c259c640 1 --2- 172.21.15.2:0/1293385793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1c4110da0 0x7fb1c4130730 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc01a060 tx=0x7fb1bc0191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:40:00.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.169+0000 7fb1b2ffd640 1 -- 172.21.15.2:0/1293385793 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1bc0b0040 con 0x7fb1c4110da0 2024-09-10T05:40:00.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.169+0000 7fb1b2ffd640 1 -- 172.21.15.2:0/1293385793 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1bc0b4570 con 0x7fb1c4110da0 2024-09-10T05:40:00.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.169+0000 7fb1b2ffd640 1 -- 172.21.15.2:0/1293385793 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1bc0b4890 con 0x7fb1c4110da0 2024-09-10T05:40:00.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.169+0000 7fb1c8c3c640 1 -- 172.21.15.2:0/1293385793 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1c4131d30 con 0x7fb1c4110da0 2024-09-10T05:40:00.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.169+0000 7fb1c8c3c640 1 -- 172.21.15.2:0/1293385793 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1c41155b0 con 0x7fb1c4110da0 2024-09-10T05:40:00.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.169+0000 7fb1c8c3c640 1 -- 172.21.15.2:0/1293385793 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1c4111180 con 0x7fb1c4110da0 2024-09-10T05:40:00.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.169+0000 7fb1b2ffd640 1 -- 172.21.15.2:0/1293385793 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb1bc0bb020 con 0x7fb1c4110da0 2024-09-10T05:40:00.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.169+0000 7fb1b2ffd640 1 --2- 172.21.15.2:0/1293385793 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb1a403b200 0x7fb1a403d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:40:00.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.169+0000 7fb1b2ffd640 1 -- 172.21.15.2:0/1293385793 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7fb1bc0b9020 con 0x7fb1c4110da0 2024-09-10T05:40:00.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.169+0000 7fb1c1d9b640 1 --2- 172.21.15.2:0/1293385793 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb1a403b200 0x7fb1a403d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:40:00.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.173+0000 7fb1c1d9b640 1 --2- 172.21.15.2:0/1293385793 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb1a403b200 0x7fb1a403d6c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8001d40 tx=0x7fb1b8007db0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:40:00.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.173+0000 7fb1b2ffd640 1 -- 172.21.15.2:0/1293385793 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fb1bc0c2020 con 0x7fb1c4110da0 2024-09-10T05:40:00.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.349+0000 7fb1c8c3c640 1 -- 172.21.15.2:0/1293385793 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb1c4068e50 con 0x7fb1c4110da0 2024-09-10T05:40:00.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.353+0000 7fb1b2ffd640 1 -- 172.21.15.2:0/1293385793 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+21289 (secure 0 0 0) 0x7fb1bc0160b0 con 0x7fb1c4110da0 2024-09-10T05:40:00.355 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T05:40:00.355 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":34,"fsid":"004d9798-7539-4e93-b06c-e32e30a3c3b6","created":"2024-09-10T05:35:46.592342+0000","modified":"2024-09-10T05:37:53.702999+0000","last_up_change":"2024-09-10T05:35:57.655557+0000","last_in_change":"2024-09-10T05:35:47.803069+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T05:35:57.624941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-10T05:36:02.556976+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-10T05:36:10.336734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-10T05:36:11.943415+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-10T05:36:13.845841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-10T05:36:15.761817+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-10T05:36:17.654461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-10T05:36:19.812076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6b013ec0-c5ae-44ad-8d52-95ef02dc3140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":945139080},{"type":"v1","addr":"172.21.15.2:6801","nonce":945139080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":945139080},{"type":"v1","addr":"172.21.15.2:6803","nonce":945139080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":945139080},{"type":"v1","addr":"172.21.15.2:6807","nonce":945139080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":945139080},{"type":"v1","addr":"172.21.15.2:6805","nonce":945139080}]},"public_addr":"172.21.15.2:6801/945139080","cluster_addr":"172.21.15.2:6803/945139080","heartbeat_back_addr":"172.21.15.2:6807/945139080","heartbeat_front_addr":"172.21.15.2:6805/945139080","state":["exists","up"]},{"osd":1,"uuid":"39b3a256-0e4e-417d-8962-eebb40b35e16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":3442097179},{"type":"v1","addr":"172.21.15.62:6809","nonce":3442097179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3442097179},{"type":"v1","addr":"172.21.15.62:6811","nonce":3442097179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3442097179},{"type":"v1","addr":"172.21.15.62:6815","nonce":3442097179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3442097179},{"type":"v1","addr":"172.21.15.62:6813","nonce":3442097179}]},"public_addr":"172.21.15.62:6809/3442097179","cluster_addr":"172.21.15.62:6811/3442097179","heartbeat_back_addr":"172.21.15.62:6815/3442097179","heartbeat_front_addr":"172.21.15.62:6813/3442097179","state":["exists","up"]},{"osd":2,"uuid":"d7df24cd-e2f8-48ce-9956-0885d11a5685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2677868286},{"type":"v1","addr":"172.21.15.62:6801","nonce":2677868286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2677868286},{"type":"v1","addr":"172.21.15.62:6803","nonce":2677868286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2677868286},{"type":"v1","addr":"172.21.15.62:6807","nonce":2677868286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2677868286},{"type":"v1","addr":"172.21.15.62:6805","nonce":2677868286}]},"public_addr":"172.21.15.62:6801/2677868286","cluster_addr":"172.21.15.62:6803/2677868286","heartbeat_back_addr":"172.21.15.62:6807/2677868286","heartbeat_front_addr":"172.21.15.62:6805/2677868286","state":["exists","up"]},{"osd":3,"uuid":"e7bedfd2-ac57-47c9-ad11-0aaf1710946d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":2708991149},{"type":"v1","addr":"172.21.15.62:6817","nonce":2708991149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2708991149},{"type":"v1","addr":"172.21.15.62:6819","nonce":2708991149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2708991149},{"type":"v1","addr":"172.21.15.62:6823","nonce":2708991149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":2708991149},{"type":"v1","addr":"172.21.15.62:6821","nonce":2708991149}]},"public_addr":"172.21.15.62:6817/2708991149","cluster_addr":"172.21.15.62:6819/2708991149","heartbeat_back_addr":"172.21.15.62:6823/2708991149","heartbeat_front_addr":"172.21.15.62:6821/2708991149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:35:53.717657+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:35:54.611828+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:35:54.504863+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:35:55.176104+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.29","mappings":[{"from":3,"to":1}]},{"pgid":"3.2d","mappings":[{"from":3,"to":1}]},{"pgid":"3.33","mappings":[{"from":3,"to":2}]},{"pgid":"3.3a","mappings":[{"from":3,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":0,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]},{"pgid":"5.7","mappings":[{"from":1,"to":2}]},{"pgid":"6.a","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T05:40:00.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.353+0000 7fb1c8c3c640 1 -- 172.21.15.2:0/1293385793 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb1a403b200 msgr2=0x7fb1a403d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:40:00.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.353+0000 7fb1c8c3c640 1 --2- 172.21.15.2:0/1293385793 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb1a403b200 0x7fb1a403d6c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8001d40 tx=0x7fb1b8007db0 comp rx=0 tx=0).stop 2024-09-10T05:40:00.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.353+0000 7fb1c8c3c640 1 -- 172.21.15.2:0/1293385793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1c4110da0 msgr2=0x7fb1c4130730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:40:00.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.353+0000 7fb1c8c3c640 1 --2- 172.21.15.2:0/1293385793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1c4110da0 0x7fb1c4130730 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc01a060 tx=0x7fb1bc0191d0 comp rx=0 tx=0).stop 2024-09-10T05:40:00.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.353+0000 7fb1c8c3c640 1 -- 172.21.15.2:0/1293385793 shutdown_connections 2024-09-10T05:40:00.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.353+0000 7fb1c8c3c640 1 --2- 172.21.15.2:0/1293385793 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb1a403b200 0x7fb1a403d6c0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:40:00.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.353+0000 7fb1c8c3c640 1 --2- 172.21.15.2:0/1293385793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1c4110da0 0x7fb1c4130730 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:40:00.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.353+0000 7fb1c8c3c640 1 -- 172.21.15.2:0/1293385793 >> 172.21.15.2:0/1293385793 conn(0x7fb1c4070900 msgr2=0x7fb1c4071ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:40:00.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.353+0000 7fb1c8c3c640 1 -- 172.21.15.2:0/1293385793 shutdown_connections 2024-09-10T05:40:00.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:00.353+0000 7fb1c8c3c640 1 -- 172.21.15.2:0/1293385793 wait complete. 2024-09-10T05:40:01.376 INFO:tasks.ceph:Scrubbing osd.0 2024-09-10T05:40:01.376 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-10T05:40:01.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.513+0000 7fc2b96de640 1 Processor -- start 2024-09-10T05:40:01.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.513+0000 7fc2b96de640 1 -- start start 2024-09-10T05:40:01.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.513+0000 7fc2b96de640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc2b412a6c0 0x7fc2b41322a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:40:01.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.513+0000 7fc2b96de640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2b4114950 con 0x7fc2b4129a20 2024-09-10T05:40:01.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.513+0000 7fc2b96de640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fc2b4069170 con 0x7fc2b412a6c0 2024-09-10T05:40:01.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.513+0000 7fc2b2ffd640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc2b4129a20 0x7fc2b4129fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48600/0 (socket says 172.21.15.2:48600) 2024-09-10T05:40:01.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.513+0000 7fc2b2ffd640 1 -- 172.21.15.2:0/1438407908 learned_addr learned my addr 172.21.15.2:0/1438407908 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T05:40:01.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.513+0000 7fc2b27fc640 1 --2- 172.21.15.2:0/1438407908 >> v2:172.21.15.2:3300/0 conn(0x7fc2b412a6c0 0x7fc2b41322a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:40:01.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.513+0000 7fc2b27fc640 1 -- 172.21.15.2:0/1438407908 >> v1:172.21.15.2:6789/0 conn(0x7fc2b4129a20 legacy=0x7fc2b4129fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:40:01.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.513+0000 7fc2b27fc640 1 -- 172.21.15.2:0/1438407908 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2b4114c50 con 0x7fc2b412a6c0 2024-09-10T05:40:01.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.517+0000 7fc2b27fc640 1 --2- 172.21.15.2:0/1438407908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b412a6c0 0x7fc2b41322a0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8009740 tx=0x7fc2a801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b017e1961f59b92d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:40:01.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.517+0000 7fc2b1ffb640 1 -- 172.21.15.2:0/1438407908 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2a80b0070 con 0x7fc2b412a6c0 2024-09-10T05:40:01.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.517+0000 7fc2b1ffb640 1 -- 172.21.15.2:0/1438407908 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2a80ab530 con 0x7fc2b412a6c0 2024-09-10T05:40:01.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.517+0000 7fc2b1ffb640 1 -- 172.21.15.2:0/1438407908 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2a80ab830 con 0x7fc2b412a6c0 2024-09-10T05:40:01.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.517+0000 7fc2b96de640 1 -- 172.21.15.2:0/1438407908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b412a6c0 msgr2=0x7fc2b41322a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:40:01.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.517+0000 7fc2b96de640 1 --2- 172.21.15.2:0/1438407908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b412a6c0 0x7fc2b41322a0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8009740 tx=0x7fc2a801c370 comp rx=0 tx=0).stop 2024-09-10T05:40:01.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.517+0000 7fc2b96de640 1 -- 172.21.15.2:0/1438407908 shutdown_connections 2024-09-10T05:40:01.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.517+0000 7fc2b96de640 1 --2- 172.21.15.2:0/1438407908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b412a6c0 0x7fc2b41322a0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:40:01.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.517+0000 7fc2b96de640 1 -- 172.21.15.2:0/1438407908 >> 172.21.15.2:0/1438407908 conn(0x7fc2b4070d70 msgr2=0x7fc2b4073190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:40:01.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.517+0000 7fc2b96de640 1 -- 172.21.15.2:0/1438407908 shutdown_connections 2024-09-10T05:40:01.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.517+0000 7fc2b96de640 1 -- 172.21.15.2:0/1438407908 wait complete. 2024-09-10T05:40:01.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.521+0000 7fc2b96de640 1 Processor -- start 2024-09-10T05:40:01.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.521+0000 7fc2b96de640 1 -- start start 2024-09-10T05:40:01.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.521+0000 7fc2b96de640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b4129a20 0x7fc2b4123620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:40:01.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.521+0000 7fc2b96de640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b4135210 con 0x7fc2b4129a20 2024-09-10T05:40:01.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.521+0000 7fc2b2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b4129a20 0x7fc2b4123620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:40:01.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.521+0000 7fc2b2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b4129a20 0x7fc2b4123620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35482/0 (socket says 172.21.15.2:35482) 2024-09-10T05:40:01.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.521+0000 7fc2b2ffd640 1 -- 172.21.15.2:0/512371950 learned_addr learned my addr 172.21.15.2:0/512371950 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:40:01.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.521+0000 7fc2b2ffd640 1 -- 172.21.15.2:0/512371950 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2b4123b60 con 0x7fc2b4129a20 2024-09-10T05:40:01.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.521+0000 7fc2b2ffd640 1 --2- 172.21.15.2:0/512371950 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b4129a20 0x7fc2b4123620 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fc2a400c480 tx=0x7fc2a400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:40:01.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.521+0000 7fc29b7fe640 1 -- 172.21.15.2:0/512371950 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2a4017070 con 0x7fc2b4129a20 2024-09-10T05:40:01.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.521+0000 7fc29b7fe640 1 -- 172.21.15.2:0/512371950 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2a4005c20 con 0x7fc2b4129a20 2024-09-10T05:40:01.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.521+0000 7fc29b7fe640 1 -- 172.21.15.2:0/512371950 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2a40070d0 con 0x7fc2b4129a20 2024-09-10T05:40:01.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.521+0000 7fc2b96de640 1 -- 172.21.15.2:0/512371950 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2b4123df0 con 0x7fc2b4129a20 2024-09-10T05:40:01.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.521+0000 7fc2b96de640 1 -- 172.21.15.2:0/512371950 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2b41308a0 con 0x7fc2b4129a20 2024-09-10T05:40:01.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.521+0000 7fc2b96de640 1 -- 172.21.15.2:0/512371950 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc2b4130230 con 0x7fc2b4129a20 2024-09-10T05:40:01.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.521+0000 7fc29b7fe640 1 -- 172.21.15.2:0/512371950 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc2a401a070 con 0x7fc2b4129a20 2024-09-10T05:40:01.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.521+0000 7fc29b7fe640 1 --2- 172.21.15.2:0/512371950 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc2a003b220 0x7fc2a003d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:40:01.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.521+0000 7fc29b7fe640 1 -- 172.21.15.2:0/512371950 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7fc2a404e990 con 0x7fc2b4129a20 2024-09-10T05:40:01.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.521+0000 7fc29b7fe640 1 --2- 172.21.15.2:0/512371950 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x7fc2a0047200 0x7fc2a00496a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:40:01.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.521+0000 7fc29b7fe640 1 -- 172.21.15.2:0/512371950 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc2a0049d70 con 0x7fc2a0047200 2024-09-10T05:40:01.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.521+0000 7fc29b7fe640 1 -- 172.21.15.2:0/512371950 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc2a4053220 con 0x7fc2b4129a20 2024-09-10T05:40:01.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.521+0000 7fc2b37fe640 1 --2- 172.21.15.2:0/512371950 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x7fc2a0047200 0x7fc2a00496a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:40:01.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.521+0000 7fc2b27fc640 1 --2- 172.21.15.2:0/512371950 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc2a003b220 0x7fc2a003d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:40:01.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.521+0000 7fc2b37fe640 1 --2- 172.21.15.2:0/512371950 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x7fc2a0047200 0x7fc2a00496a0 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:40:01.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.521+0000 7fc2b27fc640 1 --2- 172.21.15.2:0/512371950 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc2a003b220 0x7fc2a003d6e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc2a80ad000 tx=0x7fc2a80a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:40:01.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.525+0000 7fc29b7fe640 1 -- 172.21.15.2:0/512371950 <== osd.0 v2:172.21.15.2:6800/945139080 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc2a0049d70 con 0x7fc2a0047200 2024-09-10T05:40:01.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.537+0000 7fc2b96de640 1 -- 172.21.15.2:0/512371950 --> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc2b4127710 con 0x7fc2a0047200 2024-09-10T05:40:01.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.537+0000 7fc29b7fe640 1 -- 172.21.15.2:0/512371950 <== osd.0 v2:172.21.15.2:6800/945139080 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc2b4127710 con 0x7fc2a0047200 2024-09-10T05:40:01.541 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T05:40:01.541 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T05:40:01.541 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T05:40:01.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.537+0000 7fc2b96de640 1 -- 172.21.15.2:0/512371950 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x7fc2a0047200 msgr2=0x7fc2a00496a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:40:01.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.537+0000 7fc2b96de640 1 --2- 172.21.15.2:0/512371950 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x7fc2a0047200 0x7fc2a00496a0 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:40:01.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.537+0000 7fc2b96de640 1 -- 172.21.15.2:0/512371950 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc2a003b220 msgr2=0x7fc2a003d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:40:01.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.537+0000 7fc2b96de640 1 --2- 172.21.15.2:0/512371950 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc2a003b220 0x7fc2a003d6e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc2a80ad000 tx=0x7fc2a80a6000 comp rx=0 tx=0).stop 2024-09-10T05:40:01.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.537+0000 7fc2b96de640 1 -- 172.21.15.2:0/512371950 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b4129a20 msgr2=0x7fc2b4123620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:40:01.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.537+0000 7fc2b96de640 1 --2- 172.21.15.2:0/512371950 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b4129a20 0x7fc2b4123620 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fc2a400c480 tx=0x7fc2a400c940 comp rx=0 tx=0).stop 2024-09-10T05:40:01.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.537+0000 7fc2b96de640 1 -- 172.21.15.2:0/512371950 shutdown_connections 2024-09-10T05:40:01.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.537+0000 7fc2b96de640 1 --2- 172.21.15.2:0/512371950 >> [v2:172.21.15.2:6800/945139080,v1:172.21.15.2:6801/945139080] conn(0x7fc2a0047200 0x7fc2a00496a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:40:01.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.537+0000 7fc2b96de640 1 --2- 172.21.15.2:0/512371950 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc2a003b220 0x7fc2a003d6e0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:40:01.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.537+0000 7fc2b96de640 1 --2- 172.21.15.2:0/512371950 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b4129a20 0x7fc2b4123620 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:40:01.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.537+0000 7fc2b96de640 1 -- 172.21.15.2:0/512371950 >> 172.21.15.2:0/512371950 conn(0x7fc2b4070d70 msgr2=0x7fc2b4127d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:40:01.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.537+0000 7fc2b96de640 1 -- 172.21.15.2:0/512371950 shutdown_connections 2024-09-10T05:40:01.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.537+0000 7fc2b96de640 1 -- 172.21.15.2:0/512371950 wait complete. 2024-09-10T05:40:01.558 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-10T05:40:01.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.665+0000 7f42e8f9f640 1 Processor -- start 2024-09-10T05:40:01.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.669+0000 7f42e8f9f640 1 -- start start 2024-09-10T05:40:01.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.669+0000 7f42e8f9f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f42e412c700 0x7f42e41346a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:40:01.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.669+0000 7f42e8f9f640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42e4073830 con 0x7f42e412bc10 2024-09-10T05:40:01.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.669+0000 7f42e8f9f640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f42e4071eb0 con 0x7f42e412c700 2024-09-10T05:40:01.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.669+0000 7f42e259c640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f42e412bc10 0x7f42e412bff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48610/0 (socket says 172.21.15.2:48610) 2024-09-10T05:40:01.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.669+0000 7f42e259c640 1 -- 172.21.15.2:0/1918308825 learned_addr learned my addr 172.21.15.2:0/1918308825 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T05:40:01.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.669+0000 7f42e1d9b640 1 --2- 172.21.15.2:0/1918308825 >> v2:172.21.15.2:3300/0 conn(0x7f42e412c700 0x7f42e41346a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:40:01.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.669+0000 7f42e159a640 1 -- 172.21.15.2:0/1918308825 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1316231442 0 0) 0x7f42e4073830 con 0x7f42e412bc10 2024-09-10T05:40:01.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.669+0000 7f42e159a640 1 -- 172.21.15.2:0/1918308825 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42cc003530 con 0x7f42e412bc10 2024-09-10T05:40:01.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.669+0000 7f42e1d9b640 1 -- 172.21.15.2:0/1918308825 >> v1:172.21.15.2:6789/0 conn(0x7f42e412bc10 legacy=0x7f42e412bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:40:01.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.669+0000 7f42e1d9b640 1 -- 172.21.15.2:0/1918308825 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42e40a30b0 con 0x7f42e412c700 2024-09-10T05:40:01.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.669+0000 7f42e1d9b640 1 --2- 172.21.15.2:0/1918308825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42e412c700 0x7f42e41346a0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f42d4009d90 tx=0x7f42d401c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5e485648453c451 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:40:01.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.669+0000 7f42e159a640 1 -- 172.21.15.2:0/1918308825 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42d40a6640 con 0x7f42e412c700 2024-09-10T05:40:01.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.669+0000 7f42e159a640 1 -- 172.21.15.2:0/1918308825 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42d40a67e0 con 0x7f42e412c700 2024-09-10T05:40:01.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.669+0000 7f42e159a640 1 -- 172.21.15.2:0/1918308825 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42d40a6ae0 con 0x7f42e412c700 2024-09-10T05:40:01.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.673+0000 7f42e8f9f640 1 -- 172.21.15.2:0/1918308825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42e412c700 msgr2=0x7f42e41346a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:40:01.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.673+0000 7f42e8f9f640 1 --2- 172.21.15.2:0/1918308825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42e412c700 0x7f42e41346a0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f42d4009d90 tx=0x7f42d401c8c0 comp rx=0 tx=0).stop 2024-09-10T05:40:01.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.673+0000 7f42e8f9f640 1 -- 172.21.15.2:0/1918308825 shutdown_connections 2024-09-10T05:40:01.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.673+0000 7f42e8f9f640 1 --2- 172.21.15.2:0/1918308825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42e412c700 0x7f42e41346a0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:40:01.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.673+0000 7f42e8f9f640 1 -- 172.21.15.2:0/1918308825 >> 172.21.15.2:0/1918308825 conn(0x7f42e40a0a60 msgr2=0x7f42e406e800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:40:01.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.673+0000 7f42e8f9f640 1 -- 172.21.15.2:0/1918308825 shutdown_connections 2024-09-10T05:40:01.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.673+0000 7f42e8f9f640 1 -- 172.21.15.2:0/1918308825 wait complete. 2024-09-10T05:40:01.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.673+0000 7f42e8f9f640 1 Processor -- start 2024-09-10T05:40:01.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.673+0000 7f42e8f9f640 1 -- start start 2024-09-10T05:40:01.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.673+0000 7f42e8f9f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42e412bc10 0x7f42e412a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:40:01.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.673+0000 7f42e8f9f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f42e4137790 con 0x7f42e412bc10 2024-09-10T05:40:01.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.673+0000 7f42e259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42e412bc10 0x7f42e412a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:40:01.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.673+0000 7f42e259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42e412bc10 0x7f42e412a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35488/0 (socket says 172.21.15.2:35488) 2024-09-10T05:40:01.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.673+0000 7f42e259c640 1 -- 172.21.15.2:0/585167752 learned_addr learned my addr 172.21.15.2:0/585167752 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:40:01.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.673+0000 7f42e259c640 1 -- 172.21.15.2:0/585167752 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42e411c700 con 0x7f42e412bc10 2024-09-10T05:40:01.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.673+0000 7f42e259c640 1 --2- 172.21.15.2:0/585167752 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42e412bc10 0x7f42e412a430 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f42d800c450 tx=0x7f42d800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:40:01.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.673+0000 7f42d2ffd640 1 -- 172.21.15.2:0/585167752 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42d8017070 con 0x7f42e412bc10 2024-09-10T05:40:01.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.673+0000 7f42d2ffd640 1 -- 172.21.15.2:0/585167752 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42d8005ce0 con 0x7f42e412bc10 2024-09-10T05:40:01.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.673+0000 7f42e8f9f640 1 -- 172.21.15.2:0/585167752 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42e411d150 con 0x7f42e412bc10 2024-09-10T05:40:01.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.673+0000 7f42d2ffd640 1 -- 172.21.15.2:0/585167752 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42d8007200 con 0x7f42e412bc10 2024-09-10T05:40:01.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.673+0000 7f42e8f9f640 1 -- 172.21.15.2:0/585167752 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42e412ab40 con 0x7f42e412bc10 2024-09-10T05:40:01.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.673+0000 7f42e8f9f640 1 -- 172.21.15.2:0/585167752 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42e412bff0 con 0x7f42e412bc10 2024-09-10T05:40:01.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.673+0000 7f42d2ffd640 1 -- 172.21.15.2:0/585167752 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f42d801a070 con 0x7f42e412bc10 2024-09-10T05:40:01.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.673+0000 7f42d2ffd640 1 --2- 172.21.15.2:0/585167752 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f42c403b1d0 0x7f42c403d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:40:01.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.673+0000 7f42d2ffd640 1 -- 172.21.15.2:0/585167752 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7f42d804e9b0 con 0x7f42e412bc10 2024-09-10T05:40:01.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.677+0000 7f42e1d9b640 1 --2- 172.21.15.2:0/585167752 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f42c403b1d0 0x7f42c403d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:40:01.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.677+0000 7f42e1d9b640 1 --2- 172.21.15.2:0/585167752 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f42c403b1d0 0x7f42c403d690 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f42d40af000 tx=0x7f42d40a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:40:01.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.681+0000 7f42d2ffd640 1 -- 172.21.15.2:0/585167752 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f42d8012400 con 0x7f42e412bc10 2024-09-10T05:40:01.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.849+0000 7f42e8f9f640 1 -- 172.21.15.2:0/585167752 --> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f42e411c090 con 0x7f42c403b1d0 2024-09-10T05:40:01.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.853+0000 7f42d2ffd640 1 -- 172.21.15.2:0/585167752 <== mgr.4101 v2:172.21.15.62:6824/3663628807 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f42e411c090 con 0x7f42c403b1d0 2024-09-10T05:40:01.856 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 0 to deep-scrub 2024-09-10T05:40:01.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.857+0000 7f42e8f9f640 1 -- 172.21.15.2:0/585167752 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f42c403b1d0 msgr2=0x7f42c403d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:40:01.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.857+0000 7f42e8f9f640 1 --2- 172.21.15.2:0/585167752 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f42c403b1d0 0x7f42c403d690 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f42d40af000 tx=0x7f42d40a7000 comp rx=0 tx=0).stop 2024-09-10T05:40:01.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.857+0000 7f42e8f9f640 1 -- 172.21.15.2:0/585167752 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42e412bc10 msgr2=0x7f42e412a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:40:01.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.857+0000 7f42e8f9f640 1 --2- 172.21.15.2:0/585167752 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42e412bc10 0x7f42e412a430 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f42d800c450 tx=0x7f42d800c910 comp rx=0 tx=0).stop 2024-09-10T05:40:01.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.857+0000 7f42e8f9f640 1 -- 172.21.15.2:0/585167752 shutdown_connections 2024-09-10T05:40:01.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.857+0000 7f42e8f9f640 1 --2- 172.21.15.2:0/585167752 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f42c403b1d0 0x7f42c403d690 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:40:01.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.857+0000 7f42e8f9f640 1 --2- 172.21.15.2:0/585167752 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42e412bc10 0x7f42e412a430 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:40:01.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.857+0000 7f42e8f9f640 1 -- 172.21.15.2:0/585167752 >> 172.21.15.2:0/585167752 conn(0x7f42e40a0a60 msgr2=0x7f42e40a0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:40:01.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.857+0000 7f42e8f9f640 1 -- 172.21.15.2:0/585167752 shutdown_connections 2024-09-10T05:40:01.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:01.857+0000 7f42e8f9f640 1 -- 172.21.15.2:0/585167752 wait complete. 2024-09-10T05:40:01.876 INFO:tasks.ceph:Scrubbing osd.1 2024-09-10T05:40:01.876 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-10T05:40:02.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.001+0000 7fa040ed7640 1 Processor -- start 2024-09-10T05:40:02.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.001+0000 7fa040ed7640 1 -- start start 2024-09-10T05:40:02.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.001+0000 7fa040ed7640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa03c12be40 0x7fa03c12c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:40:02.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.001+0000 7fa040ed7640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa03c115f00 con 0x7fa03c116350 2024-09-10T05:40:02.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.001+0000 7fa040ed7640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fa03c116ac0 con 0x7fa03c12be40 2024-09-10T05:40:02.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.001+0000 7fa03a59c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa03c12be40 0x7fa03c12c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:40:02.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.001+0000 7fa039d9b640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa03c116350 0x7fa03c12f160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48624/0 (socket says 172.21.15.2:48624) 2024-09-10T05:40:02.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.001+0000 7fa039d9b640 1 -- 172.21.15.2:0/3367643075 learned_addr learned my addr 172.21.15.2:0/3367643075 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T05:40:02.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.001+0000 7fa03959a640 1 -- 172.21.15.2:0/3367643075 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1632553836 0 0) 0x7fa03c115f00 con 0x7fa03c116350 2024-09-10T05:40:02.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.001+0000 7fa03959a640 1 -- 172.21.15.2:0/3367643075 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa024003530 con 0x7fa03c116350 2024-09-10T05:40:02.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.001+0000 7fa03a59c640 1 -- 172.21.15.2:0/3367643075 >> v1:172.21.15.2:6789/0 conn(0x7fa03c116350 legacy=0x7fa03c12f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:40:02.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.001+0000 7fa03a59c640 1 -- 172.21.15.2:0/3367643075 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa03c12c760 con 0x7fa03c12be40 2024-09-10T05:40:02.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.005+0000 7fa03a59c640 1 --2- 172.21.15.2:0/3367643075 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa03c12be40 0x7fa03c12c220 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fa02c009740 tx=0x7fa02c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=271d25d438c916b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:40:02.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.005+0000 7fa03959a640 1 -- 172.21.15.2:0/3367643075 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa02c0b0070 con 0x7fa03c12be40 2024-09-10T05:40:02.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.005+0000 7fa03959a640 1 -- 172.21.15.2:0/3367643075 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa02c0ab530 con 0x7fa03c12be40 2024-09-10T05:40:02.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.005+0000 7fa03959a640 1 -- 172.21.15.2:0/3367643075 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa02c0ab830 con 0x7fa03c12be40 2024-09-10T05:40:02.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.005+0000 7fa040ed7640 1 -- 172.21.15.2:0/3367643075 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa03c12be40 msgr2=0x7fa03c12c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:40:02.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.005+0000 7fa040ed7640 1 --2- 172.21.15.2:0/3367643075 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa03c12be40 0x7fa03c12c220 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fa02c009740 tx=0x7fa02c01c370 comp rx=0 tx=0).stop 2024-09-10T05:40:02.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.005+0000 7fa040ed7640 1 -- 172.21.15.2:0/3367643075 shutdown_connections 2024-09-10T05:40:02.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.005+0000 7fa040ed7640 1 --2- 172.21.15.2:0/3367643075 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa03c12be40 0x7fa03c12c220 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:40:02.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.005+0000 7fa040ed7640 1 -- 172.21.15.2:0/3367643075 >> 172.21.15.2:0/3367643075 conn(0x7fa03c06fb10 msgr2=0x7fa03c071f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:40:02.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.005+0000 7fa040ed7640 1 -- 172.21.15.2:0/3367643075 shutdown_connections 2024-09-10T05:40:02.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.005+0000 7fa040ed7640 1 -- 172.21.15.2:0/3367643075 wait complete. 2024-09-10T05:40:02.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.005+0000 7fa040ed7640 1 Processor -- start 2024-09-10T05:40:02.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.005+0000 7fa040ed7640 1 -- start start 2024-09-10T05:40:02.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.005+0000 7fa040ed7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa03c116350 0x7fa03c124ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:40:02.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.005+0000 7fa040ed7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa03c137f20 con 0x7fa03c116350 2024-09-10T05:40:02.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.005+0000 7fa03a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa03c116350 0x7fa03c124ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:40:02.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.005+0000 7fa03a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa03c116350 0x7fa03c124ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35516/0 (socket says 172.21.15.2:35516) 2024-09-10T05:40:02.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.005+0000 7fa03a59c640 1 -- 172.21.15.2:0/3508048316 learned_addr learned my addr 172.21.15.2:0/3508048316 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:40:02.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.005+0000 7fa03a59c640 1 -- 172.21.15.2:0/3508048316 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa03c1298b0 con 0x7fa03c116350 2024-09-10T05:40:02.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.005+0000 7fa03a59c640 1 --2- 172.21.15.2:0/3508048316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa03c116350 0x7fa03c124ab0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fa02c0ae040 tx=0x7fa02c01abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:40:02.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.005+0000 7fa02affd640 1 -- 172.21.15.2:0/3508048316 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa02c0b0050 con 0x7fa03c116350 2024-09-10T05:40:02.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.005+0000 7fa02affd640 1 -- 172.21.15.2:0/3508048316 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa02c0b1040 con 0x7fa03c116350 2024-09-10T05:40:02.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.005+0000 7fa040ed7640 1 -- 172.21.15.2:0/3508048316 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa03c118480 con 0x7fa03c116350 2024-09-10T05:40:02.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.009+0000 7fa02affd640 1 -- 172.21.15.2:0/3508048316 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa02c0aa8e0 con 0x7fa03c116350 2024-09-10T05:40:02.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.009+0000 7fa040ed7640 1 -- 172.21.15.2:0/3508048316 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa03c124ff0 con 0x7fa03c116350 2024-09-10T05:40:02.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.009+0000 7fa040ed7640 1 -- 172.21.15.2:0/3508048316 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa03c076880 con 0x7fa03c116350 2024-09-10T05:40:02.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.009+0000 7fa02affd640 1 -- 172.21.15.2:0/3508048316 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fa02c0be030 con 0x7fa03c116350 2024-09-10T05:40:02.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.009+0000 7fa02affd640 1 --2- 172.21.15.2:0/3508048316 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fa01c03b1d0 0x7fa01c03d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:40:02.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.009+0000 7fa02affd640 1 -- 172.21.15.2:0/3508048316 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7fa02c0bc070 con 0x7fa03c116350 2024-09-10T05:40:02.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.009+0000 7fa02affd640 1 --2- 172.21.15.2:0/3508048316 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x7fa01c0470d0 0x7fa01c049570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:40:02.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.009+0000 7fa02affd640 1 -- 172.21.15.2:0/3508048316 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa02c0044a0 con 0x7fa01c0470d0 2024-09-10T05:40:02.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.009+0000 7fa02affd640 1 -- 172.21.15.2:0/3508048316 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fa02c0ee2a0 con 0x7fa03c116350 2024-09-10T05:40:02.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.009+0000 7fa039d9b640 1 --2- 172.21.15.2:0/3508048316 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fa01c03b1d0 0x7fa01c03d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:40:02.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.009+0000 7fa03ad9d640 1 --2- 172.21.15.2:0/3508048316 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x7fa01c0470d0 0x7fa01c049570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:40:02.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.009+0000 7fa039d9b640 1 --2- 172.21.15.2:0/3508048316 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fa01c03b1d0 0x7fa01c03d690 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa030007fd0 tx=0x7fa030007900 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:40:02.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.009+0000 7fa03ad9d640 1 --2- 172.21.15.2:0/3508048316 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x7fa01c0470d0 0x7fa01c049570 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:40:02.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.013+0000 7fa02affd640 1 -- 172.21.15.2:0/3508048316 <== osd.1 v2:172.21.15.62:6808/3442097179 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa02c0044a0 con 0x7fa01c0470d0 2024-09-10T05:40:02.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.025+0000 7fa040ed7640 1 -- 172.21.15.2:0/3508048316 --> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa03c12c090 con 0x7fa01c0470d0 2024-09-10T05:40:02.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.025+0000 7fa02affd640 1 -- 172.21.15.2:0/3508048316 <== osd.1 v2:172.21.15.62:6808/3442097179 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa03c12c090 con 0x7fa01c0470d0 2024-09-10T05:40:02.029 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T05:40:02.029 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T05:40:02.029 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T05:40:02.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.025+0000 7fa040ed7640 1 -- 172.21.15.2:0/3508048316 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x7fa01c0470d0 msgr2=0x7fa01c049570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:40:02.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.025+0000 7fa040ed7640 1 --2- 172.21.15.2:0/3508048316 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x7fa01c0470d0 0x7fa01c049570 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:40:02.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.025+0000 7fa040ed7640 1 -- 172.21.15.2:0/3508048316 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fa01c03b1d0 msgr2=0x7fa01c03d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:40:02.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.025+0000 7fa040ed7640 1 --2- 172.21.15.2:0/3508048316 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fa01c03b1d0 0x7fa01c03d690 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa030007fd0 tx=0x7fa030007900 comp rx=0 tx=0).stop 2024-09-10T05:40:02.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.025+0000 7fa040ed7640 1 -- 172.21.15.2:0/3508048316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa03c116350 msgr2=0x7fa03c124ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:40:02.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.025+0000 7fa040ed7640 1 --2- 172.21.15.2:0/3508048316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa03c116350 0x7fa03c124ab0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fa02c0ae040 tx=0x7fa02c01abb0 comp rx=0 tx=0).stop 2024-09-10T05:40:02.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.025+0000 7fa040ed7640 1 -- 172.21.15.2:0/3508048316 shutdown_connections 2024-09-10T05:40:02.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.025+0000 7fa040ed7640 1 --2- 172.21.15.2:0/3508048316 >> [v2:172.21.15.62:6808/3442097179,v1:172.21.15.62:6809/3442097179] conn(0x7fa01c0470d0 0x7fa01c049570 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:40:02.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.025+0000 7fa040ed7640 1 --2- 172.21.15.2:0/3508048316 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fa01c03b1d0 0x7fa01c03d690 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:40:02.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.025+0000 7fa040ed7640 1 --2- 172.21.15.2:0/3508048316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa03c116350 0x7fa03c124ab0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:40:02.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.025+0000 7fa040ed7640 1 -- 172.21.15.2:0/3508048316 >> 172.21.15.2:0/3508048316 conn(0x7fa03c06fb10 msgr2=0x7fa03c12dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:40:02.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.025+0000 7fa040ed7640 1 -- 172.21.15.2:0/3508048316 shutdown_connections 2024-09-10T05:40:02.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.025+0000 7fa040ed7640 1 -- 172.21.15.2:0/3508048316 wait complete. 2024-09-10T05:40:02.045 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-10T05:40:02.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.157+0000 7f90b17d7640 1 Processor -- start 2024-09-10T05:40:02.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.157+0000 7f90b17d7640 1 -- start start 2024-09-10T05:40:02.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.157+0000 7f90b17d7640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f90ac1141a0 0x7f90ac114580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:40:02.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.157+0000 7f90b17d7640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90ac116c60 con 0x7f90ac116370 2024-09-10T05:40:02.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.157+0000 7f90b17d7640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f90ac115610 con 0x7f90ac1141a0 2024-09-10T05:40:02.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.157+0000 7f90aaffd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f90ac1141a0 0x7f90ac114580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:40:02.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.157+0000 7f90aa7fc640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f90ac116370 0x7f90ac1254a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48636/0 (socket says 172.21.15.2:48636) 2024-09-10T05:40:02.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.157+0000 7f90aa7fc640 1 -- 172.21.15.2:0/3080737312 learned_addr learned my addr 172.21.15.2:0/3080737312 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T05:40:02.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.157+0000 7f90aaffd640 1 -- 172.21.15.2:0/3080737312 >> v1:172.21.15.2:6789/0 conn(0x7f90ac116370 legacy=0x7f90ac1254a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:40:02.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.157+0000 7f90aaffd640 1 -- 172.21.15.2:0/3080737312 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90ac0736f0 con 0x7f90ac1141a0 2024-09-10T05:40:02.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.161+0000 7f90aaffd640 1 --2- 172.21.15.2:0/3080737312 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90ac1141a0 0x7f90ac114580 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f90a0009740 tx=0x7f90a001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5a29b063658f17a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:40:02.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.161+0000 7f90a9ffb640 1 -- 172.21.15.2:0/3080737312 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90a00b0070 con 0x7f90ac1141a0 2024-09-10T05:40:02.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.161+0000 7f90a9ffb640 1 -- 172.21.15.2:0/3080737312 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90a00ab530 con 0x7f90ac1141a0 2024-09-10T05:40:02.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.161+0000 7f90a9ffb640 1 -- 172.21.15.2:0/3080737312 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90a00ab830 con 0x7f90ac1141a0 2024-09-10T05:40:02.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.161+0000 7f90b17d7640 1 -- 172.21.15.2:0/3080737312 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90ac1141a0 msgr2=0x7f90ac114580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:40:02.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.161+0000 7f90b17d7640 1 --2- 172.21.15.2:0/3080737312 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90ac1141a0 0x7f90ac114580 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f90a0009740 tx=0x7f90a001c370 comp rx=0 tx=0).stop 2024-09-10T05:40:02.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.161+0000 7f90b17d7640 1 -- 172.21.15.2:0/3080737312 shutdown_connections 2024-09-10T05:40:02.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.161+0000 7f90b17d7640 1 --2- 172.21.15.2:0/3080737312 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90ac1141a0 0x7f90ac114580 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:40:02.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.161+0000 7f90b17d7640 1 -- 172.21.15.2:0/3080737312 >> 172.21.15.2:0/3080737312 conn(0x7f90ac06f950 msgr2=0x7f90ac071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:40:02.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.161+0000 7f90b17d7640 1 -- 172.21.15.2:0/3080737312 shutdown_connections 2024-09-10T05:40:02.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.161+0000 7f90b17d7640 1 -- 172.21.15.2:0/3080737312 wait complete. 2024-09-10T05:40:02.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.161+0000 7f90b17d7640 1 Processor -- start 2024-09-10T05:40:02.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.161+0000 7f90b17d7640 1 -- start start 2024-09-10T05:40:02.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.161+0000 7f90b17d7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90ac1141a0 0x7f90ac123dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:40:02.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.161+0000 7f90b17d7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f90ac137b70 con 0x7f90ac1141a0 2024-09-10T05:40:02.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.161+0000 7f90aaffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90ac1141a0 0x7f90ac123dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:40:02.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.161+0000 7f90aaffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90ac1141a0 0x7f90ac123dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35538/0 (socket says 172.21.15.2:35538) 2024-09-10T05:40:02.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.161+0000 7f90aaffd640 1 -- 172.21.15.2:0/2453146702 learned_addr learned my addr 172.21.15.2:0/2453146702 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:40:02.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.161+0000 7f90aaffd640 1 -- 172.21.15.2:0/2453146702 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90ac135010 con 0x7f90ac1141a0 2024-09-10T05:40:02.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.161+0000 7f90aaffd640 1 --2- 172.21.15.2:0/2453146702 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90ac1141a0 0x7f90ac123dc0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f90a00ae040 tx=0x7f90a0019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:40:02.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.161+0000 7f90937fe640 1 -- 172.21.15.2:0/2453146702 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90a00b8020 con 0x7f90ac1141a0 2024-09-10T05:40:02.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.161+0000 7f90937fe640 1 -- 172.21.15.2:0/2453146702 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90a00b4410 con 0x7f90ac1141a0 2024-09-10T05:40:02.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.161+0000 7f90b17d7640 1 -- 172.21.15.2:0/2453146702 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90ac1352a0 con 0x7f90ac1141a0 2024-09-10T05:40:02.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.161+0000 7f90937fe640 1 -- 172.21.15.2:0/2453146702 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90a00b0040 con 0x7f90ac1141a0 2024-09-10T05:40:02.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.161+0000 7f90b17d7640 1 -- 172.21.15.2:0/2453146702 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90ac1244d0 con 0x7f90ac1141a0 2024-09-10T05:40:02.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.165+0000 7f90b17d7640 1 -- 172.21.15.2:0/2453146702 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90ac114580 con 0x7f90ac1141a0 2024-09-10T05:40:02.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.165+0000 7f90937fe640 1 -- 172.21.15.2:0/2453146702 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f90a00bb020 con 0x7f90ac1141a0 2024-09-10T05:40:02.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.165+0000 7f90937fe640 1 --2- 172.21.15.2:0/2453146702 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f909803b1d0 0x7f909803d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:40:02.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.165+0000 7f90937fe640 1 -- 172.21.15.2:0/2453146702 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7f90a00e9520 con 0x7f90ac1141a0 2024-09-10T05:40:02.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.165+0000 7f90aa7fc640 1 --2- 172.21.15.2:0/2453146702 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f909803b1d0 0x7f909803d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:40:02.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.165+0000 7f90aa7fc640 1 --2- 172.21.15.2:0/2453146702 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f909803b1d0 0x7f909803d690 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f909c0015f0 tx=0x7f909c007ab0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:40:02.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.169+0000 7f90937fe640 1 -- 172.21.15.2:0/2453146702 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f90a00c2030 con 0x7f90ac1141a0 2024-09-10T05:40:02.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.337+0000 7f90b17d7640 1 -- 172.21.15.2:0/2453146702 --> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f90ac134d60 con 0x7f909803b1d0 2024-09-10T05:40:02.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.337+0000 7f90937fe640 1 -- 172.21.15.2:0/2453146702 <== mgr.4101 v2:172.21.15.62:6824/3663628807 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f909c0058c0 con 0x7f909803b1d0 2024-09-10T05:40:02.341 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 1 to deep-scrub 2024-09-10T05:40:02.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.341+0000 7f90b17d7640 1 -- 172.21.15.2:0/2453146702 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f909803b1d0 msgr2=0x7f909803d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:40:02.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.341+0000 7f90b17d7640 1 --2- 172.21.15.2:0/2453146702 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f909803b1d0 0x7f909803d690 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f909c0015f0 tx=0x7f909c007ab0 comp rx=0 tx=0).stop 2024-09-10T05:40:02.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.341+0000 7f90b17d7640 1 -- 172.21.15.2:0/2453146702 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90ac1141a0 msgr2=0x7f90ac123dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:40:02.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.341+0000 7f90b17d7640 1 --2- 172.21.15.2:0/2453146702 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90ac1141a0 0x7f90ac123dc0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f90a00ae040 tx=0x7f90a0019110 comp rx=0 tx=0).stop 2024-09-10T05:40:02.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.341+0000 7f90b17d7640 1 -- 172.21.15.2:0/2453146702 shutdown_connections 2024-09-10T05:40:02.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.341+0000 7f90b17d7640 1 --2- 172.21.15.2:0/2453146702 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f909803b1d0 0x7f909803d690 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:40:02.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.341+0000 7f90b17d7640 1 --2- 172.21.15.2:0/2453146702 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90ac1141a0 0x7f90ac123dc0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:40:02.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.341+0000 7f90b17d7640 1 -- 172.21.15.2:0/2453146702 >> 172.21.15.2:0/2453146702 conn(0x7f90ac06f950 msgr2=0x7f90ac129b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:40:02.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.341+0000 7f90b17d7640 1 -- 172.21.15.2:0/2453146702 shutdown_connections 2024-09-10T05:40:02.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.341+0000 7f90b17d7640 1 -- 172.21.15.2:0/2453146702 wait complete. 2024-09-10T05:40:02.359 INFO:tasks.ceph:Scrubbing osd.2 2024-09-10T05:40:02.360 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-10T05:40:02.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.473+0000 7f55fde2d640 1 Processor -- start 2024-09-10T05:40:02.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.473+0000 7f55fde2d640 1 -- start start 2024-09-10T05:40:02.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.473+0000 7f55fde2d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f55f8112890 0x7f55f806de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:40:02.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.473+0000 7f55fde2d640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55f8134770 con 0x7f55f8111da0 2024-09-10T05:40:02.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.473+0000 7f55fde2d640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f55f806ebd0 con 0x7f55f8112890 2024-09-10T05:40:02.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.473+0000 7f55f6ffd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f55f8112890 0x7f55f806de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:40:02.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.473+0000 7f55f6ffd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f55f8112890 0x7f55f806de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35546/0 (socket says 172.21.15.2:35546) 2024-09-10T05:40:02.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.473+0000 7f55f6ffd640 1 -- 172.21.15.2:0/3388829243 learned_addr learned my addr 172.21.15.2:0/3388829243 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:40:02.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.473+0000 7f55f77fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f55f8111da0 0x7f55f8112180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48652/0 (socket says 172.21.15.2:48652) 2024-09-10T05:40:02.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.473+0000 7f55f6ffd640 1 -- 172.21.15.2:0/3388829243 >> v1:172.21.15.2:6789/0 conn(0x7f55f8111da0 legacy=0x7f55f8112180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:40:02.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.473+0000 7f55f6ffd640 1 -- 172.21.15.2:0/3388829243 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55f8135950 con 0x7f55f8112890 2024-09-10T05:40:02.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.473+0000 7f55f6ffd640 1 --2- 172.21.15.2:0/3388829243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55f8112890 0x7f55f806de30 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f55e00097f0 tx=0x7f55e001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b50fbbf6e3be8150 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:40:02.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.477+0000 7f55f67fc640 1 -- 172.21.15.2:0/3388829243 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55e00b0070 con 0x7f55f8112890 2024-09-10T05:40:02.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.477+0000 7f55f67fc640 1 -- 172.21.15.2:0/3388829243 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55e00ab530 con 0x7f55f8112890 2024-09-10T05:40:02.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.477+0000 7f55f67fc640 1 -- 172.21.15.2:0/3388829243 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55e00ab830 con 0x7f55f8112890 2024-09-10T05:40:02.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.477+0000 7f55fde2d640 1 -- 172.21.15.2:0/3388829243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55f8112890 msgr2=0x7f55f806de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:40:02.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.477+0000 7f55fde2d640 1 --2- 172.21.15.2:0/3388829243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55f8112890 0x7f55f806de30 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f55e00097f0 tx=0x7f55e001c430 comp rx=0 tx=0).stop 2024-09-10T05:40:02.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.477+0000 7f55fde2d640 1 -- 172.21.15.2:0/3388829243 shutdown_connections 2024-09-10T05:40:02.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.477+0000 7f55fde2d640 1 --2- 172.21.15.2:0/3388829243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55f8112890 0x7f55f806de30 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:40:02.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.477+0000 7f55fde2d640 1 -- 172.21.15.2:0/3388829243 >> 172.21.15.2:0/3388829243 conn(0x7f55f8071a90 msgr2=0x7f55f8071ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:40:02.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.477+0000 7f55fde2d640 1 -- 172.21.15.2:0/3388829243 shutdown_connections 2024-09-10T05:40:02.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.477+0000 7f55fde2d640 1 -- 172.21.15.2:0/3388829243 wait complete. 2024-09-10T05:40:02.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.477+0000 7f55fde2d640 1 Processor -- start 2024-09-10T05:40:02.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.477+0000 7f55fde2d640 1 -- start start 2024-09-10T05:40:02.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.477+0000 7f55fde2d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55f8111da0 0x7f55f812d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:40:02.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.477+0000 7f55fde2d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f55f81354e0 con 0x7f55f8111da0 2024-09-10T05:40:02.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.477+0000 7f55f77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55f8111da0 0x7f55f812d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:40:02.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.477+0000 7f55f77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55f8111da0 0x7f55f812d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35556/0 (socket says 172.21.15.2:35556) 2024-09-10T05:40:02.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.477+0000 7f55f77fe640 1 -- 172.21.15.2:0/1523225205 learned_addr learned my addr 172.21.15.2:0/1523225205 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:40:02.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.477+0000 7f55f77fe640 1 -- 172.21.15.2:0/1523225205 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55f8120200 con 0x7f55f8111da0 2024-09-10T05:40:02.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.477+0000 7f55f77fe640 1 --2- 172.21.15.2:0/1523225205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55f8111da0 0x7f55f812d210 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f55f000c7f0 tx=0x7f55f000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:40:02.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.477+0000 7f55effff640 1 -- 172.21.15.2:0/1523225205 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55f0017070 con 0x7f55f8111da0 2024-09-10T05:40:02.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.477+0000 7f55effff640 1 -- 172.21.15.2:0/1523225205 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55f000a610 con 0x7f55f8111da0 2024-09-10T05:40:02.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.477+0000 7f55fde2d640 1 -- 172.21.15.2:0/1523225205 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55f811f7b0 con 0x7f55f8111da0 2024-09-10T05:40:02.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.477+0000 7f55effff640 1 -- 172.21.15.2:0/1523225205 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55f000a910 con 0x7f55f8111da0 2024-09-10T05:40:02.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.477+0000 7f55fde2d640 1 -- 172.21.15.2:0/1523225205 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55f812d920 con 0x7f55f8111da0 2024-09-10T05:40:02.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.477+0000 7f55fde2d640 1 -- 172.21.15.2:0/1523225205 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f55f81204e0 con 0x7f55f8111da0 2024-09-10T05:40:02.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.477+0000 7f55effff640 1 -- 172.21.15.2:0/1523225205 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f55f001a070 con 0x7f55f8111da0 2024-09-10T05:40:02.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.481+0000 7f55effff640 1 --2- 172.21.15.2:0/1523225205 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f55d803b1d0 0x7f55d803d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:40:02.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.481+0000 7f55effff640 1 -- 172.21.15.2:0/1523225205 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7f55f004ede0 con 0x7f55f8111da0 2024-09-10T05:40:02.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.481+0000 7f55effff640 1 --2- 172.21.15.2:0/1523225205 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f55d80470d0 0x7f55d8049570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:40:02.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.481+0000 7f55effff640 1 -- 172.21.15.2:0/1523225205 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f55d8049c40 con 0x7f55d80470d0 2024-09-10T05:40:02.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.481+0000 7f55effff640 1 -- 172.21.15.2:0/1523225205 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f55f00543f0 con 0x7f55f8111da0 2024-09-10T05:40:02.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.481+0000 7f55f6ffd640 1 --2- 172.21.15.2:0/1523225205 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f55d803b1d0 0x7f55d803d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:40:02.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.481+0000 7f55f7fff640 1 --2- 172.21.15.2:0/1523225205 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f55d80470d0 0x7f55d8049570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:40:02.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.481+0000 7f55f7fff640 1 --2- 172.21.15.2:0/1523225205 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f55d80470d0 0x7f55d8049570 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:40:02.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.481+0000 7f55f6ffd640 1 --2- 172.21.15.2:0/1523225205 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f55d803b1d0 0x7f55d803d690 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f55e00ad000 tx=0x7f55e0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:40:02.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.481+0000 7f55effff640 1 -- 172.21.15.2:0/1523225205 <== osd.2 v2:172.21.15.62:6800/2677868286 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f55d8049c40 con 0x7f55d80470d0 2024-09-10T05:40:02.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.493+0000 7f55fde2d640 1 -- 172.21.15.2:0/1523225205 --> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f55f806de30 con 0x7f55d80470d0 2024-09-10T05:40:02.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.497+0000 7f55effff640 1 -- 172.21.15.2:0/1523225205 <== osd.2 v2:172.21.15.62:6800/2677868286 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f55f806de30 con 0x7f55d80470d0 2024-09-10T05:40:02.499 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T05:40:02.500 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T05:40:02.500 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T05:40:02.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.497+0000 7f55fde2d640 1 -- 172.21.15.2:0/1523225205 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f55d80470d0 msgr2=0x7f55d8049570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:40:02.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.497+0000 7f55fde2d640 1 --2- 172.21.15.2:0/1523225205 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f55d80470d0 0x7f55d8049570 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:40:02.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.497+0000 7f55fde2d640 1 -- 172.21.15.2:0/1523225205 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f55d803b1d0 msgr2=0x7f55d803d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:40:02.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.497+0000 7f55fde2d640 1 --2- 172.21.15.2:0/1523225205 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f55d803b1d0 0x7f55d803d690 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f55e00ad000 tx=0x7f55e0008040 comp rx=0 tx=0).stop 2024-09-10T05:40:02.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.497+0000 7f55fde2d640 1 -- 172.21.15.2:0/1523225205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55f8111da0 msgr2=0x7f55f812d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:40:02.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.497+0000 7f55fde2d640 1 --2- 172.21.15.2:0/1523225205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55f8111da0 0x7f55f812d210 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f55f000c7f0 tx=0x7f55f000ccb0 comp rx=0 tx=0).stop 2024-09-10T05:40:02.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.497+0000 7f55fde2d640 1 -- 172.21.15.2:0/1523225205 shutdown_connections 2024-09-10T05:40:02.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.497+0000 7f55fde2d640 1 --2- 172.21.15.2:0/1523225205 >> [v2:172.21.15.62:6800/2677868286,v1:172.21.15.62:6801/2677868286] conn(0x7f55d80470d0 0x7f55d8049570 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:40:02.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.497+0000 7f55fde2d640 1 --2- 172.21.15.2:0/1523225205 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f55d803b1d0 0x7f55d803d690 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:40:02.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.497+0000 7f55fde2d640 1 --2- 172.21.15.2:0/1523225205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55f8111da0 0x7f55f812d210 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:40:02.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.497+0000 7f55fde2d640 1 -- 172.21.15.2:0/1523225205 >> 172.21.15.2:0/1523225205 conn(0x7f55f8071a90 msgr2=0x7f55f810fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:40:02.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.497+0000 7f55fde2d640 1 -- 172.21.15.2:0/1523225205 shutdown_connections 2024-09-10T05:40:02.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.497+0000 7f55fde2d640 1 -- 172.21.15.2:0/1523225205 wait complete. 2024-09-10T05:40:02.514 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-10T05:40:02.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.621+0000 7f84a0a83640 1 Processor -- start 2024-09-10T05:40:02.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.621+0000 7f84a0a83640 1 -- start start 2024-09-10T05:40:02.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.621+0000 7f84a0a83640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f849c130260 0x7f849c132650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:40:02.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.621+0000 7f84a0a83640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f849c1122f0 con 0x7f849c12d2e0 2024-09-10T05:40:02.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.621+0000 7f84a0a83640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f849c06dcb0 con 0x7f849c130260 2024-09-10T05:40:02.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.621+0000 7f8499d9b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f849c130260 0x7f849c132650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:40:02.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.621+0000 7f849a59c640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f849c12d2e0 0x7f849c12d6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48660/0 (socket says 172.21.15.2:48660) 2024-09-10T05:40:02.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.621+0000 7f849a59c640 1 -- 172.21.15.2:0/1855095482 learned_addr learned my addr 172.21.15.2:0/1855095482 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T05:40:02.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.621+0000 7f8499d9b640 1 -- 172.21.15.2:0/1855095482 >> v1:172.21.15.2:6789/0 conn(0x7f849c12d2e0 legacy=0x7f849c12d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:40:02.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.621+0000 7f8499d9b640 1 -- 172.21.15.2:0/1855095482 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f849c073ad0 con 0x7f849c130260 2024-09-10T05:40:02.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.625+0000 7f8499d9b640 1 --2- 172.21.15.2:0/1855095482 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f849c130260 0x7f849c132650 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f8484009740 tx=0x7f848401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68c1ac2263131d2c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:40:02.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.625+0000 7f849959a640 1 -- 172.21.15.2:0/1855095482 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84840b0070 con 0x7f849c130260 2024-09-10T05:40:02.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.625+0000 7f849959a640 1 -- 172.21.15.2:0/1855095482 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84840ab530 con 0x7f849c130260 2024-09-10T05:40:02.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.625+0000 7f849959a640 1 -- 172.21.15.2:0/1855095482 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84840ab830 con 0x7f849c130260 2024-09-10T05:40:02.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.625+0000 7f84a0a83640 1 -- 172.21.15.2:0/1855095482 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f849c130260 msgr2=0x7f849c132650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:40:02.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.625+0000 7f84a0a83640 1 --2- 172.21.15.2:0/1855095482 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f849c130260 0x7f849c132650 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f8484009740 tx=0x7f848401c370 comp rx=0 tx=0).stop 2024-09-10T05:40:02.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.625+0000 7f84a0a83640 1 -- 172.21.15.2:0/1855095482 shutdown_connections 2024-09-10T05:40:02.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.625+0000 7f84a0a83640 1 --2- 172.21.15.2:0/1855095482 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f849c130260 0x7f849c132650 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:40:02.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.625+0000 7f84a0a83640 1 -- 172.21.15.2:0/1855095482 >> 172.21.15.2:0/1855095482 conn(0x7f849c070940 msgr2=0x7f849c072d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:40:02.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.625+0000 7f84a0a83640 1 -- 172.21.15.2:0/1855095482 shutdown_connections 2024-09-10T05:40:02.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.625+0000 7f84a0a83640 1 -- 172.21.15.2:0/1855095482 wait complete. 2024-09-10T05:40:02.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.625+0000 7f84a0a83640 1 Processor -- start 2024-09-10T05:40:02.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.625+0000 7f84a0a83640 1 -- start start 2024-09-10T05:40:02.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.625+0000 7f84a0a83640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f849c12d2e0 0x7f849c123940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:40:02.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.625+0000 7f84a0a83640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f849c135740 con 0x7f849c12d2e0 2024-09-10T05:40:02.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.625+0000 7f849a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f849c12d2e0 0x7f849c123940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:40:02.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.625+0000 7f849a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f849c12d2e0 0x7f849c123940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35574/0 (socket says 172.21.15.2:35574) 2024-09-10T05:40:02.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.625+0000 7f849a59c640 1 -- 172.21.15.2:0/193108632 learned_addr learned my addr 172.21.15.2:0/193108632 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:40:02.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.625+0000 7f849a59c640 1 -- 172.21.15.2:0/193108632 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f849c114430 con 0x7f849c12d2e0 2024-09-10T05:40:02.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.625+0000 7f849a59c640 1 --2- 172.21.15.2:0/193108632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f849c12d2e0 0x7f849c123940 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f849400cbd0 tx=0x7f849400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:40:02.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.625+0000 7f8492ffd640 1 -- 172.21.15.2:0/193108632 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8494017070 con 0x7f849c12d2e0 2024-09-10T05:40:02.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.625+0000 7f8492ffd640 1 -- 172.21.15.2:0/193108632 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f849400abc0 con 0x7f849c12d2e0 2024-09-10T05:40:02.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.625+0000 7f8492ffd640 1 -- 172.21.15.2:0/193108632 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8494012400 con 0x7f849c12d2e0 2024-09-10T05:40:02.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.625+0000 7f84a0a83640 1 -- 172.21.15.2:0/193108632 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f849c123e80 con 0x7f849c12d2e0 2024-09-10T05:40:02.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.625+0000 7f84a0a83640 1 -- 172.21.15.2:0/193108632 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f849c125af0 con 0x7f849c12d2e0 2024-09-10T05:40:02.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.625+0000 7f84a0a83640 1 -- 172.21.15.2:0/193108632 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f849c12d6c0 con 0x7f849c12d2e0 2024-09-10T05:40:02.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.625+0000 7f8492ffd640 1 -- 172.21.15.2:0/193108632 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f849401a070 con 0x7f849c12d2e0 2024-09-10T05:40:02.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.625+0000 7f8492ffd640 1 --2- 172.21.15.2:0/193108632 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f847c03b250 0x7f847c03d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:40:02.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.629+0000 7f8492ffd640 1 -- 172.21.15.2:0/193108632 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7f849404f6a0 con 0x7f849c12d2e0 2024-09-10T05:40:02.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.629+0000 7f8499d9b640 1 --2- 172.21.15.2:0/193108632 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f847c03b250 0x7f847c03d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:40:02.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.629+0000 7f8499d9b640 1 --2- 172.21.15.2:0/193108632 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f847c03b250 0x7f847c03d710 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f84840ad000 tx=0x7f8484008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:40:02.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.633+0000 7f8492ffd640 1 -- 172.21.15.2:0/193108632 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f849404db00 con 0x7f849c12d2e0 2024-09-10T05:40:02.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.793+0000 7f84a0a83640 1 -- 172.21.15.2:0/193108632 --> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f849c068e50 con 0x7f847c03b250 2024-09-10T05:40:02.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.797+0000 7f8492ffd640 1 -- 172.21.15.2:0/193108632 <== mgr.4101 v2:172.21.15.62:6824/3663628807 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f849c068e50 con 0x7f847c03b250 2024-09-10T05:40:02.800 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 2 to deep-scrub 2024-09-10T05:40:02.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.797+0000 7f84a0a83640 1 -- 172.21.15.2:0/193108632 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f847c03b250 msgr2=0x7f847c03d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:40:02.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.797+0000 7f84a0a83640 1 --2- 172.21.15.2:0/193108632 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f847c03b250 0x7f847c03d710 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f84840ad000 tx=0x7f8484008040 comp rx=0 tx=0).stop 2024-09-10T05:40:02.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.797+0000 7f84a0a83640 1 -- 172.21.15.2:0/193108632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f849c12d2e0 msgr2=0x7f849c123940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:40:02.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.797+0000 7f84a0a83640 1 --2- 172.21.15.2:0/193108632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f849c12d2e0 0x7f849c123940 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f849400cbd0 tx=0x7f849400a430 comp rx=0 tx=0).stop 2024-09-10T05:40:02.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.797+0000 7f84a0a83640 1 -- 172.21.15.2:0/193108632 shutdown_connections 2024-09-10T05:40:02.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.797+0000 7f84a0a83640 1 --2- 172.21.15.2:0/193108632 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f847c03b250 0x7f847c03d710 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:40:02.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.797+0000 7f84a0a83640 1 --2- 172.21.15.2:0/193108632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f849c12d2e0 0x7f849c123940 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:40:02.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.797+0000 7f84a0a83640 1 -- 172.21.15.2:0/193108632 >> 172.21.15.2:0/193108632 conn(0x7f849c070940 msgr2=0x7f849c12b870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:40:02.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.797+0000 7f84a0a83640 1 -- 172.21.15.2:0/193108632 shutdown_connections 2024-09-10T05:40:02.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.797+0000 7f84a0a83640 1 -- 172.21.15.2:0/193108632 wait complete. 2024-09-10T05:40:02.818 INFO:tasks.ceph:Scrubbing osd.3 2024-09-10T05:40:02.818 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-10T05:40:02.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.937+0000 7fe7d8dc1640 1 Processor -- start 2024-09-10T05:40:02.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.937+0000 7fe7d8dc1640 1 -- start start 2024-09-10T05:40:02.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.937+0000 7fe7d8dc1640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe7d412f170 0x7fe7d4131560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:40:02.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.937+0000 7fe7d8dc1640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7d4111000 con 0x7fe7d4128b90 2024-09-10T05:40:02.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.937+0000 7fe7d8dc1640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fe7d4128900 con 0x7fe7d412f170 2024-09-10T05:40:02.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.937+0000 7fe7d1d9b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe7d412f170 0x7fe7d4131560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:40:02.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.937+0000 7fe7d1d9b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe7d412f170 0x7fe7d4131560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35576/0 (socket says 172.21.15.2:35576) 2024-09-10T05:40:02.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.937+0000 7fe7d1d9b640 1 -- 172.21.15.2:0/2450807333 learned_addr learned my addr 172.21.15.2:0/2450807333 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:40:02.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.937+0000 7fe7d259c640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe7d4128b90 0x7fe7d4128f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48676/0 (socket says 172.21.15.2:48676) 2024-09-10T05:40:02.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.937+0000 7fe7d1d9b640 1 -- 172.21.15.2:0/2450807333 >> v1:172.21.15.2:6789/0 conn(0x7fe7d4128b90 legacy=0x7fe7d4128f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:40:02.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.937+0000 7fe7d1d9b640 1 -- 172.21.15.2:0/2450807333 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7d4113750 con 0x7fe7d412f170 2024-09-10T05:40:02.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.941+0000 7fe7d1d9b640 1 --2- 172.21.15.2:0/2450807333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7d412f170 0x7fe7d4131560 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fe7c40097f0 tx=0x7fe7c401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=842ea65c149f7db9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:40:02.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.941+0000 7fe7d159a640 1 -- 172.21.15.2:0/2450807333 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7c40b0070 con 0x7fe7d412f170 2024-09-10T05:40:02.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.941+0000 7fe7d159a640 1 -- 172.21.15.2:0/2450807333 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7c40ab530 con 0x7fe7d412f170 2024-09-10T05:40:02.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.941+0000 7fe7d159a640 1 -- 172.21.15.2:0/2450807333 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7c40ab830 con 0x7fe7d412f170 2024-09-10T05:40:02.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.941+0000 7fe7d8dc1640 1 -- 172.21.15.2:0/2450807333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7d412f170 msgr2=0x7fe7d4131560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:40:02.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.941+0000 7fe7d8dc1640 1 --2- 172.21.15.2:0/2450807333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7d412f170 0x7fe7d4131560 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fe7c40097f0 tx=0x7fe7c401c430 comp rx=0 tx=0).stop 2024-09-10T05:40:02.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.941+0000 7fe7d8dc1640 1 -- 172.21.15.2:0/2450807333 shutdown_connections 2024-09-10T05:40:02.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.941+0000 7fe7d8dc1640 1 --2- 172.21.15.2:0/2450807333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7d412f170 0x7fe7d4131560 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:40:02.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.941+0000 7fe7d8dc1640 1 -- 172.21.15.2:0/2450807333 >> 172.21.15.2:0/2450807333 conn(0x7fe7d4070d70 msgr2=0x7fe7d4073190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:40:02.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.941+0000 7fe7d8dc1640 1 -- 172.21.15.2:0/2450807333 shutdown_connections 2024-09-10T05:40:02.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.941+0000 7fe7d8dc1640 1 -- 172.21.15.2:0/2450807333 wait complete. 2024-09-10T05:40:02.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.941+0000 7fe7d8dc1640 1 Processor -- start 2024-09-10T05:40:02.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.941+0000 7fe7d8dc1640 1 -- start start 2024-09-10T05:40:02.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.941+0000 7fe7d8dc1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7d4128b90 0x7fe7d41222f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:40:02.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.941+0000 7fe7d8dc1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d4132640 con 0x7fe7d4128b90 2024-09-10T05:40:02.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.941+0000 7fe7d259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7d4128b90 0x7fe7d41222f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:40:02.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.945+0000 7fe7d259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7d4128b90 0x7fe7d41222f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35592/0 (socket says 172.21.15.2:35592) 2024-09-10T05:40:02.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.945+0000 7fe7d259c640 1 -- 172.21.15.2:0/797697101 learned_addr learned my addr 172.21.15.2:0/797697101 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:40:02.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.945+0000 7fe7d259c640 1 -- 172.21.15.2:0/797697101 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7d4134a20 con 0x7fe7d4128b90 2024-09-10T05:40:02.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.945+0000 7fe7d259c640 1 --2- 172.21.15.2:0/797697101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7d4128b90 0x7fe7d41222f0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc00c450 tx=0x7fe7bc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:40:02.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.945+0000 7fe7caffd640 1 -- 172.21.15.2:0/797697101 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7bc007410 con 0x7fe7d4128b90 2024-09-10T05:40:02.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.945+0000 7fe7caffd640 1 -- 172.21.15.2:0/797697101 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7bc0075b0 con 0x7fe7d4128b90 2024-09-10T05:40:02.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.945+0000 7fe7caffd640 1 -- 172.21.15.2:0/797697101 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7bc004960 con 0x7fe7d4128b90 2024-09-10T05:40:02.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.945+0000 7fe7d8dc1640 1 -- 172.21.15.2:0/797697101 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7d41265f0 con 0x7fe7d4128b90 2024-09-10T05:40:02.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.945+0000 7fe7d8dc1640 1 -- 172.21.15.2:0/797697101 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7d412ca10 con 0x7fe7d4128b90 2024-09-10T05:40:02.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.945+0000 7fe7d8dc1640 1 -- 172.21.15.2:0/797697101 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe7d4128f70 con 0x7fe7d4128b90 2024-09-10T05:40:02.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.945+0000 7fe7caffd640 1 -- 172.21.15.2:0/797697101 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe7bc01a020 con 0x7fe7d4128b90 2024-09-10T05:40:02.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.945+0000 7fe7caffd640 1 --2- 172.21.15.2:0/797697101 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fe7b403b1d0 0x7fe7b403d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:40:02.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.945+0000 7fe7caffd640 1 -- 172.21.15.2:0/797697101 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7fe7bc04ef30 con 0x7fe7d4128b90 2024-09-10T05:40:02.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.945+0000 7fe7caffd640 1 --2- 172.21.15.2:0/797697101 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x7fe7b40470d0 0x7fe7b4049570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:40:02.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.945+0000 7fe7caffd640 1 -- 172.21.15.2:0/797697101 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe7b4049c40 con 0x7fe7b40470d0 2024-09-10T05:40:02.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.945+0000 7fe7caffd640 1 -- 172.21.15.2:0/797697101 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe7bc0514c0 con 0x7fe7d4128b90 2024-09-10T05:40:02.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.945+0000 7fe7d1d9b640 1 --2- 172.21.15.2:0/797697101 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fe7b403b1d0 0x7fe7b403d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:40:02.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.945+0000 7fe7d2d9d640 1 --2- 172.21.15.2:0/797697101 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x7fe7b40470d0 0x7fe7b4049570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:40:02.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.945+0000 7fe7d2d9d640 1 --2- 172.21.15.2:0/797697101 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x7fe7b40470d0 0x7fe7b4049570 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:40:02.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.945+0000 7fe7d1d9b640 1 --2- 172.21.15.2:0/797697101 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fe7b403b1d0 0x7fe7b403d690 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe7c40ad000 tx=0x7fe7c40a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:40:02.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.949+0000 7fe7caffd640 1 -- 172.21.15.2:0/797697101 <== osd.3 v2:172.21.15.62:6816/2708991149 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe7b4049c40 con 0x7fe7b40470d0 2024-09-10T05:40:02.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.961+0000 7fe7d8dc1640 1 -- 172.21.15.2:0/797697101 --> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe7d4122830 con 0x7fe7b40470d0 2024-09-10T05:40:02.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.961+0000 7fe7caffd640 1 -- 172.21.15.2:0/797697101 <== osd.3 v2:172.21.15.62:6816/2708991149 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe7d4122830 con 0x7fe7b40470d0 2024-09-10T05:40:02.966 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T05:40:02.966 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T05:40:02.966 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T05:40:02.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.961+0000 7fe7d8dc1640 1 -- 172.21.15.2:0/797697101 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x7fe7b40470d0 msgr2=0x7fe7b4049570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:40:02.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.961+0000 7fe7d8dc1640 1 --2- 172.21.15.2:0/797697101 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x7fe7b40470d0 0x7fe7b4049570 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:40:02.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.961+0000 7fe7d8dc1640 1 -- 172.21.15.2:0/797697101 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fe7b403b1d0 msgr2=0x7fe7b403d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:40:02.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.961+0000 7fe7d8dc1640 1 --2- 172.21.15.2:0/797697101 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fe7b403b1d0 0x7fe7b403d690 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe7c40ad000 tx=0x7fe7c40a6000 comp rx=0 tx=0).stop 2024-09-10T05:40:02.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.961+0000 7fe7d8dc1640 1 -- 172.21.15.2:0/797697101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7d4128b90 msgr2=0x7fe7d41222f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:40:02.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.961+0000 7fe7d8dc1640 1 --2- 172.21.15.2:0/797697101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7d4128b90 0x7fe7d41222f0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc00c450 tx=0x7fe7bc00c910 comp rx=0 tx=0).stop 2024-09-10T05:40:02.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.961+0000 7fe7d8dc1640 1 -- 172.21.15.2:0/797697101 shutdown_connections 2024-09-10T05:40:02.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.961+0000 7fe7d8dc1640 1 --2- 172.21.15.2:0/797697101 >> [v2:172.21.15.62:6816/2708991149,v1:172.21.15.62:6817/2708991149] conn(0x7fe7b40470d0 0x7fe7b4049570 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:40:02.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.961+0000 7fe7d8dc1640 1 --2- 172.21.15.2:0/797697101 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fe7b403b1d0 0x7fe7b403d690 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:40:02.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.961+0000 7fe7d8dc1640 1 --2- 172.21.15.2:0/797697101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7d4128b90 0x7fe7d41222f0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:40:02.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.961+0000 7fe7d8dc1640 1 -- 172.21.15.2:0/797697101 >> 172.21.15.2:0/797697101 conn(0x7fe7d4070d70 msgr2=0x7fe7d412fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:40:02.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.961+0000 7fe7d8dc1640 1 -- 172.21.15.2:0/797697101 shutdown_connections 2024-09-10T05:40:02.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:02.961+0000 7fe7d8dc1640 1 -- 172.21.15.2:0/797697101 wait complete. 2024-09-10T05:40:02.980 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-10T05:40:03.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.085+0000 7f2e739fd640 1 Processor -- start 2024-09-10T05:40:03.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.085+0000 7f2e739fd640 1 -- start start 2024-09-10T05:40:03.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.085+0000 7f2e739fd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2e6c12c700 0x7f2e6c1346a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:40:03.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.085+0000 7f2e739fd640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e6c073830 con 0x7f2e6c12bc10 2024-09-10T05:40:03.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.085+0000 7f2e739fd640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f2e6c071eb0 con 0x7f2e6c12c700 2024-09-10T05:40:03.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.085+0000 7f2e71799640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f2e6c12bc10 0x7f2e6c12bff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48678/0 (socket says 172.21.15.2:48678) 2024-09-10T05:40:03.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.085+0000 7f2e71799640 1 -- 172.21.15.2:0/491444982 learned_addr learned my addr 172.21.15.2:0/491444982 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T05:40:03.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.085+0000 7f2e70f98640 1 --2- 172.21.15.2:0/491444982 >> v2:172.21.15.2:3300/0 conn(0x7f2e6c12c700 0x7f2e6c1346a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:40:03.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.085+0000 7f2e6bfff640 1 -- 172.21.15.2:0/491444982 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3635180155 0 0) 0x7f2e6c073830 con 0x7f2e6c12bc10 2024-09-10T05:40:03.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.085+0000 7f2e6bfff640 1 -- 172.21.15.2:0/491444982 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e54003530 con 0x7f2e6c12bc10 2024-09-10T05:40:03.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.085+0000 7f2e70f98640 1 -- 172.21.15.2:0/491444982 >> v1:172.21.15.2:6789/0 conn(0x7f2e6c12bc10 legacy=0x7f2e6c12bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:40:03.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.085+0000 7f2e70f98640 1 -- 172.21.15.2:0/491444982 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e6c0a30b0 con 0x7f2e6c12c700 2024-09-10T05:40:03.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.089+0000 7f2e70f98640 1 --2- 172.21.15.2:0/491444982 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e6c12c700 0x7f2e6c1346a0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f2e60009740 tx=0x7f2e6001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3c093a1e1390657 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:40:03.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.089+0000 7f2e6bfff640 1 -- 172.21.15.2:0/491444982 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e600b0070 con 0x7f2e6c12c700 2024-09-10T05:40:03.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.089+0000 7f2e6bfff640 1 -- 172.21.15.2:0/491444982 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e600ab530 con 0x7f2e6c12c700 2024-09-10T05:40:03.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.089+0000 7f2e6bfff640 1 -- 172.21.15.2:0/491444982 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e600ab830 con 0x7f2e6c12c700 2024-09-10T05:40:03.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.089+0000 7f2e739fd640 1 -- 172.21.15.2:0/491444982 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e6c12c700 msgr2=0x7f2e6c1346a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:40:03.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.089+0000 7f2e739fd640 1 --2- 172.21.15.2:0/491444982 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e6c12c700 0x7f2e6c1346a0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f2e60009740 tx=0x7f2e6001c370 comp rx=0 tx=0).stop 2024-09-10T05:40:03.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.089+0000 7f2e739fd640 1 -- 172.21.15.2:0/491444982 shutdown_connections 2024-09-10T05:40:03.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.089+0000 7f2e739fd640 1 --2- 172.21.15.2:0/491444982 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e6c12c700 0x7f2e6c1346a0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:40:03.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.089+0000 7f2e739fd640 1 -- 172.21.15.2:0/491444982 >> 172.21.15.2:0/491444982 conn(0x7f2e6c0a0a60 msgr2=0x7f2e6c06e800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:40:03.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.089+0000 7f2e739fd640 1 -- 172.21.15.2:0/491444982 shutdown_connections 2024-09-10T05:40:03.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.089+0000 7f2e739fd640 1 -- 172.21.15.2:0/491444982 wait complete. 2024-09-10T05:40:03.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.089+0000 7f2e739fd640 1 Processor -- start 2024-09-10T05:40:03.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.089+0000 7f2e739fd640 1 -- start start 2024-09-10T05:40:03.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.089+0000 7f2e739fd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e6c12bc10 0x7f2e6c12a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:40:03.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.089+0000 7f2e739fd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2e6c137790 con 0x7f2e6c12bc10 2024-09-10T05:40:03.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.089+0000 7f2e71799640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e6c12bc10 0x7f2e6c12a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:40:03.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.089+0000 7f2e71799640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e6c12bc10 0x7f2e6c12a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35598/0 (socket says 172.21.15.2:35598) 2024-09-10T05:40:03.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.089+0000 7f2e71799640 1 -- 172.21.15.2:0/353893303 learned_addr learned my addr 172.21.15.2:0/353893303 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:40:03.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.089+0000 7f2e71799640 1 -- 172.21.15.2:0/353893303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e6c073a50 con 0x7f2e6c12bc10 2024-09-10T05:40:03.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.093+0000 7f2e71799640 1 --2- 172.21.15.2:0/353893303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e6c12bc10 0x7f2e6c12a650 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f2e6400cb40 tx=0x7f2e6400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:40:03.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.093+0000 7f2e69ffb640 1 -- 172.21.15.2:0/353893303 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e6400ab50 con 0x7f2e6c12bc10 2024-09-10T05:40:03.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.093+0000 7f2e69ffb640 1 -- 172.21.15.2:0/353893303 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e6400acf0 con 0x7f2e6c12bc10 2024-09-10T05:40:03.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.093+0000 7f2e739fd640 1 -- 172.21.15.2:0/353893303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e6c11c1b0 con 0x7f2e6c12bc10 2024-09-10T05:40:03.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.093+0000 7f2e69ffb640 1 -- 172.21.15.2:0/353893303 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e64012530 con 0x7f2e6c12bc10 2024-09-10T05:40:03.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.093+0000 7f2e739fd640 1 -- 172.21.15.2:0/353893303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e6c12ab90 con 0x7f2e6c12bc10 2024-09-10T05:40:03.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.093+0000 7f2e739fd640 1 -- 172.21.15.2:0/353893303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e6c12bff0 con 0x7f2e6c12bc10 2024-09-10T05:40:03.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.093+0000 7f2e69ffb640 1 -- 172.21.15.2:0/353893303 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2e640126d0 con 0x7f2e6c12bc10 2024-09-10T05:40:03.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.093+0000 7f2e69ffb640 1 --2- 172.21.15.2:0/353893303 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2e5803b1d0 0x7f2e5803d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:40:03.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.093+0000 7f2e69ffb640 1 -- 172.21.15.2:0/353893303 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7f2e6404fca0 con 0x7f2e6c12bc10 2024-09-10T05:40:03.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.093+0000 7f2e70f98640 1 --2- 172.21.15.2:0/353893303 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2e5803b1d0 0x7f2e5803d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:40:03.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.093+0000 7f2e70f98640 1 --2- 172.21.15.2:0/353893303 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2e5803b1d0 0x7f2e5803d690 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f2e600ad000 tx=0x7f2e60008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:40:03.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.097+0000 7f2e69ffb640 1 -- 172.21.15.2:0/353893303 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f2e6401a360 con 0x7f2e6c12bc10 2024-09-10T05:40:03.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.265+0000 7f2e739fd640 1 -- 172.21.15.2:0/353893303 --> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f2e6c11d370 con 0x7f2e5803b1d0 2024-09-10T05:40:03.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.269+0000 7f2e69ffb640 1 -- 172.21.15.2:0/353893303 <== mgr.4101 v2:172.21.15.62:6824/3663628807 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2e6c11d370 con 0x7f2e5803b1d0 2024-09-10T05:40:03.271 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 3 to deep-scrub 2024-09-10T05:40:03.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.269+0000 7f2e739fd640 1 -- 172.21.15.2:0/353893303 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2e5803b1d0 msgr2=0x7f2e5803d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:40:03.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.269+0000 7f2e739fd640 1 --2- 172.21.15.2:0/353893303 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2e5803b1d0 0x7f2e5803d690 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f2e600ad000 tx=0x7f2e60008040 comp rx=0 tx=0).stop 2024-09-10T05:40:03.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.269+0000 7f2e739fd640 1 -- 172.21.15.2:0/353893303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e6c12bc10 msgr2=0x7f2e6c12a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:40:03.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.269+0000 7f2e739fd640 1 --2- 172.21.15.2:0/353893303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e6c12bc10 0x7f2e6c12a650 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f2e6400cb40 tx=0x7f2e6400a060 comp rx=0 tx=0).stop 2024-09-10T05:40:03.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.269+0000 7f2e739fd640 1 -- 172.21.15.2:0/353893303 shutdown_connections 2024-09-10T05:40:03.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.269+0000 7f2e739fd640 1 --2- 172.21.15.2:0/353893303 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f2e5803b1d0 0x7f2e5803d690 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:40:03.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.269+0000 7f2e739fd640 1 --2- 172.21.15.2:0/353893303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e6c12bc10 0x7f2e6c12a650 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:40:03.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.269+0000 7f2e739fd640 1 -- 172.21.15.2:0/353893303 >> 172.21.15.2:0/353893303 conn(0x7f2e6c0a0a60 msgr2=0x7f2e6c070810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:40:03.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.269+0000 7f2e739fd640 1 -- 172.21.15.2:0/353893303 shutdown_connections 2024-09-10T05:40:03.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.269+0000 7f2e739fd640 1 -- 172.21.15.2:0/353893303 wait complete. 2024-09-10T05:40:03.290 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T05:40:03.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.397+0000 7fcdb7bac640 1 Processor -- start 2024-09-10T05:40:03.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.401+0000 7fcdb7bac640 1 -- start start 2024-09-10T05:40:03.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.401+0000 7fcdb7bac640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcdb0110da0 0x7fcdb0111180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:40:03.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.401+0000 7fcdb7bac640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdb0112730 con 0x7fcdb01116c0 2024-09-10T05:40:03.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.401+0000 7fcdb7bac640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fcdb0073a90 con 0x7fcdb0110da0 2024-09-10T05:40:03.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.401+0000 7fcdb5948640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcdb0110da0 0x7fcdb0111180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:40:03.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.401+0000 7fcdb5147640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fcdb01116c0 0x7fcdb012be90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48688/0 (socket says 172.21.15.2:48688) 2024-09-10T05:40:03.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.401+0000 7fcdb5147640 1 -- 172.21.15.2:0/3883236230 learned_addr learned my addr 172.21.15.2:0/3883236230 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T05:40:03.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.401+0000 7fcdb5948640 1 -- 172.21.15.2:0/3883236230 >> v1:172.21.15.2:6789/0 conn(0x7fcdb01116c0 legacy=0x7fcdb012be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:40:03.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.401+0000 7fcdb5948640 1 -- 172.21.15.2:0/3883236230 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdb0112b70 con 0x7fcdb0110da0 2024-09-10T05:40:03.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.401+0000 7fcdb4946640 1 -- 172.21.15.2:0/3883236230 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2656357526 0 0) 0x7fcda0001120 con 0x7fcdb01116c0 2024-09-10T05:40:03.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.401+0000 7fcdb5948640 1 --2- 172.21.15.2:0/3883236230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdb0110da0 0x7fcdb0111180 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fcdac009740 tx=0x7fcdac01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=487d5a799989a493 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:40:03.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.401+0000 7fcdb4946640 1 -- 172.21.15.2:0/3883236230 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdac0b0070 con 0x7fcdb0110da0 2024-09-10T05:40:03.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.401+0000 7fcdb4946640 1 -- 172.21.15.2:0/3883236230 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdac0ab530 con 0x7fcdb0110da0 2024-09-10T05:40:03.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.401+0000 7fcdb4946640 1 -- 172.21.15.2:0/3883236230 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdac0ab830 con 0x7fcdb0110da0 2024-09-10T05:40:03.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.401+0000 7fcdb7bac640 1 -- 172.21.15.2:0/3883236230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdb0110da0 msgr2=0x7fcdb0111180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:40:03.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.401+0000 7fcdb7bac640 1 --2- 172.21.15.2:0/3883236230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdb0110da0 0x7fcdb0111180 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fcdac009740 tx=0x7fcdac01c370 comp rx=0 tx=0).stop 2024-09-10T05:40:03.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.401+0000 7fcdb7bac640 1 -- 172.21.15.2:0/3883236230 shutdown_connections 2024-09-10T05:40:03.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.401+0000 7fcdb7bac640 1 --2- 172.21.15.2:0/3883236230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdb0110da0 0x7fcdb0111180 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:40:03.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.401+0000 7fcdb7bac640 1 -- 172.21.15.2:0/3883236230 >> 172.21.15.2:0/3883236230 conn(0x7fcdb0070900 msgr2=0x7fcdb0072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:40:03.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.401+0000 7fcdb7bac640 1 -- 172.21.15.2:0/3883236230 shutdown_connections 2024-09-10T05:40:03.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.401+0000 7fcdb7bac640 1 -- 172.21.15.2:0/3883236230 wait complete. 2024-09-10T05:40:03.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.405+0000 7fcdb7bac640 1 Processor -- start 2024-09-10T05:40:03.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.405+0000 7fcdb7bac640 1 -- start start 2024-09-10T05:40:03.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.405+0000 7fcdb7bac640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdb0110da0 0x7fcdb01c7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:40:03.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.405+0000 7fcdb7bac640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcdb0138310 con 0x7fcdb0110da0 2024-09-10T05:40:03.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.405+0000 7fcdb5948640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdb0110da0 0x7fcdb01c7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:40:03.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.405+0000 7fcdb5948640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdb0110da0 0x7fcdb01c7590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35624/0 (socket says 172.21.15.2:35624) 2024-09-10T05:40:03.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.405+0000 7fcdb5948640 1 -- 172.21.15.2:0/2469824482 learned_addr learned my addr 172.21.15.2:0/2469824482 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:40:03.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.405+0000 7fcdb5948640 1 -- 172.21.15.2:0/2469824482 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdb011ce00 con 0x7fcdb0110da0 2024-09-10T05:40:03.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.405+0000 7fcdb5948640 1 --2- 172.21.15.2:0/2469824482 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdb0110da0 0x7fcdb01c7590 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fcdac019fa0 tx=0x7fcdac01abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:40:03.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.405+0000 7fcda67fc640 1 -- 172.21.15.2:0/2469824482 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdac0bb070 con 0x7fcdb0110da0 2024-09-10T05:40:03.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.405+0000 7fcda67fc640 1 -- 172.21.15.2:0/2469824482 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdac004020 con 0x7fcdb0110da0 2024-09-10T05:40:03.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.405+0000 7fcdb7bac640 1 -- 172.21.15.2:0/2469824482 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdb011b800 con 0x7fcdb0110da0 2024-09-10T05:40:03.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.405+0000 7fcda67fc640 1 -- 172.21.15.2:0/2469824482 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdac0b0040 con 0x7fcdb0110da0 2024-09-10T05:40:03.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.405+0000 7fcdb7bac640 1 -- 172.21.15.2:0/2469824482 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdb01c7ca0 con 0x7fcdb0110da0 2024-09-10T05:40:03.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.405+0000 7fcdb7bac640 1 -- 172.21.15.2:0/2469824482 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdb011be00 con 0x7fcdb0110da0 2024-09-10T05:40:03.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.405+0000 7fcda67fc640 1 -- 172.21.15.2:0/2469824482 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fcdac004300 con 0x7fcdb0110da0 2024-09-10T05:40:03.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.405+0000 7fcda67fc640 1 --2- 172.21.15.2:0/2469824482 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fcd9403b1d0 0x7fcd9403d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:40:03.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.405+0000 7fcda67fc640 1 -- 172.21.15.2:0/2469824482 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7fcdac0ea0f0 con 0x7fcdb0110da0 2024-09-10T05:40:03.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.405+0000 7fcdb5147640 1 --2- 172.21.15.2:0/2469824482 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fcd9403b1d0 0x7fcd9403d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:40:03.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.409+0000 7fcdb5147640 1 --2- 172.21.15.2:0/2469824482 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fcd9403b1d0 0x7fcd9403d690 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fcda0000c10 tx=0x7fcda0001260 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:40:03.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.409+0000 7fcda67fc640 1 -- 172.21.15.2:0/2469824482 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fcdac015ff0 con 0x7fcdb0110da0 2024-09-10T05:40:03.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.581+0000 7fcdb7bac640 1 -- 172.21.15.2:0/2469824482 --> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcdb0114400 con 0x7fcd9403b1d0 2024-09-10T05:40:03.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.617+0000 7fcda67fc640 1 -- 172.21.15.2:0/2469824482 <== mgr.4101 v2:172.21.15.62:6824/3663628807 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665554 (secure 0 0 0) 0x7fcda00058e0 con 0x7fcd9403b1d0 2024-09-10T05:40:03.626 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T05:40:03.632 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-10T05:40:03.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.621+0000 7fcdb7bac640 1 -- 172.21.15.2:0/2469824482 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fcd9403b1d0 msgr2=0x7fcd9403d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:40:03.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.621+0000 7fcdb7bac640 1 --2- 172.21.15.2:0/2469824482 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fcd9403b1d0 0x7fcd9403d690 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fcda0000c10 tx=0x7fcda0001260 comp rx=0 tx=0).stop 2024-09-10T05:40:03.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.621+0000 7fcdb7bac640 1 -- 172.21.15.2:0/2469824482 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdb0110da0 msgr2=0x7fcdb01c7590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:40:03.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.621+0000 7fcdb7bac640 1 --2- 172.21.15.2:0/2469824482 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdb0110da0 0x7fcdb01c7590 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fcdac019fa0 tx=0x7fcdac01abb0 comp rx=0 tx=0).stop 2024-09-10T05:40:03.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.621+0000 7fcdb7bac640 1 -- 172.21.15.2:0/2469824482 shutdown_connections 2024-09-10T05:40:03.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.621+0000 7fcdb7bac640 1 --2- 172.21.15.2:0/2469824482 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fcd9403b1d0 0x7fcd9403d690 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:40:03.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.621+0000 7fcdb7bac640 1 --2- 172.21.15.2:0/2469824482 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdb0110da0 0x7fcdb01c7590 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:40:03.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.621+0000 7fcdb7bac640 1 -- 172.21.15.2:0/2469824482 >> 172.21.15.2:0/2469824482 conn(0x7fcdb0070900 msgr2=0x7fcdb0070ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:40:03.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.621+0000 7fcdb7bac640 1 -- 172.21.15.2:0/2469824482 shutdown_connections 2024-09-10T05:40:03.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:03.621+0000 7fcdb7bac640 1 -- 172.21.15.2:0/2469824482 wait complete. 2024-09-10T05:40:03.643 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":153,"stamp":"2024-09-10T05:40:01.697863+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":18024208,"num_objects":259,"num_object_clones":0,"num_object_copies":518,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":259,"num_whiteouts":0,"num_read":5272,"num_read_kb":4824,"num_write":2258,"num_write_kb":60587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":639982,"num_keys_recovered":1,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4658,"ondisk_log_size":4658,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":174160,"kb_used_data":36944,"kb_used_omap":6,"kb_used_meta":137145,"kb_avail":377313200,"statfs":{"total":386547056640,"available":386368716800,"internally_reserved":0,"allocated":37830656,"data_stored":36611448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":140437270},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8388608,"num_objects":-2,"num_object_clones":0,"num_object_copies":-4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007131"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.898799+0000","last_change":"2024-09-10T05:36:11.606846+0000","last_active":"2024-09-10T05:37:55.898799+0000","last_peered":"2024-09-10T05:37:55.898799+0000","last_clean":"2024-09-10T05:37:55.898799+0000","last_became_active":"2024-09-10T05:36:11.605721+0000","last_became_peered":"2024-09-10T05:36:11.605721+0000","last_unstale":"2024-09-10T05:37:55.898799+0000","last_undegraded":"2024-09-10T05:37:55.898799+0000","last_fullsized":"2024-09-10T05:37:55.898799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:44:08.530179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"30'2","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.900982+0000","last_change":"2024-09-10T05:36:13.628621+0000","last_active":"2024-09-10T05:37:55.900982+0000","last_peered":"2024-09-10T05:37:55.900982+0000","last_clean":"2024-09-10T05:37:55.900982+0000","last_became_active":"2024-09-10T05:36:13.628174+0000","last_became_peered":"2024-09-10T05:36:13.628174+0000","last_unstale":"2024-09-10T05:37:55.900982+0000","last_undegraded":"2024-09-10T05:37:55.900982+0000","last_fullsized":"2024-09-10T05:37:55.900982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:47.128005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"30'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.856072+0000","last_change":"2024-09-10T05:36:11.596391+0000","last_active":"2024-09-10T05:37:53.856072+0000","last_peered":"2024-09-10T05:37:53.856072+0000","last_clean":"2024-09-10T05:37:53.856072+0000","last_became_active":"2024-09-10T05:36:11.596100+0000","last_became_peered":"2024-09-10T05:36:11.596100+0000","last_unstale":"2024-09-10T05:37:53.856072+0000","last_undegraded":"2024-09-10T05:37:53.856072+0000","last_fullsized":"2024-09-10T05:37:53.856072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:45:53.700310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"34'5","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:43.687749+0000","last_change":"2024-09-10T05:36:13.601197+0000","last_active":"2024-09-10T05:38:43.687749+0000","last_peered":"2024-09-10T05:38:43.687749+0000","last_clean":"2024-09-10T05:38:43.687749+0000","last_became_active":"2024-09-10T05:36:13.598320+0000","last_became_peered":"2024-09-10T05:36:13.598320+0000","last_unstale":"2024-09-10T05:38:43.687749+0000","last_undegraded":"2024-09-10T05:38:43.687749+0000","last_fullsized":"2024-09-10T05:38:43.687749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:38:17.550395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.726285+0000","last_change":"2024-09-10T05:36:11.604217+0000","last_active":"2024-09-10T05:37:53.726285+0000","last_peered":"2024-09-10T05:37:53.726285+0000","last_clean":"2024-09-10T05:37:53.726285+0000","last_became_active":"2024-09-10T05:36:11.603193+0000","last_became_peered":"2024-09-10T05:36:11.603193+0000","last_unstale":"2024-09-10T05:37:53.726285+0000","last_undegraded":"2024-09-10T05:37:53.726285+0000","last_fullsized":"2024-09-10T05:37:53.726285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:09:46.125040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'10","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.200739+0000","last_change":"2024-09-10T05:36:13.604439+0000","last_active":"2024-09-10T05:39:27.200739+0000","last_peered":"2024-09-10T05:39:27.200739+0000","last_clean":"2024-09-10T05:39:27.200739+0000","last_became_active":"2024-09-10T05:36:13.604094+0000","last_became_peered":"2024-09-10T05:36:13.604094+0000","last_unstale":"2024-09-10T05:39:27.200739+0000","last_undegraded":"2024-09-10T05:39:27.200739+0000","last_fullsized":"2024-09-10T05:39:27.200739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:17:01.676891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.713626+0000","last_change":"2024-09-10T05:36:11.611784+0000","last_active":"2024-09-10T05:37:53.713626+0000","last_peered":"2024-09-10T05:37:53.713626+0000","last_clean":"2024-09-10T05:37:53.713626+0000","last_became_active":"2024-09-10T05:36:11.611399+0000","last_became_peered":"2024-09-10T05:36:11.611399+0000","last_unstale":"2024-09-10T05:37:53.713626+0000","last_undegraded":"2024-09-10T05:37:53.713626+0000","last_fullsized":"2024-09-10T05:37:53.713626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:34:57.058604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'10","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.363850+0000","last_change":"2024-09-10T05:36:52.703620+0000","last_active":"2024-09-10T05:39:27.363850+0000","last_peered":"2024-09-10T05:39:27.363850+0000","last_clean":"2024-09-10T05:39:27.363850+0000","last_became_active":"2024-09-10T05:36:52.702713+0000","last_became_peered":"2024-09-10T05:36:52.702713+0000","last_unstale":"2024-09-10T05:39:27.363850+0000","last_undegraded":"2024-09-10T05:39:27.363850+0000","last_fullsized":"2024-09-10T05:39:27.363850+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:09:12.955195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.897222+0000","last_change":"2024-09-10T05:36:11.598408+0000","last_active":"2024-09-10T05:37:55.897222+0000","last_peered":"2024-09-10T05:37:55.897222+0000","last_clean":"2024-09-10T05:37:55.897222+0000","last_became_active":"2024-09-10T05:36:11.597514+0000","last_became_peered":"2024-09-10T05:36:11.597514+0000","last_unstale":"2024-09-10T05:37:55.897222+0000","last_undegraded":"2024-09-10T05:37:55.897222+0000","last_fullsized":"2024-09-10T05:37:55.897222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:23.782584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"34'11","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.024907+0000","last_change":"2024-09-10T05:36:13.622714+0000","last_active":"2024-09-10T05:39:27.024907+0000","last_peered":"2024-09-10T05:39:27.024907+0000","last_clean":"2024-09-10T05:39:27.024907+0000","last_became_active":"2024-09-10T05:36:13.621573+0000","last_became_peered":"2024-09-10T05:36:13.621573+0000","last_unstale":"2024-09-10T05:39:27.024907+0000","last_undegraded":"2024-09-10T05:39:27.024907+0000","last_fullsized":"2024-09-10T05:39:27.024907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:33.906083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.902223+0000","last_change":"2024-09-10T05:36:52.704991+0000","last_active":"2024-09-10T05:37:55.902223+0000","last_peered":"2024-09-10T05:37:55.902223+0000","last_clean":"2024-09-10T05:37:55.902223+0000","last_became_active":"2024-09-10T05:36:52.704285+0000","last_became_peered":"2024-09-10T05:36:52.704285+0000","last_unstale":"2024-09-10T05:37:55.902223+0000","last_undegraded":"2024-09-10T05:37:55.902223+0000","last_fullsized":"2024-09-10T05:37:55.902223+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:31:44.000002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.905524+0000","last_change":"2024-09-10T05:36:13.613130+0000","last_active":"2024-09-10T05:37:55.905524+0000","last_peered":"2024-09-10T05:37:55.905524+0000","last_clean":"2024-09-10T05:37:55.905524+0000","last_became_active":"2024-09-10T05:36:13.612127+0000","last_became_peered":"2024-09-10T05:36:13.612127+0000","last_unstale":"2024-09-10T05:37:55.905524+0000","last_undegraded":"2024-09-10T05:37:55.905524+0000","last_fullsized":"2024-09-10T05:37:55.905524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:55:15.649785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.723024+0000","last_change":"2024-09-10T05:36:11.598434+0000","last_active":"2024-09-10T05:37:53.723024+0000","last_peered":"2024-09-10T05:37:53.723024+0000","last_clean":"2024-09-10T05:37:53.723024+0000","last_became_active":"2024-09-10T05:36:11.598054+0000","last_became_peered":"2024-09-10T05:36:11.598054+0000","last_unstale":"2024-09-10T05:37:53.723024+0000","last_undegraded":"2024-09-10T05:37:53.723024+0000","last_fullsized":"2024-09-10T05:37:53.723024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:15:17.547203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'8","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.905442+0000","last_change":"2024-09-10T05:36:13.613557+0000","last_active":"2024-09-10T05:37:55.905442+0000","last_peered":"2024-09-10T05:37:55.905442+0000","last_clean":"2024-09-10T05:37:55.905442+0000","last_became_active":"2024-09-10T05:36:13.612743+0000","last_became_peered":"2024-09-10T05:36:13.612743+0000","last_unstale":"2024-09-10T05:37:55.905442+0000","last_undegraded":"2024-09-10T05:37:55.905442+0000","last_fullsized":"2024-09-10T05:37:55.905442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:46:09.360826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.721935+0000","last_change":"2024-09-10T05:36:11.593912+0000","last_active":"2024-09-10T05:37:53.721935+0000","last_peered":"2024-09-10T05:37:53.721935+0000","last_clean":"2024-09-10T05:37:53.721935+0000","last_became_active":"2024-09-10T05:36:11.593454+0000","last_became_peered":"2024-09-10T05:36:11.593454+0000","last_unstale":"2024-09-10T05:37:53.721935+0000","last_undegraded":"2024-09-10T05:37:53.721935+0000","last_fullsized":"2024-09-10T05:37:53.721935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:50:30.548750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"34'10","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.861683+0000","last_change":"2024-09-10T05:36:13.621644+0000","last_active":"2024-09-10T05:39:26.861683+0000","last_peered":"2024-09-10T05:39:26.861683+0000","last_clean":"2024-09-10T05:39:26.861683+0000","last_became_active":"2024-09-10T05:36:13.621362+0000","last_became_peered":"2024-09-10T05:36:13.621362+0000","last_unstale":"2024-09-10T05:39:26.861683+0000","last_undegraded":"2024-09-10T05:39:26.861683+0000","last_fullsized":"2024-09-10T05:39:26.861683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:44:10.159543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.295664+0000","last_change":"2024-09-10T05:36:13.628746+0000","last_active":"2024-09-10T05:39:27.295664+0000","last_peered":"2024-09-10T05:39:27.295664+0000","last_clean":"2024-09-10T05:39:27.295664+0000","last_became_active":"2024-09-10T05:36:13.628203+0000","last_became_peered":"2024-09-10T05:36:13.628203+0000","last_unstale":"2024-09-10T05:39:27.295664+0000","last_undegraded":"2024-09-10T05:39:27.295664+0000","last_fullsized":"2024-09-10T05:39:27.295664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:15:01.197465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"30'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.860067+0000","last_change":"2024-09-10T05:36:11.595338+0000","last_active":"2024-09-10T05:37:53.860067+0000","last_peered":"2024-09-10T05:37:53.860067+0000","last_clean":"2024-09-10T05:37:53.860067+0000","last_became_active":"2024-09-10T05:36:11.594409+0000","last_became_peered":"2024-09-10T05:36:11.594409+0000","last_unstale":"2024-09-10T05:37:53.860067+0000","last_undegraded":"2024-09-10T05:37:53.860067+0000","last_fullsized":"2024-09-10T05:37:53.860067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:40:54.327881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'8","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.314170+0000","last_change":"2024-09-10T05:36:13.620594+0000","last_active":"2024-09-10T05:39:27.314170+0000","last_peered":"2024-09-10T05:39:27.314170+0000","last_clean":"2024-09-10T05:39:27.314170+0000","last_became_active":"2024-09-10T05:36:13.619905+0000","last_became_peered":"2024-09-10T05:36:13.619905+0000","last_unstale":"2024-09-10T05:39:27.314170+0000","last_undegraded":"2024-09-10T05:39:27.314170+0000","last_fullsized":"2024-09-10T05:39:27.314170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:43:07.884535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.716388+0000","last_change":"2024-09-10T05:36:11.612156+0000","last_active":"2024-09-10T05:37:53.716388+0000","last_peered":"2024-09-10T05:37:53.716388+0000","last_clean":"2024-09-10T05:37:53.716388+0000","last_became_active":"2024-09-10T05:36:11.611735+0000","last_became_peered":"2024-09-10T05:36:11.611735+0000","last_unstale":"2024-09-10T05:37:53.716388+0000","last_undegraded":"2024-09-10T05:37:53.716388+0000","last_fullsized":"2024-09-10T05:37:53.716388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:25:27.078667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'18","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.364017+0000","last_change":"2024-09-10T05:36:13.625084+0000","last_active":"2024-09-10T05:39:27.364017+0000","last_peered":"2024-09-10T05:39:27.364017+0000","last_clean":"2024-09-10T05:39:27.364017+0000","last_became_active":"2024-09-10T05:36:13.624358+0000","last_became_peered":"2024-09-10T05:36:13.624358+0000","last_unstale":"2024-09-10T05:39:27.364017+0000","last_undegraded":"2024-09-10T05:39:27.364017+0000","last_fullsized":"2024-09-10T05:39:27.364017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:03:25.809000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":77,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"34'4","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.188377+0000","last_change":"2024-09-10T05:36:11.608840+0000","last_active":"2024-09-10T05:39:27.188377+0000","last_peered":"2024-09-10T05:39:27.188377+0000","last_clean":"2024-09-10T05:39:27.188377+0000","last_became_active":"2024-09-10T05:36:11.608244+0000","last_became_peered":"2024-09-10T05:36:11.608244+0000","last_unstale":"2024-09-10T05:39:27.188377+0000","last_undegraded":"2024-09-10T05:39:27.188377+0000","last_fullsized":"2024-09-10T05:39:27.188377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:54:31.346128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"32'24","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.714987+0000","last_change":"2024-09-10T05:36:13.614877+0000","last_active":"2024-09-10T05:37:53.714987+0000","last_peered":"2024-09-10T05:37:53.714987+0000","last_clean":"2024-09-10T05:37:53.714987+0000","last_became_active":"2024-09-10T05:36:13.613298+0000","last_became_peered":"2024-09-10T05:36:13.613298+0000","last_unstale":"2024-09-10T05:37:53.714987+0000","last_undegraded":"2024-09-10T05:37:53.714987+0000","last_fullsized":"2024-09-10T05:37:53.714987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:36:36.280933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":77,"num_write":32,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"32'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.896973+0000","last_change":"2024-09-10T05:36:11.600946+0000","last_active":"2024-09-10T05:37:55.896973+0000","last_peered":"2024-09-10T05:37:55.896973+0000","last_clean":"2024-09-10T05:37:55.896973+0000","last_became_active":"2024-09-10T05:36:11.600159+0000","last_became_peered":"2024-09-10T05:36:11.600159+0000","last_unstale":"2024-09-10T05:37:55.896973+0000","last_undegraded":"2024-09-10T05:37:55.896973+0000","last_fullsized":"2024-09-10T05:37:55.896973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:17:55.025975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"34'10","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.465170+0000","last_change":"2024-09-10T05:36:13.610326+0000","last_active":"2024-09-10T05:39:27.465170+0000","last_peered":"2024-09-10T05:39:27.465170+0000","last_clean":"2024-09-10T05:39:27.465170+0000","last_became_active":"2024-09-10T05:36:13.605913+0000","last_became_peered":"2024-09-10T05:36:13.605913+0000","last_unstale":"2024-09-10T05:39:27.465170+0000","last_undegraded":"2024-09-10T05:39:27.465170+0000","last_fullsized":"2024-09-10T05:39:27.465170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:40:06.248271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"34'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:17.692508+0000","last_change":"2024-09-10T05:36:52.721595+0000","last_active":"2024-09-10T05:39:17.692508+0000","last_peered":"2024-09-10T05:39:17.692508+0000","last_clean":"2024-09-10T05:39:17.692508+0000","last_became_active":"2024-09-10T05:36:52.701277+0000","last_became_peered":"2024-09-10T05:36:52.701277+0000","last_unstale":"2024-09-10T05:39:17.692508+0000","last_undegraded":"2024-09-10T05:39:17.692508+0000","last_fullsized":"2024-09-10T05:39:17.692508+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:20:16.743547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3,"num_write_kb":1250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":639872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.855635+0000","last_change":"2024-09-10T05:36:13.600360+0000","last_active":"2024-09-10T05:37:53.855635+0000","last_peered":"2024-09-10T05:37:53.855635+0000","last_clean":"2024-09-10T05:37:53.855635+0000","last_became_active":"2024-09-10T05:36:13.599955+0000","last_became_peered":"2024-09-10T05:36:13.599955+0000","last_unstale":"2024-09-10T05:37:53.855635+0000","last_undegraded":"2024-09-10T05:37:53.855635+0000","last_fullsized":"2024-09-10T05:37:53.855635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:12:25.023354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.158891+0000","last_change":"2024-09-10T05:36:11.606469+0000","last_active":"2024-09-10T05:39:27.158891+0000","last_peered":"2024-09-10T05:39:27.158891+0000","last_clean":"2024-09-10T05:39:27.158891+0000","last_became_active":"2024-09-10T05:36:11.603982+0000","last_became_peered":"2024-09-10T05:36:11.603982+0000","last_unstale":"2024-09-10T05:39:27.158891+0000","last_undegraded":"2024-09-10T05:39:27.158891+0000","last_fullsized":"2024-09-10T05:39:27.158891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:27:57.248963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'35","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.250994+0000","last_change":"2024-09-10T05:36:21.673756+0000","last_active":"2024-09-10T05:39:27.250994+0000","last_peered":"2024-09-10T05:39:27.250994+0000","last_clean":"2024-09-10T05:39:27.250994+0000","last_became_active":"2024-09-10T05:36:21.672975+0000","last_became_peered":"2024-09-10T05:36:21.672975+0000","last_unstale":"2024-09-10T05:39:27.250994+0000","last_undegraded":"2024-09-10T05:39:27.250994+0000","last_fullsized":"2024-09-10T05:39:27.250994+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:09:28.929715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'10","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.200652+0000","last_change":"2024-09-10T05:36:13.616306+0000","last_active":"2024-09-10T05:39:27.200652+0000","last_peered":"2024-09-10T05:39:27.200652+0000","last_clean":"2024-09-10T05:39:27.200652+0000","last_became_active":"2024-09-10T05:36:13.616006+0000","last_became_peered":"2024-09-10T05:36:13.616006+0000","last_unstale":"2024-09-10T05:39:27.200652+0000","last_undegraded":"2024-09-10T05:39:27.200652+0000","last_fullsized":"2024-09-10T05:39:27.200652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:12:47.354260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.725430+0000","last_change":"2024-09-10T05:36:11.606773+0000","last_active":"2024-09-10T05:37:53.725430+0000","last_peered":"2024-09-10T05:37:53.725430+0000","last_clean":"2024-09-10T05:37:53.725430+0000","last_became_active":"2024-09-10T05:36:11.601101+0000","last_became_peered":"2024-09-10T05:36:11.601101+0000","last_unstale":"2024-09-10T05:37:53.725430+0000","last_undegraded":"2024-09-10T05:37:53.725430+0000","last_fullsized":"2024-09-10T05:37:53.725430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:18:28.907356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.727535+0000","last_change":"2024-09-10T05:36:15.626686+0000","last_active":"2024-09-10T05:37:53.727535+0000","last_peered":"2024-09-10T05:37:53.727535+0000","last_clean":"2024-09-10T05:37:53.727535+0000","last_became_active":"2024-09-10T05:36:15.626172+0000","last_became_peered":"2024-09-10T05:36:15.626172+0000","last_unstale":"2024-09-10T05:37:53.727535+0000","last_undegraded":"2024-09-10T05:37:53.727535+0000","last_fullsized":"2024-09-10T05:37:53.727535+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:39:20.579324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'45","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.479585+0000","last_change":"2024-09-10T05:36:17.640065+0000","last_active":"2024-09-10T05:39:58.479585+0000","last_peered":"2024-09-10T05:39:58.479585+0000","last_clean":"2024-09-10T05:39:58.479585+0000","last_became_active":"2024-09-10T05:36:17.639318+0000","last_became_peered":"2024-09-10T05:36:17.639318+0000","last_unstale":"2024-09-10T05:39:58.479585+0000","last_undegraded":"2024-09-10T05:39:58.479585+0000","last_fullsized":"2024-09-10T05:39:58.479585+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:05:59.617319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.898449+0000","last_change":"2024-09-10T05:36:19.648793+0000","last_active":"2024-09-10T05:37:55.898449+0000","last_peered":"2024-09-10T05:37:55.898449+0000","last_clean":"2024-09-10T05:37:55.898449+0000","last_became_active":"2024-09-10T05:36:19.647998+0000","last_became_peered":"2024-09-10T05:36:19.647998+0000","last_unstale":"2024-09-10T05:37:55.898449+0000","last_undegraded":"2024-09-10T05:37:55.898449+0000","last_fullsized":"2024-09-10T05:37:55.898449+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:14:38.933277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"32'9","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.899552+0000","last_change":"2024-09-10T05:36:21.673262+0000","last_active":"2024-09-10T05:37:55.899552+0000","last_peered":"2024-09-10T05:37:55.899552+0000","last_clean":"2024-09-10T05:37:55.899552+0000","last_became_active":"2024-09-10T05:36:21.672757+0000","last_became_peered":"2024-09-10T05:36:21.672757+0000","last_unstale":"2024-09-10T05:37:55.899552+0000","last_undegraded":"2024-09-10T05:37:55.899552+0000","last_fullsized":"2024-09-10T05:37:55.899552+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:49:20.130241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"32'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.727360+0000","last_change":"2024-09-10T05:36:13.598805+0000","last_active":"2024-09-10T05:37:53.727360+0000","last_peered":"2024-09-10T05:37:53.727360+0000","last_clean":"2024-09-10T05:37:53.727360+0000","last_became_active":"2024-09-10T05:36:13.597649+0000","last_became_peered":"2024-09-10T05:36:13.597649+0000","last_unstale":"2024-09-10T05:37:53.727360+0000","last_undegraded":"2024-09-10T05:37:53.727360+0000","last_fullsized":"2024-09-10T05:37:53.727360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:02:19.101449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.711943+0000","last_change":"2024-09-10T05:36:11.611702+0000","last_active":"2024-09-10T05:37:53.711943+0000","last_peered":"2024-09-10T05:37:53.711943+0000","last_clean":"2024-09-10T05:37:53.711943+0000","last_became_active":"2024-09-10T05:36:11.611326+0000","last_became_peered":"2024-09-10T05:36:11.611326+0000","last_unstale":"2024-09-10T05:37:53.711943+0000","last_undegraded":"2024-09-10T05:37:53.711943+0000","last_fullsized":"2024-09-10T05:37:53.711943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:06:03.034626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.725805+0000","last_change":"2024-09-10T05:36:15.608668+0000","last_active":"2024-09-10T05:37:53.725805+0000","last_peered":"2024-09-10T05:37:53.725805+0000","last_clean":"2024-09-10T05:37:53.725805+0000","last_became_active":"2024-09-10T05:36:15.607918+0000","last_became_peered":"2024-09-10T05:36:15.607918+0000","last_unstale":"2024-09-10T05:37:53.725805+0000","last_undegraded":"2024-09-10T05:37:53.725805+0000","last_fullsized":"2024-09-10T05:37:53.725805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:57.614009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"30'12","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.859373+0000","last_change":"2024-09-10T05:36:17.644680+0000","last_active":"2024-09-10T05:37:53.859373+0000","last_peered":"2024-09-10T05:37:53.859373+0000","last_clean":"2024-09-10T05:37:53.859373+0000","last_became_active":"2024-09-10T05:36:17.643856+0000","last_became_peered":"2024-09-10T05:36:17.643856+0000","last_unstale":"2024-09-10T05:37:53.859373+0000","last_undegraded":"2024-09-10T05:37:53.859373+0000","last_fullsized":"2024-09-10T05:37:53.859373+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:31:24.591766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.899864+0000","last_change":"2024-09-10T05:36:19.648357+0000","last_active":"2024-09-10T05:37:55.899864+0000","last_peered":"2024-09-10T05:37:55.899864+0000","last_clean":"2024-09-10T05:37:55.899864+0000","last_became_active":"2024-09-10T05:36:19.647612+0000","last_became_peered":"2024-09-10T05:36:19.647612+0000","last_unstale":"2024-09-10T05:37:55.899864+0000","last_undegraded":"2024-09-10T05:37:55.899864+0000","last_fullsized":"2024-09-10T05:37:55.899864+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:06:01.493680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"34'10","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.344196+0000","last_change":"2024-09-10T05:36:21.679828+0000","last_active":"2024-09-10T05:39:26.344196+0000","last_peered":"2024-09-10T05:39:26.344196+0000","last_clean":"2024-09-10T05:39:26.344196+0000","last_became_active":"2024-09-10T05:36:21.679052+0000","last_became_peered":"2024-09-10T05:36:21.679052+0000","last_unstale":"2024-09-10T05:39:26.344196+0000","last_undegraded":"2024-09-10T05:39:26.344196+0000","last_fullsized":"2024-09-10T05:39:26.344196+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:53.565670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.729075+0000","last_change":"2024-09-10T05:36:13.612634+0000","last_active":"2024-09-10T05:37:53.729075+0000","last_peered":"2024-09-10T05:37:53.729075+0000","last_clean":"2024-09-10T05:37:53.729075+0000","last_became_active":"2024-09-10T05:36:13.611935+0000","last_became_peered":"2024-09-10T05:36:13.611935+0000","last_unstale":"2024-09-10T05:37:53.729075+0000","last_undegraded":"2024-09-10T05:37:53.729075+0000","last_fullsized":"2024-09-10T05:37:53.729075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:11.305578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.897677+0000","last_change":"2024-09-10T05:36:11.596948+0000","last_active":"2024-09-10T05:37:55.897677+0000","last_peered":"2024-09-10T05:37:55.897677+0000","last_clean":"2024-09-10T05:37:55.897677+0000","last_became_active":"2024-09-10T05:36:11.596047+0000","last_became_peered":"2024-09-10T05:36:11.596047+0000","last_unstale":"2024-09-10T05:37:55.897677+0000","last_undegraded":"2024-09-10T05:37:55.897677+0000","last_fullsized":"2024-09-10T05:37:55.897677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:36:34.651568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.729520+0000","last_change":"2024-09-10T05:36:15.636316+0000","last_active":"2024-09-10T05:37:53.729520+0000","last_peered":"2024-09-10T05:37:53.729520+0000","last_clean":"2024-09-10T05:37:53.729520+0000","last_became_active":"2024-09-10T05:36:15.635534+0000","last_became_peered":"2024-09-10T05:36:15.635534+0000","last_unstale":"2024-09-10T05:37:53.729520+0000","last_undegraded":"2024-09-10T05:37:53.729520+0000","last_fullsized":"2024-09-10T05:37:53.729520+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:51:10.736802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"30'23","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.715019+0000","last_change":"2024-09-10T05:36:17.630853+0000","last_active":"2024-09-10T05:37:53.715019+0000","last_peered":"2024-09-10T05:37:53.715019+0000","last_clean":"2024-09-10T05:37:53.715019+0000","last_became_active":"2024-09-10T05:36:17.626936+0000","last_became_peered":"2024-09-10T05:36:17.626936+0000","last_unstale":"2024-09-10T05:37:53.715019+0000","last_undegraded":"2024-09-10T05:37:53.715019+0000","last_fullsized":"2024-09-10T05:37:53.715019+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:27:38.243510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'282","reported_seq":391,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.551691+0000","last_change":"2024-09-10T05:36:19.665303+0000","last_active":"2024-09-10T05:39:27.551691+0000","last_peered":"2024-09-10T05:39:27.551691+0000","last_clean":"2024-09-10T05:39:27.551691+0000","last_became_active":"2024-09-10T05:36:19.664741+0000","last_became_peered":"2024-09-10T05:36:19.664741+0000","last_unstale":"2024-09-10T05:39:27.551691+0000","last_undegraded":"2024-09-10T05:39:27.551691+0000","last_fullsized":"2024-09-10T05:39:27.551691+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:34:14.254885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"34'2","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:21.797711+0000","last_change":"2024-09-10T05:36:21.657298+0000","last_active":"2024-09-10T05:38:21.797711+0000","last_peered":"2024-09-10T05:38:21.797711+0000","last_clean":"2024-09-10T05:38:21.797711+0000","last_became_active":"2024-09-10T05:36:21.656522+0000","last_became_peered":"2024-09-10T05:36:21.656522+0000","last_unstale":"2024-09-10T05:38:21.797711+0000","last_undegraded":"2024-09-10T05:38:21.797711+0000","last_fullsized":"2024-09-10T05:38:21.797711+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:46:36.764173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'8","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.883202+0000","last_change":"2024-09-10T05:36:13.623674+0000","last_active":"2024-09-10T05:39:26.883202+0000","last_peered":"2024-09-10T05:39:26.883202+0000","last_clean":"2024-09-10T05:39:26.883202+0000","last_became_active":"2024-09-10T05:36:13.622771+0000","last_became_peered":"2024-09-10T05:36:13.622771+0000","last_unstale":"2024-09-10T05:39:26.883202+0000","last_undegraded":"2024-09-10T05:39:26.883202+0000","last_fullsized":"2024-09-10T05:39:26.883202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:10.534366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"32'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.898045+0000","last_change":"2024-09-10T05:36:11.598113+0000","last_active":"2024-09-10T05:37:55.898045+0000","last_peered":"2024-09-10T05:37:55.898045+0000","last_clean":"2024-09-10T05:37:55.898045+0000","last_became_active":"2024-09-10T05:36:11.596165+0000","last_became_peered":"2024-09-10T05:36:11.596165+0000","last_unstale":"2024-09-10T05:37:55.898045+0000","last_undegraded":"2024-09-10T05:37:55.898045+0000","last_fullsized":"2024-09-10T05:37:55.898045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:34.424848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.905564+0000","last_change":"2024-09-10T05:36:15.616568+0000","last_active":"2024-09-10T05:37:55.905564+0000","last_peered":"2024-09-10T05:37:55.905564+0000","last_clean":"2024-09-10T05:37:55.905564+0000","last_became_active":"2024-09-10T05:36:15.615994+0000","last_became_peered":"2024-09-10T05:36:15.615994+0000","last_unstale":"2024-09-10T05:37:55.905564+0000","last_undegraded":"2024-09-10T05:37:55.905564+0000","last_fullsized":"2024-09-10T05:37:55.905564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:15:00.093895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"34'36","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.012568+0000","last_change":"2024-09-10T05:36:17.631891+0000","last_active":"2024-09-10T05:38:24.012568+0000","last_peered":"2024-09-10T05:38:24.012568+0000","last_clean":"2024-09-10T05:38:24.012568+0000","last_became_active":"2024-09-10T05:36:17.631054+0000","last_became_peered":"2024-09-10T05:36:17.631054+0000","last_unstale":"2024-09-10T05:38:24.012568+0000","last_undegraded":"2024-09-10T05:38:24.012568+0000","last_fullsized":"2024-09-10T05:38:24.012568+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:59.553249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"34'284","reported_seq":409,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.368908+0000","last_change":"2024-09-10T05:36:19.671507+0000","last_active":"2024-09-10T05:39:58.368908+0000","last_peered":"2024-09-10T05:39:58.368908+0000","last_clean":"2024-09-10T05:39:58.368908+0000","last_became_active":"2024-09-10T05:36:19.670915+0000","last_became_peered":"2024-09-10T05:36:19.670915+0000","last_unstale":"2024-09-10T05:39:58.368908+0000","last_undegraded":"2024-09-10T05:39:58.368908+0000","last_fullsized":"2024-09-10T05:39:58.368908+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:35.175677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"34'8","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.859732+0000","last_change":"2024-09-10T05:36:13.598359+0000","last_active":"2024-09-10T05:39:26.859732+0000","last_peered":"2024-09-10T05:39:26.859732+0000","last_clean":"2024-09-10T05:39:26.859732+0000","last_became_active":"2024-09-10T05:36:13.597477+0000","last_became_peered":"2024-09-10T05:36:13.597477+0000","last_unstale":"2024-09-10T05:39:26.859732+0000","last_undegraded":"2024-09-10T05:39:26.859732+0000","last_fullsized":"2024-09-10T05:39:26.859732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:33.752285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.899248+0000","last_change":"2024-09-10T05:36:11.601343+0000","last_active":"2024-09-10T05:37:55.899248+0000","last_peered":"2024-09-10T05:37:55.899248+0000","last_clean":"2024-09-10T05:37:55.899248+0000","last_became_active":"2024-09-10T05:36:11.600405+0000","last_became_peered":"2024-09-10T05:36:11.600405+0000","last_unstale":"2024-09-10T05:37:55.899248+0000","last_undegraded":"2024-09-10T05:37:55.899248+0000","last_fullsized":"2024-09-10T05:37:55.899248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:06:53.012489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.857307+0000","last_change":"2024-09-10T05:36:15.624083+0000","last_active":"2024-09-10T05:37:53.857307+0000","last_peered":"2024-09-10T05:37:53.857307+0000","last_clean":"2024-09-10T05:37:53.857307+0000","last_became_active":"2024-09-10T05:36:15.620908+0000","last_became_peered":"2024-09-10T05:36:15.620908+0000","last_unstale":"2024-09-10T05:37:53.857307+0000","last_undegraded":"2024-09-10T05:37:53.857307+0000","last_fullsized":"2024-09-10T05:37:53.857307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:18:19.390635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'47","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.031891+0000","last_change":"2024-09-10T05:36:52.763550+0000","last_active":"2024-09-10T05:38:24.031891+0000","last_peered":"2024-09-10T05:38:24.031891+0000","last_clean":"2024-09-10T05:38:24.031891+0000","last_became_active":"2024-09-10T05:36:52.710284+0000","last_became_peered":"2024-09-10T05:36:52.710284+0000","last_unstale":"2024-09-10T05:38:24.031891+0000","last_undegraded":"2024-09-10T05:38:24.031891+0000","last_fullsized":"2024-09-10T05:38:24.031891+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:08.202725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.853131+0000","last_change":"2024-09-10T05:36:19.641236+0000","last_active":"2024-09-10T05:37:53.853131+0000","last_peered":"2024-09-10T05:37:53.853131+0000","last_clean":"2024-09-10T05:37:53.853131+0000","last_became_active":"2024-09-10T05:36:19.640470+0000","last_became_peered":"2024-09-10T05:36:19.640470+0000","last_unstale":"2024-09-10T05:37:53.853131+0000","last_undegraded":"2024-09-10T05:37:53.853131+0000","last_fullsized":"2024-09-10T05:37:53.853131+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:38.686660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"32'3","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.715202+0000","last_change":"2024-09-10T05:36:21.665615+0000","last_active":"2024-09-10T05:37:53.715202+0000","last_peered":"2024-09-10T05:37:53.715202+0000","last_clean":"2024-09-10T05:37:53.715202+0000","last_became_active":"2024-09-10T05:36:21.664232+0000","last_became_peered":"2024-09-10T05:36:21.664232+0000","last_unstale":"2024-09-10T05:37:53.715202+0000","last_undegraded":"2024-09-10T05:37:53.715202+0000","last_fullsized":"2024-09-10T05:37:53.715202+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:22:54.635544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'2","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.296681+0000","last_change":"2024-09-10T05:36:52.704557+0000","last_active":"2024-09-10T05:39:27.296681+0000","last_peered":"2024-09-10T05:39:27.296681+0000","last_clean":"2024-09-10T05:39:27.296681+0000","last_became_active":"2024-09-10T05:36:52.703743+0000","last_became_peered":"2024-09-10T05:36:52.703743+0000","last_unstale":"2024-09-10T05:39:27.296681+0000","last_undegraded":"2024-09-10T05:39:27.296681+0000","last_fullsized":"2024-09-10T05:39:27.296681+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:08:22.378233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.899208+0000","last_change":"2024-09-10T05:36:11.599409+0000","last_active":"2024-09-10T05:37:55.899208+0000","last_peered":"2024-09-10T05:37:55.899208+0000","last_clean":"2024-09-10T05:37:55.899208+0000","last_became_active":"2024-09-10T05:36:11.597717+0000","last_became_peered":"2024-09-10T05:36:11.597717+0000","last_unstale":"2024-09-10T05:37:55.899208+0000","last_undegraded":"2024-09-10T05:37:55.899208+0000","last_fullsized":"2024-09-10T05:37:55.899208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:31:10.630773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.712459+0000","last_change":"2024-09-10T05:36:15.632405+0000","last_active":"2024-09-10T05:37:53.712459+0000","last_peered":"2024-09-10T05:37:53.712459+0000","last_clean":"2024-09-10T05:37:53.712459+0000","last_became_active":"2024-09-10T05:36:15.631635+0000","last_became_peered":"2024-09-10T05:36:15.631635+0000","last_unstale":"2024-09-10T05:37:53.712459+0000","last_undegraded":"2024-09-10T05:37:53.712459+0000","last_fullsized":"2024-09-10T05:37:53.712459+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:17:58.666673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"34'39","reported_seq":96,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.638757+0000","last_change":"2024-09-10T05:36:17.638936+0000","last_active":"2024-09-10T05:39:58.638757+0000","last_peered":"2024-09-10T05:39:58.638757+0000","last_clean":"2024-09-10T05:39:58.638757+0000","last_became_active":"2024-09-10T05:36:17.638301+0000","last_became_peered":"2024-09-10T05:36:17.638301+0000","last_unstale":"2024-09-10T05:39:58.638757+0000","last_undegraded":"2024-09-10T05:39:58.638757+0000","last_fullsized":"2024-09-10T05:39:58.638757+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:17.394424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.725401+0000","last_change":"2024-09-10T05:36:19.671665+0000","last_active":"2024-09-10T05:37:53.725401+0000","last_peered":"2024-09-10T05:37:53.725401+0000","last_clean":"2024-09-10T05:37:53.725401+0000","last_became_active":"2024-09-10T05:36:19.671022+0000","last_became_peered":"2024-09-10T05:36:19.671022+0000","last_unstale":"2024-09-10T05:37:53.725401+0000","last_undegraded":"2024-09-10T05:37:53.725401+0000","last_fullsized":"2024-09-10T05:37:53.725401+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:52:58.839879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"32'3","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.854472+0000","last_change":"2024-09-10T05:36:21.667571+0000","last_active":"2024-09-10T05:37:53.854472+0000","last_peered":"2024-09-10T05:37:53.854472+0000","last_clean":"2024-09-10T05:37:53.854472+0000","last_became_active":"2024-09-10T05:36:21.666042+0000","last_became_peered":"2024-09-10T05:36:21.666042+0000","last_unstale":"2024-09-10T05:37:53.854472+0000","last_undegraded":"2024-09-10T05:37:53.854472+0000","last_fullsized":"2024-09-10T05:37:53.854472+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:39.262665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'13","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.222570+0000","last_change":"2024-09-10T05:36:52.713178+0000","last_active":"2024-09-10T05:39:27.222570+0000","last_peered":"2024-09-10T05:39:27.222570+0000","last_clean":"2024-09-10T05:39:27.222570+0000","last_became_active":"2024-09-10T05:36:52.696116+0000","last_became_peered":"2024-09-10T05:36:52.696116+0000","last_unstale":"2024-09-10T05:39:27.222570+0000","last_undegraded":"2024-09-10T05:39:27.222570+0000","last_fullsized":"2024-09-10T05:39:27.222570+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:19:34.691310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.897741+0000","last_change":"2024-09-10T05:36:11.607638+0000","last_active":"2024-09-10T05:37:55.897741+0000","last_peered":"2024-09-10T05:37:55.897741+0000","last_clean":"2024-09-10T05:37:55.897741+0000","last_became_active":"2024-09-10T05:36:11.606576+0000","last_became_peered":"2024-09-10T05:36:11.606576+0000","last_unstale":"2024-09-10T05:37:55.897741+0000","last_undegraded":"2024-09-10T05:37:55.897741+0000","last_fullsized":"2024-09-10T05:37:55.897741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:18:24.850629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.712965+0000","last_change":"2024-09-10T05:36:15.618352+0000","last_active":"2024-09-10T05:37:53.712965+0000","last_peered":"2024-09-10T05:37:53.712965+0000","last_clean":"2024-09-10T05:37:53.712965+0000","last_became_active":"2024-09-10T05:36:15.617647+0000","last_became_peered":"2024-09-10T05:36:15.617647+0000","last_unstale":"2024-09-10T05:37:53.712965+0000","last_undegraded":"2024-09-10T05:37:53.712965+0000","last_fullsized":"2024-09-10T05:37:53.712965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:04:41.335062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"34'49","reported_seq":111,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.035913+0000","last_change":"2024-09-10T05:36:17.636835+0000","last_active":"2024-09-10T05:38:24.035913+0000","last_peered":"2024-09-10T05:38:24.035913+0000","last_clean":"2024-09-10T05:38:24.035913+0000","last_became_active":"2024-09-10T05:36:17.636000+0000","last_became_peered":"2024-09-10T05:36:17.636000+0000","last_unstale":"2024-09-10T05:38:24.035913+0000","last_undegraded":"2024-09-10T05:38:24.035913+0000","last_fullsized":"2024-09-10T05:38:24.035913+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:10:22.233813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"34'282","reported_seq":354,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.565613+0000","last_change":"2024-09-10T05:36:19.664630+0000","last_active":"2024-09-10T05:39:27.565613+0000","last_peered":"2024-09-10T05:39:27.565613+0000","last_clean":"2024-09-10T05:39:27.565613+0000","last_became_active":"2024-09-10T05:36:19.663950+0000","last_became_peered":"2024-09-10T05:36:19.663950+0000","last_unstale":"2024-09-10T05:39:27.565613+0000","last_undegraded":"2024-09-10T05:39:27.565613+0000","last_fullsized":"2024-09-10T05:39:27.565613+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:53.165826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"32'2","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.854389+0000","last_change":"2024-09-10T05:36:21.691277+0000","last_active":"2024-09-10T05:37:53.854389+0000","last_peered":"2024-09-10T05:37:53.854389+0000","last_clean":"2024-09-10T05:37:53.854389+0000","last_became_active":"2024-09-10T05:36:21.690772+0000","last_became_peered":"2024-09-10T05:36:21.690772+0000","last_unstale":"2024-09-10T05:37:53.854389+0000","last_undegraded":"2024-09-10T05:37:53.854389+0000","last_fullsized":"2024-09-10T05:37:53.854389+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:17:39.487372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"34'6","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.364489+0000","last_change":"2024-09-10T05:36:13.612369+0000","last_active":"2024-09-10T05:39:27.364489+0000","last_peered":"2024-09-10T05:39:27.364489+0000","last_clean":"2024-09-10T05:39:27.364489+0000","last_became_active":"2024-09-10T05:36:13.611694+0000","last_became_peered":"2024-09-10T05:36:13.611694+0000","last_unstale":"2024-09-10T05:39:27.364489+0000","last_undegraded":"2024-09-10T05:39:27.364489+0000","last_fullsized":"2024-09-10T05:39:27.364489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:25.411949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.897408+0000","last_change":"2024-09-10T05:36:11.607748+0000","last_active":"2024-09-10T05:37:55.897408+0000","last_peered":"2024-09-10T05:37:55.897408+0000","last_clean":"2024-09-10T05:37:55.897408+0000","last_became_active":"2024-09-10T05:36:11.606957+0000","last_became_peered":"2024-09-10T05:36:11.606957+0000","last_unstale":"2024-09-10T05:37:55.897408+0000","last_undegraded":"2024-09-10T05:37:55.897408+0000","last_fullsized":"2024-09-10T05:37:55.897408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:51:30.178935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.712437+0000","last_change":"2024-09-10T05:36:15.632297+0000","last_active":"2024-09-10T05:37:53.712437+0000","last_peered":"2024-09-10T05:37:53.712437+0000","last_clean":"2024-09-10T05:37:53.712437+0000","last_became_active":"2024-09-10T05:36:15.631551+0000","last_became_peered":"2024-09-10T05:36:15.631551+0000","last_unstale":"2024-09-10T05:37:53.712437+0000","last_undegraded":"2024-09-10T05:37:53.712437+0000","last_fullsized":"2024-09-10T05:37:53.712437+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:38:35.217361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"34'72","reported_seq":153,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.668223+0000","last_change":"2024-09-10T05:36:17.651071+0000","last_active":"2024-09-10T05:39:58.668223+0000","last_peered":"2024-09-10T05:39:58.668223+0000","last_clean":"2024-09-10T05:39:58.668223+0000","last_became_active":"2024-09-10T05:36:17.650601+0000","last_became_peered":"2024-09-10T05:36:17.650601+0000","last_unstale":"2024-09-10T05:39:58.668223+0000","last_undegraded":"2024-09-10T05:39:58.668223+0000","last_fullsized":"2024-09-10T05:39:58.668223+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:33:18.024305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.712799+0000","last_change":"2024-09-10T05:36:19.638840+0000","last_active":"2024-09-10T05:37:53.712799+0000","last_peered":"2024-09-10T05:37:53.712799+0000","last_clean":"2024-09-10T05:37:53.712799+0000","last_became_active":"2024-09-10T05:36:19.638087+0000","last_became_peered":"2024-09-10T05:36:19.638087+0000","last_unstale":"2024-09-10T05:37:53.712799+0000","last_undegraded":"2024-09-10T05:37:53.712799+0000","last_fullsized":"2024-09-10T05:37:53.712799+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:43:13.922357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"34'18","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.525874+0000","last_change":"2024-09-10T05:36:21.681112+0000","last_active":"2024-09-10T05:39:27.525874+0000","last_peered":"2024-09-10T05:39:27.525874+0000","last_clean":"2024-09-10T05:39:27.525874+0000","last_became_active":"2024-09-10T05:36:21.680246+0000","last_became_peered":"2024-09-10T05:36:21.680246+0000","last_unstale":"2024-09-10T05:39:27.525874+0000","last_undegraded":"2024-09-10T05:39:27.525874+0000","last_fullsized":"2024-09-10T05:39:27.525874+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:41.764675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"34'5","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:07.690351+0000","last_change":"2024-09-10T05:36:52.725901+0000","last_active":"2024-09-10T05:39:07.690351+0000","last_peered":"2024-09-10T05:39:07.690351+0000","last_clean":"2024-09-10T05:39:07.690351+0000","last_became_active":"2024-09-10T05:36:52.702912+0000","last_became_peered":"2024-09-10T05:36:52.702912+0000","last_unstale":"2024-09-10T05:39:07.690351+0000","last_undegraded":"2024-09-10T05:39:07.690351+0000","last_fullsized":"2024-09-10T05:39:07.690351+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:30:22.591725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.165811+0000","last_change":"2024-09-10T05:36:11.608535+0000","last_active":"2024-09-10T05:39:27.165811+0000","last_peered":"2024-09-10T05:39:27.165811+0000","last_clean":"2024-09-10T05:39:27.165811+0000","last_became_active":"2024-09-10T05:36:11.606930+0000","last_became_peered":"2024-09-10T05:36:11.606930+0000","last_unstale":"2024-09-10T05:39:27.165811+0000","last_undegraded":"2024-09-10T05:39:27.165811+0000","last_fullsized":"2024-09-10T05:39:27.165811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:23:14.287549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.714198+0000","last_change":"2024-09-10T05:36:15.617401+0000","last_active":"2024-09-10T05:37:53.714198+0000","last_peered":"2024-09-10T05:37:53.714198+0000","last_clean":"2024-09-10T05:37:53.714198+0000","last_became_active":"2024-09-10T05:36:15.616975+0000","last_became_peered":"2024-09-10T05:36:15.616975+0000","last_unstale":"2024-09-10T05:37:53.714198+0000","last_undegraded":"2024-09-10T05:37:53.714198+0000","last_fullsized":"2024-09-10T05:37:53.714198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:18:28.491327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'42","reported_seq":96,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:32.690954+0000","last_change":"2024-09-10T05:36:17.651377+0000","last_active":"2024-09-10T05:38:32.690954+0000","last_peered":"2024-09-10T05:38:32.690954+0000","last_clean":"2024-09-10T05:38:32.690954+0000","last_became_active":"2024-09-10T05:36:17.650522+0000","last_became_peered":"2024-09-10T05:36:17.650522+0000","last_unstale":"2024-09-10T05:38:32.690954+0000","last_undegraded":"2024-09-10T05:38:32.690954+0000","last_fullsized":"2024-09-10T05:38:32.690954+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:31:03.454940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.728744+0000","last_change":"2024-09-10T05:36:19.664052+0000","last_active":"2024-09-10T05:37:53.728744+0000","last_peered":"2024-09-10T05:37:53.728744+0000","last_clean":"2024-09-10T05:37:53.728744+0000","last_became_active":"2024-09-10T05:36:19.663287+0000","last_became_peered":"2024-09-10T05:36:19.663287+0000","last_unstale":"2024-09-10T05:37:53.728744+0000","last_undegraded":"2024-09-10T05:37:53.728744+0000","last_fullsized":"2024-09-10T05:37:53.728744+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:39.277013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'5","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.028076+0000","last_change":"2024-09-10T05:36:21.664412+0000","last_active":"2024-09-10T05:39:27.028076+0000","last_peered":"2024-09-10T05:39:27.028076+0000","last_clean":"2024-09-10T05:39:27.028076+0000","last_became_active":"2024-09-10T05:36:21.663661+0000","last_became_peered":"2024-09-10T05:36:21.663661+0000","last_unstale":"2024-09-10T05:39:27.028076+0000","last_undegraded":"2024-09-10T05:39:27.028076+0000","last_fullsized":"2024-09-10T05:39:27.028076+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:53.553843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'5","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.024835+0000","last_change":"2024-09-10T05:36:13.631202+0000","last_active":"2024-09-10T05:39:27.024835+0000","last_peered":"2024-09-10T05:39:27.024835+0000","last_clean":"2024-09-10T05:39:27.024835+0000","last_became_active":"2024-09-10T05:36:13.630386+0000","last_became_peered":"2024-09-10T05:36:13.630386+0000","last_unstale":"2024-09-10T05:39:27.024835+0000","last_undegraded":"2024-09-10T05:39:27.024835+0000","last_fullsized":"2024-09-10T05:39:27.024835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:36.024873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.897689+0000","last_change":"2024-09-10T05:36:11.598765+0000","last_active":"2024-09-10T05:37:55.897689+0000","last_peered":"2024-09-10T05:37:55.897689+0000","last_clean":"2024-09-10T05:37:55.897689+0000","last_became_active":"2024-09-10T05:36:11.597935+0000","last_became_peered":"2024-09-10T05:36:11.597935+0000","last_unstale":"2024-09-10T05:37:55.897689+0000","last_undegraded":"2024-09-10T05:37:55.897689+0000","last_fullsized":"2024-09-10T05:37:55.897689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:06:01.704380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.853934+0000","last_change":"2024-09-10T05:36:15.619918+0000","last_active":"2024-09-10T05:37:53.853934+0000","last_peered":"2024-09-10T05:37:53.853934+0000","last_clean":"2024-09-10T05:37:53.853934+0000","last_became_active":"2024-09-10T05:36:15.619388+0000","last_became_peered":"2024-09-10T05:36:15.619388+0000","last_unstale":"2024-09-10T05:37:53.853934+0000","last_undegraded":"2024-09-10T05:37:53.853934+0000","last_fullsized":"2024-09-10T05:37:53.853934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:26.033372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"34'36","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.051975+0000","last_change":"2024-09-10T05:36:17.638791+0000","last_active":"2024-09-10T05:38:24.051975+0000","last_peered":"2024-09-10T05:38:24.051975+0000","last_clean":"2024-09-10T05:38:24.051975+0000","last_became_active":"2024-09-10T05:36:17.636568+0000","last_became_peered":"2024-09-10T05:36:17.636568+0000","last_unstale":"2024-09-10T05:38:24.051975+0000","last_undegraded":"2024-09-10T05:38:24.051975+0000","last_fullsized":"2024-09-10T05:38:24.051975+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:58.268199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'282","reported_seq":409,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.536932+0000","last_change":"2024-09-10T05:36:19.667395+0000","last_active":"2024-09-10T05:39:27.536932+0000","last_peered":"2024-09-10T05:39:27.536932+0000","last_clean":"2024-09-10T05:39:27.536932+0000","last_became_active":"2024-09-10T05:36:19.666610+0000","last_became_peered":"2024-09-10T05:36:19.666610+0000","last_unstale":"2024-09-10T05:39:27.536932+0000","last_undegraded":"2024-09-10T05:39:27.536932+0000","last_fullsized":"2024-09-10T05:39:27.536932+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:22:18.017142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'12","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:27.686883+0000","last_change":"2024-09-10T05:36:21.669588+0000","last_active":"2024-09-10T05:38:27.686883+0000","last_peered":"2024-09-10T05:38:27.686883+0000","last_clean":"2024-09-10T05:38:27.686883+0000","last_became_active":"2024-09-10T05:36:21.668641+0000","last_became_peered":"2024-09-10T05:36:21.668641+0000","last_unstale":"2024-09-10T05:38:27.686883+0000","last_undegraded":"2024-09-10T05:38:27.686883+0000","last_fullsized":"2024-09-10T05:38:27.686883+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:59.764142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"34'7","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:27.681562+0000","last_change":"2024-09-10T05:36:13.609927+0000","last_active":"2024-09-10T05:38:27.681562+0000","last_peered":"2024-09-10T05:38:27.681562+0000","last_clean":"2024-09-10T05:38:27.681562+0000","last_became_active":"2024-09-10T05:36:13.605112+0000","last_became_peered":"2024-09-10T05:36:13.605112+0000","last_unstale":"2024-09-10T05:38:27.681562+0000","last_undegraded":"2024-09-10T05:38:27.681562+0000","last_fullsized":"2024-09-10T05:38:27.681562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:54:32.975492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.722448+0000","last_change":"2024-09-10T05:36:11.606136+0000","last_active":"2024-09-10T05:37:53.722448+0000","last_peered":"2024-09-10T05:37:53.722448+0000","last_clean":"2024-09-10T05:37:53.722448+0000","last_became_active":"2024-09-10T05:36:11.600833+0000","last_became_peered":"2024-09-10T05:36:11.600833+0000","last_unstale":"2024-09-10T05:37:53.722448+0000","last_undegraded":"2024-09-10T05:37:53.722448+0000","last_fullsized":"2024-09-10T05:37:53.722448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:30:30.034878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'3","reported_seq":418,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:25.599083+0000","last_change":"2024-09-10T05:36:15.636516+0000","last_active":"2024-09-10T05:38:25.599083+0000","last_peered":"2024-09-10T05:38:25.599083+0000","last_clean":"2024-09-10T05:38:25.599083+0000","last_became_active":"2024-09-10T05:36:15.635670+0000","last_became_peered":"2024-09-10T05:36:15.635670+0000","last_unstale":"2024-09-10T05:38:25.599083+0000","last_undegraded":"2024-09-10T05:38:25.599083+0000","last_fullsized":"2024-09-10T05:38:25.599083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:38:23.956906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.726176+0000","last_change":"2024-09-10T05:36:17.639202+0000","last_active":"2024-09-10T05:37:53.726176+0000","last_peered":"2024-09-10T05:37:53.726176+0000","last_clean":"2024-09-10T05:37:53.726176+0000","last_became_active":"2024-09-10T05:36:17.633215+0000","last_became_peered":"2024-09-10T05:36:17.633215+0000","last_unstale":"2024-09-10T05:37:53.726176+0000","last_undegraded":"2024-09-10T05:37:53.726176+0000","last_fullsized":"2024-09-10T05:37:53.726176+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:47:38.759892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'282","reported_seq":471,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.479089+0000","last_change":"2024-09-10T05:36:19.650595+0000","last_active":"2024-09-10T05:39:27.479089+0000","last_peered":"2024-09-10T05:39:27.479089+0000","last_clean":"2024-09-10T05:39:27.479089+0000","last_became_active":"2024-09-10T05:36:19.649781+0000","last_became_peered":"2024-09-10T05:36:19.649781+0000","last_unstale":"2024-09-10T05:39:27.479089+0000","last_undegraded":"2024-09-10T05:39:27.479089+0000","last_fullsized":"2024-09-10T05:39:27.479089+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:13:23.575638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:25.756309+0000","last_change":"2024-09-10T05:36:21.665015+0000","last_active":"2024-09-10T05:38:25.756309+0000","last_peered":"2024-09-10T05:38:25.756309+0000","last_clean":"2024-09-10T05:38:25.756309+0000","last_became_active":"2024-09-10T05:36:21.664283+0000","last_became_peered":"2024-09-10T05:36:21.664283+0000","last_unstale":"2024-09-10T05:38:25.756309+0000","last_undegraded":"2024-09-10T05:38:25.756309+0000","last_fullsized":"2024-09-10T05:38:25.756309+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:35:48.390527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'4","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.363782+0000","last_change":"2024-09-10T05:37:53.730744+0000","last_active":"2024-09-10T05:39:27.363782+0000","last_peered":"2024-09-10T05:39:27.363782+0000","last_clean":"2024-09-10T05:39:27.363782+0000","last_became_active":"2024-09-10T05:37:53.724668+0000","last_became_peered":"2024-09-10T05:37:53.724668+0000","last_unstale":"2024-09-10T05:39:27.363782+0000","last_undegraded":"2024-09-10T05:39:27.363782+0000","last_fullsized":"2024-09-10T05:39:27.363782+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:32.648839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.676279+0000","last_change":"2024-09-10T05:36:11.598666+0000","last_active":"2024-09-10T05:39:26.676279+0000","last_peered":"2024-09-10T05:39:26.676279+0000","last_clean":"2024-09-10T05:39:26.676279+0000","last_became_active":"2024-09-10T05:36:11.598213+0000","last_became_peered":"2024-09-10T05:36:11.598213+0000","last_unstale":"2024-09-10T05:39:26.676279+0000","last_undegraded":"2024-09-10T05:39:26.676279+0000","last_fullsized":"2024-09-10T05:39:26.676279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:54.224630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.729250+0000","last_change":"2024-09-10T05:36:15.622429+0000","last_active":"2024-09-10T05:37:53.729250+0000","last_peered":"2024-09-10T05:37:53.729250+0000","last_clean":"2024-09-10T05:37:53.729250+0000","last_became_active":"2024-09-10T05:36:15.621697+0000","last_became_peered":"2024-09-10T05:36:15.621697+0000","last_unstale":"2024-09-10T05:37:53.729250+0000","last_undegraded":"2024-09-10T05:37:53.729250+0000","last_fullsized":"2024-09-10T05:37:53.729250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:13:04.950511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'38","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.025920+0000","last_change":"2024-09-10T05:36:17.648212+0000","last_active":"2024-09-10T05:38:24.025920+0000","last_peered":"2024-09-10T05:38:24.025920+0000","last_clean":"2024-09-10T05:38:24.025920+0000","last_became_active":"2024-09-10T05:36:17.647533+0000","last_became_peered":"2024-09-10T05:36:17.647533+0000","last_unstale":"2024-09-10T05:38:24.025920+0000","last_undegraded":"2024-09-10T05:38:24.025920+0000","last_fullsized":"2024-09-10T05:38:24.025920+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:49:23.646157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.896760+0000","last_change":"2024-09-10T05:36:19.641688+0000","last_active":"2024-09-10T05:37:55.896760+0000","last_peered":"2024-09-10T05:37:55.896760+0000","last_clean":"2024-09-10T05:37:55.896760+0000","last_became_active":"2024-09-10T05:36:19.640885+0000","last_became_peered":"2024-09-10T05:36:19.640885+0000","last_unstale":"2024-09-10T05:37:55.896760+0000","last_undegraded":"2024-09-10T05:37:55.896760+0000","last_fullsized":"2024-09-10T05:37:55.896760+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:07.106507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"34'8","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.434518+0000","last_change":"2024-09-10T05:36:21.665178+0000","last_active":"2024-09-10T05:39:27.434518+0000","last_peered":"2024-09-10T05:39:27.434518+0000","last_clean":"2024-09-10T05:39:27.434518+0000","last_became_active":"2024-09-10T05:36:21.664454+0000","last_became_peered":"2024-09-10T05:36:21.664454+0000","last_unstale":"2024-09-10T05:39:27.434518+0000","last_undegraded":"2024-09-10T05:39:27.434518+0000","last_fullsized":"2024-09-10T05:39:27.434518+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:10:47.751838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'6","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.005232+0000","last_change":"2024-09-10T05:36:13.605825+0000","last_active":"2024-09-10T05:39:27.005232+0000","last_peered":"2024-09-10T05:39:27.005232+0000","last_clean":"2024-09-10T05:39:27.005232+0000","last_became_active":"2024-09-10T05:36:13.605318+0000","last_became_peered":"2024-09-10T05:36:13.605318+0000","last_unstale":"2024-09-10T05:39:27.005232+0000","last_undegraded":"2024-09-10T05:39:27.005232+0000","last_fullsized":"2024-09-10T05:39:27.005232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:18:36.672577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'72","reported_seq":146,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.852563+0000","last_change":"2024-09-10T05:35:59.488460+0000","last_active":"2024-09-10T05:37:53.852563+0000","last_peered":"2024-09-10T05:37:53.852563+0000","last_clean":"2024-09-10T05:37:53.852563+0000","last_became_active":"2024-09-10T05:35:59.486077+0000","last_became_peered":"2024-09-10T05:35:59.486077+0000","last_unstale":"2024-09-10T05:37:53.852563+0000","last_undegraded":"2024-09-10T05:37:53.852563+0000","last_fullsized":"2024-09-10T05:37:53.852563+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:35:57.655557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:35:57.655557+0000","last_clean_scrub_stamp":"2024-09-10T05:35:57.655557+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:41:07.276856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.897409+0000","last_change":"2024-09-10T05:36:05.711729+0000","last_active":"2024-09-10T05:37:55.897409+0000","last_peered":"2024-09-10T05:37:55.897409+0000","last_clean":"2024-09-10T05:37:55.897409+0000","last_became_active":"2024-09-10T05:36:03.710352+0000","last_became_peered":"2024-09-10T05:36:03.710352+0000","last_unstale":"2024-09-10T05:37:55.897409+0000","last_undegraded":"2024-09-10T05:37:55.897409+0000","last_fullsized":"2024-09-10T05:37:55.897409+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_clean_scrub_stamp":"2024-09-10T05:36:02.684661+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:03:30.592449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002047461,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.596937+0000","last_change":"2024-09-10T05:36:11.606900+0000","last_active":"2024-09-10T05:39:26.596937+0000","last_peered":"2024-09-10T05:39:26.596937+0000","last_clean":"2024-09-10T05:39:26.596937+0000","last_became_active":"2024-09-10T05:36:11.604178+0000","last_became_peered":"2024-09-10T05:36:11.604178+0000","last_unstale":"2024-09-10T05:39:26.596937+0000","last_undegraded":"2024-09-10T05:39:26.596937+0000","last_fullsized":"2024-09-10T05:39:26.596937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:53:24.406596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.854195+0000","last_change":"2024-09-10T05:36:15.624270+0000","last_active":"2024-09-10T05:37:53.854195+0000","last_peered":"2024-09-10T05:37:53.854195+0000","last_clean":"2024-09-10T05:37:53.854195+0000","last_became_active":"2024-09-10T05:36:15.623637+0000","last_became_peered":"2024-09-10T05:36:15.623637+0000","last_unstale":"2024-09-10T05:37:53.854195+0000","last_undegraded":"2024-09-10T05:37:53.854195+0000","last_fullsized":"2024-09-10T05:37:53.854195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:37:16.145975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'83","reported_seq":163,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.049037+0000","last_change":"2024-09-10T05:36:17.637408+0000","last_active":"2024-09-10T05:38:24.049037+0000","last_peered":"2024-09-10T05:38:24.049037+0000","last_clean":"2024-09-10T05:38:24.049037+0000","last_became_active":"2024-09-10T05:36:17.636543+0000","last_became_peered":"2024-09-10T05:36:17.636543+0000","last_unstale":"2024-09-10T05:38:24.049037+0000","last_undegraded":"2024-09-10T05:38:24.049037+0000","last_fullsized":"2024-09-10T05:38:24.049037+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:15:25.918278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.728409+0000","last_change":"2024-09-10T05:36:19.664203+0000","last_active":"2024-09-10T05:37:53.728409+0000","last_peered":"2024-09-10T05:37:53.728409+0000","last_clean":"2024-09-10T05:37:53.728409+0000","last_became_active":"2024-09-10T05:36:19.663584+0000","last_became_peered":"2024-09-10T05:36:19.663584+0000","last_unstale":"2024-09-10T05:37:53.728409+0000","last_undegraded":"2024-09-10T05:37:53.728409+0000","last_fullsized":"2024-09-10T05:37:53.728409+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:33.708215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"34'82","reported_seq":168,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.391356+0000","last_change":"2024-09-10T05:36:21.664939+0000","last_active":"2024-09-10T05:39:27.391356+0000","last_peered":"2024-09-10T05:39:27.391356+0000","last_clean":"2024-09-10T05:39:27.391356+0000","last_became_active":"2024-09-10T05:36:21.664075+0000","last_became_peered":"2024-09-10T05:36:21.664075+0000","last_unstale":"2024-09-10T05:39:27.391356+0000","last_undegraded":"2024-09-10T05:39:27.391356+0000","last_fullsized":"2024-09-10T05:39:27.391356+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:13:56.435337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":223,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"30'2","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.729039+0000","last_change":"2024-09-10T05:36:13.617433+0000","last_active":"2024-09-10T05:37:53.729039+0000","last_peered":"2024-09-10T05:37:53.729039+0000","last_clean":"2024-09-10T05:37:53.729039+0000","last_became_active":"2024-09-10T05:36:13.616766+0000","last_became_peered":"2024-09-10T05:36:13.616766+0000","last_unstale":"2024-09-10T05:37:53.729039+0000","last_undegraded":"2024-09-10T05:37:53.729039+0000","last_fullsized":"2024-09-10T05:37:53.729039+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:08:29.778211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.896383+0000","last_change":"2024-09-10T05:36:05.710898+0000","last_active":"2024-09-10T05:37:55.896383+0000","last_peered":"2024-09-10T05:37:55.896383+0000","last_clean":"2024-09-10T05:37:55.896383+0000","last_became_active":"2024-09-10T05:36:03.706256+0000","last_became_peered":"2024-09-10T05:36:03.706256+0000","last_unstale":"2024-09-10T05:37:55.896383+0000","last_undegraded":"2024-09-10T05:37:55.896383+0000","last_fullsized":"2024-09-10T05:37:55.896383+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_clean_scrub_stamp":"2024-09-10T05:36:02.684661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:42:18.313806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001383542,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.856705+0000","last_change":"2024-09-10T05:36:11.591881+0000","last_active":"2024-09-10T05:37:53.856705+0000","last_peered":"2024-09-10T05:37:53.856705+0000","last_clean":"2024-09-10T05:37:53.856705+0000","last_became_active":"2024-09-10T05:36:11.591339+0000","last_became_peered":"2024-09-10T05:36:11.591339+0000","last_unstale":"2024-09-10T05:37:53.856705+0000","last_undegraded":"2024-09-10T05:37:53.856705+0000","last_fullsized":"2024-09-10T05:37:53.856705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:21:35.347921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.906123+0000","last_change":"2024-09-10T05:36:52.705367+0000","last_active":"2024-09-10T05:37:55.906123+0000","last_peered":"2024-09-10T05:37:55.906123+0000","last_clean":"2024-09-10T05:37:55.906123+0000","last_became_active":"2024-09-10T05:36:52.704490+0000","last_became_peered":"2024-09-10T05:36:52.704490+0000","last_unstale":"2024-09-10T05:37:55.906123+0000","last_undegraded":"2024-09-10T05:37:55.906123+0000","last_fullsized":"2024-09-10T05:37:55.906123+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:44:28.080659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"34'280","reported_seq":495,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:25.874900+0000","last_change":"2024-09-10T05:36:17.640102+0000","last_active":"2024-09-10T05:39:25.874900+0000","last_peered":"2024-09-10T05:39:25.874900+0000","last_clean":"2024-09-10T05:39:25.874900+0000","last_became_active":"2024-09-10T05:36:17.637623+0000","last_became_peered":"2024-09-10T05:36:17.637623+0000","last_unstale":"2024-09-10T05:39:25.874900+0000","last_undegraded":"2024-09-10T05:39:25.874900+0000","last_fullsized":"2024-09-10T05:39:25.874900+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:47:34.520585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":366,"num_read_kb":350,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.725860+0000","last_change":"2024-09-10T05:36:19.673384+0000","last_active":"2024-09-10T05:37:53.725860+0000","last_peered":"2024-09-10T05:37:53.725860+0000","last_clean":"2024-09-10T05:37:53.725860+0000","last_became_active":"2024-09-10T05:36:19.672554+0000","last_became_peered":"2024-09-10T05:36:19.672554+0000","last_unstale":"2024-09-10T05:37:53.725860+0000","last_undegraded":"2024-09-10T05:37:53.725860+0000","last_fullsized":"2024-09-10T05:37:53.725860+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:09.659188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'5","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.856766+0000","last_change":"2024-09-10T05:36:21.662079+0000","last_active":"2024-09-10T05:37:53.856766+0000","last_peered":"2024-09-10T05:37:53.856766+0000","last_clean":"2024-09-10T05:37:53.856766+0000","last_became_active":"2024-09-10T05:36:21.661347+0000","last_became_peered":"2024-09-10T05:36:21.661347+0000","last_unstale":"2024-09-10T05:37:53.856766+0000","last_undegraded":"2024-09-10T05:37:53.856766+0000","last_fullsized":"2024-09-10T05:37:53.856766+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:23.555775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'6","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.364285+0000","last_change":"2024-09-10T05:36:13.626334+0000","last_active":"2024-09-10T05:39:27.364285+0000","last_peered":"2024-09-10T05:39:27.364285+0000","last_clean":"2024-09-10T05:39:27.364285+0000","last_became_active":"2024-09-10T05:36:13.621451+0000","last_became_peered":"2024-09-10T05:36:13.621451+0000","last_unstale":"2024-09-10T05:39:27.364285+0000","last_undegraded":"2024-09-10T05:39:27.364285+0000","last_fullsized":"2024-09-10T05:39:27.364285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:29:14.676606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.713298+0000","last_change":"2024-09-10T05:36:06.203202+0000","last_active":"2024-09-10T05:37:53.713298+0000","last_peered":"2024-09-10T05:37:53.713298+0000","last_clean":"2024-09-10T05:37:53.713298+0000","last_became_active":"2024-09-10T05:36:03.707045+0000","last_became_peered":"2024-09-10T05:36:03.707045+0000","last_unstale":"2024-09-10T05:37:53.713298+0000","last_undegraded":"2024-09-10T05:37:53.713298+0000","last_fullsized":"2024-09-10T05:37:53.713298+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_clean_scrub_stamp":"2024-09-10T05:36:02.684661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:47:09.787526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093121299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:21.782377+0000","last_change":"2024-09-10T05:36:11.595624+0000","last_active":"2024-09-10T05:38:21.782377+0000","last_peered":"2024-09-10T05:38:21.782377+0000","last_clean":"2024-09-10T05:38:21.782377+0000","last_became_active":"2024-09-10T05:36:11.594432+0000","last_became_peered":"2024-09-10T05:36:11.594432+0000","last_unstale":"2024-09-10T05:38:21.782377+0000","last_undegraded":"2024-09-10T05:38:21.782377+0000","last_fullsized":"2024-09-10T05:38:21.782377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:25:27.078667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.716765+0000","last_change":"2024-09-10T05:36:15.620736+0000","last_active":"2024-09-10T05:37:53.716765+0000","last_peered":"2024-09-10T05:37:53.716765+0000","last_clean":"2024-09-10T05:37:53.716765+0000","last_became_active":"2024-09-10T05:36:15.620043+0000","last_became_peered":"2024-09-10T05:36:15.620043+0000","last_unstale":"2024-09-10T05:37:53.716765+0000","last_undegraded":"2024-09-10T05:37:53.716765+0000","last_fullsized":"2024-09-10T05:37:53.716765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:34.666759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'17","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.227823+0000","last_change":"2024-09-10T05:36:17.637187+0000","last_active":"2024-09-10T05:39:27.227823+0000","last_peered":"2024-09-10T05:39:27.227823+0000","last_clean":"2024-09-10T05:39:27.227823+0000","last_became_active":"2024-09-10T05:36:17.636381+0000","last_became_peered":"2024-09-10T05:36:17.636381+0000","last_unstale":"2024-09-10T05:39:27.227823+0000","last_undegraded":"2024-09-10T05:39:27.227823+0000","last_fullsized":"2024-09-10T05:39:27.227823+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:55:19.261582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.854702+0000","last_change":"2024-09-10T05:36:19.666298+0000","last_active":"2024-09-10T05:37:53.854702+0000","last_peered":"2024-09-10T05:37:53.854702+0000","last_clean":"2024-09-10T05:37:53.854702+0000","last_became_active":"2024-09-10T05:36:19.664396+0000","last_became_peered":"2024-09-10T05:36:19.664396+0000","last_unstale":"2024-09-10T05:37:53.854702+0000","last_undegraded":"2024-09-10T05:37:53.854702+0000","last_fullsized":"2024-09-10T05:37:53.854702+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:27:46.613544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.725249+0000","last_change":"2024-09-10T05:36:21.675746+0000","last_active":"2024-09-10T05:37:53.725249+0000","last_peered":"2024-09-10T05:37:53.725249+0000","last_clean":"2024-09-10T05:37:53.725249+0000","last_became_active":"2024-09-10T05:36:21.674984+0000","last_became_peered":"2024-09-10T05:36:21.674984+0000","last_unstale":"2024-09-10T05:37:53.725249+0000","last_undegraded":"2024-09-10T05:37:53.725249+0000","last_fullsized":"2024-09-10T05:37:53.725249+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:13.261758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'3","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:21.803367+0000","last_change":"2024-09-10T05:36:13.627345+0000","last_active":"2024-09-10T05:38:21.803367+0000","last_peered":"2024-09-10T05:38:21.803367+0000","last_clean":"2024-09-10T05:38:21.803367+0000","last_became_active":"2024-09-10T05:36:13.626654+0000","last_became_peered":"2024-09-10T05:36:13.626654+0000","last_unstale":"2024-09-10T05:38:21.803367+0000","last_undegraded":"2024-09-10T05:38:21.803367+0000","last_fullsized":"2024-09-10T05:38:21.803367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:41:27.351374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.897831+0000","last_change":"2024-09-10T05:36:05.710910+0000","last_active":"2024-09-10T05:37:55.897831+0000","last_peered":"2024-09-10T05:37:55.897831+0000","last_clean":"2024-09-10T05:37:55.897831+0000","last_became_active":"2024-09-10T05:36:03.708495+0000","last_became_peered":"2024-09-10T05:36:03.708495+0000","last_unstale":"2024-09-10T05:37:55.897831+0000","last_undegraded":"2024-09-10T05:37:55.897831+0000","last_fullsized":"2024-09-10T05:37:55.897831+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_clean_scrub_stamp":"2024-09-10T05:36:02.684661+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:51.729077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012525469999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.897736+0000","last_change":"2024-09-10T05:36:11.602156+0000","last_active":"2024-09-10T05:37:55.897736+0000","last_peered":"2024-09-10T05:37:55.897736+0000","last_clean":"2024-09-10T05:37:55.897736+0000","last_became_active":"2024-09-10T05:36:11.601414+0000","last_became_peered":"2024-09-10T05:36:11.601414+0000","last_unstale":"2024-09-10T05:37:55.897736+0000","last_undegraded":"2024-09-10T05:37:55.897736+0000","last_fullsized":"2024-09-10T05:37:55.897736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:42:50.298063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.856412+0000","last_change":"2024-09-10T05:36:15.619942+0000","last_active":"2024-09-10T05:37:53.856412+0000","last_peered":"2024-09-10T05:37:53.856412+0000","last_clean":"2024-09-10T05:37:53.856412+0000","last_became_active":"2024-09-10T05:36:15.619505+0000","last_became_peered":"2024-09-10T05:36:15.619505+0000","last_unstale":"2024-09-10T05:37:53.856412+0000","last_undegraded":"2024-09-10T05:37:53.856412+0000","last_fullsized":"2024-09-10T05:37:53.856412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:14:30.972656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"33'13","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.217385+0000","last_change":"2024-09-10T05:36:17.638373+0000","last_active":"2024-09-10T05:39:26.217385+0000","last_peered":"2024-09-10T05:39:26.217385+0000","last_clean":"2024-09-10T05:39:26.217385+0000","last_became_active":"2024-09-10T05:36:17.637551+0000","last_became_peered":"2024-09-10T05:36:17.637551+0000","last_unstale":"2024-09-10T05:39:26.217385+0000","last_undegraded":"2024-09-10T05:39:26.217385+0000","last_fullsized":"2024-09-10T05:39:26.217385+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:56:29.072774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.728759+0000","last_change":"2024-09-10T05:36:19.670810+0000","last_active":"2024-09-10T05:37:53.728759+0000","last_peered":"2024-09-10T05:37:53.728759+0000","last_clean":"2024-09-10T05:37:53.728759+0000","last_became_active":"2024-09-10T05:36:19.669130+0000","last_became_peered":"2024-09-10T05:36:19.669130+0000","last_unstale":"2024-09-10T05:37:53.728759+0000","last_undegraded":"2024-09-10T05:37:53.728759+0000","last_fullsized":"2024-09-10T05:37:53.728759+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:50:25.186904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'6","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:25.732480+0000","last_change":"2024-09-10T05:36:21.672078+0000","last_active":"2024-09-10T05:38:25.732480+0000","last_peered":"2024-09-10T05:38:25.732480+0000","last_clean":"2024-09-10T05:38:25.732480+0000","last_became_active":"2024-09-10T05:36:21.671206+0000","last_became_peered":"2024-09-10T05:36:21.671206+0000","last_unstale":"2024-09-10T05:38:25.732480+0000","last_undegraded":"2024-09-10T05:38:25.732480+0000","last_fullsized":"2024-09-10T05:38:25.732480+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:44:48.926007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'4","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:21.790850+0000","last_change":"2024-09-10T05:36:13.611873+0000","last_active":"2024-09-10T05:38:21.790850+0000","last_peered":"2024-09-10T05:38:21.790850+0000","last_clean":"2024-09-10T05:38:21.790850+0000","last_became_active":"2024-09-10T05:36:13.611242+0000","last_became_peered":"2024-09-10T05:36:13.611242+0000","last_unstale":"2024-09-10T05:38:21.790850+0000","last_undegraded":"2024-09-10T05:38:21.790850+0000","last_fullsized":"2024-09-10T05:38:21.790850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:54:18.272234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'1","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:17.687049+0000","last_change":"2024-09-10T05:36:11.605555+0000","last_active":"2024-09-10T05:38:17.687049+0000","last_peered":"2024-09-10T05:38:17.687049+0000","last_clean":"2024-09-10T05:38:17.687049+0000","last_became_active":"2024-09-10T05:36:11.604802+0000","last_became_peered":"2024-09-10T05:36:11.604802+0000","last_unstale":"2024-09-10T05:38:17.687049+0000","last_undegraded":"2024-09-10T05:38:17.687049+0000","last_fullsized":"2024-09-10T05:38:17.687049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:31.026061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.854446+0000","last_change":"2024-09-10T05:36:05.716234+0000","last_active":"2024-09-10T05:37:53.854446+0000","last_peered":"2024-09-10T05:37:53.854446+0000","last_clean":"2024-09-10T05:37:53.854446+0000","last_became_active":"2024-09-10T05:36:03.705338+0000","last_became_peered":"2024-09-10T05:36:03.705338+0000","last_unstale":"2024-09-10T05:37:53.854446+0000","last_undegraded":"2024-09-10T05:37:53.854446+0000","last_fullsized":"2024-09-10T05:37:53.854446+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_clean_scrub_stamp":"2024-09-10T05:36:02.684661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:59.676796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010885789999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:22.680314+0000","last_change":"2024-09-10T05:36:15.618592+0000","last_active":"2024-09-10T05:38:22.680314+0000","last_peered":"2024-09-10T05:38:22.680314+0000","last_clean":"2024-09-10T05:38:22.680314+0000","last_became_active":"2024-09-10T05:36:15.618041+0000","last_became_peered":"2024-09-10T05:36:15.618041+0000","last_unstale":"2024-09-10T05:38:22.680314+0000","last_undegraded":"2024-09-10T05:38:22.680314+0000","last_fullsized":"2024-09-10T05:38:22.680314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:44.697723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"34'74","reported_seq":150,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.738721+0000","last_change":"2024-09-10T05:36:17.654376+0000","last_active":"2024-09-10T05:39:26.738721+0000","last_peered":"2024-09-10T05:39:26.738721+0000","last_clean":"2024-09-10T05:39:26.738721+0000","last_became_active":"2024-09-10T05:36:17.653627+0000","last_became_peered":"2024-09-10T05:36:17.653627+0000","last_unstale":"2024-09-10T05:39:26.738721+0000","last_undegraded":"2024-09-10T05:39:26.738721+0000","last_fullsized":"2024-09-10T05:39:26.738721+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:43:52.608114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5916,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":79,"num_read_kb":65,"num_write":40,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.896388+0000","last_change":"2024-09-10T05:36:19.650800+0000","last_active":"2024-09-10T05:37:55.896388+0000","last_peered":"2024-09-10T05:37:55.896388+0000","last_clean":"2024-09-10T05:37:55.896388+0000","last_became_active":"2024-09-10T05:36:19.650115+0000","last_became_peered":"2024-09-10T05:36:19.650115+0000","last_unstale":"2024-09-10T05:37:55.896388+0000","last_undegraded":"2024-09-10T05:37:55.896388+0000","last_fullsized":"2024-09-10T05:37:55.896388+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:27:32.687339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"34'9","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:26.048065+0000","last_change":"2024-09-10T05:36:21.689033+0000","last_active":"2024-09-10T05:38:26.048065+0000","last_peered":"2024-09-10T05:38:26.048065+0000","last_clean":"2024-09-10T05:38:26.048065+0000","last_became_active":"2024-09-10T05:36:21.687744+0000","last_became_peered":"2024-09-10T05:36:21.687744+0000","last_unstale":"2024-09-10T05:38:26.048065+0000","last_undegraded":"2024-09-10T05:38:26.048065+0000","last_fullsized":"2024-09-10T05:38:26.048065+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:05:42.167772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"32'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.853863+0000","last_change":"2024-09-10T05:36:13.618496+0000","last_active":"2024-09-10T05:37:53.853863+0000","last_peered":"2024-09-10T05:37:53.853863+0000","last_clean":"2024-09-10T05:37:53.853863+0000","last_became_active":"2024-09-10T05:36:13.617814+0000","last_became_peered":"2024-09-10T05:36:13.617814+0000","last_unstale":"2024-09-10T05:37:53.853863+0000","last_undegraded":"2024-09-10T05:37:53.853863+0000","last_fullsized":"2024-09-10T05:37:53.853863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:45.951433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.855803+0000","last_change":"2024-09-10T05:36:11.596607+0000","last_active":"2024-09-10T05:37:53.855803+0000","last_peered":"2024-09-10T05:37:53.855803+0000","last_clean":"2024-09-10T05:37:53.855803+0000","last_became_active":"2024-09-10T05:36:11.595349+0000","last_became_peered":"2024-09-10T05:36:11.595349+0000","last_unstale":"2024-09-10T05:37:53.855803+0000","last_undegraded":"2024-09-10T05:37:53.855803+0000","last_fullsized":"2024-09-10T05:37:53.855803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:26:47.764082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.898073+0000","last_change":"2024-09-10T05:36:05.712138+0000","last_active":"2024-09-10T05:37:55.898073+0000","last_peered":"2024-09-10T05:37:55.898073+0000","last_clean":"2024-09-10T05:37:55.898073+0000","last_became_active":"2024-09-10T05:36:03.709534+0000","last_became_peered":"2024-09-10T05:36:03.709534+0000","last_unstale":"2024-09-10T05:37:55.898073+0000","last_undegraded":"2024-09-10T05:37:55.898073+0000","last_fullsized":"2024-09-10T05:37:55.898073+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_clean_scrub_stamp":"2024-09-10T05:36:02.684661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:58:56.347286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022338829999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.901170+0000","last_change":"2024-09-10T05:36:15.619244+0000","last_active":"2024-09-10T05:37:55.901170+0000","last_peered":"2024-09-10T05:37:55.901170+0000","last_clean":"2024-09-10T05:37:55.901170+0000","last_became_active":"2024-09-10T05:36:15.618491+0000","last_became_peered":"2024-09-10T05:36:15.618491+0000","last_unstale":"2024-09-10T05:37:55.901170+0000","last_undegraded":"2024-09-10T05:37:55.901170+0000","last_fullsized":"2024-09-10T05:37:55.901170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:43:50.594184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"30'20","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.856948+0000","last_change":"2024-09-10T05:36:17.658105+0000","last_active":"2024-09-10T05:37:53.856948+0000","last_peered":"2024-09-10T05:37:53.856948+0000","last_clean":"2024-09-10T05:37:53.856948+0000","last_became_active":"2024-09-10T05:36:17.657112+0000","last_became_peered":"2024-09-10T05:36:17.657112+0000","last_unstale":"2024-09-10T05:37:53.856948+0000","last_undegraded":"2024-09-10T05:37:53.856948+0000","last_fullsized":"2024-09-10T05:37:53.856948+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:40.438888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'282","reported_seq":361,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:25.874874+0000","last_change":"2024-09-10T05:36:19.649214+0000","last_active":"2024-09-10T05:39:25.874874+0000","last_peered":"2024-09-10T05:39:25.874874+0000","last_clean":"2024-09-10T05:39:25.874874+0000","last_became_active":"2024-09-10T05:36:19.643319+0000","last_became_peered":"2024-09-10T05:36:19.643319+0000","last_unstale":"2024-09-10T05:39:25.874874+0000","last_undegraded":"2024-09-10T05:39:25.874874+0000","last_fullsized":"2024-09-10T05:39:25.874874+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:07:40.515326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"30'2","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.729162+0000","last_change":"2024-09-10T05:36:21.692062+0000","last_active":"2024-09-10T05:37:53.729162+0000","last_peered":"2024-09-10T05:37:53.729162+0000","last_clean":"2024-09-10T05:37:53.729162+0000","last_became_active":"2024-09-10T05:36:21.691590+0000","last_became_peered":"2024-09-10T05:36:21.691590+0000","last_unstale":"2024-09-10T05:37:53.729162+0000","last_undegraded":"2024-09-10T05:37:53.729162+0000","last_fullsized":"2024-09-10T05:37:53.729162+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:43:35.691961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'6","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.295258+0000","last_change":"2024-09-10T05:36:13.607662+0000","last_active":"2024-09-10T05:39:27.295258+0000","last_peered":"2024-09-10T05:39:27.295258+0000","last_clean":"2024-09-10T05:39:27.295258+0000","last_became_active":"2024-09-10T05:36:13.607367+0000","last_became_peered":"2024-09-10T05:36:13.607367+0000","last_unstale":"2024-09-10T05:39:27.295258+0000","last_undegraded":"2024-09-10T05:39:27.295258+0000","last_fullsized":"2024-09-10T05:39:27.295258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:45.424290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:26.122156+0000","last_change":"2024-09-10T05:36:11.608356+0000","last_active":"2024-09-10T05:38:26.122156+0000","last_peered":"2024-09-10T05:38:26.122156+0000","last_clean":"2024-09-10T05:38:26.122156+0000","last_became_active":"2024-09-10T05:36:11.606234+0000","last_became_peered":"2024-09-10T05:36:11.606234+0000","last_unstale":"2024-09-10T05:38:26.122156+0000","last_undegraded":"2024-09-10T05:38:26.122156+0000","last_fullsized":"2024-09-10T05:38:26.122156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:03.114192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.854826+0000","last_change":"2024-09-10T05:36:05.716475+0000","last_active":"2024-09-10T05:37:53.854826+0000","last_peered":"2024-09-10T05:37:53.854826+0000","last_clean":"2024-09-10T05:37:53.854826+0000","last_became_active":"2024-09-10T05:36:03.705038+0000","last_became_peered":"2024-09-10T05:36:03.705038+0000","last_unstale":"2024-09-10T05:37:53.854826+0000","last_undegraded":"2024-09-10T05:37:53.854826+0000","last_fullsized":"2024-09-10T05:37:53.854826+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_clean_scrub_stamp":"2024-09-10T05:36:02.684661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:33:56.689163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00126935,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.901115+0000","last_change":"2024-09-10T05:36:15.618499+0000","last_active":"2024-09-10T05:37:55.901115+0000","last_peered":"2024-09-10T05:37:55.901115+0000","last_clean":"2024-09-10T05:37:55.901115+0000","last_became_active":"2024-09-10T05:36:15.617690+0000","last_became_peered":"2024-09-10T05:36:15.617690+0000","last_unstale":"2024-09-10T05:37:55.901115+0000","last_undegraded":"2024-09-10T05:37:55.901115+0000","last_fullsized":"2024-09-10T05:37:55.901115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:44.575577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"30'16","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.724231+0000","last_change":"2024-09-10T05:36:17.635256+0000","last_active":"2024-09-10T05:37:53.724231+0000","last_peered":"2024-09-10T05:37:53.724231+0000","last_clean":"2024-09-10T05:37:53.724231+0000","last_became_active":"2024-09-10T05:36:17.634261+0000","last_became_peered":"2024-09-10T05:36:17.634261+0000","last_unstale":"2024-09-10T05:37:53.724231+0000","last_undegraded":"2024-09-10T05:37:53.724231+0000","last_fullsized":"2024-09-10T05:37:53.724231+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:56:40.871070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'284","reported_seq":437,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.366924+0000","last_change":"2024-09-10T05:36:19.673204+0000","last_active":"2024-09-10T05:39:58.366924+0000","last_peered":"2024-09-10T05:39:58.366924+0000","last_clean":"2024-09-10T05:39:58.366924+0000","last_became_active":"2024-09-10T05:36:19.672586+0000","last_became_peered":"2024-09-10T05:36:19.672586+0000","last_unstale":"2024-09-10T05:39:58.366924+0000","last_undegraded":"2024-09-10T05:39:58.366924+0000","last_fullsized":"2024-09-10T05:39:58.366924+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:18:32.110473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.853637+0000","last_change":"2024-09-10T05:36:21.670112+0000","last_active":"2024-09-10T05:37:53.853637+0000","last_peered":"2024-09-10T05:37:53.853637+0000","last_clean":"2024-09-10T05:37:53.853637+0000","last_became_active":"2024-09-10T05:36:21.668909+0000","last_became_peered":"2024-09-10T05:36:21.668909+0000","last_unstale":"2024-09-10T05:37:53.853637+0000","last_undegraded":"2024-09-10T05:37:53.853637+0000","last_fullsized":"2024-09-10T05:37:53.853637+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:37:35.984330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'14","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.201146+0000","last_change":"2024-09-10T05:36:13.622291+0000","last_active":"2024-09-10T05:39:27.201146+0000","last_peered":"2024-09-10T05:39:27.201146+0000","last_clean":"2024-09-10T05:39:27.201146+0000","last_became_active":"2024-09-10T05:36:13.621703+0000","last_became_peered":"2024-09-10T05:36:13.621703+0000","last_unstale":"2024-09-10T05:39:27.201146+0000","last_undegraded":"2024-09-10T05:39:27.201146+0000","last_fullsized":"2024-09-10T05:39:27.201146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:40:52.344660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.855830+0000","last_change":"2024-09-10T05:36:11.594329+0000","last_active":"2024-09-10T05:37:53.855830+0000","last_peered":"2024-09-10T05:37:53.855830+0000","last_clean":"2024-09-10T05:37:53.855830+0000","last_became_active":"2024-09-10T05:36:11.594029+0000","last_became_peered":"2024-09-10T05:36:11.594029+0000","last_unstale":"2024-09-10T05:37:53.855830+0000","last_undegraded":"2024-09-10T05:37:53.855830+0000","last_fullsized":"2024-09-10T05:37:53.855830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:10:40.202152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.899337+0000","last_change":"2024-09-10T05:36:05.711580+0000","last_active":"2024-09-10T05:37:55.899337+0000","last_peered":"2024-09-10T05:37:55.899337+0000","last_clean":"2024-09-10T05:37:55.899337+0000","last_became_active":"2024-09-10T05:36:03.708884+0000","last_became_peered":"2024-09-10T05:36:03.708884+0000","last_unstale":"2024-09-10T05:37:55.899337+0000","last_undegraded":"2024-09-10T05:37:55.899337+0000","last_fullsized":"2024-09-10T05:37:55.899337+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:02.684661+0000","last_clean_scrub_stamp":"2024-09-10T05:36:02.684661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:41:36.044908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018824390000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.722537+0000","last_change":"2024-09-10T05:36:15.638715+0000","last_active":"2024-09-10T05:37:53.722537+0000","last_peered":"2024-09-10T05:37:53.722537+0000","last_clean":"2024-09-10T05:37:53.722537+0000","last_became_active":"2024-09-10T05:36:15.637890+0000","last_became_peered":"2024-09-10T05:36:15.637890+0000","last_unstale":"2024-09-10T05:37:53.722537+0000","last_undegraded":"2024-09-10T05:37:53.722537+0000","last_fullsized":"2024-09-10T05:37:53.722537+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:43:41.621798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'88","reported_seq":171,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.008941+0000","last_change":"2024-09-10T05:36:17.632261+0000","last_active":"2024-09-10T05:38:24.008941+0000","last_peered":"2024-09-10T05:38:24.008941+0000","last_clean":"2024-09-10T05:38:24.008941+0000","last_became_active":"2024-09-10T05:36:17.631509+0000","last_became_peered":"2024-09-10T05:36:17.631509+0000","last_unstale":"2024-09-10T05:38:24.008941+0000","last_undegraded":"2024-09-10T05:38:24.008941+0000","last_fullsized":"2024-09-10T05:38:24.008941+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:42.713689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":84,"num_read_kb":69,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.723343+0000","last_change":"2024-09-10T05:36:19.668038+0000","last_active":"2024-09-10T05:37:53.723343+0000","last_peered":"2024-09-10T05:37:53.723343+0000","last_clean":"2024-09-10T05:37:53.723343+0000","last_became_active":"2024-09-10T05:36:19.667446+0000","last_became_peered":"2024-09-10T05:36:19.667446+0000","last_unstale":"2024-09-10T05:37:53.723343+0000","last_undegraded":"2024-09-10T05:37:53.723343+0000","last_fullsized":"2024-09-10T05:37:53.723343+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:54:25.333105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.713880+0000","last_change":"2024-09-10T05:36:21.658395+0000","last_active":"2024-09-10T05:37:53.713880+0000","last_peered":"2024-09-10T05:37:53.713880+0000","last_clean":"2024-09-10T05:37:53.713880+0000","last_became_active":"2024-09-10T05:36:21.657621+0000","last_became_peered":"2024-09-10T05:36:21.657621+0000","last_unstale":"2024-09-10T05:37:53.713880+0000","last_undegraded":"2024-09-10T05:37:53.713880+0000","last_fullsized":"2024-09-10T05:37:53.713880+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:09.853561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"32'8","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.717636+0000","last_change":"2024-09-10T05:36:21.657351+0000","last_active":"2024-09-10T05:37:53.717636+0000","last_peered":"2024-09-10T05:37:53.717636+0000","last_clean":"2024-09-10T05:37:53.717636+0000","last_became_active":"2024-09-10T05:36:21.656563+0000","last_became_peered":"2024-09-10T05:36:21.656563+0000","last_unstale":"2024-09-10T05:37:53.717636+0000","last_undegraded":"2024-09-10T05:37:53.717636+0000","last_fullsized":"2024-09-10T05:37:53.717636+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:25:08.627704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.714178+0000","last_change":"2024-09-10T05:36:13.621461+0000","last_active":"2024-09-10T05:37:53.714178+0000","last_peered":"2024-09-10T05:37:53.714178+0000","last_clean":"2024-09-10T05:37:53.714178+0000","last_became_active":"2024-09-10T05:36:13.620892+0000","last_became_peered":"2024-09-10T05:36:13.620892+0000","last_unstale":"2024-09-10T05:37:53.714178+0000","last_undegraded":"2024-09-10T05:37:53.714178+0000","last_fullsized":"2024-09-10T05:37:53.714178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:39.193639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'6","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.350902+0000","last_change":"2024-09-10T05:36:11.598055+0000","last_active":"2024-09-10T05:39:27.350902+0000","last_peered":"2024-09-10T05:39:27.350902+0000","last_clean":"2024-09-10T05:39:27.350902+0000","last_became_active":"2024-09-10T05:36:11.597209+0000","last_became_peered":"2024-09-10T05:36:11.597209+0000","last_unstale":"2024-09-10T05:39:27.350902+0000","last_undegraded":"2024-09-10T05:39:27.350902+0000","last_fullsized":"2024-09-10T05:39:27.350902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:02.735158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.858869+0000","last_change":"2024-09-10T05:36:15.617459+0000","last_active":"2024-09-10T05:37:53.858869+0000","last_peered":"2024-09-10T05:37:53.858869+0000","last_clean":"2024-09-10T05:37:53.858869+0000","last_became_active":"2024-09-10T05:36:15.617049+0000","last_became_peered":"2024-09-10T05:36:15.617049+0000","last_unstale":"2024-09-10T05:37:53.858869+0000","last_undegraded":"2024-09-10T05:37:53.858869+0000","last_fullsized":"2024-09-10T05:37:53.858869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:13:50.392282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'41","reported_seq":99,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.519835+0000","last_change":"2024-09-10T05:36:17.658656+0000","last_active":"2024-09-10T05:39:58.519835+0000","last_peered":"2024-09-10T05:39:58.519835+0000","last_clean":"2024-09-10T05:39:58.519835+0000","last_became_active":"2024-09-10T05:36:17.657669+0000","last_became_peered":"2024-09-10T05:36:17.657669+0000","last_unstale":"2024-09-10T05:39:58.519835+0000","last_undegraded":"2024-09-10T05:39:58.519835+0000","last_fullsized":"2024-09-10T05:39:58.519835+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:39.765543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.724025+0000","last_change":"2024-09-10T05:36:19.673156+0000","last_active":"2024-09-10T05:37:53.724025+0000","last_peered":"2024-09-10T05:37:53.724025+0000","last_clean":"2024-09-10T05:37:53.724025+0000","last_became_active":"2024-09-10T05:36:19.672498+0000","last_became_peered":"2024-09-10T05:36:19.672498+0000","last_unstale":"2024-09-10T05:37:53.724025+0000","last_undegraded":"2024-09-10T05:37:53.724025+0000","last_fullsized":"2024-09-10T05:37:53.724025+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:27:09.531398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'5","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:23.587545+0000","last_change":"2024-09-10T05:36:21.689435+0000","last_active":"2024-09-10T05:38:23.587545+0000","last_peered":"2024-09-10T05:38:23.587545+0000","last_clean":"2024-09-10T05:38:23.587545+0000","last_became_active":"2024-09-10T05:36:21.688864+0000","last_became_peered":"2024-09-10T05:36:21.688864+0000","last_unstale":"2024-09-10T05:38:23.587545+0000","last_undegraded":"2024-09-10T05:38:23.587545+0000","last_fullsized":"2024-09-10T05:38:23.587545+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:55:36.492043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"34'10","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.294531+0000","last_change":"2024-09-10T05:36:13.612003+0000","last_active":"2024-09-10T05:39:27.294531+0000","last_peered":"2024-09-10T05:39:27.294531+0000","last_clean":"2024-09-10T05:39:27.294531+0000","last_became_active":"2024-09-10T05:36:13.610883+0000","last_became_peered":"2024-09-10T05:36:13.610883+0000","last_unstale":"2024-09-10T05:39:27.294531+0000","last_undegraded":"2024-09-10T05:39:27.294531+0000","last_fullsized":"2024-09-10T05:39:27.294531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:29:40.273630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'1","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:37.684035+0000","last_change":"2024-09-10T05:36:11.605653+0000","last_active":"2024-09-10T05:38:37.684035+0000","last_peered":"2024-09-10T05:38:37.684035+0000","last_clean":"2024-09-10T05:38:37.684035+0000","last_became_active":"2024-09-10T05:36:11.605259+0000","last_became_peered":"2024-09-10T05:36:11.605259+0000","last_unstale":"2024-09-10T05:38:37.684035+0000","last_undegraded":"2024-09-10T05:38:37.684035+0000","last_fullsized":"2024-09-10T05:38:37.684035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:18:08.260486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.724971+0000","last_change":"2024-09-10T05:36:15.630108+0000","last_active":"2024-09-10T05:37:53.724971+0000","last_peered":"2024-09-10T05:37:53.724971+0000","last_clean":"2024-09-10T05:37:53.724971+0000","last_became_active":"2024-09-10T05:36:15.629278+0000","last_became_peered":"2024-09-10T05:36:15.629278+0000","last_unstale":"2024-09-10T05:37:53.724971+0000","last_undegraded":"2024-09-10T05:37:53.724971+0000","last_fullsized":"2024-09-10T05:37:53.724971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:14:38.879647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'6","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.226218+0000","last_change":"2024-09-10T05:36:17.652832+0000","last_active":"2024-09-10T05:39:26.226218+0000","last_peered":"2024-09-10T05:39:26.226218+0000","last_clean":"2024-09-10T05:39:26.226218+0000","last_became_active":"2024-09-10T05:36:17.648835+0000","last_became_peered":"2024-09-10T05:36:17.648835+0000","last_unstale":"2024-09-10T05:39:26.226218+0000","last_undegraded":"2024-09-10T05:39:26.226218+0000","last_fullsized":"2024-09-10T05:39:26.226218+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:46.589507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.711967+0000","last_change":"2024-09-10T05:36:19.638688+0000","last_active":"2024-09-10T05:37:53.711967+0000","last_peered":"2024-09-10T05:37:53.711967+0000","last_clean":"2024-09-10T05:37:53.711967+0000","last_became_active":"2024-09-10T05:36:19.637912+0000","last_became_peered":"2024-09-10T05:36:19.637912+0000","last_unstale":"2024-09-10T05:37:53.711967+0000","last_undegraded":"2024-09-10T05:37:53.711967+0000","last_fullsized":"2024-09-10T05:37:53.711967+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:25:54.923848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.854267+0000","last_change":"2024-09-10T05:36:21.668904+0000","last_active":"2024-09-10T05:37:53.854267+0000","last_peered":"2024-09-10T05:37:53.854267+0000","last_clean":"2024-09-10T05:37:53.854267+0000","last_became_active":"2024-09-10T05:36:21.666877+0000","last_became_peered":"2024-09-10T05:36:21.666877+0000","last_unstale":"2024-09-10T05:37:53.854267+0000","last_undegraded":"2024-09-10T05:37:53.854267+0000","last_fullsized":"2024-09-10T05:37:53.854267+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:43:13.848554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"34'4","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.856889+0000","last_change":"2024-09-10T05:36:13.598863+0000","last_active":"2024-09-10T05:39:26.856889+0000","last_peered":"2024-09-10T05:39:26.856889+0000","last_clean":"2024-09-10T05:39:26.856889+0000","last_became_active":"2024-09-10T05:36:13.597857+0000","last_became_peered":"2024-09-10T05:36:13.597857+0000","last_unstale":"2024-09-10T05:39:26.856889+0000","last_undegraded":"2024-09-10T05:39:26.856889+0000","last_fullsized":"2024-09-10T05:39:26.856889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:32:45.970120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.898820+0000","last_change":"2024-09-10T05:36:11.601417+0000","last_active":"2024-09-10T05:37:55.898820+0000","last_peered":"2024-09-10T05:37:55.898820+0000","last_clean":"2024-09-10T05:37:55.898820+0000","last_became_active":"2024-09-10T05:36:11.600603+0000","last_became_peered":"2024-09-10T05:36:11.600603+0000","last_unstale":"2024-09-10T05:37:55.898820+0000","last_undegraded":"2024-09-10T05:37:55.898820+0000","last_fullsized":"2024-09-10T05:37:55.898820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:55:12.247844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.900977+0000","last_change":"2024-09-10T05:36:15.638682+0000","last_active":"2024-09-10T05:37:55.900977+0000","last_peered":"2024-09-10T05:37:55.900977+0000","last_clean":"2024-09-10T05:37:55.900977+0000","last_became_active":"2024-09-10T05:36:15.638197+0000","last_became_peered":"2024-09-10T05:36:15.638197+0000","last_unstale":"2024-09-10T05:37:55.900977+0000","last_undegraded":"2024-09-10T05:37:55.900977+0000","last_fullsized":"2024-09-10T05:37:55.900977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:53:28.099101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"34'42","reported_seq":106,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.587641+0000","last_change":"2024-09-10T05:36:17.647135+0000","last_active":"2024-09-10T05:39:27.587641+0000","last_peered":"2024-09-10T05:39:27.587641+0000","last_clean":"2024-09-10T05:39:27.587641+0000","last_became_active":"2024-09-10T05:36:17.646459+0000","last_became_peered":"2024-09-10T05:36:17.646459+0000","last_unstale":"2024-09-10T05:39:27.587641+0000","last_undegraded":"2024-09-10T05:39:27.587641+0000","last_fullsized":"2024-09-10T05:39:27.587641+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:25:06.130753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.852746+0000","last_change":"2024-09-10T05:36:19.654869+0000","last_active":"2024-09-10T05:37:53.852746+0000","last_peered":"2024-09-10T05:37:53.852746+0000","last_clean":"2024-09-10T05:37:53.852746+0000","last_became_active":"2024-09-10T05:36:19.648608+0000","last_became_peered":"2024-09-10T05:36:19.648608+0000","last_unstale":"2024-09-10T05:37:53.852746+0000","last_undegraded":"2024-09-10T05:37:53.852746+0000","last_fullsized":"2024-09-10T05:37:53.852746+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:00.797025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.723161+0000","last_change":"2024-09-10T05:36:21.684218+0000","last_active":"2024-09-10T05:37:53.723161+0000","last_peered":"2024-09-10T05:37:53.723161+0000","last_clean":"2024-09-10T05:37:53.723161+0000","last_became_active":"2024-09-10T05:36:21.683406+0000","last_became_peered":"2024-09-10T05:36:21.683406+0000","last_unstale":"2024-09-10T05:37:53.723161+0000","last_undegraded":"2024-09-10T05:37:53.723161+0000","last_fullsized":"2024-09-10T05:37:53.723161+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:58:10.494998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'4","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.200914+0000","last_change":"2024-09-10T05:36:13.607573+0000","last_active":"2024-09-10T05:39:27.200914+0000","last_peered":"2024-09-10T05:39:27.200914+0000","last_clean":"2024-09-10T05:39:27.200914+0000","last_became_active":"2024-09-10T05:36:13.606903+0000","last_became_peered":"2024-09-10T05:36:13.606903+0000","last_unstale":"2024-09-10T05:39:27.200914+0000","last_undegraded":"2024-09-10T05:39:27.200914+0000","last_fullsized":"2024-09-10T05:39:27.200914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:36.946797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.859661+0000","last_change":"2024-09-10T05:36:11.595373+0000","last_active":"2024-09-10T05:37:53.859661+0000","last_peered":"2024-09-10T05:37:53.859661+0000","last_clean":"2024-09-10T05:37:53.859661+0000","last_became_active":"2024-09-10T05:36:11.594653+0000","last_became_peered":"2024-09-10T05:36:11.594653+0000","last_unstale":"2024-09-10T05:37:53.859661+0000","last_undegraded":"2024-09-10T05:37:53.859661+0000","last_fullsized":"2024-09-10T05:37:53.859661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:01:15.108575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"34'5","reported_seq":424,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.336436+0000","last_change":"2024-09-10T05:36:15.617558+0000","last_active":"2024-09-10T05:39:58.336436+0000","last_peered":"2024-09-10T05:39:58.336436+0000","last_clean":"2024-09-10T05:39:58.336436+0000","last_became_active":"2024-09-10T05:36:15.615147+0000","last_became_peered":"2024-09-10T05:36:15.615147+0000","last_unstale":"2024-09-10T05:39:58.336436+0000","last_undegraded":"2024-09-10T05:39:58.336436+0000","last_fullsized":"2024-09-10T05:39:58.336436+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:18:16.479290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1429,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":586,"num_read_kb":586,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'30","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.003868+0000","last_change":"2024-09-10T05:36:17.632006+0000","last_active":"2024-09-10T05:38:24.003868+0000","last_peered":"2024-09-10T05:38:24.003868+0000","last_clean":"2024-09-10T05:38:24.003868+0000","last_became_active":"2024-09-10T05:36:17.631446+0000","last_became_peered":"2024-09-10T05:36:17.631446+0000","last_unstale":"2024-09-10T05:38:24.003868+0000","last_undegraded":"2024-09-10T05:38:24.003868+0000","last_fullsized":"2024-09-10T05:38:24.003868+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:30.388651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.715083+0000","last_change":"2024-09-10T05:36:19.639207+0000","last_active":"2024-09-10T05:37:53.715083+0000","last_peered":"2024-09-10T05:37:53.715083+0000","last_clean":"2024-09-10T05:37:53.715083+0000","last_became_active":"2024-09-10T05:36:19.638240+0000","last_became_peered":"2024-09-10T05:36:19.638240+0000","last_unstale":"2024-09-10T05:37:53.715083+0000","last_undegraded":"2024-09-10T05:37:53.715083+0000","last_fullsized":"2024-09-10T05:37:53.715083+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:39:50.347393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'8","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.905694+0000","last_change":"2024-09-10T05:36:13.619194+0000","last_active":"2024-09-10T05:37:55.905694+0000","last_peered":"2024-09-10T05:37:55.905694+0000","last_clean":"2024-09-10T05:37:55.905694+0000","last_became_active":"2024-09-10T05:36:13.618656+0000","last_became_peered":"2024-09-10T05:36:13.618656+0000","last_unstale":"2024-09-10T05:37:55.905694+0000","last_undegraded":"2024-09-10T05:37:55.905694+0000","last_fullsized":"2024-09-10T05:37:55.905694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:02:21.175825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.721692+0000","last_change":"2024-09-10T05:36:11.598128+0000","last_active":"2024-09-10T05:37:53.721692+0000","last_peered":"2024-09-10T05:37:53.721692+0000","last_clean":"2024-09-10T05:37:53.721692+0000","last_became_active":"2024-09-10T05:36:11.597710+0000","last_became_peered":"2024-09-10T05:36:11.597710+0000","last_unstale":"2024-09-10T05:37:53.721692+0000","last_undegraded":"2024-09-10T05:37:53.721692+0000","last_fullsized":"2024-09-10T05:37:53.721692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:38:54.156857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.856979+0000","last_change":"2024-09-10T05:36:15.627731+0000","last_active":"2024-09-10T05:37:53.856979+0000","last_peered":"2024-09-10T05:37:53.856979+0000","last_clean":"2024-09-10T05:37:53.856979+0000","last_became_active":"2024-09-10T05:36:15.626787+0000","last_became_peered":"2024-09-10T05:36:15.626787+0000","last_unstale":"2024-09-10T05:37:53.856979+0000","last_undegraded":"2024-09-10T05:37:53.856979+0000","last_fullsized":"2024-09-10T05:37:53.856979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:46:30.721119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"34'60","reported_seq":127,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.046372+0000","last_change":"2024-09-10T05:36:17.645250+0000","last_active":"2024-09-10T05:38:24.046372+0000","last_peered":"2024-09-10T05:38:24.046372+0000","last_clean":"2024-09-10T05:38:24.046372+0000","last_became_active":"2024-09-10T05:36:17.644469+0000","last_became_peered":"2024-09-10T05:36:17.644469+0000","last_unstale":"2024-09-10T05:38:24.046372+0000","last_undegraded":"2024-09-10T05:38:24.046372+0000","last_fullsized":"2024-09-10T05:38:24.046372+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:35.181585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":58,"num_read_kb":48,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.715316+0000","last_change":"2024-09-10T05:36:19.639542+0000","last_active":"2024-09-10T05:37:53.715316+0000","last_peered":"2024-09-10T05:37:53.715316+0000","last_clean":"2024-09-10T05:37:53.715316+0000","last_became_active":"2024-09-10T05:36:19.638136+0000","last_became_peered":"2024-09-10T05:36:19.638136+0000","last_unstale":"2024-09-10T05:37:53.715316+0000","last_undegraded":"2024-09-10T05:37:53.715316+0000","last_fullsized":"2024-09-10T05:37:53.715316+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:15:07.235287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'14","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:26.038899+0000","last_change":"2024-09-10T05:36:21.682080+0000","last_active":"2024-09-10T05:38:26.038899+0000","last_peered":"2024-09-10T05:38:26.038899+0000","last_clean":"2024-09-10T05:38:26.038899+0000","last_became_active":"2024-09-10T05:36:21.681263+0000","last_became_peered":"2024-09-10T05:36:21.681263+0000","last_unstale":"2024-09-10T05:38:26.038899+0000","last_undegraded":"2024-09-10T05:38:26.038899+0000","last_fullsized":"2024-09-10T05:38:26.038899+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:35:30.867304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"34'10","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.004821+0000","last_change":"2024-09-10T05:36:13.610413+0000","last_active":"2024-09-10T05:39:27.004821+0000","last_peered":"2024-09-10T05:39:27.004821+0000","last_clean":"2024-09-10T05:39:27.004821+0000","last_became_active":"2024-09-10T05:36:13.609773+0000","last_became_peered":"2024-09-10T05:36:13.609773+0000","last_unstale":"2024-09-10T05:39:27.004821+0000","last_undegraded":"2024-09-10T05:39:27.004821+0000","last_fullsized":"2024-09-10T05:39:27.004821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:39:34.903497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.853462+0000","last_change":"2024-09-10T05:36:11.596239+0000","last_active":"2024-09-10T05:37:53.853462+0000","last_peered":"2024-09-10T05:37:53.853462+0000","last_clean":"2024-09-10T05:37:53.853462+0000","last_became_active":"2024-09-10T05:36:11.595758+0000","last_became_peered":"2024-09-10T05:36:11.595758+0000","last_unstale":"2024-09-10T05:37:53.853462+0000","last_undegraded":"2024-09-10T05:37:53.853462+0000","last_fullsized":"2024-09-10T05:37:53.853462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:59:57.154376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.906346+0000","last_change":"2024-09-10T05:36:15.614782+0000","last_active":"2024-09-10T05:37:55.906346+0000","last_peered":"2024-09-10T05:37:55.906346+0000","last_clean":"2024-09-10T05:37:55.906346+0000","last_became_active":"2024-09-10T05:36:15.613949+0000","last_became_peered":"2024-09-10T05:36:15.613949+0000","last_unstale":"2024-09-10T05:37:55.906346+0000","last_undegraded":"2024-09-10T05:37:55.906346+0000","last_fullsized":"2024-09-10T05:37:55.906346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:33.167655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"34'36","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.006452+0000","last_change":"2024-09-10T05:36:17.637253+0000","last_active":"2024-09-10T05:38:24.006452+0000","last_peered":"2024-09-10T05:38:24.006452+0000","last_clean":"2024-09-10T05:38:24.006452+0000","last_became_active":"2024-09-10T05:36:17.636067+0000","last_became_peered":"2024-09-10T05:36:17.636067+0000","last_unstale":"2024-09-10T05:38:24.006452+0000","last_undegraded":"2024-09-10T05:38:24.006452+0000","last_fullsized":"2024-09-10T05:38:24.006452+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:27:48.471606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.856515+0000","last_change":"2024-09-10T05:36:19.665827+0000","last_active":"2024-09-10T05:37:53.856515+0000","last_peered":"2024-09-10T05:37:53.856515+0000","last_clean":"2024-09-10T05:37:53.856515+0000","last_became_active":"2024-09-10T05:36:19.665010+0000","last_became_peered":"2024-09-10T05:36:19.665010+0000","last_unstale":"2024-09-10T05:37:53.856515+0000","last_undegraded":"2024-09-10T05:37:53.856515+0000","last_fullsized":"2024-09-10T05:37:53.856515+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:47:10.890181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.899872+0000","last_change":"2024-09-10T05:36:21.665684+0000","last_active":"2024-09-10T05:37:55.899872+0000","last_peered":"2024-09-10T05:37:55.899872+0000","last_clean":"2024-09-10T05:37:55.899872+0000","last_became_active":"2024-09-10T05:36:21.664884+0000","last_became_peered":"2024-09-10T05:36:21.664884+0000","last_unstale":"2024-09-10T05:37:55.899872+0000","last_undegraded":"2024-09-10T05:37:55.899872+0000","last_fullsized":"2024-09-10T05:37:55.899872+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:21:16.296649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.726940+0000","last_change":"2024-09-10T05:36:13.616705+0000","last_active":"2024-09-10T05:37:53.726940+0000","last_peered":"2024-09-10T05:37:53.726940+0000","last_clean":"2024-09-10T05:37:53.726940+0000","last_became_active":"2024-09-10T05:36:13.616392+0000","last_became_peered":"2024-09-10T05:36:13.616392+0000","last_unstale":"2024-09-10T05:37:53.726940+0000","last_undegraded":"2024-09-10T05:37:53.726940+0000","last_fullsized":"2024-09-10T05:37:53.726940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:58:42.346686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.808522+0000","last_change":"2024-09-10T05:36:11.596038+0000","last_active":"2024-09-10T05:39:26.808522+0000","last_peered":"2024-09-10T05:39:26.808522+0000","last_clean":"2024-09-10T05:39:26.808522+0000","last_became_active":"2024-09-10T05:36:11.595319+0000","last_became_peered":"2024-09-10T05:36:11.595319+0000","last_unstale":"2024-09-10T05:39:26.808522+0000","last_undegraded":"2024-09-10T05:39:26.808522+0000","last_fullsized":"2024-09-10T05:39:26.808522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:55:19.990619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.902488+0000","last_change":"2024-09-10T05:36:15.618307+0000","last_active":"2024-09-10T05:37:55.902488+0000","last_peered":"2024-09-10T05:37:55.902488+0000","last_clean":"2024-09-10T05:37:55.902488+0000","last_became_active":"2024-09-10T05:36:15.617595+0000","last_became_peered":"2024-09-10T05:36:15.617595+0000","last_unstale":"2024-09-10T05:37:55.902488+0000","last_undegraded":"2024-09-10T05:37:55.902488+0000","last_fullsized":"2024-09-10T05:37:55.902488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:38.424958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1f","version":"34'41","reported_seq":99,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.551852+0000","last_change":"2024-09-10T05:36:17.635281+0000","last_active":"2024-09-10T05:39:58.551852+0000","last_peered":"2024-09-10T05:39:58.551852+0000","last_clean":"2024-09-10T05:39:58.551852+0000","last_became_active":"2024-09-10T05:36:17.634616+0000","last_became_peered":"2024-09-10T05:36:17.634616+0000","last_unstale":"2024-09-10T05:39:58.551852+0000","last_undegraded":"2024-09-10T05:39:58.551852+0000","last_fullsized":"2024-09-10T05:39:58.551852+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:14.597186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.859042+0000","last_change":"2024-09-10T05:36:19.665974+0000","last_active":"2024-09-10T05:37:53.859042+0000","last_peered":"2024-09-10T05:37:53.859042+0000","last_clean":"2024-09-10T05:37:53.859042+0000","last_became_active":"2024-09-10T05:36:19.665236+0000","last_became_peered":"2024-09-10T05:36:19.665236+0000","last_unstale":"2024-09-10T05:37:53.859042+0000","last_undegraded":"2024-09-10T05:37:53.859042+0000","last_fullsized":"2024-09-10T05:37:53.859042+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:24.647011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"34'5","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.906432+0000","last_change":"2024-09-10T05:36:21.695106+0000","last_active":"2024-09-10T05:39:26.906432+0000","last_peered":"2024-09-10T05:39:26.906432+0000","last_clean":"2024-09-10T05:39:26.906432+0000","last_became_active":"2024-09-10T05:36:21.694522+0000","last_became_peered":"2024-09-10T05:36:21.694522+0000","last_unstale":"2024-09-10T05:39:26.906432+0000","last_undegraded":"2024-09-10T05:39:26.906432+0000","last_fullsized":"2024-09-10T05:39:26.906432+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:40.765075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.295199+0000","last_change":"2024-09-10T05:36:13.611415+0000","last_active":"2024-09-10T05:39:27.295199+0000","last_peered":"2024-09-10T05:39:27.295199+0000","last_clean":"2024-09-10T05:39:27.295199+0000","last_became_active":"2024-09-10T05:36:13.610788+0000","last_became_peered":"2024-09-10T05:36:13.610788+0000","last_unstale":"2024-09-10T05:39:27.295199+0000","last_undegraded":"2024-09-10T05:39:27.295199+0000","last_fullsized":"2024-09-10T05:39:27.295199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:04.364523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"32'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.724690+0000","last_change":"2024-09-10T05:36:11.606056+0000","last_active":"2024-09-10T05:37:53.724690+0000","last_peered":"2024-09-10T05:37:53.724690+0000","last_clean":"2024-09-10T05:37:53.724690+0000","last_became_active":"2024-09-10T05:36:11.600655+0000","last_became_peered":"2024-09-10T05:36:11.600655+0000","last_unstale":"2024-09-10T05:37:53.724690+0000","last_undegraded":"2024-09-10T05:37:53.724690+0000","last_fullsized":"2024-09-10T05:37:53.724690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:42:31.168856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.857028+0000","last_change":"2024-09-10T05:36:15.624306+0000","last_active":"2024-09-10T05:37:53.857028+0000","last_peered":"2024-09-10T05:37:53.857028+0000","last_clean":"2024-09-10T05:37:53.857028+0000","last_became_active":"2024-09-10T05:36:15.623436+0000","last_became_peered":"2024-09-10T05:36:15.623436+0000","last_unstale":"2024-09-10T05:37:53.857028+0000","last_undegraded":"2024-09-10T05:37:53.857028+0000","last_fullsized":"2024-09-10T05:37:53.857028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:35:42.347473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'16","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.729552+0000","last_change":"2024-09-10T05:36:17.639307+0000","last_active":"2024-09-10T05:37:53.729552+0000","last_peered":"2024-09-10T05:37:53.729552+0000","last_clean":"2024-09-10T05:37:53.729552+0000","last_became_active":"2024-09-10T05:36:17.638408+0000","last_became_peered":"2024-09-10T05:36:17.638408+0000","last_unstale":"2024-09-10T05:37:53.729552+0000","last_undegraded":"2024-09-10T05:37:53.729552+0000","last_fullsized":"2024-09-10T05:37:53.729552+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:30.086363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'282","reported_seq":423,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.376804+0000","last_change":"2024-09-10T05:36:19.651451+0000","last_active":"2024-09-10T05:39:27.376804+0000","last_peered":"2024-09-10T05:39:27.376804+0000","last_clean":"2024-09-10T05:39:27.376804+0000","last_became_active":"2024-09-10T05:36:19.649079+0000","last_became_peered":"2024-09-10T05:36:19.649079+0000","last_unstale":"2024-09-10T05:39:27.376804+0000","last_undegraded":"2024-09-10T05:39:27.376804+0000","last_fullsized":"2024-09-10T05:39:27.376804+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:13:31.933741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.899307+0000","last_change":"2024-09-10T05:36:21.665833+0000","last_active":"2024-09-10T05:37:55.899307+0000","last_peered":"2024-09-10T05:37:55.899307+0000","last_clean":"2024-09-10T05:37:55.899307+0000","last_became_active":"2024-09-10T05:36:21.665112+0000","last_became_peered":"2024-09-10T05:36:21.665112+0000","last_unstale":"2024-09-10T05:37:55.899307+0000","last_undegraded":"2024-09-10T05:37:55.899307+0000","last_fullsized":"2024-09-10T05:37:55.899307+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:16:25.547381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"32'8","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.714229+0000","last_change":"2024-09-10T05:36:13.620715+0000","last_active":"2024-09-10T05:37:53.714229+0000","last_peered":"2024-09-10T05:37:53.714229+0000","last_clean":"2024-09-10T05:37:53.714229+0000","last_became_active":"2024-09-10T05:36:13.614222+0000","last_became_peered":"2024-09-10T05:36:13.614222+0000","last_unstale":"2024-09-10T05:37:53.714229+0000","last_undegraded":"2024-09-10T05:37:53.714229+0000","last_fullsized":"2024-09-10T05:37:53.714229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:14:25.317688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.180964+0000","last_change":"2024-09-10T05:36:11.593230+0000","last_active":"2024-09-10T05:39:27.180964+0000","last_peered":"2024-09-10T05:39:27.180964+0000","last_clean":"2024-09-10T05:39:27.180964+0000","last_became_active":"2024-09-10T05:36:11.592805+0000","last_became_peered":"2024-09-10T05:36:11.592805+0000","last_unstale":"2024-09-10T05:39:27.180964+0000","last_undegraded":"2024-09-10T05:39:27.180964+0000","last_fullsized":"2024-09-10T05:39:27.180964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:02:54.932468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.857006+0000","last_change":"2024-09-10T05:36:15.620727+0000","last_active":"2024-09-10T05:37:53.857006+0000","last_peered":"2024-09-10T05:37:53.857006+0000","last_clean":"2024-09-10T05:37:53.857006+0000","last_became_active":"2024-09-10T05:36:15.620288+0000","last_became_peered":"2024-09-10T05:36:15.620288+0000","last_unstale":"2024-09-10T05:37:53.857006+0000","last_undegraded":"2024-09-10T05:37:53.857006+0000","last_fullsized":"2024-09-10T05:37:53.857006+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:02:23.187158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'60","reported_seq":134,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:23.987842+0000","last_change":"2024-09-10T05:36:17.651973+0000","last_active":"2024-09-10T05:38:23.987842+0000","last_peered":"2024-09-10T05:38:23.987842+0000","last_clean":"2024-09-10T05:38:23.987842+0000","last_became_active":"2024-09-10T05:36:17.651364+0000","last_became_peered":"2024-09-10T05:36:17.651364+0000","last_unstale":"2024-09-10T05:38:23.987842+0000","last_undegraded":"2024-09-10T05:38:23.987842+0000","last_fullsized":"2024-09-10T05:38:23.987842+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:42:52.172095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":74,"num_read_kb":61,"num_write":42,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.721434+0000","last_change":"2024-09-10T05:36:19.659340+0000","last_active":"2024-09-10T05:37:53.721434+0000","last_peered":"2024-09-10T05:37:53.721434+0000","last_clean":"2024-09-10T05:37:53.721434+0000","last_became_active":"2024-09-10T05:36:19.658646+0000","last_became_peered":"2024-09-10T05:36:19.658646+0000","last_unstale":"2024-09-10T05:37:53.721434+0000","last_undegraded":"2024-09-10T05:37:53.721434+0000","last_fullsized":"2024-09-10T05:37:53.721434+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:22:35.133305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"34'4","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.471685+0000","last_change":"2024-09-10T05:36:21.689581+0000","last_active":"2024-09-10T05:39:27.471685+0000","last_peered":"2024-09-10T05:39:27.471685+0000","last_clean":"2024-09-10T05:39:27.471685+0000","last_became_active":"2024-09-10T05:36:21.688695+0000","last_became_peered":"2024-09-10T05:36:21.688695+0000","last_unstale":"2024-09-10T05:39:27.471685+0000","last_undegraded":"2024-09-10T05:39:27.471685+0000","last_fullsized":"2024-09-10T05:39:27.471685+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:53.585393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"34'4","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:21.802832+0000","last_change":"2024-09-10T05:36:13.616187+0000","last_active":"2024-09-10T05:38:21.802832+0000","last_peered":"2024-09-10T05:38:21.802832+0000","last_clean":"2024-09-10T05:38:21.802832+0000","last_became_active":"2024-09-10T05:36:13.615340+0000","last_became_peered":"2024-09-10T05:36:13.615340+0000","last_unstale":"2024-09-10T05:38:21.802832+0000","last_undegraded":"2024-09-10T05:38:21.802832+0000","last_fullsized":"2024-09-10T05:38:21.802832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:35:40.336140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"30'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.897590+0000","last_change":"2024-09-10T05:36:11.598985+0000","last_active":"2024-09-10T05:37:55.897590+0000","last_peered":"2024-09-10T05:37:55.897590+0000","last_clean":"2024-09-10T05:37:55.897590+0000","last_became_active":"2024-09-10T05:36:11.597360+0000","last_became_peered":"2024-09-10T05:36:11.597360+0000","last_unstale":"2024-09-10T05:37:55.897590+0000","last_undegraded":"2024-09-10T05:37:55.897590+0000","last_fullsized":"2024-09-10T05:37:55.897590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:38:31.576663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.902188+0000","last_change":"2024-09-10T05:36:15.620708+0000","last_active":"2024-09-10T05:37:55.902188+0000","last_peered":"2024-09-10T05:37:55.902188+0000","last_clean":"2024-09-10T05:37:55.902188+0000","last_became_active":"2024-09-10T05:36:15.619849+0000","last_became_peered":"2024-09-10T05:36:15.619849+0000","last_unstale":"2024-09-10T05:37:55.902188+0000","last_undegraded":"2024-09-10T05:37:55.902188+0000","last_fullsized":"2024-09-10T05:37:55.902188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:47:32.506655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"34'37","reported_seq":90,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:23.989171+0000","last_change":"2024-09-10T05:36:17.647578+0000","last_active":"2024-09-10T05:38:23.989171+0000","last_peered":"2024-09-10T05:38:23.989171+0000","last_clean":"2024-09-10T05:38:23.989171+0000","last_became_active":"2024-09-10T05:36:17.646780+0000","last_became_peered":"2024-09-10T05:36:17.646780+0000","last_unstale":"2024-09-10T05:38:23.989171+0000","last_undegraded":"2024-09-10T05:38:23.989171+0000","last_fullsized":"2024-09-10T05:38:23.989171+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:44.392590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.896432+0000","last_change":"2024-09-10T05:36:19.652878+0000","last_active":"2024-09-10T05:37:55.896432+0000","last_peered":"2024-09-10T05:37:55.896432+0000","last_clean":"2024-09-10T05:37:55.896432+0000","last_became_active":"2024-09-10T05:36:19.652114+0000","last_became_peered":"2024-09-10T05:36:19.652114+0000","last_unstale":"2024-09-10T05:37:55.896432+0000","last_undegraded":"2024-09-10T05:37:55.896432+0000","last_fullsized":"2024-09-10T05:37:55.896432+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:46:40.081106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.16","version":"34'2","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.271654+0000","last_change":"2024-09-10T05:36:21.693139+0000","last_active":"2024-09-10T05:39:27.271654+0000","last_peered":"2024-09-10T05:39:27.271654+0000","last_clean":"2024-09-10T05:39:27.271654+0000","last_became_active":"2024-09-10T05:36:21.692564+0000","last_became_peered":"2024-09-10T05:36:21.692564+0000","last_unstale":"2024-09-10T05:39:27.271654+0000","last_undegraded":"2024-09-10T05:39:27.271654+0000","last_fullsized":"2024-09-10T05:39:27.271654+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:51.507378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'6","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:26.195675+0000","last_change":"2024-09-10T05:36:13.600568+0000","last_active":"2024-09-10T05:38:26.195675+0000","last_peered":"2024-09-10T05:38:26.195675+0000","last_clean":"2024-09-10T05:38:26.195675+0000","last_became_active":"2024-09-10T05:36:13.600225+0000","last_became_peered":"2024-09-10T05:36:13.600225+0000","last_unstale":"2024-09-10T05:38:26.195675+0000","last_undegraded":"2024-09-10T05:38:26.195675+0000","last_fullsized":"2024-09-10T05:38:26.195675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:12:34.999826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.729875+0000","last_change":"2024-09-10T05:36:11.600905+0000","last_active":"2024-09-10T05:37:53.729875+0000","last_peered":"2024-09-10T05:37:53.729875+0000","last_clean":"2024-09-10T05:37:53.729875+0000","last_became_active":"2024-09-10T05:36:11.600598+0000","last_became_peered":"2024-09-10T05:36:11.600598+0000","last_unstale":"2024-09-10T05:37:53.729875+0000","last_undegraded":"2024-09-10T05:37:53.729875+0000","last_fullsized":"2024-09-10T05:37:53.729875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:33:49.620025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.853389+0000","last_change":"2024-09-10T05:36:15.635553+0000","last_active":"2024-09-10T05:37:53.853389+0000","last_peered":"2024-09-10T05:37:53.853389+0000","last_clean":"2024-09-10T05:37:53.853389+0000","last_became_active":"2024-09-10T05:36:15.634465+0000","last_became_peered":"2024-09-10T05:36:15.634465+0000","last_unstale":"2024-09-10T05:37:53.853389+0000","last_undegraded":"2024-09-10T05:37:53.853389+0000","last_fullsized":"2024-09-10T05:37:53.853389+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:18:38.683911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'36","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.537394+0000","last_change":"2024-09-10T05:36:17.635770+0000","last_active":"2024-09-10T05:39:58.537394+0000","last_peered":"2024-09-10T05:39:58.537394+0000","last_clean":"2024-09-10T05:39:58.537394+0000","last_became_active":"2024-09-10T05:36:17.634874+0000","last_became_peered":"2024-09-10T05:36:17.634874+0000","last_unstale":"2024-09-10T05:39:58.537394+0000","last_undegraded":"2024-09-10T05:39:58.537394+0000","last_fullsized":"2024-09-10T05:39:58.537394+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:54:06.818353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.898394+0000","last_change":"2024-09-10T05:36:19.638483+0000","last_active":"2024-09-10T05:37:55.898394+0000","last_peered":"2024-09-10T05:37:55.898394+0000","last_clean":"2024-09-10T05:37:55.898394+0000","last_became_active":"2024-09-10T05:36:19.637682+0000","last_became_peered":"2024-09-10T05:36:19.637682+0000","last_unstale":"2024-09-10T05:37:55.898394+0000","last_undegraded":"2024-09-10T05:37:55.898394+0000","last_fullsized":"2024-09-10T05:37:55.898394+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:35.498813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"34'4","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.056283+0000","last_change":"2024-09-10T05:36:21.688794+0000","last_active":"2024-09-10T05:38:24.056283+0000","last_peered":"2024-09-10T05:38:24.056283+0000","last_clean":"2024-09-10T05:38:24.056283+0000","last_became_active":"2024-09-10T05:36:21.688046+0000","last_became_peered":"2024-09-10T05:36:21.688046+0000","last_unstale":"2024-09-10T05:38:24.056283+0000","last_undegraded":"2024-09-10T05:38:24.056283+0000","last_fullsized":"2024-09-10T05:38:24.056283+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:06:36.753067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.200751+0000","last_change":"2024-09-10T05:36:13.612701+0000","last_active":"2024-09-10T05:39:27.200751+0000","last_peered":"2024-09-10T05:39:27.200751+0000","last_clean":"2024-09-10T05:39:27.200751+0000","last_became_active":"2024-09-10T05:36:13.611864+0000","last_became_peered":"2024-09-10T05:36:13.611864+0000","last_unstale":"2024-09-10T05:39:27.200751+0000","last_undegraded":"2024-09-10T05:39:27.200751+0000","last_fullsized":"2024-09-10T05:39:27.200751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:07:57.487596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"32'3","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.859772+0000","last_change":"2024-09-10T05:36:11.595800+0000","last_active":"2024-09-10T05:37:53.859772+0000","last_peered":"2024-09-10T05:37:53.859772+0000","last_clean":"2024-09-10T05:37:53.859772+0000","last_became_active":"2024-09-10T05:36:11.594949+0000","last_became_peered":"2024-09-10T05:36:11.594949+0000","last_unstale":"2024-09-10T05:37:53.859772+0000","last_undegraded":"2024-09-10T05:37:53.859772+0000","last_fullsized":"2024-09-10T05:37:53.859772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:42.468342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:22.306367+0000","last_change":"2024-09-10T05:36:15.619284+0000","last_active":"2024-09-10T05:38:22.306367+0000","last_peered":"2024-09-10T05:38:22.306367+0000","last_clean":"2024-09-10T05:38:22.306367+0000","last_became_active":"2024-09-10T05:36:15.618169+0000","last_became_peered":"2024-09-10T05:36:15.618169+0000","last_unstale":"2024-09-10T05:38:22.306367+0000","last_undegraded":"2024-09-10T05:38:22.306367+0000","last_fullsized":"2024-09-10T05:38:22.306367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:22:48.592489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'47","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.260272+0000","last_change":"2024-09-10T05:36:17.631950+0000","last_active":"2024-09-10T05:39:26.260272+0000","last_peered":"2024-09-10T05:39:26.260272+0000","last_clean":"2024-09-10T05:39:26.260272+0000","last_became_active":"2024-09-10T05:36:17.631194+0000","last_became_peered":"2024-09-10T05:36:17.631194+0000","last_unstale":"2024-09-10T05:39:26.260272+0000","last_undegraded":"2024-09-10T05:39:26.260272+0000","last_fullsized":"2024-09-10T05:39:26.260272+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:53:16.893462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":67,"num_write":34,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.713950+0000","last_change":"2024-09-10T05:36:19.637266+0000","last_active":"2024-09-10T05:37:53.713950+0000","last_peered":"2024-09-10T05:37:53.713950+0000","last_clean":"2024-09-10T05:37:53.713950+0000","last_became_active":"2024-09-10T05:36:19.636483+0000","last_became_peered":"2024-09-10T05:36:19.636483+0000","last_unstale":"2024-09-10T05:37:53.713950+0000","last_undegraded":"2024-09-10T05:37:53.713950+0000","last_fullsized":"2024-09-10T05:37:53.713950+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:56:30.945572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"34'8","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.060943+0000","last_change":"2024-09-10T05:36:21.689539+0000","last_active":"2024-09-10T05:38:24.060943+0000","last_peered":"2024-09-10T05:38:24.060943+0000","last_clean":"2024-09-10T05:38:24.060943+0000","last_became_active":"2024-09-10T05:36:21.688818+0000","last_became_peered":"2024-09-10T05:36:21.688818+0000","last_unstale":"2024-09-10T05:38:24.060943+0000","last_undegraded":"2024-09-10T05:38:24.060943+0000","last_fullsized":"2024-09-10T05:38:24.060943+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:50:15.537977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":19,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"34'8","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.381517+0000","last_change":"2024-09-10T05:36:13.618862+0000","last_active":"2024-09-10T05:39:27.381517+0000","last_peered":"2024-09-10T05:39:27.381517+0000","last_clean":"2024-09-10T05:39:27.381517+0000","last_became_active":"2024-09-10T05:36:13.618260+0000","last_became_peered":"2024-09-10T05:36:13.618260+0000","last_unstale":"2024-09-10T05:39:27.381517+0000","last_undegraded":"2024-09-10T05:39:27.381517+0000","last_fullsized":"2024-09-10T05:39:27.381517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:25:48.886027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.711408+0000","last_change":"2024-09-10T05:36:11.604033+0000","last_active":"2024-09-10T05:37:53.711408+0000","last_peered":"2024-09-10T05:37:53.711408+0000","last_clean":"2024-09-10T05:37:53.711408+0000","last_became_active":"2024-09-10T05:36:11.603738+0000","last_became_peered":"2024-09-10T05:36:11.603738+0000","last_unstale":"2024-09-10T05:37:53.711408+0000","last_undegraded":"2024-09-10T05:37:53.711408+0000","last_fullsized":"2024-09-10T05:37:53.711408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:24:44.820464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'14","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.005687+0000","last_change":"2024-09-10T05:36:13.624965+0000","last_active":"2024-09-10T05:39:27.005687+0000","last_peered":"2024-09-10T05:39:27.005687+0000","last_clean":"2024-09-10T05:39:27.005687+0000","last_became_active":"2024-09-10T05:36:13.624460+0000","last_became_peered":"2024-09-10T05:36:13.624460+0000","last_unstale":"2024-09-10T05:39:27.005687+0000","last_undegraded":"2024-09-10T05:39:27.005687+0000","last_fullsized":"2024-09-10T05:39:27.005687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:05:54.096604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":58,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"34'1","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:17.679564+0000","last_change":"2024-09-10T05:36:11.602104+0000","last_active":"2024-09-10T05:38:17.679564+0000","last_peered":"2024-09-10T05:38:17.679564+0000","last_clean":"2024-09-10T05:38:17.679564+0000","last_became_active":"2024-09-10T05:36:11.601762+0000","last_became_peered":"2024-09-10T05:36:11.601762+0000","last_unstale":"2024-09-10T05:38:17.679564+0000","last_undegraded":"2024-09-10T05:38:17.679564+0000","last_fullsized":"2024-09-10T05:38:17.679564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:40:20.378957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"34'20","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.202070+0000","last_change":"2024-09-10T05:36:13.615511+0000","last_active":"2024-09-10T05:39:27.202070+0000","last_peered":"2024-09-10T05:39:27.202070+0000","last_clean":"2024-09-10T05:39:27.202070+0000","last_became_active":"2024-09-10T05:36:13.614221+0000","last_became_peered":"2024-09-10T05:36:13.614221+0000","last_unstale":"2024-09-10T05:39:27.202070+0000","last_undegraded":"2024-09-10T05:39:27.202070+0000","last_fullsized":"2024-09-10T05:39:27.202070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:22:46.581156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":66,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.723905+0000","last_change":"2024-09-10T05:36:11.606212+0000","last_active":"2024-09-10T05:37:53.723905+0000","last_peered":"2024-09-10T05:37:53.723905+0000","last_clean":"2024-09-10T05:37:53.723905+0000","last_became_active":"2024-09-10T05:36:11.601269+0000","last_became_peered":"2024-09-10T05:36:11.601269+0000","last_unstale":"2024-09-10T05:37:53.723905+0000","last_undegraded":"2024-09-10T05:37:53.723905+0000","last_fullsized":"2024-09-10T05:37:53.723905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:20.541837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'21","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.222435+0000","last_change":"2024-09-10T05:36:13.626184+0000","last_active":"2024-09-10T05:39:27.222435+0000","last_peered":"2024-09-10T05:39:27.222435+0000","last_clean":"2024-09-10T05:39:27.222435+0000","last_became_active":"2024-09-10T05:36:13.626022+0000","last_became_peered":"2024-09-10T05:36:13.626022+0000","last_unstale":"2024-09-10T05:39:27.222435+0000","last_undegraded":"2024-09-10T05:39:27.222435+0000","last_fullsized":"2024-09-10T05:39:27.222435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:53:45.495092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":48,"num_read_kb":40,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.713130+0000","last_change":"2024-09-10T05:36:11.611309+0000","last_active":"2024-09-10T05:37:53.713130+0000","last_peered":"2024-09-10T05:37:53.713130+0000","last_clean":"2024-09-10T05:37:53.713130+0000","last_became_active":"2024-09-10T05:36:11.610933+0000","last_became_peered":"2024-09-10T05:36:11.610933+0000","last_unstale":"2024-09-10T05:37:53.713130+0000","last_undegraded":"2024-09-10T05:37:53.713130+0000","last_fullsized":"2024-09-10T05:37:53.713130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:18.400915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"34'14","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.311516+0000","last_change":"2024-09-10T05:36:13.599973+0000","last_active":"2024-09-10T05:39:27.311516+0000","last_peered":"2024-09-10T05:39:27.311516+0000","last_clean":"2024-09-10T05:39:27.311516+0000","last_became_active":"2024-09-10T05:36:13.597975+0000","last_became_peered":"2024-09-10T05:36:13.597975+0000","last_unstale":"2024-09-10T05:39:27.311516+0000","last_undegraded":"2024-09-10T05:39:27.311516+0000","last_fullsized":"2024-09-10T05:39:27.311516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:04.875436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:26.066736+0000","last_change":"2024-09-10T05:36:11.603591+0000","last_active":"2024-09-10T05:38:26.066736+0000","last_peered":"2024-09-10T05:38:26.066736+0000","last_clean":"2024-09-10T05:38:26.066736+0000","last_became_active":"2024-09-10T05:36:11.603085+0000","last_became_peered":"2024-09-10T05:36:11.603085+0000","last_unstale":"2024-09-10T05:38:26.066736+0000","last_undegraded":"2024-09-10T05:38:26.066736+0000","last_fullsized":"2024-09-10T05:38:26.066736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:10:49.254963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.854228+0000","last_change":"2024-09-10T05:36:13.611510+0000","last_active":"2024-09-10T05:37:53.854228+0000","last_peered":"2024-09-10T05:37:53.854228+0000","last_clean":"2024-09-10T05:37:53.854228+0000","last_became_active":"2024-09-10T05:36:13.610894+0000","last_became_peered":"2024-09-10T05:36:13.610894+0000","last_unstale":"2024-09-10T05:37:53.854228+0000","last_undegraded":"2024-09-10T05:37:53.854228+0000","last_fullsized":"2024-09-10T05:37:53.854228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:07:55.559113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.854514+0000","last_change":"2024-09-10T05:36:11.593190+0000","last_active":"2024-09-10T05:37:53.854514+0000","last_peered":"2024-09-10T05:37:53.854514+0000","last_clean":"2024-09-10T05:37:53.854514+0000","last_became_active":"2024-09-10T05:36:11.592809+0000","last_became_peered":"2024-09-10T05:36:11.592809+0000","last_unstale":"2024-09-10T05:37:53.854514+0000","last_undegraded":"2024-09-10T05:37:53.854514+0000","last_fullsized":"2024-09-10T05:37:53.854514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:58:36.951469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:26.178147+0000","last_change":"2024-09-10T05:36:13.607562+0000","last_active":"2024-09-10T05:38:26.178147+0000","last_peered":"2024-09-10T05:38:26.178147+0000","last_clean":"2024-09-10T05:38:26.178147+0000","last_became_active":"2024-09-10T05:36:13.607052+0000","last_became_peered":"2024-09-10T05:36:13.607052+0000","last_unstale":"2024-09-10T05:38:26.178147+0000","last_undegraded":"2024-09-10T05:38:26.178147+0000","last_fullsized":"2024-09-10T05:38:26.178147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:33:32.480741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"32'2","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.715328+0000","last_change":"2024-09-10T05:36:11.594051+0000","last_active":"2024-09-10T05:37:53.715328+0000","last_peered":"2024-09-10T05:37:53.715328+0000","last_clean":"2024-09-10T05:37:53.715328+0000","last_became_active":"2024-09-10T05:36:11.593614+0000","last_became_peered":"2024-09-10T05:36:11.593614+0000","last_unstale":"2024-09-10T05:37:53.715328+0000","last_undegraded":"2024-09-10T05:37:53.715328+0000","last_fullsized":"2024-09-10T05:37:53.715328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:46:37.205574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.363940+0000","last_change":"2024-09-10T05:36:13.595278+0000","last_active":"2024-09-10T05:39:27.363940+0000","last_peered":"2024-09-10T05:39:27.363940+0000","last_clean":"2024-09-10T05:39:27.363940+0000","last_became_active":"2024-09-10T05:36:13.593693+0000","last_became_peered":"2024-09-10T05:36:13.593693+0000","last_unstale":"2024-09-10T05:39:27.363940+0000","last_undegraded":"2024-09-10T05:39:27.363940+0000","last_fullsized":"2024-09-10T05:39:27.363940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:22:11.979321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"34'8","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.727061+0000","last_change":"2024-09-10T05:36:11.606672+0000","last_active":"2024-09-10T05:39:26.727061+0000","last_peered":"2024-09-10T05:39:26.727061+0000","last_clean":"2024-09-10T05:39:26.727061+0000","last_became_active":"2024-09-10T05:36:11.604011+0000","last_became_peered":"2024-09-10T05:36:11.604011+0000","last_unstale":"2024-09-10T05:39:26.727061+0000","last_undegraded":"2024-09-10T05:39:26.727061+0000","last_fullsized":"2024-09-10T05:39:26.727061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:10:51.639983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":24,"num_write_kb":12289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"34'16","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:26.194535+0000","last_change":"2024-09-10T05:36:13.630165+0000","last_active":"2024-09-10T05:38:26.194535+0000","last_peered":"2024-09-10T05:38:26.194535+0000","last_clean":"2024-09-10T05:38:26.194535+0000","last_became_active":"2024-09-10T05:36:13.629760+0000","last_became_peered":"2024-09-10T05:36:13.629760+0000","last_unstale":"2024-09-10T05:38:26.194535+0000","last_undegraded":"2024-09-10T05:38:26.194535+0000","last_fullsized":"2024-09-10T05:38:26.194535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:59:45.392768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":66,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.721785+0000","last_change":"2024-09-10T05:36:11.597692+0000","last_active":"2024-09-10T05:37:53.721785+0000","last_peered":"2024-09-10T05:37:53.721785+0000","last_clean":"2024-09-10T05:37:53.721785+0000","last_became_active":"2024-09-10T05:36:11.597158+0000","last_became_peered":"2024-09-10T05:36:11.597158+0000","last_unstale":"2024-09-10T05:37:53.721785+0000","last_undegraded":"2024-09-10T05:37:53.721785+0000","last_fullsized":"2024-09-10T05:37:53.721785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:49.958598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.006147+0000","last_change":"2024-09-10T05:36:13.613919+0000","last_active":"2024-09-10T05:39:27.006147+0000","last_peered":"2024-09-10T05:39:27.006147+0000","last_clean":"2024-09-10T05:39:27.006147+0000","last_became_active":"2024-09-10T05:36:13.613206+0000","last_became_peered":"2024-09-10T05:36:13.613206+0000","last_unstale":"2024-09-10T05:39:27.006147+0000","last_undegraded":"2024-09-10T05:39:27.006147+0000","last_fullsized":"2024-09-10T05:39:27.006147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:20:09.645015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.854005+0000","last_change":"2024-09-10T05:36:52.706116+0000","last_active":"2024-09-10T05:37:53.854005+0000","last_peered":"2024-09-10T05:37:53.854005+0000","last_clean":"2024-09-10T05:37:53.854005+0000","last_became_active":"2024-09-10T05:36:52.705212+0000","last_became_peered":"2024-09-10T05:36:52.705212+0000","last_unstale":"2024-09-10T05:37:53.854005+0000","last_undegraded":"2024-09-10T05:37:53.854005+0000","last_fullsized":"2024-09-10T05:37:53.854005+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:27.831627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.005396+0000","last_change":"2024-09-10T05:36:13.627667+0000","last_active":"2024-09-10T05:39:27.005396+0000","last_peered":"2024-09-10T05:39:27.005396+0000","last_clean":"2024-09-10T05:39:27.005396+0000","last_became_active":"2024-09-10T05:36:13.626912+0000","last_became_peered":"2024-09-10T05:36:13.626912+0000","last_unstale":"2024-09-10T05:39:27.005396+0000","last_undegraded":"2024-09-10T05:39:27.005396+0000","last_fullsized":"2024-09-10T05:39:27.005396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:36.054213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.896918+0000","last_change":"2024-09-10T05:36:11.607179+0000","last_active":"2024-09-10T05:37:55.896918+0000","last_peered":"2024-09-10T05:37:55.896918+0000","last_clean":"2024-09-10T05:37:55.896918+0000","last_became_active":"2024-09-10T05:36:11.606369+0000","last_became_peered":"2024-09-10T05:36:11.606369+0000","last_unstale":"2024-09-10T05:37:55.896918+0000","last_undegraded":"2024-09-10T05:37:55.896918+0000","last_fullsized":"2024-09-10T05:37:55.896918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:14:23.688323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"32'8","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.858816+0000","last_change":"2024-09-10T05:36:13.608226+0000","last_active":"2024-09-10T05:37:53.858816+0000","last_peered":"2024-09-10T05:37:53.858816+0000","last_clean":"2024-09-10T05:37:53.858816+0000","last_became_active":"2024-09-10T05:36:13.607807+0000","last_became_peered":"2024-09-10T05:36:13.607807+0000","last_unstale":"2024-09-10T05:37:53.858816+0000","last_undegraded":"2024-09-10T05:37:53.858816+0000","last_fullsized":"2024-09-10T05:37:53.858816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:30:41.672233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.854315+0000","last_change":"2024-09-10T05:36:11.594296+0000","last_active":"2024-09-10T05:37:53.854315+0000","last_peered":"2024-09-10T05:37:53.854315+0000","last_clean":"2024-09-10T05:37:53.854315+0000","last_became_active":"2024-09-10T05:36:11.593962+0000","last_became_peered":"2024-09-10T05:36:11.593962+0000","last_unstale":"2024-09-10T05:37:53.854315+0000","last_undegraded":"2024-09-10T05:37:53.854315+0000","last_fullsized":"2024-09-10T05:37:53.854315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:55.429080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.902466+0000","last_change":"2024-09-10T05:36:13.615141+0000","last_active":"2024-09-10T05:37:55.902466+0000","last_peered":"2024-09-10T05:37:55.902466+0000","last_clean":"2024-09-10T05:37:55.902466+0000","last_became_active":"2024-09-10T05:36:13.614155+0000","last_became_peered":"2024-09-10T05:36:13.614155+0000","last_unstale":"2024-09-10T05:37:55.902466+0000","last_undegraded":"2024-09-10T05:37:55.902466+0000","last_fullsized":"2024-09-10T05:37:55.902466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:39:44.309572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.724975+0000","last_change":"2024-09-10T05:36:11.603262+0000","last_active":"2024-09-10T05:37:53.724975+0000","last_peered":"2024-09-10T05:37:53.724975+0000","last_clean":"2024-09-10T05:37:53.724975+0000","last_became_active":"2024-09-10T05:36:11.602866+0000","last_became_peered":"2024-09-10T05:36:11.602866+0000","last_unstale":"2024-09-10T05:37:53.724975+0000","last_undegraded":"2024-09-10T05:37:53.724975+0000","last_fullsized":"2024-09-10T05:37:53.724975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:54:03.517815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'15","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.381320+0000","last_change":"2024-09-10T05:36:13.613437+0000","last_active":"2024-09-10T05:39:27.381320+0000","last_peered":"2024-09-10T05:39:27.381320+0000","last_clean":"2024-09-10T05:39:27.381320+0000","last_became_active":"2024-09-10T05:36:13.611391+0000","last_became_peered":"2024-09-10T05:36:13.611391+0000","last_unstale":"2024-09-10T05:39:27.381320+0000","last_undegraded":"2024-09-10T05:39:27.381320+0000","last_fullsized":"2024-09-10T05:39:27.381320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:28:23.276697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.853711+0000","last_change":"2024-09-10T05:36:52.707618+0000","last_active":"2024-09-10T05:37:53.853711+0000","last_peered":"2024-09-10T05:37:53.853711+0000","last_clean":"2024-09-10T05:37:53.853711+0000","last_became_active":"2024-09-10T05:36:52.706226+0000","last_became_peered":"2024-09-10T05:36:52.706226+0000","last_unstale":"2024-09-10T05:37:53.853711+0000","last_undegraded":"2024-09-10T05:37:53.853711+0000","last_fullsized":"2024-09-10T05:37:53.853711+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:21:59.439322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"34'10","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.200918+0000","last_change":"2024-09-10T05:36:13.616625+0000","last_active":"2024-09-10T05:39:27.200918+0000","last_peered":"2024-09-10T05:39:27.200918+0000","last_clean":"2024-09-10T05:39:27.200918+0000","last_became_active":"2024-09-10T05:36:13.616136+0000","last_became_peered":"2024-09-10T05:36:13.616136+0000","last_unstale":"2024-09-10T05:39:27.200918+0000","last_undegraded":"2024-09-10T05:39:27.200918+0000","last_fullsized":"2024-09-10T05:39:27.200918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:40:37.044525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"32'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.715111+0000","last_change":"2024-09-10T05:36:11.600692+0000","last_active":"2024-09-10T05:37:53.715111+0000","last_peered":"2024-09-10T05:37:53.715111+0000","last_clean":"2024-09-10T05:37:53.715111+0000","last_became_active":"2024-09-10T05:36:11.600234+0000","last_became_peered":"2024-09-10T05:36:11.600234+0000","last_unstale":"2024-09-10T05:37:53.715111+0000","last_undegraded":"2024-09-10T05:37:53.715111+0000","last_fullsized":"2024-09-10T05:37:53.715111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:23:34.604922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"30'2","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.899857+0000","last_change":"2024-09-10T05:36:13.615416+0000","last_active":"2024-09-10T05:37:55.899857+0000","last_peered":"2024-09-10T05:37:55.899857+0000","last_clean":"2024-09-10T05:37:55.899857+0000","last_became_active":"2024-09-10T05:36:13.614098+0000","last_became_peered":"2024-09-10T05:36:13.614098+0000","last_unstale":"2024-09-10T05:37:55.899857+0000","last_undegraded":"2024-09-10T05:37:55.899857+0000","last_fullsized":"2024-09-10T05:37:55.899857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:56:24.907751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"30'2","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.729428+0000","last_change":"2024-09-10T05:36:11.606179+0000","last_active":"2024-09-10T05:37:53.729428+0000","last_peered":"2024-09-10T05:37:53.729428+0000","last_clean":"2024-09-10T05:37:53.729428+0000","last_became_active":"2024-09-10T05:36:11.603972+0000","last_became_peered":"2024-09-10T05:36:11.603972+0000","last_unstale":"2024-09-10T05:37:53.729428+0000","last_undegraded":"2024-09-10T05:37:53.729428+0000","last_fullsized":"2024-09-10T05:37:53.729428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:01:31.149492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.897044+0000","last_change":"2024-09-10T05:36:11.597226+0000","last_active":"2024-09-10T05:37:55.897044+0000","last_peered":"2024-09-10T05:37:55.897044+0000","last_clean":"2024-09-10T05:37:55.897044+0000","last_became_active":"2024-09-10T05:36:11.595183+0000","last_became_peered":"2024-09-10T05:36:11.595183+0000","last_unstale":"2024-09-10T05:37:55.897044+0000","last_undegraded":"2024-09-10T05:37:55.897044+0000","last_fullsized":"2024-09-10T05:37:55.897044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:40:04.618907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"34'8","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.296974+0000","last_change":"2024-09-10T05:36:13.623166+0000","last_active":"2024-09-10T05:39:27.296974+0000","last_peered":"2024-09-10T05:39:27.296974+0000","last_clean":"2024-09-10T05:39:27.296974+0000","last_became_active":"2024-09-10T05:36:13.622559+0000","last_became_peered":"2024-09-10T05:36:13.622559+0000","last_unstale":"2024-09-10T05:39:27.296974+0000","last_undegraded":"2024-09-10T05:39:27.296974+0000","last_fullsized":"2024-09-10T05:39:27.296974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:42:51.927427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"34'1","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:32.688141+0000","last_change":"2024-09-10T05:36:11.591759+0000","last_active":"2024-09-10T05:38:32.688141+0000","last_peered":"2024-09-10T05:38:32.688141+0000","last_clean":"2024-09-10T05:38:32.688141+0000","last_became_active":"2024-09-10T05:36:11.588124+0000","last_became_peered":"2024-09-10T05:36:11.588124+0000","last_unstale":"2024-09-10T05:38:32.688141+0000","last_undegraded":"2024-09-10T05:38:32.688141+0000","last_fullsized":"2024-09-10T05:38:32.688141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:46:37.205574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"34'20","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.383693+0000","last_change":"2024-09-10T05:36:13.618023+0000","last_active":"2024-09-10T05:39:27.383693+0000","last_peered":"2024-09-10T05:39:27.383693+0000","last_clean":"2024-09-10T05:39:27.383693+0000","last_became_active":"2024-09-10T05:36:13.614959+0000","last_became_peered":"2024-09-10T05:36:13.614959+0000","last_unstale":"2024-09-10T05:39:27.383693+0000","last_undegraded":"2024-09-10T05:39:27.383693+0000","last_fullsized":"2024-09-10T05:39:27.383693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:10:02.645509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":56,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":692,"num_read_kb":660,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2260,"ondisk_log_size":2260,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1732,"num_read_kb":1486,"num_write":737,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":9114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1492,"ondisk_log_size":1492,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":967,"num_read_kb":967,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1683,"num_read_kb":1573,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":17417088,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":132,"num_read_kb":83,"num_write":311,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":639872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34840576,"data_stored":34834176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640307,"num_pgs":142,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39940,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331900,"statfs":{"total":96636764160,"available":96595865600,"internally_reserved":0,"allocated":446464,"data_stored":150733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673012,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45136,"kb_used_data":9792,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94326704,"statfs":{"total":96636764160,"available":96590544896,"internally_reserved":0,"allocated":10027008,"data_stored":9765035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673013,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48668,"kb_used_data":13324,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323172,"statfs":{"total":96636764160,"available":96586928128,"internally_reserved":0,"allocated":13643776,"data_stored":13323216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949673012,"num_pgs":143,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40416,"kb_used_data":13392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94331424,"statfs":{"total":96636764160,"available":96595378176,"internally_reserved":0,"allocated":13713408,"data_stored":13372464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13225984,"data_stored":13222784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9031680,"data_stored":9028480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":2712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T05:40:03.654 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.654 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.654 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.654 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.654 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.654 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.655 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.655 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.655 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.655 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.655 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.655 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.655 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.655 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.655 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.656 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.656 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.656 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.656 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.656 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.656 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.656 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.656 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.656 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.657 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.657 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.657 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.657 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.657 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.657 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.657 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.657 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.658 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.658 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.658 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.658 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.658 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.658 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.658 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.658 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.659 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.659 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.659 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.659 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.659 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.659 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.659 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.659 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.659 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.660 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.660 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.660 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.660 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.660 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.660 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.660 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.660 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.661 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.661 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.661 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.661 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.661 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.661 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.661 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.661 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.661 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.662 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.662 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.662 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.662 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.662 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.662 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.662 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.662 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.663 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.663 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.663 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.663 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.663 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.663 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.663 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.663 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.664 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.664 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.664 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.664 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.664 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.664 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.664 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.664 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.664 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.665 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.665 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.665 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.665 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.665 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.665 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.665 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.665 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.666 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.666 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.666 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-10T05:35:57.655557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=35, tm_sec=57, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.666 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-10T05:36:02.684661+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=2, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.666 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.666 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.667 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.667 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.667 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.667 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.667 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-10T05:36:02.684661+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=2, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.667 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.667 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.668 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.668 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.668 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.668 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.668 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-10T05:36:02.684661+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=2, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.668 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.668 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.668 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.669 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.669 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.669 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.669 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-10T05:36:02.684661+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=2, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.669 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.669 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.669 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.669 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.669 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.670 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.670 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.670 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-10T05:36:02.684661+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=2, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.670 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.670 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.670 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.670 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.670 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.670 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.671 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-10T05:36:02.684661+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=2, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.671 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.671 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.671 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.671 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.671 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.671 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.671 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-10T05:36:02.684661+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=2, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.672 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.672 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.672 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.672 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.672 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.672 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.672 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-10T05:36:02.684661+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=2, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.672 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.673 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.673 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.673 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.673 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.673 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.673 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.673 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.673 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.674 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.674 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.674 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.674 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.674 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.674 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.674 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.674 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.675 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.675 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.675 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.675 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.675 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.675 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.675 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.675 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.676 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.676 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.676 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.676 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.676 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.676 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.676 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.676 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.677 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.677 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.677 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.677 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.677 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.677 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.677 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.678 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.678 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.678 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.678 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.678 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.678 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.678 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.678 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.678 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.679 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.679 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.679 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.679 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.679 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.679 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.679 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.679 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.680 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.680 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.680 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.680 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.680 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.680 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.680 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.680 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.681 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.681 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.681 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.681 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.681 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.681 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.681 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.682 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.682 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.682 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.682 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.682 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.682 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.682 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.682 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.682 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.682 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.683 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.683 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.683 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.683 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.683 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.683 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.683 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.683 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.683 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.684 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.684 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.684 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.684 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.684 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.684 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.684 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.684 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.685 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.685 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.685 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.685 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.685 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.685 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.685 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.685 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.686 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.686 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.686 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.686 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.686 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:03.686 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-10T05:40:23.687 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T05:40:23.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:23.821+0000 7fc1a3c33640 1 Processor -- start 2024-09-10T05:40:23.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:23.821+0000 7fc1a3c33640 1 -- start start 2024-09-10T05:40:23.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:23.821+0000 7fc1a3c33640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc19c12f0c0 0x7fc19c12f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:40:23.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:23.821+0000 7fc1a3c33640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc19c071620 con 0x7fc19c12f9e0 2024-09-10T05:40:23.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:23.821+0000 7fc1a3c33640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fc19c0a3130 con 0x7fc19c12f0c0 2024-09-10T05:40:23.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:23.821+0000 7fc1a19cf640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc19c12f0c0 0x7fc19c12f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:40:23.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:23.821+0000 7fc1a11ce640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc19c12f9e0 0x7fc19c12bc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54134/0 (socket says 172.21.15.2:54134) 2024-09-10T05:40:23.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:23.821+0000 7fc1a11ce640 1 -- 172.21.15.2:0/490689575 learned_addr learned my addr 172.21.15.2:0/490689575 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T05:40:23.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:23.821+0000 7fc1a19cf640 1 -- 172.21.15.2:0/490689575 >> v1:172.21.15.2:6789/0 conn(0x7fc19c12f9e0 legacy=0x7fc19c12bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:40:23.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:23.821+0000 7fc1a19cf640 1 -- 172.21.15.2:0/490689575 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc19c0737d0 con 0x7fc19c12f0c0 2024-09-10T05:40:23.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:23.821+0000 7fc1a19cf640 1 --2- 172.21.15.2:0/490689575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc19c12f0c0 0x7fc19c12f4a0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fc18c009740 tx=0x7fc18c01c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9883291533f248b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:40:23.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:23.821+0000 7fc1a09cd640 1 -- 172.21.15.2:0/490689575 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc18c0b0070 con 0x7fc19c12f0c0 2024-09-10T05:40:23.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:23.821+0000 7fc1a09cd640 1 -- 172.21.15.2:0/490689575 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc18c0ab530 con 0x7fc19c12f0c0 2024-09-10T05:40:23.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:23.821+0000 7fc1a09cd640 1 -- 172.21.15.2:0/490689575 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc18c0ab830 con 0x7fc19c12f0c0 2024-09-10T05:40:23.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:23.825+0000 7fc1a3c33640 1 -- 172.21.15.2:0/490689575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc19c12f0c0 msgr2=0x7fc19c12f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:40:23.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:23.825+0000 7fc1a3c33640 1 --2- 172.21.15.2:0/490689575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc19c12f0c0 0x7fc19c12f4a0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fc18c009740 tx=0x7fc18c01c310 comp rx=0 tx=0).stop 2024-09-10T05:40:23.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:23.825+0000 7fc1a3c33640 1 -- 172.21.15.2:0/490689575 shutdown_connections 2024-09-10T05:40:23.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:23.825+0000 7fc1a3c33640 1 --2- 172.21.15.2:0/490689575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc19c12f0c0 0x7fc19c12f4a0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:40:23.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:23.825+0000 7fc1a3c33640 1 -- 172.21.15.2:0/490689575 >> 172.21.15.2:0/490689575 conn(0x7fc19c0a0ab0 msgr2=0x7fc19c06dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:40:23.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:23.825+0000 7fc1a3c33640 1 -- 172.21.15.2:0/490689575 shutdown_connections 2024-09-10T05:40:23.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:23.825+0000 7fc1a3c33640 1 -- 172.21.15.2:0/490689575 wait complete. 2024-09-10T05:40:23.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:23.825+0000 7fc1a3c33640 1 Processor -- start 2024-09-10T05:40:23.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:23.825+0000 7fc1a3c33640 1 -- start start 2024-09-10T05:40:23.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:23.825+0000 7fc1a3c33640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc19c12f0c0 0x7fc19c11acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:40:23.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:23.825+0000 7fc1a3c33640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc19c1376e0 con 0x7fc19c12f0c0 2024-09-10T05:40:23.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:23.825+0000 7fc1a19cf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc19c12f0c0 0x7fc19c11acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:40:23.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:23.825+0000 7fc1a19cf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc19c12f0c0 0x7fc19c11acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49748/0 (socket says 172.21.15.2:49748) 2024-09-10T05:40:23.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:23.825+0000 7fc1a19cf640 1 -- 172.21.15.2:0/1845903284 learned_addr learned my addr 172.21.15.2:0/1845903284 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:40:23.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:23.825+0000 7fc1a19cf640 1 -- 172.21.15.2:0/1845903284 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc19c11ddc0 con 0x7fc19c12f0c0 2024-09-10T05:40:23.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:23.825+0000 7fc1a19cf640 1 --2- 172.21.15.2:0/1845903284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc19c12f0c0 0x7fc19c11acd0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fc18c0ae040 tx=0x7fc18c019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:40:23.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:23.825+0000 7fc1927fc640 1 -- 172.21.15.2:0/1845903284 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc18c0b8020 con 0x7fc19c12f0c0 2024-09-10T05:40:23.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:23.825+0000 7fc1927fc640 1 -- 172.21.15.2:0/1845903284 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc18c0b4410 con 0x7fc19c12f0c0 2024-09-10T05:40:23.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:23.825+0000 7fc1927fc640 1 -- 172.21.15.2:0/1845903284 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc18c0b0040 con 0x7fc19c12f0c0 2024-09-10T05:40:23.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:23.825+0000 7fc1a3c33640 1 -- 172.21.15.2:0/1845903284 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc19c11e0f0 con 0x7fc19c12f0c0 2024-09-10T05:40:23.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:23.825+0000 7fc1a3c33640 1 -- 172.21.15.2:0/1845903284 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc19c11d780 con 0x7fc19c12f0c0 2024-09-10T05:40:23.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:23.825+0000 7fc1a3c33640 1 -- 172.21.15.2:0/1845903284 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc19c11d440 con 0x7fc19c12f0c0 2024-09-10T05:40:23.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:23.829+0000 7fc1927fc640 1 -- 172.21.15.2:0/1845903284 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc18c0bb020 con 0x7fc19c12f0c0 2024-09-10T05:40:23.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:23.829+0000 7fc1927fc640 1 --2- 172.21.15.2:0/1845903284 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc18003b1d0 0x7fc18003d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:40:23.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:23.829+0000 7fc1927fc640 1 -- 172.21.15.2:0/1845903284 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7fc18c0e9500 con 0x7fc19c12f0c0 2024-09-10T05:40:23.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:23.829+0000 7fc1a11ce640 1 --2- 172.21.15.2:0/1845903284 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc18003b1d0 0x7fc18003d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:40:23.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:23.829+0000 7fc1a11ce640 1 --2- 172.21.15.2:0/1845903284 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc18003b1d0 0x7fc18003d690 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc198005890 tx=0x7fc198007ab0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:40:23.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:23.833+0000 7fc1927fc640 1 -- 172.21.15.2:0/1845903284 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fc19c11d440 con 0x7fc19c12f0c0 2024-09-10T05:40:24.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:24.001+0000 7fc1a3c33640 1 -- 172.21.15.2:0/1845903284 --> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc19c071cd0 con 0x7fc18003b1d0 2024-09-10T05:40:24.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:24.029+0000 7fc1927fc640 1 -- 172.21.15.2:0/1845903284 <== mgr.4101 v2:172.21.15.62:6824/3663628807 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+664893 (secure 0 0 0) 0x7fc19c071cd0 con 0x7fc18003b1d0 2024-09-10T05:40:24.036 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T05:40:24.046 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-10T05:40:24.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:24.037+0000 7fc1a3c33640 1 -- 172.21.15.2:0/1845903284 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc18003b1d0 msgr2=0x7fc18003d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:40:24.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:24.037+0000 7fc1a3c33640 1 --2- 172.21.15.2:0/1845903284 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc18003b1d0 0x7fc18003d690 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc198005890 tx=0x7fc198007ab0 comp rx=0 tx=0).stop 2024-09-10T05:40:24.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:24.037+0000 7fc1a3c33640 1 -- 172.21.15.2:0/1845903284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc19c12f0c0 msgr2=0x7fc19c11acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:40:24.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:24.037+0000 7fc1a3c33640 1 --2- 172.21.15.2:0/1845903284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc19c12f0c0 0x7fc19c11acd0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fc18c0ae040 tx=0x7fc18c019110 comp rx=0 tx=0).stop 2024-09-10T05:40:24.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:24.037+0000 7fc1a3c33640 1 -- 172.21.15.2:0/1845903284 shutdown_connections 2024-09-10T05:40:24.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:24.037+0000 7fc1a3c33640 1 --2- 172.21.15.2:0/1845903284 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fc18003b1d0 0x7fc18003d690 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:40:24.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:24.037+0000 7fc1a3c33640 1 --2- 172.21.15.2:0/1845903284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc19c12f0c0 0x7fc19c11acd0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:40:24.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:24.037+0000 7fc1a3c33640 1 -- 172.21.15.2:0/1845903284 >> 172.21.15.2:0/1845903284 conn(0x7fc19c0a0ab0 msgr2=0x7fc19c12cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:40:24.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:24.041+0000 7fc1a3c33640 1 -- 172.21.15.2:0/1845903284 shutdown_connections 2024-09-10T05:40:24.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:24.041+0000 7fc1a3c33640 1 -- 172.21.15.2:0/1845903284 wait complete. 2024-09-10T05:40:24.061 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":164,"stamp":"2024-09-10T05:40:23.709118+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":254,"num_object_clones":0,"num_object_copies":508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":254,"num_whiteouts":0,"num_read":5438,"num_read_kb":4996,"num_write":2315,"num_write_kb":60588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":639982,"num_keys_recovered":1,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4767,"ondisk_log_size":4767,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148448,"kb_used_data":2912,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377338912,"statfs":{"total":386547056640,"available":386395045888,"internally_reserved":0,"allocated":2981888,"data_stored":1773852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005960"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:17.687219+0000","last_change":"2024-09-10T05:36:11.606846+0000","last_active":"2024-09-10T05:38:17.687219+0000","last_peered":"2024-09-10T05:38:17.687219+0000","last_clean":"2024-09-10T05:38:17.687219+0000","last_became_active":"2024-09-10T05:36:11.605721+0000","last_became_peered":"2024-09-10T05:36:11.605721+0000","last_unstale":"2024-09-10T05:38:17.687219+0000","last_undegraded":"2024-09-10T05:38:17.687219+0000","last_fullsized":"2024-09-10T05:38:17.687219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"30'2","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.900982+0000","last_change":"2024-09-10T05:36:13.628621+0000","last_active":"2024-09-10T05:37:55.900982+0000","last_peered":"2024-09-10T05:37:55.900982+0000","last_clean":"2024-09-10T05:37:55.900982+0000","last_became_active":"2024-09-10T05:36:13.628174+0000","last_became_peered":"2024-09-10T05:36:13.628174+0000","last_unstale":"2024-09-10T05:37:55.900982+0000","last_undegraded":"2024-09-10T05:37:55.900982+0000","last_fullsized":"2024-09-10T05:37:55.900982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:47.128005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"30'2","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:18.009113+0000","last_change":"2024-09-10T05:40:18.008954+0000","last_active":"2024-09-10T05:40:18.009113+0000","last_peered":"2024-09-10T05:40:18.009113+0000","last_clean":"2024-09-10T05:40:18.009113+0000","last_became_active":"2024-09-10T05:36:11.596100+0000","last_became_peered":"2024-09-10T05:36:11.596100+0000","last_unstale":"2024-09-10T05:40:18.009113+0000","last_undegraded":"2024-09-10T05:40:18.009113+0000","last_fullsized":"2024-09-10T05:40:18.009113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-10T05:40:18.008765+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-10T05:40:18.008765+0000","last_clean_scrub_stamp":"2024-09-10T05:40:18.008765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:04:13.763296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"34'5","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:43.687749+0000","last_change":"2024-09-10T05:36:13.601197+0000","last_active":"2024-09-10T05:38:43.687749+0000","last_peered":"2024-09-10T05:38:43.687749+0000","last_clean":"2024-09-10T05:38:43.687749+0000","last_became_active":"2024-09-10T05:36:13.598320+0000","last_became_peered":"2024-09-10T05:36:13.598320+0000","last_unstale":"2024-09-10T05:38:43.687749+0000","last_undegraded":"2024-09-10T05:38:43.687749+0000","last_fullsized":"2024-09-10T05:38:43.687749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:38:17.550395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.726285+0000","last_change":"2024-09-10T05:36:11.604217+0000","last_active":"2024-09-10T05:37:53.726285+0000","last_peered":"2024-09-10T05:37:53.726285+0000","last_clean":"2024-09-10T05:37:53.726285+0000","last_became_active":"2024-09-10T05:36:11.603193+0000","last_became_peered":"2024-09-10T05:36:11.603193+0000","last_unstale":"2024-09-10T05:37:53.726285+0000","last_undegraded":"2024-09-10T05:37:53.726285+0000","last_fullsized":"2024-09-10T05:37:53.726285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:09:46.125040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'10","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.200739+0000","last_change":"2024-09-10T05:36:13.604439+0000","last_active":"2024-09-10T05:39:27.200739+0000","last_peered":"2024-09-10T05:39:27.200739+0000","last_clean":"2024-09-10T05:39:27.200739+0000","last_became_active":"2024-09-10T05:36:13.604094+0000","last_became_peered":"2024-09-10T05:36:13.604094+0000","last_unstale":"2024-09-10T05:39:27.200739+0000","last_undegraded":"2024-09-10T05:39:27.200739+0000","last_fullsized":"2024-09-10T05:39:27.200739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:17:01.676891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:12.538733+0000","last_change":"2024-09-10T05:40:12.538576+0000","last_active":"2024-09-10T05:40:12.538733+0000","last_peered":"2024-09-10T05:40:12.538733+0000","last_clean":"2024-09-10T05:40:12.538733+0000","last_became_active":"2024-09-10T05:36:11.611399+0000","last_became_peered":"2024-09-10T05:36:11.611399+0000","last_unstale":"2024-09-10T05:40:12.538733+0000","last_undegraded":"2024-09-10T05:40:12.538733+0000","last_fullsized":"2024-09-10T05:40:12.538733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:12.538392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:12.538392+0000","last_clean_scrub_stamp":"2024-09-10T05:40:12.538392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:51:29.630049+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'10","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.363850+0000","last_change":"2024-09-10T05:36:52.703620+0000","last_active":"2024-09-10T05:39:27.363850+0000","last_peered":"2024-09-10T05:39:27.363850+0000","last_clean":"2024-09-10T05:39:27.363850+0000","last_became_active":"2024-09-10T05:36:52.702713+0000","last_became_peered":"2024-09-10T05:36:52.702713+0000","last_unstale":"2024-09-10T05:39:27.363850+0000","last_undegraded":"2024-09-10T05:39:27.363850+0000","last_fullsized":"2024-09-10T05:39:27.363850+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:09:12.955195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:22.425237+0000","last_change":"2024-09-10T05:40:22.425237+0000","last_active":"2024-09-10T05:40:22.425237+0000","last_peered":"2024-09-10T05:40:22.425237+0000","last_clean":"2024-09-10T05:40:22.425237+0000","last_became_active":"2024-09-10T05:36:11.597514+0000","last_became_peered":"2024-09-10T05:36:11.597514+0000","last_unstale":"2024-09-10T05:40:22.425237+0000","last_undegraded":"2024-09-10T05:40:22.425237+0000","last_fullsized":"2024-09-10T05:40:22.425237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:22.425061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:22.425061+0000","last_clean_scrub_stamp":"2024-09-10T05:40:22.425061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:18:48.780922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"34'11","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.465373+0000","last_change":"2024-09-10T05:36:13.622714+0000","last_active":"2024-09-10T05:39:27.465373+0000","last_peered":"2024-09-10T05:39:27.465373+0000","last_clean":"2024-09-10T05:39:27.465373+0000","last_became_active":"2024-09-10T05:36:13.621573+0000","last_became_peered":"2024-09-10T05:36:13.621573+0000","last_unstale":"2024-09-10T05:39:27.465373+0000","last_undegraded":"2024-09-10T05:39:27.465373+0000","last_fullsized":"2024-09-10T05:39:27.465373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.902223+0000","last_change":"2024-09-10T05:36:52.704991+0000","last_active":"2024-09-10T05:37:55.902223+0000","last_peered":"2024-09-10T05:37:55.902223+0000","last_clean":"2024-09-10T05:37:55.902223+0000","last_became_active":"2024-09-10T05:36:52.704285+0000","last_became_peered":"2024-09-10T05:36:52.704285+0000","last_unstale":"2024-09-10T05:37:55.902223+0000","last_undegraded":"2024-09-10T05:37:55.902223+0000","last_fullsized":"2024-09-10T05:37:55.902223+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:31:44.000002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:17.687108+0000","last_change":"2024-09-10T05:36:13.613130+0000","last_active":"2024-09-10T05:38:17.687108+0000","last_peered":"2024-09-10T05:38:17.687108+0000","last_clean":"2024-09-10T05:38:17.687108+0000","last_became_active":"2024-09-10T05:36:13.612127+0000","last_became_peered":"2024-09-10T05:36:13.612127+0000","last_unstale":"2024-09-10T05:38:17.687108+0000","last_undegraded":"2024-09-10T05:38:17.687108+0000","last_fullsized":"2024-09-10T05:38:17.687108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.723024+0000","last_change":"2024-09-10T05:36:11.598434+0000","last_active":"2024-09-10T05:37:53.723024+0000","last_peered":"2024-09-10T05:37:53.723024+0000","last_clean":"2024-09-10T05:37:53.723024+0000","last_became_active":"2024-09-10T05:36:11.598054+0000","last_became_peered":"2024-09-10T05:36:11.598054+0000","last_unstale":"2024-09-10T05:37:53.723024+0000","last_undegraded":"2024-09-10T05:37:53.723024+0000","last_fullsized":"2024-09-10T05:37:53.723024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:15:17.547203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'8","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:17.687142+0000","last_change":"2024-09-10T05:36:13.613557+0000","last_active":"2024-09-10T05:38:17.687142+0000","last_peered":"2024-09-10T05:38:17.687142+0000","last_clean":"2024-09-10T05:38:17.687142+0000","last_became_active":"2024-09-10T05:36:13.612743+0000","last_became_peered":"2024-09-10T05:36:13.612743+0000","last_unstale":"2024-09-10T05:38:17.687142+0000","last_undegraded":"2024-09-10T05:38:17.687142+0000","last_fullsized":"2024-09-10T05:38:17.687142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.721935+0000","last_change":"2024-09-10T05:36:11.593912+0000","last_active":"2024-09-10T05:37:53.721935+0000","last_peered":"2024-09-10T05:37:53.721935+0000","last_clean":"2024-09-10T05:37:53.721935+0000","last_became_active":"2024-09-10T05:36:11.593454+0000","last_became_peered":"2024-09-10T05:36:11.593454+0000","last_unstale":"2024-09-10T05:37:53.721935+0000","last_undegraded":"2024-09-10T05:37:53.721935+0000","last_fullsized":"2024-09-10T05:37:53.721935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:50:30.548750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"34'10","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.883156+0000","last_change":"2024-09-10T05:36:13.621644+0000","last_active":"2024-09-10T05:39:26.883156+0000","last_peered":"2024-09-10T05:39:26.883156+0000","last_clean":"2024-09-10T05:39:26.883156+0000","last_became_active":"2024-09-10T05:36:13.621362+0000","last_became_peered":"2024-09-10T05:36:13.621362+0000","last_unstale":"2024-09-10T05:39:26.883156+0000","last_undegraded":"2024-09-10T05:39:26.883156+0000","last_fullsized":"2024-09-10T05:39:26.883156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.295664+0000","last_change":"2024-09-10T05:36:13.628746+0000","last_active":"2024-09-10T05:39:27.295664+0000","last_peered":"2024-09-10T05:39:27.295664+0000","last_clean":"2024-09-10T05:39:27.295664+0000","last_became_active":"2024-09-10T05:36:13.628203+0000","last_became_peered":"2024-09-10T05:36:13.628203+0000","last_unstale":"2024-09-10T05:39:27.295664+0000","last_undegraded":"2024-09-10T05:39:27.295664+0000","last_fullsized":"2024-09-10T05:39:27.295664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:15:01.197465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"30'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:19.050830+0000","last_change":"2024-09-10T05:40:19.050830+0000","last_active":"2024-09-10T05:40:19.050830+0000","last_peered":"2024-09-10T05:40:19.050830+0000","last_clean":"2024-09-10T05:40:19.050830+0000","last_became_active":"2024-09-10T05:36:11.594409+0000","last_became_peered":"2024-09-10T05:36:11.594409+0000","last_unstale":"2024-09-10T05:40:19.050830+0000","last_undegraded":"2024-09-10T05:40:19.050830+0000","last_fullsized":"2024-09-10T05:40:19.050830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-10T05:40:19.050639+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-10T05:40:19.050639+0000","last_clean_scrub_stamp":"2024-09-10T05:40:19.050639+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:00:35.050660+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'8","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.314170+0000","last_change":"2024-09-10T05:36:13.620594+0000","last_active":"2024-09-10T05:39:27.314170+0000","last_peered":"2024-09-10T05:39:27.314170+0000","last_clean":"2024-09-10T05:39:27.314170+0000","last_became_active":"2024-09-10T05:36:13.619905+0000","last_became_peered":"2024-09-10T05:36:13.619905+0000","last_unstale":"2024-09-10T05:39:27.314170+0000","last_undegraded":"2024-09-10T05:39:27.314170+0000","last_fullsized":"2024-09-10T05:39:27.314170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:43:07.884535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:13.522641+0000","last_change":"2024-09-10T05:40:13.522641+0000","last_active":"2024-09-10T05:40:13.522641+0000","last_peered":"2024-09-10T05:40:13.522641+0000","last_clean":"2024-09-10T05:40:13.522641+0000","last_became_active":"2024-09-10T05:36:11.611735+0000","last_became_peered":"2024-09-10T05:36:11.611735+0000","last_unstale":"2024-09-10T05:40:13.522641+0000","last_undegraded":"2024-09-10T05:40:13.522641+0000","last_fullsized":"2024-09-10T05:40:13.522641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:13.522433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:13.522433+0000","last_clean_scrub_stamp":"2024-09-10T05:40:13.522433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:18:33.845607+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'18","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.364017+0000","last_change":"2024-09-10T05:36:13.625084+0000","last_active":"2024-09-10T05:39:27.364017+0000","last_peered":"2024-09-10T05:39:27.364017+0000","last_clean":"2024-09-10T05:39:27.364017+0000","last_became_active":"2024-09-10T05:36:13.624358+0000","last_became_peered":"2024-09-10T05:36:13.624358+0000","last_unstale":"2024-09-10T05:39:27.364017+0000","last_undegraded":"2024-09-10T05:39:27.364017+0000","last_fullsized":"2024-09-10T05:39:27.364017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:03:25.809000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":77,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"34'4","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:18.464461+0000","last_change":"2024-09-10T05:40:18.464461+0000","last_active":"2024-09-10T05:40:18.464461+0000","last_peered":"2024-09-10T05:40:18.464461+0000","last_clean":"2024-09-10T05:40:18.464461+0000","last_became_active":"2024-09-10T05:36:11.608244+0000","last_became_peered":"2024-09-10T05:36:11.608244+0000","last_unstale":"2024-09-10T05:40:18.464461+0000","last_undegraded":"2024-09-10T05:40:18.464461+0000","last_fullsized":"2024-09-10T05:40:18.464461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:18.464272+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:18.464272+0000","last_clean_scrub_stamp":"2024-09-10T05:40:18.464272+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:52:02.384371+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"32'24","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.714987+0000","last_change":"2024-09-10T05:36:13.614877+0000","last_active":"2024-09-10T05:37:53.714987+0000","last_peered":"2024-09-10T05:37:53.714987+0000","last_clean":"2024-09-10T05:37:53.714987+0000","last_became_active":"2024-09-10T05:36:13.613298+0000","last_became_peered":"2024-09-10T05:36:13.613298+0000","last_unstale":"2024-09-10T05:37:53.714987+0000","last_undegraded":"2024-09-10T05:37:53.714987+0000","last_fullsized":"2024-09-10T05:37:53.714987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:36:36.280933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":77,"num_write":32,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"32'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:20.433725+0000","last_change":"2024-09-10T05:40:20.433725+0000","last_active":"2024-09-10T05:40:20.433725+0000","last_peered":"2024-09-10T05:40:20.433725+0000","last_clean":"2024-09-10T05:40:20.433725+0000","last_became_active":"2024-09-10T05:36:11.600159+0000","last_became_peered":"2024-09-10T05:36:11.600159+0000","last_unstale":"2024-09-10T05:40:20.433725+0000","last_undegraded":"2024-09-10T05:40:20.433725+0000","last_fullsized":"2024-09-10T05:40:20.433725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T05:40:20.433528+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T05:40:20.433528+0000","last_clean_scrub_stamp":"2024-09-10T05:40:20.433528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:07:04.481328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"34'10","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.465170+0000","last_change":"2024-09-10T05:36:13.610326+0000","last_active":"2024-09-10T05:39:27.465170+0000","last_peered":"2024-09-10T05:39:27.465170+0000","last_clean":"2024-09-10T05:39:27.465170+0000","last_became_active":"2024-09-10T05:36:13.605913+0000","last_became_peered":"2024-09-10T05:36:13.605913+0000","last_unstale":"2024-09-10T05:39:27.465170+0000","last_undegraded":"2024-09-10T05:39:27.465170+0000","last_fullsized":"2024-09-10T05:39:27.465170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:40:06.248271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:10.535482+0000","last_change":"2024-09-10T05:40:10.535482+0000","last_active":"2024-09-10T05:40:10.535482+0000","last_peered":"2024-09-10T05:40:10.535482+0000","last_clean":"2024-09-10T05:40:10.535482+0000","last_became_active":"2024-09-10T05:36:52.701277+0000","last_became_peered":"2024-09-10T05:36:52.701277+0000","last_unstale":"2024-09-10T05:40:10.535482+0000","last_undegraded":"2024-09-10T05:40:10.535482+0000","last_fullsized":"2024-09-10T05:40:10.535482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:10.535301+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:10.535301+0000","last_clean_scrub_stamp":"2024-09-10T05:40:10.535301+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:04:14.281405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":1250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":639872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.855635+0000","last_change":"2024-09-10T05:36:13.600360+0000","last_active":"2024-09-10T05:37:53.855635+0000","last_peered":"2024-09-10T05:37:53.855635+0000","last_clean":"2024-09-10T05:37:53.855635+0000","last_became_active":"2024-09-10T05:36:13.599955+0000","last_became_peered":"2024-09-10T05:36:13.599955+0000","last_unstale":"2024-09-10T05:37:53.855635+0000","last_undegraded":"2024-09-10T05:37:53.855635+0000","last_fullsized":"2024-09-10T05:37:53.855635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:12:25.023354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.158891+0000","last_change":"2024-09-10T05:36:11.606469+0000","last_active":"2024-09-10T05:39:27.158891+0000","last_peered":"2024-09-10T05:39:27.158891+0000","last_clean":"2024-09-10T05:39:27.158891+0000","last_became_active":"2024-09-10T05:36:11.603982+0000","last_became_peered":"2024-09-10T05:36:11.603982+0000","last_unstale":"2024-09-10T05:39:27.158891+0000","last_undegraded":"2024-09-10T05:39:27.158891+0000","last_fullsized":"2024-09-10T05:39:27.158891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:27:57.248963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'35","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.250994+0000","last_change":"2024-09-10T05:36:21.673756+0000","last_active":"2024-09-10T05:39:27.250994+0000","last_peered":"2024-09-10T05:39:27.250994+0000","last_clean":"2024-09-10T05:39:27.250994+0000","last_became_active":"2024-09-10T05:36:21.672975+0000","last_became_peered":"2024-09-10T05:36:21.672975+0000","last_unstale":"2024-09-10T05:39:27.250994+0000","last_undegraded":"2024-09-10T05:39:27.250994+0000","last_fullsized":"2024-09-10T05:39:27.250994+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:09:28.929715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'10","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.200652+0000","last_change":"2024-09-10T05:36:13.616306+0000","last_active":"2024-09-10T05:39:27.200652+0000","last_peered":"2024-09-10T05:39:27.200652+0000","last_clean":"2024-09-10T05:39:27.200652+0000","last_became_active":"2024-09-10T05:36:13.616006+0000","last_became_peered":"2024-09-10T05:36:13.616006+0000","last_unstale":"2024-09-10T05:39:27.200652+0000","last_undegraded":"2024-09-10T05:39:27.200652+0000","last_fullsized":"2024-09-10T05:39:27.200652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:12:47.354260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:11.764472+0000","last_change":"2024-09-10T05:40:11.764472+0000","last_active":"2024-09-10T05:40:11.764472+0000","last_peered":"2024-09-10T05:40:11.764472+0000","last_clean":"2024-09-10T05:40:11.764472+0000","last_became_active":"2024-09-10T05:36:11.601101+0000","last_became_peered":"2024-09-10T05:36:11.601101+0000","last_unstale":"2024-09-10T05:40:11.764472+0000","last_undegraded":"2024-09-10T05:40:11.764472+0000","last_fullsized":"2024-09-10T05:40:11.764472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:11.764291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:11.764291+0000","last_clean_scrub_stamp":"2024-09-10T05:40:11.764291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:10:57.529948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.727535+0000","last_change":"2024-09-10T05:36:15.626686+0000","last_active":"2024-09-10T05:37:53.727535+0000","last_peered":"2024-09-10T05:37:53.727535+0000","last_clean":"2024-09-10T05:37:53.727535+0000","last_became_active":"2024-09-10T05:36:15.626172+0000","last_became_peered":"2024-09-10T05:36:15.626172+0000","last_unstale":"2024-09-10T05:37:53.727535+0000","last_undegraded":"2024-09-10T05:37:53.727535+0000","last_fullsized":"2024-09-10T05:37:53.727535+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:39:20.579324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'45","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.479585+0000","last_change":"2024-09-10T05:36:17.640065+0000","last_active":"2024-09-10T05:39:58.479585+0000","last_peered":"2024-09-10T05:39:58.479585+0000","last_clean":"2024-09-10T05:39:58.479585+0000","last_became_active":"2024-09-10T05:36:17.639318+0000","last_became_peered":"2024-09-10T05:36:17.639318+0000","last_unstale":"2024-09-10T05:39:58.479585+0000","last_undegraded":"2024-09-10T05:39:58.479585+0000","last_fullsized":"2024-09-10T05:39:58.479585+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:05:59.617319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.898449+0000","last_change":"2024-09-10T05:36:19.648793+0000","last_active":"2024-09-10T05:37:55.898449+0000","last_peered":"2024-09-10T05:37:55.898449+0000","last_clean":"2024-09-10T05:37:55.898449+0000","last_became_active":"2024-09-10T05:36:19.647998+0000","last_became_peered":"2024-09-10T05:36:19.647998+0000","last_unstale":"2024-09-10T05:37:55.898449+0000","last_undegraded":"2024-09-10T05:37:55.898449+0000","last_fullsized":"2024-09-10T05:37:55.898449+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:14:38.933277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"32'9","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.899552+0000","last_change":"2024-09-10T05:36:21.673262+0000","last_active":"2024-09-10T05:37:55.899552+0000","last_peered":"2024-09-10T05:37:55.899552+0000","last_clean":"2024-09-10T05:37:55.899552+0000","last_became_active":"2024-09-10T05:36:21.672757+0000","last_became_peered":"2024-09-10T05:36:21.672757+0000","last_unstale":"2024-09-10T05:37:55.899552+0000","last_undegraded":"2024-09-10T05:37:55.899552+0000","last_fullsized":"2024-09-10T05:37:55.899552+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:49:20.130241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"32'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.727360+0000","last_change":"2024-09-10T05:36:13.598805+0000","last_active":"2024-09-10T05:37:53.727360+0000","last_peered":"2024-09-10T05:37:53.727360+0000","last_clean":"2024-09-10T05:37:53.727360+0000","last_became_active":"2024-09-10T05:36:13.597649+0000","last_became_peered":"2024-09-10T05:36:13.597649+0000","last_unstale":"2024-09-10T05:37:53.727360+0000","last_undegraded":"2024-09-10T05:37:53.727360+0000","last_fullsized":"2024-09-10T05:37:53.727360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:02:19.101449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:03.520977+0000","last_change":"2024-09-10T05:40:03.520977+0000","last_active":"2024-09-10T05:40:03.520977+0000","last_peered":"2024-09-10T05:40:03.520977+0000","last_clean":"2024-09-10T05:40:03.520977+0000","last_became_active":"2024-09-10T05:36:11.611326+0000","last_became_peered":"2024-09-10T05:36:11.611326+0000","last_unstale":"2024-09-10T05:40:03.520977+0000","last_undegraded":"2024-09-10T05:40:03.520977+0000","last_fullsized":"2024-09-10T05:40:03.520977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:03.520795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:03.520795+0000","last_clean_scrub_stamp":"2024-09-10T05:40:03.520795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:12:23.788294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.725805+0000","last_change":"2024-09-10T05:36:15.608668+0000","last_active":"2024-09-10T05:37:53.725805+0000","last_peered":"2024-09-10T05:37:53.725805+0000","last_clean":"2024-09-10T05:37:53.725805+0000","last_became_active":"2024-09-10T05:36:15.607918+0000","last_became_peered":"2024-09-10T05:36:15.607918+0000","last_unstale":"2024-09-10T05:37:53.725805+0000","last_undegraded":"2024-09-10T05:37:53.725805+0000","last_fullsized":"2024-09-10T05:37:53.725805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:57.614009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"30'12","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.859373+0000","last_change":"2024-09-10T05:36:17.644680+0000","last_active":"2024-09-10T05:37:53.859373+0000","last_peered":"2024-09-10T05:37:53.859373+0000","last_clean":"2024-09-10T05:37:53.859373+0000","last_became_active":"2024-09-10T05:36:17.643856+0000","last_became_peered":"2024-09-10T05:36:17.643856+0000","last_unstale":"2024-09-10T05:37:53.859373+0000","last_undegraded":"2024-09-10T05:37:53.859373+0000","last_fullsized":"2024-09-10T05:37:53.859373+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:31:24.591766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.899864+0000","last_change":"2024-09-10T05:36:19.648357+0000","last_active":"2024-09-10T05:37:55.899864+0000","last_peered":"2024-09-10T05:37:55.899864+0000","last_clean":"2024-09-10T05:37:55.899864+0000","last_became_active":"2024-09-10T05:36:19.647612+0000","last_became_peered":"2024-09-10T05:36:19.647612+0000","last_unstale":"2024-09-10T05:37:55.899864+0000","last_undegraded":"2024-09-10T05:37:55.899864+0000","last_fullsized":"2024-09-10T05:37:55.899864+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:06:01.493680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"34'10","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.344196+0000","last_change":"2024-09-10T05:36:21.679828+0000","last_active":"2024-09-10T05:39:26.344196+0000","last_peered":"2024-09-10T05:39:26.344196+0000","last_clean":"2024-09-10T05:39:26.344196+0000","last_became_active":"2024-09-10T05:36:21.679052+0000","last_became_peered":"2024-09-10T05:36:21.679052+0000","last_unstale":"2024-09-10T05:39:26.344196+0000","last_undegraded":"2024-09-10T05:39:26.344196+0000","last_fullsized":"2024-09-10T05:39:26.344196+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:53.565670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.729075+0000","last_change":"2024-09-10T05:36:13.612634+0000","last_active":"2024-09-10T05:37:53.729075+0000","last_peered":"2024-09-10T05:37:53.729075+0000","last_clean":"2024-09-10T05:37:53.729075+0000","last_became_active":"2024-09-10T05:36:13.611935+0000","last_became_peered":"2024-09-10T05:36:13.611935+0000","last_unstale":"2024-09-10T05:37:53.729075+0000","last_undegraded":"2024-09-10T05:37:53.729075+0000","last_fullsized":"2024-09-10T05:37:53.729075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:11.305578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:13.353164+0000","last_change":"2024-09-10T05:40:13.353164+0000","last_active":"2024-09-10T05:40:13.353164+0000","last_peered":"2024-09-10T05:40:13.353164+0000","last_clean":"2024-09-10T05:40:13.353164+0000","last_became_active":"2024-09-10T05:36:11.596047+0000","last_became_peered":"2024-09-10T05:36:11.596047+0000","last_unstale":"2024-09-10T05:40:13.353164+0000","last_undegraded":"2024-09-10T05:40:13.353164+0000","last_fullsized":"2024-09-10T05:40:13.353164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:13.352981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:13.352981+0000","last_clean_scrub_stamp":"2024-09-10T05:40:13.352981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:20.013639+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.729520+0000","last_change":"2024-09-10T05:36:15.636316+0000","last_active":"2024-09-10T05:37:53.729520+0000","last_peered":"2024-09-10T05:37:53.729520+0000","last_clean":"2024-09-10T05:37:53.729520+0000","last_became_active":"2024-09-10T05:36:15.635534+0000","last_became_peered":"2024-09-10T05:36:15.635534+0000","last_unstale":"2024-09-10T05:37:53.729520+0000","last_undegraded":"2024-09-10T05:37:53.729520+0000","last_fullsized":"2024-09-10T05:37:53.729520+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:51:10.736802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"30'23","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.715019+0000","last_change":"2024-09-10T05:36:17.630853+0000","last_active":"2024-09-10T05:37:53.715019+0000","last_peered":"2024-09-10T05:37:53.715019+0000","last_clean":"2024-09-10T05:37:53.715019+0000","last_became_active":"2024-09-10T05:36:17.626936+0000","last_became_peered":"2024-09-10T05:36:17.626936+0000","last_unstale":"2024-09-10T05:37:53.715019+0000","last_undegraded":"2024-09-10T05:37:53.715019+0000","last_fullsized":"2024-09-10T05:37:53.715019+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:27:38.243510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'285","reported_seq":394,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.363782+0000","last_change":"2024-09-10T05:36:19.665303+0000","last_active":"2024-09-10T05:39:58.363782+0000","last_peered":"2024-09-10T05:39:58.363782+0000","last_clean":"2024-09-10T05:39:58.363782+0000","last_became_active":"2024-09-10T05:36:19.664741+0000","last_became_peered":"2024-09-10T05:36:19.664741+0000","last_unstale":"2024-09-10T05:39:58.363782+0000","last_undegraded":"2024-09-10T05:39:58.363782+0000","last_fullsized":"2024-09-10T05:39:58.363782+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:34:14.254885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"34'2","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:21.797711+0000","last_change":"2024-09-10T05:36:21.657298+0000","last_active":"2024-09-10T05:38:21.797711+0000","last_peered":"2024-09-10T05:38:21.797711+0000","last_clean":"2024-09-10T05:38:21.797711+0000","last_became_active":"2024-09-10T05:36:21.656522+0000","last_became_peered":"2024-09-10T05:36:21.656522+0000","last_unstale":"2024-09-10T05:38:21.797711+0000","last_undegraded":"2024-09-10T05:38:21.797711+0000","last_fullsized":"2024-09-10T05:38:21.797711+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:46:36.764173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'8","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.883202+0000","last_change":"2024-09-10T05:36:13.623674+0000","last_active":"2024-09-10T05:39:26.883202+0000","last_peered":"2024-09-10T05:39:26.883202+0000","last_clean":"2024-09-10T05:39:26.883202+0000","last_became_active":"2024-09-10T05:36:13.622771+0000","last_became_peered":"2024-09-10T05:36:13.622771+0000","last_unstale":"2024-09-10T05:39:26.883202+0000","last_undegraded":"2024-09-10T05:39:26.883202+0000","last_fullsized":"2024-09-10T05:39:26.883202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:10.534366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"32'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:09.364492+0000","last_change":"2024-09-10T05:40:09.364492+0000","last_active":"2024-09-10T05:40:09.364492+0000","last_peered":"2024-09-10T05:40:09.364492+0000","last_clean":"2024-09-10T05:40:09.364492+0000","last_became_active":"2024-09-10T05:36:11.596165+0000","last_became_peered":"2024-09-10T05:36:11.596165+0000","last_unstale":"2024-09-10T05:40:09.364492+0000","last_undegraded":"2024-09-10T05:40:09.364492+0000","last_fullsized":"2024-09-10T05:40:09.364492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T05:40:09.364301+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T05:40:09.364301+0000","last_clean_scrub_stamp":"2024-09-10T05:40:09.364301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:02:21.771318+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.905564+0000","last_change":"2024-09-10T05:36:15.616568+0000","last_active":"2024-09-10T05:37:55.905564+0000","last_peered":"2024-09-10T05:37:55.905564+0000","last_clean":"2024-09-10T05:37:55.905564+0000","last_became_active":"2024-09-10T05:36:15.615994+0000","last_became_peered":"2024-09-10T05:36:15.615994+0000","last_unstale":"2024-09-10T05:37:55.905564+0000","last_undegraded":"2024-09-10T05:37:55.905564+0000","last_fullsized":"2024-09-10T05:37:55.905564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:15:00.093895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"34'39","reported_seq":96,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.739092+0000","last_change":"2024-09-10T05:36:17.631891+0000","last_active":"2024-09-10T05:39:58.739092+0000","last_peered":"2024-09-10T05:39:58.739092+0000","last_clean":"2024-09-10T05:39:58.739092+0000","last_became_active":"2024-09-10T05:36:17.631054+0000","last_became_peered":"2024-09-10T05:36:17.631054+0000","last_unstale":"2024-09-10T05:39:58.739092+0000","last_undegraded":"2024-09-10T05:39:58.739092+0000","last_fullsized":"2024-09-10T05:39:58.739092+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:59.553249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"34'285","reported_seq":410,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.370539+0000","last_change":"2024-09-10T05:36:19.671507+0000","last_active":"2024-09-10T05:39:58.370539+0000","last_peered":"2024-09-10T05:39:58.370539+0000","last_clean":"2024-09-10T05:39:58.370539+0000","last_became_active":"2024-09-10T05:36:19.670915+0000","last_became_peered":"2024-09-10T05:36:19.670915+0000","last_unstale":"2024-09-10T05:39:58.370539+0000","last_undegraded":"2024-09-10T05:39:58.370539+0000","last_fullsized":"2024-09-10T05:39:58.370539+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:35.175677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"34'8","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.859732+0000","last_change":"2024-09-10T05:36:13.598359+0000","last_active":"2024-09-10T05:39:26.859732+0000","last_peered":"2024-09-10T05:39:26.859732+0000","last_clean":"2024-09-10T05:39:26.859732+0000","last_became_active":"2024-09-10T05:36:13.597477+0000","last_became_peered":"2024-09-10T05:36:13.597477+0000","last_unstale":"2024-09-10T05:39:26.859732+0000","last_undegraded":"2024-09-10T05:39:26.859732+0000","last_fullsized":"2024-09-10T05:39:26.859732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:33.752285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:12.341960+0000","last_change":"2024-09-10T05:40:12.341960+0000","last_active":"2024-09-10T05:40:12.341960+0000","last_peered":"2024-09-10T05:40:12.341960+0000","last_clean":"2024-09-10T05:40:12.341960+0000","last_became_active":"2024-09-10T05:36:11.600405+0000","last_became_peered":"2024-09-10T05:36:11.600405+0000","last_unstale":"2024-09-10T05:40:12.341960+0000","last_undegraded":"2024-09-10T05:40:12.341960+0000","last_fullsized":"2024-09-10T05:40:12.341960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:12.341728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:12.341728+0000","last_clean_scrub_stamp":"2024-09-10T05:40:12.341728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:41:26.735507+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.857307+0000","last_change":"2024-09-10T05:36:15.624083+0000","last_active":"2024-09-10T05:37:53.857307+0000","last_peered":"2024-09-10T05:37:53.857307+0000","last_clean":"2024-09-10T05:37:53.857307+0000","last_became_active":"2024-09-10T05:36:15.620908+0000","last_became_peered":"2024-09-10T05:36:15.620908+0000","last_unstale":"2024-09-10T05:37:53.857307+0000","last_undegraded":"2024-09-10T05:37:53.857307+0000","last_fullsized":"2024-09-10T05:37:53.857307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:18:19.390635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'50","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.512328+0000","last_change":"2024-09-10T05:36:52.763550+0000","last_active":"2024-09-10T05:39:58.512328+0000","last_peered":"2024-09-10T05:39:58.512328+0000","last_clean":"2024-09-10T05:39:58.512328+0000","last_became_active":"2024-09-10T05:36:52.710284+0000","last_became_peered":"2024-09-10T05:36:52.710284+0000","last_unstale":"2024-09-10T05:39:58.512328+0000","last_undegraded":"2024-09-10T05:39:58.512328+0000","last_fullsized":"2024-09-10T05:39:58.512328+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:08.202725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.853131+0000","last_change":"2024-09-10T05:36:19.641236+0000","last_active":"2024-09-10T05:37:53.853131+0000","last_peered":"2024-09-10T05:37:53.853131+0000","last_clean":"2024-09-10T05:37:53.853131+0000","last_became_active":"2024-09-10T05:36:19.640470+0000","last_became_peered":"2024-09-10T05:36:19.640470+0000","last_unstale":"2024-09-10T05:37:53.853131+0000","last_undegraded":"2024-09-10T05:37:53.853131+0000","last_fullsized":"2024-09-10T05:37:53.853131+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:38.686660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"32'3","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.715202+0000","last_change":"2024-09-10T05:36:21.665615+0000","last_active":"2024-09-10T05:37:53.715202+0000","last_peered":"2024-09-10T05:37:53.715202+0000","last_clean":"2024-09-10T05:37:53.715202+0000","last_became_active":"2024-09-10T05:36:21.664232+0000","last_became_peered":"2024-09-10T05:36:21.664232+0000","last_unstale":"2024-09-10T05:37:53.715202+0000","last_undegraded":"2024-09-10T05:37:53.715202+0000","last_fullsized":"2024-09-10T05:37:53.715202+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:22:54.635544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'2","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:15.511801+0000","last_change":"2024-09-10T05:40:15.511801+0000","last_active":"2024-09-10T05:40:15.511801+0000","last_peered":"2024-09-10T05:40:15.511801+0000","last_clean":"2024-09-10T05:40:15.511801+0000","last_became_active":"2024-09-10T05:36:52.703743+0000","last_became_peered":"2024-09-10T05:36:52.703743+0000","last_unstale":"2024-09-10T05:40:15.511801+0000","last_undegraded":"2024-09-10T05:40:15.511801+0000","last_fullsized":"2024-09-10T05:40:15.511801+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:15.511620+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:15.511620+0000","last_clean_scrub_stamp":"2024-09-10T05:40:15.511620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:45:41.854563+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:07.337269+0000","last_change":"2024-09-10T05:40:07.337269+0000","last_active":"2024-09-10T05:40:07.337269+0000","last_peered":"2024-09-10T05:40:07.337269+0000","last_clean":"2024-09-10T05:40:07.337269+0000","last_became_active":"2024-09-10T05:36:11.597717+0000","last_became_peered":"2024-09-10T05:36:11.597717+0000","last_unstale":"2024-09-10T05:40:07.337269+0000","last_undegraded":"2024-09-10T05:40:07.337269+0000","last_fullsized":"2024-09-10T05:40:07.337269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:07.337094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:07.337094+0000","last_clean_scrub_stamp":"2024-09-10T05:40:07.337094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:15.999267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.712459+0000","last_change":"2024-09-10T05:36:15.632405+0000","last_active":"2024-09-10T05:37:53.712459+0000","last_peered":"2024-09-10T05:37:53.712459+0000","last_clean":"2024-09-10T05:37:53.712459+0000","last_became_active":"2024-09-10T05:36:15.631635+0000","last_became_peered":"2024-09-10T05:36:15.631635+0000","last_unstale":"2024-09-10T05:37:53.712459+0000","last_undegraded":"2024-09-10T05:37:53.712459+0000","last_fullsized":"2024-09-10T05:37:53.712459+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:17:58.666673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"34'39","reported_seq":96,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.638757+0000","last_change":"2024-09-10T05:36:17.638936+0000","last_active":"2024-09-10T05:39:58.638757+0000","last_peered":"2024-09-10T05:39:58.638757+0000","last_clean":"2024-09-10T05:39:58.638757+0000","last_became_active":"2024-09-10T05:36:17.638301+0000","last_became_peered":"2024-09-10T05:36:17.638301+0000","last_unstale":"2024-09-10T05:39:58.638757+0000","last_undegraded":"2024-09-10T05:39:58.638757+0000","last_fullsized":"2024-09-10T05:39:58.638757+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:17.394424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.725401+0000","last_change":"2024-09-10T05:36:19.671665+0000","last_active":"2024-09-10T05:37:53.725401+0000","last_peered":"2024-09-10T05:37:53.725401+0000","last_clean":"2024-09-10T05:37:53.725401+0000","last_became_active":"2024-09-10T05:36:19.671022+0000","last_became_peered":"2024-09-10T05:36:19.671022+0000","last_unstale":"2024-09-10T05:37:53.725401+0000","last_undegraded":"2024-09-10T05:37:53.725401+0000","last_fullsized":"2024-09-10T05:37:53.725401+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:52:58.839879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"32'3","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.854472+0000","last_change":"2024-09-10T05:36:21.667571+0000","last_active":"2024-09-10T05:37:53.854472+0000","last_peered":"2024-09-10T05:37:53.854472+0000","last_clean":"2024-09-10T05:37:53.854472+0000","last_became_active":"2024-09-10T05:36:21.666042+0000","last_became_peered":"2024-09-10T05:36:21.666042+0000","last_unstale":"2024-09-10T05:37:53.854472+0000","last_undegraded":"2024-09-10T05:37:53.854472+0000","last_fullsized":"2024-09-10T05:37:53.854472+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:39.262665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'14","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:16.468481+0000","last_change":"2024-09-10T05:40:16.468481+0000","last_active":"2024-09-10T05:40:16.468481+0000","last_peered":"2024-09-10T05:40:16.468481+0000","last_clean":"2024-09-10T05:40:16.468481+0000","last_became_active":"2024-09-10T05:36:52.696116+0000","last_became_peered":"2024-09-10T05:36:52.696116+0000","last_unstale":"2024-09-10T05:40:16.468481+0000","last_undegraded":"2024-09-10T05:40:16.468481+0000","last_fullsized":"2024-09-10T05:40:16.468481+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-10T05:40:16.468308+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-10T05:40:16.468308+0000","last_clean_scrub_stamp":"2024-09-10T05:40:16.468308+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:13:08.427165+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:11.363136+0000","last_change":"2024-09-10T05:40:11.363136+0000","last_active":"2024-09-10T05:40:11.363136+0000","last_peered":"2024-09-10T05:40:11.363136+0000","last_clean":"2024-09-10T05:40:11.363136+0000","last_became_active":"2024-09-10T05:36:11.606576+0000","last_became_peered":"2024-09-10T05:36:11.606576+0000","last_unstale":"2024-09-10T05:40:11.363136+0000","last_undegraded":"2024-09-10T05:40:11.363136+0000","last_fullsized":"2024-09-10T05:40:11.363136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:11.362960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:11.362960+0000","last_clean_scrub_stamp":"2024-09-10T05:40:11.362960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:18.945320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.712965+0000","last_change":"2024-09-10T05:36:15.618352+0000","last_active":"2024-09-10T05:37:53.712965+0000","last_peered":"2024-09-10T05:37:53.712965+0000","last_clean":"2024-09-10T05:37:53.712965+0000","last_became_active":"2024-09-10T05:36:15.617647+0000","last_became_peered":"2024-09-10T05:36:15.617647+0000","last_unstale":"2024-09-10T05:37:53.712965+0000","last_undegraded":"2024-09-10T05:37:53.712965+0000","last_fullsized":"2024-09-10T05:37:53.712965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:04:41.335062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"34'52","reported_seq":118,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.529180+0000","last_change":"2024-09-10T05:36:17.636835+0000","last_active":"2024-09-10T05:39:58.529180+0000","last_peered":"2024-09-10T05:39:58.529180+0000","last_clean":"2024-09-10T05:39:58.529180+0000","last_became_active":"2024-09-10T05:36:17.636000+0000","last_became_peered":"2024-09-10T05:36:17.636000+0000","last_unstale":"2024-09-10T05:39:58.529180+0000","last_undegraded":"2024-09-10T05:39:58.529180+0000","last_fullsized":"2024-09-10T05:39:58.529180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:10:22.233813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"34'285","reported_seq":357,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.371839+0000","last_change":"2024-09-10T05:36:19.664630+0000","last_active":"2024-09-10T05:39:58.371839+0000","last_peered":"2024-09-10T05:39:58.371839+0000","last_clean":"2024-09-10T05:39:58.371839+0000","last_became_active":"2024-09-10T05:36:19.663950+0000","last_became_peered":"2024-09-10T05:36:19.663950+0000","last_unstale":"2024-09-10T05:39:58.371839+0000","last_undegraded":"2024-09-10T05:39:58.371839+0000","last_fullsized":"2024-09-10T05:39:58.371839+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:53.165826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"32'2","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.854389+0000","last_change":"2024-09-10T05:36:21.691277+0000","last_active":"2024-09-10T05:37:53.854389+0000","last_peered":"2024-09-10T05:37:53.854389+0000","last_clean":"2024-09-10T05:37:53.854389+0000","last_became_active":"2024-09-10T05:36:21.690772+0000","last_became_peered":"2024-09-10T05:36:21.690772+0000","last_unstale":"2024-09-10T05:37:53.854389+0000","last_undegraded":"2024-09-10T05:37:53.854389+0000","last_fullsized":"2024-09-10T05:37:53.854389+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:17:39.487372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"34'6","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:17.463570+0000","last_change":"2024-09-10T05:40:17.463570+0000","last_active":"2024-09-10T05:40:17.463570+0000","last_peered":"2024-09-10T05:40:17.463570+0000","last_clean":"2024-09-10T05:40:17.463570+0000","last_became_active":"2024-09-10T05:36:13.611694+0000","last_became_peered":"2024-09-10T05:36:13.611694+0000","last_unstale":"2024-09-10T05:40:17.463570+0000","last_undegraded":"2024-09-10T05:40:17.463570+0000","last_fullsized":"2024-09-10T05:40:17.463570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T05:40:17.463381+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T05:40:17.463381+0000","last_clean_scrub_stamp":"2024-09-10T05:40:17.463381+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:29.689757+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:03.358004+0000","last_change":"2024-09-10T05:40:03.358004+0000","last_active":"2024-09-10T05:40:03.358004+0000","last_peered":"2024-09-10T05:40:03.358004+0000","last_clean":"2024-09-10T05:40:03.358004+0000","last_became_active":"2024-09-10T05:36:11.606957+0000","last_became_peered":"2024-09-10T05:36:11.606957+0000","last_unstale":"2024-09-10T05:40:03.358004+0000","last_undegraded":"2024-09-10T05:40:03.358004+0000","last_fullsized":"2024-09-10T05:40:03.358004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T05:40:03.357891+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T05:40:03.357891+0000","last_clean_scrub_stamp":"2024-09-10T05:40:03.357891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:00:33.509652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.712437+0000","last_change":"2024-09-10T05:36:15.632297+0000","last_active":"2024-09-10T05:37:53.712437+0000","last_peered":"2024-09-10T05:37:53.712437+0000","last_clean":"2024-09-10T05:37:53.712437+0000","last_became_active":"2024-09-10T05:36:15.631551+0000","last_became_peered":"2024-09-10T05:36:15.631551+0000","last_unstale":"2024-09-10T05:37:53.712437+0000","last_undegraded":"2024-09-10T05:37:53.712437+0000","last_fullsized":"2024-09-10T05:37:53.712437+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:38:35.217361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"34'72","reported_seq":153,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.668223+0000","last_change":"2024-09-10T05:36:17.651071+0000","last_active":"2024-09-10T05:39:58.668223+0000","last_peered":"2024-09-10T05:39:58.668223+0000","last_clean":"2024-09-10T05:39:58.668223+0000","last_became_active":"2024-09-10T05:36:17.650601+0000","last_became_peered":"2024-09-10T05:36:17.650601+0000","last_unstale":"2024-09-10T05:39:58.668223+0000","last_undegraded":"2024-09-10T05:39:58.668223+0000","last_fullsized":"2024-09-10T05:39:58.668223+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:33:18.024305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.712799+0000","last_change":"2024-09-10T05:36:19.638840+0000","last_active":"2024-09-10T05:37:53.712799+0000","last_peered":"2024-09-10T05:37:53.712799+0000","last_clean":"2024-09-10T05:37:53.712799+0000","last_became_active":"2024-09-10T05:36:19.638087+0000","last_became_peered":"2024-09-10T05:36:19.638087+0000","last_unstale":"2024-09-10T05:37:53.712799+0000","last_undegraded":"2024-09-10T05:37:53.712799+0000","last_fullsized":"2024-09-10T05:37:53.712799+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:43:13.922357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"34'18","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.525874+0000","last_change":"2024-09-10T05:36:21.681112+0000","last_active":"2024-09-10T05:39:27.525874+0000","last_peered":"2024-09-10T05:39:27.525874+0000","last_clean":"2024-09-10T05:39:27.525874+0000","last_became_active":"2024-09-10T05:36:21.680246+0000","last_became_peered":"2024-09-10T05:36:21.680246+0000","last_unstale":"2024-09-10T05:39:27.525874+0000","last_undegraded":"2024-09-10T05:39:27.525874+0000","last_fullsized":"2024-09-10T05:39:27.525874+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:41.764675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"34'6","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:18.483578+0000","last_change":"2024-09-10T05:40:18.483578+0000","last_active":"2024-09-10T05:40:18.483578+0000","last_peered":"2024-09-10T05:40:18.483578+0000","last_clean":"2024-09-10T05:40:18.483578+0000","last_became_active":"2024-09-10T05:36:52.702912+0000","last_became_peered":"2024-09-10T05:36:52.702912+0000","last_unstale":"2024-09-10T05:40:18.483578+0000","last_undegraded":"2024-09-10T05:40:18.483578+0000","last_fullsized":"2024-09-10T05:40:18.483578+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T05:40:18.483367+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T05:40:18.483367+0000","last_clean_scrub_stamp":"2024-09-10T05:40:18.483367+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:29:35.440454+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:06.664984+0000","last_change":"2024-09-10T05:40:06.664984+0000","last_active":"2024-09-10T05:40:06.664984+0000","last_peered":"2024-09-10T05:40:06.664984+0000","last_clean":"2024-09-10T05:40:06.664984+0000","last_became_active":"2024-09-10T05:36:11.606930+0000","last_became_peered":"2024-09-10T05:36:11.606930+0000","last_unstale":"2024-09-10T05:40:06.664984+0000","last_undegraded":"2024-09-10T05:40:06.664984+0000","last_fullsized":"2024-09-10T05:40:06.664984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:06.664807+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:06.664807+0000","last_clean_scrub_stamp":"2024-09-10T05:40:06.664807+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:52:51.651502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.714198+0000","last_change":"2024-09-10T05:36:15.617401+0000","last_active":"2024-09-10T05:37:53.714198+0000","last_peered":"2024-09-10T05:37:53.714198+0000","last_clean":"2024-09-10T05:37:53.714198+0000","last_became_active":"2024-09-10T05:36:15.616975+0000","last_became_peered":"2024-09-10T05:36:15.616975+0000","last_unstale":"2024-09-10T05:37:53.714198+0000","last_undegraded":"2024-09-10T05:37:53.714198+0000","last_fullsized":"2024-09-10T05:37:53.714198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:18:28.491327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'45","reported_seq":103,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.677847+0000","last_change":"2024-09-10T05:36:17.651377+0000","last_active":"2024-09-10T05:39:58.677847+0000","last_peered":"2024-09-10T05:39:58.677847+0000","last_clean":"2024-09-10T05:39:58.677847+0000","last_became_active":"2024-09-10T05:36:17.650522+0000","last_became_peered":"2024-09-10T05:36:17.650522+0000","last_unstale":"2024-09-10T05:39:58.677847+0000","last_undegraded":"2024-09-10T05:39:58.677847+0000","last_fullsized":"2024-09-10T05:39:58.677847+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:31:03.454940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.728744+0000","last_change":"2024-09-10T05:36:19.664052+0000","last_active":"2024-09-10T05:37:53.728744+0000","last_peered":"2024-09-10T05:37:53.728744+0000","last_clean":"2024-09-10T05:37:53.728744+0000","last_became_active":"2024-09-10T05:36:19.663287+0000","last_became_peered":"2024-09-10T05:36:19.663287+0000","last_unstale":"2024-09-10T05:37:53.728744+0000","last_undegraded":"2024-09-10T05:37:53.728744+0000","last_fullsized":"2024-09-10T05:37:53.728744+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:39.277013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'5","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.028076+0000","last_change":"2024-09-10T05:36:21.664412+0000","last_active":"2024-09-10T05:39:27.028076+0000","last_peered":"2024-09-10T05:39:27.028076+0000","last_clean":"2024-09-10T05:39:27.028076+0000","last_became_active":"2024-09-10T05:36:21.663661+0000","last_became_peered":"2024-09-10T05:36:21.663661+0000","last_unstale":"2024-09-10T05:39:27.028076+0000","last_undegraded":"2024-09-10T05:39:27.028076+0000","last_fullsized":"2024-09-10T05:39:27.028076+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:53.553843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'5","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.024835+0000","last_change":"2024-09-10T05:36:13.631202+0000","last_active":"2024-09-10T05:39:27.024835+0000","last_peered":"2024-09-10T05:39:27.024835+0000","last_clean":"2024-09-10T05:39:27.024835+0000","last_became_active":"2024-09-10T05:36:13.630386+0000","last_became_peered":"2024-09-10T05:36:13.630386+0000","last_unstale":"2024-09-10T05:39:27.024835+0000","last_undegraded":"2024-09-10T05:39:27.024835+0000","last_fullsized":"2024-09-10T05:39:27.024835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:36.024873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:19.418419+0000","last_change":"2024-09-10T05:40:19.418419+0000","last_active":"2024-09-10T05:40:19.418419+0000","last_peered":"2024-09-10T05:40:19.418419+0000","last_clean":"2024-09-10T05:40:19.418419+0000","last_became_active":"2024-09-10T05:36:11.597935+0000","last_became_peered":"2024-09-10T05:36:11.597935+0000","last_unstale":"2024-09-10T05:40:19.418419+0000","last_undegraded":"2024-09-10T05:40:19.418419+0000","last_fullsized":"2024-09-10T05:40:19.418419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:19.418236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:19.418236+0000","last_clean_scrub_stamp":"2024-09-10T05:40:19.418236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:15:58.466576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.853934+0000","last_change":"2024-09-10T05:36:15.619918+0000","last_active":"2024-09-10T05:37:53.853934+0000","last_peered":"2024-09-10T05:37:53.853934+0000","last_clean":"2024-09-10T05:37:53.853934+0000","last_became_active":"2024-09-10T05:36:15.619388+0000","last_became_peered":"2024-09-10T05:36:15.619388+0000","last_unstale":"2024-09-10T05:37:53.853934+0000","last_undegraded":"2024-09-10T05:37:53.853934+0000","last_fullsized":"2024-09-10T05:37:53.853934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:26.033372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"34'39","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.609725+0000","last_change":"2024-09-10T05:36:17.638791+0000","last_active":"2024-09-10T05:39:58.609725+0000","last_peered":"2024-09-10T05:39:58.609725+0000","last_clean":"2024-09-10T05:39:58.609725+0000","last_became_active":"2024-09-10T05:36:17.636568+0000","last_became_peered":"2024-09-10T05:36:17.636568+0000","last_unstale":"2024-09-10T05:39:58.609725+0000","last_undegraded":"2024-09-10T05:39:58.609725+0000","last_fullsized":"2024-09-10T05:39:58.609725+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:58.268199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'285","reported_seq":412,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.364326+0000","last_change":"2024-09-10T05:36:19.667395+0000","last_active":"2024-09-10T05:39:58.364326+0000","last_peered":"2024-09-10T05:39:58.364326+0000","last_clean":"2024-09-10T05:39:58.364326+0000","last_became_active":"2024-09-10T05:36:19.666610+0000","last_became_peered":"2024-09-10T05:36:19.666610+0000","last_unstale":"2024-09-10T05:39:58.364326+0000","last_undegraded":"2024-09-10T05:39:58.364326+0000","last_fullsized":"2024-09-10T05:39:58.364326+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:22:18.017142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'12","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:27.686883+0000","last_change":"2024-09-10T05:36:21.669588+0000","last_active":"2024-09-10T05:38:27.686883+0000","last_peered":"2024-09-10T05:38:27.686883+0000","last_clean":"2024-09-10T05:38:27.686883+0000","last_became_active":"2024-09-10T05:36:21.668641+0000","last_became_peered":"2024-09-10T05:36:21.668641+0000","last_unstale":"2024-09-10T05:38:27.686883+0000","last_undegraded":"2024-09-10T05:38:27.686883+0000","last_fullsized":"2024-09-10T05:38:27.686883+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:59.764142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"34'8","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:19.486658+0000","last_change":"2024-09-10T05:40:19.486658+0000","last_active":"2024-09-10T05:40:19.486658+0000","last_peered":"2024-09-10T05:40:19.486658+0000","last_clean":"2024-09-10T05:40:19.486658+0000","last_became_active":"2024-09-10T05:36:13.605112+0000","last_became_peered":"2024-09-10T05:36:13.605112+0000","last_unstale":"2024-09-10T05:40:19.486658+0000","last_undegraded":"2024-09-10T05:40:19.486658+0000","last_fullsized":"2024-09-10T05:40:19.486658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-10T05:40:19.486471+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-10T05:40:19.486471+0000","last_clean_scrub_stamp":"2024-09-10T05:40:19.486471+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:21:20.885876+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:05.699984+0000","last_change":"2024-09-10T05:40:05.699984+0000","last_active":"2024-09-10T05:40:05.699984+0000","last_peered":"2024-09-10T05:40:05.699984+0000","last_clean":"2024-09-10T05:40:05.699984+0000","last_became_active":"2024-09-10T05:36:11.600833+0000","last_became_peered":"2024-09-10T05:36:11.600833+0000","last_unstale":"2024-09-10T05:40:05.699984+0000","last_undegraded":"2024-09-10T05:40:05.699984+0000","last_fullsized":"2024-09-10T05:40:05.699984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:05.699733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:05.699733+0000","last_clean_scrub_stamp":"2024-09-10T05:40:05.699733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:58:29.252913+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'3","reported_seq":422,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.335604+0000","last_change":"2024-09-10T05:36:15.636516+0000","last_active":"2024-09-10T05:39:58.335604+0000","last_peered":"2024-09-10T05:39:58.335604+0000","last_clean":"2024-09-10T05:39:58.335604+0000","last_became_active":"2024-09-10T05:36:15.635670+0000","last_became_peered":"2024-09-10T05:36:15.635670+0000","last_unstale":"2024-09-10T05:39:58.335604+0000","last_undegraded":"2024-09-10T05:39:58.335604+0000","last_fullsized":"2024-09-10T05:39:58.335604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:38:23.956906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.726176+0000","last_change":"2024-09-10T05:36:17.639202+0000","last_active":"2024-09-10T05:37:53.726176+0000","last_peered":"2024-09-10T05:37:53.726176+0000","last_clean":"2024-09-10T05:37:53.726176+0000","last_became_active":"2024-09-10T05:36:17.633215+0000","last_became_peered":"2024-09-10T05:36:17.633215+0000","last_unstale":"2024-09-10T05:37:53.726176+0000","last_undegraded":"2024-09-10T05:37:53.726176+0000","last_fullsized":"2024-09-10T05:37:53.726176+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:47:38.759892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'285","reported_seq":474,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.367543+0000","last_change":"2024-09-10T05:36:19.650595+0000","last_active":"2024-09-10T05:39:58.367543+0000","last_peered":"2024-09-10T05:39:58.367543+0000","last_clean":"2024-09-10T05:39:58.367543+0000","last_became_active":"2024-09-10T05:36:19.649781+0000","last_became_peered":"2024-09-10T05:36:19.649781+0000","last_unstale":"2024-09-10T05:39:58.367543+0000","last_undegraded":"2024-09-10T05:39:58.367543+0000","last_fullsized":"2024-09-10T05:39:58.367543+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:13:23.575638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:25.756309+0000","last_change":"2024-09-10T05:36:21.665015+0000","last_active":"2024-09-10T05:38:25.756309+0000","last_peered":"2024-09-10T05:38:25.756309+0000","last_clean":"2024-09-10T05:38:25.756309+0000","last_became_active":"2024-09-10T05:36:21.664283+0000","last_became_peered":"2024-09-10T05:36:21.664283+0000","last_unstale":"2024-09-10T05:38:25.756309+0000","last_undegraded":"2024-09-10T05:38:25.756309+0000","last_fullsized":"2024-09-10T05:38:25.756309+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:35:48.390527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'4","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:20.525777+0000","last_change":"2024-09-10T05:40:20.525777+0000","last_active":"2024-09-10T05:40:20.525777+0000","last_peered":"2024-09-10T05:40:20.525777+0000","last_clean":"2024-09-10T05:40:20.525777+0000","last_became_active":"2024-09-10T05:37:53.724668+0000","last_became_peered":"2024-09-10T05:37:53.724668+0000","last_unstale":"2024-09-10T05:40:20.525777+0000","last_undegraded":"2024-09-10T05:40:20.525777+0000","last_fullsized":"2024-09-10T05:40:20.525777+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:20.525572+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:20.525572+0000","last_clean_scrub_stamp":"2024-09-10T05:40:20.525572+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:25.446283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:07.715354+0000","last_change":"2024-09-10T05:40:07.715354+0000","last_active":"2024-09-10T05:40:07.715354+0000","last_peered":"2024-09-10T05:40:07.715354+0000","last_clean":"2024-09-10T05:40:07.715354+0000","last_became_active":"2024-09-10T05:36:11.598213+0000","last_became_peered":"2024-09-10T05:36:11.598213+0000","last_unstale":"2024-09-10T05:40:07.715354+0000","last_undegraded":"2024-09-10T05:40:07.715354+0000","last_fullsized":"2024-09-10T05:40:07.715354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:07.715175+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:07.715175+0000","last_clean_scrub_stamp":"2024-09-10T05:40:07.715175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:29:24.579705+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.729250+0000","last_change":"2024-09-10T05:36:15.622429+0000","last_active":"2024-09-10T05:37:53.729250+0000","last_peered":"2024-09-10T05:37:53.729250+0000","last_clean":"2024-09-10T05:37:53.729250+0000","last_became_active":"2024-09-10T05:36:15.621697+0000","last_became_peered":"2024-09-10T05:36:15.621697+0000","last_unstale":"2024-09-10T05:37:53.729250+0000","last_undegraded":"2024-09-10T05:37:53.729250+0000","last_fullsized":"2024-09-10T05:37:53.729250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:13:04.950511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'41","reported_seq":96,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.488104+0000","last_change":"2024-09-10T05:36:17.648212+0000","last_active":"2024-09-10T05:39:58.488104+0000","last_peered":"2024-09-10T05:39:58.488104+0000","last_clean":"2024-09-10T05:39:58.488104+0000","last_became_active":"2024-09-10T05:36:17.647533+0000","last_became_peered":"2024-09-10T05:36:17.647533+0000","last_unstale":"2024-09-10T05:39:58.488104+0000","last_undegraded":"2024-09-10T05:39:58.488104+0000","last_fullsized":"2024-09-10T05:39:58.488104+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:49:23.646157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.896760+0000","last_change":"2024-09-10T05:36:19.641688+0000","last_active":"2024-09-10T05:37:55.896760+0000","last_peered":"2024-09-10T05:37:55.896760+0000","last_clean":"2024-09-10T05:37:55.896760+0000","last_became_active":"2024-09-10T05:36:19.640885+0000","last_became_peered":"2024-09-10T05:36:19.640885+0000","last_unstale":"2024-09-10T05:37:55.896760+0000","last_undegraded":"2024-09-10T05:37:55.896760+0000","last_fullsized":"2024-09-10T05:37:55.896760+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:07.106507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"34'8","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.434518+0000","last_change":"2024-09-10T05:36:21.665178+0000","last_active":"2024-09-10T05:39:27.434518+0000","last_peered":"2024-09-10T05:39:27.434518+0000","last_clean":"2024-09-10T05:39:27.434518+0000","last_became_active":"2024-09-10T05:36:21.664454+0000","last_became_peered":"2024-09-10T05:36:21.664454+0000","last_unstale":"2024-09-10T05:39:27.434518+0000","last_undegraded":"2024-09-10T05:39:27.434518+0000","last_fullsized":"2024-09-10T05:39:27.434518+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:10:47.751838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'6","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:21.456922+0000","last_change":"2024-09-10T05:40:21.456783+0000","last_active":"2024-09-10T05:40:21.456922+0000","last_peered":"2024-09-10T05:40:21.456922+0000","last_clean":"2024-09-10T05:40:21.456922+0000","last_became_active":"2024-09-10T05:36:13.605318+0000","last_became_peered":"2024-09-10T05:36:13.605318+0000","last_unstale":"2024-09-10T05:40:21.456922+0000","last_undegraded":"2024-09-10T05:40:21.456922+0000","last_fullsized":"2024-09-10T05:40:21.456922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T05:40:21.456596+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T05:40:21.456596+0000","last_clean_scrub_stamp":"2024-09-10T05:40:21.456596+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:47.464427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"34'74","reported_seq":157,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:04.098105+0000","last_change":"2024-09-10T05:40:04.098105+0000","last_active":"2024-09-10T05:40:04.098105+0000","last_peered":"2024-09-10T05:40:04.098105+0000","last_clean":"2024-09-10T05:40:04.098105+0000","last_became_active":"2024-09-10T05:35:59.486077+0000","last_became_peered":"2024-09-10T05:35:59.486077+0000","last_unstale":"2024-09-10T05:40:04.098105+0000","last_undegraded":"2024-09-10T05:40:04.098105+0000","last_fullsized":"2024-09-10T05:40:04.098105+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'74","last_scrub_stamp":"2024-09-10T05:40:04.097908+0000","last_deep_scrub":"34'74","last_deep_scrub_stamp":"2024-09-10T05:40:04.097908+0000","last_clean_scrub_stamp":"2024-09-10T05:40:04.097908+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:20:39.253681+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"34'2","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:02.370065+0000","last_change":"2024-09-10T05:40:02.369928+0000","last_active":"2024-09-10T05:40:02.370065+0000","last_peered":"2024-09-10T05:40:02.370065+0000","last_clean":"2024-09-10T05:40:02.370065+0000","last_became_active":"2024-09-10T05:36:03.710352+0000","last_became_peered":"2024-09-10T05:36:03.710352+0000","last_unstale":"2024-09-10T05:40:02.370065+0000","last_undegraded":"2024-09-10T05:40:02.370065+0000","last_fullsized":"2024-09-10T05:40:02.370065+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:02.369862+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:02.369862+0000","last_clean_scrub_stamp":"2024-09-10T05:40:02.369862+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:48.466459+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.002047461,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:03.692057+0000","last_change":"2024-09-10T05:40:03.692057+0000","last_active":"2024-09-10T05:40:03.692057+0000","last_peered":"2024-09-10T05:40:03.692057+0000","last_clean":"2024-09-10T05:40:03.692057+0000","last_became_active":"2024-09-10T05:36:11.604178+0000","last_became_peered":"2024-09-10T05:36:11.604178+0000","last_unstale":"2024-09-10T05:40:03.692057+0000","last_undegraded":"2024-09-10T05:40:03.692057+0000","last_fullsized":"2024-09-10T05:40:03.692057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:03.691877+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:03.691877+0000","last_clean_scrub_stamp":"2024-09-10T05:40:03.691877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:48:28.093143+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.854195+0000","last_change":"2024-09-10T05:36:15.624270+0000","last_active":"2024-09-10T05:37:53.854195+0000","last_peered":"2024-09-10T05:37:53.854195+0000","last_clean":"2024-09-10T05:37:53.854195+0000","last_became_active":"2024-09-10T05:36:15.623637+0000","last_became_peered":"2024-09-10T05:36:15.623637+0000","last_unstale":"2024-09-10T05:37:53.854195+0000","last_undegraded":"2024-09-10T05:37:53.854195+0000","last_fullsized":"2024-09-10T05:37:53.854195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:37:16.145975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'92","reported_seq":184,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.580313+0000","last_change":"2024-09-10T05:36:17.637408+0000","last_active":"2024-09-10T05:39:58.580313+0000","last_peered":"2024-09-10T05:39:58.580313+0000","last_clean":"2024-09-10T05:39:58.580313+0000","last_became_active":"2024-09-10T05:36:17.636543+0000","last_became_peered":"2024-09-10T05:36:17.636543+0000","last_unstale":"2024-09-10T05:39:58.580313+0000","last_undegraded":"2024-09-10T05:39:58.580313+0000","last_fullsized":"2024-09-10T05:39:58.580313+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:15:25.918278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.728409+0000","last_change":"2024-09-10T05:36:19.664203+0000","last_active":"2024-09-10T05:37:53.728409+0000","last_peered":"2024-09-10T05:37:53.728409+0000","last_clean":"2024-09-10T05:37:53.728409+0000","last_became_active":"2024-09-10T05:36:19.663584+0000","last_became_peered":"2024-09-10T05:36:19.663584+0000","last_unstale":"2024-09-10T05:37:53.728409+0000","last_undegraded":"2024-09-10T05:37:53.728409+0000","last_fullsized":"2024-09-10T05:37:53.728409+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:33.708215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"34'82","reported_seq":168,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.391356+0000","last_change":"2024-09-10T05:36:21.664939+0000","last_active":"2024-09-10T05:39:27.391356+0000","last_peered":"2024-09-10T05:39:27.391356+0000","last_clean":"2024-09-10T05:39:27.391356+0000","last_became_active":"2024-09-10T05:36:21.664075+0000","last_became_peered":"2024-09-10T05:36:21.664075+0000","last_unstale":"2024-09-10T05:39:27.391356+0000","last_undegraded":"2024-09-10T05:39:27.391356+0000","last_fullsized":"2024-09-10T05:39:27.391356+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:13:56.435337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":223,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"30'2","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.729039+0000","last_change":"2024-09-10T05:36:13.617433+0000","last_active":"2024-09-10T05:37:53.729039+0000","last_peered":"2024-09-10T05:37:53.729039+0000","last_clean":"2024-09-10T05:37:53.729039+0000","last_became_active":"2024-09-10T05:36:13.616766+0000","last_became_peered":"2024-09-10T05:36:13.616766+0000","last_unstale":"2024-09-10T05:37:53.729039+0000","last_undegraded":"2024-09-10T05:37:53.729039+0000","last_fullsized":"2024-09-10T05:37:53.729039+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:08:29.778211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:08.386382+0000","last_change":"2024-09-10T05:40:08.386382+0000","last_active":"2024-09-10T05:40:08.386382+0000","last_peered":"2024-09-10T05:40:08.386382+0000","last_clean":"2024-09-10T05:40:08.386382+0000","last_became_active":"2024-09-10T05:36:03.706256+0000","last_became_peered":"2024-09-10T05:36:03.706256+0000","last_unstale":"2024-09-10T05:40:08.386382+0000","last_undegraded":"2024-09-10T05:40:08.386382+0000","last_fullsized":"2024-09-10T05:40:08.386382+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:08.386197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:08.386197+0000","last_clean_scrub_stamp":"2024-09-10T05:40:08.386197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:07.558694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001383542,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:07.029001+0000","last_change":"2024-09-10T05:40:07.028861+0000","last_active":"2024-09-10T05:40:07.029001+0000","last_peered":"2024-09-10T05:40:07.029001+0000","last_clean":"2024-09-10T05:40:07.029001+0000","last_became_active":"2024-09-10T05:36:11.591339+0000","last_became_peered":"2024-09-10T05:36:11.591339+0000","last_unstale":"2024-09-10T05:40:07.029001+0000","last_undegraded":"2024-09-10T05:40:07.029001+0000","last_fullsized":"2024-09-10T05:40:07.029001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:07.028674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:07.028674+0000","last_clean_scrub_stamp":"2024-09-10T05:40:07.028674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:03.721457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.906123+0000","last_change":"2024-09-10T05:36:52.705367+0000","last_active":"2024-09-10T05:37:55.906123+0000","last_peered":"2024-09-10T05:37:55.906123+0000","last_clean":"2024-09-10T05:37:55.906123+0000","last_became_active":"2024-09-10T05:36:52.704490+0000","last_became_peered":"2024-09-10T05:36:52.704490+0000","last_unstale":"2024-09-10T05:37:55.906123+0000","last_undegraded":"2024-09-10T05:37:55.906123+0000","last_fullsized":"2024-09-10T05:37:55.906123+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:44:28.080659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"34'291","reported_seq":519,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.650541+0000","last_change":"2024-09-10T05:36:17.640102+0000","last_active":"2024-09-10T05:39:58.650541+0000","last_peered":"2024-09-10T05:39:58.650541+0000","last_clean":"2024-09-10T05:39:58.650541+0000","last_became_active":"2024-09-10T05:36:17.637623+0000","last_became_peered":"2024-09-10T05:36:17.637623+0000","last_unstale":"2024-09-10T05:39:58.650541+0000","last_undegraded":"2024-09-10T05:39:58.650541+0000","last_fullsized":"2024-09-10T05:39:58.650541+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:47:34.520585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":387,"num_read_kb":371,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.725860+0000","last_change":"2024-09-10T05:36:19.673384+0000","last_active":"2024-09-10T05:37:53.725860+0000","last_peered":"2024-09-10T05:37:53.725860+0000","last_clean":"2024-09-10T05:37:53.725860+0000","last_became_active":"2024-09-10T05:36:19.672554+0000","last_became_peered":"2024-09-10T05:36:19.672554+0000","last_unstale":"2024-09-10T05:37:53.725860+0000","last_undegraded":"2024-09-10T05:37:53.725860+0000","last_fullsized":"2024-09-10T05:37:53.725860+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:09.659188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'5","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.856766+0000","last_change":"2024-09-10T05:36:21.662079+0000","last_active":"2024-09-10T05:37:53.856766+0000","last_peered":"2024-09-10T05:37:53.856766+0000","last_clean":"2024-09-10T05:37:53.856766+0000","last_became_active":"2024-09-10T05:36:21.661347+0000","last_became_peered":"2024-09-10T05:36:21.661347+0000","last_unstale":"2024-09-10T05:37:53.856766+0000","last_undegraded":"2024-09-10T05:37:53.856766+0000","last_fullsized":"2024-09-10T05:37:53.856766+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:23.555775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'6","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.364285+0000","last_change":"2024-09-10T05:36:13.626334+0000","last_active":"2024-09-10T05:39:27.364285+0000","last_peered":"2024-09-10T05:39:27.364285+0000","last_clean":"2024-09-10T05:39:27.364285+0000","last_became_active":"2024-09-10T05:36:13.621451+0000","last_became_peered":"2024-09-10T05:36:13.621451+0000","last_unstale":"2024-09-10T05:39:27.364285+0000","last_undegraded":"2024-09-10T05:39:27.364285+0000","last_fullsized":"2024-09-10T05:39:27.364285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:29:14.676606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:04.549247+0000","last_change":"2024-09-10T05:40:04.549099+0000","last_active":"2024-09-10T05:40:04.549247+0000","last_peered":"2024-09-10T05:40:04.549247+0000","last_clean":"2024-09-10T05:40:04.549247+0000","last_became_active":"2024-09-10T05:36:03.707045+0000","last_became_peered":"2024-09-10T05:36:03.707045+0000","last_unstale":"2024-09-10T05:40:04.549247+0000","last_undegraded":"2024-09-10T05:40:04.549247+0000","last_fullsized":"2024-09-10T05:40:04.549247+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:04.548887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:04.548887+0000","last_clean_scrub_stamp":"2024-09-10T05:40:04.548887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:06.035520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093121299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"34'4","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:06.066743+0000","last_change":"2024-09-10T05:40:06.066584+0000","last_active":"2024-09-10T05:40:06.066743+0000","last_peered":"2024-09-10T05:40:06.066743+0000","last_clean":"2024-09-10T05:40:06.066743+0000","last_became_active":"2024-09-10T05:36:11.594432+0000","last_became_peered":"2024-09-10T05:36:11.594432+0000","last_unstale":"2024-09-10T05:40:06.066743+0000","last_undegraded":"2024-09-10T05:40:06.066743+0000","last_fullsized":"2024-09-10T05:40:06.066743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:06.066401+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:06.066401+0000","last_clean_scrub_stamp":"2024-09-10T05:40:06.066401+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:26.311891+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.716765+0000","last_change":"2024-09-10T05:36:15.620736+0000","last_active":"2024-09-10T05:37:53.716765+0000","last_peered":"2024-09-10T05:37:53.716765+0000","last_clean":"2024-09-10T05:37:53.716765+0000","last_became_active":"2024-09-10T05:36:15.620043+0000","last_became_peered":"2024-09-10T05:36:15.620043+0000","last_unstale":"2024-09-10T05:37:53.716765+0000","last_undegraded":"2024-09-10T05:37:53.716765+0000","last_fullsized":"2024-09-10T05:37:53.716765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:34.666759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'17","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.227823+0000","last_change":"2024-09-10T05:36:17.637187+0000","last_active":"2024-09-10T05:39:27.227823+0000","last_peered":"2024-09-10T05:39:27.227823+0000","last_clean":"2024-09-10T05:39:27.227823+0000","last_became_active":"2024-09-10T05:36:17.636381+0000","last_became_peered":"2024-09-10T05:36:17.636381+0000","last_unstale":"2024-09-10T05:39:27.227823+0000","last_undegraded":"2024-09-10T05:39:27.227823+0000","last_fullsized":"2024-09-10T05:39:27.227823+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:55:19.261582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.854702+0000","last_change":"2024-09-10T05:36:19.666298+0000","last_active":"2024-09-10T05:37:53.854702+0000","last_peered":"2024-09-10T05:37:53.854702+0000","last_clean":"2024-09-10T05:37:53.854702+0000","last_became_active":"2024-09-10T05:36:19.664396+0000","last_became_peered":"2024-09-10T05:36:19.664396+0000","last_unstale":"2024-09-10T05:37:53.854702+0000","last_undegraded":"2024-09-10T05:37:53.854702+0000","last_fullsized":"2024-09-10T05:37:53.854702+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:27:46.613544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.725249+0000","last_change":"2024-09-10T05:36:21.675746+0000","last_active":"2024-09-10T05:37:53.725249+0000","last_peered":"2024-09-10T05:37:53.725249+0000","last_clean":"2024-09-10T05:37:53.725249+0000","last_became_active":"2024-09-10T05:36:21.674984+0000","last_became_peered":"2024-09-10T05:36:21.674984+0000","last_unstale":"2024-09-10T05:37:53.725249+0000","last_undegraded":"2024-09-10T05:37:53.725249+0000","last_fullsized":"2024-09-10T05:37:53.725249+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:13.261758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'3","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.467557+0000","last_change":"2024-09-10T05:36:13.627345+0000","last_active":"2024-09-10T05:39:27.467557+0000","last_peered":"2024-09-10T05:39:27.467557+0000","last_clean":"2024-09-10T05:39:27.467557+0000","last_became_active":"2024-09-10T05:36:13.626654+0000","last_became_peered":"2024-09-10T05:36:13.626654+0000","last_unstale":"2024-09-10T05:39:27.467557+0000","last_undegraded":"2024-09-10T05:39:27.467557+0000","last_fullsized":"2024-09-10T05:39:27.467557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"34'3","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:15.375407+0000","last_change":"2024-09-10T05:40:15.375209+0000","last_active":"2024-09-10T05:40:15.375407+0000","last_peered":"2024-09-10T05:40:15.375407+0000","last_clean":"2024-09-10T05:40:15.375407+0000","last_became_active":"2024-09-10T05:36:03.708495+0000","last_became_peered":"2024-09-10T05:36:03.708495+0000","last_unstale":"2024-09-10T05:40:15.375407+0000","last_undegraded":"2024-09-10T05:40:15.375407+0000","last_fullsized":"2024-09-10T05:40:15.375407+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-10T05:40:15.375014+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-10T05:40:15.375014+0000","last_clean_scrub_stamp":"2024-09-10T05:40:15.375014+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:49:34.092873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012525469999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:04.336783+0000","last_change":"2024-09-10T05:40:04.336594+0000","last_active":"2024-09-10T05:40:04.336783+0000","last_peered":"2024-09-10T05:40:04.336783+0000","last_clean":"2024-09-10T05:40:04.336783+0000","last_became_active":"2024-09-10T05:36:11.601414+0000","last_became_peered":"2024-09-10T05:36:11.601414+0000","last_unstale":"2024-09-10T05:40:04.336783+0000","last_undegraded":"2024-09-10T05:40:04.336783+0000","last_fullsized":"2024-09-10T05:40:04.336783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:04.336407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:04.336407+0000","last_clean_scrub_stamp":"2024-09-10T05:40:04.336407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:42:28.818551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.856412+0000","last_change":"2024-09-10T05:36:15.619942+0000","last_active":"2024-09-10T05:37:53.856412+0000","last_peered":"2024-09-10T05:37:53.856412+0000","last_clean":"2024-09-10T05:37:53.856412+0000","last_became_active":"2024-09-10T05:36:15.619505+0000","last_became_peered":"2024-09-10T05:36:15.619505+0000","last_unstale":"2024-09-10T05:37:53.856412+0000","last_undegraded":"2024-09-10T05:37:53.856412+0000","last_fullsized":"2024-09-10T05:37:53.856412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:14:30.972656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"33'13","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.217385+0000","last_change":"2024-09-10T05:36:17.638373+0000","last_active":"2024-09-10T05:39:26.217385+0000","last_peered":"2024-09-10T05:39:26.217385+0000","last_clean":"2024-09-10T05:39:26.217385+0000","last_became_active":"2024-09-10T05:36:17.637551+0000","last_became_peered":"2024-09-10T05:36:17.637551+0000","last_unstale":"2024-09-10T05:39:26.217385+0000","last_undegraded":"2024-09-10T05:39:26.217385+0000","last_fullsized":"2024-09-10T05:39:26.217385+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:56:29.072774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.728759+0000","last_change":"2024-09-10T05:36:19.670810+0000","last_active":"2024-09-10T05:37:53.728759+0000","last_peered":"2024-09-10T05:37:53.728759+0000","last_clean":"2024-09-10T05:37:53.728759+0000","last_became_active":"2024-09-10T05:36:19.669130+0000","last_became_peered":"2024-09-10T05:36:19.669130+0000","last_unstale":"2024-09-10T05:37:53.728759+0000","last_undegraded":"2024-09-10T05:37:53.728759+0000","last_fullsized":"2024-09-10T05:37:53.728759+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:50:25.186904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'6","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:25.732480+0000","last_change":"2024-09-10T05:36:21.672078+0000","last_active":"2024-09-10T05:38:25.732480+0000","last_peered":"2024-09-10T05:38:25.732480+0000","last_clean":"2024-09-10T05:38:25.732480+0000","last_became_active":"2024-09-10T05:36:21.671206+0000","last_became_peered":"2024-09-10T05:36:21.671206+0000","last_unstale":"2024-09-10T05:38:25.732480+0000","last_undegraded":"2024-09-10T05:38:25.732480+0000","last_fullsized":"2024-09-10T05:38:25.732480+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:44:48.926007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'4","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:22.094327+0000","last_change":"2024-09-10T05:40:22.094076+0000","last_active":"2024-09-10T05:40:22.094327+0000","last_peered":"2024-09-10T05:40:22.094327+0000","last_clean":"2024-09-10T05:40:22.094327+0000","last_became_active":"2024-09-10T05:36:13.611242+0000","last_became_peered":"2024-09-10T05:36:13.611242+0000","last_unstale":"2024-09-10T05:40:22.094327+0000","last_undegraded":"2024-09-10T05:40:22.094327+0000","last_fullsized":"2024-09-10T05:40:22.094327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:22.093836+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:22.093836+0000","last_clean_scrub_stamp":"2024-09-10T05:40:22.093836+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:16:04.536508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:10.404039+0000","last_change":"2024-09-10T05:40:10.403855+0000","last_active":"2024-09-10T05:40:10.404039+0000","last_peered":"2024-09-10T05:40:10.404039+0000","last_clean":"2024-09-10T05:40:10.404039+0000","last_became_active":"2024-09-10T05:36:11.604802+0000","last_became_peered":"2024-09-10T05:36:11.604802+0000","last_unstale":"2024-09-10T05:40:10.404039+0000","last_undegraded":"2024-09-10T05:40:10.404039+0000","last_fullsized":"2024-09-10T05:40:10.404039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:10.403675+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:10.403675+0000","last_clean_scrub_stamp":"2024-09-10T05:40:10.403675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:44:01.698908+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:03.095986+0000","last_change":"2024-09-10T05:40:03.095816+0000","last_active":"2024-09-10T05:40:03.095986+0000","last_peered":"2024-09-10T05:40:03.095986+0000","last_clean":"2024-09-10T05:40:03.095986+0000","last_became_active":"2024-09-10T05:36:03.705338+0000","last_became_peered":"2024-09-10T05:36:03.705338+0000","last_unstale":"2024-09-10T05:40:03.095986+0000","last_undegraded":"2024-09-10T05:40:03.095986+0000","last_fullsized":"2024-09-10T05:40:03.095986+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:03.095625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:03.095625+0000","last_clean_scrub_stamp":"2024-09-10T05:40:03.095625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:21.581455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010885789999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.564132+0000","last_change":"2024-09-10T05:36:15.618592+0000","last_active":"2024-09-10T05:39:27.564132+0000","last_peered":"2024-09-10T05:39:27.564132+0000","last_clean":"2024-09-10T05:39:27.564132+0000","last_became_active":"2024-09-10T05:36:15.618041+0000","last_became_peered":"2024-09-10T05:36:15.618041+0000","last_unstale":"2024-09-10T05:39:27.564132+0000","last_undegraded":"2024-09-10T05:39:27.564132+0000","last_fullsized":"2024-09-10T05:39:27.564132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:44.697723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"34'81","reported_seq":166,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.603770+0000","last_change":"2024-09-10T05:36:17.654376+0000","last_active":"2024-09-10T05:39:58.603770+0000","last_peered":"2024-09-10T05:39:58.603770+0000","last_clean":"2024-09-10T05:39:58.603770+0000","last_became_active":"2024-09-10T05:36:17.653627+0000","last_became_peered":"2024-09-10T05:36:17.653627+0000","last_unstale":"2024-09-10T05:39:58.603770+0000","last_undegraded":"2024-09-10T05:39:58.603770+0000","last_fullsized":"2024-09-10T05:39:58.603770+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":94,"num_read_kb":88,"num_write":46,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.896388+0000","last_change":"2024-09-10T05:36:19.650800+0000","last_active":"2024-09-10T05:37:55.896388+0000","last_peered":"2024-09-10T05:37:55.896388+0000","last_clean":"2024-09-10T05:37:55.896388+0000","last_became_active":"2024-09-10T05:36:19.650115+0000","last_became_peered":"2024-09-10T05:36:19.650115+0000","last_unstale":"2024-09-10T05:37:55.896388+0000","last_undegraded":"2024-09-10T05:37:55.896388+0000","last_fullsized":"2024-09-10T05:37:55.896388+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:27:32.687339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"34'9","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:26.048065+0000","last_change":"2024-09-10T05:36:21.689033+0000","last_active":"2024-09-10T05:38:26.048065+0000","last_peered":"2024-09-10T05:38:26.048065+0000","last_clean":"2024-09-10T05:38:26.048065+0000","last_became_active":"2024-09-10T05:36:21.687744+0000","last_became_peered":"2024-09-10T05:36:21.687744+0000","last_unstale":"2024-09-10T05:38:26.048065+0000","last_undegraded":"2024-09-10T05:38:26.048065+0000","last_fullsized":"2024-09-10T05:38:26.048065+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:05:42.167772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"32'6","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:20.043583+0000","last_change":"2024-09-10T05:40:20.043416+0000","last_active":"2024-09-10T05:40:20.043583+0000","last_peered":"2024-09-10T05:40:20.043583+0000","last_clean":"2024-09-10T05:40:20.043583+0000","last_became_active":"2024-09-10T05:36:13.617814+0000","last_became_peered":"2024-09-10T05:36:13.617814+0000","last_unstale":"2024-09-10T05:40:20.043583+0000","last_undegraded":"2024-09-10T05:40:20.043583+0000","last_fullsized":"2024-09-10T05:40:20.043583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-10T05:40:20.043232+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-10T05:40:20.043232+0000","last_clean_scrub_stamp":"2024-09-10T05:40:20.043232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:12.310111+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:08.043171+0000","last_change":"2024-09-10T05:40:08.043044+0000","last_active":"2024-09-10T05:40:08.043171+0000","last_peered":"2024-09-10T05:40:08.043171+0000","last_clean":"2024-09-10T05:40:08.043171+0000","last_became_active":"2024-09-10T05:36:11.595349+0000","last_became_peered":"2024-09-10T05:36:11.595349+0000","last_unstale":"2024-09-10T05:40:08.043171+0000","last_undegraded":"2024-09-10T05:40:08.043171+0000","last_fullsized":"2024-09-10T05:40:08.043171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:08.042856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:08.042856+0000","last_clean_scrub_stamp":"2024-09-10T05:40:08.042856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:15:37.792723+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:05.325390+0000","last_change":"2024-09-10T05:40:05.325151+0000","last_active":"2024-09-10T05:40:05.325390+0000","last_peered":"2024-09-10T05:40:05.325390+0000","last_clean":"2024-09-10T05:40:05.325390+0000","last_became_active":"2024-09-10T05:36:03.709534+0000","last_became_peered":"2024-09-10T05:36:03.709534+0000","last_unstale":"2024-09-10T05:40:05.325390+0000","last_undegraded":"2024-09-10T05:40:05.325390+0000","last_fullsized":"2024-09-10T05:40:05.325390+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:05.324950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:05.324950+0000","last_clean_scrub_stamp":"2024-09-10T05:40:05.324950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:04:00.453210+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0022338829999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.901170+0000","last_change":"2024-09-10T05:36:15.619244+0000","last_active":"2024-09-10T05:37:55.901170+0000","last_peered":"2024-09-10T05:37:55.901170+0000","last_clean":"2024-09-10T05:37:55.901170+0000","last_became_active":"2024-09-10T05:36:15.618491+0000","last_became_peered":"2024-09-10T05:36:15.618491+0000","last_unstale":"2024-09-10T05:37:55.901170+0000","last_undegraded":"2024-09-10T05:37:55.901170+0000","last_fullsized":"2024-09-10T05:37:55.901170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:43:50.594184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"30'20","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.856948+0000","last_change":"2024-09-10T05:36:17.658105+0000","last_active":"2024-09-10T05:37:53.856948+0000","last_peered":"2024-09-10T05:37:53.856948+0000","last_clean":"2024-09-10T05:37:53.856948+0000","last_became_active":"2024-09-10T05:36:17.657112+0000","last_became_peered":"2024-09-10T05:36:17.657112+0000","last_unstale":"2024-09-10T05:37:53.856948+0000","last_undegraded":"2024-09-10T05:37:53.856948+0000","last_fullsized":"2024-09-10T05:37:53.856948+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:40.438888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'285","reported_seq":365,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.752461+0000","last_change":"2024-09-10T05:36:19.649214+0000","last_active":"2024-09-10T05:39:58.752461+0000","last_peered":"2024-09-10T05:39:58.752461+0000","last_clean":"2024-09-10T05:39:58.752461+0000","last_became_active":"2024-09-10T05:36:19.643319+0000","last_became_peered":"2024-09-10T05:36:19.643319+0000","last_unstale":"2024-09-10T05:39:58.752461+0000","last_undegraded":"2024-09-10T05:39:58.752461+0000","last_fullsized":"2024-09-10T05:39:58.752461+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"30'2","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.729162+0000","last_change":"2024-09-10T05:36:21.692062+0000","last_active":"2024-09-10T05:37:53.729162+0000","last_peered":"2024-09-10T05:37:53.729162+0000","last_clean":"2024-09-10T05:37:53.729162+0000","last_became_active":"2024-09-10T05:36:21.691590+0000","last_became_peered":"2024-09-10T05:36:21.691590+0000","last_unstale":"2024-09-10T05:37:53.729162+0000","last_undegraded":"2024-09-10T05:37:53.729162+0000","last_fullsized":"2024-09-10T05:37:53.729162+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:43:35.691961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.313173+0000","last_change":"2024-09-10T05:36:13.607662+0000","last_active":"2024-09-10T05:39:27.313173+0000","last_peered":"2024-09-10T05:39:27.313173+0000","last_clean":"2024-09-10T05:39:27.313173+0000","last_became_active":"2024-09-10T05:36:13.607367+0000","last_became_peered":"2024-09-10T05:36:13.607367+0000","last_unstale":"2024-09-10T05:39:27.313173+0000","last_undegraded":"2024-09-10T05:39:27.313173+0000","last_fullsized":"2024-09-10T05:39:27.313173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:04.718781+0000","last_change":"2024-09-10T05:40:04.718781+0000","last_active":"2024-09-10T05:40:04.718781+0000","last_peered":"2024-09-10T05:40:04.718781+0000","last_clean":"2024-09-10T05:40:04.718781+0000","last_became_active":"2024-09-10T05:36:11.606234+0000","last_became_peered":"2024-09-10T05:36:11.606234+0000","last_unstale":"2024-09-10T05:40:04.718781+0000","last_undegraded":"2024-09-10T05:40:04.718781+0000","last_fullsized":"2024-09-10T05:40:04.718781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:04.718605+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:04.718605+0000","last_clean_scrub_stamp":"2024-09-10T05:40:04.718605+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:24:19.567951+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:05.070401+0000","last_change":"2024-09-10T05:40:05.070401+0000","last_active":"2024-09-10T05:40:05.070401+0000","last_peered":"2024-09-10T05:40:05.070401+0000","last_clean":"2024-09-10T05:40:05.070401+0000","last_became_active":"2024-09-10T05:36:03.705038+0000","last_became_peered":"2024-09-10T05:36:03.705038+0000","last_unstale":"2024-09-10T05:40:05.070401+0000","last_undegraded":"2024-09-10T05:40:05.070401+0000","last_fullsized":"2024-09-10T05:40:05.070401+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:05.070198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:05.070198+0000","last_clean_scrub_stamp":"2024-09-10T05:40:05.070198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:41:09.633680+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00126935,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.901115+0000","last_change":"2024-09-10T05:36:15.618499+0000","last_active":"2024-09-10T05:37:55.901115+0000","last_peered":"2024-09-10T05:37:55.901115+0000","last_clean":"2024-09-10T05:37:55.901115+0000","last_became_active":"2024-09-10T05:36:15.617690+0000","last_became_peered":"2024-09-10T05:36:15.617690+0000","last_unstale":"2024-09-10T05:37:55.901115+0000","last_undegraded":"2024-09-10T05:37:55.901115+0000","last_fullsized":"2024-09-10T05:37:55.901115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:44.575577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"30'16","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.724231+0000","last_change":"2024-09-10T05:36:17.635256+0000","last_active":"2024-09-10T05:37:53.724231+0000","last_peered":"2024-09-10T05:37:53.724231+0000","last_clean":"2024-09-10T05:37:53.724231+0000","last_became_active":"2024-09-10T05:36:17.634261+0000","last_became_peered":"2024-09-10T05:36:17.634261+0000","last_unstale":"2024-09-10T05:37:53.724231+0000","last_undegraded":"2024-09-10T05:37:53.724231+0000","last_fullsized":"2024-09-10T05:37:53.724231+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:56:40.871070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'285","reported_seq":438,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.368712+0000","last_change":"2024-09-10T05:36:19.673204+0000","last_active":"2024-09-10T05:39:58.368712+0000","last_peered":"2024-09-10T05:39:58.368712+0000","last_clean":"2024-09-10T05:39:58.368712+0000","last_became_active":"2024-09-10T05:36:19.672586+0000","last_became_peered":"2024-09-10T05:36:19.672586+0000","last_unstale":"2024-09-10T05:39:58.368712+0000","last_undegraded":"2024-09-10T05:39:58.368712+0000","last_fullsized":"2024-09-10T05:39:58.368712+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:18:32.110473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.853637+0000","last_change":"2024-09-10T05:36:21.670112+0000","last_active":"2024-09-10T05:37:53.853637+0000","last_peered":"2024-09-10T05:37:53.853637+0000","last_clean":"2024-09-10T05:37:53.853637+0000","last_became_active":"2024-09-10T05:36:21.668909+0000","last_became_peered":"2024-09-10T05:36:21.668909+0000","last_unstale":"2024-09-10T05:37:53.853637+0000","last_undegraded":"2024-09-10T05:37:53.853637+0000","last_fullsized":"2024-09-10T05:37:53.853637+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:37:35.984330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'14","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:14.474283+0000","last_change":"2024-09-10T05:40:14.474129+0000","last_active":"2024-09-10T05:40:14.474283+0000","last_peered":"2024-09-10T05:40:14.474283+0000","last_clean":"2024-09-10T05:40:14.474283+0000","last_became_active":"2024-09-10T05:36:13.621703+0000","last_became_peered":"2024-09-10T05:36:13.621703+0000","last_unstale":"2024-09-10T05:40:14.474283+0000","last_undegraded":"2024-09-10T05:40:14.474283+0000","last_fullsized":"2024-09-10T05:40:14.474283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-10T05:40:14.473954+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-10T05:40:14.473954+0000","last_clean_scrub_stamp":"2024-09-10T05:40:14.473954+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:27.797592+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:08.998414+0000","last_change":"2024-09-10T05:40:08.998414+0000","last_active":"2024-09-10T05:40:08.998414+0000","last_peered":"2024-09-10T05:40:08.998414+0000","last_clean":"2024-09-10T05:40:08.998414+0000","last_became_active":"2024-09-10T05:36:11.594029+0000","last_became_peered":"2024-09-10T05:36:11.594029+0000","last_unstale":"2024-09-10T05:40:08.998414+0000","last_undegraded":"2024-09-10T05:40:08.998414+0000","last_fullsized":"2024-09-10T05:40:08.998414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:08.998240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:08.998240+0000","last_clean_scrub_stamp":"2024-09-10T05:40:08.998240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:40.972877+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:06.349353+0000","last_change":"2024-09-10T05:40:06.349353+0000","last_active":"2024-09-10T05:40:06.349353+0000","last_peered":"2024-09-10T05:40:06.349353+0000","last_clean":"2024-09-10T05:40:06.349353+0000","last_became_active":"2024-09-10T05:36:03.708884+0000","last_became_peered":"2024-09-10T05:36:03.708884+0000","last_unstale":"2024-09-10T05:40:06.349353+0000","last_undegraded":"2024-09-10T05:40:06.349353+0000","last_fullsized":"2024-09-10T05:40:06.349353+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:06.349170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:06.349170+0000","last_clean_scrub_stamp":"2024-09-10T05:40:06.349170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:46:31.673889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018824390000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:18.680942+0000","last_change":"2024-09-10T05:36:15.638715+0000","last_active":"2024-09-10T05:38:18.680942+0000","last_peered":"2024-09-10T05:38:18.680942+0000","last_clean":"2024-09-10T05:38:18.680942+0000","last_became_active":"2024-09-10T05:36:15.637890+0000","last_became_peered":"2024-09-10T05:36:15.637890+0000","last_unstale":"2024-09-10T05:38:18.680942+0000","last_undegraded":"2024-09-10T05:38:18.680942+0000","last_fullsized":"2024-09-10T05:38:18.680942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'97","reported_seq":192,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.719659+0000","last_change":"2024-09-10T05:36:17.632261+0000","last_active":"2024-09-10T05:39:58.719659+0000","last_peered":"2024-09-10T05:39:58.719659+0000","last_clean":"2024-09-10T05:39:58.719659+0000","last_became_active":"2024-09-10T05:36:17.631509+0000","last_became_peered":"2024-09-10T05:36:17.631509+0000","last_unstale":"2024-09-10T05:39:58.719659+0000","last_undegraded":"2024-09-10T05:39:58.719659+0000","last_fullsized":"2024-09-10T05:39:58.719659+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:42.713689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.723343+0000","last_change":"2024-09-10T05:36:19.668038+0000","last_active":"2024-09-10T05:37:53.723343+0000","last_peered":"2024-09-10T05:37:53.723343+0000","last_clean":"2024-09-10T05:37:53.723343+0000","last_became_active":"2024-09-10T05:36:19.667446+0000","last_became_peered":"2024-09-10T05:36:19.667446+0000","last_unstale":"2024-09-10T05:37:53.723343+0000","last_undegraded":"2024-09-10T05:37:53.723343+0000","last_fullsized":"2024-09-10T05:37:53.723343+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:54:25.333105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.713880+0000","last_change":"2024-09-10T05:36:21.658395+0000","last_active":"2024-09-10T05:37:53.713880+0000","last_peered":"2024-09-10T05:37:53.713880+0000","last_clean":"2024-09-10T05:37:53.713880+0000","last_became_active":"2024-09-10T05:36:21.657621+0000","last_became_peered":"2024-09-10T05:36:21.657621+0000","last_unstale":"2024-09-10T05:37:53.713880+0000","last_undegraded":"2024-09-10T05:37:53.713880+0000","last_fullsized":"2024-09-10T05:37:53.713880+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:09.853561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"32'8","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.717636+0000","last_change":"2024-09-10T05:36:21.657351+0000","last_active":"2024-09-10T05:37:53.717636+0000","last_peered":"2024-09-10T05:37:53.717636+0000","last_clean":"2024-09-10T05:37:53.717636+0000","last_became_active":"2024-09-10T05:36:21.656563+0000","last_became_peered":"2024-09-10T05:36:21.656563+0000","last_unstale":"2024-09-10T05:37:53.717636+0000","last_undegraded":"2024-09-10T05:37:53.717636+0000","last_fullsized":"2024-09-10T05:37:53.717636+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:25:08.627704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:21.547908+0000","last_change":"2024-09-10T05:40:21.547908+0000","last_active":"2024-09-10T05:40:21.547908+0000","last_peered":"2024-09-10T05:40:21.547908+0000","last_clean":"2024-09-10T05:40:21.547908+0000","last_became_active":"2024-09-10T05:36:13.620892+0000","last_became_peered":"2024-09-10T05:36:13.620892+0000","last_unstale":"2024-09-10T05:40:21.547908+0000","last_undegraded":"2024-09-10T05:40:21.547908+0000","last_fullsized":"2024-09-10T05:40:21.547908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:21.547721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:21.547721+0000","last_clean_scrub_stamp":"2024-09-10T05:40:21.547721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:53:21.051292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'6","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:16.412389+0000","last_change":"2024-09-10T05:40:16.412389+0000","last_active":"2024-09-10T05:40:16.412389+0000","last_peered":"2024-09-10T05:40:16.412389+0000","last_clean":"2024-09-10T05:40:16.412389+0000","last_became_active":"2024-09-10T05:36:11.597209+0000","last_became_peered":"2024-09-10T05:36:11.597209+0000","last_unstale":"2024-09-10T05:40:16.412389+0000","last_undegraded":"2024-09-10T05:40:16.412389+0000","last_fullsized":"2024-09-10T05:40:16.412389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T05:40:16.412205+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T05:40:16.412205+0000","last_clean_scrub_stamp":"2024-09-10T05:40:16.412205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:16.536426+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.858869+0000","last_change":"2024-09-10T05:36:15.617459+0000","last_active":"2024-09-10T05:37:53.858869+0000","last_peered":"2024-09-10T05:37:53.858869+0000","last_clean":"2024-09-10T05:37:53.858869+0000","last_became_active":"2024-09-10T05:36:15.617049+0000","last_became_peered":"2024-09-10T05:36:15.617049+0000","last_unstale":"2024-09-10T05:37:53.858869+0000","last_undegraded":"2024-09-10T05:37:53.858869+0000","last_fullsized":"2024-09-10T05:37:53.858869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:13:50.392282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'41","reported_seq":99,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.519835+0000","last_change":"2024-09-10T05:36:17.658656+0000","last_active":"2024-09-10T05:39:58.519835+0000","last_peered":"2024-09-10T05:39:58.519835+0000","last_clean":"2024-09-10T05:39:58.519835+0000","last_became_active":"2024-09-10T05:36:17.657669+0000","last_became_peered":"2024-09-10T05:36:17.657669+0000","last_unstale":"2024-09-10T05:39:58.519835+0000","last_undegraded":"2024-09-10T05:39:58.519835+0000","last_fullsized":"2024-09-10T05:39:58.519835+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:39.765543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.724025+0000","last_change":"2024-09-10T05:36:19.673156+0000","last_active":"2024-09-10T05:37:53.724025+0000","last_peered":"2024-09-10T05:37:53.724025+0000","last_clean":"2024-09-10T05:37:53.724025+0000","last_became_active":"2024-09-10T05:36:19.672498+0000","last_became_peered":"2024-09-10T05:36:19.672498+0000","last_unstale":"2024-09-10T05:37:53.724025+0000","last_undegraded":"2024-09-10T05:37:53.724025+0000","last_fullsized":"2024-09-10T05:37:53.724025+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:27:09.531398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'5","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:23.587545+0000","last_change":"2024-09-10T05:36:21.689435+0000","last_active":"2024-09-10T05:38:23.587545+0000","last_peered":"2024-09-10T05:38:23.587545+0000","last_clean":"2024-09-10T05:38:23.587545+0000","last_became_active":"2024-09-10T05:36:21.688864+0000","last_became_peered":"2024-09-10T05:36:21.688864+0000","last_unstale":"2024-09-10T05:38:23.587545+0000","last_undegraded":"2024-09-10T05:38:23.587545+0000","last_fullsized":"2024-09-10T05:38:23.587545+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:55:36.492043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"34'10","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.294531+0000","last_change":"2024-09-10T05:36:13.612003+0000","last_active":"2024-09-10T05:39:27.294531+0000","last_peered":"2024-09-10T05:39:27.294531+0000","last_clean":"2024-09-10T05:39:27.294531+0000","last_became_active":"2024-09-10T05:36:13.610883+0000","last_became_peered":"2024-09-10T05:36:13.610883+0000","last_unstale":"2024-09-10T05:39:27.294531+0000","last_undegraded":"2024-09-10T05:39:27.294531+0000","last_fullsized":"2024-09-10T05:39:27.294531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:29:40.273630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:06.519495+0000","last_change":"2024-09-10T05:40:06.519495+0000","last_active":"2024-09-10T05:40:06.519495+0000","last_peered":"2024-09-10T05:40:06.519495+0000","last_clean":"2024-09-10T05:40:06.519495+0000","last_became_active":"2024-09-10T05:36:11.605259+0000","last_became_peered":"2024-09-10T05:36:11.605259+0000","last_unstale":"2024-09-10T05:40:06.519495+0000","last_undegraded":"2024-09-10T05:40:06.519495+0000","last_fullsized":"2024-09-10T05:40:06.519495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:06.519303+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:06.519303+0000","last_clean_scrub_stamp":"2024-09-10T05:40:06.519303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:41:27.502766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.724971+0000","last_change":"2024-09-10T05:36:15.630108+0000","last_active":"2024-09-10T05:37:53.724971+0000","last_peered":"2024-09-10T05:37:53.724971+0000","last_clean":"2024-09-10T05:37:53.724971+0000","last_became_active":"2024-09-10T05:36:15.629278+0000","last_became_peered":"2024-09-10T05:36:15.629278+0000","last_unstale":"2024-09-10T05:37:53.724971+0000","last_undegraded":"2024-09-10T05:37:53.724971+0000","last_fullsized":"2024-09-10T05:37:53.724971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:14:38.879647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'6","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.226218+0000","last_change":"2024-09-10T05:36:17.652832+0000","last_active":"2024-09-10T05:39:26.226218+0000","last_peered":"2024-09-10T05:39:26.226218+0000","last_clean":"2024-09-10T05:39:26.226218+0000","last_became_active":"2024-09-10T05:36:17.648835+0000","last_became_peered":"2024-09-10T05:36:17.648835+0000","last_unstale":"2024-09-10T05:39:26.226218+0000","last_undegraded":"2024-09-10T05:39:26.226218+0000","last_fullsized":"2024-09-10T05:39:26.226218+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:46.589507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.711967+0000","last_change":"2024-09-10T05:36:19.638688+0000","last_active":"2024-09-10T05:37:53.711967+0000","last_peered":"2024-09-10T05:37:53.711967+0000","last_clean":"2024-09-10T05:37:53.711967+0000","last_became_active":"2024-09-10T05:36:19.637912+0000","last_became_peered":"2024-09-10T05:36:19.637912+0000","last_unstale":"2024-09-10T05:37:53.711967+0000","last_undegraded":"2024-09-10T05:37:53.711967+0000","last_fullsized":"2024-09-10T05:37:53.711967+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:25:54.923848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.854267+0000","last_change":"2024-09-10T05:36:21.668904+0000","last_active":"2024-09-10T05:37:53.854267+0000","last_peered":"2024-09-10T05:37:53.854267+0000","last_clean":"2024-09-10T05:37:53.854267+0000","last_became_active":"2024-09-10T05:36:21.666877+0000","last_became_peered":"2024-09-10T05:36:21.666877+0000","last_unstale":"2024-09-10T05:37:53.854267+0000","last_undegraded":"2024-09-10T05:37:53.854267+0000","last_fullsized":"2024-09-10T05:37:53.854267+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:43:13.848554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"34'4","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.856889+0000","last_change":"2024-09-10T05:36:13.598863+0000","last_active":"2024-09-10T05:39:26.856889+0000","last_peered":"2024-09-10T05:39:26.856889+0000","last_clean":"2024-09-10T05:39:26.856889+0000","last_became_active":"2024-09-10T05:36:13.597857+0000","last_became_peered":"2024-09-10T05:36:13.597857+0000","last_unstale":"2024-09-10T05:39:26.856889+0000","last_undegraded":"2024-09-10T05:39:26.856889+0000","last_fullsized":"2024-09-10T05:39:26.856889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:32:45.970120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:14.332224+0000","last_change":"2024-09-10T05:40:14.332224+0000","last_active":"2024-09-10T05:40:14.332224+0000","last_peered":"2024-09-10T05:40:14.332224+0000","last_clean":"2024-09-10T05:40:14.332224+0000","last_became_active":"2024-09-10T05:36:11.600603+0000","last_became_peered":"2024-09-10T05:36:11.600603+0000","last_unstale":"2024-09-10T05:40:14.332224+0000","last_undegraded":"2024-09-10T05:40:14.332224+0000","last_fullsized":"2024-09-10T05:40:14.332224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:14.332052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:14.332052+0000","last_clean_scrub_stamp":"2024-09-10T05:40:14.332052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:20:12.250167+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.900977+0000","last_change":"2024-09-10T05:36:15.638682+0000","last_active":"2024-09-10T05:37:55.900977+0000","last_peered":"2024-09-10T05:37:55.900977+0000","last_clean":"2024-09-10T05:37:55.900977+0000","last_became_active":"2024-09-10T05:36:15.638197+0000","last_became_peered":"2024-09-10T05:36:15.638197+0000","last_unstale":"2024-09-10T05:37:55.900977+0000","last_undegraded":"2024-09-10T05:37:55.900977+0000","last_fullsized":"2024-09-10T05:37:55.900977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:53:28.099101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"34'44","reported_seq":112,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.728639+0000","last_change":"2024-09-10T05:36:17.647135+0000","last_active":"2024-09-10T05:39:58.728639+0000","last_peered":"2024-09-10T05:39:58.728639+0000","last_clean":"2024-09-10T05:39:58.728639+0000","last_became_active":"2024-09-10T05:36:17.646459+0000","last_became_peered":"2024-09-10T05:36:17.646459+0000","last_unstale":"2024-09-10T05:39:58.728639+0000","last_undegraded":"2024-09-10T05:39:58.728639+0000","last_fullsized":"2024-09-10T05:39:58.728639+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:25:06.130753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.852746+0000","last_change":"2024-09-10T05:36:19.654869+0000","last_active":"2024-09-10T05:37:53.852746+0000","last_peered":"2024-09-10T05:37:53.852746+0000","last_clean":"2024-09-10T05:37:53.852746+0000","last_became_active":"2024-09-10T05:36:19.648608+0000","last_became_peered":"2024-09-10T05:36:19.648608+0000","last_unstale":"2024-09-10T05:37:53.852746+0000","last_undegraded":"2024-09-10T05:37:53.852746+0000","last_fullsized":"2024-09-10T05:37:53.852746+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:00.797025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.723161+0000","last_change":"2024-09-10T05:36:21.684218+0000","last_active":"2024-09-10T05:37:53.723161+0000","last_peered":"2024-09-10T05:37:53.723161+0000","last_clean":"2024-09-10T05:37:53.723161+0000","last_became_active":"2024-09-10T05:36:21.683406+0000","last_became_peered":"2024-09-10T05:36:21.683406+0000","last_unstale":"2024-09-10T05:37:53.723161+0000","last_undegraded":"2024-09-10T05:37:53.723161+0000","last_fullsized":"2024-09-10T05:37:53.723161+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:58:10.494998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'4","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.200914+0000","last_change":"2024-09-10T05:36:13.607573+0000","last_active":"2024-09-10T05:39:27.200914+0000","last_peered":"2024-09-10T05:39:27.200914+0000","last_clean":"2024-09-10T05:39:27.200914+0000","last_became_active":"2024-09-10T05:36:13.606903+0000","last_became_peered":"2024-09-10T05:36:13.606903+0000","last_unstale":"2024-09-10T05:39:27.200914+0000","last_undegraded":"2024-09-10T05:39:27.200914+0000","last_fullsized":"2024-09-10T05:39:27.200914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:36.946797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:11.044271+0000","last_change":"2024-09-10T05:40:11.044271+0000","last_active":"2024-09-10T05:40:11.044271+0000","last_peered":"2024-09-10T05:40:11.044271+0000","last_clean":"2024-09-10T05:40:11.044271+0000","last_became_active":"2024-09-10T05:36:11.594653+0000","last_became_peered":"2024-09-10T05:36:11.594653+0000","last_unstale":"2024-09-10T05:40:11.044271+0000","last_undegraded":"2024-09-10T05:40:11.044271+0000","last_fullsized":"2024-09-10T05:40:11.044271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:11.044085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:11.044085+0000","last_clean_scrub_stamp":"2024-09-10T05:40:11.044085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:34.806153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"34'5","reported_seq":424,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.336436+0000","last_change":"2024-09-10T05:36:15.617558+0000","last_active":"2024-09-10T05:39:58.336436+0000","last_peered":"2024-09-10T05:39:58.336436+0000","last_clean":"2024-09-10T05:39:58.336436+0000","last_became_active":"2024-09-10T05:36:15.615147+0000","last_became_peered":"2024-09-10T05:36:15.615147+0000","last_unstale":"2024-09-10T05:39:58.336436+0000","last_undegraded":"2024-09-10T05:39:58.336436+0000","last_fullsized":"2024-09-10T05:39:58.336436+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:18:16.479290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1429,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":586,"num_read_kb":586,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'33","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.698482+0000","last_change":"2024-09-10T05:36:17.632006+0000","last_active":"2024-09-10T05:39:58.698482+0000","last_peered":"2024-09-10T05:39:58.698482+0000","last_clean":"2024-09-10T05:39:58.698482+0000","last_became_active":"2024-09-10T05:36:17.631446+0000","last_became_peered":"2024-09-10T05:36:17.631446+0000","last_unstale":"2024-09-10T05:39:58.698482+0000","last_undegraded":"2024-09-10T05:39:58.698482+0000","last_fullsized":"2024-09-10T05:39:58.698482+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:30.388651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.715083+0000","last_change":"2024-09-10T05:36:19.639207+0000","last_active":"2024-09-10T05:37:53.715083+0000","last_peered":"2024-09-10T05:37:53.715083+0000","last_clean":"2024-09-10T05:37:53.715083+0000","last_became_active":"2024-09-10T05:36:19.638240+0000","last_became_peered":"2024-09-10T05:36:19.638240+0000","last_unstale":"2024-09-10T05:37:53.715083+0000","last_undegraded":"2024-09-10T05:37:53.715083+0000","last_fullsized":"2024-09-10T05:37:53.715083+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:39:50.347393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'8","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:17.687192+0000","last_change":"2024-09-10T05:36:13.619194+0000","last_active":"2024-09-10T05:38:17.687192+0000","last_peered":"2024-09-10T05:38:17.687192+0000","last_clean":"2024-09-10T05:38:17.687192+0000","last_became_active":"2024-09-10T05:36:13.618656+0000","last_became_peered":"2024-09-10T05:36:13.618656+0000","last_unstale":"2024-09-10T05:38:17.687192+0000","last_undegraded":"2024-09-10T05:38:17.687192+0000","last_fullsized":"2024-09-10T05:38:17.687192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:08.688775+0000","last_change":"2024-09-10T05:40:08.688775+0000","last_active":"2024-09-10T05:40:08.688775+0000","last_peered":"2024-09-10T05:40:08.688775+0000","last_clean":"2024-09-10T05:40:08.688775+0000","last_became_active":"2024-09-10T05:36:11.597710+0000","last_became_peered":"2024-09-10T05:36:11.597710+0000","last_unstale":"2024-09-10T05:40:08.688775+0000","last_undegraded":"2024-09-10T05:40:08.688775+0000","last_fullsized":"2024-09-10T05:40:08.688775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:08.688601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:08.688601+0000","last_clean_scrub_stamp":"2024-09-10T05:40:08.688601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:22:28.106904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:17.685265+0000","last_change":"2024-09-10T05:36:15.627731+0000","last_active":"2024-09-10T05:38:17.685265+0000","last_peered":"2024-09-10T05:38:17.685265+0000","last_clean":"2024-09-10T05:38:17.685265+0000","last_became_active":"2024-09-10T05:36:15.626787+0000","last_became_peered":"2024-09-10T05:36:15.626787+0000","last_unstale":"2024-09-10T05:38:17.685265+0000","last_undegraded":"2024-09-10T05:38:17.685265+0000","last_fullsized":"2024-09-10T05:38:17.685265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"34'66","reported_seq":141,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.686492+0000","last_change":"2024-09-10T05:36:17.645250+0000","last_active":"2024-09-10T05:39:58.686492+0000","last_peered":"2024-09-10T05:39:58.686492+0000","last_clean":"2024-09-10T05:39:58.686492+0000","last_became_active":"2024-09-10T05:36:17.644469+0000","last_became_peered":"2024-09-10T05:36:17.644469+0000","last_unstale":"2024-09-10T05:39:58.686492+0000","last_undegraded":"2024-09-10T05:39:58.686492+0000","last_fullsized":"2024-09-10T05:39:58.686492+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:35.181585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.715316+0000","last_change":"2024-09-10T05:36:19.639542+0000","last_active":"2024-09-10T05:37:53.715316+0000","last_peered":"2024-09-10T05:37:53.715316+0000","last_clean":"2024-09-10T05:37:53.715316+0000","last_became_active":"2024-09-10T05:36:19.638136+0000","last_became_peered":"2024-09-10T05:36:19.638136+0000","last_unstale":"2024-09-10T05:37:53.715316+0000","last_undegraded":"2024-09-10T05:37:53.715316+0000","last_fullsized":"2024-09-10T05:37:53.715316+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:15:07.235287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'14","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:26.038899+0000","last_change":"2024-09-10T05:36:21.682080+0000","last_active":"2024-09-10T05:38:26.038899+0000","last_peered":"2024-09-10T05:38:26.038899+0000","last_clean":"2024-09-10T05:38:26.038899+0000","last_became_active":"2024-09-10T05:36:21.681263+0000","last_became_peered":"2024-09-10T05:36:21.681263+0000","last_unstale":"2024-09-10T05:38:26.038899+0000","last_undegraded":"2024-09-10T05:38:26.038899+0000","last_fullsized":"2024-09-10T05:38:26.038899+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:35:30.867304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.021479+0000","last_change":"2024-09-10T05:36:13.610413+0000","last_active":"2024-09-10T05:39:27.021479+0000","last_peered":"2024-09-10T05:39:27.021479+0000","last_clean":"2024-09-10T05:39:27.021479+0000","last_became_active":"2024-09-10T05:36:13.609773+0000","last_became_peered":"2024-09-10T05:36:13.609773+0000","last_unstale":"2024-09-10T05:39:27.021479+0000","last_undegraded":"2024-09-10T05:39:27.021479+0000","last_fullsized":"2024-09-10T05:39:27.021479+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:10.048126+0000","last_change":"2024-09-10T05:40:10.048126+0000","last_active":"2024-09-10T05:40:10.048126+0000","last_peered":"2024-09-10T05:40:10.048126+0000","last_clean":"2024-09-10T05:40:10.048126+0000","last_became_active":"2024-09-10T05:36:11.595758+0000","last_became_peered":"2024-09-10T05:36:11.595758+0000","last_unstale":"2024-09-10T05:40:10.048126+0000","last_undegraded":"2024-09-10T05:40:10.048126+0000","last_fullsized":"2024-09-10T05:40:10.048126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:10.047905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:10.047905+0000","last_clean_scrub_stamp":"2024-09-10T05:40:10.047905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:36:54.103088+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.906346+0000","last_change":"2024-09-10T05:36:15.614782+0000","last_active":"2024-09-10T05:37:55.906346+0000","last_peered":"2024-09-10T05:37:55.906346+0000","last_clean":"2024-09-10T05:37:55.906346+0000","last_became_active":"2024-09-10T05:36:15.613949+0000","last_became_peered":"2024-09-10T05:36:15.613949+0000","last_unstale":"2024-09-10T05:37:55.906346+0000","last_undegraded":"2024-09-10T05:37:55.906346+0000","last_fullsized":"2024-09-10T05:37:55.906346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:33.167655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"34'39","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.709345+0000","last_change":"2024-09-10T05:36:17.637253+0000","last_active":"2024-09-10T05:39:58.709345+0000","last_peered":"2024-09-10T05:39:58.709345+0000","last_clean":"2024-09-10T05:39:58.709345+0000","last_became_active":"2024-09-10T05:36:17.636067+0000","last_became_peered":"2024-09-10T05:36:17.636067+0000","last_unstale":"2024-09-10T05:39:58.709345+0000","last_undegraded":"2024-09-10T05:39:58.709345+0000","last_fullsized":"2024-09-10T05:39:58.709345+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:27:48.471606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.856515+0000","last_change":"2024-09-10T05:36:19.665827+0000","last_active":"2024-09-10T05:37:53.856515+0000","last_peered":"2024-09-10T05:37:53.856515+0000","last_clean":"2024-09-10T05:37:53.856515+0000","last_became_active":"2024-09-10T05:36:19.665010+0000","last_became_peered":"2024-09-10T05:36:19.665010+0000","last_unstale":"2024-09-10T05:37:53.856515+0000","last_undegraded":"2024-09-10T05:37:53.856515+0000","last_fullsized":"2024-09-10T05:37:53.856515+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:47:10.890181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.899872+0000","last_change":"2024-09-10T05:36:21.665684+0000","last_active":"2024-09-10T05:37:55.899872+0000","last_peered":"2024-09-10T05:37:55.899872+0000","last_clean":"2024-09-10T05:37:55.899872+0000","last_became_active":"2024-09-10T05:36:21.664884+0000","last_became_peered":"2024-09-10T05:36:21.664884+0000","last_unstale":"2024-09-10T05:37:55.899872+0000","last_undegraded":"2024-09-10T05:37:55.899872+0000","last_fullsized":"2024-09-10T05:37:55.899872+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:21:16.296649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.726940+0000","last_change":"2024-09-10T05:36:13.616705+0000","last_active":"2024-09-10T05:37:53.726940+0000","last_peered":"2024-09-10T05:37:53.726940+0000","last_clean":"2024-09-10T05:37:53.726940+0000","last_became_active":"2024-09-10T05:36:13.616392+0000","last_became_peered":"2024-09-10T05:36:13.616392+0000","last_unstale":"2024-09-10T05:37:53.726940+0000","last_undegraded":"2024-09-10T05:37:53.726940+0000","last_fullsized":"2024-09-10T05:37:53.726940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:58:42.346686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.808522+0000","last_change":"2024-09-10T05:36:11.596038+0000","last_active":"2024-09-10T05:39:26.808522+0000","last_peered":"2024-09-10T05:39:26.808522+0000","last_clean":"2024-09-10T05:39:26.808522+0000","last_became_active":"2024-09-10T05:36:11.595319+0000","last_became_peered":"2024-09-10T05:36:11.595319+0000","last_unstale":"2024-09-10T05:39:26.808522+0000","last_undegraded":"2024-09-10T05:39:26.808522+0000","last_fullsized":"2024-09-10T05:39:26.808522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:55:19.990619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.902488+0000","last_change":"2024-09-10T05:36:15.618307+0000","last_active":"2024-09-10T05:37:55.902488+0000","last_peered":"2024-09-10T05:37:55.902488+0000","last_clean":"2024-09-10T05:37:55.902488+0000","last_became_active":"2024-09-10T05:36:15.617595+0000","last_became_peered":"2024-09-10T05:36:15.617595+0000","last_unstale":"2024-09-10T05:37:55.902488+0000","last_undegraded":"2024-09-10T05:37:55.902488+0000","last_fullsized":"2024-09-10T05:37:55.902488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:38.424958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1f","version":"34'41","reported_seq":99,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.551852+0000","last_change":"2024-09-10T05:36:17.635281+0000","last_active":"2024-09-10T05:39:58.551852+0000","last_peered":"2024-09-10T05:39:58.551852+0000","last_clean":"2024-09-10T05:39:58.551852+0000","last_became_active":"2024-09-10T05:36:17.634616+0000","last_became_peered":"2024-09-10T05:36:17.634616+0000","last_unstale":"2024-09-10T05:39:58.551852+0000","last_undegraded":"2024-09-10T05:39:58.551852+0000","last_fullsized":"2024-09-10T05:39:58.551852+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:14.597186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:22.686104+0000","last_change":"2024-09-10T05:36:19.665974+0000","last_active":"2024-09-10T05:38:22.686104+0000","last_peered":"2024-09-10T05:38:22.686104+0000","last_clean":"2024-09-10T05:38:22.686104+0000","last_became_active":"2024-09-10T05:36:19.665236+0000","last_became_peered":"2024-09-10T05:36:19.665236+0000","last_unstale":"2024-09-10T05:38:22.686104+0000","last_undegraded":"2024-09-10T05:38:22.686104+0000","last_fullsized":"2024-09-10T05:38:22.686104+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"34'5","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.906432+0000","last_change":"2024-09-10T05:36:21.695106+0000","last_active":"2024-09-10T05:39:26.906432+0000","last_peered":"2024-09-10T05:39:26.906432+0000","last_clean":"2024-09-10T05:39:26.906432+0000","last_became_active":"2024-09-10T05:36:21.694522+0000","last_became_peered":"2024-09-10T05:36:21.694522+0000","last_unstale":"2024-09-10T05:39:26.906432+0000","last_undegraded":"2024-09-10T05:39:26.906432+0000","last_fullsized":"2024-09-10T05:39:26.906432+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:40.765075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.295199+0000","last_change":"2024-09-10T05:36:13.611415+0000","last_active":"2024-09-10T05:39:27.295199+0000","last_peered":"2024-09-10T05:39:27.295199+0000","last_clean":"2024-09-10T05:39:27.295199+0000","last_became_active":"2024-09-10T05:36:13.610788+0000","last_became_peered":"2024-09-10T05:36:13.610788+0000","last_unstale":"2024-09-10T05:39:27.295199+0000","last_undegraded":"2024-09-10T05:39:27.295199+0000","last_fullsized":"2024-09-10T05:39:27.295199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:04.364523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"32'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:12.773984+0000","last_change":"2024-09-10T05:40:12.773984+0000","last_active":"2024-09-10T05:40:12.773984+0000","last_peered":"2024-09-10T05:40:12.773984+0000","last_clean":"2024-09-10T05:40:12.773984+0000","last_became_active":"2024-09-10T05:36:11.600655+0000","last_became_peered":"2024-09-10T05:36:11.600655+0000","last_unstale":"2024-09-10T05:40:12.773984+0000","last_undegraded":"2024-09-10T05:40:12.773984+0000","last_fullsized":"2024-09-10T05:40:12.773984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T05:40:12.773793+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T05:40:12.773793+0000","last_clean_scrub_stamp":"2024-09-10T05:40:12.773793+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:00:18.439768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.857028+0000","last_change":"2024-09-10T05:36:15.624306+0000","last_active":"2024-09-10T05:37:53.857028+0000","last_peered":"2024-09-10T05:37:53.857028+0000","last_clean":"2024-09-10T05:37:53.857028+0000","last_became_active":"2024-09-10T05:36:15.623436+0000","last_became_peered":"2024-09-10T05:36:15.623436+0000","last_unstale":"2024-09-10T05:37:53.857028+0000","last_undegraded":"2024-09-10T05:37:53.857028+0000","last_fullsized":"2024-09-10T05:37:53.857028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:35:42.347473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'16","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:18.681293+0000","last_change":"2024-09-10T05:36:17.639307+0000","last_active":"2024-09-10T05:38:18.681293+0000","last_peered":"2024-09-10T05:38:18.681293+0000","last_clean":"2024-09-10T05:38:18.681293+0000","last_became_active":"2024-09-10T05:36:17.638408+0000","last_became_peered":"2024-09-10T05:36:17.638408+0000","last_unstale":"2024-09-10T05:38:18.681293+0000","last_undegraded":"2024-09-10T05:38:18.681293+0000","last_fullsized":"2024-09-10T05:38:18.681293+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'285","reported_seq":426,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.360333+0000","last_change":"2024-09-10T05:36:19.651451+0000","last_active":"2024-09-10T05:39:58.360333+0000","last_peered":"2024-09-10T05:39:58.360333+0000","last_clean":"2024-09-10T05:39:58.360333+0000","last_became_active":"2024-09-10T05:36:19.649079+0000","last_became_peered":"2024-09-10T05:36:19.649079+0000","last_unstale":"2024-09-10T05:39:58.360333+0000","last_undegraded":"2024-09-10T05:39:58.360333+0000","last_fullsized":"2024-09-10T05:39:58.360333+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:13:31.933741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.899307+0000","last_change":"2024-09-10T05:36:21.665833+0000","last_active":"2024-09-10T05:37:55.899307+0000","last_peered":"2024-09-10T05:37:55.899307+0000","last_clean":"2024-09-10T05:37:55.899307+0000","last_became_active":"2024-09-10T05:36:21.665112+0000","last_became_peered":"2024-09-10T05:36:21.665112+0000","last_unstale":"2024-09-10T05:37:55.899307+0000","last_undegraded":"2024-09-10T05:37:55.899307+0000","last_fullsized":"2024-09-10T05:37:55.899307+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:16:25.547381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"32'8","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:22.502077+0000","last_change":"2024-09-10T05:40:22.502077+0000","last_active":"2024-09-10T05:40:22.502077+0000","last_peered":"2024-09-10T05:40:22.502077+0000","last_clean":"2024-09-10T05:40:22.502077+0000","last_became_active":"2024-09-10T05:36:13.614222+0000","last_became_peered":"2024-09-10T05:36:13.614222+0000","last_unstale":"2024-09-10T05:40:22.502077+0000","last_undegraded":"2024-09-10T05:40:22.502077+0000","last_fullsized":"2024-09-10T05:40:22.502077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T05:40:22.501876+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T05:40:22.501876+0000","last_clean_scrub_stamp":"2024-09-10T05:40:22.501876+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:38.894156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:12.065325+0000","last_change":"2024-09-10T05:40:12.065325+0000","last_active":"2024-09-10T05:40:12.065325+0000","last_peered":"2024-09-10T05:40:12.065325+0000","last_clean":"2024-09-10T05:40:12.065325+0000","last_became_active":"2024-09-10T05:36:11.592805+0000","last_became_peered":"2024-09-10T05:36:11.592805+0000","last_unstale":"2024-09-10T05:40:12.065325+0000","last_undegraded":"2024-09-10T05:40:12.065325+0000","last_fullsized":"2024-09-10T05:40:12.065325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:12.065148+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:12.065148+0000","last_clean_scrub_stamp":"2024-09-10T05:40:12.065148+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:52:44.626794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.857006+0000","last_change":"2024-09-10T05:36:15.620727+0000","last_active":"2024-09-10T05:37:53.857006+0000","last_peered":"2024-09-10T05:37:53.857006+0000","last_clean":"2024-09-10T05:37:53.857006+0000","last_became_active":"2024-09-10T05:36:15.620288+0000","last_became_peered":"2024-09-10T05:36:15.620288+0000","last_unstale":"2024-09-10T05:37:53.857006+0000","last_undegraded":"2024-09-10T05:37:53.857006+0000","last_fullsized":"2024-09-10T05:37:53.857006+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:02:23.187158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'63","reported_seq":141,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.620034+0000","last_change":"2024-09-10T05:36:17.651973+0000","last_active":"2024-09-10T05:39:58.620034+0000","last_peered":"2024-09-10T05:39:58.620034+0000","last_clean":"2024-09-10T05:39:58.620034+0000","last_became_active":"2024-09-10T05:36:17.651364+0000","last_became_peered":"2024-09-10T05:36:17.651364+0000","last_unstale":"2024-09-10T05:39:58.620034+0000","last_undegraded":"2024-09-10T05:39:58.620034+0000","last_fullsized":"2024-09-10T05:39:58.620034+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:42:52.172095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.721434+0000","last_change":"2024-09-10T05:36:19.659340+0000","last_active":"2024-09-10T05:37:53.721434+0000","last_peered":"2024-09-10T05:37:53.721434+0000","last_clean":"2024-09-10T05:37:53.721434+0000","last_became_active":"2024-09-10T05:36:19.658646+0000","last_became_peered":"2024-09-10T05:36:19.658646+0000","last_unstale":"2024-09-10T05:37:53.721434+0000","last_undegraded":"2024-09-10T05:37:53.721434+0000","last_fullsized":"2024-09-10T05:37:53.721434+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:22:35.133305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"34'4","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.471685+0000","last_change":"2024-09-10T05:36:21.689581+0000","last_active":"2024-09-10T05:39:27.471685+0000","last_peered":"2024-09-10T05:39:27.471685+0000","last_clean":"2024-09-10T05:39:27.471685+0000","last_became_active":"2024-09-10T05:36:21.688695+0000","last_became_peered":"2024-09-10T05:36:21.688695+0000","last_unstale":"2024-09-10T05:39:27.471685+0000","last_undegraded":"2024-09-10T05:39:27.471685+0000","last_fullsized":"2024-09-10T05:39:27.471685+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:53.585393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"34'4","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:21.802832+0000","last_change":"2024-09-10T05:36:13.616187+0000","last_active":"2024-09-10T05:38:21.802832+0000","last_peered":"2024-09-10T05:38:21.802832+0000","last_clean":"2024-09-10T05:38:21.802832+0000","last_became_active":"2024-09-10T05:36:13.615340+0000","last_became_peered":"2024-09-10T05:36:13.615340+0000","last_unstale":"2024-09-10T05:38:21.802832+0000","last_undegraded":"2024-09-10T05:38:21.802832+0000","last_fullsized":"2024-09-10T05:38:21.802832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:35:40.336140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"30'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:17.453722+0000","last_change":"2024-09-10T05:40:17.453722+0000","last_active":"2024-09-10T05:40:17.453722+0000","last_peered":"2024-09-10T05:40:17.453722+0000","last_clean":"2024-09-10T05:40:17.453722+0000","last_became_active":"2024-09-10T05:36:11.597360+0000","last_became_peered":"2024-09-10T05:36:11.597360+0000","last_unstale":"2024-09-10T05:40:17.453722+0000","last_undegraded":"2024-09-10T05:40:17.453722+0000","last_fullsized":"2024-09-10T05:40:17.453722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-10T05:40:17.453532+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-10T05:40:17.453532+0000","last_clean_scrub_stamp":"2024-09-10T05:40:17.453532+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:04:31.620004+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.902188+0000","last_change":"2024-09-10T05:36:15.620708+0000","last_active":"2024-09-10T05:37:55.902188+0000","last_peered":"2024-09-10T05:37:55.902188+0000","last_clean":"2024-09-10T05:37:55.902188+0000","last_became_active":"2024-09-10T05:36:15.619849+0000","last_became_peered":"2024-09-10T05:36:15.619849+0000","last_unstale":"2024-09-10T05:37:55.902188+0000","last_undegraded":"2024-09-10T05:37:55.902188+0000","last_fullsized":"2024-09-10T05:37:55.902188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:47:32.506655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"34'40","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.629318+0000","last_change":"2024-09-10T05:36:17.647578+0000","last_active":"2024-09-10T05:39:58.629318+0000","last_peered":"2024-09-10T05:39:58.629318+0000","last_clean":"2024-09-10T05:39:58.629318+0000","last_became_active":"2024-09-10T05:36:17.646780+0000","last_became_peered":"2024-09-10T05:36:17.646780+0000","last_unstale":"2024-09-10T05:39:58.629318+0000","last_undegraded":"2024-09-10T05:39:58.629318+0000","last_fullsized":"2024-09-10T05:39:58.629318+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:44.392590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.896432+0000","last_change":"2024-09-10T05:36:19.652878+0000","last_active":"2024-09-10T05:37:55.896432+0000","last_peered":"2024-09-10T05:37:55.896432+0000","last_clean":"2024-09-10T05:37:55.896432+0000","last_became_active":"2024-09-10T05:36:19.652114+0000","last_became_peered":"2024-09-10T05:36:19.652114+0000","last_unstale":"2024-09-10T05:37:55.896432+0000","last_undegraded":"2024-09-10T05:37:55.896432+0000","last_fullsized":"2024-09-10T05:37:55.896432+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:46:40.081106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.16","version":"34'2","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.271654+0000","last_change":"2024-09-10T05:36:21.693139+0000","last_active":"2024-09-10T05:39:27.271654+0000","last_peered":"2024-09-10T05:39:27.271654+0000","last_clean":"2024-09-10T05:39:27.271654+0000","last_became_active":"2024-09-10T05:36:21.692564+0000","last_became_peered":"2024-09-10T05:36:21.692564+0000","last_unstale":"2024-09-10T05:39:27.271654+0000","last_undegraded":"2024-09-10T05:39:27.271654+0000","last_fullsized":"2024-09-10T05:39:27.271654+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:51.507378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'6","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:26.195675+0000","last_change":"2024-09-10T05:36:13.600568+0000","last_active":"2024-09-10T05:38:26.195675+0000","last_peered":"2024-09-10T05:38:26.195675+0000","last_clean":"2024-09-10T05:38:26.195675+0000","last_became_active":"2024-09-10T05:36:13.600225+0000","last_became_peered":"2024-09-10T05:36:13.600225+0000","last_unstale":"2024-09-10T05:38:26.195675+0000","last_undegraded":"2024-09-10T05:38:26.195675+0000","last_fullsized":"2024-09-10T05:38:26.195675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:12:34.999826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:09.683197+0000","last_change":"2024-09-10T05:40:09.683066+0000","last_active":"2024-09-10T05:40:09.683197+0000","last_peered":"2024-09-10T05:40:09.683197+0000","last_clean":"2024-09-10T05:40:09.683197+0000","last_became_active":"2024-09-10T05:36:11.600598+0000","last_became_peered":"2024-09-10T05:36:11.600598+0000","last_unstale":"2024-09-10T05:40:09.683197+0000","last_undegraded":"2024-09-10T05:40:09.683197+0000","last_fullsized":"2024-09-10T05:40:09.683197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:09.682886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:09.682886+0000","last_clean_scrub_stamp":"2024-09-10T05:40:09.682886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:07.178758+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.853389+0000","last_change":"2024-09-10T05:36:15.635553+0000","last_active":"2024-09-10T05:37:53.853389+0000","last_peered":"2024-09-10T05:37:53.853389+0000","last_clean":"2024-09-10T05:37:53.853389+0000","last_became_active":"2024-09-10T05:36:15.634465+0000","last_became_peered":"2024-09-10T05:36:15.634465+0000","last_unstale":"2024-09-10T05:37:53.853389+0000","last_undegraded":"2024-09-10T05:37:53.853389+0000","last_fullsized":"2024-09-10T05:37:53.853389+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:18:38.683911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'36","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.537394+0000","last_change":"2024-09-10T05:36:17.635770+0000","last_active":"2024-09-10T05:39:58.537394+0000","last_peered":"2024-09-10T05:39:58.537394+0000","last_clean":"2024-09-10T05:39:58.537394+0000","last_became_active":"2024-09-10T05:36:17.634874+0000","last_became_peered":"2024-09-10T05:36:17.634874+0000","last_unstale":"2024-09-10T05:39:58.537394+0000","last_undegraded":"2024-09-10T05:39:58.537394+0000","last_fullsized":"2024-09-10T05:39:58.537394+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:54:06.818353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.898394+0000","last_change":"2024-09-10T05:36:19.638483+0000","last_active":"2024-09-10T05:37:55.898394+0000","last_peered":"2024-09-10T05:37:55.898394+0000","last_clean":"2024-09-10T05:37:55.898394+0000","last_became_active":"2024-09-10T05:36:19.637682+0000","last_became_peered":"2024-09-10T05:36:19.637682+0000","last_unstale":"2024-09-10T05:37:55.898394+0000","last_undegraded":"2024-09-10T05:37:55.898394+0000","last_fullsized":"2024-09-10T05:37:55.898394+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:35.498813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"34'4","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.056283+0000","last_change":"2024-09-10T05:36:21.688794+0000","last_active":"2024-09-10T05:38:24.056283+0000","last_peered":"2024-09-10T05:38:24.056283+0000","last_clean":"2024-09-10T05:38:24.056283+0000","last_became_active":"2024-09-10T05:36:21.688046+0000","last_became_peered":"2024-09-10T05:36:21.688046+0000","last_unstale":"2024-09-10T05:38:24.056283+0000","last_undegraded":"2024-09-10T05:38:24.056283+0000","last_fullsized":"2024-09-10T05:38:24.056283+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:06:36.753067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.200751+0000","last_change":"2024-09-10T05:36:13.612701+0000","last_active":"2024-09-10T05:39:27.200751+0000","last_peered":"2024-09-10T05:39:27.200751+0000","last_clean":"2024-09-10T05:39:27.200751+0000","last_became_active":"2024-09-10T05:36:13.611864+0000","last_became_peered":"2024-09-10T05:36:13.611864+0000","last_unstale":"2024-09-10T05:39:27.200751+0000","last_undegraded":"2024-09-10T05:39:27.200751+0000","last_fullsized":"2024-09-10T05:39:27.200751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:07:57.487596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"32'3","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:13.027528+0000","last_change":"2024-09-10T05:40:13.027402+0000","last_active":"2024-09-10T05:40:13.027528+0000","last_peered":"2024-09-10T05:40:13.027528+0000","last_clean":"2024-09-10T05:40:13.027528+0000","last_became_active":"2024-09-10T05:36:11.594949+0000","last_became_peered":"2024-09-10T05:36:11.594949+0000","last_unstale":"2024-09-10T05:40:13.027528+0000","last_undegraded":"2024-09-10T05:40:13.027528+0000","last_fullsized":"2024-09-10T05:40:13.027528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-10T05:40:13.027220+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-10T05:40:13.027220+0000","last_clean_scrub_stamp":"2024-09-10T05:40:13.027220+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:48:42.771696+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:22.306367+0000","last_change":"2024-09-10T05:36:15.619284+0000","last_active":"2024-09-10T05:38:22.306367+0000","last_peered":"2024-09-10T05:38:22.306367+0000","last_clean":"2024-09-10T05:38:22.306367+0000","last_became_active":"2024-09-10T05:36:15.618169+0000","last_became_peered":"2024-09-10T05:36:15.618169+0000","last_unstale":"2024-09-10T05:38:22.306367+0000","last_undegraded":"2024-09-10T05:38:22.306367+0000","last_fullsized":"2024-09-10T05:38:22.306367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:22:48.592489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'50","reported_seq":115,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.562381+0000","last_change":"2024-09-10T05:36:17.631950+0000","last_active":"2024-09-10T05:39:58.562381+0000","last_peered":"2024-09-10T05:39:58.562381+0000","last_clean":"2024-09-10T05:39:58.562381+0000","last_became_active":"2024-09-10T05:36:17.631194+0000","last_became_peered":"2024-09-10T05:36:17.631194+0000","last_unstale":"2024-09-10T05:39:58.562381+0000","last_undegraded":"2024-09-10T05:39:58.562381+0000","last_fullsized":"2024-09-10T05:39:58.562381+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:53:16.893462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":64,"num_read_kb":76,"num_write":36,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.713950+0000","last_change":"2024-09-10T05:36:19.637266+0000","last_active":"2024-09-10T05:37:53.713950+0000","last_peered":"2024-09-10T05:37:53.713950+0000","last_clean":"2024-09-10T05:37:53.713950+0000","last_became_active":"2024-09-10T05:36:19.636483+0000","last_became_peered":"2024-09-10T05:36:19.636483+0000","last_unstale":"2024-09-10T05:37:53.713950+0000","last_undegraded":"2024-09-10T05:37:53.713950+0000","last_fullsized":"2024-09-10T05:37:53.713950+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:56:30.945572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"34'8","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.060943+0000","last_change":"2024-09-10T05:36:21.689539+0000","last_active":"2024-09-10T05:38:24.060943+0000","last_peered":"2024-09-10T05:38:24.060943+0000","last_clean":"2024-09-10T05:38:24.060943+0000","last_became_active":"2024-09-10T05:36:21.688818+0000","last_became_peered":"2024-09-10T05:36:21.688818+0000","last_unstale":"2024-09-10T05:38:24.060943+0000","last_undegraded":"2024-09-10T05:38:24.060943+0000","last_fullsized":"2024-09-10T05:38:24.060943+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:50:15.537977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":19,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"34'8","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.381517+0000","last_change":"2024-09-10T05:36:13.618862+0000","last_active":"2024-09-10T05:39:27.381517+0000","last_peered":"2024-09-10T05:39:27.381517+0000","last_clean":"2024-09-10T05:39:27.381517+0000","last_became_active":"2024-09-10T05:36:13.618260+0000","last_became_peered":"2024-09-10T05:36:13.618260+0000","last_unstale":"2024-09-10T05:39:27.381517+0000","last_undegraded":"2024-09-10T05:39:27.381517+0000","last_fullsized":"2024-09-10T05:39:27.381517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:25:48.886027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:05.545029+0000","last_change":"2024-09-10T05:40:05.544869+0000","last_active":"2024-09-10T05:40:05.545029+0000","last_peered":"2024-09-10T05:40:05.545029+0000","last_clean":"2024-09-10T05:40:05.545029+0000","last_became_active":"2024-09-10T05:36:11.603738+0000","last_became_peered":"2024-09-10T05:36:11.603738+0000","last_unstale":"2024-09-10T05:40:05.545029+0000","last_undegraded":"2024-09-10T05:40:05.545029+0000","last_fullsized":"2024-09-10T05:40:05.545029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:05.544682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:05.544682+0000","last_clean_scrub_stamp":"2024-09-10T05:40:05.544682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:49:54.654103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'14","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.005687+0000","last_change":"2024-09-10T05:36:13.624965+0000","last_active":"2024-09-10T05:39:27.005687+0000","last_peered":"2024-09-10T05:39:27.005687+0000","last_clean":"2024-09-10T05:39:27.005687+0000","last_became_active":"2024-09-10T05:36:13.624460+0000","last_became_peered":"2024-09-10T05:36:13.624460+0000","last_unstale":"2024-09-10T05:39:27.005687+0000","last_undegraded":"2024-09-10T05:39:27.005687+0000","last_fullsized":"2024-09-10T05:39:27.005687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:05:54.096604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":58,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:07.495701+0000","last_change":"2024-09-10T05:40:07.495530+0000","last_active":"2024-09-10T05:40:07.495701+0000","last_peered":"2024-09-10T05:40:07.495701+0000","last_clean":"2024-09-10T05:40:07.495701+0000","last_became_active":"2024-09-10T05:36:11.601762+0000","last_became_peered":"2024-09-10T05:36:11.601762+0000","last_unstale":"2024-09-10T05:40:07.495701+0000","last_undegraded":"2024-09-10T05:40:07.495701+0000","last_fullsized":"2024-09-10T05:40:07.495701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:07.495353+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:07.495353+0000","last_clean_scrub_stamp":"2024-09-10T05:40:07.495353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:18:59.814823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"34'20","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.202070+0000","last_change":"2024-09-10T05:36:13.615511+0000","last_active":"2024-09-10T05:39:27.202070+0000","last_peered":"2024-09-10T05:39:27.202070+0000","last_clean":"2024-09-10T05:39:27.202070+0000","last_became_active":"2024-09-10T05:36:13.614221+0000","last_became_peered":"2024-09-10T05:36:13.614221+0000","last_unstale":"2024-09-10T05:39:27.202070+0000","last_undegraded":"2024-09-10T05:39:27.202070+0000","last_fullsized":"2024-09-10T05:39:27.202070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:22:46.581156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":66,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:10.730128+0000","last_change":"2024-09-10T05:40:10.730128+0000","last_active":"2024-09-10T05:40:10.730128+0000","last_peered":"2024-09-10T05:40:10.730128+0000","last_clean":"2024-09-10T05:40:10.730128+0000","last_became_active":"2024-09-10T05:36:11.601269+0000","last_became_peered":"2024-09-10T05:36:11.601269+0000","last_unstale":"2024-09-10T05:40:10.730128+0000","last_undegraded":"2024-09-10T05:40:10.730128+0000","last_fullsized":"2024-09-10T05:40:10.730128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:10.729946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:10.729946+0000","last_clean_scrub_stamp":"2024-09-10T05:40:10.729946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:23.818687+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'21","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.222435+0000","last_change":"2024-09-10T05:36:13.626184+0000","last_active":"2024-09-10T05:39:27.222435+0000","last_peered":"2024-09-10T05:39:27.222435+0000","last_clean":"2024-09-10T05:39:27.222435+0000","last_became_active":"2024-09-10T05:36:13.626022+0000","last_became_peered":"2024-09-10T05:36:13.626022+0000","last_unstale":"2024-09-10T05:39:27.222435+0000","last_undegraded":"2024-09-10T05:39:27.222435+0000","last_fullsized":"2024-09-10T05:39:27.222435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:53:45.495092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":48,"num_read_kb":40,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:08.499166+0000","last_change":"2024-09-10T05:40:08.498960+0000","last_active":"2024-09-10T05:40:08.499166+0000","last_peered":"2024-09-10T05:40:08.499166+0000","last_clean":"2024-09-10T05:40:08.499166+0000","last_became_active":"2024-09-10T05:36:11.610933+0000","last_became_peered":"2024-09-10T05:36:11.610933+0000","last_unstale":"2024-09-10T05:40:08.499166+0000","last_undegraded":"2024-09-10T05:40:08.499166+0000","last_fullsized":"2024-09-10T05:40:08.499166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:08.498772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:08.498772+0000","last_clean_scrub_stamp":"2024-09-10T05:40:08.498772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:52:48.692131+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"34'14","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.311516+0000","last_change":"2024-09-10T05:36:13.599973+0000","last_active":"2024-09-10T05:39:27.311516+0000","last_peered":"2024-09-10T05:39:27.311516+0000","last_clean":"2024-09-10T05:39:27.311516+0000","last_became_active":"2024-09-10T05:36:13.597975+0000","last_became_peered":"2024-09-10T05:36:13.597975+0000","last_unstale":"2024-09-10T05:39:27.311516+0000","last_undegraded":"2024-09-10T05:39:27.311516+0000","last_fullsized":"2024-09-10T05:39:27.311516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:04.875436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"34'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:13.779908+0000","last_change":"2024-09-10T05:40:13.779908+0000","last_active":"2024-09-10T05:40:13.779908+0000","last_peered":"2024-09-10T05:40:13.779908+0000","last_clean":"2024-09-10T05:40:13.779908+0000","last_became_active":"2024-09-10T05:36:11.603085+0000","last_became_peered":"2024-09-10T05:36:11.603085+0000","last_unstale":"2024-09-10T05:40:13.779908+0000","last_undegraded":"2024-09-10T05:40:13.779908+0000","last_fullsized":"2024-09-10T05:40:13.779908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:13.779687+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:13.779687+0000","last_clean_scrub_stamp":"2024-09-10T05:40:13.779687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:21:43.655717+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:17.685007+0000","last_change":"2024-09-10T05:36:13.611510+0000","last_active":"2024-09-10T05:38:17.685007+0000","last_peered":"2024-09-10T05:38:17.685007+0000","last_clean":"2024-09-10T05:38:17.685007+0000","last_became_active":"2024-09-10T05:36:13.610894+0000","last_became_peered":"2024-09-10T05:36:13.610894+0000","last_unstale":"2024-09-10T05:38:17.685007+0000","last_undegraded":"2024-09-10T05:38:17.685007+0000","last_fullsized":"2024-09-10T05:38:17.685007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:14.058953+0000","last_change":"2024-09-10T05:40:14.058953+0000","last_active":"2024-09-10T05:40:14.058953+0000","last_peered":"2024-09-10T05:40:14.058953+0000","last_clean":"2024-09-10T05:40:14.058953+0000","last_became_active":"2024-09-10T05:36:11.592809+0000","last_became_peered":"2024-09-10T05:36:11.592809+0000","last_unstale":"2024-09-10T05:40:14.058953+0000","last_undegraded":"2024-09-10T05:40:14.058953+0000","last_fullsized":"2024-09-10T05:40:14.058953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:14.058768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:14.058768+0000","last_clean_scrub_stamp":"2024-09-10T05:40:14.058768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:44.630239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:26.178147+0000","last_change":"2024-09-10T05:36:13.607562+0000","last_active":"2024-09-10T05:38:26.178147+0000","last_peered":"2024-09-10T05:38:26.178147+0000","last_clean":"2024-09-10T05:38:26.178147+0000","last_became_active":"2024-09-10T05:36:13.607052+0000","last_became_peered":"2024-09-10T05:36:13.607052+0000","last_unstale":"2024-09-10T05:38:26.178147+0000","last_undegraded":"2024-09-10T05:38:26.178147+0000","last_fullsized":"2024-09-10T05:38:26.178147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:33:32.480741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"32'2","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:09.533645+0000","last_change":"2024-09-10T05:40:09.533645+0000","last_active":"2024-09-10T05:40:09.533645+0000","last_peered":"2024-09-10T05:40:09.533645+0000","last_clean":"2024-09-10T05:40:09.533645+0000","last_became_active":"2024-09-10T05:36:11.593614+0000","last_became_peered":"2024-09-10T05:36:11.593614+0000","last_unstale":"2024-09-10T05:40:09.533645+0000","last_undegraded":"2024-09-10T05:40:09.533645+0000","last_fullsized":"2024-09-10T05:40:09.533645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T05:40:09.533454+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T05:40:09.533454+0000","last_clean_scrub_stamp":"2024-09-10T05:40:09.533454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:03:38.053067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.383143+0000","last_change":"2024-09-10T05:36:13.595278+0000","last_active":"2024-09-10T05:39:27.383143+0000","last_peered":"2024-09-10T05:39:27.383143+0000","last_clean":"2024-09-10T05:39:27.383143+0000","last_became_active":"2024-09-10T05:36:13.593693+0000","last_became_peered":"2024-09-10T05:36:13.593693+0000","last_unstale":"2024-09-10T05:39:27.383143+0000","last_undegraded":"2024-09-10T05:39:27.383143+0000","last_fullsized":"2024-09-10T05:39:27.383143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"34'8","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:14.767528+0000","last_change":"2024-09-10T05:40:14.767528+0000","last_active":"2024-09-10T05:40:14.767528+0000","last_peered":"2024-09-10T05:40:14.767528+0000","last_clean":"2024-09-10T05:40:14.767528+0000","last_became_active":"2024-09-10T05:36:11.604011+0000","last_became_peered":"2024-09-10T05:36:11.604011+0000","last_unstale":"2024-09-10T05:40:14.767528+0000","last_undegraded":"2024-09-10T05:40:14.767528+0000","last_fullsized":"2024-09-10T05:40:14.767528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-10T05:40:14.767349+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-10T05:40:14.767349+0000","last_clean_scrub_stamp":"2024-09-10T05:40:14.767349+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:21:09.642300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":24,"num_write_kb":12289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"34'16","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:26.194535+0000","last_change":"2024-09-10T05:36:13.630165+0000","last_active":"2024-09-10T05:38:26.194535+0000","last_peered":"2024-09-10T05:38:26.194535+0000","last_clean":"2024-09-10T05:38:26.194535+0000","last_became_active":"2024-09-10T05:36:13.629760+0000","last_became_peered":"2024-09-10T05:36:13.629760+0000","last_unstale":"2024-09-10T05:38:26.194535+0000","last_undegraded":"2024-09-10T05:38:26.194535+0000","last_fullsized":"2024-09-10T05:38:26.194535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:59:45.392768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":66,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:15.759115+0000","last_change":"2024-09-10T05:40:15.759115+0000","last_active":"2024-09-10T05:40:15.759115+0000","last_peered":"2024-09-10T05:40:15.759115+0000","last_clean":"2024-09-10T05:40:15.759115+0000","last_became_active":"2024-09-10T05:36:11.597158+0000","last_became_peered":"2024-09-10T05:36:11.597158+0000","last_unstale":"2024-09-10T05:40:15.759115+0000","last_undegraded":"2024-09-10T05:40:15.759115+0000","last_fullsized":"2024-09-10T05:40:15.759115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:15.758931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:15.758931+0000","last_clean_scrub_stamp":"2024-09-10T05:40:15.758931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:16.124076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.006147+0000","last_change":"2024-09-10T05:36:13.613919+0000","last_active":"2024-09-10T05:39:27.006147+0000","last_peered":"2024-09-10T05:39:27.006147+0000","last_clean":"2024-09-10T05:39:27.006147+0000","last_became_active":"2024-09-10T05:36:13.613206+0000","last_became_peered":"2024-09-10T05:36:13.613206+0000","last_unstale":"2024-09-10T05:39:27.006147+0000","last_undegraded":"2024-09-10T05:39:27.006147+0000","last_fullsized":"2024-09-10T05:39:27.006147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:20:09.645015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'2","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:16.993374+0000","last_change":"2024-09-10T05:40:16.993374+0000","last_active":"2024-09-10T05:40:16.993374+0000","last_peered":"2024-09-10T05:40:16.993374+0000","last_clean":"2024-09-10T05:40:16.993374+0000","last_became_active":"2024-09-10T05:36:52.705212+0000","last_became_peered":"2024-09-10T05:36:52.705212+0000","last_unstale":"2024-09-10T05:40:16.993374+0000","last_undegraded":"2024-09-10T05:40:16.993374+0000","last_fullsized":"2024-09-10T05:40:16.993374+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T05:40:16.993183+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T05:40:16.993183+0000","last_clean_scrub_stamp":"2024-09-10T05:40:16.993183+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:47:37.839890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.005396+0000","last_change":"2024-09-10T05:36:13.627667+0000","last_active":"2024-09-10T05:39:27.005396+0000","last_peered":"2024-09-10T05:39:27.005396+0000","last_clean":"2024-09-10T05:39:27.005396+0000","last_became_active":"2024-09-10T05:36:13.626912+0000","last_became_peered":"2024-09-10T05:36:13.626912+0000","last_unstale":"2024-09-10T05:39:27.005396+0000","last_undegraded":"2024-09-10T05:39:27.005396+0000","last_fullsized":"2024-09-10T05:39:27.005396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:36.054213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.896918+0000","last_change":"2024-09-10T05:36:11.607179+0000","last_active":"2024-09-10T05:37:55.896918+0000","last_peered":"2024-09-10T05:37:55.896918+0000","last_clean":"2024-09-10T05:37:55.896918+0000","last_became_active":"2024-09-10T05:36:11.606369+0000","last_became_peered":"2024-09-10T05:36:11.606369+0000","last_unstale":"2024-09-10T05:37:55.896918+0000","last_undegraded":"2024-09-10T05:37:55.896918+0000","last_fullsized":"2024-09-10T05:37:55.896918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:14:23.688323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"32'8","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.858816+0000","last_change":"2024-09-10T05:36:13.608226+0000","last_active":"2024-09-10T05:37:53.858816+0000","last_peered":"2024-09-10T05:37:53.858816+0000","last_clean":"2024-09-10T05:37:53.858816+0000","last_became_active":"2024-09-10T05:36:13.607807+0000","last_became_peered":"2024-09-10T05:36:13.607807+0000","last_unstale":"2024-09-10T05:37:53.858816+0000","last_undegraded":"2024-09-10T05:37:53.858816+0000","last_fullsized":"2024-09-10T05:37:53.858816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:30:41.672233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:21.057801+0000","last_change":"2024-09-10T05:40:21.057801+0000","last_active":"2024-09-10T05:40:21.057801+0000","last_peered":"2024-09-10T05:40:21.057801+0000","last_clean":"2024-09-10T05:40:21.057801+0000","last_became_active":"2024-09-10T05:36:11.593962+0000","last_became_peered":"2024-09-10T05:36:11.593962+0000","last_unstale":"2024-09-10T05:40:21.057801+0000","last_undegraded":"2024-09-10T05:40:21.057801+0000","last_fullsized":"2024-09-10T05:40:21.057801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:21.057604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:21.057604+0000","last_clean_scrub_stamp":"2024-09-10T05:40:21.057604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:31:16.451869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.902466+0000","last_change":"2024-09-10T05:36:13.615141+0000","last_active":"2024-09-10T05:37:55.902466+0000","last_peered":"2024-09-10T05:37:55.902466+0000","last_clean":"2024-09-10T05:37:55.902466+0000","last_became_active":"2024-09-10T05:36:13.614155+0000","last_became_peered":"2024-09-10T05:36:13.614155+0000","last_unstale":"2024-09-10T05:37:55.902466+0000","last_undegraded":"2024-09-10T05:37:55.902466+0000","last_fullsized":"2024-09-10T05:37:55.902466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:39:44.309572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:17.752385+0000","last_change":"2024-09-10T05:40:17.752385+0000","last_active":"2024-09-10T05:40:17.752385+0000","last_peered":"2024-09-10T05:40:17.752385+0000","last_clean":"2024-09-10T05:40:17.752385+0000","last_became_active":"2024-09-10T05:36:11.602866+0000","last_became_peered":"2024-09-10T05:36:11.602866+0000","last_unstale":"2024-09-10T05:40:17.752385+0000","last_undegraded":"2024-09-10T05:40:17.752385+0000","last_fullsized":"2024-09-10T05:40:17.752385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:17.752209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:17.752209+0000","last_clean_scrub_stamp":"2024-09-10T05:40:17.752209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:37:42.386692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'15","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.381320+0000","last_change":"2024-09-10T05:36:13.613437+0000","last_active":"2024-09-10T05:39:27.381320+0000","last_peered":"2024-09-10T05:39:27.381320+0000","last_clean":"2024-09-10T05:39:27.381320+0000","last_became_active":"2024-09-10T05:36:13.611391+0000","last_became_peered":"2024-09-10T05:36:13.611391+0000","last_unstale":"2024-09-10T05:39:27.381320+0000","last_undegraded":"2024-09-10T05:39:27.381320+0000","last_fullsized":"2024-09-10T05:39:27.381320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:28:23.276697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:16.032739+0000","last_change":"2024-09-10T05:40:16.032739+0000","last_active":"2024-09-10T05:40:16.032739+0000","last_peered":"2024-09-10T05:40:16.032739+0000","last_clean":"2024-09-10T05:40:16.032739+0000","last_became_active":"2024-09-10T05:36:52.706226+0000","last_became_peered":"2024-09-10T05:36:52.706226+0000","last_unstale":"2024-09-10T05:40:16.032739+0000","last_undegraded":"2024-09-10T05:40:16.032739+0000","last_fullsized":"2024-09-10T05:40:16.032739+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:16.032561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:16.032561+0000","last_clean_scrub_stamp":"2024-09-10T05:40:16.032561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:29.267082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"34'10","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.200918+0000","last_change":"2024-09-10T05:36:13.616625+0000","last_active":"2024-09-10T05:39:27.200918+0000","last_peered":"2024-09-10T05:39:27.200918+0000","last_clean":"2024-09-10T05:39:27.200918+0000","last_became_active":"2024-09-10T05:36:13.616136+0000","last_became_peered":"2024-09-10T05:36:13.616136+0000","last_unstale":"2024-09-10T05:39:27.200918+0000","last_undegraded":"2024-09-10T05:39:27.200918+0000","last_fullsized":"2024-09-10T05:39:27.200918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:40:37.044525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"32'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:11.568074+0000","last_change":"2024-09-10T05:40:11.568074+0000","last_active":"2024-09-10T05:40:11.568074+0000","last_peered":"2024-09-10T05:40:11.568074+0000","last_clean":"2024-09-10T05:40:11.568074+0000","last_became_active":"2024-09-10T05:36:11.600234+0000","last_became_peered":"2024-09-10T05:36:11.600234+0000","last_unstale":"2024-09-10T05:40:11.568074+0000","last_undegraded":"2024-09-10T05:40:11.568074+0000","last_fullsized":"2024-09-10T05:40:11.568074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T05:40:11.567892+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T05:40:11.567892+0000","last_clean_scrub_stamp":"2024-09-10T05:40:11.567892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:09:54.451468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"30'2","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.899857+0000","last_change":"2024-09-10T05:36:13.615416+0000","last_active":"2024-09-10T05:37:55.899857+0000","last_peered":"2024-09-10T05:37:55.899857+0000","last_clean":"2024-09-10T05:37:55.899857+0000","last_became_active":"2024-09-10T05:36:13.614098+0000","last_became_peered":"2024-09-10T05:36:13.614098+0000","last_unstale":"2024-09-10T05:37:55.899857+0000","last_undegraded":"2024-09-10T05:37:55.899857+0000","last_fullsized":"2024-09-10T05:37:55.899857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:56:24.907751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"30'2","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:16.732918+0000","last_change":"2024-09-10T05:40:16.732918+0000","last_active":"2024-09-10T05:40:16.732918+0000","last_peered":"2024-09-10T05:40:16.732918+0000","last_clean":"2024-09-10T05:40:16.732918+0000","last_became_active":"2024-09-10T05:36:11.603972+0000","last_became_peered":"2024-09-10T05:36:11.603972+0000","last_unstale":"2024-09-10T05:40:16.732918+0000","last_undegraded":"2024-09-10T05:40:16.732918+0000","last_fullsized":"2024-09-10T05:40:16.732918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-10T05:40:16.732725+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-10T05:40:16.732725+0000","last_clean_scrub_stamp":"2024-09-10T05:40:16.732725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:45:48.371841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.897044+0000","last_change":"2024-09-10T05:36:11.597226+0000","last_active":"2024-09-10T05:37:55.897044+0000","last_peered":"2024-09-10T05:37:55.897044+0000","last_clean":"2024-09-10T05:37:55.897044+0000","last_became_active":"2024-09-10T05:36:11.595183+0000","last_became_peered":"2024-09-10T05:36:11.595183+0000","last_unstale":"2024-09-10T05:37:55.897044+0000","last_undegraded":"2024-09-10T05:37:55.897044+0000","last_fullsized":"2024-09-10T05:37:55.897044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:10.942918+0000","last_clean_scrub_stamp":"2024-09-10T05:36:10.942918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:40:04.618907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"34'8","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.296974+0000","last_change":"2024-09-10T05:36:13.623166+0000","last_active":"2024-09-10T05:39:27.296974+0000","last_peered":"2024-09-10T05:39:27.296974+0000","last_clean":"2024-09-10T05:39:27.296974+0000","last_became_active":"2024-09-10T05:36:13.622559+0000","last_became_peered":"2024-09-10T05:36:13.622559+0000","last_unstale":"2024-09-10T05:39:27.296974+0000","last_undegraded":"2024-09-10T05:39:27.296974+0000","last_fullsized":"2024-09-10T05:39:27.296974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:42:51.927427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:15.048760+0000","last_change":"2024-09-10T05:40:15.048760+0000","last_active":"2024-09-10T05:40:15.048760+0000","last_peered":"2024-09-10T05:40:15.048760+0000","last_clean":"2024-09-10T05:40:15.048760+0000","last_became_active":"2024-09-10T05:36:11.588124+0000","last_became_peered":"2024-09-10T05:36:11.588124+0000","last_unstale":"2024-09-10T05:40:15.048760+0000","last_undegraded":"2024-09-10T05:40:15.048760+0000","last_fullsized":"2024-09-10T05:40:15.048760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:15.048548+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:15.048548+0000","last_clean_scrub_stamp":"2024-09-10T05:40:15.048548+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:29:26.086020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"34'20","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.383693+0000","last_change":"2024-09-10T05:36:13.618023+0000","last_active":"2024-09-10T05:39:27.383693+0000","last_peered":"2024-09-10T05:39:27.383693+0000","last_clean":"2024-09-10T05:39:27.383693+0000","last_became_active":"2024-09-10T05:36:13.614959+0000","last_became_peered":"2024-09-10T05:36:13.614959+0000","last_unstale":"2024-09-10T05:39:27.383693+0000","last_undegraded":"2024-09-10T05:39:27.383693+0000","last_fullsized":"2024-09-10T05:39:27.383693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:12.572282+0000","last_clean_scrub_stamp":"2024-09-10T05:36:12.572282+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:10:02.645509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":56,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":692,"num_read_kb":660,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1888,"num_read_kb":1653,"num_write":789,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1569,"ondisk_log_size":1569,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1683,"num_read_kb":1573,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":476,"ondisk_log_size":476,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":639872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640311,"num_pgs":142,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39936,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331904,"statfs":{"total":96636764160,"available":96595869696,"internally_reserved":0,"allocated":442368,"data_stored":149023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673017,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40476,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331364,"statfs":{"total":96636764160,"available":96595316736,"internally_reserved":0,"allocated":995328,"data_stored":736555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673018,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40536,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331304,"statfs":{"total":96636764160,"available":96595255296,"internally_reserved":0,"allocated":1056768,"data_stored":738594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949673017,"num_pgs":143,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":487424,"data_stored":149680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":2712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":1788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T05:40:24.073 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.073 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.074 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.074 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.074 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.074 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.074 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.074 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.074 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.074 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.075 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.075 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.075 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.075 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.075 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.075 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.075 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.075 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.075 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.076 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.076 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.076 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.076 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.076 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.076 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.076 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.076 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.077 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.077 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.077 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.077 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.077 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.077 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.077 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.077 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.077 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.077 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.078 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.078 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.078 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.078 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.078 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.078 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.078 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.078 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.079 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.079 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.079 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.079 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.079 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.079 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.079 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.079 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.079 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.080 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.080 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.080 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.080 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.080 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.080 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.080 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.080 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.080 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.081 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.081 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.081 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.081 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.081 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.081 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.081 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.081 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.082 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.082 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.082 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.082 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.082 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.082 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.084 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.084 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.084 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.084 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.084 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.084 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.084 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.084 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.085 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.085 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.085 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.085 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.085 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.085 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.085 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.085 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.086 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.086 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.086 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.086 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.086 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.086 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.086 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.086 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.086 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.087 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.087 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.087 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.087 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.087 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.087 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.087 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.087 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.088 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.088 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.088 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.088 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.088 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.088 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.088 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.088 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.089 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.089 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.089 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.089 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.089 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.089 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.089 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.089 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.089 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.090 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.090 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.090 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.090 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.090 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.090 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.090 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.090 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.091 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.091 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.091 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.091 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.091 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.091 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.091 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.091 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.091 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.092 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.092 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.092 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.092 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.092 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.092 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.092 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.092 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.093 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.093 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.093 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.093 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.093 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.093 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.093 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.093 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.093 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.094 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.094 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.094 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.094 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.094 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.094 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.094 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.094 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.094 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.095 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.095 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.095 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.095 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.095 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.095 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.095 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.095 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.096 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.096 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.096 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.096 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.096 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.096 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.096 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.097 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.097 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-10T05:36:10.942918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.097 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.097 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-10T05:36:12.572282+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:24.097 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-10T05:40:44.098 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T05:40:44.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.224+0000 7f1b6b304640 1 Processor -- start 2024-09-10T05:40:44.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.224+0000 7f1b6b304640 1 -- start start 2024-09-10T05:40:44.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.228+0000 7f1b6b304640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1b64110da0 0x7f1b64111180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:40:44.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.228+0000 7f1b6b304640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b64073a90 con 0x7f1b641116c0 2024-09-10T05:40:44.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.228+0000 7f1b6b304640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f1b640696e0 con 0x7f1b64110da0 2024-09-10T05:40:44.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.228+0000 7f1b690a0640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1b64110da0 0x7f1b64111180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:40:44.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.228+0000 7f1b6889f640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f1b641116c0 0x7f1b641231e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:56516/0 (socket says 172.21.15.2:56516) 2024-09-10T05:40:44.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.228+0000 7f1b6889f640 1 -- 172.21.15.2:0/3626874886 learned_addr learned my addr 172.21.15.2:0/3626874886 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T05:40:44.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.228+0000 7f1b690a0640 1 -- 172.21.15.2:0/3626874886 >> v1:172.21.15.2:6789/0 conn(0x7f1b641116c0 legacy=0x7f1b641231e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:40:44.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.228+0000 7f1b690a0640 1 -- 172.21.15.2:0/3626874886 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b6406dd50 con 0x7f1b64110da0 2024-09-10T05:40:44.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.228+0000 7f1b690a0640 1 --2- 172.21.15.2:0/3626874886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b64110da0 0x7f1b64111180 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f1b58009740 tx=0x7f1b5801c200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91693aaf617525ee server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:40:44.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.228+0000 7f1b63fff640 1 -- 172.21.15.2:0/3626874886 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b580b0070 con 0x7f1b64110da0 2024-09-10T05:40:44.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.228+0000 7f1b63fff640 1 -- 172.21.15.2:0/3626874886 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b580ab530 con 0x7f1b64110da0 2024-09-10T05:40:44.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.228+0000 7f1b63fff640 1 -- 172.21.15.2:0/3626874886 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b580ab830 con 0x7f1b64110da0 2024-09-10T05:40:44.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.232+0000 7f1b6b304640 1 -- 172.21.15.2:0/3626874886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b64110da0 msgr2=0x7f1b64111180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:40:44.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.232+0000 7f1b6b304640 1 --2- 172.21.15.2:0/3626874886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b64110da0 0x7f1b64111180 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f1b58009740 tx=0x7f1b5801c200 comp rx=0 tx=0).stop 2024-09-10T05:40:44.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.232+0000 7f1b6b304640 1 -- 172.21.15.2:0/3626874886 shutdown_connections 2024-09-10T05:40:44.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.232+0000 7f1b6b304640 1 --2- 172.21.15.2:0/3626874886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b64110da0 0x7f1b64111180 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:40:44.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.232+0000 7f1b6b304640 1 -- 172.21.15.2:0/3626874886 >> 172.21.15.2:0/3626874886 conn(0x7f1b64070900 msgr2=0x7f1b64072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:40:44.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.232+0000 7f1b6b304640 1 -- 172.21.15.2:0/3626874886 shutdown_connections 2024-09-10T05:40:44.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.232+0000 7f1b6b304640 1 -- 172.21.15.2:0/3626874886 wait complete. 2024-09-10T05:40:44.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.232+0000 7f1b6b304640 1 Processor -- start 2024-09-10T05:40:44.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.232+0000 7f1b6b304640 1 -- start start 2024-09-10T05:40:44.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.232+0000 7f1b6b304640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b64110da0 0x7f1b64130770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:40:44.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.232+0000 7f1b6b304640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1b64135470 con 0x7f1b64110da0 2024-09-10T05:40:44.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.232+0000 7f1b690a0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b64110da0 0x7f1b64130770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:40:44.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.232+0000 7f1b690a0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b64110da0 0x7f1b64130770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39008/0 (socket says 172.21.15.2:39008) 2024-09-10T05:40:44.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.232+0000 7f1b690a0640 1 -- 172.21.15.2:0/1663619334 learned_addr learned my addr 172.21.15.2:0/1663619334 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:40:44.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.232+0000 7f1b690a0640 1 -- 172.21.15.2:0/1663619334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b64131d10 con 0x7f1b64110da0 2024-09-10T05:40:44.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.232+0000 7f1b690a0640 1 --2- 172.21.15.2:0/1663619334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b64110da0 0x7f1b64130770 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f1b580ae040 tx=0x7f1b58018fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:40:44.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.232+0000 7f1b61ffb640 1 -- 172.21.15.2:0/1663619334 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b580b8020 con 0x7f1b64110da0 2024-09-10T05:40:44.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.232+0000 7f1b61ffb640 1 -- 172.21.15.2:0/1663619334 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b580b4600 con 0x7f1b64110da0 2024-09-10T05:40:44.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.232+0000 7f1b61ffb640 1 -- 172.21.15.2:0/1663619334 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b580b0040 con 0x7f1b64110da0 2024-09-10T05:40:44.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.232+0000 7f1b6b304640 1 -- 172.21.15.2:0/1663619334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b641155f0 con 0x7f1b64110da0 2024-09-10T05:40:44.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.232+0000 7f1b6b304640 1 -- 172.21.15.2:0/1663619334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b64130cb0 con 0x7f1b64110da0 2024-09-10T05:40:44.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.232+0000 7f1b6b304640 1 -- 172.21.15.2:0/1663619334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b64111180 con 0x7f1b64110da0 2024-09-10T05:40:44.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.232+0000 7f1b61ffb640 1 -- 172.21.15.2:0/1663619334 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1b580bb020 con 0x7f1b64110da0 2024-09-10T05:40:44.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.232+0000 7f1b61ffb640 1 --2- 172.21.15.2:0/1663619334 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1b5003b1d0 0x7f1b5003d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:40:44.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.232+0000 7f1b61ffb640 1 -- 172.21.15.2:0/1663619334 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7f1b580e9590 con 0x7f1b64110da0 2024-09-10T05:40:44.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.236+0000 7f1b6889f640 1 --2- 172.21.15.2:0/1663619334 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1b5003b1d0 0x7f1b5003d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:40:44.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.236+0000 7f1b6889f640 1 --2- 172.21.15.2:0/1663619334 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1b5003b1d0 0x7f1b5003d690 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f1b54001ea0 tx=0x7f1b54007db0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:40:44.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.240+0000 7f1b61ffb640 1 -- 172.21.15.2:0/1663619334 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f1b580c2030 con 0x7f1b64110da0 2024-09-10T05:40:44.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.408+0000 7f1b6b304640 1 -- 172.21.15.2:0/1663619334 --> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1b641120e0 con 0x7f1b5003b1d0 2024-09-10T05:40:44.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.436+0000 7f1b61ffb640 1 -- 172.21.15.2:0/1663619334 <== mgr.4101 v2:172.21.15.62:6824/3663628807 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+664218 (secure 0 0 0) 0x7f1b54001f90 con 0x7f1b5003b1d0 2024-09-10T05:40:44.447 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T05:40:44.453 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-10T05:40:44.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.444+0000 7f1b6b304640 1 -- 172.21.15.2:0/1663619334 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1b5003b1d0 msgr2=0x7f1b5003d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:40:44.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.444+0000 7f1b6b304640 1 --2- 172.21.15.2:0/1663619334 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1b5003b1d0 0x7f1b5003d690 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f1b54001ea0 tx=0x7f1b54007db0 comp rx=0 tx=0).stop 2024-09-10T05:40:44.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.444+0000 7f1b6b304640 1 -- 172.21.15.2:0/1663619334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b64110da0 msgr2=0x7f1b64130770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:40:44.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.444+0000 7f1b6b304640 1 --2- 172.21.15.2:0/1663619334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b64110da0 0x7f1b64130770 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f1b580ae040 tx=0x7f1b58018fa0 comp rx=0 tx=0).stop 2024-09-10T05:40:44.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.444+0000 7f1b6b304640 1 -- 172.21.15.2:0/1663619334 shutdown_connections 2024-09-10T05:40:44.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.444+0000 7f1b6b304640 1 --2- 172.21.15.2:0/1663619334 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f1b5003b1d0 0x7f1b5003d690 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:40:44.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.444+0000 7f1b6b304640 1 --2- 172.21.15.2:0/1663619334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b64110da0 0x7f1b64130770 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:40:44.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.444+0000 7f1b6b304640 1 -- 172.21.15.2:0/1663619334 >> 172.21.15.2:0/1663619334 conn(0x7f1b64070900 msgr2=0x7f1b64129830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:40:44.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.444+0000 7f1b6b304640 1 -- 172.21.15.2:0/1663619334 shutdown_connections 2024-09-10T05:40:44.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:40:44.444+0000 7f1b6b304640 1 -- 172.21.15.2:0/1663619334 wait complete. 2024-09-10T05:40:44.471 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":174,"stamp":"2024-09-10T05:40:43.719437+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":254,"num_object_clones":0,"num_object_copies":508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":254,"num_whiteouts":0,"num_read":5438,"num_read_kb":4996,"num_write":2315,"num_write_kb":60588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":639982,"num_keys_recovered":1,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4810,"ondisk_log_size":4810,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152608,"kb_used_data":2912,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334752,"statfs":{"total":386547056640,"available":386390786048,"internally_reserved":0,"allocated":2981888,"data_stored":1773852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005669"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:26.410446+0000","last_change":"2024-09-10T05:40:26.410446+0000","last_active":"2024-09-10T05:40:26.410446+0000","last_peered":"2024-09-10T05:40:26.410446+0000","last_clean":"2024-09-10T05:40:26.410446+0000","last_became_active":"2024-09-10T05:36:11.605721+0000","last_became_peered":"2024-09-10T05:36:11.605721+0000","last_unstale":"2024-09-10T05:40:26.410446+0000","last_undegraded":"2024-09-10T05:40:26.410446+0000","last_fullsized":"2024-09-10T05:40:26.410446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:26.410267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:26.410267+0000","last_clean_scrub_stamp":"2024-09-10T05:40:26.410267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:28:48.605725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"30'2","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:37.485493+0000","last_change":"2024-09-10T05:40:37.485493+0000","last_active":"2024-09-10T05:40:37.485493+0000","last_peered":"2024-09-10T05:40:37.485493+0000","last_clean":"2024-09-10T05:40:37.485493+0000","last_became_active":"2024-09-10T05:36:13.628174+0000","last_became_peered":"2024-09-10T05:36:13.628174+0000","last_unstale":"2024-09-10T05:40:37.485493+0000","last_undegraded":"2024-09-10T05:40:37.485493+0000","last_fullsized":"2024-09-10T05:40:37.485493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-10T05:40:37.485299+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-10T05:40:37.485299+0000","last_clean_scrub_stamp":"2024-09-10T05:40:37.485299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:00:09.382323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"30'2","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:18.009113+0000","last_change":"2024-09-10T05:40:18.008954+0000","last_active":"2024-09-10T05:40:18.009113+0000","last_peered":"2024-09-10T05:40:18.009113+0000","last_clean":"2024-09-10T05:40:18.009113+0000","last_became_active":"2024-09-10T05:36:11.596100+0000","last_became_peered":"2024-09-10T05:36:11.596100+0000","last_unstale":"2024-09-10T05:40:18.009113+0000","last_undegraded":"2024-09-10T05:40:18.009113+0000","last_fullsized":"2024-09-10T05:40:18.009113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-10T05:40:18.008765+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-10T05:40:18.008765+0000","last_clean_scrub_stamp":"2024-09-10T05:40:18.008765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:04:13.763296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"34'6","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:36.862530+0000","last_change":"2024-09-10T05:40:36.862530+0000","last_active":"2024-09-10T05:40:36.862530+0000","last_peered":"2024-09-10T05:40:36.862530+0000","last_clean":"2024-09-10T05:40:36.862530+0000","last_became_active":"2024-09-10T05:36:13.598320+0000","last_became_peered":"2024-09-10T05:36:13.598320+0000","last_unstale":"2024-09-10T05:40:36.862530+0000","last_undegraded":"2024-09-10T05:40:36.862530+0000","last_fullsized":"2024-09-10T05:40:36.862530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T05:40:36.862311+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T05:40:36.862311+0000","last_clean_scrub_stamp":"2024-09-10T05:40:36.862311+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:10:19.778937+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:19.837151+0000","last_change":"2024-09-10T05:40:19.837024+0000","last_active":"2024-09-10T05:40:19.837151+0000","last_peered":"2024-09-10T05:40:19.837151+0000","last_clean":"2024-09-10T05:40:19.837151+0000","last_became_active":"2024-09-10T05:36:11.603193+0000","last_became_peered":"2024-09-10T05:36:11.603193+0000","last_unstale":"2024-09-10T05:40:19.837151+0000","last_undegraded":"2024-09-10T05:40:19.837151+0000","last_fullsized":"2024-09-10T05:40:19.837151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:19.836770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:19.836770+0000","last_clean_scrub_stamp":"2024-09-10T05:40:19.836770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:58:57.386751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'10","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:38.821797+0000","last_change":"2024-09-10T05:40:38.821797+0000","last_active":"2024-09-10T05:40:38.821797+0000","last_peered":"2024-09-10T05:40:38.821797+0000","last_clean":"2024-09-10T05:40:38.821797+0000","last_became_active":"2024-09-10T05:36:13.604094+0000","last_became_peered":"2024-09-10T05:36:13.604094+0000","last_unstale":"2024-09-10T05:40:38.821797+0000","last_undegraded":"2024-09-10T05:40:38.821797+0000","last_fullsized":"2024-09-10T05:40:38.821797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-10T05:40:38.821572+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-10T05:40:38.821572+0000","last_clean_scrub_stamp":"2024-09-10T05:40:38.821572+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:17:38.193128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:12.538733+0000","last_change":"2024-09-10T05:40:12.538576+0000","last_active":"2024-09-10T05:40:12.538733+0000","last_peered":"2024-09-10T05:40:12.538733+0000","last_clean":"2024-09-10T05:40:12.538733+0000","last_became_active":"2024-09-10T05:36:11.611399+0000","last_became_peered":"2024-09-10T05:36:11.611399+0000","last_unstale":"2024-09-10T05:40:12.538733+0000","last_undegraded":"2024-09-10T05:40:12.538733+0000","last_fullsized":"2024-09-10T05:40:12.538733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:12.538392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:12.538392+0000","last_clean_scrub_stamp":"2024-09-10T05:40:12.538392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:51:29.630049+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'10","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:28.558502+0000","last_change":"2024-09-10T05:40:28.558502+0000","last_active":"2024-09-10T05:40:28.558502+0000","last_peered":"2024-09-10T05:40:28.558502+0000","last_clean":"2024-09-10T05:40:28.558502+0000","last_became_active":"2024-09-10T05:36:52.702713+0000","last_became_peered":"2024-09-10T05:36:52.702713+0000","last_unstale":"2024-09-10T05:40:28.558502+0000","last_undegraded":"2024-09-10T05:40:28.558502+0000","last_fullsized":"2024-09-10T05:40:28.558502+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-10T05:40:28.558256+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-10T05:40:28.558256+0000","last_clean_scrub_stamp":"2024-09-10T05:40:28.558256+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:36:01.615339+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:22.425237+0000","last_change":"2024-09-10T05:40:22.425237+0000","last_active":"2024-09-10T05:40:22.425237+0000","last_peered":"2024-09-10T05:40:22.425237+0000","last_clean":"2024-09-10T05:40:22.425237+0000","last_became_active":"2024-09-10T05:36:11.597514+0000","last_became_peered":"2024-09-10T05:36:11.597514+0000","last_unstale":"2024-09-10T05:40:22.425237+0000","last_undegraded":"2024-09-10T05:40:22.425237+0000","last_fullsized":"2024-09-10T05:40:22.425237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:22.425061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:22.425061+0000","last_clean_scrub_stamp":"2024-09-10T05:40:22.425061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:18:48.780922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"34'12","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:36.250669+0000","last_change":"2024-09-10T05:40:36.250669+0000","last_active":"2024-09-10T05:40:36.250669+0000","last_peered":"2024-09-10T05:40:36.250669+0000","last_clean":"2024-09-10T05:40:36.250669+0000","last_became_active":"2024-09-10T05:36:13.621573+0000","last_became_peered":"2024-09-10T05:36:13.621573+0000","last_unstale":"2024-09-10T05:40:36.250669+0000","last_undegraded":"2024-09-10T05:40:36.250669+0000","last_fullsized":"2024-09-10T05:40:36.250669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-10T05:40:36.250487+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-10T05:40:36.250487+0000","last_clean_scrub_stamp":"2024-09-10T05:40:36.250487+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:44:20.265219+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:30.390534+0000","last_change":"2024-09-10T05:40:30.390534+0000","last_active":"2024-09-10T05:40:30.390534+0000","last_peered":"2024-09-10T05:40:30.390534+0000","last_clean":"2024-09-10T05:40:30.390534+0000","last_became_active":"2024-09-10T05:36:52.704285+0000","last_became_peered":"2024-09-10T05:36:52.704285+0000","last_unstale":"2024-09-10T05:40:30.390534+0000","last_undegraded":"2024-09-10T05:40:30.390534+0000","last_fullsized":"2024-09-10T05:40:30.390534+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:30.390348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:30.390348+0000","last_clean_scrub_stamp":"2024-09-10T05:40:30.390348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:21:07.016828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:41.484929+0000","last_change":"2024-09-10T05:40:41.484929+0000","last_active":"2024-09-10T05:40:41.484929+0000","last_peered":"2024-09-10T05:40:41.484929+0000","last_clean":"2024-09-10T05:40:41.484929+0000","last_became_active":"2024-09-10T05:36:13.612127+0000","last_became_peered":"2024-09-10T05:36:13.612127+0000","last_unstale":"2024-09-10T05:40:41.484929+0000","last_undegraded":"2024-09-10T05:40:41.484929+0000","last_fullsized":"2024-09-10T05:40:41.484929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:41.484740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:41.484740+0000","last_clean_scrub_stamp":"2024-09-10T05:40:41.484740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:17:33.369812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:18.795525+0000","last_change":"2024-09-10T05:40:18.795525+0000","last_active":"2024-09-10T05:40:18.795525+0000","last_peered":"2024-09-10T05:40:18.795525+0000","last_clean":"2024-09-10T05:40:18.795525+0000","last_became_active":"2024-09-10T05:36:11.598054+0000","last_became_peered":"2024-09-10T05:36:11.598054+0000","last_unstale":"2024-09-10T05:40:18.795525+0000","last_undegraded":"2024-09-10T05:40:18.795525+0000","last_fullsized":"2024-09-10T05:40:18.795525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:18.795346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:18.795346+0000","last_clean_scrub_stamp":"2024-09-10T05:40:18.795346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:40:32.792167+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'8","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:39.470635+0000","last_change":"2024-09-10T05:40:39.470635+0000","last_active":"2024-09-10T05:40:39.470635+0000","last_peered":"2024-09-10T05:40:39.470635+0000","last_clean":"2024-09-10T05:40:39.470635+0000","last_became_active":"2024-09-10T05:36:13.612743+0000","last_became_peered":"2024-09-10T05:36:13.612743+0000","last_unstale":"2024-09-10T05:40:39.470635+0000","last_undegraded":"2024-09-10T05:40:39.470635+0000","last_fullsized":"2024-09-10T05:40:39.470635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T05:40:39.470439+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T05:40:39.470439+0000","last_clean_scrub_stamp":"2024-09-10T05:40:39.470439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:04.935597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:20.856875+0000","last_change":"2024-09-10T05:40:20.856875+0000","last_active":"2024-09-10T05:40:20.856875+0000","last_peered":"2024-09-10T05:40:20.856875+0000","last_clean":"2024-09-10T05:40:20.856875+0000","last_became_active":"2024-09-10T05:36:11.593454+0000","last_became_peered":"2024-09-10T05:36:11.593454+0000","last_unstale":"2024-09-10T05:40:20.856875+0000","last_undegraded":"2024-09-10T05:40:20.856875+0000","last_fullsized":"2024-09-10T05:40:20.856875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:20.856670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:20.856670+0000","last_clean_scrub_stamp":"2024-09-10T05:40:20.856670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:07:34.824817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"34'10","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:29.569735+0000","last_change":"2024-09-10T05:40:29.569735+0000","last_active":"2024-09-10T05:40:29.569735+0000","last_peered":"2024-09-10T05:40:29.569735+0000","last_clean":"2024-09-10T05:40:29.569735+0000","last_became_active":"2024-09-10T05:36:13.621362+0000","last_became_peered":"2024-09-10T05:36:13.621362+0000","last_unstale":"2024-09-10T05:40:29.569735+0000","last_undegraded":"2024-09-10T05:40:29.569735+0000","last_fullsized":"2024-09-10T05:40:29.569735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-10T05:40:29.569463+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-10T05:40:29.569463+0000","last_clean_scrub_stamp":"2024-09-10T05:40:29.569463+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:43.066506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:35.454824+0000","last_change":"2024-09-10T05:40:35.454824+0000","last_active":"2024-09-10T05:40:35.454824+0000","last_peered":"2024-09-10T05:40:35.454824+0000","last_clean":"2024-09-10T05:40:35.454824+0000","last_became_active":"2024-09-10T05:36:13.628203+0000","last_became_peered":"2024-09-10T05:36:13.628203+0000","last_unstale":"2024-09-10T05:40:35.454824+0000","last_undegraded":"2024-09-10T05:40:35.454824+0000","last_fullsized":"2024-09-10T05:40:35.454824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:35.454640+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:35.454640+0000","last_clean_scrub_stamp":"2024-09-10T05:40:35.454640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:03:22.203757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"30'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:19.050830+0000","last_change":"2024-09-10T05:40:19.050830+0000","last_active":"2024-09-10T05:40:19.050830+0000","last_peered":"2024-09-10T05:40:19.050830+0000","last_clean":"2024-09-10T05:40:19.050830+0000","last_became_active":"2024-09-10T05:36:11.594409+0000","last_became_peered":"2024-09-10T05:36:11.594409+0000","last_unstale":"2024-09-10T05:40:19.050830+0000","last_undegraded":"2024-09-10T05:40:19.050830+0000","last_fullsized":"2024-09-10T05:40:19.050830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-10T05:40:19.050639+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-10T05:40:19.050639+0000","last_clean_scrub_stamp":"2024-09-10T05:40:19.050639+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:00:35.050660+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'8","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:36.503001+0000","last_change":"2024-09-10T05:40:36.503001+0000","last_active":"2024-09-10T05:40:36.503001+0000","last_peered":"2024-09-10T05:40:36.503001+0000","last_clean":"2024-09-10T05:40:36.503001+0000","last_became_active":"2024-09-10T05:36:13.619905+0000","last_became_peered":"2024-09-10T05:36:13.619905+0000","last_unstale":"2024-09-10T05:40:36.503001+0000","last_undegraded":"2024-09-10T05:40:36.503001+0000","last_fullsized":"2024-09-10T05:40:36.503001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-10T05:40:36.502829+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-10T05:40:36.502829+0000","last_clean_scrub_stamp":"2024-09-10T05:40:36.502829+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:50:18.078007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:13.522641+0000","last_change":"2024-09-10T05:40:13.522641+0000","last_active":"2024-09-10T05:40:13.522641+0000","last_peered":"2024-09-10T05:40:13.522641+0000","last_clean":"2024-09-10T05:40:13.522641+0000","last_became_active":"2024-09-10T05:36:11.611735+0000","last_became_peered":"2024-09-10T05:36:11.611735+0000","last_unstale":"2024-09-10T05:40:13.522641+0000","last_undegraded":"2024-09-10T05:40:13.522641+0000","last_fullsized":"2024-09-10T05:40:13.522641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:13.522433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:13.522433+0000","last_clean_scrub_stamp":"2024-09-10T05:40:13.522433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:18:33.845607+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'18","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:40.447249+0000","last_change":"2024-09-10T05:40:40.447249+0000","last_active":"2024-09-10T05:40:40.447249+0000","last_peered":"2024-09-10T05:40:40.447249+0000","last_clean":"2024-09-10T05:40:40.447249+0000","last_became_active":"2024-09-10T05:36:13.624358+0000","last_became_peered":"2024-09-10T05:36:13.624358+0000","last_unstale":"2024-09-10T05:40:40.447249+0000","last_undegraded":"2024-09-10T05:40:40.447249+0000","last_fullsized":"2024-09-10T05:40:40.447249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'18","last_scrub_stamp":"2024-09-10T05:40:40.447075+0000","last_deep_scrub":"34'18","last_deep_scrub_stamp":"2024-09-10T05:40:40.447075+0000","last_clean_scrub_stamp":"2024-09-10T05:40:40.447075+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:55:33.861501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":77,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"34'4","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:18.464461+0000","last_change":"2024-09-10T05:40:18.464461+0000","last_active":"2024-09-10T05:40:18.464461+0000","last_peered":"2024-09-10T05:40:18.464461+0000","last_clean":"2024-09-10T05:40:18.464461+0000","last_became_active":"2024-09-10T05:36:11.608244+0000","last_became_peered":"2024-09-10T05:36:11.608244+0000","last_unstale":"2024-09-10T05:40:18.464461+0000","last_undegraded":"2024-09-10T05:40:18.464461+0000","last_fullsized":"2024-09-10T05:40:18.464461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:18.464272+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:18.464272+0000","last_clean_scrub_stamp":"2024-09-10T05:40:18.464272+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:52:02.384371+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"32'24","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:24.517664+0000","last_change":"2024-09-10T05:40:24.517664+0000","last_active":"2024-09-10T05:40:24.517664+0000","last_peered":"2024-09-10T05:40:24.517664+0000","last_clean":"2024-09-10T05:40:24.517664+0000","last_became_active":"2024-09-10T05:36:13.613298+0000","last_became_peered":"2024-09-10T05:36:13.613298+0000","last_unstale":"2024-09-10T05:40:24.517664+0000","last_undegraded":"2024-09-10T05:40:24.517664+0000","last_fullsized":"2024-09-10T05:40:24.517664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'24","last_scrub_stamp":"2024-09-10T05:40:24.517467+0000","last_deep_scrub":"32'24","last_deep_scrub_stamp":"2024-09-10T05:40:24.517467+0000","last_clean_scrub_stamp":"2024-09-10T05:40:24.517467+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:57.476190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":77,"num_write":32,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"32'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:20.433725+0000","last_change":"2024-09-10T05:40:20.433725+0000","last_active":"2024-09-10T05:40:20.433725+0000","last_peered":"2024-09-10T05:40:20.433725+0000","last_clean":"2024-09-10T05:40:20.433725+0000","last_became_active":"2024-09-10T05:36:11.600159+0000","last_became_peered":"2024-09-10T05:36:11.600159+0000","last_unstale":"2024-09-10T05:40:20.433725+0000","last_undegraded":"2024-09-10T05:40:20.433725+0000","last_fullsized":"2024-09-10T05:40:20.433725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T05:40:20.433528+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T05:40:20.433528+0000","last_clean_scrub_stamp":"2024-09-10T05:40:20.433528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:07:04.481328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"34'12","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:25.520043+0000","last_change":"2024-09-10T05:40:25.520043+0000","last_active":"2024-09-10T05:40:25.520043+0000","last_peered":"2024-09-10T05:40:25.520043+0000","last_clean":"2024-09-10T05:40:25.520043+0000","last_became_active":"2024-09-10T05:36:13.605913+0000","last_became_peered":"2024-09-10T05:36:13.605913+0000","last_unstale":"2024-09-10T05:40:25.520043+0000","last_undegraded":"2024-09-10T05:40:25.520043+0000","last_fullsized":"2024-09-10T05:40:25.520043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-10T05:40:25.519838+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-10T05:40:25.519838+0000","last_clean_scrub_stamp":"2024-09-10T05:40:25.519838+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:25:15.570219+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:10.535482+0000","last_change":"2024-09-10T05:40:10.535482+0000","last_active":"2024-09-10T05:40:10.535482+0000","last_peered":"2024-09-10T05:40:10.535482+0000","last_clean":"2024-09-10T05:40:10.535482+0000","last_became_active":"2024-09-10T05:36:52.701277+0000","last_became_peered":"2024-09-10T05:36:52.701277+0000","last_unstale":"2024-09-10T05:40:10.535482+0000","last_undegraded":"2024-09-10T05:40:10.535482+0000","last_fullsized":"2024-09-10T05:40:10.535482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:10.535301+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:10.535301+0000","last_clean_scrub_stamp":"2024-09-10T05:40:10.535301+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:04:14.281405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":1250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":639872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:34.183121+0000","last_change":"2024-09-10T05:40:34.183121+0000","last_active":"2024-09-10T05:40:34.183121+0000","last_peered":"2024-09-10T05:40:34.183121+0000","last_clean":"2024-09-10T05:40:34.183121+0000","last_became_active":"2024-09-10T05:36:13.599955+0000","last_became_peered":"2024-09-10T05:36:13.599955+0000","last_unstale":"2024-09-10T05:40:34.183121+0000","last_undegraded":"2024-09-10T05:40:34.183121+0000","last_fullsized":"2024-09-10T05:40:34.183121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:34.182915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:34.182915+0000","last_clean_scrub_stamp":"2024-09-10T05:40:34.182915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:14:10.458122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"34'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:25.836463+0000","last_change":"2024-09-10T05:40:25.836463+0000","last_active":"2024-09-10T05:40:25.836463+0000","last_peered":"2024-09-10T05:40:25.836463+0000","last_clean":"2024-09-10T05:40:25.836463+0000","last_became_active":"2024-09-10T05:36:11.603982+0000","last_became_peered":"2024-09-10T05:36:11.603982+0000","last_unstale":"2024-09-10T05:40:25.836463+0000","last_undegraded":"2024-09-10T05:40:25.836463+0000","last_fullsized":"2024-09-10T05:40:25.836463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:25.836286+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:25.836286+0000","last_clean_scrub_stamp":"2024-09-10T05:40:25.836286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:57:32.240826+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'35","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.250994+0000","last_change":"2024-09-10T05:36:21.673756+0000","last_active":"2024-09-10T05:39:27.250994+0000","last_peered":"2024-09-10T05:39:27.250994+0000","last_clean":"2024-09-10T05:39:27.250994+0000","last_became_active":"2024-09-10T05:36:21.672975+0000","last_became_peered":"2024-09-10T05:36:21.672975+0000","last_unstale":"2024-09-10T05:39:27.250994+0000","last_undegraded":"2024-09-10T05:39:27.250994+0000","last_fullsized":"2024-09-10T05:39:27.250994+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:09:28.929715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'10","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:24.858068+0000","last_change":"2024-09-10T05:40:24.858068+0000","last_active":"2024-09-10T05:40:24.858068+0000","last_peered":"2024-09-10T05:40:24.858068+0000","last_clean":"2024-09-10T05:40:24.858068+0000","last_became_active":"2024-09-10T05:36:13.616006+0000","last_became_peered":"2024-09-10T05:36:13.616006+0000","last_unstale":"2024-09-10T05:40:24.858068+0000","last_undegraded":"2024-09-10T05:40:24.858068+0000","last_fullsized":"2024-09-10T05:40:24.858068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-10T05:40:24.857896+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-10T05:40:24.857896+0000","last_clean_scrub_stamp":"2024-09-10T05:40:24.857896+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:05:44.490607+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:11.764472+0000","last_change":"2024-09-10T05:40:11.764472+0000","last_active":"2024-09-10T05:40:11.764472+0000","last_peered":"2024-09-10T05:40:11.764472+0000","last_clean":"2024-09-10T05:40:11.764472+0000","last_became_active":"2024-09-10T05:36:11.601101+0000","last_became_peered":"2024-09-10T05:36:11.601101+0000","last_unstale":"2024-09-10T05:40:11.764472+0000","last_undegraded":"2024-09-10T05:40:11.764472+0000","last_fullsized":"2024-09-10T05:40:11.764472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:11.764291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:11.764291+0000","last_clean_scrub_stamp":"2024-09-10T05:40:11.764291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:10:57.529948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.727535+0000","last_change":"2024-09-10T05:36:15.626686+0000","last_active":"2024-09-10T05:37:53.727535+0000","last_peered":"2024-09-10T05:37:53.727535+0000","last_clean":"2024-09-10T05:37:53.727535+0000","last_became_active":"2024-09-10T05:36:15.626172+0000","last_became_peered":"2024-09-10T05:36:15.626172+0000","last_unstale":"2024-09-10T05:37:53.727535+0000","last_undegraded":"2024-09-10T05:37:53.727535+0000","last_fullsized":"2024-09-10T05:37:53.727535+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:39:20.579324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'45","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.479585+0000","last_change":"2024-09-10T05:36:17.640065+0000","last_active":"2024-09-10T05:39:58.479585+0000","last_peered":"2024-09-10T05:39:58.479585+0000","last_clean":"2024-09-10T05:39:58.479585+0000","last_became_active":"2024-09-10T05:36:17.639318+0000","last_became_peered":"2024-09-10T05:36:17.639318+0000","last_unstale":"2024-09-10T05:39:58.479585+0000","last_undegraded":"2024-09-10T05:39:58.479585+0000","last_fullsized":"2024-09-10T05:39:58.479585+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:05:59.617319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.898449+0000","last_change":"2024-09-10T05:36:19.648793+0000","last_active":"2024-09-10T05:37:55.898449+0000","last_peered":"2024-09-10T05:37:55.898449+0000","last_clean":"2024-09-10T05:37:55.898449+0000","last_became_active":"2024-09-10T05:36:19.647998+0000","last_became_peered":"2024-09-10T05:36:19.647998+0000","last_unstale":"2024-09-10T05:37:55.898449+0000","last_undegraded":"2024-09-10T05:37:55.898449+0000","last_fullsized":"2024-09-10T05:37:55.898449+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:14:38.933277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"32'9","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.899552+0000","last_change":"2024-09-10T05:36:21.673262+0000","last_active":"2024-09-10T05:37:55.899552+0000","last_peered":"2024-09-10T05:37:55.899552+0000","last_clean":"2024-09-10T05:37:55.899552+0000","last_became_active":"2024-09-10T05:36:21.672757+0000","last_became_peered":"2024-09-10T05:36:21.672757+0000","last_unstale":"2024-09-10T05:37:55.899552+0000","last_undegraded":"2024-09-10T05:37:55.899552+0000","last_fullsized":"2024-09-10T05:37:55.899552+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:49:20.130241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"32'6","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:30.812041+0000","last_change":"2024-09-10T05:40:30.812041+0000","last_active":"2024-09-10T05:40:30.812041+0000","last_peered":"2024-09-10T05:40:30.812041+0000","last_clean":"2024-09-10T05:40:30.812041+0000","last_became_active":"2024-09-10T05:36:13.597649+0000","last_became_peered":"2024-09-10T05:36:13.597649+0000","last_unstale":"2024-09-10T05:40:30.812041+0000","last_undegraded":"2024-09-10T05:40:30.812041+0000","last_fullsized":"2024-09-10T05:40:30.812041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-10T05:40:30.811823+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-10T05:40:30.811823+0000","last_clean_scrub_stamp":"2024-09-10T05:40:30.811823+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:34:06.593714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:03.520977+0000","last_change":"2024-09-10T05:40:03.520977+0000","last_active":"2024-09-10T05:40:03.520977+0000","last_peered":"2024-09-10T05:40:03.520977+0000","last_clean":"2024-09-10T05:40:03.520977+0000","last_became_active":"2024-09-10T05:36:11.611326+0000","last_became_peered":"2024-09-10T05:36:11.611326+0000","last_unstale":"2024-09-10T05:40:03.520977+0000","last_undegraded":"2024-09-10T05:40:03.520977+0000","last_fullsized":"2024-09-10T05:40:03.520977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:03.520795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:03.520795+0000","last_clean_scrub_stamp":"2024-09-10T05:40:03.520795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:12:23.788294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.725805+0000","last_change":"2024-09-10T05:36:15.608668+0000","last_active":"2024-09-10T05:37:53.725805+0000","last_peered":"2024-09-10T05:37:53.725805+0000","last_clean":"2024-09-10T05:37:53.725805+0000","last_became_active":"2024-09-10T05:36:15.607918+0000","last_became_peered":"2024-09-10T05:36:15.607918+0000","last_unstale":"2024-09-10T05:37:53.725805+0000","last_undegraded":"2024-09-10T05:37:53.725805+0000","last_fullsized":"2024-09-10T05:37:53.725805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:57.614009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"30'12","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.859373+0000","last_change":"2024-09-10T05:36:17.644680+0000","last_active":"2024-09-10T05:37:53.859373+0000","last_peered":"2024-09-10T05:37:53.859373+0000","last_clean":"2024-09-10T05:37:53.859373+0000","last_became_active":"2024-09-10T05:36:17.643856+0000","last_became_peered":"2024-09-10T05:36:17.643856+0000","last_unstale":"2024-09-10T05:37:53.859373+0000","last_undegraded":"2024-09-10T05:37:53.859373+0000","last_fullsized":"2024-09-10T05:37:53.859373+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:31:24.591766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.899864+0000","last_change":"2024-09-10T05:36:19.648357+0000","last_active":"2024-09-10T05:37:55.899864+0000","last_peered":"2024-09-10T05:37:55.899864+0000","last_clean":"2024-09-10T05:37:55.899864+0000","last_became_active":"2024-09-10T05:36:19.647612+0000","last_became_peered":"2024-09-10T05:36:19.647612+0000","last_unstale":"2024-09-10T05:37:55.899864+0000","last_undegraded":"2024-09-10T05:37:55.899864+0000","last_fullsized":"2024-09-10T05:37:55.899864+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:06:01.493680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"34'10","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.344196+0000","last_change":"2024-09-10T05:36:21.679828+0000","last_active":"2024-09-10T05:39:26.344196+0000","last_peered":"2024-09-10T05:39:26.344196+0000","last_clean":"2024-09-10T05:39:26.344196+0000","last_became_active":"2024-09-10T05:36:21.679052+0000","last_became_peered":"2024-09-10T05:36:21.679052+0000","last_unstale":"2024-09-10T05:39:26.344196+0000","last_undegraded":"2024-09-10T05:39:26.344196+0000","last_fullsized":"2024-09-10T05:39:26.344196+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:53.565670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:27.819874+0000","last_change":"2024-09-10T05:40:27.819874+0000","last_active":"2024-09-10T05:40:27.819874+0000","last_peered":"2024-09-10T05:40:27.819874+0000","last_clean":"2024-09-10T05:40:27.819874+0000","last_became_active":"2024-09-10T05:36:13.611935+0000","last_became_peered":"2024-09-10T05:36:13.611935+0000","last_unstale":"2024-09-10T05:40:27.819874+0000","last_undegraded":"2024-09-10T05:40:27.819874+0000","last_fullsized":"2024-09-10T05:40:27.819874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:27.819678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:27.819678+0000","last_clean_scrub_stamp":"2024-09-10T05:40:27.819678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:58:08.522577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:13.353164+0000","last_change":"2024-09-10T05:40:13.353164+0000","last_active":"2024-09-10T05:40:13.353164+0000","last_peered":"2024-09-10T05:40:13.353164+0000","last_clean":"2024-09-10T05:40:13.353164+0000","last_became_active":"2024-09-10T05:36:11.596047+0000","last_became_peered":"2024-09-10T05:36:11.596047+0000","last_unstale":"2024-09-10T05:40:13.353164+0000","last_undegraded":"2024-09-10T05:40:13.353164+0000","last_fullsized":"2024-09-10T05:40:13.353164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:13.352981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:13.352981+0000","last_clean_scrub_stamp":"2024-09-10T05:40:13.352981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:20.013639+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.729520+0000","last_change":"2024-09-10T05:36:15.636316+0000","last_active":"2024-09-10T05:37:53.729520+0000","last_peered":"2024-09-10T05:37:53.729520+0000","last_clean":"2024-09-10T05:37:53.729520+0000","last_became_active":"2024-09-10T05:36:15.635534+0000","last_became_peered":"2024-09-10T05:36:15.635534+0000","last_unstale":"2024-09-10T05:37:53.729520+0000","last_undegraded":"2024-09-10T05:37:53.729520+0000","last_fullsized":"2024-09-10T05:37:53.729520+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:51:10.736802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"34'30","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:38.546544+0000","last_change":"2024-09-10T05:40:38.546544+0000","last_active":"2024-09-10T05:40:38.546544+0000","last_peered":"2024-09-10T05:40:38.546544+0000","last_clean":"2024-09-10T05:40:38.546544+0000","last_became_active":"2024-09-10T05:36:17.626936+0000","last_became_peered":"2024-09-10T05:36:17.626936+0000","last_unstale":"2024-09-10T05:40:38.546544+0000","last_undegraded":"2024-09-10T05:40:38.546544+0000","last_fullsized":"2024-09-10T05:40:38.546544+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'30","last_scrub_stamp":"2024-09-10T05:40:38.546347+0000","last_deep_scrub":"34'30","last_deep_scrub_stamp":"2024-09-10T05:40:38.546347+0000","last_clean_scrub_stamp":"2024-09-10T05:40:38.546347+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:58.791838+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'285","reported_seq":394,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.363782+0000","last_change":"2024-09-10T05:36:19.665303+0000","last_active":"2024-09-10T05:39:58.363782+0000","last_peered":"2024-09-10T05:39:58.363782+0000","last_clean":"2024-09-10T05:39:58.363782+0000","last_became_active":"2024-09-10T05:36:19.664741+0000","last_became_peered":"2024-09-10T05:36:19.664741+0000","last_unstale":"2024-09-10T05:39:58.363782+0000","last_undegraded":"2024-09-10T05:39:58.363782+0000","last_fullsized":"2024-09-10T05:39:58.363782+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:34:14.254885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"34'2","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:21.797711+0000","last_change":"2024-09-10T05:36:21.657298+0000","last_active":"2024-09-10T05:38:21.797711+0000","last_peered":"2024-09-10T05:38:21.797711+0000","last_clean":"2024-09-10T05:38:21.797711+0000","last_became_active":"2024-09-10T05:36:21.656522+0000","last_became_peered":"2024-09-10T05:36:21.656522+0000","last_unstale":"2024-09-10T05:38:21.797711+0000","last_undegraded":"2024-09-10T05:38:21.797711+0000","last_fullsized":"2024-09-10T05:38:21.797711+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:46:36.764173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'8","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:29.796565+0000","last_change":"2024-09-10T05:40:29.796565+0000","last_active":"2024-09-10T05:40:29.796565+0000","last_peered":"2024-09-10T05:40:29.796565+0000","last_clean":"2024-09-10T05:40:29.796565+0000","last_became_active":"2024-09-10T05:36:13.622771+0000","last_became_peered":"2024-09-10T05:36:13.622771+0000","last_unstale":"2024-09-10T05:40:29.796565+0000","last_undegraded":"2024-09-10T05:40:29.796565+0000","last_fullsized":"2024-09-10T05:40:29.796565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-10T05:40:29.796340+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-10T05:40:29.796340+0000","last_clean_scrub_stamp":"2024-09-10T05:40:29.796340+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:33:51.581411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"32'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:09.364492+0000","last_change":"2024-09-10T05:40:09.364492+0000","last_active":"2024-09-10T05:40:09.364492+0000","last_peered":"2024-09-10T05:40:09.364492+0000","last_clean":"2024-09-10T05:40:09.364492+0000","last_became_active":"2024-09-10T05:36:11.596165+0000","last_became_peered":"2024-09-10T05:36:11.596165+0000","last_unstale":"2024-09-10T05:40:09.364492+0000","last_undegraded":"2024-09-10T05:40:09.364492+0000","last_fullsized":"2024-09-10T05:40:09.364492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T05:40:09.364301+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T05:40:09.364301+0000","last_clean_scrub_stamp":"2024-09-10T05:40:09.364301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:02:21.771318+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.905564+0000","last_change":"2024-09-10T05:36:15.616568+0000","last_active":"2024-09-10T05:37:55.905564+0000","last_peered":"2024-09-10T05:37:55.905564+0000","last_clean":"2024-09-10T05:37:55.905564+0000","last_became_active":"2024-09-10T05:36:15.615994+0000","last_became_peered":"2024-09-10T05:36:15.615994+0000","last_unstale":"2024-09-10T05:37:55.905564+0000","last_undegraded":"2024-09-10T05:37:55.905564+0000","last_fullsized":"2024-09-10T05:37:55.905564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:15:00.093895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"34'39","reported_seq":96,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.739092+0000","last_change":"2024-09-10T05:36:17.631891+0000","last_active":"2024-09-10T05:39:58.739092+0000","last_peered":"2024-09-10T05:39:58.739092+0000","last_clean":"2024-09-10T05:39:58.739092+0000","last_became_active":"2024-09-10T05:36:17.631054+0000","last_became_peered":"2024-09-10T05:36:17.631054+0000","last_unstale":"2024-09-10T05:39:58.739092+0000","last_undegraded":"2024-09-10T05:39:58.739092+0000","last_fullsized":"2024-09-10T05:39:58.739092+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:59.553249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"34'285","reported_seq":410,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.370539+0000","last_change":"2024-09-10T05:36:19.671507+0000","last_active":"2024-09-10T05:39:58.370539+0000","last_peered":"2024-09-10T05:39:58.370539+0000","last_clean":"2024-09-10T05:39:58.370539+0000","last_became_active":"2024-09-10T05:36:19.670915+0000","last_became_peered":"2024-09-10T05:36:19.670915+0000","last_unstale":"2024-09-10T05:39:58.370539+0000","last_undegraded":"2024-09-10T05:39:58.370539+0000","last_fullsized":"2024-09-10T05:39:58.370539+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:35.175677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"34'8","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:23.819129+0000","last_change":"2024-09-10T05:40:23.818949+0000","last_active":"2024-09-10T05:40:23.819129+0000","last_peered":"2024-09-10T05:40:23.819129+0000","last_clean":"2024-09-10T05:40:23.819129+0000","last_became_active":"2024-09-10T05:36:13.597477+0000","last_became_peered":"2024-09-10T05:36:13.597477+0000","last_unstale":"2024-09-10T05:40:23.819129+0000","last_undegraded":"2024-09-10T05:40:23.819129+0000","last_fullsized":"2024-09-10T05:40:23.819129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-10T05:40:23.818774+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-10T05:40:23.818774+0000","last_clean_scrub_stamp":"2024-09-10T05:40:23.818774+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:57.685828+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:12.342230+0000","last_change":"2024-09-10T05:40:12.341960+0000","last_active":"2024-09-10T05:40:12.342230+0000","last_peered":"2024-09-10T05:40:12.342230+0000","last_clean":"2024-09-10T05:40:12.342230+0000","last_became_active":"2024-09-10T05:36:11.600405+0000","last_became_peered":"2024-09-10T05:36:11.600405+0000","last_unstale":"2024-09-10T05:40:12.342230+0000","last_undegraded":"2024-09-10T05:40:12.342230+0000","last_fullsized":"2024-09-10T05:40:12.342230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:12.341728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:12.341728+0000","last_clean_scrub_stamp":"2024-09-10T05:40:12.341728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:41:26.735507+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:39.182970+0000","last_change":"2024-09-10T05:40:39.182970+0000","last_active":"2024-09-10T05:40:39.182970+0000","last_peered":"2024-09-10T05:40:39.182970+0000","last_clean":"2024-09-10T05:40:39.182970+0000","last_became_active":"2024-09-10T05:36:15.620908+0000","last_became_peered":"2024-09-10T05:36:15.620908+0000","last_unstale":"2024-09-10T05:40:39.182970+0000","last_undegraded":"2024-09-10T05:40:39.182970+0000","last_fullsized":"2024-09-10T05:40:39.182970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:39.182790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:39.182790+0000","last_clean_scrub_stamp":"2024-09-10T05:40:39.182790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:00:57.905871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'60","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:36.535093+0000","last_change":"2024-09-10T05:40:36.535093+0000","last_active":"2024-09-10T05:40:36.535093+0000","last_peered":"2024-09-10T05:40:36.535093+0000","last_clean":"2024-09-10T05:40:36.535093+0000","last_became_active":"2024-09-10T05:36:52.710284+0000","last_became_peered":"2024-09-10T05:36:52.710284+0000","last_unstale":"2024-09-10T05:40:36.535093+0000","last_undegraded":"2024-09-10T05:40:36.535093+0000","last_fullsized":"2024-09-10T05:40:36.535093+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'60","last_scrub_stamp":"2024-09-10T05:40:36.534889+0000","last_deep_scrub":"34'60","last_deep_scrub_stamp":"2024-09-10T05:40:36.534889+0000","last_clean_scrub_stamp":"2024-09-10T05:40:36.534889+0000","objects_scrubbed":10,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:52:45.576787+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.853131+0000","last_change":"2024-09-10T05:36:19.641236+0000","last_active":"2024-09-10T05:37:53.853131+0000","last_peered":"2024-09-10T05:37:53.853131+0000","last_clean":"2024-09-10T05:37:53.853131+0000","last_became_active":"2024-09-10T05:36:19.640470+0000","last_became_peered":"2024-09-10T05:36:19.640470+0000","last_unstale":"2024-09-10T05:37:53.853131+0000","last_undegraded":"2024-09-10T05:37:53.853131+0000","last_fullsized":"2024-09-10T05:37:53.853131+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:38.686660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"32'3","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:27.681410+0000","last_change":"2024-09-10T05:36:21.665615+0000","last_active":"2024-09-10T05:38:27.681410+0000","last_peered":"2024-09-10T05:38:27.681410+0000","last_clean":"2024-09-10T05:38:27.681410+0000","last_became_active":"2024-09-10T05:36:21.664232+0000","last_became_peered":"2024-09-10T05:36:21.664232+0000","last_unstale":"2024-09-10T05:38:27.681410+0000","last_undegraded":"2024-09-10T05:38:27.681410+0000","last_fullsized":"2024-09-10T05:38:27.681410+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'2","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:15.511801+0000","last_change":"2024-09-10T05:40:15.511801+0000","last_active":"2024-09-10T05:40:15.511801+0000","last_peered":"2024-09-10T05:40:15.511801+0000","last_clean":"2024-09-10T05:40:15.511801+0000","last_became_active":"2024-09-10T05:36:52.703743+0000","last_became_peered":"2024-09-10T05:36:52.703743+0000","last_unstale":"2024-09-10T05:40:15.511801+0000","last_undegraded":"2024-09-10T05:40:15.511801+0000","last_fullsized":"2024-09-10T05:40:15.511801+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:15.511620+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:15.511620+0000","last_clean_scrub_stamp":"2024-09-10T05:40:15.511620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:45:41.854563+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:07.337399+0000","last_change":"2024-09-10T05:40:07.337269+0000","last_active":"2024-09-10T05:40:07.337399+0000","last_peered":"2024-09-10T05:40:07.337399+0000","last_clean":"2024-09-10T05:40:07.337399+0000","last_became_active":"2024-09-10T05:36:11.597717+0000","last_became_peered":"2024-09-10T05:36:11.597717+0000","last_unstale":"2024-09-10T05:40:07.337399+0000","last_undegraded":"2024-09-10T05:40:07.337399+0000","last_fullsized":"2024-09-10T05:40:07.337399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:07.337094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:07.337094+0000","last_clean_scrub_stamp":"2024-09-10T05:40:07.337094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:15.999267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:32.546321+0000","last_change":"2024-09-10T05:40:32.546155+0000","last_active":"2024-09-10T05:40:32.546321+0000","last_peered":"2024-09-10T05:40:32.546321+0000","last_clean":"2024-09-10T05:40:32.546321+0000","last_became_active":"2024-09-10T05:36:15.631635+0000","last_became_peered":"2024-09-10T05:36:15.631635+0000","last_unstale":"2024-09-10T05:40:32.546321+0000","last_undegraded":"2024-09-10T05:40:32.546321+0000","last_fullsized":"2024-09-10T05:40:32.546321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:32.545964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:32.545964+0000","last_clean_scrub_stamp":"2024-09-10T05:40:32.545964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:59:39.430013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"34'39","reported_seq":96,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.638757+0000","last_change":"2024-09-10T05:36:17.638936+0000","last_active":"2024-09-10T05:39:58.638757+0000","last_peered":"2024-09-10T05:39:58.638757+0000","last_clean":"2024-09-10T05:39:58.638757+0000","last_became_active":"2024-09-10T05:36:17.638301+0000","last_became_peered":"2024-09-10T05:36:17.638301+0000","last_unstale":"2024-09-10T05:39:58.638757+0000","last_undegraded":"2024-09-10T05:39:58.638757+0000","last_fullsized":"2024-09-10T05:39:58.638757+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:17.394424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:28.683882+0000","last_change":"2024-09-10T05:36:19.671665+0000","last_active":"2024-09-10T05:38:28.683882+0000","last_peered":"2024-09-10T05:38:28.683882+0000","last_clean":"2024-09-10T05:38:28.683882+0000","last_became_active":"2024-09-10T05:36:19.671022+0000","last_became_peered":"2024-09-10T05:36:19.671022+0000","last_unstale":"2024-09-10T05:38:28.683882+0000","last_undegraded":"2024-09-10T05:38:28.683882+0000","last_fullsized":"2024-09-10T05:38:28.683882+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"32'3","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:27.687142+0000","last_change":"2024-09-10T05:36:21.667571+0000","last_active":"2024-09-10T05:38:27.687142+0000","last_peered":"2024-09-10T05:38:27.687142+0000","last_clean":"2024-09-10T05:38:27.687142+0000","last_became_active":"2024-09-10T05:36:21.666042+0000","last_became_peered":"2024-09-10T05:36:21.666042+0000","last_unstale":"2024-09-10T05:38:27.687142+0000","last_undegraded":"2024-09-10T05:38:27.687142+0000","last_fullsized":"2024-09-10T05:38:27.687142+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'14","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:16.468481+0000","last_change":"2024-09-10T05:40:16.468481+0000","last_active":"2024-09-10T05:40:16.468481+0000","last_peered":"2024-09-10T05:40:16.468481+0000","last_clean":"2024-09-10T05:40:16.468481+0000","last_became_active":"2024-09-10T05:36:52.696116+0000","last_became_peered":"2024-09-10T05:36:52.696116+0000","last_unstale":"2024-09-10T05:40:16.468481+0000","last_undegraded":"2024-09-10T05:40:16.468481+0000","last_fullsized":"2024-09-10T05:40:16.468481+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-10T05:40:16.468308+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-10T05:40:16.468308+0000","last_clean_scrub_stamp":"2024-09-10T05:40:16.468308+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:13:08.427165+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:11.363315+0000","last_change":"2024-09-10T05:40:11.363136+0000","last_active":"2024-09-10T05:40:11.363315+0000","last_peered":"2024-09-10T05:40:11.363315+0000","last_clean":"2024-09-10T05:40:11.363315+0000","last_became_active":"2024-09-10T05:36:11.606576+0000","last_became_peered":"2024-09-10T05:36:11.606576+0000","last_unstale":"2024-09-10T05:40:11.363315+0000","last_undegraded":"2024-09-10T05:40:11.363315+0000","last_fullsized":"2024-09-10T05:40:11.363315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:11.362960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:11.362960+0000","last_clean_scrub_stamp":"2024-09-10T05:40:11.362960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:18.945320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:34.536659+0000","last_change":"2024-09-10T05:40:34.536659+0000","last_active":"2024-09-10T05:40:34.536659+0000","last_peered":"2024-09-10T05:40:34.536659+0000","last_clean":"2024-09-10T05:40:34.536659+0000","last_became_active":"2024-09-10T05:36:15.617647+0000","last_became_peered":"2024-09-10T05:36:15.617647+0000","last_unstale":"2024-09-10T05:40:34.536659+0000","last_undegraded":"2024-09-10T05:40:34.536659+0000","last_fullsized":"2024-09-10T05:40:34.536659+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:34.536474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:34.536474+0000","last_clean_scrub_stamp":"2024-09-10T05:40:34.536474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:08.497925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"34'52","reported_seq":119,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.532198+0000","last_change":"2024-09-10T05:36:17.636835+0000","last_active":"2024-09-10T05:39:58.532198+0000","last_peered":"2024-09-10T05:39:58.532198+0000","last_clean":"2024-09-10T05:39:58.532198+0000","last_became_active":"2024-09-10T05:36:17.636000+0000","last_became_peered":"2024-09-10T05:36:17.636000+0000","last_unstale":"2024-09-10T05:39:58.532198+0000","last_undegraded":"2024-09-10T05:39:58.532198+0000","last_fullsized":"2024-09-10T05:39:58.532198+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"34'286","reported_seq":367,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:40.504504+0000","last_change":"2024-09-10T05:40:40.504338+0000","last_active":"2024-09-10T05:40:40.504504+0000","last_peered":"2024-09-10T05:40:40.504504+0000","last_clean":"2024-09-10T05:40:40.504504+0000","last_became_active":"2024-09-10T05:36:19.663950+0000","last_became_peered":"2024-09-10T05:36:19.663950+0000","last_unstale":"2024-09-10T05:40:40.504504+0000","last_undegraded":"2024-09-10T05:40:40.504504+0000","last_fullsized":"2024-09-10T05:40:40.504504+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-10T05:40:40.504135+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-10T05:40:40.504135+0000","last_clean_scrub_stamp":"2024-09-10T05:40:40.504135+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:54:50.079992+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"32'2","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:32.688372+0000","last_change":"2024-09-10T05:36:21.691277+0000","last_active":"2024-09-10T05:38:32.688372+0000","last_peered":"2024-09-10T05:38:32.688372+0000","last_clean":"2024-09-10T05:38:32.688372+0000","last_became_active":"2024-09-10T05:36:21.690772+0000","last_became_peered":"2024-09-10T05:36:21.690772+0000","last_unstale":"2024-09-10T05:38:32.688372+0000","last_undegraded":"2024-09-10T05:38:32.688372+0000","last_fullsized":"2024-09-10T05:38:32.688372+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"34'6","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:17.463737+0000","last_change":"2024-09-10T05:40:17.463570+0000","last_active":"2024-09-10T05:40:17.463737+0000","last_peered":"2024-09-10T05:40:17.463737+0000","last_clean":"2024-09-10T05:40:17.463737+0000","last_became_active":"2024-09-10T05:36:13.611694+0000","last_became_peered":"2024-09-10T05:36:13.611694+0000","last_unstale":"2024-09-10T05:40:17.463737+0000","last_undegraded":"2024-09-10T05:40:17.463737+0000","last_fullsized":"2024-09-10T05:40:17.463737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T05:40:17.463381+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T05:40:17.463381+0000","last_clean_scrub_stamp":"2024-09-10T05:40:17.463381+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:29.689757+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'2","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:03.358116+0000","last_change":"2024-09-10T05:40:03.358004+0000","last_active":"2024-09-10T05:40:03.358116+0000","last_peered":"2024-09-10T05:40:03.358116+0000","last_clean":"2024-09-10T05:40:03.358116+0000","last_became_active":"2024-09-10T05:36:11.606957+0000","last_became_peered":"2024-09-10T05:36:11.606957+0000","last_unstale":"2024-09-10T05:40:03.358116+0000","last_undegraded":"2024-09-10T05:40:03.358116+0000","last_fullsized":"2024-09-10T05:40:03.358116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T05:40:03.357891+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T05:40:03.357891+0000","last_clean_scrub_stamp":"2024-09-10T05:40:03.357891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:00:33.509652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:33.551675+0000","last_change":"2024-09-10T05:40:33.551523+0000","last_active":"2024-09-10T05:40:33.551675+0000","last_peered":"2024-09-10T05:40:33.551675+0000","last_clean":"2024-09-10T05:40:33.551675+0000","last_became_active":"2024-09-10T05:36:15.631551+0000","last_became_peered":"2024-09-10T05:36:15.631551+0000","last_unstale":"2024-09-10T05:40:33.551675+0000","last_undegraded":"2024-09-10T05:40:33.551675+0000","last_fullsized":"2024-09-10T05:40:33.551675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:33.551317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:33.551317+0000","last_clean_scrub_stamp":"2024-09-10T05:40:33.551317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:55.912005+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"34'72","reported_seq":154,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.671035+0000","last_change":"2024-09-10T05:36:17.651071+0000","last_active":"2024-09-10T05:39:58.671035+0000","last_peered":"2024-09-10T05:39:58.671035+0000","last_clean":"2024-09-10T05:39:58.671035+0000","last_became_active":"2024-09-10T05:36:17.650601+0000","last_became_peered":"2024-09-10T05:36:17.650601+0000","last_unstale":"2024-09-10T05:39:58.671035+0000","last_undegraded":"2024-09-10T05:39:58.671035+0000","last_fullsized":"2024-09-10T05:39:58.671035+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:42.486465+0000","last_change":"2024-09-10T05:40:42.486308+0000","last_active":"2024-09-10T05:40:42.486465+0000","last_peered":"2024-09-10T05:40:42.486465+0000","last_clean":"2024-09-10T05:40:42.486465+0000","last_became_active":"2024-09-10T05:36:19.638087+0000","last_became_peered":"2024-09-10T05:36:19.638087+0000","last_unstale":"2024-09-10T05:40:42.486465+0000","last_undegraded":"2024-09-10T05:40:42.486465+0000","last_fullsized":"2024-09-10T05:40:42.486465+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:42.486118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:42.486118+0000","last_clean_scrub_stamp":"2024-09-10T05:40:42.486118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:05:00.763542+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"34'18","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.535451+0000","last_change":"2024-09-10T05:36:21.681112+0000","last_active":"2024-09-10T05:39:27.535451+0000","last_peered":"2024-09-10T05:39:27.535451+0000","last_clean":"2024-09-10T05:39:27.535451+0000","last_became_active":"2024-09-10T05:36:21.680246+0000","last_became_peered":"2024-09-10T05:36:21.680246+0000","last_unstale":"2024-09-10T05:39:27.535451+0000","last_undegraded":"2024-09-10T05:39:27.535451+0000","last_fullsized":"2024-09-10T05:39:27.535451+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"34'6","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:18.483578+0000","last_change":"2024-09-10T05:40:18.483578+0000","last_active":"2024-09-10T05:40:18.483578+0000","last_peered":"2024-09-10T05:40:18.483578+0000","last_clean":"2024-09-10T05:40:18.483578+0000","last_became_active":"2024-09-10T05:36:52.702912+0000","last_became_peered":"2024-09-10T05:36:52.702912+0000","last_unstale":"2024-09-10T05:40:18.483578+0000","last_undegraded":"2024-09-10T05:40:18.483578+0000","last_fullsized":"2024-09-10T05:40:18.483578+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T05:40:18.483367+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T05:40:18.483367+0000","last_clean_scrub_stamp":"2024-09-10T05:40:18.483367+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:29:35.440454+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"34'4","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:06.665116+0000","last_change":"2024-09-10T05:40:06.664984+0000","last_active":"2024-09-10T05:40:06.665116+0000","last_peered":"2024-09-10T05:40:06.665116+0000","last_clean":"2024-09-10T05:40:06.665116+0000","last_became_active":"2024-09-10T05:36:11.606930+0000","last_became_peered":"2024-09-10T05:36:11.606930+0000","last_unstale":"2024-09-10T05:40:06.665116+0000","last_undegraded":"2024-09-10T05:40:06.665116+0000","last_fullsized":"2024-09-10T05:40:06.665116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:06.664807+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:06.664807+0000","last_clean_scrub_stamp":"2024-09-10T05:40:06.664807+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:52:51.651502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:35.492588+0000","last_change":"2024-09-10T05:40:35.492588+0000","last_active":"2024-09-10T05:40:35.492588+0000","last_peered":"2024-09-10T05:40:35.492588+0000","last_clean":"2024-09-10T05:40:35.492588+0000","last_became_active":"2024-09-10T05:36:15.616975+0000","last_became_peered":"2024-09-10T05:36:15.616975+0000","last_unstale":"2024-09-10T05:40:35.492588+0000","last_undegraded":"2024-09-10T05:40:35.492588+0000","last_fullsized":"2024-09-10T05:40:35.492588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:35.492410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:35.492410+0000","last_clean_scrub_stamp":"2024-09-10T05:40:35.492410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:47:37.689480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'45","reported_seq":103,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.677847+0000","last_change":"2024-09-10T05:36:17.651377+0000","last_active":"2024-09-10T05:39:58.677847+0000","last_peered":"2024-09-10T05:39:58.677847+0000","last_clean":"2024-09-10T05:39:58.677847+0000","last_became_active":"2024-09-10T05:36:17.650522+0000","last_became_peered":"2024-09-10T05:36:17.650522+0000","last_unstale":"2024-09-10T05:39:58.677847+0000","last_undegraded":"2024-09-10T05:39:58.677847+0000","last_fullsized":"2024-09-10T05:39:58.677847+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:31:03.454940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.728744+0000","last_change":"2024-09-10T05:36:19.664052+0000","last_active":"2024-09-10T05:37:53.728744+0000","last_peered":"2024-09-10T05:37:53.728744+0000","last_clean":"2024-09-10T05:37:53.728744+0000","last_became_active":"2024-09-10T05:36:19.663287+0000","last_became_peered":"2024-09-10T05:36:19.663287+0000","last_unstale":"2024-09-10T05:37:53.728744+0000","last_undegraded":"2024-09-10T05:37:53.728744+0000","last_fullsized":"2024-09-10T05:37:53.728744+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:39.277013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'5","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.476946+0000","last_change":"2024-09-10T05:36:21.664412+0000","last_active":"2024-09-10T05:39:27.476946+0000","last_peered":"2024-09-10T05:39:27.476946+0000","last_clean":"2024-09-10T05:39:27.476946+0000","last_became_active":"2024-09-10T05:36:21.663661+0000","last_became_peered":"2024-09-10T05:36:21.663661+0000","last_unstale":"2024-09-10T05:39:27.476946+0000","last_undegraded":"2024-09-10T05:39:27.476946+0000","last_fullsized":"2024-09-10T05:39:27.476946+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'6","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:32.451634+0000","last_change":"2024-09-10T05:40:32.451450+0000","last_active":"2024-09-10T05:40:32.451634+0000","last_peered":"2024-09-10T05:40:32.451634+0000","last_clean":"2024-09-10T05:40:32.451634+0000","last_became_active":"2024-09-10T05:36:13.630386+0000","last_became_peered":"2024-09-10T05:36:13.630386+0000","last_unstale":"2024-09-10T05:40:32.451634+0000","last_undegraded":"2024-09-10T05:40:32.451634+0000","last_fullsized":"2024-09-10T05:40:32.451634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T05:40:32.451241+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T05:40:32.451241+0000","last_clean_scrub_stamp":"2024-09-10T05:40:32.451241+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:37:51.470047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:19.418589+0000","last_change":"2024-09-10T05:40:19.418419+0000","last_active":"2024-09-10T05:40:19.418589+0000","last_peered":"2024-09-10T05:40:19.418589+0000","last_clean":"2024-09-10T05:40:19.418589+0000","last_became_active":"2024-09-10T05:36:11.597935+0000","last_became_peered":"2024-09-10T05:36:11.597935+0000","last_unstale":"2024-09-10T05:40:19.418589+0000","last_undegraded":"2024-09-10T05:40:19.418589+0000","last_fullsized":"2024-09-10T05:40:19.418589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:19.418236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:19.418236+0000","last_clean_scrub_stamp":"2024-09-10T05:40:19.418236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:15:58.466576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:40.162608+0000","last_change":"2024-09-10T05:40:40.162608+0000","last_active":"2024-09-10T05:40:40.162608+0000","last_peered":"2024-09-10T05:40:40.162608+0000","last_clean":"2024-09-10T05:40:40.162608+0000","last_became_active":"2024-09-10T05:36:15.619388+0000","last_became_peered":"2024-09-10T05:36:15.619388+0000","last_unstale":"2024-09-10T05:40:40.162608+0000","last_undegraded":"2024-09-10T05:40:40.162608+0000","last_fullsized":"2024-09-10T05:40:40.162608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:40.162436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:40.162436+0000","last_clean_scrub_stamp":"2024-09-10T05:40:40.162436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:57.508074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"34'46","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:37.501956+0000","last_change":"2024-09-10T05:40:37.501956+0000","last_active":"2024-09-10T05:40:37.501956+0000","last_peered":"2024-09-10T05:40:37.501956+0000","last_clean":"2024-09-10T05:40:37.501956+0000","last_became_active":"2024-09-10T05:36:17.636568+0000","last_became_peered":"2024-09-10T05:36:17.636568+0000","last_unstale":"2024-09-10T05:40:37.501956+0000","last_undegraded":"2024-09-10T05:40:37.501956+0000","last_fullsized":"2024-09-10T05:40:37.501956+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-10T05:40:37.501724+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-10T05:40:37.501724+0000","last_clean_scrub_stamp":"2024-09-10T05:40:37.501724+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:41:42.065206+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'286","reported_seq":421,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:41.522983+0000","last_change":"2024-09-10T05:40:41.522983+0000","last_active":"2024-09-10T05:40:41.522983+0000","last_peered":"2024-09-10T05:40:41.522983+0000","last_clean":"2024-09-10T05:40:41.522983+0000","last_became_active":"2024-09-10T05:36:19.666610+0000","last_became_peered":"2024-09-10T05:36:19.666610+0000","last_unstale":"2024-09-10T05:40:41.522983+0000","last_undegraded":"2024-09-10T05:40:41.522983+0000","last_fullsized":"2024-09-10T05:40:41.522983+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-10T05:40:41.522779+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-10T05:40:41.522779+0000","last_clean_scrub_stamp":"2024-09-10T05:40:41.522779+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:13:32.225111+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'12","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.482198+0000","last_change":"2024-09-10T05:36:21.669588+0000","last_active":"2024-09-10T05:39:27.482198+0000","last_peered":"2024-09-10T05:39:27.482198+0000","last_clean":"2024-09-10T05:39:27.482198+0000","last_became_active":"2024-09-10T05:36:21.668641+0000","last_became_peered":"2024-09-10T05:36:21.668641+0000","last_unstale":"2024-09-10T05:39:27.482198+0000","last_undegraded":"2024-09-10T05:39:27.482198+0000","last_fullsized":"2024-09-10T05:39:27.482198+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"34'8","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:19.486804+0000","last_change":"2024-09-10T05:40:19.486658+0000","last_active":"2024-09-10T05:40:19.486804+0000","last_peered":"2024-09-10T05:40:19.486804+0000","last_clean":"2024-09-10T05:40:19.486804+0000","last_became_active":"2024-09-10T05:36:13.605112+0000","last_became_peered":"2024-09-10T05:36:13.605112+0000","last_unstale":"2024-09-10T05:40:19.486804+0000","last_undegraded":"2024-09-10T05:40:19.486804+0000","last_fullsized":"2024-09-10T05:40:19.486804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-10T05:40:19.486471+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-10T05:40:19.486471+0000","last_clean_scrub_stamp":"2024-09-10T05:40:19.486471+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:21:20.885876+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:05.700119+0000","last_change":"2024-09-10T05:40:05.699984+0000","last_active":"2024-09-10T05:40:05.700119+0000","last_peered":"2024-09-10T05:40:05.700119+0000","last_clean":"2024-09-10T05:40:05.700119+0000","last_became_active":"2024-09-10T05:36:11.600833+0000","last_became_peered":"2024-09-10T05:36:11.600833+0000","last_unstale":"2024-09-10T05:40:05.700119+0000","last_undegraded":"2024-09-10T05:40:05.700119+0000","last_fullsized":"2024-09-10T05:40:05.700119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:05.699733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:05.699733+0000","last_clean_scrub_stamp":"2024-09-10T05:40:05.699733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:58:29.252913+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'3","reported_seq":422,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.335604+0000","last_change":"2024-09-10T05:36:15.636516+0000","last_active":"2024-09-10T05:39:58.335604+0000","last_peered":"2024-09-10T05:39:58.335604+0000","last_clean":"2024-09-10T05:39:58.335604+0000","last_became_active":"2024-09-10T05:36:15.635670+0000","last_became_peered":"2024-09-10T05:36:15.635670+0000","last_unstale":"2024-09-10T05:39:58.335604+0000","last_undegraded":"2024-09-10T05:39:58.335604+0000","last_fullsized":"2024-09-10T05:39:58.335604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:38:23.956906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.726176+0000","last_change":"2024-09-10T05:36:17.639202+0000","last_active":"2024-09-10T05:37:53.726176+0000","last_peered":"2024-09-10T05:37:53.726176+0000","last_clean":"2024-09-10T05:37:53.726176+0000","last_became_active":"2024-09-10T05:36:17.633215+0000","last_became_peered":"2024-09-10T05:36:17.633215+0000","last_unstale":"2024-09-10T05:37:53.726176+0000","last_undegraded":"2024-09-10T05:37:53.726176+0000","last_fullsized":"2024-09-10T05:37:53.726176+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:47:38.759892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'285","reported_seq":474,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.367543+0000","last_change":"2024-09-10T05:36:19.650595+0000","last_active":"2024-09-10T05:39:58.367543+0000","last_peered":"2024-09-10T05:39:58.367543+0000","last_clean":"2024-09-10T05:39:58.367543+0000","last_became_active":"2024-09-10T05:36:19.649781+0000","last_became_peered":"2024-09-10T05:36:19.649781+0000","last_unstale":"2024-09-10T05:39:58.367543+0000","last_undegraded":"2024-09-10T05:39:58.367543+0000","last_fullsized":"2024-09-10T05:39:58.367543+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:13:23.575638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:27.681250+0000","last_change":"2024-09-10T05:36:21.665015+0000","last_active":"2024-09-10T05:38:27.681250+0000","last_peered":"2024-09-10T05:38:27.681250+0000","last_clean":"2024-09-10T05:38:27.681250+0000","last_became_active":"2024-09-10T05:36:21.664283+0000","last_became_peered":"2024-09-10T05:36:21.664283+0000","last_unstale":"2024-09-10T05:38:27.681250+0000","last_undegraded":"2024-09-10T05:38:27.681250+0000","last_fullsized":"2024-09-10T05:38:27.681250+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'4","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:20.525777+0000","last_change":"2024-09-10T05:40:20.525777+0000","last_active":"2024-09-10T05:40:20.525777+0000","last_peered":"2024-09-10T05:40:20.525777+0000","last_clean":"2024-09-10T05:40:20.525777+0000","last_became_active":"2024-09-10T05:37:53.724668+0000","last_became_peered":"2024-09-10T05:37:53.724668+0000","last_unstale":"2024-09-10T05:40:20.525777+0000","last_undegraded":"2024-09-10T05:40:20.525777+0000","last_fullsized":"2024-09-10T05:40:20.525777+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:20.525572+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:20.525572+0000","last_clean_scrub_stamp":"2024-09-10T05:40:20.525572+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:25.446283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:07.715488+0000","last_change":"2024-09-10T05:40:07.715354+0000","last_active":"2024-09-10T05:40:07.715488+0000","last_peered":"2024-09-10T05:40:07.715488+0000","last_clean":"2024-09-10T05:40:07.715488+0000","last_became_active":"2024-09-10T05:36:11.598213+0000","last_became_peered":"2024-09-10T05:36:11.598213+0000","last_unstale":"2024-09-10T05:40:07.715488+0000","last_undegraded":"2024-09-10T05:40:07.715488+0000","last_fullsized":"2024-09-10T05:40:07.715488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:07.715175+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:07.715175+0000","last_clean_scrub_stamp":"2024-09-10T05:40:07.715175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:29:24.579705+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:40.840583+0000","last_change":"2024-09-10T05:40:40.840583+0000","last_active":"2024-09-10T05:40:40.840583+0000","last_peered":"2024-09-10T05:40:40.840583+0000","last_clean":"2024-09-10T05:40:40.840583+0000","last_became_active":"2024-09-10T05:36:15.621697+0000","last_became_peered":"2024-09-10T05:36:15.621697+0000","last_unstale":"2024-09-10T05:40:40.840583+0000","last_undegraded":"2024-09-10T05:40:40.840583+0000","last_fullsized":"2024-09-10T05:40:40.840583+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:40.840381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:40.840381+0000","last_clean_scrub_stamp":"2024-09-10T05:40:40.840381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:29:43.354536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'41","reported_seq":96,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.488104+0000","last_change":"2024-09-10T05:36:17.648212+0000","last_active":"2024-09-10T05:39:58.488104+0000","last_peered":"2024-09-10T05:39:58.488104+0000","last_clean":"2024-09-10T05:39:58.488104+0000","last_became_active":"2024-09-10T05:36:17.647533+0000","last_became_peered":"2024-09-10T05:36:17.647533+0000","last_unstale":"2024-09-10T05:39:58.488104+0000","last_undegraded":"2024-09-10T05:39:58.488104+0000","last_fullsized":"2024-09-10T05:39:58.488104+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:49:23.646157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.896760+0000","last_change":"2024-09-10T05:36:19.641688+0000","last_active":"2024-09-10T05:37:55.896760+0000","last_peered":"2024-09-10T05:37:55.896760+0000","last_clean":"2024-09-10T05:37:55.896760+0000","last_became_active":"2024-09-10T05:36:19.640885+0000","last_became_peered":"2024-09-10T05:36:19.640885+0000","last_unstale":"2024-09-10T05:37:55.896760+0000","last_undegraded":"2024-09-10T05:37:55.896760+0000","last_fullsized":"2024-09-10T05:37:55.896760+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:07.106507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"34'8","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.530828+0000","last_change":"2024-09-10T05:36:21.665178+0000","last_active":"2024-09-10T05:39:27.530828+0000","last_peered":"2024-09-10T05:39:27.530828+0000","last_clean":"2024-09-10T05:39:27.530828+0000","last_became_active":"2024-09-10T05:36:21.664454+0000","last_became_peered":"2024-09-10T05:36:21.664454+0000","last_unstale":"2024-09-10T05:39:27.530828+0000","last_undegraded":"2024-09-10T05:39:27.530828+0000","last_fullsized":"2024-09-10T05:39:27.530828+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'6","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:21.456922+0000","last_change":"2024-09-10T05:40:21.456783+0000","last_active":"2024-09-10T05:40:21.456922+0000","last_peered":"2024-09-10T05:40:21.456922+0000","last_clean":"2024-09-10T05:40:21.456922+0000","last_became_active":"2024-09-10T05:36:13.605318+0000","last_became_peered":"2024-09-10T05:36:13.605318+0000","last_unstale":"2024-09-10T05:40:21.456922+0000","last_undegraded":"2024-09-10T05:40:21.456922+0000","last_fullsized":"2024-09-10T05:40:21.456922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T05:40:21.456596+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T05:40:21.456596+0000","last_clean_scrub_stamp":"2024-09-10T05:40:21.456596+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:47.464427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"34'74","reported_seq":157,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:04.098105+0000","last_change":"2024-09-10T05:40:04.098105+0000","last_active":"2024-09-10T05:40:04.098105+0000","last_peered":"2024-09-10T05:40:04.098105+0000","last_clean":"2024-09-10T05:40:04.098105+0000","last_became_active":"2024-09-10T05:35:59.486077+0000","last_became_peered":"2024-09-10T05:35:59.486077+0000","last_unstale":"2024-09-10T05:40:04.098105+0000","last_undegraded":"2024-09-10T05:40:04.098105+0000","last_fullsized":"2024-09-10T05:40:04.098105+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'74","last_scrub_stamp":"2024-09-10T05:40:04.097908+0000","last_deep_scrub":"34'74","last_deep_scrub_stamp":"2024-09-10T05:40:04.097908+0000","last_clean_scrub_stamp":"2024-09-10T05:40:04.097908+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:20:39.253681+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"34'2","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:02.370065+0000","last_change":"2024-09-10T05:40:02.369928+0000","last_active":"2024-09-10T05:40:02.370065+0000","last_peered":"2024-09-10T05:40:02.370065+0000","last_clean":"2024-09-10T05:40:02.370065+0000","last_became_active":"2024-09-10T05:36:03.710352+0000","last_became_peered":"2024-09-10T05:36:03.710352+0000","last_unstale":"2024-09-10T05:40:02.370065+0000","last_undegraded":"2024-09-10T05:40:02.370065+0000","last_fullsized":"2024-09-10T05:40:02.370065+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:02.369862+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:02.369862+0000","last_clean_scrub_stamp":"2024-09-10T05:40:02.369862+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:48.466459+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.002047461,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"34'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:03.692190+0000","last_change":"2024-09-10T05:40:03.692057+0000","last_active":"2024-09-10T05:40:03.692190+0000","last_peered":"2024-09-10T05:40:03.692190+0000","last_clean":"2024-09-10T05:40:03.692190+0000","last_became_active":"2024-09-10T05:36:11.604178+0000","last_became_peered":"2024-09-10T05:36:11.604178+0000","last_unstale":"2024-09-10T05:40:03.692190+0000","last_undegraded":"2024-09-10T05:40:03.692190+0000","last_fullsized":"2024-09-10T05:40:03.692190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:03.691877+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:03.691877+0000","last_clean_scrub_stamp":"2024-09-10T05:40:03.691877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:48:28.093143+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:38.228258+0000","last_change":"2024-09-10T05:40:38.228258+0000","last_active":"2024-09-10T05:40:38.228258+0000","last_peered":"2024-09-10T05:40:38.228258+0000","last_clean":"2024-09-10T05:40:38.228258+0000","last_became_active":"2024-09-10T05:36:15.623637+0000","last_became_peered":"2024-09-10T05:36:15.623637+0000","last_unstale":"2024-09-10T05:40:38.228258+0000","last_undegraded":"2024-09-10T05:40:38.228258+0000","last_fullsized":"2024-09-10T05:40:38.228258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:38.228078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:38.228078+0000","last_clean_scrub_stamp":"2024-09-10T05:40:38.228078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:52:22.148177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'92","reported_seq":185,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.582841+0000","last_change":"2024-09-10T05:36:17.637408+0000","last_active":"2024-09-10T05:39:58.582841+0000","last_peered":"2024-09-10T05:39:58.582841+0000","last_clean":"2024-09-10T05:39:58.582841+0000","last_became_active":"2024-09-10T05:36:17.636543+0000","last_became_peered":"2024-09-10T05:36:17.636543+0000","last_unstale":"2024-09-10T05:39:58.582841+0000","last_undegraded":"2024-09-10T05:39:58.582841+0000","last_fullsized":"2024-09-10T05:39:58.582841+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:28.684026+0000","last_change":"2024-09-10T05:36:19.664203+0000","last_active":"2024-09-10T05:38:28.684026+0000","last_peered":"2024-09-10T05:38:28.684026+0000","last_clean":"2024-09-10T05:38:28.684026+0000","last_became_active":"2024-09-10T05:36:19.663584+0000","last_became_peered":"2024-09-10T05:36:19.663584+0000","last_unstale":"2024-09-10T05:38:28.684026+0000","last_undegraded":"2024-09-10T05:38:28.684026+0000","last_fullsized":"2024-09-10T05:38:28.684026+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"34'82","reported_seq":169,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.402819+0000","last_change":"2024-09-10T05:36:21.664939+0000","last_active":"2024-09-10T05:39:27.402819+0000","last_peered":"2024-09-10T05:39:27.402819+0000","last_clean":"2024-09-10T05:39:27.402819+0000","last_became_active":"2024-09-10T05:36:21.664075+0000","last_became_peered":"2024-09-10T05:36:21.664075+0000","last_unstale":"2024-09-10T05:39:27.402819+0000","last_undegraded":"2024-09-10T05:39:27.402819+0000","last_fullsized":"2024-09-10T05:39:27.402819+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":223,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"30'2","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:22.862239+0000","last_change":"2024-09-10T05:40:22.862111+0000","last_active":"2024-09-10T05:40:22.862239+0000","last_peered":"2024-09-10T05:40:22.862239+0000","last_clean":"2024-09-10T05:40:22.862239+0000","last_became_active":"2024-09-10T05:36:13.616766+0000","last_became_peered":"2024-09-10T05:36:13.616766+0000","last_unstale":"2024-09-10T05:40:22.862239+0000","last_undegraded":"2024-09-10T05:40:22.862239+0000","last_fullsized":"2024-09-10T05:40:22.862239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-10T05:40:22.861923+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-10T05:40:22.861923+0000","last_clean_scrub_stamp":"2024-09-10T05:40:22.861923+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:18:25.222001+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:08.386382+0000","last_change":"2024-09-10T05:40:08.386382+0000","last_active":"2024-09-10T05:40:08.386382+0000","last_peered":"2024-09-10T05:40:08.386382+0000","last_clean":"2024-09-10T05:40:08.386382+0000","last_became_active":"2024-09-10T05:36:03.706256+0000","last_became_peered":"2024-09-10T05:36:03.706256+0000","last_unstale":"2024-09-10T05:40:08.386382+0000","last_undegraded":"2024-09-10T05:40:08.386382+0000","last_fullsized":"2024-09-10T05:40:08.386382+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:08.386197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:08.386197+0000","last_clean_scrub_stamp":"2024-09-10T05:40:08.386197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:07.558694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001383542,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:07.029001+0000","last_change":"2024-09-10T05:40:07.028861+0000","last_active":"2024-09-10T05:40:07.029001+0000","last_peered":"2024-09-10T05:40:07.029001+0000","last_clean":"2024-09-10T05:40:07.029001+0000","last_became_active":"2024-09-10T05:36:11.591339+0000","last_became_peered":"2024-09-10T05:36:11.591339+0000","last_unstale":"2024-09-10T05:40:07.029001+0000","last_undegraded":"2024-09-10T05:40:07.029001+0000","last_fullsized":"2024-09-10T05:40:07.029001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:07.028674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:07.028674+0000","last_clean_scrub_stamp":"2024-09-10T05:40:07.028674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:03.721457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:27.689707+0000","last_change":"2024-09-10T05:36:52.705367+0000","last_active":"2024-09-10T05:38:27.689707+0000","last_peered":"2024-09-10T05:38:27.689707+0000","last_clean":"2024-09-10T05:38:27.689707+0000","last_became_active":"2024-09-10T05:36:52.704490+0000","last_became_peered":"2024-09-10T05:36:52.704490+0000","last_unstale":"2024-09-10T05:38:27.689707+0000","last_undegraded":"2024-09-10T05:38:27.689707+0000","last_fullsized":"2024-09-10T05:38:27.689707+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"34'291","reported_seq":520,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.747024+0000","last_change":"2024-09-10T05:36:17.640102+0000","last_active":"2024-09-10T05:39:58.747024+0000","last_peered":"2024-09-10T05:39:58.747024+0000","last_clean":"2024-09-10T05:39:58.747024+0000","last_became_active":"2024-09-10T05:36:17.637623+0000","last_became_peered":"2024-09-10T05:36:17.637623+0000","last_unstale":"2024-09-10T05:39:58.747024+0000","last_undegraded":"2024-09-10T05:39:58.747024+0000","last_fullsized":"2024-09-10T05:39:58.747024+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":387,"num_read_kb":371,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:23.682625+0000","last_change":"2024-09-10T05:36:19.673384+0000","last_active":"2024-09-10T05:38:23.682625+0000","last_peered":"2024-09-10T05:38:23.682625+0000","last_clean":"2024-09-10T05:38:23.682625+0000","last_became_active":"2024-09-10T05:36:19.672554+0000","last_became_peered":"2024-09-10T05:36:19.672554+0000","last_unstale":"2024-09-10T05:38:23.682625+0000","last_undegraded":"2024-09-10T05:38:23.682625+0000","last_fullsized":"2024-09-10T05:38:23.682625+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'5","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:32.688213+0000","last_change":"2024-09-10T05:36:21.662079+0000","last_active":"2024-09-10T05:38:32.688213+0000","last_peered":"2024-09-10T05:38:32.688213+0000","last_clean":"2024-09-10T05:38:32.688213+0000","last_became_active":"2024-09-10T05:36:21.661347+0000","last_became_peered":"2024-09-10T05:36:21.661347+0000","last_unstale":"2024-09-10T05:38:32.688213+0000","last_undegraded":"2024-09-10T05:38:32.688213+0000","last_fullsized":"2024-09-10T05:38:32.688213+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:24.185198+0000","last_change":"2024-09-10T05:40:24.185051+0000","last_active":"2024-09-10T05:40:24.185198+0000","last_peered":"2024-09-10T05:40:24.185198+0000","last_clean":"2024-09-10T05:40:24.185198+0000","last_became_active":"2024-09-10T05:36:13.621451+0000","last_became_peered":"2024-09-10T05:36:13.621451+0000","last_unstale":"2024-09-10T05:40:24.185198+0000","last_undegraded":"2024-09-10T05:40:24.185198+0000","last_fullsized":"2024-09-10T05:40:24.185198+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T05:40:24.184869+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T05:40:24.184869+0000","last_clean_scrub_stamp":"2024-09-10T05:40:24.184869+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:25:47.203486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:04.549247+0000","last_change":"2024-09-10T05:40:04.549099+0000","last_active":"2024-09-10T05:40:04.549247+0000","last_peered":"2024-09-10T05:40:04.549247+0000","last_clean":"2024-09-10T05:40:04.549247+0000","last_became_active":"2024-09-10T05:36:03.707045+0000","last_became_peered":"2024-09-10T05:36:03.707045+0000","last_unstale":"2024-09-10T05:40:04.549247+0000","last_undegraded":"2024-09-10T05:40:04.549247+0000","last_fullsized":"2024-09-10T05:40:04.549247+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:04.548887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:04.548887+0000","last_clean_scrub_stamp":"2024-09-10T05:40:04.548887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:06.035520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093121299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"34'4","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:06.066743+0000","last_change":"2024-09-10T05:40:06.066584+0000","last_active":"2024-09-10T05:40:06.066743+0000","last_peered":"2024-09-10T05:40:06.066743+0000","last_clean":"2024-09-10T05:40:06.066743+0000","last_became_active":"2024-09-10T05:36:11.594432+0000","last_became_peered":"2024-09-10T05:36:11.594432+0000","last_unstale":"2024-09-10T05:40:06.066743+0000","last_undegraded":"2024-09-10T05:40:06.066743+0000","last_fullsized":"2024-09-10T05:40:06.066743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:06.066401+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:06.066401+0000","last_clean_scrub_stamp":"2024-09-10T05:40:06.066401+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:26.311891+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:31.519925+0000","last_change":"2024-09-10T05:40:31.519773+0000","last_active":"2024-09-10T05:40:31.519925+0000","last_peered":"2024-09-10T05:40:31.519925+0000","last_clean":"2024-09-10T05:40:31.519925+0000","last_became_active":"2024-09-10T05:36:15.620043+0000","last_became_peered":"2024-09-10T05:36:15.620043+0000","last_unstale":"2024-09-10T05:40:31.519925+0000","last_undegraded":"2024-09-10T05:40:31.519925+0000","last_fullsized":"2024-09-10T05:40:31.519925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:31.519580+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:31.519580+0000","last_clean_scrub_stamp":"2024-09-10T05:40:31.519580+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:18:37.004223+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'17","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.584868+0000","last_change":"2024-09-10T05:36:17.637187+0000","last_active":"2024-09-10T05:39:27.584868+0000","last_peered":"2024-09-10T05:39:27.584868+0000","last_clean":"2024-09-10T05:39:27.584868+0000","last_became_active":"2024-09-10T05:36:17.636381+0000","last_became_peered":"2024-09-10T05:36:17.636381+0000","last_unstale":"2024-09-10T05:39:27.584868+0000","last_undegraded":"2024-09-10T05:39:27.584868+0000","last_fullsized":"2024-09-10T05:39:27.584868+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:27.687077+0000","last_change":"2024-09-10T05:36:19.666298+0000","last_active":"2024-09-10T05:38:27.687077+0000","last_peered":"2024-09-10T05:38:27.687077+0000","last_clean":"2024-09-10T05:38:27.687077+0000","last_became_active":"2024-09-10T05:36:19.664396+0000","last_became_peered":"2024-09-10T05:36:19.664396+0000","last_unstale":"2024-09-10T05:38:27.687077+0000","last_undegraded":"2024-09-10T05:38:27.687077+0000","last_fullsized":"2024-09-10T05:38:27.687077+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.725249+0000","last_change":"2024-09-10T05:36:21.675746+0000","last_active":"2024-09-10T05:37:53.725249+0000","last_peered":"2024-09-10T05:37:53.725249+0000","last_clean":"2024-09-10T05:37:53.725249+0000","last_became_active":"2024-09-10T05:36:21.674984+0000","last_became_peered":"2024-09-10T05:36:21.674984+0000","last_unstale":"2024-09-10T05:37:53.725249+0000","last_undegraded":"2024-09-10T05:37:53.725249+0000","last_fullsized":"2024-09-10T05:37:53.725249+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:13.261758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:23.144701+0000","last_change":"2024-09-10T05:40:23.144701+0000","last_active":"2024-09-10T05:40:23.144701+0000","last_peered":"2024-09-10T05:40:23.144701+0000","last_clean":"2024-09-10T05:40:23.144701+0000","last_became_active":"2024-09-10T05:36:13.626654+0000","last_became_peered":"2024-09-10T05:36:13.626654+0000","last_unstale":"2024-09-10T05:40:23.144701+0000","last_undegraded":"2024-09-10T05:40:23.144701+0000","last_fullsized":"2024-09-10T05:40:23.144701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:23.144518+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:23.144518+0000","last_clean_scrub_stamp":"2024-09-10T05:40:23.144518+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:29:05.863627+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"34'3","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:15.375407+0000","last_change":"2024-09-10T05:40:15.375209+0000","last_active":"2024-09-10T05:40:15.375407+0000","last_peered":"2024-09-10T05:40:15.375407+0000","last_clean":"2024-09-10T05:40:15.375407+0000","last_became_active":"2024-09-10T05:36:03.708495+0000","last_became_peered":"2024-09-10T05:36:03.708495+0000","last_unstale":"2024-09-10T05:40:15.375407+0000","last_undegraded":"2024-09-10T05:40:15.375407+0000","last_fullsized":"2024-09-10T05:40:15.375407+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-10T05:40:15.375014+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-10T05:40:15.375014+0000","last_clean_scrub_stamp":"2024-09-10T05:40:15.375014+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:49:34.092873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012525469999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:04.336783+0000","last_change":"2024-09-10T05:40:04.336594+0000","last_active":"2024-09-10T05:40:04.336783+0000","last_peered":"2024-09-10T05:40:04.336783+0000","last_clean":"2024-09-10T05:40:04.336783+0000","last_became_active":"2024-09-10T05:36:11.601414+0000","last_became_peered":"2024-09-10T05:36:11.601414+0000","last_unstale":"2024-09-10T05:40:04.336783+0000","last_undegraded":"2024-09-10T05:40:04.336783+0000","last_fullsized":"2024-09-10T05:40:04.336783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:04.336407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:04.336407+0000","last_clean_scrub_stamp":"2024-09-10T05:40:04.336407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:42:28.818551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:37.248228+0000","last_change":"2024-09-10T05:40:37.248228+0000","last_active":"2024-09-10T05:40:37.248228+0000","last_peered":"2024-09-10T05:40:37.248228+0000","last_clean":"2024-09-10T05:40:37.248228+0000","last_became_active":"2024-09-10T05:36:15.619505+0000","last_became_peered":"2024-09-10T05:36:15.619505+0000","last_unstale":"2024-09-10T05:40:37.248228+0000","last_undegraded":"2024-09-10T05:40:37.248228+0000","last_fullsized":"2024-09-10T05:40:37.248228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:37.248025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:37.248025+0000","last_clean_scrub_stamp":"2024-09-10T05:40:37.248025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:04:51.414497+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"33'13","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.249618+0000","last_change":"2024-09-10T05:36:17.638373+0000","last_active":"2024-09-10T05:39:26.249618+0000","last_peered":"2024-09-10T05:39:26.249618+0000","last_clean":"2024-09-10T05:39:26.249618+0000","last_became_active":"2024-09-10T05:36:17.637551+0000","last_became_peered":"2024-09-10T05:36:17.637551+0000","last_unstale":"2024-09-10T05:39:26.249618+0000","last_undegraded":"2024-09-10T05:39:26.249618+0000","last_fullsized":"2024-09-10T05:39:26.249618+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:28.684095+0000","last_change":"2024-09-10T05:36:19.670810+0000","last_active":"2024-09-10T05:38:28.684095+0000","last_peered":"2024-09-10T05:38:28.684095+0000","last_clean":"2024-09-10T05:38:28.684095+0000","last_became_active":"2024-09-10T05:36:19.669130+0000","last_became_peered":"2024-09-10T05:36:19.669130+0000","last_unstale":"2024-09-10T05:38:28.684095+0000","last_undegraded":"2024-09-10T05:38:28.684095+0000","last_fullsized":"2024-09-10T05:38:28.684095+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'6","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:32.688080+0000","last_change":"2024-09-10T05:36:21.672078+0000","last_active":"2024-09-10T05:38:32.688080+0000","last_peered":"2024-09-10T05:38:32.688080+0000","last_clean":"2024-09-10T05:38:32.688080+0000","last_became_active":"2024-09-10T05:36:21.671206+0000","last_became_peered":"2024-09-10T05:36:21.671206+0000","last_unstale":"2024-09-10T05:38:32.688080+0000","last_undegraded":"2024-09-10T05:38:32.688080+0000","last_fullsized":"2024-09-10T05:38:32.688080+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'4","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:22.094327+0000","last_change":"2024-09-10T05:40:22.094076+0000","last_active":"2024-09-10T05:40:22.094327+0000","last_peered":"2024-09-10T05:40:22.094327+0000","last_clean":"2024-09-10T05:40:22.094327+0000","last_became_active":"2024-09-10T05:36:13.611242+0000","last_became_peered":"2024-09-10T05:36:13.611242+0000","last_unstale":"2024-09-10T05:40:22.094327+0000","last_undegraded":"2024-09-10T05:40:22.094327+0000","last_fullsized":"2024-09-10T05:40:22.094327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:22.093836+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:22.093836+0000","last_clean_scrub_stamp":"2024-09-10T05:40:22.093836+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:16:04.536508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:10.404039+0000","last_change":"2024-09-10T05:40:10.403855+0000","last_active":"2024-09-10T05:40:10.404039+0000","last_peered":"2024-09-10T05:40:10.404039+0000","last_clean":"2024-09-10T05:40:10.404039+0000","last_became_active":"2024-09-10T05:36:11.604802+0000","last_became_peered":"2024-09-10T05:36:11.604802+0000","last_unstale":"2024-09-10T05:40:10.404039+0000","last_undegraded":"2024-09-10T05:40:10.404039+0000","last_fullsized":"2024-09-10T05:40:10.404039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:10.403675+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:10.403675+0000","last_clean_scrub_stamp":"2024-09-10T05:40:10.403675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:44:01.698908+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:03.095986+0000","last_change":"2024-09-10T05:40:03.095816+0000","last_active":"2024-09-10T05:40:03.095986+0000","last_peered":"2024-09-10T05:40:03.095986+0000","last_clean":"2024-09-10T05:40:03.095986+0000","last_became_active":"2024-09-10T05:36:03.705338+0000","last_became_peered":"2024-09-10T05:36:03.705338+0000","last_unstale":"2024-09-10T05:40:03.095986+0000","last_undegraded":"2024-09-10T05:40:03.095986+0000","last_fullsized":"2024-09-10T05:40:03.095986+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:03.095625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:03.095625+0000","last_clean_scrub_stamp":"2024-09-10T05:40:03.095625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:21.581455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010885789999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"34'2","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:30.543765+0000","last_change":"2024-09-10T05:40:30.543765+0000","last_active":"2024-09-10T05:40:30.543765+0000","last_peered":"2024-09-10T05:40:30.543765+0000","last_clean":"2024-09-10T05:40:30.543765+0000","last_became_active":"2024-09-10T05:36:15.618041+0000","last_became_peered":"2024-09-10T05:36:15.618041+0000","last_unstale":"2024-09-10T05:40:30.543765+0000","last_undegraded":"2024-09-10T05:40:30.543765+0000","last_fullsized":"2024-09-10T05:40:30.543765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:30.543571+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:30.543571+0000","last_clean_scrub_stamp":"2024-09-10T05:40:30.543571+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:04:23.896422+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"34'81","reported_seq":166,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.603770+0000","last_change":"2024-09-10T05:36:17.654376+0000","last_active":"2024-09-10T05:39:58.603770+0000","last_peered":"2024-09-10T05:39:58.603770+0000","last_clean":"2024-09-10T05:39:58.603770+0000","last_became_active":"2024-09-10T05:36:17.653627+0000","last_became_peered":"2024-09-10T05:36:17.653627+0000","last_unstale":"2024-09-10T05:39:58.603770+0000","last_undegraded":"2024-09-10T05:39:58.603770+0000","last_fullsized":"2024-09-10T05:39:58.603770+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":94,"num_read_kb":88,"num_write":46,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:27.689376+0000","last_change":"2024-09-10T05:36:19.650800+0000","last_active":"2024-09-10T05:38:27.689376+0000","last_peered":"2024-09-10T05:38:27.689376+0000","last_clean":"2024-09-10T05:38:27.689376+0000","last_became_active":"2024-09-10T05:36:19.650115+0000","last_became_peered":"2024-09-10T05:36:19.650115+0000","last_unstale":"2024-09-10T05:38:27.689376+0000","last_undegraded":"2024-09-10T05:38:27.689376+0000","last_fullsized":"2024-09-10T05:38:27.689376+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"34'9","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:26.048065+0000","last_change":"2024-09-10T05:36:21.689033+0000","last_active":"2024-09-10T05:38:26.048065+0000","last_peered":"2024-09-10T05:38:26.048065+0000","last_clean":"2024-09-10T05:38:26.048065+0000","last_became_active":"2024-09-10T05:36:21.687744+0000","last_became_peered":"2024-09-10T05:36:21.687744+0000","last_unstale":"2024-09-10T05:38:26.048065+0000","last_undegraded":"2024-09-10T05:38:26.048065+0000","last_fullsized":"2024-09-10T05:38:26.048065+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:05:42.167772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"32'6","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:20.043583+0000","last_change":"2024-09-10T05:40:20.043416+0000","last_active":"2024-09-10T05:40:20.043583+0000","last_peered":"2024-09-10T05:40:20.043583+0000","last_clean":"2024-09-10T05:40:20.043583+0000","last_became_active":"2024-09-10T05:36:13.617814+0000","last_became_peered":"2024-09-10T05:36:13.617814+0000","last_unstale":"2024-09-10T05:40:20.043583+0000","last_undegraded":"2024-09-10T05:40:20.043583+0000","last_fullsized":"2024-09-10T05:40:20.043583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-10T05:40:20.043232+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-10T05:40:20.043232+0000","last_clean_scrub_stamp":"2024-09-10T05:40:20.043232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:12.310111+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:08.043171+0000","last_change":"2024-09-10T05:40:08.043044+0000","last_active":"2024-09-10T05:40:08.043171+0000","last_peered":"2024-09-10T05:40:08.043171+0000","last_clean":"2024-09-10T05:40:08.043171+0000","last_became_active":"2024-09-10T05:36:11.595349+0000","last_became_peered":"2024-09-10T05:36:11.595349+0000","last_unstale":"2024-09-10T05:40:08.043171+0000","last_undegraded":"2024-09-10T05:40:08.043171+0000","last_fullsized":"2024-09-10T05:40:08.043171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:08.042856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:08.042856+0000","last_clean_scrub_stamp":"2024-09-10T05:40:08.042856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:15:37.792723+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:05.325390+0000","last_change":"2024-09-10T05:40:05.325151+0000","last_active":"2024-09-10T05:40:05.325390+0000","last_peered":"2024-09-10T05:40:05.325390+0000","last_clean":"2024-09-10T05:40:05.325390+0000","last_became_active":"2024-09-10T05:36:03.709534+0000","last_became_peered":"2024-09-10T05:36:03.709534+0000","last_unstale":"2024-09-10T05:40:05.325390+0000","last_undegraded":"2024-09-10T05:40:05.325390+0000","last_fullsized":"2024-09-10T05:40:05.325390+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:05.324950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:05.324950+0000","last_clean_scrub_stamp":"2024-09-10T05:40:05.324950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:04:00.453210+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0022338829999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:22.688196+0000","last_change":"2024-09-10T05:36:15.619244+0000","last_active":"2024-09-10T05:38:22.688196+0000","last_peered":"2024-09-10T05:38:22.688196+0000","last_clean":"2024-09-10T05:38:22.688196+0000","last_became_active":"2024-09-10T05:36:15.618491+0000","last_became_peered":"2024-09-10T05:36:15.618491+0000","last_unstale":"2024-09-10T05:38:22.688196+0000","last_undegraded":"2024-09-10T05:38:22.688196+0000","last_fullsized":"2024-09-10T05:38:22.688196+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"30'20","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:22.685974+0000","last_change":"2024-09-10T05:36:17.658105+0000","last_active":"2024-09-10T05:38:22.685974+0000","last_peered":"2024-09-10T05:38:22.685974+0000","last_clean":"2024-09-10T05:38:22.685974+0000","last_became_active":"2024-09-10T05:36:17.657112+0000","last_became_peered":"2024-09-10T05:36:17.657112+0000","last_unstale":"2024-09-10T05:38:22.685974+0000","last_undegraded":"2024-09-10T05:38:22.685974+0000","last_fullsized":"2024-09-10T05:38:22.685974+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'285","reported_seq":365,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.752461+0000","last_change":"2024-09-10T05:36:19.649214+0000","last_active":"2024-09-10T05:39:58.752461+0000","last_peered":"2024-09-10T05:39:58.752461+0000","last_clean":"2024-09-10T05:39:58.752461+0000","last_became_active":"2024-09-10T05:36:19.643319+0000","last_became_peered":"2024-09-10T05:36:19.643319+0000","last_unstale":"2024-09-10T05:39:58.752461+0000","last_undegraded":"2024-09-10T05:39:58.752461+0000","last_fullsized":"2024-09-10T05:39:58.752461+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"30'2","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.729162+0000","last_change":"2024-09-10T05:36:21.692062+0000","last_active":"2024-09-10T05:37:53.729162+0000","last_peered":"2024-09-10T05:37:53.729162+0000","last_clean":"2024-09-10T05:37:53.729162+0000","last_became_active":"2024-09-10T05:36:21.691590+0000","last_became_peered":"2024-09-10T05:36:21.691590+0000","last_unstale":"2024-09-10T05:37:53.729162+0000","last_undegraded":"2024-09-10T05:37:53.729162+0000","last_fullsized":"2024-09-10T05:37:53.729162+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:43:35.691961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:21.866611+0000","last_change":"2024-09-10T05:40:21.866611+0000","last_active":"2024-09-10T05:40:21.866611+0000","last_peered":"2024-09-10T05:40:21.866611+0000","last_clean":"2024-09-10T05:40:21.866611+0000","last_became_active":"2024-09-10T05:36:13.607367+0000","last_became_peered":"2024-09-10T05:36:13.607367+0000","last_unstale":"2024-09-10T05:40:21.866611+0000","last_undegraded":"2024-09-10T05:40:21.866611+0000","last_fullsized":"2024-09-10T05:40:21.866611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T05:40:21.866434+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T05:40:21.866434+0000","last_clean_scrub_stamp":"2024-09-10T05:40:21.866434+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:46.440442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:04.718942+0000","last_change":"2024-09-10T05:40:04.718781+0000","last_active":"2024-09-10T05:40:04.718942+0000","last_peered":"2024-09-10T05:40:04.718942+0000","last_clean":"2024-09-10T05:40:04.718942+0000","last_became_active":"2024-09-10T05:36:11.606234+0000","last_became_peered":"2024-09-10T05:36:11.606234+0000","last_unstale":"2024-09-10T05:40:04.718942+0000","last_undegraded":"2024-09-10T05:40:04.718942+0000","last_fullsized":"2024-09-10T05:40:04.718942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:04.718605+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:04.718605+0000","last_clean_scrub_stamp":"2024-09-10T05:40:04.718605+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:24:19.567951+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:05.070657+0000","last_change":"2024-09-10T05:40:05.070401+0000","last_active":"2024-09-10T05:40:05.070657+0000","last_peered":"2024-09-10T05:40:05.070657+0000","last_clean":"2024-09-10T05:40:05.070657+0000","last_became_active":"2024-09-10T05:36:03.705038+0000","last_became_peered":"2024-09-10T05:36:03.705038+0000","last_unstale":"2024-09-10T05:40:05.070657+0000","last_undegraded":"2024-09-10T05:40:05.070657+0000","last_fullsized":"2024-09-10T05:40:05.070657+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:05.070198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:05.070198+0000","last_clean_scrub_stamp":"2024-09-10T05:40:05.070198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:41:09.633680+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00126935,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:42.450239+0000","last_change":"2024-09-10T05:40:42.450239+0000","last_active":"2024-09-10T05:40:42.450239+0000","last_peered":"2024-09-10T05:40:42.450239+0000","last_clean":"2024-09-10T05:40:42.450239+0000","last_became_active":"2024-09-10T05:36:15.617690+0000","last_became_peered":"2024-09-10T05:36:15.617690+0000","last_unstale":"2024-09-10T05:40:42.450239+0000","last_undegraded":"2024-09-10T05:40:42.450239+0000","last_fullsized":"2024-09-10T05:40:42.450239+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:42.450063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:42.450063+0000","last_clean_scrub_stamp":"2024-09-10T05:40:42.450063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:29:06.495558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"30'16","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:23.682463+0000","last_change":"2024-09-10T05:36:17.635256+0000","last_active":"2024-09-10T05:38:23.682463+0000","last_peered":"2024-09-10T05:38:23.682463+0000","last_clean":"2024-09-10T05:38:23.682463+0000","last_became_active":"2024-09-10T05:36:17.634261+0000","last_became_peered":"2024-09-10T05:36:17.634261+0000","last_unstale":"2024-09-10T05:38:23.682463+0000","last_undegraded":"2024-09-10T05:38:23.682463+0000","last_fullsized":"2024-09-10T05:38:23.682463+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'285","reported_seq":439,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.763055+0000","last_change":"2024-09-10T05:36:19.673204+0000","last_active":"2024-09-10T05:39:58.763055+0000","last_peered":"2024-09-10T05:39:58.763055+0000","last_clean":"2024-09-10T05:39:58.763055+0000","last_became_active":"2024-09-10T05:36:19.672586+0000","last_became_peered":"2024-09-10T05:36:19.672586+0000","last_unstale":"2024-09-10T05:39:58.763055+0000","last_undegraded":"2024-09-10T05:39:58.763055+0000","last_fullsized":"2024-09-10T05:39:58.763055+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.853637+0000","last_change":"2024-09-10T05:36:21.670112+0000","last_active":"2024-09-10T05:37:53.853637+0000","last_peered":"2024-09-10T05:37:53.853637+0000","last_clean":"2024-09-10T05:37:53.853637+0000","last_became_active":"2024-09-10T05:36:21.668909+0000","last_became_peered":"2024-09-10T05:36:21.668909+0000","last_unstale":"2024-09-10T05:37:53.853637+0000","last_undegraded":"2024-09-10T05:37:53.853637+0000","last_fullsized":"2024-09-10T05:37:53.853637+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:37:35.984330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'14","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:14.474283+0000","last_change":"2024-09-10T05:40:14.474129+0000","last_active":"2024-09-10T05:40:14.474283+0000","last_peered":"2024-09-10T05:40:14.474283+0000","last_clean":"2024-09-10T05:40:14.474283+0000","last_became_active":"2024-09-10T05:36:13.621703+0000","last_became_peered":"2024-09-10T05:36:13.621703+0000","last_unstale":"2024-09-10T05:40:14.474283+0000","last_undegraded":"2024-09-10T05:40:14.474283+0000","last_fullsized":"2024-09-10T05:40:14.474283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-10T05:40:14.473954+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-10T05:40:14.473954+0000","last_clean_scrub_stamp":"2024-09-10T05:40:14.473954+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:27.797592+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:08.998572+0000","last_change":"2024-09-10T05:40:08.998414+0000","last_active":"2024-09-10T05:40:08.998572+0000","last_peered":"2024-09-10T05:40:08.998572+0000","last_clean":"2024-09-10T05:40:08.998572+0000","last_became_active":"2024-09-10T05:36:11.594029+0000","last_became_peered":"2024-09-10T05:36:11.594029+0000","last_unstale":"2024-09-10T05:40:08.998572+0000","last_undegraded":"2024-09-10T05:40:08.998572+0000","last_fullsized":"2024-09-10T05:40:08.998572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:08.998240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:08.998240+0000","last_clean_scrub_stamp":"2024-09-10T05:40:08.998240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:40.972877+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:06.349490+0000","last_change":"2024-09-10T05:40:06.349353+0000","last_active":"2024-09-10T05:40:06.349490+0000","last_peered":"2024-09-10T05:40:06.349490+0000","last_clean":"2024-09-10T05:40:06.349490+0000","last_became_active":"2024-09-10T05:36:03.708884+0000","last_became_peered":"2024-09-10T05:36:03.708884+0000","last_unstale":"2024-09-10T05:40:06.349490+0000","last_undegraded":"2024-09-10T05:40:06.349490+0000","last_fullsized":"2024-09-10T05:40:06.349490+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:06.349170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:06.349170+0000","last_clean_scrub_stamp":"2024-09-10T05:40:06.349170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:46:31.673889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018824390000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:39.857195+0000","last_change":"2024-09-10T05:40:39.857195+0000","last_active":"2024-09-10T05:40:39.857195+0000","last_peered":"2024-09-10T05:40:39.857195+0000","last_clean":"2024-09-10T05:40:39.857195+0000","last_became_active":"2024-09-10T05:36:15.637890+0000","last_became_peered":"2024-09-10T05:36:15.637890+0000","last_unstale":"2024-09-10T05:40:39.857195+0000","last_undegraded":"2024-09-10T05:40:39.857195+0000","last_fullsized":"2024-09-10T05:40:39.857195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:39.856991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:39.856991+0000","last_clean_scrub_stamp":"2024-09-10T05:40:39.856991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:38:38.940634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'97","reported_seq":193,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.722977+0000","last_change":"2024-09-10T05:36:17.632261+0000","last_active":"2024-09-10T05:39:58.722977+0000","last_peered":"2024-09-10T05:39:58.722977+0000","last_clean":"2024-09-10T05:39:58.722977+0000","last_became_active":"2024-09-10T05:36:17.631509+0000","last_became_peered":"2024-09-10T05:36:17.631509+0000","last_unstale":"2024-09-10T05:39:58.722977+0000","last_undegraded":"2024-09-10T05:39:58.722977+0000","last_fullsized":"2024-09-10T05:39:58.722977+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:23.682424+0000","last_change":"2024-09-10T05:36:19.668038+0000","last_active":"2024-09-10T05:38:23.682424+0000","last_peered":"2024-09-10T05:38:23.682424+0000","last_clean":"2024-09-10T05:38:23.682424+0000","last_became_active":"2024-09-10T05:36:19.667446+0000","last_became_peered":"2024-09-10T05:36:19.667446+0000","last_unstale":"2024-09-10T05:38:23.682424+0000","last_undegraded":"2024-09-10T05:38:23.682424+0000","last_fullsized":"2024-09-10T05:38:23.682424+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.713880+0000","last_change":"2024-09-10T05:36:21.658395+0000","last_active":"2024-09-10T05:37:53.713880+0000","last_peered":"2024-09-10T05:37:53.713880+0000","last_clean":"2024-09-10T05:37:53.713880+0000","last_became_active":"2024-09-10T05:36:21.657621+0000","last_became_peered":"2024-09-10T05:36:21.657621+0000","last_unstale":"2024-09-10T05:37:53.713880+0000","last_undegraded":"2024-09-10T05:37:53.713880+0000","last_fullsized":"2024-09-10T05:37:53.713880+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:09.853561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"32'8","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:27.681632+0000","last_change":"2024-09-10T05:36:21.657351+0000","last_active":"2024-09-10T05:38:27.681632+0000","last_peered":"2024-09-10T05:38:27.681632+0000","last_clean":"2024-09-10T05:38:27.681632+0000","last_became_active":"2024-09-10T05:36:21.656563+0000","last_became_peered":"2024-09-10T05:36:21.656563+0000","last_unstale":"2024-09-10T05:38:27.681632+0000","last_undegraded":"2024-09-10T05:38:27.681632+0000","last_fullsized":"2024-09-10T05:38:27.681632+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:21.547908+0000","last_change":"2024-09-10T05:40:21.547908+0000","last_active":"2024-09-10T05:40:21.547908+0000","last_peered":"2024-09-10T05:40:21.547908+0000","last_clean":"2024-09-10T05:40:21.547908+0000","last_became_active":"2024-09-10T05:36:13.620892+0000","last_became_peered":"2024-09-10T05:36:13.620892+0000","last_unstale":"2024-09-10T05:40:21.547908+0000","last_undegraded":"2024-09-10T05:40:21.547908+0000","last_fullsized":"2024-09-10T05:40:21.547908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:21.547721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:21.547721+0000","last_clean_scrub_stamp":"2024-09-10T05:40:21.547721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:53:21.051292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'6","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:16.412389+0000","last_change":"2024-09-10T05:40:16.412389+0000","last_active":"2024-09-10T05:40:16.412389+0000","last_peered":"2024-09-10T05:40:16.412389+0000","last_clean":"2024-09-10T05:40:16.412389+0000","last_became_active":"2024-09-10T05:36:11.597209+0000","last_became_peered":"2024-09-10T05:36:11.597209+0000","last_unstale":"2024-09-10T05:40:16.412389+0000","last_undegraded":"2024-09-10T05:40:16.412389+0000","last_fullsized":"2024-09-10T05:40:16.412389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T05:40:16.412205+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T05:40:16.412205+0000","last_clean_scrub_stamp":"2024-09-10T05:40:16.412205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:16.536426+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:41.154583+0000","last_change":"2024-09-10T05:40:41.154583+0000","last_active":"2024-09-10T05:40:41.154583+0000","last_peered":"2024-09-10T05:40:41.154583+0000","last_clean":"2024-09-10T05:40:41.154583+0000","last_became_active":"2024-09-10T05:36:15.617049+0000","last_became_peered":"2024-09-10T05:36:15.617049+0000","last_unstale":"2024-09-10T05:40:41.154583+0000","last_undegraded":"2024-09-10T05:40:41.154583+0000","last_fullsized":"2024-09-10T05:40:41.154583+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:41.154403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:41.154403+0000","last_clean_scrub_stamp":"2024-09-10T05:40:41.154403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:08.337788+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'41","reported_seq":99,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.519835+0000","last_change":"2024-09-10T05:36:17.658656+0000","last_active":"2024-09-10T05:39:58.519835+0000","last_peered":"2024-09-10T05:39:58.519835+0000","last_clean":"2024-09-10T05:39:58.519835+0000","last_became_active":"2024-09-10T05:36:17.657669+0000","last_became_peered":"2024-09-10T05:36:17.657669+0000","last_unstale":"2024-09-10T05:39:58.519835+0000","last_undegraded":"2024-09-10T05:39:58.519835+0000","last_fullsized":"2024-09-10T05:39:58.519835+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:39.765543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.724025+0000","last_change":"2024-09-10T05:36:19.673156+0000","last_active":"2024-09-10T05:37:53.724025+0000","last_peered":"2024-09-10T05:37:53.724025+0000","last_clean":"2024-09-10T05:37:53.724025+0000","last_became_active":"2024-09-10T05:36:19.672498+0000","last_became_peered":"2024-09-10T05:36:19.672498+0000","last_unstale":"2024-09-10T05:37:53.724025+0000","last_undegraded":"2024-09-10T05:37:53.724025+0000","last_fullsized":"2024-09-10T05:37:53.724025+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:27:09.531398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'5","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:23.682676+0000","last_change":"2024-09-10T05:36:21.689435+0000","last_active":"2024-09-10T05:38:23.682676+0000","last_peered":"2024-09-10T05:38:23.682676+0000","last_clean":"2024-09-10T05:38:23.682676+0000","last_became_active":"2024-09-10T05:36:21.688864+0000","last_became_peered":"2024-09-10T05:36:21.688864+0000","last_unstale":"2024-09-10T05:38:23.682676+0000","last_undegraded":"2024-09-10T05:38:23.682676+0000","last_fullsized":"2024-09-10T05:38:23.682676+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"34'10","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:25.204938+0000","last_change":"2024-09-10T05:40:25.204938+0000","last_active":"2024-09-10T05:40:25.204938+0000","last_peered":"2024-09-10T05:40:25.204938+0000","last_clean":"2024-09-10T05:40:25.204938+0000","last_became_active":"2024-09-10T05:36:13.610883+0000","last_became_peered":"2024-09-10T05:36:13.610883+0000","last_unstale":"2024-09-10T05:40:25.204938+0000","last_undegraded":"2024-09-10T05:40:25.204938+0000","last_fullsized":"2024-09-10T05:40:25.204938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-10T05:40:25.204764+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-10T05:40:25.204764+0000","last_clean_scrub_stamp":"2024-09-10T05:40:25.204764+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:35:50.293206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:06.519495+0000","last_change":"2024-09-10T05:40:06.519495+0000","last_active":"2024-09-10T05:40:06.519495+0000","last_peered":"2024-09-10T05:40:06.519495+0000","last_clean":"2024-09-10T05:40:06.519495+0000","last_became_active":"2024-09-10T05:36:11.605259+0000","last_became_peered":"2024-09-10T05:36:11.605259+0000","last_unstale":"2024-09-10T05:40:06.519495+0000","last_undegraded":"2024-09-10T05:40:06.519495+0000","last_fullsized":"2024-09-10T05:40:06.519495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:06.519303+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:06.519303+0000","last_clean_scrub_stamp":"2024-09-10T05:40:06.519303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:41:27.502766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:42.886806+0000","last_change":"2024-09-10T05:40:42.886806+0000","last_active":"2024-09-10T05:40:42.886806+0000","last_peered":"2024-09-10T05:40:42.886806+0000","last_clean":"2024-09-10T05:40:42.886806+0000","last_became_active":"2024-09-10T05:36:15.629278+0000","last_became_peered":"2024-09-10T05:36:15.629278+0000","last_unstale":"2024-09-10T05:40:42.886806+0000","last_undegraded":"2024-09-10T05:40:42.886806+0000","last_fullsized":"2024-09-10T05:40:42.886806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:42.886628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:42.886628+0000","last_clean_scrub_stamp":"2024-09-10T05:40:42.886628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:03:03.609286+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'6","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.226218+0000","last_change":"2024-09-10T05:36:17.652832+0000","last_active":"2024-09-10T05:39:26.226218+0000","last_peered":"2024-09-10T05:39:26.226218+0000","last_clean":"2024-09-10T05:39:26.226218+0000","last_became_active":"2024-09-10T05:36:17.648835+0000","last_became_peered":"2024-09-10T05:36:17.648835+0000","last_unstale":"2024-09-10T05:39:26.226218+0000","last_undegraded":"2024-09-10T05:39:26.226218+0000","last_fullsized":"2024-09-10T05:39:26.226218+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:46.589507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.711967+0000","last_change":"2024-09-10T05:36:19.638688+0000","last_active":"2024-09-10T05:37:53.711967+0000","last_peered":"2024-09-10T05:37:53.711967+0000","last_clean":"2024-09-10T05:37:53.711967+0000","last_became_active":"2024-09-10T05:36:19.637912+0000","last_became_peered":"2024-09-10T05:36:19.637912+0000","last_unstale":"2024-09-10T05:37:53.711967+0000","last_undegraded":"2024-09-10T05:37:53.711967+0000","last_fullsized":"2024-09-10T05:37:53.711967+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:25:54.923848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.854267+0000","last_change":"2024-09-10T05:36:21.668904+0000","last_active":"2024-09-10T05:37:53.854267+0000","last_peered":"2024-09-10T05:37:53.854267+0000","last_clean":"2024-09-10T05:37:53.854267+0000","last_became_active":"2024-09-10T05:36:21.666877+0000","last_became_peered":"2024-09-10T05:36:21.666877+0000","last_unstale":"2024-09-10T05:37:53.854267+0000","last_undegraded":"2024-09-10T05:37:53.854267+0000","last_fullsized":"2024-09-10T05:37:53.854267+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:43:13.848554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"34'4","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:26.838639+0000","last_change":"2024-09-10T05:40:26.838639+0000","last_active":"2024-09-10T05:40:26.838639+0000","last_peered":"2024-09-10T05:40:26.838639+0000","last_clean":"2024-09-10T05:40:26.838639+0000","last_became_active":"2024-09-10T05:36:13.597857+0000","last_became_peered":"2024-09-10T05:36:13.597857+0000","last_unstale":"2024-09-10T05:40:26.838639+0000","last_undegraded":"2024-09-10T05:40:26.838639+0000","last_fullsized":"2024-09-10T05:40:26.838639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:26.838457+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:26.838457+0000","last_clean_scrub_stamp":"2024-09-10T05:40:26.838457+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:01:18.916559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:14.332224+0000","last_change":"2024-09-10T05:40:14.332224+0000","last_active":"2024-09-10T05:40:14.332224+0000","last_peered":"2024-09-10T05:40:14.332224+0000","last_clean":"2024-09-10T05:40:14.332224+0000","last_became_active":"2024-09-10T05:36:11.600603+0000","last_became_peered":"2024-09-10T05:36:11.600603+0000","last_unstale":"2024-09-10T05:40:14.332224+0000","last_undegraded":"2024-09-10T05:40:14.332224+0000","last_fullsized":"2024-09-10T05:40:14.332224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:14.332052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:14.332052+0000","last_clean_scrub_stamp":"2024-09-10T05:40:14.332052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:20:12.250167+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.900977+0000","last_change":"2024-09-10T05:36:15.638682+0000","last_active":"2024-09-10T05:37:55.900977+0000","last_peered":"2024-09-10T05:37:55.900977+0000","last_clean":"2024-09-10T05:37:55.900977+0000","last_became_active":"2024-09-10T05:36:15.638197+0000","last_became_peered":"2024-09-10T05:36:15.638197+0000","last_unstale":"2024-09-10T05:37:55.900977+0000","last_undegraded":"2024-09-10T05:37:55.900977+0000","last_fullsized":"2024-09-10T05:37:55.900977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:53:28.099101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"34'44","reported_seq":112,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.728639+0000","last_change":"2024-09-10T05:36:17.647135+0000","last_active":"2024-09-10T05:39:58.728639+0000","last_peered":"2024-09-10T05:39:58.728639+0000","last_clean":"2024-09-10T05:39:58.728639+0000","last_became_active":"2024-09-10T05:36:17.646459+0000","last_became_peered":"2024-09-10T05:36:17.646459+0000","last_unstale":"2024-09-10T05:39:58.728639+0000","last_undegraded":"2024-09-10T05:39:58.728639+0000","last_fullsized":"2024-09-10T05:39:58.728639+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:25:06.130753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.852746+0000","last_change":"2024-09-10T05:36:19.654869+0000","last_active":"2024-09-10T05:37:53.852746+0000","last_peered":"2024-09-10T05:37:53.852746+0000","last_clean":"2024-09-10T05:37:53.852746+0000","last_became_active":"2024-09-10T05:36:19.648608+0000","last_became_peered":"2024-09-10T05:36:19.648608+0000","last_unstale":"2024-09-10T05:37:53.852746+0000","last_undegraded":"2024-09-10T05:37:53.852746+0000","last_fullsized":"2024-09-10T05:37:53.852746+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:00.797025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.723161+0000","last_change":"2024-09-10T05:36:21.684218+0000","last_active":"2024-09-10T05:37:53.723161+0000","last_peered":"2024-09-10T05:37:53.723161+0000","last_clean":"2024-09-10T05:37:53.723161+0000","last_became_active":"2024-09-10T05:36:21.683406+0000","last_became_peered":"2024-09-10T05:36:21.683406+0000","last_unstale":"2024-09-10T05:37:53.723161+0000","last_undegraded":"2024-09-10T05:37:53.723161+0000","last_fullsized":"2024-09-10T05:37:53.723161+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:58:10.494998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'4","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:28.800763+0000","last_change":"2024-09-10T05:40:28.800763+0000","last_active":"2024-09-10T05:40:28.800763+0000","last_peered":"2024-09-10T05:40:28.800763+0000","last_clean":"2024-09-10T05:40:28.800763+0000","last_became_active":"2024-09-10T05:36:13.606903+0000","last_became_peered":"2024-09-10T05:36:13.606903+0000","last_unstale":"2024-09-10T05:40:28.800763+0000","last_undegraded":"2024-09-10T05:40:28.800763+0000","last_fullsized":"2024-09-10T05:40:28.800763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:28.800520+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:28.800520+0000","last_clean_scrub_stamp":"2024-09-10T05:40:28.800520+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:47:09.736656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:11.044271+0000","last_change":"2024-09-10T05:40:11.044271+0000","last_active":"2024-09-10T05:40:11.044271+0000","last_peered":"2024-09-10T05:40:11.044271+0000","last_clean":"2024-09-10T05:40:11.044271+0000","last_became_active":"2024-09-10T05:36:11.594653+0000","last_became_peered":"2024-09-10T05:36:11.594653+0000","last_unstale":"2024-09-10T05:40:11.044271+0000","last_undegraded":"2024-09-10T05:40:11.044271+0000","last_fullsized":"2024-09-10T05:40:11.044271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:11.044085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:11.044085+0000","last_clean_scrub_stamp":"2024-09-10T05:40:11.044085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:34.806153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"34'7","reported_seq":434,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:41.856554+0000","last_change":"2024-09-10T05:40:41.856554+0000","last_active":"2024-09-10T05:40:41.856554+0000","last_peered":"2024-09-10T05:40:41.856554+0000","last_clean":"2024-09-10T05:40:41.856554+0000","last_became_active":"2024-09-10T05:36:15.615147+0000","last_became_peered":"2024-09-10T05:36:15.615147+0000","last_unstale":"2024-09-10T05:40:41.856554+0000","last_undegraded":"2024-09-10T05:40:41.856554+0000","last_fullsized":"2024-09-10T05:40:41.856554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-10T05:40:41.856356+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-10T05:40:41.856356+0000","last_clean_scrub_stamp":"2024-09-10T05:40:41.856356+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:35.810677+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1429,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":586,"num_read_kb":586,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'33","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.698482+0000","last_change":"2024-09-10T05:36:17.632006+0000","last_active":"2024-09-10T05:39:58.698482+0000","last_peered":"2024-09-10T05:39:58.698482+0000","last_clean":"2024-09-10T05:39:58.698482+0000","last_became_active":"2024-09-10T05:36:17.631446+0000","last_became_peered":"2024-09-10T05:36:17.631446+0000","last_unstale":"2024-09-10T05:39:58.698482+0000","last_undegraded":"2024-09-10T05:39:58.698482+0000","last_fullsized":"2024-09-10T05:39:58.698482+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:30.388651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.715083+0000","last_change":"2024-09-10T05:36:19.639207+0000","last_active":"2024-09-10T05:37:53.715083+0000","last_peered":"2024-09-10T05:37:53.715083+0000","last_clean":"2024-09-10T05:37:53.715083+0000","last_became_active":"2024-09-10T05:36:19.638240+0000","last_became_peered":"2024-09-10T05:36:19.638240+0000","last_unstale":"2024-09-10T05:37:53.715083+0000","last_undegraded":"2024-09-10T05:37:53.715083+0000","last_fullsized":"2024-09-10T05:37:53.715083+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:39:50.347393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'8","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:25.365276+0000","last_change":"2024-09-10T05:40:25.365276+0000","last_active":"2024-09-10T05:40:25.365276+0000","last_peered":"2024-09-10T05:40:25.365276+0000","last_clean":"2024-09-10T05:40:25.365276+0000","last_became_active":"2024-09-10T05:36:13.618656+0000","last_became_peered":"2024-09-10T05:36:13.618656+0000","last_unstale":"2024-09-10T05:40:25.365276+0000","last_undegraded":"2024-09-10T05:40:25.365276+0000","last_fullsized":"2024-09-10T05:40:25.365276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T05:40:25.365088+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T05:40:25.365088+0000","last_clean_scrub_stamp":"2024-09-10T05:40:25.365088+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:55:23.978163+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:08.688775+0000","last_change":"2024-09-10T05:40:08.688775+0000","last_active":"2024-09-10T05:40:08.688775+0000","last_peered":"2024-09-10T05:40:08.688775+0000","last_clean":"2024-09-10T05:40:08.688775+0000","last_became_active":"2024-09-10T05:36:11.597710+0000","last_became_peered":"2024-09-10T05:36:11.597710+0000","last_unstale":"2024-09-10T05:40:08.688775+0000","last_undegraded":"2024-09-10T05:40:08.688775+0000","last_fullsized":"2024-09-10T05:40:08.688775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:08.688601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:08.688601+0000","last_clean_scrub_stamp":"2024-09-10T05:40:08.688601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:22:28.106904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:17.685265+0000","last_change":"2024-09-10T05:36:15.627731+0000","last_active":"2024-09-10T05:38:17.685265+0000","last_peered":"2024-09-10T05:38:17.685265+0000","last_clean":"2024-09-10T05:38:17.685265+0000","last_became_active":"2024-09-10T05:36:15.626787+0000","last_became_peered":"2024-09-10T05:36:15.626787+0000","last_unstale":"2024-09-10T05:38:17.685265+0000","last_undegraded":"2024-09-10T05:38:17.685265+0000","last_fullsized":"2024-09-10T05:38:17.685265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"34'66","reported_seq":141,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.686492+0000","last_change":"2024-09-10T05:36:17.645250+0000","last_active":"2024-09-10T05:39:58.686492+0000","last_peered":"2024-09-10T05:39:58.686492+0000","last_clean":"2024-09-10T05:39:58.686492+0000","last_became_active":"2024-09-10T05:36:17.644469+0000","last_became_peered":"2024-09-10T05:36:17.644469+0000","last_unstale":"2024-09-10T05:39:58.686492+0000","last_undegraded":"2024-09-10T05:39:58.686492+0000","last_fullsized":"2024-09-10T05:39:58.686492+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:35.181585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.715316+0000","last_change":"2024-09-10T05:36:19.639542+0000","last_active":"2024-09-10T05:37:53.715316+0000","last_peered":"2024-09-10T05:37:53.715316+0000","last_clean":"2024-09-10T05:37:53.715316+0000","last_became_active":"2024-09-10T05:36:19.638136+0000","last_became_peered":"2024-09-10T05:36:19.638136+0000","last_unstale":"2024-09-10T05:37:53.715316+0000","last_undegraded":"2024-09-10T05:37:53.715316+0000","last_fullsized":"2024-09-10T05:37:53.715316+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:15:07.235287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'14","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:26.038899+0000","last_change":"2024-09-10T05:36:21.682080+0000","last_active":"2024-09-10T05:38:26.038899+0000","last_peered":"2024-09-10T05:38:26.038899+0000","last_clean":"2024-09-10T05:38:26.038899+0000","last_became_active":"2024-09-10T05:36:21.681263+0000","last_became_peered":"2024-09-10T05:36:21.681263+0000","last_unstale":"2024-09-10T05:38:26.038899+0000","last_undegraded":"2024-09-10T05:38:26.038899+0000","last_fullsized":"2024-09-10T05:38:26.038899+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:35:30.867304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"34'10","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:26.215448+0000","last_change":"2024-09-10T05:40:26.215448+0000","last_active":"2024-09-10T05:40:26.215448+0000","last_peered":"2024-09-10T05:40:26.215448+0000","last_clean":"2024-09-10T05:40:26.215448+0000","last_became_active":"2024-09-10T05:36:13.609773+0000","last_became_peered":"2024-09-10T05:36:13.609773+0000","last_unstale":"2024-09-10T05:40:26.215448+0000","last_undegraded":"2024-09-10T05:40:26.215448+0000","last_fullsized":"2024-09-10T05:40:26.215448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-10T05:40:26.215272+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-10T05:40:26.215272+0000","last_clean_scrub_stamp":"2024-09-10T05:40:26.215272+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:04:21.343533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:10.048126+0000","last_change":"2024-09-10T05:40:10.048126+0000","last_active":"2024-09-10T05:40:10.048126+0000","last_peered":"2024-09-10T05:40:10.048126+0000","last_clean":"2024-09-10T05:40:10.048126+0000","last_became_active":"2024-09-10T05:36:11.595758+0000","last_became_peered":"2024-09-10T05:36:11.595758+0000","last_unstale":"2024-09-10T05:40:10.048126+0000","last_undegraded":"2024-09-10T05:40:10.048126+0000","last_fullsized":"2024-09-10T05:40:10.048126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:10.047905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:10.047905+0000","last_clean_scrub_stamp":"2024-09-10T05:40:10.047905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:36:54.103088+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:22.688448+0000","last_change":"2024-09-10T05:36:15.614782+0000","last_active":"2024-09-10T05:38:22.688448+0000","last_peered":"2024-09-10T05:38:22.688448+0000","last_clean":"2024-09-10T05:38:22.688448+0000","last_became_active":"2024-09-10T05:36:15.613949+0000","last_became_peered":"2024-09-10T05:36:15.613949+0000","last_unstale":"2024-09-10T05:38:22.688448+0000","last_undegraded":"2024-09-10T05:38:22.688448+0000","last_fullsized":"2024-09-10T05:38:22.688448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"34'39","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.709345+0000","last_change":"2024-09-10T05:36:17.637253+0000","last_active":"2024-09-10T05:39:58.709345+0000","last_peered":"2024-09-10T05:39:58.709345+0000","last_clean":"2024-09-10T05:39:58.709345+0000","last_became_active":"2024-09-10T05:36:17.636067+0000","last_became_peered":"2024-09-10T05:36:17.636067+0000","last_unstale":"2024-09-10T05:39:58.709345+0000","last_undegraded":"2024-09-10T05:39:58.709345+0000","last_fullsized":"2024-09-10T05:39:58.709345+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:27:48.471606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.856515+0000","last_change":"2024-09-10T05:36:19.665827+0000","last_active":"2024-09-10T05:37:53.856515+0000","last_peered":"2024-09-10T05:37:53.856515+0000","last_clean":"2024-09-10T05:37:53.856515+0000","last_became_active":"2024-09-10T05:36:19.665010+0000","last_became_peered":"2024-09-10T05:36:19.665010+0000","last_unstale":"2024-09-10T05:37:53.856515+0000","last_undegraded":"2024-09-10T05:37:53.856515+0000","last_fullsized":"2024-09-10T05:37:53.856515+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:47:10.890181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.899872+0000","last_change":"2024-09-10T05:36:21.665684+0000","last_active":"2024-09-10T05:37:55.899872+0000","last_peered":"2024-09-10T05:37:55.899872+0000","last_clean":"2024-09-10T05:37:55.899872+0000","last_became_active":"2024-09-10T05:36:21.664884+0000","last_became_peered":"2024-09-10T05:36:21.664884+0000","last_unstale":"2024-09-10T05:37:55.899872+0000","last_undegraded":"2024-09-10T05:37:55.899872+0000","last_fullsized":"2024-09-10T05:37:55.899872+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:21:16.296649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:33.849823+0000","last_change":"2024-09-10T05:40:33.849823+0000","last_active":"2024-09-10T05:40:33.849823+0000","last_peered":"2024-09-10T05:40:33.849823+0000","last_clean":"2024-09-10T05:40:33.849823+0000","last_became_active":"2024-09-10T05:36:13.616392+0000","last_became_peered":"2024-09-10T05:36:13.616392+0000","last_unstale":"2024-09-10T05:40:33.849823+0000","last_undegraded":"2024-09-10T05:40:33.849823+0000","last_fullsized":"2024-09-10T05:40:33.849823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:33.849612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:33.849612+0000","last_clean_scrub_stamp":"2024-09-10T05:40:33.849612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:50:01.897366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"34'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:23.407468+0000","last_change":"2024-09-10T05:40:23.407468+0000","last_active":"2024-09-10T05:40:23.407468+0000","last_peered":"2024-09-10T05:40:23.407468+0000","last_clean":"2024-09-10T05:40:23.407468+0000","last_became_active":"2024-09-10T05:36:11.595319+0000","last_became_peered":"2024-09-10T05:36:11.595319+0000","last_unstale":"2024-09-10T05:40:23.407468+0000","last_undegraded":"2024-09-10T05:40:23.407468+0000","last_fullsized":"2024-09-10T05:40:23.407468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:23.407266+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:23.407266+0000","last_clean_scrub_stamp":"2024-09-10T05:40:23.407266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:04:56.547309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.902488+0000","last_change":"2024-09-10T05:36:15.618307+0000","last_active":"2024-09-10T05:37:55.902488+0000","last_peered":"2024-09-10T05:37:55.902488+0000","last_clean":"2024-09-10T05:37:55.902488+0000","last_became_active":"2024-09-10T05:36:15.617595+0000","last_became_peered":"2024-09-10T05:36:15.617595+0000","last_unstale":"2024-09-10T05:37:55.902488+0000","last_undegraded":"2024-09-10T05:37:55.902488+0000","last_fullsized":"2024-09-10T05:37:55.902488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:38.424958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1f","version":"34'41","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.554094+0000","last_change":"2024-09-10T05:36:17.635281+0000","last_active":"2024-09-10T05:39:58.554094+0000","last_peered":"2024-09-10T05:39:58.554094+0000","last_clean":"2024-09-10T05:39:58.554094+0000","last_became_active":"2024-09-10T05:36:17.634616+0000","last_became_peered":"2024-09-10T05:36:17.634616+0000","last_unstale":"2024-09-10T05:39:58.554094+0000","last_undegraded":"2024-09-10T05:39:58.554094+0000","last_fullsized":"2024-09-10T05:39:58.554094+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:22.686104+0000","last_change":"2024-09-10T05:36:19.665974+0000","last_active":"2024-09-10T05:38:22.686104+0000","last_peered":"2024-09-10T05:38:22.686104+0000","last_clean":"2024-09-10T05:38:22.686104+0000","last_became_active":"2024-09-10T05:36:19.665236+0000","last_became_peered":"2024-09-10T05:36:19.665236+0000","last_unstale":"2024-09-10T05:38:22.686104+0000","last_undegraded":"2024-09-10T05:38:22.686104+0000","last_fullsized":"2024-09-10T05:38:22.686104+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"34'5","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.906432+0000","last_change":"2024-09-10T05:36:21.695106+0000","last_active":"2024-09-10T05:39:26.906432+0000","last_peered":"2024-09-10T05:39:26.906432+0000","last_clean":"2024-09-10T05:39:26.906432+0000","last_became_active":"2024-09-10T05:36:21.694522+0000","last_became_peered":"2024-09-10T05:36:21.694522+0000","last_unstale":"2024-09-10T05:39:26.906432+0000","last_undegraded":"2024-09-10T05:39:26.906432+0000","last_fullsized":"2024-09-10T05:39:26.906432+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:40.765075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:23.468572+0000","last_change":"2024-09-10T05:40:23.468572+0000","last_active":"2024-09-10T05:40:23.468572+0000","last_peered":"2024-09-10T05:40:23.468572+0000","last_clean":"2024-09-10T05:40:23.468572+0000","last_became_active":"2024-09-10T05:36:13.610788+0000","last_became_peered":"2024-09-10T05:36:13.610788+0000","last_unstale":"2024-09-10T05:40:23.468572+0000","last_undegraded":"2024-09-10T05:40:23.468572+0000","last_fullsized":"2024-09-10T05:40:23.468572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:23.468389+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:23.468389+0000","last_clean_scrub_stamp":"2024-09-10T05:40:23.468389+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:07.634792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"32'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:12.773984+0000","last_change":"2024-09-10T05:40:12.773984+0000","last_active":"2024-09-10T05:40:12.773984+0000","last_peered":"2024-09-10T05:40:12.773984+0000","last_clean":"2024-09-10T05:40:12.773984+0000","last_became_active":"2024-09-10T05:36:11.600655+0000","last_became_peered":"2024-09-10T05:36:11.600655+0000","last_unstale":"2024-09-10T05:40:12.773984+0000","last_undegraded":"2024-09-10T05:40:12.773984+0000","last_fullsized":"2024-09-10T05:40:12.773984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T05:40:12.773793+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T05:40:12.773793+0000","last_clean_scrub_stamp":"2024-09-10T05:40:12.773793+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:00:18.439768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.857028+0000","last_change":"2024-09-10T05:36:15.624306+0000","last_active":"2024-09-10T05:37:53.857028+0000","last_peered":"2024-09-10T05:37:53.857028+0000","last_clean":"2024-09-10T05:37:53.857028+0000","last_became_active":"2024-09-10T05:36:15.623436+0000","last_became_peered":"2024-09-10T05:36:15.623436+0000","last_unstale":"2024-09-10T05:37:53.857028+0000","last_undegraded":"2024-09-10T05:37:53.857028+0000","last_fullsized":"2024-09-10T05:37:53.857028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:35:42.347473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'16","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:18.681293+0000","last_change":"2024-09-10T05:36:17.639307+0000","last_active":"2024-09-10T05:38:18.681293+0000","last_peered":"2024-09-10T05:38:18.681293+0000","last_clean":"2024-09-10T05:38:18.681293+0000","last_became_active":"2024-09-10T05:36:17.638408+0000","last_became_peered":"2024-09-10T05:36:17.638408+0000","last_unstale":"2024-09-10T05:38:18.681293+0000","last_undegraded":"2024-09-10T05:38:18.681293+0000","last_fullsized":"2024-09-10T05:38:18.681293+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'285","reported_seq":427,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.750044+0000","last_change":"2024-09-10T05:36:19.651451+0000","last_active":"2024-09-10T05:39:58.750044+0000","last_peered":"2024-09-10T05:39:58.750044+0000","last_clean":"2024-09-10T05:39:58.750044+0000","last_became_active":"2024-09-10T05:36:19.649079+0000","last_became_peered":"2024-09-10T05:36:19.649079+0000","last_unstale":"2024-09-10T05:39:58.750044+0000","last_undegraded":"2024-09-10T05:39:58.750044+0000","last_fullsized":"2024-09-10T05:39:58.750044+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.899307+0000","last_change":"2024-09-10T05:36:21.665833+0000","last_active":"2024-09-10T05:37:55.899307+0000","last_peered":"2024-09-10T05:37:55.899307+0000","last_clean":"2024-09-10T05:37:55.899307+0000","last_became_active":"2024-09-10T05:36:21.665112+0000","last_became_peered":"2024-09-10T05:36:21.665112+0000","last_unstale":"2024-09-10T05:37:55.899307+0000","last_undegraded":"2024-09-10T05:37:55.899307+0000","last_fullsized":"2024-09-10T05:37:55.899307+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:16:25.547381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"32'8","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:22.502077+0000","last_change":"2024-09-10T05:40:22.502077+0000","last_active":"2024-09-10T05:40:22.502077+0000","last_peered":"2024-09-10T05:40:22.502077+0000","last_clean":"2024-09-10T05:40:22.502077+0000","last_became_active":"2024-09-10T05:36:13.614222+0000","last_became_peered":"2024-09-10T05:36:13.614222+0000","last_unstale":"2024-09-10T05:40:22.502077+0000","last_undegraded":"2024-09-10T05:40:22.502077+0000","last_fullsized":"2024-09-10T05:40:22.502077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T05:40:22.501876+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T05:40:22.501876+0000","last_clean_scrub_stamp":"2024-09-10T05:40:22.501876+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:38.894156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:12.065325+0000","last_change":"2024-09-10T05:40:12.065325+0000","last_active":"2024-09-10T05:40:12.065325+0000","last_peered":"2024-09-10T05:40:12.065325+0000","last_clean":"2024-09-10T05:40:12.065325+0000","last_became_active":"2024-09-10T05:36:11.592805+0000","last_became_peered":"2024-09-10T05:36:11.592805+0000","last_unstale":"2024-09-10T05:40:12.065325+0000","last_undegraded":"2024-09-10T05:40:12.065325+0000","last_fullsized":"2024-09-10T05:40:12.065325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:12.065148+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:12.065148+0000","last_clean_scrub_stamp":"2024-09-10T05:40:12.065148+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:52:44.626794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.857006+0000","last_change":"2024-09-10T05:36:15.620727+0000","last_active":"2024-09-10T05:37:53.857006+0000","last_peered":"2024-09-10T05:37:53.857006+0000","last_clean":"2024-09-10T05:37:53.857006+0000","last_became_active":"2024-09-10T05:36:15.620288+0000","last_became_peered":"2024-09-10T05:36:15.620288+0000","last_unstale":"2024-09-10T05:37:53.857006+0000","last_undegraded":"2024-09-10T05:37:53.857006+0000","last_fullsized":"2024-09-10T05:37:53.857006+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:02:23.187158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'63","reported_seq":141,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.620034+0000","last_change":"2024-09-10T05:36:17.651973+0000","last_active":"2024-09-10T05:39:58.620034+0000","last_peered":"2024-09-10T05:39:58.620034+0000","last_clean":"2024-09-10T05:39:58.620034+0000","last_became_active":"2024-09-10T05:36:17.651364+0000","last_became_peered":"2024-09-10T05:36:17.651364+0000","last_unstale":"2024-09-10T05:39:58.620034+0000","last_undegraded":"2024-09-10T05:39:58.620034+0000","last_fullsized":"2024-09-10T05:39:58.620034+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:42:52.172095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.721434+0000","last_change":"2024-09-10T05:36:19.659340+0000","last_active":"2024-09-10T05:37:53.721434+0000","last_peered":"2024-09-10T05:37:53.721434+0000","last_clean":"2024-09-10T05:37:53.721434+0000","last_became_active":"2024-09-10T05:36:19.658646+0000","last_became_peered":"2024-09-10T05:36:19.658646+0000","last_unstale":"2024-09-10T05:37:53.721434+0000","last_undegraded":"2024-09-10T05:37:53.721434+0000","last_fullsized":"2024-09-10T05:37:53.721434+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:22:35.133305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"34'4","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.471685+0000","last_change":"2024-09-10T05:36:21.689581+0000","last_active":"2024-09-10T05:39:27.471685+0000","last_peered":"2024-09-10T05:39:27.471685+0000","last_clean":"2024-09-10T05:39:27.471685+0000","last_became_active":"2024-09-10T05:36:21.688695+0000","last_became_peered":"2024-09-10T05:36:21.688695+0000","last_unstale":"2024-09-10T05:39:27.471685+0000","last_undegraded":"2024-09-10T05:39:27.471685+0000","last_fullsized":"2024-09-10T05:39:27.471685+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:53.585393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"34'4","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:29.383586+0000","last_change":"2024-09-10T05:40:29.383586+0000","last_active":"2024-09-10T05:40:29.383586+0000","last_peered":"2024-09-10T05:40:29.383586+0000","last_clean":"2024-09-10T05:40:29.383586+0000","last_became_active":"2024-09-10T05:36:13.615340+0000","last_became_peered":"2024-09-10T05:36:13.615340+0000","last_unstale":"2024-09-10T05:40:29.383586+0000","last_undegraded":"2024-09-10T05:40:29.383586+0000","last_fullsized":"2024-09-10T05:40:29.383586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:29.383350+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:29.383350+0000","last_clean_scrub_stamp":"2024-09-10T05:40:29.383350+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:11:46.571874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"30'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:17.453722+0000","last_change":"2024-09-10T05:40:17.453722+0000","last_active":"2024-09-10T05:40:17.453722+0000","last_peered":"2024-09-10T05:40:17.453722+0000","last_clean":"2024-09-10T05:40:17.453722+0000","last_became_active":"2024-09-10T05:36:11.597360+0000","last_became_peered":"2024-09-10T05:36:11.597360+0000","last_unstale":"2024-09-10T05:40:17.453722+0000","last_undegraded":"2024-09-10T05:40:17.453722+0000","last_fullsized":"2024-09-10T05:40:17.453722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-10T05:40:17.453532+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-10T05:40:17.453532+0000","last_clean_scrub_stamp":"2024-09-10T05:40:17.453532+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:04:31.620004+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.902188+0000","last_change":"2024-09-10T05:36:15.620708+0000","last_active":"2024-09-10T05:37:55.902188+0000","last_peered":"2024-09-10T05:37:55.902188+0000","last_clean":"2024-09-10T05:37:55.902188+0000","last_became_active":"2024-09-10T05:36:15.619849+0000","last_became_peered":"2024-09-10T05:36:15.619849+0000","last_unstale":"2024-09-10T05:37:55.902188+0000","last_undegraded":"2024-09-10T05:37:55.902188+0000","last_fullsized":"2024-09-10T05:37:55.902188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:47:32.506655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"34'45","reported_seq":110,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:39.497036+0000","last_change":"2024-09-10T05:40:39.497036+0000","last_active":"2024-09-10T05:40:39.497036+0000","last_peered":"2024-09-10T05:40:39.497036+0000","last_clean":"2024-09-10T05:40:39.497036+0000","last_became_active":"2024-09-10T05:36:17.646780+0000","last_became_peered":"2024-09-10T05:36:17.646780+0000","last_unstale":"2024-09-10T05:40:39.497036+0000","last_undegraded":"2024-09-10T05:40:39.497036+0000","last_fullsized":"2024-09-10T05:40:39.497036+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'45","last_scrub_stamp":"2024-09-10T05:40:39.496818+0000","last_deep_scrub":"34'45","last_deep_scrub_stamp":"2024-09-10T05:40:39.496818+0000","last_clean_scrub_stamp":"2024-09-10T05:40:39.496818+0000","objects_scrubbed":5,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:56:18.167230+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.896432+0000","last_change":"2024-09-10T05:36:19.652878+0000","last_active":"2024-09-10T05:37:55.896432+0000","last_peered":"2024-09-10T05:37:55.896432+0000","last_clean":"2024-09-10T05:37:55.896432+0000","last_became_active":"2024-09-10T05:36:19.652114+0000","last_became_peered":"2024-09-10T05:36:19.652114+0000","last_unstale":"2024-09-10T05:37:55.896432+0000","last_undegraded":"2024-09-10T05:37:55.896432+0000","last_fullsized":"2024-09-10T05:37:55.896432+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:46:40.081106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.16","version":"34'2","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.271654+0000","last_change":"2024-09-10T05:36:21.693139+0000","last_active":"2024-09-10T05:39:27.271654+0000","last_peered":"2024-09-10T05:39:27.271654+0000","last_clean":"2024-09-10T05:39:27.271654+0000","last_became_active":"2024-09-10T05:36:21.692564+0000","last_became_peered":"2024-09-10T05:36:21.692564+0000","last_unstale":"2024-09-10T05:39:27.271654+0000","last_undegraded":"2024-09-10T05:39:27.271654+0000","last_fullsized":"2024-09-10T05:39:27.271654+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:51.507378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:31.814481+0000","last_change":"2024-09-10T05:40:31.814481+0000","last_active":"2024-09-10T05:40:31.814481+0000","last_peered":"2024-09-10T05:40:31.814481+0000","last_clean":"2024-09-10T05:40:31.814481+0000","last_became_active":"2024-09-10T05:36:13.600225+0000","last_became_peered":"2024-09-10T05:36:13.600225+0000","last_unstale":"2024-09-10T05:40:31.814481+0000","last_undegraded":"2024-09-10T05:40:31.814481+0000","last_fullsized":"2024-09-10T05:40:31.814481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T05:40:31.814262+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T05:40:31.814262+0000","last_clean_scrub_stamp":"2024-09-10T05:40:31.814262+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:47:13.698886+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:09.683197+0000","last_change":"2024-09-10T05:40:09.683066+0000","last_active":"2024-09-10T05:40:09.683197+0000","last_peered":"2024-09-10T05:40:09.683197+0000","last_clean":"2024-09-10T05:40:09.683197+0000","last_became_active":"2024-09-10T05:36:11.600598+0000","last_became_peered":"2024-09-10T05:36:11.600598+0000","last_unstale":"2024-09-10T05:40:09.683197+0000","last_undegraded":"2024-09-10T05:40:09.683197+0000","last_fullsized":"2024-09-10T05:40:09.683197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:09.682886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:09.682886+0000","last_clean_scrub_stamp":"2024-09-10T05:40:09.682886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:07.178758+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:42.112135+0000","last_change":"2024-09-10T05:40:42.112135+0000","last_active":"2024-09-10T05:40:42.112135+0000","last_peered":"2024-09-10T05:40:42.112135+0000","last_clean":"2024-09-10T05:40:42.112135+0000","last_became_active":"2024-09-10T05:36:15.634465+0000","last_became_peered":"2024-09-10T05:36:15.634465+0000","last_unstale":"2024-09-10T05:40:42.112135+0000","last_undegraded":"2024-09-10T05:40:42.112135+0000","last_fullsized":"2024-09-10T05:40:42.112135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:42.111930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:42.111930+0000","last_clean_scrub_stamp":"2024-09-10T05:40:42.111930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:08:44.803427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'36","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.537394+0000","last_change":"2024-09-10T05:36:17.635770+0000","last_active":"2024-09-10T05:39:58.537394+0000","last_peered":"2024-09-10T05:39:58.537394+0000","last_clean":"2024-09-10T05:39:58.537394+0000","last_became_active":"2024-09-10T05:36:17.634874+0000","last_became_peered":"2024-09-10T05:36:17.634874+0000","last_unstale":"2024-09-10T05:39:58.537394+0000","last_undegraded":"2024-09-10T05:39:58.537394+0000","last_fullsized":"2024-09-10T05:39:58.537394+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:54:06.818353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.898394+0000","last_change":"2024-09-10T05:36:19.638483+0000","last_active":"2024-09-10T05:37:55.898394+0000","last_peered":"2024-09-10T05:37:55.898394+0000","last_clean":"2024-09-10T05:37:55.898394+0000","last_became_active":"2024-09-10T05:36:19.637682+0000","last_became_peered":"2024-09-10T05:36:19.637682+0000","last_unstale":"2024-09-10T05:37:55.898394+0000","last_undegraded":"2024-09-10T05:37:55.898394+0000","last_fullsized":"2024-09-10T05:37:55.898394+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:35.498813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"34'4","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.056283+0000","last_change":"2024-09-10T05:36:21.688794+0000","last_active":"2024-09-10T05:38:24.056283+0000","last_peered":"2024-09-10T05:38:24.056283+0000","last_clean":"2024-09-10T05:38:24.056283+0000","last_became_active":"2024-09-10T05:36:21.688046+0000","last_became_peered":"2024-09-10T05:36:21.688046+0000","last_unstale":"2024-09-10T05:38:24.056283+0000","last_undegraded":"2024-09-10T05:38:24.056283+0000","last_fullsized":"2024-09-10T05:38:24.056283+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:06:36.753067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:28.342899+0000","last_change":"2024-09-10T05:40:28.342899+0000","last_active":"2024-09-10T05:40:28.342899+0000","last_peered":"2024-09-10T05:40:28.342899+0000","last_clean":"2024-09-10T05:40:28.342899+0000","last_became_active":"2024-09-10T05:36:13.611864+0000","last_became_peered":"2024-09-10T05:36:13.611864+0000","last_unstale":"2024-09-10T05:40:28.342899+0000","last_undegraded":"2024-09-10T05:40:28.342899+0000","last_fullsized":"2024-09-10T05:40:28.342899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:28.342719+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:28.342719+0000","last_clean_scrub_stamp":"2024-09-10T05:40:28.342719+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:50:09.925425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"32'3","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:13.027528+0000","last_change":"2024-09-10T05:40:13.027402+0000","last_active":"2024-09-10T05:40:13.027528+0000","last_peered":"2024-09-10T05:40:13.027528+0000","last_clean":"2024-09-10T05:40:13.027528+0000","last_became_active":"2024-09-10T05:36:11.594949+0000","last_became_peered":"2024-09-10T05:36:11.594949+0000","last_unstale":"2024-09-10T05:40:13.027528+0000","last_undegraded":"2024-09-10T05:40:13.027528+0000","last_fullsized":"2024-09-10T05:40:13.027528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-10T05:40:13.027220+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-10T05:40:13.027220+0000","last_clean_scrub_stamp":"2024-09-10T05:40:13.027220+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:48:42.771696+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:22.306367+0000","last_change":"2024-09-10T05:36:15.619284+0000","last_active":"2024-09-10T05:38:22.306367+0000","last_peered":"2024-09-10T05:38:22.306367+0000","last_clean":"2024-09-10T05:38:22.306367+0000","last_became_active":"2024-09-10T05:36:15.618169+0000","last_became_peered":"2024-09-10T05:36:15.618169+0000","last_unstale":"2024-09-10T05:38:22.306367+0000","last_undegraded":"2024-09-10T05:38:22.306367+0000","last_fullsized":"2024-09-10T05:38:22.306367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:14.583615+0000","last_clean_scrub_stamp":"2024-09-10T05:36:14.583615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:22:48.592489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'50","reported_seq":115,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.562381+0000","last_change":"2024-09-10T05:36:17.631950+0000","last_active":"2024-09-10T05:39:58.562381+0000","last_peered":"2024-09-10T05:39:58.562381+0000","last_clean":"2024-09-10T05:39:58.562381+0000","last_became_active":"2024-09-10T05:36:17.631194+0000","last_became_peered":"2024-09-10T05:36:17.631194+0000","last_unstale":"2024-09-10T05:39:58.562381+0000","last_undegraded":"2024-09-10T05:39:58.562381+0000","last_fullsized":"2024-09-10T05:39:58.562381+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:16.597545+0000","last_clean_scrub_stamp":"2024-09-10T05:36:16.597545+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:53:16.893462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":64,"num_read_kb":76,"num_write":36,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.713950+0000","last_change":"2024-09-10T05:36:19.637266+0000","last_active":"2024-09-10T05:37:53.713950+0000","last_peered":"2024-09-10T05:37:53.713950+0000","last_clean":"2024-09-10T05:37:53.713950+0000","last_became_active":"2024-09-10T05:36:19.636483+0000","last_became_peered":"2024-09-10T05:36:19.636483+0000","last_unstale":"2024-09-10T05:37:53.713950+0000","last_undegraded":"2024-09-10T05:37:53.713950+0000","last_fullsized":"2024-09-10T05:37:53.713950+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:56:30.945572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"34'8","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.060943+0000","last_change":"2024-09-10T05:36:21.689539+0000","last_active":"2024-09-10T05:38:24.060943+0000","last_peered":"2024-09-10T05:38:24.060943+0000","last_clean":"2024-09-10T05:38:24.060943+0000","last_became_active":"2024-09-10T05:36:21.688818+0000","last_became_peered":"2024-09-10T05:36:21.688818+0000","last_unstale":"2024-09-10T05:38:24.060943+0000","last_undegraded":"2024-09-10T05:38:24.060943+0000","last_fullsized":"2024-09-10T05:38:24.060943+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:50:15.537977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":19,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"34'8","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:29.160600+0000","last_change":"2024-09-10T05:40:29.160453+0000","last_active":"2024-09-10T05:40:29.160600+0000","last_peered":"2024-09-10T05:40:29.160600+0000","last_clean":"2024-09-10T05:40:29.160600+0000","last_became_active":"2024-09-10T05:36:13.618260+0000","last_became_peered":"2024-09-10T05:36:13.618260+0000","last_unstale":"2024-09-10T05:40:29.160600+0000","last_undegraded":"2024-09-10T05:40:29.160600+0000","last_fullsized":"2024-09-10T05:40:29.160600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-10T05:40:29.160278+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-10T05:40:29.160278+0000","last_clean_scrub_stamp":"2024-09-10T05:40:29.160278+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:55:42.355372+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:05.545029+0000","last_change":"2024-09-10T05:40:05.544869+0000","last_active":"2024-09-10T05:40:05.545029+0000","last_peered":"2024-09-10T05:40:05.545029+0000","last_clean":"2024-09-10T05:40:05.545029+0000","last_became_active":"2024-09-10T05:36:11.603738+0000","last_became_peered":"2024-09-10T05:36:11.603738+0000","last_unstale":"2024-09-10T05:40:05.545029+0000","last_undegraded":"2024-09-10T05:40:05.545029+0000","last_fullsized":"2024-09-10T05:40:05.545029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:05.544682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:05.544682+0000","last_clean_scrub_stamp":"2024-09-10T05:40:05.544682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:49:54.654103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'14","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:30.165195+0000","last_change":"2024-09-10T05:40:30.165018+0000","last_active":"2024-09-10T05:40:30.165195+0000","last_peered":"2024-09-10T05:40:30.165195+0000","last_clean":"2024-09-10T05:40:30.165195+0000","last_became_active":"2024-09-10T05:36:13.624460+0000","last_became_peered":"2024-09-10T05:36:13.624460+0000","last_unstale":"2024-09-10T05:40:30.165195+0000","last_undegraded":"2024-09-10T05:40:30.165195+0000","last_fullsized":"2024-09-10T05:40:30.165195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-10T05:40:30.164829+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-10T05:40:30.164829+0000","last_clean_scrub_stamp":"2024-09-10T05:40:30.164829+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:29:41.992659+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":58,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:07.495701+0000","last_change":"2024-09-10T05:40:07.495530+0000","last_active":"2024-09-10T05:40:07.495701+0000","last_peered":"2024-09-10T05:40:07.495701+0000","last_clean":"2024-09-10T05:40:07.495701+0000","last_became_active":"2024-09-10T05:36:11.601762+0000","last_became_peered":"2024-09-10T05:36:11.601762+0000","last_unstale":"2024-09-10T05:40:07.495701+0000","last_undegraded":"2024-09-10T05:40:07.495701+0000","last_fullsized":"2024-09-10T05:40:07.495701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:07.495353+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:07.495353+0000","last_clean_scrub_stamp":"2024-09-10T05:40:07.495353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:18:59.814823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"34'20","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:34.439775+0000","last_change":"2024-09-10T05:40:34.439775+0000","last_active":"2024-09-10T05:40:34.439775+0000","last_peered":"2024-09-10T05:40:34.439775+0000","last_clean":"2024-09-10T05:40:34.439775+0000","last_became_active":"2024-09-10T05:36:13.614221+0000","last_became_peered":"2024-09-10T05:36:13.614221+0000","last_unstale":"2024-09-10T05:40:34.439775+0000","last_undegraded":"2024-09-10T05:40:34.439775+0000","last_fullsized":"2024-09-10T05:40:34.439775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'20","last_scrub_stamp":"2024-09-10T05:40:34.439594+0000","last_deep_scrub":"34'20","last_deep_scrub_stamp":"2024-09-10T05:40:34.439594+0000","last_clean_scrub_stamp":"2024-09-10T05:40:34.439594+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:21:01.217898+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":66,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:10.730272+0000","last_change":"2024-09-10T05:40:10.730128+0000","last_active":"2024-09-10T05:40:10.730272+0000","last_peered":"2024-09-10T05:40:10.730272+0000","last_clean":"2024-09-10T05:40:10.730272+0000","last_became_active":"2024-09-10T05:36:11.601269+0000","last_became_peered":"2024-09-10T05:36:11.601269+0000","last_unstale":"2024-09-10T05:40:10.730272+0000","last_undegraded":"2024-09-10T05:40:10.730272+0000","last_fullsized":"2024-09-10T05:40:10.730272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:10.729946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:10.729946+0000","last_clean_scrub_stamp":"2024-09-10T05:40:10.729946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:23.818687+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'22","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:28.165310+0000","last_change":"2024-09-10T05:40:28.165073+0000","last_active":"2024-09-10T05:40:28.165310+0000","last_peered":"2024-09-10T05:40:28.165310+0000","last_clean":"2024-09-10T05:40:28.165310+0000","last_became_active":"2024-09-10T05:36:13.626022+0000","last_became_peered":"2024-09-10T05:36:13.626022+0000","last_unstale":"2024-09-10T05:40:28.165310+0000","last_undegraded":"2024-09-10T05:40:28.165310+0000","last_fullsized":"2024-09-10T05:40:28.165310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-09-10T05:40:28.164834+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-09-10T05:40:28.164834+0000","last_clean_scrub_stamp":"2024-09-10T05:40:28.164834+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:36.827007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":48,"num_read_kb":40,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:08.499166+0000","last_change":"2024-09-10T05:40:08.498960+0000","last_active":"2024-09-10T05:40:08.499166+0000","last_peered":"2024-09-10T05:40:08.499166+0000","last_clean":"2024-09-10T05:40:08.499166+0000","last_became_active":"2024-09-10T05:36:11.610933+0000","last_became_peered":"2024-09-10T05:36:11.610933+0000","last_unstale":"2024-09-10T05:40:08.499166+0000","last_undegraded":"2024-09-10T05:40:08.499166+0000","last_fullsized":"2024-09-10T05:40:08.499166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:08.498772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:08.498772+0000","last_clean_scrub_stamp":"2024-09-10T05:40:08.498772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:52:48.692131+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"34'14","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:34.804203+0000","last_change":"2024-09-10T05:40:34.804203+0000","last_active":"2024-09-10T05:40:34.804203+0000","last_peered":"2024-09-10T05:40:34.804203+0000","last_clean":"2024-09-10T05:40:34.804203+0000","last_became_active":"2024-09-10T05:36:13.597975+0000","last_became_peered":"2024-09-10T05:36:13.597975+0000","last_unstale":"2024-09-10T05:40:34.804203+0000","last_undegraded":"2024-09-10T05:40:34.804203+0000","last_fullsized":"2024-09-10T05:40:34.804203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-10T05:40:34.804027+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-10T05:40:34.804027+0000","last_clean_scrub_stamp":"2024-09-10T05:40:34.804027+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:55.230805+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"34'2","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:13.780147+0000","last_change":"2024-09-10T05:40:13.779908+0000","last_active":"2024-09-10T05:40:13.780147+0000","last_peered":"2024-09-10T05:40:13.780147+0000","last_clean":"2024-09-10T05:40:13.780147+0000","last_became_active":"2024-09-10T05:36:11.603085+0000","last_became_peered":"2024-09-10T05:36:11.603085+0000","last_unstale":"2024-09-10T05:40:13.780147+0000","last_undegraded":"2024-09-10T05:40:13.780147+0000","last_fullsized":"2024-09-10T05:40:13.780147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:13.779687+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:13.779687+0000","last_clean_scrub_stamp":"2024-09-10T05:40:13.779687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:21:43.655717+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:27.184735+0000","last_change":"2024-09-10T05:40:27.184735+0000","last_active":"2024-09-10T05:40:27.184735+0000","last_peered":"2024-09-10T05:40:27.184735+0000","last_clean":"2024-09-10T05:40:27.184735+0000","last_became_active":"2024-09-10T05:36:13.610894+0000","last_became_peered":"2024-09-10T05:36:13.610894+0000","last_unstale":"2024-09-10T05:40:27.184735+0000","last_undegraded":"2024-09-10T05:40:27.184735+0000","last_fullsized":"2024-09-10T05:40:27.184735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:27.184546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:27.184546+0000","last_clean_scrub_stamp":"2024-09-10T05:40:27.184546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:46:52.509265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:14.059086+0000","last_change":"2024-09-10T05:40:14.058953+0000","last_active":"2024-09-10T05:40:14.059086+0000","last_peered":"2024-09-10T05:40:14.059086+0000","last_clean":"2024-09-10T05:40:14.059086+0000","last_became_active":"2024-09-10T05:36:11.592809+0000","last_became_peered":"2024-09-10T05:36:11.592809+0000","last_unstale":"2024-09-10T05:40:14.059086+0000","last_undegraded":"2024-09-10T05:40:14.059086+0000","last_fullsized":"2024-09-10T05:40:14.059086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:14.058768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:14.058768+0000","last_clean_scrub_stamp":"2024-09-10T05:40:14.058768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:44.630239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'6","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:32.827471+0000","last_change":"2024-09-10T05:40:32.827471+0000","last_active":"2024-09-10T05:40:32.827471+0000","last_peered":"2024-09-10T05:40:32.827471+0000","last_clean":"2024-09-10T05:40:32.827471+0000","last_became_active":"2024-09-10T05:36:13.607052+0000","last_became_peered":"2024-09-10T05:36:13.607052+0000","last_unstale":"2024-09-10T05:40:32.827471+0000","last_undegraded":"2024-09-10T05:40:32.827471+0000","last_fullsized":"2024-09-10T05:40:32.827471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T05:40:32.827295+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T05:40:32.827295+0000","last_clean_scrub_stamp":"2024-09-10T05:40:32.827295+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:41:56.575014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"32'2","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:09.533820+0000","last_change":"2024-09-10T05:40:09.533645+0000","last_active":"2024-09-10T05:40:09.533820+0000","last_peered":"2024-09-10T05:40:09.533820+0000","last_clean":"2024-09-10T05:40:09.533820+0000","last_became_active":"2024-09-10T05:36:11.593614+0000","last_became_peered":"2024-09-10T05:36:11.593614+0000","last_unstale":"2024-09-10T05:40:09.533820+0000","last_undegraded":"2024-09-10T05:40:09.533820+0000","last_fullsized":"2024-09-10T05:40:09.533820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T05:40:09.533454+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T05:40:09.533454+0000","last_clean_scrub_stamp":"2024-09-10T05:40:09.533454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:03:38.053067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:31.431004+0000","last_change":"2024-09-10T05:40:31.431004+0000","last_active":"2024-09-10T05:40:31.431004+0000","last_peered":"2024-09-10T05:40:31.431004+0000","last_clean":"2024-09-10T05:40:31.431004+0000","last_became_active":"2024-09-10T05:36:13.593693+0000","last_became_peered":"2024-09-10T05:36:13.593693+0000","last_unstale":"2024-09-10T05:40:31.431004+0000","last_undegraded":"2024-09-10T05:40:31.431004+0000","last_fullsized":"2024-09-10T05:40:31.431004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:31.430822+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:31.430822+0000","last_clean_scrub_stamp":"2024-09-10T05:40:31.430822+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:12.717581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"34'8","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:14.767670+0000","last_change":"2024-09-10T05:40:14.767528+0000","last_active":"2024-09-10T05:40:14.767670+0000","last_peered":"2024-09-10T05:40:14.767670+0000","last_clean":"2024-09-10T05:40:14.767670+0000","last_became_active":"2024-09-10T05:36:11.604011+0000","last_became_peered":"2024-09-10T05:36:11.604011+0000","last_unstale":"2024-09-10T05:40:14.767670+0000","last_undegraded":"2024-09-10T05:40:14.767670+0000","last_fullsized":"2024-09-10T05:40:14.767670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-10T05:40:14.767349+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-10T05:40:14.767349+0000","last_clean_scrub_stamp":"2024-09-10T05:40:14.767349+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:21:09.642300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":24,"num_write_kb":12289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"34'16","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:33.141794+0000","last_change":"2024-09-10T05:40:33.141794+0000","last_active":"2024-09-10T05:40:33.141794+0000","last_peered":"2024-09-10T05:40:33.141794+0000","last_clean":"2024-09-10T05:40:33.141794+0000","last_became_active":"2024-09-10T05:36:13.629760+0000","last_became_peered":"2024-09-10T05:36:13.629760+0000","last_unstale":"2024-09-10T05:40:33.141794+0000","last_undegraded":"2024-09-10T05:40:33.141794+0000","last_fullsized":"2024-09-10T05:40:33.141794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-10T05:40:33.141579+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-10T05:40:33.141579+0000","last_clean_scrub_stamp":"2024-09-10T05:40:33.141579+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:13:56.723961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":66,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:15.759238+0000","last_change":"2024-09-10T05:40:15.759115+0000","last_active":"2024-09-10T05:40:15.759238+0000","last_peered":"2024-09-10T05:40:15.759238+0000","last_clean":"2024-09-10T05:40:15.759238+0000","last_became_active":"2024-09-10T05:36:11.597158+0000","last_became_peered":"2024-09-10T05:36:11.597158+0000","last_unstale":"2024-09-10T05:40:15.759238+0000","last_undegraded":"2024-09-10T05:40:15.759238+0000","last_fullsized":"2024-09-10T05:40:15.759238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:15.758931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:15.758931+0000","last_clean_scrub_stamp":"2024-09-10T05:40:15.758931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:16.124076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:35.841896+0000","last_change":"2024-09-10T05:40:35.841896+0000","last_active":"2024-09-10T05:40:35.841896+0000","last_peered":"2024-09-10T05:40:35.841896+0000","last_clean":"2024-09-10T05:40:35.841896+0000","last_became_active":"2024-09-10T05:36:13.613206+0000","last_became_peered":"2024-09-10T05:36:13.613206+0000","last_unstale":"2024-09-10T05:40:35.841896+0000","last_undegraded":"2024-09-10T05:40:35.841896+0000","last_fullsized":"2024-09-10T05:40:35.841896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:35.841653+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:35.841653+0000","last_clean_scrub_stamp":"2024-09-10T05:40:35.841653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:12:38.162551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'2","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:16.993374+0000","last_change":"2024-09-10T05:40:16.993374+0000","last_active":"2024-09-10T05:40:16.993374+0000","last_peered":"2024-09-10T05:40:16.993374+0000","last_clean":"2024-09-10T05:40:16.993374+0000","last_became_active":"2024-09-10T05:36:52.705212+0000","last_became_peered":"2024-09-10T05:36:52.705212+0000","last_unstale":"2024-09-10T05:40:16.993374+0000","last_undegraded":"2024-09-10T05:40:16.993374+0000","last_fullsized":"2024-09-10T05:40:16.993374+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T05:40:16.993183+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T05:40:16.993183+0000","last_clean_scrub_stamp":"2024-09-10T05:40:16.993183+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:47:37.839890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"34'6","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:26.552621+0000","last_change":"2024-09-10T05:40:26.552418+0000","last_active":"2024-09-10T05:40:26.552621+0000","last_peered":"2024-09-10T05:40:26.552621+0000","last_clean":"2024-09-10T05:40:26.552621+0000","last_became_active":"2024-09-10T05:36:13.626912+0000","last_became_peered":"2024-09-10T05:36:13.626912+0000","last_unstale":"2024-09-10T05:40:26.552621+0000","last_undegraded":"2024-09-10T05:40:26.552621+0000","last_fullsized":"2024-09-10T05:40:26.552621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T05:40:26.552231+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T05:40:26.552231+0000","last_clean_scrub_stamp":"2024-09-10T05:40:26.552231+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:07:42.396989+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:24.386144+0000","last_change":"2024-09-10T05:40:24.386014+0000","last_active":"2024-09-10T05:40:24.386144+0000","last_peered":"2024-09-10T05:40:24.386144+0000","last_clean":"2024-09-10T05:40:24.386144+0000","last_became_active":"2024-09-10T05:36:11.606369+0000","last_became_peered":"2024-09-10T05:36:11.606369+0000","last_unstale":"2024-09-10T05:40:24.386144+0000","last_undegraded":"2024-09-10T05:40:24.386144+0000","last_fullsized":"2024-09-10T05:40:24.386144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:24.385801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:24.385801+0000","last_clean_scrub_stamp":"2024-09-10T05:40:24.385801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:48.821098+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"32'8","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:32.095285+0000","last_change":"2024-09-10T05:40:32.095140+0000","last_active":"2024-09-10T05:40:32.095285+0000","last_peered":"2024-09-10T05:40:32.095285+0000","last_clean":"2024-09-10T05:40:32.095285+0000","last_became_active":"2024-09-10T05:36:13.607807+0000","last_became_peered":"2024-09-10T05:36:13.607807+0000","last_unstale":"2024-09-10T05:40:32.095285+0000","last_undegraded":"2024-09-10T05:40:32.095285+0000","last_fullsized":"2024-09-10T05:40:32.095285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T05:40:32.094948+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T05:40:32.094948+0000","last_clean_scrub_stamp":"2024-09-10T05:40:32.094948+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:48.800391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:21.057945+0000","last_change":"2024-09-10T05:40:21.057801+0000","last_active":"2024-09-10T05:40:21.057945+0000","last_peered":"2024-09-10T05:40:21.057945+0000","last_clean":"2024-09-10T05:40:21.057945+0000","last_became_active":"2024-09-10T05:36:11.593962+0000","last_became_peered":"2024-09-10T05:36:11.593962+0000","last_unstale":"2024-09-10T05:40:21.057945+0000","last_undegraded":"2024-09-10T05:40:21.057945+0000","last_fullsized":"2024-09-10T05:40:21.057945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:21.057604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:21.057604+0000","last_clean_scrub_stamp":"2024-09-10T05:40:21.057604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:31:16.451869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:38.455689+0000","last_change":"2024-09-10T05:40:38.455536+0000","last_active":"2024-09-10T05:40:38.455689+0000","last_peered":"2024-09-10T05:40:38.455689+0000","last_clean":"2024-09-10T05:40:38.455689+0000","last_became_active":"2024-09-10T05:36:13.614155+0000","last_became_peered":"2024-09-10T05:36:13.614155+0000","last_unstale":"2024-09-10T05:40:38.455689+0000","last_undegraded":"2024-09-10T05:40:38.455689+0000","last_fullsized":"2024-09-10T05:40:38.455689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:38.455337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:38.455337+0000","last_clean_scrub_stamp":"2024-09-10T05:40:38.455337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:59:49.912552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:17.752534+0000","last_change":"2024-09-10T05:40:17.752385+0000","last_active":"2024-09-10T05:40:17.752534+0000","last_peered":"2024-09-10T05:40:17.752534+0000","last_clean":"2024-09-10T05:40:17.752534+0000","last_became_active":"2024-09-10T05:36:11.602866+0000","last_became_peered":"2024-09-10T05:36:11.602866+0000","last_unstale":"2024-09-10T05:40:17.752534+0000","last_undegraded":"2024-09-10T05:40:17.752534+0000","last_fullsized":"2024-09-10T05:40:17.752534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:17.752209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:17.752209+0000","last_clean_scrub_stamp":"2024-09-10T05:40:17.752209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:37:42.386692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'16","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:31.135884+0000","last_change":"2024-09-10T05:40:31.135746+0000","last_active":"2024-09-10T05:40:31.135884+0000","last_peered":"2024-09-10T05:40:31.135884+0000","last_clean":"2024-09-10T05:40:31.135884+0000","last_became_active":"2024-09-10T05:36:13.611391+0000","last_became_peered":"2024-09-10T05:36:13.611391+0000","last_unstale":"2024-09-10T05:40:31.135884+0000","last_undegraded":"2024-09-10T05:40:31.135884+0000","last_fullsized":"2024-09-10T05:40:31.135884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-10T05:40:31.135543+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-10T05:40:31.135543+0000","last_clean_scrub_stamp":"2024-09-10T05:40:31.135543+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:39:31.932855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:16.032739+0000","last_change":"2024-09-10T05:40:16.032739+0000","last_active":"2024-09-10T05:40:16.032739+0000","last_peered":"2024-09-10T05:40:16.032739+0000","last_clean":"2024-09-10T05:40:16.032739+0000","last_became_active":"2024-09-10T05:36:52.706226+0000","last_became_peered":"2024-09-10T05:36:52.706226+0000","last_unstale":"2024-09-10T05:40:16.032739+0000","last_undegraded":"2024-09-10T05:40:16.032739+0000","last_fullsized":"2024-09-10T05:40:16.032739+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:16.032561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:16.032561+0000","last_clean_scrub_stamp":"2024-09-10T05:40:16.032561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:29.267082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"34'10","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:37.810522+0000","last_change":"2024-09-10T05:40:37.810391+0000","last_active":"2024-09-10T05:40:37.810522+0000","last_peered":"2024-09-10T05:40:37.810522+0000","last_clean":"2024-09-10T05:40:37.810522+0000","last_became_active":"2024-09-10T05:36:13.616136+0000","last_became_peered":"2024-09-10T05:36:13.616136+0000","last_unstale":"2024-09-10T05:40:37.810522+0000","last_undegraded":"2024-09-10T05:40:37.810522+0000","last_fullsized":"2024-09-10T05:40:37.810522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-10T05:40:37.810174+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-10T05:40:37.810174+0000","last_clean_scrub_stamp":"2024-09-10T05:40:37.810174+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:00:30.777170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"32'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:11.568074+0000","last_change":"2024-09-10T05:40:11.568074+0000","last_active":"2024-09-10T05:40:11.568074+0000","last_peered":"2024-09-10T05:40:11.568074+0000","last_clean":"2024-09-10T05:40:11.568074+0000","last_became_active":"2024-09-10T05:36:11.600234+0000","last_became_peered":"2024-09-10T05:36:11.600234+0000","last_unstale":"2024-09-10T05:40:11.568074+0000","last_undegraded":"2024-09-10T05:40:11.568074+0000","last_fullsized":"2024-09-10T05:40:11.568074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T05:40:11.567892+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T05:40:11.567892+0000","last_clean_scrub_stamp":"2024-09-10T05:40:11.567892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:09:54.451468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"30'2","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:33.449784+0000","last_change":"2024-09-10T05:40:33.449784+0000","last_active":"2024-09-10T05:40:33.449784+0000","last_peered":"2024-09-10T05:40:33.449784+0000","last_clean":"2024-09-10T05:40:33.449784+0000","last_became_active":"2024-09-10T05:36:13.614098+0000","last_became_peered":"2024-09-10T05:36:13.614098+0000","last_unstale":"2024-09-10T05:40:33.449784+0000","last_undegraded":"2024-09-10T05:40:33.449784+0000","last_fullsized":"2024-09-10T05:40:33.449784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-10T05:40:33.449593+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-10T05:40:33.449593+0000","last_clean_scrub_stamp":"2024-09-10T05:40:33.449593+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:09.814056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"30'2","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:16.732918+0000","last_change":"2024-09-10T05:40:16.732918+0000","last_active":"2024-09-10T05:40:16.732918+0000","last_peered":"2024-09-10T05:40:16.732918+0000","last_clean":"2024-09-10T05:40:16.732918+0000","last_became_active":"2024-09-10T05:36:11.603972+0000","last_became_peered":"2024-09-10T05:36:11.603972+0000","last_unstale":"2024-09-10T05:40:16.732918+0000","last_undegraded":"2024-09-10T05:40:16.732918+0000","last_fullsized":"2024-09-10T05:40:16.732918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-10T05:40:16.732725+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-10T05:40:16.732725+0000","last_clean_scrub_stamp":"2024-09-10T05:40:16.732725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:45:48.371841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:27.383465+0000","last_change":"2024-09-10T05:40:27.383465+0000","last_active":"2024-09-10T05:40:27.383465+0000","last_peered":"2024-09-10T05:40:27.383465+0000","last_clean":"2024-09-10T05:40:27.383465+0000","last_became_active":"2024-09-10T05:36:11.595183+0000","last_became_peered":"2024-09-10T05:36:11.595183+0000","last_unstale":"2024-09-10T05:40:27.383465+0000","last_undegraded":"2024-09-10T05:40:27.383465+0000","last_fullsized":"2024-09-10T05:40:27.383465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:27.383240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:27.383240+0000","last_clean_scrub_stamp":"2024-09-10T05:40:27.383240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:00:27.997849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"34'8","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:27.569593+0000","last_change":"2024-09-10T05:40:27.569593+0000","last_active":"2024-09-10T05:40:27.569593+0000","last_peered":"2024-09-10T05:40:27.569593+0000","last_clean":"2024-09-10T05:40:27.569593+0000","last_became_active":"2024-09-10T05:36:13.622559+0000","last_became_peered":"2024-09-10T05:36:13.622559+0000","last_unstale":"2024-09-10T05:40:27.569593+0000","last_undegraded":"2024-09-10T05:40:27.569593+0000","last_fullsized":"2024-09-10T05:40:27.569593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-10T05:40:27.569380+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-10T05:40:27.569380+0000","last_clean_scrub_stamp":"2024-09-10T05:40:27.569380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:24:04.016693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:15.048760+0000","last_change":"2024-09-10T05:40:15.048760+0000","last_active":"2024-09-10T05:40:15.048760+0000","last_peered":"2024-09-10T05:40:15.048760+0000","last_clean":"2024-09-10T05:40:15.048760+0000","last_became_active":"2024-09-10T05:36:11.588124+0000","last_became_peered":"2024-09-10T05:36:11.588124+0000","last_unstale":"2024-09-10T05:40:15.048760+0000","last_undegraded":"2024-09-10T05:40:15.048760+0000","last_fullsized":"2024-09-10T05:40:15.048760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:15.048548+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:15.048548+0000","last_clean_scrub_stamp":"2024-09-10T05:40:15.048548+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:29:26.086020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"34'20","reported_seq":101,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:35.210598+0000","last_change":"2024-09-10T05:40:35.210598+0000","last_active":"2024-09-10T05:40:35.210598+0000","last_peered":"2024-09-10T05:40:35.210598+0000","last_clean":"2024-09-10T05:40:35.210598+0000","last_became_active":"2024-09-10T05:36:13.614959+0000","last_became_peered":"2024-09-10T05:36:13.614959+0000","last_unstale":"2024-09-10T05:40:35.210598+0000","last_undegraded":"2024-09-10T05:40:35.210598+0000","last_fullsized":"2024-09-10T05:40:35.210598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'20","last_scrub_stamp":"2024-09-10T05:40:35.210385+0000","last_deep_scrub":"34'20","last_deep_scrub_stamp":"2024-09-10T05:40:35.210385+0000","last_clean_scrub_stamp":"2024-09-10T05:40:35.210385+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:28:52.615497+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":56,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":692,"num_read_kb":660,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2282,"ondisk_log_size":2282,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1888,"num_read_kb":1653,"num_write":789,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1598,"ondisk_log_size":1598,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1683,"num_read_kb":1573,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":639872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640316,"num_pgs":142,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44096,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327744,"statfs":{"total":96636764160,"available":96591609856,"internally_reserved":0,"allocated":442368,"data_stored":149023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":44693959},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673021,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40476,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331364,"statfs":{"total":96636764160,"available":96595316736,"internally_reserved":0,"allocated":995328,"data_stored":736555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673022,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40536,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331304,"statfs":{"total":96636764160,"available":96595255296,"internally_reserved":0,"allocated":1056768,"data_stored":738594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949673021,"num_pgs":143,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":487424,"data_stored":149680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":2712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":1788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T05:40:44.481 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.481 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.482 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.482 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.482 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.482 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.482 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.482 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.482 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.482 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.483 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.483 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.483 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.483 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.483 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.483 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.483 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.483 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.484 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.484 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.484 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.484 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.484 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.484 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.484 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.485 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.485 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.485 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.485 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.485 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.485 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.485 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.486 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.486 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.486 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.486 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.486 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.487 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.487 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.487 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.487 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.487 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.487 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.487 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.487 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.488 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.488 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.488 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.488 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.488 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.488 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.489 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.489 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.489 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.489 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.489 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.489 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.489 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.490 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.490 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.490 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.490 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.490 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.490 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.490 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.490 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.491 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.491 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.491 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.491 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.491 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.491 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.491 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.491 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.492 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.492 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.492 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.492 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.492 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.492 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.492 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.492 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.493 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.493 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.493 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.493 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.493 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.493 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.493 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.493 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.494 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.494 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.494 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.494 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.494 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.494 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.494 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.494 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.495 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.495 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.495 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-10T05:36:14.583615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.495 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-10T05:36:16.597545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.495 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.495 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:40:44.496 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-10T05:41:04.497 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T05:41:04.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.628+0000 7fb0ef923640 1 Processor -- start 2024-09-10T05:41:04.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.628+0000 7fb0ef923640 1 -- start start 2024-09-10T05:41:04.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.632+0000 7fb0ef923640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb0e8111db0 0x7fb0e81319d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:41:04.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.632+0000 7fb0ef923640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0e8073a90 con 0x7fb0e812b850 2024-09-10T05:41:04.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.632+0000 7fb0ef923640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fb0e8112ef0 con 0x7fb0e8111db0 2024-09-10T05:41:04.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.632+0000 7fb0ecebe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb0e8111db0 0x7fb0e81319d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:41:04.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.632+0000 7fb0ecebe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb0e8111db0 0x7fb0e81319d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53012/0 (socket says 172.21.15.2:53012) 2024-09-10T05:41:04.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.632+0000 7fb0ed6bf640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb0e812b850 0x7fb0e812bc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60126/0 (socket says 172.21.15.2:60126) 2024-09-10T05:41:04.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.632+0000 7fb0ecebe640 1 -- 172.21.15.2:0/1240859116 learned_addr learned my addr 172.21.15.2:0/1240859116 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:41:04.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.632+0000 7fb0ecebe640 1 -- 172.21.15.2:0/1240859116 >> v1:172.21.15.2:6789/0 conn(0x7fb0e812b850 legacy=0x7fb0e812bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:41:04.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.632+0000 7fb0ecebe640 1 -- 172.21.15.2:0/1240859116 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0e812c340 con 0x7fb0e8111db0 2024-09-10T05:41:04.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.632+0000 7fb0e7fff640 1 -- 172.21.15.2:0/1240859116 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 861372213 0 0) 0x7fb0e8073a90 con 0x7fb0e812b850 2024-09-10T05:41:04.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.632+0000 7fb0ecebe640 1 --2- 172.21.15.2:0/1240859116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0e8111db0 0x7fb0e81319d0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc00ba90 tx=0x7fb0dc01eae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d43855342be5a734 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:41:04.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.632+0000 7fb0e7fff640 1 -- 172.21.15.2:0/1240859116 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0dc0b4070 con 0x7fb0e8111db0 2024-09-10T05:41:04.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.632+0000 7fb0e7fff640 1 -- 172.21.15.2:0/1240859116 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0dc0a78f0 con 0x7fb0e8111db0 2024-09-10T05:41:04.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.632+0000 7fb0e7fff640 1 -- 172.21.15.2:0/1240859116 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0dc0a7bf0 con 0x7fb0e8111db0 2024-09-10T05:41:04.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.632+0000 7fb0ef923640 1 -- 172.21.15.2:0/1240859116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0e8111db0 msgr2=0x7fb0e81319d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:41:04.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.636+0000 7fb0ef923640 1 --2- 172.21.15.2:0/1240859116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0e8111db0 0x7fb0e81319d0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc00ba90 tx=0x7fb0dc01eae0 comp rx=0 tx=0).stop 2024-09-10T05:41:04.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.636+0000 7fb0ef923640 1 -- 172.21.15.2:0/1240859116 shutdown_connections 2024-09-10T05:41:04.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.636+0000 7fb0ef923640 1 --2- 172.21.15.2:0/1240859116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0e8111db0 0x7fb0e81319d0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:41:04.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.636+0000 7fb0ef923640 1 -- 172.21.15.2:0/1240859116 >> 172.21.15.2:0/1240859116 conn(0x7fb0e8070900 msgr2=0x7fb0e8072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:41:04.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.636+0000 7fb0ef923640 1 -- 172.21.15.2:0/1240859116 shutdown_connections 2024-09-10T05:41:04.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.636+0000 7fb0ef923640 1 -- 172.21.15.2:0/1240859116 wait complete. 2024-09-10T05:41:04.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.636+0000 7fb0ef923640 1 Processor -- start 2024-09-10T05:41:04.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.636+0000 7fb0ef923640 1 -- start start 2024-09-10T05:41:04.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.636+0000 7fb0ef923640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0e8111db0 0x7fb0e81c2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:41:04.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.636+0000 7fb0ef923640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb0e812d440 con 0x7fb0e8111db0 2024-09-10T05:41:04.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.636+0000 7fb0ed6bf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0e8111db0 0x7fb0e81c2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:41:04.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.636+0000 7fb0ed6bf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0e8111db0 0x7fb0e81c2f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53016/0 (socket says 172.21.15.2:53016) 2024-09-10T05:41:04.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.636+0000 7fb0ed6bf640 1 -- 172.21.15.2:0/3982694954 learned_addr learned my addr 172.21.15.2:0/3982694954 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:41:04.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.636+0000 7fb0ed6bf640 1 -- 172.21.15.2:0/3982694954 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0e8125c90 con 0x7fb0e8111db0 2024-09-10T05:41:04.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.636+0000 7fb0ed6bf640 1 --2- 172.21.15.2:0/3982694954 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0e8111db0 0x7fb0e81c2f30 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fb0d800c7f0 tx=0x7fb0d800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:41:04.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.636+0000 7fb0e5ffb640 1 -- 172.21.15.2:0/3982694954 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0d8018070 con 0x7fb0e8111db0 2024-09-10T05:41:04.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.636+0000 7fb0e5ffb640 1 -- 172.21.15.2:0/3982694954 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0d8004d80 con 0x7fb0e8111db0 2024-09-10T05:41:04.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.636+0000 7fb0e5ffb640 1 -- 172.21.15.2:0/3982694954 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0d800a7b0 con 0x7fb0e8111db0 2024-09-10T05:41:04.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.636+0000 7fb0ef923640 1 -- 172.21.15.2:0/3982694954 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0e8114840 con 0x7fb0e8111db0 2024-09-10T05:41:04.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.636+0000 7fb0ef923640 1 -- 172.21.15.2:0/3982694954 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0e81c3470 con 0x7fb0e8111db0 2024-09-10T05:41:04.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.636+0000 7fb0ef923640 1 -- 172.21.15.2:0/3982694954 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0e8131000 con 0x7fb0e8111db0 2024-09-10T05:41:04.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.636+0000 7fb0e5ffb640 1 -- 172.21.15.2:0/3982694954 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb0d801b070 con 0x7fb0e8111db0 2024-09-10T05:41:04.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.636+0000 7fb0e5ffb640 1 --2- 172.21.15.2:0/3982694954 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb0d403b1d0 0x7fb0d403d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:41:04.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.636+0000 7fb0e5ffb640 1 -- 172.21.15.2:0/3982694954 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7fb0d804ecd0 con 0x7fb0e8111db0 2024-09-10T05:41:04.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.640+0000 7fb0ecebe640 1 --2- 172.21.15.2:0/3982694954 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb0d403b1d0 0x7fb0d403d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:41:04.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.640+0000 7fb0ecebe640 1 --2- 172.21.15.2:0/3982694954 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb0d403b1d0 0x7fb0d403d690 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc0b1000 tx=0x7fb0dc0a9070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:41:04.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.644+0000 7fb0e5ffb640 1 -- 172.21.15.2:0/3982694954 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fb0e8131000 con 0x7fb0e8111db0 2024-09-10T05:41:04.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.812+0000 7fb0ef923640 1 -- 172.21.15.2:0/3982694954 --> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb0e8113bf0 con 0x7fb0d403b1d0 2024-09-10T05:41:04.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.840+0000 7fb0e5ffb640 1 -- 172.21.15.2:0/3982694954 <== mgr.4101 v2:172.21.15.62:6824/3663628807 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665207 (secure 0 0 0) 0x7fb0dc0a7940 con 0x7fb0d403b1d0 2024-09-10T05:41:04.851 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T05:41:04.857 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-10T05:41:04.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.848+0000 7fb0ef923640 1 -- 172.21.15.2:0/3982694954 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb0d403b1d0 msgr2=0x7fb0d403d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:41:04.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.848+0000 7fb0ef923640 1 --2- 172.21.15.2:0/3982694954 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb0d403b1d0 0x7fb0d403d690 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc0b1000 tx=0x7fb0dc0a9070 comp rx=0 tx=0).stop 2024-09-10T05:41:04.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.848+0000 7fb0ef923640 1 -- 172.21.15.2:0/3982694954 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0e8111db0 msgr2=0x7fb0e81c2f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:41:04.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.848+0000 7fb0ef923640 1 --2- 172.21.15.2:0/3982694954 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0e8111db0 0x7fb0e81c2f30 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fb0d800c7f0 tx=0x7fb0d800ccb0 comp rx=0 tx=0).stop 2024-09-10T05:41:04.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.848+0000 7fb0ef923640 1 -- 172.21.15.2:0/3982694954 shutdown_connections 2024-09-10T05:41:04.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.848+0000 7fb0ef923640 1 --2- 172.21.15.2:0/3982694954 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7fb0d403b1d0 0x7fb0d403d690 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:41:04.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.848+0000 7fb0ef923640 1 --2- 172.21.15.2:0/3982694954 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0e8111db0 0x7fb0e81c2f30 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:41:04.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.848+0000 7fb0ef923640 1 -- 172.21.15.2:0/3982694954 >> 172.21.15.2:0/3982694954 conn(0x7fb0e8070900 msgr2=0x7fb0e8125ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:41:04.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.848+0000 7fb0ef923640 1 -- 172.21.15.2:0/3982694954 shutdown_connections 2024-09-10T05:41:04.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:04.848+0000 7fb0ef923640 1 -- 172.21.15.2:0/3982694954 wait complete. 2024-09-10T05:41:04.872 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":184,"stamp":"2024-09-10T05:41:03.729852+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":254,"num_object_clones":0,"num_object_copies":508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":254,"num_whiteouts":0,"num_read":5438,"num_read_kb":4996,"num_write":2315,"num_write_kb":60588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":639982,"num_keys_recovered":1,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3349,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5004,"ondisk_log_size":5004,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152608,"kb_used_data":2912,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334752,"statfs":{"total":386547056640,"available":386390786048,"internally_reserved":0,"allocated":2981888,"data_stored":1773852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2619,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005596"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:26.410446+0000","last_change":"2024-09-10T05:40:26.410446+0000","last_active":"2024-09-10T05:40:26.410446+0000","last_peered":"2024-09-10T05:40:26.410446+0000","last_clean":"2024-09-10T05:40:26.410446+0000","last_became_active":"2024-09-10T05:36:11.605721+0000","last_became_peered":"2024-09-10T05:36:11.605721+0000","last_unstale":"2024-09-10T05:40:26.410446+0000","last_undegraded":"2024-09-10T05:40:26.410446+0000","last_fullsized":"2024-09-10T05:40:26.410446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:26.410267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:26.410267+0000","last_clean_scrub_stamp":"2024-09-10T05:40:26.410267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:28:48.605725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"30'2","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:37.485493+0000","last_change":"2024-09-10T05:40:37.485493+0000","last_active":"2024-09-10T05:40:37.485493+0000","last_peered":"2024-09-10T05:40:37.485493+0000","last_clean":"2024-09-10T05:40:37.485493+0000","last_became_active":"2024-09-10T05:36:13.628174+0000","last_became_peered":"2024-09-10T05:36:13.628174+0000","last_unstale":"2024-09-10T05:40:37.485493+0000","last_undegraded":"2024-09-10T05:40:37.485493+0000","last_fullsized":"2024-09-10T05:40:37.485493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-10T05:40:37.485299+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-10T05:40:37.485299+0000","last_clean_scrub_stamp":"2024-09-10T05:40:37.485299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:00:09.382323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"30'2","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:18.009113+0000","last_change":"2024-09-10T05:40:18.008954+0000","last_active":"2024-09-10T05:40:18.009113+0000","last_peered":"2024-09-10T05:40:18.009113+0000","last_clean":"2024-09-10T05:40:18.009113+0000","last_became_active":"2024-09-10T05:36:11.596100+0000","last_became_peered":"2024-09-10T05:36:11.596100+0000","last_unstale":"2024-09-10T05:40:18.009113+0000","last_undegraded":"2024-09-10T05:40:18.009113+0000","last_fullsized":"2024-09-10T05:40:18.009113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-10T05:40:18.008765+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-10T05:40:18.008765+0000","last_clean_scrub_stamp":"2024-09-10T05:40:18.008765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:04:13.763296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"34'6","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:36.862530+0000","last_change":"2024-09-10T05:40:36.862530+0000","last_active":"2024-09-10T05:40:36.862530+0000","last_peered":"2024-09-10T05:40:36.862530+0000","last_clean":"2024-09-10T05:40:36.862530+0000","last_became_active":"2024-09-10T05:36:13.598320+0000","last_became_peered":"2024-09-10T05:36:13.598320+0000","last_unstale":"2024-09-10T05:40:36.862530+0000","last_undegraded":"2024-09-10T05:40:36.862530+0000","last_fullsized":"2024-09-10T05:40:36.862530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T05:40:36.862311+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T05:40:36.862311+0000","last_clean_scrub_stamp":"2024-09-10T05:40:36.862311+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:10:19.778937+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:19.837151+0000","last_change":"2024-09-10T05:40:19.837024+0000","last_active":"2024-09-10T05:40:19.837151+0000","last_peered":"2024-09-10T05:40:19.837151+0000","last_clean":"2024-09-10T05:40:19.837151+0000","last_became_active":"2024-09-10T05:36:11.603193+0000","last_became_peered":"2024-09-10T05:36:11.603193+0000","last_unstale":"2024-09-10T05:40:19.837151+0000","last_undegraded":"2024-09-10T05:40:19.837151+0000","last_fullsized":"2024-09-10T05:40:19.837151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:19.836770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:19.836770+0000","last_clean_scrub_stamp":"2024-09-10T05:40:19.836770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:58:57.386751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'10","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:38.821797+0000","last_change":"2024-09-10T05:40:38.821797+0000","last_active":"2024-09-10T05:40:38.821797+0000","last_peered":"2024-09-10T05:40:38.821797+0000","last_clean":"2024-09-10T05:40:38.821797+0000","last_became_active":"2024-09-10T05:36:13.604094+0000","last_became_peered":"2024-09-10T05:36:13.604094+0000","last_unstale":"2024-09-10T05:40:38.821797+0000","last_undegraded":"2024-09-10T05:40:38.821797+0000","last_fullsized":"2024-09-10T05:40:38.821797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-10T05:40:38.821572+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-10T05:40:38.821572+0000","last_clean_scrub_stamp":"2024-09-10T05:40:38.821572+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:17:38.193128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:12.538733+0000","last_change":"2024-09-10T05:40:12.538576+0000","last_active":"2024-09-10T05:40:12.538733+0000","last_peered":"2024-09-10T05:40:12.538733+0000","last_clean":"2024-09-10T05:40:12.538733+0000","last_became_active":"2024-09-10T05:36:11.611399+0000","last_became_peered":"2024-09-10T05:36:11.611399+0000","last_unstale":"2024-09-10T05:40:12.538733+0000","last_undegraded":"2024-09-10T05:40:12.538733+0000","last_fullsized":"2024-09-10T05:40:12.538733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:12.538392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:12.538392+0000","last_clean_scrub_stamp":"2024-09-10T05:40:12.538392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:51:29.630049+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'10","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:28.558502+0000","last_change":"2024-09-10T05:40:28.558502+0000","last_active":"2024-09-10T05:40:28.558502+0000","last_peered":"2024-09-10T05:40:28.558502+0000","last_clean":"2024-09-10T05:40:28.558502+0000","last_became_active":"2024-09-10T05:36:52.702713+0000","last_became_peered":"2024-09-10T05:36:52.702713+0000","last_unstale":"2024-09-10T05:40:28.558502+0000","last_undegraded":"2024-09-10T05:40:28.558502+0000","last_fullsized":"2024-09-10T05:40:28.558502+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-10T05:40:28.558256+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-10T05:40:28.558256+0000","last_clean_scrub_stamp":"2024-09-10T05:40:28.558256+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:36:01.615339+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:22.425237+0000","last_change":"2024-09-10T05:40:22.425237+0000","last_active":"2024-09-10T05:40:22.425237+0000","last_peered":"2024-09-10T05:40:22.425237+0000","last_clean":"2024-09-10T05:40:22.425237+0000","last_became_active":"2024-09-10T05:36:11.597514+0000","last_became_peered":"2024-09-10T05:36:11.597514+0000","last_unstale":"2024-09-10T05:40:22.425237+0000","last_undegraded":"2024-09-10T05:40:22.425237+0000","last_fullsized":"2024-09-10T05:40:22.425237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:22.425061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:22.425061+0000","last_clean_scrub_stamp":"2024-09-10T05:40:22.425061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:18:48.780922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"34'12","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:36.250669+0000","last_change":"2024-09-10T05:40:36.250669+0000","last_active":"2024-09-10T05:40:36.250669+0000","last_peered":"2024-09-10T05:40:36.250669+0000","last_clean":"2024-09-10T05:40:36.250669+0000","last_became_active":"2024-09-10T05:36:13.621573+0000","last_became_peered":"2024-09-10T05:36:13.621573+0000","last_unstale":"2024-09-10T05:40:36.250669+0000","last_undegraded":"2024-09-10T05:40:36.250669+0000","last_fullsized":"2024-09-10T05:40:36.250669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-10T05:40:36.250487+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-10T05:40:36.250487+0000","last_clean_scrub_stamp":"2024-09-10T05:40:36.250487+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:44:20.265219+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:30.390534+0000","last_change":"2024-09-10T05:40:30.390534+0000","last_active":"2024-09-10T05:40:30.390534+0000","last_peered":"2024-09-10T05:40:30.390534+0000","last_clean":"2024-09-10T05:40:30.390534+0000","last_became_active":"2024-09-10T05:36:52.704285+0000","last_became_peered":"2024-09-10T05:36:52.704285+0000","last_unstale":"2024-09-10T05:40:30.390534+0000","last_undegraded":"2024-09-10T05:40:30.390534+0000","last_fullsized":"2024-09-10T05:40:30.390534+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:30.390348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:30.390348+0000","last_clean_scrub_stamp":"2024-09-10T05:40:30.390348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:21:07.016828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:41.484929+0000","last_change":"2024-09-10T05:40:41.484929+0000","last_active":"2024-09-10T05:40:41.484929+0000","last_peered":"2024-09-10T05:40:41.484929+0000","last_clean":"2024-09-10T05:40:41.484929+0000","last_became_active":"2024-09-10T05:36:13.612127+0000","last_became_peered":"2024-09-10T05:36:13.612127+0000","last_unstale":"2024-09-10T05:40:41.484929+0000","last_undegraded":"2024-09-10T05:40:41.484929+0000","last_fullsized":"2024-09-10T05:40:41.484929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:41.484740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:41.484740+0000","last_clean_scrub_stamp":"2024-09-10T05:40:41.484740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:17:33.369812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:18.795525+0000","last_change":"2024-09-10T05:40:18.795525+0000","last_active":"2024-09-10T05:40:18.795525+0000","last_peered":"2024-09-10T05:40:18.795525+0000","last_clean":"2024-09-10T05:40:18.795525+0000","last_became_active":"2024-09-10T05:36:11.598054+0000","last_became_peered":"2024-09-10T05:36:11.598054+0000","last_unstale":"2024-09-10T05:40:18.795525+0000","last_undegraded":"2024-09-10T05:40:18.795525+0000","last_fullsized":"2024-09-10T05:40:18.795525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:18.795346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:18.795346+0000","last_clean_scrub_stamp":"2024-09-10T05:40:18.795346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:40:32.792167+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'8","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:39.470635+0000","last_change":"2024-09-10T05:40:39.470635+0000","last_active":"2024-09-10T05:40:39.470635+0000","last_peered":"2024-09-10T05:40:39.470635+0000","last_clean":"2024-09-10T05:40:39.470635+0000","last_became_active":"2024-09-10T05:36:13.612743+0000","last_became_peered":"2024-09-10T05:36:13.612743+0000","last_unstale":"2024-09-10T05:40:39.470635+0000","last_undegraded":"2024-09-10T05:40:39.470635+0000","last_fullsized":"2024-09-10T05:40:39.470635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T05:40:39.470439+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T05:40:39.470439+0000","last_clean_scrub_stamp":"2024-09-10T05:40:39.470439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:04.935597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:20.856875+0000","last_change":"2024-09-10T05:40:20.856875+0000","last_active":"2024-09-10T05:40:20.856875+0000","last_peered":"2024-09-10T05:40:20.856875+0000","last_clean":"2024-09-10T05:40:20.856875+0000","last_became_active":"2024-09-10T05:36:11.593454+0000","last_became_peered":"2024-09-10T05:36:11.593454+0000","last_unstale":"2024-09-10T05:40:20.856875+0000","last_undegraded":"2024-09-10T05:40:20.856875+0000","last_fullsized":"2024-09-10T05:40:20.856875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:20.856670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:20.856670+0000","last_clean_scrub_stamp":"2024-09-10T05:40:20.856670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:07:34.824817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"34'10","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:29.569735+0000","last_change":"2024-09-10T05:40:29.569735+0000","last_active":"2024-09-10T05:40:29.569735+0000","last_peered":"2024-09-10T05:40:29.569735+0000","last_clean":"2024-09-10T05:40:29.569735+0000","last_became_active":"2024-09-10T05:36:13.621362+0000","last_became_peered":"2024-09-10T05:36:13.621362+0000","last_unstale":"2024-09-10T05:40:29.569735+0000","last_undegraded":"2024-09-10T05:40:29.569735+0000","last_fullsized":"2024-09-10T05:40:29.569735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-10T05:40:29.569463+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-10T05:40:29.569463+0000","last_clean_scrub_stamp":"2024-09-10T05:40:29.569463+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:43.066506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:35.454956+0000","last_change":"2024-09-10T05:40:35.454824+0000","last_active":"2024-09-10T05:40:35.454956+0000","last_peered":"2024-09-10T05:40:35.454956+0000","last_clean":"2024-09-10T05:40:35.454956+0000","last_became_active":"2024-09-10T05:36:13.628203+0000","last_became_peered":"2024-09-10T05:36:13.628203+0000","last_unstale":"2024-09-10T05:40:35.454956+0000","last_undegraded":"2024-09-10T05:40:35.454956+0000","last_fullsized":"2024-09-10T05:40:35.454956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:35.454640+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:35.454640+0000","last_clean_scrub_stamp":"2024-09-10T05:40:35.454640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:03:22.203757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"30'2","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:19.051004+0000","last_change":"2024-09-10T05:40:19.050830+0000","last_active":"2024-09-10T05:40:19.051004+0000","last_peered":"2024-09-10T05:40:19.051004+0000","last_clean":"2024-09-10T05:40:19.051004+0000","last_became_active":"2024-09-10T05:36:11.594409+0000","last_became_peered":"2024-09-10T05:36:11.594409+0000","last_unstale":"2024-09-10T05:40:19.051004+0000","last_undegraded":"2024-09-10T05:40:19.051004+0000","last_fullsized":"2024-09-10T05:40:19.051004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-10T05:40:19.050639+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-10T05:40:19.050639+0000","last_clean_scrub_stamp":"2024-09-10T05:40:19.050639+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:00:35.050660+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'8","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:36.503143+0000","last_change":"2024-09-10T05:40:36.503001+0000","last_active":"2024-09-10T05:40:36.503143+0000","last_peered":"2024-09-10T05:40:36.503143+0000","last_clean":"2024-09-10T05:40:36.503143+0000","last_became_active":"2024-09-10T05:36:13.619905+0000","last_became_peered":"2024-09-10T05:36:13.619905+0000","last_unstale":"2024-09-10T05:40:36.503143+0000","last_undegraded":"2024-09-10T05:40:36.503143+0000","last_fullsized":"2024-09-10T05:40:36.503143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-10T05:40:36.502829+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-10T05:40:36.502829+0000","last_clean_scrub_stamp":"2024-09-10T05:40:36.502829+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:50:18.078007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:13.522876+0000","last_change":"2024-09-10T05:40:13.522641+0000","last_active":"2024-09-10T05:40:13.522876+0000","last_peered":"2024-09-10T05:40:13.522876+0000","last_clean":"2024-09-10T05:40:13.522876+0000","last_became_active":"2024-09-10T05:36:11.611735+0000","last_became_peered":"2024-09-10T05:36:11.611735+0000","last_unstale":"2024-09-10T05:40:13.522876+0000","last_undegraded":"2024-09-10T05:40:13.522876+0000","last_fullsized":"2024-09-10T05:40:13.522876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:13.522433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:13.522433+0000","last_clean_scrub_stamp":"2024-09-10T05:40:13.522433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:18:33.845607+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'18","reported_seq":106,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:40.447388+0000","last_change":"2024-09-10T05:40:40.447249+0000","last_active":"2024-09-10T05:40:40.447388+0000","last_peered":"2024-09-10T05:40:40.447388+0000","last_clean":"2024-09-10T05:40:40.447388+0000","last_became_active":"2024-09-10T05:36:13.624358+0000","last_became_peered":"2024-09-10T05:36:13.624358+0000","last_unstale":"2024-09-10T05:40:40.447388+0000","last_undegraded":"2024-09-10T05:40:40.447388+0000","last_fullsized":"2024-09-10T05:40:40.447388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'18","last_scrub_stamp":"2024-09-10T05:40:40.447075+0000","last_deep_scrub":"34'18","last_deep_scrub_stamp":"2024-09-10T05:40:40.447075+0000","last_clean_scrub_stamp":"2024-09-10T05:40:40.447075+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:55:33.861501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":77,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"34'4","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:18.464650+0000","last_change":"2024-09-10T05:40:18.464461+0000","last_active":"2024-09-10T05:40:18.464650+0000","last_peered":"2024-09-10T05:40:18.464650+0000","last_clean":"2024-09-10T05:40:18.464650+0000","last_became_active":"2024-09-10T05:36:11.608244+0000","last_became_peered":"2024-09-10T05:36:11.608244+0000","last_unstale":"2024-09-10T05:40:18.464650+0000","last_undegraded":"2024-09-10T05:40:18.464650+0000","last_fullsized":"2024-09-10T05:40:18.464650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:18.464272+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:18.464272+0000","last_clean_scrub_stamp":"2024-09-10T05:40:18.464272+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:52:02.384371+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"32'24","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:24.517863+0000","last_change":"2024-09-10T05:40:24.517664+0000","last_active":"2024-09-10T05:40:24.517863+0000","last_peered":"2024-09-10T05:40:24.517863+0000","last_clean":"2024-09-10T05:40:24.517863+0000","last_became_active":"2024-09-10T05:36:13.613298+0000","last_became_peered":"2024-09-10T05:36:13.613298+0000","last_unstale":"2024-09-10T05:40:24.517863+0000","last_undegraded":"2024-09-10T05:40:24.517863+0000","last_fullsized":"2024-09-10T05:40:24.517863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'24","last_scrub_stamp":"2024-09-10T05:40:24.517467+0000","last_deep_scrub":"32'24","last_deep_scrub_stamp":"2024-09-10T05:40:24.517467+0000","last_clean_scrub_stamp":"2024-09-10T05:40:24.517467+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:57.476190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":77,"num_write":32,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"32'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:20.433898+0000","last_change":"2024-09-10T05:40:20.433725+0000","last_active":"2024-09-10T05:40:20.433898+0000","last_peered":"2024-09-10T05:40:20.433898+0000","last_clean":"2024-09-10T05:40:20.433898+0000","last_became_active":"2024-09-10T05:36:11.600159+0000","last_became_peered":"2024-09-10T05:36:11.600159+0000","last_unstale":"2024-09-10T05:40:20.433898+0000","last_undegraded":"2024-09-10T05:40:20.433898+0000","last_fullsized":"2024-09-10T05:40:20.433898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T05:40:20.433528+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T05:40:20.433528+0000","last_clean_scrub_stamp":"2024-09-10T05:40:20.433528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:07:04.481328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"34'12","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:25.520204+0000","last_change":"2024-09-10T05:40:25.520043+0000","last_active":"2024-09-10T05:40:25.520204+0000","last_peered":"2024-09-10T05:40:25.520204+0000","last_clean":"2024-09-10T05:40:25.520204+0000","last_became_active":"2024-09-10T05:36:13.605913+0000","last_became_peered":"2024-09-10T05:36:13.605913+0000","last_unstale":"2024-09-10T05:40:25.520204+0000","last_undegraded":"2024-09-10T05:40:25.520204+0000","last_fullsized":"2024-09-10T05:40:25.520204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-10T05:40:25.519838+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-10T05:40:25.519838+0000","last_clean_scrub_stamp":"2024-09-10T05:40:25.519838+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:25:15.570219+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:10.535482+0000","last_change":"2024-09-10T05:40:10.535482+0000","last_active":"2024-09-10T05:40:10.535482+0000","last_peered":"2024-09-10T05:40:10.535482+0000","last_clean":"2024-09-10T05:40:10.535482+0000","last_became_active":"2024-09-10T05:36:52.701277+0000","last_became_peered":"2024-09-10T05:36:52.701277+0000","last_unstale":"2024-09-10T05:40:10.535482+0000","last_undegraded":"2024-09-10T05:40:10.535482+0000","last_fullsized":"2024-09-10T05:40:10.535482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:10.535301+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:10.535301+0000","last_clean_scrub_stamp":"2024-09-10T05:40:10.535301+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:04:14.281405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":1250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":639872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:34.183372+0000","last_change":"2024-09-10T05:40:34.183121+0000","last_active":"2024-09-10T05:40:34.183372+0000","last_peered":"2024-09-10T05:40:34.183372+0000","last_clean":"2024-09-10T05:40:34.183372+0000","last_became_active":"2024-09-10T05:36:13.599955+0000","last_became_peered":"2024-09-10T05:36:13.599955+0000","last_unstale":"2024-09-10T05:40:34.183372+0000","last_undegraded":"2024-09-10T05:40:34.183372+0000","last_fullsized":"2024-09-10T05:40:34.183372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:34.182915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:34.182915+0000","last_clean_scrub_stamp":"2024-09-10T05:40:34.182915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:14:10.458122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"34'2","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:25.836610+0000","last_change":"2024-09-10T05:40:25.836463+0000","last_active":"2024-09-10T05:40:25.836610+0000","last_peered":"2024-09-10T05:40:25.836610+0000","last_clean":"2024-09-10T05:40:25.836610+0000","last_became_active":"2024-09-10T05:36:11.603982+0000","last_became_peered":"2024-09-10T05:36:11.603982+0000","last_unstale":"2024-09-10T05:40:25.836610+0000","last_undegraded":"2024-09-10T05:40:25.836610+0000","last_fullsized":"2024-09-10T05:40:25.836610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:25.836286+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:25.836286+0000","last_clean_scrub_stamp":"2024-09-10T05:40:25.836286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:57:32.240826+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'35","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.250994+0000","last_change":"2024-09-10T05:36:21.673756+0000","last_active":"2024-09-10T05:39:27.250994+0000","last_peered":"2024-09-10T05:39:27.250994+0000","last_clean":"2024-09-10T05:39:27.250994+0000","last_became_active":"2024-09-10T05:36:21.672975+0000","last_became_peered":"2024-09-10T05:36:21.672975+0000","last_unstale":"2024-09-10T05:39:27.250994+0000","last_undegraded":"2024-09-10T05:39:27.250994+0000","last_fullsized":"2024-09-10T05:39:27.250994+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:09:28.929715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'10","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:24.858208+0000","last_change":"2024-09-10T05:40:24.858068+0000","last_active":"2024-09-10T05:40:24.858208+0000","last_peered":"2024-09-10T05:40:24.858208+0000","last_clean":"2024-09-10T05:40:24.858208+0000","last_became_active":"2024-09-10T05:36:13.616006+0000","last_became_peered":"2024-09-10T05:36:13.616006+0000","last_unstale":"2024-09-10T05:40:24.858208+0000","last_undegraded":"2024-09-10T05:40:24.858208+0000","last_fullsized":"2024-09-10T05:40:24.858208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-10T05:40:24.857896+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-10T05:40:24.857896+0000","last_clean_scrub_stamp":"2024-09-10T05:40:24.857896+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:05:44.490607+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:11.764615+0000","last_change":"2024-09-10T05:40:11.764472+0000","last_active":"2024-09-10T05:40:11.764615+0000","last_peered":"2024-09-10T05:40:11.764615+0000","last_clean":"2024-09-10T05:40:11.764615+0000","last_became_active":"2024-09-10T05:36:11.601101+0000","last_became_peered":"2024-09-10T05:36:11.601101+0000","last_unstale":"2024-09-10T05:40:11.764615+0000","last_undegraded":"2024-09-10T05:40:11.764615+0000","last_fullsized":"2024-09-10T05:40:11.764615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:11.764291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:11.764291+0000","last_clean_scrub_stamp":"2024-09-10T05:40:11.764291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:10:57.529948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:44.925654+0000","last_change":"2024-09-10T05:40:44.925654+0000","last_active":"2024-09-10T05:40:44.925654+0000","last_peered":"2024-09-10T05:40:44.925654+0000","last_clean":"2024-09-10T05:40:44.925654+0000","last_became_active":"2024-09-10T05:36:15.626172+0000","last_became_peered":"2024-09-10T05:36:15.626172+0000","last_unstale":"2024-09-10T05:40:44.925654+0000","last_undegraded":"2024-09-10T05:40:44.925654+0000","last_fullsized":"2024-09-10T05:40:44.925654+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:44.925471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:44.925471+0000","last_clean_scrub_stamp":"2024-09-10T05:40:44.925471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:02:08.889223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'51","reported_seq":122,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:54.893901+0000","last_change":"2024-09-10T05:40:54.893901+0000","last_active":"2024-09-10T05:40:54.893901+0000","last_peered":"2024-09-10T05:40:54.893901+0000","last_clean":"2024-09-10T05:40:54.893901+0000","last_became_active":"2024-09-10T05:36:17.639318+0000","last_became_peered":"2024-09-10T05:36:17.639318+0000","last_unstale":"2024-09-10T05:40:54.893901+0000","last_undegraded":"2024-09-10T05:40:54.893901+0000","last_fullsized":"2024-09-10T05:40:54.893901+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'51","last_scrub_stamp":"2024-09-10T05:40:54.893657+0000","last_deep_scrub":"34'51","last_deep_scrub_stamp":"2024-09-10T05:40:54.893657+0000","last_clean_scrub_stamp":"2024-09-10T05:40:54.893657+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:49:25.809577+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.898449+0000","last_change":"2024-09-10T05:36:19.648793+0000","last_active":"2024-09-10T05:37:55.898449+0000","last_peered":"2024-09-10T05:37:55.898449+0000","last_clean":"2024-09-10T05:37:55.898449+0000","last_became_active":"2024-09-10T05:36:19.647998+0000","last_became_peered":"2024-09-10T05:36:19.647998+0000","last_unstale":"2024-09-10T05:37:55.898449+0000","last_undegraded":"2024-09-10T05:37:55.898449+0000","last_fullsized":"2024-09-10T05:37:55.898449+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:14:38.933277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"32'9","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.899552+0000","last_change":"2024-09-10T05:36:21.673262+0000","last_active":"2024-09-10T05:37:55.899552+0000","last_peered":"2024-09-10T05:37:55.899552+0000","last_clean":"2024-09-10T05:37:55.899552+0000","last_became_active":"2024-09-10T05:36:21.672757+0000","last_became_peered":"2024-09-10T05:36:21.672757+0000","last_unstale":"2024-09-10T05:37:55.899552+0000","last_undegraded":"2024-09-10T05:37:55.899552+0000","last_fullsized":"2024-09-10T05:37:55.899552+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:49:20.130241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"32'6","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:30.812303+0000","last_change":"2024-09-10T05:40:30.812041+0000","last_active":"2024-09-10T05:40:30.812303+0000","last_peered":"2024-09-10T05:40:30.812303+0000","last_clean":"2024-09-10T05:40:30.812303+0000","last_became_active":"2024-09-10T05:36:13.597649+0000","last_became_peered":"2024-09-10T05:36:13.597649+0000","last_unstale":"2024-09-10T05:40:30.812303+0000","last_undegraded":"2024-09-10T05:40:30.812303+0000","last_fullsized":"2024-09-10T05:40:30.812303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-10T05:40:30.811823+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-10T05:40:30.811823+0000","last_clean_scrub_stamp":"2024-09-10T05:40:30.811823+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:34:06.593714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:03.521134+0000","last_change":"2024-09-10T05:40:03.520977+0000","last_active":"2024-09-10T05:40:03.521134+0000","last_peered":"2024-09-10T05:40:03.521134+0000","last_clean":"2024-09-10T05:40:03.521134+0000","last_became_active":"2024-09-10T05:36:11.611326+0000","last_became_peered":"2024-09-10T05:36:11.611326+0000","last_unstale":"2024-09-10T05:40:03.521134+0000","last_undegraded":"2024-09-10T05:40:03.521134+0000","last_fullsized":"2024-09-10T05:40:03.521134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:03.520795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:03.520795+0000","last_clean_scrub_stamp":"2024-09-10T05:40:03.520795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:12:23.788294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:43.901999+0000","last_change":"2024-09-10T05:40:43.901867+0000","last_active":"2024-09-10T05:40:43.901999+0000","last_peered":"2024-09-10T05:40:43.901999+0000","last_clean":"2024-09-10T05:40:43.901999+0000","last_became_active":"2024-09-10T05:36:15.607918+0000","last_became_peered":"2024-09-10T05:36:15.607918+0000","last_unstale":"2024-09-10T05:40:43.901999+0000","last_undegraded":"2024-09-10T05:40:43.901999+0000","last_fullsized":"2024-09-10T05:40:43.901999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:43.901620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:43.901620+0000","last_clean_scrub_stamp":"2024-09-10T05:40:43.901620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:07:10.194917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"34'16","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:51.051260+0000","last_change":"2024-09-10T05:40:51.051260+0000","last_active":"2024-09-10T05:40:51.051260+0000","last_peered":"2024-09-10T05:40:51.051260+0000","last_clean":"2024-09-10T05:40:51.051260+0000","last_became_active":"2024-09-10T05:36:17.643856+0000","last_became_peered":"2024-09-10T05:36:17.643856+0000","last_unstale":"2024-09-10T05:40:51.051260+0000","last_undegraded":"2024-09-10T05:40:51.051260+0000","last_fullsized":"2024-09-10T05:40:51.051260+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-10T05:40:51.051071+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-10T05:40:51.051071+0000","last_clean_scrub_stamp":"2024-09-10T05:40:51.051071+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:18:30.814962+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.899864+0000","last_change":"2024-09-10T05:36:19.648357+0000","last_active":"2024-09-10T05:37:55.899864+0000","last_peered":"2024-09-10T05:37:55.899864+0000","last_clean":"2024-09-10T05:37:55.899864+0000","last_became_active":"2024-09-10T05:36:19.647612+0000","last_became_peered":"2024-09-10T05:36:19.647612+0000","last_unstale":"2024-09-10T05:37:55.899864+0000","last_undegraded":"2024-09-10T05:37:55.899864+0000","last_fullsized":"2024-09-10T05:37:55.899864+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:06:01.493680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"34'10","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:26.344196+0000","last_change":"2024-09-10T05:36:21.679828+0000","last_active":"2024-09-10T05:39:26.344196+0000","last_peered":"2024-09-10T05:39:26.344196+0000","last_clean":"2024-09-10T05:39:26.344196+0000","last_became_active":"2024-09-10T05:36:21.679052+0000","last_became_peered":"2024-09-10T05:36:21.679052+0000","last_unstale":"2024-09-10T05:39:26.344196+0000","last_undegraded":"2024-09-10T05:39:26.344196+0000","last_fullsized":"2024-09-10T05:39:26.344196+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:53.565670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:27.820103+0000","last_change":"2024-09-10T05:40:27.819874+0000","last_active":"2024-09-10T05:40:27.820103+0000","last_peered":"2024-09-10T05:40:27.820103+0000","last_clean":"2024-09-10T05:40:27.820103+0000","last_became_active":"2024-09-10T05:36:13.611935+0000","last_became_peered":"2024-09-10T05:36:13.611935+0000","last_unstale":"2024-09-10T05:40:27.820103+0000","last_undegraded":"2024-09-10T05:40:27.820103+0000","last_fullsized":"2024-09-10T05:40:27.820103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:27.819678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:27.819678+0000","last_clean_scrub_stamp":"2024-09-10T05:40:27.819678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:58:08.522577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:13.353307+0000","last_change":"2024-09-10T05:40:13.353164+0000","last_active":"2024-09-10T05:40:13.353307+0000","last_peered":"2024-09-10T05:40:13.353307+0000","last_clean":"2024-09-10T05:40:13.353307+0000","last_became_active":"2024-09-10T05:36:11.596047+0000","last_became_peered":"2024-09-10T05:36:11.596047+0000","last_unstale":"2024-09-10T05:40:13.353307+0000","last_undegraded":"2024-09-10T05:40:13.353307+0000","last_fullsized":"2024-09-10T05:40:13.353307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:13.352981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:13.352981+0000","last_clean_scrub_stamp":"2024-09-10T05:40:13.352981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:20.013639+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:45.960970+0000","last_change":"2024-09-10T05:40:45.960970+0000","last_active":"2024-09-10T05:40:45.960970+0000","last_peered":"2024-09-10T05:40:45.960970+0000","last_clean":"2024-09-10T05:40:45.960970+0000","last_became_active":"2024-09-10T05:36:15.635534+0000","last_became_peered":"2024-09-10T05:36:15.635534+0000","last_unstale":"2024-09-10T05:40:45.960970+0000","last_undegraded":"2024-09-10T05:40:45.960970+0000","last_fullsized":"2024-09-10T05:40:45.960970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:45.960788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:45.960788+0000","last_clean_scrub_stamp":"2024-09-10T05:40:45.960788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:06:22.011394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"34'30","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:38.546679+0000","last_change":"2024-09-10T05:40:38.546544+0000","last_active":"2024-09-10T05:40:38.546679+0000","last_peered":"2024-09-10T05:40:38.546679+0000","last_clean":"2024-09-10T05:40:38.546679+0000","last_became_active":"2024-09-10T05:36:17.626936+0000","last_became_peered":"2024-09-10T05:36:17.626936+0000","last_unstale":"2024-09-10T05:40:38.546679+0000","last_undegraded":"2024-09-10T05:40:38.546679+0000","last_fullsized":"2024-09-10T05:40:38.546679+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'30","last_scrub_stamp":"2024-09-10T05:40:38.546347+0000","last_deep_scrub":"34'30","last_deep_scrub_stamp":"2024-09-10T05:40:38.546347+0000","last_clean_scrub_stamp":"2024-09-10T05:40:38.546347+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:58.791838+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'285","reported_seq":394,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.363782+0000","last_change":"2024-09-10T05:36:19.665303+0000","last_active":"2024-09-10T05:39:58.363782+0000","last_peered":"2024-09-10T05:39:58.363782+0000","last_clean":"2024-09-10T05:39:58.363782+0000","last_became_active":"2024-09-10T05:36:19.664741+0000","last_became_peered":"2024-09-10T05:36:19.664741+0000","last_unstale":"2024-09-10T05:39:58.363782+0000","last_undegraded":"2024-09-10T05:39:58.363782+0000","last_fullsized":"2024-09-10T05:39:58.363782+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:34:14.254885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"34'2","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:51.580891+0000","last_change":"2024-09-10T05:40:51.580891+0000","last_active":"2024-09-10T05:40:51.580891+0000","last_peered":"2024-09-10T05:40:51.580891+0000","last_clean":"2024-09-10T05:40:51.580891+0000","last_became_active":"2024-09-10T05:36:21.656522+0000","last_became_peered":"2024-09-10T05:36:21.656522+0000","last_unstale":"2024-09-10T05:40:51.580891+0000","last_undegraded":"2024-09-10T05:40:51.580891+0000","last_fullsized":"2024-09-10T05:40:51.580891+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:51.580717+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:51.580717+0000","last_clean_scrub_stamp":"2024-09-10T05:40:51.580717+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:43:05.177184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'8","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:29.796808+0000","last_change":"2024-09-10T05:40:29.796565+0000","last_active":"2024-09-10T05:40:29.796808+0000","last_peered":"2024-09-10T05:40:29.796808+0000","last_clean":"2024-09-10T05:40:29.796808+0000","last_became_active":"2024-09-10T05:36:13.622771+0000","last_became_peered":"2024-09-10T05:36:13.622771+0000","last_unstale":"2024-09-10T05:40:29.796808+0000","last_undegraded":"2024-09-10T05:40:29.796808+0000","last_fullsized":"2024-09-10T05:40:29.796808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-10T05:40:29.796340+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-10T05:40:29.796340+0000","last_clean_scrub_stamp":"2024-09-10T05:40:29.796340+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:33:51.581411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"32'2","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:09.364674+0000","last_change":"2024-09-10T05:40:09.364492+0000","last_active":"2024-09-10T05:40:09.364674+0000","last_peered":"2024-09-10T05:40:09.364674+0000","last_clean":"2024-09-10T05:40:09.364674+0000","last_became_active":"2024-09-10T05:36:11.596165+0000","last_became_peered":"2024-09-10T05:36:11.596165+0000","last_unstale":"2024-09-10T05:40:09.364674+0000","last_undegraded":"2024-09-10T05:40:09.364674+0000","last_fullsized":"2024-09-10T05:40:09.364674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T05:40:09.364301+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T05:40:09.364301+0000","last_clean_scrub_stamp":"2024-09-10T05:40:09.364301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:02:21.771318+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:45.515346+0000","last_change":"2024-09-10T05:40:45.515346+0000","last_active":"2024-09-10T05:40:45.515346+0000","last_peered":"2024-09-10T05:40:45.515346+0000","last_clean":"2024-09-10T05:40:45.515346+0000","last_became_active":"2024-09-10T05:36:15.615994+0000","last_became_peered":"2024-09-10T05:36:15.615994+0000","last_unstale":"2024-09-10T05:40:45.515346+0000","last_undegraded":"2024-09-10T05:40:45.515346+0000","last_fullsized":"2024-09-10T05:40:45.515346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:45.515134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:45.515134+0000","last_clean_scrub_stamp":"2024-09-10T05:40:45.515134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:21:51.761789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"34'44","reported_seq":109,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:58.170821+0000","last_change":"2024-09-10T05:40:58.170821+0000","last_active":"2024-09-10T05:40:58.170821+0000","last_peered":"2024-09-10T05:40:58.170821+0000","last_clean":"2024-09-10T05:40:58.170821+0000","last_became_active":"2024-09-10T05:36:17.631054+0000","last_became_peered":"2024-09-10T05:36:17.631054+0000","last_unstale":"2024-09-10T05:40:58.170821+0000","last_undegraded":"2024-09-10T05:40:58.170821+0000","last_fullsized":"2024-09-10T05:40:58.170821+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'44","last_scrub_stamp":"2024-09-10T05:40:58.170623+0000","last_deep_scrub":"34'44","last_deep_scrub_stamp":"2024-09-10T05:40:58.170623+0000","last_clean_scrub_stamp":"2024-09-10T05:40:58.170623+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:34.367806+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"34'285","reported_seq":411,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.765634+0000","last_change":"2024-09-10T05:36:19.671507+0000","last_active":"2024-09-10T05:39:58.765634+0000","last_peered":"2024-09-10T05:39:58.765634+0000","last_clean":"2024-09-10T05:39:58.765634+0000","last_became_active":"2024-09-10T05:36:19.670915+0000","last_became_peered":"2024-09-10T05:36:19.670915+0000","last_unstale":"2024-09-10T05:39:58.765634+0000","last_undegraded":"2024-09-10T05:39:58.765634+0000","last_fullsized":"2024-09-10T05:39:58.765634+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"34'8","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:23.819129+0000","last_change":"2024-09-10T05:40:23.818949+0000","last_active":"2024-09-10T05:40:23.819129+0000","last_peered":"2024-09-10T05:40:23.819129+0000","last_clean":"2024-09-10T05:40:23.819129+0000","last_became_active":"2024-09-10T05:36:13.597477+0000","last_became_peered":"2024-09-10T05:36:13.597477+0000","last_unstale":"2024-09-10T05:40:23.819129+0000","last_undegraded":"2024-09-10T05:40:23.819129+0000","last_fullsized":"2024-09-10T05:40:23.819129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-10T05:40:23.818774+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-10T05:40:23.818774+0000","last_clean_scrub_stamp":"2024-09-10T05:40:23.818774+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:57.685828+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:12.342230+0000","last_change":"2024-09-10T05:40:12.341960+0000","last_active":"2024-09-10T05:40:12.342230+0000","last_peered":"2024-09-10T05:40:12.342230+0000","last_clean":"2024-09-10T05:40:12.342230+0000","last_became_active":"2024-09-10T05:36:11.600405+0000","last_became_peered":"2024-09-10T05:36:11.600405+0000","last_unstale":"2024-09-10T05:40:12.342230+0000","last_undegraded":"2024-09-10T05:40:12.342230+0000","last_fullsized":"2024-09-10T05:40:12.342230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:12.341728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:12.341728+0000","last_clean_scrub_stamp":"2024-09-10T05:40:12.341728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:41:26.735507+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:39.182970+0000","last_change":"2024-09-10T05:40:39.182970+0000","last_active":"2024-09-10T05:40:39.182970+0000","last_peered":"2024-09-10T05:40:39.182970+0000","last_clean":"2024-09-10T05:40:39.182970+0000","last_became_active":"2024-09-10T05:36:15.620908+0000","last_became_peered":"2024-09-10T05:36:15.620908+0000","last_unstale":"2024-09-10T05:40:39.182970+0000","last_undegraded":"2024-09-10T05:40:39.182970+0000","last_fullsized":"2024-09-10T05:40:39.182970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:39.182790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:39.182790+0000","last_clean_scrub_stamp":"2024-09-10T05:40:39.182790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:00:57.905871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'60","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:36.535093+0000","last_change":"2024-09-10T05:40:36.535093+0000","last_active":"2024-09-10T05:40:36.535093+0000","last_peered":"2024-09-10T05:40:36.535093+0000","last_clean":"2024-09-10T05:40:36.535093+0000","last_became_active":"2024-09-10T05:36:52.710284+0000","last_became_peered":"2024-09-10T05:36:52.710284+0000","last_unstale":"2024-09-10T05:40:36.535093+0000","last_undegraded":"2024-09-10T05:40:36.535093+0000","last_fullsized":"2024-09-10T05:40:36.535093+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'60","last_scrub_stamp":"2024-09-10T05:40:36.534889+0000","last_deep_scrub":"34'60","last_deep_scrub_stamp":"2024-09-10T05:40:36.534889+0000","last_clean_scrub_stamp":"2024-09-10T05:40:36.534889+0000","objects_scrubbed":10,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:52:45.576787+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:53.104709+0000","last_change":"2024-09-10T05:40:53.104709+0000","last_active":"2024-09-10T05:40:53.104709+0000","last_peered":"2024-09-10T05:40:53.104709+0000","last_clean":"2024-09-10T05:40:53.104709+0000","last_became_active":"2024-09-10T05:36:19.640470+0000","last_became_peered":"2024-09-10T05:36:19.640470+0000","last_unstale":"2024-09-10T05:40:53.104709+0000","last_undegraded":"2024-09-10T05:40:53.104709+0000","last_fullsized":"2024-09-10T05:40:53.104709+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:53.104501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:53.104501+0000","last_clean_scrub_stamp":"2024-09-10T05:40:53.104501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:08:52.699420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"32'3","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:49.524901+0000","last_change":"2024-09-10T05:40:49.524901+0000","last_active":"2024-09-10T05:40:49.524901+0000","last_peered":"2024-09-10T05:40:49.524901+0000","last_clean":"2024-09-10T05:40:49.524901+0000","last_became_active":"2024-09-10T05:36:21.664232+0000","last_became_peered":"2024-09-10T05:36:21.664232+0000","last_unstale":"2024-09-10T05:40:49.524901+0000","last_undegraded":"2024-09-10T05:40:49.524901+0000","last_fullsized":"2024-09-10T05:40:49.524901+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-10T05:40:49.524695+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-10T05:40:49.524695+0000","last_clean_scrub_stamp":"2024-09-10T05:40:49.524695+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:14:48.157451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'2","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:15.511801+0000","last_change":"2024-09-10T05:40:15.511801+0000","last_active":"2024-09-10T05:40:15.511801+0000","last_peered":"2024-09-10T05:40:15.511801+0000","last_clean":"2024-09-10T05:40:15.511801+0000","last_became_active":"2024-09-10T05:36:52.703743+0000","last_became_peered":"2024-09-10T05:36:52.703743+0000","last_unstale":"2024-09-10T05:40:15.511801+0000","last_undegraded":"2024-09-10T05:40:15.511801+0000","last_fullsized":"2024-09-10T05:40:15.511801+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:15.511620+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:15.511620+0000","last_clean_scrub_stamp":"2024-09-10T05:40:15.511620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:45:41.854563+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:07.337399+0000","last_change":"2024-09-10T05:40:07.337269+0000","last_active":"2024-09-10T05:40:07.337399+0000","last_peered":"2024-09-10T05:40:07.337399+0000","last_clean":"2024-09-10T05:40:07.337399+0000","last_became_active":"2024-09-10T05:36:11.597717+0000","last_became_peered":"2024-09-10T05:36:11.597717+0000","last_unstale":"2024-09-10T05:40:07.337399+0000","last_undegraded":"2024-09-10T05:40:07.337399+0000","last_fullsized":"2024-09-10T05:40:07.337399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:07.337094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:07.337094+0000","last_clean_scrub_stamp":"2024-09-10T05:40:07.337094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:15.999267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:32.546321+0000","last_change":"2024-09-10T05:40:32.546155+0000","last_active":"2024-09-10T05:40:32.546321+0000","last_peered":"2024-09-10T05:40:32.546321+0000","last_clean":"2024-09-10T05:40:32.546321+0000","last_became_active":"2024-09-10T05:36:15.631635+0000","last_became_peered":"2024-09-10T05:36:15.631635+0000","last_unstale":"2024-09-10T05:40:32.546321+0000","last_undegraded":"2024-09-10T05:40:32.546321+0000","last_fullsized":"2024-09-10T05:40:32.546321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:32.545964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:32.545964+0000","last_clean_scrub_stamp":"2024-09-10T05:40:32.545964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:59:39.430013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"34'44","reported_seq":110,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:49.911492+0000","last_change":"2024-09-10T05:40:49.911492+0000","last_active":"2024-09-10T05:40:49.911492+0000","last_peered":"2024-09-10T05:40:49.911492+0000","last_clean":"2024-09-10T05:40:49.911492+0000","last_became_active":"2024-09-10T05:36:17.638301+0000","last_became_peered":"2024-09-10T05:36:17.638301+0000","last_unstale":"2024-09-10T05:40:49.911492+0000","last_undegraded":"2024-09-10T05:40:49.911492+0000","last_fullsized":"2024-09-10T05:40:49.911492+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'44","last_scrub_stamp":"2024-09-10T05:40:49.911298+0000","last_deep_scrub":"34'44","last_deep_scrub_stamp":"2024-09-10T05:40:49.911298+0000","last_clean_scrub_stamp":"2024-09-10T05:40:49.911298+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:47:57.628255+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:41:01.914898+0000","last_change":"2024-09-10T05:41:01.914898+0000","last_active":"2024-09-10T05:41:01.914898+0000","last_peered":"2024-09-10T05:41:01.914898+0000","last_clean":"2024-09-10T05:41:01.914898+0000","last_became_active":"2024-09-10T05:36:19.671022+0000","last_became_peered":"2024-09-10T05:36:19.671022+0000","last_unstale":"2024-09-10T05:41:01.914898+0000","last_undegraded":"2024-09-10T05:41:01.914898+0000","last_fullsized":"2024-09-10T05:41:01.914898+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:41:01.914715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:41:01.914715+0000","last_clean_scrub_stamp":"2024-09-10T05:41:01.914715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:42:25.922776+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"34'4","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:41:00.207808+0000","last_change":"2024-09-10T05:41:00.207808+0000","last_active":"2024-09-10T05:41:00.207808+0000","last_peered":"2024-09-10T05:41:00.207808+0000","last_clean":"2024-09-10T05:41:00.207808+0000","last_became_active":"2024-09-10T05:36:21.666042+0000","last_became_peered":"2024-09-10T05:36:21.666042+0000","last_unstale":"2024-09-10T05:41:00.207808+0000","last_undegraded":"2024-09-10T05:41:00.207808+0000","last_fullsized":"2024-09-10T05:41:00.207808+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:41:00.207581+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:41:00.207581+0000","last_clean_scrub_stamp":"2024-09-10T05:41:00.207581+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:07:09.337309+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'14","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:16.468481+0000","last_change":"2024-09-10T05:40:16.468481+0000","last_active":"2024-09-10T05:40:16.468481+0000","last_peered":"2024-09-10T05:40:16.468481+0000","last_clean":"2024-09-10T05:40:16.468481+0000","last_became_active":"2024-09-10T05:36:52.696116+0000","last_became_peered":"2024-09-10T05:36:52.696116+0000","last_unstale":"2024-09-10T05:40:16.468481+0000","last_undegraded":"2024-09-10T05:40:16.468481+0000","last_fullsized":"2024-09-10T05:40:16.468481+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-10T05:40:16.468308+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-10T05:40:16.468308+0000","last_clean_scrub_stamp":"2024-09-10T05:40:16.468308+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:13:08.427165+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:11.363315+0000","last_change":"2024-09-10T05:40:11.363136+0000","last_active":"2024-09-10T05:40:11.363315+0000","last_peered":"2024-09-10T05:40:11.363315+0000","last_clean":"2024-09-10T05:40:11.363315+0000","last_became_active":"2024-09-10T05:36:11.606576+0000","last_became_peered":"2024-09-10T05:36:11.606576+0000","last_unstale":"2024-09-10T05:40:11.363315+0000","last_undegraded":"2024-09-10T05:40:11.363315+0000","last_fullsized":"2024-09-10T05:40:11.363315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:11.362960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:11.362960+0000","last_clean_scrub_stamp":"2024-09-10T05:40:11.362960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:18.945320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:34.536824+0000","last_change":"2024-09-10T05:40:34.536659+0000","last_active":"2024-09-10T05:40:34.536824+0000","last_peered":"2024-09-10T05:40:34.536824+0000","last_clean":"2024-09-10T05:40:34.536824+0000","last_became_active":"2024-09-10T05:36:15.617647+0000","last_became_peered":"2024-09-10T05:36:15.617647+0000","last_unstale":"2024-09-10T05:40:34.536824+0000","last_undegraded":"2024-09-10T05:40:34.536824+0000","last_fullsized":"2024-09-10T05:40:34.536824+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:34.536474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:34.536474+0000","last_clean_scrub_stamp":"2024-09-10T05:40:34.536474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:08.497925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"34'61","reported_seq":136,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:56.195805+0000","last_change":"2024-09-10T05:40:56.195805+0000","last_active":"2024-09-10T05:40:56.195805+0000","last_peered":"2024-09-10T05:40:56.195805+0000","last_clean":"2024-09-10T05:40:56.195805+0000","last_became_active":"2024-09-10T05:36:17.636000+0000","last_became_peered":"2024-09-10T05:36:17.636000+0000","last_unstale":"2024-09-10T05:40:56.195805+0000","last_undegraded":"2024-09-10T05:40:56.195805+0000","last_fullsized":"2024-09-10T05:40:56.195805+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'61","last_scrub_stamp":"2024-09-10T05:40:56.195653+0000","last_deep_scrub":"34'61","last_deep_scrub_stamp":"2024-09-10T05:40:56.195653+0000","last_clean_scrub_stamp":"2024-09-10T05:40:56.195653+0000","objects_scrubbed":9,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:49:29.798030+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"34'286","reported_seq":367,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:40.504504+0000","last_change":"2024-09-10T05:40:40.504338+0000","last_active":"2024-09-10T05:40:40.504504+0000","last_peered":"2024-09-10T05:40:40.504504+0000","last_clean":"2024-09-10T05:40:40.504504+0000","last_became_active":"2024-09-10T05:36:19.663950+0000","last_became_peered":"2024-09-10T05:36:19.663950+0000","last_unstale":"2024-09-10T05:40:40.504504+0000","last_undegraded":"2024-09-10T05:40:40.504504+0000","last_fullsized":"2024-09-10T05:40:40.504504+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-10T05:40:40.504135+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-10T05:40:40.504135+0000","last_clean_scrub_stamp":"2024-09-10T05:40:40.504135+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:54:50.079992+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"32'2","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:41:01.234202+0000","last_change":"2024-09-10T05:41:01.234202+0000","last_active":"2024-09-10T05:41:01.234202+0000","last_peered":"2024-09-10T05:41:01.234202+0000","last_clean":"2024-09-10T05:41:01.234202+0000","last_became_active":"2024-09-10T05:36:21.690772+0000","last_became_peered":"2024-09-10T05:36:21.690772+0000","last_unstale":"2024-09-10T05:41:01.234202+0000","last_undegraded":"2024-09-10T05:41:01.234202+0000","last_fullsized":"2024-09-10T05:41:01.234202+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T05:41:01.234034+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T05:41:01.234034+0000","last_clean_scrub_stamp":"2024-09-10T05:41:01.234034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:17:53.119106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"34'6","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:17.463737+0000","last_change":"2024-09-10T05:40:17.463570+0000","last_active":"2024-09-10T05:40:17.463737+0000","last_peered":"2024-09-10T05:40:17.463737+0000","last_clean":"2024-09-10T05:40:17.463737+0000","last_became_active":"2024-09-10T05:36:13.611694+0000","last_became_peered":"2024-09-10T05:36:13.611694+0000","last_unstale":"2024-09-10T05:40:17.463737+0000","last_undegraded":"2024-09-10T05:40:17.463737+0000","last_fullsized":"2024-09-10T05:40:17.463737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T05:40:17.463381+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T05:40:17.463381+0000","last_clean_scrub_stamp":"2024-09-10T05:40:17.463381+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:29.689757+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'2","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:03.358116+0000","last_change":"2024-09-10T05:40:03.358004+0000","last_active":"2024-09-10T05:40:03.358116+0000","last_peered":"2024-09-10T05:40:03.358116+0000","last_clean":"2024-09-10T05:40:03.358116+0000","last_became_active":"2024-09-10T05:36:11.606957+0000","last_became_peered":"2024-09-10T05:36:11.606957+0000","last_unstale":"2024-09-10T05:40:03.358116+0000","last_undegraded":"2024-09-10T05:40:03.358116+0000","last_fullsized":"2024-09-10T05:40:03.358116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T05:40:03.357891+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T05:40:03.357891+0000","last_clean_scrub_stamp":"2024-09-10T05:40:03.357891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:00:33.509652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:33.551675+0000","last_change":"2024-09-10T05:40:33.551523+0000","last_active":"2024-09-10T05:40:33.551675+0000","last_peered":"2024-09-10T05:40:33.551675+0000","last_clean":"2024-09-10T05:40:33.551675+0000","last_became_active":"2024-09-10T05:36:15.631551+0000","last_became_peered":"2024-09-10T05:36:15.631551+0000","last_unstale":"2024-09-10T05:40:33.551675+0000","last_undegraded":"2024-09-10T05:40:33.551675+0000","last_fullsized":"2024-09-10T05:40:33.551675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:33.551317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:33.551317+0000","last_clean_scrub_stamp":"2024-09-10T05:40:33.551317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:55.912005+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"34'79","reported_seq":169,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:48.873037+0000","last_change":"2024-09-10T05:40:48.873037+0000","last_active":"2024-09-10T05:40:48.873037+0000","last_peered":"2024-09-10T05:40:48.873037+0000","last_clean":"2024-09-10T05:40:48.873037+0000","last_became_active":"2024-09-10T05:36:17.650601+0000","last_became_peered":"2024-09-10T05:36:17.650601+0000","last_unstale":"2024-09-10T05:40:48.873037+0000","last_undegraded":"2024-09-10T05:40:48.873037+0000","last_fullsized":"2024-09-10T05:40:48.873037+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'79","last_scrub_stamp":"2024-09-10T05:40:48.872842+0000","last_deep_scrub":"34'79","last_deep_scrub_stamp":"2024-09-10T05:40:48.872842+0000","last_clean_scrub_stamp":"2024-09-10T05:40:48.872842+0000","objects_scrubbed":7,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:52.323378+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:42.486465+0000","last_change":"2024-09-10T05:40:42.486308+0000","last_active":"2024-09-10T05:40:42.486465+0000","last_peered":"2024-09-10T05:40:42.486465+0000","last_clean":"2024-09-10T05:40:42.486465+0000","last_became_active":"2024-09-10T05:36:19.638087+0000","last_became_peered":"2024-09-10T05:36:19.638087+0000","last_unstale":"2024-09-10T05:40:42.486465+0000","last_undegraded":"2024-09-10T05:40:42.486465+0000","last_fullsized":"2024-09-10T05:40:42.486465+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:42.486118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:42.486118+0000","last_clean_scrub_stamp":"2024-09-10T05:40:42.486118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:05:00.763542+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"34'18","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.535451+0000","last_change":"2024-09-10T05:36:21.681112+0000","last_active":"2024-09-10T05:39:27.535451+0000","last_peered":"2024-09-10T05:39:27.535451+0000","last_clean":"2024-09-10T05:39:27.535451+0000","last_became_active":"2024-09-10T05:36:21.680246+0000","last_became_peered":"2024-09-10T05:36:21.680246+0000","last_unstale":"2024-09-10T05:39:27.535451+0000","last_undegraded":"2024-09-10T05:39:27.535451+0000","last_fullsized":"2024-09-10T05:39:27.535451+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"34'6","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:18.483578+0000","last_change":"2024-09-10T05:40:18.483578+0000","last_active":"2024-09-10T05:40:18.483578+0000","last_peered":"2024-09-10T05:40:18.483578+0000","last_clean":"2024-09-10T05:40:18.483578+0000","last_became_active":"2024-09-10T05:36:52.702912+0000","last_became_peered":"2024-09-10T05:36:52.702912+0000","last_unstale":"2024-09-10T05:40:18.483578+0000","last_undegraded":"2024-09-10T05:40:18.483578+0000","last_fullsized":"2024-09-10T05:40:18.483578+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T05:40:18.483367+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T05:40:18.483367+0000","last_clean_scrub_stamp":"2024-09-10T05:40:18.483367+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:29:35.440454+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"34'4","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:06.665116+0000","last_change":"2024-09-10T05:40:06.664984+0000","last_active":"2024-09-10T05:40:06.665116+0000","last_peered":"2024-09-10T05:40:06.665116+0000","last_clean":"2024-09-10T05:40:06.665116+0000","last_became_active":"2024-09-10T05:36:11.606930+0000","last_became_peered":"2024-09-10T05:36:11.606930+0000","last_unstale":"2024-09-10T05:40:06.665116+0000","last_undegraded":"2024-09-10T05:40:06.665116+0000","last_fullsized":"2024-09-10T05:40:06.665116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:06.664807+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:06.664807+0000","last_clean_scrub_stamp":"2024-09-10T05:40:06.664807+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:52:51.651502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:35.492736+0000","last_change":"2024-09-10T05:40:35.492588+0000","last_active":"2024-09-10T05:40:35.492736+0000","last_peered":"2024-09-10T05:40:35.492736+0000","last_clean":"2024-09-10T05:40:35.492736+0000","last_became_active":"2024-09-10T05:36:15.616975+0000","last_became_peered":"2024-09-10T05:36:15.616975+0000","last_unstale":"2024-09-10T05:40:35.492736+0000","last_undegraded":"2024-09-10T05:40:35.492736+0000","last_fullsized":"2024-09-10T05:40:35.492736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:35.492410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:35.492410+0000","last_clean_scrub_stamp":"2024-09-10T05:40:35.492410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:47:37.689480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'51","reported_seq":118,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:55.239703+0000","last_change":"2024-09-10T05:40:55.239703+0000","last_active":"2024-09-10T05:40:55.239703+0000","last_peered":"2024-09-10T05:40:55.239703+0000","last_clean":"2024-09-10T05:40:55.239703+0000","last_became_active":"2024-09-10T05:36:17.650522+0000","last_became_peered":"2024-09-10T05:36:17.650522+0000","last_unstale":"2024-09-10T05:40:55.239703+0000","last_undegraded":"2024-09-10T05:40:55.239703+0000","last_fullsized":"2024-09-10T05:40:55.239703+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'51","last_scrub_stamp":"2024-09-10T05:40:55.239580+0000","last_deep_scrub":"34'51","last_deep_scrub_stamp":"2024-09-10T05:40:55.239580+0000","last_clean_scrub_stamp":"2024-09-10T05:40:55.239580+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:09:19.053210+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:33.685367+0000","last_change":"2024-09-10T05:36:19.664052+0000","last_active":"2024-09-10T05:38:33.685367+0000","last_peered":"2024-09-10T05:38:33.685367+0000","last_clean":"2024-09-10T05:38:33.685367+0000","last_became_active":"2024-09-10T05:36:19.663287+0000","last_became_peered":"2024-09-10T05:36:19.663287+0000","last_unstale":"2024-09-10T05:38:33.685367+0000","last_undegraded":"2024-09-10T05:38:33.685367+0000","last_fullsized":"2024-09-10T05:38:33.685367+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'5","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.476946+0000","last_change":"2024-09-10T05:36:21.664412+0000","last_active":"2024-09-10T05:39:27.476946+0000","last_peered":"2024-09-10T05:39:27.476946+0000","last_clean":"2024-09-10T05:39:27.476946+0000","last_became_active":"2024-09-10T05:36:21.663661+0000","last_became_peered":"2024-09-10T05:36:21.663661+0000","last_unstale":"2024-09-10T05:39:27.476946+0000","last_undegraded":"2024-09-10T05:39:27.476946+0000","last_fullsized":"2024-09-10T05:39:27.476946+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'6","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:32.451634+0000","last_change":"2024-09-10T05:40:32.451450+0000","last_active":"2024-09-10T05:40:32.451634+0000","last_peered":"2024-09-10T05:40:32.451634+0000","last_clean":"2024-09-10T05:40:32.451634+0000","last_became_active":"2024-09-10T05:36:13.630386+0000","last_became_peered":"2024-09-10T05:36:13.630386+0000","last_unstale":"2024-09-10T05:40:32.451634+0000","last_undegraded":"2024-09-10T05:40:32.451634+0000","last_fullsized":"2024-09-10T05:40:32.451634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T05:40:32.451241+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T05:40:32.451241+0000","last_clean_scrub_stamp":"2024-09-10T05:40:32.451241+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:37:51.470047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:19.418589+0000","last_change":"2024-09-10T05:40:19.418419+0000","last_active":"2024-09-10T05:40:19.418589+0000","last_peered":"2024-09-10T05:40:19.418589+0000","last_clean":"2024-09-10T05:40:19.418589+0000","last_became_active":"2024-09-10T05:36:11.597935+0000","last_became_peered":"2024-09-10T05:36:11.597935+0000","last_unstale":"2024-09-10T05:40:19.418589+0000","last_undegraded":"2024-09-10T05:40:19.418589+0000","last_fullsized":"2024-09-10T05:40:19.418589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:19.418236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:19.418236+0000","last_clean_scrub_stamp":"2024-09-10T05:40:19.418236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:15:58.466576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:40.162732+0000","last_change":"2024-09-10T05:40:40.162608+0000","last_active":"2024-09-10T05:40:40.162732+0000","last_peered":"2024-09-10T05:40:40.162732+0000","last_clean":"2024-09-10T05:40:40.162732+0000","last_became_active":"2024-09-10T05:36:15.619388+0000","last_became_peered":"2024-09-10T05:36:15.619388+0000","last_unstale":"2024-09-10T05:40:40.162732+0000","last_undegraded":"2024-09-10T05:40:40.162732+0000","last_fullsized":"2024-09-10T05:40:40.162732+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:40.162436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:40.162436+0000","last_clean_scrub_stamp":"2024-09-10T05:40:40.162436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:57.508074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"34'46","reported_seq":109,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:37.502123+0000","last_change":"2024-09-10T05:40:37.501956+0000","last_active":"2024-09-10T05:40:37.502123+0000","last_peered":"2024-09-10T05:40:37.502123+0000","last_clean":"2024-09-10T05:40:37.502123+0000","last_became_active":"2024-09-10T05:36:17.636568+0000","last_became_peered":"2024-09-10T05:36:17.636568+0000","last_unstale":"2024-09-10T05:40:37.502123+0000","last_undegraded":"2024-09-10T05:40:37.502123+0000","last_fullsized":"2024-09-10T05:40:37.502123+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-10T05:40:37.501724+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-10T05:40:37.501724+0000","last_clean_scrub_stamp":"2024-09-10T05:40:37.501724+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:41:42.065206+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'286","reported_seq":422,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:41.523152+0000","last_change":"2024-09-10T05:40:41.522983+0000","last_active":"2024-09-10T05:40:41.523152+0000","last_peered":"2024-09-10T05:40:41.523152+0000","last_clean":"2024-09-10T05:40:41.523152+0000","last_became_active":"2024-09-10T05:36:19.666610+0000","last_became_peered":"2024-09-10T05:36:19.666610+0000","last_unstale":"2024-09-10T05:40:41.523152+0000","last_undegraded":"2024-09-10T05:40:41.523152+0000","last_fullsized":"2024-09-10T05:40:41.523152+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-10T05:40:41.522779+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-10T05:40:41.522779+0000","last_clean_scrub_stamp":"2024-09-10T05:40:41.522779+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:13:32.225111+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'13","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:58.228442+0000","last_change":"2024-09-10T05:40:58.228442+0000","last_active":"2024-09-10T05:40:58.228442+0000","last_peered":"2024-09-10T05:40:58.228442+0000","last_clean":"2024-09-10T05:40:58.228442+0000","last_became_active":"2024-09-10T05:36:21.668641+0000","last_became_peered":"2024-09-10T05:36:21.668641+0000","last_unstale":"2024-09-10T05:40:58.228442+0000","last_undegraded":"2024-09-10T05:40:58.228442+0000","last_fullsized":"2024-09-10T05:40:58.228442+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'13","last_scrub_stamp":"2024-09-10T05:40:58.228258+0000","last_deep_scrub":"34'13","last_deep_scrub_stamp":"2024-09-10T05:40:58.228258+0000","last_clean_scrub_stamp":"2024-09-10T05:40:58.228258+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:07:29.447226+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"34'8","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:19.486804+0000","last_change":"2024-09-10T05:40:19.486658+0000","last_active":"2024-09-10T05:40:19.486804+0000","last_peered":"2024-09-10T05:40:19.486804+0000","last_clean":"2024-09-10T05:40:19.486804+0000","last_became_active":"2024-09-10T05:36:13.605112+0000","last_became_peered":"2024-09-10T05:36:13.605112+0000","last_unstale":"2024-09-10T05:40:19.486804+0000","last_undegraded":"2024-09-10T05:40:19.486804+0000","last_fullsized":"2024-09-10T05:40:19.486804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-10T05:40:19.486471+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-10T05:40:19.486471+0000","last_clean_scrub_stamp":"2024-09-10T05:40:19.486471+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:21:20.885876+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:05.700119+0000","last_change":"2024-09-10T05:40:05.699984+0000","last_active":"2024-09-10T05:40:05.700119+0000","last_peered":"2024-09-10T05:40:05.700119+0000","last_clean":"2024-09-10T05:40:05.700119+0000","last_became_active":"2024-09-10T05:36:11.600833+0000","last_became_peered":"2024-09-10T05:36:11.600833+0000","last_unstale":"2024-09-10T05:40:05.700119+0000","last_undegraded":"2024-09-10T05:40:05.700119+0000","last_fullsized":"2024-09-10T05:40:05.700119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:05.699733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:05.699733+0000","last_clean_scrub_stamp":"2024-09-10T05:40:05.699733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:58:29.252913+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'5","reported_seq":433,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:47.460449+0000","last_change":"2024-09-10T05:40:47.460135+0000","last_active":"2024-09-10T05:40:47.460449+0000","last_peered":"2024-09-10T05:40:47.460449+0000","last_clean":"2024-09-10T05:40:47.460449+0000","last_became_active":"2024-09-10T05:36:15.635670+0000","last_became_peered":"2024-09-10T05:36:15.635670+0000","last_unstale":"2024-09-10T05:40:47.460449+0000","last_undegraded":"2024-09-10T05:40:47.460449+0000","last_fullsized":"2024-09-10T05:40:47.460449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-10T05:40:47.459916+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-10T05:40:47.459916+0000","last_clean_scrub_stamp":"2024-09-10T05:40:47.459916+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:55.003531+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"34'15","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:50.899221+0000","last_change":"2024-09-10T05:40:50.899221+0000","last_active":"2024-09-10T05:40:50.899221+0000","last_peered":"2024-09-10T05:40:50.899221+0000","last_clean":"2024-09-10T05:40:50.899221+0000","last_became_active":"2024-09-10T05:36:17.633215+0000","last_became_peered":"2024-09-10T05:36:17.633215+0000","last_unstale":"2024-09-10T05:40:50.899221+0000","last_undegraded":"2024-09-10T05:40:50.899221+0000","last_fullsized":"2024-09-10T05:40:50.899221+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-10T05:40:50.899046+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-10T05:40:50.899046+0000","last_clean_scrub_stamp":"2024-09-10T05:40:50.899046+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:14:29.689122+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'285","reported_seq":475,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.760466+0000","last_change":"2024-09-10T05:36:19.650595+0000","last_active":"2024-09-10T05:39:58.760466+0000","last_peered":"2024-09-10T05:39:58.760466+0000","last_clean":"2024-09-10T05:39:58.760466+0000","last_became_active":"2024-09-10T05:36:19.649781+0000","last_became_peered":"2024-09-10T05:36:19.649781+0000","last_unstale":"2024-09-10T05:39:58.760466+0000","last_undegraded":"2024-09-10T05:39:58.760466+0000","last_fullsized":"2024-09-10T05:39:58.760466+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:46.558861+0000","last_change":"2024-09-10T05:40:46.558861+0000","last_active":"2024-09-10T05:40:46.558861+0000","last_peered":"2024-09-10T05:40:46.558861+0000","last_clean":"2024-09-10T05:40:46.558861+0000","last_became_active":"2024-09-10T05:36:21.664283+0000","last_became_peered":"2024-09-10T05:36:21.664283+0000","last_unstale":"2024-09-10T05:40:46.558861+0000","last_undegraded":"2024-09-10T05:40:46.558861+0000","last_fullsized":"2024-09-10T05:40:46.558861+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:46.558583+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:46.558583+0000","last_clean_scrub_stamp":"2024-09-10T05:40:46.558583+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:53:39.565368+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'4","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:20.525777+0000","last_change":"2024-09-10T05:40:20.525777+0000","last_active":"2024-09-10T05:40:20.525777+0000","last_peered":"2024-09-10T05:40:20.525777+0000","last_clean":"2024-09-10T05:40:20.525777+0000","last_became_active":"2024-09-10T05:37:53.724668+0000","last_became_peered":"2024-09-10T05:37:53.724668+0000","last_unstale":"2024-09-10T05:40:20.525777+0000","last_undegraded":"2024-09-10T05:40:20.525777+0000","last_fullsized":"2024-09-10T05:40:20.525777+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:20.525572+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:20.525572+0000","last_clean_scrub_stamp":"2024-09-10T05:40:20.525572+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:25.446283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:07.715488+0000","last_change":"2024-09-10T05:40:07.715354+0000","last_active":"2024-09-10T05:40:07.715488+0000","last_peered":"2024-09-10T05:40:07.715488+0000","last_clean":"2024-09-10T05:40:07.715488+0000","last_became_active":"2024-09-10T05:36:11.598213+0000","last_became_peered":"2024-09-10T05:36:11.598213+0000","last_unstale":"2024-09-10T05:40:07.715488+0000","last_undegraded":"2024-09-10T05:40:07.715488+0000","last_fullsized":"2024-09-10T05:40:07.715488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:07.715175+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:07.715175+0000","last_clean_scrub_stamp":"2024-09-10T05:40:07.715175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:29:24.579705+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:40.840714+0000","last_change":"2024-09-10T05:40:40.840583+0000","last_active":"2024-09-10T05:40:40.840714+0000","last_peered":"2024-09-10T05:40:40.840714+0000","last_clean":"2024-09-10T05:40:40.840714+0000","last_became_active":"2024-09-10T05:36:15.621697+0000","last_became_peered":"2024-09-10T05:36:15.621697+0000","last_unstale":"2024-09-10T05:40:40.840714+0000","last_undegraded":"2024-09-10T05:40:40.840714+0000","last_fullsized":"2024-09-10T05:40:40.840714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:40.840381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:40.840381+0000","last_clean_scrub_stamp":"2024-09-10T05:40:40.840381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:29:43.354536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'49","reported_seq":113,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:54.289646+0000","last_change":"2024-09-10T05:40:54.289646+0000","last_active":"2024-09-10T05:40:54.289646+0000","last_peered":"2024-09-10T05:40:54.289646+0000","last_clean":"2024-09-10T05:40:54.289646+0000","last_became_active":"2024-09-10T05:36:17.647533+0000","last_became_peered":"2024-09-10T05:36:17.647533+0000","last_unstale":"2024-09-10T05:40:54.289646+0000","last_undegraded":"2024-09-10T05:40:54.289646+0000","last_fullsized":"2024-09-10T05:40:54.289646+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'49","last_scrub_stamp":"2024-09-10T05:40:54.289498+0000","last_deep_scrub":"34'49","last_deep_scrub_stamp":"2024-09-10T05:40:54.289498+0000","last_clean_scrub_stamp":"2024-09-10T05:40:54.289498+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:33:27.390715+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:37.692167+0000","last_change":"2024-09-10T05:36:19.641688+0000","last_active":"2024-09-10T05:38:37.692167+0000","last_peered":"2024-09-10T05:38:37.692167+0000","last_clean":"2024-09-10T05:38:37.692167+0000","last_became_active":"2024-09-10T05:36:19.640885+0000","last_became_peered":"2024-09-10T05:36:19.640885+0000","last_unstale":"2024-09-10T05:38:37.692167+0000","last_undegraded":"2024-09-10T05:38:37.692167+0000","last_fullsized":"2024-09-10T05:38:37.692167+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"34'9","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:59.196618+0000","last_change":"2024-09-10T05:40:59.196618+0000","last_active":"2024-09-10T05:40:59.196618+0000","last_peered":"2024-09-10T05:40:59.196618+0000","last_clean":"2024-09-10T05:40:59.196618+0000","last_became_active":"2024-09-10T05:36:21.664454+0000","last_became_peered":"2024-09-10T05:36:21.664454+0000","last_unstale":"2024-09-10T05:40:59.196618+0000","last_undegraded":"2024-09-10T05:40:59.196618+0000","last_fullsized":"2024-09-10T05:40:59.196618+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-10T05:40:59.196417+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-10T05:40:59.196417+0000","last_clean_scrub_stamp":"2024-09-10T05:40:59.196417+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:01:04.607582+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'6","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:21.456922+0000","last_change":"2024-09-10T05:40:21.456783+0000","last_active":"2024-09-10T05:40:21.456922+0000","last_peered":"2024-09-10T05:40:21.456922+0000","last_clean":"2024-09-10T05:40:21.456922+0000","last_became_active":"2024-09-10T05:36:13.605318+0000","last_became_peered":"2024-09-10T05:36:13.605318+0000","last_unstale":"2024-09-10T05:40:21.456922+0000","last_undegraded":"2024-09-10T05:40:21.456922+0000","last_fullsized":"2024-09-10T05:40:21.456922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T05:40:21.456596+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T05:40:21.456596+0000","last_clean_scrub_stamp":"2024-09-10T05:40:21.456596+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:47.464427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"34'74","reported_seq":157,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:04.098105+0000","last_change":"2024-09-10T05:40:04.098105+0000","last_active":"2024-09-10T05:40:04.098105+0000","last_peered":"2024-09-10T05:40:04.098105+0000","last_clean":"2024-09-10T05:40:04.098105+0000","last_became_active":"2024-09-10T05:35:59.486077+0000","last_became_peered":"2024-09-10T05:35:59.486077+0000","last_unstale":"2024-09-10T05:40:04.098105+0000","last_undegraded":"2024-09-10T05:40:04.098105+0000","last_fullsized":"2024-09-10T05:40:04.098105+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'74","last_scrub_stamp":"2024-09-10T05:40:04.097908+0000","last_deep_scrub":"34'74","last_deep_scrub_stamp":"2024-09-10T05:40:04.097908+0000","last_clean_scrub_stamp":"2024-09-10T05:40:04.097908+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:20:39.253681+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"34'2","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:02.370065+0000","last_change":"2024-09-10T05:40:02.369928+0000","last_active":"2024-09-10T05:40:02.370065+0000","last_peered":"2024-09-10T05:40:02.370065+0000","last_clean":"2024-09-10T05:40:02.370065+0000","last_became_active":"2024-09-10T05:36:03.710352+0000","last_became_peered":"2024-09-10T05:36:03.710352+0000","last_unstale":"2024-09-10T05:40:02.370065+0000","last_undegraded":"2024-09-10T05:40:02.370065+0000","last_fullsized":"2024-09-10T05:40:02.370065+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:02.369862+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:02.369862+0000","last_clean_scrub_stamp":"2024-09-10T05:40:02.369862+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:48.466459+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.002047461,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"34'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:03.692190+0000","last_change":"2024-09-10T05:40:03.692057+0000","last_active":"2024-09-10T05:40:03.692190+0000","last_peered":"2024-09-10T05:40:03.692190+0000","last_clean":"2024-09-10T05:40:03.692190+0000","last_became_active":"2024-09-10T05:36:11.604178+0000","last_became_peered":"2024-09-10T05:36:11.604178+0000","last_unstale":"2024-09-10T05:40:03.692190+0000","last_undegraded":"2024-09-10T05:40:03.692190+0000","last_fullsized":"2024-09-10T05:40:03.692190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:03.691877+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:03.691877+0000","last_clean_scrub_stamp":"2024-09-10T05:40:03.691877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:48:28.093143+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:38.228258+0000","last_change":"2024-09-10T05:40:38.228258+0000","last_active":"2024-09-10T05:40:38.228258+0000","last_peered":"2024-09-10T05:40:38.228258+0000","last_clean":"2024-09-10T05:40:38.228258+0000","last_became_active":"2024-09-10T05:36:15.623637+0000","last_became_peered":"2024-09-10T05:36:15.623637+0000","last_unstale":"2024-09-10T05:40:38.228258+0000","last_undegraded":"2024-09-10T05:40:38.228258+0000","last_fullsized":"2024-09-10T05:40:38.228258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:38.228078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:38.228078+0000","last_clean_scrub_stamp":"2024-09-10T05:40:38.228078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:52:22.148177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'98","reported_seq":199,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:52.329463+0000","last_change":"2024-09-10T05:40:52.329463+0000","last_active":"2024-09-10T05:40:52.329463+0000","last_peered":"2024-09-10T05:40:52.329463+0000","last_clean":"2024-09-10T05:40:52.329463+0000","last_became_active":"2024-09-10T05:36:17.636543+0000","last_became_peered":"2024-09-10T05:36:17.636543+0000","last_unstale":"2024-09-10T05:40:52.329463+0000","last_undegraded":"2024-09-10T05:40:52.329463+0000","last_fullsized":"2024-09-10T05:40:52.329463+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'98","last_scrub_stamp":"2024-09-10T05:40:52.329249+0000","last_deep_scrub":"34'98","last_deep_scrub_stamp":"2024-09-10T05:40:52.329249+0000","last_clean_scrub_stamp":"2024-09-10T05:40:52.329249+0000","objects_scrubbed":6,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:49:31.558533+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:41:00.902866+0000","last_change":"2024-09-10T05:41:00.902866+0000","last_active":"2024-09-10T05:41:00.902866+0000","last_peered":"2024-09-10T05:41:00.902866+0000","last_clean":"2024-09-10T05:41:00.902866+0000","last_became_active":"2024-09-10T05:36:19.663584+0000","last_became_peered":"2024-09-10T05:36:19.663584+0000","last_unstale":"2024-09-10T05:41:00.902866+0000","last_undegraded":"2024-09-10T05:41:00.902866+0000","last_fullsized":"2024-09-10T05:41:00.902866+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:41:00.902681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:41:00.902681+0000","last_clean_scrub_stamp":"2024-09-10T05:41:00.902681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:54:37.086133+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"34'82","reported_seq":177,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:52.561691+0000","last_change":"2024-09-10T05:40:52.561691+0000","last_active":"2024-09-10T05:40:52.561691+0000","last_peered":"2024-09-10T05:40:52.561691+0000","last_clean":"2024-09-10T05:40:52.561691+0000","last_became_active":"2024-09-10T05:36:21.664075+0000","last_became_peered":"2024-09-10T05:36:21.664075+0000","last_unstale":"2024-09-10T05:40:52.561691+0000","last_undegraded":"2024-09-10T05:40:52.561691+0000","last_fullsized":"2024-09-10T05:40:52.561691+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'82","last_scrub_stamp":"2024-09-10T05:40:52.561498+0000","last_deep_scrub":"34'82","last_deep_scrub_stamp":"2024-09-10T05:40:52.561498+0000","last_clean_scrub_stamp":"2024-09-10T05:40:52.561498+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:17:38.379926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":223,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"30'2","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:22.862239+0000","last_change":"2024-09-10T05:40:22.862111+0000","last_active":"2024-09-10T05:40:22.862239+0000","last_peered":"2024-09-10T05:40:22.862239+0000","last_clean":"2024-09-10T05:40:22.862239+0000","last_became_active":"2024-09-10T05:36:13.616766+0000","last_became_peered":"2024-09-10T05:36:13.616766+0000","last_unstale":"2024-09-10T05:40:22.862239+0000","last_undegraded":"2024-09-10T05:40:22.862239+0000","last_fullsized":"2024-09-10T05:40:22.862239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-10T05:40:22.861923+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-10T05:40:22.861923+0000","last_clean_scrub_stamp":"2024-09-10T05:40:22.861923+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:18:25.222001+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:08.386382+0000","last_change":"2024-09-10T05:40:08.386382+0000","last_active":"2024-09-10T05:40:08.386382+0000","last_peered":"2024-09-10T05:40:08.386382+0000","last_clean":"2024-09-10T05:40:08.386382+0000","last_became_active":"2024-09-10T05:36:03.706256+0000","last_became_peered":"2024-09-10T05:36:03.706256+0000","last_unstale":"2024-09-10T05:40:08.386382+0000","last_undegraded":"2024-09-10T05:40:08.386382+0000","last_fullsized":"2024-09-10T05:40:08.386382+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:08.386197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:08.386197+0000","last_clean_scrub_stamp":"2024-09-10T05:40:08.386197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:07.558694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001383542,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:07.029001+0000","last_change":"2024-09-10T05:40:07.028861+0000","last_active":"2024-09-10T05:40:07.029001+0000","last_peered":"2024-09-10T05:40:07.029001+0000","last_clean":"2024-09-10T05:40:07.029001+0000","last_became_active":"2024-09-10T05:36:11.591339+0000","last_became_peered":"2024-09-10T05:36:11.591339+0000","last_unstale":"2024-09-10T05:40:07.029001+0000","last_undegraded":"2024-09-10T05:40:07.029001+0000","last_fullsized":"2024-09-10T05:40:07.029001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:07.028674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:07.028674+0000","last_clean_scrub_stamp":"2024-09-10T05:40:07.028674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:03.721457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:43.459631+0000","last_change":"2024-09-10T05:40:43.459631+0000","last_active":"2024-09-10T05:40:43.459631+0000","last_peered":"2024-09-10T05:40:43.459631+0000","last_clean":"2024-09-10T05:40:43.459631+0000","last_became_active":"2024-09-10T05:36:52.704490+0000","last_became_peered":"2024-09-10T05:36:52.704490+0000","last_unstale":"2024-09-10T05:40:43.459631+0000","last_undegraded":"2024-09-10T05:40:43.459631+0000","last_fullsized":"2024-09-10T05:40:43.459631+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:43.459420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:43.459420+0000","last_clean_scrub_stamp":"2024-09-10T05:40:43.459420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:14:25.648856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"34'302","reported_seq":539,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:49.083132+0000","last_change":"2024-09-10T05:40:49.083132+0000","last_active":"2024-09-10T05:40:49.083132+0000","last_peered":"2024-09-10T05:40:49.083132+0000","last_clean":"2024-09-10T05:40:49.083132+0000","last_became_active":"2024-09-10T05:36:17.637623+0000","last_became_peered":"2024-09-10T05:36:17.637623+0000","last_unstale":"2024-09-10T05:40:49.083132+0000","last_undegraded":"2024-09-10T05:40:49.083132+0000","last_fullsized":"2024-09-10T05:40:49.083132+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'302","last_scrub_stamp":"2024-09-10T05:40:49.082917+0000","last_deep_scrub":"34'302","last_deep_scrub_stamp":"2024-09-10T05:40:49.082917+0000","last_clean_scrub_stamp":"2024-09-10T05:40:49.082917+0000","objects_scrubbed":11,"log_size":302,"log_dups_size":0,"ondisk_log_size":302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:07.102658+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":387,"num_read_kb":371,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:59.935034+0000","last_change":"2024-09-10T05:40:59.935034+0000","last_active":"2024-09-10T05:40:59.935034+0000","last_peered":"2024-09-10T05:40:59.935034+0000","last_clean":"2024-09-10T05:40:59.935034+0000","last_became_active":"2024-09-10T05:36:19.672554+0000","last_became_peered":"2024-09-10T05:36:19.672554+0000","last_unstale":"2024-09-10T05:40:59.935034+0000","last_undegraded":"2024-09-10T05:40:59.935034+0000","last_fullsized":"2024-09-10T05:40:59.935034+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:59.934849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:59.934849+0000","last_clean_scrub_stamp":"2024-09-10T05:40:59.934849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:19:42.465061+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'5","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:32.688213+0000","last_change":"2024-09-10T05:36:21.662079+0000","last_active":"2024-09-10T05:38:32.688213+0000","last_peered":"2024-09-10T05:38:32.688213+0000","last_clean":"2024-09-10T05:38:32.688213+0000","last_became_active":"2024-09-10T05:36:21.661347+0000","last_became_peered":"2024-09-10T05:36:21.661347+0000","last_unstale":"2024-09-10T05:38:32.688213+0000","last_undegraded":"2024-09-10T05:38:32.688213+0000","last_fullsized":"2024-09-10T05:38:32.688213+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:24.185198+0000","last_change":"2024-09-10T05:40:24.185051+0000","last_active":"2024-09-10T05:40:24.185198+0000","last_peered":"2024-09-10T05:40:24.185198+0000","last_clean":"2024-09-10T05:40:24.185198+0000","last_became_active":"2024-09-10T05:36:13.621451+0000","last_became_peered":"2024-09-10T05:36:13.621451+0000","last_unstale":"2024-09-10T05:40:24.185198+0000","last_undegraded":"2024-09-10T05:40:24.185198+0000","last_fullsized":"2024-09-10T05:40:24.185198+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T05:40:24.184869+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T05:40:24.184869+0000","last_clean_scrub_stamp":"2024-09-10T05:40:24.184869+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:25:47.203486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:04.549247+0000","last_change":"2024-09-10T05:40:04.549099+0000","last_active":"2024-09-10T05:40:04.549247+0000","last_peered":"2024-09-10T05:40:04.549247+0000","last_clean":"2024-09-10T05:40:04.549247+0000","last_became_active":"2024-09-10T05:36:03.707045+0000","last_became_peered":"2024-09-10T05:36:03.707045+0000","last_unstale":"2024-09-10T05:40:04.549247+0000","last_undegraded":"2024-09-10T05:40:04.549247+0000","last_fullsized":"2024-09-10T05:40:04.549247+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:04.548887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:04.548887+0000","last_clean_scrub_stamp":"2024-09-10T05:40:04.548887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:06.035520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093121299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"34'4","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:06.066743+0000","last_change":"2024-09-10T05:40:06.066584+0000","last_active":"2024-09-10T05:40:06.066743+0000","last_peered":"2024-09-10T05:40:06.066743+0000","last_clean":"2024-09-10T05:40:06.066743+0000","last_became_active":"2024-09-10T05:36:11.594432+0000","last_became_peered":"2024-09-10T05:36:11.594432+0000","last_unstale":"2024-09-10T05:40:06.066743+0000","last_undegraded":"2024-09-10T05:40:06.066743+0000","last_fullsized":"2024-09-10T05:40:06.066743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:06.066401+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:06.066401+0000","last_clean_scrub_stamp":"2024-09-10T05:40:06.066401+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:26.311891+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:31.519925+0000","last_change":"2024-09-10T05:40:31.519773+0000","last_active":"2024-09-10T05:40:31.519925+0000","last_peered":"2024-09-10T05:40:31.519925+0000","last_clean":"2024-09-10T05:40:31.519925+0000","last_became_active":"2024-09-10T05:36:15.620043+0000","last_became_peered":"2024-09-10T05:36:15.620043+0000","last_unstale":"2024-09-10T05:40:31.519925+0000","last_undegraded":"2024-09-10T05:40:31.519925+0000","last_fullsized":"2024-09-10T05:40:31.519925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:31.519580+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:31.519580+0000","last_clean_scrub_stamp":"2024-09-10T05:40:31.519580+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:18:37.004223+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'25","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:53.328256+0000","last_change":"2024-09-10T05:40:53.328256+0000","last_active":"2024-09-10T05:40:53.328256+0000","last_peered":"2024-09-10T05:40:53.328256+0000","last_clean":"2024-09-10T05:40:53.328256+0000","last_became_active":"2024-09-10T05:36:17.636381+0000","last_became_peered":"2024-09-10T05:36:17.636381+0000","last_unstale":"2024-09-10T05:40:53.328256+0000","last_undegraded":"2024-09-10T05:40:53.328256+0000","last_fullsized":"2024-09-10T05:40:53.328256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'25","last_scrub_stamp":"2024-09-10T05:40:53.328046+0000","last_deep_scrub":"34'25","last_deep_scrub_stamp":"2024-09-10T05:40:53.328046+0000","last_clean_scrub_stamp":"2024-09-10T05:40:53.328046+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:48:07.847432+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:41:02.195110+0000","last_change":"2024-09-10T05:41:02.195110+0000","last_active":"2024-09-10T05:41:02.195110+0000","last_peered":"2024-09-10T05:41:02.195110+0000","last_clean":"2024-09-10T05:41:02.195110+0000","last_became_active":"2024-09-10T05:36:19.664396+0000","last_became_peered":"2024-09-10T05:36:19.664396+0000","last_unstale":"2024-09-10T05:41:02.195110+0000","last_undegraded":"2024-09-10T05:41:02.195110+0000","last_fullsized":"2024-09-10T05:41:02.195110+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:41:02.194939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:41:02.194939+0000","last_clean_scrub_stamp":"2024-09-10T05:41:02.194939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:11.268535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:38.686572+0000","last_change":"2024-09-10T05:36:21.675746+0000","last_active":"2024-09-10T05:38:38.686572+0000","last_peered":"2024-09-10T05:38:38.686572+0000","last_clean":"2024-09-10T05:38:38.686572+0000","last_became_active":"2024-09-10T05:36:21.674984+0000","last_became_peered":"2024-09-10T05:36:21.674984+0000","last_unstale":"2024-09-10T05:38:38.686572+0000","last_undegraded":"2024-09-10T05:38:38.686572+0000","last_fullsized":"2024-09-10T05:38:38.686572+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:23.144701+0000","last_change":"2024-09-10T05:40:23.144701+0000","last_active":"2024-09-10T05:40:23.144701+0000","last_peered":"2024-09-10T05:40:23.144701+0000","last_clean":"2024-09-10T05:40:23.144701+0000","last_became_active":"2024-09-10T05:36:13.626654+0000","last_became_peered":"2024-09-10T05:36:13.626654+0000","last_unstale":"2024-09-10T05:40:23.144701+0000","last_undegraded":"2024-09-10T05:40:23.144701+0000","last_fullsized":"2024-09-10T05:40:23.144701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:23.144518+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:23.144518+0000","last_clean_scrub_stamp":"2024-09-10T05:40:23.144518+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:29:05.863627+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"34'3","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:15.375407+0000","last_change":"2024-09-10T05:40:15.375209+0000","last_active":"2024-09-10T05:40:15.375407+0000","last_peered":"2024-09-10T05:40:15.375407+0000","last_clean":"2024-09-10T05:40:15.375407+0000","last_became_active":"2024-09-10T05:36:03.708495+0000","last_became_peered":"2024-09-10T05:36:03.708495+0000","last_unstale":"2024-09-10T05:40:15.375407+0000","last_undegraded":"2024-09-10T05:40:15.375407+0000","last_fullsized":"2024-09-10T05:40:15.375407+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-10T05:40:15.375014+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-10T05:40:15.375014+0000","last_clean_scrub_stamp":"2024-09-10T05:40:15.375014+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:49:34.092873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012525469999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:04.336783+0000","last_change":"2024-09-10T05:40:04.336594+0000","last_active":"2024-09-10T05:40:04.336783+0000","last_peered":"2024-09-10T05:40:04.336783+0000","last_clean":"2024-09-10T05:40:04.336783+0000","last_became_active":"2024-09-10T05:36:11.601414+0000","last_became_peered":"2024-09-10T05:36:11.601414+0000","last_unstale":"2024-09-10T05:40:04.336783+0000","last_undegraded":"2024-09-10T05:40:04.336783+0000","last_fullsized":"2024-09-10T05:40:04.336783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:04.336407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:04.336407+0000","last_clean_scrub_stamp":"2024-09-10T05:40:04.336407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:42:28.818551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:37.248228+0000","last_change":"2024-09-10T05:40:37.248228+0000","last_active":"2024-09-10T05:40:37.248228+0000","last_peered":"2024-09-10T05:40:37.248228+0000","last_clean":"2024-09-10T05:40:37.248228+0000","last_became_active":"2024-09-10T05:36:15.619505+0000","last_became_peered":"2024-09-10T05:36:15.619505+0000","last_unstale":"2024-09-10T05:40:37.248228+0000","last_undegraded":"2024-09-10T05:40:37.248228+0000","last_fullsized":"2024-09-10T05:40:37.248228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:37.248025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:37.248025+0000","last_clean_scrub_stamp":"2024-09-10T05:40:37.248025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:04:51.414497+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"34'20","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:47.905235+0000","last_change":"2024-09-10T05:40:47.905235+0000","last_active":"2024-09-10T05:40:47.905235+0000","last_peered":"2024-09-10T05:40:47.905235+0000","last_clean":"2024-09-10T05:40:47.905235+0000","last_became_active":"2024-09-10T05:36:17.637551+0000","last_became_peered":"2024-09-10T05:36:17.637551+0000","last_unstale":"2024-09-10T05:40:47.905235+0000","last_undegraded":"2024-09-10T05:40:47.905235+0000","last_fullsized":"2024-09-10T05:40:47.905235+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'20","last_scrub_stamp":"2024-09-10T05:40:47.905126+0000","last_deep_scrub":"34'20","last_deep_scrub_stamp":"2024-09-10T05:40:47.905126+0000","last_clean_scrub_stamp":"2024-09-10T05:40:47.905126+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:00:42.306089+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:41:02.946405+0000","last_change":"2024-09-10T05:41:02.946405+0000","last_active":"2024-09-10T05:41:02.946405+0000","last_peered":"2024-09-10T05:41:02.946405+0000","last_clean":"2024-09-10T05:41:02.946405+0000","last_became_active":"2024-09-10T05:36:19.669130+0000","last_became_peered":"2024-09-10T05:36:19.669130+0000","last_unstale":"2024-09-10T05:41:02.946405+0000","last_undegraded":"2024-09-10T05:41:02.946405+0000","last_fullsized":"2024-09-10T05:41:02.946405+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:41:02.946231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:41:02.946231+0000","last_clean_scrub_stamp":"2024-09-10T05:41:02.946231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:37:30.404827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'6","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:32.688080+0000","last_change":"2024-09-10T05:36:21.672078+0000","last_active":"2024-09-10T05:38:32.688080+0000","last_peered":"2024-09-10T05:38:32.688080+0000","last_clean":"2024-09-10T05:38:32.688080+0000","last_became_active":"2024-09-10T05:36:21.671206+0000","last_became_peered":"2024-09-10T05:36:21.671206+0000","last_unstale":"2024-09-10T05:38:32.688080+0000","last_undegraded":"2024-09-10T05:38:32.688080+0000","last_fullsized":"2024-09-10T05:38:32.688080+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'4","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:22.094327+0000","last_change":"2024-09-10T05:40:22.094076+0000","last_active":"2024-09-10T05:40:22.094327+0000","last_peered":"2024-09-10T05:40:22.094327+0000","last_clean":"2024-09-10T05:40:22.094327+0000","last_became_active":"2024-09-10T05:36:13.611242+0000","last_became_peered":"2024-09-10T05:36:13.611242+0000","last_unstale":"2024-09-10T05:40:22.094327+0000","last_undegraded":"2024-09-10T05:40:22.094327+0000","last_fullsized":"2024-09-10T05:40:22.094327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:22.093836+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:22.093836+0000","last_clean_scrub_stamp":"2024-09-10T05:40:22.093836+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:16:04.536508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:10.404039+0000","last_change":"2024-09-10T05:40:10.403855+0000","last_active":"2024-09-10T05:40:10.404039+0000","last_peered":"2024-09-10T05:40:10.404039+0000","last_clean":"2024-09-10T05:40:10.404039+0000","last_became_active":"2024-09-10T05:36:11.604802+0000","last_became_peered":"2024-09-10T05:36:11.604802+0000","last_unstale":"2024-09-10T05:40:10.404039+0000","last_undegraded":"2024-09-10T05:40:10.404039+0000","last_fullsized":"2024-09-10T05:40:10.404039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:10.403675+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:10.403675+0000","last_clean_scrub_stamp":"2024-09-10T05:40:10.403675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:44:01.698908+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:03.095986+0000","last_change":"2024-09-10T05:40:03.095816+0000","last_active":"2024-09-10T05:40:03.095986+0000","last_peered":"2024-09-10T05:40:03.095986+0000","last_clean":"2024-09-10T05:40:03.095986+0000","last_became_active":"2024-09-10T05:36:03.705338+0000","last_became_peered":"2024-09-10T05:36:03.705338+0000","last_unstale":"2024-09-10T05:40:03.095986+0000","last_undegraded":"2024-09-10T05:40:03.095986+0000","last_fullsized":"2024-09-10T05:40:03.095986+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:03.095625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:03.095625+0000","last_clean_scrub_stamp":"2024-09-10T05:40:03.095625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:21.581455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010885789999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"34'2","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:30.543765+0000","last_change":"2024-09-10T05:40:30.543765+0000","last_active":"2024-09-10T05:40:30.543765+0000","last_peered":"2024-09-10T05:40:30.543765+0000","last_clean":"2024-09-10T05:40:30.543765+0000","last_became_active":"2024-09-10T05:36:15.618041+0000","last_became_peered":"2024-09-10T05:36:15.618041+0000","last_unstale":"2024-09-10T05:40:30.543765+0000","last_undegraded":"2024-09-10T05:40:30.543765+0000","last_fullsized":"2024-09-10T05:40:30.543765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:30.543571+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:30.543571+0000","last_clean_scrub_stamp":"2024-09-10T05:40:30.543571+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:04:23.896422+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"34'92","reported_seq":185,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:47.138202+0000","last_change":"2024-09-10T05:40:47.138202+0000","last_active":"2024-09-10T05:40:47.138202+0000","last_peered":"2024-09-10T05:40:47.138202+0000","last_clean":"2024-09-10T05:40:47.138202+0000","last_became_active":"2024-09-10T05:36:17.653627+0000","last_became_peered":"2024-09-10T05:36:17.653627+0000","last_unstale":"2024-09-10T05:40:47.138202+0000","last_undegraded":"2024-09-10T05:40:47.138202+0000","last_fullsized":"2024-09-10T05:40:47.138202+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'92","last_scrub_stamp":"2024-09-10T05:40:47.137926+0000","last_deep_scrub":"34'92","last_deep_scrub_stamp":"2024-09-10T05:40:47.137926+0000","last_clean_scrub_stamp":"2024-09-10T05:40:47.137926+0000","objects_scrubbed":11,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:30.802496+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":94,"num_read_kb":88,"num_write":46,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:41:00.201195+0000","last_change":"2024-09-10T05:41:00.201195+0000","last_active":"2024-09-10T05:41:00.201195+0000","last_peered":"2024-09-10T05:41:00.201195+0000","last_clean":"2024-09-10T05:41:00.201195+0000","last_became_active":"2024-09-10T05:36:19.650115+0000","last_became_peered":"2024-09-10T05:36:19.650115+0000","last_unstale":"2024-09-10T05:41:00.201195+0000","last_undegraded":"2024-09-10T05:41:00.201195+0000","last_fullsized":"2024-09-10T05:41:00.201195+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:41:00.200987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:41:00.200987+0000","last_clean_scrub_stamp":"2024-09-10T05:41:00.200987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:28:31.591631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"34'9","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:50.540770+0000","last_change":"2024-09-10T05:40:50.540632+0000","last_active":"2024-09-10T05:40:50.540770+0000","last_peered":"2024-09-10T05:40:50.540770+0000","last_clean":"2024-09-10T05:40:50.540770+0000","last_became_active":"2024-09-10T05:36:21.687744+0000","last_became_peered":"2024-09-10T05:36:21.687744+0000","last_unstale":"2024-09-10T05:40:50.540770+0000","last_undegraded":"2024-09-10T05:40:50.540770+0000","last_fullsized":"2024-09-10T05:40:50.540770+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-10T05:40:50.540456+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-10T05:40:50.540456+0000","last_clean_scrub_stamp":"2024-09-10T05:40:50.540456+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:17:38.930771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"32'6","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:20.043583+0000","last_change":"2024-09-10T05:40:20.043416+0000","last_active":"2024-09-10T05:40:20.043583+0000","last_peered":"2024-09-10T05:40:20.043583+0000","last_clean":"2024-09-10T05:40:20.043583+0000","last_became_active":"2024-09-10T05:36:13.617814+0000","last_became_peered":"2024-09-10T05:36:13.617814+0000","last_unstale":"2024-09-10T05:40:20.043583+0000","last_undegraded":"2024-09-10T05:40:20.043583+0000","last_fullsized":"2024-09-10T05:40:20.043583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-10T05:40:20.043232+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-10T05:40:20.043232+0000","last_clean_scrub_stamp":"2024-09-10T05:40:20.043232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:12.310111+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:08.043171+0000","last_change":"2024-09-10T05:40:08.043044+0000","last_active":"2024-09-10T05:40:08.043171+0000","last_peered":"2024-09-10T05:40:08.043171+0000","last_clean":"2024-09-10T05:40:08.043171+0000","last_became_active":"2024-09-10T05:36:11.595349+0000","last_became_peered":"2024-09-10T05:36:11.595349+0000","last_unstale":"2024-09-10T05:40:08.043171+0000","last_undegraded":"2024-09-10T05:40:08.043171+0000","last_fullsized":"2024-09-10T05:40:08.043171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:08.042856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:08.042856+0000","last_clean_scrub_stamp":"2024-09-10T05:40:08.042856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:15:37.792723+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:05.325390+0000","last_change":"2024-09-10T05:40:05.325151+0000","last_active":"2024-09-10T05:40:05.325390+0000","last_peered":"2024-09-10T05:40:05.325390+0000","last_clean":"2024-09-10T05:40:05.325390+0000","last_became_active":"2024-09-10T05:36:03.709534+0000","last_became_peered":"2024-09-10T05:36:03.709534+0000","last_unstale":"2024-09-10T05:40:05.325390+0000","last_undegraded":"2024-09-10T05:40:05.325390+0000","last_fullsized":"2024-09-10T05:40:05.325390+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:05.324950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:05.324950+0000","last_clean_scrub_stamp":"2024-09-10T05:40:05.324950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:04:00.453210+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0022338829999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:44.474801+0000","last_change":"2024-09-10T05:40:44.474801+0000","last_active":"2024-09-10T05:40:44.474801+0000","last_peered":"2024-09-10T05:40:44.474801+0000","last_clean":"2024-09-10T05:40:44.474801+0000","last_became_active":"2024-09-10T05:36:15.618491+0000","last_became_peered":"2024-09-10T05:36:15.618491+0000","last_unstale":"2024-09-10T05:40:44.474801+0000","last_undegraded":"2024-09-10T05:40:44.474801+0000","last_fullsized":"2024-09-10T05:40:44.474801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:44.474691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:44.474691+0000","last_clean_scrub_stamp":"2024-09-10T05:40:44.474691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:07:40.548413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"34'28","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:48.110316+0000","last_change":"2024-09-10T05:40:48.110316+0000","last_active":"2024-09-10T05:40:48.110316+0000","last_peered":"2024-09-10T05:40:48.110316+0000","last_clean":"2024-09-10T05:40:48.110316+0000","last_became_active":"2024-09-10T05:36:17.657112+0000","last_became_peered":"2024-09-10T05:36:17.657112+0000","last_unstale":"2024-09-10T05:40:48.110316+0000","last_undegraded":"2024-09-10T05:40:48.110316+0000","last_fullsized":"2024-09-10T05:40:48.110316+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'28","last_scrub_stamp":"2024-09-10T05:40:48.110110+0000","last_deep_scrub":"34'28","last_deep_scrub_stamp":"2024-09-10T05:40:48.110110+0000","last_clean_scrub_stamp":"2024-09-10T05:40:48.110110+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:02:46.580756+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'286","reported_seq":374,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:52.095334+0000","last_change":"2024-09-10T05:40:52.095334+0000","last_active":"2024-09-10T05:40:52.095334+0000","last_peered":"2024-09-10T05:40:52.095334+0000","last_clean":"2024-09-10T05:40:52.095334+0000","last_became_active":"2024-09-10T05:36:19.643319+0000","last_became_peered":"2024-09-10T05:36:19.643319+0000","last_unstale":"2024-09-10T05:40:52.095334+0000","last_undegraded":"2024-09-10T05:40:52.095334+0000","last_fullsized":"2024-09-10T05:40:52.095334+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-10T05:40:52.095154+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-10T05:40:52.095154+0000","last_clean_scrub_stamp":"2024-09-10T05:40:52.095154+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:38:11.113960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"30'2","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:38.686753+0000","last_change":"2024-09-10T05:36:21.692062+0000","last_active":"2024-09-10T05:38:38.686753+0000","last_peered":"2024-09-10T05:38:38.686753+0000","last_clean":"2024-09-10T05:38:38.686753+0000","last_became_active":"2024-09-10T05:36:21.691590+0000","last_became_peered":"2024-09-10T05:36:21.691590+0000","last_unstale":"2024-09-10T05:38:38.686753+0000","last_undegraded":"2024-09-10T05:38:38.686753+0000","last_fullsized":"2024-09-10T05:38:38.686753+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:21.866611+0000","last_change":"2024-09-10T05:40:21.866611+0000","last_active":"2024-09-10T05:40:21.866611+0000","last_peered":"2024-09-10T05:40:21.866611+0000","last_clean":"2024-09-10T05:40:21.866611+0000","last_became_active":"2024-09-10T05:36:13.607367+0000","last_became_peered":"2024-09-10T05:36:13.607367+0000","last_unstale":"2024-09-10T05:40:21.866611+0000","last_undegraded":"2024-09-10T05:40:21.866611+0000","last_fullsized":"2024-09-10T05:40:21.866611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T05:40:21.866434+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T05:40:21.866434+0000","last_clean_scrub_stamp":"2024-09-10T05:40:21.866434+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:46.440442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:04.718942+0000","last_change":"2024-09-10T05:40:04.718781+0000","last_active":"2024-09-10T05:40:04.718942+0000","last_peered":"2024-09-10T05:40:04.718942+0000","last_clean":"2024-09-10T05:40:04.718942+0000","last_became_active":"2024-09-10T05:36:11.606234+0000","last_became_peered":"2024-09-10T05:36:11.606234+0000","last_unstale":"2024-09-10T05:40:04.718942+0000","last_undegraded":"2024-09-10T05:40:04.718942+0000","last_fullsized":"2024-09-10T05:40:04.718942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:04.718605+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:04.718605+0000","last_clean_scrub_stamp":"2024-09-10T05:40:04.718605+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:24:19.567951+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:05.070657+0000","last_change":"2024-09-10T05:40:05.070401+0000","last_active":"2024-09-10T05:40:05.070657+0000","last_peered":"2024-09-10T05:40:05.070657+0000","last_clean":"2024-09-10T05:40:05.070657+0000","last_became_active":"2024-09-10T05:36:03.705038+0000","last_became_peered":"2024-09-10T05:36:03.705038+0000","last_unstale":"2024-09-10T05:40:05.070657+0000","last_undegraded":"2024-09-10T05:40:05.070657+0000","last_fullsized":"2024-09-10T05:40:05.070657+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:05.070198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:05.070198+0000","last_clean_scrub_stamp":"2024-09-10T05:40:05.070198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:41:09.633680+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00126935,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:42.450239+0000","last_change":"2024-09-10T05:40:42.450239+0000","last_active":"2024-09-10T05:40:42.450239+0000","last_peered":"2024-09-10T05:40:42.450239+0000","last_clean":"2024-09-10T05:40:42.450239+0000","last_became_active":"2024-09-10T05:36:15.617690+0000","last_became_peered":"2024-09-10T05:36:15.617690+0000","last_unstale":"2024-09-10T05:40:42.450239+0000","last_undegraded":"2024-09-10T05:40:42.450239+0000","last_fullsized":"2024-09-10T05:40:42.450239+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:42.450063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:42.450063+0000","last_clean_scrub_stamp":"2024-09-10T05:40:42.450063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:29:06.495558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"34'22","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:46.954416+0000","last_change":"2024-09-10T05:40:46.954416+0000","last_active":"2024-09-10T05:40:46.954416+0000","last_peered":"2024-09-10T05:40:46.954416+0000","last_clean":"2024-09-10T05:40:46.954416+0000","last_became_active":"2024-09-10T05:36:17.634261+0000","last_became_peered":"2024-09-10T05:36:17.634261+0000","last_unstale":"2024-09-10T05:40:46.954416+0000","last_undegraded":"2024-09-10T05:40:46.954416+0000","last_fullsized":"2024-09-10T05:40:46.954416+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-09-10T05:40:46.954214+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-09-10T05:40:46.954214+0000","last_clean_scrub_stamp":"2024-09-10T05:40:46.954214+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:05:05.692878+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'286","reported_seq":448,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:58.934193+0000","last_change":"2024-09-10T05:40:58.934193+0000","last_active":"2024-09-10T05:40:58.934193+0000","last_peered":"2024-09-10T05:40:58.934193+0000","last_clean":"2024-09-10T05:40:58.934193+0000","last_became_active":"2024-09-10T05:36:19.672586+0000","last_became_peered":"2024-09-10T05:36:19.672586+0000","last_unstale":"2024-09-10T05:40:58.934193+0000","last_undegraded":"2024-09-10T05:40:58.934193+0000","last_fullsized":"2024-09-10T05:40:58.934193+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-10T05:40:58.934009+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-10T05:40:58.934009+0000","last_clean_scrub_stamp":"2024-09-10T05:40:58.934009+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:54:05.413635+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:37.689617+0000","last_change":"2024-09-10T05:36:21.670112+0000","last_active":"2024-09-10T05:38:37.689617+0000","last_peered":"2024-09-10T05:38:37.689617+0000","last_clean":"2024-09-10T05:38:37.689617+0000","last_became_active":"2024-09-10T05:36:21.668909+0000","last_became_peered":"2024-09-10T05:36:21.668909+0000","last_unstale":"2024-09-10T05:38:37.689617+0000","last_undegraded":"2024-09-10T05:38:37.689617+0000","last_fullsized":"2024-09-10T05:38:37.689617+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'14","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:14.474283+0000","last_change":"2024-09-10T05:40:14.474129+0000","last_active":"2024-09-10T05:40:14.474283+0000","last_peered":"2024-09-10T05:40:14.474283+0000","last_clean":"2024-09-10T05:40:14.474283+0000","last_became_active":"2024-09-10T05:36:13.621703+0000","last_became_peered":"2024-09-10T05:36:13.621703+0000","last_unstale":"2024-09-10T05:40:14.474283+0000","last_undegraded":"2024-09-10T05:40:14.474283+0000","last_fullsized":"2024-09-10T05:40:14.474283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-10T05:40:14.473954+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-10T05:40:14.473954+0000","last_clean_scrub_stamp":"2024-09-10T05:40:14.473954+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:27.797592+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:08.998572+0000","last_change":"2024-09-10T05:40:08.998414+0000","last_active":"2024-09-10T05:40:08.998572+0000","last_peered":"2024-09-10T05:40:08.998572+0000","last_clean":"2024-09-10T05:40:08.998572+0000","last_became_active":"2024-09-10T05:36:11.594029+0000","last_became_peered":"2024-09-10T05:36:11.594029+0000","last_unstale":"2024-09-10T05:40:08.998572+0000","last_undegraded":"2024-09-10T05:40:08.998572+0000","last_fullsized":"2024-09-10T05:40:08.998572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:08.998240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:08.998240+0000","last_clean_scrub_stamp":"2024-09-10T05:40:08.998240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:40.972877+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:06.349490+0000","last_change":"2024-09-10T05:40:06.349353+0000","last_active":"2024-09-10T05:40:06.349490+0000","last_peered":"2024-09-10T05:40:06.349490+0000","last_clean":"2024-09-10T05:40:06.349490+0000","last_became_active":"2024-09-10T05:36:03.708884+0000","last_became_peered":"2024-09-10T05:36:03.708884+0000","last_unstale":"2024-09-10T05:40:06.349490+0000","last_undegraded":"2024-09-10T05:40:06.349490+0000","last_fullsized":"2024-09-10T05:40:06.349490+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:06.349170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:06.349170+0000","last_clean_scrub_stamp":"2024-09-10T05:40:06.349170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:46:31.673889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018824390000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:39.857195+0000","last_change":"2024-09-10T05:40:39.857195+0000","last_active":"2024-09-10T05:40:39.857195+0000","last_peered":"2024-09-10T05:40:39.857195+0000","last_clean":"2024-09-10T05:40:39.857195+0000","last_became_active":"2024-09-10T05:36:15.637890+0000","last_became_peered":"2024-09-10T05:36:15.637890+0000","last_unstale":"2024-09-10T05:40:39.857195+0000","last_undegraded":"2024-09-10T05:40:39.857195+0000","last_fullsized":"2024-09-10T05:40:39.857195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:39.856991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:39.856991+0000","last_clean_scrub_stamp":"2024-09-10T05:40:39.856991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:38:38.940634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'106","reported_seq":210,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:50.414583+0000","last_change":"2024-09-10T05:40:50.414583+0000","last_active":"2024-09-10T05:40:50.414583+0000","last_peered":"2024-09-10T05:40:50.414583+0000","last_clean":"2024-09-10T05:40:50.414583+0000","last_became_active":"2024-09-10T05:36:17.631509+0000","last_became_peered":"2024-09-10T05:36:17.631509+0000","last_unstale":"2024-09-10T05:40:50.414583+0000","last_undegraded":"2024-09-10T05:40:50.414583+0000","last_fullsized":"2024-09-10T05:40:50.414583+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'106","last_scrub_stamp":"2024-09-10T05:40:50.414466+0000","last_deep_scrub":"34'106","last_deep_scrub_stamp":"2024-09-10T05:40:50.414466+0000","last_clean_scrub_stamp":"2024-09-10T05:40:50.414466+0000","objects_scrubbed":9,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:55:04.596359+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:57.922869+0000","last_change":"2024-09-10T05:40:57.922869+0000","last_active":"2024-09-10T05:40:57.922869+0000","last_peered":"2024-09-10T05:40:57.922869+0000","last_clean":"2024-09-10T05:40:57.922869+0000","last_became_active":"2024-09-10T05:36:19.667446+0000","last_became_peered":"2024-09-10T05:36:19.667446+0000","last_unstale":"2024-09-10T05:40:57.922869+0000","last_undegraded":"2024-09-10T05:40:57.922869+0000","last_fullsized":"2024-09-10T05:40:57.922869+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:57.922691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:57.922691+0000","last_clean_scrub_stamp":"2024-09-10T05:40:57.922691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:38:15.854566+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:48.548239+0000","last_change":"2024-09-10T05:40:48.548082+0000","last_active":"2024-09-10T05:40:48.548239+0000","last_peered":"2024-09-10T05:40:48.548239+0000","last_clean":"2024-09-10T05:40:48.548239+0000","last_became_active":"2024-09-10T05:36:21.657621+0000","last_became_peered":"2024-09-10T05:36:21.657621+0000","last_unstale":"2024-09-10T05:40:48.548239+0000","last_undegraded":"2024-09-10T05:40:48.548239+0000","last_fullsized":"2024-09-10T05:40:48.548239+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:48.547898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:48.547898+0000","last_clean_scrub_stamp":"2024-09-10T05:40:48.547898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:00:53.080799+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"32'8","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:53.515720+0000","last_change":"2024-09-10T05:40:53.515720+0000","last_active":"2024-09-10T05:40:53.515720+0000","last_peered":"2024-09-10T05:40:53.515720+0000","last_clean":"2024-09-10T05:40:53.515720+0000","last_became_active":"2024-09-10T05:36:21.656563+0000","last_became_peered":"2024-09-10T05:36:21.656563+0000","last_unstale":"2024-09-10T05:40:53.515720+0000","last_undegraded":"2024-09-10T05:40:53.515720+0000","last_fullsized":"2024-09-10T05:40:53.515720+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T05:40:53.515524+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T05:40:53.515524+0000","last_clean_scrub_stamp":"2024-09-10T05:40:53.515524+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:31:48.909789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:21.548091+0000","last_change":"2024-09-10T05:40:21.547908+0000","last_active":"2024-09-10T05:40:21.548091+0000","last_peered":"2024-09-10T05:40:21.548091+0000","last_clean":"2024-09-10T05:40:21.548091+0000","last_became_active":"2024-09-10T05:36:13.620892+0000","last_became_peered":"2024-09-10T05:36:13.620892+0000","last_unstale":"2024-09-10T05:40:21.548091+0000","last_undegraded":"2024-09-10T05:40:21.548091+0000","last_fullsized":"2024-09-10T05:40:21.548091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:21.547721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:21.547721+0000","last_clean_scrub_stamp":"2024-09-10T05:40:21.547721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:53:21.051292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'6","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:16.412548+0000","last_change":"2024-09-10T05:40:16.412389+0000","last_active":"2024-09-10T05:40:16.412548+0000","last_peered":"2024-09-10T05:40:16.412548+0000","last_clean":"2024-09-10T05:40:16.412548+0000","last_became_active":"2024-09-10T05:36:11.597209+0000","last_became_peered":"2024-09-10T05:36:11.597209+0000","last_unstale":"2024-09-10T05:40:16.412548+0000","last_undegraded":"2024-09-10T05:40:16.412548+0000","last_fullsized":"2024-09-10T05:40:16.412548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T05:40:16.412205+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T05:40:16.412205+0000","last_clean_scrub_stamp":"2024-09-10T05:40:16.412205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:16.536426+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:41.154711+0000","last_change":"2024-09-10T05:40:41.154583+0000","last_active":"2024-09-10T05:40:41.154711+0000","last_peered":"2024-09-10T05:40:41.154711+0000","last_clean":"2024-09-10T05:40:41.154711+0000","last_became_active":"2024-09-10T05:36:15.617049+0000","last_became_peered":"2024-09-10T05:36:15.617049+0000","last_unstale":"2024-09-10T05:40:41.154711+0000","last_undegraded":"2024-09-10T05:40:41.154711+0000","last_fullsized":"2024-09-10T05:40:41.154711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:41.154403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:41.154403+0000","last_clean_scrub_stamp":"2024-09-10T05:40:41.154403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:08.337788+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'47","reported_seq":114,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:51.915964+0000","last_change":"2024-09-10T05:40:51.915819+0000","last_active":"2024-09-10T05:40:51.915964+0000","last_peered":"2024-09-10T05:40:51.915964+0000","last_clean":"2024-09-10T05:40:51.915964+0000","last_became_active":"2024-09-10T05:36:17.657669+0000","last_became_peered":"2024-09-10T05:36:17.657669+0000","last_unstale":"2024-09-10T05:40:51.915964+0000","last_undegraded":"2024-09-10T05:40:51.915964+0000","last_fullsized":"2024-09-10T05:40:51.915964+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'47","last_scrub_stamp":"2024-09-10T05:40:51.915605+0000","last_deep_scrub":"34'47","last_deep_scrub_stamp":"2024-09-10T05:40:51.915605+0000","last_clean_scrub_stamp":"2024-09-10T05:40:51.915605+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:00:40.832043+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:38.686372+0000","last_change":"2024-09-10T05:36:19.673156+0000","last_active":"2024-09-10T05:38:38.686372+0000","last_peered":"2024-09-10T05:38:38.686372+0000","last_clean":"2024-09-10T05:38:38.686372+0000","last_became_active":"2024-09-10T05:36:19.672498+0000","last_became_peered":"2024-09-10T05:36:19.672498+0000","last_unstale":"2024-09-10T05:38:38.686372+0000","last_undegraded":"2024-09-10T05:38:38.686372+0000","last_fullsized":"2024-09-10T05:38:38.686372+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'5","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:23.682676+0000","last_change":"2024-09-10T05:36:21.689435+0000","last_active":"2024-09-10T05:38:23.682676+0000","last_peered":"2024-09-10T05:38:23.682676+0000","last_clean":"2024-09-10T05:38:23.682676+0000","last_became_active":"2024-09-10T05:36:21.688864+0000","last_became_peered":"2024-09-10T05:36:21.688864+0000","last_unstale":"2024-09-10T05:38:23.682676+0000","last_undegraded":"2024-09-10T05:38:23.682676+0000","last_fullsized":"2024-09-10T05:38:23.682676+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"34'10","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:25.205113+0000","last_change":"2024-09-10T05:40:25.204938+0000","last_active":"2024-09-10T05:40:25.205113+0000","last_peered":"2024-09-10T05:40:25.205113+0000","last_clean":"2024-09-10T05:40:25.205113+0000","last_became_active":"2024-09-10T05:36:13.610883+0000","last_became_peered":"2024-09-10T05:36:13.610883+0000","last_unstale":"2024-09-10T05:40:25.205113+0000","last_undegraded":"2024-09-10T05:40:25.205113+0000","last_fullsized":"2024-09-10T05:40:25.205113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-10T05:40:25.204764+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-10T05:40:25.204764+0000","last_clean_scrub_stamp":"2024-09-10T05:40:25.204764+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:35:50.293206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:06.519698+0000","last_change":"2024-09-10T05:40:06.519495+0000","last_active":"2024-09-10T05:40:06.519698+0000","last_peered":"2024-09-10T05:40:06.519698+0000","last_clean":"2024-09-10T05:40:06.519698+0000","last_became_active":"2024-09-10T05:36:11.605259+0000","last_became_peered":"2024-09-10T05:36:11.605259+0000","last_unstale":"2024-09-10T05:40:06.519698+0000","last_undegraded":"2024-09-10T05:40:06.519698+0000","last_fullsized":"2024-09-10T05:40:06.519698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:06.519303+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:06.519303+0000","last_clean_scrub_stamp":"2024-09-10T05:40:06.519303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:41:27.502766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:42.886959+0000","last_change":"2024-09-10T05:40:42.886806+0000","last_active":"2024-09-10T05:40:42.886959+0000","last_peered":"2024-09-10T05:40:42.886959+0000","last_clean":"2024-09-10T05:40:42.886959+0000","last_became_active":"2024-09-10T05:36:15.629278+0000","last_became_peered":"2024-09-10T05:36:15.629278+0000","last_unstale":"2024-09-10T05:40:42.886959+0000","last_undegraded":"2024-09-10T05:40:42.886959+0000","last_fullsized":"2024-09-10T05:40:42.886959+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:42.886628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:42.886628+0000","last_clean_scrub_stamp":"2024-09-10T05:40:42.886628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:03:03.609286+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'9","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:50.036820+0000","last_change":"2024-09-10T05:40:50.036573+0000","last_active":"2024-09-10T05:40:50.036820+0000","last_peered":"2024-09-10T05:40:50.036820+0000","last_clean":"2024-09-10T05:40:50.036820+0000","last_became_active":"2024-09-10T05:36:17.648835+0000","last_became_peered":"2024-09-10T05:36:17.648835+0000","last_unstale":"2024-09-10T05:40:50.036820+0000","last_undegraded":"2024-09-10T05:40:50.036820+0000","last_fullsized":"2024-09-10T05:40:50.036820+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-10T05:40:50.036348+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-10T05:40:50.036348+0000","last_clean_scrub_stamp":"2024-09-10T05:40:50.036348+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:54:15.633765+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:43.512774+0000","last_change":"2024-09-10T05:40:43.512624+0000","last_active":"2024-09-10T05:40:43.512774+0000","last_peered":"2024-09-10T05:40:43.512774+0000","last_clean":"2024-09-10T05:40:43.512774+0000","last_became_active":"2024-09-10T05:36:19.637912+0000","last_became_peered":"2024-09-10T05:36:19.637912+0000","last_unstale":"2024-09-10T05:40:43.512774+0000","last_undegraded":"2024-09-10T05:40:43.512774+0000","last_fullsized":"2024-09-10T05:40:43.512774+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:43.512445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:43.512445+0000","last_clean_scrub_stamp":"2024-09-10T05:40:43.512445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:37:23.811953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.854267+0000","last_change":"2024-09-10T05:36:21.668904+0000","last_active":"2024-09-10T05:37:53.854267+0000","last_peered":"2024-09-10T05:37:53.854267+0000","last_clean":"2024-09-10T05:37:53.854267+0000","last_became_active":"2024-09-10T05:36:21.666877+0000","last_became_peered":"2024-09-10T05:36:21.666877+0000","last_unstale":"2024-09-10T05:37:53.854267+0000","last_undegraded":"2024-09-10T05:37:53.854267+0000","last_fullsized":"2024-09-10T05:37:53.854267+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:43:13.848554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"34'4","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:26.838801+0000","last_change":"2024-09-10T05:40:26.838639+0000","last_active":"2024-09-10T05:40:26.838801+0000","last_peered":"2024-09-10T05:40:26.838801+0000","last_clean":"2024-09-10T05:40:26.838801+0000","last_became_active":"2024-09-10T05:36:13.597857+0000","last_became_peered":"2024-09-10T05:36:13.597857+0000","last_unstale":"2024-09-10T05:40:26.838801+0000","last_undegraded":"2024-09-10T05:40:26.838801+0000","last_fullsized":"2024-09-10T05:40:26.838801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:26.838457+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:26.838457+0000","last_clean_scrub_stamp":"2024-09-10T05:40:26.838457+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:01:18.916559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:14.332397+0000","last_change":"2024-09-10T05:40:14.332224+0000","last_active":"2024-09-10T05:40:14.332397+0000","last_peered":"2024-09-10T05:40:14.332397+0000","last_clean":"2024-09-10T05:40:14.332397+0000","last_became_active":"2024-09-10T05:36:11.600603+0000","last_became_peered":"2024-09-10T05:36:11.600603+0000","last_unstale":"2024-09-10T05:40:14.332397+0000","last_undegraded":"2024-09-10T05:40:14.332397+0000","last_fullsized":"2024-09-10T05:40:14.332397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:14.332052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:14.332052+0000","last_clean_scrub_stamp":"2024-09-10T05:40:14.332052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:20:12.250167+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:46.476149+0000","last_change":"2024-09-10T05:40:46.475980+0000","last_active":"2024-09-10T05:40:46.476149+0000","last_peered":"2024-09-10T05:40:46.476149+0000","last_clean":"2024-09-10T05:40:46.476149+0000","last_became_active":"2024-09-10T05:36:15.638197+0000","last_became_peered":"2024-09-10T05:36:15.638197+0000","last_unstale":"2024-09-10T05:40:46.476149+0000","last_undegraded":"2024-09-10T05:40:46.476149+0000","last_fullsized":"2024-09-10T05:40:46.476149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:46.475798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:46.475798+0000","last_clean_scrub_stamp":"2024-09-10T05:40:46.475798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:09.961814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"34'50","reported_seq":127,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:52.888343+0000","last_change":"2024-09-10T05:40:52.888211+0000","last_active":"2024-09-10T05:40:52.888343+0000","last_peered":"2024-09-10T05:40:52.888343+0000","last_clean":"2024-09-10T05:40:52.888343+0000","last_became_active":"2024-09-10T05:36:17.646459+0000","last_became_peered":"2024-09-10T05:36:17.646459+0000","last_unstale":"2024-09-10T05:40:52.888343+0000","last_undegraded":"2024-09-10T05:40:52.888343+0000","last_fullsized":"2024-09-10T05:40:52.888343+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'50","last_scrub_stamp":"2024-09-10T05:40:52.888007+0000","last_deep_scrub":"34'50","last_deep_scrub_stamp":"2024-09-10T05:40:52.888007+0000","last_clean_scrub_stamp":"2024-09-10T05:40:52.888007+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:44:52.943536+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:55.179578+0000","last_change":"2024-09-10T05:40:55.179302+0000","last_active":"2024-09-10T05:40:55.179578+0000","last_peered":"2024-09-10T05:40:55.179578+0000","last_clean":"2024-09-10T05:40:55.179578+0000","last_became_active":"2024-09-10T05:36:19.648608+0000","last_became_peered":"2024-09-10T05:36:19.648608+0000","last_unstale":"2024-09-10T05:40:55.179578+0000","last_undegraded":"2024-09-10T05:40:55.179578+0000","last_fullsized":"2024-09-10T05:40:55.179578+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:55.179095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:55.179095+0000","last_clean_scrub_stamp":"2024-09-10T05:40:55.179095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:03:41.928212+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.723161+0000","last_change":"2024-09-10T05:36:21.684218+0000","last_active":"2024-09-10T05:37:53.723161+0000","last_peered":"2024-09-10T05:37:53.723161+0000","last_clean":"2024-09-10T05:37:53.723161+0000","last_became_active":"2024-09-10T05:36:21.683406+0000","last_became_peered":"2024-09-10T05:36:21.683406+0000","last_unstale":"2024-09-10T05:37:53.723161+0000","last_undegraded":"2024-09-10T05:37:53.723161+0000","last_fullsized":"2024-09-10T05:37:53.723161+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:58:10.494998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'4","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:28.801034+0000","last_change":"2024-09-10T05:40:28.800763+0000","last_active":"2024-09-10T05:40:28.801034+0000","last_peered":"2024-09-10T05:40:28.801034+0000","last_clean":"2024-09-10T05:40:28.801034+0000","last_became_active":"2024-09-10T05:36:13.606903+0000","last_became_peered":"2024-09-10T05:36:13.606903+0000","last_unstale":"2024-09-10T05:40:28.801034+0000","last_undegraded":"2024-09-10T05:40:28.801034+0000","last_fullsized":"2024-09-10T05:40:28.801034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:28.800520+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:28.800520+0000","last_clean_scrub_stamp":"2024-09-10T05:40:28.800520+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:47:09.736656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:11.044412+0000","last_change":"2024-09-10T05:40:11.044271+0000","last_active":"2024-09-10T05:40:11.044412+0000","last_peered":"2024-09-10T05:40:11.044412+0000","last_clean":"2024-09-10T05:40:11.044412+0000","last_became_active":"2024-09-10T05:36:11.594653+0000","last_became_peered":"2024-09-10T05:36:11.594653+0000","last_unstale":"2024-09-10T05:40:11.044412+0000","last_undegraded":"2024-09-10T05:40:11.044412+0000","last_fullsized":"2024-09-10T05:40:11.044412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:11.044085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:11.044085+0000","last_clean_scrub_stamp":"2024-09-10T05:40:11.044085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:34.806153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"34'7","reported_seq":435,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:41.856715+0000","last_change":"2024-09-10T05:40:41.856554+0000","last_active":"2024-09-10T05:40:41.856715+0000","last_peered":"2024-09-10T05:40:41.856715+0000","last_clean":"2024-09-10T05:40:41.856715+0000","last_became_active":"2024-09-10T05:36:15.615147+0000","last_became_peered":"2024-09-10T05:36:15.615147+0000","last_unstale":"2024-09-10T05:40:41.856715+0000","last_undegraded":"2024-09-10T05:40:41.856715+0000","last_fullsized":"2024-09-10T05:40:41.856715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-10T05:40:41.856356+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-10T05:40:41.856356+0000","last_clean_scrub_stamp":"2024-09-10T05:40:41.856356+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:35.810677+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1429,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":586,"num_read_kb":586,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'37","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:57.199571+0000","last_change":"2024-09-10T05:40:57.199435+0000","last_active":"2024-09-10T05:40:57.199571+0000","last_peered":"2024-09-10T05:40:57.199571+0000","last_clean":"2024-09-10T05:40:57.199571+0000","last_became_active":"2024-09-10T05:36:17.631446+0000","last_became_peered":"2024-09-10T05:36:17.631446+0000","last_unstale":"2024-09-10T05:40:57.199571+0000","last_undegraded":"2024-09-10T05:40:57.199571+0000","last_fullsized":"2024-09-10T05:40:57.199571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-10T05:40:57.199208+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-10T05:40:57.199208+0000","last_clean_scrub_stamp":"2024-09-10T05:40:57.199208+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:50:23.979300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:44.528309+0000","last_change":"2024-09-10T05:40:44.528162+0000","last_active":"2024-09-10T05:40:44.528309+0000","last_peered":"2024-09-10T05:40:44.528309+0000","last_clean":"2024-09-10T05:40:44.528309+0000","last_became_active":"2024-09-10T05:36:19.638240+0000","last_became_peered":"2024-09-10T05:36:19.638240+0000","last_unstale":"2024-09-10T05:40:44.528309+0000","last_undegraded":"2024-09-10T05:40:44.528309+0000","last_fullsized":"2024-09-10T05:40:44.528309+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:44.527968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:44.527968+0000","last_clean_scrub_stamp":"2024-09-10T05:40:44.527968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:53:17.089615+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'8","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:25.365276+0000","last_change":"2024-09-10T05:40:25.365276+0000","last_active":"2024-09-10T05:40:25.365276+0000","last_peered":"2024-09-10T05:40:25.365276+0000","last_clean":"2024-09-10T05:40:25.365276+0000","last_became_active":"2024-09-10T05:36:13.618656+0000","last_became_peered":"2024-09-10T05:36:13.618656+0000","last_unstale":"2024-09-10T05:40:25.365276+0000","last_undegraded":"2024-09-10T05:40:25.365276+0000","last_fullsized":"2024-09-10T05:40:25.365276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T05:40:25.365088+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T05:40:25.365088+0000","last_clean_scrub_stamp":"2024-09-10T05:40:25.365088+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:55:23.978163+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:08.688955+0000","last_change":"2024-09-10T05:40:08.688775+0000","last_active":"2024-09-10T05:40:08.688955+0000","last_peered":"2024-09-10T05:40:08.688955+0000","last_clean":"2024-09-10T05:40:08.688955+0000","last_became_active":"2024-09-10T05:36:11.597710+0000","last_became_peered":"2024-09-10T05:36:11.597710+0000","last_unstale":"2024-09-10T05:40:08.688955+0000","last_undegraded":"2024-09-10T05:40:08.688955+0000","last_fullsized":"2024-09-10T05:40:08.688955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:08.688601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:08.688601+0000","last_clean_scrub_stamp":"2024-09-10T05:40:08.688601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:22:28.106904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:46.128725+0000","last_change":"2024-09-10T05:40:46.128725+0000","last_active":"2024-09-10T05:40:46.128725+0000","last_peered":"2024-09-10T05:40:46.128725+0000","last_clean":"2024-09-10T05:40:46.128725+0000","last_became_active":"2024-09-10T05:36:15.626787+0000","last_became_peered":"2024-09-10T05:36:15.626787+0000","last_unstale":"2024-09-10T05:40:46.128725+0000","last_undegraded":"2024-09-10T05:40:46.128725+0000","last_fullsized":"2024-09-10T05:40:46.128725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:46.128520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:46.128520+0000","last_clean_scrub_stamp":"2024-09-10T05:40:46.128520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:41:40.082470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"34'72","reported_seq":155,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:54.139296+0000","last_change":"2024-09-10T05:40:54.139296+0000","last_active":"2024-09-10T05:40:54.139296+0000","last_peered":"2024-09-10T05:40:54.139296+0000","last_clean":"2024-09-10T05:40:54.139296+0000","last_became_active":"2024-09-10T05:36:17.644469+0000","last_became_peered":"2024-09-10T05:36:17.644469+0000","last_unstale":"2024-09-10T05:40:54.139296+0000","last_undegraded":"2024-09-10T05:40:54.139296+0000","last_fullsized":"2024-09-10T05:40:54.139296+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'72","last_scrub_stamp":"2024-09-10T05:40:54.139106+0000","last_deep_scrub":"34'72","last_deep_scrub_stamp":"2024-09-10T05:40:54.139106+0000","last_clean_scrub_stamp":"2024-09-10T05:40:54.139106+0000","objects_scrubbed":6,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:21:20.917410+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:45.516054+0000","last_change":"2024-09-10T05:40:45.516054+0000","last_active":"2024-09-10T05:40:45.516054+0000","last_peered":"2024-09-10T05:40:45.516054+0000","last_clean":"2024-09-10T05:40:45.516054+0000","last_became_active":"2024-09-10T05:36:19.638136+0000","last_became_peered":"2024-09-10T05:36:19.638136+0000","last_unstale":"2024-09-10T05:40:45.516054+0000","last_undegraded":"2024-09-10T05:40:45.516054+0000","last_fullsized":"2024-09-10T05:40:45.516054+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:45.515827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:45.515827+0000","last_clean_scrub_stamp":"2024-09-10T05:40:45.515827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:27:58.518128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'14","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:43.687820+0000","last_change":"2024-09-10T05:36:21.682080+0000","last_active":"2024-09-10T05:38:43.687820+0000","last_peered":"2024-09-10T05:38:43.687820+0000","last_clean":"2024-09-10T05:38:43.687820+0000","last_became_active":"2024-09-10T05:36:21.681263+0000","last_became_peered":"2024-09-10T05:36:21.681263+0000","last_unstale":"2024-09-10T05:38:43.687820+0000","last_undegraded":"2024-09-10T05:38:43.687820+0000","last_fullsized":"2024-09-10T05:38:43.687820+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"34'10","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:26.215448+0000","last_change":"2024-09-10T05:40:26.215448+0000","last_active":"2024-09-10T05:40:26.215448+0000","last_peered":"2024-09-10T05:40:26.215448+0000","last_clean":"2024-09-10T05:40:26.215448+0000","last_became_active":"2024-09-10T05:36:13.609773+0000","last_became_peered":"2024-09-10T05:36:13.609773+0000","last_unstale":"2024-09-10T05:40:26.215448+0000","last_undegraded":"2024-09-10T05:40:26.215448+0000","last_fullsized":"2024-09-10T05:40:26.215448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-10T05:40:26.215272+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-10T05:40:26.215272+0000","last_clean_scrub_stamp":"2024-09-10T05:40:26.215272+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:04:21.343533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:10.048383+0000","last_change":"2024-09-10T05:40:10.048126+0000","last_active":"2024-09-10T05:40:10.048383+0000","last_peered":"2024-09-10T05:40:10.048383+0000","last_clean":"2024-09-10T05:40:10.048383+0000","last_became_active":"2024-09-10T05:36:11.595758+0000","last_became_peered":"2024-09-10T05:36:11.595758+0000","last_unstale":"2024-09-10T05:40:10.048383+0000","last_undegraded":"2024-09-10T05:40:10.048383+0000","last_fullsized":"2024-09-10T05:40:10.048383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:10.047905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:10.047905+0000","last_clean_scrub_stamp":"2024-09-10T05:40:10.047905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:36:54.103088+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:51.365968+0000","last_change":"2024-09-10T05:40:51.365968+0000","last_active":"2024-09-10T05:40:51.365968+0000","last_peered":"2024-09-10T05:40:51.365968+0000","last_clean":"2024-09-10T05:40:51.365968+0000","last_became_active":"2024-09-10T05:36:15.613949+0000","last_became_peered":"2024-09-10T05:36:15.613949+0000","last_unstale":"2024-09-10T05:40:51.365968+0000","last_undegraded":"2024-09-10T05:40:51.365968+0000","last_fullsized":"2024-09-10T05:40:51.365968+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:51.365784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:51.365784+0000","last_clean_scrub_stamp":"2024-09-10T05:40:51.365784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:59.376119+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"34'46","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:41:01.189558+0000","last_change":"2024-09-10T05:41:01.189558+0000","last_active":"2024-09-10T05:41:01.189558+0000","last_peered":"2024-09-10T05:41:01.189558+0000","last_clean":"2024-09-10T05:41:01.189558+0000","last_became_active":"2024-09-10T05:36:17.636067+0000","last_became_peered":"2024-09-10T05:36:17.636067+0000","last_unstale":"2024-09-10T05:41:01.189558+0000","last_undegraded":"2024-09-10T05:41:01.189558+0000","last_fullsized":"2024-09-10T05:41:01.189558+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-10T05:41:01.189321+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-10T05:41:01.189321+0000","last_clean_scrub_stamp":"2024-09-10T05:41:01.189321+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:45:22.475179+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:56.179871+0000","last_change":"2024-09-10T05:40:56.179871+0000","last_active":"2024-09-10T05:40:56.179871+0000","last_peered":"2024-09-10T05:40:56.179871+0000","last_clean":"2024-09-10T05:40:56.179871+0000","last_became_active":"2024-09-10T05:36:19.665010+0000","last_became_peered":"2024-09-10T05:36:19.665010+0000","last_unstale":"2024-09-10T05:40:56.179871+0000","last_undegraded":"2024-09-10T05:40:56.179871+0000","last_fullsized":"2024-09-10T05:40:56.179871+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:56.179693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:56.179693+0000","last_clean_scrub_stamp":"2024-09-10T05:40:56.179693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:28:16.068853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:42.693351+0000","last_change":"2024-09-10T05:36:21.665684+0000","last_active":"2024-09-10T05:38:42.693351+0000","last_peered":"2024-09-10T05:38:42.693351+0000","last_clean":"2024-09-10T05:38:42.693351+0000","last_became_active":"2024-09-10T05:36:21.664884+0000","last_became_peered":"2024-09-10T05:36:21.664884+0000","last_unstale":"2024-09-10T05:38:42.693351+0000","last_undegraded":"2024-09-10T05:38:42.693351+0000","last_fullsized":"2024-09-10T05:38:42.693351+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:33.849823+0000","last_change":"2024-09-10T05:40:33.849823+0000","last_active":"2024-09-10T05:40:33.849823+0000","last_peered":"2024-09-10T05:40:33.849823+0000","last_clean":"2024-09-10T05:40:33.849823+0000","last_became_active":"2024-09-10T05:36:13.616392+0000","last_became_peered":"2024-09-10T05:36:13.616392+0000","last_unstale":"2024-09-10T05:40:33.849823+0000","last_undegraded":"2024-09-10T05:40:33.849823+0000","last_fullsized":"2024-09-10T05:40:33.849823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:33.849612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:33.849612+0000","last_clean_scrub_stamp":"2024-09-10T05:40:33.849612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:50:01.897366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"34'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:23.407468+0000","last_change":"2024-09-10T05:40:23.407468+0000","last_active":"2024-09-10T05:40:23.407468+0000","last_peered":"2024-09-10T05:40:23.407468+0000","last_clean":"2024-09-10T05:40:23.407468+0000","last_became_active":"2024-09-10T05:36:11.595319+0000","last_became_peered":"2024-09-10T05:36:11.595319+0000","last_unstale":"2024-09-10T05:40:23.407468+0000","last_undegraded":"2024-09-10T05:40:23.407468+0000","last_fullsized":"2024-09-10T05:40:23.407468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:23.407266+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:23.407266+0000","last_clean_scrub_stamp":"2024-09-10T05:40:23.407266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:04:56.547309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:49.431425+0000","last_change":"2024-09-10T05:40:49.431425+0000","last_active":"2024-09-10T05:40:49.431425+0000","last_peered":"2024-09-10T05:40:49.431425+0000","last_clean":"2024-09-10T05:40:49.431425+0000","last_became_active":"2024-09-10T05:36:15.617595+0000","last_became_peered":"2024-09-10T05:36:15.617595+0000","last_unstale":"2024-09-10T05:40:49.431425+0000","last_undegraded":"2024-09-10T05:40:49.431425+0000","last_fullsized":"2024-09-10T05:40:49.431425+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:49.431210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:49.431210+0000","last_clean_scrub_stamp":"2024-09-10T05:40:49.431210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:49:15.185193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1f","version":"34'47","reported_seq":114,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:56.972995+0000","last_change":"2024-09-10T05:40:56.972995+0000","last_active":"2024-09-10T05:40:56.972995+0000","last_peered":"2024-09-10T05:40:56.972995+0000","last_clean":"2024-09-10T05:40:56.972995+0000","last_became_active":"2024-09-10T05:36:17.634616+0000","last_became_peered":"2024-09-10T05:36:17.634616+0000","last_unstale":"2024-09-10T05:40:56.972995+0000","last_undegraded":"2024-09-10T05:40:56.972995+0000","last_fullsized":"2024-09-10T05:40:56.972995+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'47","last_scrub_stamp":"2024-09-10T05:40:56.972810+0000","last_deep_scrub":"34'47","last_deep_scrub_stamp":"2024-09-10T05:40:56.972810+0000","last_clean_scrub_stamp":"2024-09-10T05:40:56.972810+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:56:10.530415+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:57.198931+0000","last_change":"2024-09-10T05:40:57.198931+0000","last_active":"2024-09-10T05:40:57.198931+0000","last_peered":"2024-09-10T05:40:57.198931+0000","last_clean":"2024-09-10T05:40:57.198931+0000","last_became_active":"2024-09-10T05:36:19.665236+0000","last_became_peered":"2024-09-10T05:36:19.665236+0000","last_unstale":"2024-09-10T05:40:57.198931+0000","last_undegraded":"2024-09-10T05:40:57.198931+0000","last_fullsized":"2024-09-10T05:40:57.198931+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:57.198720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:57.198720+0000","last_clean_scrub_stamp":"2024-09-10T05:40:57.198720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:52:29.804612+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"34'5","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.212454+0000","last_change":"2024-09-10T05:36:21.695106+0000","last_active":"2024-09-10T05:39:27.212454+0000","last_peered":"2024-09-10T05:39:27.212454+0000","last_clean":"2024-09-10T05:39:27.212454+0000","last_became_active":"2024-09-10T05:36:21.694522+0000","last_became_peered":"2024-09-10T05:36:21.694522+0000","last_unstale":"2024-09-10T05:39:27.212454+0000","last_undegraded":"2024-09-10T05:39:27.212454+0000","last_fullsized":"2024-09-10T05:39:27.212454+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:23.468572+0000","last_change":"2024-09-10T05:40:23.468572+0000","last_active":"2024-09-10T05:40:23.468572+0000","last_peered":"2024-09-10T05:40:23.468572+0000","last_clean":"2024-09-10T05:40:23.468572+0000","last_became_active":"2024-09-10T05:36:13.610788+0000","last_became_peered":"2024-09-10T05:36:13.610788+0000","last_unstale":"2024-09-10T05:40:23.468572+0000","last_undegraded":"2024-09-10T05:40:23.468572+0000","last_fullsized":"2024-09-10T05:40:23.468572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:23.468389+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:23.468389+0000","last_clean_scrub_stamp":"2024-09-10T05:40:23.468389+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:07.634792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"32'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:12.773984+0000","last_change":"2024-09-10T05:40:12.773984+0000","last_active":"2024-09-10T05:40:12.773984+0000","last_peered":"2024-09-10T05:40:12.773984+0000","last_clean":"2024-09-10T05:40:12.773984+0000","last_became_active":"2024-09-10T05:36:11.600655+0000","last_became_peered":"2024-09-10T05:36:11.600655+0000","last_unstale":"2024-09-10T05:40:12.773984+0000","last_undegraded":"2024-09-10T05:40:12.773984+0000","last_fullsized":"2024-09-10T05:40:12.773984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T05:40:12.773793+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T05:40:12.773793+0000","last_clean_scrub_stamp":"2024-09-10T05:40:12.773793+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:00:18.439768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:45.150973+0000","last_change":"2024-09-10T05:40:45.150973+0000","last_active":"2024-09-10T05:40:45.150973+0000","last_peered":"2024-09-10T05:40:45.150973+0000","last_clean":"2024-09-10T05:40:45.150973+0000","last_became_active":"2024-09-10T05:36:15.623436+0000","last_became_peered":"2024-09-10T05:36:15.623436+0000","last_unstale":"2024-09-10T05:40:45.150973+0000","last_undegraded":"2024-09-10T05:40:45.150973+0000","last_fullsized":"2024-09-10T05:40:45.150973+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:45.150793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:45.150793+0000","last_clean_scrub_stamp":"2024-09-10T05:40:45.150793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:24.710984+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'22","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:55.937705+0000","last_change":"2024-09-10T05:40:55.937705+0000","last_active":"2024-09-10T05:40:55.937705+0000","last_peered":"2024-09-10T05:40:55.937705+0000","last_clean":"2024-09-10T05:40:55.937705+0000","last_became_active":"2024-09-10T05:36:17.638408+0000","last_became_peered":"2024-09-10T05:36:17.638408+0000","last_unstale":"2024-09-10T05:40:55.937705+0000","last_undegraded":"2024-09-10T05:40:55.937705+0000","last_fullsized":"2024-09-10T05:40:55.937705+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-09-10T05:40:55.937512+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-09-10T05:40:55.937512+0000","last_clean_scrub_stamp":"2024-09-10T05:40:55.937512+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:20:52.761603+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'285","reported_seq":427,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:58.750044+0000","last_change":"2024-09-10T05:36:19.651451+0000","last_active":"2024-09-10T05:39:58.750044+0000","last_peered":"2024-09-10T05:39:58.750044+0000","last_clean":"2024-09-10T05:39:58.750044+0000","last_became_active":"2024-09-10T05:36:19.649079+0000","last_became_peered":"2024-09-10T05:36:19.649079+0000","last_unstale":"2024-09-10T05:39:58.750044+0000","last_undegraded":"2024-09-10T05:39:58.750044+0000","last_fullsized":"2024-09-10T05:39:58.750044+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:42.693156+0000","last_change":"2024-09-10T05:36:21.665833+0000","last_active":"2024-09-10T05:38:42.693156+0000","last_peered":"2024-09-10T05:38:42.693156+0000","last_clean":"2024-09-10T05:38:42.693156+0000","last_became_active":"2024-09-10T05:36:21.665112+0000","last_became_peered":"2024-09-10T05:36:21.665112+0000","last_unstale":"2024-09-10T05:38:42.693156+0000","last_undegraded":"2024-09-10T05:38:42.693156+0000","last_fullsized":"2024-09-10T05:38:42.693156+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"32'8","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:22.502077+0000","last_change":"2024-09-10T05:40:22.502077+0000","last_active":"2024-09-10T05:40:22.502077+0000","last_peered":"2024-09-10T05:40:22.502077+0000","last_clean":"2024-09-10T05:40:22.502077+0000","last_became_active":"2024-09-10T05:36:13.614222+0000","last_became_peered":"2024-09-10T05:36:13.614222+0000","last_unstale":"2024-09-10T05:40:22.502077+0000","last_undegraded":"2024-09-10T05:40:22.502077+0000","last_fullsized":"2024-09-10T05:40:22.502077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T05:40:22.501876+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T05:40:22.501876+0000","last_clean_scrub_stamp":"2024-09-10T05:40:22.501876+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:38.894156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:12.065325+0000","last_change":"2024-09-10T05:40:12.065325+0000","last_active":"2024-09-10T05:40:12.065325+0000","last_peered":"2024-09-10T05:40:12.065325+0000","last_clean":"2024-09-10T05:40:12.065325+0000","last_became_active":"2024-09-10T05:36:11.592805+0000","last_became_peered":"2024-09-10T05:36:11.592805+0000","last_unstale":"2024-09-10T05:40:12.065325+0000","last_undegraded":"2024-09-10T05:40:12.065325+0000","last_fullsized":"2024-09-10T05:40:12.065325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:12.065148+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:12.065148+0000","last_clean_scrub_stamp":"2024-09-10T05:40:12.065148+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:52:44.626794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:44.142808+0000","last_change":"2024-09-10T05:40:44.142808+0000","last_active":"2024-09-10T05:40:44.142808+0000","last_peered":"2024-09-10T05:40:44.142808+0000","last_clean":"2024-09-10T05:40:44.142808+0000","last_became_active":"2024-09-10T05:36:15.620288+0000","last_became_peered":"2024-09-10T05:36:15.620288+0000","last_unstale":"2024-09-10T05:40:44.142808+0000","last_undegraded":"2024-09-10T05:40:44.142808+0000","last_fullsized":"2024-09-10T05:40:44.142808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:44.142623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:44.142623+0000","last_clean_scrub_stamp":"2024-09-10T05:40:44.142623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:42:35.173358+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'74","reported_seq":160,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:59.180939+0000","last_change":"2024-09-10T05:40:59.180939+0000","last_active":"2024-09-10T05:40:59.180939+0000","last_peered":"2024-09-10T05:40:59.180939+0000","last_clean":"2024-09-10T05:40:59.180939+0000","last_became_active":"2024-09-10T05:36:17.651364+0000","last_became_peered":"2024-09-10T05:36:17.651364+0000","last_unstale":"2024-09-10T05:40:59.180939+0000","last_undegraded":"2024-09-10T05:40:59.180939+0000","last_fullsized":"2024-09-10T05:40:59.180939+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'74","last_scrub_stamp":"2024-09-10T05:40:59.180739+0000","last_deep_scrub":"34'74","last_deep_scrub_stamp":"2024-09-10T05:40:59.180739+0000","last_clean_scrub_stamp":"2024-09-10T05:40:59.180739+0000","objects_scrubbed":11,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:19:24.729828+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:53.721434+0000","last_change":"2024-09-10T05:36:19.659340+0000","last_active":"2024-09-10T05:37:53.721434+0000","last_peered":"2024-09-10T05:37:53.721434+0000","last_clean":"2024-09-10T05:37:53.721434+0000","last_became_active":"2024-09-10T05:36:19.658646+0000","last_became_peered":"2024-09-10T05:36:19.658646+0000","last_unstale":"2024-09-10T05:37:53.721434+0000","last_undegraded":"2024-09-10T05:37:53.721434+0000","last_fullsized":"2024-09-10T05:37:53.721434+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:22:35.133305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"34'4","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.471685+0000","last_change":"2024-09-10T05:36:21.689581+0000","last_active":"2024-09-10T05:39:27.471685+0000","last_peered":"2024-09-10T05:39:27.471685+0000","last_clean":"2024-09-10T05:39:27.471685+0000","last_became_active":"2024-09-10T05:36:21.688695+0000","last_became_peered":"2024-09-10T05:36:21.688695+0000","last_unstale":"2024-09-10T05:39:27.471685+0000","last_undegraded":"2024-09-10T05:39:27.471685+0000","last_fullsized":"2024-09-10T05:39:27.471685+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:53.585393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"34'4","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:29.383586+0000","last_change":"2024-09-10T05:40:29.383586+0000","last_active":"2024-09-10T05:40:29.383586+0000","last_peered":"2024-09-10T05:40:29.383586+0000","last_clean":"2024-09-10T05:40:29.383586+0000","last_became_active":"2024-09-10T05:36:13.615340+0000","last_became_peered":"2024-09-10T05:36:13.615340+0000","last_unstale":"2024-09-10T05:40:29.383586+0000","last_undegraded":"2024-09-10T05:40:29.383586+0000","last_fullsized":"2024-09-10T05:40:29.383586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:29.383350+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:29.383350+0000","last_clean_scrub_stamp":"2024-09-10T05:40:29.383350+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:11:46.571874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"30'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:17.453722+0000","last_change":"2024-09-10T05:40:17.453722+0000","last_active":"2024-09-10T05:40:17.453722+0000","last_peered":"2024-09-10T05:40:17.453722+0000","last_clean":"2024-09-10T05:40:17.453722+0000","last_became_active":"2024-09-10T05:36:11.597360+0000","last_became_peered":"2024-09-10T05:36:11.597360+0000","last_unstale":"2024-09-10T05:40:17.453722+0000","last_undegraded":"2024-09-10T05:40:17.453722+0000","last_fullsized":"2024-09-10T05:40:17.453722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-10T05:40:17.453532+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-10T05:40:17.453532+0000","last_clean_scrub_stamp":"2024-09-10T05:40:17.453532+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:04:31.620004+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:48.480286+0000","last_change":"2024-09-10T05:40:48.480286+0000","last_active":"2024-09-10T05:40:48.480286+0000","last_peered":"2024-09-10T05:40:48.480286+0000","last_clean":"2024-09-10T05:40:48.480286+0000","last_became_active":"2024-09-10T05:36:15.619849+0000","last_became_peered":"2024-09-10T05:36:15.619849+0000","last_unstale":"2024-09-10T05:40:48.480286+0000","last_undegraded":"2024-09-10T05:40:48.480286+0000","last_fullsized":"2024-09-10T05:40:48.480286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:48.480069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:48.480069+0000","last_clean_scrub_stamp":"2024-09-10T05:40:48.480069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:01:42.309353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"34'45","reported_seq":110,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:39.497036+0000","last_change":"2024-09-10T05:40:39.497036+0000","last_active":"2024-09-10T05:40:39.497036+0000","last_peered":"2024-09-10T05:40:39.497036+0000","last_clean":"2024-09-10T05:40:39.497036+0000","last_became_active":"2024-09-10T05:36:17.646780+0000","last_became_peered":"2024-09-10T05:36:17.646780+0000","last_unstale":"2024-09-10T05:40:39.497036+0000","last_undegraded":"2024-09-10T05:40:39.497036+0000","last_fullsized":"2024-09-10T05:40:39.497036+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'45","last_scrub_stamp":"2024-09-10T05:40:39.496818+0000","last_deep_scrub":"34'45","last_deep_scrub_stamp":"2024-09-10T05:40:39.496818+0000","last_clean_scrub_stamp":"2024-09-10T05:40:39.496818+0000","objects_scrubbed":5,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:56:18.167230+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.896432+0000","last_change":"2024-09-10T05:36:19.652878+0000","last_active":"2024-09-10T05:37:55.896432+0000","last_peered":"2024-09-10T05:37:55.896432+0000","last_clean":"2024-09-10T05:37:55.896432+0000","last_became_active":"2024-09-10T05:36:19.652114+0000","last_became_peered":"2024-09-10T05:36:19.652114+0000","last_unstale":"2024-09-10T05:37:55.896432+0000","last_undegraded":"2024-09-10T05:37:55.896432+0000","last_fullsized":"2024-09-10T05:37:55.896432+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:46:40.081106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.16","version":"34'2","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:39:27.271654+0000","last_change":"2024-09-10T05:36:21.693139+0000","last_active":"2024-09-10T05:39:27.271654+0000","last_peered":"2024-09-10T05:39:27.271654+0000","last_clean":"2024-09-10T05:39:27.271654+0000","last_became_active":"2024-09-10T05:36:21.692564+0000","last_became_peered":"2024-09-10T05:36:21.692564+0000","last_unstale":"2024-09-10T05:39:27.271654+0000","last_undegraded":"2024-09-10T05:39:27.271654+0000","last_fullsized":"2024-09-10T05:39:27.271654+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:51.507378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:31.814778+0000","last_change":"2024-09-10T05:40:31.814481+0000","last_active":"2024-09-10T05:40:31.814778+0000","last_peered":"2024-09-10T05:40:31.814778+0000","last_clean":"2024-09-10T05:40:31.814778+0000","last_became_active":"2024-09-10T05:36:13.600225+0000","last_became_peered":"2024-09-10T05:36:13.600225+0000","last_unstale":"2024-09-10T05:40:31.814778+0000","last_undegraded":"2024-09-10T05:40:31.814778+0000","last_fullsized":"2024-09-10T05:40:31.814778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T05:40:31.814262+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T05:40:31.814262+0000","last_clean_scrub_stamp":"2024-09-10T05:40:31.814262+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:47:13.698886+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:09.683197+0000","last_change":"2024-09-10T05:40:09.683066+0000","last_active":"2024-09-10T05:40:09.683197+0000","last_peered":"2024-09-10T05:40:09.683197+0000","last_clean":"2024-09-10T05:40:09.683197+0000","last_became_active":"2024-09-10T05:36:11.600598+0000","last_became_peered":"2024-09-10T05:36:11.600598+0000","last_unstale":"2024-09-10T05:40:09.683197+0000","last_undegraded":"2024-09-10T05:40:09.683197+0000","last_fullsized":"2024-09-10T05:40:09.683197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:09.682886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:09.682886+0000","last_clean_scrub_stamp":"2024-09-10T05:40:09.682886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:07.178758+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:42.112135+0000","last_change":"2024-09-10T05:40:42.112135+0000","last_active":"2024-09-10T05:40:42.112135+0000","last_peered":"2024-09-10T05:40:42.112135+0000","last_clean":"2024-09-10T05:40:42.112135+0000","last_became_active":"2024-09-10T05:36:15.634465+0000","last_became_peered":"2024-09-10T05:36:15.634465+0000","last_unstale":"2024-09-10T05:40:42.112135+0000","last_undegraded":"2024-09-10T05:40:42.112135+0000","last_fullsized":"2024-09-10T05:40:42.112135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:42.111930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:42.111930+0000","last_clean_scrub_stamp":"2024-09-10T05:40:42.111930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:08:44.803427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'39","reported_seq":102,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:53.931027+0000","last_change":"2024-09-10T05:40:53.931027+0000","last_active":"2024-09-10T05:40:53.931027+0000","last_peered":"2024-09-10T05:40:53.931027+0000","last_clean":"2024-09-10T05:40:53.931027+0000","last_became_active":"2024-09-10T05:36:17.634874+0000","last_became_peered":"2024-09-10T05:36:17.634874+0000","last_unstale":"2024-09-10T05:40:53.931027+0000","last_undegraded":"2024-09-10T05:40:53.931027+0000","last_fullsized":"2024-09-10T05:40:53.931027+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'39","last_scrub_stamp":"2024-09-10T05:40:53.930836+0000","last_deep_scrub":"34'39","last_deep_scrub_stamp":"2024-09-10T05:40:53.930836+0000","last_clean_scrub_stamp":"2024-09-10T05:40:53.930836+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:42:45.436023+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:37:55.898394+0000","last_change":"2024-09-10T05:36:19.638483+0000","last_active":"2024-09-10T05:37:55.898394+0000","last_peered":"2024-09-10T05:37:55.898394+0000","last_clean":"2024-09-10T05:37:55.898394+0000","last_became_active":"2024-09-10T05:36:19.637682+0000","last_became_peered":"2024-09-10T05:36:19.637682+0000","last_unstale":"2024-09-10T05:37:55.898394+0000","last_undegraded":"2024-09-10T05:37:55.898394+0000","last_fullsized":"2024-09-10T05:37:55.898394+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:18.610103+0000","last_clean_scrub_stamp":"2024-09-10T05:36:18.610103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:35.498813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"34'4","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:24.056283+0000","last_change":"2024-09-10T05:36:21.688794+0000","last_active":"2024-09-10T05:38:24.056283+0000","last_peered":"2024-09-10T05:38:24.056283+0000","last_clean":"2024-09-10T05:38:24.056283+0000","last_became_active":"2024-09-10T05:36:21.688046+0000","last_became_peered":"2024-09-10T05:36:21.688046+0000","last_unstale":"2024-09-10T05:38:24.056283+0000","last_undegraded":"2024-09-10T05:38:24.056283+0000","last_fullsized":"2024-09-10T05:38:24.056283+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:06:36.753067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:28.343027+0000","last_change":"2024-09-10T05:40:28.342899+0000","last_active":"2024-09-10T05:40:28.343027+0000","last_peered":"2024-09-10T05:40:28.343027+0000","last_clean":"2024-09-10T05:40:28.343027+0000","last_became_active":"2024-09-10T05:36:13.611864+0000","last_became_peered":"2024-09-10T05:36:13.611864+0000","last_unstale":"2024-09-10T05:40:28.343027+0000","last_undegraded":"2024-09-10T05:40:28.343027+0000","last_fullsized":"2024-09-10T05:40:28.343027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:28.342719+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:28.342719+0000","last_clean_scrub_stamp":"2024-09-10T05:40:28.342719+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:50:09.925425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"32'3","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:13.027528+0000","last_change":"2024-09-10T05:40:13.027402+0000","last_active":"2024-09-10T05:40:13.027528+0000","last_peered":"2024-09-10T05:40:13.027528+0000","last_clean":"2024-09-10T05:40:13.027528+0000","last_became_active":"2024-09-10T05:36:11.594949+0000","last_became_peered":"2024-09-10T05:36:11.594949+0000","last_unstale":"2024-09-10T05:40:13.027528+0000","last_undegraded":"2024-09-10T05:40:13.027528+0000","last_fullsized":"2024-09-10T05:40:13.027528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-10T05:40:13.027220+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-10T05:40:13.027220+0000","last_clean_scrub_stamp":"2024-09-10T05:40:13.027220+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:48:42.771696+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'3","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:43.109826+0000","last_change":"2024-09-10T05:40:43.109826+0000","last_active":"2024-09-10T05:40:43.109826+0000","last_peered":"2024-09-10T05:40:43.109826+0000","last_clean":"2024-09-10T05:40:43.109826+0000","last_became_active":"2024-09-10T05:36:15.618169+0000","last_became_peered":"2024-09-10T05:36:15.618169+0000","last_unstale":"2024-09-10T05:40:43.109826+0000","last_undegraded":"2024-09-10T05:40:43.109826+0000","last_fullsized":"2024-09-10T05:40:43.109826+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-10T05:40:43.109616+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-10T05:40:43.109616+0000","last_clean_scrub_stamp":"2024-09-10T05:40:43.109616+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:05:16.249660+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'57","reported_seq":130,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:41:02.218358+0000","last_change":"2024-09-10T05:41:02.218358+0000","last_active":"2024-09-10T05:41:02.218358+0000","last_peered":"2024-09-10T05:41:02.218358+0000","last_clean":"2024-09-10T05:41:02.218358+0000","last_became_active":"2024-09-10T05:36:17.631194+0000","last_became_peered":"2024-09-10T05:36:17.631194+0000","last_unstale":"2024-09-10T05:41:02.218358+0000","last_undegraded":"2024-09-10T05:41:02.218358+0000","last_fullsized":"2024-09-10T05:41:02.218358+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'57","last_scrub_stamp":"2024-09-10T05:41:02.218141+0000","last_deep_scrub":"34'57","last_deep_scrub_stamp":"2024-09-10T05:41:02.218141+0000","last_clean_scrub_stamp":"2024-09-10T05:41:02.218141+0000","objects_scrubbed":7,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:34:38.794126+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":64,"num_read_kb":76,"num_write":36,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1270,"num_omap_keys":6,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:47.591951+0000","last_change":"2024-09-10T05:40:47.591951+0000","last_active":"2024-09-10T05:40:47.591951+0000","last_peered":"2024-09-10T05:40:47.591951+0000","last_clean":"2024-09-10T05:40:47.591951+0000","last_became_active":"2024-09-10T05:36:19.636483+0000","last_became_peered":"2024-09-10T05:36:19.636483+0000","last_unstale":"2024-09-10T05:40:47.591951+0000","last_undegraded":"2024-09-10T05:40:47.591951+0000","last_fullsized":"2024-09-10T05:40:47.591951+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:47.591770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:47.591770+0000","last_clean_scrub_stamp":"2024-09-10T05:40:47.591770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:35:40.910769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"34'8","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:38:42.693485+0000","last_change":"2024-09-10T05:36:21.689539+0000","last_active":"2024-09-10T05:38:42.693485+0000","last_peered":"2024-09-10T05:38:42.693485+0000","last_clean":"2024-09-10T05:38:42.693485+0000","last_became_active":"2024-09-10T05:36:21.688818+0000","last_became_peered":"2024-09-10T05:36:21.688818+0000","last_unstale":"2024-09-10T05:38:42.693485+0000","last_undegraded":"2024-09-10T05:38:42.693485+0000","last_fullsized":"2024-09-10T05:38:42.693485+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:36:20.626670+0000","last_clean_scrub_stamp":"2024-09-10T05:36:20.626670+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":19,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"34'8","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:29.160600+0000","last_change":"2024-09-10T05:40:29.160453+0000","last_active":"2024-09-10T05:40:29.160600+0000","last_peered":"2024-09-10T05:40:29.160600+0000","last_clean":"2024-09-10T05:40:29.160600+0000","last_became_active":"2024-09-10T05:36:13.618260+0000","last_became_peered":"2024-09-10T05:36:13.618260+0000","last_unstale":"2024-09-10T05:40:29.160600+0000","last_undegraded":"2024-09-10T05:40:29.160600+0000","last_fullsized":"2024-09-10T05:40:29.160600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-10T05:40:29.160278+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-10T05:40:29.160278+0000","last_clean_scrub_stamp":"2024-09-10T05:40:29.160278+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:55:42.355372+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:05.545029+0000","last_change":"2024-09-10T05:40:05.544869+0000","last_active":"2024-09-10T05:40:05.545029+0000","last_peered":"2024-09-10T05:40:05.545029+0000","last_clean":"2024-09-10T05:40:05.545029+0000","last_became_active":"2024-09-10T05:36:11.603738+0000","last_became_peered":"2024-09-10T05:36:11.603738+0000","last_unstale":"2024-09-10T05:40:05.545029+0000","last_undegraded":"2024-09-10T05:40:05.545029+0000","last_fullsized":"2024-09-10T05:40:05.545029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:05.544682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:05.544682+0000","last_clean_scrub_stamp":"2024-09-10T05:40:05.544682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:49:54.654103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'14","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:30.165195+0000","last_change":"2024-09-10T05:40:30.165018+0000","last_active":"2024-09-10T05:40:30.165195+0000","last_peered":"2024-09-10T05:40:30.165195+0000","last_clean":"2024-09-10T05:40:30.165195+0000","last_became_active":"2024-09-10T05:36:13.624460+0000","last_became_peered":"2024-09-10T05:36:13.624460+0000","last_unstale":"2024-09-10T05:40:30.165195+0000","last_undegraded":"2024-09-10T05:40:30.165195+0000","last_fullsized":"2024-09-10T05:40:30.165195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-10T05:40:30.164829+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-10T05:40:30.164829+0000","last_clean_scrub_stamp":"2024-09-10T05:40:30.164829+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:29:41.992659+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":58,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:07.495701+0000","last_change":"2024-09-10T05:40:07.495530+0000","last_active":"2024-09-10T05:40:07.495701+0000","last_peered":"2024-09-10T05:40:07.495701+0000","last_clean":"2024-09-10T05:40:07.495701+0000","last_became_active":"2024-09-10T05:36:11.601762+0000","last_became_peered":"2024-09-10T05:36:11.601762+0000","last_unstale":"2024-09-10T05:40:07.495701+0000","last_undegraded":"2024-09-10T05:40:07.495701+0000","last_fullsized":"2024-09-10T05:40:07.495701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:07.495353+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:07.495353+0000","last_clean_scrub_stamp":"2024-09-10T05:40:07.495353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:18:59.814823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"34'20","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:34.439775+0000","last_change":"2024-09-10T05:40:34.439775+0000","last_active":"2024-09-10T05:40:34.439775+0000","last_peered":"2024-09-10T05:40:34.439775+0000","last_clean":"2024-09-10T05:40:34.439775+0000","last_became_active":"2024-09-10T05:36:13.614221+0000","last_became_peered":"2024-09-10T05:36:13.614221+0000","last_unstale":"2024-09-10T05:40:34.439775+0000","last_undegraded":"2024-09-10T05:40:34.439775+0000","last_fullsized":"2024-09-10T05:40:34.439775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'20","last_scrub_stamp":"2024-09-10T05:40:34.439594+0000","last_deep_scrub":"34'20","last_deep_scrub_stamp":"2024-09-10T05:40:34.439594+0000","last_clean_scrub_stamp":"2024-09-10T05:40:34.439594+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:21:01.217898+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":66,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:10.730272+0000","last_change":"2024-09-10T05:40:10.730128+0000","last_active":"2024-09-10T05:40:10.730272+0000","last_peered":"2024-09-10T05:40:10.730272+0000","last_clean":"2024-09-10T05:40:10.730272+0000","last_became_active":"2024-09-10T05:36:11.601269+0000","last_became_peered":"2024-09-10T05:36:11.601269+0000","last_unstale":"2024-09-10T05:40:10.730272+0000","last_undegraded":"2024-09-10T05:40:10.730272+0000","last_fullsized":"2024-09-10T05:40:10.730272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:10.729946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:10.729946+0000","last_clean_scrub_stamp":"2024-09-10T05:40:10.729946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:23.818687+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'22","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:28.165310+0000","last_change":"2024-09-10T05:40:28.165073+0000","last_active":"2024-09-10T05:40:28.165310+0000","last_peered":"2024-09-10T05:40:28.165310+0000","last_clean":"2024-09-10T05:40:28.165310+0000","last_became_active":"2024-09-10T05:36:13.626022+0000","last_became_peered":"2024-09-10T05:36:13.626022+0000","last_unstale":"2024-09-10T05:40:28.165310+0000","last_undegraded":"2024-09-10T05:40:28.165310+0000","last_fullsized":"2024-09-10T05:40:28.165310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-09-10T05:40:28.164834+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-09-10T05:40:28.164834+0000","last_clean_scrub_stamp":"2024-09-10T05:40:28.164834+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:36.827007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":48,"num_read_kb":40,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:08.499166+0000","last_change":"2024-09-10T05:40:08.498960+0000","last_active":"2024-09-10T05:40:08.499166+0000","last_peered":"2024-09-10T05:40:08.499166+0000","last_clean":"2024-09-10T05:40:08.499166+0000","last_became_active":"2024-09-10T05:36:11.610933+0000","last_became_peered":"2024-09-10T05:36:11.610933+0000","last_unstale":"2024-09-10T05:40:08.499166+0000","last_undegraded":"2024-09-10T05:40:08.499166+0000","last_fullsized":"2024-09-10T05:40:08.499166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:08.498772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:08.498772+0000","last_clean_scrub_stamp":"2024-09-10T05:40:08.498772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:52:48.692131+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"34'14","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:34.804203+0000","last_change":"2024-09-10T05:40:34.804203+0000","last_active":"2024-09-10T05:40:34.804203+0000","last_peered":"2024-09-10T05:40:34.804203+0000","last_clean":"2024-09-10T05:40:34.804203+0000","last_became_active":"2024-09-10T05:36:13.597975+0000","last_became_peered":"2024-09-10T05:36:13.597975+0000","last_unstale":"2024-09-10T05:40:34.804203+0000","last_undegraded":"2024-09-10T05:40:34.804203+0000","last_fullsized":"2024-09-10T05:40:34.804203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-10T05:40:34.804027+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-10T05:40:34.804027+0000","last_clean_scrub_stamp":"2024-09-10T05:40:34.804027+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:55.230805+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"34'2","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:13.780147+0000","last_change":"2024-09-10T05:40:13.779908+0000","last_active":"2024-09-10T05:40:13.780147+0000","last_peered":"2024-09-10T05:40:13.780147+0000","last_clean":"2024-09-10T05:40:13.780147+0000","last_became_active":"2024-09-10T05:36:11.603085+0000","last_became_peered":"2024-09-10T05:36:11.603085+0000","last_unstale":"2024-09-10T05:40:13.780147+0000","last_undegraded":"2024-09-10T05:40:13.780147+0000","last_fullsized":"2024-09-10T05:40:13.780147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:13.779687+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:13.779687+0000","last_clean_scrub_stamp":"2024-09-10T05:40:13.779687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:21:43.655717+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:27.184735+0000","last_change":"2024-09-10T05:40:27.184735+0000","last_active":"2024-09-10T05:40:27.184735+0000","last_peered":"2024-09-10T05:40:27.184735+0000","last_clean":"2024-09-10T05:40:27.184735+0000","last_became_active":"2024-09-10T05:36:13.610894+0000","last_became_peered":"2024-09-10T05:36:13.610894+0000","last_unstale":"2024-09-10T05:40:27.184735+0000","last_undegraded":"2024-09-10T05:40:27.184735+0000","last_fullsized":"2024-09-10T05:40:27.184735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:27.184546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:27.184546+0000","last_clean_scrub_stamp":"2024-09-10T05:40:27.184546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:46:52.509265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:14.059086+0000","last_change":"2024-09-10T05:40:14.058953+0000","last_active":"2024-09-10T05:40:14.059086+0000","last_peered":"2024-09-10T05:40:14.059086+0000","last_clean":"2024-09-10T05:40:14.059086+0000","last_became_active":"2024-09-10T05:36:11.592809+0000","last_became_peered":"2024-09-10T05:36:11.592809+0000","last_unstale":"2024-09-10T05:40:14.059086+0000","last_undegraded":"2024-09-10T05:40:14.059086+0000","last_fullsized":"2024-09-10T05:40:14.059086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:14.058768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:14.058768+0000","last_clean_scrub_stamp":"2024-09-10T05:40:14.058768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:44.630239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'6","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:32.827471+0000","last_change":"2024-09-10T05:40:32.827471+0000","last_active":"2024-09-10T05:40:32.827471+0000","last_peered":"2024-09-10T05:40:32.827471+0000","last_clean":"2024-09-10T05:40:32.827471+0000","last_became_active":"2024-09-10T05:36:13.607052+0000","last_became_peered":"2024-09-10T05:36:13.607052+0000","last_unstale":"2024-09-10T05:40:32.827471+0000","last_undegraded":"2024-09-10T05:40:32.827471+0000","last_fullsized":"2024-09-10T05:40:32.827471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T05:40:32.827295+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T05:40:32.827295+0000","last_clean_scrub_stamp":"2024-09-10T05:40:32.827295+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:41:56.575014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"32'2","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:09.533820+0000","last_change":"2024-09-10T05:40:09.533645+0000","last_active":"2024-09-10T05:40:09.533820+0000","last_peered":"2024-09-10T05:40:09.533820+0000","last_clean":"2024-09-10T05:40:09.533820+0000","last_became_active":"2024-09-10T05:36:11.593614+0000","last_became_peered":"2024-09-10T05:36:11.593614+0000","last_unstale":"2024-09-10T05:40:09.533820+0000","last_undegraded":"2024-09-10T05:40:09.533820+0000","last_fullsized":"2024-09-10T05:40:09.533820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T05:40:09.533454+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T05:40:09.533454+0000","last_clean_scrub_stamp":"2024-09-10T05:40:09.533454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:03:38.053067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:31.431004+0000","last_change":"2024-09-10T05:40:31.431004+0000","last_active":"2024-09-10T05:40:31.431004+0000","last_peered":"2024-09-10T05:40:31.431004+0000","last_clean":"2024-09-10T05:40:31.431004+0000","last_became_active":"2024-09-10T05:36:13.593693+0000","last_became_peered":"2024-09-10T05:36:13.593693+0000","last_unstale":"2024-09-10T05:40:31.431004+0000","last_undegraded":"2024-09-10T05:40:31.431004+0000","last_fullsized":"2024-09-10T05:40:31.431004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:31.430822+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:31.430822+0000","last_clean_scrub_stamp":"2024-09-10T05:40:31.430822+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:12.717581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"34'8","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:14.767670+0000","last_change":"2024-09-10T05:40:14.767528+0000","last_active":"2024-09-10T05:40:14.767670+0000","last_peered":"2024-09-10T05:40:14.767670+0000","last_clean":"2024-09-10T05:40:14.767670+0000","last_became_active":"2024-09-10T05:36:11.604011+0000","last_became_peered":"2024-09-10T05:36:11.604011+0000","last_unstale":"2024-09-10T05:40:14.767670+0000","last_undegraded":"2024-09-10T05:40:14.767670+0000","last_fullsized":"2024-09-10T05:40:14.767670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-10T05:40:14.767349+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-10T05:40:14.767349+0000","last_clean_scrub_stamp":"2024-09-10T05:40:14.767349+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:21:09.642300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":24,"num_write_kb":12289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"34'16","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:33.141932+0000","last_change":"2024-09-10T05:40:33.141794+0000","last_active":"2024-09-10T05:40:33.141932+0000","last_peered":"2024-09-10T05:40:33.141932+0000","last_clean":"2024-09-10T05:40:33.141932+0000","last_became_active":"2024-09-10T05:36:13.629760+0000","last_became_peered":"2024-09-10T05:36:13.629760+0000","last_unstale":"2024-09-10T05:40:33.141932+0000","last_undegraded":"2024-09-10T05:40:33.141932+0000","last_fullsized":"2024-09-10T05:40:33.141932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-10T05:40:33.141579+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-10T05:40:33.141579+0000","last_clean_scrub_stamp":"2024-09-10T05:40:33.141579+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:13:56.723961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":66,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:15.759238+0000","last_change":"2024-09-10T05:40:15.759115+0000","last_active":"2024-09-10T05:40:15.759238+0000","last_peered":"2024-09-10T05:40:15.759238+0000","last_clean":"2024-09-10T05:40:15.759238+0000","last_became_active":"2024-09-10T05:36:11.597158+0000","last_became_peered":"2024-09-10T05:36:11.597158+0000","last_unstale":"2024-09-10T05:40:15.759238+0000","last_undegraded":"2024-09-10T05:40:15.759238+0000","last_fullsized":"2024-09-10T05:40:15.759238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:15.758931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:15.758931+0000","last_clean_scrub_stamp":"2024-09-10T05:40:15.758931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:16.124076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:35.842058+0000","last_change":"2024-09-10T05:40:35.841896+0000","last_active":"2024-09-10T05:40:35.842058+0000","last_peered":"2024-09-10T05:40:35.842058+0000","last_clean":"2024-09-10T05:40:35.842058+0000","last_became_active":"2024-09-10T05:36:13.613206+0000","last_became_peered":"2024-09-10T05:36:13.613206+0000","last_unstale":"2024-09-10T05:40:35.842058+0000","last_undegraded":"2024-09-10T05:40:35.842058+0000","last_fullsized":"2024-09-10T05:40:35.842058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:35.841653+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:35.841653+0000","last_clean_scrub_stamp":"2024-09-10T05:40:35.841653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:12:38.162551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'2","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:16.993374+0000","last_change":"2024-09-10T05:40:16.993374+0000","last_active":"2024-09-10T05:40:16.993374+0000","last_peered":"2024-09-10T05:40:16.993374+0000","last_clean":"2024-09-10T05:40:16.993374+0000","last_became_active":"2024-09-10T05:36:52.705212+0000","last_became_peered":"2024-09-10T05:36:52.705212+0000","last_unstale":"2024-09-10T05:40:16.993374+0000","last_undegraded":"2024-09-10T05:40:16.993374+0000","last_fullsized":"2024-09-10T05:40:16.993374+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T05:40:16.993183+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T05:40:16.993183+0000","last_clean_scrub_stamp":"2024-09-10T05:40:16.993183+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:47:37.839890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"34'6","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:26.552621+0000","last_change":"2024-09-10T05:40:26.552418+0000","last_active":"2024-09-10T05:40:26.552621+0000","last_peered":"2024-09-10T05:40:26.552621+0000","last_clean":"2024-09-10T05:40:26.552621+0000","last_became_active":"2024-09-10T05:36:13.626912+0000","last_became_peered":"2024-09-10T05:36:13.626912+0000","last_unstale":"2024-09-10T05:40:26.552621+0000","last_undegraded":"2024-09-10T05:40:26.552621+0000","last_fullsized":"2024-09-10T05:40:26.552621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T05:40:26.552231+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T05:40:26.552231+0000","last_clean_scrub_stamp":"2024-09-10T05:40:26.552231+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:07:42.396989+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:24.386144+0000","last_change":"2024-09-10T05:40:24.386014+0000","last_active":"2024-09-10T05:40:24.386144+0000","last_peered":"2024-09-10T05:40:24.386144+0000","last_clean":"2024-09-10T05:40:24.386144+0000","last_became_active":"2024-09-10T05:36:11.606369+0000","last_became_peered":"2024-09-10T05:36:11.606369+0000","last_unstale":"2024-09-10T05:40:24.386144+0000","last_undegraded":"2024-09-10T05:40:24.386144+0000","last_fullsized":"2024-09-10T05:40:24.386144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:24.385801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:24.385801+0000","last_clean_scrub_stamp":"2024-09-10T05:40:24.385801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:48.821098+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"32'8","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:32.095285+0000","last_change":"2024-09-10T05:40:32.095140+0000","last_active":"2024-09-10T05:40:32.095285+0000","last_peered":"2024-09-10T05:40:32.095285+0000","last_clean":"2024-09-10T05:40:32.095285+0000","last_became_active":"2024-09-10T05:36:13.607807+0000","last_became_peered":"2024-09-10T05:36:13.607807+0000","last_unstale":"2024-09-10T05:40:32.095285+0000","last_undegraded":"2024-09-10T05:40:32.095285+0000","last_fullsized":"2024-09-10T05:40:32.095285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T05:40:32.094948+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T05:40:32.094948+0000","last_clean_scrub_stamp":"2024-09-10T05:40:32.094948+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:48.800391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:21.057945+0000","last_change":"2024-09-10T05:40:21.057801+0000","last_active":"2024-09-10T05:40:21.057945+0000","last_peered":"2024-09-10T05:40:21.057945+0000","last_clean":"2024-09-10T05:40:21.057945+0000","last_became_active":"2024-09-10T05:36:11.593962+0000","last_became_peered":"2024-09-10T05:36:11.593962+0000","last_unstale":"2024-09-10T05:40:21.057945+0000","last_undegraded":"2024-09-10T05:40:21.057945+0000","last_fullsized":"2024-09-10T05:40:21.057945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:21.057604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:21.057604+0000","last_clean_scrub_stamp":"2024-09-10T05:40:21.057604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:31:16.451869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:38.455689+0000","last_change":"2024-09-10T05:40:38.455536+0000","last_active":"2024-09-10T05:40:38.455689+0000","last_peered":"2024-09-10T05:40:38.455689+0000","last_clean":"2024-09-10T05:40:38.455689+0000","last_became_active":"2024-09-10T05:36:13.614155+0000","last_became_peered":"2024-09-10T05:36:13.614155+0000","last_unstale":"2024-09-10T05:40:38.455689+0000","last_undegraded":"2024-09-10T05:40:38.455689+0000","last_fullsized":"2024-09-10T05:40:38.455689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:38.455337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:38.455337+0000","last_clean_scrub_stamp":"2024-09-10T05:40:38.455337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:59:49.912552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:17.752534+0000","last_change":"2024-09-10T05:40:17.752385+0000","last_active":"2024-09-10T05:40:17.752534+0000","last_peered":"2024-09-10T05:40:17.752534+0000","last_clean":"2024-09-10T05:40:17.752534+0000","last_became_active":"2024-09-10T05:36:11.602866+0000","last_became_peered":"2024-09-10T05:36:11.602866+0000","last_unstale":"2024-09-10T05:40:17.752534+0000","last_undegraded":"2024-09-10T05:40:17.752534+0000","last_fullsized":"2024-09-10T05:40:17.752534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:17.752209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:17.752209+0000","last_clean_scrub_stamp":"2024-09-10T05:40:17.752209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:37:42.386692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'16","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:31.135884+0000","last_change":"2024-09-10T05:40:31.135746+0000","last_active":"2024-09-10T05:40:31.135884+0000","last_peered":"2024-09-10T05:40:31.135884+0000","last_clean":"2024-09-10T05:40:31.135884+0000","last_became_active":"2024-09-10T05:36:13.611391+0000","last_became_peered":"2024-09-10T05:36:13.611391+0000","last_unstale":"2024-09-10T05:40:31.135884+0000","last_undegraded":"2024-09-10T05:40:31.135884+0000","last_fullsized":"2024-09-10T05:40:31.135884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-10T05:40:31.135543+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-10T05:40:31.135543+0000","last_clean_scrub_stamp":"2024-09-10T05:40:31.135543+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:39:31.932855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:16.032739+0000","last_change":"2024-09-10T05:40:16.032739+0000","last_active":"2024-09-10T05:40:16.032739+0000","last_peered":"2024-09-10T05:40:16.032739+0000","last_clean":"2024-09-10T05:40:16.032739+0000","last_became_active":"2024-09-10T05:36:52.706226+0000","last_became_peered":"2024-09-10T05:36:52.706226+0000","last_unstale":"2024-09-10T05:40:16.032739+0000","last_undegraded":"2024-09-10T05:40:16.032739+0000","last_fullsized":"2024-09-10T05:40:16.032739+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:16.032561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:16.032561+0000","last_clean_scrub_stamp":"2024-09-10T05:40:16.032561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:29.267082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"34'10","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:37.810522+0000","last_change":"2024-09-10T05:40:37.810391+0000","last_active":"2024-09-10T05:40:37.810522+0000","last_peered":"2024-09-10T05:40:37.810522+0000","last_clean":"2024-09-10T05:40:37.810522+0000","last_became_active":"2024-09-10T05:36:13.616136+0000","last_became_peered":"2024-09-10T05:36:13.616136+0000","last_unstale":"2024-09-10T05:40:37.810522+0000","last_undegraded":"2024-09-10T05:40:37.810522+0000","last_fullsized":"2024-09-10T05:40:37.810522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-10T05:40:37.810174+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-10T05:40:37.810174+0000","last_clean_scrub_stamp":"2024-09-10T05:40:37.810174+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:00:30.777170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"32'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:11.568212+0000","last_change":"2024-09-10T05:40:11.568074+0000","last_active":"2024-09-10T05:40:11.568212+0000","last_peered":"2024-09-10T05:40:11.568212+0000","last_clean":"2024-09-10T05:40:11.568212+0000","last_became_active":"2024-09-10T05:36:11.600234+0000","last_became_peered":"2024-09-10T05:36:11.600234+0000","last_unstale":"2024-09-10T05:40:11.568212+0000","last_undegraded":"2024-09-10T05:40:11.568212+0000","last_fullsized":"2024-09-10T05:40:11.568212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T05:40:11.567892+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T05:40:11.567892+0000","last_clean_scrub_stamp":"2024-09-10T05:40:11.567892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:09:54.451468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"30'2","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:33.449784+0000","last_change":"2024-09-10T05:40:33.449784+0000","last_active":"2024-09-10T05:40:33.449784+0000","last_peered":"2024-09-10T05:40:33.449784+0000","last_clean":"2024-09-10T05:40:33.449784+0000","last_became_active":"2024-09-10T05:36:13.614098+0000","last_became_peered":"2024-09-10T05:36:13.614098+0000","last_unstale":"2024-09-10T05:40:33.449784+0000","last_undegraded":"2024-09-10T05:40:33.449784+0000","last_fullsized":"2024-09-10T05:40:33.449784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-10T05:40:33.449593+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-10T05:40:33.449593+0000","last_clean_scrub_stamp":"2024-09-10T05:40:33.449593+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:09.814056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"30'2","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:16.733078+0000","last_change":"2024-09-10T05:40:16.732918+0000","last_active":"2024-09-10T05:40:16.733078+0000","last_peered":"2024-09-10T05:40:16.733078+0000","last_clean":"2024-09-10T05:40:16.733078+0000","last_became_active":"2024-09-10T05:36:11.603972+0000","last_became_peered":"2024-09-10T05:36:11.603972+0000","last_unstale":"2024-09-10T05:40:16.733078+0000","last_undegraded":"2024-09-10T05:40:16.733078+0000","last_fullsized":"2024-09-10T05:40:16.733078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-10T05:40:16.732725+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-10T05:40:16.732725+0000","last_clean_scrub_stamp":"2024-09-10T05:40:16.732725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:45:48.371841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:27.383592+0000","last_change":"2024-09-10T05:40:27.383465+0000","last_active":"2024-09-10T05:40:27.383592+0000","last_peered":"2024-09-10T05:40:27.383592+0000","last_clean":"2024-09-10T05:40:27.383592+0000","last_became_active":"2024-09-10T05:36:11.595183+0000","last_became_peered":"2024-09-10T05:36:11.595183+0000","last_unstale":"2024-09-10T05:40:27.383592+0000","last_undegraded":"2024-09-10T05:40:27.383592+0000","last_fullsized":"2024-09-10T05:40:27.383592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:27.383240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:27.383240+0000","last_clean_scrub_stamp":"2024-09-10T05:40:27.383240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:00:27.997849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"34'8","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:27.569896+0000","last_change":"2024-09-10T05:40:27.569593+0000","last_active":"2024-09-10T05:40:27.569896+0000","last_peered":"2024-09-10T05:40:27.569896+0000","last_clean":"2024-09-10T05:40:27.569896+0000","last_became_active":"2024-09-10T05:36:13.622559+0000","last_became_peered":"2024-09-10T05:36:13.622559+0000","last_unstale":"2024-09-10T05:40:27.569896+0000","last_undegraded":"2024-09-10T05:40:27.569896+0000","last_fullsized":"2024-09-10T05:40:27.569896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-10T05:40:27.569380+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-10T05:40:27.569380+0000","last_clean_scrub_stamp":"2024-09-10T05:40:27.569380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:24:04.016693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"34'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:15.048986+0000","last_change":"2024-09-10T05:40:15.048760+0000","last_active":"2024-09-10T05:40:15.048986+0000","last_peered":"2024-09-10T05:40:15.048986+0000","last_clean":"2024-09-10T05:40:15.048986+0000","last_became_active":"2024-09-10T05:36:11.588124+0000","last_became_peered":"2024-09-10T05:36:11.588124+0000","last_unstale":"2024-09-10T05:40:15.048986+0000","last_undegraded":"2024-09-10T05:40:15.048986+0000","last_fullsized":"2024-09-10T05:40:15.048986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:15.048548+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:15.048548+0000","last_clean_scrub_stamp":"2024-09-10T05:40:15.048548+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:29:26.086020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"34'20","reported_seq":102,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:35.210765+0000","last_change":"2024-09-10T05:40:35.210598+0000","last_active":"2024-09-10T05:40:35.210765+0000","last_peered":"2024-09-10T05:40:35.210765+0000","last_clean":"2024-09-10T05:40:35.210765+0000","last_became_active":"2024-09-10T05:36:13.614959+0000","last_became_peered":"2024-09-10T05:36:13.614959+0000","last_unstale":"2024-09-10T05:40:35.210765+0000","last_undegraded":"2024-09-10T05:40:35.210765+0000","last_fullsized":"2024-09-10T05:40:35.210765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'20","last_scrub_stamp":"2024-09-10T05:40:35.210385+0000","last_deep_scrub":"34'20","last_deep_scrub_stamp":"2024-09-10T05:40:35.210385+0000","last_clean_scrub_stamp":"2024-09-10T05:40:35.210385+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:28:52.615497+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":56,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":692,"num_read_kb":660,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2284,"ondisk_log_size":2284,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1888,"num_read_kb":1653,"num_write":789,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1784,"ondisk_log_size":1784,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1683,"num_read_kb":1573,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":639872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640320,"num_pgs":142,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44096,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327744,"statfs":{"total":96636764160,"available":96591609856,"internally_reserved":0,"allocated":442368,"data_stored":149023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":44693959},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673025,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40476,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331364,"statfs":{"total":96636764160,"available":96595316736,"internally_reserved":0,"allocated":995328,"data_stored":736555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673026,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40536,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331304,"statfs":{"total":96636764160,"available":96595255296,"internally_reserved":0,"allocated":1056768,"data_stored":738594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949673025,"num_pgs":143,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":487424,"data_stored":149680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":2712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":1788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T05:41:04.884 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:41:04.884 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:41:04.884 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:41:04.884 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:41:04.885 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:41:04.885 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:41:04.885 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:41:04.885 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:41:04.886 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:41:04.886 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:41:04.886 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:41:04.886 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:41:04.886 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:41:04.887 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:41:04.887 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:41:04.887 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:41:04.888 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:41:04.888 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:41:04.888 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:41:04.888 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:41:04.889 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:41:04.889 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:41:04.889 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:41:04.889 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:41:04.889 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:41:04.890 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:41:04.890 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:41:04.890 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:41:04.890 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:41:04.890 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:41:04.890 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-10T05:36:18.610103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:41:04.890 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:41:04.891 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-10T05:36:20.626670+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=36, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=40, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:41:04.891 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-10T05:41:24.893 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T05:41:25.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.024+0000 7f7d5036c640 1 Processor -- start 2024-09-10T05:41:25.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.024+0000 7f7d5036c640 1 -- start start 2024-09-10T05:41:25.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.024+0000 7f7d5036c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7d48110da0 0x7f7d48111180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:41:25.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.024+0000 7f7d5036c640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d48073a90 con 0x7f7d481116c0 2024-09-10T05:41:25.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.024+0000 7f7d5036c640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f7d480696e0 con 0x7f7d48110da0 2024-09-10T05:41:25.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.024+0000 7f7d4e108640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7d48110da0 0x7f7d48111180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:41:25.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.024+0000 7f7d4d907640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f7d481116c0 0x7f7d481231e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44636/0 (socket says 172.21.15.2:44636) 2024-09-10T05:41:25.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.024+0000 7f7d4d907640 1 -- 172.21.15.2:0/1074435492 learned_addr learned my addr 172.21.15.2:0/1074435492 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T05:41:25.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.024+0000 7f7d4d106640 1 -- 172.21.15.2:0/1074435492 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1607945666 0 0) 0x7f7d48073a90 con 0x7f7d481116c0 2024-09-10T05:41:25.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.024+0000 7f7d4d106640 1 -- 172.21.15.2:0/1074435492 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d34003530 con 0x7f7d481116c0 2024-09-10T05:41:25.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.024+0000 7f7d4e108640 1 -- 172.21.15.2:0/1074435492 >> v1:172.21.15.2:6789/0 conn(0x7f7d481116c0 legacy=0x7f7d481231e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:41:25.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.024+0000 7f7d4e108640 1 -- 172.21.15.2:0/1074435492 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d4806dd50 con 0x7f7d48110da0 2024-09-10T05:41:25.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.024+0000 7f7d4e108640 1 --2- 172.21.15.2:0/1074435492 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d48110da0 0x7f7d48111180 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f7d44009740 tx=0x7f7d4401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b42c713d52cdfa48 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:41:25.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.024+0000 7f7d4d106640 1 -- 172.21.15.2:0/1074435492 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d440b0070 con 0x7f7d48110da0 2024-09-10T05:41:25.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.028+0000 7f7d4d106640 1 -- 172.21.15.2:0/1074435492 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d440ab530 con 0x7f7d48110da0 2024-09-10T05:41:25.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.028+0000 7f7d4d106640 1 -- 172.21.15.2:0/1074435492 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d440ab830 con 0x7f7d48110da0 2024-09-10T05:41:25.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.028+0000 7f7d5036c640 1 -- 172.21.15.2:0/1074435492 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d48110da0 msgr2=0x7f7d48111180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:41:25.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.028+0000 7f7d5036c640 1 --2- 172.21.15.2:0/1074435492 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d48110da0 0x7f7d48111180 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f7d44009740 tx=0x7f7d4401c370 comp rx=0 tx=0).stop 2024-09-10T05:41:25.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.028+0000 7f7d5036c640 1 -- 172.21.15.2:0/1074435492 shutdown_connections 2024-09-10T05:41:25.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.028+0000 7f7d5036c640 1 --2- 172.21.15.2:0/1074435492 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d48110da0 0x7f7d48111180 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:41:25.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.028+0000 7f7d5036c640 1 -- 172.21.15.2:0/1074435492 >> 172.21.15.2:0/1074435492 conn(0x7f7d48070900 msgr2=0x7f7d48072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:41:25.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.028+0000 7f7d5036c640 1 -- 172.21.15.2:0/1074435492 shutdown_connections 2024-09-10T05:41:25.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.028+0000 7f7d5036c640 1 -- 172.21.15.2:0/1074435492 wait complete. 2024-09-10T05:41:25.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.028+0000 7f7d5036c640 1 Processor -- start 2024-09-10T05:41:25.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.028+0000 7f7d5036c640 1 -- start start 2024-09-10T05:41:25.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.028+0000 7f7d5036c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d48110da0 0x7f7d481226b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:41:25.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.028+0000 7f7d5036c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7d48135470 con 0x7f7d48110da0 2024-09-10T05:41:25.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.028+0000 7f7d4e108640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d48110da0 0x7f7d481226b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:41:25.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.028+0000 7f7d4e108640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d48110da0 0x7f7d481226b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60598/0 (socket says 172.21.15.2:60598) 2024-09-10T05:41:25.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.028+0000 7f7d4e108640 1 -- 172.21.15.2:0/1190534504 learned_addr learned my addr 172.21.15.2:0/1190534504 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:41:25.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.028+0000 7f7d4e108640 1 -- 172.21.15.2:0/1190534504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d48114600 con 0x7f7d48110da0 2024-09-10T05:41:25.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.028+0000 7f7d4e108640 1 --2- 172.21.15.2:0/1190534504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d48110da0 0x7f7d481226b0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f7d440ae040 tx=0x7f7d44019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:41:25.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.028+0000 7f7d3effd640 1 -- 172.21.15.2:0/1190534504 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d440b8020 con 0x7f7d48110da0 2024-09-10T05:41:25.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.028+0000 7f7d3effd640 1 -- 172.21.15.2:0/1190534504 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d440b4410 con 0x7f7d48110da0 2024-09-10T05:41:25.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.028+0000 7f7d3effd640 1 -- 172.21.15.2:0/1190534504 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d440b0040 con 0x7f7d48110da0 2024-09-10T05:41:25.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.028+0000 7f7d5036c640 1 -- 172.21.15.2:0/1190534504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d48130b00 con 0x7f7d48110da0 2024-09-10T05:41:25.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.028+0000 7f7d5036c640 1 -- 172.21.15.2:0/1190534504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d48122dc0 con 0x7f7d48110da0 2024-09-10T05:41:25.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.028+0000 7f7d5036c640 1 -- 172.21.15.2:0/1190534504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d48111180 con 0x7f7d48110da0 2024-09-10T05:41:25.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.032+0000 7f7d3effd640 1 -- 172.21.15.2:0/1190534504 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f7d440bb020 con 0x7f7d48110da0 2024-09-10T05:41:25.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.032+0000 7f7d3effd640 1 --2- 172.21.15.2:0/1190534504 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7d2c03b1d0 0x7f7d2c03d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:41:25.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.032+0000 7f7d3effd640 1 -- 172.21.15.2:0/1190534504 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7f7d440e9390 con 0x7f7d48110da0 2024-09-10T05:41:25.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.032+0000 7f7d4d907640 1 --2- 172.21.15.2:0/1190534504 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7d2c03b1d0 0x7f7d2c03d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:41:25.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.032+0000 7f7d4d907640 1 --2- 172.21.15.2:0/1190534504 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7d2c03b1d0 0x7f7d2c03d690 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7d38007fd0 tx=0x7f7d38007900 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:41:25.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.036+0000 7f7d3effd640 1 -- 172.21.15.2:0/1190534504 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f7d440c2030 con 0x7f7d48110da0 2024-09-10T05:41:25.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.200+0000 7f7d5036c640 1 -- 172.21.15.2:0/1190534504 --> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7d48130de0 con 0x7f7d2c03b1d0 2024-09-10T05:41:25.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.232+0000 7f7d3effd640 1 -- 172.21.15.2:0/1190534504 <== mgr.4101 v2:172.21.15.62:6824/3663628807 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665970 (secure 0 0 0) 0x7f7d380058c0 con 0x7f7d2c03b1d0 2024-09-10T05:41:25.241 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T05:41:25.247 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-10T05:41:25.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.236+0000 7f7d5036c640 1 -- 172.21.15.2:0/1190534504 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7d2c03b1d0 msgr2=0x7f7d2c03d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:41:25.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.236+0000 7f7d5036c640 1 --2- 172.21.15.2:0/1190534504 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7d2c03b1d0 0x7f7d2c03d690 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7d38007fd0 tx=0x7f7d38007900 comp rx=0 tx=0).stop 2024-09-10T05:41:25.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.236+0000 7f7d5036c640 1 -- 172.21.15.2:0/1190534504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d48110da0 msgr2=0x7f7d481226b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:41:25.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.236+0000 7f7d5036c640 1 --2- 172.21.15.2:0/1190534504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d48110da0 0x7f7d481226b0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f7d440ae040 tx=0x7f7d44019110 comp rx=0 tx=0).stop 2024-09-10T05:41:25.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.236+0000 7f7d5036c640 1 -- 172.21.15.2:0/1190534504 shutdown_connections 2024-09-10T05:41:25.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.236+0000 7f7d5036c640 1 --2- 172.21.15.2:0/1190534504 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f7d2c03b1d0 0x7f7d2c03d690 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:41:25.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.236+0000 7f7d5036c640 1 --2- 172.21.15.2:0/1190534504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d48110da0 0x7f7d481226b0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:41:25.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.236+0000 7f7d5036c640 1 -- 172.21.15.2:0/1190534504 >> 172.21.15.2:0/1190534504 conn(0x7f7d48070900 msgr2=0x7f7d48071cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:41:25.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.236+0000 7f7d5036c640 1 -- 172.21.15.2:0/1190534504 shutdown_connections 2024-09-10T05:41:25.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.236+0000 7f7d5036c640 1 -- 172.21.15.2:0/1190534504 wait complete. 2024-09-10T05:41:25.260 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":194,"stamp":"2024-09-10T05:41:23.739770+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":254,"num_object_clones":0,"num_object_copies":508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":254,"num_whiteouts":0,"num_read":5438,"num_read_kb":4996,"num_write":2315,"num_write_kb":60588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":639982,"num_keys_recovered":1,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3349,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5014,"ondisk_log_size":5014,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":135968,"kb_used_data":2912,"kb_used_omap":6,"kb_used_meta":132985,"kb_avail":377351392,"statfs":{"total":386547056640,"available":386407825408,"internally_reserved":0,"allocated":2981888,"data_stored":1773852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":136177430},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005559"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:26.410446+0000","last_change":"2024-09-10T05:40:26.410446+0000","last_active":"2024-09-10T05:40:26.410446+0000","last_peered":"2024-09-10T05:40:26.410446+0000","last_clean":"2024-09-10T05:40:26.410446+0000","last_became_active":"2024-09-10T05:36:11.605721+0000","last_became_peered":"2024-09-10T05:36:11.605721+0000","last_unstale":"2024-09-10T05:40:26.410446+0000","last_undegraded":"2024-09-10T05:40:26.410446+0000","last_fullsized":"2024-09-10T05:40:26.410446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:26.410267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:26.410267+0000","last_clean_scrub_stamp":"2024-09-10T05:40:26.410267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:28:48.605725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"30'2","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:37.485630+0000","last_change":"2024-09-10T05:40:37.485493+0000","last_active":"2024-09-10T05:40:37.485630+0000","last_peered":"2024-09-10T05:40:37.485630+0000","last_clean":"2024-09-10T05:40:37.485630+0000","last_became_active":"2024-09-10T05:36:13.628174+0000","last_became_peered":"2024-09-10T05:36:13.628174+0000","last_unstale":"2024-09-10T05:40:37.485630+0000","last_undegraded":"2024-09-10T05:40:37.485630+0000","last_fullsized":"2024-09-10T05:40:37.485630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-10T05:40:37.485299+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-10T05:40:37.485299+0000","last_clean_scrub_stamp":"2024-09-10T05:40:37.485299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:00:09.382323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"30'2","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:18.009113+0000","last_change":"2024-09-10T05:40:18.008954+0000","last_active":"2024-09-10T05:40:18.009113+0000","last_peered":"2024-09-10T05:40:18.009113+0000","last_clean":"2024-09-10T05:40:18.009113+0000","last_became_active":"2024-09-10T05:36:11.596100+0000","last_became_peered":"2024-09-10T05:36:11.596100+0000","last_unstale":"2024-09-10T05:40:18.009113+0000","last_undegraded":"2024-09-10T05:40:18.009113+0000","last_fullsized":"2024-09-10T05:40:18.009113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-10T05:40:18.008765+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-10T05:40:18.008765+0000","last_clean_scrub_stamp":"2024-09-10T05:40:18.008765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:04:13.763296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"34'6","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:36.862809+0000","last_change":"2024-09-10T05:40:36.862530+0000","last_active":"2024-09-10T05:40:36.862809+0000","last_peered":"2024-09-10T05:40:36.862809+0000","last_clean":"2024-09-10T05:40:36.862809+0000","last_became_active":"2024-09-10T05:36:13.598320+0000","last_became_peered":"2024-09-10T05:36:13.598320+0000","last_unstale":"2024-09-10T05:40:36.862809+0000","last_undegraded":"2024-09-10T05:40:36.862809+0000","last_fullsized":"2024-09-10T05:40:36.862809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T05:40:36.862311+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T05:40:36.862311+0000","last_clean_scrub_stamp":"2024-09-10T05:40:36.862311+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:10:19.778937+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:19.837151+0000","last_change":"2024-09-10T05:40:19.837024+0000","last_active":"2024-09-10T05:40:19.837151+0000","last_peered":"2024-09-10T05:40:19.837151+0000","last_clean":"2024-09-10T05:40:19.837151+0000","last_became_active":"2024-09-10T05:36:11.603193+0000","last_became_peered":"2024-09-10T05:36:11.603193+0000","last_unstale":"2024-09-10T05:40:19.837151+0000","last_undegraded":"2024-09-10T05:40:19.837151+0000","last_fullsized":"2024-09-10T05:40:19.837151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:19.836770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:19.836770+0000","last_clean_scrub_stamp":"2024-09-10T05:40:19.836770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:58:57.386751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'10","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:38.821980+0000","last_change":"2024-09-10T05:40:38.821797+0000","last_active":"2024-09-10T05:40:38.821980+0000","last_peered":"2024-09-10T05:40:38.821980+0000","last_clean":"2024-09-10T05:40:38.821980+0000","last_became_active":"2024-09-10T05:36:13.604094+0000","last_became_peered":"2024-09-10T05:36:13.604094+0000","last_unstale":"2024-09-10T05:40:38.821980+0000","last_undegraded":"2024-09-10T05:40:38.821980+0000","last_fullsized":"2024-09-10T05:40:38.821980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-10T05:40:38.821572+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-10T05:40:38.821572+0000","last_clean_scrub_stamp":"2024-09-10T05:40:38.821572+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:17:38.193128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:12.538733+0000","last_change":"2024-09-10T05:40:12.538576+0000","last_active":"2024-09-10T05:40:12.538733+0000","last_peered":"2024-09-10T05:40:12.538733+0000","last_clean":"2024-09-10T05:40:12.538733+0000","last_became_active":"2024-09-10T05:36:11.611399+0000","last_became_peered":"2024-09-10T05:36:11.611399+0000","last_unstale":"2024-09-10T05:40:12.538733+0000","last_undegraded":"2024-09-10T05:40:12.538733+0000","last_fullsized":"2024-09-10T05:40:12.538733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:12.538392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:12.538392+0000","last_clean_scrub_stamp":"2024-09-10T05:40:12.538392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:51:29.630049+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'10","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:28.558502+0000","last_change":"2024-09-10T05:40:28.558502+0000","last_active":"2024-09-10T05:40:28.558502+0000","last_peered":"2024-09-10T05:40:28.558502+0000","last_clean":"2024-09-10T05:40:28.558502+0000","last_became_active":"2024-09-10T05:36:52.702713+0000","last_became_peered":"2024-09-10T05:36:52.702713+0000","last_unstale":"2024-09-10T05:40:28.558502+0000","last_undegraded":"2024-09-10T05:40:28.558502+0000","last_fullsized":"2024-09-10T05:40:28.558502+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-10T05:40:28.558256+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-10T05:40:28.558256+0000","last_clean_scrub_stamp":"2024-09-10T05:40:28.558256+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:36:01.615339+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:22.425370+0000","last_change":"2024-09-10T05:40:22.425237+0000","last_active":"2024-09-10T05:40:22.425370+0000","last_peered":"2024-09-10T05:40:22.425370+0000","last_clean":"2024-09-10T05:40:22.425370+0000","last_became_active":"2024-09-10T05:36:11.597514+0000","last_became_peered":"2024-09-10T05:36:11.597514+0000","last_unstale":"2024-09-10T05:40:22.425370+0000","last_undegraded":"2024-09-10T05:40:22.425370+0000","last_fullsized":"2024-09-10T05:40:22.425370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:22.425061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:22.425061+0000","last_clean_scrub_stamp":"2024-09-10T05:40:22.425061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:18:48.780922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"34'12","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:36.250669+0000","last_change":"2024-09-10T05:40:36.250669+0000","last_active":"2024-09-10T05:40:36.250669+0000","last_peered":"2024-09-10T05:40:36.250669+0000","last_clean":"2024-09-10T05:40:36.250669+0000","last_became_active":"2024-09-10T05:36:13.621573+0000","last_became_peered":"2024-09-10T05:36:13.621573+0000","last_unstale":"2024-09-10T05:40:36.250669+0000","last_undegraded":"2024-09-10T05:40:36.250669+0000","last_fullsized":"2024-09-10T05:40:36.250669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-10T05:40:36.250487+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-10T05:40:36.250487+0000","last_clean_scrub_stamp":"2024-09-10T05:40:36.250487+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:44:20.265219+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:30.390665+0000","last_change":"2024-09-10T05:40:30.390534+0000","last_active":"2024-09-10T05:40:30.390665+0000","last_peered":"2024-09-10T05:40:30.390665+0000","last_clean":"2024-09-10T05:40:30.390665+0000","last_became_active":"2024-09-10T05:36:52.704285+0000","last_became_peered":"2024-09-10T05:36:52.704285+0000","last_unstale":"2024-09-10T05:40:30.390665+0000","last_undegraded":"2024-09-10T05:40:30.390665+0000","last_fullsized":"2024-09-10T05:40:30.390665+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:30.390348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:30.390348+0000","last_clean_scrub_stamp":"2024-09-10T05:40:30.390348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:21:07.016828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:41.484929+0000","last_change":"2024-09-10T05:40:41.484929+0000","last_active":"2024-09-10T05:40:41.484929+0000","last_peered":"2024-09-10T05:40:41.484929+0000","last_clean":"2024-09-10T05:40:41.484929+0000","last_became_active":"2024-09-10T05:36:13.612127+0000","last_became_peered":"2024-09-10T05:36:13.612127+0000","last_unstale":"2024-09-10T05:40:41.484929+0000","last_undegraded":"2024-09-10T05:40:41.484929+0000","last_fullsized":"2024-09-10T05:40:41.484929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:41.484740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:41.484740+0000","last_clean_scrub_stamp":"2024-09-10T05:40:41.484740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:17:33.369812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:18.795661+0000","last_change":"2024-09-10T05:40:18.795525+0000","last_active":"2024-09-10T05:40:18.795661+0000","last_peered":"2024-09-10T05:40:18.795661+0000","last_clean":"2024-09-10T05:40:18.795661+0000","last_became_active":"2024-09-10T05:36:11.598054+0000","last_became_peered":"2024-09-10T05:36:11.598054+0000","last_unstale":"2024-09-10T05:40:18.795661+0000","last_undegraded":"2024-09-10T05:40:18.795661+0000","last_fullsized":"2024-09-10T05:40:18.795661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:18.795346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:18.795346+0000","last_clean_scrub_stamp":"2024-09-10T05:40:18.795346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:40:32.792167+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'8","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:39.470635+0000","last_change":"2024-09-10T05:40:39.470635+0000","last_active":"2024-09-10T05:40:39.470635+0000","last_peered":"2024-09-10T05:40:39.470635+0000","last_clean":"2024-09-10T05:40:39.470635+0000","last_became_active":"2024-09-10T05:36:13.612743+0000","last_became_peered":"2024-09-10T05:36:13.612743+0000","last_unstale":"2024-09-10T05:40:39.470635+0000","last_undegraded":"2024-09-10T05:40:39.470635+0000","last_fullsized":"2024-09-10T05:40:39.470635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T05:40:39.470439+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T05:40:39.470439+0000","last_clean_scrub_stamp":"2024-09-10T05:40:39.470439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:04.935597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:20.857035+0000","last_change":"2024-09-10T05:40:20.856875+0000","last_active":"2024-09-10T05:40:20.857035+0000","last_peered":"2024-09-10T05:40:20.857035+0000","last_clean":"2024-09-10T05:40:20.857035+0000","last_became_active":"2024-09-10T05:36:11.593454+0000","last_became_peered":"2024-09-10T05:36:11.593454+0000","last_unstale":"2024-09-10T05:40:20.857035+0000","last_undegraded":"2024-09-10T05:40:20.857035+0000","last_fullsized":"2024-09-10T05:40:20.857035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:20.856670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:20.856670+0000","last_clean_scrub_stamp":"2024-09-10T05:40:20.856670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:07:34.824817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"34'10","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:29.569735+0000","last_change":"2024-09-10T05:40:29.569735+0000","last_active":"2024-09-10T05:40:29.569735+0000","last_peered":"2024-09-10T05:40:29.569735+0000","last_clean":"2024-09-10T05:40:29.569735+0000","last_became_active":"2024-09-10T05:36:13.621362+0000","last_became_peered":"2024-09-10T05:36:13.621362+0000","last_unstale":"2024-09-10T05:40:29.569735+0000","last_undegraded":"2024-09-10T05:40:29.569735+0000","last_fullsized":"2024-09-10T05:40:29.569735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-10T05:40:29.569463+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-10T05:40:29.569463+0000","last_clean_scrub_stamp":"2024-09-10T05:40:29.569463+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:43.066506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:35.454956+0000","last_change":"2024-09-10T05:40:35.454824+0000","last_active":"2024-09-10T05:40:35.454956+0000","last_peered":"2024-09-10T05:40:35.454956+0000","last_clean":"2024-09-10T05:40:35.454956+0000","last_became_active":"2024-09-10T05:36:13.628203+0000","last_became_peered":"2024-09-10T05:36:13.628203+0000","last_unstale":"2024-09-10T05:40:35.454956+0000","last_undegraded":"2024-09-10T05:40:35.454956+0000","last_fullsized":"2024-09-10T05:40:35.454956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:35.454640+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:35.454640+0000","last_clean_scrub_stamp":"2024-09-10T05:40:35.454640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:03:22.203757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"30'2","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:19.051004+0000","last_change":"2024-09-10T05:40:19.050830+0000","last_active":"2024-09-10T05:40:19.051004+0000","last_peered":"2024-09-10T05:40:19.051004+0000","last_clean":"2024-09-10T05:40:19.051004+0000","last_became_active":"2024-09-10T05:36:11.594409+0000","last_became_peered":"2024-09-10T05:36:11.594409+0000","last_unstale":"2024-09-10T05:40:19.051004+0000","last_undegraded":"2024-09-10T05:40:19.051004+0000","last_fullsized":"2024-09-10T05:40:19.051004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-10T05:40:19.050639+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-10T05:40:19.050639+0000","last_clean_scrub_stamp":"2024-09-10T05:40:19.050639+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:00:35.050660+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'8","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:36.503143+0000","last_change":"2024-09-10T05:40:36.503001+0000","last_active":"2024-09-10T05:40:36.503143+0000","last_peered":"2024-09-10T05:40:36.503143+0000","last_clean":"2024-09-10T05:40:36.503143+0000","last_became_active":"2024-09-10T05:36:13.619905+0000","last_became_peered":"2024-09-10T05:36:13.619905+0000","last_unstale":"2024-09-10T05:40:36.503143+0000","last_undegraded":"2024-09-10T05:40:36.503143+0000","last_fullsized":"2024-09-10T05:40:36.503143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-10T05:40:36.502829+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-10T05:40:36.502829+0000","last_clean_scrub_stamp":"2024-09-10T05:40:36.502829+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:50:18.078007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:13.522876+0000","last_change":"2024-09-10T05:40:13.522641+0000","last_active":"2024-09-10T05:40:13.522876+0000","last_peered":"2024-09-10T05:40:13.522876+0000","last_clean":"2024-09-10T05:40:13.522876+0000","last_became_active":"2024-09-10T05:36:11.611735+0000","last_became_peered":"2024-09-10T05:36:11.611735+0000","last_unstale":"2024-09-10T05:40:13.522876+0000","last_undegraded":"2024-09-10T05:40:13.522876+0000","last_fullsized":"2024-09-10T05:40:13.522876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:13.522433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:13.522433+0000","last_clean_scrub_stamp":"2024-09-10T05:40:13.522433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:18:33.845607+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'18","reported_seq":106,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:40.447388+0000","last_change":"2024-09-10T05:40:40.447249+0000","last_active":"2024-09-10T05:40:40.447388+0000","last_peered":"2024-09-10T05:40:40.447388+0000","last_clean":"2024-09-10T05:40:40.447388+0000","last_became_active":"2024-09-10T05:36:13.624358+0000","last_became_peered":"2024-09-10T05:36:13.624358+0000","last_unstale":"2024-09-10T05:40:40.447388+0000","last_undegraded":"2024-09-10T05:40:40.447388+0000","last_fullsized":"2024-09-10T05:40:40.447388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'18","last_scrub_stamp":"2024-09-10T05:40:40.447075+0000","last_deep_scrub":"34'18","last_deep_scrub_stamp":"2024-09-10T05:40:40.447075+0000","last_clean_scrub_stamp":"2024-09-10T05:40:40.447075+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:55:33.861501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":77,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"34'4","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:18.464650+0000","last_change":"2024-09-10T05:40:18.464461+0000","last_active":"2024-09-10T05:40:18.464650+0000","last_peered":"2024-09-10T05:40:18.464650+0000","last_clean":"2024-09-10T05:40:18.464650+0000","last_became_active":"2024-09-10T05:36:11.608244+0000","last_became_peered":"2024-09-10T05:36:11.608244+0000","last_unstale":"2024-09-10T05:40:18.464650+0000","last_undegraded":"2024-09-10T05:40:18.464650+0000","last_fullsized":"2024-09-10T05:40:18.464650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:18.464272+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:18.464272+0000","last_clean_scrub_stamp":"2024-09-10T05:40:18.464272+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:52:02.384371+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"32'24","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:24.517863+0000","last_change":"2024-09-10T05:40:24.517664+0000","last_active":"2024-09-10T05:40:24.517863+0000","last_peered":"2024-09-10T05:40:24.517863+0000","last_clean":"2024-09-10T05:40:24.517863+0000","last_became_active":"2024-09-10T05:36:13.613298+0000","last_became_peered":"2024-09-10T05:36:13.613298+0000","last_unstale":"2024-09-10T05:40:24.517863+0000","last_undegraded":"2024-09-10T05:40:24.517863+0000","last_fullsized":"2024-09-10T05:40:24.517863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'24","last_scrub_stamp":"2024-09-10T05:40:24.517467+0000","last_deep_scrub":"32'24","last_deep_scrub_stamp":"2024-09-10T05:40:24.517467+0000","last_clean_scrub_stamp":"2024-09-10T05:40:24.517467+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:57.476190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":77,"num_write":32,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"32'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:20.433898+0000","last_change":"2024-09-10T05:40:20.433725+0000","last_active":"2024-09-10T05:40:20.433898+0000","last_peered":"2024-09-10T05:40:20.433898+0000","last_clean":"2024-09-10T05:40:20.433898+0000","last_became_active":"2024-09-10T05:36:11.600159+0000","last_became_peered":"2024-09-10T05:36:11.600159+0000","last_unstale":"2024-09-10T05:40:20.433898+0000","last_undegraded":"2024-09-10T05:40:20.433898+0000","last_fullsized":"2024-09-10T05:40:20.433898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T05:40:20.433528+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T05:40:20.433528+0000","last_clean_scrub_stamp":"2024-09-10T05:40:20.433528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:07:04.481328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"34'12","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:25.520204+0000","last_change":"2024-09-10T05:40:25.520043+0000","last_active":"2024-09-10T05:40:25.520204+0000","last_peered":"2024-09-10T05:40:25.520204+0000","last_clean":"2024-09-10T05:40:25.520204+0000","last_became_active":"2024-09-10T05:36:13.605913+0000","last_became_peered":"2024-09-10T05:36:13.605913+0000","last_unstale":"2024-09-10T05:40:25.520204+0000","last_undegraded":"2024-09-10T05:40:25.520204+0000","last_fullsized":"2024-09-10T05:40:25.520204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-10T05:40:25.519838+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-10T05:40:25.519838+0000","last_clean_scrub_stamp":"2024-09-10T05:40:25.519838+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:25:15.570219+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:10.535482+0000","last_change":"2024-09-10T05:40:10.535482+0000","last_active":"2024-09-10T05:40:10.535482+0000","last_peered":"2024-09-10T05:40:10.535482+0000","last_clean":"2024-09-10T05:40:10.535482+0000","last_became_active":"2024-09-10T05:36:52.701277+0000","last_became_peered":"2024-09-10T05:36:52.701277+0000","last_unstale":"2024-09-10T05:40:10.535482+0000","last_undegraded":"2024-09-10T05:40:10.535482+0000","last_fullsized":"2024-09-10T05:40:10.535482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:10.535301+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:10.535301+0000","last_clean_scrub_stamp":"2024-09-10T05:40:10.535301+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:04:14.281405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":1250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":639872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:34.183372+0000","last_change":"2024-09-10T05:40:34.183121+0000","last_active":"2024-09-10T05:40:34.183372+0000","last_peered":"2024-09-10T05:40:34.183372+0000","last_clean":"2024-09-10T05:40:34.183372+0000","last_became_active":"2024-09-10T05:36:13.599955+0000","last_became_peered":"2024-09-10T05:36:13.599955+0000","last_unstale":"2024-09-10T05:40:34.183372+0000","last_undegraded":"2024-09-10T05:40:34.183372+0000","last_fullsized":"2024-09-10T05:40:34.183372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:34.182915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:34.182915+0000","last_clean_scrub_stamp":"2024-09-10T05:40:34.182915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:14:10.458122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"34'2","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:25.836610+0000","last_change":"2024-09-10T05:40:25.836463+0000","last_active":"2024-09-10T05:40:25.836610+0000","last_peered":"2024-09-10T05:40:25.836610+0000","last_clean":"2024-09-10T05:40:25.836610+0000","last_became_active":"2024-09-10T05:36:11.603982+0000","last_became_peered":"2024-09-10T05:36:11.603982+0000","last_unstale":"2024-09-10T05:40:25.836610+0000","last_undegraded":"2024-09-10T05:40:25.836610+0000","last_fullsized":"2024-09-10T05:40:25.836610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:25.836286+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:25.836286+0000","last_clean_scrub_stamp":"2024-09-10T05:40:25.836286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:57:32.240826+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'36","reported_seq":114,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:41:08.189530+0000","last_change":"2024-09-10T05:41:08.189379+0000","last_active":"2024-09-10T05:41:08.189530+0000","last_peered":"2024-09-10T05:41:08.189530+0000","last_clean":"2024-09-10T05:41:08.189530+0000","last_became_active":"2024-09-10T05:36:21.672975+0000","last_became_peered":"2024-09-10T05:36:21.672975+0000","last_unstale":"2024-09-10T05:41:08.189530+0000","last_undegraded":"2024-09-10T05:41:08.189530+0000","last_fullsized":"2024-09-10T05:41:08.189530+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-09-10T05:41:08.189181+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-09-10T05:41:08.189181+0000","last_clean_scrub_stamp":"2024-09-10T05:41:08.189181+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:02.018465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'10","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:24.858208+0000","last_change":"2024-09-10T05:40:24.858068+0000","last_active":"2024-09-10T05:40:24.858208+0000","last_peered":"2024-09-10T05:40:24.858208+0000","last_clean":"2024-09-10T05:40:24.858208+0000","last_became_active":"2024-09-10T05:36:13.616006+0000","last_became_peered":"2024-09-10T05:36:13.616006+0000","last_unstale":"2024-09-10T05:40:24.858208+0000","last_undegraded":"2024-09-10T05:40:24.858208+0000","last_fullsized":"2024-09-10T05:40:24.858208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-10T05:40:24.857896+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-10T05:40:24.857896+0000","last_clean_scrub_stamp":"2024-09-10T05:40:24.857896+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:05:44.490607+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:11.764615+0000","last_change":"2024-09-10T05:40:11.764472+0000","last_active":"2024-09-10T05:40:11.764615+0000","last_peered":"2024-09-10T05:40:11.764615+0000","last_clean":"2024-09-10T05:40:11.764615+0000","last_became_active":"2024-09-10T05:36:11.601101+0000","last_became_peered":"2024-09-10T05:36:11.601101+0000","last_unstale":"2024-09-10T05:40:11.764615+0000","last_undegraded":"2024-09-10T05:40:11.764615+0000","last_fullsized":"2024-09-10T05:40:11.764615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:11.764291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:11.764291+0000","last_clean_scrub_stamp":"2024-09-10T05:40:11.764291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:10:57.529948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:44.925822+0000","last_change":"2024-09-10T05:40:44.925654+0000","last_active":"2024-09-10T05:40:44.925822+0000","last_peered":"2024-09-10T05:40:44.925822+0000","last_clean":"2024-09-10T05:40:44.925822+0000","last_became_active":"2024-09-10T05:36:15.626172+0000","last_became_peered":"2024-09-10T05:36:15.626172+0000","last_unstale":"2024-09-10T05:40:44.925822+0000","last_undegraded":"2024-09-10T05:40:44.925822+0000","last_fullsized":"2024-09-10T05:40:44.925822+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:44.925471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:44.925471+0000","last_clean_scrub_stamp":"2024-09-10T05:40:44.925471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:02:08.889223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'51","reported_seq":123,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:54.894043+0000","last_change":"2024-09-10T05:40:54.893901+0000","last_active":"2024-09-10T05:40:54.894043+0000","last_peered":"2024-09-10T05:40:54.894043+0000","last_clean":"2024-09-10T05:40:54.894043+0000","last_became_active":"2024-09-10T05:36:17.639318+0000","last_became_peered":"2024-09-10T05:36:17.639318+0000","last_unstale":"2024-09-10T05:40:54.894043+0000","last_undegraded":"2024-09-10T05:40:54.894043+0000","last_fullsized":"2024-09-10T05:40:54.894043+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'51","last_scrub_stamp":"2024-09-10T05:40:54.893657+0000","last_deep_scrub":"34'51","last_deep_scrub_stamp":"2024-09-10T05:40:54.893657+0000","last_clean_scrub_stamp":"2024-09-10T05:40:54.893657+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:49:25.809577+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:41:08.241916+0000","last_change":"2024-09-10T05:41:08.241761+0000","last_active":"2024-09-10T05:41:08.241916+0000","last_peered":"2024-09-10T05:41:08.241916+0000","last_clean":"2024-09-10T05:41:08.241916+0000","last_became_active":"2024-09-10T05:36:19.647998+0000","last_became_peered":"2024-09-10T05:36:19.647998+0000","last_unstale":"2024-09-10T05:41:08.241916+0000","last_undegraded":"2024-09-10T05:41:08.241916+0000","last_fullsized":"2024-09-10T05:41:08.241916+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:41:08.241579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:41:08.241579+0000","last_clean_scrub_stamp":"2024-09-10T05:41:08.241579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:19.829817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"32'9","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:41:16.183126+0000","last_change":"2024-09-10T05:41:16.183126+0000","last_active":"2024-09-10T05:41:16.183126+0000","last_peered":"2024-09-10T05:41:16.183126+0000","last_clean":"2024-09-10T05:41:16.183126+0000","last_became_active":"2024-09-10T05:36:21.672757+0000","last_became_peered":"2024-09-10T05:36:21.672757+0000","last_unstale":"2024-09-10T05:41:16.183126+0000","last_undegraded":"2024-09-10T05:41:16.183126+0000","last_fullsized":"2024-09-10T05:41:16.183126+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-09-10T05:41:16.182942+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-09-10T05:41:16.182942+0000","last_clean_scrub_stamp":"2024-09-10T05:41:16.182942+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:14:36.194971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"32'6","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:30.812303+0000","last_change":"2024-09-10T05:40:30.812041+0000","last_active":"2024-09-10T05:40:30.812303+0000","last_peered":"2024-09-10T05:40:30.812303+0000","last_clean":"2024-09-10T05:40:30.812303+0000","last_became_active":"2024-09-10T05:36:13.597649+0000","last_became_peered":"2024-09-10T05:36:13.597649+0000","last_unstale":"2024-09-10T05:40:30.812303+0000","last_undegraded":"2024-09-10T05:40:30.812303+0000","last_fullsized":"2024-09-10T05:40:30.812303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-10T05:40:30.811823+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-10T05:40:30.811823+0000","last_clean_scrub_stamp":"2024-09-10T05:40:30.811823+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:34:06.593714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:03.521134+0000","last_change":"2024-09-10T05:40:03.520977+0000","last_active":"2024-09-10T05:40:03.521134+0000","last_peered":"2024-09-10T05:40:03.521134+0000","last_clean":"2024-09-10T05:40:03.521134+0000","last_became_active":"2024-09-10T05:36:11.611326+0000","last_became_peered":"2024-09-10T05:36:11.611326+0000","last_unstale":"2024-09-10T05:40:03.521134+0000","last_undegraded":"2024-09-10T05:40:03.521134+0000","last_fullsized":"2024-09-10T05:40:03.521134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:03.520795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:03.520795+0000","last_clean_scrub_stamp":"2024-09-10T05:40:03.520795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:12:23.788294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:43.901999+0000","last_change":"2024-09-10T05:40:43.901867+0000","last_active":"2024-09-10T05:40:43.901999+0000","last_peered":"2024-09-10T05:40:43.901999+0000","last_clean":"2024-09-10T05:40:43.901999+0000","last_became_active":"2024-09-10T05:36:15.607918+0000","last_became_peered":"2024-09-10T05:36:15.607918+0000","last_unstale":"2024-09-10T05:40:43.901999+0000","last_undegraded":"2024-09-10T05:40:43.901999+0000","last_fullsized":"2024-09-10T05:40:43.901999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:43.901620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:43.901620+0000","last_clean_scrub_stamp":"2024-09-10T05:40:43.901620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:07:10.194917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"34'16","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:51.051436+0000","last_change":"2024-09-10T05:40:51.051260+0000","last_active":"2024-09-10T05:40:51.051436+0000","last_peered":"2024-09-10T05:40:51.051436+0000","last_clean":"2024-09-10T05:40:51.051436+0000","last_became_active":"2024-09-10T05:36:17.643856+0000","last_became_peered":"2024-09-10T05:36:17.643856+0000","last_unstale":"2024-09-10T05:40:51.051436+0000","last_undegraded":"2024-09-10T05:40:51.051436+0000","last_fullsized":"2024-09-10T05:40:51.051436+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-10T05:40:51.051071+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-10T05:40:51.051071+0000","last_clean_scrub_stamp":"2024-09-10T05:40:51.051071+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:18:30.814962+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:41:04.194622+0000","last_change":"2024-09-10T05:41:04.194478+0000","last_active":"2024-09-10T05:41:04.194622+0000","last_peered":"2024-09-10T05:41:04.194622+0000","last_clean":"2024-09-10T05:41:04.194622+0000","last_became_active":"2024-09-10T05:36:19.647612+0000","last_became_peered":"2024-09-10T05:36:19.647612+0000","last_unstale":"2024-09-10T05:41:04.194622+0000","last_undegraded":"2024-09-10T05:41:04.194622+0000","last_fullsized":"2024-09-10T05:41:04.194622+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:41:04.194294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:41:04.194294+0000","last_clean_scrub_stamp":"2024-09-10T05:41:04.194294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:26:33.954776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"34'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:41:13.961863+0000","last_change":"2024-09-10T05:41:13.961701+0000","last_active":"2024-09-10T05:41:13.961863+0000","last_peered":"2024-09-10T05:41:13.961863+0000","last_clean":"2024-09-10T05:41:13.961863+0000","last_became_active":"2024-09-10T05:36:21.679052+0000","last_became_peered":"2024-09-10T05:36:21.679052+0000","last_unstale":"2024-09-10T05:41:13.961863+0000","last_undegraded":"2024-09-10T05:41:13.961863+0000","last_fullsized":"2024-09-10T05:41:13.961863+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-10T05:41:13.961516+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-10T05:41:13.961516+0000","last_clean_scrub_stamp":"2024-09-10T05:41:13.961516+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:24.751050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:27.820103+0000","last_change":"2024-09-10T05:40:27.819874+0000","last_active":"2024-09-10T05:40:27.820103+0000","last_peered":"2024-09-10T05:40:27.820103+0000","last_clean":"2024-09-10T05:40:27.820103+0000","last_became_active":"2024-09-10T05:36:13.611935+0000","last_became_peered":"2024-09-10T05:36:13.611935+0000","last_unstale":"2024-09-10T05:40:27.820103+0000","last_undegraded":"2024-09-10T05:40:27.820103+0000","last_fullsized":"2024-09-10T05:40:27.820103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:27.819678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:27.819678+0000","last_clean_scrub_stamp":"2024-09-10T05:40:27.819678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:58:08.522577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:13.353307+0000","last_change":"2024-09-10T05:40:13.353164+0000","last_active":"2024-09-10T05:40:13.353307+0000","last_peered":"2024-09-10T05:40:13.353307+0000","last_clean":"2024-09-10T05:40:13.353307+0000","last_became_active":"2024-09-10T05:36:11.596047+0000","last_became_peered":"2024-09-10T05:36:11.596047+0000","last_unstale":"2024-09-10T05:40:13.353307+0000","last_undegraded":"2024-09-10T05:40:13.353307+0000","last_fullsized":"2024-09-10T05:40:13.353307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:13.352981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:13.352981+0000","last_clean_scrub_stamp":"2024-09-10T05:40:13.352981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:20.013639+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:45.961091+0000","last_change":"2024-09-10T05:40:45.960970+0000","last_active":"2024-09-10T05:40:45.961091+0000","last_peered":"2024-09-10T05:40:45.961091+0000","last_clean":"2024-09-10T05:40:45.961091+0000","last_became_active":"2024-09-10T05:36:15.635534+0000","last_became_peered":"2024-09-10T05:36:15.635534+0000","last_unstale":"2024-09-10T05:40:45.961091+0000","last_undegraded":"2024-09-10T05:40:45.961091+0000","last_fullsized":"2024-09-10T05:40:45.961091+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:45.960788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:45.960788+0000","last_clean_scrub_stamp":"2024-09-10T05:40:45.960788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:06:22.011394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"34'30","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:38.546679+0000","last_change":"2024-09-10T05:40:38.546544+0000","last_active":"2024-09-10T05:40:38.546679+0000","last_peered":"2024-09-10T05:40:38.546679+0000","last_clean":"2024-09-10T05:40:38.546679+0000","last_became_active":"2024-09-10T05:36:17.626936+0000","last_became_peered":"2024-09-10T05:36:17.626936+0000","last_unstale":"2024-09-10T05:40:38.546679+0000","last_undegraded":"2024-09-10T05:40:38.546679+0000","last_fullsized":"2024-09-10T05:40:38.546679+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'30","last_scrub_stamp":"2024-09-10T05:40:38.546347+0000","last_deep_scrub":"34'30","last_deep_scrub_stamp":"2024-09-10T05:40:38.546347+0000","last_clean_scrub_stamp":"2024-09-10T05:40:38.546347+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:58.791838+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'286","reported_seq":404,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:41:06.193091+0000","last_change":"2024-09-10T05:41:06.192947+0000","last_active":"2024-09-10T05:41:06.193091+0000","last_peered":"2024-09-10T05:41:06.193091+0000","last_clean":"2024-09-10T05:41:06.193091+0000","last_became_active":"2024-09-10T05:36:19.664741+0000","last_became_peered":"2024-09-10T05:36:19.664741+0000","last_unstale":"2024-09-10T05:41:06.193091+0000","last_undegraded":"2024-09-10T05:41:06.193091+0000","last_fullsized":"2024-09-10T05:41:06.193091+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-10T05:41:06.192766+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-10T05:41:06.192766+0000","last_clean_scrub_stamp":"2024-09-10T05:41:06.192766+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:56:05.412811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"34'2","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:51.581066+0000","last_change":"2024-09-10T05:40:51.580891+0000","last_active":"2024-09-10T05:40:51.581066+0000","last_peered":"2024-09-10T05:40:51.581066+0000","last_clean":"2024-09-10T05:40:51.581066+0000","last_became_active":"2024-09-10T05:36:21.656522+0000","last_became_peered":"2024-09-10T05:36:21.656522+0000","last_unstale":"2024-09-10T05:40:51.581066+0000","last_undegraded":"2024-09-10T05:40:51.581066+0000","last_fullsized":"2024-09-10T05:40:51.581066+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:51.580717+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:51.580717+0000","last_clean_scrub_stamp":"2024-09-10T05:40:51.580717+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:43:05.177184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'8","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:29.796808+0000","last_change":"2024-09-10T05:40:29.796565+0000","last_active":"2024-09-10T05:40:29.796808+0000","last_peered":"2024-09-10T05:40:29.796808+0000","last_clean":"2024-09-10T05:40:29.796808+0000","last_became_active":"2024-09-10T05:36:13.622771+0000","last_became_peered":"2024-09-10T05:36:13.622771+0000","last_unstale":"2024-09-10T05:40:29.796808+0000","last_undegraded":"2024-09-10T05:40:29.796808+0000","last_fullsized":"2024-09-10T05:40:29.796808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-10T05:40:29.796340+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-10T05:40:29.796340+0000","last_clean_scrub_stamp":"2024-09-10T05:40:29.796340+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:33:51.581411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"32'2","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:09.364674+0000","last_change":"2024-09-10T05:40:09.364492+0000","last_active":"2024-09-10T05:40:09.364674+0000","last_peered":"2024-09-10T05:40:09.364674+0000","last_clean":"2024-09-10T05:40:09.364674+0000","last_became_active":"2024-09-10T05:36:11.596165+0000","last_became_peered":"2024-09-10T05:36:11.596165+0000","last_unstale":"2024-09-10T05:40:09.364674+0000","last_undegraded":"2024-09-10T05:40:09.364674+0000","last_fullsized":"2024-09-10T05:40:09.364674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T05:40:09.364301+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T05:40:09.364301+0000","last_clean_scrub_stamp":"2024-09-10T05:40:09.364301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:02:21.771318+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:45.515622+0000","last_change":"2024-09-10T05:40:45.515346+0000","last_active":"2024-09-10T05:40:45.515622+0000","last_peered":"2024-09-10T05:40:45.515622+0000","last_clean":"2024-09-10T05:40:45.515622+0000","last_became_active":"2024-09-10T05:36:15.615994+0000","last_became_peered":"2024-09-10T05:36:15.615994+0000","last_unstale":"2024-09-10T05:40:45.515622+0000","last_undegraded":"2024-09-10T05:40:45.515622+0000","last_fullsized":"2024-09-10T05:40:45.515622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:45.515134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:45.515134+0000","last_clean_scrub_stamp":"2024-09-10T05:40:45.515134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:21:51.761789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"34'44","reported_seq":110,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:58.170963+0000","last_change":"2024-09-10T05:40:58.170821+0000","last_active":"2024-09-10T05:40:58.170963+0000","last_peered":"2024-09-10T05:40:58.170963+0000","last_clean":"2024-09-10T05:40:58.170963+0000","last_became_active":"2024-09-10T05:36:17.631054+0000","last_became_peered":"2024-09-10T05:36:17.631054+0000","last_unstale":"2024-09-10T05:40:58.170963+0000","last_undegraded":"2024-09-10T05:40:58.170963+0000","last_fullsized":"2024-09-10T05:40:58.170963+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'44","last_scrub_stamp":"2024-09-10T05:40:58.170623+0000","last_deep_scrub":"34'44","last_deep_scrub_stamp":"2024-09-10T05:40:58.170623+0000","last_clean_scrub_stamp":"2024-09-10T05:40:58.170623+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:34.367806+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"34'286","reported_seq":420,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:41:05.932523+0000","last_change":"2024-09-10T05:41:05.932523+0000","last_active":"2024-09-10T05:41:05.932523+0000","last_peered":"2024-09-10T05:41:05.932523+0000","last_clean":"2024-09-10T05:41:05.932523+0000","last_became_active":"2024-09-10T05:36:19.670915+0000","last_became_peered":"2024-09-10T05:36:19.670915+0000","last_unstale":"2024-09-10T05:41:05.932523+0000","last_undegraded":"2024-09-10T05:41:05.932523+0000","last_fullsized":"2024-09-10T05:41:05.932523+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-10T05:41:05.932334+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-10T05:41:05.932334+0000","last_clean_scrub_stamp":"2024-09-10T05:41:05.932334+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:06:33.603375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"34'8","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:23.819129+0000","last_change":"2024-09-10T05:40:23.818949+0000","last_active":"2024-09-10T05:40:23.819129+0000","last_peered":"2024-09-10T05:40:23.819129+0000","last_clean":"2024-09-10T05:40:23.819129+0000","last_became_active":"2024-09-10T05:36:13.597477+0000","last_became_peered":"2024-09-10T05:36:13.597477+0000","last_unstale":"2024-09-10T05:40:23.819129+0000","last_undegraded":"2024-09-10T05:40:23.819129+0000","last_fullsized":"2024-09-10T05:40:23.819129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-10T05:40:23.818774+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-10T05:40:23.818774+0000","last_clean_scrub_stamp":"2024-09-10T05:40:23.818774+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:57.685828+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:12.342230+0000","last_change":"2024-09-10T05:40:12.341960+0000","last_active":"2024-09-10T05:40:12.342230+0000","last_peered":"2024-09-10T05:40:12.342230+0000","last_clean":"2024-09-10T05:40:12.342230+0000","last_became_active":"2024-09-10T05:36:11.600405+0000","last_became_peered":"2024-09-10T05:36:11.600405+0000","last_unstale":"2024-09-10T05:40:12.342230+0000","last_undegraded":"2024-09-10T05:40:12.342230+0000","last_fullsized":"2024-09-10T05:40:12.342230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:12.341728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:12.341728+0000","last_clean_scrub_stamp":"2024-09-10T05:40:12.341728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:41:26.735507+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:39.182970+0000","last_change":"2024-09-10T05:40:39.182970+0000","last_active":"2024-09-10T05:40:39.182970+0000","last_peered":"2024-09-10T05:40:39.182970+0000","last_clean":"2024-09-10T05:40:39.182970+0000","last_became_active":"2024-09-10T05:36:15.620908+0000","last_became_peered":"2024-09-10T05:36:15.620908+0000","last_unstale":"2024-09-10T05:40:39.182970+0000","last_undegraded":"2024-09-10T05:40:39.182970+0000","last_fullsized":"2024-09-10T05:40:39.182970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:39.182790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:39.182790+0000","last_clean_scrub_stamp":"2024-09-10T05:40:39.182790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:00:57.905871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'60","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:36.535232+0000","last_change":"2024-09-10T05:40:36.535093+0000","last_active":"2024-09-10T05:40:36.535232+0000","last_peered":"2024-09-10T05:40:36.535232+0000","last_clean":"2024-09-10T05:40:36.535232+0000","last_became_active":"2024-09-10T05:36:52.710284+0000","last_became_peered":"2024-09-10T05:36:52.710284+0000","last_unstale":"2024-09-10T05:40:36.535232+0000","last_undegraded":"2024-09-10T05:40:36.535232+0000","last_fullsized":"2024-09-10T05:40:36.535232+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'60","last_scrub_stamp":"2024-09-10T05:40:36.534889+0000","last_deep_scrub":"34'60","last_deep_scrub_stamp":"2024-09-10T05:40:36.534889+0000","last_clean_scrub_stamp":"2024-09-10T05:40:36.534889+0000","objects_scrubbed":10,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:52:45.576787+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:53.104709+0000","last_change":"2024-09-10T05:40:53.104709+0000","last_active":"2024-09-10T05:40:53.104709+0000","last_peered":"2024-09-10T05:40:53.104709+0000","last_clean":"2024-09-10T05:40:53.104709+0000","last_became_active":"2024-09-10T05:36:19.640470+0000","last_became_peered":"2024-09-10T05:36:19.640470+0000","last_unstale":"2024-09-10T05:40:53.104709+0000","last_undegraded":"2024-09-10T05:40:53.104709+0000","last_fullsized":"2024-09-10T05:40:53.104709+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:53.104501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:53.104501+0000","last_clean_scrub_stamp":"2024-09-10T05:40:53.104501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:08:52.699420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"32'3","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:49.524901+0000","last_change":"2024-09-10T05:40:49.524901+0000","last_active":"2024-09-10T05:40:49.524901+0000","last_peered":"2024-09-10T05:40:49.524901+0000","last_clean":"2024-09-10T05:40:49.524901+0000","last_became_active":"2024-09-10T05:36:21.664232+0000","last_became_peered":"2024-09-10T05:36:21.664232+0000","last_unstale":"2024-09-10T05:40:49.524901+0000","last_undegraded":"2024-09-10T05:40:49.524901+0000","last_fullsized":"2024-09-10T05:40:49.524901+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-10T05:40:49.524695+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-10T05:40:49.524695+0000","last_clean_scrub_stamp":"2024-09-10T05:40:49.524695+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:14:48.157451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'2","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:15.511938+0000","last_change":"2024-09-10T05:40:15.511801+0000","last_active":"2024-09-10T05:40:15.511938+0000","last_peered":"2024-09-10T05:40:15.511938+0000","last_clean":"2024-09-10T05:40:15.511938+0000","last_became_active":"2024-09-10T05:36:52.703743+0000","last_became_peered":"2024-09-10T05:36:52.703743+0000","last_unstale":"2024-09-10T05:40:15.511938+0000","last_undegraded":"2024-09-10T05:40:15.511938+0000","last_fullsized":"2024-09-10T05:40:15.511938+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:15.511620+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:15.511620+0000","last_clean_scrub_stamp":"2024-09-10T05:40:15.511620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:45:41.854563+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:07.337399+0000","last_change":"2024-09-10T05:40:07.337269+0000","last_active":"2024-09-10T05:40:07.337399+0000","last_peered":"2024-09-10T05:40:07.337399+0000","last_clean":"2024-09-10T05:40:07.337399+0000","last_became_active":"2024-09-10T05:36:11.597717+0000","last_became_peered":"2024-09-10T05:36:11.597717+0000","last_unstale":"2024-09-10T05:40:07.337399+0000","last_undegraded":"2024-09-10T05:40:07.337399+0000","last_fullsized":"2024-09-10T05:40:07.337399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:07.337094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:07.337094+0000","last_clean_scrub_stamp":"2024-09-10T05:40:07.337094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:15.999267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:32.546321+0000","last_change":"2024-09-10T05:40:32.546155+0000","last_active":"2024-09-10T05:40:32.546321+0000","last_peered":"2024-09-10T05:40:32.546321+0000","last_clean":"2024-09-10T05:40:32.546321+0000","last_became_active":"2024-09-10T05:36:15.631635+0000","last_became_peered":"2024-09-10T05:36:15.631635+0000","last_unstale":"2024-09-10T05:40:32.546321+0000","last_undegraded":"2024-09-10T05:40:32.546321+0000","last_fullsized":"2024-09-10T05:40:32.546321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:32.545964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:32.545964+0000","last_clean_scrub_stamp":"2024-09-10T05:40:32.545964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:59:39.430013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"34'44","reported_seq":110,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:49.911492+0000","last_change":"2024-09-10T05:40:49.911492+0000","last_active":"2024-09-10T05:40:49.911492+0000","last_peered":"2024-09-10T05:40:49.911492+0000","last_clean":"2024-09-10T05:40:49.911492+0000","last_became_active":"2024-09-10T05:36:17.638301+0000","last_became_peered":"2024-09-10T05:36:17.638301+0000","last_unstale":"2024-09-10T05:40:49.911492+0000","last_undegraded":"2024-09-10T05:40:49.911492+0000","last_fullsized":"2024-09-10T05:40:49.911492+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'44","last_scrub_stamp":"2024-09-10T05:40:49.911298+0000","last_deep_scrub":"34'44","last_deep_scrub_stamp":"2024-09-10T05:40:49.911298+0000","last_clean_scrub_stamp":"2024-09-10T05:40:49.911298+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:47:57.628255+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:41:01.914898+0000","last_change":"2024-09-10T05:41:01.914898+0000","last_active":"2024-09-10T05:41:01.914898+0000","last_peered":"2024-09-10T05:41:01.914898+0000","last_clean":"2024-09-10T05:41:01.914898+0000","last_became_active":"2024-09-10T05:36:19.671022+0000","last_became_peered":"2024-09-10T05:36:19.671022+0000","last_unstale":"2024-09-10T05:41:01.914898+0000","last_undegraded":"2024-09-10T05:41:01.914898+0000","last_fullsized":"2024-09-10T05:41:01.914898+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:41:01.914715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:41:01.914715+0000","last_clean_scrub_stamp":"2024-09-10T05:41:01.914715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:42:25.922776+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"34'4","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:41:00.207808+0000","last_change":"2024-09-10T05:41:00.207808+0000","last_active":"2024-09-10T05:41:00.207808+0000","last_peered":"2024-09-10T05:41:00.207808+0000","last_clean":"2024-09-10T05:41:00.207808+0000","last_became_active":"2024-09-10T05:36:21.666042+0000","last_became_peered":"2024-09-10T05:36:21.666042+0000","last_unstale":"2024-09-10T05:41:00.207808+0000","last_undegraded":"2024-09-10T05:41:00.207808+0000","last_fullsized":"2024-09-10T05:41:00.207808+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:41:00.207581+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:41:00.207581+0000","last_clean_scrub_stamp":"2024-09-10T05:41:00.207581+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:07:09.337309+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'14","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:16.468630+0000","last_change":"2024-09-10T05:40:16.468481+0000","last_active":"2024-09-10T05:40:16.468630+0000","last_peered":"2024-09-10T05:40:16.468630+0000","last_clean":"2024-09-10T05:40:16.468630+0000","last_became_active":"2024-09-10T05:36:52.696116+0000","last_became_peered":"2024-09-10T05:36:52.696116+0000","last_unstale":"2024-09-10T05:40:16.468630+0000","last_undegraded":"2024-09-10T05:40:16.468630+0000","last_fullsized":"2024-09-10T05:40:16.468630+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-10T05:40:16.468308+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-10T05:40:16.468308+0000","last_clean_scrub_stamp":"2024-09-10T05:40:16.468308+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:13:08.427165+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:11.363315+0000","last_change":"2024-09-10T05:40:11.363136+0000","last_active":"2024-09-10T05:40:11.363315+0000","last_peered":"2024-09-10T05:40:11.363315+0000","last_clean":"2024-09-10T05:40:11.363315+0000","last_became_active":"2024-09-10T05:36:11.606576+0000","last_became_peered":"2024-09-10T05:36:11.606576+0000","last_unstale":"2024-09-10T05:40:11.363315+0000","last_undegraded":"2024-09-10T05:40:11.363315+0000","last_fullsized":"2024-09-10T05:40:11.363315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:11.362960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:11.362960+0000","last_clean_scrub_stamp":"2024-09-10T05:40:11.362960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:18.945320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:34.536824+0000","last_change":"2024-09-10T05:40:34.536659+0000","last_active":"2024-09-10T05:40:34.536824+0000","last_peered":"2024-09-10T05:40:34.536824+0000","last_clean":"2024-09-10T05:40:34.536824+0000","last_became_active":"2024-09-10T05:36:15.617647+0000","last_became_peered":"2024-09-10T05:36:15.617647+0000","last_unstale":"2024-09-10T05:40:34.536824+0000","last_undegraded":"2024-09-10T05:40:34.536824+0000","last_fullsized":"2024-09-10T05:40:34.536824+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:34.536474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:34.536474+0000","last_clean_scrub_stamp":"2024-09-10T05:40:34.536474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:08.497925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"34'61","reported_seq":136,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:56.195805+0000","last_change":"2024-09-10T05:40:56.195805+0000","last_active":"2024-09-10T05:40:56.195805+0000","last_peered":"2024-09-10T05:40:56.195805+0000","last_clean":"2024-09-10T05:40:56.195805+0000","last_became_active":"2024-09-10T05:36:17.636000+0000","last_became_peered":"2024-09-10T05:36:17.636000+0000","last_unstale":"2024-09-10T05:40:56.195805+0000","last_undegraded":"2024-09-10T05:40:56.195805+0000","last_fullsized":"2024-09-10T05:40:56.195805+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'61","last_scrub_stamp":"2024-09-10T05:40:56.195653+0000","last_deep_scrub":"34'61","last_deep_scrub_stamp":"2024-09-10T05:40:56.195653+0000","last_clean_scrub_stamp":"2024-09-10T05:40:56.195653+0000","objects_scrubbed":9,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:49:29.798030+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"34'286","reported_seq":367,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:40.504504+0000","last_change":"2024-09-10T05:40:40.504338+0000","last_active":"2024-09-10T05:40:40.504504+0000","last_peered":"2024-09-10T05:40:40.504504+0000","last_clean":"2024-09-10T05:40:40.504504+0000","last_became_active":"2024-09-10T05:36:19.663950+0000","last_became_peered":"2024-09-10T05:36:19.663950+0000","last_unstale":"2024-09-10T05:40:40.504504+0000","last_undegraded":"2024-09-10T05:40:40.504504+0000","last_fullsized":"2024-09-10T05:40:40.504504+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-10T05:40:40.504135+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-10T05:40:40.504135+0000","last_clean_scrub_stamp":"2024-09-10T05:40:40.504135+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:54:50.079992+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"32'2","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:41:01.234202+0000","last_change":"2024-09-10T05:41:01.234202+0000","last_active":"2024-09-10T05:41:01.234202+0000","last_peered":"2024-09-10T05:41:01.234202+0000","last_clean":"2024-09-10T05:41:01.234202+0000","last_became_active":"2024-09-10T05:36:21.690772+0000","last_became_peered":"2024-09-10T05:36:21.690772+0000","last_unstale":"2024-09-10T05:41:01.234202+0000","last_undegraded":"2024-09-10T05:41:01.234202+0000","last_fullsized":"2024-09-10T05:41:01.234202+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T05:41:01.234034+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T05:41:01.234034+0000","last_clean_scrub_stamp":"2024-09-10T05:41:01.234034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:17:53.119106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"34'6","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:17.463737+0000","last_change":"2024-09-10T05:40:17.463570+0000","last_active":"2024-09-10T05:40:17.463737+0000","last_peered":"2024-09-10T05:40:17.463737+0000","last_clean":"2024-09-10T05:40:17.463737+0000","last_became_active":"2024-09-10T05:36:13.611694+0000","last_became_peered":"2024-09-10T05:36:13.611694+0000","last_unstale":"2024-09-10T05:40:17.463737+0000","last_undegraded":"2024-09-10T05:40:17.463737+0000","last_fullsized":"2024-09-10T05:40:17.463737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T05:40:17.463381+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T05:40:17.463381+0000","last_clean_scrub_stamp":"2024-09-10T05:40:17.463381+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:29.689757+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'2","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:03.358116+0000","last_change":"2024-09-10T05:40:03.358004+0000","last_active":"2024-09-10T05:40:03.358116+0000","last_peered":"2024-09-10T05:40:03.358116+0000","last_clean":"2024-09-10T05:40:03.358116+0000","last_became_active":"2024-09-10T05:36:11.606957+0000","last_became_peered":"2024-09-10T05:36:11.606957+0000","last_unstale":"2024-09-10T05:40:03.358116+0000","last_undegraded":"2024-09-10T05:40:03.358116+0000","last_fullsized":"2024-09-10T05:40:03.358116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T05:40:03.357891+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T05:40:03.357891+0000","last_clean_scrub_stamp":"2024-09-10T05:40:03.357891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:00:33.509652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:33.551675+0000","last_change":"2024-09-10T05:40:33.551523+0000","last_active":"2024-09-10T05:40:33.551675+0000","last_peered":"2024-09-10T05:40:33.551675+0000","last_clean":"2024-09-10T05:40:33.551675+0000","last_became_active":"2024-09-10T05:36:15.631551+0000","last_became_peered":"2024-09-10T05:36:15.631551+0000","last_unstale":"2024-09-10T05:40:33.551675+0000","last_undegraded":"2024-09-10T05:40:33.551675+0000","last_fullsized":"2024-09-10T05:40:33.551675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:33.551317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:33.551317+0000","last_clean_scrub_stamp":"2024-09-10T05:40:33.551317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:55.912005+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"34'79","reported_seq":169,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:48.873037+0000","last_change":"2024-09-10T05:40:48.873037+0000","last_active":"2024-09-10T05:40:48.873037+0000","last_peered":"2024-09-10T05:40:48.873037+0000","last_clean":"2024-09-10T05:40:48.873037+0000","last_became_active":"2024-09-10T05:36:17.650601+0000","last_became_peered":"2024-09-10T05:36:17.650601+0000","last_unstale":"2024-09-10T05:40:48.873037+0000","last_undegraded":"2024-09-10T05:40:48.873037+0000","last_fullsized":"2024-09-10T05:40:48.873037+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'79","last_scrub_stamp":"2024-09-10T05:40:48.872842+0000","last_deep_scrub":"34'79","last_deep_scrub_stamp":"2024-09-10T05:40:48.872842+0000","last_clean_scrub_stamp":"2024-09-10T05:40:48.872842+0000","objects_scrubbed":7,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:52.323378+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:42.486465+0000","last_change":"2024-09-10T05:40:42.486308+0000","last_active":"2024-09-10T05:40:42.486465+0000","last_peered":"2024-09-10T05:40:42.486465+0000","last_clean":"2024-09-10T05:40:42.486465+0000","last_became_active":"2024-09-10T05:36:19.638087+0000","last_became_peered":"2024-09-10T05:36:19.638087+0000","last_unstale":"2024-09-10T05:40:42.486465+0000","last_undegraded":"2024-09-10T05:40:42.486465+0000","last_fullsized":"2024-09-10T05:40:42.486465+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:42.486118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:42.486118+0000","last_clean_scrub_stamp":"2024-09-10T05:40:42.486118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:05:00.763542+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"34'21","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:41:03.197786+0000","last_change":"2024-09-10T05:41:03.197786+0000","last_active":"2024-09-10T05:41:03.197786+0000","last_peered":"2024-09-10T05:41:03.197786+0000","last_clean":"2024-09-10T05:41:03.197786+0000","last_became_active":"2024-09-10T05:36:21.680246+0000","last_became_peered":"2024-09-10T05:36:21.680246+0000","last_unstale":"2024-09-10T05:41:03.197786+0000","last_undegraded":"2024-09-10T05:41:03.197786+0000","last_fullsized":"2024-09-10T05:41:03.197786+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'21","last_scrub_stamp":"2024-09-10T05:41:03.197567+0000","last_deep_scrub":"34'21","last_deep_scrub_stamp":"2024-09-10T05:41:03.197567+0000","last_clean_scrub_stamp":"2024-09-10T05:41:03.197567+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:14:45.387003+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"34'6","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:18.483738+0000","last_change":"2024-09-10T05:40:18.483578+0000","last_active":"2024-09-10T05:40:18.483738+0000","last_peered":"2024-09-10T05:40:18.483738+0000","last_clean":"2024-09-10T05:40:18.483738+0000","last_became_active":"2024-09-10T05:36:52.702912+0000","last_became_peered":"2024-09-10T05:36:52.702912+0000","last_unstale":"2024-09-10T05:40:18.483738+0000","last_undegraded":"2024-09-10T05:40:18.483738+0000","last_fullsized":"2024-09-10T05:40:18.483738+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T05:40:18.483367+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T05:40:18.483367+0000","last_clean_scrub_stamp":"2024-09-10T05:40:18.483367+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:29:35.440454+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"34'4","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:06.665116+0000","last_change":"2024-09-10T05:40:06.664984+0000","last_active":"2024-09-10T05:40:06.665116+0000","last_peered":"2024-09-10T05:40:06.665116+0000","last_clean":"2024-09-10T05:40:06.665116+0000","last_became_active":"2024-09-10T05:36:11.606930+0000","last_became_peered":"2024-09-10T05:36:11.606930+0000","last_unstale":"2024-09-10T05:40:06.665116+0000","last_undegraded":"2024-09-10T05:40:06.665116+0000","last_fullsized":"2024-09-10T05:40:06.665116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:06.664807+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:06.664807+0000","last_clean_scrub_stamp":"2024-09-10T05:40:06.664807+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:52:51.651502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:35.492736+0000","last_change":"2024-09-10T05:40:35.492588+0000","last_active":"2024-09-10T05:40:35.492736+0000","last_peered":"2024-09-10T05:40:35.492736+0000","last_clean":"2024-09-10T05:40:35.492736+0000","last_became_active":"2024-09-10T05:36:15.616975+0000","last_became_peered":"2024-09-10T05:36:15.616975+0000","last_unstale":"2024-09-10T05:40:35.492736+0000","last_undegraded":"2024-09-10T05:40:35.492736+0000","last_fullsized":"2024-09-10T05:40:35.492736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:35.492410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:35.492410+0000","last_clean_scrub_stamp":"2024-09-10T05:40:35.492410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:47:37.689480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'51","reported_seq":118,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:55.239703+0000","last_change":"2024-09-10T05:40:55.239703+0000","last_active":"2024-09-10T05:40:55.239703+0000","last_peered":"2024-09-10T05:40:55.239703+0000","last_clean":"2024-09-10T05:40:55.239703+0000","last_became_active":"2024-09-10T05:36:17.650522+0000","last_became_peered":"2024-09-10T05:36:17.650522+0000","last_unstale":"2024-09-10T05:40:55.239703+0000","last_undegraded":"2024-09-10T05:40:55.239703+0000","last_fullsized":"2024-09-10T05:40:55.239703+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'51","last_scrub_stamp":"2024-09-10T05:40:55.239580+0000","last_deep_scrub":"34'51","last_deep_scrub_stamp":"2024-09-10T05:40:55.239580+0000","last_clean_scrub_stamp":"2024-09-10T05:40:55.239580+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:09:19.053210+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:41:04.944523+0000","last_change":"2024-09-10T05:41:04.944523+0000","last_active":"2024-09-10T05:41:04.944523+0000","last_peered":"2024-09-10T05:41:04.944523+0000","last_clean":"2024-09-10T05:41:04.944523+0000","last_became_active":"2024-09-10T05:36:19.663287+0000","last_became_peered":"2024-09-10T05:36:19.663287+0000","last_unstale":"2024-09-10T05:41:04.944523+0000","last_undegraded":"2024-09-10T05:41:04.944523+0000","last_fullsized":"2024-09-10T05:41:04.944523+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:41:04.944344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:41:04.944344+0000","last_clean_scrub_stamp":"2024-09-10T05:41:04.944344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:11:40.569613+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'6","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:41:07.973349+0000","last_change":"2024-09-10T05:41:07.973349+0000","last_active":"2024-09-10T05:41:07.973349+0000","last_peered":"2024-09-10T05:41:07.973349+0000","last_clean":"2024-09-10T05:41:07.973349+0000","last_became_active":"2024-09-10T05:36:21.663661+0000","last_became_peered":"2024-09-10T05:36:21.663661+0000","last_unstale":"2024-09-10T05:41:07.973349+0000","last_undegraded":"2024-09-10T05:41:07.973349+0000","last_fullsized":"2024-09-10T05:41:07.973349+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T05:41:07.973169+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T05:41:07.973169+0000","last_clean_scrub_stamp":"2024-09-10T05:41:07.973169+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:11.545807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'6","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:32.451634+0000","last_change":"2024-09-10T05:40:32.451450+0000","last_active":"2024-09-10T05:40:32.451634+0000","last_peered":"2024-09-10T05:40:32.451634+0000","last_clean":"2024-09-10T05:40:32.451634+0000","last_became_active":"2024-09-10T05:36:13.630386+0000","last_became_peered":"2024-09-10T05:36:13.630386+0000","last_unstale":"2024-09-10T05:40:32.451634+0000","last_undegraded":"2024-09-10T05:40:32.451634+0000","last_fullsized":"2024-09-10T05:40:32.451634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T05:40:32.451241+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T05:40:32.451241+0000","last_clean_scrub_stamp":"2024-09-10T05:40:32.451241+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:37:51.470047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:19.418589+0000","last_change":"2024-09-10T05:40:19.418419+0000","last_active":"2024-09-10T05:40:19.418589+0000","last_peered":"2024-09-10T05:40:19.418589+0000","last_clean":"2024-09-10T05:40:19.418589+0000","last_became_active":"2024-09-10T05:36:11.597935+0000","last_became_peered":"2024-09-10T05:36:11.597935+0000","last_unstale":"2024-09-10T05:40:19.418589+0000","last_undegraded":"2024-09-10T05:40:19.418589+0000","last_fullsized":"2024-09-10T05:40:19.418589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:19.418236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:19.418236+0000","last_clean_scrub_stamp":"2024-09-10T05:40:19.418236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:15:58.466576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:40.162732+0000","last_change":"2024-09-10T05:40:40.162608+0000","last_active":"2024-09-10T05:40:40.162732+0000","last_peered":"2024-09-10T05:40:40.162732+0000","last_clean":"2024-09-10T05:40:40.162732+0000","last_became_active":"2024-09-10T05:36:15.619388+0000","last_became_peered":"2024-09-10T05:36:15.619388+0000","last_unstale":"2024-09-10T05:40:40.162732+0000","last_undegraded":"2024-09-10T05:40:40.162732+0000","last_fullsized":"2024-09-10T05:40:40.162732+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:40.162436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:40.162436+0000","last_clean_scrub_stamp":"2024-09-10T05:40:40.162436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:57.508074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"34'46","reported_seq":109,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:37.502123+0000","last_change":"2024-09-10T05:40:37.501956+0000","last_active":"2024-09-10T05:40:37.502123+0000","last_peered":"2024-09-10T05:40:37.502123+0000","last_clean":"2024-09-10T05:40:37.502123+0000","last_became_active":"2024-09-10T05:36:17.636568+0000","last_became_peered":"2024-09-10T05:36:17.636568+0000","last_unstale":"2024-09-10T05:40:37.502123+0000","last_undegraded":"2024-09-10T05:40:37.502123+0000","last_fullsized":"2024-09-10T05:40:37.502123+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-10T05:40:37.501724+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-10T05:40:37.501724+0000","last_clean_scrub_stamp":"2024-09-10T05:40:37.501724+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:41:42.065206+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'286","reported_seq":422,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:41.523152+0000","last_change":"2024-09-10T05:40:41.522983+0000","last_active":"2024-09-10T05:40:41.523152+0000","last_peered":"2024-09-10T05:40:41.523152+0000","last_clean":"2024-09-10T05:40:41.523152+0000","last_became_active":"2024-09-10T05:36:19.666610+0000","last_became_peered":"2024-09-10T05:36:19.666610+0000","last_unstale":"2024-09-10T05:40:41.523152+0000","last_undegraded":"2024-09-10T05:40:41.523152+0000","last_fullsized":"2024-09-10T05:40:41.523152+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-10T05:40:41.522779+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-10T05:40:41.522779+0000","last_clean_scrub_stamp":"2024-09-10T05:40:41.522779+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:13:32.225111+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'13","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:58.228442+0000","last_change":"2024-09-10T05:40:58.228442+0000","last_active":"2024-09-10T05:40:58.228442+0000","last_peered":"2024-09-10T05:40:58.228442+0000","last_clean":"2024-09-10T05:40:58.228442+0000","last_became_active":"2024-09-10T05:36:21.668641+0000","last_became_peered":"2024-09-10T05:36:21.668641+0000","last_unstale":"2024-09-10T05:40:58.228442+0000","last_undegraded":"2024-09-10T05:40:58.228442+0000","last_fullsized":"2024-09-10T05:40:58.228442+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'13","last_scrub_stamp":"2024-09-10T05:40:58.228258+0000","last_deep_scrub":"34'13","last_deep_scrub_stamp":"2024-09-10T05:40:58.228258+0000","last_clean_scrub_stamp":"2024-09-10T05:40:58.228258+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:07:29.447226+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"34'8","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:19.486804+0000","last_change":"2024-09-10T05:40:19.486658+0000","last_active":"2024-09-10T05:40:19.486804+0000","last_peered":"2024-09-10T05:40:19.486804+0000","last_clean":"2024-09-10T05:40:19.486804+0000","last_became_active":"2024-09-10T05:36:13.605112+0000","last_became_peered":"2024-09-10T05:36:13.605112+0000","last_unstale":"2024-09-10T05:40:19.486804+0000","last_undegraded":"2024-09-10T05:40:19.486804+0000","last_fullsized":"2024-09-10T05:40:19.486804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-10T05:40:19.486471+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-10T05:40:19.486471+0000","last_clean_scrub_stamp":"2024-09-10T05:40:19.486471+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:21:20.885876+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:05.700119+0000","last_change":"2024-09-10T05:40:05.699984+0000","last_active":"2024-09-10T05:40:05.700119+0000","last_peered":"2024-09-10T05:40:05.700119+0000","last_clean":"2024-09-10T05:40:05.700119+0000","last_became_active":"2024-09-10T05:36:11.600833+0000","last_became_peered":"2024-09-10T05:36:11.600833+0000","last_unstale":"2024-09-10T05:40:05.700119+0000","last_undegraded":"2024-09-10T05:40:05.700119+0000","last_fullsized":"2024-09-10T05:40:05.700119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:05.699733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:05.699733+0000","last_clean_scrub_stamp":"2024-09-10T05:40:05.699733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:58:29.252913+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'5","reported_seq":433,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:47.460449+0000","last_change":"2024-09-10T05:40:47.460135+0000","last_active":"2024-09-10T05:40:47.460449+0000","last_peered":"2024-09-10T05:40:47.460449+0000","last_clean":"2024-09-10T05:40:47.460449+0000","last_became_active":"2024-09-10T05:36:15.635670+0000","last_became_peered":"2024-09-10T05:36:15.635670+0000","last_unstale":"2024-09-10T05:40:47.460449+0000","last_undegraded":"2024-09-10T05:40:47.460449+0000","last_fullsized":"2024-09-10T05:40:47.460449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-10T05:40:47.459916+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-10T05:40:47.459916+0000","last_clean_scrub_stamp":"2024-09-10T05:40:47.459916+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:55.003531+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"34'15","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:50.899221+0000","last_change":"2024-09-10T05:40:50.899221+0000","last_active":"2024-09-10T05:40:50.899221+0000","last_peered":"2024-09-10T05:40:50.899221+0000","last_clean":"2024-09-10T05:40:50.899221+0000","last_became_active":"2024-09-10T05:36:17.633215+0000","last_became_peered":"2024-09-10T05:36:17.633215+0000","last_unstale":"2024-09-10T05:40:50.899221+0000","last_undegraded":"2024-09-10T05:40:50.899221+0000","last_fullsized":"2024-09-10T05:40:50.899221+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-10T05:40:50.899046+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-10T05:40:50.899046+0000","last_clean_scrub_stamp":"2024-09-10T05:40:50.899046+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:14:29.689122+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'286","reported_seq":484,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:41:03.180031+0000","last_change":"2024-09-10T05:41:03.180031+0000","last_active":"2024-09-10T05:41:03.180031+0000","last_peered":"2024-09-10T05:41:03.180031+0000","last_clean":"2024-09-10T05:41:03.180031+0000","last_became_active":"2024-09-10T05:36:19.649781+0000","last_became_peered":"2024-09-10T05:36:19.649781+0000","last_unstale":"2024-09-10T05:41:03.180031+0000","last_undegraded":"2024-09-10T05:41:03.180031+0000","last_fullsized":"2024-09-10T05:41:03.180031+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-10T05:41:03.179852+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-10T05:41:03.179852+0000","last_clean_scrub_stamp":"2024-09-10T05:41:03.179852+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:26:32.944316+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:46.558861+0000","last_change":"2024-09-10T05:40:46.558861+0000","last_active":"2024-09-10T05:40:46.558861+0000","last_peered":"2024-09-10T05:40:46.558861+0000","last_clean":"2024-09-10T05:40:46.558861+0000","last_became_active":"2024-09-10T05:36:21.664283+0000","last_became_peered":"2024-09-10T05:36:21.664283+0000","last_unstale":"2024-09-10T05:40:46.558861+0000","last_undegraded":"2024-09-10T05:40:46.558861+0000","last_fullsized":"2024-09-10T05:40:46.558861+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:46.558583+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:46.558583+0000","last_clean_scrub_stamp":"2024-09-10T05:40:46.558583+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:53:39.565368+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'4","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:20.525777+0000","last_change":"2024-09-10T05:40:20.525777+0000","last_active":"2024-09-10T05:40:20.525777+0000","last_peered":"2024-09-10T05:40:20.525777+0000","last_clean":"2024-09-10T05:40:20.525777+0000","last_became_active":"2024-09-10T05:37:53.724668+0000","last_became_peered":"2024-09-10T05:37:53.724668+0000","last_unstale":"2024-09-10T05:40:20.525777+0000","last_undegraded":"2024-09-10T05:40:20.525777+0000","last_fullsized":"2024-09-10T05:40:20.525777+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:20.525572+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:20.525572+0000","last_clean_scrub_stamp":"2024-09-10T05:40:20.525572+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:25.446283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:07.715488+0000","last_change":"2024-09-10T05:40:07.715354+0000","last_active":"2024-09-10T05:40:07.715488+0000","last_peered":"2024-09-10T05:40:07.715488+0000","last_clean":"2024-09-10T05:40:07.715488+0000","last_became_active":"2024-09-10T05:36:11.598213+0000","last_became_peered":"2024-09-10T05:36:11.598213+0000","last_unstale":"2024-09-10T05:40:07.715488+0000","last_undegraded":"2024-09-10T05:40:07.715488+0000","last_fullsized":"2024-09-10T05:40:07.715488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:07.715175+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:07.715175+0000","last_clean_scrub_stamp":"2024-09-10T05:40:07.715175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:29:24.579705+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:40.840714+0000","last_change":"2024-09-10T05:40:40.840583+0000","last_active":"2024-09-10T05:40:40.840714+0000","last_peered":"2024-09-10T05:40:40.840714+0000","last_clean":"2024-09-10T05:40:40.840714+0000","last_became_active":"2024-09-10T05:36:15.621697+0000","last_became_peered":"2024-09-10T05:36:15.621697+0000","last_unstale":"2024-09-10T05:40:40.840714+0000","last_undegraded":"2024-09-10T05:40:40.840714+0000","last_fullsized":"2024-09-10T05:40:40.840714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:40.840381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:40.840381+0000","last_clean_scrub_stamp":"2024-09-10T05:40:40.840381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:29:43.354536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'49","reported_seq":113,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:54.289646+0000","last_change":"2024-09-10T05:40:54.289646+0000","last_active":"2024-09-10T05:40:54.289646+0000","last_peered":"2024-09-10T05:40:54.289646+0000","last_clean":"2024-09-10T05:40:54.289646+0000","last_became_active":"2024-09-10T05:36:17.647533+0000","last_became_peered":"2024-09-10T05:36:17.647533+0000","last_unstale":"2024-09-10T05:40:54.289646+0000","last_undegraded":"2024-09-10T05:40:54.289646+0000","last_fullsized":"2024-09-10T05:40:54.289646+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'49","last_scrub_stamp":"2024-09-10T05:40:54.289498+0000","last_deep_scrub":"34'49","last_deep_scrub_stamp":"2024-09-10T05:40:54.289498+0000","last_clean_scrub_stamp":"2024-09-10T05:40:54.289498+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:33:27.390715+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:41:05.206310+0000","last_change":"2024-09-10T05:41:05.206310+0000","last_active":"2024-09-10T05:41:05.206310+0000","last_peered":"2024-09-10T05:41:05.206310+0000","last_clean":"2024-09-10T05:41:05.206310+0000","last_became_active":"2024-09-10T05:36:19.640885+0000","last_became_peered":"2024-09-10T05:36:19.640885+0000","last_unstale":"2024-09-10T05:41:05.206310+0000","last_undegraded":"2024-09-10T05:41:05.206310+0000","last_fullsized":"2024-09-10T05:41:05.206310+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:41:05.206127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:41:05.206127+0000","last_clean_scrub_stamp":"2024-09-10T05:41:05.206127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:56:33.472939+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"34'9","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:59.196618+0000","last_change":"2024-09-10T05:40:59.196618+0000","last_active":"2024-09-10T05:40:59.196618+0000","last_peered":"2024-09-10T05:40:59.196618+0000","last_clean":"2024-09-10T05:40:59.196618+0000","last_became_active":"2024-09-10T05:36:21.664454+0000","last_became_peered":"2024-09-10T05:36:21.664454+0000","last_unstale":"2024-09-10T05:40:59.196618+0000","last_undegraded":"2024-09-10T05:40:59.196618+0000","last_fullsized":"2024-09-10T05:40:59.196618+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-10T05:40:59.196417+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-10T05:40:59.196417+0000","last_clean_scrub_stamp":"2024-09-10T05:40:59.196417+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:01:04.607582+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'6","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:21.456922+0000","last_change":"2024-09-10T05:40:21.456783+0000","last_active":"2024-09-10T05:40:21.456922+0000","last_peered":"2024-09-10T05:40:21.456922+0000","last_clean":"2024-09-10T05:40:21.456922+0000","last_became_active":"2024-09-10T05:36:13.605318+0000","last_became_peered":"2024-09-10T05:36:13.605318+0000","last_unstale":"2024-09-10T05:40:21.456922+0000","last_undegraded":"2024-09-10T05:40:21.456922+0000","last_fullsized":"2024-09-10T05:40:21.456922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T05:40:21.456596+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T05:40:21.456596+0000","last_clean_scrub_stamp":"2024-09-10T05:40:21.456596+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:47.464427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"34'74","reported_seq":157,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:04.098105+0000","last_change":"2024-09-10T05:40:04.098105+0000","last_active":"2024-09-10T05:40:04.098105+0000","last_peered":"2024-09-10T05:40:04.098105+0000","last_clean":"2024-09-10T05:40:04.098105+0000","last_became_active":"2024-09-10T05:35:59.486077+0000","last_became_peered":"2024-09-10T05:35:59.486077+0000","last_unstale":"2024-09-10T05:40:04.098105+0000","last_undegraded":"2024-09-10T05:40:04.098105+0000","last_fullsized":"2024-09-10T05:40:04.098105+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'74","last_scrub_stamp":"2024-09-10T05:40:04.097908+0000","last_deep_scrub":"34'74","last_deep_scrub_stamp":"2024-09-10T05:40:04.097908+0000","last_clean_scrub_stamp":"2024-09-10T05:40:04.097908+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:20:39.253681+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"34'2","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:02.370065+0000","last_change":"2024-09-10T05:40:02.369928+0000","last_active":"2024-09-10T05:40:02.370065+0000","last_peered":"2024-09-10T05:40:02.370065+0000","last_clean":"2024-09-10T05:40:02.370065+0000","last_became_active":"2024-09-10T05:36:03.710352+0000","last_became_peered":"2024-09-10T05:36:03.710352+0000","last_unstale":"2024-09-10T05:40:02.370065+0000","last_undegraded":"2024-09-10T05:40:02.370065+0000","last_fullsized":"2024-09-10T05:40:02.370065+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:02.369862+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:02.369862+0000","last_clean_scrub_stamp":"2024-09-10T05:40:02.369862+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:48.466459+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.002047461,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"34'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:03.692190+0000","last_change":"2024-09-10T05:40:03.692057+0000","last_active":"2024-09-10T05:40:03.692190+0000","last_peered":"2024-09-10T05:40:03.692190+0000","last_clean":"2024-09-10T05:40:03.692190+0000","last_became_active":"2024-09-10T05:36:11.604178+0000","last_became_peered":"2024-09-10T05:36:11.604178+0000","last_unstale":"2024-09-10T05:40:03.692190+0000","last_undegraded":"2024-09-10T05:40:03.692190+0000","last_fullsized":"2024-09-10T05:40:03.692190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:03.691877+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:03.691877+0000","last_clean_scrub_stamp":"2024-09-10T05:40:03.691877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:48:28.093143+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:38.228258+0000","last_change":"2024-09-10T05:40:38.228258+0000","last_active":"2024-09-10T05:40:38.228258+0000","last_peered":"2024-09-10T05:40:38.228258+0000","last_clean":"2024-09-10T05:40:38.228258+0000","last_became_active":"2024-09-10T05:36:15.623637+0000","last_became_peered":"2024-09-10T05:36:15.623637+0000","last_unstale":"2024-09-10T05:40:38.228258+0000","last_undegraded":"2024-09-10T05:40:38.228258+0000","last_fullsized":"2024-09-10T05:40:38.228258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:38.228078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:38.228078+0000","last_clean_scrub_stamp":"2024-09-10T05:40:38.228078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:52:22.148177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'98","reported_seq":199,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:52.329463+0000","last_change":"2024-09-10T05:40:52.329463+0000","last_active":"2024-09-10T05:40:52.329463+0000","last_peered":"2024-09-10T05:40:52.329463+0000","last_clean":"2024-09-10T05:40:52.329463+0000","last_became_active":"2024-09-10T05:36:17.636543+0000","last_became_peered":"2024-09-10T05:36:17.636543+0000","last_unstale":"2024-09-10T05:40:52.329463+0000","last_undegraded":"2024-09-10T05:40:52.329463+0000","last_fullsized":"2024-09-10T05:40:52.329463+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'98","last_scrub_stamp":"2024-09-10T05:40:52.329249+0000","last_deep_scrub":"34'98","last_deep_scrub_stamp":"2024-09-10T05:40:52.329249+0000","last_clean_scrub_stamp":"2024-09-10T05:40:52.329249+0000","objects_scrubbed":6,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:49:31.558533+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:41:00.902866+0000","last_change":"2024-09-10T05:41:00.902866+0000","last_active":"2024-09-10T05:41:00.902866+0000","last_peered":"2024-09-10T05:41:00.902866+0000","last_clean":"2024-09-10T05:41:00.902866+0000","last_became_active":"2024-09-10T05:36:19.663584+0000","last_became_peered":"2024-09-10T05:36:19.663584+0000","last_unstale":"2024-09-10T05:41:00.902866+0000","last_undegraded":"2024-09-10T05:41:00.902866+0000","last_fullsized":"2024-09-10T05:41:00.902866+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:41:00.902681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:41:00.902681+0000","last_clean_scrub_stamp":"2024-09-10T05:41:00.902681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:54:37.086133+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"34'82","reported_seq":177,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:52.561691+0000","last_change":"2024-09-10T05:40:52.561691+0000","last_active":"2024-09-10T05:40:52.561691+0000","last_peered":"2024-09-10T05:40:52.561691+0000","last_clean":"2024-09-10T05:40:52.561691+0000","last_became_active":"2024-09-10T05:36:21.664075+0000","last_became_peered":"2024-09-10T05:36:21.664075+0000","last_unstale":"2024-09-10T05:40:52.561691+0000","last_undegraded":"2024-09-10T05:40:52.561691+0000","last_fullsized":"2024-09-10T05:40:52.561691+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'82","last_scrub_stamp":"2024-09-10T05:40:52.561498+0000","last_deep_scrub":"34'82","last_deep_scrub_stamp":"2024-09-10T05:40:52.561498+0000","last_clean_scrub_stamp":"2024-09-10T05:40:52.561498+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:17:38.379926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":223,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"30'2","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:22.862239+0000","last_change":"2024-09-10T05:40:22.862111+0000","last_active":"2024-09-10T05:40:22.862239+0000","last_peered":"2024-09-10T05:40:22.862239+0000","last_clean":"2024-09-10T05:40:22.862239+0000","last_became_active":"2024-09-10T05:36:13.616766+0000","last_became_peered":"2024-09-10T05:36:13.616766+0000","last_unstale":"2024-09-10T05:40:22.862239+0000","last_undegraded":"2024-09-10T05:40:22.862239+0000","last_fullsized":"2024-09-10T05:40:22.862239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-10T05:40:22.861923+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-10T05:40:22.861923+0000","last_clean_scrub_stamp":"2024-09-10T05:40:22.861923+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:18:25.222001+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:08.386382+0000","last_change":"2024-09-10T05:40:08.386382+0000","last_active":"2024-09-10T05:40:08.386382+0000","last_peered":"2024-09-10T05:40:08.386382+0000","last_clean":"2024-09-10T05:40:08.386382+0000","last_became_active":"2024-09-10T05:36:03.706256+0000","last_became_peered":"2024-09-10T05:36:03.706256+0000","last_unstale":"2024-09-10T05:40:08.386382+0000","last_undegraded":"2024-09-10T05:40:08.386382+0000","last_fullsized":"2024-09-10T05:40:08.386382+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:08.386197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:08.386197+0000","last_clean_scrub_stamp":"2024-09-10T05:40:08.386197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:07.558694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001383542,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:07.029001+0000","last_change":"2024-09-10T05:40:07.028861+0000","last_active":"2024-09-10T05:40:07.029001+0000","last_peered":"2024-09-10T05:40:07.029001+0000","last_clean":"2024-09-10T05:40:07.029001+0000","last_became_active":"2024-09-10T05:36:11.591339+0000","last_became_peered":"2024-09-10T05:36:11.591339+0000","last_unstale":"2024-09-10T05:40:07.029001+0000","last_undegraded":"2024-09-10T05:40:07.029001+0000","last_fullsized":"2024-09-10T05:40:07.029001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:07.028674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:07.028674+0000","last_clean_scrub_stamp":"2024-09-10T05:40:07.028674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:03.721457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:43.459631+0000","last_change":"2024-09-10T05:40:43.459631+0000","last_active":"2024-09-10T05:40:43.459631+0000","last_peered":"2024-09-10T05:40:43.459631+0000","last_clean":"2024-09-10T05:40:43.459631+0000","last_became_active":"2024-09-10T05:36:52.704490+0000","last_became_peered":"2024-09-10T05:36:52.704490+0000","last_unstale":"2024-09-10T05:40:43.459631+0000","last_undegraded":"2024-09-10T05:40:43.459631+0000","last_fullsized":"2024-09-10T05:40:43.459631+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:43.459420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:43.459420+0000","last_clean_scrub_stamp":"2024-09-10T05:40:43.459420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:14:25.648856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"34'302","reported_seq":539,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:49.083132+0000","last_change":"2024-09-10T05:40:49.083132+0000","last_active":"2024-09-10T05:40:49.083132+0000","last_peered":"2024-09-10T05:40:49.083132+0000","last_clean":"2024-09-10T05:40:49.083132+0000","last_became_active":"2024-09-10T05:36:17.637623+0000","last_became_peered":"2024-09-10T05:36:17.637623+0000","last_unstale":"2024-09-10T05:40:49.083132+0000","last_undegraded":"2024-09-10T05:40:49.083132+0000","last_fullsized":"2024-09-10T05:40:49.083132+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'302","last_scrub_stamp":"2024-09-10T05:40:49.082917+0000","last_deep_scrub":"34'302","last_deep_scrub_stamp":"2024-09-10T05:40:49.082917+0000","last_clean_scrub_stamp":"2024-09-10T05:40:49.082917+0000","objects_scrubbed":11,"log_size":302,"log_dups_size":0,"ondisk_log_size":302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:07.102658+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":387,"num_read_kb":371,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:59.935034+0000","last_change":"2024-09-10T05:40:59.935034+0000","last_active":"2024-09-10T05:40:59.935034+0000","last_peered":"2024-09-10T05:40:59.935034+0000","last_clean":"2024-09-10T05:40:59.935034+0000","last_became_active":"2024-09-10T05:36:19.672554+0000","last_became_peered":"2024-09-10T05:36:19.672554+0000","last_unstale":"2024-09-10T05:40:59.935034+0000","last_undegraded":"2024-09-10T05:40:59.935034+0000","last_fullsized":"2024-09-10T05:40:59.935034+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:59.934849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:59.934849+0000","last_clean_scrub_stamp":"2024-09-10T05:40:59.934849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:19:42.465061+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'5","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:41:04.236757+0000","last_change":"2024-09-10T05:41:04.236757+0000","last_active":"2024-09-10T05:41:04.236757+0000","last_peered":"2024-09-10T05:41:04.236757+0000","last_clean":"2024-09-10T05:41:04.236757+0000","last_became_active":"2024-09-10T05:36:21.661347+0000","last_became_peered":"2024-09-10T05:36:21.661347+0000","last_unstale":"2024-09-10T05:41:04.236757+0000","last_undegraded":"2024-09-10T05:41:04.236757+0000","last_fullsized":"2024-09-10T05:41:04.236757+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-10T05:41:04.236523+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-10T05:41:04.236523+0000","last_clean_scrub_stamp":"2024-09-10T05:41:04.236523+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:08:00.310245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:24.185198+0000","last_change":"2024-09-10T05:40:24.185051+0000","last_active":"2024-09-10T05:40:24.185198+0000","last_peered":"2024-09-10T05:40:24.185198+0000","last_clean":"2024-09-10T05:40:24.185198+0000","last_became_active":"2024-09-10T05:36:13.621451+0000","last_became_peered":"2024-09-10T05:36:13.621451+0000","last_unstale":"2024-09-10T05:40:24.185198+0000","last_undegraded":"2024-09-10T05:40:24.185198+0000","last_fullsized":"2024-09-10T05:40:24.185198+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T05:40:24.184869+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T05:40:24.184869+0000","last_clean_scrub_stamp":"2024-09-10T05:40:24.184869+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:25:47.203486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:04.549247+0000","last_change":"2024-09-10T05:40:04.549099+0000","last_active":"2024-09-10T05:40:04.549247+0000","last_peered":"2024-09-10T05:40:04.549247+0000","last_clean":"2024-09-10T05:40:04.549247+0000","last_became_active":"2024-09-10T05:36:03.707045+0000","last_became_peered":"2024-09-10T05:36:03.707045+0000","last_unstale":"2024-09-10T05:40:04.549247+0000","last_undegraded":"2024-09-10T05:40:04.549247+0000","last_fullsized":"2024-09-10T05:40:04.549247+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:04.548887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:04.548887+0000","last_clean_scrub_stamp":"2024-09-10T05:40:04.548887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:06.035520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093121299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"34'4","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:06.066743+0000","last_change":"2024-09-10T05:40:06.066584+0000","last_active":"2024-09-10T05:40:06.066743+0000","last_peered":"2024-09-10T05:40:06.066743+0000","last_clean":"2024-09-10T05:40:06.066743+0000","last_became_active":"2024-09-10T05:36:11.594432+0000","last_became_peered":"2024-09-10T05:36:11.594432+0000","last_unstale":"2024-09-10T05:40:06.066743+0000","last_undegraded":"2024-09-10T05:40:06.066743+0000","last_fullsized":"2024-09-10T05:40:06.066743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:06.066401+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:06.066401+0000","last_clean_scrub_stamp":"2024-09-10T05:40:06.066401+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:26.311891+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:31.519925+0000","last_change":"2024-09-10T05:40:31.519773+0000","last_active":"2024-09-10T05:40:31.519925+0000","last_peered":"2024-09-10T05:40:31.519925+0000","last_clean":"2024-09-10T05:40:31.519925+0000","last_became_active":"2024-09-10T05:36:15.620043+0000","last_became_peered":"2024-09-10T05:36:15.620043+0000","last_unstale":"2024-09-10T05:40:31.519925+0000","last_undegraded":"2024-09-10T05:40:31.519925+0000","last_fullsized":"2024-09-10T05:40:31.519925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:31.519580+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:31.519580+0000","last_clean_scrub_stamp":"2024-09-10T05:40:31.519580+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:18:37.004223+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'25","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:53.328256+0000","last_change":"2024-09-10T05:40:53.328256+0000","last_active":"2024-09-10T05:40:53.328256+0000","last_peered":"2024-09-10T05:40:53.328256+0000","last_clean":"2024-09-10T05:40:53.328256+0000","last_became_active":"2024-09-10T05:36:17.636381+0000","last_became_peered":"2024-09-10T05:36:17.636381+0000","last_unstale":"2024-09-10T05:40:53.328256+0000","last_undegraded":"2024-09-10T05:40:53.328256+0000","last_fullsized":"2024-09-10T05:40:53.328256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'25","last_scrub_stamp":"2024-09-10T05:40:53.328046+0000","last_deep_scrub":"34'25","last_deep_scrub_stamp":"2024-09-10T05:40:53.328046+0000","last_clean_scrub_stamp":"2024-09-10T05:40:53.328046+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:48:07.847432+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:41:02.195110+0000","last_change":"2024-09-10T05:41:02.195110+0000","last_active":"2024-09-10T05:41:02.195110+0000","last_peered":"2024-09-10T05:41:02.195110+0000","last_clean":"2024-09-10T05:41:02.195110+0000","last_became_active":"2024-09-10T05:36:19.664396+0000","last_became_peered":"2024-09-10T05:36:19.664396+0000","last_unstale":"2024-09-10T05:41:02.195110+0000","last_undegraded":"2024-09-10T05:41:02.195110+0000","last_fullsized":"2024-09-10T05:41:02.195110+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:41:02.194939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:41:02.194939+0000","last_clean_scrub_stamp":"2024-09-10T05:41:02.194939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:11.268535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:41:08.942604+0000","last_change":"2024-09-10T05:41:08.942604+0000","last_active":"2024-09-10T05:41:08.942604+0000","last_peered":"2024-09-10T05:41:08.942604+0000","last_clean":"2024-09-10T05:41:08.942604+0000","last_became_active":"2024-09-10T05:36:21.674984+0000","last_became_peered":"2024-09-10T05:36:21.674984+0000","last_unstale":"2024-09-10T05:41:08.942604+0000","last_undegraded":"2024-09-10T05:41:08.942604+0000","last_fullsized":"2024-09-10T05:41:08.942604+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:41:08.942395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:41:08.942395+0000","last_clean_scrub_stamp":"2024-09-10T05:41:08.942395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:42:56.480627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:23.144701+0000","last_change":"2024-09-10T05:40:23.144701+0000","last_active":"2024-09-10T05:40:23.144701+0000","last_peered":"2024-09-10T05:40:23.144701+0000","last_clean":"2024-09-10T05:40:23.144701+0000","last_became_active":"2024-09-10T05:36:13.626654+0000","last_became_peered":"2024-09-10T05:36:13.626654+0000","last_unstale":"2024-09-10T05:40:23.144701+0000","last_undegraded":"2024-09-10T05:40:23.144701+0000","last_fullsized":"2024-09-10T05:40:23.144701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:23.144518+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:23.144518+0000","last_clean_scrub_stamp":"2024-09-10T05:40:23.144518+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:29:05.863627+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"34'3","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:15.375407+0000","last_change":"2024-09-10T05:40:15.375209+0000","last_active":"2024-09-10T05:40:15.375407+0000","last_peered":"2024-09-10T05:40:15.375407+0000","last_clean":"2024-09-10T05:40:15.375407+0000","last_became_active":"2024-09-10T05:36:03.708495+0000","last_became_peered":"2024-09-10T05:36:03.708495+0000","last_unstale":"2024-09-10T05:40:15.375407+0000","last_undegraded":"2024-09-10T05:40:15.375407+0000","last_fullsized":"2024-09-10T05:40:15.375407+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-10T05:40:15.375014+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-10T05:40:15.375014+0000","last_clean_scrub_stamp":"2024-09-10T05:40:15.375014+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:49:34.092873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012525469999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:04.336783+0000","last_change":"2024-09-10T05:40:04.336594+0000","last_active":"2024-09-10T05:40:04.336783+0000","last_peered":"2024-09-10T05:40:04.336783+0000","last_clean":"2024-09-10T05:40:04.336783+0000","last_became_active":"2024-09-10T05:36:11.601414+0000","last_became_peered":"2024-09-10T05:36:11.601414+0000","last_unstale":"2024-09-10T05:40:04.336783+0000","last_undegraded":"2024-09-10T05:40:04.336783+0000","last_fullsized":"2024-09-10T05:40:04.336783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:04.336407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:04.336407+0000","last_clean_scrub_stamp":"2024-09-10T05:40:04.336407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:42:28.818551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:37.248228+0000","last_change":"2024-09-10T05:40:37.248228+0000","last_active":"2024-09-10T05:40:37.248228+0000","last_peered":"2024-09-10T05:40:37.248228+0000","last_clean":"2024-09-10T05:40:37.248228+0000","last_became_active":"2024-09-10T05:36:15.619505+0000","last_became_peered":"2024-09-10T05:36:15.619505+0000","last_unstale":"2024-09-10T05:40:37.248228+0000","last_undegraded":"2024-09-10T05:40:37.248228+0000","last_fullsized":"2024-09-10T05:40:37.248228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:37.248025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:37.248025+0000","last_clean_scrub_stamp":"2024-09-10T05:40:37.248025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:04:51.414497+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"34'20","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:47.905235+0000","last_change":"2024-09-10T05:40:47.905235+0000","last_active":"2024-09-10T05:40:47.905235+0000","last_peered":"2024-09-10T05:40:47.905235+0000","last_clean":"2024-09-10T05:40:47.905235+0000","last_became_active":"2024-09-10T05:36:17.637551+0000","last_became_peered":"2024-09-10T05:36:17.637551+0000","last_unstale":"2024-09-10T05:40:47.905235+0000","last_undegraded":"2024-09-10T05:40:47.905235+0000","last_fullsized":"2024-09-10T05:40:47.905235+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'20","last_scrub_stamp":"2024-09-10T05:40:47.905126+0000","last_deep_scrub":"34'20","last_deep_scrub_stamp":"2024-09-10T05:40:47.905126+0000","last_clean_scrub_stamp":"2024-09-10T05:40:47.905126+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:00:42.306089+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:41:02.946405+0000","last_change":"2024-09-10T05:41:02.946405+0000","last_active":"2024-09-10T05:41:02.946405+0000","last_peered":"2024-09-10T05:41:02.946405+0000","last_clean":"2024-09-10T05:41:02.946405+0000","last_became_active":"2024-09-10T05:36:19.669130+0000","last_became_peered":"2024-09-10T05:36:19.669130+0000","last_unstale":"2024-09-10T05:41:02.946405+0000","last_undegraded":"2024-09-10T05:41:02.946405+0000","last_fullsized":"2024-09-10T05:41:02.946405+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:41:02.946231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:41:02.946231+0000","last_clean_scrub_stamp":"2024-09-10T05:41:02.946231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:37:30.404827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'6","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:41:05.202452+0000","last_change":"2024-09-10T05:41:05.202452+0000","last_active":"2024-09-10T05:41:05.202452+0000","last_peered":"2024-09-10T05:41:05.202452+0000","last_clean":"2024-09-10T05:41:05.202452+0000","last_became_active":"2024-09-10T05:36:21.671206+0000","last_became_peered":"2024-09-10T05:36:21.671206+0000","last_unstale":"2024-09-10T05:41:05.202452+0000","last_undegraded":"2024-09-10T05:41:05.202452+0000","last_fullsized":"2024-09-10T05:41:05.202452+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T05:41:05.202273+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T05:41:05.202273+0000","last_clean_scrub_stamp":"2024-09-10T05:41:05.202273+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:11.448928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'4","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:22.094327+0000","last_change":"2024-09-10T05:40:22.094076+0000","last_active":"2024-09-10T05:40:22.094327+0000","last_peered":"2024-09-10T05:40:22.094327+0000","last_clean":"2024-09-10T05:40:22.094327+0000","last_became_active":"2024-09-10T05:36:13.611242+0000","last_became_peered":"2024-09-10T05:36:13.611242+0000","last_unstale":"2024-09-10T05:40:22.094327+0000","last_undegraded":"2024-09-10T05:40:22.094327+0000","last_fullsized":"2024-09-10T05:40:22.094327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:22.093836+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:22.093836+0000","last_clean_scrub_stamp":"2024-09-10T05:40:22.093836+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:16:04.536508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:10.404039+0000","last_change":"2024-09-10T05:40:10.403855+0000","last_active":"2024-09-10T05:40:10.404039+0000","last_peered":"2024-09-10T05:40:10.404039+0000","last_clean":"2024-09-10T05:40:10.404039+0000","last_became_active":"2024-09-10T05:36:11.604802+0000","last_became_peered":"2024-09-10T05:36:11.604802+0000","last_unstale":"2024-09-10T05:40:10.404039+0000","last_undegraded":"2024-09-10T05:40:10.404039+0000","last_fullsized":"2024-09-10T05:40:10.404039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:10.403675+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:10.403675+0000","last_clean_scrub_stamp":"2024-09-10T05:40:10.403675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:44:01.698908+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:03.095986+0000","last_change":"2024-09-10T05:40:03.095816+0000","last_active":"2024-09-10T05:40:03.095986+0000","last_peered":"2024-09-10T05:40:03.095986+0000","last_clean":"2024-09-10T05:40:03.095986+0000","last_became_active":"2024-09-10T05:36:03.705338+0000","last_became_peered":"2024-09-10T05:36:03.705338+0000","last_unstale":"2024-09-10T05:40:03.095986+0000","last_undegraded":"2024-09-10T05:40:03.095986+0000","last_fullsized":"2024-09-10T05:40:03.095986+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:03.095625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:03.095625+0000","last_clean_scrub_stamp":"2024-09-10T05:40:03.095625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:21.581455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010885789999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"34'2","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:30.543765+0000","last_change":"2024-09-10T05:40:30.543765+0000","last_active":"2024-09-10T05:40:30.543765+0000","last_peered":"2024-09-10T05:40:30.543765+0000","last_clean":"2024-09-10T05:40:30.543765+0000","last_became_active":"2024-09-10T05:36:15.618041+0000","last_became_peered":"2024-09-10T05:36:15.618041+0000","last_unstale":"2024-09-10T05:40:30.543765+0000","last_undegraded":"2024-09-10T05:40:30.543765+0000","last_fullsized":"2024-09-10T05:40:30.543765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:30.543571+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:30.543571+0000","last_clean_scrub_stamp":"2024-09-10T05:40:30.543571+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:04:23.896422+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"34'92","reported_seq":185,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:47.138202+0000","last_change":"2024-09-10T05:40:47.138202+0000","last_active":"2024-09-10T05:40:47.138202+0000","last_peered":"2024-09-10T05:40:47.138202+0000","last_clean":"2024-09-10T05:40:47.138202+0000","last_became_active":"2024-09-10T05:36:17.653627+0000","last_became_peered":"2024-09-10T05:36:17.653627+0000","last_unstale":"2024-09-10T05:40:47.138202+0000","last_undegraded":"2024-09-10T05:40:47.138202+0000","last_fullsized":"2024-09-10T05:40:47.138202+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'92","last_scrub_stamp":"2024-09-10T05:40:47.137926+0000","last_deep_scrub":"34'92","last_deep_scrub_stamp":"2024-09-10T05:40:47.137926+0000","last_clean_scrub_stamp":"2024-09-10T05:40:47.137926+0000","objects_scrubbed":11,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:30.802496+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":94,"num_read_kb":88,"num_write":46,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:41:00.201195+0000","last_change":"2024-09-10T05:41:00.201195+0000","last_active":"2024-09-10T05:41:00.201195+0000","last_peered":"2024-09-10T05:41:00.201195+0000","last_clean":"2024-09-10T05:41:00.201195+0000","last_became_active":"2024-09-10T05:36:19.650115+0000","last_became_peered":"2024-09-10T05:36:19.650115+0000","last_unstale":"2024-09-10T05:41:00.201195+0000","last_undegraded":"2024-09-10T05:41:00.201195+0000","last_fullsized":"2024-09-10T05:41:00.201195+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:41:00.200987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:41:00.200987+0000","last_clean_scrub_stamp":"2024-09-10T05:41:00.200987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:28:31.591631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"34'9","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:50.540770+0000","last_change":"2024-09-10T05:40:50.540632+0000","last_active":"2024-09-10T05:40:50.540770+0000","last_peered":"2024-09-10T05:40:50.540770+0000","last_clean":"2024-09-10T05:40:50.540770+0000","last_became_active":"2024-09-10T05:36:21.687744+0000","last_became_peered":"2024-09-10T05:36:21.687744+0000","last_unstale":"2024-09-10T05:40:50.540770+0000","last_undegraded":"2024-09-10T05:40:50.540770+0000","last_fullsized":"2024-09-10T05:40:50.540770+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-10T05:40:50.540456+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-10T05:40:50.540456+0000","last_clean_scrub_stamp":"2024-09-10T05:40:50.540456+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:17:38.930771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"32'6","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:20.043583+0000","last_change":"2024-09-10T05:40:20.043416+0000","last_active":"2024-09-10T05:40:20.043583+0000","last_peered":"2024-09-10T05:40:20.043583+0000","last_clean":"2024-09-10T05:40:20.043583+0000","last_became_active":"2024-09-10T05:36:13.617814+0000","last_became_peered":"2024-09-10T05:36:13.617814+0000","last_unstale":"2024-09-10T05:40:20.043583+0000","last_undegraded":"2024-09-10T05:40:20.043583+0000","last_fullsized":"2024-09-10T05:40:20.043583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-10T05:40:20.043232+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-10T05:40:20.043232+0000","last_clean_scrub_stamp":"2024-09-10T05:40:20.043232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:12.310111+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:08.043171+0000","last_change":"2024-09-10T05:40:08.043044+0000","last_active":"2024-09-10T05:40:08.043171+0000","last_peered":"2024-09-10T05:40:08.043171+0000","last_clean":"2024-09-10T05:40:08.043171+0000","last_became_active":"2024-09-10T05:36:11.595349+0000","last_became_peered":"2024-09-10T05:36:11.595349+0000","last_unstale":"2024-09-10T05:40:08.043171+0000","last_undegraded":"2024-09-10T05:40:08.043171+0000","last_fullsized":"2024-09-10T05:40:08.043171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:08.042856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:08.042856+0000","last_clean_scrub_stamp":"2024-09-10T05:40:08.042856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:15:37.792723+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:05.325390+0000","last_change":"2024-09-10T05:40:05.325151+0000","last_active":"2024-09-10T05:40:05.325390+0000","last_peered":"2024-09-10T05:40:05.325390+0000","last_clean":"2024-09-10T05:40:05.325390+0000","last_became_active":"2024-09-10T05:36:03.709534+0000","last_became_peered":"2024-09-10T05:36:03.709534+0000","last_unstale":"2024-09-10T05:40:05.325390+0000","last_undegraded":"2024-09-10T05:40:05.325390+0000","last_fullsized":"2024-09-10T05:40:05.325390+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:05.324950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:05.324950+0000","last_clean_scrub_stamp":"2024-09-10T05:40:05.324950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:04:00.453210+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0022338829999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:44.474801+0000","last_change":"2024-09-10T05:40:44.474801+0000","last_active":"2024-09-10T05:40:44.474801+0000","last_peered":"2024-09-10T05:40:44.474801+0000","last_clean":"2024-09-10T05:40:44.474801+0000","last_became_active":"2024-09-10T05:36:15.618491+0000","last_became_peered":"2024-09-10T05:36:15.618491+0000","last_unstale":"2024-09-10T05:40:44.474801+0000","last_undegraded":"2024-09-10T05:40:44.474801+0000","last_fullsized":"2024-09-10T05:40:44.474801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:44.474691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:44.474691+0000","last_clean_scrub_stamp":"2024-09-10T05:40:44.474691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:07:40.548413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"34'28","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:48.110316+0000","last_change":"2024-09-10T05:40:48.110316+0000","last_active":"2024-09-10T05:40:48.110316+0000","last_peered":"2024-09-10T05:40:48.110316+0000","last_clean":"2024-09-10T05:40:48.110316+0000","last_became_active":"2024-09-10T05:36:17.657112+0000","last_became_peered":"2024-09-10T05:36:17.657112+0000","last_unstale":"2024-09-10T05:40:48.110316+0000","last_undegraded":"2024-09-10T05:40:48.110316+0000","last_fullsized":"2024-09-10T05:40:48.110316+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'28","last_scrub_stamp":"2024-09-10T05:40:48.110110+0000","last_deep_scrub":"34'28","last_deep_scrub_stamp":"2024-09-10T05:40:48.110110+0000","last_clean_scrub_stamp":"2024-09-10T05:40:48.110110+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:02:46.580756+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'286","reported_seq":374,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:52.095334+0000","last_change":"2024-09-10T05:40:52.095334+0000","last_active":"2024-09-10T05:40:52.095334+0000","last_peered":"2024-09-10T05:40:52.095334+0000","last_clean":"2024-09-10T05:40:52.095334+0000","last_became_active":"2024-09-10T05:36:19.643319+0000","last_became_peered":"2024-09-10T05:36:19.643319+0000","last_unstale":"2024-09-10T05:40:52.095334+0000","last_undegraded":"2024-09-10T05:40:52.095334+0000","last_fullsized":"2024-09-10T05:40:52.095334+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-10T05:40:52.095154+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-10T05:40:52.095154+0000","last_clean_scrub_stamp":"2024-09-10T05:40:52.095154+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:38:11.113960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"30'2","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:41:09.986143+0000","last_change":"2024-09-10T05:41:09.986143+0000","last_active":"2024-09-10T05:41:09.986143+0000","last_peered":"2024-09-10T05:41:09.986143+0000","last_clean":"2024-09-10T05:41:09.986143+0000","last_became_active":"2024-09-10T05:36:21.691590+0000","last_became_peered":"2024-09-10T05:36:21.691590+0000","last_unstale":"2024-09-10T05:41:09.986143+0000","last_undegraded":"2024-09-10T05:41:09.986143+0000","last_fullsized":"2024-09-10T05:41:09.986143+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-10T05:41:09.985936+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-10T05:41:09.985936+0000","last_clean_scrub_stamp":"2024-09-10T05:41:09.985936+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:38:51.340871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:21.866611+0000","last_change":"2024-09-10T05:40:21.866611+0000","last_active":"2024-09-10T05:40:21.866611+0000","last_peered":"2024-09-10T05:40:21.866611+0000","last_clean":"2024-09-10T05:40:21.866611+0000","last_became_active":"2024-09-10T05:36:13.607367+0000","last_became_peered":"2024-09-10T05:36:13.607367+0000","last_unstale":"2024-09-10T05:40:21.866611+0000","last_undegraded":"2024-09-10T05:40:21.866611+0000","last_fullsized":"2024-09-10T05:40:21.866611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T05:40:21.866434+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T05:40:21.866434+0000","last_clean_scrub_stamp":"2024-09-10T05:40:21.866434+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:46.440442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:04.718942+0000","last_change":"2024-09-10T05:40:04.718781+0000","last_active":"2024-09-10T05:40:04.718942+0000","last_peered":"2024-09-10T05:40:04.718942+0000","last_clean":"2024-09-10T05:40:04.718942+0000","last_became_active":"2024-09-10T05:36:11.606234+0000","last_became_peered":"2024-09-10T05:36:11.606234+0000","last_unstale":"2024-09-10T05:40:04.718942+0000","last_undegraded":"2024-09-10T05:40:04.718942+0000","last_fullsized":"2024-09-10T05:40:04.718942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:04.718605+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:04.718605+0000","last_clean_scrub_stamp":"2024-09-10T05:40:04.718605+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:24:19.567951+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:05.070657+0000","last_change":"2024-09-10T05:40:05.070401+0000","last_active":"2024-09-10T05:40:05.070657+0000","last_peered":"2024-09-10T05:40:05.070657+0000","last_clean":"2024-09-10T05:40:05.070657+0000","last_became_active":"2024-09-10T05:36:03.705038+0000","last_became_peered":"2024-09-10T05:36:03.705038+0000","last_unstale":"2024-09-10T05:40:05.070657+0000","last_undegraded":"2024-09-10T05:40:05.070657+0000","last_fullsized":"2024-09-10T05:40:05.070657+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:05.070198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:05.070198+0000","last_clean_scrub_stamp":"2024-09-10T05:40:05.070198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:41:09.633680+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00126935,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:42.450239+0000","last_change":"2024-09-10T05:40:42.450239+0000","last_active":"2024-09-10T05:40:42.450239+0000","last_peered":"2024-09-10T05:40:42.450239+0000","last_clean":"2024-09-10T05:40:42.450239+0000","last_became_active":"2024-09-10T05:36:15.617690+0000","last_became_peered":"2024-09-10T05:36:15.617690+0000","last_unstale":"2024-09-10T05:40:42.450239+0000","last_undegraded":"2024-09-10T05:40:42.450239+0000","last_fullsized":"2024-09-10T05:40:42.450239+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:42.450063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:42.450063+0000","last_clean_scrub_stamp":"2024-09-10T05:40:42.450063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:29:06.495558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"34'22","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:46.954416+0000","last_change":"2024-09-10T05:40:46.954416+0000","last_active":"2024-09-10T05:40:46.954416+0000","last_peered":"2024-09-10T05:40:46.954416+0000","last_clean":"2024-09-10T05:40:46.954416+0000","last_became_active":"2024-09-10T05:36:17.634261+0000","last_became_peered":"2024-09-10T05:36:17.634261+0000","last_unstale":"2024-09-10T05:40:46.954416+0000","last_undegraded":"2024-09-10T05:40:46.954416+0000","last_fullsized":"2024-09-10T05:40:46.954416+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-09-10T05:40:46.954214+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-09-10T05:40:46.954214+0000","last_clean_scrub_stamp":"2024-09-10T05:40:46.954214+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:05:05.692878+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'286","reported_seq":448,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:58.934193+0000","last_change":"2024-09-10T05:40:58.934193+0000","last_active":"2024-09-10T05:40:58.934193+0000","last_peered":"2024-09-10T05:40:58.934193+0000","last_clean":"2024-09-10T05:40:58.934193+0000","last_became_active":"2024-09-10T05:36:19.672586+0000","last_became_peered":"2024-09-10T05:36:19.672586+0000","last_unstale":"2024-09-10T05:40:58.934193+0000","last_undegraded":"2024-09-10T05:40:58.934193+0000","last_fullsized":"2024-09-10T05:40:58.934193+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-10T05:40:58.934009+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-10T05:40:58.934009+0000","last_clean_scrub_stamp":"2024-09-10T05:40:58.934009+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:54:05.413635+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:41:06.221867+0000","last_change":"2024-09-10T05:41:06.221867+0000","last_active":"2024-09-10T05:41:06.221867+0000","last_peered":"2024-09-10T05:41:06.221867+0000","last_clean":"2024-09-10T05:41:06.221867+0000","last_became_active":"2024-09-10T05:36:21.668909+0000","last_became_peered":"2024-09-10T05:36:21.668909+0000","last_unstale":"2024-09-10T05:41:06.221867+0000","last_undegraded":"2024-09-10T05:41:06.221867+0000","last_fullsized":"2024-09-10T05:41:06.221867+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2024-09-10T05:41:06.221622+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2024-09-10T05:41:06.221622+0000","last_clean_scrub_stamp":"2024-09-10T05:41:06.221622+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:29.707638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'14","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:14.474283+0000","last_change":"2024-09-10T05:40:14.474129+0000","last_active":"2024-09-10T05:40:14.474283+0000","last_peered":"2024-09-10T05:40:14.474283+0000","last_clean":"2024-09-10T05:40:14.474283+0000","last_became_active":"2024-09-10T05:36:13.621703+0000","last_became_peered":"2024-09-10T05:36:13.621703+0000","last_unstale":"2024-09-10T05:40:14.474283+0000","last_undegraded":"2024-09-10T05:40:14.474283+0000","last_fullsized":"2024-09-10T05:40:14.474283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-10T05:40:14.473954+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-10T05:40:14.473954+0000","last_clean_scrub_stamp":"2024-09-10T05:40:14.473954+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:27.797592+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:08.998572+0000","last_change":"2024-09-10T05:40:08.998414+0000","last_active":"2024-09-10T05:40:08.998572+0000","last_peered":"2024-09-10T05:40:08.998572+0000","last_clean":"2024-09-10T05:40:08.998572+0000","last_became_active":"2024-09-10T05:36:11.594029+0000","last_became_peered":"2024-09-10T05:36:11.594029+0000","last_unstale":"2024-09-10T05:40:08.998572+0000","last_undegraded":"2024-09-10T05:40:08.998572+0000","last_fullsized":"2024-09-10T05:40:08.998572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:08.998240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:08.998240+0000","last_clean_scrub_stamp":"2024-09-10T05:40:08.998240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:40.972877+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:06.349490+0000","last_change":"2024-09-10T05:40:06.349353+0000","last_active":"2024-09-10T05:40:06.349490+0000","last_peered":"2024-09-10T05:40:06.349490+0000","last_clean":"2024-09-10T05:40:06.349490+0000","last_became_active":"2024-09-10T05:36:03.708884+0000","last_became_peered":"2024-09-10T05:36:03.708884+0000","last_unstale":"2024-09-10T05:40:06.349490+0000","last_undegraded":"2024-09-10T05:40:06.349490+0000","last_fullsized":"2024-09-10T05:40:06.349490+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:06.349170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:06.349170+0000","last_clean_scrub_stamp":"2024-09-10T05:40:06.349170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:46:31.673889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018824390000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:39.857195+0000","last_change":"2024-09-10T05:40:39.857195+0000","last_active":"2024-09-10T05:40:39.857195+0000","last_peered":"2024-09-10T05:40:39.857195+0000","last_clean":"2024-09-10T05:40:39.857195+0000","last_became_active":"2024-09-10T05:36:15.637890+0000","last_became_peered":"2024-09-10T05:36:15.637890+0000","last_unstale":"2024-09-10T05:40:39.857195+0000","last_undegraded":"2024-09-10T05:40:39.857195+0000","last_fullsized":"2024-09-10T05:40:39.857195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:39.856991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:39.856991+0000","last_clean_scrub_stamp":"2024-09-10T05:40:39.856991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:38:38.940634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'106","reported_seq":210,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:50.414583+0000","last_change":"2024-09-10T05:40:50.414583+0000","last_active":"2024-09-10T05:40:50.414583+0000","last_peered":"2024-09-10T05:40:50.414583+0000","last_clean":"2024-09-10T05:40:50.414583+0000","last_became_active":"2024-09-10T05:36:17.631509+0000","last_became_peered":"2024-09-10T05:36:17.631509+0000","last_unstale":"2024-09-10T05:40:50.414583+0000","last_undegraded":"2024-09-10T05:40:50.414583+0000","last_fullsized":"2024-09-10T05:40:50.414583+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'106","last_scrub_stamp":"2024-09-10T05:40:50.414466+0000","last_deep_scrub":"34'106","last_deep_scrub_stamp":"2024-09-10T05:40:50.414466+0000","last_clean_scrub_stamp":"2024-09-10T05:40:50.414466+0000","objects_scrubbed":9,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:55:04.596359+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:57.922869+0000","last_change":"2024-09-10T05:40:57.922869+0000","last_active":"2024-09-10T05:40:57.922869+0000","last_peered":"2024-09-10T05:40:57.922869+0000","last_clean":"2024-09-10T05:40:57.922869+0000","last_became_active":"2024-09-10T05:36:19.667446+0000","last_became_peered":"2024-09-10T05:36:19.667446+0000","last_unstale":"2024-09-10T05:40:57.922869+0000","last_undegraded":"2024-09-10T05:40:57.922869+0000","last_fullsized":"2024-09-10T05:40:57.922869+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:57.922691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:57.922691+0000","last_clean_scrub_stamp":"2024-09-10T05:40:57.922691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:38:15.854566+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:48.548239+0000","last_change":"2024-09-10T05:40:48.548082+0000","last_active":"2024-09-10T05:40:48.548239+0000","last_peered":"2024-09-10T05:40:48.548239+0000","last_clean":"2024-09-10T05:40:48.548239+0000","last_became_active":"2024-09-10T05:36:21.657621+0000","last_became_peered":"2024-09-10T05:36:21.657621+0000","last_unstale":"2024-09-10T05:40:48.548239+0000","last_undegraded":"2024-09-10T05:40:48.548239+0000","last_fullsized":"2024-09-10T05:40:48.548239+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:48.547898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:48.547898+0000","last_clean_scrub_stamp":"2024-09-10T05:40:48.547898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:00:53.080799+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"32'8","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:53.515720+0000","last_change":"2024-09-10T05:40:53.515720+0000","last_active":"2024-09-10T05:40:53.515720+0000","last_peered":"2024-09-10T05:40:53.515720+0000","last_clean":"2024-09-10T05:40:53.515720+0000","last_became_active":"2024-09-10T05:36:21.656563+0000","last_became_peered":"2024-09-10T05:36:21.656563+0000","last_unstale":"2024-09-10T05:40:53.515720+0000","last_undegraded":"2024-09-10T05:40:53.515720+0000","last_fullsized":"2024-09-10T05:40:53.515720+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T05:40:53.515524+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T05:40:53.515524+0000","last_clean_scrub_stamp":"2024-09-10T05:40:53.515524+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:31:48.909789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:21.548091+0000","last_change":"2024-09-10T05:40:21.547908+0000","last_active":"2024-09-10T05:40:21.548091+0000","last_peered":"2024-09-10T05:40:21.548091+0000","last_clean":"2024-09-10T05:40:21.548091+0000","last_became_active":"2024-09-10T05:36:13.620892+0000","last_became_peered":"2024-09-10T05:36:13.620892+0000","last_unstale":"2024-09-10T05:40:21.548091+0000","last_undegraded":"2024-09-10T05:40:21.548091+0000","last_fullsized":"2024-09-10T05:40:21.548091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:21.547721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:21.547721+0000","last_clean_scrub_stamp":"2024-09-10T05:40:21.547721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:53:21.051292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'6","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:16.412548+0000","last_change":"2024-09-10T05:40:16.412389+0000","last_active":"2024-09-10T05:40:16.412548+0000","last_peered":"2024-09-10T05:40:16.412548+0000","last_clean":"2024-09-10T05:40:16.412548+0000","last_became_active":"2024-09-10T05:36:11.597209+0000","last_became_peered":"2024-09-10T05:36:11.597209+0000","last_unstale":"2024-09-10T05:40:16.412548+0000","last_undegraded":"2024-09-10T05:40:16.412548+0000","last_fullsized":"2024-09-10T05:40:16.412548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T05:40:16.412205+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T05:40:16.412205+0000","last_clean_scrub_stamp":"2024-09-10T05:40:16.412205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:16.536426+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:41.154711+0000","last_change":"2024-09-10T05:40:41.154583+0000","last_active":"2024-09-10T05:40:41.154711+0000","last_peered":"2024-09-10T05:40:41.154711+0000","last_clean":"2024-09-10T05:40:41.154711+0000","last_became_active":"2024-09-10T05:36:15.617049+0000","last_became_peered":"2024-09-10T05:36:15.617049+0000","last_unstale":"2024-09-10T05:40:41.154711+0000","last_undegraded":"2024-09-10T05:40:41.154711+0000","last_fullsized":"2024-09-10T05:40:41.154711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:41.154403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:41.154403+0000","last_clean_scrub_stamp":"2024-09-10T05:40:41.154403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:08.337788+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'47","reported_seq":114,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:51.915964+0000","last_change":"2024-09-10T05:40:51.915819+0000","last_active":"2024-09-10T05:40:51.915964+0000","last_peered":"2024-09-10T05:40:51.915964+0000","last_clean":"2024-09-10T05:40:51.915964+0000","last_became_active":"2024-09-10T05:36:17.657669+0000","last_became_peered":"2024-09-10T05:36:17.657669+0000","last_unstale":"2024-09-10T05:40:51.915964+0000","last_undegraded":"2024-09-10T05:40:51.915964+0000","last_fullsized":"2024-09-10T05:40:51.915964+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'47","last_scrub_stamp":"2024-09-10T05:40:51.915605+0000","last_deep_scrub":"34'47","last_deep_scrub_stamp":"2024-09-10T05:40:51.915605+0000","last_clean_scrub_stamp":"2024-09-10T05:40:51.915605+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:00:40.832043+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:41:03.956645+0000","last_change":"2024-09-10T05:41:03.956645+0000","last_active":"2024-09-10T05:41:03.956645+0000","last_peered":"2024-09-10T05:41:03.956645+0000","last_clean":"2024-09-10T05:41:03.956645+0000","last_became_active":"2024-09-10T05:36:19.672498+0000","last_became_peered":"2024-09-10T05:36:19.672498+0000","last_unstale":"2024-09-10T05:41:03.956645+0000","last_undegraded":"2024-09-10T05:41:03.956645+0000","last_fullsized":"2024-09-10T05:41:03.956645+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:41:03.956365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:41:03.956365+0000","last_clean_scrub_stamp":"2024-09-10T05:41:03.956365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:46:13.790420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'5","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:41:15.985295+0000","last_change":"2024-09-10T05:41:15.985295+0000","last_active":"2024-09-10T05:41:15.985295+0000","last_peered":"2024-09-10T05:41:15.985295+0000","last_clean":"2024-09-10T05:41:15.985295+0000","last_became_active":"2024-09-10T05:36:21.688864+0000","last_became_peered":"2024-09-10T05:36:21.688864+0000","last_unstale":"2024-09-10T05:41:15.985295+0000","last_undegraded":"2024-09-10T05:41:15.985295+0000","last_fullsized":"2024-09-10T05:41:15.985295+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-10T05:41:15.985114+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-10T05:41:15.985114+0000","last_clean_scrub_stamp":"2024-09-10T05:41:15.985114+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:20.616977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"34'10","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:25.205113+0000","last_change":"2024-09-10T05:40:25.204938+0000","last_active":"2024-09-10T05:40:25.205113+0000","last_peered":"2024-09-10T05:40:25.205113+0000","last_clean":"2024-09-10T05:40:25.205113+0000","last_became_active":"2024-09-10T05:36:13.610883+0000","last_became_peered":"2024-09-10T05:36:13.610883+0000","last_unstale":"2024-09-10T05:40:25.205113+0000","last_undegraded":"2024-09-10T05:40:25.205113+0000","last_fullsized":"2024-09-10T05:40:25.205113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-10T05:40:25.204764+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-10T05:40:25.204764+0000","last_clean_scrub_stamp":"2024-09-10T05:40:25.204764+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:35:50.293206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:06.519698+0000","last_change":"2024-09-10T05:40:06.519495+0000","last_active":"2024-09-10T05:40:06.519698+0000","last_peered":"2024-09-10T05:40:06.519698+0000","last_clean":"2024-09-10T05:40:06.519698+0000","last_became_active":"2024-09-10T05:36:11.605259+0000","last_became_peered":"2024-09-10T05:36:11.605259+0000","last_unstale":"2024-09-10T05:40:06.519698+0000","last_undegraded":"2024-09-10T05:40:06.519698+0000","last_fullsized":"2024-09-10T05:40:06.519698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:06.519303+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:06.519303+0000","last_clean_scrub_stamp":"2024-09-10T05:40:06.519303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:41:27.502766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:42.886959+0000","last_change":"2024-09-10T05:40:42.886806+0000","last_active":"2024-09-10T05:40:42.886959+0000","last_peered":"2024-09-10T05:40:42.886959+0000","last_clean":"2024-09-10T05:40:42.886959+0000","last_became_active":"2024-09-10T05:36:15.629278+0000","last_became_peered":"2024-09-10T05:36:15.629278+0000","last_unstale":"2024-09-10T05:40:42.886959+0000","last_undegraded":"2024-09-10T05:40:42.886959+0000","last_fullsized":"2024-09-10T05:40:42.886959+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:42.886628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:42.886628+0000","last_clean_scrub_stamp":"2024-09-10T05:40:42.886628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:03:03.609286+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'9","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:50.036820+0000","last_change":"2024-09-10T05:40:50.036573+0000","last_active":"2024-09-10T05:40:50.036820+0000","last_peered":"2024-09-10T05:40:50.036820+0000","last_clean":"2024-09-10T05:40:50.036820+0000","last_became_active":"2024-09-10T05:36:17.648835+0000","last_became_peered":"2024-09-10T05:36:17.648835+0000","last_unstale":"2024-09-10T05:40:50.036820+0000","last_undegraded":"2024-09-10T05:40:50.036820+0000","last_fullsized":"2024-09-10T05:40:50.036820+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-10T05:40:50.036348+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-10T05:40:50.036348+0000","last_clean_scrub_stamp":"2024-09-10T05:40:50.036348+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:54:15.633765+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:43.512774+0000","last_change":"2024-09-10T05:40:43.512624+0000","last_active":"2024-09-10T05:40:43.512774+0000","last_peered":"2024-09-10T05:40:43.512774+0000","last_clean":"2024-09-10T05:40:43.512774+0000","last_became_active":"2024-09-10T05:36:19.637912+0000","last_became_peered":"2024-09-10T05:36:19.637912+0000","last_unstale":"2024-09-10T05:40:43.512774+0000","last_undegraded":"2024-09-10T05:40:43.512774+0000","last_fullsized":"2024-09-10T05:40:43.512774+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:43.512445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:43.512445+0000","last_clean_scrub_stamp":"2024-09-10T05:40:43.512445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:37:23.811953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:41:07.235163+0000","last_change":"2024-09-10T05:41:07.234902+0000","last_active":"2024-09-10T05:41:07.235163+0000","last_peered":"2024-09-10T05:41:07.235163+0000","last_clean":"2024-09-10T05:41:07.235163+0000","last_became_active":"2024-09-10T05:36:21.666877+0000","last_became_peered":"2024-09-10T05:36:21.666877+0000","last_unstale":"2024-09-10T05:41:07.235163+0000","last_undegraded":"2024-09-10T05:41:07.235163+0000","last_fullsized":"2024-09-10T05:41:07.235163+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:41:07.234694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:41:07.234694+0000","last_clean_scrub_stamp":"2024-09-10T05:41:07.234694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:45:14.778309+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"34'4","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:26.838801+0000","last_change":"2024-09-10T05:40:26.838639+0000","last_active":"2024-09-10T05:40:26.838801+0000","last_peered":"2024-09-10T05:40:26.838801+0000","last_clean":"2024-09-10T05:40:26.838801+0000","last_became_active":"2024-09-10T05:36:13.597857+0000","last_became_peered":"2024-09-10T05:36:13.597857+0000","last_unstale":"2024-09-10T05:40:26.838801+0000","last_undegraded":"2024-09-10T05:40:26.838801+0000","last_fullsized":"2024-09-10T05:40:26.838801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:26.838457+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:26.838457+0000","last_clean_scrub_stamp":"2024-09-10T05:40:26.838457+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:01:18.916559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:14.332397+0000","last_change":"2024-09-10T05:40:14.332224+0000","last_active":"2024-09-10T05:40:14.332397+0000","last_peered":"2024-09-10T05:40:14.332397+0000","last_clean":"2024-09-10T05:40:14.332397+0000","last_became_active":"2024-09-10T05:36:11.600603+0000","last_became_peered":"2024-09-10T05:36:11.600603+0000","last_unstale":"2024-09-10T05:40:14.332397+0000","last_undegraded":"2024-09-10T05:40:14.332397+0000","last_fullsized":"2024-09-10T05:40:14.332397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:14.332052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:14.332052+0000","last_clean_scrub_stamp":"2024-09-10T05:40:14.332052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:20:12.250167+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:46.476149+0000","last_change":"2024-09-10T05:40:46.475980+0000","last_active":"2024-09-10T05:40:46.476149+0000","last_peered":"2024-09-10T05:40:46.476149+0000","last_clean":"2024-09-10T05:40:46.476149+0000","last_became_active":"2024-09-10T05:36:15.638197+0000","last_became_peered":"2024-09-10T05:36:15.638197+0000","last_unstale":"2024-09-10T05:40:46.476149+0000","last_undegraded":"2024-09-10T05:40:46.476149+0000","last_fullsized":"2024-09-10T05:40:46.476149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:46.475798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:46.475798+0000","last_clean_scrub_stamp":"2024-09-10T05:40:46.475798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:09.961814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"34'50","reported_seq":127,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:52.888343+0000","last_change":"2024-09-10T05:40:52.888211+0000","last_active":"2024-09-10T05:40:52.888343+0000","last_peered":"2024-09-10T05:40:52.888343+0000","last_clean":"2024-09-10T05:40:52.888343+0000","last_became_active":"2024-09-10T05:36:17.646459+0000","last_became_peered":"2024-09-10T05:36:17.646459+0000","last_unstale":"2024-09-10T05:40:52.888343+0000","last_undegraded":"2024-09-10T05:40:52.888343+0000","last_fullsized":"2024-09-10T05:40:52.888343+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'50","last_scrub_stamp":"2024-09-10T05:40:52.888007+0000","last_deep_scrub":"34'50","last_deep_scrub_stamp":"2024-09-10T05:40:52.888007+0000","last_clean_scrub_stamp":"2024-09-10T05:40:52.888007+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:44:52.943536+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:55.179578+0000","last_change":"2024-09-10T05:40:55.179302+0000","last_active":"2024-09-10T05:40:55.179578+0000","last_peered":"2024-09-10T05:40:55.179578+0000","last_clean":"2024-09-10T05:40:55.179578+0000","last_became_active":"2024-09-10T05:36:19.648608+0000","last_became_peered":"2024-09-10T05:36:19.648608+0000","last_unstale":"2024-09-10T05:40:55.179578+0000","last_undegraded":"2024-09-10T05:40:55.179578+0000","last_fullsized":"2024-09-10T05:40:55.179578+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:55.179095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:55.179095+0000","last_clean_scrub_stamp":"2024-09-10T05:40:55.179095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:03:41.928212+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:41:14.978277+0000","last_change":"2024-09-10T05:41:14.978121+0000","last_active":"2024-09-10T05:41:14.978277+0000","last_peered":"2024-09-10T05:41:14.978277+0000","last_clean":"2024-09-10T05:41:14.978277+0000","last_became_active":"2024-09-10T05:36:21.683406+0000","last_became_peered":"2024-09-10T05:36:21.683406+0000","last_unstale":"2024-09-10T05:41:14.978277+0000","last_undegraded":"2024-09-10T05:41:14.978277+0000","last_fullsized":"2024-09-10T05:41:14.978277+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:41:14.977949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:41:14.977949+0000","last_clean_scrub_stamp":"2024-09-10T05:41:14.977949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:45:34.773960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'4","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:28.801034+0000","last_change":"2024-09-10T05:40:28.800763+0000","last_active":"2024-09-10T05:40:28.801034+0000","last_peered":"2024-09-10T05:40:28.801034+0000","last_clean":"2024-09-10T05:40:28.801034+0000","last_became_active":"2024-09-10T05:36:13.606903+0000","last_became_peered":"2024-09-10T05:36:13.606903+0000","last_unstale":"2024-09-10T05:40:28.801034+0000","last_undegraded":"2024-09-10T05:40:28.801034+0000","last_fullsized":"2024-09-10T05:40:28.801034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:28.800520+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:28.800520+0000","last_clean_scrub_stamp":"2024-09-10T05:40:28.800520+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:47:09.736656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:11.044412+0000","last_change":"2024-09-10T05:40:11.044271+0000","last_active":"2024-09-10T05:40:11.044412+0000","last_peered":"2024-09-10T05:40:11.044412+0000","last_clean":"2024-09-10T05:40:11.044412+0000","last_became_active":"2024-09-10T05:36:11.594653+0000","last_became_peered":"2024-09-10T05:36:11.594653+0000","last_unstale":"2024-09-10T05:40:11.044412+0000","last_undegraded":"2024-09-10T05:40:11.044412+0000","last_fullsized":"2024-09-10T05:40:11.044412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:11.044085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:11.044085+0000","last_clean_scrub_stamp":"2024-09-10T05:40:11.044085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:34.806153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"34'7","reported_seq":435,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:41.856715+0000","last_change":"2024-09-10T05:40:41.856554+0000","last_active":"2024-09-10T05:40:41.856715+0000","last_peered":"2024-09-10T05:40:41.856715+0000","last_clean":"2024-09-10T05:40:41.856715+0000","last_became_active":"2024-09-10T05:36:15.615147+0000","last_became_peered":"2024-09-10T05:36:15.615147+0000","last_unstale":"2024-09-10T05:40:41.856715+0000","last_undegraded":"2024-09-10T05:40:41.856715+0000","last_fullsized":"2024-09-10T05:40:41.856715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-10T05:40:41.856356+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-10T05:40:41.856356+0000","last_clean_scrub_stamp":"2024-09-10T05:40:41.856356+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:35.810677+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1429,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":586,"num_read_kb":586,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'37","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:57.199571+0000","last_change":"2024-09-10T05:40:57.199435+0000","last_active":"2024-09-10T05:40:57.199571+0000","last_peered":"2024-09-10T05:40:57.199571+0000","last_clean":"2024-09-10T05:40:57.199571+0000","last_became_active":"2024-09-10T05:36:17.631446+0000","last_became_peered":"2024-09-10T05:36:17.631446+0000","last_unstale":"2024-09-10T05:40:57.199571+0000","last_undegraded":"2024-09-10T05:40:57.199571+0000","last_fullsized":"2024-09-10T05:40:57.199571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-10T05:40:57.199208+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-10T05:40:57.199208+0000","last_clean_scrub_stamp":"2024-09-10T05:40:57.199208+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:50:23.979300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:44.528309+0000","last_change":"2024-09-10T05:40:44.528162+0000","last_active":"2024-09-10T05:40:44.528309+0000","last_peered":"2024-09-10T05:40:44.528309+0000","last_clean":"2024-09-10T05:40:44.528309+0000","last_became_active":"2024-09-10T05:36:19.638240+0000","last_became_peered":"2024-09-10T05:36:19.638240+0000","last_unstale":"2024-09-10T05:40:44.528309+0000","last_undegraded":"2024-09-10T05:40:44.528309+0000","last_fullsized":"2024-09-10T05:40:44.528309+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:44.527968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:44.527968+0000","last_clean_scrub_stamp":"2024-09-10T05:40:44.527968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:53:17.089615+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'8","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:25.365276+0000","last_change":"2024-09-10T05:40:25.365276+0000","last_active":"2024-09-10T05:40:25.365276+0000","last_peered":"2024-09-10T05:40:25.365276+0000","last_clean":"2024-09-10T05:40:25.365276+0000","last_became_active":"2024-09-10T05:36:13.618656+0000","last_became_peered":"2024-09-10T05:36:13.618656+0000","last_unstale":"2024-09-10T05:40:25.365276+0000","last_undegraded":"2024-09-10T05:40:25.365276+0000","last_fullsized":"2024-09-10T05:40:25.365276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T05:40:25.365088+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T05:40:25.365088+0000","last_clean_scrub_stamp":"2024-09-10T05:40:25.365088+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:55:23.978163+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:08.688955+0000","last_change":"2024-09-10T05:40:08.688775+0000","last_active":"2024-09-10T05:40:08.688955+0000","last_peered":"2024-09-10T05:40:08.688955+0000","last_clean":"2024-09-10T05:40:08.688955+0000","last_became_active":"2024-09-10T05:36:11.597710+0000","last_became_peered":"2024-09-10T05:36:11.597710+0000","last_unstale":"2024-09-10T05:40:08.688955+0000","last_undegraded":"2024-09-10T05:40:08.688955+0000","last_fullsized":"2024-09-10T05:40:08.688955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:08.688601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:08.688601+0000","last_clean_scrub_stamp":"2024-09-10T05:40:08.688601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:22:28.106904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:46.128725+0000","last_change":"2024-09-10T05:40:46.128725+0000","last_active":"2024-09-10T05:40:46.128725+0000","last_peered":"2024-09-10T05:40:46.128725+0000","last_clean":"2024-09-10T05:40:46.128725+0000","last_became_active":"2024-09-10T05:36:15.626787+0000","last_became_peered":"2024-09-10T05:36:15.626787+0000","last_unstale":"2024-09-10T05:40:46.128725+0000","last_undegraded":"2024-09-10T05:40:46.128725+0000","last_fullsized":"2024-09-10T05:40:46.128725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:46.128520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:46.128520+0000","last_clean_scrub_stamp":"2024-09-10T05:40:46.128520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:41:40.082470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"34'72","reported_seq":156,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:54.139432+0000","last_change":"2024-09-10T05:40:54.139296+0000","last_active":"2024-09-10T05:40:54.139432+0000","last_peered":"2024-09-10T05:40:54.139432+0000","last_clean":"2024-09-10T05:40:54.139432+0000","last_became_active":"2024-09-10T05:36:17.644469+0000","last_became_peered":"2024-09-10T05:36:17.644469+0000","last_unstale":"2024-09-10T05:40:54.139432+0000","last_undegraded":"2024-09-10T05:40:54.139432+0000","last_fullsized":"2024-09-10T05:40:54.139432+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'72","last_scrub_stamp":"2024-09-10T05:40:54.139106+0000","last_deep_scrub":"34'72","last_deep_scrub_stamp":"2024-09-10T05:40:54.139106+0000","last_clean_scrub_stamp":"2024-09-10T05:40:54.139106+0000","objects_scrubbed":6,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:21:20.917410+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:45.516292+0000","last_change":"2024-09-10T05:40:45.516054+0000","last_active":"2024-09-10T05:40:45.516292+0000","last_peered":"2024-09-10T05:40:45.516292+0000","last_clean":"2024-09-10T05:40:45.516292+0000","last_became_active":"2024-09-10T05:36:19.638136+0000","last_became_peered":"2024-09-10T05:36:19.638136+0000","last_unstale":"2024-09-10T05:40:45.516292+0000","last_undegraded":"2024-09-10T05:40:45.516292+0000","last_fullsized":"2024-09-10T05:40:45.516292+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:45.515827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:45.515827+0000","last_clean_scrub_stamp":"2024-09-10T05:40:45.515827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:27:58.518128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'14","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:41:11.009479+0000","last_change":"2024-09-10T05:41:11.009479+0000","last_active":"2024-09-10T05:41:11.009479+0000","last_peered":"2024-09-10T05:41:11.009479+0000","last_clean":"2024-09-10T05:41:11.009479+0000","last_became_active":"2024-09-10T05:36:21.681263+0000","last_became_peered":"2024-09-10T05:36:21.681263+0000","last_unstale":"2024-09-10T05:41:11.009479+0000","last_undegraded":"2024-09-10T05:41:11.009479+0000","last_fullsized":"2024-09-10T05:41:11.009479+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-10T05:41:11.009296+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-10T05:41:11.009296+0000","last_clean_scrub_stamp":"2024-09-10T05:41:11.009296+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:39:55.166917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"34'10","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:26.215448+0000","last_change":"2024-09-10T05:40:26.215448+0000","last_active":"2024-09-10T05:40:26.215448+0000","last_peered":"2024-09-10T05:40:26.215448+0000","last_clean":"2024-09-10T05:40:26.215448+0000","last_became_active":"2024-09-10T05:36:13.609773+0000","last_became_peered":"2024-09-10T05:36:13.609773+0000","last_unstale":"2024-09-10T05:40:26.215448+0000","last_undegraded":"2024-09-10T05:40:26.215448+0000","last_fullsized":"2024-09-10T05:40:26.215448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-10T05:40:26.215272+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-10T05:40:26.215272+0000","last_clean_scrub_stamp":"2024-09-10T05:40:26.215272+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:04:21.343533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:10.048383+0000","last_change":"2024-09-10T05:40:10.048126+0000","last_active":"2024-09-10T05:40:10.048383+0000","last_peered":"2024-09-10T05:40:10.048383+0000","last_clean":"2024-09-10T05:40:10.048383+0000","last_became_active":"2024-09-10T05:36:11.595758+0000","last_became_peered":"2024-09-10T05:36:11.595758+0000","last_unstale":"2024-09-10T05:40:10.048383+0000","last_undegraded":"2024-09-10T05:40:10.048383+0000","last_fullsized":"2024-09-10T05:40:10.048383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:10.047905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:10.047905+0000","last_clean_scrub_stamp":"2024-09-10T05:40:10.047905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:36:54.103088+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:51.365968+0000","last_change":"2024-09-10T05:40:51.365968+0000","last_active":"2024-09-10T05:40:51.365968+0000","last_peered":"2024-09-10T05:40:51.365968+0000","last_clean":"2024-09-10T05:40:51.365968+0000","last_became_active":"2024-09-10T05:36:15.613949+0000","last_became_peered":"2024-09-10T05:36:15.613949+0000","last_unstale":"2024-09-10T05:40:51.365968+0000","last_undegraded":"2024-09-10T05:40:51.365968+0000","last_fullsized":"2024-09-10T05:40:51.365968+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:51.365784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:51.365784+0000","last_clean_scrub_stamp":"2024-09-10T05:40:51.365784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:59.376119+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"34'46","reported_seq":109,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:41:01.189863+0000","last_change":"2024-09-10T05:41:01.189558+0000","last_active":"2024-09-10T05:41:01.189863+0000","last_peered":"2024-09-10T05:41:01.189863+0000","last_clean":"2024-09-10T05:41:01.189863+0000","last_became_active":"2024-09-10T05:36:17.636067+0000","last_became_peered":"2024-09-10T05:36:17.636067+0000","last_unstale":"2024-09-10T05:41:01.189863+0000","last_undegraded":"2024-09-10T05:41:01.189863+0000","last_fullsized":"2024-09-10T05:41:01.189863+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-10T05:41:01.189321+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-10T05:41:01.189321+0000","last_clean_scrub_stamp":"2024-09-10T05:41:01.189321+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:45:22.475179+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:56.180048+0000","last_change":"2024-09-10T05:40:56.179871+0000","last_active":"2024-09-10T05:40:56.180048+0000","last_peered":"2024-09-10T05:40:56.180048+0000","last_clean":"2024-09-10T05:40:56.180048+0000","last_became_active":"2024-09-10T05:36:19.665010+0000","last_became_peered":"2024-09-10T05:36:19.665010+0000","last_unstale":"2024-09-10T05:40:56.180048+0000","last_undegraded":"2024-09-10T05:40:56.180048+0000","last_fullsized":"2024-09-10T05:40:56.180048+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:56.179693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:56.179693+0000","last_clean_scrub_stamp":"2024-09-10T05:40:56.179693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:28:16.068853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:41:14.177936+0000","last_change":"2024-09-10T05:41:14.177936+0000","last_active":"2024-09-10T05:41:14.177936+0000","last_peered":"2024-09-10T05:41:14.177936+0000","last_clean":"2024-09-10T05:41:14.177936+0000","last_became_active":"2024-09-10T05:36:21.664884+0000","last_became_peered":"2024-09-10T05:36:21.664884+0000","last_unstale":"2024-09-10T05:41:14.177936+0000","last_undegraded":"2024-09-10T05:41:14.177936+0000","last_fullsized":"2024-09-10T05:41:14.177936+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:41:14.177757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:41:14.177757+0000","last_clean_scrub_stamp":"2024-09-10T05:41:14.177757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:27:53.687920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:33.849981+0000","last_change":"2024-09-10T05:40:33.849823+0000","last_active":"2024-09-10T05:40:33.849981+0000","last_peered":"2024-09-10T05:40:33.849981+0000","last_clean":"2024-09-10T05:40:33.849981+0000","last_became_active":"2024-09-10T05:36:13.616392+0000","last_became_peered":"2024-09-10T05:36:13.616392+0000","last_unstale":"2024-09-10T05:40:33.849981+0000","last_undegraded":"2024-09-10T05:40:33.849981+0000","last_fullsized":"2024-09-10T05:40:33.849981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:33.849612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:33.849612+0000","last_clean_scrub_stamp":"2024-09-10T05:40:33.849612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:50:01.897366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"34'2","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:23.407619+0000","last_change":"2024-09-10T05:40:23.407468+0000","last_active":"2024-09-10T05:40:23.407619+0000","last_peered":"2024-09-10T05:40:23.407619+0000","last_clean":"2024-09-10T05:40:23.407619+0000","last_became_active":"2024-09-10T05:36:11.595319+0000","last_became_peered":"2024-09-10T05:36:11.595319+0000","last_unstale":"2024-09-10T05:40:23.407619+0000","last_undegraded":"2024-09-10T05:40:23.407619+0000","last_fullsized":"2024-09-10T05:40:23.407619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:23.407266+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:23.407266+0000","last_clean_scrub_stamp":"2024-09-10T05:40:23.407266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:04:56.547309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:49.431601+0000","last_change":"2024-09-10T05:40:49.431425+0000","last_active":"2024-09-10T05:40:49.431601+0000","last_peered":"2024-09-10T05:40:49.431601+0000","last_clean":"2024-09-10T05:40:49.431601+0000","last_became_active":"2024-09-10T05:36:15.617595+0000","last_became_peered":"2024-09-10T05:36:15.617595+0000","last_unstale":"2024-09-10T05:40:49.431601+0000","last_undegraded":"2024-09-10T05:40:49.431601+0000","last_fullsized":"2024-09-10T05:40:49.431601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:49.431210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:49.431210+0000","last_clean_scrub_stamp":"2024-09-10T05:40:49.431210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:49:15.185193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1f","version":"34'47","reported_seq":114,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:56.972995+0000","last_change":"2024-09-10T05:40:56.972995+0000","last_active":"2024-09-10T05:40:56.972995+0000","last_peered":"2024-09-10T05:40:56.972995+0000","last_clean":"2024-09-10T05:40:56.972995+0000","last_became_active":"2024-09-10T05:36:17.634616+0000","last_became_peered":"2024-09-10T05:36:17.634616+0000","last_unstale":"2024-09-10T05:40:56.972995+0000","last_undegraded":"2024-09-10T05:40:56.972995+0000","last_fullsized":"2024-09-10T05:40:56.972995+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'47","last_scrub_stamp":"2024-09-10T05:40:56.972810+0000","last_deep_scrub":"34'47","last_deep_scrub_stamp":"2024-09-10T05:40:56.972810+0000","last_clean_scrub_stamp":"2024-09-10T05:40:56.972810+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:56:10.530415+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:57.198931+0000","last_change":"2024-09-10T05:40:57.198931+0000","last_active":"2024-09-10T05:40:57.198931+0000","last_peered":"2024-09-10T05:40:57.198931+0000","last_clean":"2024-09-10T05:40:57.198931+0000","last_became_active":"2024-09-10T05:36:19.665236+0000","last_became_peered":"2024-09-10T05:36:19.665236+0000","last_unstale":"2024-09-10T05:40:57.198931+0000","last_undegraded":"2024-09-10T05:40:57.198931+0000","last_fullsized":"2024-09-10T05:40:57.198931+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:57.198720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:57.198720+0000","last_clean_scrub_stamp":"2024-09-10T05:40:57.198720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:52:29.804612+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"34'5","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:41:12.171105+0000","last_change":"2024-09-10T05:41:12.171105+0000","last_active":"2024-09-10T05:41:12.171105+0000","last_peered":"2024-09-10T05:41:12.171105+0000","last_clean":"2024-09-10T05:41:12.171105+0000","last_became_active":"2024-09-10T05:36:21.694522+0000","last_became_peered":"2024-09-10T05:36:21.694522+0000","last_unstale":"2024-09-10T05:41:12.171105+0000","last_undegraded":"2024-09-10T05:41:12.171105+0000","last_fullsized":"2024-09-10T05:41:12.171105+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-10T05:41:12.170923+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-10T05:41:12.170923+0000","last_clean_scrub_stamp":"2024-09-10T05:41:12.170923+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:12:25.386136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"34'4","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:23.468737+0000","last_change":"2024-09-10T05:40:23.468572+0000","last_active":"2024-09-10T05:40:23.468737+0000","last_peered":"2024-09-10T05:40:23.468737+0000","last_clean":"2024-09-10T05:40:23.468737+0000","last_became_active":"2024-09-10T05:36:13.610788+0000","last_became_peered":"2024-09-10T05:36:13.610788+0000","last_unstale":"2024-09-10T05:40:23.468737+0000","last_undegraded":"2024-09-10T05:40:23.468737+0000","last_fullsized":"2024-09-10T05:40:23.468737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:23.468389+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:23.468389+0000","last_clean_scrub_stamp":"2024-09-10T05:40:23.468389+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:07.634792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"32'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:12.774121+0000","last_change":"2024-09-10T05:40:12.773984+0000","last_active":"2024-09-10T05:40:12.774121+0000","last_peered":"2024-09-10T05:40:12.774121+0000","last_clean":"2024-09-10T05:40:12.774121+0000","last_became_active":"2024-09-10T05:36:11.600655+0000","last_became_peered":"2024-09-10T05:36:11.600655+0000","last_unstale":"2024-09-10T05:40:12.774121+0000","last_undegraded":"2024-09-10T05:40:12.774121+0000","last_fullsized":"2024-09-10T05:40:12.774121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T05:40:12.773793+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T05:40:12.773793+0000","last_clean_scrub_stamp":"2024-09-10T05:40:12.773793+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:00:18.439768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:45.151123+0000","last_change":"2024-09-10T05:40:45.150973+0000","last_active":"2024-09-10T05:40:45.151123+0000","last_peered":"2024-09-10T05:40:45.151123+0000","last_clean":"2024-09-10T05:40:45.151123+0000","last_became_active":"2024-09-10T05:36:15.623436+0000","last_became_peered":"2024-09-10T05:36:15.623436+0000","last_unstale":"2024-09-10T05:40:45.151123+0000","last_undegraded":"2024-09-10T05:40:45.151123+0000","last_fullsized":"2024-09-10T05:40:45.151123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:45.150793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:45.150793+0000","last_clean_scrub_stamp":"2024-09-10T05:40:45.150793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:24.710984+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'22","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:55.937705+0000","last_change":"2024-09-10T05:40:55.937705+0000","last_active":"2024-09-10T05:40:55.937705+0000","last_peered":"2024-09-10T05:40:55.937705+0000","last_clean":"2024-09-10T05:40:55.937705+0000","last_became_active":"2024-09-10T05:36:17.638408+0000","last_became_peered":"2024-09-10T05:36:17.638408+0000","last_unstale":"2024-09-10T05:40:55.937705+0000","last_undegraded":"2024-09-10T05:40:55.937705+0000","last_fullsized":"2024-09-10T05:40:55.937705+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-09-10T05:40:55.937512+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-09-10T05:40:55.937512+0000","last_clean_scrub_stamp":"2024-09-10T05:40:55.937512+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:20:52.761603+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'286","reported_seq":436,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:41:11.153837+0000","last_change":"2024-09-10T05:41:11.153837+0000","last_active":"2024-09-10T05:41:11.153837+0000","last_peered":"2024-09-10T05:41:11.153837+0000","last_clean":"2024-09-10T05:41:11.153837+0000","last_became_active":"2024-09-10T05:36:19.649079+0000","last_became_peered":"2024-09-10T05:36:19.649079+0000","last_unstale":"2024-09-10T05:41:11.153837+0000","last_undegraded":"2024-09-10T05:41:11.153837+0000","last_fullsized":"2024-09-10T05:41:11.153837+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-10T05:41:11.153618+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-10T05:41:11.153618+0000","last_clean_scrub_stamp":"2024-09-10T05:41:11.153618+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:00.450987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:41:10.158072+0000","last_change":"2024-09-10T05:41:10.158072+0000","last_active":"2024-09-10T05:41:10.158072+0000","last_peered":"2024-09-10T05:41:10.158072+0000","last_clean":"2024-09-10T05:41:10.158072+0000","last_became_active":"2024-09-10T05:36:21.665112+0000","last_became_peered":"2024-09-10T05:36:21.665112+0000","last_unstale":"2024-09-10T05:41:10.158072+0000","last_undegraded":"2024-09-10T05:41:10.158072+0000","last_fullsized":"2024-09-10T05:41:10.158072+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:41:10.157898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:41:10.157898+0000","last_clean_scrub_stamp":"2024-09-10T05:41:10.157898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:28:40.152833+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"32'8","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:22.502214+0000","last_change":"2024-09-10T05:40:22.502077+0000","last_active":"2024-09-10T05:40:22.502214+0000","last_peered":"2024-09-10T05:40:22.502214+0000","last_clean":"2024-09-10T05:40:22.502214+0000","last_became_active":"2024-09-10T05:36:13.614222+0000","last_became_peered":"2024-09-10T05:36:13.614222+0000","last_unstale":"2024-09-10T05:40:22.502214+0000","last_undegraded":"2024-09-10T05:40:22.502214+0000","last_fullsized":"2024-09-10T05:40:22.502214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T05:40:22.501876+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T05:40:22.501876+0000","last_clean_scrub_stamp":"2024-09-10T05:40:22.501876+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:38.894156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'4","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:12.065491+0000","last_change":"2024-09-10T05:40:12.065325+0000","last_active":"2024-09-10T05:40:12.065491+0000","last_peered":"2024-09-10T05:40:12.065491+0000","last_clean":"2024-09-10T05:40:12.065491+0000","last_became_active":"2024-09-10T05:36:11.592805+0000","last_became_peered":"2024-09-10T05:36:11.592805+0000","last_unstale":"2024-09-10T05:40:12.065491+0000","last_undegraded":"2024-09-10T05:40:12.065491+0000","last_fullsized":"2024-09-10T05:40:12.065491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:12.065148+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:12.065148+0000","last_clean_scrub_stamp":"2024-09-10T05:40:12.065148+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:52:44.626794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:44.142949+0000","last_change":"2024-09-10T05:40:44.142808+0000","last_active":"2024-09-10T05:40:44.142949+0000","last_peered":"2024-09-10T05:40:44.142949+0000","last_clean":"2024-09-10T05:40:44.142949+0000","last_became_active":"2024-09-10T05:36:15.620288+0000","last_became_peered":"2024-09-10T05:36:15.620288+0000","last_unstale":"2024-09-10T05:40:44.142949+0000","last_undegraded":"2024-09-10T05:40:44.142949+0000","last_fullsized":"2024-09-10T05:40:44.142949+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:44.142623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:44.142623+0000","last_clean_scrub_stamp":"2024-09-10T05:40:44.142623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:42:35.173358+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'74","reported_seq":161,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:59.181074+0000","last_change":"2024-09-10T05:40:59.180939+0000","last_active":"2024-09-10T05:40:59.181074+0000","last_peered":"2024-09-10T05:40:59.181074+0000","last_clean":"2024-09-10T05:40:59.181074+0000","last_became_active":"2024-09-10T05:36:17.651364+0000","last_became_peered":"2024-09-10T05:36:17.651364+0000","last_unstale":"2024-09-10T05:40:59.181074+0000","last_undegraded":"2024-09-10T05:40:59.181074+0000","last_fullsized":"2024-09-10T05:40:59.181074+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'74","last_scrub_stamp":"2024-09-10T05:40:59.180739+0000","last_deep_scrub":"34'74","last_deep_scrub_stamp":"2024-09-10T05:40:59.180739+0000","last_clean_scrub_stamp":"2024-09-10T05:40:59.180739+0000","objects_scrubbed":11,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:19:24.729828+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:41:06.933287+0000","last_change":"2024-09-10T05:41:06.933111+0000","last_active":"2024-09-10T05:41:06.933287+0000","last_peered":"2024-09-10T05:41:06.933287+0000","last_clean":"2024-09-10T05:41:06.933287+0000","last_became_active":"2024-09-10T05:36:19.658646+0000","last_became_peered":"2024-09-10T05:36:19.658646+0000","last_unstale":"2024-09-10T05:41:06.933287+0000","last_undegraded":"2024-09-10T05:41:06.933287+0000","last_fullsized":"2024-09-10T05:41:06.933287+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:41:06.932937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:41:06.932937+0000","last_clean_scrub_stamp":"2024-09-10T05:41:06.932937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:59:25.733355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"34'5","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:41:15.183417+0000","last_change":"2024-09-10T05:41:15.183417+0000","last_active":"2024-09-10T05:41:15.183417+0000","last_peered":"2024-09-10T05:41:15.183417+0000","last_clean":"2024-09-10T05:41:15.183417+0000","last_became_active":"2024-09-10T05:36:21.688695+0000","last_became_peered":"2024-09-10T05:36:21.688695+0000","last_unstale":"2024-09-10T05:41:15.183417+0000","last_undegraded":"2024-09-10T05:41:15.183417+0000","last_fullsized":"2024-09-10T05:41:15.183417+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-10T05:41:15.183217+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-10T05:41:15.183217+0000","last_clean_scrub_stamp":"2024-09-10T05:41:15.183217+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:21:31.269386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"34'4","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:29.383756+0000","last_change":"2024-09-10T05:40:29.383586+0000","last_active":"2024-09-10T05:40:29.383756+0000","last_peered":"2024-09-10T05:40:29.383756+0000","last_clean":"2024-09-10T05:40:29.383756+0000","last_became_active":"2024-09-10T05:36:13.615340+0000","last_became_peered":"2024-09-10T05:36:13.615340+0000","last_unstale":"2024-09-10T05:40:29.383756+0000","last_undegraded":"2024-09-10T05:40:29.383756+0000","last_fullsized":"2024-09-10T05:40:29.383756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:29.383350+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:29.383350+0000","last_clean_scrub_stamp":"2024-09-10T05:40:29.383350+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:11:46.571874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"30'2","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:17.453897+0000","last_change":"2024-09-10T05:40:17.453722+0000","last_active":"2024-09-10T05:40:17.453897+0000","last_peered":"2024-09-10T05:40:17.453897+0000","last_clean":"2024-09-10T05:40:17.453897+0000","last_became_active":"2024-09-10T05:36:11.597360+0000","last_became_peered":"2024-09-10T05:36:11.597360+0000","last_unstale":"2024-09-10T05:40:17.453897+0000","last_undegraded":"2024-09-10T05:40:17.453897+0000","last_fullsized":"2024-09-10T05:40:17.453897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-10T05:40:17.453532+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-10T05:40:17.453532+0000","last_clean_scrub_stamp":"2024-09-10T05:40:17.453532+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:04:31.620004+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:48.480573+0000","last_change":"2024-09-10T05:40:48.480286+0000","last_active":"2024-09-10T05:40:48.480573+0000","last_peered":"2024-09-10T05:40:48.480573+0000","last_clean":"2024-09-10T05:40:48.480573+0000","last_became_active":"2024-09-10T05:36:15.619849+0000","last_became_peered":"2024-09-10T05:36:15.619849+0000","last_unstale":"2024-09-10T05:40:48.480573+0000","last_undegraded":"2024-09-10T05:40:48.480573+0000","last_fullsized":"2024-09-10T05:40:48.480573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:48.480069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:48.480069+0000","last_clean_scrub_stamp":"2024-09-10T05:40:48.480069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:01:42.309353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"34'45","reported_seq":111,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:39.497173+0000","last_change":"2024-09-10T05:40:39.497036+0000","last_active":"2024-09-10T05:40:39.497173+0000","last_peered":"2024-09-10T05:40:39.497173+0000","last_clean":"2024-09-10T05:40:39.497173+0000","last_became_active":"2024-09-10T05:36:17.646780+0000","last_became_peered":"2024-09-10T05:36:17.646780+0000","last_unstale":"2024-09-10T05:40:39.497173+0000","last_undegraded":"2024-09-10T05:40:39.497173+0000","last_fullsized":"2024-09-10T05:40:39.497173+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'45","last_scrub_stamp":"2024-09-10T05:40:39.496818+0000","last_deep_scrub":"34'45","last_deep_scrub_stamp":"2024-09-10T05:40:39.496818+0000","last_clean_scrub_stamp":"2024-09-10T05:40:39.496818+0000","objects_scrubbed":5,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:56:18.167230+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:41:07.228303+0000","last_change":"2024-09-10T05:41:07.228163+0000","last_active":"2024-09-10T05:41:07.228303+0000","last_peered":"2024-09-10T05:41:07.228303+0000","last_clean":"2024-09-10T05:41:07.228303+0000","last_became_active":"2024-09-10T05:36:19.652114+0000","last_became_peered":"2024-09-10T05:36:19.652114+0000","last_unstale":"2024-09-10T05:41:07.228303+0000","last_undegraded":"2024-09-10T05:41:07.228303+0000","last_fullsized":"2024-09-10T05:41:07.228303+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:41:07.227975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:41:07.227975+0000","last_clean_scrub_stamp":"2024-09-10T05:41:07.227975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:48:58.271053+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.16","version":"34'2","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:41:12.950064+0000","last_change":"2024-09-10T05:41:12.949887+0000","last_active":"2024-09-10T05:41:12.950064+0000","last_peered":"2024-09-10T05:41:12.950064+0000","last_clean":"2024-09-10T05:41:12.950064+0000","last_became_active":"2024-09-10T05:36:21.692564+0000","last_became_peered":"2024-09-10T05:36:21.692564+0000","last_unstale":"2024-09-10T05:41:12.950064+0000","last_undegraded":"2024-09-10T05:41:12.950064+0000","last_fullsized":"2024-09-10T05:41:12.950064+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:41:12.949675+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:41:12.949675+0000","last_clean_scrub_stamp":"2024-09-10T05:41:12.949675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:46:26.049194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:31.814778+0000","last_change":"2024-09-10T05:40:31.814481+0000","last_active":"2024-09-10T05:40:31.814778+0000","last_peered":"2024-09-10T05:40:31.814778+0000","last_clean":"2024-09-10T05:40:31.814778+0000","last_became_active":"2024-09-10T05:36:13.600225+0000","last_became_peered":"2024-09-10T05:36:13.600225+0000","last_unstale":"2024-09-10T05:40:31.814778+0000","last_undegraded":"2024-09-10T05:40:31.814778+0000","last_fullsized":"2024-09-10T05:40:31.814778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T05:40:31.814262+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T05:40:31.814262+0000","last_clean_scrub_stamp":"2024-09-10T05:40:31.814262+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:47:13.698886+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:09.683197+0000","last_change":"2024-09-10T05:40:09.683066+0000","last_active":"2024-09-10T05:40:09.683197+0000","last_peered":"2024-09-10T05:40:09.683197+0000","last_clean":"2024-09-10T05:40:09.683197+0000","last_became_active":"2024-09-10T05:36:11.600598+0000","last_became_peered":"2024-09-10T05:36:11.600598+0000","last_unstale":"2024-09-10T05:40:09.683197+0000","last_undegraded":"2024-09-10T05:40:09.683197+0000","last_fullsized":"2024-09-10T05:40:09.683197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:09.682886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:09.682886+0000","last_clean_scrub_stamp":"2024-09-10T05:40:09.682886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:07.178758+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:42.112288+0000","last_change":"2024-09-10T05:40:42.112135+0000","last_active":"2024-09-10T05:40:42.112288+0000","last_peered":"2024-09-10T05:40:42.112288+0000","last_clean":"2024-09-10T05:40:42.112288+0000","last_became_active":"2024-09-10T05:36:15.634465+0000","last_became_peered":"2024-09-10T05:36:15.634465+0000","last_unstale":"2024-09-10T05:40:42.112288+0000","last_undegraded":"2024-09-10T05:40:42.112288+0000","last_fullsized":"2024-09-10T05:40:42.112288+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:42.111930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:42.111930+0000","last_clean_scrub_stamp":"2024-09-10T05:40:42.111930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:08:44.803427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'39","reported_seq":103,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:53.931165+0000","last_change":"2024-09-10T05:40:53.931027+0000","last_active":"2024-09-10T05:40:53.931165+0000","last_peered":"2024-09-10T05:40:53.931165+0000","last_clean":"2024-09-10T05:40:53.931165+0000","last_became_active":"2024-09-10T05:36:17.634874+0000","last_became_peered":"2024-09-10T05:36:17.634874+0000","last_unstale":"2024-09-10T05:40:53.931165+0000","last_undegraded":"2024-09-10T05:40:53.931165+0000","last_fullsized":"2024-09-10T05:40:53.931165+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'39","last_scrub_stamp":"2024-09-10T05:40:53.930836+0000","last_deep_scrub":"34'39","last_deep_scrub_stamp":"2024-09-10T05:40:53.930836+0000","last_clean_scrub_stamp":"2024-09-10T05:40:53.930836+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:42:45.436023+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:41:09.196910+0000","last_change":"2024-09-10T05:41:09.196775+0000","last_active":"2024-09-10T05:41:09.196910+0000","last_peered":"2024-09-10T05:41:09.196910+0000","last_clean":"2024-09-10T05:41:09.196910+0000","last_became_active":"2024-09-10T05:36:19.637682+0000","last_became_peered":"2024-09-10T05:36:19.637682+0000","last_unstale":"2024-09-10T05:41:09.196910+0000","last_undegraded":"2024-09-10T05:41:09.196910+0000","last_fullsized":"2024-09-10T05:41:09.196910+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:41:09.196596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:41:09.196596+0000","last_clean_scrub_stamp":"2024-09-10T05:41:09.196596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:43:58.349704+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"34'4","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:41:11.977757+0000","last_change":"2024-09-10T05:41:11.977554+0000","last_active":"2024-09-10T05:41:11.977757+0000","last_peered":"2024-09-10T05:41:11.977757+0000","last_clean":"2024-09-10T05:41:11.977757+0000","last_became_active":"2024-09-10T05:36:21.688046+0000","last_became_peered":"2024-09-10T05:36:21.688046+0000","last_unstale":"2024-09-10T05:41:11.977757+0000","last_undegraded":"2024-09-10T05:41:11.977757+0000","last_fullsized":"2024-09-10T05:41:11.977757+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:41:11.977382+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:41:11.977382+0000","last_clean_scrub_stamp":"2024-09-10T05:41:11.977382+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:57:07.632113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:28.343027+0000","last_change":"2024-09-10T05:40:28.342899+0000","last_active":"2024-09-10T05:40:28.343027+0000","last_peered":"2024-09-10T05:40:28.343027+0000","last_clean":"2024-09-10T05:40:28.343027+0000","last_became_active":"2024-09-10T05:36:13.611864+0000","last_became_peered":"2024-09-10T05:36:13.611864+0000","last_unstale":"2024-09-10T05:40:28.343027+0000","last_undegraded":"2024-09-10T05:40:28.343027+0000","last_fullsized":"2024-09-10T05:40:28.343027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T05:40:28.342719+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T05:40:28.342719+0000","last_clean_scrub_stamp":"2024-09-10T05:40:28.342719+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:50:09.925425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"32'3","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:13.027528+0000","last_change":"2024-09-10T05:40:13.027402+0000","last_active":"2024-09-10T05:40:13.027528+0000","last_peered":"2024-09-10T05:40:13.027528+0000","last_clean":"2024-09-10T05:40:13.027528+0000","last_became_active":"2024-09-10T05:36:11.594949+0000","last_became_peered":"2024-09-10T05:36:11.594949+0000","last_unstale":"2024-09-10T05:40:13.027528+0000","last_undegraded":"2024-09-10T05:40:13.027528+0000","last_fullsized":"2024-09-10T05:40:13.027528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-10T05:40:13.027220+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-10T05:40:13.027220+0000","last_clean_scrub_stamp":"2024-09-10T05:40:13.027220+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:48:42.771696+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'3","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:43.109956+0000","last_change":"2024-09-10T05:40:43.109826+0000","last_active":"2024-09-10T05:40:43.109956+0000","last_peered":"2024-09-10T05:40:43.109956+0000","last_clean":"2024-09-10T05:40:43.109956+0000","last_became_active":"2024-09-10T05:36:15.618169+0000","last_became_peered":"2024-09-10T05:36:15.618169+0000","last_unstale":"2024-09-10T05:40:43.109956+0000","last_undegraded":"2024-09-10T05:40:43.109956+0000","last_fullsized":"2024-09-10T05:40:43.109956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-10T05:40:43.109616+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-10T05:40:43.109616+0000","last_clean_scrub_stamp":"2024-09-10T05:40:43.109616+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:05:16.249660+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'57","reported_seq":131,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:41:02.218512+0000","last_change":"2024-09-10T05:41:02.218358+0000","last_active":"2024-09-10T05:41:02.218512+0000","last_peered":"2024-09-10T05:41:02.218512+0000","last_clean":"2024-09-10T05:41:02.218512+0000","last_became_active":"2024-09-10T05:36:17.631194+0000","last_became_peered":"2024-09-10T05:36:17.631194+0000","last_unstale":"2024-09-10T05:41:02.218512+0000","last_undegraded":"2024-09-10T05:41:02.218512+0000","last_fullsized":"2024-09-10T05:41:02.218512+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'57","last_scrub_stamp":"2024-09-10T05:41:02.218141+0000","last_deep_scrub":"34'57","last_deep_scrub_stamp":"2024-09-10T05:41:02.218141+0000","last_clean_scrub_stamp":"2024-09-10T05:41:02.218141+0000","objects_scrubbed":7,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:34:38.794126+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":64,"num_read_kb":76,"num_write":36,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1270,"num_omap_keys":6,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:47.592122+0000","last_change":"2024-09-10T05:40:47.591951+0000","last_active":"2024-09-10T05:40:47.592122+0000","last_peered":"2024-09-10T05:40:47.592122+0000","last_clean":"2024-09-10T05:40:47.592122+0000","last_became_active":"2024-09-10T05:36:19.636483+0000","last_became_peered":"2024-09-10T05:36:19.636483+0000","last_unstale":"2024-09-10T05:40:47.592122+0000","last_undegraded":"2024-09-10T05:40:47.592122+0000","last_fullsized":"2024-09-10T05:40:47.592122+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:47.591770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:47.591770+0000","last_clean_scrub_stamp":"2024-09-10T05:40:47.591770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:35:40.910769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"34'8","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:41:13.189296+0000","last_change":"2024-09-10T05:41:13.189296+0000","last_active":"2024-09-10T05:41:13.189296+0000","last_peered":"2024-09-10T05:41:13.189296+0000","last_clean":"2024-09-10T05:41:13.189296+0000","last_became_active":"2024-09-10T05:36:21.688818+0000","last_became_peered":"2024-09-10T05:36:21.688818+0000","last_unstale":"2024-09-10T05:41:13.189296+0000","last_undegraded":"2024-09-10T05:41:13.189296+0000","last_fullsized":"2024-09-10T05:41:13.189296+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-10T05:41:13.189111+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-10T05:41:13.189111+0000","last_clean_scrub_stamp":"2024-09-10T05:41:13.189111+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:12:40.146566+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":19,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"34'8","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:29.160600+0000","last_change":"2024-09-10T05:40:29.160453+0000","last_active":"2024-09-10T05:40:29.160600+0000","last_peered":"2024-09-10T05:40:29.160600+0000","last_clean":"2024-09-10T05:40:29.160600+0000","last_became_active":"2024-09-10T05:36:13.618260+0000","last_became_peered":"2024-09-10T05:36:13.618260+0000","last_unstale":"2024-09-10T05:40:29.160600+0000","last_undegraded":"2024-09-10T05:40:29.160600+0000","last_fullsized":"2024-09-10T05:40:29.160600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-10T05:40:29.160278+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-10T05:40:29.160278+0000","last_clean_scrub_stamp":"2024-09-10T05:40:29.160278+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:55:42.355372+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:05.545029+0000","last_change":"2024-09-10T05:40:05.544869+0000","last_active":"2024-09-10T05:40:05.545029+0000","last_peered":"2024-09-10T05:40:05.545029+0000","last_clean":"2024-09-10T05:40:05.545029+0000","last_became_active":"2024-09-10T05:36:11.603738+0000","last_became_peered":"2024-09-10T05:36:11.603738+0000","last_unstale":"2024-09-10T05:40:05.545029+0000","last_undegraded":"2024-09-10T05:40:05.545029+0000","last_fullsized":"2024-09-10T05:40:05.545029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:05.544682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:05.544682+0000","last_clean_scrub_stamp":"2024-09-10T05:40:05.544682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:49:54.654103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'14","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:30.165195+0000","last_change":"2024-09-10T05:40:30.165018+0000","last_active":"2024-09-10T05:40:30.165195+0000","last_peered":"2024-09-10T05:40:30.165195+0000","last_clean":"2024-09-10T05:40:30.165195+0000","last_became_active":"2024-09-10T05:36:13.624460+0000","last_became_peered":"2024-09-10T05:36:13.624460+0000","last_unstale":"2024-09-10T05:40:30.165195+0000","last_undegraded":"2024-09-10T05:40:30.165195+0000","last_fullsized":"2024-09-10T05:40:30.165195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-10T05:40:30.164829+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-10T05:40:30.164829+0000","last_clean_scrub_stamp":"2024-09-10T05:40:30.164829+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:29:41.992659+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":58,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:07.495701+0000","last_change":"2024-09-10T05:40:07.495530+0000","last_active":"2024-09-10T05:40:07.495701+0000","last_peered":"2024-09-10T05:40:07.495701+0000","last_clean":"2024-09-10T05:40:07.495701+0000","last_became_active":"2024-09-10T05:36:11.601762+0000","last_became_peered":"2024-09-10T05:36:11.601762+0000","last_unstale":"2024-09-10T05:40:07.495701+0000","last_undegraded":"2024-09-10T05:40:07.495701+0000","last_fullsized":"2024-09-10T05:40:07.495701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:07.495353+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:07.495353+0000","last_clean_scrub_stamp":"2024-09-10T05:40:07.495353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:18:59.814823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"34'20","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:34.439775+0000","last_change":"2024-09-10T05:40:34.439775+0000","last_active":"2024-09-10T05:40:34.439775+0000","last_peered":"2024-09-10T05:40:34.439775+0000","last_clean":"2024-09-10T05:40:34.439775+0000","last_became_active":"2024-09-10T05:36:13.614221+0000","last_became_peered":"2024-09-10T05:36:13.614221+0000","last_unstale":"2024-09-10T05:40:34.439775+0000","last_undegraded":"2024-09-10T05:40:34.439775+0000","last_fullsized":"2024-09-10T05:40:34.439775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'20","last_scrub_stamp":"2024-09-10T05:40:34.439594+0000","last_deep_scrub":"34'20","last_deep_scrub_stamp":"2024-09-10T05:40:34.439594+0000","last_clean_scrub_stamp":"2024-09-10T05:40:34.439594+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:21:01.217898+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":66,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:10.730272+0000","last_change":"2024-09-10T05:40:10.730128+0000","last_active":"2024-09-10T05:40:10.730272+0000","last_peered":"2024-09-10T05:40:10.730272+0000","last_clean":"2024-09-10T05:40:10.730272+0000","last_became_active":"2024-09-10T05:36:11.601269+0000","last_became_peered":"2024-09-10T05:36:11.601269+0000","last_unstale":"2024-09-10T05:40:10.730272+0000","last_undegraded":"2024-09-10T05:40:10.730272+0000","last_fullsized":"2024-09-10T05:40:10.730272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:10.729946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:10.729946+0000","last_clean_scrub_stamp":"2024-09-10T05:40:10.729946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:23.818687+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'22","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:28.165310+0000","last_change":"2024-09-10T05:40:28.165073+0000","last_active":"2024-09-10T05:40:28.165310+0000","last_peered":"2024-09-10T05:40:28.165310+0000","last_clean":"2024-09-10T05:40:28.165310+0000","last_became_active":"2024-09-10T05:36:13.626022+0000","last_became_peered":"2024-09-10T05:36:13.626022+0000","last_unstale":"2024-09-10T05:40:28.165310+0000","last_undegraded":"2024-09-10T05:40:28.165310+0000","last_fullsized":"2024-09-10T05:40:28.165310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-09-10T05:40:28.164834+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-09-10T05:40:28.164834+0000","last_clean_scrub_stamp":"2024-09-10T05:40:28.164834+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:36.827007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":48,"num_read_kb":40,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:08.499166+0000","last_change":"2024-09-10T05:40:08.498960+0000","last_active":"2024-09-10T05:40:08.499166+0000","last_peered":"2024-09-10T05:40:08.499166+0000","last_clean":"2024-09-10T05:40:08.499166+0000","last_became_active":"2024-09-10T05:36:11.610933+0000","last_became_peered":"2024-09-10T05:36:11.610933+0000","last_unstale":"2024-09-10T05:40:08.499166+0000","last_undegraded":"2024-09-10T05:40:08.499166+0000","last_fullsized":"2024-09-10T05:40:08.499166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:08.498772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:08.498772+0000","last_clean_scrub_stamp":"2024-09-10T05:40:08.498772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:52:48.692131+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"34'14","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:34.804203+0000","last_change":"2024-09-10T05:40:34.804203+0000","last_active":"2024-09-10T05:40:34.804203+0000","last_peered":"2024-09-10T05:40:34.804203+0000","last_clean":"2024-09-10T05:40:34.804203+0000","last_became_active":"2024-09-10T05:36:13.597975+0000","last_became_peered":"2024-09-10T05:36:13.597975+0000","last_unstale":"2024-09-10T05:40:34.804203+0000","last_undegraded":"2024-09-10T05:40:34.804203+0000","last_fullsized":"2024-09-10T05:40:34.804203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-10T05:40:34.804027+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-10T05:40:34.804027+0000","last_clean_scrub_stamp":"2024-09-10T05:40:34.804027+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:55.230805+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"34'2","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:13.780147+0000","last_change":"2024-09-10T05:40:13.779908+0000","last_active":"2024-09-10T05:40:13.780147+0000","last_peered":"2024-09-10T05:40:13.780147+0000","last_clean":"2024-09-10T05:40:13.780147+0000","last_became_active":"2024-09-10T05:36:11.603085+0000","last_became_peered":"2024-09-10T05:36:11.603085+0000","last_unstale":"2024-09-10T05:40:13.780147+0000","last_undegraded":"2024-09-10T05:40:13.780147+0000","last_fullsized":"2024-09-10T05:40:13.780147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:13.779687+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:13.779687+0000","last_clean_scrub_stamp":"2024-09-10T05:40:13.779687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:21:43.655717+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:27.184735+0000","last_change":"2024-09-10T05:40:27.184735+0000","last_active":"2024-09-10T05:40:27.184735+0000","last_peered":"2024-09-10T05:40:27.184735+0000","last_clean":"2024-09-10T05:40:27.184735+0000","last_became_active":"2024-09-10T05:36:13.610894+0000","last_became_peered":"2024-09-10T05:36:13.610894+0000","last_unstale":"2024-09-10T05:40:27.184735+0000","last_undegraded":"2024-09-10T05:40:27.184735+0000","last_fullsized":"2024-09-10T05:40:27.184735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:27.184546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:27.184546+0000","last_clean_scrub_stamp":"2024-09-10T05:40:27.184546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:46:52.509265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:14.059086+0000","last_change":"2024-09-10T05:40:14.058953+0000","last_active":"2024-09-10T05:40:14.059086+0000","last_peered":"2024-09-10T05:40:14.059086+0000","last_clean":"2024-09-10T05:40:14.059086+0000","last_became_active":"2024-09-10T05:36:11.592809+0000","last_became_peered":"2024-09-10T05:36:11.592809+0000","last_unstale":"2024-09-10T05:40:14.059086+0000","last_undegraded":"2024-09-10T05:40:14.059086+0000","last_fullsized":"2024-09-10T05:40:14.059086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:14.058768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:14.058768+0000","last_clean_scrub_stamp":"2024-09-10T05:40:14.058768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:44.630239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'6","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:32.827471+0000","last_change":"2024-09-10T05:40:32.827471+0000","last_active":"2024-09-10T05:40:32.827471+0000","last_peered":"2024-09-10T05:40:32.827471+0000","last_clean":"2024-09-10T05:40:32.827471+0000","last_became_active":"2024-09-10T05:36:13.607052+0000","last_became_peered":"2024-09-10T05:36:13.607052+0000","last_unstale":"2024-09-10T05:40:32.827471+0000","last_undegraded":"2024-09-10T05:40:32.827471+0000","last_fullsized":"2024-09-10T05:40:32.827471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T05:40:32.827295+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T05:40:32.827295+0000","last_clean_scrub_stamp":"2024-09-10T05:40:32.827295+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:41:56.575014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"32'2","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:09.533820+0000","last_change":"2024-09-10T05:40:09.533645+0000","last_active":"2024-09-10T05:40:09.533820+0000","last_peered":"2024-09-10T05:40:09.533820+0000","last_clean":"2024-09-10T05:40:09.533820+0000","last_became_active":"2024-09-10T05:36:11.593614+0000","last_became_peered":"2024-09-10T05:36:11.593614+0000","last_unstale":"2024-09-10T05:40:09.533820+0000","last_undegraded":"2024-09-10T05:40:09.533820+0000","last_fullsized":"2024-09-10T05:40:09.533820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T05:40:09.533454+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T05:40:09.533454+0000","last_clean_scrub_stamp":"2024-09-10T05:40:09.533454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:03:38.053067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:31.431004+0000","last_change":"2024-09-10T05:40:31.431004+0000","last_active":"2024-09-10T05:40:31.431004+0000","last_peered":"2024-09-10T05:40:31.431004+0000","last_clean":"2024-09-10T05:40:31.431004+0000","last_became_active":"2024-09-10T05:36:13.593693+0000","last_became_peered":"2024-09-10T05:36:13.593693+0000","last_unstale":"2024-09-10T05:40:31.431004+0000","last_undegraded":"2024-09-10T05:40:31.431004+0000","last_fullsized":"2024-09-10T05:40:31.431004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:31.430822+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:31.430822+0000","last_clean_scrub_stamp":"2024-09-10T05:40:31.430822+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:12.717581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"34'8","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:14.767670+0000","last_change":"2024-09-10T05:40:14.767528+0000","last_active":"2024-09-10T05:40:14.767670+0000","last_peered":"2024-09-10T05:40:14.767670+0000","last_clean":"2024-09-10T05:40:14.767670+0000","last_became_active":"2024-09-10T05:36:11.604011+0000","last_became_peered":"2024-09-10T05:36:11.604011+0000","last_unstale":"2024-09-10T05:40:14.767670+0000","last_undegraded":"2024-09-10T05:40:14.767670+0000","last_fullsized":"2024-09-10T05:40:14.767670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-10T05:40:14.767349+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-10T05:40:14.767349+0000","last_clean_scrub_stamp":"2024-09-10T05:40:14.767349+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:21:09.642300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":24,"num_write_kb":12289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"34'16","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:33.141932+0000","last_change":"2024-09-10T05:40:33.141794+0000","last_active":"2024-09-10T05:40:33.141932+0000","last_peered":"2024-09-10T05:40:33.141932+0000","last_clean":"2024-09-10T05:40:33.141932+0000","last_became_active":"2024-09-10T05:36:13.629760+0000","last_became_peered":"2024-09-10T05:36:13.629760+0000","last_unstale":"2024-09-10T05:40:33.141932+0000","last_undegraded":"2024-09-10T05:40:33.141932+0000","last_fullsized":"2024-09-10T05:40:33.141932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-10T05:40:33.141579+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-10T05:40:33.141579+0000","last_clean_scrub_stamp":"2024-09-10T05:40:33.141579+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:13:56.723961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":66,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:15.759238+0000","last_change":"2024-09-10T05:40:15.759115+0000","last_active":"2024-09-10T05:40:15.759238+0000","last_peered":"2024-09-10T05:40:15.759238+0000","last_clean":"2024-09-10T05:40:15.759238+0000","last_became_active":"2024-09-10T05:36:11.597158+0000","last_became_peered":"2024-09-10T05:36:11.597158+0000","last_unstale":"2024-09-10T05:40:15.759238+0000","last_undegraded":"2024-09-10T05:40:15.759238+0000","last_fullsized":"2024-09-10T05:40:15.759238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:15.758931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:15.758931+0000","last_clean_scrub_stamp":"2024-09-10T05:40:15.758931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:16.124076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:35.842058+0000","last_change":"2024-09-10T05:40:35.841896+0000","last_active":"2024-09-10T05:40:35.842058+0000","last_peered":"2024-09-10T05:40:35.842058+0000","last_clean":"2024-09-10T05:40:35.842058+0000","last_became_active":"2024-09-10T05:36:13.613206+0000","last_became_peered":"2024-09-10T05:36:13.613206+0000","last_unstale":"2024-09-10T05:40:35.842058+0000","last_undegraded":"2024-09-10T05:40:35.842058+0000","last_fullsized":"2024-09-10T05:40:35.842058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:35.841653+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:35.841653+0000","last_clean_scrub_stamp":"2024-09-10T05:40:35.841653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:12:38.162551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'2","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:16.993568+0000","last_change":"2024-09-10T05:40:16.993374+0000","last_active":"2024-09-10T05:40:16.993568+0000","last_peered":"2024-09-10T05:40:16.993568+0000","last_clean":"2024-09-10T05:40:16.993568+0000","last_became_active":"2024-09-10T05:36:52.705212+0000","last_became_peered":"2024-09-10T05:36:52.705212+0000","last_unstale":"2024-09-10T05:40:16.993568+0000","last_undegraded":"2024-09-10T05:40:16.993568+0000","last_fullsized":"2024-09-10T05:40:16.993568+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T05:40:16.993183+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T05:40:16.993183+0000","last_clean_scrub_stamp":"2024-09-10T05:40:16.993183+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:47:37.839890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"34'6","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:26.552621+0000","last_change":"2024-09-10T05:40:26.552418+0000","last_active":"2024-09-10T05:40:26.552621+0000","last_peered":"2024-09-10T05:40:26.552621+0000","last_clean":"2024-09-10T05:40:26.552621+0000","last_became_active":"2024-09-10T05:36:13.626912+0000","last_became_peered":"2024-09-10T05:36:13.626912+0000","last_unstale":"2024-09-10T05:40:26.552621+0000","last_undegraded":"2024-09-10T05:40:26.552621+0000","last_fullsized":"2024-09-10T05:40:26.552621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T05:40:26.552231+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T05:40:26.552231+0000","last_clean_scrub_stamp":"2024-09-10T05:40:26.552231+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:07:42.396989+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:24.386144+0000","last_change":"2024-09-10T05:40:24.386014+0000","last_active":"2024-09-10T05:40:24.386144+0000","last_peered":"2024-09-10T05:40:24.386144+0000","last_clean":"2024-09-10T05:40:24.386144+0000","last_became_active":"2024-09-10T05:36:11.606369+0000","last_became_peered":"2024-09-10T05:36:11.606369+0000","last_unstale":"2024-09-10T05:40:24.386144+0000","last_undegraded":"2024-09-10T05:40:24.386144+0000","last_fullsized":"2024-09-10T05:40:24.386144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:24.385801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:24.385801+0000","last_clean_scrub_stamp":"2024-09-10T05:40:24.385801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:48.821098+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"32'8","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:32.095285+0000","last_change":"2024-09-10T05:40:32.095140+0000","last_active":"2024-09-10T05:40:32.095285+0000","last_peered":"2024-09-10T05:40:32.095285+0000","last_clean":"2024-09-10T05:40:32.095285+0000","last_became_active":"2024-09-10T05:36:13.607807+0000","last_became_peered":"2024-09-10T05:36:13.607807+0000","last_unstale":"2024-09-10T05:40:32.095285+0000","last_undegraded":"2024-09-10T05:40:32.095285+0000","last_fullsized":"2024-09-10T05:40:32.095285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T05:40:32.094948+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T05:40:32.094948+0000","last_clean_scrub_stamp":"2024-09-10T05:40:32.094948+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:48.800391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:21.057945+0000","last_change":"2024-09-10T05:40:21.057801+0000","last_active":"2024-09-10T05:40:21.057945+0000","last_peered":"2024-09-10T05:40:21.057945+0000","last_clean":"2024-09-10T05:40:21.057945+0000","last_became_active":"2024-09-10T05:36:11.593962+0000","last_became_peered":"2024-09-10T05:36:11.593962+0000","last_unstale":"2024-09-10T05:40:21.057945+0000","last_undegraded":"2024-09-10T05:40:21.057945+0000","last_fullsized":"2024-09-10T05:40:21.057945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:21.057604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:21.057604+0000","last_clean_scrub_stamp":"2024-09-10T05:40:21.057604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:31:16.451869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:38.455689+0000","last_change":"2024-09-10T05:40:38.455536+0000","last_active":"2024-09-10T05:40:38.455689+0000","last_peered":"2024-09-10T05:40:38.455689+0000","last_clean":"2024-09-10T05:40:38.455689+0000","last_became_active":"2024-09-10T05:36:13.614155+0000","last_became_peered":"2024-09-10T05:36:13.614155+0000","last_unstale":"2024-09-10T05:40:38.455689+0000","last_undegraded":"2024-09-10T05:40:38.455689+0000","last_fullsized":"2024-09-10T05:40:38.455689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:38.455337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:38.455337+0000","last_clean_scrub_stamp":"2024-09-10T05:40:38.455337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:59:49.912552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:17.752534+0000","last_change":"2024-09-10T05:40:17.752385+0000","last_active":"2024-09-10T05:40:17.752534+0000","last_peered":"2024-09-10T05:40:17.752534+0000","last_clean":"2024-09-10T05:40:17.752534+0000","last_became_active":"2024-09-10T05:36:11.602866+0000","last_became_peered":"2024-09-10T05:36:11.602866+0000","last_unstale":"2024-09-10T05:40:17.752534+0000","last_undegraded":"2024-09-10T05:40:17.752534+0000","last_fullsized":"2024-09-10T05:40:17.752534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:17.752209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:17.752209+0000","last_clean_scrub_stamp":"2024-09-10T05:40:17.752209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:37:42.386692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'16","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:31.135884+0000","last_change":"2024-09-10T05:40:31.135746+0000","last_active":"2024-09-10T05:40:31.135884+0000","last_peered":"2024-09-10T05:40:31.135884+0000","last_clean":"2024-09-10T05:40:31.135884+0000","last_became_active":"2024-09-10T05:36:13.611391+0000","last_became_peered":"2024-09-10T05:36:13.611391+0000","last_unstale":"2024-09-10T05:40:31.135884+0000","last_undegraded":"2024-09-10T05:40:31.135884+0000","last_fullsized":"2024-09-10T05:40:31.135884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-10T05:40:31.135543+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-10T05:40:31.135543+0000","last_clean_scrub_stamp":"2024-09-10T05:40:31.135543+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:39:31.932855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:16.032889+0000","last_change":"2024-09-10T05:40:16.032739+0000","last_active":"2024-09-10T05:40:16.032889+0000","last_peered":"2024-09-10T05:40:16.032889+0000","last_clean":"2024-09-10T05:40:16.032889+0000","last_became_active":"2024-09-10T05:36:52.706226+0000","last_became_peered":"2024-09-10T05:36:52.706226+0000","last_unstale":"2024-09-10T05:40:16.032889+0000","last_undegraded":"2024-09-10T05:40:16.032889+0000","last_fullsized":"2024-09-10T05:40:16.032889+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:16.032561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:16.032561+0000","last_clean_scrub_stamp":"2024-09-10T05:40:16.032561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:29.267082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"34'10","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:37.810522+0000","last_change":"2024-09-10T05:40:37.810391+0000","last_active":"2024-09-10T05:40:37.810522+0000","last_peered":"2024-09-10T05:40:37.810522+0000","last_clean":"2024-09-10T05:40:37.810522+0000","last_became_active":"2024-09-10T05:36:13.616136+0000","last_became_peered":"2024-09-10T05:36:13.616136+0000","last_unstale":"2024-09-10T05:40:37.810522+0000","last_undegraded":"2024-09-10T05:40:37.810522+0000","last_fullsized":"2024-09-10T05:40:37.810522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-10T05:40:37.810174+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-10T05:40:37.810174+0000","last_clean_scrub_stamp":"2024-09-10T05:40:37.810174+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:00:30.777170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"32'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:11.568212+0000","last_change":"2024-09-10T05:40:11.568074+0000","last_active":"2024-09-10T05:40:11.568212+0000","last_peered":"2024-09-10T05:40:11.568212+0000","last_clean":"2024-09-10T05:40:11.568212+0000","last_became_active":"2024-09-10T05:36:11.600234+0000","last_became_peered":"2024-09-10T05:36:11.600234+0000","last_unstale":"2024-09-10T05:40:11.568212+0000","last_undegraded":"2024-09-10T05:40:11.568212+0000","last_fullsized":"2024-09-10T05:40:11.568212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T05:40:11.567892+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T05:40:11.567892+0000","last_clean_scrub_stamp":"2024-09-10T05:40:11.567892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:09:54.451468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"30'2","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:33.449784+0000","last_change":"2024-09-10T05:40:33.449784+0000","last_active":"2024-09-10T05:40:33.449784+0000","last_peered":"2024-09-10T05:40:33.449784+0000","last_clean":"2024-09-10T05:40:33.449784+0000","last_became_active":"2024-09-10T05:36:13.614098+0000","last_became_peered":"2024-09-10T05:36:13.614098+0000","last_unstale":"2024-09-10T05:40:33.449784+0000","last_undegraded":"2024-09-10T05:40:33.449784+0000","last_fullsized":"2024-09-10T05:40:33.449784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-10T05:40:33.449593+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-10T05:40:33.449593+0000","last_clean_scrub_stamp":"2024-09-10T05:40:33.449593+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:09.814056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"30'2","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:16.733078+0000","last_change":"2024-09-10T05:40:16.732918+0000","last_active":"2024-09-10T05:40:16.733078+0000","last_peered":"2024-09-10T05:40:16.733078+0000","last_clean":"2024-09-10T05:40:16.733078+0000","last_became_active":"2024-09-10T05:36:11.603972+0000","last_became_peered":"2024-09-10T05:36:11.603972+0000","last_unstale":"2024-09-10T05:40:16.733078+0000","last_undegraded":"2024-09-10T05:40:16.733078+0000","last_fullsized":"2024-09-10T05:40:16.733078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-10T05:40:16.732725+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-10T05:40:16.732725+0000","last_clean_scrub_stamp":"2024-09-10T05:40:16.732725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:45:48.371841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:27.383592+0000","last_change":"2024-09-10T05:40:27.383465+0000","last_active":"2024-09-10T05:40:27.383592+0000","last_peered":"2024-09-10T05:40:27.383592+0000","last_clean":"2024-09-10T05:40:27.383592+0000","last_became_active":"2024-09-10T05:36:11.595183+0000","last_became_peered":"2024-09-10T05:36:11.595183+0000","last_unstale":"2024-09-10T05:40:27.383592+0000","last_undegraded":"2024-09-10T05:40:27.383592+0000","last_fullsized":"2024-09-10T05:40:27.383592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:40:27.383240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:40:27.383240+0000","last_clean_scrub_stamp":"2024-09-10T05:40:27.383240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:00:27.997849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"34'8","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:27.569896+0000","last_change":"2024-09-10T05:40:27.569593+0000","last_active":"2024-09-10T05:40:27.569896+0000","last_peered":"2024-09-10T05:40:27.569896+0000","last_clean":"2024-09-10T05:40:27.569896+0000","last_became_active":"2024-09-10T05:36:13.622559+0000","last_became_peered":"2024-09-10T05:36:13.622559+0000","last_unstale":"2024-09-10T05:40:27.569896+0000","last_undegraded":"2024-09-10T05:40:27.569896+0000","last_fullsized":"2024-09-10T05:40:27.569896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-10T05:40:27.569380+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-10T05:40:27.569380+0000","last_clean_scrub_stamp":"2024-09-10T05:40:27.569380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:24:04.016693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"34'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:15.048986+0000","last_change":"2024-09-10T05:40:15.048760+0000","last_active":"2024-09-10T05:40:15.048986+0000","last_peered":"2024-09-10T05:40:15.048986+0000","last_clean":"2024-09-10T05:40:15.048986+0000","last_became_active":"2024-09-10T05:36:11.588124+0000","last_became_peered":"2024-09-10T05:36:11.588124+0000","last_unstale":"2024-09-10T05:40:15.048986+0000","last_undegraded":"2024-09-10T05:40:15.048986+0000","last_fullsized":"2024-09-10T05:40:15.048986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T05:40:15.048548+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T05:40:15.048548+0000","last_clean_scrub_stamp":"2024-09-10T05:40:15.048548+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:29:26.086020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"34'20","reported_seq":102,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T05:40:35.210765+0000","last_change":"2024-09-10T05:40:35.210598+0000","last_active":"2024-09-10T05:40:35.210765+0000","last_peered":"2024-09-10T05:40:35.210765+0000","last_clean":"2024-09-10T05:40:35.210765+0000","last_became_active":"2024-09-10T05:36:13.614959+0000","last_became_peered":"2024-09-10T05:36:13.614959+0000","last_unstale":"2024-09-10T05:40:35.210765+0000","last_undegraded":"2024-09-10T05:40:35.210765+0000","last_fullsized":"2024-09-10T05:40:35.210765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'20","last_scrub_stamp":"2024-09-10T05:40:35.210385+0000","last_deep_scrub":"34'20","last_deep_scrub_stamp":"2024-09-10T05:40:35.210385+0000","last_clean_scrub_stamp":"2024-09-10T05:40:35.210385+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:28:52.615497+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":56,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":692,"num_read_kb":660,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2288,"ondisk_log_size":2288,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1888,"num_read_kb":1653,"num_write":789,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1784,"ondisk_log_size":1784,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1683,"num_read_kb":1573,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":639872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640324,"num_pgs":142,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":442368,"data_stored":149023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673029,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40476,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331364,"statfs":{"total":96636764160,"available":96595316736,"internally_reserved":0,"allocated":995328,"data_stored":736555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673030,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40536,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331304,"statfs":{"total":96636764160,"available":96595255296,"internally_reserved":0,"allocated":1056768,"data_stored":738594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949673029,"num_pgs":143,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":487424,"data_stored":149680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":2712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":1788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T05:41:25.274 DEBUG:teuthology.orchestra.run.smithi002:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-10T05:41:25.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.428+0000 7f154bde3640 1 Processor -- start 2024-09-10T05:41:25.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.428+0000 7f154bde3640 1 -- start start 2024-09-10T05:41:25.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.428+0000 7f154bde3640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f154412be20 0x7f154412c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:41:25.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.428+0000 7f154bde3640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f154406df00 con 0x7f154409a190 2024-09-10T05:41:25.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.428+0000 7f154bde3640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f15440981a0 con 0x7f154412be20 2024-09-10T05:41:25.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.428+0000 7f1549b7f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f154412be20 0x7f154412c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:41:25.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.428+0000 7f1549b7f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f154412be20 0x7f154412c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60612/0 (socket says 172.21.15.2:60612) 2024-09-10T05:41:25.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.428+0000 7f1549b7f640 1 -- 172.21.15.2:0/374089864 learned_addr learned my addr 172.21.15.2:0/374089864 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:41:25.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.428+0000 7f1549b7f640 1 -- 172.21.15.2:0/374089864 >> v1:172.21.15.2:6789/0 conn(0x7f154409a190 legacy=0x7f154412ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T05:41:25.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.428+0000 7f1549b7f640 1 -- 172.21.15.2:0/374089864 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1544099b90 con 0x7f154412be20 2024-09-10T05:41:25.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.432+0000 7f1549b7f640 1 --2- 172.21.15.2:0/374089864 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f154412be20 0x7f154412c200 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f15400097f0 tx=0x7f154001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=134ba692ca1bb4f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:41:25.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.432+0000 7f1548b7d640 1 -- 172.21.15.2:0/374089864 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15400ab580 con 0x7f154412be20 2024-09-10T05:41:25.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.432+0000 7f1548b7d640 1 -- 172.21.15.2:0/374089864 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15400b0070 con 0x7f154412be20 2024-09-10T05:41:25.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.432+0000 7f1548b7d640 1 -- 172.21.15.2:0/374089864 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15400ab870 con 0x7f154412be20 2024-09-10T05:41:25.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.432+0000 7f154bde3640 1 -- 172.21.15.2:0/374089864 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f154412be20 msgr2=0x7f154412c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:41:25.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.432+0000 7f154bde3640 1 --2- 172.21.15.2:0/374089864 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f154412be20 0x7f154412c200 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f15400097f0 tx=0x7f154001c430 comp rx=0 tx=0).stop 2024-09-10T05:41:25.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.432+0000 7f154bde3640 1 -- 172.21.15.2:0/374089864 shutdown_connections 2024-09-10T05:41:25.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.432+0000 7f154bde3640 1 --2- 172.21.15.2:0/374089864 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f154412be20 0x7f154412c200 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:41:25.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.432+0000 7f154bde3640 1 -- 172.21.15.2:0/374089864 >> 172.21.15.2:0/374089864 conn(0x7f154409a930 msgr2=0x7f154409ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:41:25.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.432+0000 7f154bde3640 1 -- 172.21.15.2:0/374089864 shutdown_connections 2024-09-10T05:41:25.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.432+0000 7f154bde3640 1 -- 172.21.15.2:0/374089864 wait complete. 2024-09-10T05:41:25.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.432+0000 7f154bde3640 1 Processor -- start 2024-09-10T05:41:25.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.432+0000 7f154bde3640 1 -- start start 2024-09-10T05:41:25.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.432+0000 7f154bde3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f154409a190 0x7f1544129da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:41:25.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.432+0000 7f154bde3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f15441347e0 con 0x7f154409a190 2024-09-10T05:41:25.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.432+0000 7f1549b7f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f154409a190 0x7f1544129da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:41:25.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.432+0000 7f1549b7f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f154409a190 0x7f1544129da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60626/0 (socket says 172.21.15.2:60626) 2024-09-10T05:41:25.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.432+0000 7f1549b7f640 1 -- 172.21.15.2:0/1516994310 learned_addr learned my addr 172.21.15.2:0/1516994310 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T05:41:25.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.432+0000 7f1549b7f640 1 -- 172.21.15.2:0/1516994310 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1544127b50 con 0x7f154409a190 2024-09-10T05:41:25.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.432+0000 7f1549b7f640 1 --2- 172.21.15.2:0/1516994310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f154409a190 0x7f1544129da0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f154001a060 tx=0x7f154001ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:41:25.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.432+0000 7f153a7fc640 1 -- 172.21.15.2:0/1516994310 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15400be3f0 con 0x7f154409a190 2024-09-10T05:41:25.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.432+0000 7f153a7fc640 1 -- 172.21.15.2:0/1516994310 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15400be590 con 0x7f154409a190 2024-09-10T05:41:25.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.432+0000 7f154bde3640 1 -- 172.21.15.2:0/1516994310 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f154412ac60 con 0x7f154409a190 2024-09-10T05:41:25.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.432+0000 7f153a7fc640 1 -- 172.21.15.2:0/1516994310 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15400be890 con 0x7f154409a190 2024-09-10T05:41:25.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.432+0000 7f154bde3640 1 -- 172.21.15.2:0/1516994310 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1544129830 con 0x7f154409a190 2024-09-10T05:41:25.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.436+0000 7f154bde3640 1 -- 172.21.15.2:0/1516994310 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1544076880 con 0x7f154409a190 2024-09-10T05:41:25.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.436+0000 7f153a7fc640 1 -- 172.21.15.2:0/1516994310 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f15400c7440 con 0x7f154409a190 2024-09-10T05:41:25.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.436+0000 7f153a7fc640 1 --2- 172.21.15.2:0/1516994310 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f152803b1d0 0x7f152803d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:41:25.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.436+0000 7f153a7fc640 1 -- 172.21.15.2:0/1516994310 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6025+0+0 (secure 0 0 0) 0x7f15400ea050 con 0x7f154409a190 2024-09-10T05:41:25.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.436+0000 7f154937e640 1 --2- 172.21.15.2:0/1516994310 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f152803b1d0 0x7f152803d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:41:25.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.436+0000 7f154937e640 1 --2- 172.21.15.2:0/1516994310 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f152803b1d0 0x7f152803d690 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f154409a5a0 tx=0x7f1534007a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:41:25.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.440+0000 7f153a7fc640 1 -- 172.21.15.2:0/1516994310 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f15400160b0 con 0x7f154409a190 2024-09-10T05:41:25.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.608+0000 7f154bde3640 1 -- 172.21.15.2:0/1516994310 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f1544128ea0 con 0x7f154409a190 2024-09-10T05:41:25.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.612+0000 7f153a7fc640 1 -- 172.21.15.2:0/1516994310 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7f15400b43f0 con 0x7f154409a190 2024-09-10T05:41:25.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.612+0000 7f153a7fc640 1 -- 172.21.15.2:0/1516994310 <== mon.0 v2:172.21.15.2:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f15400b0020 con 0x7f154409a190 2024-09-10T05:41:25.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.616+0000 7f154bde3640 1 -- 172.21.15.2:0/1516994310 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f152803b1d0 msgr2=0x7f152803d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:41:25.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.616+0000 7f154bde3640 1 --2- 172.21.15.2:0/1516994310 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f152803b1d0 0x7f152803d690 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f154409a5a0 tx=0x7f1534007a00 comp rx=0 tx=0).stop 2024-09-10T05:41:25.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.616+0000 7f154bde3640 1 -- 172.21.15.2:0/1516994310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f154409a190 msgr2=0x7f1544129da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:41:25.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.616+0000 7f154bde3640 1 --2- 172.21.15.2:0/1516994310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f154409a190 0x7f1544129da0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f154001a060 tx=0x7f154001ac70 comp rx=0 tx=0).stop 2024-09-10T05:41:25.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.616+0000 7f154bde3640 1 -- 172.21.15.2:0/1516994310 shutdown_connections 2024-09-10T05:41:25.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.616+0000 7f154bde3640 1 --2- 172.21.15.2:0/1516994310 >> [v2:172.21.15.62:6824/3663628807,v1:172.21.15.62:6825/3663628807] conn(0x7f152803b1d0 0x7f152803d690 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:41:25.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.616+0000 7f154bde3640 1 --2- 172.21.15.2:0/1516994310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f154409a190 0x7f1544129da0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:41:25.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.616+0000 7f154bde3640 1 -- 172.21.15.2:0/1516994310 >> 172.21.15.2:0/1516994310 conn(0x7f154409a930 msgr2=0x7f1544131630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:41:25.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.616+0000 7f154bde3640 1 -- 172.21.15.2:0/1516994310 shutdown_connections 2024-09-10T05:41:25.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T05:41:25.616+0000 7f154bde3640 1 -- 172.21.15.2:0/1516994310 wait complete. 2024-09-10T05:41:25.636 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-10T05:41:25.636 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-10T05:41:25.636 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-10T05:41:25.636 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T05:41:25.715 INFO:tasks.ceph.osd.0:Stopped 2024-09-10T05:41:25.715 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-10T05:41:25.716 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T05:41:25.803 INFO:tasks.ceph.osd.1:Stopped 2024-09-10T05:41:25.804 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-10T05:41:25.804 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T05:41:29.542 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-09-10T05:41:31.905 INFO:tasks.ceph.osd.2:Stopped 2024-09-10T05:41:31.905 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-10T05:41:31.905 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T05:41:31.988 INFO:tasks.ceph.osd.3:Stopped 2024-09-10T05:41:31.988 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-10T05:41:31.988 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-10T05:41:31.988 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T05:41:32.019 INFO:tasks.ceph.mgr.x:Stopped 2024-09-10T05:41:32.020 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-10T05:41:32.020 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-10T05:41:32.020 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T05:41:32.045 INFO:tasks.ceph.mon.a:Stopped 2024-09-10T05:41:32.045 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-10T05:41:32.046 DEBUG:teuthology.orchestra.run.smithi002:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-09-10T05:41:32.104 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi002.front.sepia.ceph.com 2024-09-10T05:41:32.104 DEBUG:teuthology.orchestra.run.smithi002:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-10T05:41:32.329 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi062.front.sepia.ceph.com 2024-09-10T05:41:32.329 DEBUG:teuthology.orchestra.run.smithi062:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-10T05:41:32.531 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi062.front.sepia.ceph.com 2024-09-10T05:41:32.531 DEBUG:teuthology.orchestra.run.smithi062:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-10T05:41:32.736 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi062.front.sepia.ceph.com 2024-09-10T05:41:32.736 DEBUG:teuthology.orchestra.run.smithi062:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-10T05:41:32.902 INFO:tasks.ceph:Archiving mon data... 2024-09-10T05:41:32.903 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-09-10_03:21:45-rgw-wip-rgw-meta-handlers-distro-default-smithi/7898714/data/mon.a.tgz 2024-09-10T05:41:32.903 DEBUG:teuthology.orchestra.run.smithi002:> mktemp 2024-09-10T05:41:32.909 INFO:teuthology.orchestra.run.smithi002.stdout:/tmp/tmp.ql4DZprYui 2024-09-10T05:41:32.910 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.ql4DZprYui 2024-09-10T05:41:33.040 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0666 /tmp/tmp.ql4DZprYui 2024-09-10T05:41:33.103 DEBUG:teuthology.orchestra.remote:smithi002:/tmp/tmp.ql4DZprYui is 286KB 2024-09-10T05:41:33.165 DEBUG:teuthology.orchestra.run.smithi002:> rm -fr /tmp/tmp.ql4DZprYui 2024-09-10T05:41:33.170 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-10T05:41:33.170 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-10T05:41:33.216 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-10T05:41:33.276 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-10T05:41:33.281 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-10T05:41:33.281 INFO:tasks.ceph:Archiving crash dumps... 2024-09-10T05:41:33.283 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-10_03:21:45-rgw-wip-rgw-meta-handlers-distro-default-smithi/7898714/remote/smithi002/crash 2024-09-10T05:41:33.284 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-10T05:41:33.331 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-10_03:21:45-rgw-wip-rgw-meta-handlers-distro-default-smithi/7898714/remote/smithi062/crash 2024-09-10T05:41:33.332 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-10T05:41:33.346 INFO:tasks.ceph:Compressing logs... 2024-09-10T05:41:33.346 DEBUG:teuthology.orchestra.run.smithi002:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T05:41:33.376 DEBUG:teuthology.orchestra.run.smithi062:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T05:41:33.391 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24622.log 2024-09-10T05:41:33.391 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23721.log 2024-09-10T05:41:33.392 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.24622.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21366.log 2024-09-10T05:41:33.392 INFO:teuthology.orchestra.run.smithi002.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.24622.log.gz 2024-09-10T05:41:33.393 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.23721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23587.log 2024-09-10T05:41:33.393 INFO:teuthology.orchestra.run.smithi002.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.23721.log.gz 2024-09-10T05:41:33.394 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-10T05:41:33.394 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph.tmp-client.admin.21366.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.21366.log.gz 2024-09-10T05:41:33.394 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23914.log 2024-09-10T05:41:33.397 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.23587.log: /var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24540.log 2024-09-10T05:41:33.397 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.23914.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.23587.log.gz 2024-09-10T05:41:33.397 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24279.log 2024-09-10T05:41:33.397 INFO:teuthology.orchestra.run.smithi002.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.23914.log.gz 2024-09-10T05:41:33.397 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.24540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24596.log 2024-09-10T05:41:33.397 INFO:teuthology.orchestra.run.smithi002.stderr: 85.8%/var/log/ceph/ceph-client.admin.24279.log: -- replaced with /var/log/ceph/ceph-client.admin.24540.log.gz 2024-09-10T05:41:33.397 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24331.log 2024-09-10T05:41:33.397 INFO:teuthology.orchestra.run.smithi002.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.24279.log.gz 2024-09-10T05:41:33.397 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.24596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24019.log 2024-09-10T05:41:33.397 INFO:teuthology.orchestra.run.smithi002.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.24596.log.gz 2024-09-10T05:41:33.398 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.24331.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.24331.log.gz 2024-09-10T05:41:33.398 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24357.log 2024-09-10T05:41:33.401 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.24019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24163.log 2024-09-10T05:41:33.402 INFO:teuthology.orchestra.run.smithi002.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.24019.log.gz 2024-09-10T05:41:33.402 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.24357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24568.log 2024-09-10T05:41:33.402 INFO:teuthology.orchestra.run.smithi002.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.24357.log.gz 2024-09-10T05:41:33.402 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.24163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24111.log 2024-09-10T05:41:33.402 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.24568.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.24163.log.gz 2024-09-10T05:41:33.402 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23808.log 2024-09-10T05:41:33.402 INFO:teuthology.orchestra.run.smithi002.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.24568.log.gz 2024-09-10T05:41:33.402 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.24111.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-10T05:41:33.402 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.23808.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.24111.log.gz 2024-09-10T05:41:33.402 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24305.log 2024-09-10T05:41:33.402 INFO:teuthology.orchestra.run.smithi002.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.23808.log.gz 2024-09-10T05:41:33.403 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23773.log 2024-09-10T05:41:33.403 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.24305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24646.log 2024-09-10T05:41:33.403 INFO:teuthology.orchestra.run.smithi002.stderr: 86.9%/var/log/ceph/ceph-client.admin.23773.log: -- replaced with /var/log/ceph/ceph-client.admin.24305.log.gz 2024-09-10T05:41:33.403 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23675.log 2024-09-10T05:41:33.403 INFO:teuthology.orchestra.run.smithi002.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.23773.log.gz 2024-09-10T05:41:33.403 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23915.log 2024-09-10T05:41:33.403 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.24646.log: /var/log/ceph/ceph-client.admin.23675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22685.log 2024-09-10T05:41:33.403 INFO:teuthology.orchestra.run.smithi002.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.24646.log.gz 2024-09-10T05:41:33.408 INFO:teuthology.orchestra.run.smithi002.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.23675.log.gz 2024-09-10T05:41:33.408 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.23915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24435.log 2024-09-10T05:41:33.408 INFO:teuthology.orchestra.run.smithi002.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.23915.log.gz 2024-09-10T05:41:33.408 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.22685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24409.log 2024-09-10T05:41:33.408 INFO:teuthology.orchestra.run.smithi002.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.22685.log.gz 2024-09-10T05:41:33.408 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.24435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24227.log 2024-09-10T05:41:33.409 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.24409.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.24435.log.gz 2024-09-10T05:41:33.409 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24018.log 2024-09-10T05:41:33.409 INFO:teuthology.orchestra.run.smithi002.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.24409.log.gz 2024-09-10T05:41:33.409 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.24227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23650.log 2024-09-10T05:41:33.409 INFO:teuthology.orchestra.run.smithi002.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.24227.log.gz 2024-09-10T05:41:33.409 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.24018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23811.log 2024-09-10T05:41:33.409 INFO:teuthology.orchestra.run.smithi002.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.24018.log.gz 2024-09-10T05:41:33.409 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.23650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23903.log 2024-09-10T05:41:33.409 INFO:teuthology.orchestra.run.smithi002.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.23650.log.gz 2024-09-10T05:41:33.409 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.23811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23747.log 2024-09-10T05:41:33.409 INFO:teuthology.orchestra.run.smithi002.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.23811.log.gz 2024-09-10T05:41:33.409 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-10T05:41:33.410 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.23903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22726.log 2024-09-10T05:41:33.410 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.23747.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.23903.log.gz 2024-09-10T05:41:33.410 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph.log: 86.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.23747.log.gz 2024-09-10T05:41:33.410 INFO:teuthology.orchestra.run.smithi002.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.24513.log 2024-09-10T05:41:33.410 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.22726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22615.log 2024-09-10T05:41:33.410 INFO:teuthology.orchestra.run.smithi002.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.22726.log.gz 2024-09-10T05:41:33.410 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.24513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24201.log 2024-09-10T05:41:33.410 INFO:teuthology.orchestra.run.smithi002.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.24513.log.gz 2024-09-10T05:41:33.410 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.22615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24007.log 2024-09-10T05:41:33.421 INFO:teuthology.orchestra.run.smithi002.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.22615.log.gz 2024-09-10T05:41:33.421 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.24201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24487.log 2024-09-10T05:41:33.421 INFO:teuthology.orchestra.run.smithi002.stderr: 86.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-10T05:41:33.421 INFO:teuthology.orchestra.run.smithi002.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.24201.log.gz 2024-09-10T05:41:33.421 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.24007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23695.log 2024-09-10T05:41:33.421 INFO:teuthology.orchestra.run.smithi002.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.24007.log.gz 2024-09-10T05:41:33.421 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.24487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24137.log 2024-09-10T05:41:33.421 INFO:teuthology.orchestra.run.smithi002.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.24487.log.gz 2024-09-10T05:41:33.421 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.23695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24011.log 2024-09-10T05:41:33.421 INFO:teuthology.orchestra.run.smithi002.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.23695.log.gz 2024-09-10T05:41:33.422 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.24137.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-10T05:41:33.422 INFO:teuthology.orchestra.run.smithi002.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.24137.log.gz 2024-09-10T05:41:33.422 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24253.log 2024-09-10T05:41:33.422 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.24011.log: /var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23907.log 2024-09-10T05:41:33.422 INFO:teuthology.orchestra.run.smithi002.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.24011.log.gz 2024-09-10T05:41:33.422 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.24253.log: 88.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-10T05:41:33.422 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23809.log 2024-09-10T05:41:33.422 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.23907.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.24253.log.gz 2024-09-10T05:41:33.422 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24383.log 2024-09-10T05:41:33.422 INFO:teuthology.orchestra.run.smithi002.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.23907.log.gz 2024-09-10T05:41:33.422 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.23809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23810.log 2024-09-10T05:41:33.423 INFO:teuthology.orchestra.run.smithi002.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.23809.log.gz 2024-09-10T05:41:33.423 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.24383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23625.log 2024-09-10T05:41:33.423 INFO:teuthology.orchestra.run.smithi002.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.24383.log.gz 2024-09-10T05:41:33.423 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24461.log 2024-09-10T05:41:33.423 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.23810.log: /var/log/ceph/ceph-client.admin.23625.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.23625.log.gz 2024-09-10T05:41:33.423 INFO:teuthology.orchestra.run.smithi002.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.23810.log.gz 2024-09-10T05:41:33.423 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.24461.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.24461.log.gz 2024-09-10T05:41:33.438 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40098.log 2024-09-10T05:41:33.438 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-10T05:41:33.438 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.40098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28791.log 2024-09-10T05:41:33.438 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25091.log 2024-09-10T05:41:33.438 INFO:teuthology.orchestra.run.smithi062.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.40098.log.gz 2024-09-10T05:41:33.439 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.29484.log 2024-09-10T05:41:33.439 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.28791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30074.log 2024-09-10T05:41:33.439 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.25091.log: /var/log/ceph/ceph-client.0.29484.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.25091.log.gz 2024-09-10T05:41:33.439 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68418.log 2024-09-10T05:41:33.439 INFO:teuthology.orchestra.run.smithi062.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.28791.log.gz 2024-09-10T05:41:33.439 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.30074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41278.log 2024-09-10T05:41:33.439 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.68418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85500.log 2024-09-10T05:41:33.439 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.41278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48948.log 2024-09-10T05:41:33.439 INFO:teuthology.orchestra.run.smithi062.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.0.29484.log.gz 2024-09-10T05:41:33.439 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.85500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47768.log 2024-09-10T05:41:33.439 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.48948.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.30074.log.gz 2024-09-10T05:41:33.439 INFO:teuthology.orchestra.run.smithi062.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.68418.log.gz 2024-09-10T05:41:33.439 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34198.log 2024-09-10T05:41:33.440 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.47768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48358.log 2024-09-10T05:41:33.440 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.34198.log: 91.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86680.log 2024-09-10T05:41:33.440 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.0.41278.log.gz 2024-09-10T05:41:33.440 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.48358.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.48948.log.gz 2024-09-10T05:41:33.440 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37738.log 2024-09-10T05:41:33.440 INFO:teuthology.orchestra.run.smithi062.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.85500.log.gz 2024-09-10T05:41:33.440 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.86680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86090.log 2024-09-10T05:41:33.440 INFO:teuthology.orchestra.run.smithi062.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.47768.log.gz 2024-09-10T05:41:33.440 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.37738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76090.log 2024-09-10T05:41:33.440 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.86090.log: 91.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77848.log 2024-09-10T05:41:33.440 INFO:teuthology.orchestra.run.smithi062.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.48358.log.gz 2024-09-10T05:41:33.440 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.0.34198.log.gz 2024-09-10T05:41:33.440 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.76090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39508.log 2024-09-10T05:41:33.441 INFO:teuthology.orchestra.run.smithi062.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.86680.log.gz 2024-09-10T05:41:33.441 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.77848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70778.log 2024-09-10T05:41:33.441 INFO:teuthology.orchestra.run.smithi062.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.86090.log.gz 2024-09-10T05:41:33.441 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.39508.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.37738.log.gz 2024-09-10T05:41:33.441 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43048.log 2024-09-10T05:41:33.441 INFO:teuthology.orchestra.run.smithi062.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.0.77848.log.gz 2024-09-10T05:41:33.441 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.70778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71368.log 2024-09-10T05:41:33.441 INFO:teuthology.orchestra.run.smithi062.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.76090.log.gz 2024-09-10T05:41:33.441 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.43048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61928.log 2024-09-10T05:41:33.441 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.71368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36558.log 2024-09-10T05:41:33.441 INFO:teuthology.orchestra.run.smithi062.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.39508.log.gz 2024-09-10T05:41:33.441 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.61928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77264.log 2024-09-10T05:41:33.442 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.36558.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.43048.log.gz 2024-09-10T05:41:33.442 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47178.log 2024-09-10T05:41:33.442 INFO:teuthology.orchestra.run.smithi062.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.70778.log.gz 2024-09-10T05:41:33.442 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.77264.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-10T05:41:33.442 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.47178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53078.log 2024-09-10T05:41:33.442 INFO:teuthology.orchestra.run.smithi062.stderr: 91.2% 91.7% -- replaced with /var/log/ceph/ceph-client.0.77264.log.gz 2024-09-10T05:41:33.442 INFO:teuthology.orchestra.run.smithi062.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.36558.log.gz 2024-09-10T05:41:33.442 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43638.log 2024-09-10T05:41:33.442 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.0.71368.log.gz 2024-09-10T05:41:33.442 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28743.log 2024-09-10T05:41:33.442 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.53078.log: /var/log/ceph/ceph-client.0.43638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67828.log 2024-09-10T05:41:33.442 INFO:teuthology.orchestra.run.smithi062.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.0.61928.log.gz 2024-09-10T05:41:33.442 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.28743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37148.log 2024-09-10T05:41:33.443 INFO:teuthology.orchestra.run.smithi062.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.0.47178.log.gz 2024-09-10T05:41:33.443 INFO:teuthology.orchestra.run.smithi062.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.28743.log.gz 2024-09-10T05:41:33.443 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73138.log 2024-09-10T05:41:33.443 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.67828.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.53078.log.gz 2024-09-10T05:41:33.443 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.37148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83730.log 2024-09-10T05:41:33.443 INFO:teuthology.orchestra.run.smithi062.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.43638.log.gz 2024-09-10T05:41:33.443 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.73138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70188.log 2024-09-10T05:41:33.443 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.83730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60748.log 2024-09-10T05:41:33.443 INFO:teuthology.orchestra.run.smithi062.stderr: 91.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31844.log 2024-09-10T05:41:33.443 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.70188.log: -- replaced with /var/log/ceph/ceph-client.0.67828.log.gz 2024-09-10T05:41:33.443 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.60748.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.37148.log.gz 2024-09-10T05:41:33.443 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49538.log 2024-09-10T05:41:33.443 INFO:teuthology.orchestra.run.smithi062.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.83730.log.gz 2024-09-10T05:41:33.443 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.31844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74320.log 2024-09-10T05:41:33.444 INFO:teuthology.orchestra.run.smithi062.stderr:gzip/var/log/ceph/ceph-client.0.49538.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.28767.log 2024-09-10T05:41:33.444 INFO:teuthology.orchestra.run.smithi062.stderr: 91.6% 91.5% -- replaced with /var/log/ceph/ceph-client.0.70188.log.gz 2024-09-10T05:41:33.444 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.0.73138.log.gz/var/log/ceph/ceph-client.0.74320.log: 2024-09-10T05:41:33.444 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84320.log 2024-09-10T05:41:33.444 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.28767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31254.log 2024-09-10T05:41:33.444 INFO:teuthology.orchestra.run.smithi062.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.31844.log.gz 2024-09-10T05:41:33.444 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.84320.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.28767.log.gz 2024-09-10T05:41:33.444 INFO:teuthology.orchestra.run.smithi062.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.74320.log.gz 2024-09-10T05:41:33.444 INFO:teuthology.orchestra.run.smithi062.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.49538.log.gz 2024-09-10T05:41:33.444 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69008.log 2024-09-10T05:41:33.444 INFO:teuthology.orchestra.run.smithi062.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.0.60748.log.gz 2024-09-10T05:41:33.444 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84910.log 2024-09-10T05:41:33.445 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.31254.log: /var/log/ceph/ceph-client.0.69008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32434.log 2024-09-10T05:41:33.445 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.84910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74910.log 2024-09-10T05:41:33.445 INFO:teuthology.orchestra.run.smithi062.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.84320.log.gz 2024-09-10T05:41:33.445 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.32434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30664.log 2024-09-10T05:41:33.445 INFO:teuthology.orchestra.run.smithi062.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.69008.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.76680.log 2024-09-10T05:41:33.445 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-09-10T05:41:33.445 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.74910.log: 91.6%/var/log/ceph/ceph-client.0.30664.log: -- replaced with /var/log/ceph/ceph-client.0.31254.log.gz 90.7% -- replaced with /var/log/ceph/ceph-client.0.32434.log.gz 2024-09-10T05:41:33.445 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-09-10T05:41:33.445 INFO:teuthology.orchestra.run.smithi062.stderr: 91.3%gzip -- replaced with /var/log/ceph/ceph-client.0.84910.log.gz -5 2024-09-10T05:41:33.445 INFO:teuthology.orchestra.run.smithi062.stderr: --verbose -- /var/log/ceph/ceph-client.0.62518.log 2024-09-10T05:41:33.445 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.76680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87270.log 2024-09-10T05:41:33.446 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.62518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60158.log 2024-09-10T05:41:33.446 INFO:teuthology.orchestra.run.smithi062.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.0.76680.log.gz 2024-09-10T05:41:33.446 INFO:teuthology.orchestra.run.smithi062.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.74910.log.gz 2024-09-10T05:41:33.446 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.87270.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-10T05:41:33.446 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58978.log 2024-09-10T05:41:33.446 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.60158.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.30664.log.gz 2024-09-10T05:41:33.446 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72548.log 2024-09-10T05:41:33.446 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54258.log 2024-09-10T05:41:33.446 INFO:teuthology.orchestra.run.smithi062.stderr: 91.5%/var/log/ceph/ceph-client.0.58978.log: -- replaced with /var/log/ceph/ceph-client.0.62518.log.gz 2024-09-10T05:41:33.446 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.72548.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.87270.log.gz 2024-09-10T05:41:33.446 INFO:teuthology.orchestra.run.smithi062.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.60158.log.gz 2024-09-10T05:41:33.446 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64288.log 2024-09-10T05:41:33.447 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.54258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61338.log 2024-09-10T05:41:33.454 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.64288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45998.log 2024-09-10T05:41:33.454 INFO:teuthology.orchestra.run.smithi062.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.72548.log.gz/var/log/ceph/ceph-client.0.61338.log: 2024-09-10T05:41:33.454 INFO:teuthology.orchestra.run.smithi062.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.0.58978.log.gz 2024-09-10T05:41:33.454 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44228.log 2024-09-10T05:41:33.454 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-10T05:41:33.454 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.45998.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.54258.log.gz 2024-09-10T05:41:33.454 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.44228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66058.log 2024-09-10T05:41:33.454 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-osd.1.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.45998.log.gz 2024-09-10T05:41:33.454 INFO:teuthology.orchestra.run.smithi062.stderr: 91.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71958.log 2024-09-10T05:41:33.455 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.0.64288.log.gz 2024-09-10T05:41:33.455 INFO:teuthology.orchestra.run.smithi062.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.44228.log.gz 2024-09-10T05:41:33.455 INFO:teuthology.orchestra.run.smithi062.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.0.61338.log.gz 2024-09-10T05:41:33.455 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.66058.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.66058.log.gz 2024-09-10T05:41:33.455 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78432.log 2024-09-10T05:41:33.455 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.71958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38328.log 2024-09-10T05:41:33.455 INFO:teuthology.orchestra.run.smithi062.stderr:gzip/var/log/ceph/ceph-client.0.78432.log: -5 --verbose -- /var/log/ceph/ceph-client.0.81370.log 2024-09-10T05:41:33.455 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.38328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65468.log 2024-09-10T05:41:33.455 INFO:teuthology.orchestra.run.smithi062.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.0.78432.log.gz 2024-09-10T05:41:33.455 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.81370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56618.log 2024-09-10T05:41:33.455 INFO:teuthology.orchestra.run.smithi062.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.71958.log.gz 2024-09-10T05:41:33.455 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.65468.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-10T05:41:33.455 INFO:teuthology.orchestra.run.smithi062.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.38328.log.gz 2024-09-10T05:41:33.456 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.56618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25067.log 2024-09-10T05:41:33.456 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-mgr.x.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.81370.log.gz 2024-09-10T05:41:33.456 INFO:teuthology.orchestra.run.smithi062.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.65468.log.gz 2024-09-10T05:41:33.456 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82550.log 2024-09-10T05:41:33.456 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54848.log 2024-09-10T05:41:33.456 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.25067.log: 91.2%/var/log/ceph/ceph-client.0.82550.log: -- replaced with /var/log/ceph/ceph-client.0.56618.log.gz 2024-09-10T05:41:33.456 INFO:teuthology.orchestra.run.smithi062.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.25067.log.gz 2024-09-10T05:41:33.456 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73728.log 2024-09-10T05:41:33.456 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.54848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55438.log 2024-09-10T05:41:33.456 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.73728.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.82550.log.gz 2024-09-10T05:41:33.456 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87865.log 2024-09-10T05:41:33.456 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.55438.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.54848.log.gz 2024-09-10T05:41:33.456 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53668.log 2024-09-10T05:41:33.459 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.87865.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.73728.log.gz 2024-09-10T05:41:33.459 INFO:teuthology.orchestra.run.smithi062.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.55438.log.gz 2024-09-10T05:41:33.459 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41868.log 2024-09-10T05:41:33.459 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83140.log 2024-09-10T05:41:33.459 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.53668.log: /var/log/ceph/ceph-client.0.41868.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.41868.log.gz 2024-09-10T05:41:33.459 INFO:teuthology.orchestra.run.smithi062.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.53668.log.gz 2024-09-10T05:41:33.459 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45408.log 2024-09-10T05:41:33.459 INFO:teuthology.orchestra.run.smithi062.stderr: 93.4%/var/log/ceph/ceph-client.0.83140.log: -- replaced with /var/log/ceph/ceph-client.0.87865.log.gz 2024-09-10T05:41:33.460 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75500.log 2024-09-10T05:41:33.460 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.45408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81960.log 2024-09-10T05:41:33.461 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.75500.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.83140.log.gz 2024-09-10T05:41:33.461 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79016.log 2024-09-10T05:41:33.461 INFO:teuthology.orchestra.run.smithi062.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.45408.log.gz 2024-09-10T05:41:33.462 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.81960.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.75500.log.gz 2024-09-10T05:41:33.462 INFO:teuthology.orchestra.run.smithi062.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.81960.log.gz 2024-09-10T05:41:33.462 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50128.log 2024-09-10T05:41:33.464 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.79016.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-10T05:41:33.464 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.50128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66648.log 2024-09-10T05:41:33.464 INFO:teuthology.orchestra.run.smithi062.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.0.79016.log.gz 2024-09-10T05:41:33.466 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25019.log 2024-09-10T05:41:33.466 INFO:teuthology.orchestra.run.smithi062.stderr: 91.8% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-10T05:41:33.466 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.66648.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.50128.log.gz 2024-09-10T05:41:33.466 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33608.log 2024-09-10T05:41:33.466 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.25019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35968.log 2024-09-10T05:41:33.466 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.33608.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.25019.log.gz 2024-09-10T05:41:33.467 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35378.log 2024-09-10T05:41:33.467 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.35968.log: 91.9% -- replaced with /var/log/ceph/ceph-client.0.66648.log.gz 2024-09-10T05:41:33.467 INFO:teuthology.orchestra.run.smithi062.stderr:gzip 91.4% -- replaced with /var/log/ceph/ceph-client.0.33608.log.gz -5 2024-09-10T05:41:33.467 INFO:teuthology.orchestra.run.smithi062.stderr: --verbose -- /var/log/ceph/ceph-client.0.64878.log 2024-09-10T05:41:33.468 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.35378.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.35968.log.gz 2024-09-10T05:41:33.468 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50718.log 2024-09-10T05:41:33.469 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.64878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58388.log 2024-09-10T05:41:33.469 INFO:teuthology.orchestra.run.smithi062.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.35378.log.gz 2024-09-10T05:41:33.470 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.50718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51308.log 2024-09-10T05:41:33.472 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.58388.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.64878.log.gz 2024-09-10T05:41:33.472 INFO:teuthology.orchestra.run.smithi062.stderr: 92.2% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-10T05:41:33.472 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63108.log 2024-09-10T05:41:33.472 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.51308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57798.log 2024-09-10T05:41:33.472 INFO:teuthology.orchestra.run.smithi062.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.50718.log.gz 2024-09-10T05:41:33.472 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.63108.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.58388.log.gz 2024-09-10T05:41:33.472 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59568.log 2024-09-10T05:41:33.474 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33018.log 2024-09-10T05:41:33.474 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.57798.log: /var/log/ceph/ceph-client.0.59568.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.51308.log.gz 2024-09-10T05:41:33.474 INFO:teuthology.orchestra.run.smithi062.stderr:gzip 91.2% -5 -- replaced with /var/log/ceph/ceph-client.0.63108.log.gz --verbose 2024-09-10T05:41:33.474 INFO:teuthology.orchestra.run.smithi062.stderr: -- /var/log/ceph/ceph-client.0.52488.log 2024-09-10T05:41:33.474 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.33018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44818.log 2024-09-10T05:41:33.476 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.52488.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.59568.log.gz 2024-09-10T05:41:33.476 INFO:teuthology.orchestra.run.smithi062.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.57798.log.gz 2024-09-10T05:41:33.476 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80780.log 2024-09-10T05:41:33.476 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.44818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67238.log 2024-09-10T05:41:33.476 INFO:teuthology.orchestra.run.smithi062.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.0.33018.log.gz 2024-09-10T05:41:33.476 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.80780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28815.log 2024-09-10T05:41:33.476 INFO:teuthology.orchestra.run.smithi062.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.52488.log.gz 2024-09-10T05:41:33.479 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.67238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25043.log 2024-09-10T05:41:33.479 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.28815.log: 91.3% 86.7% -- replaced with /var/log/ceph/ceph-client.admin.28815.log.gz 2024-09-10T05:41:33.479 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.0.44818.log.gz 2024-09-10T05:41:33.479 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46588.log 2024-09-10T05:41:33.479 INFO:teuthology.orchestra.run.smithi062.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.80780.log.gz 2024-09-10T05:41:33.479 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.25043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42458.log 2024-09-10T05:41:33.479 INFO:teuthology.orchestra.run.smithi062.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.0.67238.log.gz 85.4% -- replaced with /var/log/ceph/ceph-client.admin.25043.log.gz 2024-09-10T05:41:33.480 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-09-10T05:41:33.480 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34788.log 2024-09-10T05:41:33.480 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.46588.log: /var/log/ceph/ceph-client.0.42458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38918.log 2024-09-10T05:41:33.480 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.34788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40688.log 2024-09-10T05:41:33.482 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.38918.log: 91.3% 91.6% -- replaced with /var/log/ceph/ceph-client.0.46588.log.gz 2024-09-10T05:41:33.482 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.0.42458.log.gz 2024-09-10T05:41:33.482 INFO:teuthology.orchestra.run.smithi062.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.34788.log.gz 2024-09-10T05:41:33.482 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56028.log 2024-09-10T05:41:33.482 INFO:teuthology.orchestra.run.smithi062.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.38918.log.gz 2024-09-10T05:41:33.482 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51898.log 2024-09-10T05:41:33.482 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.40688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79600.log 2024-09-10T05:41:33.482 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.56028.log: /var/log/ceph/ceph-client.0.51898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57208.log 2024-09-10T05:41:33.484 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.79600.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.40688.log.gz 2024-09-10T05:41:33.484 INFO:teuthology.orchestra.run.smithi062.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.56028.log.gz 2024-09-10T05:41:33.484 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69598.log 2024-09-10T05:41:33.484 INFO:teuthology.orchestra.run.smithi062.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.51898.log.gz 2024-09-10T05:41:33.485 INFO:teuthology.orchestra.run.smithi062.stderr:gzip 91.4% -- replaced with /var/log/ceph/ceph-client.0.79600.log.gz -5 2024-09-10T05:41:33.485 INFO:teuthology.orchestra.run.smithi062.stderr: --verbose -- /var/log/ceph/ceph-client.0.80190.log 2024-09-10T05:41:33.485 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.57208.log: /var/log/ceph/ceph-client.0.69598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63698.log 2024-09-10T05:41:33.486 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.80190.log: /var/log/ceph/ceph-client.0.63698.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.69598.log.gz 2024-09-10T05:41:33.486 INFO:teuthology.orchestra.run.smithi062.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.80190.log.gz 2024-09-10T05:41:33.486 INFO:teuthology.orchestra.run.smithi062.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.57208.log.gz 2024-09-10T05:41:33.486 INFO:teuthology.orchestra.run.smithi062.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.63698.log.gz 2024-09-10T05:41:33.506 INFO:teuthology.orchestra.run.smithi062.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-10T05:41:33.594 INFO:teuthology.orchestra.run.smithi002.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-10T05:41:34.230 INFO:teuthology.orchestra.run.smithi062.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-10T05:41:34.393 INFO:teuthology.orchestra.run.smithi062.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-10T05:41:34.445 INFO:teuthology.orchestra.run.smithi002.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-10T05:41:34.446 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-09-10T05:41:34.446 INFO:teuthology.orchestra.run.smithi002.stderr:real 0m1.069s 2024-09-10T05:41:34.447 INFO:teuthology.orchestra.run.smithi002.stderr:user 0m1.246s 2024-09-10T05:41:34.447 INFO:teuthology.orchestra.run.smithi002.stderr:sys 0m0.089s 2024-09-10T05:41:34.479 INFO:teuthology.orchestra.run.smithi062.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-10T05:41:34.481 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-09-10T05:41:34.481 INFO:teuthology.orchestra.run.smithi062.stderr:real 0m1.088s 2024-09-10T05:41:34.481 INFO:teuthology.orchestra.run.smithi062.stderr:user 0m3.064s 2024-09-10T05:41:34.481 INFO:teuthology.orchestra.run.smithi062.stderr:sys 0m0.160s 2024-09-10T05:41:34.481 INFO:tasks.ceph:Archiving logs... 2024-09-10T05:41:34.482 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-10_03:21:45-rgw-wip-rgw-meta-handlers-distro-default-smithi/7898714/remote/smithi002/log 2024-09-10T05:41:34.483 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T05:41:34.555 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-09-10T05:41:34.701 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-10_03:21:45-rgw-wip-rgw-meta-handlers-distro-default-smithi/7898714/remote/smithi062/log 2024-09-10T05:41:34.702 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T05:41:35.125 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-10T05:41:35.135 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-10T05:41:35.136 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T05:41:35.138 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T05:41:35.202 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-10T05:41:35.210 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-10T05:41:35.210 DEBUG:teuthology.orchestra.run.smithi002:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T05:41:35.213 DEBUG:teuthology.orchestra.run.smithi062:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T05:41:35.225 INFO:teuthology.orchestra.run.smithi002.stdout: remote refid st t when poll reach delay offset jitter 2024-09-10T05:41:35.225 INFO:teuthology.orchestra.run.smithi002.stdout:============================================================================== 2024-09-10T05:41:35.225 INFO:teuthology.orchestra.run.smithi002.stdout:+hv01.front.sepi 67.205.162.81 3 u 13 64 377 0.139 -1.244 0.832 2024-09-10T05:41:35.225 INFO:teuthology.orchestra.run.smithi002.stdout:*hv02.front.sepi 63.231.80.2 3 u 14 64 377 0.095 -0.966 0.826 2024-09-10T05:41:35.225 INFO:teuthology.orchestra.run.smithi002.stdout:+hv03.front.sepi 74.6.168.72 3 u 12 64 377 0.168 -0.888 0.860 2024-09-10T05:41:35.225 INFO:teuthology.orchestra.run.smithi002.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T05:41:35.227 INFO:teuthology.orchestra.run.smithi062.stdout: remote refid st t when poll reach delay offset jitter 2024-09-10T05:41:35.227 INFO:teuthology.orchestra.run.smithi062.stdout:============================================================================== 2024-09-10T05:41:35.227 INFO:teuthology.orchestra.run.smithi062.stdout:+hv01.front.sepi 67.205.162.81 3 u 12 64 377 0.095 -0.502 0.673 2024-09-10T05:41:35.227 INFO:teuthology.orchestra.run.smithi062.stdout:*hv02.front.sepi 63.231.80.2 3 u 17 64 377 0.080 -0.325 0.550 2024-09-10T05:41:35.227 INFO:teuthology.orchestra.run.smithi062.stdout:+hv03.front.sepi 74.6.168.72 3 u 7 64 377 0.078 -1.359 0.931 2024-09-10T05:41:35.228 INFO:teuthology.orchestra.run.smithi062.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T05:41:35.228 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-10T05:41:35.282 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-10T05:41:35.282 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-10T05:41:35.406 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-10T05:41:35.515 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-10T05:41:35.523 INFO:teuthology.task.internal:Duration was 940.618407 seconds 2024-09-10T05:41:35.523 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-10T05:41:35.532 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-10T05:41:35.532 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T05:41:35.535 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T05:41:35.574 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-10T05:41:35.574 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi002.front.sepia.ceph.com 2024-09-10T05:41:35.574 DEBUG:teuthology.orchestra.run.smithi002:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T05:41:35.624 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi062.front.sepia.ceph.com 2024-09-10T05:41:35.624 DEBUG:teuthology.orchestra.run.smithi062:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T05:41:35.634 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-10T05:41:35.634 DEBUG:teuthology.orchestra.run.smithi002:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T05:41:35.668 DEBUG:teuthology.orchestra.run.smithi062:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T05:41:35.704 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-10T05:41:35.705 DEBUG:teuthology.orchestra.run.smithi002:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T05:41:35.740 DEBUG:teuthology.orchestra.run.smithi062:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T05:41:35.802 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-10T05:41:35.812 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-10T05:41:35.813 DEBUG:teuthology.orchestra.run.smithi002:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T05:41:35.825 DEBUG:teuthology.orchestra.run.smithi062:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T05:41:35.839 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-10T05:41:35.850 DEBUG:teuthology.orchestra.run.smithi002:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T05:41:35.868 DEBUG:teuthology.orchestra.run.smithi062:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T05:41:35.877 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern = core 2024-09-10T05:41:35.892 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern = core 2024-09-10T05:41:35.916 DEBUG:teuthology.orchestra.run.smithi002:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T05:41:35.946 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T05:41:35.947 DEBUG:teuthology.orchestra.run.smithi062:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T05:41:35.960 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T05:41:35.961 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-10T05:41:35.981 INFO:teuthology.task.internal:Transferring archived files... 2024-09-10T05:41:35.982 DEBUG:teuthology.misc:Transferring archived files from smithi002:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-10_03:21:45-rgw-wip-rgw-meta-handlers-distro-default-smithi/7898714/remote/smithi002 2024-09-10T05:41:35.982 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T05:41:36.011 DEBUG:teuthology.misc:Transferring archived files from smithi062:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-10_03:21:45-rgw-wip-rgw-meta-handlers-distro-default-smithi/7898714/remote/smithi062 2024-09-10T05:41:36.011 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T05:41:36.032 INFO:teuthology.task.internal:Removing archive directory... 2024-09-10T05:41:36.033 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T05:41:36.051 DEBUG:teuthology.orchestra.run.smithi062:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T05:41:36.078 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-10T05:41:36.205 INFO:teuthology.task.internal:Not uploading archives. 2024-09-10T05:41:36.205 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-10T05:41:36.432 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-10T05:41:36.432 DEBUG:teuthology.orchestra.run.smithi002:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T05:41:36.434 DEBUG:teuthology.orchestra.run.smithi062:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T05:41:36.439 INFO:teuthology.orchestra.run.smithi002.stdout: 658641 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 05:41 /home/ubuntu/cephtest 2024-09-10T05:41:36.441 INFO:teuthology.orchestra.run.smithi062.stdout: 658610 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 05:41 /home/ubuntu/cephtest 2024-09-10T05:41:36.442 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-10T05:41:36.508 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-10T05:41:36.628 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{ubuntu_latest}} duration: 940.6184072494507 flavor: default owner: scheduled_cbodley@teuthology success: true 2024-09-10T05:41:36.628 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T05:41:36.696 INFO:teuthology.run:pass